I believe when your center is set to small the sub plays both LFE AND the lower frequencies diverted from the center channel. The sub is then amplifying part of the center channel signal and sometimes it just isn't very good at the upper regions of that signal?
I don't know if I'm full of it or not, but I'm glad it worked for you!