I found the same when my sub was close to the wall. Turning it slightly so it faced the center of the room helped. Moving it away from the wall helped even more. My guess is that the sound waves were reflecting and colliding off the wall, creating sounds and frequencies that were easier to localize.

It might help to recalibrate everything again, if you haven't done so.