I suggest you look again at 2D film. Maybe it's so natural you're not noticing it, but most movies make use of depth of field (DoF) to direct the eye. Where the background is out of focus, but the subject is sharp.
In the real world the eye auto focuses rapidly to what you're actually looking at. But the forced focus plus depth information in 3D films is totally wrong, and is more than likely what you're seeing. Ideally 3D films would be shot like the live action Speed Racer movie, with everything in sharp focus, then the director could direct the eyes using depth cues. That's how holographic movies will work.
