I agree. I don't have a fancy rotating speaker base - even near each other, the change in direction might give it away.
Other than that, though, I'll have 2nd blind person operate the A/B switch.