It's good to know you've already experimented with this. My 500s are currently on the inside. I am still concerned though because ray tracing tells me the listening window curve will be affected. The backs of my actives are 3 feet from the front wall.

House of the Rising Sone
Out in the mid or far field
Dedicated mid-woofers are over-rated