Lewis, welcome. Allowing at least 3" of "breathing room" for rear ports is generally considered to be adequate so that no bad effect results. Although that shouldn't be a problem with what you propose, the "behind a fabric frame" part may be troublesome. Either the fabric or frame itself may absorb/diffract/reflect sound.

-----------------------------------

Enjoy the music, not the equipment.