Well my townhome room was a total afterthought and is really not insulated very well at all so it could be a lot of different things. I will try the foam insulation around the box and the weather stripping on the door. Hope its that easy...

It all matters.....just not that much.