Rather than risk ruining the finish on the speaker, I think if it were me, I'd just make a (painted) cover of some sort to block the reflections.

Half of communication is listening. You can't listen with your mouth.