As long as the internal and external dimensions stay the same, it should not change the sound of the speaker.

I am actually toying with the idea of getting my speakers refinished.