The tube amp won't clip in the same manner as a solid state amp. I wouldn't be concerned about damaging the speakers with the tube amp.

However, you'll be drawing excessive plate current if your amp is not rated for 4Ohm speakers and you'll be replacing tubes frequently.