Your receiver could very quickly overheat and fry, because it likely doesn't have the heatsinks or protection circuits necessary to deal with the excess current driving 4 ohm speakers.

This isn't to say it will happen, but I wouldn't take the chance.