Clipping can damage speakers before it become audible. I don't know if I'd describe gross clipping as so much as a popping sound, maybe in low frequencies. But it's the tweeters you have to worry about the most. High frequency clipping is just more of a harshness, a fatiguing distortion. Really though, if you're hearing it you've already pushed the system too far.