Distortion from an amplifier pushed into clipping will damage a speaker quicker than driving it with too much clean power.
It's very difficult to record a clipped signal and have it's DC component make it all the way to the speaker.
Say someone is overdriving a guitar amp. Guitar amps are usually mic'd, the microphone can't produce a DC signal, so it won't make it to the recording.
As you move up the chain, mic pre-amp, mixing board, mastering, it does become easier for a DC signal to end up on the the disc, but then there's playback.
It's just as hard to get a DC signal out of an amp (that isn't over driven) even if it appears in the music source.
Really the only place one has to worry about dangerous distortion from clipping is when it is being generated by the amplifier connected to the speakers. In a recording you'll only hear the harmonic components of said clipping.