Thank you all for the help.

I think that you are right. As Mojo said, the M2s are being pushed into their non-linear operating range leading to greater harmonic and intermodulation distortion. When I just keep it to low to medium volume, the busy content still sounds good.