Sounds like AVR clipping to me.

I run my medium grade Denon AVR (5.2) at -10 Db for most movies as it is just too loud for my medium size room. I can't imagine what +5 Db would be like & I would expect clipping up that high as well...

TAM