In my experience you should notice a difference even at lower volumes by adding a separate amp, but as you said the biggest difference is when you get to crank it up. I still haven't bought a separate amp despite my desire to get one, I just feel it to big a price to pay for the slight/but noticeable improvements. YMMV