I tried the mini to RCA route and I had the same problem. Then, I bought a sound card with a digital output and the db level and sound quality improved dramatically. There's also no hum.

Eventually, I'm going to try an ethernet/optical adapter and bypass the sound card.