Is there is separate headphone settings? I never had a receiver or processor that did not have a separate "+/-" db to add or substract from the main volume.
The adapter seems to be the culprit as even at -60/-70 you would hear something. Not loud, but you would not mistake it for silence.

See Mojo's signature