If I'm not mistaken, Night Mode compresses the dynamic range so you can hear all of the detail without having the volume up too loud, so you can listen at night without disturbing others. So, as a rule, you want night mode off.