There may be a sweet spot, but it varies according to mood, and also according to how loudly you've been listening lately.

Have you ever started up your car and couldn't believe how loudly you were listening to the stereo the last time you were in your car? Your ear/brain unit adjusts to loudness over time.