I personally would adjust the display, most sources dont actually have these sort of adjustments, Perhaps a few more modern models but whats originally intended is that you adjust the display. Also keep in mind that once you have your settings for a calibrated display, If your tv allows for different settings for differnt inputs you can set them all to the correct settings. While sources will differ on what display settings will be correct for calibration, at least you'll be in the ballpark.