Unless you use it in error in the middle of the night. I'm pretty sure he'll notice then.

Always call the place you live a house. When you're old, everyone else will call it a home.