I usually try to keep my iTunes playlists managed by putting in a filter about "not played in the last 2 weeks" or somesuch. That tends to cut down on that sort of problem, at least.

I am the Doctor, and THIS... is my SPOON!