Mark, no, as long as the sets are matched within themselves, you're fine. In other words, if the system uses triple channel RAM, you'll want to use 3 of the same kind, but the next 3 can be of a different kind.

I am the Doctor, and THIS... is my SPOON!