Saturn,

I don't see any issues/problems using an external selector switch like the one you linked. Just in case, I would re-confirm that the switch is an open-before-connect design (which all source selector switches should be).