No, you won't do any damage by making the connections backwards (out of phase), and you're correct in saying that it wouldn't sound right.

Glad to hear that you're pleased, thrilled even, with your decision.