if you look at my room, you'll see that i can easily do both:
use the remote towards the rack at the left and do some changes by hand, as the rack is at arm's length.

for me, this arrangement is ideal.