Not necessarily, but it depends on what kind of car they're racing. F1 drivers are all extremely slim, but I don't know if they're height limited or not. Sports car drivers in general have a lot more flexibility and you frequently see endurance drivers switching seat inserts when they switch drivers.

I am the Doctor, and THIS... is my SPOON!