Everything should be easy to reach, and the buttons should have enough space between them for you to find them by touch without accidentally pressing multiple buttons. The controller should also feel substantial but not so heavy that it causes arm and wrist fatigue.
Comfort: Regardless of your hand size, you should be able to hold the controller for a couple of hours without cramping, and it shouldn’t slip around if your hands get sweaty.