Yes, you are right bigger diameter better ugh. But compromise is the crux of aviation. What if there is no room for big dia. props? Or the engine would spin them to fast and make the tips go supersonic and lose all efficiency? Or you have other concerns that require a reduction in dia.? So like you pointed out practical reasons or even not so practical reasons can win out.