To get a good fit on the female you have to model it around the female form and then modify it for the neuter form. To make a good fit for the male you have to go one step further and adjust it for the male form.

But time will tell. I think there will be an outcry for more "real" male clothing in a few months for precisely the reason I gave you

But you don't need my word for it - Check out the DAZ store for genesis clothing. How much can be worn by males (in "real" life of course, not as a joke)