I don't know for sure, but I would suspect this issue is at least partially based on the number of polygons the shirt has.  I haven't done any tests, but I would like to know how a shirt with a much higher resolution mesh would act.

Dragontales