just to say, i've never had that happen even when i didn't have a separate group for the hem (which is my standard practice). in fact, i've seen others manage soft body dynamics on items that were as thick as average objects.  what are your simulation settings?  do you have self-collisions on?.