Have you tried the constrained setting, and click 'add all'? I have done that with body suits and the like that I didn't want to drape and lose their shape during the cloth sim. It might work for this.

If I had a nickle for ever time a woman told me to get lost, I could buy Manhattan.