Hmmm. Perhaps it would work better if you created a separate simulation for each clothing item? Then you could have different collision targets for each clothing item, although it would take longer to set up as you'd have to calculate each simulation separately.