Looks like you have a collision on the prop...lol. If you do, the cloth will suck to it like a magnet if it's close enough...lol. Remove the prop from the collisions ;). All you need it to collide with is the stuff it's directly touching: the figure, the floor, other clothes, etc.

Laurie