Just tried again and discover that it seems to only work if I start draping from frame 1. From frame 2 onwards, whatever drape from there will get messed up. Above is an image of how it looks like when it is draping in frame 1 and frame 2.