I havent tried this so i dont know if it works or not but try holding down shift while your clicking.  I know while selecting/moving stuff holding down shift will keep it from changing actors.

My Homepage - Free stuff and Galleries