You must plug the transparancy map into the VALUE channel of ANY and ALL active specular, reflection or refraction channels in order to totally eliminate the ghost effect. And Kiera is correct that if the black in the transmap is not RGB 0,0,0 then you might still see some effect.