I have not used a camera as an object for the eyes to point at but replicating your method also reproduces your problem. My usual method is to use a primitive such as a ball and have the eyes point at that, in which case everything moves properly. If you need the eyes to follow a particular camera, make the ball invisible and parent it to the camera you need. Hope that helps.