You have "Inverse Kinesmatics" on... Go to Figure, and "Inverse Kinesmatics", and uncheck whatever is checked. Or, you could always move the hoof instead of the horse itself.

Remember, kids! Napalm is Nature's Toothpaste!