No, you're not really wrong. The IK function is either on, or off. But you can turn IK on to assist in adjusting a pose at a specific keyframe, and then turn it off again once you're finished adjusting.