" ... the primitive isn't there anymore." Do you mean the primitive moves around? Or it disappears? Or?

When you save an animation to the pose folder, you can control what elements are saved with it.