You can close the "Animation Controls" palette in several ways (menu, keyboard shortcut, close button).
If you want to start up with it closed, you'll need to close it and make sure that the "Launch Behavior" option is set to "Launch to previous state" on the "Interface" tab of the preferences.

It also never hurts to set at least one "UI dot" for your preferred layout "just in case".