If something is auto-loading it should be listed in Edit>Preferences>Start or Edit>Preferences>Scene (load on launch and load on File>New respectively). If you have items appearing in your viewport with nothing set to load then the issue is something else.