I have had the same issue before.  It's like sometimes when you resave your project (.car file) after removing objects, it doesn't completely remove them when it resaves so all the old junk that you think is gone, really isn't gone from the saved .car file.  So the next time you load it, it's slow and huge.