I've done some more tests and it seems to only do this when a complex figure is in the scene (ie. V4, Aiko, Ty2, millenium dragon etc.).

if its just a prop or primitive in the scene then there is no memory usage increase.