Programs are supposed to clean up their temporary files when the program closes, but I'm not sure how well blender in particular does it.  If you have it set to the default system temporary directory, the operating system may also clean it up.  Personally, I've never had a problem with blender taking up too much space there, so I wouldn't worry about it too much.