Ok, I managed to save a previous render.. I had to fidle with the "compare image" thing at the bottom left, and once I found the one I wanted, it worked. I'd think though, that whatever you actually see in the render window would be saved...

Way too many people take way too many things way too seriously.