But isn't radiosity related to the geometry of the scene? If the geometry hasn't moved then maybe the irradiance map wouldn't either. I thought that irradiance caching was designed for animations where the only thing moving was the camera.

I'll need to do a few tests obviously.