On the Preview lights, if you study them closely, each light is designated as an infinite light, but in the Material Room, the light node has extra channels that the actual infinite light does not have.  Those lights are actually Point lights redesignated into Infinite lights.  When you connect a color node to the light, it ignores that connection in preview but activates it in the render.  In this particular case, rendering black will show no lighting.