I think it's more the lighting rigs and their shadow maps that slow it down. I have a complex lighting rig plus a couple of additionnal spot lights to create localised shadows. I find that those lighting rigs although making for nice renders tend to lack those normal shadows that object make.

Dominique Digital Cats Media