The shadow does: I could be wrong, but to me shadows seem to take up the most time. Even I've surpassed 35 hours for a render using soft shadows and volumetric world without even using premium render.