If you have lights beside daylight in your scene, then enenabling soft shadows or edge softness enabled in light lab, it will bump up your render time like the premium fx soft shadow settings. Also, in many images your can get away with a lot less than 64 rays per pixel.