I would guess that cranking up the photon count and accuracy will remove more of the noise. I would reason that the lower the number on those two settings, the more guesswork is going on, somewhere in the process. As they lengthen the render time (even more...), there must be some heavy calculation going on.

Regards!
Hoof