Since you said your settings are taking 40 minutes to render 50 frames, your settings are taking 48 seconds per frame and you are still getting grainy renders. When I use the OptiX preset, my renders took less than 3 seconds per frame, with no graininess. 

This is why I would like to see what your render settings are, and whether or not you are using OptiX.