Since you have plenty of memory, I'd recommend increasing the bucket size (in Render Options) to at least 64 or 128, rather than the default of 32. This may speed up your renders, and will almost certainly speed up shadow-map calculations.