Tebop, if you are using AO_IBL (which you didn't say you were), but no raytracing you will not get the proper shadows. 

Try your exact same image again with a stock AO_IBL and use raytracing.   

Just do it as an experiment.  Do it for me.  Please.  You will be surprised at the difference it makes.  

If you are worried about the time, do it and set it to render just before going to watch a TV show, or going to bed or something.  Just give it a try, post the new image and let us know what you think.