Here is an interesting effect. I blended just the shadow from the IBL/AO to the point light render. Not realism obviously but a strange Wythe quality.