The solution is just to add your own light to the scene, change it to diffuse IBL, then add your IBL image to it in the material room manually. Then you can have shadow maps on that IBL with no AO.

Alternatively you can load a default P6 light over-the-top (to replace) an existing light that already has a shadow camera attached, which permits the light to render with depth map shadows enabled.