Yeah, that's pretty much what I did with the Vue renders.  The object with IBL/IDL looked mostly fine itself, oddly enough.  However, a wall waaaay in the background was producing flickering/spazzing shadows interestingly enough.  So I just rendered in two passes (got off easy on this one, eh?) and all was well.  There is some MINOR flicker on the object itself, but only noticeable because I am really looking for it.