If you're going this route, I would render a very crude low Poly HDRI, then render a decent backdrop of the room, then render all the furniture and people separate with just the floor as a shadow catcher.

-Kix