I'm sure you're going for low-key lighting, but as Lobo pointed out, you need more contrast. It's perfectly okay to add in lamps to HDRI lighting.

Also, brightening parts of the scene may help with render times.

It is better to do one thing well, than to do many things and excel at nothing.