I fiddled around with a local installation of stable diffusion (automatic 1111). It's easy to create depth-maps in firefly. One can feed the depth-map to stable diffusion and use the ai as a renderer, which works quite well.