~Beach Ball~ by Ken1171_Designs
Open full image in new tab Members remain the original copyright holder in all their materials here at Renderosity. Use of any of their material inconsistent with the terms and conditions set forth is prohibited and is considered an infringement of the copyrights of the respective holders unless specially stated otherwise.
Description
~Beach Ball~
While aiming to get exactly the pose I want in my AI images, I have expanded my 3D-to-AI workflow to now include a depth map! My OpenPose plugin is used in Poser to extract and export the 3D OpenPose image, and I run a 2nd pass to render a scene depth map. I then feed ControlNet with both maps (OpenPose + Depth), which allows me to place extra objects in the scene, in this case, the beach ball, with the girl kneeling over it exactly as I wanted. My prompt said there was a beach ball in the scene, and the AI looked at the depth map in ControlNet, and understood the size and placement extracted from it.
This also helps disambiguating OP poses where limbs overlap with the body, like the hand over the chest, and foot over the shin. This also helps the AI to understand what side the character is facing, which can often be ambiguous when dealing with OP stick figure representations from OpenPose.
One side-effect is that the depth map may impose the hairless naked 3D model I used to create the pose, but this can be easily helped by reducing the depth map weight to values as low as 10-15% in ControlNet, allowing the AI to fill in the blanks with whatever I prompt.
This OP+Depth workflow allows me to add objects from my 3D Poser scene to the AI image that match the character pose, size, and placement, while removing the pesky pose and orientation ambiguities that often emerge when dealing with OP stick figures. 3D pose and camera set in Poser with my OpenPose plugin, rendered in Stable Diffusion, postwork in PaintShop.
Comments (5)
poser4me Online Now!
Wow this Is great! Excellent work flow.
Ken1171_Designs
Thank you! The depth map helps a lot. ^^
cblueyes
Super pinup 😊🌷👍
Ken1171_Designs
Thank you! This new workflow will allow for better compositions with objects in the scene. ^^
shadelix
The description sounds rather comlex to me, but the result is great.
Ken1171_Designs
Thank you! I started with just ball, but now I have used entire 3D scenes in Poser, and it works just as well. Now I can bring not only the poses, but entire 3D scenes in SD. It also helps removing OP poses ambiguities, which was a problem before. I will be definitely using more of this in the future. ^^
Claywoman
Really nice! Thanks for explaining your workflow!
Ken1171_Designs
Thank you! I have been posting more examples of this workflow this week using full 3D scenes. ^^
RodS
Oh, my.... Where is this beach again?
Now this is how AI should be used - as part of the toolset and process of creating something. Fascinating description, and a gorgeous result!
Ken1171_Designs
Thank you! I have been expanding my 3D-to-AI workflows to give more control, where depth maps now allow me to render entire Poser scenes in AI, instead of just the character pose. ^^