andygraph opened this issue on Dec 23, 2002 ยท 22 posts
andygraph posted Mon, 23 December 2002 at 9:36 PM
PabloS posted Mon, 23 December 2002 at 9:53 PM
I'm sorry. I can't figure out what your point is. Could you summarize?
andygraph posted Mon, 23 December 2002 at 10:02 PM
This is a my idea for create a software of mocap for face expression and lipsinc from footage (quicktime or avi) ! VISUALMARKERFACE or MOCAPFACE etc etc for MAC and PC but this is a idea and no a software .. i search a collaborator or collaborators for create togheter this software .. freeware, shareware, ? i dont know now ;-) but then UVmapper it would be the next cool software for poser Andygraph
wolf359 posted Mon, 23 December 2002 at 10:11 PM
will the shareware version come with a free a video camera and a PC/MAC capture card that can capture the footage??? By the time they have$$Bought all that they could have gotten mimic from daz and learned how to keyframe secondary facial expressions to go with the auto lipsynch generated by mimic
andygraph posted Mon, 23 December 2002 at 10:21 PM
the way cool of this idea is to would can take the expression face in "automatic mode" (with tracking 2D) from dates about markers position (face markers pose) from the library to you will can developed then ... Visualmarkerface would work with only map of markers in link with your personal morphtargets and labial morphs ! lipsinc dont take the expression from the actor but create only lipsinc from audio .. visualmarkerface would can make it take the expression face and labial from a 640x480 quicktime or avi source ! the position setup of the markers would be use for another sequences .. developed so your personal library expression face ;-) andygraph
JFStan posted Mon, 23 December 2002 at 11:32 PM
Although it's beyond my programming capability, I think this is an outstanding and very workable idea. You wouldn't need any expensive equipment, just a simple webcam would do nicely. You could record the dialogue (audio) while capturing the facial expression animation, and then use the recorded audio with mimic to create the lipsynch. This would result in perfectly synchronized facial animation. This two step process would be a huge time saver! Similar programs (that recognize data taken from a live video feed) already exist that, for example, allow you to juggle virtual objects and play virtual instruments. I don't think it would be a huge step to record the locations of reflective dots placed on one's face and translate them into varying degrees of morph dial settings. Andygraph, I'm all for this idea of yours.. I hope you find someone with the programming prowess to pull it off! Best of luck!! -=JFStan=-
andygraph posted Mon, 23 December 2002 at 11:47 PM
thx JFStan ;-)
ryamka posted Tue, 24 December 2002 at 1:21 AM
Um... Just to let you know, there IS such a program that works and is readily available for high-end apps. Look up Face Station (or some such variation of it... Facestation, etc.) We have it at work. i played with it a bit when it first came out. Does all that you show above, plus it has a feature like the Poser 5 Face Rooms, but implemented a lot better. - Ray
JFStan posted Tue, 24 December 2002 at 1:21 AM
It seems this idea has merit.. Check out this site: http://www.famous3d.com/animation/Products/proFACEvideo.html This software obviously isn't designed for Poser, plus it's very expensive, but it's the same idea. The Poser version could be much simpler, since the expression morphs already exist within the characters. It would simply measure the movement of the dots and apply a certain value to the morph dial(s) based on the distance (or direction) moved. It seems that head movement is also controlled with this software by using "stabilizing markers". This may add a degree of difficulty in programming such an application for Poser. The user might just have to hold his/her head still during the capture process. So, any developers out there want to tackle this?? :) -=JFStan=-
ryamka posted Tue, 24 December 2002 at 1:28 AM
Here is FaceStation: http://www.eyematic.com/products_facestation.html, price $1,995USD
andygraph posted Tue, 24 December 2002 at 1:31 AM
Visualmarkerface is a automatic tracking 2D software and it take the position markers from a 2D space (x/y coordinate) don't is need upload a mesh for work with it but is need only one footage ... ;-) to work in C++ about 3D markers maybe is more difficult .. but to work with 2D markers is more simple i believe .. Andygraph
andygraph posted Tue, 24 December 2002 at 1:32 AM
Facestation and famous3D are not for poser ... and the price is expencive
andygraph posted Tue, 24 December 2002 at 1:39 AM
Is need a mocap face software for poser for MACINTOSH and pc ;) to capture the expression and labial from footage with a save as PZ2 format .. this would can to be VisualMarkerFace or MocapFace or ... Andygraph
Jaqui posted Tue, 24 December 2002 at 7:14 AM
andygraph, great idea, unfortunately, to avoid complications with communicating with poser, thhis would need to be a poser plugin to work right. and CL is very protective of the data ( like global variable names they used ) needed to ensure it functioning right. it may be do-able in pythonscript, but then you are requiring pro pack or poser 5. a poser plugin would enhance all versions that the data was available to be able to port it to. ( and I doubt that CL is selling a SDK for anything prior to poser 5 any more )
andygraph posted Tue, 24 December 2002 at 10:44 AM
I have think about a standalone software for use it to another 3D software , lw, 3ds, etc etc and with another export file support ;-) for poser - pz2 is need for now know 2 things: 1) how make a AUTOMATIC multy tracking 2d 2) how write a pz2 or a fc2 file
Romanboy75 posted Tue, 24 December 2002 at 12:12 PM
I think it is a nice idea, but not practical for me. I would have to agree with Wolf359. It would really only take a few minutes to keyframe secondary facial expressions to go with the auto lipsynch generated by mimic, but with the the system you are suggesting it would take at least an hour for me just to set up the animation. Then after I created the animation I would still have to line up the audio track with the animation so that they would match perfectly. Too much work for me, but it would be a great idea if Mimic wasn't around.
I really do think it was a wonderful idea for people who do not want to buy Mimic.
andygraph posted Tue, 24 December 2002 at 12:18 PM
viualmarkerface would give a more professional mocap face solution .. about the time i dont agree with you because i would have need another time then have use mimic for give more expression on face to my character ;-) visualmarkerface would make a more cool work in little time Andygraph
JFStan posted Tue, 24 December 2002 at 12:36 PM
Romanboy, this program would be a companion to Mimic.. And since you could record the audio while capturing the expression and then use that with Mimic (as I mentioned in an earlier post), the synchronization of expression, speech and the audio track would be perfect and effortless. I really do believe this is an excellent idea. Andygraph, perhaps we should try to find programmers/developers in other forums who would like to take on the challenge.. What do you think? -=JFStan=-
andygraph posted Tue, 24 December 2002 at 12:49 PM
I agree with you JFStan .. can you help me ? Andygraph
JFStan posted Tue, 24 December 2002 at 1:07 PM
I'd be glad to, Andrea... I'll e-mail you soon and we can discuss our options. -=JFStan=-
madriver posted Tue, 24 December 2002 at 3:45 PM
I'm not a programmer but I purchased visual marker and like it. I would buy this visualmarkerface in a minute! Do it!
andygraph posted Tue, 24 December 2002 at 4:10 PM
i want it how you want too ;)