Real-time Full Body Webcam Mocap in Unreal Engine - Dollars MONO Tutorial
Ғылым және технология
Get ready to explore real-time full-body Metahuman motion capture using just a simple webcam in Unreal Engine! You might be thinking, 'What do you mean by full body?' Well, I mean face, fingers, and body - so yes, you heard it right, it's all possible with a single, simple webcam!
Join me for an in-depth review & tutorial of Dollars Mocap Mono. We'll go through its features together and I'll show you how to use your own Metahumans!
Download links:
● Dollars MONO - Unreal Engine Plugin - Control Rig for UE MetaHuman
www.dollarsmocap.com/download
● Sample Project
drive.google.com/u/0/uc?id=1E...
● Dollars EGAO (Free Facial Capture)
www.dollarsmocap.com/egao
● Dollars MoCap Documentation
docs.dollarsmocap.com/categor...
-----------------------------------------------------------------------------------
Chapters:
00:00 - What's Dollars Mocap Mono?
01:21 - Sample Project
02:18 - Features (Video Options)
03:37 - Features (MoCap Modes)
04:43 - Features (Facial Capture)
05:26 - Stream and Sensitivity Settings
07:10 - Part 1 : How to use your own Metahumans? (Body Capture)
10:17 - Part 2: How to use your own Metahumans? (Facial Capture)
14:18 - Conclusion
-----------------------------------------------------------------------------------
#unrealengine #mocap #metahuman #motioncapture #webcammocap #realtimemocap #metahumanmocap #dollarsmocap #dollarsmono #unrealenginetutorial #unrealengine5
Пікірлер: 105
This is strange. the downloads do not come in files with the file names in your video.
@duz_gen
3 ай бұрын
I've checked the updated files. Your downloaded files now look like this: "Dollars", "Dollars_Metahuman", "Dollars_MONO" The only change is the removal of the "DollarsMarkerlessUE" folder, and now this file downloads directly as "Dollars" In the video, I showed how to copy the "Dollars" folder from inside the "DollarsMarkerlessUE" folder into the "Content" folder. But now, things are simpler. The file directly downloads as "Dollars", so all you need to do is copy the "Dollars" and "Dollars_Metahuman" folders into the "Content" folder. Hope this helps!
Thank you for your coverage for this app. I really am thinking of starting to mocap soon and these kind of reviews of different products and services gives me a good idea about my options and price range.
@duz_gen
5 ай бұрын
awesome to hear it's helping you! you're welcome and best of luck as you dive into mocap 👍
really great bro, got it working by watching the vid a few times!
@duz_gen
4 ай бұрын
Glad it helped! if you run into any issues give me a shout
Thank you for the explanation!
Thanks for sharing this amazing tool
sweet, perfect timing as I start building our first public game next week. Perfect software for indies. Definitely going to purchase it. Thanks for bringing this into my attention :)
@duz_gen
5 ай бұрын
You're welcome and best of luck with your game. Happy new year! 🎉
Alot of companies are about to be put out of business. Most of us have been just trying to find some decent waist up mocap options. This including the face makes it beyond amazing. I purchased a license halfway through your video. Thanks!
@duz_gen
3 ай бұрын
Happy you liked it, good luck with your mocap projects!
I love the ability to shoot with a good camera and then doing the mocap in post.
@duz_gen
4 ай бұрын
Yes, the winner is video footage... much better results than a webcam and more suitable for mocap.
@pacificostudios
4 ай бұрын
@@duz_gen That's good to hear. When you already have good camera gear, it's nice to be able to take advantage of its features.
amazing lord, i love you for you tutorial i need this
@duz_gen
4 ай бұрын
thanks buddy, glad you like it!
Thank you for this insight! It would be also interesting to see how to integrate a custom made character (for exmaple in Character Creator 4) into this MoCap system. Character Creator 4 offers an Auto Setup for UE which already includes the rig for body and face. I wonder if Dollars MONO MoCap system is able to work with this.
@duz_gen
4 ай бұрын
You're welcome! I think what you're looking for is here kzread.info/dash/bejne/gHinzrFwmbzLpNI.html
nice i like it good work
good work but u can sync 3 camera in time for scan all pose from back and front and more camera for face reaction ?
@duz_gen
2 ай бұрын
It supports only 1 camera.
Any idea how to record an animation and finetune it? I got it on Take Recorder, but i cant edit it to perfect it. Any idea how to fix?
wehen i put the folders into my project folder and i open the project they are not visibable... the programm is working but i cant find the folders in the content browser
can we record the capture for a metahuman and then record another one for another character ?
Thanks for the video! This is very helpful. Did you do setting IPaddress etc for BP_DollarsReceiver?
@duz_gen
5 ай бұрын
You're welcome! No, I didn't. It's already set up, you don't have to manually enter the IP address for anything
thanks man
This is a great tutorial, thanks so much! The only bit I can't figure out is how to capture the mocap animations with take recorder and then get them onto my metahuman. How do you do this?
@duz_gen
3 ай бұрын
Glad you like it! You can use window > cinematics > take recorder Please take a look at this: kzread.info/dash/bejne/qqWI07mkYc27gZM.html
Is it possible to capture movement like playing guitar hanging on the strap? I mean when you're not 'playing' an invisible guitar, but really do precise movenets with your both hands and then add a 3d guitar into the scene?
@duz_gen
2 ай бұрын
It's good at tracking finger movements, as long as your webcam can see every finger. I'm not sure how well it would perform for activities like playing a guitar there could be potential problems.
can we use iPhone for Facial and Dollar for Body motions together ?
@duz_gen
2 ай бұрын
Yes, you can. Start by setting up a body mocap, then move on to a standard live link setup. If you want to get better performance for the body and head, just turn off the 'head rotation' option in the live link settings.
Does this mocap record information on spine? Or spin will be stiff?
@duz_gen
4 ай бұрын
Yes it does but the spine mocap data will be different depending on which mocap you choose because each mode captures the spine data differently.
the blueprint inside the dollar metahuman folder is throwing a ton of compile error for me :/
Is it possible to tweak the capchered data to enhance the quality ? Can you maybe make a tutorial on this??
@duz_gen
4 ай бұрын
Editing metahuman animations in the sequencer is possible but not straightforward. I'll consider your suggestion thanks
this is great, but there has to be a better way to set this up with your own metahuman than the process you described. if there's already a template project with it ready to go...no way to just migrate?
@duz_gen
4 ай бұрын
I was thinking about this idea while working on the video!😀 Tried changing a few files, thinking it should work but didn't get the result I wanted. Setting up body mocap is easy but when it comes to face mocap it takes a bit more time and seems a bit complicated. Perhaps dollars mocap might figure it out soon.
Hey your tutorials are amazing and very helpful for begginers like me 😄. I have a question, How can i composite metahuman animation in real life footage ? Like some of the virtual influencers do? I tried to search on whole internet but not able to find any tutorial on it, it will he very helpful if you make one of those 🙌🙌🙌
@duz_gen
4 ай бұрын
Thanks! glad you liked it 🙌 so when you say "real life footage" are you talking about those super realistic scenes and virtual influencers like codemiko? drop an example, I'll totally check it out!
@ayushkawalgaonkar2318
4 ай бұрын
@@duz_genI meant footage(video) recorded on phone or camera, like filmmakers make CGI and VFX effects and merge it with raw video, one of the example is @lilmiquela
@ayushkawalgaonkar2318
4 ай бұрын
@@duz_gen I mean footage (video MP4 format) captured through phone or camera. Like filmmakers add CGI and VFX effects in raw footage. One of the example is @lilmiquela you can check her posts and reels.
@duz_gen
3 ай бұрын
My guess is that she uses real people in her pics and puts her own face on them with photoshop. If I were a virtual influencer, I'd do the same thing. Creating everything in 3D and making it look photorealistic? Tough job. And check out her vids closely, those backgrounds aren't real spots, but 3D animations. She might be using Unreal Engine.
Was there not an option to move the mouth line onto your mouth position on screen? That could improve the capture and matching of your speaking and mouth expressions, no?
@duz_gen
3 ай бұрын
The mouth line is automatically adjusted by software, no tweaking allowed. In the new version, 'facial capture sensitivity' has been added, which improves the effectiveness of facial capture compared to the previous version.
While im first opennig the dollars mono app, the Unreal is OFF in the application, what should i do?
@itzarcade5141
Ай бұрын
same here what should i do?
@bochenkoo4794
Ай бұрын
@@itzarcade5141 found the solution, go to the settings in the app and check the box with unreal ip, hope it helps you
@bochenkoo4794
Ай бұрын
@@itzarcade5141 Found the solution, go to the settings in the app and check the box where it say Unreal, hope it helps
@bochenkoo4794
Ай бұрын
@@itzarcade5141 Check in the settings in the mocap app if you have checked the box where its says ,, Unreal,, hope it helps
step by step still having issues, how come some of the folders I download (name ones you did) have different names?
@duz_gen
3 ай бұрын
I've checked the updated files. Your downloaded files now look like this: "Dollars", "Dollars_Metahuman", "Dollars_MONO" Actually, the only change is the removal of the "DollarsMarkerlessUE" folder, and now this file downloads directly as "Dollars" In the tutorial, I showed how to copy the "Dollars" folder from inside the "DollarsMarkerlessUE" folder into the "Content" folder. But now, things are simpler. The file directly downloads as "Dollars", so all you need to do is copy the "Dollars" and "Dollars_Metahuman" folders into the "Content" folder. Hope this helps and let me know if you need help.
@TheLoreLabs
3 ай бұрын
thats amazing! it worked, purchased license through your link idk if youre an affiliate but just in case, definitely helped content creation for me today! @@duz_gen
@duz_gen
2 ай бұрын
So glad to hear that! I don’t have any affiliate links. Best of luck with your content creation!
What are your PC Specs to run UE that smooth ?
@duz_gen
4 ай бұрын
Nvidia 3090, ryzen 5950x, 64 gb ram. For setup and system requirements, please check at 14:52
Bro, which camera are using for motion capture?
@duz_gen
2 ай бұрын
I'm currently using the Creative Live 1080p V2 but don't like its narrow view. If you're looking for a wide-angle webcam, google it >> Spedal C920 Pro
@pks001
2 ай бұрын
@@duz_gen thanks bro
Is there a way to get the facial mocap data into Blender?
@duz_gen
2 ай бұрын
I'm not 100% on this, but if you save your facial mocap data in BVH format, I think you can totally bring it into Blender.
How does this work with Kinect? Facecap?
@duz_gen
3 ай бұрын
This one is for the webcams, but they have another software for Kinect called "Dollars DEEP"
gracias capo sos un genio!!!
@duz_gen
4 ай бұрын
Hey, muchas gracias, me alegra que te haya gustado. Saludos!
Which version of the Unreal Engine are you using?
@duz_gen
3 ай бұрын
Latest version (5.3.2)
Can I save the mocap animation?
@duz_gen
2 ай бұрын
Yes you can. Window > Cinematics > Take recorder Take a look at this: kzread.info/dash/bejne/qqWI07mkYc27gZM.html
God bless you
Whats the classical music name please
@duz_gen
2 ай бұрын
A Far Cry - Josef Suk, Serenade, Op 6
Is it a one time payment system or is it a monthly payment or annual payment system of $99?
@duz_gen
5 ай бұрын
It's one time payment
@conciousnessofsteel6033
5 ай бұрын
@@duz_gen wow thanks
@conciousnessofsteel6033
5 ай бұрын
I also noticed a control rig for Daz 3D. Do you have a video going over it?
@duz_gen
5 ай бұрын
@@conciousnessofsteel6033 My channel mainly focuses on Unreal Engine so I don't have any content related to Daz 3D
thank for the tutorial , The creator of this plugin should try to place some type of smoothing or some type of control of the speed of the animation in real time to have more control of the nervous movements. I wish he implemented this, it would be even better.
@duz_gen
4 ай бұрын
Great suggestion, thank you! Let's pass it on @dollarsmocap
Can i use it with blender?
@duz_gen
4 ай бұрын
Yes you can but there won't be any real-time integration. The only method for blender is to record the motion capture data as a BVH file and then edit the data in blender to create animations.
how to render this animation after mocap
@duz_gen
2 ай бұрын
Window > Cinematics > Take recorder take a look at this: kzread.info/dash/bejne/qqWI07mkYc27gZM.html
doing face animations and body animations separately has always made me very tired. i should definitely try this thanks
@duz_gen
5 ай бұрын
figuring out the best workflow can be a bit of trial and error. if you're using an iphone I recommend trying livelink + dollars mono. It's easy to set up and the results are pretty good
5 ай бұрын
@@duz_gen I will try. thank you for the advice
@zanderwhiton1235
5 ай бұрын
@@duz_gen Can you make a video trying livelink + dollars mono?
Please show in iClone if possible
@duz_gen
4 ай бұрын
Hi, hope this helps kzread.info/dash/bejne/hX9lksOsmtDdqps.html
the thumbnail 🤣🤣🤣face fingers body 🤣🤣🤣
💡🥳
I'm ready to kiss you, my friend, there is no limit to happiness, thank you very much, there is nothing in official documents about individual dollars folders, and files are downloaded without these folders. You are a great man, thank you a hundred more times.
bro you killed rokoko directly
@duz_gen
4 ай бұрын
Haha, i'm considering a vid on rokoko's mocap software to see if it's worth the $240/year price tag
@federicoest
4 ай бұрын
More than that, I'll skip buying a super expensive Iphone at the moment
why cant companies just use cameras and software's instead of having us spend thousands of dollars on freaking suits that could be a waste of money in the future
@duz_gen
4 ай бұрын
MOVE AI has a camera-based motion capture app going for $500/month and that's for the standard dual-camera package. The problem is it's pricey and you'll also need cameras or iPhones, starting with 5 cameras would be a good start. People seem to like it but I haven't tried it yet. I'm curious to know if it's as precise as the traditional mocap suits