Automatic motion capture with Deepmotion and Blender
In this short video, DJ shows how he uses a new Deepmotion.com online service to turn a video of himself moving into an animated 3D character. To achieve this all you need is a smartphone with a camera to record yourself (or someone else) in motion and upload the video to 3d animate cloud on deepmotion’s webpage. You can get a free trial of Animate 3D here: deepmotion.com...
Animate 3D prepares an animated rig based on the video you upload. This is truly automatic motion capture! You can download the animations as fbx or bvh and import them to Blender or other 3d programs like 3dsMax, Maya, or Cinema 4D.
In this video DJ also shows the process of binding the rig with animations to a pre-made character from blender cloud (made by Andy Goralczyk). To do that you can use parenting with automatic weights. With only a few clicks you can have a 3d avatar repeating your moves!
Here are a few tips from Deepmotion on how to prepare the video to get best results:
- Keep the camera still and parallel to the subject
- Make the whole body visible
- Shoot the footage in neutral lighting and have a contrast between the subject and background
- The video can be maximum 60 seconds long and up to 50 MB size
- The character in the video should be the only thing visible and not occluded by any objects
- Wear possibly tight-fitting clothing (loose clothes that cover key joints might give worse results or errors)
This makes motion capture available for everyone and incredibly simple. With almost no skills in animation, you can make your 3d characters come to life! No mocap suit is required and you don’t even need any special markers for tracking.
#Mocap #BlenderAnimation #MotionCapture
👉 Facebook Group 👈
Join our group, a friendly space for Blender 3d enthusiasts and pros, to share tips, ask questions, and learn, learn learn! / 666797333683403
GREAT DEAL! 💸
Use the code 🏷️ GFACDMY 🏷️ while registering to get 💰 FREE 💰 $50 credits and render your projects - bit.ly/GarageFa...
If you're new to cloud rendering and would like to learn more, here's a great resource for you garagefarm.net...
Пікірлер: 130
This tutorial is priceless. Thank you for this video.
Holy moly I was not expecting this tool to be as good as is it is. It's a good thing I joined late on this tutorial as by the time I tried it they also added support for facial animations
I'll add that we can go into the animation and edit it in Blender to correct anything needed to be corrected like the hands etc... prior to rendering it out. Cool tutorial overall and very helpful for folks. Curated!
Wtf this feels like a cheat code to animating. This is THAT good!
Love how you jumped straight into the video. Did not waste a single minute of my time. Good job! 👍
great stuff! I had trouble transferring the animations while I was still learning blender so this is awesome to have :)
@kirishimarize9210
3 жыл бұрын
So... Are you a master of blender now?
@ultradarkbeast
10 ай бұрын
So now you're a master?
hi!! can i do this with the human generator add on instead of the charecter ?
Muy buen video simple y práctico . Seguí así no pares vas crecer mucho
I was confused. I used FBX bad. but finally I got BVH better. Thanks.
This is amazing!
It's funking awesome 😳😳😳😳
LOL, the eye balls became the other balls. Nice tuto. Thanks for sharing.
Thanks you sir
Thank you so much
@badmintonminishorts3770
3 жыл бұрын
kzread.info/dash/bejne/oat2y9mcfLaxj9o.html
Thank you so much!!!
@badmintonminishorts3770
3 жыл бұрын
kzread.info/dash/bejne/oat2y9mcfLaxj9o.html
Thank you for showing the whole animation process in a very nice shortcut way and by doing this if we set sequence after sequence then it is possible to make a short film. 🙂🙂
@RonaldoSSilva-tn8kp
Жыл бұрын
Really amazing tutorial, thank you very much 🙏💕
very powerful tool
Thank you so much I can't wait to try it! This will really save time especially for someone who is very busy like me.
can you please make a follow up video where you fine tune the animation, like your hand shapes when they touched, and fingers etc. great tutorial btw
Website registration is troublesome and requires payment and approval
I dont think it can transfer the character running or walking.....That is a big issue for studio.
1:37 May i know how to insert that character ? And how can i use my own character ?
Can this be used for tracking characters from tv shows where the view and motions may not be big and clear?
all is good, but size 50 Mb.....how is that with high quality ????
Thanks for the help but there is one question, if your still replying to this video, how did you only set the model to wire frame?
hi wanted to know weather lip sync is possible in deep motion ?
bone heating fail problem
If we wanted to do real time then?
very sweet thank you !!! OoO
After I animate the character on blender how do I make an MP4 green screen video out of that? Thank you for taking the time to read
great! Once I recorded the animation can I export the FBX directly to unity?
@DeepMotionInc
3 жыл бұрын
absolutely you can export the .FBX, and the .GLB, and the .BVH
@BornthrupiecesEntertainment
Жыл бұрын
I think it uses the standard bones, will try it out soon
what do I do if I can't move or edit the BVH rig if I set it to "Rest Pose" ?
I have tried to upload the video to deepmotion but it always stuck on 10-15%.
@DeepMotionInc
3 жыл бұрын
Thank you for reporting, please send your video and the problem to support@deepmotion.com and we'll help you there.
which type of mobile we want use for a facial motion capture pls comment mobiles name too pls bro
@pekame
3 жыл бұрын
iPhone X and above, there may be some android phones that work too
@DeepMotionInc
3 жыл бұрын
We just launched Face + Body tracking from a single video clip in Animate-3D v3.0: kzread.info/dash/bejne/gnue08Nsf5nVYc4.html
hi thx for the info
Which has a better end result quality? DEEOTION Pro or RADICAL Pro? :D
I can't sign in, it's stuck in signing in, could someone help me with the problem?
Dude, nice video!! But I don’t have a green screen. Is there anything else I can do?
@ionic_
3 жыл бұрын
Use a curtain or something
Can you modify the animations to be more accurate to the video after the upload?
@studiofoots8143
3 жыл бұрын
@@badmintonminishorts3770 Idiot
@DeepMotionInc
3 жыл бұрын
Yes you can polish the result animations in Blender.
Note for everyone: This program sucks ass when you aren't using a character model that is mirrored on both sides. I'm using a custom mesh that is disfigured and unbalanced and every time I run the animation after applying the parent weight, the mesh just implodes slightly so every limb clips through itself. No idea how to fix it so I've given up, but the advanced users can probably figure this out...
Any idea about body and facial motion both at same time?
@DeepMotionInc
3 жыл бұрын
We just launched Face + Body motion capture from a single video clip: kzread.info/dash/bejne/gnue08Nsf5nVYc4.html
@NipunShastri
3 жыл бұрын
@@DeepMotionInc That is awesome.!!
that means alot to me thanks sir
im trying to use the rig Rain but it's not working when I try to append. everytime i hit append nothing happens? nor do i have the same options as you under collections. what do i do?
how do i download it in a video file
how did you simplify the mesh?
this is for capture motion and i can export to source filmmaker ?
Was that live
Thank, tutorial it's veri good!
Am I able to make the animations, then port them into Unity, as a custom avatar?
The sign up web page is not working.
Thank you for the amazing tutorial! Extremely helpful. Can I use this for hyper real facial animation on a photo real human character that I already rigged?
@HarrisonKillianAnimation
2 жыл бұрын
@@garagefarmacademy thank you so much
Can it be with only a face
pudo usarlo con cinema ?
does this work on any mesh with armatures?
How do I make the movement loop?
Can you please put a video on face capturing like you do in this video🙄 can it be done?
@DeepMotionInc
3 жыл бұрын
We just launched Face + Body motion capture from a single video clip. Welcome to give it try: kzread.info/dash/bejne/gnue08Nsf5nVYc4.html Also look forward to a potential new tutorial from @GarageFarm.NET Academy for face capturing ! We really appreciate this tutorial video that is of great help to Blender users.
Can you use this with unity 3D and custom models?
como vc faz para deixa os bannes centralizados?
3 жыл бұрын
seleccione o esqueleto e entre no modo de edição
Deepmotion doesn't track the hands and fingers, or you set up the animation like that?
@DeepMotionInc
3 жыл бұрын
@@garagefarmacademy To clarify - we don't track the hands, we procedurally generate hand motions so it looks natural. Hand tracking is a bit further away on our dev roadmap!
@user-bs3jd2hj3z
3 жыл бұрын
@@DeepMotionInc Do you already have finger tracking for now? I need some animations with hand interaction
@SheheryarProductions
3 жыл бұрын
@@DeepMotionInc Please add hand and finger track along with body please! That would help alot
The virus program gives an alarm when I enter the web page?
Is it captureing fongers
hey pls could you tell me why the position changes when i toggle to object mode from edit and when i change to edit mode it changes the way i changed and when i change to object mode it becomes different
@chittibabuable
3 жыл бұрын
sorry i am always so hurried to do something i did not see that you changed it to pose mode rest position and then you edited it BTW thx
If I already have the rig on my character, how can i replace it with the animation rig from my bvh rig animation?
@misterformal2763
2 жыл бұрын
@FOX CRAFT what if I like my rig
is there a way to do this with faces? the character I want to make will usually not even be seen with her whole body but I want to animate her face
@raphaelmorgan2307
Жыл бұрын
@@garagefarmacademy thank you! I'll make sure to watch it!
Is the green scree must be used while making the video
Hi Brasil 🇧🇷
Yes... Now I don't have to spend $4k on a full body tracking suit.
can i use an already made rig with hands and face rigged (that i will eventually animate myself) with the program?
@conorsvfx
3 жыл бұрын
@@garagefarmacademy I have a similar question. Can I replace the relevant parts of my armature with the animated rig while keeping my hands so I can animate them after?
@DeepMotionInc
3 жыл бұрын
You need to provide the essential joints in the following FAQ. However your rig can have extra joints for hands and feet. We will add some simple procedural hand animations to the hand rigs in the result .FBX / .BVH, you can however replace them with your own hand animation in Blender during the post processing. In general, for all the joints besides those essential joints we will keep them in neutral/bind poses. blog.deepmotion.com/2020/11/19/animate-3d-custom-characters/
além do mas a qualidade da gravação ficou horrível
would the motion still work properly if you add kinematics to the armature?
@victoramona9190
3 жыл бұрын
kzread.info/dash/bejne/f4Z_1c2QqM_UY8o.html
1Lakh viewers 😱😱😱😱
Subscribed due to T-Pose meme.
Thank you so much
Thanks a lot.
i can get better mocap from 2 cameras and AI
shame it uses already like 20 of your free credits a month for 1 motion the tutorial is great though but for regular use you'd have to pay monthly for sure
where is the 3d view select option
It seems like a lot of these tutorials only capture one actor. Is there a tutorial for capturing multiple actors?
@williamweidner5425
3 жыл бұрын
@@garagefarmacademy ok. one other question, can this software track finger motion? like can digits be added to the armature in order to live track hand motions?
@DeepMotionInc
3 жыл бұрын
We are working on multiple actors capturing. It will take some time.
@DeepMotionInc
3 жыл бұрын
@@williamweidner5425 Not yet, but on our radar
The bvh is mangled on import....
sir is it free
Can we do facial expressions? Requesting for the rply.🙏
@jaroslawdzedzej
3 жыл бұрын
I guess animate 3d doesn't have that feature yet
@DeepMotionInc
3 жыл бұрын
We just launched Face + Body motion capture from a single video clip: kzread.info/dash/bejne/gnue08Nsf5nVYc4.html
Can we import the character also in this software ??
xbox 360 kinect are work in blender??
@mutanazublond4391
3 жыл бұрын
I have faceshift for you , if u want
Is the website shown at the beginning paid?
ou sou um retardado ou esse povinho que diz ensinar aqui via youtube fala e mostra as coisas rápido demas
every time I use dep motion the character is twisted beyond belief let alone use. Do you have any advice.
i heard D##K motion
100 bucks per month and the time you can capture isnt even limitless? are you kidding me?
I have learned that he is an adult male
🤗😇
We all know how this will be used.
monthly subscription. No thanks
is no accurate at all
can this software convert the final video to .webm or .mov with full transparency ?