Animate MetaHuman Face with your Phone | Unreal Engine 5 Tutorial
Ойын-сауық
Step by step guide to animate the face of your MetaHuman using Live Link face app on your phone and Unreal Engine 5. Plus, we showed you how to fix one of the most common bugs in MetaHumans at the end ;)
This is part TWO of the series "Create your MetaHuman". In the upcoming days, we will post the next parts which includes customising Mesh, Texture, Hair and etc.
Timestamps:
00:00:00 Intro
00:01:00 Setup
00:01:43 Connecting Phone to UE5
00:04:01 Record Face Animation
00:06:31 BUG FIX - Detached hair
00:09:14 FIX missing hair
Day 69 our daily vlog 🎥
Join our discord server:
/ discord
If you wanna see us to do cool things follow us here too:
Instagram: / badxstudio
Twitter: / badxstudio
TikTok: / badxstudio
LinkedIn: / badxstudio
Bad Decisions Podcast 🎙️:
podcasters.spotify.com/pod/sh...
Our personal handles: (if you wanna stalk us)
/ farhad_sh
/ farazshababs
/ farhads__
/ farazshababi
/ farhadshababi
/ farazshababi
#unrealengine5 #ue5 #metahuman #livelink #faceanimation #metahumancreator #vancouver #blender3d #canada #blender #photogrammetry
Пікірлер: 229
Can you put the Pt.1 Pt.2 Pt.3 Etc. All in description
@badxstudio
11 ай бұрын
All the Metahuman Tutorials are in this Playlist kzread.info/head/PLIn-yd4vnXbjwxPNYeHz4Ac3le_zIZc-P
Great job guys, I was waiting for this video and now I am waiting for the third too.
@badxstudio
Жыл бұрын
Third one is coming soon this week ❤️❤️❤️
awesome!!! would love to see more content related to virtual production. especially on how to do it on a budget
@badxstudio
Жыл бұрын
That is a great idea! We definitely have that in the pipeline too so don’t worry it’s coming 😍
@violentpixelation5486
3 ай бұрын
@@badxstudio maybe you gonna use the VIVE Mars Camtrack System?! #Budget #VirtualProduction
It's eerie how every time I have a question the bois have answered it in a video published LIKE THAT SAME DAY 😇😎💥
@badxstudio
Жыл бұрын
SAMMM!!! ma man thank you for the love
You guys got me addicted to scanning people and turning them into Metahuman, and now I see this??! The journey continues 😂
@badxstudio
Жыл бұрын
Hahhahahahaah WE WANNA GET EVERYONE ADDICTED LETS GOOOO! Part 3 coming soon
@lewliteki
Жыл бұрын
@@badxstudio part 3?! Can’t wait!
@badxstudio
Жыл бұрын
@@lewliteki Lol Part 3: Customise mesh in blender part 4: Customise texture in substance part 5: Custom hair in blender part 6: Attach items to Metahuman (Hat/glasses) Part 7: Animate metahumans Part 8: To be announced :D
great tutorial details about solving the bugs and all. Really Appreciate it.
@badxstudio
Жыл бұрын
No worries ❤️❤️ glad you enjoyed it!!
Thank you very much! Just super, everything is simple and neat!!!👍👍👍
@badxstudio
Жыл бұрын
No worries at all ❤️ see you in part 3!!
Love the series so far! Will you have a video on creating custom hair not using the metahuman default hair styles?
@badxstudio
Жыл бұрын
Eventually yes! probably gonna try MetaHuman animator first and then customising the hair.
@olliegreen2307
Жыл бұрын
@@badxstudio Awesome! Yeah excited for you guys to do the animator!
I have subscribed you guys to keep it up. Never stop making these types of tutorial.
@badxstudio
10 ай бұрын
Brother thank you for your time and trust! We will KEEP MAKING VIDEOS! Thiis is full time for us :) :)
loved it. And subscribed 🤭 because the last sentence sounded like it was an order for me 🤣
@badxstudio
Жыл бұрын
Hahahahahah lol yeah we had to force people
Hey guys you are doing great stuff, making something educational with good sense of humour. I hope you get thousands of views which you deserve! Keep it up and all the best!
@badxstudio
Жыл бұрын
Wow thank you so much!! That means a lot we will keep workin to create cool shit for ya
Thank you very simple explaination
@badxstudio
Жыл бұрын
You are welcome 😍
You guys are awesome, you've earned a sub!
@badxstudio
11 ай бұрын
Heheheh thank u
Great content. Good job guys 🙌
@badxstudio
Жыл бұрын
Suzanneeeeee you know we love you right???
@Suzanne06
Жыл бұрын
@badxstudio You sure you don't have me confused with COFFEE? xD haha you guys are soooooo amazing 🩵
Brilliant guys
@badxstudio
Жыл бұрын
Cheers ❤️
I think it would've been a good idea to note Live Link is only available for Apple users with Iphone X and newer or Ipad Pro (3rd Generation or newer)
@user-gc1hg9sp9k
Жыл бұрын
its pretty sad that there isnt android version of this. Probably because there is no other phone that have a lidar sensor
Awesome vid. In case anyone had the issue of "hey, my head movement isn't tracked!?". Don't worry, in the livelink app on your iphone, click the gear in the top left of the screen and enable ' Stream Head Rotation'. Voila babbyyy
@badxstudio
Жыл бұрын
Thank you for that extra tip!
@MrKissmass
Жыл бұрын
i ctrl+f search 'head', i knew you will be here! cheers bro!
Amazing video guys. I love your chanel. Are you planing to do a video showing how to animate and/or import body animations to the Meta Humans? Is there some stock animations available for MH?
@badxstudio
11 ай бұрын
Thanks buddy, for sure will do it in future
This is really cool what you are doing I roam around in a wheelchair and i have just scanned myself so I'm going to walk around in the virtual space I have a question for animation the app that you use Is it available on android If not can you recommend another app
Before i try this what PC can i get to try this cos am using mini PC so can you tell me the pc to get??
Awesome, good job M F
Yesterday we create our metahuman with your first tutorial and it was great! I can send you some pictures if you want. Thank you a lot! ❤Just want to ask can we use android for this tutorial or it has to be an iPhone?
@badxstudio
Жыл бұрын
Ok first of all you are awesomeeee!! thank you for letting us know that the video actually helped. WE WOULD LOVE TO SEE THE RESULTS! yes pls send it in our discord: discord.gg/XZ3tD2Xf Also as for livelink that app is only available for iphone and Ipad with TRUDEPTH camera! For android you probably cant use livelink BUT there were videos of different work arounds to animate the metahuman face. Not sure what they are but we remember we saw videos before. You might wanna search that on youtube :)
Epic! But how do you animate the face and use mocap to animate the body movements at the same time?
@badxstudio
Жыл бұрын
Body mocap is coming in the upcoming episodes of this series so don't worry we gotchu
@tiagomaia.
11 ай бұрын
@@badxstudio WE CANT WAIT FOR IT!
Beautiful, I would like to know if I can create a face, a scenery, or a scene and then sell it as an NFT on a marketplace just like with any digital creation software.
So to get the voice you have to render out the sequence and add the voice track in post or can you add the voice track inside UE5?
Hi! Great tutorial but I have an issue in neck movement facial expression works fine but neck is not moving.
@badxstudio
11 ай бұрын
So in your livelink app go to settings and make sure NECK/HEAD Movement and rotation is ENABLED! If that doesnt work I realized just creating a new project in unreal works :)
Awesome tutorial!! still cant get the hair though, followed the steps and seemed like it should work. Other than that everything works great!
@badxstudio
11 ай бұрын
Glad that it helped ❤️❤️ whats the problem u faced with the hair?
Thank you for the video. What should I do if the rotation and the direction of the head are not reflected when I play back the recorded animation in the timeline? (Sometimes the neck keeps fixed although the motion of the face is successfully reflected)
@jafetnoriega8623
2 ай бұрын
I have an issue like that when export. the head moves on sequencer but not in the export
HELLO, i am having an issue where LOD are forced set to 1, but in the sequencer there is no hair showing up, thats on only 1 map , do you know why?
What if the Angelina metahuman stops following your movements one day and starts acting on its own. Looking forward for day 213 when that happens!
@farazshababi1
Жыл бұрын
Hahahaha dude we are gonna fken pin this comment in the video on day 213 when it happens bro
arkit has 50+ blendshapes but i know metahuman has more than 700. how do you gain control to the full range of motion locked in the model ?
Hey can you make a full tutorial where you create a short KZread video using just meta human.. by adding background and scene
@badxstudio
Жыл бұрын
yessss thats a dope idea! Will definitely do that in the upcoming days
Hi, so I followed all your steps one by one, double check and I have a problem, when I add the animation to the face on the sequences only the neck moves, but not the eyes, mouth or anything else, do you know why this could be happening?
hey you guys did what i wanted to learn, Thanks. but can you make a video on how can i make my character move (walk) so that i can create a story. cause character moving only head don't looks realistic. btw really appreciate your work.
@badxstudio
Жыл бұрын
Of course we can
@ShreyanshMehta-ov8ze
Жыл бұрын
@@badxstudio thanks i'll try this + wait for your updated video as well ❤
@badxstudio
Жыл бұрын
@@ShreyanshMehta-ov8ze Comin soon
Also, enable the Groom plugin, or your metahuman will be completly hairless, not only from distance. And, at least in my case, enablling the groom plugin after downloading the metahuman didn't work, I had to redownload the metahuman from Quixel Bridge after the groom plugin was enabled. That in 5.3.2 UE version. I have no idea about other versions.
عالی
@badxstudio
Жыл бұрын
Any Android alternatives for 3D scanning and exporting, and for Live Link?
When I try to add my Metahuman to the scene it only imports the materials, textures, etc but not the mesh
@badxstudio
Жыл бұрын
Hey we checked and dont know why thats happening
is there an Android version of the live link app, or do i need to go out and by an iphone just to do this?
Ive been wanting to do this but don't have an iPhone. Might try to borrow a friends My current project is low poly though so ill try it on my next one
@badxstudio
Жыл бұрын
Heyy so borrowing is a good idea since you can record it and give it back to your friend! Alternatively there are some other android solutions, other youtubers might have covered it so pls check it out
@Furiac.
Жыл бұрын
@@badxstudio didn't know about Android solutions. Ill definitely check it out THANK YOU
wow soo cool دمتون گرم خیلی حال می کنم ایرانی های مثل شما رو می بینم
@badxstudio
Жыл бұрын
Thanks a lot dadash 😍
hi! in 5.3 the hair dosent stick to the face, like beard when animating... Do you have a fix for that? Binding asset dont work , it wont apply and just disappears from the slot.
Hmm.... Apple only - grabbing some old iPhone with iOS 15.8 latest installable version: Live Link App needs at least iOS 16 :D Isn't there some alternative to do the same on your pc with a simple webcam?
This is a wonderful job, is it possible to do it with an Ipad?
@badxstudio
Жыл бұрын
Thanks a lot. The ipad must have a true depth camera. Only Ipad pro 3rd generation or newer ones currently have this
@guillermomontoya3382
Жыл бұрын
@@badxstudio I see, thanks for answering. I believe that feature is ONLY in the front camera for Iphones and Ipads, does that mean we can't scan animations with the rear camera?
I was able to do every thing fine, the sequencer plays de facial and head rotations, but, when i trie to render a cinematic, only the facial expressions move, not the head rotations.... What would be the probem. Thanks.
Bro please answer after this animate how to use hand animation i mean hand moving
Is there any way to do this with an Android phone?
Live link is not available for android ! what can I do ?
Does it works with iPad PRO? (with lidar sensors)
does this work with android phones?
I can't connect my iPhone to the live link, I put the same IP, submask and router and nothing, nothing appears on the live link! Could you help me?
Wow😂 , please can you create your own character or upload your own character inside the app?
@badxstudio
Жыл бұрын
Hey!! We are making our own character. Please check out our PART 1 that we uploaded a few weeks ago :)
@Abbaajihausatv1
Жыл бұрын
@@badxstudio please help me with the link
I’m having trouble connecting my iPhone. I’m on same network but it’s not working. Is there more plug-ins that I have to check? Thanks in advance
@badxstudio
Жыл бұрын
That's weird! It's hard to troubleshoot the problem like this. Since it's been a day already have you found a fix?
@TheWordandI
Жыл бұрын
@@badxstudio Yea my iPhone an SE. I need a X or better. Thanks anyway
Is there a way through Live Link being able to allow your character move its neck so it doesn’t look stiff?
@badxstudio
10 ай бұрын
You should have neck movement my man! Make sure in your livelink setting on your iphone turn on neck movement. ALso if that still doesnt work, start a new project in unreal and try it on your metahuman again. Anyways u shud probably check out our METAHUMAN ANIMATOR tutorial which has far better facial animation :)
head movement works but once i record it and put the animation in the sequencer the head movement doesnt work only eyes and mouth move
I can't import my custom Metahuman to UE5, I just click on Add, creates the folder but there is not mesh
@badxstudio
Жыл бұрын
Not sure why we're sorry
Yo Faraz you look like Adam Jones from TOOL a bit :D
@badxstudio
Жыл бұрын
Hahhahaha really? :D
@parasol222
Жыл бұрын
@@badxstudio not really, he looks like you! :D I really like yours channel
hairs??? LET'S GO
@badxstudio
Жыл бұрын
Lol hair is juust ONE of the upcoming tutorials :)
lol yeah so easy and no single word about detouching head problem and rotatation issue
What the app you use on phone
can it be put in a model game created by me?
Is there some similar app for android?
can you make a tutorial on custom body and custom clothes to meta Human
@badxstudio
11 ай бұрын
Yessssir! Will do ❤️
is this the new Face-Mocap technique, Epic Games showed at their show a few weeks ago?
@man4408
Жыл бұрын
no
@badxstudio
Жыл бұрын
No the new Animator update isnt out yet! But you bet we are going to cover the the second its out!!
@sheraixy
Жыл бұрын
@@badxstudio cool, therefore i leave a like and follow. Cant wait for it
What phone model is needed at the lowest price to work?
@badxstudio
Жыл бұрын
You need an iphone or ipad that has trudepth! So any of them that come with that ...
Hi, I did the whole thing but I do have a walking Animation Asset and a Face Animation but the movement of the Face and Body is not synced so the whole body appearance breaks and the face clips out of the body. Any ideas?
@badxstudio
Жыл бұрын
In your sequencer can you just move the track for the face animation to sit at the position you want. That should help manually sync it with the body movmeent. Let us know if that helped
@Lukimuc
Жыл бұрын
@@badxstudio it didn't help So what I did is that I used the method you described but recorded the body as well Then I changed the Body Movement to the Blueprint asset I recorded and the face movement (two separate animations created by this one recording). They should be synced because I tracked the body and face simultaneously... but it's slightly different (It's a scream animation and the face moves 1-2 seconds faster to the front than the body)
In next part tell us to import metahuman in blender please 🥺
@badxstudio
Жыл бұрын
That’s coming soon too! This week ❤️
@keeknation4674
8 ай бұрын
@@badxstudiopls
my characters head is not turning, what could be the problem?
Adipurush vfx artists watching this tutorials😂😂
@badxstudio
Жыл бұрын
Wait is that Adipurush the movie???
Then how do you move the body
I can’t get pasted Prepare for Performance. It just errors and says failed.
The facial tracking works but when I add the BP to sequencer the facial animations stop? Really strange
@badxstudio
11 ай бұрын
Can you elaborate more? maybe we can help fix it
Need help, I can't move the metahuman neck but rest is working perfectly.
But i don’t have the version that you have i have the new version of the app in that i can’t do this can you please do it in the new version of live link
@thomasdunn5211
4 ай бұрын
Make sure mode is set to "Live Link (ARKit)" or you won't see the live link target in settings.
excuse me.... when i import animation, head is not moving... only face moving. I dont know why.. HELP PLS
Cant get the neck joint to move, my mouth eyes and eyebrows move but no face rotation :(
@Diskokeisari
8 ай бұрын
same problem
can we able to make this with android instead of iPhone ????????????????????????????????????????????????
Is there any way to do this without Iphone? I only hv android.
@badxstudio
11 ай бұрын
Unfortunately not as of now
@hypherak47
11 ай бұрын
@@badxstudio ohk thanks. IG I need to start some side projects for marketplace :) RTX 3050 w 4gb vram is also not enough to run UE properly :/
holy cow i have to learn how to make an AR KIT FOR MY AKIDCALLEBEAST WTF
@badxstudio
Жыл бұрын
You know the blender FACEIT addon right?
@OUTTHEMUDVISUAL
Жыл бұрын
@@badxstudio 😯
@OUTTHEMUDVISUAL
Жыл бұрын
@@badxstudio I just saw a video on it I have to buy it !! Pretty crazy would be sick to use a trial of it to test it before I buy it to see if it’s possible to do it before I waste $100 🙃🔥 thanks broo
Title should be = Animate Metahuman with i Phone 🗿
Make videos using unity also sir
@badxstudio
Жыл бұрын
Dudeeee I wish we could right now butttt unfortunately our team is not well versed in Unity yet! I don't want us to come and talk about something we don't know much about. BUT we promise that over the course of our channel as we grow we will definitely be catering to the Unity audience too
Great Tutorial. I tried. But Mouth is not closing. Teeth visible even if i am closing mouth. What is the solution?
@badxstudio
10 ай бұрын
Thanks a lot For the 'Teeth' pose, you should make sure that the top and bottom teeth are together, with the back teeth meeting in a 'clench', and (likely) top teeth slightly overlapping the bottom teeth, and opening the lips so that the upper teeth tips are visible. In your pose, there was a small gap between top and bottom teeth, which can lead to slightly less accurate positioning of the teeth in the MetaHuman Identity, and therefore slightly less good quality of animation.
@anantarachuri5068
10 ай бұрын
Thank you for reply. 😊
is it possible to make if we only have human photos , HOW?
@badxstudio
11 ай бұрын
U can try a blender addon called FACEBUILDER from keentools :)
MF was personal so i sub
I dont have the same settings in Live link on my phone
@badxstudio
11 ай бұрын
What?? how come? Whats the difference?
@Jordanc87
11 ай бұрын
@@badxstudio I figured it out, just in a different place
Alternative for Android?
I'm not joking when I say that this tutorial can be made in under 2 minutes.
@badxstudio
Жыл бұрын
Yes and we have already done that :) we posted it as a shorts and insta and tiktok video! Some people couldnt follow the speed so we made a longer version
@flowpoi5864
Жыл бұрын
@@badxstudio yea and you made it just about long enough for what again? We both know it's not about the speed man. And we also both know why shorts exist lol.
can metahuman talk with a script we provide?
This app works whit blender ?
@badxstudio
Жыл бұрын
Which app my friend?
@sebastianodibusti
Жыл бұрын
@@badxstudio livelink 🙂🙌🏻
Ok, I've managed to import the face animation to the Metahuman and all plays ok in the sequencer, but when I export a render from it, it won't show the animation, only te Metahuman! What am I missing?
Does this only work with iPhones??? Is there an Android solution????
how can we import offline video in ue5.2
@badxstudio
10 ай бұрын
For offline video, you better use the MetaHuman Animato. We have a full tutorial here: kzread.info/dash/bejne/mo5mz82clJepZ7A.html&lc=Ugz9WDr_v81RhDVgzst4AaABAg
do you need an iphone to do this?
@badxstudio
11 ай бұрын
You need a supported IOS device so we believe some Ipads are supported too. We wished that android phones were supported but unfortunately many of android phones or maybe all (we are unsure) do not have a depth camera which MetaHuman Animator uses to calculate the super realistic performance and bake it into a sequence. But you can always consider how expensive or unattainable the other alternatives for such animation quality is .... any head gear can cost upwards of $5,000 to achieve similar qualities and can be a hurdle. If you really need this level of quality you can always consider buying a second hand iphone juust for this scenario. Just make sure the iphone/ipad you buy is supported by MHA
@ThePerceptionParadox
11 ай бұрын
@@badxstudio thank you for the quick reply and the tip about buying a second hand iphone. considering that this is free and the only cost to create these will be the cost of buying a second hand iphone is well worth it. I am still considering if I should wait till it becomes available on android (if it even does) or just buy the iphone. Love your content! Liked and subbed!
Man I must have done this 50 times and live link still doesnt connect. Ive putinthe ipv4 address exact but my iphone doesnt connect. Why?? All plugins are activated.
@jonos138
4 ай бұрын
Found out why. For anyone else who may have followed exactly how to connect but still can't. Go to your Windows network settings and make sure its set to private network and not public. This cured it for me. 😉👍
@badxstudio
4 ай бұрын
Glad you found the solution
If anyone is having a problem where the expressions + neck movement all work fine in the Take Recorder, but the neck movement stops working once you add the animation in Sequencer - open up the MetaHuman BP, select the 'Face' component on the left-hand side, then in Details, make sure Anim Class is set to ‘none’ for the character BP’s Face component.
@LoreDeco
10 ай бұрын
I am, the first time I used this tutorial it worked fine, now nothing works - if you ever find a fix please let me know! I am currently having a snoop so I'll do that same if I find the cause!
@LoreDeco
10 ай бұрын
I found the fix - go to the animation properties and make sure 'Force Custom Mode' is enabled.
@_technomo
10 ай бұрын
Thank you
@Ronggerr
7 ай бұрын
yes!!! I've been stuck here for almost a week, you've saved my life bro!!!!
Sad that live link is only available for apple and not android
@badxstudio
Жыл бұрын
I know :(( Listen can you check youtube for android alternatives to animate metahumans? im sure there are ways!
Is this released yet
@badxstudio
Жыл бұрын
This is released since a long time ago
@wayneroyrutherford
Жыл бұрын
@@badxstudio lol I should have watched it I thought to was the new Metahuman Animator and jump the gun
"fixing the hair isssue" Could use that in real life -_-
@badxstudio
11 ай бұрын
Lol
One of the super tutorials. But in my case, there are few bugs. 1.Metahuman is not pronouncing as I pronounce. 2.Metahuman's expression slightly does not match my expression. Please help me by suggesting a solution.
@badxstudio
10 ай бұрын
Hello hellooo!! Of course! We uploaded a new video called "METAHUMAN ANIMATOR TUTORIAL" That will give you MUCH Better animation! Please check that out :) kzread.info/dash/bejne/mo5mz82clJepZ7A.html&lc=UgwH6FkaqlaK8_h28at4AaABAg
@rachuriantaratma5945
10 ай бұрын
Thank you for the reply. I tried that one also but it's not pronouncing as I pronounce. Is there any solution?
been trying to get it to work for 2 hours, but the only problem i've had is that my iphone will not appear as a subject i've tried turning off my firewall reconnecting to the same network on both devices changing the unicast endpoint to my pc's ip
@badxstudio
Жыл бұрын
Hey so are you absolutely certain that your iphone and pc are connected to the SAME WIFI NETWORK! Not one on ethernet and other on a wifi. Like literally the same WIFI and using the PC IPV4 address?
@MacandGamingBBFG
Жыл бұрын
@@badxstudio yup, same wifi, using the IPV4 address, neither are using ethernet