Unreal Engine Metahuman Facial Motion Workflow with Faceware

Фильм және анимация

A glimpse into my Unreal Engine Metahuman facial motion workflow with Faceware.
Link to my Discord: / discord
Link to Faceware Webinar: lnkd.in/dyyBd8Yc
Metahumans from Epic Games & 3Lateral doo Novi Sad
Thank you, to an incredible community of collaborations for being a part of my journey and creative process!
Special Thanks
-------------------------
The team at Faceware - Pete Busch, Catarina Rodrigues, Joshua Beaudry, Tatjana Vejnovic and Brandon Suyemoto.
Norman Wang - CEO & Co-Founder Glassbox Technologies
Katie Jo - Senior Product Specialist of Xsens Products at Movella
MANUS™ - Arsène van de Bilt
Puget Systems and NVIDIA
VR Division / Yahiya Jasem - Unreal Environment
Gabriel Paiva - Metahuman Whisperer
Diana Diriwaechter & Emanuele Salvucci - Rendering & Materials
Jonathan Winbush - Unreal Educator
Jobutsu - UE5 Metahuman Tutorials
Artist Credits
----------------------
Michael Weisheim - Original Character Artist
Pixel Urge - Character Body & Face Modification
Daniel Cadena - Character Body Textures
Konstantin D’Lakrua - Character Hand Rigging
Bernhard Rieder - Lighting & Cinematics
Gear I Use:
Faceware Mark IV HMC: facewaretech.com/cameras/markiv
Faceware Studio: facewaretech.com/software/studio
GlassboxTech Live Client Plugin: glassboxtech.com/products/liv...
Xsens Link Suit & MVN Animate Pro: www.xsens.com/motion-capture
Manus Prime II Gloves: www.manus-meta.com/mocapgloves
Puget Systems Workstation & Nvidia RTX A6000: www.pugetsystems.com/landing/...
#unrealengine #metahumans #virtualproduction #facemocap #mocap #facialmotioncapture #motioncapture #faceware #xsens #faceware #liveclient #glassboxtech #nvidiartx #pugetsystems #epicgames #metaverse

Пікірлер: 194

  • @TheDavidTurk
    @TheDavidTurk2 жыл бұрын

    "During the process of creating, that is when you learn the most. You find solutions to problems and create new pipelines" - this is so so true! Great video!

  • @EliasLeo6
    @EliasLeo6 Жыл бұрын

    Just to put this in perspective: she is using at least 47 168$ of hardware, not even including software licenses. So the result is really nice, but it's also very proffesional gear. Not for your average 3D Artist 🥲 Faceware Mark IV $ 28,749 Xsens MVN Link $ 13,630 Manus prime II $4,789

  • @shaddyopb

    @shaddyopb

    Жыл бұрын

    Exactly! haha, I was like shit you quit bartending and bought 50k worth of the highest end gear to make a short for yourself? -- That must have been some seriously nice bar:)

  • @Mangotropolis
    @Mangotropolis Жыл бұрын

    This is the best model I have ever seen. Good for you for giving the proper credits to your contributors :)

  • @KO-gu6wp
    @KO-gu6wp2 жыл бұрын

    I've been working with unreal engine and 3d applications for 15 years, its really great to see how elements of the engine have become very intuitive for people like yourself to just jump in and create awesome work without years of experience under your belt. Very talented work and I'm glad you are able to express your creativity without a problem using ue5

  • @FeedingWolves

    @FeedingWolves

    2 жыл бұрын

    Thank you so much for your kind words!

  • @bharatdharma3820

    @bharatdharma3820

    Жыл бұрын

    Is Blender + UE5 a good choice, from the career standpoint, for somebody starting out in this space?

  • @vizstudio_MWalsh
    @vizstudio_MWalsh2 жыл бұрын

    Amazing! Thank you so much for documenting this process and sharing with all of us.

  • @MistereXMachina
    @MistereXMachina Жыл бұрын

    By far the most interesting, valuable, insightful look at this world which I have only recently begun to seriously learn. I really appreciate you making this, instantly subbed.

  • @original9vp
    @original9vp2 жыл бұрын

    The eyes wide open as a sync point is a gem! 👍👏

  • @avtpro
    @avtpro2 жыл бұрын

    Congrats! Looks Awesome. This level of tech is ahead of what artist have been trying to do for decades. Totally Next Gen.

  • @coma13794
    @coma137942 жыл бұрын

    Not even sure what to say. You are amazing. I'm slowly getting into UE5, focusing on lumen and nanite, however it's hard to ignore how incredible this platform is in so many other aspects. Thank you for sharing this.

  • @samgoldwater
    @samgoldwater2 жыл бұрын

    Setting the example for the rest of us, just amazing

  • @AnnisNaeemOfficial
    @AnnisNaeemOfficial Жыл бұрын

    Very well explained. Great work on documenting this and explaining it so succinctly.

  • @carloguayaba
    @carloguayaba11 ай бұрын

    The uncanny valley is slowly disappearing. This is gorgeous. Can’t wait to see it in video games, imagine the drama the characters will convey with those realistic expressions.

  • @myxsys
    @myxsys2 жыл бұрын

    Thanks so much for showing us the process. Looking forward to learning more.

  • @OfirGardy
    @OfirGardy2 жыл бұрын

    Thank you for this! keep up your amazing work and sharing 😍

  • @nanopixel.studio
    @nanopixel.studio Жыл бұрын

    This is by far the best mocap result I've seen so far. There were no jerky movements and the mouth didn't half way open like other videos I've seen. This is perfect.

  • @fledgeking

    @fledgeking

    11 ай бұрын

    Mocap always looks better if you have tens of thousands of dollars to work with

  • @marvinvogtde
    @marvinvogtde2 жыл бұрын

    just amazing, really impressive work

  • @Eppideem
    @Eppideem Жыл бұрын

    Brilliant video thank you - I am starting out with performace capture, with the emphasis on performance. Your character's aminmation is so nuanced! Inspired.

  • @visualdrip.official
    @visualdrip.official Жыл бұрын

    fantastic! will sub! Im just starting my journey into unreal and i couldnt be more thrilled! this is great! keep it up!

  • @metafuel
    @metafuel Жыл бұрын

    Beautiful work. Thank you for explaining your process. Subscribed.

  • @alashchanneltv3387
    @alashchanneltv33872 жыл бұрын

    Gabriel, its very very cool👍 Thank you for studying this awesome job and sharing your experiences and knowledge with us. Develop further and share with us. We will support you by getting inspiration from you. I hope that transferring your project to UE5 will be a big bang, in the field of animation, graphics, motion capture and much more. Your 3D model is as beautiful as you are🤩 Greetings from sunny Kazakhstan🖐

  • @bobhawkey3783
    @bobhawkey37832 жыл бұрын

    Wow, you made an amazing leap. Very cool. Congratulations.

  • @pietrosvelto1434
    @pietrosvelto1434 Жыл бұрын

    Outstanding

  • @Native_Creation
    @Native_Creation2 жыл бұрын

    Most impressive, a consistent inspiration!

  • @time4changenow
    @time4changenow Жыл бұрын

    Fantastic!

  • @MikeliousXD
    @MikeliousXD2 жыл бұрын

    Amazing, excited to see more!

  • @cinematic_monkey
    @cinematic_monkey3 ай бұрын

    What a wonderful person you are!

  • @mzie25
    @mzie252 жыл бұрын

    Bravo. I love this!! Well done!! Inspiration for me to up my game.

  • @toldme3d
    @toldme3d Жыл бұрын

    Κάνεις φανταστική δουλειά !!! Συγχαρητήρια !!!

  • @ExviaStudio
    @ExviaStudio2 жыл бұрын

    Awesome!

  • @feels.9304
    @feels.9304 Жыл бұрын

    This is truly inspiringggg!!Keep going Gabz

  • @nickgettino5865
    @nickgettino58652 жыл бұрын

    Talented and beautiful, willing to share her experiences to make others better.

  • @hanswurst3811
    @hanswurst3811 Жыл бұрын

    so amazing

  • @weeliano
    @weeliano2 жыл бұрын

    Awesome work! Can't wait to see what you can do in Unreal 5!

  • @riotechmod
    @riotechmod Жыл бұрын

    Having a team just for a dedicated work flow is very helpful. As a solo artist, I struggle alot due to lack of limited online information, funds and time. You all r great and doing 100000x great job than mine 🙂. I m steel limited to use manual key framing for animations.

  • @Soluchi-InfiniteCoCreatorGod
    @Soluchi-InfiniteCoCreatorGod2 жыл бұрын

    Incredible. 😊💯

  • @jacksonbridges8108
    @jacksonbridges81082 жыл бұрын

    This is awesome!

  • @dumebinkata
    @dumebinkata Жыл бұрын

    this is so good!

  • @onethingeverything
    @onethingeverything2 жыл бұрын

    Great work!

  • @alexzanderthegeek
    @alexzanderthegeek Жыл бұрын

    This is crazy awesome!

  • @tris73
    @tris732 жыл бұрын

    Amazing job! Thank You!!!

  • @Joeherman
    @Joeherman2 жыл бұрын

    Mind blowing!

  • @AntonioParisi1968
    @AntonioParisi19682 жыл бұрын

    AMAZING!

  • @and_I_am_Life_the_fixer_of_all
    @and_I_am_Life_the_fixer_of_all Жыл бұрын

    felt like a lone wolf geeting fed, thanks!

  • @viceroy7792
    @viceroy7792 Жыл бұрын

    Brilliant

  • @StephanStreuber
    @StephanStreuber2 жыл бұрын

    amazing

  • @gmtoutdoorsindiana2785
    @gmtoutdoorsindiana27852 жыл бұрын

    just beautiful

  • @StephenCharlesBaker
    @StephenCharlesBaker Жыл бұрын

    Most excellent ... WOW

  • @supremebeme
    @supremebeme Жыл бұрын

    really insightful thank you

  • @thesahel7218
    @thesahel7218 Жыл бұрын

    The riggers on this are gods. This blows my mind.

  • @salmanramezani4784
    @salmanramezani4784 Жыл бұрын

    it was the best motivation for me as a demotivated artist these days. thanks.

  • @richd9655
    @richd96552 жыл бұрын

    Amazing videos.very inspiring.

  • @yanpengguo9154
    @yanpengguo91542 жыл бұрын

    I love your channel. That's great.

  • @enriquemontero74
    @enriquemontero742 жыл бұрын

    excelent video your work is cool, I hope you can execute all your ideas and projects with great success. Blessings.

  • @weses2
    @weses22 жыл бұрын

    damn this is amazing

  • @JorgeRodiles
    @JorgeRodiles2 жыл бұрын

    awesom

  • @Thunk3DScanner
    @Thunk3DScanner Жыл бұрын

    Amazing!!!!!❤👍

  • @simpsonelli
    @simpsonelli Жыл бұрын

    Saw you mentioned in an Epic Games metahumans talk at SIGGRAPH in Vancouver today- had to look you up. Incredible work! Especially for a newly self-taught person, this is inspiring!

  • @FeedingWolves

    @FeedingWolves

    Жыл бұрын

    Thank you so much!!!!

  • @James_McLane
    @James_McLane2 жыл бұрын

    Thanks for this! Amazing work 💥💥. Can’t wait to see what’s next, Feeding Wolves :)

  • @freebitcoingiveaway119
    @freebitcoingiveaway119 Жыл бұрын

    your a bluddy legend

  • @PassportGaming
    @PassportGaming2 жыл бұрын

    Inspiring af

  • @samianpacing
    @samianpacing Жыл бұрын

    Wowww.... Superb.... 😍 😍

  • @cerulessa
    @cerulessa2 жыл бұрын

    I really admire you!

  • @thedesignertoydragon6807
    @thedesignertoydragon68072 жыл бұрын

    interesting video you are super talented and a inspiration!

  • @carloguayaba
    @carloguayaba11 ай бұрын

    I can’t wait to see this in actual video games

  • @ianriccillo3806
    @ianriccillo3806 Жыл бұрын

    Technology is insane dude,

  • @alwaysyouramanda
    @alwaysyouramanda2 жыл бұрын

    Whoa!

  • @IndependentOnlineCinema
    @IndependentOnlineCinema2 жыл бұрын

    Incredible work Feeding Wolves!

  • @chessmusictheory4644
    @chessmusictheory4644 Жыл бұрын

    This is the go to benchmark.

  • @davimak4671
    @davimak4671 Жыл бұрын

    awesome talking animation

  • @crazzylee
    @crazzylee2 жыл бұрын

    Ziva looks more true to life to me. I think you should try it.

  • @mycloudvip
    @mycloudvip Жыл бұрын

    Awesome work. I'd love to work on a project together one day! Kudos!

  • @dioib
    @dioib2 жыл бұрын

    Hi! Your video and workflow is amazing! Really open my eys to a new virtual world! I am a blender user and very interested in learning blender / metahuman / Unreal. I am very new to Unreal 5 and very much hope that you can make a in-depth tutorial to help show the steps! It really helps newbie like me try to enter this fun world like you! Also, I love the presentation of your avatar, she looks very pretty! Great work and hope to see more videos from you!

  • @FeedingWolves

    @FeedingWolves

    2 жыл бұрын

    Thank you so much! Wish I knew blender a little better so I know what it is like using a new software. I will be releasing a full course soon for this metahuman motion capture workflow, so stay tuned!

  • @dioib

    @dioib

    2 жыл бұрын

    @@FeedingWolves Thanks and looking forward for your tutorial! Have a nice day!

  • @xingzhexin8843
    @xingzhexin8843 Жыл бұрын

    Just went on their website to check the pricing and the system (Mark IV) you're using right now is 30 grand usd? Bananas

  • @GrimGearheart
    @GrimGearheart Жыл бұрын

    I would be so happy to invest in these products, as soon as they do away with the ridiculous subscription costs. ^_^

  • @kalubandali2241
    @kalubandali22412 жыл бұрын

    like you i am trying to change my life using unreal. Thank you for the inspiration.

  • @FeedingWolves

    @FeedingWolves

    2 жыл бұрын

    Its going to happen sooner than you think! Keep at it!

  • @kalubandali2241

    @kalubandali2241

    2 жыл бұрын

    @@FeedingWolves your so kind, thank you for the nice words!

  • @GhostruktMerchantsCompany
    @GhostruktMerchantsCompany Жыл бұрын

    3:24 in you answer my question thasnk you very much you are the very very best

  • @vincev4630
    @vincev46302 жыл бұрын

    The jitter smoothing looks good, you make UE look real good. I think the reason it still looks stiff at some parts of the face is the rig. Most sliders on the rig is a 2 way axis. So this looks like a great previz but i wonder if it'd be possible to fully utilize the axis on each bone for the final shot somehow.

  • @FeedingWolves

    @FeedingWolves

    2 жыл бұрын

    Thank you so much! I am not sure if it is possible to fully utilize the axis on each bone.

  • @TheSecretHideout
    @TheSecretHideout2 жыл бұрын

    This is VERY interesting. How do you do you do such things? Can you make an in depth tutorial?? (Great work Feeding_Wolves, blown away as usual.)

  • @MDalton10
    @MDalton10 Жыл бұрын

    Amazing tech. Little bit of sticker shock when I seen the 30k pricetag (For just the Mark IV Wireless Headcam System). You can't deny the results though. Look fantastic.

  • @seanspitzer5537
    @seanspitzer55372 жыл бұрын

    Dats my Girl!!! GET SOME!!!

  • @AwesomeSauceShow
    @AwesomeSauceShow2 жыл бұрын

    Awesome stuff! You must have been a genius level bartender 😅😉

  • @FeedingWolves

    @FeedingWolves

    2 жыл бұрын

    hahaha well I was a bartender for the last decade, I would hope so!

  • @whoguy4231
    @whoguy4231 Жыл бұрын

    This is what the Metaverse should have been!

  • @virtualfilmer
    @virtualfilmer2 жыл бұрын

    This is so so helpful, as always Gabriella. You make such clear, awesome videos. Faceware is so great - I just wish they employed someone like you to fix their “how to” videos and help resources. They are outdated and don’t help with common bugs and issues. Btw Faceware studio is heavily dependent on having major contrast between lips and skin, and strong eyebrows. I have pale skin and pale-ish lips, sparse-ish eyebrows, plus a beard/mustache. Faceware Studio doesn’t work unless I wear heavy makeup. :) I have FW studio and also own analyzer/Retargeter which is much more accurate but harder to use. And is buggy with metahumans and maya - crash city! 😂

  • @FeedingWolves

    @FeedingWolves

    2 жыл бұрын

    Thank you! I personally do not have a beard lol so I haven't experienced this issue. I know the beard might confuse the tracker because you really want your mouth visible for it to get good tracking. I also recommend trying the different tracking methods - stationary vs professional head cam options. I have not used the Maya pipeline so I am missing out ;)

  • @Pauliotoshi
    @Pauliotoshi2 жыл бұрын

    Hey Gabriella, It's amazing that you showcase the facial animation quality that can be achieved by a single person. Looking forward to see your continued journey. I have a few questions: 1. How much time did you approximately spend on manual clean-up and additional animation in the video's that you have shown so far? Or what would be a good estimation to achieve your quality level for 1 minute of continued speech animation? 2. Did you fully manually animate the tongue or did you use some tool to help you with this? 3. Can you show a side by side comparison of the raw motion capture data vs the post-processed (incl manual work) version? I'm quite interested in the visual difference. Thanks in advance and keep up the good work!

  • @FeedingWolves

    @FeedingWolves

    Жыл бұрын

    Thank you for your kind words. To answer your questions: 1. It is hard to give you an approximate time on how long each performance takes for fine tuning. It really depends. The Greek metahuman robot girl took me three days. The one following that, that had more dialogue and took a bit longer. 2. I did animate the tongue manually and used my own reference video to figure out when to drop those keys. I show my process for this in the intro of this video kzread.info/dash/bejne/i6yhm9OGn5zNqbQ.html 3. Raw vs processed data..skip to 6:32 kzread.info/dash/bejne/hWphrM2ioc-tgrA.html so you can get an idea of what the data looks like raw with the additive layer disabled vs it enabled.

  • @ValeGoG
    @ValeGoG Жыл бұрын

    10/10

  • @JonathanWinbush
    @JonathanWinbush2 жыл бұрын

    Keeps getting better and better! 🤙🏿

  • @FeedingWolves

    @FeedingWolves

    2 жыл бұрын

    Thank you, Winbush!!!

  • @memnok9980
    @memnok9980 Жыл бұрын

    Rad.

  • @occultpriestess
    @occultpriestess Жыл бұрын

    I really enjoyed this video. I am proud of you! So, does anyone you know use their Metahuman to livestream? I am having a hard time finding real time content. Thank you!

  • @AlexSMontgomery
    @AlexSMontgomery2 жыл бұрын

    Stunning amount of information, great video, thank you!

  • @jonathanmazibuko6726
    @jonathanmazibuko6726 Жыл бұрын

    amazing feeding woles

  • @WATCHMEUNLOCK
    @WATCHMEUNLOCK2 жыл бұрын

    👏🏼 👏🏼 👏🏼 👏🏼

  • @GhostruktMerchantsCompany
    @GhostruktMerchantsCompany Жыл бұрын

    WOW this is beautiful, how do you syncronise the audio when using a meta human?

  • @randypan1854
    @randypan18542 жыл бұрын

    Looking great, when is your short film coming out? :)

  • @FeedingWolves

    @FeedingWolves

    2 жыл бұрын

    Thank you! As soon as I get in the swing of things in UE5, still learning all the new tools;)

  • @dreamzdziner8484
    @dreamzdziner84842 жыл бұрын

    This is so damn beautiful and inspirational stuff. You are rocking with Metahuman. Wish you all the success👌👍👏👍❤

  • @erickward
    @erickward2 жыл бұрын

    Amazing work and truly inspiring! Does your name come from the parable “The One You Feed”?

  • @FeedingWolves

    @FeedingWolves

    2 жыл бұрын

    Thank you! And yes, its all about feeding the good wolf!

  • @vicosdivicos
    @vicosdivicos2 жыл бұрын

    Would be nice if the fine lines in the face of the robot lighten up with colors together with emotions..Nice work!!! i like it

  • @FeedingWolves

    @FeedingWolves

    2 жыл бұрын

    Thank you! And yes, now that you mention it, that would be cool if they lit up!!!

  • @vicosdivicos

    @vicosdivicos

    2 жыл бұрын

    @@FeedingWolves 👌🤜🤛❤️

  • @redratpetrax
    @redratpetrax2 жыл бұрын

    30 yers exp.. Thats amezing ... its wold take me some month or 2 to make this from scratch in some 3D soft.. With 1 year exp.. Thats Crazy.. Modern Stuff..

  • @sputnickers
    @sputnickers Жыл бұрын

    5:34 "faceware will get you 90 percent of the way there" - Thanks for this stunning video. Question about this one quote: Is there any place where you compare the raw faceware images with the final? And did you ever get more of those jitters solved? For example is the facial tracking you show in this video, say at 1:20, is that raw or processed (by you, by hand). And if it is processed how long did that take per second of video? Did you find it mostly a problem with mouth closures on the explosives? Thanks

  • @RikkTheGaijin
    @RikkTheGaijin2 жыл бұрын

    For the people who think this is accessible, all of that is over $40k worth of equipment. Just saying...

  • @criscanto7040

    @criscanto7040

    Жыл бұрын

    You can now do it with a camera or 2

  • @TheFunDimension

    @TheFunDimension

    Жыл бұрын

    @@criscanto7040 lol I we all wish.

  • @criscanto7040

    @criscanto7040

    Жыл бұрын

    @@TheFunDimension not kidding I work with AI I can translate movement in my camera to UE

  • @theokrisna

    @theokrisna

    Жыл бұрын

    @@criscanto7040 can u share ur workflow?

  • @SteveSmith-ze5mw

    @SteveSmith-ze5mw

    Жыл бұрын

    @@criscanto7040 you know it doesn't fucking look anything close to as good as this lmao the hand rigs are insane.

  • @MckeeZiEMedia
    @MckeeZiEMedia2 жыл бұрын

    Thank you so much will this work on Daz characters too?

Келесі