Integrate AI Characters with MetaHuman Avatars in Unreal Engine 5 | Convai Unreal Engine Tutorial

In this tutorial, we’ll show you how you can use Convai to add AI functionalities to Metahuman Characters in Unreal Engine 5. Convai enables these Metahuman AI NPCs to perceive their surroundings, perform complex actions and even talk with you or other AI NPCs within your games and virtual worlds. Create amazing virtual experiences in UE5 with Convai today!
Sign up at convai.com to try it out.
Also, learn more about Convai's Safety Guardrails for AI Characters in our latest blog: convai.com/blog/safety-guardr...
Write to us at support@convai.com for any queries, bug reports, collab, or business-related engagement.
Convai plugin for Unreal Engine: www.unrealengine.com/marketpl...
Reallusion Guide: • AI NPCs with Reallusio...
Ready Player Me Guide: • Transform Ready Player...
Custom Character Integration: • AI Characters with Cus...
Time-Stamps:
00:00 Intro
00:45 Setting Up the Convai Plugin
01:25 Adding Metahuman Character to Scene
02:05 Adding Animations
03:18 Applying Lip Sync
05:30 Creating Characters AI Personality
08:13 Enabling Actions
09:16 Scene Perception
10:57 Changing the Character
13:52 Outro
Follow us on your favorite platforms to stay in touch:
Discord: / discord
LinkedIn: / convaitech
Reddit: / convai
Twitter: / convaitech
Instagram: / conv.ai
Facebook: / convaiofficial
TikTok: / conv.ai
ArtStation: www.artstation.com/convai

Пікірлер: 44

  • @Augmented_AI
    @Augmented_AIАй бұрын

    Please add in the ability for gpt 4o vision. So it can see dynamically what's happening in the scene

  • @RizwanTheWizard
    @RizwanTheWizard12 күн бұрын

    Thank you Convai team and the hard work you do! Please make more of these tutorials! Ill watch all of them!

  • @convai

    @convai

    11 күн бұрын

    Hey! We are glad you like the tutorials. Happy development! :)

  • @uno27heaven
    @uno27heavenАй бұрын

    Was legit JUST TRYING TO DO THIS TY

  • @convai

    @convai

    17 күн бұрын

    We are glad you found this helpful! Happy development :)

  • @user-yh3rk6no2s
    @user-yh3rk6no2sАй бұрын

    I hope you guys come out with more tutorials on integrating into VR templates!

  • @convai

    @convai

    25 күн бұрын

    Hey! Thanks for your comment. We have a tutorial out for setting up Convai into Unity VR projects! You can check it out here: kzread.info/dash/bejne/k4Z8zJiLiMmroto.html

  • @robot_collective
    @robot_collectiveАй бұрын

    Thank you so much for sharing this tutorial and for your work on Convai! I am so excited to try this out in the next few days :)

  • @robot_collective
    @robot_collectiveАй бұрын

    So awesome, the body and face animations work great on my Metahuman in UE 5.1. and also the conversation works like a charm. You got a new fan here :)

  • @mattbeets
    @mattbeets20 күн бұрын

    As a total n00b in this, I thought I was going crazy because my ConvaiBaseCharacter's edit blueprint looked nothing like what's shown on the screen @3:04. But somehow I missed that I had to click on "event graph" (Graphs section on (my) left part of the screen) under graphs inside the edit screen. Just if anyone else was confused like I was :)

  • @mattbeets

    @mattbeets

    20 күн бұрын

    Maybe also worth mentioning that using ElevenLabs voices currently requires first a subscription of 6 or 9$/month for Convai, and also a 99$/month subscription to ElevenLabs

  • @schmutz06
    @schmutz0624 күн бұрын

    nice work! i spent a while playing with this earlier with metahuman, in Unreal 5.4.2 (latest stable). I couldn't get the face sync to work unfortunately. I am certain the correct anim class is set to the face, and I have the ConvaiFaceSync component in the stack (tried it in all hierarchies; under ConvaiChatbot, under Root, under face). I was unable to get the navmesh / follow action to work either. The character responded but did nothing. It would turn and face me half the time, and otherwise only look forward. After around 1 hour of starting out, I hit the usage limit. Is it possible to use Ollama / Llama3 local with this to avoid the limit by running all the generative parts locally?

  • @SethTodd-rl6hr

    @SethTodd-rl6hr

    7 күн бұрын

    I am also trying to get a ConvAI metahuman operable, but in 5.3 . Mine also agrees to do some action, like move, but then never does it. Object specified in the details panel so not sure what the issue is.

  • @SethTodd-rl6hr
    @SethTodd-rl6hr7 күн бұрын

    I have been trying to get a working MetaHuman with ConvAi in UE 5.3, but with VR. Firstly, I notice that the text box does not appear in the view inside VR (Vive Focus 3). The convai chatbot can respond to input, but the input doesn't show up. Any idea why this might be?

  • @NostromoVA
    @NostromoVAАй бұрын

    Amazing!

  • @LivioAscione
    @LivioAscione4 күн бұрын

    As soon as I run the convai game mode and try to send a message (vocal or text) ue5 crashes on Mac OS. Maybe a problem with mic permissions?

  • @twjohnsontsai
    @twjohnsontsai15 күн бұрын

    Hello, after setting up the Metahuman character, in the game, his eyes always wander and cannot focus on the other person. How can I fix this?

  • @NetZeroEarth
    @NetZeroEarthАй бұрын

    🔥

  • @zimingpeng8418
    @zimingpeng8418Ай бұрын

    So exiciting! this is a very brilliant tutorial and plugin! I was wandering if this funtion could be packed like a Dektop-program or game version that user can play it with interactive hardware?

  • @convai

    @convai

    Ай бұрын

    Hi @zimingpeng8418 this is definitely possible, simply package the project as normal and you get a playable app.

  • @zimingpeng8418

    @zimingpeng8418

    Ай бұрын

    @@convai cool!!! Thanks! i can´t wait to try it.

  • @Espinosa_render
    @Espinosa_renderАй бұрын

    why my metahuman when talks just has an idle pose? he doesn't use the talking animations...why? Thank you for the plugin, is really amazing

  • @convai

    @convai

    Ай бұрын

    Hi Esinosa_render, thank you for your kind words, the talking animation is a bug that we solved in the latest 3.2.1 version of the plugin, it is not yet out on the marketplace but will be out along with other features and fixes.

  • @zhengdonghou178
    @zhengdonghou178Ай бұрын

    In today's test, I found that ConvaiFaceSync in metaHuman doesn't work, and as a beginner I don't know why this is?Maybe someone knows?

  • @convai

    @convai

    Ай бұрын

    Hi @zhengdonghou178, if the ConvaiFaceSync component is not correctly causing lipsync to work, then double check that you have added the correct face animation blueprint over the face skeleton in the character.

  • @frunobontes
    @frunobontes17 күн бұрын

    Are the actions not functional on 5.4? I cannot make it move or follow me.

  • @convai

    @convai

    17 күн бұрын

    Hey! Thanks for your comment. Actions are definitely functional on UE 5.4. You can check out our detailed tutorial on AI NPC actions to learn more: kzread.info/dash/bejne/opx1zad_kZm6mMY.html

  • @mikebert
    @mikebertАй бұрын

    is there a way to let the conversation box disappear while talking?

  • @convai

    @convai

    Ай бұрын

    Yes! the conversation UI supports a wide variety of customizable options, and it's even possible to hide it entirely while talking.

  • @NotFedBait

    @NotFedBait

    24 күн бұрын

    @@convai i cant find this option, do you have a quick guide? please and thank you.

  • @damingy
    @damingyАй бұрын

    Looks really cool, but I'd imagine just a few players actually utilizing this within a game could easily hit the monthly interaction limit.

  • @devasCabral
    @devasCabralАй бұрын

    When will plugin compatibility for Unreal Engine 5.4 be available?

  • @convai

    @convai

    Ай бұрын

    Hello @devasCabral, Our plugin is compatible with Unreal Engine 5.4. You can download it from our Unreal Engine Marketplace page or access it via this link. www.unrealengine.com/marketplace/en-US/product/convai

  • @MrBastos2010
    @MrBastos201011 күн бұрын

    Is it possible to use another language besides English?

  • @convai

    @convai

    10 күн бұрын

    You can select a language for your AI NPC from a wide variety of options that are available on the Convai Playground. Happy development!

  • @mrbosstv7083
    @mrbosstv7083Ай бұрын

    You guys hiring? Im a game dev, tech art, with a background in generative ai with python

  • @chris09423
    @chris09423Ай бұрын

    I wish you dont need a metahuman for this, Is there no way to use your own character?

  • @convai

    @convai

    Ай бұрын

    You can definitely use your custom characters! Check out our tutorial on integrating Convai with Custom Characters: kzread.info/dash/bejne/aG2px9OmhbbOoZc.html&t

  • @SanjeevKumar-be4dd
    @SanjeevKumar-be4ddАй бұрын

    i'm not receving any response from metahuman after asking questions

  • @convai

    @convai

    Ай бұрын

    Hi @SanjeevKumad-be4dd, is there any errors that pop up in the chat widget? you can share this issue on our Discord channel: discord.gg/uTfQqzUnhf

  • @SanjeevKumar-be4dd

    @SanjeevKumar-be4dd

    Ай бұрын

    @@convai actually i did receive response from face but hand animation not working tried so many times

  • @itzDrizzyyyman
    @itzDrizzyyymanАй бұрын

    hmmm i still dont think its it!!!! you guys went the wrong way about it actually.

  • @renanartist3d216

    @renanartist3d216

    Ай бұрын

    why?

  • @itzDrizzyyyman

    @itzDrizzyyyman

    Ай бұрын

    @@renanartist3d216 you can easilly do the same with a chat gpt subscription!