No video

tyFlow | tyDiffusion - A.I. in 3ds Max

In this video we will use tyFlow's new tyDiffusion Feature to generate AI Images directly from within 3ds Max. For this we will explore the basic workflow as how to install the plugin and how to perform an initial setup. When we are ready we will then use prompts to generate images and learn how to customize them.
The real power starts when we use Stable Diffusions Control Net features where we can directly export guidance maps from our viewport and use those to control our output. With this you can generate AI images that perfectly align with your 3d scenes which can be an awesome tool for getting inspiration, testing out different lighting conditions or try out various looks before you then move on to recreate a similar result using traditional methods.
Using tyDiffusion's built in baking features we can also bake our generation back on our 3d geometry which allows us to mix AI generated parts with traditional rendering.
Chapters:
00:00 - Overview
01:17 - Initial Setup
04:45 - Basic Workflow
10:05 - Control Net
14:12 - LoRa's and Upscaling
16:06 - Projection Baking
Be sure to subscribe to the channel in order to be notified about upcoming tutorials :-)
Check out my Patreon for all my scene files, additional videos or just to support this channel :-)
/ jonasnoell

Пікірлер: 126

  • @JonasNoell
    @JonasNoell25 күн бұрын

    ✅Check out Patreon for all my scene files, bonus videos, a whole course on car rendering or just to support this channel 🙂 patreon.com/JonasNoell

  • @evelynfive5684
    @evelynfive568424 күн бұрын

    It's not the end, it's the dawn of new approach for the best results.

  • @JonasNoell

    @JonasNoell

    23 күн бұрын

    Yeah, stuff will be changing, and probably changing fast. Curious to see how workflows will look like 2 years down the line from now

  • @FreeKiLLuminati
    @FreeKiLLuminati24 күн бұрын

    wow really a game changing

  • @ykadam
    @ykadam22 күн бұрын

    Thank you Jonas!

  • @yanke8154
    @yanke815424 күн бұрын

    Amazing

  • @averageman2063
    @averageman206321 күн бұрын

    Amazing..

  • @abdullahubeyd3060
    @abdullahubeyd306024 күн бұрын

    great tuotrial

  • @yassinedjebbari4819
    @yassinedjebbari481924 күн бұрын

    Amazing introduction to this wonderful tool ! Thanks a bunch

  • @JonasNoell

    @JonasNoell

    24 күн бұрын

    Glad it was helpful!

  • @axzichannel4837
    @axzichannel483725 күн бұрын

    Amazing. Thanks for this tutorial. :)

  • @GS3D
    @GS3D24 күн бұрын

    Thank you for the tutorial. Great content and i will play with it soon.

  • @Rammahkhalid
    @Rammahkhalid25 күн бұрын

    Nice Take

  • @mikegentile13
    @mikegentile1324 күн бұрын

    excellent explanation! thanks!

  • @JonasNoell

    @JonasNoell

    24 күн бұрын

    Thanks for your support :-)

  • @yautjagang4715
    @yautjagang471524 күн бұрын

    Great ❤ that helps a lot for me to kick start 🎉

  • @emf321
    @emf32124 күн бұрын

    I'm very positive about Stable Diffusion, its very exciting, not like people who complain about it all the time . However, i'm trying to look how i can use it in the Arch Viz industry, but there's just not a lot it can do. If you ask it to draw a pretty house, yes it can do that. If you ask it do draw a very specific house based on very specific architectural drawings, measurements and QS materials & surfaces, not at all! Its a toy at this moment in time. It can do great organic, general, abstract pictures, textures, etc. not a lot of very specific tasks in the practical real world.

  • @JonasNoell

    @JonasNoell

    24 күн бұрын

    I don't think at the moment you can use it professionally as a One-Button-Solution kind of thing. For me it is a gamechanger because I can quickly try out new ideas, get references. It's basically a reference search engine on steroids which can give you an idea about how the final result could look like. So for me at least it is an inspiration collection tool, because as you described it lacks the fine control and precise revisions required in daily production. So try to use it what it's good for and we will see what the future brings :-)

  • @juliussaurus

    @juliussaurus

    24 күн бұрын

    I´ve been using here in the office basicaly to find moods. If you have a reference image it works even better, it´s perfect to bring to a meeting and decide the project direction, even though the builing is not exactly how it should be.

  • @CaptainSnackbar
    @CaptainSnackbar22 күн бұрын

    its really good to explore the posibilities where your art can go, but in the end you have to do it your self to reach that level. otherwise you will end up cycling for options that never ends

  • @JonasNoell

    @JonasNoell

    21 күн бұрын

    Yeah that’s also how I see it at the moment. It’s a bit useless if you can’t combine it with the traditional way of doing things as it lacks control and precision and is just too random. But it will give you lots of ideas and inspirations which you can then utilize to build something new out of it.

  • @davekite5690
    @davekite569020 күн бұрын

    'a really interesting video - thanks.

  • @onlyyoucanstopevil9024
    @onlyyoucanstopevil902414 күн бұрын

    AWESOME, KEEP IT UP😊😊😊

  • @andrefranzke3882
    @andrefranzke388218 күн бұрын

    Dreams come true

  • @intiazrahim
    @intiazrahim24 күн бұрын

    Another amazing vid @JonasNoell! This is indeed a game changer for me. Trying it out for matching background landscapes instead of tediously modeling/lighting/texturing. Using this combined with other AI tools like Topaz upscaler or Magnific to further add enhancements.... the possibilities are crazy! Clients will especially like this and you can charge them an additional fee for design explorations or artistic styles.

  • @JonasNoell

    @JonasNoell

    24 күн бұрын

    Yeah exactly that what I was thinking as well, should work really well for MattePainting replacements, even with the possibility to project that directly on some simple geometry for parallax. Can definitely simplify a lot of think you would normally have some high quality assets or some matte painting skills to have decent results

  • @intiazrahim

    @intiazrahim

    24 күн бұрын

    @@JonasNoell hmmm never thought of using it for parallax. That would be amazing use for 3d orthographic projections for say 3d floor plans! Gotta try it out.

  • @shadergt2610
    @shadergt261017 күн бұрын

    Thank you!!!

  • @smukkegreen
    @smukkegreen19 күн бұрын

    Great intro Jonas. Thx a lot for this. Can we create materials for our objects that look good if the object is rotated? Like texture maps etc? I tried a tennis ball on sphere, but it looks bad when I rotate the sphere.

  • @Team_rk288
    @Team_rk28822 күн бұрын

    Waiting for tyre track in mud material

  • @andvfx
    @andvfx24 күн бұрын

    Tydiffusion is awesome! Great video. Its so fun to try different looks of an image and so fast!

  • @JonasNoell

    @JonasNoell

    24 күн бұрын

    Yeah recently going through all my recent projects and test what the AI would have come up with. You can get a good feeling for its potential but also it’s limitations! 😃

  • @chosekriz
    @chosekriz14 күн бұрын

    Great basic trainin video, thank you. I just bumped into a problem with depth - it always sends in just blank black viewport - no depth at all. Tried adding all max (arnold, v-ray) cameras, did not help. Any idea how to solve this?

  • @piergiacomomacri492
    @piergiacomomacri49224 күн бұрын

    Thank you Jonas for the video... may I ask you if there is an option to use inpaint mask feature, where you can improve some parts locally, especially 3d people?

  • @JonasNoell

    @JonasNoell

    24 күн бұрын

    There doesn't seem to be an option for this (yet?) though ComfyUI/SD supports this. I hope this will be just a matter of time as this is the first release of the tool. This would be also my most requested feature. I would also like to have localized prompts for diffferent ObjectIDs or Masks for example, also possible in ComfyUI but not existent within tyDiffusion yet...

  • @ytmelo
    @ytmelo18 күн бұрын

    Great video as usual! I have a question: is your video sped up during the image generation phase (after you press the Generate Image button) ? I own an i9 13900KF + 4080 rtx gpu PC and it takes much longer than shown here. Is there any particular setting to tweak for gaining speed performance ? Thank you for answering. EDIT: I've already changed the sampler to a GPU one but the change in speed is almost unnoticeable...

  • @JonasNoell

    @JonasNoell

    17 күн бұрын

    Hi, no the video is edited for the generation parts roughly 5x faster. This one is on a 4090

  • @ytmelo

    @ytmelo

    17 күн бұрын

    @@JonasNoell thank you very much for answering! Keep rocking!!! ❤

  • @tinrats
    @tinrats25 күн бұрын

    great tutorial! Have you experimented with animation yet? When I get a prompt that looks good as an image but then run it through animation, it looks completely different. Have you experienced that? I'm so new to AI I'm probably being stupid ;)

  • @JonasNoell

    @JonasNoell

    24 күн бұрын

    Haven't checked out animation yet but will definitely do so. I can imagine making a more advanced 2nd tutorial that covers those features. This one here was mainly for the basics to get you started.

  • @tinrats

    @tinrats

    24 күн бұрын

    @@JonasNoell Nice one. I'll look forward to it :)

  • @intiazrahim
    @intiazrahim22 күн бұрын

    @JonasNoell is it my system or is it just really slow to render in viewport. Maybe you can show a timelapse or something to get an idea of the actual speed? Just tried the cat and it placed my model in front of the cat (behind - blurry).

  • @JonasNoell

    @JonasNoell

    21 күн бұрын

    I speeded up the generations around 500%, but the speed depends on your GPU. I use a 4090 for reference so if you use weaker hardware it will of course cause delays. Also the resolution you chose plays an important factor. You could also choose smaller resolution and try to use upscaling which should be faster

  • @888berg
    @888berg23 күн бұрын

    Amazing work! Sorry just so I understand - it looks like you can use this diffusion AI to make 2D images... but can you use it to export Video Clips, and use the 3D model to have multiple camera angles etc, cheers :)

  • @JonasNoell

    @JonasNoell

    21 күн бұрын

    Yes you can do video but there are issues about inconsistency and just general weirdness that will happen, so I don’t think you can get something too productive out of it at the moment

  • @pantov
    @pantov25 күн бұрын

    is it true that animation features only work with 24gb gpu's? if so, does the vram has to be on a sinle gpu, or would a 2nd gpu solve this?

  • @JonasNoell

    @JonasNoell

    24 күн бұрын

    I haven't heard or read anything about those requirements as of now, but I haven't really tried animation yet so I can't tell for sure. Where did you read this?

  • @pantov

    @pantov

    24 күн бұрын

    @@JonasNoell i cant find the thread where i read this, i think it was tyson himself on the tyflow forum.. explanation was that to render animation you need to load multiple large ai models into vram..

  • @JonasNoell

    @JonasNoell

    24 күн бұрын

    @@pantov Ok interesting, as said I will try animation soon do see how this works. Though I have a GPU that has 24GB Ram, so if that's the requirement I probably wouldn't notice it. Maybe just make a post in the tyflow Forum if you want a reliable answer. 🙂

  • @pantov

    @pantov

    24 күн бұрын

    @@JonasNoell yeah i was planning to that a bit later, tyson is flooded with forum posts at the moment :-) i got 11gb on my workstation, but i got a render node that has 16gb but slower gpu, havent tried it there yet.. thanx for your reply, looking forward to your furter tyflow vids. cheers mate!

  • @pshethia01
    @pshethia0116 күн бұрын

    When is MAYA ASSIST coming out ?

  • @mohamedsabry6871
    @mohamedsabry687122 күн бұрын

    if i need to save the final result as the Png file what can I do ?

  • @skypilotace
    @skypilotace25 күн бұрын

    Art-producing AI, to me at least, is like a sandbox for professionals to play in. Not only is it currently a waste of time, but people need to put down the toys and get back to real work. It's important to recognize that the images generated by AI are frequently derived, either partially or entirely, from existing art and photography found online. This practice is not only questionable but also disrespectful to original creators.

  • @Brashenn

    @Brashenn

    24 күн бұрын

    Hear Hear!

  • @joelchamp1949

    @joelchamp1949

    24 күн бұрын

    Just another tool for the 3d toolbelt

  • @E_Clip

    @E_Clip

    24 күн бұрын

    The exact same argument artists used when the photo camera was invented.

  • @skypilotace

    @skypilotace

    24 күн бұрын

    @@joelchamp1949 But a tool that is premature and unusable for projects in the real world.

  • @skypilotace

    @skypilotace

    24 күн бұрын

    @@E_Clip The fact that art is still very much alive (drawing, painting, digital art, concept art, 3D animation, motion graphics, graphic design, etc.), and photography is dying a quick and painful death (video, billions of stock photos, Instagram, and filter-driven selfies), speaks for itself.

  • @miladlahooti545
    @miladlahooti54518 күн бұрын

    It doesn't work in my system and it appears an error about "torch not compiled with cuda enabled"

  • @Hung_Nguyen_90
    @Hung_Nguyen_9019 күн бұрын

    I am guessing this won't work for animation yet? This seem like it will treat each frame as a single pictureso It can't create waves, foam as If the ship is moving forward.

  • @tinko8903
    @tinko890324 күн бұрын

    "Tydiffusion comfyUI engine could not be started.Try running 3ds max as administrator." I see this box. I have this problem can’t generate.Please how can I solve this.

  • @mehmetyigit2330

    @mehmetyigit2330

    24 күн бұрын

    same problem

  • @mihabrezavscek9487

    @mihabrezavscek9487

    24 күн бұрын

    @@mehmetyigit2330 same here!

  • @JonasNoell

    @JonasNoell

    24 күн бұрын

    Have you tried running 3ds max as an administrator? :-) If yes try to get some support from TyFlow directly, I can't give you much technical support as it worked flawless for me

  • @JonasNoell

    @JonasNoell

    24 күн бұрын

    Oh and try upgrading your GPU drivers

  • @mihabrezavscek9487

    @mihabrezavscek9487

    24 күн бұрын

    tried running as admin but still no success. even though the models are downloaded they dont show up under: Generate>Model>[none found]

  • @sacifair
    @sacifair18 күн бұрын

    Interestig, how to do inpaint through this stuff?

  • @onepeacebyisobare1750
    @onepeacebyisobare175022 күн бұрын

    please which version of 3ds max do you use?

  • @JonasNoell

    @JonasNoell

    21 күн бұрын

    2024

  • @mikkeel_johnnynew
    @mikkeel_johnnynew20 күн бұрын

    do you know why mine isnt working? when i press to generate image it makes my viewport black and i cant fix even that. it doesnt generate at all and i have the default settings. does anybody know why?

  • @caseyj789456
    @caseyj78945623 күн бұрын

    If you know comfy and max (enough) you can probably do all without this plugin for free 😊

  • @JonasNoell

    @JonasNoell

    23 күн бұрын

    Of course, it is just using ComfyUI in the background. It can't do anything that you couldn't already do with ComfyUI. The novelty is the convenience and direct integration making it frictionless to use.

  • @ViperAleks

    @ViperAleks

    23 күн бұрын

    Stable Diffusion works in free version of tyFlow too.

  • @ivanbonavick227
    @ivanbonavick22723 күн бұрын

    Hey! Does anyone knows why I can't make it work with viewport depth? Only color mode seems to work

  • @ivanbonavick227

    @ivanbonavick227

    23 күн бұрын

    I also cant use edge mode "Cannot execute because node CannyEdgePreprocessor does not exist", I have the same models than in the video

  • @JonasNoell

    @JonasNoell

    21 күн бұрын

    Try to check at TYflow support forums, I can’t give you technical support

  • @aagroupaagroup3917
    @aagroupaagroup391723 күн бұрын

    Does it work with free version of Tyflow ?

  • @JonasNoell

    @JonasNoell

    23 күн бұрын

    As indicated in the video: Yes

  • @skylarkstudio
    @skylarkstudio8 күн бұрын

    I guess its the end of vray and corona 😅

  • @slavchobrusev
    @slavchobrusev24 күн бұрын

    10x

  • @mehmetyigit2330
    @mehmetyigit233025 күн бұрын

    what components are in computer hardware?

  • @JonasNoell

    @JonasNoell

    24 күн бұрын

    RTX 4090 but you can use much cheaper hardware. Also I speeded up the image generation around 500% in editing.

  • @zedeon6299
    @zedeon629919 күн бұрын

    Blender already has this a year ago, it's not game changing

  • @charltonleonen8144
    @charltonleonen814420 күн бұрын

    back those days that your rendering should be based on your vray masters, but now this ai change the game, that's rediculous back then spending much time from your vray fuck masters!

  • @JonasNoell

    @JonasNoell

    20 күн бұрын

    I don’t think that much has changed, as the tools in their current state don’t produce final, controllable and consistent results. You would still have to set this up traditionally.

  • @aymanali5491
    @aymanali549125 күн бұрын

    I think Unwrapping is dead at least

  • @JonasNoell

    @JonasNoell

    24 күн бұрын

    It is just camera projection the image one the model, there are lots of issues as stretching and being dependant on the camera perspective. Unwrapping is not dead for sure, but I guess there will be AI unwrapping tools which will do the job in the future ;-)

  • @hamidmohamadzade1920
    @hamidmohamadzade192024 күн бұрын

    it's nothing but a peace of shit!!!!!!!! because it does not allow you to use your checkpoint . it even does not allow you to deselect the model you do not want to use for the download?!!!!!!!!! why should I have to download so many unnecessary things

  • @JonasNoell

    @JonasNoell

    24 күн бұрын

    Maybe have a cup of tea to chill out a bit? 😀

  • @TauranusRex
    @TauranusRex20 күн бұрын

    Interesting, how peopla with lack of knowledge can get blinded by an interpolation algorithm...

  • @JonasNoell

    @JonasNoell

    20 күн бұрын

    Can you enlighten me what am I missing?

  • @Brashenn
    @Brashenn24 күн бұрын

    I really don't see anything game changing about this.

  • @JonasNoell

    @JonasNoell

    24 күн бұрын

    For me it is gamechanging as before I didn't use ComfyUI/SD for my daily work as it was too troublesome to export everything, leave your 3d software, deal with the hacky user experience of ComfyUI, so apart from some simple initial testing I didn't use it much. Now with tyDiffusion that is different as it is integrated so seamlessly that you would be stupid to not use it at least during concepting phase or when figuring out how you want the end result to look like. It is not a One-Button-Final-Result thing but more like a image search engine on steroids which can give you much better and faster ideas and references than traditionally.

  • @Adam.Magyar

    @Adam.Magyar

    24 күн бұрын

    I agree. Not to mention the complexity of a single render setup. Also there are other AI generators out there which make something similar. Though I'm a paid tyFlow user I cannot see to much use cases... maybe a viewport IPR and / or an animation rendering mode would be a real game changer.

  • @Brashenn

    @Brashenn

    24 күн бұрын

    @@JonasNoell Im sorry Noel but I cant agree with you there. If I wanted some lovecraftian abstract approximation to life to know what something might maybe look like, I'd just sniff some shrooms. This is just the enshitification of your ability to imagine. I am yet to see anything spewed by these scrape generators that I can honestly say that is interesting to me. Plus the whole morality of using these generators in the first place. I hope you don't start putting out more content related to this.

  • @JonasNoell

    @JonasNoell

    24 күн бұрын

    I really struggle to see how you can NOT see any use case for this 😀 Did you watch the Release Trailer? It’s literally packed with Use Cases.

  • @JonasNoell

    @JonasNoell

    24 күн бұрын

    So you can’t even see this being useful as an inspirational tool? So I’m a full time lighting and shading artist and I’m confronted every project every day with a blank viewport filled with 3d models and some rough description of what the client wants. How would that not be useful to me? It’s basically reference search on steroids. The client wants a pirate ship made out of cheese? Just see what would come out of the AI and see how I would translate that into a 3d scene and shader? Good luck finding something like this on google. I think you assume it is a solution to just press a button and get something finished. It’s not like this. I really struggle to see how you can see 0 use case of this. Nobody is forcing you to make trippy drug trip animations, you can use it for whatever you want. Use it for what’s useful to you. I’m not saying it’s the be all and end all of traditional way of doing things, as of now it’s a tool that can be used and should be used. And if that becomes a valuable tool for me I will of course continue to make videos about it as I try to provide most valuable content to my followers out of a production perspective. How about you make a video how crappy and useless it is if that is your opinion. Would be interested to see your take on it.

  • @cyanide227
    @cyanide22724 күн бұрын

    AI is just a waste of time. ComfyUI does the same stuff. People are limited with models and they need to pay. PAY PAY PAY. AI in CGI is no go.

  • @JonasNoell

    @JonasNoell

    24 күн бұрын

    tyDiffusion uses ComfyUI in the backend, so yes it is the same stuff. The innovation is the direct and seamless integration into the 3d software, which at least for me makes it accessible. Didn't use it before through ComfyUI as it was annoying, slow, hacky but now through tyDiffusion I do and would be stupid no to. In CGI NOT experimenting with it would be a no go. If you literally can't see any usecases for this and it is and always will be a waste of time for you then I can't help you :-)

  • @Hung_Nguyen_90

    @Hung_Nguyen_90

    19 күн бұрын

    Maybe AI in CGI is no go but CGI in AI is the best way to go. Imagine someday we can create a box on the ground and type: "Bush", then create a Cylinder, animate it go pass the bush and type: "A male human wearing a suit". Then type for the whole scene: "A Male human walking next to a bush". I mean using 3D object and camera to guide everything is the best way to have control over AI image generator. If We want we could create a more complex scene by using low poly human model instead of a cylinder and actually animate him to do what you want. And If you want to go extreme, you could still make a complete model and animate it just like you do right now and use AI simply to render the scene very fast.

  • @SwordToothTiger
    @SwordToothTiger20 күн бұрын

    You job is to generate tonn of tasteless cg shit? Then it definitely complete your workflow.

  • @JonasNoell

    @JonasNoell

    20 күн бұрын

    Have you ever worked in professional production? 😀

  • @SwordToothTiger

    @SwordToothTiger

    20 күн бұрын

    @@JonasNoell yes, and I know that tonns sit is a result of so called "professional production"

  • @MrAsag
    @MrAsag23 күн бұрын

    🤮🤮🤮

  • @JonasNoell

    @JonasNoell

    21 күн бұрын

    Why you puke? 😀

  • @dubtube6691
    @dubtube669124 күн бұрын

    Cash cow for the developers, useless in a professional environment, still waiting for serious tools

  • @JonasNoell

    @JonasNoell

    23 күн бұрын

    Why everyone is always so sure that it is useless in a professional environment. In its current state it has many usecases already if you are creative about implementing it.

  • @FoulPet

    @FoulPet

    8 күн бұрын

    What are serious tools?

  • @mianokamuru6333

    @mianokamuru6333

    6 күн бұрын

    whats a ''professional environment''