If your new version doesnt show up, just install another version of forge on different folder and go back to the version from the video that has that tab, I explain it here kzread.info/dash/bejne/dHqHptWGqsLbdZM.html I got the checkpoint model for SVD from here civitai.com/models/207992/stable-video-diffusion-svd Remember it can generate at 1024x576px or 576x1024px, you can use bigger images when you upload but try to keep them same size. It can generate 4 seconds video, you probably can get the last frame and get a continuation of it for another 4 seconds and so on. You need like 6-8 GB of VRAM. I used Stable Diffusion Forge UI If you want to learn more about AI or have questions join my facebook group facebook.com/groups/pixaromacommunity

@nietzchan

4 ай бұрын

Still can't get it to work in Forge. I don't know what I'm doing wrong, does it have to use SD 1.5 checkpoints and VAE first? Tried using Animagine XL 3.1 with XL VAE for the initial image feed and running SVD just sent me to BSOD

@pixaroma

4 ай бұрын

@@nietzchan it need a lot of video ram so many that why is crashing. It just need a photo on that that size 1024*576px and work with that svd model to generate, if it crash probably your video card can not handle it

@nietzchan

4 ай бұрын

@@pixaroma I think my forge installation have memory management issues, or probably the something wrong with the unet setting. I managed to run it once when I'm just running SVD, but the second time it just crashes. I'm currently using 12gb 3060 and 16gb ram, and I think the bottleneck is actually the ram when Forge is automatically load models to ram on start. I want to try offload from vram options and see if it helps.

@nietzchan

4 ай бұрын

Confirmed, I need more vram. Tried to use the offload models from vram args so SVD have plenty of room in GPU. I'm using RTX 3060 12gb despite SVD only uses around 8gb of vram the Forge backend still have the image diffuser model in vram, resulting in OOM on my GPU. the offload args works, but instead it didn't offload the SVD models once you generate video. So I'm back to square one after each generation. Oh well.

@pixaroma

4 ай бұрын

@@nietzchan sorry it didnt work, usually they make it less vram consuming in time, so in a few months maybe we have better models and systems

Nice tutorial; I enjoy the animatediff extension I get really good and consistent results using it!

@iangillan1296

2 ай бұрын

where do you use it? In comfy? I installed AD inside Forge UI, and there is now any changes, AD didn't appear

Great video, subscribed. Keep making great content.

very good content, i apreciate it. keep it like this

Thank you for the video using forge. Please make more video using forge since this is the only gui I can run SDLX model on my low end RTX 2060 6VRam PC.

@pixaroma

5 ай бұрын

Sure, i also have an older computer with same video card and with forge i managed to get it to work, but even on my new rtx4090 seems to work better, so for a while i will do only forge, unless automatic 1111 ad something that forge can't do :)

Very cool! Wish i had the hardware to run it!

Thank you for this tutorial

Thanks! Another good tutorial video!

@pixaroma

5 ай бұрын

Thanks :) glad you like it

Awesome tutorial. Keep up the great work

@pixaroma

5 ай бұрын

thank you :)

Thanks ! Yes shame about the lack of settings for the SVD output path. It'd be great to have camera movement and prompt guidance like on Deforum but with consistence of SVD. Soon I'm sure ;)

Thanks!

cool stuff. thank you

Nice one!

Great, thanks a lot.

my Stable Diffusion Forge does not have SVD I tried downloading again and the SVD still didn't appear. :(

@pixaroma

17 күн бұрын

Did you try the last stable version because the new updates mess up a lot of things kzread.info/dash/bejne/hI5-rMGToqu1k5M.htmlsi=1d9jphW2PuLB0RK6

@pixaroma

3 күн бұрын

check this video How to Install Forge UI & FLUX Models: The Ultimate Guide kzread.info/dash/bejne/dHqHptWGqsLbdZM.html

I'm trying to utilize SVD on my GTX 1660 Ti, but it doesn't seem to be working. I'm encountering error messages.

@pixaroma

2 ай бұрын

Maybe I don't have enough vram your video card , not sure, for me it worked with those settings

Thanks for the video. I use Comfy, although I generate with the same settings as you show, my results are very noisy, it has grain all over it. Is it related with Comfy itself, I don't know.

@pixaroma

Ай бұрын

Not sure, I will play more in the coming months with comfyui

@mert5809

Ай бұрын

@@pixaroma I was using tiled upscale for the image, I realize it affects svd output quality in a bad way. Just leaving a little tip for others.

Great video, question for you, my GPU has 24 GB but the software is only showing the dedicated 8 GB, trying to figure out how to make sure it is utilizing all 24 GB. I tried more frames and Task Manager shows that it taps into the shared GPU so maybe I just am over analyzing it. (RTX 3060Ti for reference)

@pixaroma

Ай бұрын

Depending on what you give it to do it will use more VRAM don't worry, if I have big images or doing video it will need more vram so it will use more. It takes what it needs in that moment. I have 24 gb of vram it takes like 4-5 sec to generate a 1024px image

@woodtech1951

Ай бұрын

@@pixaroma thanks for the quick reply! So does that mean I could possibly increase the WxH of the output video?

@pixaroma

Ай бұрын

@@woodtech1951 unfortunately that model only work with that size, so if you increase will not work. Is better you just use an upscaler after like topaz video ai or something. For images you can increase but for that specific video model you can not. Is an old model and didnt find a better version yet :( you can take a look at luma ai for image to video, is better then this, you have like 5 videos free, or runwayml version3, i rarely use this model anymore because it doesnt have to much motion. I am playing more with comfyui and there I have more options for animation, as i learn more about it I am doing more tutorials for it

HI. In the downloaded template of dtable diffusion, there is no SVD option, what can I do?

@pixaroma

12 күн бұрын

Did you tried a stable version kzread.info/dash/bejne/hI5-rMGToqu1k5M.htmlsi=kLp0fpY5boKvYImP

@onlineispections

12 күн бұрын

@@pixaroma hello, I did ungrade to 29be1da7cf2b5dccfc70fbdd33eb35c56a31ffb7 but it does not have the VSD in the interface. do you know another method to download a stable diffusion with VSD with comango.git?

Great video! Do you know if forge or any other UI like this has the capability of inpainting a certain section of your image, so that only that inpainted portion gets animated?

@pixaroma

3 ай бұрын

I don't know any, only some online platforms saw it has some motion brush, but didn't saw any to have in stable diffusion yet

@Yoshikibeats

Ай бұрын

Only with confy ui

Mine creates a video in the folder: \Stable Diffusion Forge\webui\output\svd which is the same output folder where you have img2img and txt2img at.

@pixaroma

3 ай бұрын

I didn't use it for a while but i think i put in settings all the paths to lead to the same folder

Excellent video you got a new sub. Question, can you explain to me how the seed # system works on the SVD tab? It appears that incrementing the seed # changes the output each time, I get that, but why would you want to retain a particular seed #?

@pixaroma

3 ай бұрын

You will get same result on same seed if you are using the same image, but if you change the image the animation will be different, you just use seed to get different animations but you dont actually have control on the animation, at least this is my understanding of it

thank you for the video! I've not svd folder on webui > models. Why?

@pixaroma

3 ай бұрын

it should be there since you installed forge ui, maybe you have other UI or something like A1111? not sure what to say

Brother i got this error any help please: raise FFExecutableNotFoundError( ffmpy.FFExecutableNotFoundError: Executable 'ffprobe' not found

@pixaroma

3 ай бұрын

Is possible to need to install ffmpeg , i didn't had that error yet

So you can't have a prompt for "how" you want it to animate or move?

@pixaroma

4 ай бұрын

no, is all based on the image, maybe they fix that in the future

Which stable diffusion model firge ui download because I don't see the svd option. Hrazie

@pixaroma

20 күн бұрын

I had one that started with commit that start with 29

@onlineispections

13 күн бұрын

Do you have a link to download the one as file.bat?​@@pixaroma

I get the error message "attribute error; none type object has not attribute set manual cast" I upload an image from my computer. I don't know how to correct this error. Thank you

@pixaroma

4 ай бұрын

Did you use exact same settings? Also make sure the image size is the same like in the video, if not resize it. There are some bugs when you are using a width and height that is not divisible with 64 so maybe that can fix it

I seem to get a bit closer to animation using this. I have tried the animatediff but all I get is a still image. When I click generate with the SVD module I can see a progression bar but then I get Error. Is this because I did the one click download of Forge as that may be the issue with animatediff, or is it possible that I just don't have the right amount of vram. I have NVIDIA GeForce GTX 980 Ti

@pixaroma

2 ай бұрын

I think you need more then 6gb of vram, usually rtx cards with 8gb or more work better. I saw another comment saying that 6bb gave an error

@WizzardofOdds

2 ай бұрын

@@pixaroma Thanks, I guess I need an upgrade. Your videos are very helpful.

How do websites like leonardo make it so it looks like the wings on a fly are flapping for example? I'm having a hard time generating a high quality video like that from svd its super grainy

@pixaroma

3 ай бұрын

not sure what kind of models they are using, probably if you generate a lot of them some of them would have more interesting movements, other AI I saw it have brushes control that paint and tell what to move in the image, so have more control. Or like with SORA when will be reclassed with prompt that can tell what to do

how can add a prompt to video, if i want make specific videos?

@pixaroma

4 ай бұрын

this one only works with images, so you can generate a text to image first then use that image to make the video, doesnt know text to directly video

Is anyone else having an issue with "RuntimeError: Conv3D is not supported on MPS"? Some people on github said it might be something to do with the pytorch version, but I think mine is the right version.

@pixaroma

5 ай бұрын

I didnt got that error, but from what I found online that seems to be related to the macOS and apple processors. So what seems to be the problem with the error you're encountering is due to PyTorch's Metal Performance Shaders (MPS) backend not supporting the Conv3D operation on Apple Silicon (M1, M2, etc.). I am on windows so not sure what that does means, but maybe it has more sense to you, so probably pytorch doesnt support the apple proccesor how it should, yeah that suggest updating the pytorch but that will work only if they included that support for processor.

Hello. I installed stble diffusion, I downloaded stableVideoDiffusion_img2vidXt11.safetensors, inserted in SVD, but I don't see the SVD option on the home page, why?

@pixaroma

20 күн бұрын

Not sure what could be the cause, i didn't use it in the last 5 months. Are you using forge or other version,mayne you have automatic1111 instead of forge ui, or maybe you updated to another version that doesn't have that tab. Usually svd tab should be already there even if you didn't added the model

is this the best SVD or there are other recommended models we can try

@pixaroma

5 ай бұрын

for stable video diffusion I didnt find a better one, stability ai released just one model for video, compared to the image model that released more then one

how to install it in forge ui?

@pixaroma

3 күн бұрын

I just revert it to a older version that has that svd, you can install it on separate folder and just have that older version kzread.info/dash/bejne/dHqHptWGqsLbdZM.htmlsi=v9zBYtWpLJuAfidm&t=984 i created a bat file that go back to that version see in the video @echo off set PATH=%DIR%\git\bin;%PATH% git -C "%~dp0webui" checkout 29be1da7cf2b5dccfc70fbdd33eb35c56a31ffb7 pause

For some reason I don't see the Train, svd, or z123 tabs in my forge ui install. I'm sure I have the latest install. Anybody know what the problem is?

@pixaroma

18 күн бұрын

Latest install probably is not the stable version that i use, i have a video on the channel with downgrade or update forge, i use the version with commit that start with 29

@olternaut

18 күн бұрын

@@pixaroma I'll have to look for it. Then again, even though auto1111 is slower, it seems at least to be more stable. When ForgeUI gets their act together I'll check it out again.

@pixaroma

18 күн бұрын

@@olternaut well the problem is that was not updated officially and all the new version will might brake your forge. That why i switched to comfyui. A1111 is a little slower but also i have to wait for updates when something new appear like sd3 and so on, and in comfyui i have it next day. kzread.info/dash/bejne/hI5-rMGToqu1k5M.html

@olternaut

17 күн бұрын

@@pixaroma I hear what you're saying. But comfy seems to be needlessly complex. It's like Dad yelling at me to do my homework and I begrudgingly get to it after dragging my feet. lol

@pixaroma

3 күн бұрын

check this video How to Install Forge UI & FLUX Models: The Ultimate Guide kzread.info/dash/bejne/dHqHptWGqsLbdZM.html

does the checkpoitn matter??

@pixaroma

3 ай бұрын

I think so, this one works with this settings but others might have other recommended settings

the snow overlays were not created with sd I guess?

@pixaroma

5 ай бұрын

No, it is just a snow overlay video

Doesn't work for me, animated images are just being elongated or squished with some corruptions, instead of those cool animations you've showed. I use your dimensions and a model from link. Why?

@pixaroma

2 ай бұрын

Not sure what to say maybe they changed something since i made the tutorial, if that happens with every image you use i cannot find an explanation

@dziku2222

2 ай бұрын

@@pixaroma Sorry to bother, but it looks really interesting and I would like to get it running - maybe the cause of error is simple for someone far more experienced than me. I've discovered that it works normally when I'm using baseline realistic visions model that comes together with ForgeUI - but not when I'm using something generated with old SD1.5 models like abyssorangemix

my Forge UI does not have SVD tab !!!

@pixaroma

7 күн бұрын

The latest version doesn't have it anymore only if you put an older version, the version i used then was on wirh a commit that start with 29

@pixaroma

3 күн бұрын

check this video How to Install Forge UI & FLUX Models: The Ultimate Guide kzread.info/dash/bejne/dHqHptWGqsLbdZM.html

@twd2

3 күн бұрын

great thanks 😍!!!

fam I wanna know about that A.i voice DOPE!! Vid

@pixaroma

4 ай бұрын

I am using VoiceAir ai

@Kevlord22

3 ай бұрын

Its good, since until i read this, i had no idea its was ai voice. pretty cool.

can we do batch render?

@pixaroma

5 ай бұрын

I didn't find an option for video, so I don't think it is possible or I didn't find it.

@idolgalaxy69

5 ай бұрын

@@pixaromathanks~ you tutorial is great and clear~

✨👌😎🙂😎👍✨

the worse thing that I can't really control it :( would be greate if I could add prompt, masks and etc, like in different SD tools

@pixaroma

5 ай бұрын

Yeah I understand, hope they improve it in the future, now it is all random and needs a lot of tries to get something nice. But 2 years ago image generators were basic, so probably video get better, just needs time

@snatvb

5 ай бұрын

@@pixaroma yep, I agree :)

still ran out of memory with these exact settings on 8gb vram

@pixaroma

4 ай бұрын

I don't have 8gb to test it, but online said it could work, sorry to hear it doesn't work :(

@lowserver2

4 ай бұрын

sorry, i tried again after restarting forge and it did work. However, i cannot get good results yet. It mostly wants to do panning and the stuff outside the original pic becomes all distorted, so idk.@@pixaroma

@pixaroma

4 ай бұрын

Try different seeds until you get one that works, unfortunately we dont have control, hope in future models they fix that

@pixaroma

4 ай бұрын

@@lowserver2 try also using images that doesnt touch the edge, like is not cropped, so if you have a portrait make sure it has some space, then it can rotate that without distorting, if is on edge it tries to extend that and can fail

299 one time payment for topaz but at least it’s a onetime payment ❤

@pixaroma

3 ай бұрын

I think I got it on black friday it was cheaper then :)

Such a piece of crap extension. I create one Video, VRAM gehts filled, Video is finished, VRAM stays full -> OOM when trying to create the next video. So, restarting SD after every video creation. How stupid.

@pixaroma

2 ай бұрын

It needs a lot of vram or you can't do much with it

@retikulum

2 ай бұрын

@@pixaroma Huh? No, like I said: 1st video works, 2nd video OOM because the vram is still full from the first video. It doesn't get flushed. pytorch keeps the vram reserved.

@pixaroma

2 ай бұрын

Yeah is possible to not work how it should with ram, but if you have more it never gets full so it still works, never crashed on 24vram, but still seems to be an old version and didn't saw a new one that work for stable diffusion so i keep using that one, i am waiting for Sora or alternatives

3:08 yes seed like million variable. some complete grap. tells what AI actually do. programmed todo. not any intelligence. it will not create rabbit unless trained data has rabbit and it will be same rabbit for those prompt words. it works good with this robot bcos training data have many images from this robot. it did not work good for picture of man and face swapped myself. background move if find seed but "me" not change at all LOL got so bored first attempt worked but rest did not lol lol all that waiting to get grap! cant even choose render frame 7 without make video or render mulltip images using different seeds so can choose. seed is like motion from 1 trained clip. it will do exact that if your image match(trained todo no AI) seed 1 could me pan left seed 2 could be pan right ..etc what we learned? AI result need be checked. dont make skynet and plug it to red button(it will push red button if it programmed todo it) but if human check result and human push red button not AI. then we not have skynet. just AI (tool)(automated instructions like i say)

@pixaroma

4 ай бұрын

Well in this case since is based on a image, the image is the variable, you can have infinite unique images for input. And yeah is not a Ai that we see in the movie is a trained model that do what is trained and knows only that for now.

SVD is so boring, it`s background light motion basically.

@pixaroma

4 ай бұрын

Yeah, definitely needs more work

@ranjithgaddhe9818

4 ай бұрын

SVD has better orbit camera motion I have tried Other models not even making tracking well .. but SVD still need more training for better results

Thanks!

Hello. I installed stble diffusion, I downloaded stableVideoDiffusion_img2vidXt11.safetensors, inserted in SVD, but I don't see the SVD option on the home page, why?

@pixaroma

20 күн бұрын

I have this version: Commit hash: 29be1da7cf2b5dccfc70fbdd33eb35c56a31ffb7 you can see here how you can switch between different versions kzread.info/dash/bejne/hI5-rMGToqu1k5M.html