ShanghaiTech Digital Human
ShanghaiTech Digital Human
Welcome to our KZread channel. Let's share our cutting-edge research about digital human with you!
We are the Virtual Reality and Visual Computing (VRVC) Lab from Shanghaitech University, led by Prof. Jingyi Yu and Prof. Lan Xu.
Пікірлер
Cool! What are the datasets Clay was trained on?
And as always, what is in the dataset? Were the models you took for yourselves and you're now going to make money off of ethically sourced?
Crazy stuff
Great proyect guys. Really incredible. Plase, be careful with this tech, it is dangerous. Make it public plase so everybody can test it. Congrats to the team
How can I download the app?
Great work really impressive.
When the supplementary material will be released?
Fantastic work! can we expect a July release?
Does this render in realtime?
very impressive ! Bravo
wow! great level design)
there is no eye work.
I predict that this will be a huge technology for the movie industry!
Can't wait to see the code and play with it!
So what is the driver? Image or video
Can we use it in Unreal Engine?
This is the future!
😍
Another great step towards hi-quality motion capture!😉
Very good video, which makes me rotate
The reconstructions of dynamic sports like skateboarding look marvelous!
Very impressive and informative thank you!
Is your tool accessible, how to use it. I am really interested
Amazing progress
All outputs and no inputs. The input video and how it was taken has to be shown first.
After testing I can say that it's terribly bad.... Quality, accuracy of the shapes compared to the reference, everything is bad. Classic character artists are not about to be laid off ^^ All this development for that... While we really need high-performance retopology or automatic UV tools as a priority.
Can these composite into Google's recently announced 'SMERFS"?
This is awesome! This will remove the requirements for greenscreen, but directors/dp's will still need to "match lighting" to composite. I can't wait for this to release!
the time savings we can have are incredible, you just have to shoot a video and incorporate your 3D model directly into the scene, no more need for motion tracking to integrate a flat video into the scenery. I can't wait to try
any demo online?
Nice! But wtf was that last demo haha
neural driven games will reign supreme
This is very interesting, thank you for sharing!
Can you tell me how many cameras the source material was shot on?
incredible! Will this become publicly accessible soon? Would love to try this out! Are there any limits to the amount of cameras you have to use? And do the camera's need to be high end or would this work with any kind of camera quality? And what is the processing time for lets say 10 sec of 4d footage?
Wow 🥰🥰 this is incredible, when public test?
Wow amazing!! can we download the app on ios?
cant wait to the day we can render it through cloud like polycam and export it as a mesh to blender
Holy smokes. It's like a interactive video. Now, imagine recreating famous slo-mo scenes from The Matrix. Instead of hundred cameras mounted in a fixed position, creating only one jittery sequence, we got these gaussian splats. Incredible.
You still need a lot of cameras for complete 4D 360 capture. GaSP can process only data it has, it wont generate which was not captured.
cameras around subject 360 degrees?
This is amazing! 👏How do you even set something like this up?
Awesome!
Perfect 👌
Any way get access to test or it is only a student project looking for investor to keep developing?
This could revolutionize police identity sketch work.
How can i use my face 2d face
Are the neck vertebrae that important for identity??
Congraduation!
GOOD JOB!
Very interesting tech, but to claim it's artist free seems a bit of a falsehood and tells me you've never worked at a very high level production in film/games. The mouth shapes on some of the video based examples such as Joaquin Phoenix as the Joker, and retargeting to your head model looked really off and wouldn't get final animation approval. It would most certainly require an artist to fix and reshape the mouth.
Great!