ShanghaiTech Digital Human

ShanghaiTech Digital Human

Welcome to our KZread channel. Let's share our cutting-edge research about digital human with you!
We are the Virtual Reality and Visual Computing (VRVC) Lab from Shanghaitech University, led by Prof. Jingyi Yu and Prof. Lan Xu.

Пікірлер

  • @jbach
    @jbach12 күн бұрын

    Cool! What are the datasets Clay was trained on?

  • @NoobNoob339
    @NoobNoob33915 күн бұрын

    And as always, what is in the dataset? Were the models you took for yourselves and you're now going to make money off of ethically sourced?

  • @ilanlee3025
    @ilanlee302515 күн бұрын

    Crazy stuff

  • @elrossi96
    @elrossi9625 күн бұрын

    Great proyect guys. Really incredible. Plase, be careful with this tech, it is dangerous. Make it public plase so everybody can test it. Congrats to the team

  • @tamiopaulalezon9573
    @tamiopaulalezon957327 күн бұрын

    How can I download the app?

  • @fxguide
    @fxguideАй бұрын

    Great work really impressive.

  • @mousatat7392
    @mousatat7392Ай бұрын

    When the supplementary material will be released?

  • @Inferencer
    @InferencerАй бұрын

    Fantastic work! can we expect a July release?

  • @hoang_minh_thanh
    @hoang_minh_thanhАй бұрын

    Does this render in realtime?

  • @StephaneVFX
    @StephaneVFXАй бұрын

    very impressive ! Bravo

  • @SALAVEY13
    @SALAVEY13Ай бұрын

    wow! great level design)

  • @sahinerdem5496
    @sahinerdem5496Ай бұрын

    there is no eye work.

  • @Moshugaani
    @MoshugaaniАй бұрын

    I predict that this will be a huge technology for the movie industry!

  • @benajau
    @benajauАй бұрын

    Can't wait to see the code and play with it!

  • @rallyworld3417
    @rallyworld34172 ай бұрын

    So what is the driver? Image or video

  • @Aero3D
    @Aero3D3 ай бұрын

    Can we use it in Unreal Engine?

  • @DaveDFX
    @DaveDFX3 ай бұрын

    This is the future!

  • @dodeakim
    @dodeakim3 ай бұрын

    😍

  • @anyuanli4306
    @anyuanli43063 ай бұрын

    Another great step towards hi-quality motion capture!😉

  • @yurongling
    @yurongling3 ай бұрын

    Very good video, which makes me rotate

  • @altjasonspeed8447
    @altjasonspeed84473 ай бұрын

    The reconstructions of dynamic sports like skateboarding look marvelous!

  • @orennnnnnnn
    @orennnnnnnn3 ай бұрын

    Very impressive and informative thank you!

  • @bause6182
    @bause61823 ай бұрын

    Is your tool accessible, how to use it. I am really interested

  • @myelinsheathxd
    @myelinsheathxd4 ай бұрын

    Amazing progress

  • @Pixelsplasher
    @Pixelsplasher4 ай бұрын

    All outputs and no inputs. The input video and how it was taken has to be shown first.

  • @vincentchambin
    @vincentchambin4 ай бұрын

    After testing I can say that it's terribly bad.... Quality, accuracy of the shapes compared to the reference, everything is bad. Classic character artists are not about to be laid off ^^ All this development for that... While we really need high-performance retopology or automatic UV tools as a priority.

  • @DillonThomasDigital
    @DillonThomasDigital4 ай бұрын

    Can these composite into Google's recently announced 'SMERFS"?

  • @DillonThomasDigital
    @DillonThomasDigital4 ай бұрын

    This is awesome! This will remove the requirements for greenscreen, but directors/dp's will still need to "match lighting" to composite. I can't wait for this to release!

  • @bause6182
    @bause61823 ай бұрын

    the time savings we can have are incredible, you just have to shoot a video and incorporate your 3D model directly into the scene, no more need for motion tracking to integrate a flat video into the scenery. I can't wait to try

  • @unn357
    @unn3575 ай бұрын

    any demo online?

  • @f.b.1311
    @f.b.13116 ай бұрын

    Nice! But wtf was that last demo haha

  • @Danuxsy
    @Danuxsy6 ай бұрын

    neural driven games will reign supreme

  • @Razedcold
    @Razedcold6 ай бұрын

    This is very interesting, thank you for sharing!

  • @PrinceBrosnan
    @PrinceBrosnan6 ай бұрын

    Can you tell me how many cameras the source material was shot on?

  • @nickmarlow848
    @nickmarlow8487 ай бұрын

    incredible! Will this become publicly accessible soon? Would love to try this out! Are there any limits to the amount of cameras you have to use? And do the camera's need to be high end or would this work with any kind of camera quality? And what is the processing time for lets say 10 sec of 4d footage?

  • @imanboer
    @imanboer7 ай бұрын

    Wow 🥰🥰 this is incredible, when public test?

  • @imanboer
    @imanboer7 ай бұрын

    Wow amazing!! can we download the app on ios?

  • @karubrandao
    @karubrandao7 ай бұрын

    cant wait to the day we can render it through cloud like polycam and export it as a mesh to blender

  • @Q36BN
    @Q36BN7 ай бұрын

    Holy smokes. It's like a interactive video. Now, imagine recreating famous slo-mo scenes from The Matrix. Instead of hundred cameras mounted in a fixed position, creating only one jittery sequence, we got these gaussian splats. Incredible.

  • 6 ай бұрын

    You still need a lot of cameras for complete 4D 360 capture. GaSP can process only data it has, it wont generate which was not captured.

  • @Instant_Nerf
    @Instant_Nerf7 ай бұрын

    cameras around subject 360 degrees?

  • @theweirdshow2860
    @theweirdshow28607 ай бұрын

    This is amazing! 👏How do you even set something like this up?

  • @saemranian
    @saemranian9 ай бұрын

    Awesome!

  • @saemranian
    @saemranian9 ай бұрын

    Perfect 👌

  • @FrenchDigitalProduction
    @FrenchDigitalProduction11 ай бұрын

    Any way get access to test or it is only a student project looking for investor to keep developing?

  • @bruhager
    @bruhager11 ай бұрын

    This could revolutionize police identity sketch work.

  • @yunankkays3901
    @yunankkays3901 Жыл бұрын

    How can i use my face 2d face

  • @luciengrondin5802
    @luciengrondin5802 Жыл бұрын

    Are the neck vertebrae that important for identity??

  • @hoang_minh_thanh
    @hoang_minh_thanh Жыл бұрын

    Congraduation!

  • @TinNguyen-dg4zv
    @TinNguyen-dg4zv Жыл бұрын

    GOOD JOB!

  • @3Daver
    @3Daver Жыл бұрын

    Very interesting tech, but to claim it's artist free seems a bit of a falsehood and tells me you've never worked at a very high level production in film/games. The mouth shapes on some of the video based examples such as Joaquin Phoenix as the Joker, and retargeting to your head model looked really off and wouldn't get final animation approval. It would most certainly require an artist to fix and reshape the mouth.

  • @hoang_minh_thanh
    @hoang_minh_thanh Жыл бұрын

    Great!