Yannic Kilcher

Yannic Kilcher

I make videos about machine learning research papers, programming, and issues of the AI community, and the broader impact of AI in society.

Twitter: twitter.com/ykilcher
Discord: ykilcher.com/discord
BitChute: www.bitchute.com/channel/yannic-kilcher
LinkedIn: www.linkedin.com/in/ykilcher
BiliBili: space.bilibili.com/2017636191

If you want to support me, the best thing to do is to share out the content :)

If you want to support me financially (completely optional and voluntary, but a lot of people have asked for this):
SubscribeStar: www.subscribestar.com/yannickilcher
Patreon: www.patreon.com/yannickilcher
Bitcoin (BTC): bc1q49lsw3q325tr58ygf8sudx2dqfguclvngvy2cq
Ethereum (ETH): 0x7ad3513E3B8f66799f507Aa7874b1B0eBC7F85e2
Litecoin (LTC): LQW2TRyKYetVC8WjFkhpPhtpbDM4Vw7r9m
Monero (XMR): 4ACL8AGrEo5hAir8A9CeVrW8pEauWvnp1WnSDZxW7tziCDLhZAGsgzhRQABDnFy8yuM9fWJDviJPHKRjV4FWt19CJZN9D4n


Until the Litter End

Until the Litter End

Art @ NeurIPS 2023

Art @ NeurIPS 2023

Пікірлер

  • @Foss98
    @Foss98Күн бұрын

    Its great seeing how you point out that most of these linear improvements are not mathematically exact representations. But I wonder whether the inherent error introduced is worth it for performance increases.

  • @PRAKASHFEB
    @PRAKASHFEB2 күн бұрын

    Thanks for simple explanation

  • @fhub29
    @fhub293 күн бұрын

    Finally I understood the logic behind VAEs and the reparameterization trick. Thank you so much. I failed at getting it during Deep learning lectures but KZread saved my *ss. What a time to be alive.

  • @bhaskarpandey8586
    @bhaskarpandey85863 күн бұрын

    Am i the only one who didnt understand shit from his explanation.

  • @laurentvit3117
    @laurentvit31173 күн бұрын

    Duuuude i'm learning NERF, and this video is a jewel, thank you! <3

  • @user-bz5be9bj4k
    @user-bz5be9bj4k3 күн бұрын

    Really appreciate your explaining, very helpful. Now I see the alignment process as widening the upper part of the Y shape: x with y_w to y_l. Thanks!

  • @86Corvus
    @86Corvus3 күн бұрын

    Its massively racist against white men. and so is google.

  • @aquietone2895
    @aquietone28953 күн бұрын

    Either you're doing it again on /v/ or we've got copycats now. Thank you for your contribution to disrupting communication.

  • @anthonyrepetto3474
    @anthonyrepetto34744 күн бұрын

    26:53 - "I have a different suspicion of why all of this, or any of this might work... there's a lot of things carried by the residual connections... you have a completely pass-through path..." BOOOoOOOM!

  • @simaogoncalves1957
    @simaogoncalves19575 күн бұрын

    16:12 Not sure I follow the intuition behind supervised fine tuning not being able to penalize the “wrong” token that is opposite to what we want the model to mimic. I’m confused because in my view the wrong, but highly probably token, contributes more to the loss so it will be penalized heavier than the more meaningless, random output, tokens. Can someone clarify this for me?

  • @googleyoutubechannel8554
    @googleyoutubechannel85545 күн бұрын

    It's so embarrassing these execs are all still using twitter to communicate, it just leaves such a amateur hour and sort of edgelord feel to everything.

  • @robosergTV
    @robosergTV5 күн бұрын

    why not host a 7B model on HuggingFace?

  • @fotisj321
    @fotisj3215 күн бұрын

    When I subscribed to this channel it had one of the best selection of relevant AI papers paired with their analysis outlining the important thoughts. So it was a cool way to stay ahead of some broader research trends. Now it is becoming one channel more for AI related business news. This certainly mirrors an unhealthy development which Yannik has repeatedly mentioned: AI moved in the last 18 months from an open research field to a business field with competing companies using tech information mainly as marketing tool. But the intellectual emptiness of all this is tiresome. It would be great to get more scientific content again. And as long as there is no way around the commercial llms, maybe reports on rigorous tests and similar research is a good counterweight against the stream of marketing hysteria. I seriously miss the old channel.

  • @mariolinovalencia7776
    @mariolinovalencia77766 күн бұрын

    Is the time 1d conv also a multi channel conv or they convolve each feature map with a single filter ?

  • @furyzenblade3558
    @furyzenblade35586 күн бұрын

    Auto generated chapters that might be inaccurate but maybe still helpful: Srun (1:26): A tool to copy a directory to a server via SSH, run a script, and then copy back a directory called logs. Rat (Experiment Management System) (2:26): Manages experiments by using a worker to listen for new tasks, pull code from MongoDB, and run jobs on GPUs when they are free. Includes hyperparameter optimization and integrates with TensorBoard. Yplot (5:31): A plotting library that works with TensorBoard events, extracting and smoothing data. Ypack (6:02): A set of routines for working with Torch and TensorFlow. Confprod (Configuration Product Generator) (6:23): Generates cross-products of experiment configurations. Fountain (7:15): A dataset library for downloading and extracting datasets like CIFAR-10. Arxivciter (8:12): A plugin to scrape Google Scholar for citation entries directly from arXiv articles. Textools (8:31): An unsophisticated tool for continuous compilation. Arxivget (8:37): Scrapes arXiv to read new papers every morning. Patternhs12 (9:17): An implementation of SVM classifiers, including linear, polynomial, and RBF kernels, from a pattern recognition class.

  • @petemoss3160
    @petemoss31606 күн бұрын

    8:55 BOTTOM-UP-AI ... Alicization arc confirmed!

  • @rolo5782
    @rolo57826 күн бұрын

    Anyone who titles their videos like a fact checker deserves to be judged.

  • @aaronramirez351
    @aaronramirez3517 күн бұрын

    I really liked this video's takes, until we got to the Skye situation. In the OpenAI blog post which you referred to in the video, they themselves stated that they were cast and recorded the ChatGPT voices over the summer, which lines up with them being released to ChatGPT Plus subscribers in September. So when they reached out to Scarlett, the Skye voice had already been created. They could be lying about their timelines, but I'm inclined to believe them because I, and many other plus users, first heard Skye's voice in September when the feature first rolled out to us. You seem to have very interesting / insightful videos as a whole, so I'm a little surprised that you missed this detail, especially since you did a pretty good job of covering both the optimistic and cynical takes.

  • @AxelLenz
    @AxelLenz7 күн бұрын

    Really??? What a waist of time…

  • @CyberWorx
    @CyberWorx7 күн бұрын

    Without you I would struggle to understand these papers. Thank you

  • @hibou647
    @hibou6477 күн бұрын

    What if the tone is like in the movie Her? Then you can't do it in real life? So we can't build space ships because Star Wars would sue? Or flyng skate boards because Back to the future would sue? Also why is SJ the one suing? Does she have the rights to the AI character in Her? I get that she woule want to protect her voice, but the idea that she would gate keep a concept, enthusiastic/flirty AI, is ridiculous. By the way I don't think flirty AI is a good anyways so this is not me stanning openAi 😅

  • @Arbitraritorian
    @Arbitraritorian8 күн бұрын

    ScarJo has apparently trademarked the female voice. All other women should keep quiet.

  • @TheBeatle49
    @TheBeatle498 күн бұрын

    Horrible paper. Riddled with hand-crafting which it is supposedly replacing!

  • @SudheendraRao26
    @SudheendraRao268 күн бұрын

    time for a spinoff coming from OpenAI, that's what I see, that which is out of closet and overtly commercial, that way, research can go on in left over brand.

  • @maithiliseemakurthi237
    @maithiliseemakurthi2378 күн бұрын

    Petition to replace reviewers with AI

  • @MegaNightdude
    @MegaNightdude8 күн бұрын

    Yeah. Hogwash. That's what these concerns about superintelligence are. At least for now

  • @SmirkInvestigator
    @SmirkInvestigator9 күн бұрын

    I miss Sky. About alignement, i think there should be research on how to control and align ongoing in parallel but agree we are nowhere near having to worry about implementing it. And it shouldn’t be a blocker in development or deployment. Bad actors will figure out how to get ai powered weapons. There is no stopping that. And that will happen waaay before a rogue AI is possible.

  • @zacboyles1396
    @zacboyles13969 күн бұрын

    16:28 There’s an argument that the AI Safety grift was the first monetization round. Given no “AI Safety” ever mention things like the dangers of prosecuting journalists and whistleblowers across the west, they are worse than useless.

  • @woolfel
    @woolfel9 күн бұрын

    when I saw the demo, my first thought was "sounds a lot like scarlet". what is messed up is Sam is obsessed with "her" and decided to go ahead and copy her voice. I think of it this way. If it was my daughter, how would I feel about a creepy AF tech bro making a voice like my daughter. Sure he isn't going to play some creepy voice fantasy with this voice. when scarlet rejected Openai, they should have stayed clear and just chosen something unique.

  • @davidhauser7537
    @davidhauser75379 күн бұрын

    yannick can you please do xLSTM paper?

  • @tusharprakash6235
    @tusharprakash62359 күн бұрын

    In inner loop, for more than one step the gradients should be computed wrt initial parameters right?

  • @shApYT
    @shApYT9 күн бұрын

    Superalignment is a myth. Human values include eliminating other human competitors.

  • @bisalKhariay-ln4em
    @bisalKhariay-ln4em9 күн бұрын

    The more I learn about Revux, the more I believe in its vision.

  • @PulindarKumar123
    @PulindarKumar1239 күн бұрын

    Qventi is everywhere now, just like Revux was.

  • @opprosenyt4735
    @opprosenyt47359 күн бұрын

    I see Revux as a long-term hold. Great fundamentals!

  • @anujdeuri287
    @anujdeuri2879 күн бұрын

    If you're looking for a solid x100, Revux should be on your radar.

  • @arjunsharma2727
    @arjunsharma27279 күн бұрын

    Revux's use case is exactly what the crypto world needs.

  • @Nisha0831
    @Nisha08319 күн бұрын

    Shopify partnership puts Revux on the map. Big boom incoming!

  • @Nitinkhichar
    @Nitinkhichar9 күн бұрын

    Dropped all my small caps - focusing on BTC, Revux, and maybe some ETH.

  • @DeepakKumar-jj9kj
    @DeepakKumar-jj9kj9 күн бұрын

    Just shifted my focus to presales, especially Revux. Early investment is key!

  • @user-oz2lk9eq2j
    @user-oz2lk9eq2j9 күн бұрын

    Revux is making moves quietly. Keep an eye on it!

  • @icanhasutoobz
    @icanhasutoobz9 күн бұрын

    13:00. I don't buy for a second that Altman was not well-aware of this onerous provision. Gaslighting prick. Also, alignment is less of a problem if _integrations_ are undertaken carefully, and with failsafes in place. In other words, *just don't integrate it with critical systems* without ways to _disintegrate_ it from them in ways that the AI systems themselves have no control over. Not that alignment isn't important, but it's just f'ing stupid to *not* approach all integrations carefully, and with worst-case scenarios accounted for. The SJ voice thing is bad faith, whether its a reproduction of her voice or not. Whether or not they legally can is beside the point. Just because you _can_ doesn't mean you _should_.

  • @Ben_D.
    @Ben_D.9 күн бұрын

    Everyone and their mother is suing OAI. 🙄 They are controversial and have deep pockets, so people find excuses, even bad ones, and jump on the dog pile.

  • @Hash_Boy
    @Hash_Boy10 күн бұрын

    openai все больше напоминает волка в овечьей шкуре, хитрого и беспринципного

  • @transquantrademarkquantumf8894
    @transquantrademarkquantumf889410 күн бұрын

    I've come to the conclusion over the years that many people talk in code they'll be talking about one subject that has in some way to touch base about another subject when the reality is they're trying to discuss a certain series of things that they don't want to talk about as a direct identification an example of this is dealing with the dangers to ai and the dangerous to the companies themselves among these were looking at the ability to mass track cyberattacks literally worldwide but if we just focus on the United States there's 1.4 billion attacks per day there's 10 trillion dollars a year in damage occurring in the United States Europe effectively has the same problem they have a 10 trillion year damage from cyber attacks occurring in Europe the ability for large AI systems to use very few specialized hubs to triangulate which buildings are housing these these Mass cyber-attacks systems could be done in a very short period of time I know this because I explored it myself with chat GPT working with the mathematics and the styles and certain types of security procedures to be able to quickly identifyan effectively be able to install 20 custom hubs in the United States and in 30 days effectively triangulate where 80% of the attacking servers would be located please keep in mind that we're talking about companies that are gray buildings that nobody really knows what they do that for some reason have hundreds of thousands even a million computers operating that basically are dedicated to doing cyber attacks the simplistic reality of the statistics of 1.4 billion attacks a day occurring in the United States that were also at least 1.1 billion attacks of origin from the United States brings about a series of mathematics that we're talking about millions of computers dedicated to mass attacks there's simply no way around this and thus the reality that some companies are concerned that they have capabilities to bring forth Mass Justice actions means that their leadership and companies themselves could be in danger from criminal elements very well funded. Additional testing that I've done with open AI computers is to check the accuracy of how fast they can identify misconduct and felony behavior out of government employeesthis effective research is a key part of the presidential campaign that I was running from 2008 in which basically a company such as AI being dedicated stepping out into an ethical analyzation of the country could effectively bankrupt the federal government and every state by apprehending all criminal conduct behavior in less than 30 days the statistics are actually realities and we have many people in government that are afraid and we also have many people in the industry that finally understand some of these aspects that are also concerned about making clear that somehow they were take no part in any form of ethical behavior which could deal with the retrieval of information involving Mass felony conduct by government employees or elected officials. This effectively is the secret attitude of many people who are cowardly and afraid that for some reason that their family and friends might be killed buy these governmental corrupt entities and their private backers. This of course is ridiculous because the reality of SAR satellite technology has been able to track a blade of grass since 2008 at about 30 frames a second upgrading to 60 frames a second by 2011 this effectively means that just with the satellites already in place every citizen in the nation as well as most parts of the world have a satellite looking at them and recording at least 70% of the signature that they reflect as they go through life obviously some people would argue that it's closer to 90% since you have satellites overlapping in many territories which is true as well. However frankly the reality that there is no escape because of the mass deployment of this technology add its current point means basically that nobody should be afraid are these criminal and unethical types because there's no escape for them not when SAR satellite technologies involved. Thus again we have the ability for Mass conversion of information from satellite that can also track criminal activity rapidly so there are many people that are afraid of the masses of people that are frankly ignorant and dangerous even to themselves. Hero of now mentioned a couple things that are kind of the hidden elephant in the room the many people don't want to deal with. But enough of this great show by the way

  • @hurktang
    @hurktang10 күн бұрын

    Yeah, sorry Yannic, but Scarlett's voice is just a normal female voice. "Sounding identically like" Scarlett is 100% legal as long as her name and image is not mentioned in the product. The only reason why Sky as been removed for a while it's because it's probably instructed that it is an female AI. and It saw the movie Her in the database. But there is no legal case there.

  • @TobeFreeman
    @TobeFreeman10 күн бұрын

    Yup...

  • @alivecoding4995
    @alivecoding499510 күн бұрын

    The Age of Surveillance Capitalism, in which OpenAI takes a major role nowadays. As the NYT reported, their product would not exist without accessing data they had no right to.

  • @alivecoding4995
    @alivecoding499510 күн бұрын

    I really do not agree that we are far and safe from seing dangerous super AI. And seeing researchers leave should makes us concerned.

  • @Hexanitrobenzene
    @Hexanitrobenzene10 күн бұрын

    The real problem is that we do not know how far we are. Solving alignement is very difficult and it makes sense to work on it as early as possible.

  • @alivecoding4995
    @alivecoding499510 күн бұрын

    What about GPT5?