Transforming AI | NVIDIA GTC 2024 Panel Hosted by Jensen Huang
Ғылым және технология
The Transforming AI panel from GTC 2024 features the authors of “Attention Is All You Need," the groundbreaking paper that introduced the transformer neural network architecture. Transformers have since dominated all areas of AI, revolutionizing the industry.
The discussion covers the following topics:
▫️ The development and impact of the Transformer model.
▫️ The evolution of computing and its democratization.
▫️ The future of AI technology and its potential applications.
▫️ The role of accelerated computing.
▫️ The potential for AI to revolutionize various industries.
▫️ The need for new data and learning techniques in AI development.
Feature panel host:
▫️ Jensen Huang, Founder and Chief Executive Officer, NVIDIA
Panelists:
▫️ Ashish Vaswani, Co-Founder and CEO, Essential AI
▫️ Noam Shazeer, Chief Executive Officer and Co-Founder, Character.AI
▫️ Jakob Uszkoreit, Co-Founder and Chief Executive Officer, Inceptive
▫️ Llion Jones, Co-Founder and Chief Technology Officer, Sakana AI
▫️ Aidan Gomez, Co-Founder and Chief Executive Officer, Cohere
▫️ Lukasz Kaiser, Member of Technical Staff, OpenAI
▫️ Illia Polosukhin, Co-Founder, NEAR Protocol
Explore more GTC 2024 sessions like this on NVIDIA On-Demand: nvda.ws/3U33qo
Read and subscribe to the NVIDIA Technical Blog: nvda.ws/3XHae9F
00:00 Introduction
11:00 Panelist Discussion
#GTC24 #NVIDIA #GTC #AI #GenAI #Generative AI #Transformers #FutureOfAI
Пікірлер: 173
The brilliance in this room is unparalleled, thanks for sharing!
I really appreciate Jensen doing all these amazing talks. I think he’s clearly a great leader for Nvidia
This movement has the ability to make so many things so much better and cheaper than almost anyone realizes. This truly is another industrial revolution.
@Twikkilol
27 күн бұрын
Yep, but Jensen wants to make a bigger profit, so it will never become cheaper. sorry bro
@bobsagat122
25 күн бұрын
@@Twikkilol cool story bro go play something on your 960
It is a riveting presentation on the transformation AI is undergoing, especially as highlighted by NVIDIA's GTC 2024. Jensen Huang's ability to convey the enormity of this shift, from the roots of computing to the brink of a new Industrial Revolution powered by generative AI, is nothing short of masterful. The discussion around how computing costs have plummeted while the utility skyrockets set a thrilling backdrop for the transformative power of AI. The leap from recognising images to generating them based on textual prompts shows how far we've come. We're at the cusp of something monumental, reshaping every sector imaginable. Kudos to NVIDIA for taking the charge in this exciting future.
Great optimistic chat. They love the compute they have, I can't wait to see what they do in the next ten years.
@andybaldman
Ай бұрын
Besides flood the world with accelerated spam.
@Glowbox3D
Ай бұрын
@@andybaldman Hey, by that time, I will have my own AGI that will filter all that spam before I have to see it.
@andybaldman
Ай бұрын
@@Glowbox3D So the world needs to create a massively powerful too just for you, so you can filter out all the crap everyone else's massively powerful tools are generating. The net result is zero, and we all waste a lot of effort and energy doing it.
Congratulations..very smart people excited about the future 🎉
🎯 Key Takeaways for quick navigation: 00:06 *🚪 Introduction to the Panel* - Jensen Huang welcomes attendees to the Transforming AI panel at GTC 2024. - Huang discusses the historical context of computing, emphasizing the significant reduction in computing costs over time. - He introduces the concept of accelerated computing and its challenges and benefits. 05:49 *🧠 Evolution of AI and Generative AI* - Jensen Huang discusses NVIDIA's journey into AI, starting with accelerated computing and its application to computer graphics and gaming. - He highlights the emergence of generative AI, enabling software to not only recognize but also generate content based on textual prompts. - Huang emphasizes the transformative potential of generative AI across various industries. 11:40 *💡 Introduction of Transformer Inventors* - Jensen Huang introduces the inventors of the Transformer model, authors of the paper "Attention Is All You Need." - He humorously acknowledges the CEOs of various AI startup companies among the panelists. - The panelists discuss the importance and transformative capability of the Transformer model in the field of machine learning. 15:11 *🛠️ Challenges Leading to Transformer Development* - The panelists reflect on the challenges they faced before developing the Transformer model, including the limitations of recurrent neural networks (RNNs) in processing large amounts of data. - They discuss the scalability and efficiency issues of existing architectures and the need for a more general solution. - The concept of "attention" and its role in the Transformer architecture is highlighted as a breakthrough in addressing these challenges. 19:30 *🤔 Naming and Conceptualization of Transformer* - The panelists discuss the naming process for the Transformer model, with "Transformer" chosen for its simplicity and suitability to the model's transformative nature. - Alternative names, such as "Cargonet," are humorously mentioned, emphasizing the collaborative decision-making process. - The broader implications of the Transformer architecture beyond language translation, including its application to image processing, are acknowledged. 23:26 *🧠 Early Days of Transformer Development* - Initial focus on scaling up auto-regressive training for various modalities. - Early ideas of joint models for different modalities were present in the Transformer repository from the beginning. - Scaling efforts aimed to train on diverse academic datasets, driving the modeling of the web. 26:02 *🧬 Application of Transformer in Biological Software* - Discussion on using Transformer for translating specifications of behaviors into biological molecules. - Importance of experimentation and data generation in biological research. - Exploration of adaptive computation and efficient resource allocation in model training. 27:27 *⚙️ Enhancements and Challenges in Transformer Architecture* - Ongoing efforts to improve inference speed and efficiency of Transformer models. - Recognition of the need for innovation beyond the Transformer architecture. - Discussion on the importance of clear advancements to drive industry adoption of new AI models. 30:10 *🔄 Evolving Goals and Challenges Beyond Language Modeling* - Original ambitions to model token evolution and iterative text/code generation. - Challenges in organizing computation efficiently and integrating biological software concepts. - Exploration of efficient reasoning and knowledge incorporation within AI models. 34:25 *💼 Entrepreneurial Initiatives and Impact Goals* - Founding motivations for AI-related companies focused on practical applications. - Emphasis on deploying AI technology to solve real-world problems and improve lives. - Importance of user feedback and experiential learning in AI model development. 38:33 *🐟 Nature-Inspired AI and Research Collaboration* - Introduction of nature-inspired AI philosophy and the concept of collective intelligence. - Announcement of research collaboration focused on model merging using evolutionary computation. - Emphasis on utilizing computational resources beyond gradient descent for AI innovation. 43:24 *🧱 Building Programmable Money and Blockchain* - Leveraging programmable money to coordinate people at scale. - Developing protocols and blockchain technology to enable data generation and coordination. - Exploring the transformative potential of blockchain and programmable value for data contribution and incentivization. 45:15 *🤖 Advancements in AI Model Technologies* - Discussing the limitations of current GPT models and the need for new technologies. - Exploring the role of reasoning and interaction data in enhancing AI models. - Considering approaches like reinforcement learning and synthetic data generation for model improvement. 46:59 *🧠 Developing Reasoning Capabilities in AI Models* - Emphasizing the importance of advancing reasoning capabilities in AI models. - Highlighting the relationship between reasoning and learning from little data. - Discussing the potential of reasoning to reduce data requirements while improving data quality. 49:44 *📊 Measuring Progress and Breaking Down Tasks* - Addressing the significance of benchmarks and evaluation in AI development. - Discussing the necessity of measuring progress and breaking down complex tasks into simpler components. - Emphasizing the importance of creating measurement systems for advancing AI engineering. 52:53 *🌟 Appreciation and Gratitude* - Expressing gratitude for the contributions of panel members to the AI field. - Reflecting on the impact and potential of collaborative efforts in AI research and development. - Concluding with expressions of appreciation and encouragement for future endeavors. Made with HARPA AI
12:20 Jensen Huang, in Portuguese or Spanish, "Artificial Intelligence" translates to "Inteligência Artificial" so there you go NVID(IA).
Absolute Historical!
It's an awesome discussion !
Lukasz is such a humble guy, even though he works with OpenAI itself🎖
The Worlds best CEO right here❤
@angrygreek1985
29 күн бұрын
are you freaking kidding me?
Go gamers! Driving technological innovation.
@UnsaltedCashew38
29 күн бұрын
It's not gamers that have driven Nvidia's stock from $200 to $900, it's AI chips mega corps are buying.
@joshuasexton4170
29 күн бұрын
@@UnsaltedCashew38 i THINK THEIR POINT IS THAT THE COMPANY WOULDN'T HAVE GOTTEN OFF THE GROUND IF IT WEREN'T FOR THE MARKET OF PEOPLE(mILLIONS OF GAMERS) TO BUY THEIR INITIAL PRODUCTS Oops for caps but not rewriting all of that
@theinfamous4231
29 күн бұрын
@@joshuasexton4170 EXACTLY!!!!!!!
I love to listen to his voice it's helps me learn & receive more wisdom knowledge about network transformation etc
I am satisfied 😌 ❤🎉, thank you for your service to mankind
Awesome discussion! AI will give way to more pioneers!😎
He is one of my rule models , i love his approach to management.
love jensen and the boys. great discussion :)
Thanks for sharing this
All GOAT in single place with main GOAT doing interview, Simply phenomenal
Protect this man at all costs
@experiencelife3237
Ай бұрын
Lol, he already has more than enough money to cover his protection costs.
@MacGuffin1
Ай бұрын
Like Cost of a 4080???
@r1n488
Ай бұрын
Bootlicker
@MAJ0RTOM
29 күн бұрын
@@MacGuffin1 I don't think he sets the price of the graphics cards lol.
@UnsaltedCashew38
29 күн бұрын
He's price gouging consumers and businesses by more than doubling the price of video cards. He's running a monopoly, if anything, he's needs competition, not protection.
Fuck yeah! Finally my frustration has been addressed. Since you are hiring, I would please like to apply for a position. No remuneration needed dude. Thank you for bringing access to the dreams of my generation. This needs to be a the forefront of humanity to achieve ASAP.
Man once people felt like they had permission to get their phones out they just didn't let up. Here let me block the high quality setup specifically designed to capture a high resolution moment that can be passed down through history with my off center smart phone shot that I'll never watch again.
Thank you for posting, great conversation
Amazing people!
I love how this conversation feel like friends talking in hall way but they completely put aside that they are being watched by millions making history
I love this
Lots of upvotes from stock holders. Any news on the 5000 series ties?
Great!
this is similar to markov-chaining, but enabled by massive computing power
It’s a Great time to be alive 💡
@MrMick560
25 күн бұрын
The true "Age of Enlightenment"
OK... just give me a moment to process this. Thank you for inspiring me to keep going. Not so alone after all. 😊
We have achieved AGI internally and pledging the majority of our wealth to Universal Basic Income via the Vitruvian Key Ltd and Vitruvian Sovereign Wealth Matrix Ltd
Given the transformative potential of AI, how do we envision its impact on sectors like healthcare in terms of practical applications?
10:10 I don’t want to miss this next ten year 😢.
@MrMick560
25 күн бұрын
We are either entering the true "Age of Enlightenment" or the end of the Humanity, or both ?
so much of learning and for free -- thank you nvidia
they are making the new human generation
Lukasz the only engineer
Does anybody know what is the alternative to Gradient Descent that is not a mixed up version of gradient descent?
I am your fan, Jensen. Even though I am using AMD GPU
@toohow3466
22 күн бұрын
Your comment is hilarious.
@xnx304
21 күн бұрын
@@toohow3466 haha, it's true
JensenASMR needs to be a thing
@zankyzanky9689
28 күн бұрын
Well, you COULD use an AI for that 🤔
I think SNNs are the future with neuromorphic hardware
It just started to get interesting right at the end where he let them discuss ideas amongst themselves. Then it ended a few mins later :(. The first part was mostly dumbed down.
Thx missed this one
its a giant podcast! 😅🤟
Jensen my mann
What a fun and nerdy discussion on Transformers! Jensen Huang does a great job at setting the tone and letting everyone relax and enjoy the convo. If you missed the original GTC Keynote or found it hard to absorb ALL the amazing announcements, I made a breakdown of it in a fun and easy to understand way, as a machine learning engineer myself. Check it out! :) kzread.info/dash/bejne/o2Sdy5etj7zYo6g.html
Personalities, traits (i.e. all embeddings) of these eight authors should be analyzed, studied and taught in business schools. This is the secret recipe to build a disrupting, world-transforming team.
1964 was a good year. I have not changed either! שלום from תל אביב ישראל 🇮🇱
very cool to listen to
Isn't the root of this, problem solving by viewing the data from a different dimension or domain, and another, another, etc.? Until you have viewed the issue from every possible domain or dimension and truly understand it, which then includes the answer you were looking for?
Pixel 8 pro on hand ! ❤
Is he holding a Pixel? :D
what human do in the future instead AI?
Question.. How to keep my head clear and focused with all this dazzling stuff going on?
Transformers! Robots, in, disguise!
What movie is he talking about @ 20:50 ?
@Abhishek-jh1ej
Ай бұрын
Yesterday.
@ELA1ization
Ай бұрын
@@Abhishek-jh1ej Ah, cheers
“This next 10 year you don’t want to miss”
AI-DIVINE
🥰😍🤩👍👍👍🙏Nvidia
Why would you not set it to a slower(looking at less tokens at a time) and then map its inaccuracies where it slows down then says something wrong. Then show it that
it would be better with more moderation and better questions...
future
It sounds like he says “The bills didn’t exist”. It’s The Beatles didn’t exist. The film is indeed called Yesterday.
The insurance must have been sky high for the event😅
22:00 its bubble
The AI would use a lot of processing to work out it needed a calculator to calculate 2 + 2, so that just pushes the problem back.
@happyraptor7986
Ай бұрын
In its current state yes, but the cost to do such a simple problem "shouldn't" cost so much. If the AI can have "variable-computation" depending on the complexity of the problem then 2+2 can be way cheaper than it is currently, and conversely prompting it to cure cancer may be very expensive because of variability. On that note we will see this very soon ;)
cool
All of them avoid talking about the real issues - that the exponential speed of the technological evolution will surpass human understanding and capabilities and that AI safety is way, way, way behind AI capabilities.
since ai is so profitable can you just subsidize gpu costs, cause... that sure would be nice.
3rd guy has a KZread channel I think
Please help me to publish my research findings
❤
Its all men 😮
yet, no gpu support for agx xavier. 6 years have passed and I'm sure it is still on the pipeline.
I keep hearing about NEAR protocol.. shit, now I know
Export the Azure, Chat GPT, Revit, Plant 3D, Civil 3D, Inventor, ENGI file of the Building or Refinery to Excel, prepare Budget 1 and export it to COBRA. Prepare Budget 2 and export it to Microsoft Project. Solve the problems of Overallocated Resources, Planning Problems, prepare the Budget 3 with which the construction of the Building or the Refinery is going to be quoted.
Are we entering the true "Age of Enlightenment" ?
This dude gonna make everyone a programmer by default with only plain english (or even other natural language). Be carreful he is hero!
This is amazing
🥰🥰🥰🥰
Can you guys translate the whole WEB into a Singularity Knowledge that is empirical, ownerless, purified, and isolated from intention which is necessary for the planetarian singularity infrastructure? The vision and Quantum Plan for the next stage of AI, AGI, QSI is ready: EQORIA, United Earth. It's been 24 years. 12.12.24 is the beginning.
When I think of Nvidia, I think of Linus Torvalds quote ❤
@andybaldman
Ай бұрын
What quote?
first
What do you think of this program: To neutralize the possibility of an AI which could become dangerous for humanity, we will develop the AI on a unique training focused on a single objective which we will call "ABOLUTE HEALTH". To achieve this objective, AI will have to double the longevity of the human organism and eradicate all pathologies (physical and mental). These tasks to be accomplished will be the only way for AI to achieve the goal of Absolute Health. This mode of development of AI excludes any possibility of AI being dangerous for the human species. What do you think about this idea ?
4:32 exactly! Focus optimization where it pays off big time! Sloppy code are for weak people! I can’t imagine that BYTESWAP was a C++23 feature..! Should have been in from the start. I mean it isn’t like it’s a new thing with little endian and big endian…is it! I even pointed out how you do it on i32 platform as well! No big deal! Easy peasy imho I would like to get my hands on some of the NVIDIA stuff. I might start to like my surroundings then!
Some wise man said once that there are three levels of intelligence and thinking. I would ad a fourth: 0.5. This are: animal level empathy, the intuitive level (where you understand your best interest through trial and error), the counter-intuitive level (where you focus more on the power of changing your mindset and operational quata), and finally the first level Creator level (the level at which no matter how far advanced technologically one civilization is, this persons whill always be perceived as a wizard). Ironically the fourth and last level (the first level Creator level), many, many times enforces what is to be found at the second level (the intuitive level), but not through factual-counter-factual dichotomy, but through humility, elegance and love for simplicity. As to pinpoint the classical debate of weather A.I. will leave us in peace and/ or collaborate with us humans, it is preciselly why it can't reach the first Creator level, it will never leave us in peace, and it is because we can never guarantee we won't prove more harmful to them then we have been towards ourselves in the past, they will never be able to comprehend the idea of being more aggressive than the most manifest saints, aka. monks, priest. Get this, there will never be true A.I., the only thing able to exist is next level information heuristics, cross-fields and data implementation, aka. computer science. There can only exist progress and manipulation, and everything stays the same, always. The wide eyed notion is for game consumption, any kind of game.
I am the guy who created the concept of Computer Gaming Hardware IE: Made by gamers for gamers I will NEVER use a Nvidia product, for what they did to 3dfx.
@tannerjohnson145
27 күн бұрын
What did they do?
and this is THE guy...if he could actually land one of those jokes it would be tranformative. great tech. i just dont feel it to put it nicely.
can we get Jensen a bus pass or uber account so he doesn't have to ride his motorcycle to these events
Sounded like the introducer called him "Wang 王" rather than "Huang 黃". What is it with Chinese names. They are not that hard.
wow
humans probably have short term and long term memories because we have a dominant LLM and a minor LLM. minor LLMs can update more frequently or even on the fly but the dominant LLM responsible for "ah ha" moments only updates when you sleep and dream at night because energy consumption is huge, probably done in installments over a few nights even.
@Penaming
20 күн бұрын
foundation models rather than LLMs but LLM is sexy.
Homie legit caught all the Pokémon
Companies with this type of CEO vs those following trends are two kinds
People and their F*kin phones...
Wow 🌊💦 waters come in ... electricity 🔌 goes out😮. Who new that Transformers would be used to produce products that light 🕯️ up the world .... 👀 Unbelievable inventors. LLMs
NVIDIA needs to take over Stable Diffusion.
AI COIN ASI , NUNET HYPC
Does anyone else see Gavin Belson