I really enjoyed this conversation with François. Here's the outline: 0:00 - Introduction 5:04 - Early influence 6:23 - Language 12:50 - Thinking with mind maps 23:42 - Definition of intelligence 42:24 - GPT-3 53:07 - Semantic web 57:22 - Autonomous driving 1:09:30 - Tests of intelligence 1:13:59 - Tests of human intelligence 1:27:18 - IQ tests 1:35:59 - ARC Challenge 1:59:11 - Generalization 2:09:50 - Turing Test 2:20:44 - Hutter prize 2:27:44 - Meaning of life

@newwave77

3 жыл бұрын

Should be a simulation time-stamp every pod :D lol cheers

@draker3161

3 жыл бұрын

@@newwave77 I

@raoufbouk4259

3 жыл бұрын

We want aurelien geron

@jingyinghuang4258

3 жыл бұрын

7

@thoughtscollector2128

3 жыл бұрын

Invite Terence Tao. He's great!

Listening Francois gives so much insights on everything. He is just simply amazing

“I’m not interested in psychometrics as a way to characterize 1 individual person. I think psychometrics is most useful as a statistical tool. It’s most useful at scale.” This man is a measure of intelligence himself.

We need Joscha Bach to come back ASAP!

@dankswag7860

3 жыл бұрын

This please! I've listened to that podcast 3 times already. We need more Joscha Bach!

@PUNEETAM20

3 жыл бұрын

That would be epic

@edenaut

3 жыл бұрын

hes awesome! :)

@pathofthesalaf

3 жыл бұрын

We need him to come Bach

@hemiedwards217

3 жыл бұрын

Would love to listen to a conversation between François Chollet and Joscha Bach.

Lex, Thank you for providing us layman with this extremely beautiful and captivating podcast. We all appreciate the time and effort you put into this project of yours. Life would truly be quite different without you!

Hey, Lex, I love how you dig up the guests that we didn't know we needed to hear and provide high stimulating intellectual discussion, keep it up

@jp2kk2

3 жыл бұрын

This guy is definitely very famous in the ai world! He wrote a very famous and important paper, " on the measure of intelligence" recently

@eswad007

3 жыл бұрын

@@jp2kk2 I'm a humble physics student but I'll have to check that one out, thanks!

@rijulg

3 жыл бұрын

@@jp2kk2 he created Keras, which might be better known by people.

@vikingthedude

Жыл бұрын

This man helped me get through my ml elective

When Francois talks, he gives a new insight every time. What a genius!

“Intelligence is how efficiently you learn new things” “Measure of intelligence is ability to change” Being able to learn comes from ‘understanding structured operation logic” model between events. And being able to change comes from the ability to use causal inference on a perceived event against the model.

@LockeLeon

3 жыл бұрын

That is consistent with the fact that IQ and the personality trait Openness correlate quite strongly

@kicksnarehat4393

3 жыл бұрын

Am yet to observe non-supportive data of this statement!

@goclbert

3 жыл бұрын

But this definition would mean that intelligence in humans is strongly tied to plasticity making children more intelligent than adults. However children struggle with many causal relationships that are easier to grasp as adults. This isn't because children are dumb but that this understanding of operational logic is actually learned. What you are describing is often referred to as "learning how to learn" but this is not the base of learning, just a skill that helps with applying other logical relationships in new contexts. An intelligent system would be capable of reaching this logical understanding but it does not need to start with operational logic a priori.

@krogan3760

3 жыл бұрын

@@goclbert While I don't disagree, you have to consider that children's minds are not fully developed and lack many computational abilities of adults.

@venture3800

2 жыл бұрын

@@goclbert I think going back to Francois point you could argue that this isn't evidence that adults *are* actually smarter since it's just a matter of having more training data 🤣

I love the way these two people think completely differently. I've had conversations about the way I think compared to my significant other, and its surprising to see how both similar and different ours ways of thinking can be!

@justindecker4051

Жыл бұрын

Foggat

@CatChrist

Жыл бұрын

@@justindecker4051 imagine a flat earth believer commenting on your post ☠️

“Everything we do creates ripples into the future and that’s the path to immortality”

'So you disagree with Naom Chomsky?!' '𝓨𝓮𝓼'

@Fanofjambi

3 жыл бұрын

10/10

@thisway6539

3 жыл бұрын

Gay

@PUNEETAM20

3 жыл бұрын

@@thisway6539 people are allowed to disagree with each other, that's basically how new ideas sprout

@MattOGormanSmith

3 жыл бұрын

Noam Chimpsky the chimp and Koko the gorilla effectively debunked Chomsky's core assertion that language is the root of intelligence. Various other animal studies have also broadened our conception of intelligence, for example the toolmaking ability of corvids.

@PUNEETAM20

3 жыл бұрын

@@MattOGormanSmith instead of being the root I'd argue that language is an outcome of intelligence. That it is itself a tool for articulation of more complex and abstract thought that simple action and reflex can't represent efficiently.

Legend says that when Francois applied to Google, the interviewers began to question the level of their own Googliness

I really like the way this man talks for some reason, like he has a fairly thick accent yet is more intelligible than a lot of native English speakers.

Fransios is such a guy that warms your heart with knowledge!

@Hexanitrobenzene

3 жыл бұрын

When he talks I instantly imagine a "smoking" jar with liquid nitrogen, just in this case it's pure liquid intelligence oozing towards us :)

What a great discussion! I loved the metaphor of having a subway map in your head as you write a paper. I do that all the time.

This one got me really excited

I listened to this after consuming thc. I had several mental breakthroughs by applying the albeit hard for my intelligence level to decipher. Highly valuable information contained within. Lex you have an amazing mission to question the questions, That has helped sculpt my mind into one that is slightly more efficient than it was. More efficient at detecting bias. I still have many biases. But I am getting better at detecting them. Thankyou youtube for providing such valuable content. The world is both better and worse for the torrents of information literally at our fingertips. From one random guy on the internet. Choose the content you consume wisely. Turn the play speed up incrementally over time as you adjust. This adds profound gains in efficiency of absorption. The faster play speed becomes a second language. You will become philosophically bi-lingual. Other people will likely not understand 2.0x play speed yet it sounds normal when you become fluent. 3.0x is only 50% faster than 2.0x. My average level of intelligence. Or maybe the frequency perceptiveness of my ears, will reach a performance ceiling before others with more capacity. Neurolink has the ability to increase the speed of uptake. In a realm where consciousness consists of stored information combined with interpretation and adaptation. Learning the dataset is just as important as improvisational ability. Any efficiency increase should produce measurable results in all round performance. /consciousness.exe

This is an amazing interview. One of the most rewarding ones I have ever heard. Fantastic!!

"Russian starts with a language and ends with a vodka" :) lol

@ab8jeh

3 жыл бұрын

Spare a thought for those that skipped the ads. That was Lex gold!

Love your work, mate. You're an amazing speaker and an even more amazing interviewer (or vice versa 😃)! Currently chugging through your extensive backlog of interesting content! Love it and keep up the good work!

This channel is a hidden gem on youtube. Carry on lex.

Hell yes, I was waiting for exactly this episode ever since I read the paper.

Thanks for these podcasts, lex. I've been looking for a podcast with things that I am interested in. Keep these things coming, I find a lot of value from it.

This show breaks my brain everytime I watch it. Love it. Thx Lex and guests. Hella outlet.

Thank you both lex and Francois. This was a great pod cast. Thank you for this genuine and honest podcast. I as a viewer appreciate the knowledge you two are able to explain in understanding ways. God bless u both for ur good knowledge on things

François is such an amazing person, loved this!

This was really beautiful. Especially the very end starting from the meaning of life. Hoping to be a patron soon. Best wishes

Loved the Piaget reference. One of the experiments described in Genetic Epistemology has had a profound impact on me.

What a great interview, makes me realize how crucial the ability to simulate reality is to intelligence.

Wonderful fridman, thank you.

I request a part 3. I’ve watched a number of these AI interviews, but in my opinion Francois has the deepest and clearest insights on this topic.

Lex, thank you so much for yet another awesome podcast!

Thank you so much for the insightful discussion!

Great guest and great interview! Thanks Lex.

Lex thank you everyday for inspire me

Would love to hear discussions on the differences in the mechanisms of emotional and classical intelligence.

Thanks a lot Lex

Francois explains things in detail and his psych approach has keypoints I find impressive. I have the same view on what the outcomes are in testing. Knowing and not expecting depending on the circumstance does impact the targeted goal. I thought this in my experience(s) and may I add, its an added challenge not being able to hit some goals on your own. Meaning mine, I seem to kick my own butt. You guys already know how to talk to each other. I am really going off the rail communicating.

I really like the way this guy thinks. Glad to see him on again!

Who wants Geoff Hinton on the Podcast ?

Bidirectional search 14:45

Good interview (so far). Seems like the proper view on language.

Have David Deutsch on your podcast!!

@kevinpurnell9465

3 жыл бұрын

ungratefulmetalpansy no Deutsch is the basically the father of quantum computation but his views on practically any matter are probably enlightening

@maloxi1472

3 жыл бұрын

@@kevinpurnell9465 especially AGI !

@suncat9

3 жыл бұрын

David Deutsch is truly a genius.

@wostra

3 жыл бұрын

Yes, Lex, ask David Deutsch in AGI. This will become a very interesting conversation...

@wonderfreeman8245

3 жыл бұрын

Roger Penrose and Jeff Hawkins were already interviewed so it seems natural to me for Lex to complete the set of AGI experts by inviting David Deutsch.

Super helpful textbook 📚

I don't think more intelligence is necessarily a good thing. Rather what we need is more equality, kindness and self-knowledge

Wonderful and very subtle ideas about consciousness and learning. Thank you. Some historic non-quotes: Descartes on logic: “Remember to always put des cartes before des horse.” and “C’est bien joué Monsieur Des Cartes.” Accordingly to Bertrand Russell, Descartes always wore his sword at his side, even when he was in his apartment. Thank you. William L. Ramseyer

2:31:15 he is playing both sides do that no manner which one wins he comes on top, this man is a tactical genius as well

Very nice talk!

The best logical person i ever heard talking about intelligences and AGI.

What the hell? 18k views, 140 comments? These are too low, people dafuq. This shit is the most interesting informative discussion ever Edit- ... discussion ever today, as every podcast is amazing

Just bought his book; what a beautiful coincidence!

Another great guest and interview. Best response to the meaning of life question I've heard.

Masterclass looks good. I would also like to pre-order that Sci-Fi novel of yours Lex.

Без водки, не случился б не один прорыв! Спасибо тебе за лучшие подкасты, с удовольствием смотрю и узнаю для себя, что-то новое!

This guy.. is intelligent. I believe he has solved what intelligence really is, and that’s amazing. Also he has great insights about thé shortcomings of current deep learning and of neuralink

Lex, as I observe the world and people around me, I also determined primary measure of intelligence is the ability to adapt to change. This is driven by deeper layers of character/mind that I have identified.

This blew my mind

By no fault of the eloquent guest, my auditory processing issues made this difficult to understand. Strangely enough, 1.25x speed improved intelligibility. Something to try for anyone in a similar boat.

very interesting

Not just new but also difficulty .. level of newness and complexity

I like the way you reason lex

my favorite twitter person is back!

I agree with Chollet that language is a layer on a cognitive base. Interestingly, the early universe, according to the standard model, was more accurately described by our language than the reality that we perceive. It wasn't until those few massless particles grew in number and created the force fields that gave the particles mass, that being as we know it came about...which is a combination of being and moving, not separated as in our language of nouns and verbs.

GPT is a bookworm. Tesla's autonomous driving ai is always in the car. Alpha Go knows nothing but Go. None of those will produce a well rounded education. A good AI would know the rules of writing, memorize the multiplication tables, practice a sport and musical instrument, learn how to drive, hang out with friends on the weekend, go to the beach or the mountains every now and again, watch some movies and read something like Reddit a little. Maybe blend the subjects that an AI learns. The approach we take with kids is to teach reading not by simply exposing to words but instead exposing a picture book with images next to text. So, GPT3 knows statements about dogs that may be false but they are plausible statements. Tesla's autonomous driving data surely includes dogs and dog behavior around streets but that dataset maybe has no word label for the a dog. Google images have images of dogs that are labeled as a dog. If somehow these three data collections could be combined then the ai would have statements about dogs, images labeled with text about dogs and behavior of dogs.

@Hexanitrobenzene

3 жыл бұрын

Notice that you describe very human-centric AI. That's almost certainly not the only one there could be.

I liked the ad Lex made for Babble.

The 'child mind' is, at the beginning, pure observation. Language builds out of the interactions between other people. Thinking, pre language, is the child mind. In my opinion, all thinking continues to happen in this mind, and you have to translate on the fly. You get really good at it. Language only has meaning in the interactions between people. But the child mind still has to have a language to be translated. Other than pure observation, what comes before that?

@Robert_McGarry_Poems

3 жыл бұрын

Walking my dog, and I realize that when I have no mental context to narrow focus I just observer. I take in stimuli and it just is. But it's only when I ask a specific question of myself do I start to recall labels and give the scene English language.

@Robert_McGarry_Poems

3 жыл бұрын

In that framework, abstraction must be practiced and it must be shared. You can obsess over language on your own, but there is no guarantee that you will end up with something others agree with.

@Robert_McGarry_Poems

3 жыл бұрын

We can make a camera create an image on a screen, which our brains can then understand as an image. Take the screen out and hook it to an AI, but... What do our eyes do? Does the consciousness illusion keep us from making a proper investigation of what our senses actually do?

@2davivadiva

2 жыл бұрын

Intuition comes before that.

@quanlee4693

Жыл бұрын

Emotions come before observation, your emotional state dictates your reaction to your observations. The same context and event can happen to the same person but be experienced, interpreted and processes completely differently. Your current mental state whether influenced by lack or sufficient sleep, supportive/toxic work environment, hunger or drunken state, or stressed or euphoric state will determine your reaction to events and ultimately the outcome

Hehe, I read his book: "Deep Learning with python" --> It's by far the best book I've read about this topic. In my opinion, Human Intelligence often uses heuristics. Computational power can extend these heuristics by the huge amount of operations. So, the proof of "Four-Color-Theorem" was just possible by the combination of human intelligence and computers.

"You listen to Lex's show?" "Yes." Okay, then you're intelligent.

Hey Lex, have you heard about Zettelkasten? It's a method of organizing information which is somewhat similar to mind maps but more sophisticated. You might find it useful. Btw, thanks for you podcasts, they are amazing! ❤️

Great conversation. Thank you. A couple things: I wish you had talked about the ability to “know” which transcends our compressed past and our recognized ways of perceiving, by some considered legitimate and real ways of tapping into knowledge which is actually beyond of physical finiteness. Also, our interconnected ness to other life forms. Perhaps even non physical consciousness? How do we factor in ways of learning and perceiving info from these sources which can add to our compressed knowledge as well as, dare I say it, pave ways into new ways of knowing which transcend linear time and space itself? Taking into account recent revelations in the fields of quantum physics and the emerging areas studying consciousness itself, it seems like these considerations are important not only in the development of AI, but also when considering the meaning of life itself.

Luv the poem...Pushkin request

Creative / divergent thinking should be considered highest form of intelligence as all human progress is dependant upon it, and yet it almost impossible to access. The school systems over reliance of standard models of intelligence testing does great harm to society. It filters out our most creative people unfortunately which results in reduced innovative which we already are beginning to see.

Lex should interview Dr. Peter Hershock with a background in comparative East-West philosophy

Language - the operating system of the mind. Incredibly profound.

Great conversation, general intelligence is a very interesting topic. The intelligent mind seems to me to be a confluence of culture, curiosity and the ability to address new environments and problems in a new and imaginative way, it’s a dynamic constantly evolving awareness of environment, threat level and incentives.

I really like the way this guy thinks, Francois pushes the boundaries of how to measure intelligence. I like the idea of not using the Turing test when people cheat and people will always cheat so it is best to utilize the scientific method. Like what Kate Darling was referring to, if we tell the judges they are talking to a child from Namibia then it is much easier to get them to agree that the computer is human because we have shifted the judges away from their base of reference. We are tricking them.

The amount of no real words in this pod is out of the charts. Amazing talk as usual, thanks, I learned a lot.

@joeh858

3 жыл бұрын

Sorry if I misunderstand, but that seems like a contradictory statement?

@MarcosBiga

3 жыл бұрын

@@joeh858 Chollet invented a word to explain something, they ended up using it a few times. I was making a joke about that. It is a good video, great content.

@joeh858

3 жыл бұрын

@@MarcosBiga Oh, I see what you meant now by "no real words"

@Hexanitrobenzene

3 жыл бұрын

@@joeh858 "Agentness" :) I just checked it, Oxford English Dictionary doesn't know it :)

Do a video on vodka cocktails..

I've always been curious, what is Francois' academic background? He's obviously a great engineer -- keras is a beautiful API and a huge success. Somehow he also has the ability and time to also work on deep questions of intelligence. Did he study physics? computer science? something else? PhD? Very curious if anyone knows.

@TheNitroPython

3 жыл бұрын

Computer science

@47:20 This is what I was thinking. There need to be models of cognition that can interpret BASIC abstract ideas which can then be iteratively developed. AGI is crippled without these.

One of the few youtube channels that increases my IQ

@halaldunya918

3 жыл бұрын

According to some academics, IQ can't be improved, and it's all to do with what genes you inherited. Which is depressing.

@robertpirsig5011

3 жыл бұрын

@@halaldunya918 IQ doesn't really matter that much though. If something fascinates you, you will still need to work to understand it better.

ARC in kaggle still not achieve 0 yet.. so we still have many things to do

Really admire Francosi Chollet. Thank you for this amazing talk!

Lex, don’t know if you’d see this - for visualizing notes you take, there are tools that allow you take notes in text files and make connections between notes very easily, so you get a “knowledge graph” for free. It’s easier to make connections between thoughts I think. For emacs and org (there’s one for md): github.com/org-roam/org-roam

It would be great if the guests had some way to write things down, instead of only having to rely on words. For example, when Chollet was explaining mind maps, he could draw an example really quickly instead of trying to describe it.

Love his cute french accent and his calm, quiet and relaxed way of talking during the entire time!

Step 1. Watch the entire KZread Lex-icon Step 2. Micro-dose LSD every time Lex says the word “beautiful” or “poetic” Step 3: Forget what the hell you were doing in the first place

Thanks for the pronunciation of his name. I've been struggling since I bought his book "Deep Learning With Python". Btw, he always sounds paranoid in his book. Am I the only one to feel like that?

The fact that during the entire interview (it looks like) your phone screen is on at full brightness with white background is making me anxious :)

The algorithm yet again proved me a fool

We need an update!

We need another podcast with this based person

50:18 You can, in fact, train on 100x more data when you add in video and audio

@julkiewicz

12 күн бұрын

Training data size is not measured in gigabytes though. Just because videos are a lot of data doesn't mean they will provide that much more novel information compared to pictures

@StevenAkinyemi

12 күн бұрын

@julkiewicz Well, I didn't say novel data. Just more data. The amount of novelty you find in that is not my point

The more knowledge you have, the more intelligent you can be.

Also, human level intelligence is far beyond what we are today: Learning to play chess is actually a solution to another complicated situation, like feed the hunger for getting recognized or get that geeky chess girl.

@Hexanitrobenzene

3 жыл бұрын

As far as I know, really great people, masters in their field, not neccessarily chess, are primarily motivated internally, not externally.

I am always puzzled by what exactly is "human level" driving means by different people. It seems by default it means the best human can be, which is very different from what actually is the human level driving in real world. Just because humans in theory can handle the corner case does not mean the average human would handle them perfectly.

Astonishing interview. I agree with Chollet's definition of intelligence and I sincerely hope that we will never develop non-deep learning AI. Or at least not before the final version of Neuralink.

14:45 bidirectional search. and it's very cool :)

The test already exists: demonstrate the ability to define, identify the unique characteristics of, ever smaller (or larger) "units" of matter.

Cognition id prediction; beautiful. Develop potential, an energetic mind. The brain must be a muscle, mind builds from memory. Let go, begin again from 0...

@thadfreebourn5138

3 жыл бұрын

Language, words spoken, the magic; code. Fix it! Thoughts make all the difference. I am in charge? Pray AI save the day!