comma ai | Driving to Taco Bell with end-to-end ML | Harald Schäfer | COMMA_CON 2023 talk | CTO
Ғылым және технология
Date of the stream 29 Jul 2023.
from $1250 - comma 3X comma.ai/shop/comma-3x
best ADAS system in the world - openpilot.comma.ai
Harald Schäfer social media:
- / harald-schafer-567830132
- / ___harald___
- github.com/HaraldSchafer
View original video on KZread:
- • Driving to Taco Bell w...
A drive to Taco Bell
- • A drive to Taco Bell
comma.ai youtube playlist:
- • comma.ai youtube archi...
Chapters:
00:00:00 intro Harald Schäfer, CTO: A Drive to Taco Bell
00:00:38 making a superhuman driving agent
00:03:14 three parts end-to-end lateral, longitudinal, navigation
00:04:08 taco bell
00:05:35 end-to-end lateral
00:06:50 end-to-end lateral done
00:07:15 end-to-end longitudinal
00:08:44 easy depth
00:10:40 plug into simulator and it works
00:11:25 fun sidenote, traffic code
00:11:50 is it really that easy?
00:14:50 so what did we spend time on?
00:15:10 the great refactor
00:17:15 rejected ideas
00:17:25 rabbit hole 1: stoplines
00:18:35 rabbit hole 2: depthnets
00:20:15 end-to-end longitudinal done
00:20:40 end-to-end navigation
00:21:10 end-to-end navigation in experimental mode
00:21:29 few more changes for taco bell
00:22:44 taco bell code
00:23:09 taco bell video
00:24:30 just a demo?
00:25:45 so when will this be good?
00:27:48 what's next?
00:28:00 needs to be more end-to-end
00:29:35 what's even more general?
00:30:57 billy and silly the bot
00:31:54 come to robotics hackathon
00:32:42 questions
00:33:03 lane changes blind spot sensors and interior camera
00:34:25 lane change indicator status
00:34:48 team vacation, end-to-end long speed limits
00:35:34 depth prediction in simulator, neural radiance field
00:36:18 model training simulated data, augmented real video data
00:36:53 production ready end-to-end applications for openpilot
00:37:37 technics for end-to-end navigation, zoom level
00:37:59 openpilot disengagement analysis
00:38:30 training data from cars that use openpilot longitudinal
We are not affiliated with comma.ai.
Official communication channels:
- comma.ai
- / comma_ai
- / commaai
- / comma_ai
- github.com/commaai
- discord.comma.ai
How to get a job:
- comma.ai/jobs
How to collaborate:
- comma.ai/services
Buy things to support comma.ai:
- comma.ai/shop
Are you interested in openpilot?
Knowledge base:
- wiki.comma.ai
Check out the code:
- openpilot.comma.ai
Is my car supported?
- comma.ai/vehicles
Frequently Asked Questions:
- comma.ai/faq
How to setup openpilot:
- comma.ai/setup
Comma Secure Shell:
- ssh.comma.ai
API Documentation:
- api.comma.ai
CAN analysis tool:
- cabana.comma.ai
Review and annotate your driving data:
- my.comma.ai
Leaderboard:
- my.comma.ai/leaderboard
Comma Connect App:
- apps.apple.com/us/app/comma-c...
- play.google.com/store/apps/de...
Research:
- github.com/commaai/commavq
- github.com/commaai/comma-stee...
- github.com/commaai/comma10k
- github.com/commaai/comma2k19
- github.com/commaai/research
Official George Hotz communication channels:
- geohot.com
- / georgehotz
- / georgehotz
- github.com/geohot
- / geohot
- / realgeorgehotz
We archive George Hotz and comma.ai videos for fun.
Follow for notifications:
- / geohotarchive
Unofficial communities and resources:
- / comma_ai
- / geohot
- commasupport.zendesk.com
Thank you for reading and using the SHOW MORE button.
We hope you enjoy watching George's videos as much as we do.
See you at the next video.
Пікірлер: 10
Thank you to the comma team for this amazing event and sharing the livestream and high-quality videos. All credits to them. Follow their official kzread.info for more livestreams. A drive to Taco Bell drive -> kzread.info/dash/bejne/hYl9vLuzqNezgdY.html | from $1250 buy -> comma 3X comma.ai/shop/comma-3x | openpilot.comma.ai is the best ADAS system in the world | If you have skill apply on -> comma.ai/jobs | Join the community on github.com/commaai/openpilot & discord.comma.ai | Check if your car is supported -> comma.ai/vehicles | How to setup your car comma.ai/setup | Stay up to date by following twitter.com/comma_ai | Support comma.ai at comma.ai/shop Chapters: 00:00:00 intro Harald Schäfer, CTO: A Drive to Taco Bell 00:00:38 making a superhuman driving agent 00:03:14 three parts end-to-end lateral, longitudinal, navigation 00:04:08 taco bell 00:05:35 end-to-end lateral 00:06:50 end-to-end lateral done 00:07:15 end-to-end longitudinal 00:08:44 easy depth 00:10:40 plug into simulator and it works 00:11:25 fun sidenote, traffic code 00:11:50 is it really that easy? 00:14:50 so what did we spend time on? 00:15:10 the great refactor 00:17:15 rejected ideas 00:17:25 rabbit hole 1: stoplines 00:18:35 rabbit hole 2: depthnets 00:20:15 end-to-end longitudinal done 00:20:40 end-to-end navigation 00:21:10 end-to-end navigation in experimental mode 00:21:29 few more changes for taco bell 00:22:44 taco bell code 00:23:09 taco bell video 00:24:30 just a demo? 00:25:45 so when will this be good? 00:27:48 what's next? 00:28:00 needs to be more end-to-end 00:29:35 what's even more general? 00:30:57 billy and silly the bot 00:31:54 come to robotics hackathon 00:32:42 questions 00:33:03 lane changes blind spot sensors and interior camera 00:34:25 lane change indicator status 00:34:48 team vacation, end-to-end long speed limits 00:35:34 depth prediction in simulator, neural radiance field 00:36:18 model training simulated data, augmented real video data 00:36:53 production ready end-to-end applications for openpilot 00:37:37 technics for end-to-end navigation, zoom level 00:37:59 openpilot disengagement analysis 00:38:30 training data from cars that use openpilot longitudinal
I agree. Taco bell delivery must be the most pressing issue
Surprised that disengagrments aren't used yet. Going to be amazing
alright, grabbing bakies watching this. imagine what amazing things we'd be missing out on and the accompanying chaos that would ensue if ai pause is being imposed
Can it get you from Taco Bell to the nearest toilet without disengagement?
@geohotarchive
11 ай бұрын
😂 it's probably in the pipeline 😊
Are you gonna post the Twitter spaces he did?
@geohotarchive
11 ай бұрын
@commonlogic3646 is there any full recording? twitter.com/i/spaces/1djGXlrVkjVGZ recording of spaces was not enabled by George as always. Someone already uploaded partial recording kzread.info/dash/bejne/nqho2LRviLTRXdI.html if there is anyone with full recoding let us know and we will be happy to upload.
@commonlogic3646
11 ай бұрын
@@geohotarchive i see, thank you
i hate this