A Day in the Life of a Machine Learning Engineer (at a *small* startup)
Ғылым және технология
A day in the life of a machine learning engineer at a small startup from Brisbane, Australia called Nutrify.
Nutrify uses computer vision to make learning about and tracking whole foods fun.
Links from video:
Download Nutrify on the App Store - apple.co/4ahM7Wc
Nutrify website - www.nutrify.app
What we learned from year of building LLMs part II - www.oreilly.com/radar/what-we...
Apple Overton System for Machine Learning - machinelearning.apple.com/res...
Copying Tesla’s Data Engine for Food Images - • Copying Tesla's data e...
My ML recommended resources - www.mrdbourke.com/ml-resources/
2020 Deep Learning PC Part List - au.pcpartpicker.com/list/8KXXjp
2024 Deep Learning PC Part List - au.pcpartpicker.com/list/xBvRdH
Other links:
Download Nutrify (my startup) - nutrify.app
Learn AI/ML (beginner-friendly course) - dbourke.link/ZTMMLcourse
Learn TensorFlow - dbourke.link/ZTMTFcourse
Learn PyTorch - dbourke.link/ZTMPyTorch
Read my novel Charlie Walks - www.charliewalks.com
Connect elsewhere:
Web - dbourke.link/web
X/Twitter - / mrdbourke
Twitch - / mrdbourke
ArXiv channel (past streams) - dbourke.link/archive-channel
Get email updates on my work - dbourke.link/newsletter
Timestamps:
0:00 - intro
1:08 - morning session/breakfast
1:41 - reading
2:15 - data labelling
2:40 - model training
4:19 - bug fixing
4:34 - lunchtime
6:09 - afternoon session
6:51 - what we've been working on (for the day)
8:36 - ideas for the future
9:28 - Nutrify compute cluster in a closet
11:00 - Nvidia GPU speed comparison
12:00 - Nutrify's data flywheel
13:14 - end of day
14:34 - bloopers
Пікірлер: 315
You forgot the 1 hour meditation, the audio book, the cold plunge, the sauna, the 1 hour gym session, 2 hours of answering emails.
@mrdbourke
2 күн бұрын
😂
@eygs493
2 күн бұрын
@@mrdbourke lmao,ubuntu? nah mate you lame
@eygs493
2 күн бұрын
@@mrdbourke i use arch btw
@Creativeskillshub
Күн бұрын
The 2 hours of answering emails struggle is real
@ChewieTomatoes1
Күн бұрын
You forgot the Master Course we can all buy for $100
This was the best "A Day in the life" video so far, very authentic and felt like being part of the team 😂
@saqibshafin
3 күн бұрын
This is the video where I felt like I want to be like them! Productive. Enthusiastic.
@eskimogc4587
40 минут бұрын
" felt like being part of the team" 🤣
i love how authentic this video was, none of that drama shit
@mrdbourke
3 күн бұрын
Glad you enjoyed! We like to keep it pretty chill and simple.
Being an ML engineer with no source of income is not a joke. I am kinda new into ML and I trained my model for a day and couldnt use my PC
@MultiMojo
2 күн бұрын
You can buy a used laptop to browse the internet and do stuff while your model trains. Or buy one of those mini-PCs with Oculink egpu support to use as a training system.
@rikudouensof
2 күн бұрын
Is a virtual machine not a good approach?
@roast-salamander
Күн бұрын
@@rikudouensof even the virtual machines cost money 💀 I'm cooked
@Onyxdude
Күн бұрын
@@roast-salamander oracle vm is free?
@YuriiPalchynskyi
Күн бұрын
Run command in background mode
One of the best “A day in the life” videos I've seen and actually provides insight into the work! Not like many others, just vlogging their day and joining meetings without sound all the time. Love it!
Great video! As a Data Scientist working remotely for a gaming company, I felt nostalgic for the days when I used to gather with my colleagues in a small room to work together like you guys! Keep going!
Thanks again for creating that massive PyTorch course. That was a great help in my journey into ML.
@mrdbourke
4 күн бұрын
Glad you liked it! And you're very welcome! Enjoy the epic world of ML
If I will be able to work with this man in such a balanced setup, trust me I will work all the time. I am learning deep learning while studying physics from 3rd world country. it's hard to understand by how much we go through living in a third country. I wish I will make it to go to a developed country!
@benravenhill484
3 күн бұрын
living in a 3rd world country here too, bro. It sucks lol
@oksowhat
Күн бұрын
where?
@Soulseeologia
18 сағат бұрын
Stay home fix your own country
Wow! That's how ML development is being carried outside of school. Now, i'm hooked!
@mrdbourke
3 күн бұрын
Woohoo!!! Word of warning: ML can be very addictive :P (I'll let you decide whether that's good or bad haha)
@francislalhmuakliana766
3 күн бұрын
@@mrdbourke Definitely bad :P
This is beautiful, i have a test for an internship for a company that will be using ML and AI (GenAI). And having litteraly no experience, this video made me so happy.
Love love love this video. Thank you for uploading. Esp love that you're training your models locally and also the data-first approach. Keep up the good work!
This was actually a genuinely good video, which I'm delighted to have watched. Please, do keep on making these.
This is a true day in the life blog! thanks for sharing and mentioning the technical details and roadblocks in the video. super impressed with the progress of the app and will be following along with the journey
This is the best "A Day in the life" video which i have watched so far. literally loved the whole video and how u have shown what ML folks really do. Kindly make more of such videos.
@mrdbourke
2 күн бұрын
Glad you enjoyed! Thank you for the kind words
Happiest sounding startup team ever. This video is likely going to help you recruit so many new team members. Just brilliant.
Thank god the algorithm recommended me this, content is pure gold!
Informational, wholesome and genuine record of your day. I enjoy the video a lot.
God damn it! Take a sub! This is the best day in the life of video with actual substance and not just fluffing about. Well done. Great to see another Aussie startup!!
Yes, I love this. Thanks for sharing. I'm working on setting up an ML lab in my home office and this is sooooo relatable.
Super nice office, the backyard is super nice to take a pause or unwind after work with colleagues!
I feel the enthusiasm. God speed bro! Wish you the best
Oh man! I was randomly watching the video and enjoying the good vibe at your workplace. Then I noticed the name Daniel Bourke. You and Andrei Neagoie made an Udemy course which made me who I am today! Thank you, guys!
@mrdbourke
2 күн бұрын
So stoked to hear legend! Glad you enjoyed the course :)
I worked at a similar small startup recently. Just me (ML), the sales guy (founder) and the infrastructure guy. Unfortunately, we didn’t get the funding needed to keep it running so we had to close shop. I really loved it while it lasted. Why? Everyone on the team could code, in fact I was the least experienced guy (the others each had more than a decade of experience in Java). I was working primarily in Python. Whenever I got stuck, the sales guy will come in to help. I felt blessed working with people who knew what’s up. I didn’t need to dumb down things for them to grasp.
Love the authenticity. This is how KZread should be.
You are back! Wish you a good luck with your app. It's an awesome idea!
Brother, whatever you're feeding your brain, keep it up! Your insights and energy are next level. Loving the content!
@mrdbourke
2 күн бұрын
Thank you! The secret is whole foods, not too much!
Ahhhh love the vibe! Also, finally someone doing ML Engineering version. Keep it up more mate. I'm also an ML Engineer for a while and really love your vlog.
I just feel happy watching this video. I still remember how you started out learning ML and DL in 2019 lol. You were the inspiration for me as I also started out around the same time lol. Fast forward 5 years and here you are with your own start up! Truly happy to see such development!
@mrdbourke
2 күн бұрын
Woah! Thank you for the support over the years. Hope you're well brother. Keep machine learning!
Thanks for uploading a video...I have subscribed to you 5 years back
This was awesome to witness ! 🎉
Great Video, Thankyou for making this !
You have truly inspired me, and I wish you the best of luck in your endeavors. I watched the video several times, and I enjoyed the small work environment and the interaction between you. I also liked how you manage your time effectively, eating, resting, exercising, and reading. This discipline will help your company achieve its goals because you have the necessary qualifications and capabilities.
@mrdbourke
2 күн бұрын
Wow, what a beautiful comment. Thank you so much for the kind words, we really appreciate it.
Most Realistic and wholesome day in my life video!!
This app is exactly what I need. Good job!
these guys are absolute genuis.
The best video i ve seen in the past 1 month
Man, from watching you doing coursera courses now building at scale, time goes by. Same goes for me, from being a school student to working in an AI startup. Ur chanel has been an inspiration for the idea of learning
Amazing stuff. Great to see a sneak peek into another fellow brizzy startup/business. Keep up the good work. 👌😎
This video legit made me download your app and start using it.. Well done guys!
@mrdbourke
2 күн бұрын
Woohoo! Have fun and let us know if you feel we could improve it, we're all ears!
Absolutely love this day in the life! I aspire to start something in the future, and this was super motivating!
@mrdbourke
2 күн бұрын
You got this!
Wish you guy all the best success This looks like a path to be on, not stuck in a shitty cubical job
This is so well edited
probably the best "a day in the life video" I've seen
Love this video❤ thanks for showing
Loved the video, I felt like I was doing a one-day internship, really informative and explained very well, thank you!
What a wonderful content! Keep going, surely its going to be a banger!
@mrdbourke
2 күн бұрын
Thank you! We really appreciate it.
Familiarity with the dataset you are working with is crucial for an ML engineer so kudos for getting your hands dirty and labeling. Also, if I had to look at food images all day my body weight will explode like my gradients. Thank you for sharing!
home office, i love it. my training machine only a 7 years old 2nd hand note book , gtx1050 with cuda. it just fit my need!
the most realistic one I found :v, keep up the good stuff mate!!
u r such an inspiration daniel..waititng for pytorch 2.0 love ur vids
Such a informative video it is! I have learned so many different things from it
this video feels very authentic
Everything ik about ML is thanks to your courses!
One of the best day in the life videos ever, no cringe morning routine that wastes 1 hour, no reading books that aren't related to the job field, no nothing, just straight work and grind. I'm also interested in getting a Machine Learning Job too, currently grinding and studying for it everyday and I hope to have a similiar job here.
Hey i'm really passionate about the details. Thanks for sharing from Colombia.
You never miss 🔥
Just got the motivation I needed to go through my ML engineering learning journey 💪🏻
@mrdbourke
3 күн бұрын
You got this! 💪
Great video and great book recommendation! I recently bought it as well as I venture into machine learning engineering 😄
That was a neat little trick to leave the PSU outside the case on your deep learning PC. Simple, effective way to manage heat!
Even if it is for promotion, it is a very refreshing "day in the life" !! Good work ! :)
sound is low. Excellent annotation. Also great split screen effect.
The error explanation notes are genuinely amazing, might be one of the reasons I continued watching
@mrdbourke
3 күн бұрын
Glad you liked them! I realised when editing how many things I said that someone who's not 100% familiar with ML might not fully understand.
Hey I just wanted to say this was a great video. I want to become a machine learning engineer and I feel like this one of the few day in a life videos that gave me an idea what to expect
@mrdbourke
2 күн бұрын
You got this! Being a machine learning engineer is all about being one with the data and keeping the data flywheel going.
I love how authentic this video was and this video is also a learning source for me. I just want to know if the model on iPhone runs locally or through API.
Hot dog...not hot dog!!!
@sitrakaforler8696
4 күн бұрын
Dam it ! Suxk it Jing Yang ☯️😂😂😂 Best fridge message tho 😂😂😂
@Kevin-cy2dr
3 күн бұрын
What if i tolda you there is an appu in tha makat
@abhigyanacherjee2453
3 күн бұрын
Legendary Jin Yiang
@mokoepa
2 күн бұрын
😂 😂 🤣
I learnt a lot from this video, thanks for uploading 🙏🏼
@mrdbourke
3 күн бұрын
Glad you enjoyed!
Incredible content
Love the story. Above all Josh comment at the end LOL. Keep the great work guys!
@mrdbourke
2 күн бұрын
Thank you! We really appreciate it.
Lovely watch! You're a genius
@mrdbourke
2 күн бұрын
Glad you enjoyed!
Sick video! 🤙🔥
Nice screen saver 👍
Great vlog👍🏾
Best DIL video.
Hi, software engineer here from OC California but born in Toowoomba, back of Bourke not far from you. Got into ML back in the 90’s after reading issues of AI magazine. I interviewed at an office that looked remarkably like yours in OC but this was the time of Windows 3.1 and Unix systems 5. These guys had created their own analog neural network boards and had these minicomputer chassis hollowed out with them in, sans tensorflow, no graphics cards, very tin cans with a string. Plus the activation function issue was not handled at this point in time. Often wonder what became of them.
Thanks now i want to train some models
I admitted that I "paused for book spotting" at 0:55, and nice to see many captions/emoji around. When you use jargons, there are explanation on the screen. Yes, I will pause and read it.
Hi! I just come across your video and I love it. Your Nutrify app is what I thought of doing months ago, but I did have enough time for research. Your work is awesome. But I have a small question: At 7:22, I just wonder why the model performs better on the test set on the training set (I think usually it is the opposite)? Thanks for the video!
I really like your video ❤
2 questions 1. why are you using weights and biases instead of ml flow or tensorboard? is it because monitoring is better on weights and biases?? 2. why do you use GCP? i see you are training model locally, are you using gcp to store model artifacts?
This is actually pretty cool 💯
@mrdbourke
2 күн бұрын
Thank you!
plus nice to see good old queensland vibes :) lovely stuff !
Good Luck!😍
What do you use to connect to the servers? I think a video about that would be very helpful 😊
the best video!
wow that's amazing.
Thank you for sharing, very helpful! You should launch very soooon!
Great video!! I have a question. Why build expensive PC's for model training when you can google colab or other cloud services to train your models?
this is great, make more content on building and developement
Great video, super interesting!
@mrdbourke
3 күн бұрын
Thank you! Glad you enjoyed :)
Hey there ! this was incredible, one of the few accurate day in the life videos. I'd be very interested to learn about why you're choosing to train the models on your PC vs the cloud and not using something like vertex AI to iterate swiftly and then moving to on-prem if and when required. Cheers !
@mrdbourke
2 күн бұрын
I've used the cloud plenty of times but have just found it introduces too much complexity for our use case. I use Google Colab for small experiments. But having a dedicated PC ready to run at any time (without having to wait for it to bootup) is an incredible resource. Also, cloud prices add up if you have a GPU running all the time. I want to not have to worry about booting up GPU instances every couple of days/think about having to turn them off.
that's a nice project! where did you get all of your datasets?
Inspirational
I want to see more of these videos 🎉🎉🎉
This is awesome
😂😂😂😂 i guess its a blessing in disguise to see this video, odd enough found your article a few days ago and have procrasinatin to read it🤣🤣
Inspiring and Informative video. I am ML Engineer too.
Top Day in Life video.
@mrdbourke
2 күн бұрын
Thank you thank you!
ideal
I hope you've got a solid backup solution figured out for regular backups. Like the 3-2-1 backup strategy.
@mrdbourke
2 күн бұрын
Yes we backup quite often. But thank you for the reminder, we'll do another today!
@alittax
2 күн бұрын
@@mrdbourke I see. Thank you for responding. Have a nice day.
Fantastic energy 😂
@mrdbourke
4 күн бұрын
Thank you! 🕺