A Day in the Life of a Machine Learning Engineer (at a *small* startup)

Ғылым және технология

A day in the life of a machine learning engineer at a small startup from Brisbane, Australia called Nutrify.
Nutrify uses computer vision to make learning about and tracking whole foods fun.
Links from video:
Download Nutrify on the App Store - apple.co/4ahM7Wc
Nutrify website - www.nutrify.app
What we learned from year of building LLMs part II - www.oreilly.com/radar/what-we...
Apple Overton System for Machine Learning - machinelearning.apple.com/res...
Copying Tesla’s Data Engine for Food Images - • Copying Tesla's data e...
My ML recommended resources - www.mrdbourke.com/ml-resources/
2020 Deep Learning PC Part List - au.pcpartpicker.com/list/8KXXjp
2024 Deep Learning PC Part List - au.pcpartpicker.com/list/xBvRdH
Other links:
Download Nutrify (my startup) - nutrify.app
Learn AI/ML (beginner-friendly course) - dbourke.link/ZTMMLcourse
Learn TensorFlow - dbourke.link/ZTMTFcourse
Learn PyTorch - dbourke.link/ZTMPyTorch
Read my novel Charlie Walks - www.charliewalks.com
Connect elsewhere:
Web - dbourke.link/web
X/Twitter - / mrdbourke
Twitch - / mrdbourke
ArXiv channel (past streams) - dbourke.link/archive-channel
Get email updates on my work - dbourke.link/newsletter
Timestamps:
0:00 - intro
1:08 - morning session/breakfast
1:41 - reading
2:15 - data labelling
2:40 - model training
4:19 - bug fixing
4:34 - lunchtime
6:09 - afternoon session
6:51 - what we've been working on (for the day)
8:36 - ideas for the future
9:28 - Nutrify compute cluster in a closet
11:00 - Nvidia GPU speed comparison
12:00 - Nutrify's data flywheel
13:14 - end of day
14:34 - bloopers

Пікірлер: 315

  • @GoldenTV3
    @GoldenTV32 күн бұрын

    You forgot the 1 hour meditation, the audio book, the cold plunge, the sauna, the 1 hour gym session, 2 hours of answering emails.

  • @mrdbourke

    @mrdbourke

    2 күн бұрын

    😂

  • @eygs493

    @eygs493

    2 күн бұрын

    @@mrdbourke lmao,ubuntu? nah mate you lame

  • @eygs493

    @eygs493

    2 күн бұрын

    @@mrdbourke i use arch btw

  • @Creativeskillshub

    @Creativeskillshub

    Күн бұрын

    The 2 hours of answering emails struggle is real

  • @ChewieTomatoes1

    @ChewieTomatoes1

    Күн бұрын

    You forgot the Master Course we can all buy for $100

  • @c.b.twenty9127
    @c.b.twenty91274 күн бұрын

    This was the best "A Day in the life" video so far, very authentic and felt like being part of the team 😂

  • @saqibshafin

    @saqibshafin

    3 күн бұрын

    This is the video where I felt like I want to be like them! Productive. Enthusiastic.

  • @eskimogc4587

    @eskimogc4587

    40 минут бұрын

    " felt like being part of the team" 🤣

  • @anderson3889
    @anderson38893 күн бұрын

    i love how authentic this video was, none of that drama shit

  • @mrdbourke

    @mrdbourke

    3 күн бұрын

    Glad you enjoyed! We like to keep it pretty chill and simple.

  • @roast-salamander
    @roast-salamander4 күн бұрын

    Being an ML engineer with no source of income is not a joke. I am kinda new into ML and I trained my model for a day and couldnt use my PC

  • @MultiMojo

    @MultiMojo

    2 күн бұрын

    You can buy a used laptop to browse the internet and do stuff while your model trains. Or buy one of those mini-PCs with Oculink egpu support to use as a training system.

  • @rikudouensof

    @rikudouensof

    2 күн бұрын

    Is a virtual machine not a good approach?

  • @roast-salamander

    @roast-salamander

    Күн бұрын

    @@rikudouensof even the virtual machines cost money 💀 I'm cooked

  • @Onyxdude

    @Onyxdude

    Күн бұрын

    @@roast-salamander oracle vm is free?

  • @YuriiPalchynskyi

    @YuriiPalchynskyi

    Күн бұрын

    Run command in background mode

  • @FUBAU
    @FUBAU4 күн бұрын

    One of the best “A day in the life” videos I've seen and actually provides insight into the work! Not like many others, just vlogging their day and joining meetings without sound all the time. Love it!

  • @pablocs12
    @pablocs124 күн бұрын

    Great video! As a Data Scientist working remotely for a gaming company, I felt nostalgic for the days when I used to gather with my colleagues in a small room to work together like you guys! Keep going!

  • @rock3tcatU233
    @rock3tcatU2334 күн бұрын

    Thanks again for creating that massive PyTorch course. That was a great help in my journey into ML.

  • @mrdbourke

    @mrdbourke

    4 күн бұрын

    Glad you liked it! And you're very welcome! Enjoy the epic world of ML

  • @MLexploring
    @MLexploring4 күн бұрын

    If I will be able to work with this man in such a balanced setup, trust me I will work all the time. I am learning deep learning while studying physics from 3rd world country. it's hard to understand by how much we go through living in a third country. I wish I will make it to go to a developed country!

  • @benravenhill484

    @benravenhill484

    3 күн бұрын

    living in a 3rd world country here too, bro. It sucks lol

  • @oksowhat

    @oksowhat

    Күн бұрын

    where?

  • @Soulseeologia

    @Soulseeologia

    18 сағат бұрын

    Stay home fix your own country

  • @francislalhmuakliana766
    @francislalhmuakliana7663 күн бұрын

    Wow! That's how ML development is being carried outside of school. Now, i'm hooked!

  • @mrdbourke

    @mrdbourke

    3 күн бұрын

    Woohoo!!! Word of warning: ML can be very addictive :P (I'll let you decide whether that's good or bad haha)

  • @francislalhmuakliana766

    @francislalhmuakliana766

    3 күн бұрын

    @@mrdbourke Definitely bad :P

  • @wirrexx
    @wirrexx2 күн бұрын

    This is beautiful, i have a test for an internship for a company that will be using ML and AI (GenAI). And having litteraly no experience, this video made me so happy.

  • @strickvl
    @strickvl4 күн бұрын

    Love love love this video. Thank you for uploading. Esp love that you're training your models locally and also the data-first approach. Keep up the good work!

  • @spookimiiki5891
    @spookimiiki58912 күн бұрын

    This was actually a genuinely good video, which I'm delighted to have watched. Please, do keep on making these.

  • @davidyoo647
    @davidyoo6473 күн бұрын

    This is a true day in the life blog! thanks for sharing and mentioning the technical details and roadblocks in the video. super impressed with the progress of the app and will be following along with the journey

  • @rupindersingh1312
    @rupindersingh13124 күн бұрын

    This is the best "A Day in the life" video which i have watched so far. literally loved the whole video and how u have shown what ML folks really do. Kindly make more of such videos.

  • @mrdbourke

    @mrdbourke

    2 күн бұрын

    Glad you enjoyed! Thank you for the kind words

  • @pnwrunning
    @pnwrunning2 күн бұрын

    Happiest sounding startup team ever. This video is likely going to help you recruit so many new team members. Just brilliant.

  • @-uz
    @-uz2 күн бұрын

    Thank god the algorithm recommended me this, content is pure gold!

  • @631kw
    @631kw3 күн бұрын

    Informational, wholesome and genuine record of your day. I enjoy the video a lot.

  • @pseabrook
    @pseabrook2 күн бұрын

    God damn it! Take a sub! This is the best day in the life of video with actual substance and not just fluffing about. Well done. Great to see another Aussie startup!!

  • @metadevgirl
    @metadevgirlКүн бұрын

    Yes, I love this. Thanks for sharing. I'm working on setting up an ML lab in my home office and this is sooooo relatable.

  • @saasdealership
    @saasdealership16 сағат бұрын

    Super nice office, the backyard is super nice to take a pause or unwind after work with colleagues!

  • @yungwarlock_w
    @yungwarlock_wКүн бұрын

    I feel the enthusiasm. God speed bro! Wish you the best

  • @taeefnajib
    @taeefnajib3 күн бұрын

    Oh man! I was randomly watching the video and enjoying the good vibe at your workplace. Then I noticed the name Daniel Bourke. You and Andrei Neagoie made an Udemy course which made me who I am today! Thank you, guys!

  • @mrdbourke

    @mrdbourke

    2 күн бұрын

    So stoked to hear legend! Glad you enjoyed the course :)

  • @MUSTAPHAMomoh-iy8oz
    @MUSTAPHAMomoh-iy8oz2 күн бұрын

    I worked at a similar small startup recently. Just me (ML), the sales guy (founder) and the infrastructure guy. Unfortunately, we didn’t get the funding needed to keep it running so we had to close shop. I really loved it while it lasted. Why? Everyone on the team could code, in fact I was the least experienced guy (the others each had more than a decade of experience in Java). I was working primarily in Python. Whenever I got stuck, the sales guy will come in to help. I felt blessed working with people who knew what’s up. I didn’t need to dumb down things for them to grasp.

  • @ali19231
    @ali1923122 сағат бұрын

    Love the authenticity. This is how KZread should be.

  • @mailoisback
    @mailoisback4 күн бұрын

    You are back! Wish you a good luck with your app. It's an awesome idea!

  • @Bilal_Chafi
    @Bilal_Chafi3 күн бұрын

    Brother, whatever you're feeding your brain, keep it up! Your insights and energy are next level. Loving the content!

  • @mrdbourke

    @mrdbourke

    2 күн бұрын

    Thank you! The secret is whole foods, not too much!

  • @Harry-ib5rf
    @Harry-ib5rfКүн бұрын

    Ahhhh love the vibe! Also, finally someone doing ML Engineering version. Keep it up more mate. I'm also an ML Engineer for a while and really love your vlog.

  • @dangkhoatrannguyen6734
    @dangkhoatrannguyen67344 күн бұрын

    I just feel happy watching this video. I still remember how you started out learning ML and DL in 2019 lol. You were the inspiration for me as I also started out around the same time lol. Fast forward 5 years and here you are with your own start up! Truly happy to see such development!

  • @mrdbourke

    @mrdbourke

    2 күн бұрын

    Woah! Thank you for the support over the years. Hope you're well brother. Keep machine learning!

  • @miyamotomusashi5170
    @miyamotomusashi51704 күн бұрын

    Thanks for uploading a video...I have subscribed to you 5 years back

  • @KDTechverse
    @KDTechverse4 күн бұрын

    This was awesome to witness ! 🎉

  • @FactionalSnow85-EL3
    @FactionalSnow85-EL317 сағат бұрын

    Great Video, Thankyou for making this !

  • @Qwme5
    @Qwme52 күн бұрын

    You have truly inspired me, and I wish you the best of luck in your endeavors. I watched the video several times, and I enjoyed the small work environment and the interaction between you. I also liked how you manage your time effectively, eating, resting, exercising, and reading. This discipline will help your company achieve its goals because you have the necessary qualifications and capabilities.

  • @mrdbourke

    @mrdbourke

    2 күн бұрын

    Wow, what a beautiful comment. Thank you so much for the kind words, we really appreciate it.

  • @subhratuhin
    @subhratuhin4 күн бұрын

    Most Realistic and wholesome day in my life video!!

  • @jannishuth5737
    @jannishuth57373 күн бұрын

    This app is exactly what I need. Good job!

  • @noorzaibchohan1200
    @noorzaibchohan120018 сағат бұрын

    these guys are absolute genuis.

  • @user-fh2cw8ug9f
    @user-fh2cw8ug9f4 күн бұрын

    The best video i ve seen in the past 1 month

  • @AI_Sage29
    @AI_Sage29Күн бұрын

    Man, from watching you doing coursera courses now building at scale, time goes by. Same goes for me, from being a school student to working in an AI startup. Ur chanel has been an inspiration for the idea of learning

  • @k_tully
    @k_tully2 күн бұрын

    Amazing stuff. Great to see a sneak peek into another fellow brizzy startup/business. Keep up the good work. 👌😎

  • @odvjetnikai
    @odvjetnikai2 күн бұрын

    This video legit made me download your app and start using it.. Well done guys!

  • @mrdbourke

    @mrdbourke

    2 күн бұрын

    Woohoo! Have fun and let us know if you feel we could improve it, we're all ears!

  • @simply.nonchalant6006
    @simply.nonchalant60063 күн бұрын

    Absolutely love this day in the life! I aspire to start something in the future, and this was super motivating!

  • @mrdbourke

    @mrdbourke

    2 күн бұрын

    You got this!

  • @whiskymarko
    @whiskymarko2 күн бұрын

    Wish you guy all the best success This looks like a path to be on, not stuck in a shitty cubical job

  • @lipe5331
    @lipe5331Күн бұрын

    This is so well edited

  • @abdushakoor0099
    @abdushakoor00993 сағат бұрын

    probably the best "a day in the life video" I've seen

  • @sajibchakma2766
    @sajibchakma27664 күн бұрын

    Love this video❤ thanks for showing

  • @metinunlu_
    @metinunlu_3 күн бұрын

    Loved the video, I felt like I was doing a one-day internship, really informative and explained very well, thank you!

  • @muscovitagamer
    @muscovitagamer2 күн бұрын

    What a wonderful content! Keep going, surely its going to be a banger!

  • @mrdbourke

    @mrdbourke

    2 күн бұрын

    Thank you! We really appreciate it.

  • @vladimirbosinceanu5778
    @vladimirbosinceanu5778Күн бұрын

    Familiarity with the dataset you are working with is crucial for an ML engineer so kudos for getting your hands dirty and labeling. Also, if I had to look at food images all day my body weight will explode like my gradients. Thank you for sharing!

  • @jakewong6305
    @jakewong63054 күн бұрын

    home office, i love it. my training machine only a 7 years old 2nd hand note book , gtx1050 with cuda. it just fit my need!

  • @iganarendra
    @iganarendraКүн бұрын

    the most realistic one I found :v, keep up the good stuff mate!!

  • @choisanismine
    @choisanismineКүн бұрын

    u r such an inspiration daniel..waititng for pytorch 2.0 love ur vids

  • @arkyabagchi4791
    @arkyabagchi47912 күн бұрын

    Such a informative video it is! I have learned so many different things from it

  • @yoursubscriber2032
    @yoursubscriber20324 күн бұрын

    this video feels very authentic

  • @shriharshbankapur9666
    @shriharshbankapur96662 күн бұрын

    Everything ik about ML is thanks to your courses!

  • @armandf.s4036
    @armandf.s40362 күн бұрын

    One of the best day in the life videos ever, no cringe morning routine that wastes 1 hour, no reading books that aren't related to the job field, no nothing, just straight work and grind. I'm also interested in getting a Machine Learning Job too, currently grinding and studying for it everyday and I hope to have a similiar job here.

  • @OkyCapriatto
    @OkyCapriattoКүн бұрын

    Hey i'm really passionate about the details. Thanks for sharing from Colombia.

  • @Businedu
    @Businedu16 сағат бұрын

    You never miss 🔥

  • @felixtechmedia
    @felixtechmedia3 күн бұрын

    Just got the motivation I needed to go through my ML engineering learning journey 💪🏻

  • @mrdbourke

    @mrdbourke

    3 күн бұрын

    You got this! 💪

  • @bayandakutshwa9483
    @bayandakutshwa94834 күн бұрын

    Great video and great book recommendation! I recently bought it as well as I venture into machine learning engineering 😄

  • @protokon842
    @protokon8422 күн бұрын

    That was a neat little trick to leave the PSU outside the case on your deep learning PC. Simple, effective way to manage heat!

  • @MP-vh1sp
    @MP-vh1spКүн бұрын

    Even if it is for promotion, it is a very refreshing "day in the life" !! Good work ! :)

  • @jerrinmathewgeorgeieee7866
    @jerrinmathewgeorgeieee78662 күн бұрын

    sound is low. Excellent annotation. Also great split screen effect.

  • @husam_007
    @husam_0073 күн бұрын

    The error explanation notes are genuinely amazing, might be one of the reasons I continued watching

  • @mrdbourke

    @mrdbourke

    3 күн бұрын

    Glad you liked them! I realised when editing how many things I said that someone who's not 100% familiar with ML might not fully understand.

  • @ChukwudaluDumebi-Kachikwu
    @ChukwudaluDumebi-Kachikwu4 күн бұрын

    Hey I just wanted to say this was a great video. I want to become a machine learning engineer and I feel like this one of the few day in a life videos that gave me an idea what to expect

  • @mrdbourke

    @mrdbourke

    2 күн бұрын

    You got this! Being a machine learning engineer is all about being one with the data and keeping the data flywheel going.

  • @Rahi404
    @Rahi4042 күн бұрын

    I love how authentic this video was and this video is also a learning source for me. I just want to know if the model on iPhone runs locally or through API.

  • @seanrrichards
    @seanrrichards4 күн бұрын

    Hot dog...not hot dog!!!

  • @sitrakaforler8696

    @sitrakaforler8696

    4 күн бұрын

    Dam it ! Suxk it Jing Yang ☯️😂😂😂 Best fridge message tho 😂😂😂

  • @Kevin-cy2dr

    @Kevin-cy2dr

    3 күн бұрын

    What if i tolda you there is an appu in tha makat

  • @abhigyanacherjee2453

    @abhigyanacherjee2453

    3 күн бұрын

    Legendary Jin Yiang

  • @mokoepa

    @mokoepa

    2 күн бұрын

    😂 😂 🤣

  • @bruceskellator
    @bruceskellator3 күн бұрын

    I learnt a lot from this video, thanks for uploading 🙏🏼

  • @mrdbourke

    @mrdbourke

    3 күн бұрын

    Glad you enjoyed!

  • @JuanPabloAboytes
    @JuanPabloAboytes2 күн бұрын

    Incredible content

  • @isramv74
    @isramv742 күн бұрын

    Love the story. Above all Josh comment at the end LOL. Keep the great work guys!

  • @mrdbourke

    @mrdbourke

    2 күн бұрын

    Thank you! We really appreciate it.

  • @masterbaits4108
    @masterbaits41082 күн бұрын

    Lovely watch! You're a genius

  • @mrdbourke

    @mrdbourke

    2 күн бұрын

    Glad you enjoyed!

  • @reizz4254
    @reizz425422 сағат бұрын

    Sick video! 🤙🔥

  • @landcruiser29
    @landcruiser2921 сағат бұрын

    Nice screen saver 👍

  • @chiekenwanna-nzewunwa1773
    @chiekenwanna-nzewunwa17733 күн бұрын

    Great vlog👍🏾

  • @dheerajchowdaryp214
    @dheerajchowdaryp2142 күн бұрын

    Best DIL video.

  • @rogercomix5648
    @rogercomix56484 күн бұрын

    Hi, software engineer here from OC California but born in Toowoomba, back of Bourke not far from you. Got into ML back in the 90’s after reading issues of AI magazine. I interviewed at an office that looked remarkably like yours in OC but this was the time of Windows 3.1 and Unix systems 5. These guys had created their own analog neural network boards and had these minicomputer chassis hollowed out with them in, sans tensorflow, no graphics cards, very tin cans with a string. Plus the activation function issue was not handled at this point in time. Often wonder what became of them.

  • @gangadhar_02
    @gangadhar_023 күн бұрын

    Thanks now i want to train some models

  • @alfredkhew1634
    @alfredkhew163415 сағат бұрын

    I admitted that I "paused for book spotting" at 0:55, and nice to see many captions/emoji around. When you use jargons, there are explanation on the screen. Yes, I will pause and read it.

  • @2102TrầnĐứcAnh
    @2102TrầnĐứcAnhКүн бұрын

    Hi! I just come across your video and I love it. Your Nutrify app is what I thought of doing months ago, but I did have enough time for research. Your work is awesome. But I have a small question: At 7:22, I just wonder why the model performs better on the test set on the training set (I think usually it is the opposite)? Thanks for the video!

  • @roboai0601
    @roboai060116 сағат бұрын

    I really like your video ❤

  • @adityashinde436
    @adityashinde4364 күн бұрын

    2 questions 1. why are you using weights and biases instead of ml flow or tensorboard? is it because monitoring is better on weights and biases?? 2. why do you use GCP? i see you are training model locally, are you using gcp to store model artifacts?

  • @Sammy-km9zk
    @Sammy-km9zk2 күн бұрын

    This is actually pretty cool 💯

  • @mrdbourke

    @mrdbourke

    2 күн бұрын

    Thank you!

  • @vdmoKstati
    @vdmoKstatiКүн бұрын

    plus nice to see good old queensland vibes :) lovely stuff !

  • @irugal8964
    @irugal89644 күн бұрын

    Good Luck!😍

  • @aflahalabri6331
    @aflahalabri63314 күн бұрын

    What do you use to connect to the servers? I think a video about that would be very helpful 😊

  • @TechWithAbee
    @TechWithAbee4 күн бұрын

    the best video!

  • @someshfengade9623
    @someshfengade96234 күн бұрын

    wow that's amazing.

  • @huyqn
    @huyqn3 күн бұрын

    Thank you for sharing, very helpful! You should launch very soooon!

  • @MoosaMemon.
    @MoosaMemon.4 күн бұрын

    Great video!! I have a question. Why build expensive PC's for model training when you can google colab or other cloud services to train your models?

  • @Hayden-Bunn
    @Hayden-Bunn2 күн бұрын

    this is great, make more content on building and developement

  • @Ro-codes
    @Ro-codes3 күн бұрын

    Great video, super interesting!

  • @mrdbourke

    @mrdbourke

    3 күн бұрын

    Thank you! Glad you enjoyed :)

  • @sriramananthakrishnan138
    @sriramananthakrishnan1383 күн бұрын

    Hey there ! this was incredible, one of the few accurate day in the life videos. I'd be very interested to learn about why you're choosing to train the models on your PC vs the cloud and not using something like vertex AI to iterate swiftly and then moving to on-prem if and when required. Cheers !

  • @mrdbourke

    @mrdbourke

    2 күн бұрын

    I've used the cloud plenty of times but have just found it introduces too much complexity for our use case. I use Google Colab for small experiments. But having a dedicated PC ready to run at any time (without having to wait for it to bootup) is an incredible resource. Also, cloud prices add up if you have a GPU running all the time. I want to not have to worry about booting up GPU instances every couple of days/think about having to turn them off.

  • @Jester_Cruz
    @Jester_Cruz2 күн бұрын

    that's a nice project! where did you get all of your datasets?

  • @iyoleleiyolele2194
    @iyoleleiyolele2194Күн бұрын

    Inspirational

  • @usmanyaqoob4723
    @usmanyaqoob47234 күн бұрын

    I want to see more of these videos 🎉🎉🎉

  • @hamzamihfad4884
    @hamzamihfad488422 сағат бұрын

    This is awesome

  • @taku6157
    @taku61572 күн бұрын

    😂😂😂😂 i guess its a blessing in disguise to see this video, odd enough found your article a few days ago and have procrasinatin to read it🤣🤣

  • @sapnilpatel1645
    @sapnilpatel16454 күн бұрын

    Inspiring and Informative video. I am ML Engineer too.

  • @cariyaputta
    @cariyaputta2 күн бұрын

    Top Day in Life video.

  • @mrdbourke

    @mrdbourke

    2 күн бұрын

    Thank you thank you!

  • @codenocode
    @codenocodeКүн бұрын

    ideal

  • @alittax
    @alittax2 күн бұрын

    I hope you've got a solid backup solution figured out for regular backups. Like the 3-2-1 backup strategy.

  • @mrdbourke

    @mrdbourke

    2 күн бұрын

    Yes we backup quite often. But thank you for the reminder, we'll do another today!

  • @alittax

    @alittax

    2 күн бұрын

    @@mrdbourke I see. Thank you for responding. Have a nice day.

  • @Yenrabbit
    @Yenrabbit4 күн бұрын

    Fantastic energy 😂

  • @mrdbourke

    @mrdbourke

    4 күн бұрын

    Thank you! 🕺

Келесі