Watch this BEFORE buying a LAPTOP for Machine Learning and AI 🦾

Ғылым және технология

Machine learning on a laptop, is that even possible? How about Macbooks?
What hardware do I need? What should I spend? What do I need to focus on?
Here's the follow-up on how to train machine learning models in the cloud for free:
• access Nvidia cloud GP...
This video discusses the original M1. However, the same logic applies to the Apple M2 Pro and M2 Max, they're just ✨even better✨.
--------------------------------------
Join the community and support these videos:
🎁 / thegeophysicist
--------------------------------------
- blog.tensorflow.org/2020/11/a...
- scikit-learn.org/stable/modul...
- github.com/apple/tensorflow_m...
- www.tomshardware.com/features...
--------------------------------------
🎥 My Camera Gear
www.amazon.com/shop/jesperdra...
🎼 My Music
www.epidemicsound.com/referra...
--------------------------------------
⏱️ Timestamps
00:00 Intro
00:29 Training with a Laptop
00:37 Difference Desktop and Laptop
01:23 The Apple Ecosystem
03:33 Do you even GPU, bro?
04:30 Everything you need to understand about computer hardware
08:49 What type of GPU you need
09:27 Should you even do Deep Learning on a Laptop
11:15 What to prioritize in your Laptop Hardware
12:25 Making it work with a small-ish Laptop
13:02 With a GPU you can try Nvidia RAPIDS cuML
13:47 What else is there to consider?
16:00 So can you train machine learning on your laptop?
17:01 My Recommendation
18:00 Byeeee
--------------------------------------
👋 Social
💙 Linkedin: / mlds
💜 Twitter: / jesperdramsch
🖤 Github: github.com/JesperDramsch
💚 ORCID: orcid.org/0000-0001-8273-905X
🧡 Google Scholar: scholar.google.de/citations?u...
✒️ Professional Blog: the-geophysicist.com
🌍 Main Website: dramsch.net
🎁 Community: / thegeophysicist --------------------------------------
📝 Disclaimer
Jesper Dramsch is a participant in the Amazon Services LLC Associates Program, an affiliate advertising program designed to provide a means for us to earn fees by linking to Amazon.com and affiliated sites.
Opinions my own. Not financial advice. Sponsors are acknowledged. For entertainment purposes only.

Пікірлер: 229

  • @JesperDramsch
    @JesperDramsch3 жыл бұрын

    Here's how you train a model in the cloud for free: kzread.info/dash/bejne/fphs2LKbpNywh7Q.html

  • @Matlockization

    @Matlockization

    Жыл бұрын

    If vram is low then can extra ram get you over the line ? Like 16, 32 or 64GB ?

  • @JesperDramsch

    @JesperDramsch

    Жыл бұрын

    @@Matlockization No they're connected to a different kind of chip and aren't interchangeable.

  • @Matlockization

    @Matlockization

    Жыл бұрын

    @@JesperDramsch I see, thank you.

  • @cattnation6257

    @cattnation6257

    3 ай бұрын

    Help me should I buy black diamond from dell

  • @cattnation6257

    @cattnation6257

    3 ай бұрын

    @@JesperDramsch please help because I am new to these developments I want to be future proof so in near future I don't need to buy more

  • @truthmatters7573
    @truthmatters75732 жыл бұрын

    This channel needs way more subs! The content is high quality / well explained. :)

  • @TheChanjoo
    @TheChanjoo2 жыл бұрын

    Man, this is so so helpful :) Many thanks for patiently covering all the key concepts !

  • @JesperDramsch

    @JesperDramsch

    2 жыл бұрын

    Of course!

  • @kingfukj
    @kingfukj Жыл бұрын

    Great advice. Because I've been looking for a second machine for my deep learning research. Now, I will switch my strategy from a local machine to the cloud. Thanks.

  • @rebecasarai87
    @rebecasarai87 Жыл бұрын

    Loved this video, Jesper. Thank you!!! I’m happy I came across your channels

  • @JesperDramsch

    @JesperDramsch

    Жыл бұрын

    Thank you, Rebeca! Welcome in.

  • @amdenis
    @amdenis Жыл бұрын

    You are so very correct. Especially for newer AI developers, long training times are not the norm. We use RTX through H100’s for most of our AI development- at least on the training side. However for coding, data sci work, inference and UI/UX we all use our favorite OS, whichever that is. One thing to keep in mind for pro level large parameter/data set AI dev, you will often be using a dedicated server running in the kilowatts with AI grade TPU/GPU’s (e.g. V100’S, H100’s, etc). Whether owned, hosted or otherwise, few jobs will be run locally.

  • @sharmarahul17
    @sharmarahul177 ай бұрын

    Excellent information!

  • @mateuscarvalho5959
    @mateuscarvalho59592 жыл бұрын

    Thanks a lot, man! Very useful tips

  • @JesperDramsch

    @JesperDramsch

    2 жыл бұрын

    Glad I can help

  • @galactus3136
    @galactus313610 ай бұрын

    Thanks a lot for making such a helpful video man.

  • @JesperDramsch

    @JesperDramsch

    10 ай бұрын

    Thanks for stopping by! Glad it's so helpful!

  • @juliagschwend
    @juliagschwend Жыл бұрын

    Very helpful! Thank you so much.

  • @JesperDramsch

    @JesperDramsch

    Жыл бұрын

    Glad it helped!

  • @vifareld
    @vifareld Жыл бұрын

    That was really helpful. Many thanks

  • @JesperDramsch

    @JesperDramsch

    Жыл бұрын

    Glad it helped!

  • @mohdfarhannawaz
    @mohdfarhannawaz2 жыл бұрын

    Very very helpful 👏. Thanks alot .

  • @JesperDramsch

    @JesperDramsch

    2 жыл бұрын

    Glad to help!

  • @xdakiXtritex
    @xdakiXtritex2 жыл бұрын

    What a great video!

  • @PatagoniosO
    @PatagoniosO Жыл бұрын

    great video, thank you!

  • @JesperDramsch

    @JesperDramsch

    Жыл бұрын

    Thanks!

  • @animegod567
    @animegod5672 жыл бұрын

    Thank you for this. I'm interested in ML for advancement in my career and your explanation is helpful.

  • @JesperDramsch

    @JesperDramsch

    2 жыл бұрын

    I'm glad! Thanks for stopping by!

  • @jiaruisong4024
    @jiaruisong40242 жыл бұрын

    That is really helpful!

  • @JesperDramsch

    @JesperDramsch

    2 жыл бұрын

    Thank you!

  • @alexeiw108
    @alexeiw1083 ай бұрын

    Thank you Jesper!

  • @nathalieandrea9708
    @nathalieandrea97082 жыл бұрын

    Thank you very much!

  • @skillsnwokoloanthony7557
    @skillsnwokoloanthony75574 ай бұрын

    Thank you You just saved me from getting broke 😅 I was thinking of getting a pc but confused on what graphics card to get

  • @arnaldovisco
    @arnaldovisco2 жыл бұрын

    Nice video. Very clear explanation

  • @JesperDramsch

    @JesperDramsch

    2 жыл бұрын

    Thank you!

  • @tutan1997
    @tutan1997 Жыл бұрын

    Already owned a Acer Nitro 5 with RTX 3070 mobile + R7 5800H. Still watch you full video :). And my laptop can train 90% types of model after I cramp up the virtual memory => 80 GB (from 16GB of RAM 😂). I'm very satisfied with my $1500 laptop

  • @CODEMENTAL
    @CODEMENTAL Жыл бұрын

    Nice video!

  • @paologreco9412
    @paologreco941210 ай бұрын

    Hi Jesper and tank you for your video, informative as usual. I'd like to ask you what you think of a laptop with a Ryzen 7 5825u and no GPU, but with the intention of connecting a "prosthetic" desktop GPU in the future through a pcie connector; I'm talking about something like the EXP GDC "THE BEAST". Or do you think it's easier and better just using an external GPU through thunderbolt 4?

  • @AamirSiddiquiCR7
    @AamirSiddiquiCR72 жыл бұрын

    Just discovered your channel and I'm already a fan of you. I have recently started learning data Science, currently learning python and statistics. Looking forward to your guidance through this channel.

  • @fianekosaputra417

    @fianekosaputra417

    2 жыл бұрын

    So, what laptop is your choice?

  • @AamirSiddiquiCR7

    @AamirSiddiquiCR7

    2 жыл бұрын

    ​@@fianekosaputra417 Right now I'm using my old samsung np300e5c laptop to learn python. I'll be buying an AMD 6000 series laptop with rtx 3060 once it comes out

  • @JesperDramsch

    @JesperDramsch

    2 жыл бұрын

    Thanks so much Aamir! Good luck on your journey.

  • @joelsabiti4828

    @joelsabiti4828

    Жыл бұрын

    How far have you gone since?

  • @seivansalimibabamiri5268
    @seivansalimibabamiri5268Ай бұрын

    Thanks man

  • @waynelau3256
    @waynelau3256 Жыл бұрын

    I got myself an m1 air a couple of months ago. One thing I dislike is that tensorflow has multiple issues with Mac. It's better to learn about scaling and deploying first, because clouds are always available, rather than throwing a large amount. As for whether it's worth it when you're very advanced in the field, I'll update when I get there 😂 Side note I have a 3070 but I realised model design, preprocessing plays more of a part in ML.

  • @JesperDramsch

    @JesperDramsch

    Жыл бұрын

    Agreed. Thanks for the follow-up!

  • @waynelau3256

    @waynelau3256

    Жыл бұрын

    @@JesperDramsch thanks for replying, you made want to leave an update since the time I commented. The M1 air is very strong when it comes to smaller models, especially if you're working with scikit learn. Very snappy with pandas as well. But leave the LLM/ CV models to the cloud or a GPU. Just one month after the comment, I ssh/remote into my home PC for most of my ML work. Or do my training on my work server. Overall, I personally feel that one should not buy a laptop while considering for ML/AI. It's not worth it. Get what suits your use case. For me I'm quite happy with a smaller screen as I need to carry my laptop around and I work on the commute. I also do not game so mac is fine. Hope this helps someone out.

  • @JesperDramsch

    @JesperDramsch

    Жыл бұрын

    @@waynelau3256 love this Wayne. It's similar to my experience. Happy to train scikit-learn on my phone. Not gonna get a laptop for DL / LLM

  • @auriuman78
    @auriuman782 ай бұрын

    Was looking for an EDC work laptop that can handle personal scoped AI ML on my own air gapped network at home. That way i can leave the models and data private and connect the laptop by cable to train the model when needed. Appreciate this extremely detailed information and how it all relates to AI and ML. My very own private air gapped AI 😀 sounds like I'm better off setting up a tower AI build and go with maybe a laptop with one of the new intel core ultras for otg edc.

  • @oskarbarrera1420
    @oskarbarrera1420 Жыл бұрын

    hello, I really loved your video, I have a question, I am a computer sciences master degree student and I am taking courses like machine learning, deep learning and artificial intelligent, do you recommend the macbook air M1 or should I go for a pro or promax? I need it for my studies. thank you very much for your help.

  • @indylawi5021
    @indylawi50212 жыл бұрын

    Nice coverage of laptop configurations for ML.

  • @JesperDramsch

    @JesperDramsch

    2 жыл бұрын

    Thanks!

  • @ludotosk3664
    @ludotosk36646 ай бұрын

    That's a good one, you can do deep network also on a cpu and for small models is even faster then a gpu. About using the cloud I have a different take, I'm using one computer for browsing and ome for training. 😂

  • @muhammadtaha4115
    @muhammadtaha4115 Жыл бұрын

    Hello @Jesper, Some python library's use Intel mkl and other Intel specific optimization ..... How much performance does this effect in your experience when compared to AMD. Should we just avoid amd cpus for ml work?

  • @biohazel
    @biohazel Жыл бұрын

    Very good, thanks.

  • @JesperDramsch

    @JesperDramsch

    Жыл бұрын

    Thanks hazel!

  • @biohazel

    @biohazel

    Жыл бұрын

    @@JesperDramsch I ended up sticking to Colab and buying a Raspberry Pi to assemble a Bitcoin node instead. Indeed, no need to go too far on a hardware trip, especially for starters.

  • @alexandrevalente9994
    @alexandrevalente999410 ай бұрын

    I understand your point but I don't fully agree about your sentence when you say (with my words) "a CPU with just a load of RAM will be enough"... I'll explain why: Though you are right saying we have to prioritize RAM, but CPU is important too...try training a model with Weka workbench (java based) on you laptop or desktop computer... a fast CPU will help. Students will do deep learning and not necessarily limit themselves in machine learning with scikit or whatever framework. so... a) Having a lot of RAM yes but with a very good CPU too... most probably when working with MLmodels is because you are probably working on an application that requires many components where all are not necessarilly ML based. You could design a NodeJS driven UI that will interact with some back end that you still develop onto your computer and that will serve the model. In order to make it in a very efficient and organised way, you will endup with containers and there is why you'll need CPU and RAM (though they are lightweight). b) because of (a) you will probably start diving in both DEVOPS techniques and MLOPS paradigm. Both of them will require automation which will also consume CPU. Especially if you build a C++ or Java application that must be built. c) because of (a) and (b) your computer will start to gain some load just to work all these things. d) Though an NVIDIA RTX is quite expensive, it can help you a lot on doing deep learning tasks and allow TF to use the onboard GPU. there you will face interresting issues. You'll probably hit during training the VRAM limits and will have to work hard but learn in order to get a really good neural network architecture running on your machine. e) You talk about using cloud, yes I agree partly, this is only for experienced people. Other will get hard time to make it work (I am not talking about Google colab or any other fantasy stuff). Therefore you will travel from (a) to (d) on your local machine. Personally I follow you and agree on what you say about using open sytems and not using macs. 2 years ago I bought a Linux Laptop with an onboard NVIDIA RTX. Because of the budget I could only afford an RTX3600. But I could have a very good intel i7 16 vcpus and 32 GBRAM. All that for less than 1800€ with a wide screen (17"). But that was 2 years ago. Today I would go for a more robust RTX card and smash 64GB or 128GB RAM directly. The only thing I think I would recommend in that... is the battery, choose good ones and chose a laptop with spare batteries. Also, because you will work with Docker containers and perhaps have many versions of the virtual environments in Python... think about the disk space => I recommend today MINIMUM 2TB of SSD. If you can afford more, better it is. Then yes using a cloud solution is also elegant but you'll still need to consider an efficient laptop too because of (a) to (e)..

  • @jayakumar4633

    @jayakumar4633

    10 күн бұрын

    Could you please recommend any old workstation laptops thank you

  • @alexandrevalente9994

    @alexandrevalente9994

    9 күн бұрын

    @@jayakumar4633 mine is a Clevo. Go to Laptop with Linux. But today, 2 years after, things have evolved a lot and i would consider run Tensorflow onto Mac OS. But i still haven't bought it. But certainly it Will be more expensive but there you get An M chip.

  • @aquaRuHoshino
    @aquaRuHoshinoАй бұрын

    Hi! I am also starting to to learn AI and ML now. Can you please help me with a few things. 1) After what amount of time will I need a better laptop or can I do it on my current laptop? Right now I have an office laptop with intel i5 10gen U Processor with integrated graphics 2) Since I am starting to learn where should I start for AI & ML? 3) Is Asus ROG Flow X13 2023 a good option? It has Ryzen 9 7940HS and Nvidea RTX 4050 6GB (60W). I want this one because it is super portable and would also help in taking notes since it is touchscreen. Also is 16GB RAM enough in the laptop? It would be great if you could help me out a bit. Thanks!

  • @eyupyerlikaya8354
    @eyupyerlikaya83542 жыл бұрын

    So, what is your suggestion for a person who is planing to get a laptop for ML/DL workloads?

  • @bansterref
    @bansterref Жыл бұрын

    Any market recommendations? I waa told the Lenovo Yoga is a great buy, I am new on this topic. What do I need to get on memory etc?

  • @jayakumar4633
    @jayakumar463310 күн бұрын

    Could you please recommend any old workstation laptops

  • @subashbalan772
    @subashbalan77210 ай бұрын

    Hi given that I will do the learning on cloud but it may not be always available while travelling. So, what minimum configuration would you recommend. I am a beginner and student . I travel so I have to also carry a work laptop. portability is a concern. I thought MacBook Air with m1 but ram could be concern. Can you suggest minimum ram, processor, gpu(if needed) and other.

  • @yagoa
    @yagoa2 жыл бұрын

    The M1's run very cool and you don't need to worry about running long tasks even in the fan-less one. All 1st gen M1's have a maximum of 16GB of (V)RAM(including the iMac), M1 Ultra has a maximum of 128GB of (V)RAM. Unified Memory also removes the PCI bottleneck between VRAM and RAM, with a bandwidth of up to a combined 0.8TB/s.

  • @beytulk

    @beytulk

    Жыл бұрын

    How is the compatibility of python packages? As I see on the internet, many people still face issues. I'm willing to buy an m1 and pursuing a career in data science and ml, so I will be using python a lot. Also I'll use docker for some of my classes in school. I'm very very indecisive because of the incombatibility issues.

  • @yagoa

    @yagoa

    Жыл бұрын

    @@beytulk There are not any alternatives were you would have any type of portable device(w/o being plugged in all the time to run anything locally). I have not had any issues, I think the issue has been that pytorch was slow to update, by the time you have your system up I don't think anything will be missing. About 0.1% non M1 software on my system now, at launch it was about 40% so it has been a really fast transition from a dev perspective.

  • @forlorn8025

    @forlorn8025

    Ай бұрын

    ​@beytulk which laptop did u buy?

  • @yagoa

    @yagoa

    Ай бұрын

    @@forlorn8025 M1 Air 16GB and thermal modded it at launch, no issues

  • @yagoa

    @yagoa

    Ай бұрын

    @@forlorn8025 M2 and M3 are just overclocked slightly more efficient M1 versions M4 will probably be the first worthy upgrade for ML with acceleration on CPU and GPU + better NPU

  • @bahareh_rezaie
    @bahareh_rezaie3 ай бұрын

    Such a helpful video! I need an update for 2024 products. Can't decied on which laptop to buy.

  • @JesperDramsch

    @JesperDramsch

    3 ай бұрын

    Thanks! Honestly it mostly still holds 😅

  • @mahanabotorabi9029
    @mahanabotorabi90295 ай бұрын

    is it big difference between dedicated or integrated? I want to buy expertbook core i7 -32 RAM BUT it has iris xe .is this gpu enough for my works as you said???

  • @bilal7217
    @bilal72172 жыл бұрын

    Hello Jesper, Thank you so much for the fabulous, informative and helpful video ever made on KZread about Machine Learning laptops. But wait I've a question for you. I'm thinking about buying an M1Pro 16 inch with 16gb of RAM base model and use it for machine learning purposes, of course I wanna keep this laptop for a while but I'm afraid buying it then find out that it's not powerful enough to handle machine learning and data science stuff. Well I'm between the hammer and the anvil. (The costs and the needs). I hope you're gonna be able to help me choose and take a final decision. Thank you Jesper!

  • @joserubio3036
    @joserubio30362 жыл бұрын

    So for a windows user the lenovo ideapad 5 would be a perfect option you think?

  • @zee4680
    @zee46802 жыл бұрын

    Will the Acer swift X be a good choose ?(It has a dedicated GPU)

  • @JetJV
    @JetJV2 жыл бұрын

    Should I consider buying a normal Laptop with Intel Iris Xe if i work in AI , ML, DL or some gaming laptops Nvdia RTX , GTX gpus ? Btw I am a non gamer

  • @wizardscrollstudio
    @wizardscrollstudio2 жыл бұрын

    The new Intel Xe gpus have support for machine learning via OpenVino. Intel seems to be pushing this really hard. In fact the whole Xe gpu architecture is designed around being multipurpose matrix specifically for doing lots of computation necessary for ml.

  • @thiagocavalcante2366
    @thiagocavalcante23663 жыл бұрын

    For PhD students, maybe it's better to access a University PC from your MacBook from home :D

  • @JesperDramsch

    @JesperDramsch

    3 жыл бұрын

    Definitely, as long as the university has a GPU server or GPU desktops. It's exactly what I did actually!

  • @muhammadyusoffjamaluddin
    @muhammadyusoffjamaluddin2 жыл бұрын

    Lovely video! Can you make a video about Open/Free Website and Database to test/learn Machine Learning Model? Please...

  • @JesperDramsch

    @JesperDramsch

    2 жыл бұрын

    Definitely. Check out my shorts for sme inspiration on that already!

  • @JaimeHuffman
    @JaimeHuffman2 жыл бұрын

    Excellent

  • @JesperDramsch

    @JesperDramsch

    2 жыл бұрын

    Thank you!

  • @curtisthompson7674
    @curtisthompson76742 жыл бұрын

    Hello I am new i mean new what is the best computer for ai laptop or desktop to do crypto and stock picking i was told to start with a lapton so i can learn the data and software stuff what is your thoughts

  • @divinejakiro3656
    @divinejakiro36564 ай бұрын

    For windows, when you say ram.. Is refer to RAM or gpu ram?

  • @jonconnor6697
    @jonconnor6697 Жыл бұрын

    ur right my laptop is really aerodynamic... i find myself playing frisbee with it all the time

  • @JesperDramsch

    @JesperDramsch

    Жыл бұрын

    Ultimate frisbee or fetch with a retreiver dog?

  • @kingj5983
    @kingj59832 жыл бұрын

    how about the performance of RTX2050 in deep learning? I'm considering a I7-12700H + RTX2050 laptop

  • @joecincotta5805
    @joecincotta58052 жыл бұрын

    This was really cool. I bought old server GPU and put it into a big desktop PC Case with a hydroponics fan to cool it down. Got a 24gb tesla card for usd$300 that is about as fast as a 1070ti

  • @JesperDramsch

    @JesperDramsch

    2 жыл бұрын

    That's very cool!

  • @paparas1159
    @paparas11592 жыл бұрын

    0:42 I felt that

  • @meechokechuedoung5759
    @meechokechuedoung57592 жыл бұрын

    I try the classical ML in my old Linux machine. It works very well. As you said in the video, it is a better idea to run Deep Learning in Cloud service. BTW, if I create and use my own data for creating a Deep Learning model in the cloud service, it will be guaranteed that my model and my train data set will belong to me?

  • @JesperDramsch

    @JesperDramsch

    2 жыл бұрын

    That's awesome. Normally yes, if you go with any of the mentioned services it's your property

  • @blenderpoly9826
    @blenderpoly98262 жыл бұрын

    How many gb of ram should the laptop have for neural networks

  • @duylevan304
    @duylevan3046 ай бұрын

    I tend to buy a laptop with ryzen 7 pro 6850U. Is AMD good for who begin learning machine learning ? Hope your response.

  • @primepaturi
    @primepaturi Жыл бұрын

    could you help me , ERAZER MEDION laptops are good for neural networks?

  • @NiiAnikin
    @NiiAnikin2 жыл бұрын

    We're due for an updated video after the m1x Mac

  • @JesperDramsch

    @JesperDramsch

    2 жыл бұрын

    Isn't the successor to the M1 the M1 Pro and M1 Max after all instead of m1x?

  • @HaunterButIhadNameGagWtf
    @HaunterButIhadNameGagWtf Жыл бұрын

    I'm preparing to train on two laptops, Dell Precision 7550 with Quadro T1000 dedicated graphics, 64MB RAM and Windows or Dell Precision 7520 with 16GB RAM and Quadro M1200 (it's not even supported by Rapids, so we'll see). Maybe this year I will buy PC with nVidia 3070 or other new card, depending on the market offer (we'll see how Intel ARC will behave with AI).

  • @aymen5777

    @aymen5777

    7 ай бұрын

    Were they any good? (The dell precision laptops)

  • @latlov
    @latlov Жыл бұрын

    How about running Mindspore on Macs and laptops with Nvidia?

  • @joecincotta5805
    @joecincotta5805 Жыл бұрын

    This was the first video of yours I ever watched and when I started I thought, naaah a new MacBook Pro could surely be fine for training models. I can't tell you how wrong I was. The hype is very different from reality and you are 100% correct. I have had to embed so many special cases into my training pipeline to support MPS (METAL) and even then support for torchvision is still incomplete in V2. I ended up going for an rtx4090 on a separate headless Linux server and it reduced training time on my use cases by an order of magnitude.

  • @JesperDramsch

    @JesperDramsch

    Жыл бұрын

    I appreciate that feedback!

  • @alzeNL

    @alzeNL

    8 ай бұрын

    METAL is worthless IMHO - having a mac here in multiboot OS, the Radeon chips in the imac dont really hold a candle to the nvidia GPU's for ML.

  • @felex777
    @felex7772 жыл бұрын

    Cool video. I had a choice to make between 8GB and 16GB mac. I will take a 16GB now.:) Thank you!

  • @JesperDramsch

    @JesperDramsch

    2 жыл бұрын

    Love to hear it!

  • @AaronGayah
    @AaronGayah Жыл бұрын

    Thank you for this. Is there a need to offer an update to this video given that it is now two years later?

  • @JesperDramsch

    @JesperDramsch

    Жыл бұрын

    Maybe replace M1 with M2 that's it.

  • @Ricardo_B.M.
    @Ricardo_B.M. Жыл бұрын

    Great video Jesper. Can I ask u? Wud be better laptop with i7 1260p and 64gb Intel Iris graphics xe or i7 12700h, 32gb, Intel Iris Xe too but having gpu RTX 3070 8gb? Second little more price about 250€. Thx for your help.

  • @Itachi-c137

    @Itachi-c137

    7 ай бұрын

    I would also like advice on this. Please.

  • @naveen12
    @naveen122 жыл бұрын

    What's your take on new macbook pro models, am planning to get the 14 inch base model, will that be enough, should I upgrade anything in it like Ram, more CPU and GPU cores?

  • @JesperDramsch

    @JesperDramsch

    2 жыл бұрын

    What is your main use case? NLP, computer vision, tabular data?

  • @kevinmccallister7647

    @kevinmccallister7647

    2 жыл бұрын

    @@JesperDramsch I'm looking at picking up the new Mac book pros and my main task is learning ML and DL - I'm interested in computer vision object recognition, speech to text and NLP what would you recommend?

  • @Four-S
    @Four-S2 жыл бұрын

    0:43 lmao I hope that's edited, cause my soul damn near left my body when I heard that sound

  • @JesperDramsch

    @JesperDramsch

    2 жыл бұрын

    This shall be forever a mystery 🙃

  • @johnshaff
    @johnshaff11 ай бұрын

    I do not suggest a macbook for ML. I have a fully beefed out M1 Max, even with big ML frameworks like tensorflow starting support ARM, that's not main issue. The main issue is the package manager. Your computer will be your "entire" development environment, and developers know the ass-pain of dependency hell. The apple package manager is absolute garbage. You may be able to use an updated framework for M1, but that doesn't mean you'll be able to use the code everyone else is producing with other frameworks and libraries, or more importantly the prior version of pytorch or tensorflow. Get a PC and install a linux distro with a good package manager.

  • @RobsonLanaNarvy
    @RobsonLanaNarvy2 жыл бұрын

    Video recommended days after I bought a full Desktop Computer

  • @JesperDramsch

    @JesperDramsch

    2 жыл бұрын

    Don't feel bad. I'm still rocking a full desktop PC and I wouldn't change for the world.

  • @tsizzle
    @tsizzle3 ай бұрын

    Great explanation video! One thing I would have liked to hear more about is dominance of the Nvidia CUDA framework. It seems to me that a lot of ML python libraries are compiled to work with the CUDA framework and therefore one would need to run it on Nvidia hardware. That’s the advantage that Nvidia has because it started 20 years ago developing the CUDA framework and was miles ahead of everyone else in the field of deep learning. As you said, things like Tensorflow is just starting to have Apple silicon /aarch/arm64 architecture. But Nvidia continues to innovate with RAPIDS (CUDF vs. Pandas) and with their NVLink on their DGX A100 and DGX H100 (8 GPUs w 80GB VRAM each and all linked together). However, with respect to laptop for ML, would it make sense from the perspective of a DevOps use case? Rather than using the laptop to train a huge LLM (llama2 , falcon40b, mistral, etc.) what if I just want to test a few of the prepackage Nvidia NGC containers in docker and add some additional python packages/libraries to them and test training on a smaller dataset smaller model to confirm that things work and then move the container over to the Cloud like Amazon AWS and run it on Nvidia A100 or DGX A100 resources to do the full training? Would laptops with nvidia GPUs (for docker, kubernetes, VMware) for DevOps testing purposes be useful or not at all? Thanks.

  • @frank996
    @frank9962 жыл бұрын

    If I have a pc with ryzen processor and amd integrated gpu can I still use it to access a cloud service? Sorry for the dumb question, I'm fairly a noob in this

  • @JesperDramsch

    @JesperDramsch

    2 жыл бұрын

    No worries, we all start somewhere. The cloud is literally a different computer, so as long as you have internet and some sort of PC you're fine!

  • @madmotorcyclist
    @madmotorcyclist2 жыл бұрын

    One question is has Apple with it's unified memory (shared memory between all its processors - CPU/GPU/Nueral, etc.) overcome the speed of handshaking of data required when having separate VRAM?

  • @JesperDramsch

    @JesperDramsch

    2 жыл бұрын

    That is honestly way beyond my knowledge. Sorry

  • @mannegar7650
    @mannegar76506 ай бұрын

    Pls What do u advice, i wanna get a laptop for Deepfacelab 2.0 to make deepfake vids Here are my laptop specs ; MSI raider ge78hx, corei7 13700hx Nvidia RTX 4070 8gb Vram 32gb of memory 1tb. Second laptop is; MSI stealth gs77 Intel corei7 12thgen Nvidia RTX 3070ti with 8gb vram 32gb ddr5 memory 1tb Are these specs good enough to run deepfacelab and get decent results?

  • @chrisk7332
    @chrisk7332 Жыл бұрын

    Agree with many things here, great video! However, using cloud GPUs is cheap at first sight, but letting a model train for days on cloud GPUs might be much more money than your electricity bill and cost you in the hundreds (with a sizeable model) and should be considered into the whole calculation. Cloud GPUs range from 0.2 €/hr (single 3090) up to 4€ /hr (multi-A100), a discrete GPU might pay off in less than a year depending on your project.

  • @JesperDramsch

    @JesperDramsch

    Жыл бұрын

    It's a consideration for sure. But if you're running a model for multiple days straight, I would try and dissuade from a laptop regardless and go for a desktop or server-solution. It'd be really annoying to have a laptop that has to stay on for days on a power outlet.

  • @chrisk7332

    @chrisk7332

    Жыл бұрын

    @@JesperDramsch you are right - I kind of ignored the fact your specificly talking about laptops - more used to SSHing next to my GPU

  • @JesperDramsch

    @JesperDramsch

    Жыл бұрын

    Agree there

  • @jhonenriqueramirez5799
    @jhonenriqueramirez57992 жыл бұрын

    Hey there! Love it! Great video, really useful. So, I just started my journey (MS in Data Science), and sure thing, I need to upgrade my PC. I want a laptop since it is better to work at any place, but I'm really confused about all this stuff, processor, GPU, RAM, and so on. I don't have a big budget, so I wonder what should I prioritize? Thanks to your video, I understand the first thing is RAM! Is it 16Gb RAM enough? And second, I've heard each processor is good depending on the specific task, talking about Ryzen and Intel, which one could be better, especially if I will have to work later in my projects and other small programming tasks? thank you in advance for taking a few minutes to help me with my doubts.

  • @JesperDramsch

    @JesperDramsch

    2 жыл бұрын

    I think 16GB should be plenty in a laptop. For most normal tasks you'll be happy with it. As for processors, it pretty much doesn't better. I like AMD, but I think you'll be happy with either.

  • @ShotterManable
    @ShotterManable Жыл бұрын

    Nowadays with LlaMA models we might can run some models on our laptops

  • @JesperDramsch

    @JesperDramsch

    Жыл бұрын

    Llama has 65 billion parameters. Are you sure?

  • @quantum3712
    @quantum37122 жыл бұрын

    Hello, i am getting into data science and after looking at your videos i feel dedicated graphic card is not a necessary requirement (at least for someone who is learning to code). I am contemplating thinkpad, 16gb ram and amd ryzen 5 pro processor without any dedicated graphic card. I have had a gaming laptop from dell and to be honest they are not at all reliable so I am refraining getting one for data science work. Thinkpad is reliable as what i have seen from reviews of lot of consumers. What do you suggest?

  • @JesperDramsch

    @JesperDramsch

    2 жыл бұрын

    Those sound like good considerations

  • @quantum3712

    @quantum3712

    2 жыл бұрын

    @@JesperDramsch thanks for your valuable information. Looking forward to learn from you. 🙏

  • @JesperDramsch

    @JesperDramsch

    2 жыл бұрын

    @@quantum3712 you're welcome. Hope it works out for you!

  • @stellamn
    @stellamn2 жыл бұрын

    Thanks for your recommendation with that cloud you suggested. I will try that! Though, I write deep learning networks also for my own projects in computer vision and would prefer not to use a cloud. Also because that requires internet access and I also enjoy working at places where I sometimes don’t have internet. Therefore, I’d appreciate a video about good laptop options for that purpose. P.S. It needs to be compatible w/ Fedora or Ubuntu distro

  • @JesperDramsch

    @JesperDramsch

    2 жыл бұрын

    Do you have power where you don't have internet?

  • @stellamn

    @stellamn

    2 жыл бұрын

    @@JesperDramsch to work for 2h outside it’s sufficient when my laptop is fully charged. Obviously, I will not let a very deep network learn for several hours if I just planned to go outside for 2h. In that time I would either build parts of the architecture or some test to try something out.. some ideas for architectures.. etc.

  • @JesperDramsch

    @JesperDramsch

    2 жыл бұрын

    @@stellamn that makes sense. I'd go for portability anyways then. Build it offline. Make tests offline then train in the cloud later when you're back. Otherwise see that you get a laptop with a compatible Nvidia card and enough RAM if you still want to train on your laptop.

  • @JesperDramsch

    @JesperDramsch

    2 жыл бұрын

    A pc like that will not be very portable though oftentimes. They get heavy and it can very power draining.

  • @stellamn

    @stellamn

    2 жыл бұрын

    @@JesperDramsch don’t worry, I did already my own research and found some possible solutions. Thanks for your suggestions :) (I didn’t see the prior message)

  • @ettavictor4804
    @ettavictor4804 Жыл бұрын

    Thank you so much for your exposition. I just got into machine learning at the start of the year (so 6 to 7 months at the time of writing). I have a gaming laptop with 6GB of VRAM but I find that it's not the GPU that's utilized when I'm training ANNs. So I've been considering the M1 Macs because of the inbuilt neural engines. Could you make a video detailing them, just as you did the GPU?

  • @JesperDramsch

    @JesperDramsch

    Жыл бұрын

    I'll put it on my idea list. Thanks!

  • @zainkhalid472

    @zainkhalid472

    Жыл бұрын

    Your GPU was not being utilized because you need to explicitly write code to run it on GPU. Like you will need to select Machine for processing and then move your matrices (arrays) into tensors etc..

  • @ostensibly531

    @ostensibly531

    Жыл бұрын

    Buying a different Machine won't solve your problem.

  • @vijaykumar-qi8ml
    @vijaykumar-qi8ml2 жыл бұрын

    I am working in java, python no-sql & bigdata. And want to learn NLP & deep learning. I'm looking for a durable laptop. My intention to buy a gaming laptop is learn to deep learning only. Not for gaming. I would like to buy Omen Ryzen 5800H with Rtx 3060 6gb or Legion Ryzen 5600H with Rtx 3050 4gb. I have two questions- 1. Will you suggest to buy a gaming laptop to learn ML/DL? 2. Suppose I am working on a java application, a non gpu task on that laptop. Will gpu run all the time? Will it effect the laptop longevity due to heat generation? Please advice.

  • @JesperDramsch

    @JesperDramsch

    2 жыл бұрын

    6Gb and 4GB is very small for modern-day applications, like I said in the video.

  • @himavanthkumar5269

    @himavanthkumar5269

    Жыл бұрын

    Hi I am in the same situation like you - please suggest best laptop. Can I go for gaming laptop.

  • @LewiUberg
    @LewiUberg2 жыл бұрын

    I trained a CNN on the MURA dataset (40k mri’s). My MacBooks battery swelled and the whole top case had to be changed 😅

  • @LewiUberg

    @LewiUberg

    2 жыл бұрын

    Btw! I used my macs gpu with plaidML, but it doesn’t look like it’s being maintained anymore 😫

  • @JesperDramsch

    @JesperDramsch

    2 жыл бұрын

    That's terrifying. I hope it was under warranty 😱

  • @LewiUberg

    @LewiUberg

    2 жыл бұрын

    @@JesperDramsch yes! Or else I would be crying still 🥴 now I write most of my code locally, then upload to colab for training.

  • @JesperDramsch

    @JesperDramsch

    2 жыл бұрын

    Very relatable.

  • @RC-qi6hs
    @RC-qi6hs2 жыл бұрын

    Is that legion 7 you are using. Im a student and i am planning to get one.

  • @JesperDramsch

    @JesperDramsch

    2 жыл бұрын

    I'm afraid not, sorry.

  • @rejuwanshamim1870
    @rejuwanshamim18702 жыл бұрын

    can i use amd latest gpu RX6000 series to learn deep learning and machine learning???? hope to get your reply soon

  • @JesperDramsch

    @JesperDramsch

    2 жыл бұрын

    At the moment it's still very difficult on Radeon cards. So for now I'd say no.

  • @alzeNL
    @alzeNL Жыл бұрын

    This is a useful video, but having tried tensorflow-metal on osx/mac its just not ready (in 2022) - the particular piece of work I'm doing sees the ML RNN network come to a screeching halt after several hours, the issue has been replicated by Apple Developers, but they have yet to offer a fix, in the meantime I cannot do any development on my mac. Because I have to run the model, I went for a gaming laptop that is CUDA compatible, in 2022 I was able to pick up a laptop with 4G of video ram for less than £800 - that is alot, but compared to running ML/AI GPU on cloud providers, a better and cheaper development environment (An EC2/P3 for Horovod costs £3.59 an hour in eu-west-2). I've only just found your channel and will subscribe, but I think for 2022 this video could be updated as there are some good gaming laptops with nvidia chipsets that a fully CUDA comapatible that allow tensorflow to run natively.

  • @harishvarkannadasan5555

    @harishvarkannadasan5555

    11 ай бұрын

    @alzeNL can you recommend me such laptops in 2023?

  • @alzeNL

    @alzeNL

    8 ай бұрын

    @@harishvarkannadasan5555 hello, just revisting this video and saw your comment - the laptop I use for ML/DL is a ASUS TUF Gaming F15 - It takes some tweaking, but even some of the largest RNN will load, it just takes time for them to produce the models, but still cheaper than cloud computing!

  • @HelloMedicAnkit
    @HelloMedicAnkit Жыл бұрын

    Laptops are aerodynamic 🤣🤣🤣🤣🤣🤣...

  • @JesperDramsch

    @JesperDramsch

    Жыл бұрын

    💸

  • @TheStallion1319

    @TheStallion1319

    Ай бұрын

    I liked the expression 😅

  • @pratikthakur5052
    @pratikthakur50522 жыл бұрын

    I am a Data Science student and my laptop specs are low but can I use only cloud for the projects?

  • @JesperDramsch

    @JesperDramsch

    2 жыл бұрын

    At least in the beginning you should, yes.

  • @pratikthakur5052

    @pratikthakur5052

    2 жыл бұрын

    @@JesperDramsch Okay Sir, thank you !

  • @manuelkarner8746
    @manuelkarner87462 жыл бұрын

    helpful video thanks, are you a german native ?

  • @JesperDramsch

    @JesperDramsch

    2 жыл бұрын

    Yeah, I'm from the North. Thanks!

  • @jorge1869
    @jorge1869 Жыл бұрын

    RAM is the key. At least, from my experience in ML.

  • @rajyadav2330
    @rajyadav23302 жыл бұрын

    Best comments ever on buying laptop for ML

  • @JesperDramsch

    @JesperDramsch

    2 жыл бұрын

    Thanks Raj!

  • @gorkemhazarr
    @gorkemhazarr Жыл бұрын

    Dude i dont know is it enough for me? For beginner = rtx3060 , 32gb ram , i7 12th gen , 512gb ssd (Hp Victus 16) . Is it ok for me? What do u think?

  • @JesperDramsch

    @JesperDramsch

    Жыл бұрын

    That's a pretty beefy PC. I'd hope it works for most consumer models

  • @Itachi-c137

    @Itachi-c137

    5 ай бұрын

    @@JesperDramsch Will a i5-12450h with a gtx 1650 and 64gb ram be okay?

  • @alpha001ful
    @alpha001ful8 ай бұрын

    Tensorflow has issues with M1/M2 macbooks.

  • @Duge6124
    @Duge61242 жыл бұрын

    Is jumping to a 32 gb RAM from 16gb worth it if you are going to be training a lot of Deep Neural nets (mostly Natural Language processing)

  • @JesperDramsch

    @JesperDramsch

    2 жыл бұрын

    Probably. It just means you can fit twice the data in loading/preprocessing. Not having enough RAM can be annoying

  • @Duge6124

    @Duge6124

    2 жыл бұрын

    @@JesperDramsch thanks 👍 Great and informative video by the way. If you are buying the new Macs please do another one in depth like this. I believe people around the world are looking for this kind of content

  • @JesperDramsch

    @JesperDramsch

    2 жыл бұрын

    @@Duge6124 will do!

  • @DaarioNeharis

    @DaarioNeharis

    2 жыл бұрын

    @@JesperDramsch its weird that your video comes in my recommendation when I just faced the problem of my 32 gb ram not enough.. upgrading to 64 gb now.

  • @JesperDramsch

    @JesperDramsch

    2 жыл бұрын

    @@DaarioNeharis Google knows 😂

  • @zakahaaji2358
    @zakahaaji23582 жыл бұрын

    Hei, can you name some Cheap laptop not Mac, for a beginner who want to self learn python and later artificial intelligence for under 800$ ,

  • @tolulopeoyemakinde3068
    @tolulopeoyemakinde3068 Жыл бұрын

    Does the new AMD GPU work with deep learning ?

  • @JesperDramsch

    @JesperDramsch

    Жыл бұрын

    It's getting better, but often it doesn not.

  • @nir0pilot
    @nir0pilot Жыл бұрын

    this high-pitch sound you heard most likely came from capacitors

  • @JesperDramsch

    @JesperDramsch

    Жыл бұрын

    Possibly. Might also be coil whine though.

  • @SilhouetteOfLight
    @SilhouetteOfLight2 жыл бұрын

    Hi Jesper, congrats on reaching a 1K Subs. Especially like your calm style of communication in your videos. I am an absolute beginner in Data Science and I was wondering if you have any advice on how to get more practical info on the ground realities of this field. Few initial questions that I have are... What's the right balance between Math\Stats vs Programming. When to start with your first project. What are the ground realities in job market, which data science skills are valued over others etc.. (I would be going through your video on the ideal projects to avoid)

  • @JesperDramsch

    @JesperDramsch

    2 жыл бұрын

    Thanks for the kind words! The right balance? That's hard to say honestly. Make sure you have a bit of both at least. Start your first project as early as possible. It's the best way to learn.

  • @Olimpico230
    @Olimpico230 Жыл бұрын

    what shoud i get for my graduation project. My teacher wants me to use the below techniques: -Logistic Regression -Support Vector Machine -Random Forest -Decision Trees

  • @TymexComputing
    @TymexComputing7 ай бұрын

    In fact macbook are not that expensive - maybe 1,3 of a dell or 2x of a new Acer :) but a little used macbook with nice layout/look can go well under 1000euro. I still dont recommend but they are not expensive that much - if you dont need 10 macbooks

  • @samfitness7198
    @samfitness71982 жыл бұрын

    what about amd gpus like r5500m ?

  • @JesperDramsch

    @JesperDramsch

    2 жыл бұрын

    For now AMD GPUs will not work, it has to be a Nvidia GPU. Also mobile GPUs often have less oomph than their desktop counterparts (the m after the number).

Келесі