NOTE: Gradient Boost usually uses regression trees. These are very similar to classification trees, but have a slightly different way to decide how to add branches and leaves. For more details, see: kzread.info/dash/bejne/mW2XmJiNhdzSipc.html Support StatQuest by buying my book The StatQuest Illustrated Guide to Machine Learning or a Study Guide or Merch!!! statquest.org/statquest-store/

@nataliabarros4765

3 жыл бұрын

Hi Josh. Is there a video similar to this but about Lightgbm?

@statquest

3 жыл бұрын

@@nataliabarros4765 Not yet, but I have a video about XGBoost: kzread.info/dash/bejne/gah4mtmPkanTZqg.html

@parijatkumar6866

3 жыл бұрын

@@statquest Keenly awaiting Sir.

@statquest

3 жыл бұрын

@Kristofer Yes, that is correct. That tree is a Regression Tree because it was fit to continuous values (which we see in the leaves).

@statquest

3 жыл бұрын

@Kristofer No, Gradient Boost Classification is still done with Regression Trees because we are fitting the trees to residuals. For details on Regression Trees, see: kzread.info/dash/bejne/mW2XmJiNhdzSipc.html

When I search something up and there's a statquest video for it, I feel happy.

@statquest

13 күн бұрын

Bam! :)

Thanks for your immense contribution to humanity

@statquest

4 жыл бұрын

Thank you! :)

@Privacy-LOST

4 жыл бұрын

This is not an overstatement

@statquest

4 жыл бұрын

@@Privacy-LOST :)

@dahailiu2067

4 жыл бұрын

@@Privacy-LOST 😂😂😂😂😂

@lpcruz5661

3 жыл бұрын

I agree, a step in the right direction and likely save the world

This channel should be boosted. Better than my professor.

@user-wl4ck1vb9q

4 жыл бұрын

I also think soI

@trantoan6985

3 жыл бұрын

Sure

@parijatkumar6866

3 жыл бұрын

Yes

@beautyisinmind2163

3 жыл бұрын

@@user-wl4ck1vb9q 中国教授这样教不了的

@suprobhosantra

3 жыл бұрын

Use xgboost to boost the chnl😂

i still remember the first StatQuest i watched. "you can fit a line, you can fit a squiggle, you can make me laugh, you can make me giggle. StatQueeeest" keep up the good work. this is one of the best channels of all. thanks josh.

@statquest

4 жыл бұрын

Thank you so much! (and that's one of my favorite intro songs...!)

You were BAMless for ten min. I was kind of concerned. But then you made a step in the right direction.

@statquest

5 жыл бұрын

Ha! :)

@AyushMandowara_xx7

2 жыл бұрын

I am assuming that "BAM" is a famous keyword in these videos. Is my mental model making the correct prediction?

Holy shit, I was able to finish my assignment in 1 night while watching this. For the past 1-2 weeks I'm doing an all-nighter and pulling my hair to finish my assignment using the notes I have from my class.

@statquest

4 жыл бұрын

Hooray!!!! I'm glad the video was helpful! :)

Hey your channel is a saviour for me because you make all complicated concepts easy to understand . Thanks for contributing the datascience community with such great content

@statquest

4 жыл бұрын

Thank you so much! :)

Thanks for your hard work producing all these incredible tutorials Josh. I just can't imagine how'd I have learned these concepts otherwise without your videos!

@statquest

Жыл бұрын

I'm happy to hear my videos are helpful. BAM! :)

One of the best explanations for GB regressor. Excited for the next one.

Your channel has the best videos I found for explaining gradient boosting (and many other data science and stats topics). Really appreciate it!

@statquest

4 жыл бұрын

Thank you very much! :)

I’m preparing for an interview and this definitely helps!

This video came out at exactly the right time!! Triple BAMMM!!!! Thanks, Josh! :)

Josh - another amazing video, well done! Been waiting for this one, looking forward to parts 2 & 3. Thank you so much for your crystal clear explanations - its so refreshing in a world full of confusing, jargon filled stats tutorials. Your videos really stand out!

I really like the contrast between different models that are seemingly similar. It helps a lot to clarify the ideas.

@statquest

2 жыл бұрын

Thank you! :)

Hi Josh, this is by far, the clearest explanation for a concept I was try to figure out for 3 months. Thank you very much! really appreciate your effort ! Keep up the good work !

@statquest

5 жыл бұрын

I'm glad you finally got the information you needed to understand how Gradient Boost worked.

@marvellousmoonvalley7085

4 жыл бұрын

Same here. For more than a year, I have been using Gradient Boosting heavily because of its accuracy, without understanding how it works. Now all is clear to me. Thank you, StatQuest!!!!!!!!!!!!!!!!!

After waiting for a while, finally, the series is here. Thanks :)

The Moment I clicked in and realized it is from StatQuest, I just knew I'm gonna have a really great grip on this topic.

great material, thank you :) sometimes, we need to relax, take a step back and look at seemingly complicated things with a simple perspective. I hope more teachers are exposed to this kind of freedom and agility to creatively present their lessons.

@statquest

2 жыл бұрын

Glad it was helpful!

thanks for another amazing vid. watching this video alone improves my understanding not only about the model, but also about hyperparameters which makes me better at ML modelling. lucky to have you in the community.

@statquest

Жыл бұрын

Thank you!

This is some godlike storytelling, I know myself sometimes skipped/half-understand the mathematical reasoning behind every algorithm, because sometimes its unbearable, too mathematical. You get the essence and storytelling it perfectly! Thanks man! Tha'ts a subs and bell for you!

@statquest

2 жыл бұрын

Bam! Thank you very much! :)

This is a great example of designing good instructions ! The methods you use for putting the learner in the right mindset for taking in difficult information is just inspirational

@statquest

4 жыл бұрын

Thank you very much! :)

I was scratching my head for 2 days to understand the GB algorithm and all the sites and resources on the internet are quite confusing. You just explained it so clearly and BAM...you got a new subscriber!

@statquest

4 жыл бұрын

Awesome! Thank you very much! :)

Excellent! Looking forward to future parts of the series!

Wow Josh - this is just what I needed right now. Bring on part2!!

Every time I try to learn new machine learning algorithm, I will firstly check your channel. You really helped me a lot!

@statquest

2 жыл бұрын

Awesome, thank you!

Finally! I have been waiting for you to talk about this since last year. GBM for classification would be more exciting, can't wait.

@statquest

5 жыл бұрын

Two more weeks to go!

Finding StatQuest channel "results in a small(but hugely significant) step in the right direction'" for ML. Thank you so much Josh!!

@statquest

3 жыл бұрын

Hooray! :)

Thank you for all the hard work you do to produce these videos. They are simply fantastic and every one rekindles my appreciation for statistics.

@statquest

4 жыл бұрын

Awesome! :)

Thank you Josh for this very fun video! I really enjoy watching these videos and I learnt a lot on how this is done! The use of specific step-by-step examples makes a big difference in terms of my understanding!

@statquest

3 жыл бұрын

Glad it was helpful!

I found boosting conceptually harder to grasp than bagging and random forest. This video explains each step with nice clear graphics with just about right pace! Thanks for the great efforts you have put into making this brilliant work.

@statquest

Жыл бұрын

Glad it helped!

Hi Josh, I am a Data Scientist and a music enthusiast (drummer). This video has cleared a long time confusion of mine. Thanks a lot buddy. Your songs are also good. :) Keep Rocking.

@statquest

4 жыл бұрын

Thank you very much! I'm glad you like my stuff! :)

You are just awesome!!! It’s 2:10 am London time! I have to submit my coursework tomorrow morning! I had to code it from scratch! Thank you so much 🙏

@statquest

4 жыл бұрын

I hope you get a good grade! Let me know how it goes. :)

Loved your videos, man! It's actually makes it's easy to understand the concepts behind the models instead of trying to read their papers, which can take time and some times can be really hard .

@statquest

Ай бұрын

Thank you!

This man saves my life. I first tried to understand the one by reading the book: Elements of Statistical Learning, the book is too complicated and too much information for beginners. I think it's better approach to learn the cores with the visualization first, just like this video, and mathematical properties then next. Looking forward to watching the next video! Right away!

@vamsikrishnaj4429

3 жыл бұрын

Well Said!

statquest is the best ML video out of all on the internet

This is probably the best CS/Math channel I've ever seen. Right up there with 3Blue1Brown, Kudos!

@statquest

3 жыл бұрын

Thank you!

You are amazing! I have been reading papers and ppts, none of them helped me to visualize the mechanism as what you have done! BAM!

@statquest

4 жыл бұрын

Thank you! :)

Man !! you are such a gem. Even kids can learn these topic if they refer your videos

@statquest

3 жыл бұрын

Thanks!

Greatest Video I saw on the Internet to understand with this much clarity

@statquest

5 жыл бұрын

Thank you very much! :)

Salut Josh et merci! (Just a french person trying to show his gratitude). Man, your method is amazing and you have a good voice. I saved your videos and locked them in a safe for when my 5 y old daughters are ready to hear about stats and ML... Precious gift you've got. Au revoir!

@statquest

3 жыл бұрын

Merci beaucoup!!!

@cziffras9114

4 ай бұрын

Je fais la même chose! I'm doing the same @@statquest , Merci à toi!

@statquest

4 ай бұрын

@@cziffras9114 DOUBLE BAM! :)

I wonder how can someone dislike a great content like this :/// these videos are amazing!!! even a 5 year old kid can learn complicated ML concepts from StatQuest! THANK U Josh ❤️!

@statquest

3 жыл бұрын

Thank you very much! :)

You are LOGICALY CONSISTENT You have depth knowledge of your subject

Another great video! It would have saved me a ton of time to understand how GBM works if I had watched this video rather than going through lots of random online materials.

Having summary at the end is so thoguhtful but extra effort on your part but hugely helpful for the learner! Thanks.

@statquest

4 жыл бұрын

Thank you! Very few people watch the summaries (youtube gives me statistics that tell me when people stop watching) so I've been debating whether or not they are worth the effort. It's good to know that you appreciate them.

I was working on this all day, because most examples on the internet only touch the classification side of tree-based models. And now my Messiah, my saviour. StatQuest is the only true way of living and all infidels shall be doomed to misinterpret data for the rest of their mortal existence.

@Erosis

5 жыл бұрын

BAM

@statquest

5 жыл бұрын

Thanks!!! :)

@ailiani

5 жыл бұрын

TRIPLE BAM!!!

@calvin5371

5 жыл бұрын

So basically while constructing a tree we can take features in any combination? ... like .. and do we have to take all the features?

@marvellousmoonvalley7085

4 жыл бұрын

@@calvin5371 Decision Tree is a whole subject in itself. The algorithms for efficiently constructing an efficient decision tree are quite established. Sometimes we can ignore certain features when they are irrelevant.

what a great video.I watched multiple lectures on this from various colleges.it is by far the best

@statquest

4 жыл бұрын

Awesome!

very good explanation. First time, I got a a detailed understanding of the boosting algorithm and how trees are built.

@statquest

4 жыл бұрын

Thanks! :)

Thank you for actually explaining it, and not just "you would ask a bunch of doctors".

@statquest

9 ай бұрын

Thanks!

You are beyond words Josh. Just love the work you are doing.

@statquest

4 жыл бұрын

Thank you! :)

thank you so much, you are basically not wasting any of your words explaining this concept.

@statquest

4 жыл бұрын

Thanks! :)

This was the first video which I've seen from your channel and believe me now i can't get rid of following u.. thankyou for such a nice explanation..

@statquest

2 жыл бұрын

Thank you!

This is the best explanation of the gradient boost. Period.

@statquest

3 жыл бұрын

Thank you! :)

Watched many machine learning videos from your channel, very nice and clear and easy to follow , thank you ! good luck to my final tomorrow too!

@statquest

5 жыл бұрын

How was your final?

This is brilliant. Simple yet detailed

@statquest

4 жыл бұрын

Thank you! :)

Probably one of the best explanation of GB I have ever seen

@statquest

5 жыл бұрын

Thank you! :)

You got my heart at the intro.

You're AWESOME man! your videos are easy to understand and you use your BAMS wisely.

@statquest

4 жыл бұрын

Thank you so much! :)

This is similar to Random Forest. Great explanation. Great job!

I have my Classification final tomorrow and Josh, you explain 100% better than my prof and the textbook combined. Thanks for boosting my confidence!

@statquest

4 жыл бұрын

Good luck with your final. Let me know how it goes. :)

Awesome explanation! Thank you very much!!!

People who doesn't like his videos ... are with no BAM! please guys who watch his videos do like it .. least you can contribute and you know how much it takes to make such videos ...just go through refrence and read it

@statquest

4 жыл бұрын

Thank you! :)

I am amazed .. such a complicated topic you have explained so simply.

@statquest

5 жыл бұрын

Thank you so much! :)

Your videos are awesome..you deserve much more attention from ML community. Hope you reach more heights and explain us many more concepts!

@statquest

3 жыл бұрын

Thank you very much! :)

look forward to see the next 3 series

What would I do without your videos? Thanks a ton!

@statquest

3 жыл бұрын

Wow, thanks!

the clearest explanation for gradient boosting on the internet

@statquest

4 жыл бұрын

Thank you! :)

this is incredible! very clear. thank you so much!

@statquest

5 жыл бұрын

Thanks! :)

Im in love with this chanel, idk how i didnt know about it

@statquest

2 жыл бұрын

Bam! :)

Thanks for painting such a clear picture. It really helped!

@statquest

7 ай бұрын

Thanks!

this is pure gold, Josh!

@statquest

2 жыл бұрын

Thanks!

Great job sir. I am hoping that you will make a video on explaining Frequency Ratio. Thank you.

It is the first vedio that makes clear for me to understand Gbm

@statquest

5 жыл бұрын

Hooray! :)

I like these BAMs. Improves understanding a lot!

@statquest

2 жыл бұрын

bam!

Excellent methodology! You've just gotten a new subscriber.

@statquest

4 жыл бұрын

Awesome! Thank you very much! :)

Dude... how tf is this channel not one of the most subscribed on youtube ?

Too good sir! Nothing can get better than this...namaste!!!

@statquest

5 жыл бұрын

Thank you! :)

"Then it scales the tree".-Awesome animation and great video as always!

@statquest

2 жыл бұрын

Thank you so much 😀!

i love your channel! Thanks a lot for providing such good resources to the curious learners :)

@statquest

2 жыл бұрын

Glad you enjoy it!

For understanding any ML algorithm ... yours is my go to channel!! Thank you tons !!!

@statquest

4 жыл бұрын

Awesome! Thank you! :)

Watching StatQuest videos is like multiplying yourself by the learning rate......slowly and steadily, you reach the goal

@statquest

3 жыл бұрын

bam! :)

I was going to give up to study machine learning, but you save me. I will have to contribute to the world like you. Really thank you for nice educational resource...>

@statquest

2 жыл бұрын

Happy to help!

This channel saves my machine learning!

@statquest

3 жыл бұрын

Glad to hear it!

This is becoming more n more awesome josh.... MEGAAAAA BAMMMMMM

@calvin5371

5 жыл бұрын

So basically while constructing a tree we can take features in any combination? ... like .. and do we have to take all the features?

Wow, you are amazing, thanks for sharing your knowledge in such a didactic way! Greetings from Chile :)

@statquest

4 жыл бұрын

Hola Chile! I'm glad you like my videos. :)

Explanation for those 33 dislikes: KZread adds Dislikes to Statquest videos just to make sure that THEIR MODELS DON'T GET UNDERFIT due to biased(Only likes) Training data .....

@statquest

3 жыл бұрын

Ha! You made me laugh. :)

Let it be my first comment on KZread... Really great and super very well explained things in simple words! Josh thank you for the great job!!!

@statquest

4 жыл бұрын

Thank you very much! :)

I cant thank you enough for this amazing tutorial!

@statquest

2 жыл бұрын

BAM!!!

Simple and excelent explanation, thanks for made this class; greeting from Brasil!

@statquest

3 жыл бұрын

Muito obrigado! :)

Thanks, your videos helped me start my professional career! (initially small but gradually increasing in significance BAM!)

@statquest

4 жыл бұрын

That is awesome!!! TRIPLE BAM!!! :)

Who else hasn't started learning from this GENIUS??

@statquest

4 жыл бұрын

BAM! :)

Best video I've ever watched. Thanks a lot :)

@statquest

2 жыл бұрын

Wow, thanks!

Thank you. Just Amazing. Made it simple and clear

@statquest

3 жыл бұрын

Thanks!

It was a very simple explanation of the complicated concept .Thanks for the great efforts and iam very passionate about your technique to slowly unravel the concept to brevity. Please keep doing the good work and may god bless you and your initiatives.

@statquest

3 жыл бұрын

Thank you very much! :)

Great videos! By the way, I’m not sure if you’ve been told this before, or if this is what you’re going for, but the combination of your voice, your persona throughout your videos, and the intro for each of your videos remind me of Steve on Blue’s Clues.

@statquest

4 жыл бұрын

I actually don't know Blue's Clues, but I'm glad you like my videos. :)

Thank you very much, I've got the intuition of gradient boosting. MEGA BAM🥰

@statquest

Жыл бұрын

Awesome!

You are making my dream of becoming a data scientist comes true. Thank you so much fron the bottom of my heart

@statquest

9 ай бұрын

Thanks!

Thank you good sir! Your videos are amazing, very helpful!

@statquest

2 жыл бұрын

Thanks!

amazing videos. thanks for the playlist. I learnt a lot!

@statquest

2 жыл бұрын

Thank you!

Watching these videos is the best thing someone can do before jumping into papers and articles.

@statquest

3 жыл бұрын

bam!

@arda8206

3 жыл бұрын

@@statquest Can you please mention some of the papers or resources that you used while making these videos?

@statquest

3 жыл бұрын

@@arda8206 They are listed in the videos description, but I'll copy and paste them here. A 1999 manuscript by Jerome Friedman that introduced Stochastic Gradient Boost: statweb.stanford.edu/~jhf/ftp/stobst.pdf The Wikipedia article on Gradient Boosting: en.wikipedia.org/wiki/Gradient_boosting The scikit-learn implementation of Gradient Boosting: scikit-learn.org/stable/modules/ensemble.html#gradient-boosting

@arda8206

3 жыл бұрын

@@statquest oh my bad, thank you.