Kaggle: How to Place in the Top 10% (part 1)

Ғылым және технология

This is the first part, in a series where I will discuss some techniques for placing in the top 10% that I've used in two Kaggle competitions using just a laptop and no cloud. I made use of Python, Scikit-Learn, XGBoost, and TensorFlow. I will also be covering some of the Python code that I used.
My Kaggle Playlist: bit.ly/2Evax1Q
My Kaggle GitHub Utilities: github.com/jeffheaton/jh-kagg...
My Kaggle profile: www.kaggle.com/jeffheaton

Пікірлер: 61

  • @HeatonResearch
    @HeatonResearch5 жыл бұрын

    More videos posted in this series, here is the playlist: kzread.info/dash/bejne/poeu1MeccsffesY.html

  • @ianseward6310

    @ianseward6310

    3 жыл бұрын

    Can you put this in the description?

  • @suwengu6335
    @suwengu63355 жыл бұрын

    Thank you so much! Looking forward to the subsequent videos on this topic.

  • @HeatonResearch

    @HeatonResearch

    5 жыл бұрын

    Your welcome, they will be coming.

  • @HeatonResearch
    @HeatonResearch5 жыл бұрын

    So, for those of you viewing this... What is your language of choice? These videos will be using Python. Libraries will be sklearn, xgboost, & TensorFlow. Anyone currently in a Kaggle?

  • @abblabblabalaba

    @abblabblabalaba

    5 жыл бұрын

    Hi! My language of choice is Clojure (or any lisp rly), and this is probably the 3rd or 4th time I've heard of kaggle. I don't have the skillset to participate, but i wanted to say you make great videos. Keep it up :)

  • @HeatonResearch

    @HeatonResearch

    5 жыл бұрын

    Thanks! Clojure is cool, I have not worked with it a great deal. Most of my pure functional experience is in Scheme.

  • @brotherlui5956

    @brotherlui5956

    5 жыл бұрын

    Hi Jeff, i followed your Fall 2018 course and the included Kaggle challenge was my first one ever. Unfortunately i missed the start somehow and had only 3 days to create a model. It was quite exciting to see that my model was not that bad as i first thought. In December i was busy doing the daily AdventOfCode challenges and now i'm looking forward to this series of videos which i'll use to dive deeper into Kaggle. I really like to learn from your experiences, you're a good teacher. Best regards, Thomas L.

  • @tonym5857

    @tonym5857

    5 жыл бұрын

    Python or C# ( TensorFlow )

  • @HeatonResearch

    @HeatonResearch

    5 жыл бұрын

    @@brotherlui5956 Kaggle is alot of fun. Takes alot of time. I should announce this semester's Kaggle by March 18th. You (or anyone) is welcome to join. Trying a real Kaggle is great too. The thing to remember with Kaggle, is that scores will not hurt you. So its always a good time to try!

  • @joaquinmorenoantuna9573
    @joaquinmorenoantuna95734 жыл бұрын

    Hi Jeff, excellent videos. It would be amazing if you can upload a video of the "Classify forest types" for the Roosevelt National Forest. Best!

  • @parvezmulla3324
    @parvezmulla33245 жыл бұрын

    Waiting for your upcoming videos!

  • @HeatonResearch

    @HeatonResearch

    5 жыл бұрын

    Working on that now, actually.

  • @brunovandekerkhove5688
    @brunovandekerkhove56885 жыл бұрын

    Thanks, you explain things well.

  • @HeatonResearch
    @HeatonResearch5 жыл бұрын

    If you want to have a look at the source code, I've started to upload it here. I plan on covering this in the next video Monday. github.com/jeffheaton/jh-kaggle-util

  • @checkpeck
    @checkpeck5 жыл бұрын

    @Jeff how can I approach you with a specific problem?

  • @alexianthefisherman
    @alexianthefisherman4 ай бұрын

    Thanks for the explanation i really appreciate it

  • @KPOPYakuzaz
    @KPOPYakuzaz5 жыл бұрын

    I'm a novice Python developer, but work in an environment where i am CONSTANTLY using Python, PHP, JS, Java, C#. I'm interested in learning how to begin these competitions, but have no idea where i can even begin to learn how to use Python in this way - can you point me in the right direction? Awesome video, looking forward to more :) edit: Just saw the part about titanic and kaggle introduction, whoops :p

  • @HeatonResearch

    @HeatonResearch

    5 жыл бұрын

    Titanic is a common suggestion and I agree with it. That was the first Kaggle competition that I started with.

  • @bensisakht7076

    @bensisakht7076

    5 жыл бұрын

    I’d also suggest you invest some time in learning about méthodologies of data science and statistics as knowing python is not enough for competing, coursera have some fantastic courses on data science. Good luck 😊

  • @momen_ai
    @momen_ai5 жыл бұрын

    thank you. so useful.

  • @HeatonResearch

    @HeatonResearch

    5 жыл бұрын

    Hope to add the next video in a week or so!

  • @leonardommarques
    @leonardommarques5 жыл бұрын

    ok, but how do I grow such massive mustache?

  • @HeatonResearch

    @HeatonResearch

    5 жыл бұрын

    Shhh.. Its my disguise. :-)

  • @leonardommarques

    @leonardommarques

    5 жыл бұрын

    @@HeatonResearch :-{)

  • @HeatonResearch

    @HeatonResearch

    5 жыл бұрын

    Cool. Just when I thought I knew every ASCII emoticon!

  • @npr1m991
    @npr1m9912 жыл бұрын

    I'm relatively new to kaggle so I wonder why people publish those super features ? Wouldn't them have more chances to win if they keep it secret ?

  • @kazanova2337
    @kazanova23375 жыл бұрын

    +1 , these are all good points.

  • @HeatonResearch

    @HeatonResearch

    5 жыл бұрын

    I am honored to have a +1 from one of the greatest Kagglers!!

  • @kazanova2337

    @kazanova2337

    5 жыл бұрын

    @@HeatonResearch The honor is all mine -My first experience with neural networks was through Encog -:), so thank you for that!

  • @shankarsuman8801
    @shankarsuman88012 жыл бұрын

    Howuch time in years months does it take to reach to a stage of wining cash prize and becoming grandmaster If I start today?

  • @ProfessionalTycoons
    @ProfessionalTycoons4 жыл бұрын

    thank you for this

  • @EngRiadAlmadani
    @EngRiadAlmadani3 жыл бұрын

    Great sir

  • @ianyang8799
    @ianyang87995 жыл бұрын

    Hi Jeff, 720p or 1080p quality video might be better I think

  • @HeatonResearch

    @HeatonResearch

    5 жыл бұрын

    Agree, error on my part for the encoding of this one.

  • @kulasekhar
    @kulasekhar5 жыл бұрын

    wow! watching a 480p video after almost 3 years :O

  • @HeatonResearch

    @HeatonResearch

    5 жыл бұрын

    Sorry about that, wrong setting.

  • @ayeoh47
    @ayeoh475 жыл бұрын

    dope

  • @ammarazlan2919
    @ammarazlan29195 жыл бұрын

    I'm interested in the description where you wrote: "..using just a laptop and no cloud.". Would you mind sharing the specs of your laptop and other experimental setups you use like IDE etc. Much appreciate it. Thank you.

  • @HeatonResearch

    @HeatonResearch

    5 жыл бұрын

    Macbook Pro 16GB, for tools, mainly PyCharm... Lately I've been using VSCode more. Of course Jupyter too.

  • @ammarazlan2919

    @ammarazlan2919

    5 жыл бұрын

    @@HeatonResearch Thanks for the reply. Unfortunately, it's too expensive for me. What would you recommend for a student searching for an affordable laptop to do deep learning?

  • @HeatonResearch

    @HeatonResearch

    5 жыл бұрын

    @@ammarazlan2919 I would max memory over CPU. Also, you can look at cloud. Also, for free cloud, have a look at Google colab. Or, look at a Kaggle kernels competition (in this type, all computation is done by Kaggle)

  • @ammarazlan2919

    @ammarazlan2919

    5 жыл бұрын

    @@HeatonResearch Thank you so much for your thorough answer

  • @Q_QQ_Q
    @Q_QQ_Q5 жыл бұрын

    Can we compute on cloud for free ? I have just old laptop with 4GB RAM :( #PleaseReply .

  • @HeatonResearch

    @HeatonResearch

    5 жыл бұрын

    Yes, GoogleColab is your best option there. I plan to do a video on how to use my files with CoLab.

  • @robindong3802

    @robindong3802

    5 жыл бұрын

    try colab.research.google.com or search colab on google, it is free of TPU and GPU.

  • @sainath66666

    @sainath66666

    4 жыл бұрын

    Or use kaggle kernels

  • @ThunderAppeal

    @ThunderAppeal

    3 жыл бұрын

    You shouldnt be competing if you dont know how to upgrade your computer. Youre incompetent by nature until you figure it out.

  • @shortmashins4031
    @shortmashins40312 жыл бұрын

    How do i join a team in kaggle,

  • @ashish_neo
    @ashish_neo3 жыл бұрын

    You look like my school principal 😂

  • @DannyPhantumm

    @DannyPhantumm

    3 жыл бұрын

    He looks like everyone's school principal

  • @gaureesha9840
    @gaureesha98405 жыл бұрын

    so even during the competition we can see other's solution?

  • @HeatonResearch

    @HeatonResearch

    5 жыл бұрын

    Only if they post it. Sometimes they will, usually not one of the top solutions.

  • @maithiltandel6667
    @maithiltandel66673 жыл бұрын

    If I stand in top 10% in the knowledge based competition like titanic dataset, then can I get a bronze model?

  • @talha_anwar
    @talha_anwar4 жыл бұрын

    Is not it their work? How can we use their work?

  • @suryanarayanan5158

    @suryanarayanan5158

    4 жыл бұрын

    They post it on the forum. So, you're allowed to use them.

  • @bensisakht7076
    @bensisakht70765 жыл бұрын

    Thanks for the helpful video. Just as a constructive feedback, perhaps shorter introduction & less repetition would be useful. Cheers

  • @moazzimalibhatti
    @moazzimalibhatti Жыл бұрын

    Good. But to summarize your talk. You are repeating one thing a couple of times.

Келесі