Activation Functions | Deep Learning Tutorial 8 (Tensorflow Tutorial, Keras & Python)

Activation functions (step, sigmoid, tanh, relu, leaky relu ) are very important in building a non linear model for a given problem. In this video we will cover different activation functions that are used while building a neural network. We will discuss these functions with their pros and cons,
1) Step
2) Sigmoid
3) tanh
4) ReLU (rectified linear unit)
5) Leaky ReLU
We will also write python code to implement these functions and see how they behave for sample inputes.
Github link for code in this tutorial: : github.com/codebasics/deep-le...
Do you want to learn technology from me? Check codebasics.io/?... for my affordable video courses.
🔖 Hashtags 🔖
#activationfunction #activationfunctionneuralnetwork #neuralnetwork #deeplearning
Next video: • Derivatives | Deep Lea...
Previous video: • Neural Network For Han...
Deep learning playlist: • Deep Learning With Ten...
Machine learning playlist : kzread.info?list...
Prerequisites for this series:
1: Python tutorials (first 16 videos): kzread.info?list...
2: Pandas tutorials(first 8 videos): • Pandas Tutorial (Data ...
3: Machine learning playlist (first 16 videos): kzread.info?list...
🌎 My Website For Video Courses: codebasics.io/?...
Need help building software or data analytics and AI solutions? My company www.atliq.com/ can help. Click on the Contact button on that website.
#️⃣ Social Media #️⃣
🔗 Discord: / discord
📸 Dhaval's Personal Instagram: / dhavalsays
📸 Instagram: / codebasicshub
🔊 Facebook: / codebasicshub
📝 Linkedin (Personal): / dhavalsays
📝 Linkedin (Codebasics): / codebasics
📱 Twitter: / codebasicshub
🔗 Patreon: www.patreon.com/codebasics?fa...

Пікірлер: 169

  • @codebasics
    @codebasics2 жыл бұрын

    Check out our premium machine learning course with 2 Industry projects: codebasics.io/courses/machine-learning-for-data-science-beginners-to-advanced

  • @ansumansatpathy3923
    @ansumansatpathy39235 ай бұрын

    Very structured and organic build up of concepts, not throwing a bunch in a short timeframe down your throat praying you gobble it up. I appreciate your hard work behind the animations too.Keep it up!

  • @abvijaykumar
    @abvijaykumar Жыл бұрын

    Very well articulated, I searched the whole web, nobody explained these concepts in such simple way, without any confusion!!! Thank you

  • @MrBasu-iq6md
    @MrBasu-iq6md Жыл бұрын

    I do get valuable information from youtube now and then. However, I did not expect deep learning tutorials to be explained in such simplicity yet highly informative as well. Machine Learning and Deep Learning videos on this channel are highly recommended. Thank you for such contents.

  • @shivam6565
    @shivam65653 жыл бұрын

    You are awesome. Complex topic explained so clearly that they just stick to brain. These lectures are of the highest quality. Thank you for sharing your knowledge and for free!

  • @JunaidInHenan
    @JunaidInHenan Жыл бұрын

    Hats off, I am a PhD student, and I worked on NLP, ML and text analytics, in the last semester of my PhD I am turning to deep learning for my post doc research, and I needed background information on deep learning. Also in my last project somehow I managed to apply deep learning simple classifier, but that instinct to theoretically and technically understand background of deep learning was missing. I read articles, videos etc. a lot but man your videos on deep learning concept is really fulfilling my instinct up till now. Hats off to you Bro. Thank you for your vision of education and these helpful tutorials.

  • @aditibhushan19

    @aditibhushan19

    17 күн бұрын

    May I please get your email ID

  • @aadityaprashantwaghulade9666

    @aadityaprashantwaghulade9666

    5 күн бұрын

    Sir do we need Deep Learning for NLP??? Please help me

  • @karthikc8992
    @karthikc89924 жыл бұрын

    sir what ah explanation , it seems so easy to learn deep learning,carry on your winning momentum , hope you become one of the great teachers in data science🔥🔥🔥🔥🔥🔥🔥🔥🔥

  • @nikolaynedelchev1644
    @nikolaynedelchev16443 жыл бұрын

    Thank you very much! Such a great explanation. Thank you for explaining the pitfalls in the activation functions - it is for the first time I hear them.

  • @codebasics

    @codebasics

    3 жыл бұрын

    😊👍

  • @shreyakapadia3735
    @shreyakapadia37353 жыл бұрын

    I really loved the easy explanation given by your sir. I wish I'd found this series earlier, but will watch the series from now on. Thank you for your efforts.

  • @codebasics

    @codebasics

    3 жыл бұрын

    All the best Shreya

  • @SKumar-Munna
    @SKumar-Munna4 жыл бұрын

    I am watching your video since beginning. All is amazing Sirji.

  • @ChristopherUOnova
    @ChristopherUOnova3 жыл бұрын

    Thank you once again for making Machine Learning simple...God bless.

  • @sayochikun3288
    @sayochikun32882 жыл бұрын

    wow this channel has a lot of crucial content. relu activation decreased my loss value from 0.04 to 0.003 even with half of training data!

  • @jas13
    @jas13 Жыл бұрын

    Your videos are excellent. Your words and diagrams really help clarify the process. I have recommended your videos to fellow colleagues. Bravo 👍

  • @juanpablobazan5716
    @juanpablobazan57163 жыл бұрын

    Thank you so much for all the tutorials! You are the Man!!

  • @mallikamehta3928
    @mallikamehta3928 Жыл бұрын

    this was extremely important, cleared my all doubts and now i think i m able to solve problems myself thank you so much, god bless you

  • @umarnadaf7170
    @umarnadaf71702 жыл бұрын

    i am getting more attracted to words deep learning by ur explaination wt a explaination great sir hatsoff

  • @wishIKnewHowToLove
    @wishIKnewHowToLove Жыл бұрын

    The best KZread teacher!

  • @mytechwork6351
    @mytechwork6351 Жыл бұрын

    sir, you give a good concept of deep learning. Sir i am beginner and one my friend refer your deep learning lectures when i started your lectures i learn so much from it. Sir keep it up for future, thank you sir again..

  • @arslanMCL
    @arslanMCL3 жыл бұрын

    Number of views is not doing justice to the quality of content that is created. Learning two weeks content in hardly 20 minutes. Thanks

  • @codebasics

    @codebasics

    3 жыл бұрын

    I appreciate you leaving a comment of appreciation

  • @user-yy3ts5pf8k
    @user-yy3ts5pf8k Жыл бұрын

    Nice series of tutorials. Super easy and time-efficient explanations.

  • @quaternion-pi
    @quaternion-pi4 жыл бұрын

    Excellent series, clearly explained Thanks.

  • @nikitasharma2757
    @nikitasharma27573 жыл бұрын

    Great explanation sir, I refer to all your videos for explanations.

  • @milchada
    @milchada2 жыл бұрын

    Thank you! Your tutorials are helping me get started with CNNs for my research!

  • @codebasics

    @codebasics

    2 жыл бұрын

    😊👍

  • @work-dw2hl
    @work-dw2hl4 жыл бұрын

    Awesome explanation plz continue this series

  • @chipsafan1
    @chipsafan12 жыл бұрын

    Great video! Thank you

  • @gourabkundu7476
    @gourabkundu74764 ай бұрын

    Best Video on KZread on this topic

  • @its-me-Padma
    @its-me-Padma Жыл бұрын

    big fan of this tutorials

  • @DukeOfCurling
    @DukeOfCurling Жыл бұрын

    Great explanation!

  • @petcristi
    @petcristi3 ай бұрын

    Great work!

  • @dhruvkantsharma2955
    @dhruvkantsharma29554 жыл бұрын

    Thank you for such an amazing tutorial!

  • @codebasics

    @codebasics

    4 жыл бұрын

    Glad it was helpful!

  • @sabarezaeekhavas7227
    @sabarezaeekhavas7227 Жыл бұрын

    I want you know that you are wonderful. I really enjoy watching your tutorials 💟

  • @fahadreda3060
    @fahadreda30604 жыл бұрын

    Thanks for the video .. wish you all the best

  • @Breaking_Bold
    @Breaking_Bold10 ай бұрын

    GREAT explanation ..this video and all the others in the playlist.

  • @ishapandey48
    @ishapandey484 жыл бұрын

    Understood well...thanks sir!!

  • @hannibalbra1216
    @hannibalbra12162 жыл бұрын

    Brother u are a savior god bless you

  • @mustafizurrahman5699
    @mustafizurrahman56999 ай бұрын

    BOSS BOSS, one of the best pedagogue

  • @arashnozarinejad3576
    @arashnozarinejad35762 жыл бұрын

    incredibly informative video sir, thank you

  • @_AkankshaPatil
    @_AkankshaPatil2 жыл бұрын

    Thanks a lot, sir for such an amazing tutorial

  • @unnamednolast7701
    @unnamednolast77012 жыл бұрын

    thank you so much i have learned so much

  • @muhammadrizwan727
    @muhammadrizwan727 Жыл бұрын

    Hi Sir, Amazing, I watched many videos in KZread regarding Deep Learning or Data science, But i failed to find this type of help, lectures, mentoring. Hats off. A bundle of thanks and prayers for you from Rizwan (Pakistan). Keep it up.

  • @codebasics

    @codebasics

    Жыл бұрын

    Thanks Rizwan for your kind words and glad these videos are helping you 😀

  • @Xiaoxiaoxiaomao
    @Xiaoxiaoxiaomao Жыл бұрын

    love your tutorials ❤❤❤

  • @shiv19811
    @shiv198112 жыл бұрын

    very nice videos....good work

  • @SwarnaliMollickA
    @SwarnaliMollickA2 жыл бұрын

    Amazing!

  • @Karthick-s8d
    @Karthick-s8d29 күн бұрын

    it's really help full thanks

  • @dudefromsa
    @dudefromsa2 жыл бұрын

    This is brilliant indeed Dhaval

  • @mithlesh0singh
    @mithlesh0singh3 жыл бұрын

    Just love the way you explain.

  • @codebasics

    @codebasics

    3 жыл бұрын

    thanks mithlesh

  • @shamsunder5353
    @shamsunder53534 жыл бұрын

    Simply fantastic

  • @sanooosai
    @sanooosai6 ай бұрын

    thank you great work

  • @convergence549
    @convergence5493 жыл бұрын

    Thank you brother you explained it very well

  • @komalteke1248
    @komalteke12483 жыл бұрын

    Thank you so much .... The way you are teaching big big concepts with so much of easy understanding... it's really very very good... keep going....

  • @codebasics

    @codebasics

    3 жыл бұрын

    I am happy this was helpful to you.

  • @sanobernishat223
    @sanobernishat223 Жыл бұрын

    Amazing teacher

  • @sidduhedaginal
    @sidduhedaginal4 жыл бұрын

    Your explanations are always classic and very detailed even undergraduate student can start learning DL during his course. Keep it up sir....keep good health.

  • @codebasics

    @codebasics

    4 жыл бұрын

    👍😊

  • @priyabratapanda1216
    @priyabratapanda12163 жыл бұрын

    Really very intuitive indeed!🙏🙏🙏🙏

  • @codebasics

    @codebasics

    3 жыл бұрын

    I am happy this was helpful to you.

  • @beautyIsinEverything753
    @beautyIsinEverything7532 жыл бұрын

    nice and clear explanations thanks

  • @user-cz6ht4ot7o
    @user-cz6ht4ot7o2 жыл бұрын

    SIR HOW YOUR CONCEPT IS TOO CLEAR ON ANY TOPIC? AWESOME Sir🙏🙏

  • @NazanTem
    @NazanTem3 ай бұрын

    Thank you!

  • @kashishvarshney2225
    @kashishvarshney22256 ай бұрын

    really amazing

  • @deepthikiran8345
    @deepthikiran83453 жыл бұрын

    amazing tutorial.....right to the point...thanks :)

  • @codebasics

    @codebasics

    3 жыл бұрын

    Glad you liked it!

  • @manishdas6525
    @manishdas65252 жыл бұрын

    dhasu 🔥

  • @amitjaiswal781
    @amitjaiswal7813 жыл бұрын

    Very nice and easy explanation sir.

  • @ankkush4898
    @ankkush48983 жыл бұрын

    Very useful....made it very easy...thank you

  • @codebasics

    @codebasics

    3 жыл бұрын

    Glad it helped

  • @utkarshpandya3155
    @utkarshpandya31552 жыл бұрын

    very nice concept

  • @jongcheulkim7284
    @jongcheulkim72842 жыл бұрын

    thank you so much.

  • @ranakarmakar5141
    @ranakarmakar51412 жыл бұрын

    thank you for this playlist

  • @mechanicalbaba2484
    @mechanicalbaba24843 жыл бұрын

    Thanks you sir, now I am finding deep learning kinda easy

  • @codebasics

    @codebasics

    3 жыл бұрын

    Glad to hear that

  • @artipunit
    @artipunit3 жыл бұрын

    Best explanation ever. Will share for sure

  • @codebasics

    @codebasics

    3 жыл бұрын

    Glad it was helpful!

  • @amandeepsaha
    @amandeepsaha Жыл бұрын

    Sir u r amazing

  • @amirhanna6270
    @amirhanna6270 Жыл бұрын

    Excellent

  • @61_shivangbhardwaj46
    @61_shivangbhardwaj462 жыл бұрын

    Very helpful video sir☺

  • @245uday
    @245uday4 жыл бұрын

    Well explained sir...waiting for next video

  • @codebasics

    @codebasics

    4 жыл бұрын

    😊👍

  • @darktarifa7200
    @darktarifa72003 жыл бұрын

    Thanks for your explaniation

  • @codebasics

    @codebasics

    3 жыл бұрын

    Glad it was helpful!

  • @goodwork9577
    @goodwork95772 жыл бұрын

    There is no better explanation i've come across when it comes to Data science/ Machine Learning/Deep Learning, it's a shame that big e-learning companies like edureka are just copying content as mentioned by dhaval sir in one of his recent videos.

  • @bangarrajumuppidu8354
    @bangarrajumuppidu83542 жыл бұрын

    super explanation sir!!

  • @codebasics

    @codebasics

    2 жыл бұрын

    Glad you liked it

  • @Bulbulgoyal672
    @Bulbulgoyal67211 ай бұрын

    thanku sir

  • @shikhasen3981
    @shikhasen39813 жыл бұрын

    Hi sir , I want to be as great as you are at dat science . just a question , is neutral network good for classification or can we forecast the regression as well ?

  • @mimohraj1045
    @mimohraj1045 Жыл бұрын

    maths parts must be known to the learner because to understand the problem statments , and your lecture help me a lot thanks ,,,,,,

  • @tewodrosgebre204
    @tewodrosgebre2042 жыл бұрын

    thank you

  • @MAK_3583
    @MAK_3583 Жыл бұрын

    good tutorial

  • @mohitb5230
    @mohitb52304 жыл бұрын

    well done

  • @ayushi6424
    @ayushi64243 жыл бұрын

    Sir please include softmax activation fuction also..can u give me brief of it...because i m using it in my project

  • @mayankvekariya8199
    @mayankvekariya81994 жыл бұрын

    I like your all videos

  • @codebasics

    @codebasics

    4 жыл бұрын

    And I like your comment Mayank :)

  • @grandhimanikanta7522
    @grandhimanikanta75223 жыл бұрын

    At what value of "tanh" neuron will activate/fire the output to the next neuron?

  • @shahajadealam9684
    @shahajadealam96843 жыл бұрын

    superb video sir 💕💕💕💕💕👍

  • @codebasics

    @codebasics

    3 жыл бұрын

    Glad it was helpful!

  • @vijayalaxmiyalavigi6232
    @vijayalaxmiyalavigi62323 жыл бұрын

    Sir, thank you very much.

  • @codebasics

    @codebasics

    3 жыл бұрын

    Glad it was helpful!

  • @dec13666
    @dec136663 жыл бұрын

    Nice explanation 😎👍

  • @codebasics

    @codebasics

    3 жыл бұрын

    Glad it was helpful!

  • @shubhangiagrawal336
    @shubhangiagrawal3363 жыл бұрын

    useful video

  • @sayantanmitra7897
    @sayantanmitra78973 жыл бұрын

    This is really helpful. Could you please provide the slides?

  • @debatradas9268
    @debatradas92682 жыл бұрын

    thanks

  • @rathnakumarv3956
    @rathnakumarv3956 Жыл бұрын

    Sir, what about softmax activation function, only for multiple classification? any other activation function for time series analysis?

  • @saurabhbarasiya4721
    @saurabhbarasiya47214 жыл бұрын

    Thanks

  • @kirankumarpaturu2239
    @kirankumarpaturu22393 жыл бұрын

    sir thank u so much

  • @codebasics

    @codebasics

    3 жыл бұрын

    Most welcome kiran.

  • @rizalmuhammed7816
    @rizalmuhammed78162 жыл бұрын

    Can you also upload the presentation slide in the github link for quick occasional revision. Thank You

  • @anirudhsrivastava3530
    @anirudhsrivastava3530 Жыл бұрын

    @2:52 Sir, can you explain in detail the non-linearity part of activation function

  • @akhiljohnson6019
    @akhiljohnson60194 жыл бұрын

    Sir, what is the significance of traditional ML algorithms (eg: Linear Regression, Random Forest etc) if deep learning is becoming so popular?

  • @karthikc8992

    @karthikc8992

    4 жыл бұрын

    Use of ml algorithms train data with good accuracy if our data is small . When we have tons of Data , using deep learning can fix with good accuracy If the data is small deep learning cannot fix good accuracy

  • @akhiljohnson6019

    @akhiljohnson6019

    4 жыл бұрын

    @@karthikc8992 Ohh Thanks for the info ☺️

  • @priyabratapanda1216

    @priyabratapanda1216

    3 жыл бұрын

    Also it's very difficult to handle a deeplearning model than a machine learning model. Also you might have noticed deeplearning models aren't quite responsive as compared to ML model as it requires a lot of time for training. Another thing you only go for deeplearning when you have tons of data's otherwise you'll end up overfitting your model.

  • @md.tahmidulislam5965
    @md.tahmidulislam59652 жыл бұрын

    Can you please tell something about Asymmetric Activation Function in Neural Network ?

  • @shivasiddharthnarayanan
    @shivasiddharthnarayanan3 жыл бұрын

    Thanks for the great tutorial.... Not sure if this query is right. Sir, while explaining ReLU the mark of 1 at y-axis is not correct, I guess......Please correct me if I am wrong....:-)

  • @karippuram
    @karippuram3 жыл бұрын

    Hi I get an error module 'tensorflow' has no attribute 'get_default_graph'....How do you solve this ..I ried with 2.X version initially and changed 1.15 to see if the issue goes or not..but no success

  • @AishwariyaGupta
    @AishwariyaGupta Жыл бұрын

    is there any activation function that does not suffer from vanishing gradient problem?

  • @amandaahringer7466
    @amandaahringer74662 жыл бұрын

    👏👏👏

  • @neuraspike
    @neuraspike4 жыл бұрын

    Nice tutorial. How do you make the drawings used in your presentation?

  • @codebasics

    @codebasics

    4 жыл бұрын

    Power point. I make them on my own from scratch in power point