Silhouette Score for clustering Explained | Silhouette (clustering)- Validating Clustering Models
Silhouette Score for clustering Explained | Silhouette (clustering)- Validating Clustering Models
#SilhouetteScore #UnfoldDataScience
Hello ,
My name is Aman and I am a Data Scientist.
About this video:
In this video, I speak about Silhouette Score and explain step by step how Silhouette Score works for cluster validation. I explain how to validate clusters and how to measure goodness of clusters. I explain the mathematical formula of Silhouette Score and intuition behind it. Below points are discussed in this video:
1. Silhouette Score for clustering
2. Validation on K-means clusters
3. Cluster validation techniques
4. How to measure goodness of clusters
5. Unsupervised machine learning accuracy
About Unfold Data science: This channel is to help people understand basics of data science through simple examples in easy way. Anybody without having prior knowledge of computer programming or statistics or machine learning and artificial intelligence can get an understanding of data science at high level through this channel. The videos uploaded will not be very technical in nature and hence it can be easily grasped by viewers from different background as well.
If you need Data Science training from scratch . Please fill this form (Please Note: Training is chargeable)
docs.google.com/forms/d/1Acua...
Book recommendation for Data Science:
Category 1 - Must Read For Every Data Scientist:
The Elements of Statistical Learning by Trevor Hastie - amzn.to/37wMo9H
Python Data Science Handbook - amzn.to/31UCScm
Business Statistics By Ken Black - amzn.to/2LObAA5
Hands-On Machine Learning with Scikit Learn, Keras, and TensorFlow by Aurelien Geron - amzn.to/3gV8sO9
Ctaegory 2 - Overall Data Science:
The Art of Data Science By Roger D. Peng - amzn.to/2KD75aD
Predictive Analytics By By Eric Siegel - amzn.to/3nsQftV
Data Science for Business By Foster Provost - amzn.to/3ajN8QZ
Category 3 - Statistics and Mathematics:
Naked Statistics By Charles Wheelan - amzn.to/3gXLdmp
Practical Statistics for Data Scientist By Peter Bruce - amzn.to/37wL9Y5
Category 4 - Machine Learning:
Introduction to machine learning by Andreas C Muller - amzn.to/3oZ3X7T
The Hundred Page Machine Learning Book by Andriy Burkov - amzn.to/3pdqCxJ
Category 5 - Programming:
The Pragmatic Programmer by David Thomas - amzn.to/2WqWXVj
Clean Code by Robert C. Martin - amzn.to/3oYOdlt
My Studio Setup:
My Camera : amzn.to/3mwXI9I
My Mic : amzn.to/34phfD0
My Tripod : amzn.to/3r4HeJA
My Ring Light : amzn.to/3gZz00F
Join Facebook group :
groups/41022...
Follow on medium : / amanrai77
Follow on quora: www.quora.com/profile/Aman-Ku...
Follow on twitter : @unfoldds
Get connected on LinkedIn : / aman-kumar-b4881440
Follow on Instagram : unfolddatascience
Watch Introduction to Data Science full playlist here : • Data Science In 15 Min...
Watch python for data science playlist here:
• Python Basics For Data...
Watch statistics and mathematics playlist here :
• Measures of Central Te...
Watch End to End Implementation of a simple machine learning model in Python here:
• How Does Machine Learn...
Learn Ensemble Model, Bagging and Boosting here:
• Introduction to Ensemb...
Build Career in Data Science Playlist:
• Channel updates - Unfo...
Artificial Neural Network and Deep Learning Playlist:
• Intuition behind neura...
Natural langugae Processing playlist:
• Natural Language Proce...
Understanding and building recommendation system:
• Recommendation System ...
Access all my codes here:
drive.google.com/drive/folder...
Have a different question for me? Ask me here : docs.google.com/forms/d/1ccgl...
My Music: www.bensound.com/royalty-free...
Пікірлер: 162
The explanation is so concise and simple, even in spite of the fact that english isn't your 1st language. Amazing work my dude.
I'm glad i found a teacher like you
Clear and right to the point! Thank you for your work! Much appreciated!
@UnfoldDataScience
2 жыл бұрын
Thanks for watching Chris. Stay safe. Tc
Amazing explanations! THANK YOU !!! You are an excellent teacher !!!
Sir you are the best teacher for DS ! Keep up the great work
This is simple and well explained, thank you Aman!
@UnfoldDataScience
3 жыл бұрын
Most welcome!
This is so useful for understanding & revising. Amazing work! Thankyou!
Simple but powerful, thanks and greetings from Colombia!
Thank you so much. Simple and clean explanation.
Thank you so much, best explanation I've seen on the Internet!
@UnfoldDataScience
2 жыл бұрын
Thanks a lot for watching.
Amazing explanation! Congrats and thank you!
Ur Explanation is simple and understandable,TQ sir
Very simple and easy to understand!
This is gold! thanks for putting it very simple to understand
@UnfoldDataScience
2 жыл бұрын
Glad it was helpful Khairul.
thank you, straight to the point!
Excellent Amen. Perfect explanation👏👏👏
Thank you! Simple and well explained!
@UnfoldDataScience
2 жыл бұрын
Glad it was helpful!
Excellent illustration and explanation.
What a gem of an explanation you give bhai! Truly you make things so simple and understandable! You deserve more!
@UnfoldDataScience
Жыл бұрын
Thanks a lot. Pls share with friends as well. Have a nice weekend ahead.
very concise and simple explanation.
Clearer than my professor, for sure
Perfect explanation. Thank you Aman
@UnfoldDataScience
Жыл бұрын
Welcome Paul. Your feedback is precious to me.
Great video, thanks for your time!
@UnfoldDataScience
10 ай бұрын
My pleasure!
you are the best bro!
very well explained sir thank you
You explained it so well even a 5th grader would get it. Its so easily explained!.
beautiful explanation, keep it up
Great Explanation . thanks
Straight to the point. Thank you
@UnfoldDataScience
2 жыл бұрын
Thanks a lot for watching
Great explanation, Thank you!
@UnfoldDataScience
2 жыл бұрын
Welcome
Thank You so much for this video sir
Thank you for your help. Really great explanation!
@UnfoldDataScience
2 жыл бұрын
Welcome
Too good...Way better than online courses that take thousands and thousands of money keep up the hard work
@UnfoldDataScience
2 жыл бұрын
Thanks Zaid.
Great video
Great, ty!
Tqsm sir so well explained ❤
Clearly explained!
Thank you so much for Sir, I am so glad I came across your video. I look forward to learn more from you. Thank you again.
@UnfoldDataScience
8 ай бұрын
So nice of you
at first it was very difficult for me to understand this, but you explained this in a very easy way....THANKYOU AMAN SIR FOR YOUR EASY AND INTUITIVE EXPLANATION!!!
@UnfoldDataScience
2 жыл бұрын
It's my pleasure
Thank you.
Crystal clear
Awesome ...plain and simple 👍🏼
@UnfoldDataScience
2 жыл бұрын
Glad to hear that Akash 🙂, please share with others as well who could be benefited from such content.
beautifully explained!!! Thank u so much
@UnfoldDataScience
2 жыл бұрын
Thanks Amogh. Happy Holi.
very very good explnation
Thank you sir for very clear explanation with example.. 👍
@UnfoldDataScience
3 жыл бұрын
Welcome Valli :)
how can i thank you brother . you explained this topic so easily.
Thanks for the very simple and easy to understand explanation
@UnfoldDataScience
2 жыл бұрын
Welcome
Thanks bro for explaining so perfectly
@UnfoldDataScience
3 жыл бұрын
Welcome Parv.
thank you
keep up the good work!!!
@UnfoldDataScience
Жыл бұрын
Thank you.
Its really a simple and good explanation for anybody to understand...thanks for making this simple explanation video.
@UnfoldDataScience
2 жыл бұрын
Welcome Sourabh
verry well explained !!!!
@UnfoldDataScience
2 жыл бұрын
Thanks Pranav.
Amazing explaination thank you sir
@UnfoldDataScience
3 жыл бұрын
Welcome Nandan.
Thanks a lot for this simple explenation
@UnfoldDataScience
2 жыл бұрын
You are welcome
oke i understand, thankyou sir ...
@UnfoldDataScience
2 жыл бұрын
Welcome
This is amazing!
@UnfoldDataScience
2 жыл бұрын
Thanks Diya.
Thank you!!
@UnfoldDataScience
Жыл бұрын
Welcome.
great and simple explanation, a big clap to ur efforts
@UnfoldDataScience
Жыл бұрын
Thanks Venkat.
finished watching
Very well explained!
@UnfoldDataScience
2 жыл бұрын
Glad it was helpful!
Always to the point...and you dont waste any time actually...
@UnfoldDataScience
2 жыл бұрын
Thanks again.
nice video
Thanks you so much sir
@UnfoldDataScience
2 жыл бұрын
Welcome Sachin.
Very good explanation, thanks
@UnfoldDataScience
2 жыл бұрын
Welcome.
This is very good explanation, thank you Sir....
@UnfoldDataScience
2 жыл бұрын
Welcome Yudy.
Thank you. Much love to you from Pakistan
@UnfoldDataScience
Жыл бұрын
Thanks Shaheer, pls share with friends if you like the content.
Very nice explanation
@UnfoldDataScience
10 ай бұрын
Thanks Rashid.pls share with friends also
Very well explained sir
@UnfoldDataScience
2 жыл бұрын
Thanks and welcome
excellent
@UnfoldDataScience
2 жыл бұрын
Thanks a lot.
Hi Aman, I do have a general question in clustering -I have heard of people do clustering in the dataset initially and then train separate model for each cluster. my question is lets take an example of telecom churn - there will be many services like internet, Phone, Dish etc. is there anyway we can cluster like internet users in one cluster, phone service in one cluster like that.
thanks sir
@UnfoldDataScience
Жыл бұрын
Most welcome
thank you!!!
@UnfoldDataScience
3 жыл бұрын
Welcome.
is there any way to run it in SPSS? Is it correct if I use the average of the Euclidean distance of the cluster?
Thank you so much for your explaination. I have a small question: after I got point i ' s silhouette coefficient, I calculate other two points in cluster A, then I take the average of the three silhouette coefficients, let's say it's NO.1. What we can learn from No.1? If No.1 is close to +1, it's good, it means data points in cluster A are most similar to each other, right?
Hi Aman thanks for this explanation. Please explain about assumptions of k means clustering
@UnfoldDataScience
3 жыл бұрын
Assumption at high level is, you data has clusters and centriods.
thanks
@UnfoldDataScience
2 жыл бұрын
Welcome.
I got all the concept clear, but please when is it appropriate to use silhouette distance? it when you have mixed data? or mix data is best for elbow method?
Amazing explaination..plz make a video on Dunn index.
@UnfoldDataScience
3 жыл бұрын
Thanks Bipul.
Nice video Sir thank you. please make an video of EDA sir ..!
@UnfoldDataScience
3 жыл бұрын
Thanks Ganesh.
clear
@UnfoldDataScience
2 жыл бұрын
Thank you
super bro
@UnfoldDataScience
2 жыл бұрын
Thanks Prashanth
Sir please make a video on PCA . It would be very helpful
@UnfoldDataScience
3 жыл бұрын
Sure Ranajay.
Thank u for simpler explanation! A question: In our case, it seems that for both clusters, b should be the same unless we have more than two clusters, (or since those clusters are mutually nearest) doesn't it?
@lkjhlkjh1954
Жыл бұрын
I think that’s why we do not calculate silhouettes score for less than 2 cluster
This guy is god!
So which score is better? -0.2 or 0.21 ?
As we have find cohesion and separation for only one point in one cluster A, so we have to find Silhouette score for all points for all points in same cluster so just to ensure that points are correctly clustered ?? Please explain??
@UnfoldDataScience
2 жыл бұрын
Yes , one point is just for example.
hello sir.. great video i understand this topic very well,, thank you so much... just want to ask did you make video of implementation of silhoutte score in python?? if yes plz provide link..
@UnfoldDataScience
11 ай бұрын
Thanks a lot. Its very simple to do in python - see this link - stackoverflow.com/questions/59919627/how-to-calculate-the-silhouette-score-for-each-cluster-separately-in-python
you have said "Min distance of A1,A2,A3 is the value of b ". Here you are talking about mean value of three or the which one has the minimum value among three , we'll chose it. Please clear it once, if possible
@UnfoldDataScience
3 жыл бұрын
HI Subhasis, A1, A2 etc are "mean" Distance from various other clusters ok. Now let's take att these A1 TO AN values and take the minimum from this set. This mimum is b.
@subhasisdutta3711
3 жыл бұрын
@@UnfoldDataScience thanq for the clarification. Have a blessed life ahead
Topic is very well explained sir .. But should we learn DB Index, Dunn Index, Jaccard score ... or only this Silhouette score is enough
@UnfoldDataScience
3 жыл бұрын
Thanks Sampath.
How do I get the amount of data points within the clusters ?
@UnfoldDataScience
2 жыл бұрын
Levels can be found out after clustering then we can count using pandas.
Nice video sir. But i have problem when calculate cohesion in cluster just has one data point. How i should set value of cohesion? 0 or 1?
@UnfoldDataScience
2 жыл бұрын
Thats not a good clustering process, clusters need to be reformed.
@arisurya9867
2 жыл бұрын
Thank you sir 🙏
hello sir, Plese make a video on the explanation and implementation of ppf,pdf,cdf in python with simple explanation and understanding, I am very confused in this.
@UnfoldDataScience
3 жыл бұрын
pdf cdf video is available Parikshit. Please search in my channel.
@parikshitgurjar5545
3 жыл бұрын
@@UnfoldDataScience Thankyou sir❤️
How to get silhouette score for spectral clustering
@UnfoldDataScience
2 жыл бұрын
I Will check.
is 0.4 is good silhouette score?
@UnfoldDataScience
Жыл бұрын
Dont think so
Is 0.39 a bad score?
@UnfoldDataScience
Жыл бұрын
can be better
How can i read the graph of silhouette score? Most important thing you didn't tell
@UnfoldDataScience
20 күн бұрын
Positive Scores (close to 1): Samples are well-clustered, and there is good separation between clusters. Scores around 0: Samples are on or near the boundary between clusters, indicating potential overlap. Negative Scores: Samples are likely in the wrong cluster.
apki english samajhne me time lg jata hai.. ki aap kya bolna chahte ho
apki english me confuse ho jate hai log ki aap kya bolna chahte ho...isko negitive comment ki tarah mt lena...aap samjhate aacha ho pr agar hindi me samjhaoge toh hm logo ko clear samaj ayega
Sir aap hindi me samjhaya karo toh zyada aacha samjha payoge...
finished watching