How Prometheus Monitoring works | Prometheus Architecture explained
► Part of the DevOps Bootcamp 🚀 More infos here: bit.ly/41Wc1cM
Fully understand how Prometheus Monitoring works | Explaining Prometheus Architecture | What is Prometheus Monitoring | Prometheus Monitoring Tutorial
Demo Part 1: Setup Prometheus Monitoring and Grafana on Kubernetes using Prometheus Operator ► • Setup Prometheus Monit...
Demo Part 2: In the 2nd part we will actually configure Prometheus to expose /metrics endpoint and configure Prometheus to scrape it. ► • Prometheus Monitoring ... 🤓
Prometheus has become the mainstream monitoring tool of choice in container and microservice world. 🔥
In this video you will learn:
1) Why Prometheus is so important in such infrastructure and what are some specific use cases
2) How Prometheus works? What are targets and metrics?
3) How does Prometheus collect those metrics from its targets?
4) Furthermore, I explain Prometheus Architecture with simple diagrams and animations and go through the main components: Prometheus Server, Pushgateway, Alertmanager
5) The advantages of Prometheus Pull System compared to alternative monitoring tools, which use Push System
6) Using Prometheus Monitoring with Docker and Kubernetes
You will also understand better why it’s important to monitor your applications/infrastructure in general.
▬▬▬▬▬▬ T I M E S T A M P S ⏰ ▬▬▬▬▬▬
0:00 - Intro
0:31 - What is Prometheus?
1:06 - Where and why is Prometheus used?
2:21 - Specific Use Cases for using Prometheus Monitoring
5:57 - How does Prometheus work? Prometheus Architecture explained
6:04 - Prometheus Server
7:02 - Targets and Metrics
7:53 - Metrics
8:50 - How does Prometheus collect those metrics from targets?
9:21 - Target Endpoints and Exporters
11:12 - Monitoring your own application
12:03 - Pull Mechanism - Unique advantage of Prometheus
13:38 - Pushgateway for short-lived jobs
14:14 - Configuring Prometheus - Example YAML Configuration
16:20 - Alert Manager - Triggering alerts
16:55 - Prometheus Data Storage - Where does Prometheus store the data?
17:38 - PromQL Query Language
18:37 - My Experience
19:23 - Key Characteristics - advantages and disadvantages of Prometheus
20:40 - Prometheus Monitoring with Docker and Kubernetes
▬▬▬▬▬▬ Useful Links 🛠 ▬▬▬▬▬▬
Official Prometheus Exporters List ► prometheus.io/docs/instrument...
Prometheus Client Libraries ► prometheus.io/docs/instrument...
Photo source for Metrics Example: itnext.io/prometheus-for-begi...
#prometheus #prometheusmonitoring #devops #techworldwithnana
▬▬▬▬▬▬ Want to learn more? 🚀 ▬▬▬▬▬▬
Full Kubernetes and Docker tutorial ► bit.ly/2YGeRp9
What is Kubernetes? ► • What is Kubernetes | K...
Complete Jenkins Pipeline Tutorial ► • Complete Jenkins Pipel...
▬▬▬▬▬▬ Courses & Bootcamp & Ebooks 🚀 ▬▬▬▬▬▬
► Become a DevOps Engineer - full educational program 👉🏼 bit.ly/45mXaer
► High-Quality and Hands-On Courses 👉🏼 bit.ly/3BNS8Kv
► Kubernetes 101 - compact and easy-to-read ebook bundle 👉🏼 bit.ly/3Ozl28x
▬▬▬▬▬▬ Connect with me 👋 ▬▬▬▬▬▬
Join private Facebook group ► bit.ly/32UVSZP
DEV ► bit.ly/3h2fqiO
INSTAGRAM ► bit.ly/2F3LXYJ
TWITTER ► bit.ly/3i54PUB
LINKEDIN ► bit.ly/3hWOLVT
Пікірлер: 642
Check out the demo parts: ► Demo Part 1: Setup Prometheus Monitoring and Grafana on Kubernetes using Prometheus Operator ► kzread.info/dash/bejne/g6N409qmZ9zIfMY.html ► Demo Part 2: kzread.info/dash/bejne/n4CEyZZykpaZo6Q.html In the 2nd part we will actually configure Prometheus to expose /metrics endpoint and configure Prometheus to scrape it. 0:31 - What is Prometheus? 1:06 - Where and why is Prometheus used? 2:21 - Specific Use Cases for using Prometheus Monitoring 5:57 - How does Prometheus work? Prometheus Architecture explained 6:04 - Prometheus Server 7:02 - Targets and Metrics 7:53 - Metrics 8:50 - How does Prometheus collect those metrics from targets? 9:21 - Target Endpoints and Exporters 11:12 - Monitoring your own application 12:03 - Pull Mechanism - Unique advantage of Prometheus 13:38 - Pushgateway for short-lived jobs 14:14 - Configuring Prometheus - Example YAML Configuration 16:20 - Alert Manager - Triggering alerts 16:55 - Prometheus Data Storage - Where does Prometheus store the data? 17:38 - PromQL Query Language 18:37 - My Experience 19:23 - Key Characteristics - advantages and disadvantages of Prometheus 20:40 - Prometheus Monitoring with Docker and Kubernetes 👉🏼 For any questions/issues/feedback, please leave me a comment and I will get back to you as soon as possible. Please don't forget to subscribe and give me a thumbs up if you liked my video 😊🙏
@CeezGeez
3 жыл бұрын
TechWorld with Nana Nice and simple explanation! Subbed 👍
@kalankaraivilakkam
3 жыл бұрын
Best introduction on Prometheus. Appreciated!
@TechWorldwithNana
3 жыл бұрын
@@CeezGeez Cool thanks for your feedback and subscribing :D
@TechWorldwithNana
3 жыл бұрын
@@kalankaraivilakkam Thanks a lot! :)
@deepakranganathan9644
3 жыл бұрын
@@TechWorldwithNana I have a doubt with respect to Prometheus setup for Django applications. If we have a load balancer which redirects to three application servers where the Django applications are running. Which of these setups will work and is optimally correct? 1. Having Prometheus installed in one of the application servers and then having a job for every Django application we need to monitor and provide all three application server's Django configuration details in the targets entry in prometheus.yml? - One more doubt, in this case, is when the targets are authenticated using OAuth, how can we manage in this scenario? 2. Installing Prometheus on any server and mentioning all the Django applications details in the targets entry in prometheus.yml file? - Do we need to have ssh trust set up in this case when the setup has to be done like this? It will be very helpful if you please give some insights on this. Thanks in advance :)
Nana, you're doing a great job. Don't stop what you're doing. This is helping a lot of people.
@TechWorldwithNana
3 жыл бұрын
Thank you Noah 🙏. 😊
@joshnak.974
3 жыл бұрын
WOW great stuff
@JesseSteinfort
2 жыл бұрын
I second this! I'm on my second video and looking forward to more. You have put out great content. Thank you.
@michaelhughes8413
10 ай бұрын
Agree with you 💯
The quality of this tutorial is truly excellent. Nana doesn’t jump into solutions, but describes the problem or issue first, consistently. That helps to understand not only the ‘how’, but also the ‘why’ and the ‘what’. In addition, Nana tells a coherent story at the right pace. Kudos for this great video!
I'm starting my DevOps career and this is my first-to-go KZread channel whenever I want to understand the overview and the fundamental knowledge of a DevOps tool. From Vietnam, thank you so much, Nana!
Whenever I am looking for something, if it's available on this channel then I do not need to go anywhere else. This channel has the most clear and concise explanation. Thanks, Nana.
Your tutorials are amazing and very easy to follow and helps in understandings the concepts. Great work!!
This tutorial helped me quickly understand Prometheus and answer few questions in my interview recently. Thank you, Nana!
Would love to see part 2! Part 1 was really helpful. Thank you!
This is fantastic in so many levels, i finally understood prometheus... wow
This is one of the most didactic videos I have ever seen. Newbies all over the world will forever be grateful to you. Truly fantastic video!
I have started watching your tutorials recently and I am happy with whatever you are doing.Thanks alot and keep on with the good job Nana.
Capturing the concepts with great clarity, this was a much needed one. Been looking for something like this for a while now. Great quality. Appreciated.
@TechWorldwithNana
3 жыл бұрын
Wow thanks a lot Vikas, happy you think it's that good :)
Wow! I just arrived at your video and channel. Thank you! You explained every detail of the foundation behind all of this. The usual tutorials move through the demo, but if you need more features or adapt them to your needs, you still have to dig a lot.
Thank you so much. I usually cannot tolerate video tutorials, but you approach and simple slides made it work.
As always your explanation was clear and concise, and the visuals were very helpful in understanding the concepts. You really have a talent for explaining complex technical topics in an approachable way. Keep up the great work! 💯
Hi Nana, you are great. You are helping many people with your knowledge and all this is free of cost. So kind of you. Can you please upload a session on airflow -- what it is, how to install it on local machine and create the DAG and run some pipelines and also possibly how to monitor the data pipelines.
Probably one of the best teachers I've ever had. Wow! In a week-end, I've learned more on DevOps solutions, going through your video series, than I did in months with official documentation and reference manuals. You make things so simple and easy to grasp. Great job! Thank you so much
@TechWorldwithNana
3 жыл бұрын
That's so amazing to hear! Thank you for taking your time to write such great feedback! Appreciate it 😊
@yapadqoi
3 жыл бұрын
@@TechWorldwithNana Thank YOU for taking the time to reply back. You didn't have to, but I'm so happy to read it. Keep up the good work!
First thing I am always doing on Nana videos is click Like button first and only then watch the videos! She absolutely deserves that and never dissapoints!
Good sum up ! Thanks ! A timeline : 0:44 bare servers traditional servers 11:31 own applications client libraries languages 17:56 Grafana 18:57 Grafana
Nana, your explanation is quite simple and powerful. This is the first time I was studying Prometheus and understood the basics in just a few minutes. Next, I'm figuring out on setting it up in Linux to monitor my Spring MicroServices. Let me know if you have any videos on this. Also, I am subscribing to your channel now. Keep up the good work. Thanks!
Your english is so clear, and easy to understand. A 4 year old would know what you are talking about despite the complexity of the stuff you are teaching. This shows how well you know what you are doing. Keep up the good work.
By far the best explanation, not for just this video but overall content of channel. Focusing on basic make it easy to understand. Big Thanks Nana
Thank you very much for very clear explanation. I search for such one and finally find it :-). I'm not a native English speaker so it is hard to find lecturers that talk good English and talk slowly so we can understand without stopping the video every 10 sec. You are talking in very clear manner - please continue like that. I signed up to your channel. Thanks again
@TechWorldwithNana
3 жыл бұрын
Thanks for this amazing feedback! Really happy to hear :)
~22 min lecture with no need of going backwards to understand !! Very good 👍. Coming to the content crisp and clean, that made it look simple. Good Job.!
@TechWorldwithNana
3 жыл бұрын
Thanks Vemareddy, glad I could explain it in that simple way 😊 Really appreciate your feedback!
I normally watch tutorial videos 1.5x speed but with Nana, the videos have so much quality information I actually need to stop at some points to process it better :)
Brilliant Nana. Very helpful, as I've been out of the tech space for 2 decades and needed a clear and concise primer for this!
@TechWorldwithNana
3 жыл бұрын
Thank you 🙏. 🙂
Prometheus is always a special monitoring tool for me. This was very interesting to watch. Waiting for the next one ISTIO 😁😁😁.
@TechWorldwithNana
4 жыл бұрын
Thanks, glad you enjoyed watching :) Yes Istio will be one of the next videos, because so many people asked for it, so stay tuned 🙂
Best introduction about Prometheus I ever had!!!... You have a golden talent of making hard topics super simple. BTW Nana, did you get a chance to work on the video "How to configure and use Prometheus for K8S". Can you also create one video on complete setup of K8S + Prometheus + Grafana? TIA.
@TechWorldwithNana
3 жыл бұрын
Hi Amit, thank you for your feedback! 🙂 Btw the 1st part of the demo video is out, which is the setup :)
@joenyugoh1179
3 жыл бұрын
So true, very simple description to such a complex topic. Thanks Nana
Amazing! The bestest tutorial I have ever seen! Clear and crisp!!
This is a very helpful overview of Prometheus. Very well put together. Thank you for doing this.
This video is fantastic. Clearly outlined all of the relevant information I was looking for, to get a basic understanding of Prometheus. Thanks!
Great explanations, clearly illustrate the use case with great details. Thanks so much!
This the second video I've watched in this channel and I can already say that you explain really great and talk about all the interesting parts. Thank you
This is a fantastic intro!!!! A million thanks for the thoughtful explanations. I look forward to seeing more of your presentations
@TechWorldwithNana
3 жыл бұрын
Hi Stephen, really happy to hear. Thank you :)
Everytime I finish watching your videos, I feel I have a Master's Degree in DevOps from Harvard. I learn so much. Cant thank you enuff Nana.
Nana, thank you for the fantastic video! I have a few questions on the push/pull method comparison that started around 12:41. 12:41 - Isn't network traffic determined by the amount of data that's collected? So if the monitoring targets and granularity are the same, the push or pull model would generate the same network traffic, right? 13:02 - Using daemons to push metrics for an application that doesn't have library support. I thought this would be very similar to applications that don't have native Prometheus support - it has to use an exporter sidecar to provide a scraping endpoint. It seems to me these are the same between the two models. 13:23 - Better detection if service is up and running. I also agree to pull model works better in most cases. For the push method, when the monitoring server detects service is not pushing data, it can also treat it as a failure. The pull model is a bit more straightforward, and it sees problems very quickly. However, it could also suffer from network problems. So I thought both methods could trigger potential false alarms the same way.
WOW JUST WOW, your talent can't be denied. I have been struggling with prometheus and you just made it easy for me. thank you
Great clarity and coverage in just 20 minutes. Thanks Nana. Keep it up.
@TechWorldwithNana
3 жыл бұрын
Thanks, glad you learned a lot in those 20mins :) Yes will do, many great tutorials are coming 💪🏼 :)
ty for this, i learned prometheus a couple years ago and have been somewhat managing it and it was clear to me there was a much easier way to represent that documentation. i think this is great and should sit on the front page of prometheus docs itself.
Fantastic intro to the product. Clarity at last!
@TechWorldwithNana
3 жыл бұрын
Thank you Philip! :) Happy that it was helpful for you!
@pixiedustdreams
3 жыл бұрын
Agree!! Thank you for this
You explained it very beautifully with the art of explaining in a simple way. Appreciated !!!
@TechWorldwithNana
3 жыл бұрын
Thank you Samir :)
i had to learn prometheus for my job recently and this playlist was really helpful, thanks!
This is an amazing intro for Prometheus - thank you Nana. Please publish more Prometheus/Jaeger/Grafana use cases. Thank you !!
@TechWorldwithNana
3 жыл бұрын
Thank you Santosh! Will definitely do!
Hi Nana, thank you so much for this video. Ever since I got into this DevOps world, I follow your tutorials and explainer videos religiously. Could you please do one on Fluentd, briefly explaining what its use cases and how it differs from Prometheus?
Thank you Nana. It was really helpful. You have opened another door to enrich our application.
Thank you! Best introductions on DevOps topics i've ever seen.
Just brilliant. I feel like an expert on the subject after each of your videos, thanks!
@TechWorldwithNana
3 жыл бұрын
That's great :D
Brilliantly explained! All your vids are pure gold and diamonds! Thank you so much for your work, dear Nana!
@TechWorldwithNana
4 жыл бұрын
Hi, thank you so much, happy you like my videos :)
It is amazing how you explain it, for me who has no idea what prometheus is and curious in understanding it and where I intent to pick a monitoring tools to implement, I have no trouble in understanding how prometheus works and what value it brings. Thank you very much. Really looking forwards for your contents in this channel.
@TechWorldwithNana
3 жыл бұрын
Wow thank you Samuel, that's a really great feedback! Hope you will like the upcoming videos too :)
You are amazing! Can't believe how easy it is to understand these topics by watching your videos.
Very comprehensive video with all important points covered for a beginner
To be honest you made it look easier. As of now this is the best video for getting started with Prometheus.
Thank you so much for making this video in such a simple and efficient way ❤️
Awesome wrap up! Exactly what I needed! Thanks 🙏
You are such amazing talented teacher I have ever been know
I wish to have teachers like you Nana Kudos to you and your Parents !!👏
Thanks a lot Nana for the awesome explanatory video. Sincerely appreciate what you are doing for the dev community.
Great video as always Nana. I just have one (tiny) comment on the directions of the arrows that you used to annotate the dataflow, sometimes it can be confusing. For example at 7:00 (Main component : Prometheus Server), I eventually understood it perfectly, but before that I got confused of where should the data (metrics) go as I followed the directions of the arrows. Maybe it is just me. Thank you so much. P/S and I would love to see your video on Sysdig (and Falco) and how it is different from Prometheus. Cheers.
Excellent clarity with explanation of real time scenarios.Great Job! much appreciated.
@TechWorldwithNana
3 жыл бұрын
Thanks for your feedback, happy to hear :)
This is what I was looking for. This is what you get in premium courses. Very simply explained and smartly crafted video. Thank you..!!
@TechWorldwithNana
3 жыл бұрын
Thank you so much for this feedback :)
Concepts are explained with clarity... Very impressive... Perhaps one of the best video for Prometheus present .. Amazing
@TechWorldwithNana
3 жыл бұрын
Wow thank you Rohit, happy you think so :D
Just wanted to say this video is brilliant. Ive joined a new team that use Prometheus and Grafana and this video gave me such a good understanding on Prometheus. You are a really good teacher. Keep doing what you do and thank you for your work !!
@TechWorldwithNana
3 ай бұрын
that's amazing, really great to hear my video helped! 🙌
Crystal clear explanation. God bless you. Thanks 🙏🏼
Nana, you are doing great job, bringing your knowledge and experience into the mass! Your videos are something special to me. Need to implement some monitoring into our evnrionment, so decided to give a chance to Prometeus. KZread just instantly directed me to your channel, and it cool! P.S. Keep doing what you doing!
Great explanation @Nana. Thank you so much for this content !
Yours are great video, simplified, what , where, why are all covered perfectly, it would great you cover some practical use cases and have some demo on that..thanks a lot !!
Really tutorial and very well explained, thank you!
This is actually awesome... I'm hooked to your channel!!
@TechWorldwithNana
3 жыл бұрын
Thank you Laryssa :) Happy to hear that!
This was an excellent and very helpful tutorial. Thank you!
Best introduction about Prometheus I ever had, Thank you so much. When are you releasing the video about practical example of setting it up with Kubernetes? Also, Do you have a site or blog?
@TechWorldwithNana
3 жыл бұрын
Cool, glad you liked it so much! :) I don't know yet, will try to make it as soon as possible - realistically it will be in the next 2 months. Stay tuned. I'm on DEV.to, Twitter, Instagram, LinkedIn, Facebook - check out the links here kzread.infoabout
@TechWorldwithNana
3 жыл бұрын
Hi, just wanted to let you know that I have released the first part of the demo video =)
@ankurgupta9609
3 жыл бұрын
@@TechWorldwithNana Thank you so much :)
Sending much love!!! I love your tutorials. I have learned so much from your videos. Keep up the great work.
Very informative. Looking forward to going through your other tutorials and videos. Cheers!
As usual, clear and concise content. Very much appreciated.
amazing video! thank you for covering all the grounds in 20 minutes :)
I will not be wrong when I say this is by far the best Video on the net explaining on a high level Prometheus Architecture and Monitoring with the tool. Thank you so much for sharing.
@TechWorldwithNana
4 жыл бұрын
Wow, really happy to hear that! 🙂 Check out my other videos and would appreciate if you share it :)
You are Great! I can't imagine how it could be explained better.
Outstanding explanation!! Thank you for the amazing efforts.
Wow, great explanation!, just what I needed. I have a very clear idea of what Prometheus is and what it does. Thank you!
@TechWorldwithNana
4 жыл бұрын
That's great, thank you Juan for your feedback! :)
This is a very well done video! Thank you for the information
These videos helped me a lot when as a refresher for my interviews... Thank You very much
What a brilliant tutorial. Thank you for the efforts!
@TechWorldwithNana
3 жыл бұрын
Thanks, glad you liked it! Hope you check out my other videos too 🙂
Well explained and very nice teaching style. Thank you so much for this lecture.
Best explanation i have ever watched. Thank you so much 🙏🏻🙏🏻🙏🏻🙏🏻
Hey TechWorld with Nana, your effort taken to these vlogs really makes me understand so clearly. #thanks
@TechWorldwithNana
3 жыл бұрын
Thank you. Happy to help. 🙂
Excellent content on relevant topic, as always! No fluff, just useful stuff. I must admit that I chuckled at the "Complex & not well documented" comment since that's been my experience so far :D
Amazing job Nana. Well structured better explained.
What a great Prometheus introduction. Everything was very clear and easy to grasp. Do you have any plans on making videos that explain Grafana Loki? It's advertised as being like Prometheus, but for logs. A Loki video with your level of quality would be awesome. Keep up the good work. I really appreciate your videos!
@TechWorldwithNana
3 жыл бұрын
Thank you. Appreciate the support. Hopefully we can add that to the pipeline. 🙂
I cant explain in words how much I appreciate this video, thank you so much
Thank you Nana, after watching your videos I am grooming myself better than before.
Thanks.. I thought of have to go through few documents to understand what is Prometheus. But this 20 min video helped lot, and gave good understanding on how it works.
Thanks Nana, I appreciate your content! I am excited to learn about monitoring your Kubernetes cluster with Prometheus!
@TechWorldwithNana
4 жыл бұрын
Thanks a lot Douglas! :)
Please more about Prometheus. :) Just found your channel. I love it
@TechWorldwithNana
4 жыл бұрын
Awesome, will do :) Check out my other videos in the meantime 🙂
@TechWorldwithNana
3 жыл бұрын
Hi Max, I released the next video for Prometheus yesterday, if you would like to check it out ;)
@Max-qn7gh
3 жыл бұрын
@@TechWorldwithNana Awesome, i will check it out right now. =) Thank you
Another very informative and practical video. Thank you!
I really admire the way of explanation and also thank you very much for sharing such a wonderful knowledge to every one. I am waiting for next video about ISTIO :)
@TechWorldwithNana
4 жыл бұрын
Thanks for your feedback phani :)
Each and every video talks your in-depth knowledge and the way you teach. Simply wow... Many of the concepts are neatly explained... Thanks. Pressed the Bell Icon and awaiting for more videos. Love from India.
@TechWorldwithNana
3 жыл бұрын
Wow really happy to hear :) Thank you so much and greetings to India! 🇮🇳
Wow, thanks for this video. Really need this overview with just enough details
@TechWorldwithNana
3 жыл бұрын
Thanks Elena, glad you liked my way of explaining the topic 🙂
Exactly what I need, thank you
very smooth and clear delivery, thank you very much for the video!
Very well explained on the Prometheus concepts. Appreciated.
@TechWorldwithNana
3 жыл бұрын
Thank you Yogaraj! :)
Very good explanation for a beginner like myself, thank you ☺️