Microservice | Distributed log tracing using Spring Cloud Sleuth & Zipkin | PART-7 | Javatechie
Ғылым және технология
This tutorial will walk you through the steps of building a spring boot project with Microservice architecture also we will learn Real time integration of
1.spring cloud eureka
2.Spring cloud API Gateway
3. Hystrix
4.cloud config server
5. ELK Stack Centralize logging
6. Spring Cloud Sleuth & Zipkin (Distributed log tracing)
#javatechie #SpringBoot #Microservice
#SpringCloud #Sleuth #zipkin
GitHub:
github.com/Java-Techie-jt/spr...
Blogs:
/ javatechie
Facebook:
/ 919464521471923
Guys if you like this video please do subscribe now and press the bell icon to not miss any update from Java Techie
Disclaimer/Policy:
--------------------------------
Note : All uploaded content in this channel is mine and its not copied from any community , you are free to use source code from above mentioned GitHub account
Пікірлер: 111
nice One 🎉
Awesome Video
you are doing brilliant work sir. thanks
Nice one. Thanks for preparing this
Very helpful and interesting topic.Thanks
Thanks a lot for this brief yet practical explanation!
Awesome Video Basant. You are doing invaluable service to developers community. Thank you so much.
@Javatechie
2 жыл бұрын
Thanks buddy 😊
Great explanation! Thank you very much
Great explaining. able to understand the concept
Your videos are very concise and easy to understand. Thanks for spreading knowledge.
@Javatechie
2 жыл бұрын
Thanks buddy 😊
love to see your videos sir, keep doing..!
Nice explanation and thanks for your efforts
Really Appreciated !! Thanks a lot
Awesome video man, really helpful!
really outstanding learned some decent stuff.
Very nice explaination!
Nice explanation. Thank you
While both involve deduction in some sense, they operate in different domains and contexts. Data science focuses on deriving insights from data through statistical analysis and machine learning techniques, while Spring Sleuth is specifically designed for tracing and monitoring the flow of requests through a distributed system.
Very nice video 👌
Awesome 👍👏
You're very kind hearted man... Love your videos
@Javatechie
4 жыл бұрын
😀 thanks Ahmad
well explained..Thanks .
great video mannn. thanks
Excellent
Learn a lot from you sir thank you. Can you also do a tutorial about this project, to deploy as a docker container?
Also in real time I think Kafka Messaging Queue will push the data to Zipkin server and Zipkin will store it in some databases like Elasticsearch/Mongo/Cassandra
God bless you man
nice.. thank you..
Thank you so much sir🙏
thnx bro
Thank you so much for great videos.. what happens when other external services not implemented zipkins or sluth .. Second question is does we able to see external services logs if they are implementing same log trace plugins
Thanks
Hi Sir its very useful to see Microservices Ecosystem integrated. For this series could you please add OAuth2 for Security. Please do a video on OAuth2 sir and a video for this series.
@Javatechie
4 жыл бұрын
Yes am trying jwt to integrate in same microservice series
Please keep playlist link in the description. Becomes very helpful when randomly ending on a video from a search
@Javatechie
3 жыл бұрын
Its there in video description utsav
Thanks. The Examples/scenarios are for synchronous model..will it work for asynchronous and non spring boot applications?
Hello @Java Techie, your tutorials help a lot from a learning perspective. Thanks for posting such constructive and hands-on tutorials. Just one query regarding this tutorial, Is it possible to check the request payloads on the Zipkin UI portal while tracing the request when the request is traversing from around various microservices using the sleuth and Zipkin. Please let us know. Thanks in advance.
@Javatechie
2 жыл бұрын
No we can't view payload use elk and check complete request payload in kibana log
@tejassontakke8382
2 жыл бұрын
@@Javatechie sure. Thanks.
Awesome . Awesome learning with Java Techie ..Thank you . can we use Ribbon for the LOAD balancing ? are you planning to implement the same ?
@Javatechie
4 жыл бұрын
Yes we can use ribbon as I did poc with one instance so didn't added this concept yet .but if required I will plan to add one tutorial on same
@technicalsource8236
2 жыл бұрын
In other group I think of
Please make one video on splunk framework.
Very much helpful video. Thanks a lot Basant!!! But have a doubt, Can we implement Sleuth alone for just getting those metadata in logs?
@Javatechie
6 ай бұрын
No we need to push those metrics from our app to sleuth
You are doing great job, which one to prefer ELK or Sleuth for distributed logging
@Javatechie
3 жыл бұрын
Both having different purposes Elk used for centralize logging where sleuth used for distributed tracing
I think u could have even showed tracing failed request also ,any ways good tutorial 😊
Could you please make one video on dynatrace or any other production like monitoring tool. It would be very helpful.
@Javatechie
Жыл бұрын
It's paid buddy. If i could get some free trial then definitely i will give a try
Hi Basant, I've been watching many of your videos and those are very helpful. Thank you. My question is, Will sleuth-zipkin work across kafka ? Elaboratively, one microservice is pushing data to kafka and other microservices are reading the data from kafka. Will this approach for distributed tracing work in that case? If not, then can you please suggest how can we work around. I've heard Jaeger has capability to do it. Please make tutorial on that .🙏
@Javatechie
3 жыл бұрын
Am not sure whether we can use this distributed tracing using Kafka or not .
@yashrao7236
3 жыл бұрын
@@Javatechie sir if you know some other approach then please create video for that also
@Javatechie
3 жыл бұрын
Sure I will try to explore about this
Great content man. 👍 Please help me with one query : Why traceId and spanId is same for orderService ?
@Javatechie
Жыл бұрын
Try attempting multiple time you will find your answers buddy
@basant Is trace id equivalent to Correlation ID?
Does it matter if I use in spring.zipkin baseUrl instead of base-url in the application properties?
Bro can you make a video to implement message queue for the above project .i have do the project but i want to add message queue approach
@basant - I guess you added the same tutorial twice in the playlist. Can you please correct or did you miss to add any other tutorial.
Please provide video for Eureka as service discovery and zuul as api gateway
@Javatechie
4 жыл бұрын
Vivek already uploaded please go through my microservice playlist
What will happen if the Zipkin server is down, is logs transactions will be lost? Can we see them once Zipkin is up?
Hello Sir it's great video ,just wanted to know how can I trace my request if i will be using Kafka in between of microservices??
@Javatechie
2 жыл бұрын
You need to check in Kafka tool or lenses ui
So we can add sleuth/ zipkin within elk stack ..so that in addition we get microservice flow logs for debugging Is my above statement correct ?
@Javatechie
3 жыл бұрын
Yup correct
Excellent, How can we identify or relate (span -> microservice version) which microservice instance is creating the problem. Like : SpanId : ftyytyuiyi -> Microservice A : v1 SpanId : dsfsdffs -> Microservice A : v2
can you add tutorial to containerize this project using Kubernetes.
🎯 Key Takeaways for quick navigation: 00:00 *Understanding Google Cast* 00:29 *Microservices communication* 00:58 *Importance of separate applications* 04:55 *Log Tracing Using* 05:18 *Doesn't Support* 05:42 *Service Name* 05:55 *Dependency Updates* 06:11 *Spring and Dependencies* 06:28 *Enabled to Import* 06:39 *Good Two Products* 06:56 *Cloud and Register* 07:09 *Fine Payment Services* 07:22 *Good Base Here* 07:35 *Base and Care* 07:49 *Give the Path* 08:04 *Registered Services* 08:30 *Services President Tried* 08:42 *Good Care Service* 09:03 *Service Not Able* 09:18 *Click Switch Off* 10:16 *Last When Is* 10:50 *Trace Your Service* 11:01 *Service Differences* 11:14 *Trace Your Services* 11:30 *Microservices Variations* 11:52 *Service Stability* 12:05 *Feel Good Service* 12:28 *Track the Requests* 12:42 *Click Off Services* 12:55 *Payment Service Request* 13:07 *Follow Service History* 13:21 *Dependency Satisfaction* 13:35 *Order and Payment Services* 13:49 *Multi-Microservices* Made with HARPA AI
Hi bro, I am able to work with Zipkin. But I am running multiple instances of Order and Payment services on different ports. In Zipkin, it is showing only IP and not on which port my requests are getting redirected by Eureka. How to get Ports also in Zipkin dashboard?
@Javatechie
2 жыл бұрын
Zipkin won't show your port . It will show your service name based on service name you can find out port in your Eureka server
@ChandanKumar-ou9fr
2 жыл бұрын
@@Javatechie But at timestamp 2:00 you said that we'll be able to find exactly which instance of our service will go down, whether it is 9090 or 9091. How to find that out for a request?
Nice May I know how to get all the log messages in one place in Microservices
@Javatechie
2 жыл бұрын
Use elastic logstash and kibbana . already i uploaded it please checkout my microservice playlist
Hello sir, In the production environment I wanted to see the number of microservices hit and payload for each request. How do I get it?
@Javatechie
Жыл бұрын
Use ELK or check in splunk
@sathiskumarp
Жыл бұрын
Thank you for your response. So, In splunk we can track the total number of hits for each service. What is ELK?
@Javatechie
Жыл бұрын
Buddy please search in my channel you will get both the content
can you create one video please for one flow from controller to database to show in the zipkin trace
@Javatechie
3 жыл бұрын
Zipkin used to track microservice api call not application flow
@arunlepuru
3 жыл бұрын
@@Javatechie ok..actually need to trace JPA repository what is the method it called when flow start
@Javatechie
3 жыл бұрын
Create your custom metrics using reflection api or use spring app around advice on repository later
Can you plz share zipkin jar . I have searched all the way in the google but no luck ☹️
@Javatechie
3 жыл бұрын
Directly get it from Maven central repository
Can we create a custom span ID. ? If yes, then how ?
@Javatechie
Жыл бұрын
I believe we can but will check and update
@krantimansingh7888
Жыл бұрын
@@Javatechie I am not able to find any related documentation for it. Kindly update if you find something.
What is the purpose of sleuth dependency?
Need help regarding new relic logs how to push the logs to new relic
@Javatechie
Жыл бұрын
I am not aware that relics will check and update you
2020-09-05 22:00:29.298 INFO [order-service,,,] 8076 --- [ restartedMain] c.e.S.SlauthDemoOrderServiceApplication : Started SlauthDemoOrderServiceApplication in 7.371 seconds (JVM running for 7.986) i am getting response in this format ..service name is printing , but Traceid and other metadata are not printing. But in Zipkin UI i am getting all those metadata.
@Javatechie
3 жыл бұрын
Spring boot version ? Am not sure about it in each spring version something gona changed by developer So please checkout the spring boot official documentation if you are using latest version
@krishnapanigrahi6926
3 жыл бұрын
@@Javatechie spring boot version is 2.3.3
But in real time it should be a separate spring boot project i guess
How to secure zipkin?
@Javatechie
4 жыл бұрын
Am not sure but I believe we need to create zipkin server manually then need to enable security by adding spring security starter dependency
centralized logging vs distributed logging
How to hold historical logs on zipkin ui
How can I persist all log for long time
Zipkin jar is not running in windows. Can anyone help me out?
@Javatechie
3 жыл бұрын
What error you are getting
@uma4525
3 жыл бұрын
@@Javatechie BeanCreation Exception with name ArmeriaServer. I am using zipkin- server-2.23.2-exec.jar and amazon correto jdk 11
@Javatechie
3 жыл бұрын
Not getting you why you want to sync AWS with zipkin
@uma4525
3 жыл бұрын
@@Javatechie am not using aws. Amazon correto is a jdk which am using
docker exec -it javatechie ls /data/spring-related-tutorials
Excellent