Apache Kafka Tutorial with Spring Boot Reactive & WebFlux | Kafka Tutorial

🔥 Secure your spot now and embark on your journey to becoming a Spring Boot master!🔥
aliboucoding.com/p/spring-boo...
🎁 🚀 COUPON Code: EARLY_BIRD_30
We'll explore the nuances of Kafka Clusters, Producers, Consumers, Topics, Partitions, Consumer Groups, Offsets, and demystify Serialization.
As part of our comprehensive demonstration, we'll construct an entire application designed to consume a reactive REST API stream utilizing Spring Boot Reactive and WebFlux. The producer component will dispatch events to a Kafka broker, while a dedicated consumer will process and store this data seamlessly into a DynamoDB database.
🧑‍💻 Source code: github.com/ali-bouali/apache-...
🌐 Wiki media dashboard: esjewett.github.io/wm-eventso...
🔗 Wikimedia Stream API: stream.wikimedia.org/v2/strea...
🎟 Join this channel to get access to perks: / @boualiali
Recommended Courses:
🎬 Spring Boot security & JWT token: • Spring boot 3.0 - Secu...
🎬 Spring security - Roles and permissions: • Spring boot 3 & Spring...
🎬 Spring Boot - Microservices architecture: • Microservices tutorial...
🎬 DevOps - Github Actions CI/CD: • GitHub Actions CI/CD p...
🎬 Spring Security - KeyCloak integration: • Spring boot 3 Keycloak...
🎬 DevOps - Docker for Beginners: • Docker tutorial for be...
🎬 DevOps - AWS EC2 deployment: • 🚀 Deploy Spring boot a...
🎬 Angular - Full course from scratch: • Angular Tutorial For B...
🎬 Websocket - Chat application one to one: • WebSocket Tutorial wit...
🎬 Spring Security - Two Factors Authentication 2FA (TFA): • Two Factor Authenticat...
🎬 Spring Boot - Swagger UI & OpenApi Decomentation : • Spring boot 3 - OpenAp...
🎬 Spring Boot - Reactive programming & WebFlux: • Reactive Programming w...
🎬 Spring Data JPA & Hibernate: • Spring Data JPA - The ...
CONNECT WITH ME:
👨‍💻. Website: aliboucoding.com
👨‍🏫 Facebook: / 589612651142975
📸 Instagram: / alibou_coding
🎮 GitHub: github.com/ali-bouali
🏘️ Discord: / discord
Table of content:
00:00 Intro
04:02 What is a message broker
06:13 Kafka overview
09:42 Kafka Cluster
11:06 Kafka Broker
12:14 Kafka Producer
12:54 Kafka Consumer
13:37 Kafka Topic
14:46 Kafka Partitions
17:38 Kafka Partitions Offsets
21:37 Kafka Consumer Groups
23:13 Kafka Installation
25:30 Play & Explore Kafka
33:08 Create a new Spring boot project
34:18 Configure Kafka Producer and Consumer
40:50 Configure Kafka Topic
42:57 Create a Kafka Producer
46:10 Create the REST API
48:40 Send the first message
50:36 Create the Kafka Consumer
54:23 Configure Kafka for JSON Object & Serialisation | Deserialisation
58:04 Create Kafka Json Producer
01:01:37 Adjust the REST API
01:03:48 Configure the truster packages
01:07:08 Adjust the Consumer and test the changes
01:09:58 Real world application - Overview
01:15:04 Create the Producer project
01:16:34 Configure the producer
01:18:29 Configure the WebClient (WebFlux)
01:19:25 Create the Wikimedia Kafka Producer
01:21:11 Create the Wikimedia Stream consumer
01:25:14 Consume and Publish to Kafka Topic
01:30:40 Implement the Kafka Consumer
01:35:06 Test the application
01:35:52 Outro
#SpringSecurity #kafka #apachekafka #tutorial

Пікірлер: 75

  • @user-ig9xc9ws4s
    @user-ig9xc9ws4s4 ай бұрын

    The best kafka tutorial I have ever seen, On top of that the diagrams make the things really understandable and to relate with the code.

  • @BoualiAli

    @BoualiAli

    2 ай бұрын

    Glad it helped!

  • @guuridev
    @guuridev5 ай бұрын

    Not gonna lie, this channel is top tier Spring Boot content nowadays. Straight to the point, made it look so easy, well explained with pragmatic methods, 10/10, salutes from Spain 🫡

  • @BoualiAli

    @BoualiAli

    2 ай бұрын

    Glad you think so!

  • @arefsa6
    @arefsa67 ай бұрын

    Ali, you teach us how to walk and learning to run is our duty. Thank you for your exceptional teachings

  • @BoualiAli

    @BoualiAli

    6 ай бұрын

    My pleasure!

  • @oskilochka
    @oskilochka6 ай бұрын

    Thank you for the explanation !

  • @magadiflo-dev
    @magadiflo-dev7 ай бұрын

    Great, I really like when you use diagrams, I feel it is easier to understand the concepts, thank you very much for the time you took to share this knowledge.

  • @BoualiAli

    @BoualiAli

    7 ай бұрын

    Glad you like them!

  • @user-cy7xm8lt9d
    @user-cy7xm8lt9d6 ай бұрын

    Really Great and Helpful for me Thank you!

  • @abu-dukhan
    @abu-dukhan7 ай бұрын

    Can't wait for this Bro 🔥🔥🔥

  • @BoualiAli

    @BoualiAli

    7 ай бұрын

    I will be waiting for your feedback

  • @user-mz1rs8tp9y
    @user-mz1rs8tp9y7 ай бұрын

    Can’t wait to start ❄️

  • @BoualiAli

    @BoualiAli

    7 ай бұрын

    Enjoy it!

  • @MutantBikers
    @MutantBikers7 ай бұрын

    Thanks you so much for the video ❤

  • @BoualiAli

    @BoualiAli

    7 ай бұрын

    Happy you liked it

  • @mrcoder9401
    @mrcoder940116 күн бұрын

    This is great, Thanks Ali.

  • @alexandervasilenko7773
    @alexandervasilenko77732 ай бұрын

    Cool, Ali! Thanxx a lot!!

  • @BoualiAli

    @BoualiAli

    2 ай бұрын

    Glad you liked it!

  • @achrafplayzz
    @achrafplayzz7 ай бұрын

    great video, thanks a lot.

  • @BoualiAli

    @BoualiAli

    7 ай бұрын

    Glad you liked it!

  • @tobbythebeast12
    @tobbythebeast126 ай бұрын

    your tutorials are the best.you are my savior as always.keep up the good work.love you 😘😘😘 (plz consider doing tutorial on Kafka streams)

  • @BoualiAli

    @BoualiAli

    6 ай бұрын

    Noted!

  • @haithemmihoubi
    @haithemmihoubi6 ай бұрын

    Thanks 🎉🎉🎉❤

  • @abdellatifzouliga5885
    @abdellatifzouliga588524 күн бұрын

    Thank you for this tutorial.

  • @BoualiAli

    @BoualiAli

    21 күн бұрын

    Glad it was helpful!

  • @farjallahhaythem5675
    @farjallahhaythem56757 ай бұрын

    great content

  • @BoualiAli

    @BoualiAli

    7 ай бұрын

    Thank you. Waiting for your feedback

  • @wilsonvaboum1338
    @wilsonvaboum13383 ай бұрын

    Autrement dit 😀, very nice tutorail, well done

  • @BoualiAli

    @BoualiAli

    2 ай бұрын

    hahah

  • @abdelhaibouaicha3293
    @abdelhaibouaicha32937 ай бұрын

    Generated by Talkbud: 📝 Summary of Key Points: 📌 Kafka is a distributed, fault-tolerant, and highly scalable message broker and stream processing platform. It can handle large volumes of data streams in real-time and provides advantages such as scalability, durability, fault tolerance, and real-time processing. 🧐 Kafka consists of components such as Kafka clusters, producers, consumers, topics, partitions, offsets, and consumer groups. Producers publish messages to Kafka topics, consumers subscribe to topics and process messages, and topics can be divided into partitions for parallel processing. 🚀 The video demonstrates how to install Kafka and configure topics, producers, and consumers within a Spring Boot framework. It also highlights the importance of serialization, deserialization, and offsets in Kafka. 📌 A real-world example is presented, showing how to create a Kafka topic, configure a producer and consumer, and implement a reactive REST API that consumes data from a streaming source and publishes it to the Kafka broker. The consumer transcribes the messages into a database, ensuring no messages are missed. 💡 Additional Insights and Observations: 💬 "Kafka allows for the decoupling of producers and consumers, enabling flexibility and independence in application development." 📊 Kafka is designed to handle large volumes of data streams and can process millions of messages per second. 🌐 Kafka has a rich ecosystem with connectors for integrating with various data storage systems, stream processing frameworks, and analytics tools. 📣 Concluding Remarks: The video provides a comprehensive overview of Kafka and its components, explaining its benefits and capabilities. It also offers practical examples of how to use Kafka in a Spring Boot application, demonstrating the configuration of producers, consumers, and topics. The video emphasizes the scalability, fault tolerance, and real-time processing capabilities of Kafka, making it a powerful tool for handling large volumes of data streams.

  • @BoualiAli

    @BoualiAli

    6 ай бұрын

    I like the resume

  • @QuickMixKZ
    @QuickMixKZ6 ай бұрын

    Kafka has a reactive client. The title of the video is confusing. I expected to see an example of using a reactive client here.

  • @user-wh6fj9mj9o
    @user-wh6fj9mj9o3 ай бұрын

    Zo`r tushintirib qo`yibsiz ,Alloh rozi bo`lsin,ko`p narsalarni sizni darslaringizni ko`rib o`rganyapman👍👍👍

  • @BoualiAli

    @BoualiAli

    Ай бұрын

    Thank you

  • @rahman_darb
    @rahman_darb7 ай бұрын

    Thanks bro

  • @BoualiAli

    @BoualiAli

    7 ай бұрын

    Welcome

  • @ferchamin1
    @ferchamin12 ай бұрын

    Thank you Sebas Battaglia!

  • @BoualiAli

    @BoualiAli

    2 ай бұрын

    You are welcome!

  • @cartoonnewseasons3461
    @cartoonnewseasons34615 ай бұрын

    Wonderful job thannnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnks a lot MAN

  • @BoualiAli

    @BoualiAli

    2 ай бұрын

    Glad you liked it!

  • @gabrielbatista1712
    @gabrielbatista1712Ай бұрын

    very good content thank you.

  • @BoualiAli

    @BoualiAli

    Ай бұрын

    You are welcome!

  • @jasongoossens
    @jasongoossens2 ай бұрын

    Very good tutorial! I like the no-fluff approach! (but OTOH, that makes it slightly less tailored to complete beginners 🤷‍♂)

  • @BoualiAli

    @BoualiAli

    2 ай бұрын

    Glad it was helpful!

  • @maulanahahaha
    @maulanahahaha7 ай бұрын

    Woaa

  • @BoualiAli

    @BoualiAli

    7 ай бұрын

    Happy you liked it!

  • @haykelmaaoui2492
    @haykelmaaoui24927 ай бұрын

    Great work Ali, we are still waiting to explain how debugging with Intelij like evaluate expression, ....

  • @BoualiAli

    @BoualiAli

    7 ай бұрын

    I already published a video about that, Check the channel

  • @haykelmaaoui2492

    @haykelmaaoui2492

    7 ай бұрын

    i don't find the video, can you share the link here please @@BoualiAli

  • @BoualiAli

    @BoualiAli

    7 ай бұрын

    @@haykelmaaoui2492kzread.info/dash/bejne/eWugvLSuiq67gKw.html

  • @naderayed9562
    @naderayed95625 ай бұрын

    Thank you very much, Mr. Ali, for your efforts,I appreciate it

  • @BoualiAli

    @BoualiAli

    2 ай бұрын

    sure, soon

  • @iampradeephr
    @iampradeephr3 ай бұрын

    Please do a video on KAFKA STREAMS.

  • @AmayasABBOUTE
    @AmayasABBOUTE7 ай бұрын

    Great tutorial ! Do we need a zookeeper systematically when we use kafka ?

  • @BoualiAli

    @BoualiAli

    7 ай бұрын

    Yes we do. It is the brokers orchestrator

  • @ramanav3139
    @ramanav31393 ай бұрын

    can you guide me on how to do Kafka clustering in the spring boot application,do one video one how kafka brokers work in real time applications

  • @saurabhmaurya6964
    @saurabhmaurya69646 ай бұрын

    how can we fetch all the messages from the particular topic after hitting end-point url ?..Help me with this..I tried To do with the help of KafkaConsumer consumer .. this has a method poll .. but after hitting end point i'm getting null in consumer..please help me with this ..

  • @user-qq1zb4ke6g
    @user-qq1zb4ke6g3 ай бұрын

    Did only I notice that the script for introduction is ai generated, and it is obvious that you are reading it.

  • @BoualiAli

    @BoualiAli

    2 ай бұрын

    is that a sin?

  • @TikTokTrendsCompilation
    @TikTokTrendsCompilation7 ай бұрын

    Finally! Just Please don't make a generic tutorial with boilerplate minimal kafka producer/consumer example. Everyone already made tutorials for that. There are tons of blogs posts for that.I already learned how to setup the basics of kafka to work and many people also figured it out, or if they havent yet they can easily learn in 10 minutes. We don't need another 1057th tutorial showing the basics of producer/consumer with kafka. Please turn this tutorial series into a practical real world project that uses kafka, such as a chat app, live-stream, or any real world usage with kafka. I don't know how to use kafka in a real world project because no one explains it. You could be the first one to finally explain it. How do i even connect kafka to a frontend angular/react/nextjs project? I have no clue. NPM doesnt even have a kafka library. How would i deploy kafka to AWS production app? I have no clue because no one explains it. Please make sure the tutorial series covers these concepts otherwise the tutorial would be no different than 1000s of others that already exist.

  • @BoualiAli

    @BoualiAli

    7 ай бұрын

    Thank you for your comment and here is my answer. This is not the first time you post a similar comment, that's why I want to clarify things for you. First, I don't create my videos only for you, I create videos for my community and they already voted for todays topic and here the Kafka tutorial is live now (I think you're not part of our community). Second, it seems that you are not a loyal subscriber to my channel because you don't know my teaching style (We don't need another 1057th tutorial showing the basics of producer/consumer with kafka.) Third, I'm getting payed to create content on KZread, I'm offering free high quality content for my community and I'm not getting any income from it. Fourth, Creating 90 minutes video tutorial, takes at least 4 days (preparing diagrams, coding, recording, editing,...) so you can image how long what you're asking for might need to be ready Fifth, I will create more Kafka tutorials to cover other parts and advanced ones. Thank you for your understanding

  • @TikTokTrendsCompilation

    @TikTokTrendsCompilation

    7 ай бұрын

    @@BoualiAli why do you keep deleting my comment? i can't reply with valid arguments?

  • @BoualiAli

    @BoualiAli

    7 ай бұрын

    @@TikTokTrendsCompilation I didn't delete your comment. it is still there and you're already answering my response. Waiting for your arguments.

  • @TikTokTrendsCompilation

    @TikTokTrendsCompilation

    7 ай бұрын

    @@BoualiAli ​​Not sure why youtube keeps deleting my comment then, i'll try to disperse the comment into 5 comments. 1/5 I know how difficult and time consuming it is to make a video and explain especially an advanced topic. but if youtube is your main job or you earn income from youtube, that should be no excuse.

  • @TikTokTrendsCompilation

    @TikTokTrendsCompilation

    7 ай бұрын

    @@BoualiAli 3/5 I believe you have the same potential to be the best content creator on youtube but in Spring Boot realm since you also make high quality content. I support and like all of your videos. You need to take my feedback as a constructive positive criticism.