Introduction to Apache Kafka by James Ward

Ғылым және технология

Please subscribe to our KZread channel @ bit.ly/devoxx-youtube
Like us on Facebook @ / devoxxcom
Follow us on Twitter @ / devoxx
Apache Kafka has emerged as a next generation event streaming system to connect our distributed systems through fault tolerant and scalable event-driven architectures. Now open source through Apache, Kafka is being used by numerous large enterprises for a variety of use cases. This session will introduce the basics of Kafka and walk through some code examples that will show how to begin using it

Пікірлер: 87

  • @rohanurkude8503
    @rohanurkude85032 жыл бұрын

    We hardly see someone explaining such a vast topic in such a concise and clear way. Really appreciate all the effort James, Kudos to you :)

  • @geeeee8268
    @geeeee82687 жыл бұрын

    Best Kafka intro by far.

  • @zackmacomber
    @zackmacomber6 жыл бұрын

    I wish Apache's documentation read like he speaks...I have been so confused about the AdminClient API and various Kafka Java libraries and this guy actually defines terms in a clear way...why can't the vendors themselves present their products clearly???

  • @l_combo

    @l_combo

    5 жыл бұрын

    Kafka is open source... so it's up to the community to define.

  • @l_combo

    @l_combo

    5 жыл бұрын

    @@kjeldschouten-lebbing6260 if you are writing and submitting code, I would expect you to at least comment your code at the very least and then documentation on top. The open source community has produced plenty of documentation in their time but obviously may not have the same incentive as a funded company i.e. Confluent

  • @scorpionkingnaveen
    @scorpionkingnaveen7 жыл бұрын

    Wow.. That was a absolutely great intro to Kafka. Thanks for that!

  • @sebkafka6330

    @sebkafka6330

    5 жыл бұрын

    you're welcome

  • @danuvian
    @danuvian4 жыл бұрын

    Good intro to Kafka. Easy to understand and it was explained well. Very good speaker.

  • @DevidasS
    @DevidasS4 жыл бұрын

    Really an awesome presentation this one! cant help but keep coming back to this video to go back to the basics of Kafka..

  • @CarloL525
    @CarloL5255 жыл бұрын

    Clearest explanation! Great talk!

  • @joakimhansson5687
    @joakimhansson56876 жыл бұрын

    Great stuff. Would recommend repeating questions from the audience though as we can't hear it at all.

  • @WayneTaylor1982
    @WayneTaylor19826 жыл бұрын

    Thanks for the talk here. Very informative and great working life example

  • @earlybird5612
    @earlybird56126 жыл бұрын

    Great introduction to Kafka! Provides a great overview.

  • @doviche
    @doviche6 жыл бұрын

    Very good introduction. I've bought the book Kafka The Definitive Guide and it's all just so amazing. Guys, drop traditional messaging system brokers and adopt the Kafka way.

  • @sheepyy15
    @sheepyy157 жыл бұрын

    Awesome talk! thanks

  • @rodgersnyangweso6615
    @rodgersnyangweso66153 жыл бұрын

    Precise Intro. Kudos

  • @dimuthul
    @dimuthul4 жыл бұрын

    Thanks James Ward!

  • @mehdimohammadi1623
    @mehdimohammadi16236 жыл бұрын

    Awesome , it was very useful introduction I enjoyed that!

  • @mirmali2710
    @mirmali27106 жыл бұрын

    I like James' way of presentation.

  • @hotplugin
    @hotplugin6 жыл бұрын

    Excellent intro with example

  • @channaly2772
    @channaly27725 жыл бұрын

    Awesome talk. Many thanks

  • @tormodkvalheim7214
    @tormodkvalheim72145 жыл бұрын

    Thanks, great video! :)

  • @KAWADESUMIT
    @KAWADESUMIT5 жыл бұрын

    Thank you for great information

  • @robycohen
    @robycohen6 жыл бұрын

    Awesome..! Thank you..

  • @sassynatan
    @sassynatan5 жыл бұрын

    one of the best!

  • @BritainRitten
    @BritainRitten6 жыл бұрын

    Helpful talk!

  • @gustavkullberg9842
    @gustavkullberg98425 жыл бұрын

    Great talk!

  • @sreenivasaraju4988
    @sreenivasaraju49884 жыл бұрын

    Nice presentation. Thanks

  • @muhammadtalha2363
    @muhammadtalha23636 жыл бұрын

    great explanation

  • @mowzeyluts1111
    @mowzeyluts11115 жыл бұрын

    awesome ,thank you

  • @shellac23
    @shellac235 жыл бұрын

    Great video!!!!

  • @SanthoshkumarNagulanchi
    @SanthoshkumarNagulanchi6 жыл бұрын

    Great tutorial....

  • @fredramos2343
    @fredramos23433 жыл бұрын

    Great video

  • @srik006
    @srik0065 жыл бұрын

    Excellent Presentation

  • @toenytv7946
    @toenytv79463 жыл бұрын

    Great job.

  • @bhanuprakash57
    @bhanuprakash577 жыл бұрын

    Thanks 😊

  • @SunnyG9
    @SunnyG96 жыл бұрын

    This is great

  • @jpwx
    @jpwx4 жыл бұрын

    When you want a good Kafka talk and the dude has the same damn name as you

  • @Luca1993x
    @Luca1993x6 жыл бұрын

    If you watch this on 1.25 times the speed, he and his movements look like a Sim-Character and its animations.

  • @kosterix123

    @kosterix123

    6 жыл бұрын

    could not resist.. indeed!

  • @srinivasinf

    @srinivasinf

    4 жыл бұрын

    nice comment, its good with 1.25

  • @staticage
    @staticage5 жыл бұрын

    Writes straight to disk might be a problem for anyone using virtual servers with attached storage.Latency would be a killer, not to mention the overhead of having multiple nodes, even with pagecache to socket enabled. Other factors also come into play e.g. log compacting etc

  • @xalfonso85
    @xalfonso855 жыл бұрын

    thanks

  • @jeffvoight6586
    @jeffvoight65864 жыл бұрын

    If a message gets a guaranteed commit to a leader, is it eventually guaranteed to make it to the quorum? If not, what happens to it?

  • @cliffmathew
    @cliffmathew5 жыл бұрын

    Thanks

  • @k.hemalatha4513
    @k.hemalatha45136 жыл бұрын

    Sound Introduction about Messaging system

  • @darshanaweerasingha653
    @darshanaweerasingha6535 жыл бұрын

    Great :)

  • @mvlad7402
    @mvlad74024 жыл бұрын

    very nice

  • @goverdhank
    @goverdhank5 жыл бұрын

    Excellent talk. By any chance, are thee slides shared somewhere ? Thanks

  • @JamesWard

    @JamesWard

    5 жыл бұрын

    Here you go: presos.jamesward.com/introduction_to_apache_kafka/#/

  • @CarlosEcheverriaOne
    @CarlosEcheverriaOne4 жыл бұрын

    Can we use consumer-groups on top of two Kafka Clusters, which are replicated using MirrorMaker? If yes, will Kafka warranty the "Exactly One Time Delivery" policy?

  • @videojeroki
    @videojeroki6 жыл бұрын

    i have frequently thousand of files to process. each files takes about 5min. Can kafka distribute thing king of process over computers on my lical network ?

  • @theCanadian808
    @theCanadian8086 жыл бұрын

    Where can I find the slides for this presentation? Thanks

  • @JamesWard

    @JamesWard

    6 жыл бұрын

    Here you go: presos.jamesward.com/introduction_to_apache_kafka/

  • @dengan699
    @dengan6994 жыл бұрын

    save time, watch at 1.25!

  • @IMMLF
    @IMMLF4 жыл бұрын

    Maybe a bit off-topic question, but how the presentation was made? Is there a tool for creating such presentations?

  • @JamesWard

    @JamesWard

    4 жыл бұрын

    I used Reveal.JS: github.com/hakimel/reveal.js/

  • @lhxperimental
    @lhxperimental4 жыл бұрын

    When talking about a new technology, it is best to stick to super conventional stuff around it - like the langauge and libraries. Don't mix Kafaka with Akka and a currently in fashion JVM language.

  • @thanhtranvan8113
    @thanhtranvan81135 жыл бұрын

    How did you make the car moving?

  • @JamesWard

    @JamesWard

    5 жыл бұрын

    The code for that is at: github.com/jamesward/koober/blob/master/webapp/app/views/driver.scala.html#L88-L107

  • @benmathews533
    @benmathews5335 жыл бұрын

    I'm confused. These comments seem to contradict each other: @40:34 - A source is something that produces events, and the sink is something that consumes the event. @44:58 - I create a plainSink which is... my sink is going to be the way that I get messages into Kafka. @45:34 - code comments: // sink is incoming driver messages // source is outgoing rider messages

  • @JamesWard

    @JamesWard

    5 жыл бұрын

    A sink in Akka Streams can receive messages which then get sent to Kafka. This gets tricky because in this example everything is bidirectional. There is a Kafka Sink and a Kafka Source. But also a websocket Sink and Source. Connected together like: Browser -> WebSocket Source -> Kafka Sink -> Kafka -> Kafka Source -> WebSocket Sink -> Browser

  • @AmeeliaK
    @AmeeliaK5 жыл бұрын

    Here's the code example he used: github.com/jamesward/koober

  • @iamabean
    @iamabean6 жыл бұрын

    Does anyone have the codes for this

  • @JamesWard

    @JamesWard

    6 жыл бұрын

    I think this is the sample I used: github.com/jamesward/hello-play-kafka

  • @kanaillaurent526
    @kanaillaurent5265 жыл бұрын

    Great but the use of the word "node" everywhere confuses me. It seams like one partition is a node, one consumer also is a node if I got it correctly. For him, node is a general term for defining a unity element.

  • @srinivas1363

    @srinivas1363

    4 жыл бұрын

    Hi kanail, here node is nothing but a Kafka broker server which actually maintains the copy of partitions.

  • @sebkafka6330
    @sebkafka63305 жыл бұрын

    I am a Kafka

  • @1ma4ighter
    @1ma4ighter6 ай бұрын

    hey American people, is this guy Californian? asking cos of his accent

  • @ninovalentino
    @ninovalentino4 жыл бұрын

    why he seems so high

  • @javierleguizamon7889
    @javierleguizamon78892 жыл бұрын

    ZNQ

  • @TheXV22
    @TheXV226 жыл бұрын

    is it me or is this guy really hard to listen to without losing attention?

  • @kosterix123
    @kosterix1236 жыл бұрын

    sorry, I fell asleep. Was it good?

  • @CepGamer
    @CepGamer3 жыл бұрын

    Интересная презентация, но боже мой, русские субтитры просто ужас. Query - корейцы?

  • @nguyen4so9
    @nguyen4so97 жыл бұрын

    This guy has never been in real world. Salesman only.

  • @SanthoshkumarNagulanchi

    @SanthoshkumarNagulanchi

    6 жыл бұрын

    Salesman opens ide??.... see at 43:59... if you say him as salesman for this demo.... LOL you are not an IT guy..

  • @superduck97

    @superduck97

    6 жыл бұрын

    Right.. and his reason for creating 370 repos on github was just to fool you. :)

  • @MrLinuxFreak
    @MrLinuxFreak Жыл бұрын

    jamieward45?

Келесі