What is Spark, RDD, DataFrames, Spark Vs Hadoop? Spark Architecture, Lifecycle with simple Example

Тәжірибелік нұсқаулар және стиль

This video covers What is Spark, RDD, DataFrames? How does Spark different from Hadoop? Spark Example with Lifecycle and Architecture of Spark
Twitter: / techprimers
Facebook: TechPrimers
GitHub: github.com/TechPrimers
Video Editing: iMovie
#Spark #BigData #TechPrimers

Пікірлер: 55

  • @dhivyaraj85
    @dhivyaraj855 жыл бұрын

    Thank you. Great explanation. Appreciate the effort.

  • @martynaskir7852
    @martynaskir78526 жыл бұрын

    Most useful video about spark I have seen so far, very informative. In short time covers all main idea of it. Much appreciated.

  • @TechPrimers

    @TechPrimers

    6 жыл бұрын

    +Martynas Kir Thanks martynas

  • @aashishpundir3019
    @aashishpundir30196 жыл бұрын

    Content explaination and presentation is very nice.... Easy to get it..

  • @kevinzhang8974
    @kevinzhang89746 жыл бұрын

    very clear and simple explained .... thanks!

  • @TechPrimers

    @TechPrimers

    6 жыл бұрын

    my pleasure kevin. Glad that was useful

  • @ted2101977854
    @ted21019778546 жыл бұрын

    Very nice! More videos plz.

  • @RohitLad
    @RohitLad6 жыл бұрын

    Really Nice ... Thanks ...

  • @rishisharma3910
    @rishisharma39106 жыл бұрын

    Very nice explanation

  • @emanmoussa673
    @emanmoussa6737 жыл бұрын

    Thank you very much! This is very helpful

  • @TechPrimers

    @TechPrimers

    7 жыл бұрын

    +Eman Moussa Thank you Eman. Glad it helped you

  • @randeepjohar5585
    @randeepjohar55856 жыл бұрын

    Great video,wonderful presentation and to the point ,that's what everyone needs.Thanks a lot

  • @TechPrimers

    @TechPrimers

    6 жыл бұрын

    Thanks Randeep. Glad that was helpful

  • @cs.beauty.debasis
    @cs.beauty.debasis5 жыл бұрын

    @5:06 graphX, it's graphical(visualization) or graph related algorithms (storing, querying etc.)

  • @sachinarora6111
    @sachinarora61116 жыл бұрын

    thanks a lot, waiting for loading with java part.

  • @ajaysamdyan
    @ajaysamdyan5 жыл бұрын

    very well explain spark please explain mlib and pyspark as well

  • @anjaiahseggam8703
    @anjaiahseggam87037 жыл бұрын

    hi friend your explanation is super ...

  • @TechPrimers

    @TechPrimers

    7 жыл бұрын

    +Anjaiah Seggam thank you Anjaiah

  • @harjeetkumar9087

    @harjeetkumar9087

    5 жыл бұрын

    Here are some spark interview questions, if you are intrested kzread.info/dash/bejne/jJ2mxKtqY5ibcps.html

  • @professoruma
    @professoruma7 жыл бұрын

    Can I do some action on data as part of map function?? Something like reading data from s3 and training a model using that data. sparkcontext.parallelize([[file1, file2], [file3, file4]]).map(function) here fuction will take s3 file objects as input and it will use that data to train a model and save that model to s3.

  • @hitenraheja4972
    @hitenraheja49726 жыл бұрын

    Thanks alot!!!

  • @TechPrimers

    @TechPrimers

    6 жыл бұрын

    Thanks Hiten. Glad that was useful

  • @kiraneranki5295
    @kiraneranki52957 жыл бұрын

    Hello bro, Your explanation is flawless and amazing. Even though i knew spark, your video was well edited and crisp to the point. Will look forward for more videos from you. Thanks.

  • @TechPrimers

    @TechPrimers

    7 жыл бұрын

    +kiran eranki thanks Kiran. Glad you liked it..

  • @harjeetkumar9087

    @harjeetkumar9087

    5 жыл бұрын

    Here are some more videos kzread.info/dash/bejne/jJ2mxKtqY5ibcps.html

  • @paramitamukherjee2162
    @paramitamukherjee21626 жыл бұрын

    Very nice

  • @ddhanigond
    @ddhanigond7 жыл бұрын

    Simple and good

  • @TechPrimers

    @TechPrimers

    7 жыл бұрын

    +Deepak Dhanigond thanks Deepak. Glad you liked it

  • @rishabh1671
    @rishabh16717 жыл бұрын

    Hi Sir, thank u for your good explanation. I want to know what all things i need to know before i start Spark because I am working as java developer with 1 year exp. and I have done work on front end like Angular , Bootstrap , J query , XSLT < HTML etc and web services like REST web services , Servlet , Spring MVC etc . So please provide guideline how to start learning spark because I want to learn this technology.

  • @TrackMyPhones

    @TrackMyPhones

    6 жыл бұрын

    Unix and Scala is enough to start with Spark.

  • @cogoden
    @cogoden6 жыл бұрын

    you have saved me :)

  • @SuperBhavanishankar

    @SuperBhavanishankar

    4 жыл бұрын

    Namasthe! 🙏🏼

  • @MultiRamboss
    @MultiRamboss5 жыл бұрын

    Best for a beginner like me

  • @harjeetkumar9087

    @harjeetkumar9087

    5 жыл бұрын

    Hi, here are some spark interview questions . kzread.info/dash/bejne/jJ2mxKtqY5ibcps.html

  • @ereshthekbr7659
    @ereshthekbr76596 жыл бұрын

    could you define what is a cluster computing and how it works in spark ??

  • @TechPrimers

    @TechPrimers

    6 жыл бұрын

    Sure Eresh.

  • @harjeetkumar9087

    @harjeetkumar9087

    5 жыл бұрын

    Cluster computing is generic concept... spark is one implementation of this... hadoop is another etc... kzread.info/dash/bejne/jJ2mxKtqY5ibcps.html

  • @atmiksoni5859
    @atmiksoni58592 жыл бұрын

    Pease create series of apache spark

  • @aneksingh4496
    @aneksingh44964 жыл бұрын

    just like you created compilation of playlists for spring , do u have for spark ?

  • @mutturajds2675
    @mutturajds26754 жыл бұрын

    Still the session could have been better, no explanation on dataframes even still the video title has.

  • @prashanthr130482
    @prashanthr1304823 жыл бұрын

    what s the difference between dataframes and dataset.. you didnt say pls

  • @akshaynangude2601
    @akshaynangude26014 жыл бұрын

    What is something like that.....

  • @rajeshhize
    @rajeshhize6 жыл бұрын

    How can Spark replace Hadoop man? Did Spark have its own File System? . I think you are wrong about it. Spark always added advantage to Hadoop, its not a replacement.

  • @shakthivelcr7

    @shakthivelcr7

    Жыл бұрын

    youre right

  • @shakthivelcr7

    @shakthivelcr7

    Жыл бұрын

    I think he meant -> instead of using mapreduce on data present in hdfs, we use spark context and RDDs

  • @no_more_free_nicks
    @no_more_free_nicks5 жыл бұрын

    DRR are depricated.

  • @avinash7003
    @avinash7003 Жыл бұрын

    why ppl tell scala is more powerful than python in streaming sense?

  • @MisterKhash
    @MisterKhash5 жыл бұрын

    I don't undertand

Келесі