What is Spark, RDD, DataFrames, Spark Vs Hadoop? Spark Architecture, Lifecycle with simple Example
Тәжірибелік нұсқаулар және стиль
This video covers What is Spark, RDD, DataFrames? How does Spark different from Hadoop? Spark Example with Lifecycle and Architecture of Spark
Twitter: / techprimers
Facebook: TechPrimers
GitHub: github.com/TechPrimers
Video Editing: iMovie
#Spark #BigData #TechPrimers
Пікірлер: 55
Thank you. Great explanation. Appreciate the effort.
Most useful video about spark I have seen so far, very informative. In short time covers all main idea of it. Much appreciated.
@TechPrimers
6 жыл бұрын
+Martynas Kir Thanks martynas
Content explaination and presentation is very nice.... Easy to get it..
very clear and simple explained .... thanks!
@TechPrimers
6 жыл бұрын
my pleasure kevin. Glad that was useful
Very nice! More videos plz.
Really Nice ... Thanks ...
Very nice explanation
Thank you very much! This is very helpful
@TechPrimers
7 жыл бұрын
+Eman Moussa Thank you Eman. Glad it helped you
Great video,wonderful presentation and to the point ,that's what everyone needs.Thanks a lot
@TechPrimers
6 жыл бұрын
Thanks Randeep. Glad that was helpful
@5:06 graphX, it's graphical(visualization) or graph related algorithms (storing, querying etc.)
thanks a lot, waiting for loading with java part.
very well explain spark please explain mlib and pyspark as well
hi friend your explanation is super ...
@TechPrimers
7 жыл бұрын
+Anjaiah Seggam thank you Anjaiah
@harjeetkumar9087
5 жыл бұрын
Here are some spark interview questions, if you are intrested kzread.info/dash/bejne/jJ2mxKtqY5ibcps.html
Can I do some action on data as part of map function?? Something like reading data from s3 and training a model using that data. sparkcontext.parallelize([[file1, file2], [file3, file4]]).map(function) here fuction will take s3 file objects as input and it will use that data to train a model and save that model to s3.
Thanks alot!!!
@TechPrimers
6 жыл бұрын
Thanks Hiten. Glad that was useful
Hello bro, Your explanation is flawless and amazing. Even though i knew spark, your video was well edited and crisp to the point. Will look forward for more videos from you. Thanks.
@TechPrimers
7 жыл бұрын
+kiran eranki thanks Kiran. Glad you liked it..
@harjeetkumar9087
5 жыл бұрын
Here are some more videos kzread.info/dash/bejne/jJ2mxKtqY5ibcps.html
Very nice
Simple and good
@TechPrimers
7 жыл бұрын
+Deepak Dhanigond thanks Deepak. Glad you liked it
Hi Sir, thank u for your good explanation. I want to know what all things i need to know before i start Spark because I am working as java developer with 1 year exp. and I have done work on front end like Angular , Bootstrap , J query , XSLT < HTML etc and web services like REST web services , Servlet , Spring MVC etc . So please provide guideline how to start learning spark because I want to learn this technology.
@TrackMyPhones
6 жыл бұрын
Unix and Scala is enough to start with Spark.
you have saved me :)
@SuperBhavanishankar
4 жыл бұрын
Namasthe! 🙏🏼
Best for a beginner like me
@harjeetkumar9087
5 жыл бұрын
Hi, here are some spark interview questions . kzread.info/dash/bejne/jJ2mxKtqY5ibcps.html
could you define what is a cluster computing and how it works in spark ??
@TechPrimers
6 жыл бұрын
Sure Eresh.
@harjeetkumar9087
5 жыл бұрын
Cluster computing is generic concept... spark is one implementation of this... hadoop is another etc... kzread.info/dash/bejne/jJ2mxKtqY5ibcps.html
Pease create series of apache spark
just like you created compilation of playlists for spring , do u have for spark ?
Still the session could have been better, no explanation on dataframes even still the video title has.
what s the difference between dataframes and dataset.. you didnt say pls
What is something like that.....
How can Spark replace Hadoop man? Did Spark have its own File System? . I think you are wrong about it. Spark always added advantage to Hadoop, its not a replacement.
@shakthivelcr7
Жыл бұрын
youre right
@shakthivelcr7
Жыл бұрын
I think he meant -> instead of using mapreduce on data present in hdfs, we use spark context and RDDs
DRR are depricated.
why ppl tell scala is more powerful than python in streaming sense?
I don't undertand