narrow and wide transformation in spark | | Operations in Pyspark RDD | Pyspark tutorials - 6

#PySpark
This is Sixth Video with a explanation of Pyspark RDD Narrow and Wide Transformations Operations.
i have covered below Transformations in this video:
Narrow : Map,Filter,flatmap,filter,sample,union
Wide : Intersection,Join,Distinct.
Stay tuned for Part 6 Video of Key Value Pair RDD Transformations in PYSPARK
BIG DATA IS PROBLEM and HADOOP IS A SOLUTION
Hit the Like button if you really liked the video.
Code is uploaded in to the Google Drive Link and Github link
Python Playlist: kzread.info?list...
AI PlayList: kzread.info?list...
Join Whatsapp Group for AI : chat.whatsapp.com/IB6fQBEcZAd...
Telegram Group : www.t.me/@MachineLearningIndia
Subscribe my Channel / ranjansharma
Google Drive: drive.google.com/drive/folder...
Github : github.com/iamranjan/youtube-...
*** Connect with me on below Channels ***
LinkedIn: / iamranjan
Medium : / iamranjansharma
Instagram : / iamranjan.sharma
Email : iamranjan.sh@gmail.com
Keep Practicing :-)
Happy Learning !!
#MachineLearning #Python #artificialIntelligence #dataScientist #DeepLearning #intelligence #BuisnessIntelligence #Ranjan #RanjanSharma
#Pyspark #SPark #ApachePyspark #apacheSpark #hadoop #bigData #MAPREDUCE #PysparkMachineLearning #installationonofPySpark #narrowVSWidetransformations #Pyspark

Пікірлер: 34

  • @marvhan888
    @marvhan8884 ай бұрын

    why everybody complaining about the speed. this is just perfect for me

  • @sanskarram992
    @sanskarram992 Жыл бұрын

    Your content is amazing for begineers.Thanks for such a wonderful content.

  • @RaviSahani-zc9zj
    @RaviSahani-zc9zj5 ай бұрын

    Best explanation for beginners. On KZread and Udemy.

  • @ishtigokak3526
    @ishtigokak35262 жыл бұрын

    hey ranjan amazing content... great job keep it up

  • @tesfayesusyimenu3292
    @tesfayesusyimenu32927 ай бұрын

    Superb explanation!

  • @rahulchawla6696
    @rahulchawla6696 Жыл бұрын

    nice explanation thank you

  • @pranjalgupta9427
    @pranjalgupta94272 жыл бұрын

    Thanks❤

  • @agyaatkavi
    @agyaatkavi9 ай бұрын

    Thanks :)

  • @ThaoHoang-ym9fu
    @ThaoHoang-ym9fu3 жыл бұрын

    Thank you for the comprehensive coverage. The speed is a little too fast to follow. Thanks again.

  • @RanjanSharma

    @RanjanSharma

    3 жыл бұрын

    Sorry about that I have decreased the pace in latest videos. thanks for exploring :)

  • @akzhere
    @akzhere3 жыл бұрын

    Could you please zoom-in on cells a little while running them for better visuals :) thanks!

  • @RanjanSharma

    @RanjanSharma

    3 жыл бұрын

    Sure will do in my further videos

  • @Ghumakkars_world
    @Ghumakkars_world3 жыл бұрын

    it would have been easy to go to next video if 2nd video link was provided at the end of the video as provided in earlier video's.

  • @RanjanSharma

    @RanjanSharma

    3 жыл бұрын

    ok I will do the same. Thanks for Exploring

  • @raghavagrawal6263
    @raghavagrawal62632 жыл бұрын

    Very nice lecture. The only request is to please speak a little bit slow means take a breath in between.

  • @infinioda108
    @infinioda108 Жыл бұрын

    Please please add few more videos, like a small project or something else.

  • @faizahmed9276
    @faizahmed92762 жыл бұрын

    whenever I'm applying the num lambda func it's shhowing error in Py4JJavaError Please help

  • @harshaharyani2501
    @harshaharyani25013 жыл бұрын

    What does seed in sample() transformation means?

  • @shubhamvashisth9518

    @shubhamvashisth9518

    3 жыл бұрын

    Seed is a random state, it can have any value but the notion behind using seed is, if you use the same seed for your experimentation, it will generate the same values while using random functionality.

  • @mindfulcreativity8613
    @mindfulcreativity86133 жыл бұрын

    I don't think coalesce requires shuffling

  • @RanjanSharma

    @RanjanSharma

    3 жыл бұрын

    yes Correct, Coalesce is Narrow transformation and Repartition is Wide Transformation

  • @Anokhetoons
    @Anokhetoons3 жыл бұрын

    y so fasstttttt??

  • @Ghumakkars_world
    @Ghumakkars_world3 жыл бұрын

    20:04 -- MS paint explaination of num - num2 & num2 - num is wrong... its just the other way around. (as we got the result in the jupiter notebook)

  • @RanjanSharma

    @RanjanSharma

    3 жыл бұрын

    I did not get you. i am getting the same answer on paint and jupyter notebook. i.e. 2,2,5,5,3 and 10,1,7,15. Please let me know if i am seeing other way. I might be wrong.

  • @FoodBoxByLalima

    @FoodBoxByLalima

    3 жыл бұрын

    ​@@RanjanSharma A-B means All elements of A which not present in B. so num -num2 = (5,5,3,2,2) similarly num2 -num = (1,7,10,15) in jupyter notebook num.separate(num2) means num-num2, so output is (5,5,3,22) which is different in your MS paint.

  • @sohammajumder4379

    @sohammajumder4379

    Жыл бұрын

    Yes.. I agree with you.. the paint explanation should be vice versa.. when you are saying num2 - num, num 2 is your parent and you should remove the common element between num and num2 from num2.

  • @phanikumar3136
    @phanikumar31364 жыл бұрын

    could u plzz attach notebook file

  • @RanjanSharma

    @RanjanSharma

    3 жыл бұрын

    Attached now ... drive.google.com/drive/u/1/folders/1yRsR1BsXJCcmmC5IOfexp2STFDL33gYL

  • @brijesh0808
    @brijesh0808 Жыл бұрын

    is it necessarily to be RDD @0:57 or dataframe can be considered here too?

  • @sivakrishna3413
    @sivakrishna34133 жыл бұрын

    Except speed. Everything is good. Explanation is too much speed

  • @RanjanSharma

    @RanjanSharma

    3 жыл бұрын

    thanks for your feedback ...I tried to keep the video length short. I will try to reduce the pace of the video.. Keep Exploring other Videos and Keep sharing to your friends and colleagues Join Whatsapp Group for AI chat.whatsapp.com/L3Zmt9XBa3UCccPfekYvXm Telegram Group : www.t.me/@MachineLearningIndia

  • @JD-xd3xp
    @JD-xd3xp3 жыл бұрын

    Dude, you are running too fast, are you racing against Rajdhani Express, you need to speak slowly.

  • @RanjanSharma

    @RanjanSharma

    3 жыл бұрын

    I have decreased the pace in my latest videos

  • @rajatsharma6137
    @rajatsharma61372 жыл бұрын

    I dont get the point of demo on single machine....if we are running it on local machine...what is the point of distributed computation paradigm? Please show a demo where several machines are used and then operations are carried on distributed data...

Келесі