PySpark | Session-9 | How spark executes a job internally | Stages and Tasks in Spark
#PySparkTutorials #stagesandtasks #WideVsNarrowTransformations #CleverStudies
In this video, we have covered the below topics,
How spark executes a job internally
Stages and Tasks
Type’s of Transformations
Narrow Transformations
Wide Transformations
Follow me on linkedin
/ nareshkumarboddupally
-----------------------------------------------------------------------------
Follow this link to join 'Clever Studies' official WhatsApp group:
chat.whatsapp.com/C70cGzAEKC1...
--------------------------------------------------
Follow this link to join 'Clever Studies' official telegram channel:
t.me/+eMaiZNWTPmZkYmVl
--------------------------------------------------
PySpark by Naresh playlist:
• PYSPARK BY NARESH
--------------------------------------------------
PySpark Software Installation:
• Latest Hadoop 3.2.2 Sp...
--------------------------------------------------
Realtime Interview playlist :
• How To Explain Project...
--------------------------------------------------
Apache Spark playlist :
• How Spark Executes A P...
--------------------------------------------------
PySpark playlist:
• PySpark | Tutorial-9 |...
--------------------------------------------------
Apache Hadoop playlist:
• APACHE HADOOP
--------------------------------------------------
Bigdata playlist:
• BIGDATA
--------------------------------------------------
Scala Playlist:
• SCALA TUTORIALS
--------------------------------------------------
SQL Playlist:
• SQL
Hello Viewers,
We ‘Clever Studies’ KZread Channel formed by group of experienced software professionals to fill the gap in the industry by providing free content on software tutorials, mock interviews, study materials, interview tips, knowledge sharing by Real-time working professionals and many more to help the freshers, working professionals, software aspirants to get a job.
If you like our videos, please do subscribe and share within your friends circle.
Contact us : shareit2904@gmail.com
Thank you !
Пікірлер: 17
thank you sir you explain very efficient way
Very good explanation ❤
Greate Explanation...Great Intention to inject the concept...👌👏
@cleverstudies
Жыл бұрын
Great comment Chaitanya. Thanq 🙏
Thanks for your efforts to Make us understand
@cleverstudies
Жыл бұрын
Thanks Suman.
Superb explanation 👌 👏 👍
@cleverstudies
Жыл бұрын
Thank you 🙂
Hi are u provide spark with scala in-depth course.?
Continue the series please
Excellent sir
@cleverstudies
Жыл бұрын
Thanks Abhi.
Was this last session?
I'm unable to join in WhatsApp group, it says group is full
@cleverstudies
Жыл бұрын
Okay. I will check it. Meanwhile you can join to the telegram channel.
Thanks for the explanation. But Sir I need one explanation , why the number of tasks will be 8 if the no of partitions is 2 , Total no of tasks = (no of tasks per stage)* no of stages = 2*2 =4
@andre__luiz__
8 ай бұрын
Hi! It's rdd's (4) x tasks per rdd (2) = 8 (total tasks)