What is Dynamic Partition Pruning in Spark

Ғылым және технология

What is partition pruning ?
What is static partition Pruning ?
What is dynamic partition pruning ?
How Spark optimizes queries using dynamic partition pruning ?
Spark Videos
All about Spark DAG : • All about Spark DAGs
Spark Architecture in 3 mins : • Spark Architecture in ...
How spark works internally: • How spark works intern...
10 frequently asked questions on Spark: • 10 frequently asked qu...
All about joins in Spark: • All about Joins in spark
Spark 3.0 Enhancements: • Spark 3 0 Enhancements...
Spark performance optimization Part 1: • Spark performance opti...
Spark performance optimization Part 2: • Spark performance opti...
Spark date time timestamp: • Spark Date Timestamp d...
Spark memory Management: • Spark Memory Management
Spark RDD, dataframe and dataset: • Spark APIs | Spark pro...

Пікірлер: 8

  • @mohan309
    @mohan309 Жыл бұрын

    This is bery helpful, thanks and keep up the good work.

  • @prasadj6370
    @prasadj63702 жыл бұрын

    Explained in detailed manner. Pros and Cons of Static Partitions pruning, with illustration. It's really really saves lots of time. To get same amount of knowledge one has to invest to read many pages and write sqls understand plans...

  • @BigDataThoughts

    @BigDataThoughts

    2 жыл бұрын

    Thanks Prasad

  • @raviiit6415
    @raviiit6415 Жыл бұрын

    on point, great presentation.

  • @BigDataThoughts

    @BigDataThoughts

    Жыл бұрын

    Thanks

  • @thedatacook1935
    @thedatacook19352 жыл бұрын

    The filter pushdown diagrams are wrongly placed.

  • @BigDataThoughts

    @BigDataThoughts

    2 жыл бұрын

    yes I have spoken about that in video

  • @SahilSharma-it6gf
    @SahilSharma-it6gf Жыл бұрын

    yrr ye hindi m nhi bta sakte ho kya kuch nhi smjh rha h baad ka

Келесі