How JioCinema live streams IPL to 20 million concurrent devices w/ Prachi Sharma | Ep 7

Ғылым және технология

System Design for SDE-2 and above: arpitbhayani.me/masterclass
System Design for Beginners: arpitbhayani.me/sys-design
Redis Internals: arpitbhayani.me/redis
Build Your Own Redis / DNS / BitTorrent / SQLite - with CodeCrafters.
Sign up and get 40% off - app.codecrafters.io/join?via=...
Recommended videos and playlists
If you liked this video, you will find the following videos and playlists helpful
System Design: • PostgreSQL connection ...
Designing Microservices: • Advantages of adopting...
Database Engineering: • How nested loop, hash,...
Concurrency In-depth: • How to write efficient...
Research paper dissections: • The Google File System...
Outage Dissections: • Dissecting GitHub Outa...
Hash Table Internals: • Internal Structure of ...
Bittorrent Internals: • Introduction to BitTor...
Things you will find amusing
Knowledge Base: arpitbhayani.me/knowledge-base
Bookshelf: arpitbhayani.me/bookshelf
Papershelf: arpitbhayani.me/papershelf
Other socials
I keep writing and sharing my practical experience and learnings every day, so if you resonate then follow along. I keep it no fluff.
LinkedIn: / arpitbhayani
Twitter: / arpit_bhayani
Weekly Newsletter: arpit.substack.com
Thank you for watching and supporting! it means a ton.
I am on a mission to bring out the best engineering stories from around the world and make you all fall in
love with engineering. If you resonate with this then follow along, I always keep it no-fluff.

Пікірлер: 335

  • @mmmnmmmmmmmm
    @mmmnmmmmmmmmАй бұрын

    The only IPL thing I'm interested in

  • @youdontknowme2508

    @youdontknowme2508

    Ай бұрын

    The real IPL

  • @adityadubey5204

    @adityadubey5204

    Ай бұрын

    Haven't watched a single match this year 😅

  • @propavangameryt405

    @propavangameryt405

    Ай бұрын

    Me 2

  • @vatsalyavigyaverma5494

    @vatsalyavigyaverma5494

    Ай бұрын

    Same here, I guess they use lamda function with kubernetes

  • @rriiii

    @rriiii

    Ай бұрын

    GOAT

  • @ravikatiyar6530
    @ravikatiyar6530Ай бұрын

    Couple of very high level takeaways I could get from this podcast: 1. Keep all features behind a feature flag.This helps when you need to turn something off that's breaking production without doing a code release. 2. Wherever possible have a stand by setup like a static api that can keep your most business critical services up to ensure no customer/business impact in case a disaster strikes your system. 3. Run time auto scaling of DB capacity doesn't necessarily work for use cases like live streaming. You need to scale up before traffic surges. 4. Careful planning and back of the envelop calculation for all system components that are likely to get impacted by traffic surges. Like DBs, Kafka, CDN etc.

  • @harshitsaini7879

    @harshitsaini7879

    Ай бұрын

    Always have a plan b,c,d... in case something went wrong.

  • @zafraan3038

    @zafraan3038

    Ай бұрын

    any auto scaling almost never works for any kind of sale type event.

  • @nagkumar

    @nagkumar

    Ай бұрын

    @@harshitsaini7879 It is for this reason I say NFR are no more Non Functional, they are Functional Requirments from Day One for SaaS and Cloud Solutions.

  • @rakshitjayaswal3224

    @rakshitjayaswal3224

    29 күн бұрын

    not 20 million, it is 200 million

  • @ddhingra1991

    @ddhingra1991

    23 күн бұрын

    During the fire, disable resources for P2 & P1 for the p0 remain up

  • @debdanroy2396
    @debdanroy239628 күн бұрын

    The way Prachi broke down and explained the intricacies of scaling and load handling for high-traffic applications like JIO Cinema is truly commendable.

  • @factfry1191
    @factfry1191Ай бұрын

    Rule 1. If it works, leave it Rule 2. Preplan things Rule 3. Always assume that things will fail 100% and have backup ready Rule 4. Feature flags are superb In short, system design requires presence of mind and future planning (generally taking peak cases)

  • @sleep-404
    @sleep-404Ай бұрын

    The engineering behind the amazing stuff we get to experience in life is nothing less than magic! Thanks for making these podcasts happen Arpit

  • @prakashranjan5148
    @prakashranjan5148Ай бұрын

    Hey @arpit, can you get someone from IRCTC technical team who can get us understanding on Tatkal mechanism. I believe what Amazon, hotstar, jiocinema do in their seasons(be it ipl, billion day sale etc) irctc handles far more requests on daily basis during Tatkal.

  • @aviiiiiiiiiiiiiiiiiiii

    @aviiiiiiiiiiiiiiiiiiii

    Ай бұрын

    +1

  • @pankajmishra5139

    @pankajmishra5139

    Ай бұрын

    😂😂😂 +999999

  • @amitrawat5847

    @amitrawat5847

    Ай бұрын

    🤣🤣🤣🤣🤣

  • @sanrock21

    @sanrock21

    25 күн бұрын

    boss 5 crore or 10 crore people use the app or more.. during match, how much do you think IRCTC on Tatkal time?

  • @FakeIntellect

    @FakeIntellect

    24 күн бұрын

    +1

  • @jotrades26
    @jotrades26Ай бұрын

    Can we take a moment to appreciate the engineers involved in this, they stretch their time , compromise connections with their families for us to have a seamless experience, it’s a long work for 2 months and hope they deserve necessary appreciation and bonuses for their time. Yes , tech is just one aspect, but I hope asking questions like how the team is able to manage the work load is also very important.

  • @diwakarisonyoutube
    @diwakarisonyoutubeАй бұрын

    Thanks Arpit for bringing such content. I look for these podcasts with seniors engineers. Cheers 🎉

  • @aimusicvibes
    @aimusicvibesАй бұрын

    Feature flag (keeping in config service, based on geography), Charles testing tool, Exponential backoff for API retries, Request flow ( client -> Multi CDN -> LB -> Origin server -> DB), DB autoscaling is not recommended (takes lot of time 45 mins from her example for scaling 5 instances) (prescale is recommended after some calculations), Increasing TTL of caches when there's a hockey spike (can or cannot help), API personalization (serving static response when having this hockey spikes), Always Prepare for plan B,C,D, Multi CDN Optimizer (decides where to send the traffic, used for live streamings), Cache Offload Designing cache policy in CDN is important (offloading cache monitoring), Kafka, DNS issue mitigation at backend,

  • @hrishiksancheti110

    @hrishiksancheti110

    27 күн бұрын

    thankss

  • @praneetrane2993

    @praneetrane2993

    15 күн бұрын

    Thanks mate

  • @jayvasant114
    @jayvasant114Ай бұрын

    Feels like review version of OG old Hotstar scaling to 25 million talk by Gaurav Kamboj Thanks for bringing this for us Arpit!

  • @abdulashiq2173

    @abdulashiq2173

    Ай бұрын

    Prachi is an ex-Hotstar engineer 😅

  • @RwikKumarDutta

    @RwikKumarDutta

    Ай бұрын

    Ya so many of these things seemed similar to that hotstar video, its like a lot of the same legacy but under a different company

  • @bestviralvideosclips

    @bestviralvideosclips

    26 күн бұрын

    @@RwikKumarDutta Most of the devs in JioCinema are from Hotstar...

  • @mach-7260
    @mach-7260Ай бұрын

    The ad insertion part was quite interesting for me, I did not realize that even the ads that we see during the games could be personalized and inserted based on different strategies. SCTY-35 markers was something completely new to me. The guest really had an end to end grasp of the whole solutions and was able to present a very coherent picture. Loved the podcast :)

  • @prashanthvaidya5220
    @prashanthvaidya522025 күн бұрын

    Watched this during my weekend run! What an amazing conversation- the passion that you both have for engineering is so inspiring. 🙏🏻

  • @pranavtiwari9948
    @pranavtiwari9948Ай бұрын

    Thank you to both of you. Lots of health and happiness to you and your family. It was just awesome.

  • @user-pq6xi2bb9o
    @user-pq6xi2bb9oАй бұрын

    Amazing video Arpit! Thanks.

  • @arjunnayak9088
    @arjunnayak9088Ай бұрын

    Great to see someone really know what they are talking about.

  • @casinarro
    @casinarroАй бұрын

    Thank you Prachi! You have a very sound knowledge and a great way of explaining all of it in simple words.

  • @rishushrivastav4591
    @rishushrivastav459126 күн бұрын

    Great insights, mostly when you see these kind of things people throw around standard fancy terminologies, but here its just from pure experience, deciding on base64, multiplication factors, one small change * the number of API requests etc... Enjoyed watching this.

  • @naruto5437
    @naruto5437Ай бұрын

    crazy how at very young age she is a director of engineering of company like jio/viacom and she is from normal college

  • @ancient.sanatani

    @ancient.sanatani

    Ай бұрын

    Might be a possibility that jio decided to have at least one female director, so hired her on low salary. Just an assumption. Beacuse there are many ofher IITians out there why they hired from normal college?

  • @yashsolanki069

    @yashsolanki069

    Ай бұрын

    She had prior experience with such engineering design in hotstar. So here is the niche that takes priority over the age factor.

  • @Avishwarup

    @Avishwarup

    22 күн бұрын

    ⁠@@ancient.sanataniirrespective of that, she was superb. Incredible communication and she must be a very valued person ! 👏🏼👏🏼

  • @coderkashif
    @coderkashif29 күн бұрын

    Amazing podcast....the engineering behind all this is mind blowing

  • @justlc7
    @justlc7Ай бұрын

    Thanks Arpit , this is gold tier!! Pls do more such videos.

  • @sidharthvyas7870
    @sidharthvyas7870Ай бұрын

    Learnt alot, thnx Arpit & Prachi.

  • @utkarshnagpure3034
    @utkarshnagpure303428 күн бұрын

    Amazing Podcast, Such Brilliant minds working in harmony no less than magic!!

  • @soumiyamuthuraj3516
    @soumiyamuthuraj3516Ай бұрын

    Kudos to you, Arpith, seriously no fluff, pure engineering ❤

  • @AbhishekKumar-xr1ss
    @AbhishekKumar-xr1ssАй бұрын

    "ISP" : That guess by Arpit at 38:18 gave me goosebumps 🫡

  • @kallyansingha3772
    @kallyansingha3772Ай бұрын

    Amazing discussion ! love it

  • @heyhelloitsme
    @heyhelloitsme18 күн бұрын

    Excellent discussion. Very apt questions and deep routed knowledge answers.

  • @peeyushdmishra
    @peeyushdmishraАй бұрын

    This is awesome discussion, thank you Arpit.

  • @ItiShruti
    @ItiShrutiАй бұрын

    Really enjoyed this episode ..

  • @TourYatri
    @TourYatriАй бұрын

    Thanks Arpit . Such a informative video i found first time. Keep bringing this type of content

  • @mzubair10
    @mzubair10Ай бұрын

    Prachi explained it really well, great questions

  • @MohitSharma-bz1ft
    @MohitSharma-bz1ft28 күн бұрын

    Very informative podcast. Thanks for bringing it up. Kudos to you guys

  • @aavishkarmahajan6114
    @aavishkarmahajan6114Ай бұрын

    Amazing podcast. It was great to get an idea of how things go on behind the scenes. Thank you Arpit for such insightful podcasts

  • @manikantapunnam1189
    @manikantapunnam11895 күн бұрын

    Loved this discussion. Very Helpful ❤

  • @sauravjha2933
    @sauravjha2933Ай бұрын

    Great podcast, Arpit and Prachi! Thank you so much.

  • @girijamohanty8445
    @girijamohanty844526 күн бұрын

    loved this podcast very much. The standards and tricks mentioned are very nice

  • @justMRV
    @justMRV25 күн бұрын

    Real time Problems and Solutions they come up with... These are really useful podcasts. Thanks to her.

  • @hrs4real386
    @hrs4real386Ай бұрын

    Really valuable for those who do not know how much work it takes to run the streaming platform.🔥

  • @RS-vu5um
    @RS-vu5umАй бұрын

    Excellent Discussion. Lot to learn.

  • @kumardeepam
    @kumardeepam23 күн бұрын

    Very insightful man. Thank you for sharing 🙏

  • @user-fi1vj7dl6p
    @user-fi1vj7dl6p19 күн бұрын

    by far the best one with so much problem statements and explained in a nice and proficient manner

  • @arjunk856
    @arjunk85625 күн бұрын

    Key notes: Feature flags, Circuit breaker pattern, APM, Kubernetes, Client Caching, Multi cdn optimiser, Cache offload, Kafka distributed system, Ads timing is manual, Ad personalisation is on the server side.

  • @tarunkumar-pf9bn
    @tarunkumar-pf9bnАй бұрын

    This is great. Thank you bringing this up.

  • @prabinkumarbaniya
    @prabinkumarbaniyaАй бұрын

    Its so interesting to watch these amazing engineering working at such a high scale

  • @rohanzade4972
    @rohanzade497225 күн бұрын

    wow! In 45 minutes lot of things got to be understood, thanks for this session.

  • @aakashparmar560
    @aakashparmar560Ай бұрын

    Great podcast ! Learned so many new things today.

  • @ayushtiwari4686
    @ayushtiwari4686Ай бұрын

    This reminds me of my days in Myntra during EORS and BFF I know scale is very less but such events requires lot of planning and enthusiasm

  • @kritibindra4232
    @kritibindra4232Ай бұрын

    Loved this! Some interesting stories were shared. Keep them coming Arpit☺️

  • @abhiimali
    @abhiimaliАй бұрын

    interesting.... thanks to both of you.

  • @rajsrisg
    @rajsrisg19 күн бұрын

    Wonderful video Arpit. Prachi was amazing in her explanations. Great asset to JioCinema.

  • @yashgarg4248
    @yashgarg4248Ай бұрын

    Amazing session Arpit, it was a dream to know such system from a person who knows so ins and out of it. Thanks for being curious Engineer 😊

  • @XP20213
    @XP20213Ай бұрын

    Thanks Prachi for letting us know the engineering behind the massive level of scaled system…

  • @Shivani-hello
    @Shivani-helloАй бұрын

    Awesome, having worked in Jio as a backend engineer, I really enjoyed watching this!

  • @user-zw1pd8rm6e

    @user-zw1pd8rm6e

    Ай бұрын

    Hey what was the questions asked for fresher role ?

  • @vishadjain2696
    @vishadjain2696Ай бұрын

    Thanks arpit, for the amazing insights.

  • @sridharaddagatla
    @sridharaddagatlaАй бұрын

    Thanks Arpit and Prachi. Interesting questions covering end to end flow and very well put in-depth answers. Looking forward to the next episode! One question on personalized Ads insertion: * Why can't we pre-determine personalized Ads for a user in advance and play them during the break? I think bucketing a user based on certain user parameters is a good work around for now. pros: * More personalization (More revenue) * Not much time is spent on choosing an Ad: Since we would already have a list of Ads to pick from, there will not be much time waste to select an Ad during break. cons: * Waste of compute/memory resources to personalize Ad for a user who never watches the stream till they get to Ad break. Some more follow up questions: * How we can know more about user? This brings more number of Advertisers on the platform. * Can we add Ad bidding in this high concurrency streaming situation. Following is another interesting question for me to dive deep: * How can we show a particular Ad to exactly 'X' number of people? i.e. No over delivering or under delivering.

  • @priyaaditi4147
    @priyaaditi414727 күн бұрын

    Loved this podcast. Please bring more like this.

  • @raj_kundalia
    @raj_kundalia12 күн бұрын

    Thank you for doing this!

  • @SowrenSen
    @SowrenSen29 күн бұрын

    Very useful insights, great podcast. 👍

  • @Codetutor-DemystifyCoding
    @Codetutor-DemystifyCodingАй бұрын

    Brilliant discussion - "Dhoni ke side effects on Content streaming architecture" would have been perfect title. Thanks for bringing this.

  • @anuragsengupta2880

    @anuragsengupta2880

    27 күн бұрын

    Don’t make everything about that middle aged credit hungry manipulator.

  • @prabaljain5462
    @prabaljain5462Ай бұрын

    Thanks Arpit, Excellent Session Curiosity++

  • @ankurchaudhary9507
    @ankurchaudhary9507Ай бұрын

    Loved the term "Brace for impact" made me smile, kudos to such highly available architecture. Way Prachi explained things in detail hats off!! Thanks @arpit for bringing this podcast!! Loved it♥

  • @suryadev99
    @suryadev99Ай бұрын

    Great podcast, Arpit and Prachi! Loved it

  • @highnitin
    @highnitinАй бұрын

    Loved the insights :) good one ❤

  • @vibhavaribellutagi9738
    @vibhavaribellutagi973824 күн бұрын

    Man!! What an amazing podcast ❤ no useless talks, every point was clear though I’m a data engineer, not everything topics discussed we work on. Please do more such podcasts 🎉

  • @rajeshdevhelp
    @rajeshdevhelpАй бұрын

    great Thanks Arpit. Would love to see more videos like this. It will be great if can get series of videos like this.

  • @rajesh_singha7
    @rajesh_singha725 күн бұрын

    Thanks a lot for sharing insights with us.

  • @nageshtemp
    @nageshtemp26 күн бұрын

    glad to hear that chaos engineering is being used by large infrastructures to ensure resiliency of the systems

  • @dhurontor
    @dhurontorАй бұрын

    Lot of good insights from the podcast. Thanks Prachi & Arpit. :)

  • @hashimabbas2508
    @hashimabbas2508Ай бұрын

    Excellent work, Arpit. This is gold tier content.

  • @ankitdubey9310
    @ankitdubey9310Ай бұрын

    The best thing I have watched this month

  • @priyaranjankumar_
    @priyaranjankumar_Ай бұрын

    Amazing details

  • @kyllex1901
    @kyllex1901Ай бұрын

    Thanks for the amazing content! Learnt a lot!

  • @Namesake..
    @Namesake..Ай бұрын

    This was an amazing interview. Thank you for this 🎉

  • @madhavdhungana
    @madhavdhungana22 күн бұрын

    Really enjoyed watching this episode

  • @vaibhavsharma224
    @vaibhavsharma22415 күн бұрын

    really a great conversation between u guys ,learned a lot and still there are many things i dont know,but sounded interesting to me.

  • @HusainSyedAli
    @HusainSyedAli19 күн бұрын

    What a session🎉, lot more details in a less time, we wish more these kind of sessions across all other company cloud operations, thanks Team, great job.

  • @prashanthgurunath1703
    @prashanthgurunath1703Ай бұрын

    This is a great podcast. I am a senior backend engineer in the UK and I found this to be very useful. Thanks for the content. PLease make more videos :)

  • @pavanMudavath822
    @pavanMudavath822Ай бұрын

    great work MAN!

  • @dhruvthakkar2103
    @dhruvthakkar2103Ай бұрын

    Great Podcast! Learnt a lot in this

  • @guytonedhai
    @guytonedhaiАй бұрын

    Thank you Arpit for bringing in such content.

  • @pranjalsoni1819
    @pranjalsoni1819Ай бұрын

    It is so beautiful that the streaming platform does have many bottlenecks and they have many ways to mitigate according to the failures they faced or they may face. Thanks for enlightenment Arpit❤

  • @ashishtiwari5483
    @ashishtiwari548325 күн бұрын

    such a informative video😳

  • @ajithprakashan8019
    @ajithprakashan801929 күн бұрын

    Great conversation ❤

  • @priyabratapradhan000
    @priyabratapradhan00026 күн бұрын

    Very nice conversation❤

  • @kushteppalwar1678
    @kushteppalwar167822 күн бұрын

    Great content please keep on making such videos

  • @itxmepankaj8158
    @itxmepankaj8158Ай бұрын

    it is so much to learn from these podcasts

  • @visheshdubey6204
    @visheshdubey6204Ай бұрын

    Thanks for bringing up such raw and real engineering convo! More interesting than IPL

  • @GoProIndia
    @GoProIndiaАй бұрын

    As always, amazing podcast Arpit!

  • @SahilBhosale08
    @SahilBhosale0819 күн бұрын

    Thanks for this amazing podcast , this is the best content and best insights

  • @jagrukstudents8588
    @jagrukstudents858810 күн бұрын

    Very great podcast...Please make a part 2 on the ADs part talked about at the end

  • @xikusyaa
    @xikusyaa24 күн бұрын

    Why i wasn't aware of this channel before, amazing content!

  • @kapilchoudhary2922
    @kapilchoudhary292227 күн бұрын

    Great video!

  • @jignesh_c30
    @jignesh_c30Ай бұрын

    Amazing session 🔥🔥

  • @hammad8954
    @hammad895425 күн бұрын

    Didn't know Dhoni would have such an impact on their infra 😂

  • @10suryakiran
    @10suryakiranАй бұрын

    KiHi, it was a nice conversation with perfect blend of tech terms. Thank you Arpit Bhayani and Prachi Singh.

  • @komalkungwani4625
    @komalkungwani4625Ай бұрын

    Great content 🎉 nice learnings

  • @shreyachandak5169
    @shreyachandak516929 күн бұрын

    Gem of a podcast! Loved it! Just a small suggestion, please ping for more real time examples when the speaker is briefing about particular part of application or explaining any backup procedures, giving out more use cases just helps in connecting better, even for newbie like me!! Overall was a interesting talk!

  • @joobis.b4568
    @joobis.b4568Ай бұрын

    this was really good

  • @abhilashm3278
    @abhilashm3278Ай бұрын

    Really liked how Arpit instantly isolated the issue and asked if it with the ISP.

  • @siddharthmishra1061
    @siddharthmishra106127 күн бұрын

    Thanks Arpit Sir, for doing system design PODCASTS! with actual engineers. I mean this is such a good concept, I hadn't thought was possible, and you are making it happen. The guest was really good, got to learn a lot about system design just by listening to this podcast. Good quality content 👍 keep making for us.

  • @vybhaveswaraiah7114
    @vybhaveswaraiah7114Ай бұрын

    This is awesome

Келесі