Making sure in depth and quality content reaches everyone is what separates you from the rest, who are making money just by dwelling on the surface. The word "thanks" alone can't show the gratitude of many, including me, who gets benefited a lot. I hope this continues forever!!

Thanks Arpit, for making such videos. After watching couple of videos on internals of a database, including yours, I have started enjoying learning about how things work in the background. Thanks for your effort!

Instead of reading multiple blogs, going through your vlog saves time and brings interest back to the topic.

How creating GSIs will solve the 2 major problems 1. Shard is slow 2. Shard is dead

Hi Arpit Big FAN!! From your System design playlist where you explained about the database that was exactly asked me during the interview @ INDIA MART for Technical Lead Position seems like the interviewer and i studied from the same place😅 and from the microservices playlist many challenges were thrown in the Director of Engineering Round i was able to clear both the rounds because of your videos Thanks a ton !!!

@AsliEngineering

4 ай бұрын

this is such great news 🔥 Many many congratulations Shubham 🙌

Amazing. Nice detailed explanation!

Very well explained Arpit. Before watching this video, I was literally confused as to why Partion Key is always required to create a LSI. I understood the complete picture of it now 👌

Very well explained❤Learned something new today :) Gonna dig in a little deeper in this.

Thanks for this video, we too are planning to work on Sharding/Partition in few months and would love to take this project.

Absolutely awesome content!

fantastic video

Thank you so much!

Good video ❤

Sharding can be done in relational or non-relational databases but I think non-relational db are more preffered as they have less overhead for example performing a join operation on sharded db in kind of a nightmare, but since nosql is imperative you specify the join logic in the application code itself and handle it there. In a nutshell SQL has feature for join but it is hard to make sense when db is sharded , but nql has no such concept so sharding make sense there much ..

@sankuM

4 ай бұрын

what is meant by 'imperative' here? do NoSQL handle joins very differently?

awesome

Hi Arpit, thanks for explaining the concept. I have one question regarding global secondary index, what if the secondary attribute cardinality is very high like `created_at` kind of field? Will this sharding the index based on the value scale? I also need to read more about it, but would like to know your opinion.

is an LSI a separate object that the main data itself? Cant we sort the main data itself by author key and the secondary attribute? Meaning inside of each node, the data would be sorted by athor then the secondary attribute.

What I feel about your KZread Channel is, even if someone cannot afford your courses and still watches all the videos( which are FREE, btw! ) , they are more likely to ace the interviews.

@AsliEngineering

4 ай бұрын

yes. and also ace their career. it is just that I go slightly more practical and in-depth than this in my courses helping people build the right intuition.

Hey Arpit, Great content! Is there a video on distributed sequence generator?

I'm just curious here, what if in the global secondary index instead of row_id (or primary key), we are able to store the page_no (actual hard storage page no)? This will fasten up reads that include GSIs a bit as it essentially skips the step of querying into the data shard and can directly access data using the page number. I understand that the performance difference might not be huge but in some niche over optimized scenarios this might come handy. The downside I believe would be that index creation will take some more time, but imo that can be written off.

Which app do you use to write in an present in this (and other) videos? (in iPad) Thanks for the great content btw!!

Thanks

@AsliEngineering

4 ай бұрын

Thank you so much Rohit 🙌

In first case where we store blog_id(primary_key) in GIS, we will get the list for blog_ids when we try to get for a particular category. Then how will we get to know that in which db shard this blog id resides ? as the shard is based on author id.

@Raja-kl4op

4 ай бұрын

Hi Arpit, same doubt here, Could you please help us with this one.

@chinmaykhamkar7372

4 ай бұрын

+1

@makarandpundlik1083

4 ай бұрын

I think there is a confusion between author_id(which he told asa paritiion key) and blog_id (which we are assuming as a partition key).

@kelvingandhi4124

4 ай бұрын

+1 In that case, again there will be data collection from all DB shards and combining results as blog_ids are spread across multiple shards ! Don't see any difference from actually submitted query... 🤔

With Naive implementation, the DB routing layer was firing queries to both the shard and merging the results (scatter gather). how does GSI change that? even now the data still resides on data node. Routine layer will still have to fire queries to both the nodes. How does it solve anything?

@karanchatwani5180

3 ай бұрын

The first approach was querying the main shard with the category key which was not indexed, hence more latency. The second approach was querying the main shard with the primary key (user id) which is always indexed as it is a primary key, hence less latency.

Thanks for good explanation. But is it OK using sql for saving blog data? Isn't ok nosql. Which spesific database would you recommend to choose saving blog data?

@AsliEngineering

4 ай бұрын

SQL works like a charm. No need to unnecessarily go for NoSQL solutions unless your data becomes massive.

Start kaun sa video se karu system design?????

But how the global second index solves the problem that one of the shards is slow or dead???

@AsliEngineering

4 ай бұрын

It makes pagination and query efficient. If you store the complete data in GSI the. It removes the need to query the data Shards.

hey arpit where can i find the notes you are presenting, from all videos?