Really awesome.. Understood the concept very clearly.. This is my first time on watching your video.. And subscribed in this itself.. Thank you so much for ur effort in giving this lecture in tamil..

Superb explanation sir, sounds clear. good job.

Thank you for the wonderful explanation. concepts are clear sir.

Awsome bro !!! Concept is clear and perfect👍👍

Very clear explanations about Hive Bro ❤ Thank you for sharing the knowledge 🙏🙏Vazga Vazamudan ☺️🙏👍

Hi Gowtham, U r Awesome teacher... Concepts are clear..

Crispy and clear explanation buddy keep upload more video

Super explanation... Really great

Clear explanation bro thank you😊

Hi Gowtham , Thanks! . For remote rdbms, we have to purchace another machine. Totally, slave nodes machine, master node machine and rdbms node machines. Am i right?

Vera vera level !!!

Bro you said HIVE don't have database then while inserting record again how it will store data in hive table ? Before moving the insert record to HDFS you said it will go into hive table

Sir, I learnt that Spark uses RDD and is RAM based unlike HDFS which uses hard disk. I am little confused here. Does it mean with the same infrastructure that is made up of hard disk , one cannot fully utilize the benefit of Spark and requires infrastructure change using RAM? Please correct my understanding gap

Well explanation bro

awesome expalnation bro

Super explanation

How we access the unstructure data? Is sperate technology for that.

You said about saving metadata outside of HIVE because HIVE is not having storage ?

Can you tell me the difference between command load, insert and import In detail?

Awesome explanation as always bro. The difference between embedded and remote metastore was clearly explained. I have a doubt, why to use RDBMS separately if we can store metadata in HDFS? Is there any limitation in HDFS to act as metastore?

@dataengineeringvideos

2 жыл бұрын

Thanks 🙂 And this is the exact reason The storage system for the metastore should be optimized for online transactions with random accesses and updates. A file system like HDFS is not suited since it is optimized for sequential scans and not for random access. So, the metastore uses either a traditional relational database (like MySQL, Oracle) or file system (like local, NFS, AFS) and not HDFS. As a result, HiveQL statements which only access metadata objects are executed with very low latency. However, Hive has to explicitly maintain consistency between metadata and data. Source - stack overflow

@serendipitous263

2 жыл бұрын

@@dataengineeringvideos wow got it! Thanks bro 😁

Super bro,is there any documents to Learn more?

Thank you bro for the wonderful videos, i have a question, Will the RDBMS spread across multiple nodes for HA?

@dataengineeringvideos

2 жыл бұрын

Exactly

Thank you bro

Awesome Brother, Usual 20 mins video do get bored, but your video is looking like a good movie, feels like this video don't get end likewise.. This is my first video on your channel, soon I am going to complete all the playlist bro..

@dataengineeringvideos

7 ай бұрын

So nice of you

Bro pls can you do it for impala?

How to check the metadata in RDBMS? If it is stored outside...

@dataengineeringvideos

3 жыл бұрын

For example , just login to mysql and execute show databases command , u will metastore_db this is where hive metadata will be stored

@gobi.tuk-tuk

3 жыл бұрын

@@dataengineeringvideos Thank you so much for the explanation bro...

Hive we can get only structure data, how we can see the relations of the tables and various keys ER relationship. Does hive provide DBMS managing solutions?

Why metadata in RDBMS why not in HDFS? sorry if you mentioned the reason in video.. not derby i mean

@giridharaneee

3 жыл бұрын

Hive stores metadata information in the metastore using RDBMS instead of HDFS. The reason for choosing RDBMS is to achieve low latency as HDFS read/write operations are time consuming processes.

@serendipitous263

2 жыл бұрын

@@giridharaneee Thanks, even i was wondering why to use RDMS separately if we can store metadata in HDFS itself. Your answer is convincing. Thank you.

Sqoop with hive Ku oru video podunga

@dataengineeringvideos

3 жыл бұрын

please refer this video kzread.info/dash/bejne/enWBk8yBktPKZpc.html

இதில் tez னு இருப்பது Google pay வா?

@dataengineeringvideos

2 жыл бұрын

no this is different one