Gen AI Course | Gen AI Tutorial For Beginners
This Gen AI tutorial for beginners is sort of like a Gen AI mini-course where a person can start learning the fundamentals of Gen AI and in the end, we build two end-to-end projects. Below is the outline of the exact topics that are covered.
Code for project 1: github.com/codebasics/langcha...
Code for project 2: github.com/codebasics/langcha...
LangChain source code: codebasics.io/resources/langc...
Vector database article: www.pinecone.io/learn/vector-...
00:00 Overview
00:29 What is Gen AI or Generative AI?
01:23 Gen AI evolution
10:00 What is LLM (Large Language Model)?
13:55 Embeddings, Vector Database
21:24 Retrieval Augmented Generation
28:16 Tooling for Gen AI
29:14 Langchain Fundamentals
1:14:49 End-to-End Project 1: Equity Research Tool
2:28:25 End-to-End Project 2: Retail Q&A Tool
Do you want to learn technology from me? Check codebasics.io/?... for my affordable video courses.
Need help building software or data analytics/AI solutions? My company www.atliq.com/ can help. Click on the Contact button on that website.
🎥 Codebasics Hindi channel: / @codebasicshindi
#️⃣ Social Media #️⃣
🧑🤝🧑 Discord for Community Support: / discord
📸 Codebasics' Instagram: / codebasicshub
📝 Codebasics' Linkedin : / codebasics
------
📝 Dhaval's Linkedin : / dhavalsays
📝 Hem's Linkedin: / hemvad
📽️ Hem's Instagram for daily tips: / hemvadivel
📸 Dhaval's Personal Instagram: / dhavalsays
🔗 Patreon: www.patreon.com/codebasics?fa...
Пікірлер: 155
OpenAI has stopped issuing few credits. You have two options (1) By spending less than 5$ on openai API, you can complete this project. You will learn a valuable skill by spending money that may be less than what you spend in a restaurant for a dinner. (2) Use LLama 3 etc open source model in groq.com or do the project using google gamma or palm models (the second project has relevant information on that). To learn AI concepts in a simplified and practical manner check our course "AI for everyone": codebasics.io/courses/ai-for-everyone-your-first-step-towards-ai
@UtkarshAnand-kh8vi
27 күн бұрын
M about to get my salary and with it i first want to learn power bi , I will buy ur power bi 2,700 rs course in few days . Plz help me in that after completely understand power I'll buy this one. I trust u man , u r the correct person to guide youth.
@KariBouss-ki8cb
26 күн бұрын
Hiiiiiiii sir .i have just known your channel . I have qst plzzzf i need help .im pharmacist specialized in biochimistry médicale and moléculer génitics .is master in data science in usa good idea or nooo plezzz in need your advice 😢❤
@ShreepatiHere
24 күн бұрын
Hi Dhaval, Thankyou so much for this tutorial. I am currently doing 2nd project (Retail Q&A Tool) When tried to execute in jupyter notebook, getting this error: "Retrying langchain.llms.google_palm.generate_with_retry.._generate_with_retry in 2.0 seconds as it raised RetryError: Timeout of 60.0s exceeded, last exception: 503 failed to connect to all addresses; last error: UNKNOWN" But, when tried to run curl in postman getting proper response. Could you please help me to fix this 503 failed to connect to all addresses issue. Thank you.
so far the best explanantion I heard on LLM. Thanks for all your hardwork in these videos.
The way you explain everything thing more effectively is really good
sir your way of explaining things with examples is mindblowing , never seen anyone teaching like this before , absolutely amazed . thank you for this course 🙏🙏
I come from a Non-IT background and have found myself delving into the fascinating world of programming and cutting-edge technologies. Thanks to the invaluable guidance and tutorials by Dhawal Patel, I've been able to not only grasp but also teach Python, Java, and delve into complex domains like Machine Learning. Currently, my focus lies in research within bioinformatics, where I utilize deep learning and NLP techniques. I owe a tremendous debt of gratitude to Dhawal Sir, whose teachings have been instrumental in shaping my journey. Without his insightful tutorials and unwavering support, I wouldn't have dared to dream of venturing into these domains. My deepest respect and appreciation go out to Dhawal Sir for his mentorship and guidance.
Wow - you did such an awesome job producing this video! superb explanations and video production. Thanks for making this
Thanks for this detailed video sir.. this was my first video watching on GenAI, this video has given initial confidence about basic info already…Tks a ton 🙏
love the way you explain everything
Insanely Great Dhaval sir, waiting for more on Gen AI!
You are just awesome. Your teaching techniques are mindblowing i mean i dnt need to much stress my brain very smooth explanation awesome
Wowed. Thanks for your teaching. It is so useful for me. I have used generative AI for a long time, but your explaination makes me clarify my thoughts.
it was a fast track study. Great content !
Thanks for the wonderful explanation
Hermano muy interesante, sigue adelante y agradecido por compartir tus conocimientos, saludos desde Peru!
Amazing content. Thanks for this video.
Thankyou so much sir for this course❤🙌🏻
congratulation on 1 million subscriber
thank you for this peace of art!
56:34 Thanks for the tips. It was much needed.
Great Content Dhaval bhai! 👌🏻
Really nice video, thank you for the hard work 👍
Waiting for your videos on LLM ❤
Thank you sir for prepare such informative video on Gen AI, GPT model etc..❤
@codebasics
Ай бұрын
Glad you liked it
Thanks man..God bless..saved me so much time..
You make LLM, Langchain super easy👍
Great Tutorial💯 on GENAI.
thanks for amazing content
Great explanation
I am waiting for your videos and at last get this
great course , thanks for sharing
some warnings are coming ,as the code in course compatible with earlier version. please provide the updated code. because after some time the code will stop working as well.
You sound like the GFG founder Sandeep Sir ...He is my fav mentor
Excellent.
Thank you bro.
good one thanks. keep it up
Thanks bhaiya ❤🎉
Thanks man
Thanks for this. Can u do one on CrewAI ?
00:01 Overview of Generative AI 02:31 Evolution from statistical ML to deep learning with neural networks 07:30 Transformers have led to a variety of powerful AI models. 09:59 Buddy is a stochastic parrot with mimicking ability and statistics-based predictions. 14:58 Understand Vector database and semantic search 17:21 Word to numeric representation using word embeddings 21:29 Retrieval Augmented Generation (RAG) allows fine-tuning or building AI models on specific data sets. 23:48 Using GPT-3 for querying data sources 28:24 To work with Gen AI, you need models, cloud services, and frameworks. 30:27 LLM based application using OpenAI API 34:36 Creating separate keys for different projects and managing them securely 36:55 Using LLM to generate creative restaurant names based on cuisine preferences. 41:33 Implementing Simple Sequential Chain concept in Gen AI Course 44:00 Using sequential chains to get both restaurant name and menu items in Gen AI Course 48:44 Setting up Streamlit for application development 51:15 Using response data to display restaurant name and menu items in UI 56:13 Practice coding while watching the video 58:22 Gen AI has a reasoning component for answering questions beyond its knowledge 1:02:48 Using Gen AI to retrieve information about Elon Musk's age in 2023 1:05:11 Initializing environment variables and using AI tools in an agent. 1:09:49 Using conversation chain to optimize cost and memory 1:12:15 Optimize OpenAI token cost by limiting conversational buffer memory 1:16:39 Research analysts provide detailed stock research for companies like Tata Motors and Reliance. 1:18:42 Importance of building a specialized tool over using Chat GPT 1:22:52 Using semantic search for finding relevant text chunks 1:24:56 Utilizing Vector databases for faster search and retrieval 1:29:05 Installing and loading Lang chain library in Jupyter notebook 1:31:39 Providing explanation about the movies.CSV file contents. 1:36:25 Text splitting and merging for efficient processing 1:38:35 Using Lang chain provides a simple API for text splitting. 1:43:22 Text splitting process using separators and size constraints 1:46:05 Gen AI Course explains recursive text splitter and merging for chunk optimization 1:50:23 Demonstration of using libraries to convert text into vectors 1:52:42 Using meditation and yoga to improve mental health with vector representation 1:57:30 Gen AI performs semantic search to provide results based on context, not just keywords 1:59:42 Retrieval QA with Sources Chain 2:04:06 Creating open API embeddings for document retrieval 2:06:39 Using a Vector database and creating a retrieval chain for text analysis. 2:11:06 Assembling the final project with pre-built individual pieces 2:13:10 Loading environment variables and creating basic UI in Gen AI module 2:18:20 Saving data in memory and displaying progress 2:20:46 Setting up Vector database and creating retrieval QA chain in Python 2:25:43 Automated news research tool for equity analysts 2:27:53 Utilizing vector databases for storing embeddings in large projects 2:32:07 Utilizing Google Palm and SQL Database Chain in Lang Chain Framework 2:34:10 Introduction to Vector Database and Google Palm for AI applications 2:38:14 Explaining the t-shirt records and database setup 2:40:45 Setting up a SQL database object with URI 2:45:40 Understanding the importance of correct database mapping for accurate results 2:48:17 Learning to run and manage queries in DB Chain 2:53:13 Summing of stock quantities for white color t-shirts 2:55:42 Storing data into arrays and using Hugging Face embedding for generating embeddings 3:00:34 Vector store converts input questions into embeddings for similarity matching. 3:02:52 Import SQL prompt template to generate queries. 3:07:42 Enhanced querying functionality with additional parameters 3:10:00 Creating a streamlit UI with few lines of code 3:14:54 Creating a main function in Python and running SQL queries in a database chain 3:17:27 Using Streamlet to ask and answer questions efficiently Crafted by Merlin AI.
Please do a course on AIOps.
at the 37:24 , displayed code i tried, but got an error that your 5$ limit is out of bound, and on openai it shows i used 0$ and i followed each and every step now i feel like i am not build for coding
Should we create the few shot (question, query, answer value ) list manually? Or can we generate these too using llm? I mean similar statements using llm? Also, how many samples should we add ?( My question is about the contents of few_shots array)
so this is my into to genai, what should someone go for after completing this course.like should i go on and make projects with diff models or should i go on and learn core ml..(more interested in the genai space)
sir can you give topics to explore in llms for eg: in ml and dl we focus on gradient descent like topics...what to focus in llms?
Great content..!! Please make an end to end project using pinecone vector DB
@codebasics
Ай бұрын
Yes. Point noted 👍
@harshjha6774
Ай бұрын
@@codebasics yes sir , we really need it , till when can we expect a video on this?
Hi! Can i join data analyst boot camp now or like is there any other date to join for a new batch?
wow it is very interesting tutorial
I have run the codes but shows as module errors and are deprecated. How to fix this?
to_vectorize = [" ".join(example.values()) for example in few_shots] to_vectorize Here is an error occured, sequence item 3: expected str instance, dict found. could any one of the team look over in it, so that it can help other students while accessing the code.
lab magic is not available for windows . what is the replacement for this
Amazing
what other project ideas we can do based on this ? It would be helpful if you suggest any ..
how to install the modules. Does jupyter notebook has a terminal of its own?. Coming from a non Cs background, Kindly help
Post more Gen Ai tutorial and continue it
I've a simple question! How does llm decide that the data it has do not contain answers to the questions asked by the user? As an example, in your equity research project, let's say I asked for the stock price of a company whose data is not present in the links I provided, how will llm decide that it has no answer for that.
thanks
Quite Immpresive course, How do you know all these 🙂
Very nice
Hi codebasics team i have 1 request to make here please if possible bring affordable course on product management it is a great field to explore but there are not much content available please bring this course you will be a life saviour for many of us as well as bring it with job assistance as well.
Hello Sir ,I wanted to devlop an Ai text to image and image to image ,please suggest me how to devlop
Please do a Data Engineering course
2:27 I created this project without using Open AI models. I just used opensource models.
Sir m apka y ai course lana chta hu toh aap mujha y btya beginner to advance ka course hai apka pass please send the link and sir m y bhi puchna chta hu nodejs p bhi hm ai or machine learning kar sakta hu kya
Can you please provide end to end real world NLP projects using techniques like POS, NER, Text classification etc. There are no good NLP projects on You tube in other channels.
Hello sir please make video on future scope in ai engineering VS data science. If i have complete non tech background and if i want start today than what should i choose Btw i had downloaded road maps of both field which you have provided
Sir lovely video and explanation. How is this video different from your paid course on AI? Please answer
@codebasics
17 күн бұрын
Are you referring to our "AI for everyone" course on codebasics.io? That course has much more exclusive content than this video. You can go to our website and check the curriculum
sir, i am unable to buy credit from open AI can u please give me solution alternative for same projects, ? thanks
Finally Rocky bhai stayed in code basics office..All gold 🪙 kept there
Sir please make a video on how to fine tune Llama 2 model using hugging face flan -v2 data set
Too good
@sreeniv09
Ай бұрын
I agree he has explained such complex topics in a very lucid easy to understand way! Thank You
What is the difference between this 3 hrs video content and your paid course ??? @codebasics
What is the python version used for rockybot project? Can anyone help me ?
Sir i want to take the course(data analyst) of yours which costs 6300.I don't even have any prior knowledge regarding data analytics. Can you tell if the course is beginner frndly and do the projects we do will increase the weightage of my resume? Please answer to this real quick sir!
@nagamaniv3189
26 күн бұрын
It will help for sure.
@charan5448
26 күн бұрын
@@nagamaniv3189 thanks! 👍
Hi could you please kindly make 0:11 videos on Data cleaning Webscrapping Data manipulation Data connections all concepts explained in one project shot And also video on python for data acience and gen ai in easy method so that we could do the projects Thank you And also Sir dont even know how to implement python could you please help me
If a student who has zero knowledge in gen Ai can follow this video or need any pre knowledge???
Sir..your teaching style is mind blowing...Please always try to make projects using only open source LLMs because we dont have money to buy OpenAI API key and 5 doller using my email id and many of my extra email iDs ..all those 5 dollers have been exhausted and now we dont have enough email IDs to generate free OpenAI dollers. PLEASE ONLY OPEN SOURCE LLMS FOR ANY UPCOMING PROJECTS...Thanks a lot...
@codebasics
Ай бұрын
Point noted. In this video, there is one project with opensource LLM. I am also going to build few more end to end projects using Llama 3 and other open source models. Stay tuned!
Can you make vedio on fine tunning LLM
can you also provide info about how to do it using huggingface and similar to it which are of free of cost. so that this project will be helpful for more people
Day 1 of asking making course video on MLOPS..🙂✨
Need a course on mlops
outdated(for first project), you'll need to make certain adjustments. 1. Use OpenAI and langchain version as mentioned in requirements.txt if you face indexError and/or pickle error. 2. You might encounter an error where it says davinci -003 is a deprecated version, please change the model as: llm = OpenAI(model="gpt-3.5-turbo-instruct", temperature=0.9, max_tokens=500) The project runs following these steps as of 9th May, 2024 but issues may arise later.
@codebasics
Ай бұрын
For first project, you may have to pay as openai has stopped free credits but by spending only 5$ or less you can run that project. Also for the other project, let us know what exact error are you getting?
@56_IT-B_AAKARSHROY
Ай бұрын
@@codebasics i am still receiving free credits from openAI. The project runs without any need to pay, provided some adjustments are made. I have edited the original comment, pls check it. Lastly, thanks a lot for taking out time to respond, its highly appreciated!
@codebasics
Ай бұрын
Awesome. Thank you. LLM world is changing so fast and one need to use a common sense to make tweaks like how you did it. Good job 👍🏼
@olaanthony-egorp3784
Ай бұрын
@@56_IT-B_AAKARSHROY What adjustments did you make without having to pay? Getting a RateLimitError as I try to run the first project
@56_IT-B_AAKARSHROY
28 күн бұрын
@@olaanthony-egorp3784 i didnt have to make any adjustments for that. sorry, my earlier comment is reflecting that. i intended to say that for different errors. i feel like its free for selected users only.
👍
can you do a course on mlops?
@codebasics
Ай бұрын
Yes, point noted. Give me some time, I will publish a mini course on ml ops
@frost3832
Ай бұрын
@@codebasics thank you your courses are really nice
@rohitkochikkatfrancis
Ай бұрын
Thanks mate. This one is going big. MLOPS 🔥 waiting @@codebasics
@anshikmantri6514
Ай бұрын
Yes sir please
@UNIQUEADVENTURE-ed5zz
Ай бұрын
Thank you sir
Make course on math for AI😊
please upload in hindi video on generative ai
is google palm still avaialble
My Open AI key is not working it shows max usage done like what should i do , i used it for first time
@codebasics
Ай бұрын
Yes, it looks like openai has discontinued the credits. One option is to spend money, it will be probably 3$ or less so in terms of INR, 270 RS (or less) and for learning a crucial skill, I guess most of the people can spend this type of money (actually people spend such money for a lunch or a breakfast so why not on a learning project). The other thing I am planning to do is publish another end to end LLM project using Lllama2 or some other open source model, will need few days for that but I will have it published before the end of the May 2024 on this same channel
Want to learn
OpenAI has stopped giving free credits. They have mentioned this officially. Can you please give an alternate solution for it Dhaval?
@codebasics
Ай бұрын
Yes. You can use llama 3 in groq.com. Also just think about this, if you spend less than 5$ you can do this project with openai. We usually spend more than 5$ for dinner with friends, isn't it worth spending money on learning a valuable skill?
Why this code is not running....it gives an error that openai has no module
@sonikafrontenddeveloper
23 күн бұрын
@memeologicalworld8929 I am also getting same error, is this error resolved ?
Can openai secured for office data
@codebasics
9 күн бұрын
yes. if you use Azure openai service
I am using OPENAI first time and showing me this error code: 429 - {'error': {'message': 'You exceeded your current quota, please check your pla
@mansibarse8806
Ай бұрын
I had encountered the same error and the reason is you have to buy open api key as it no longer provides the free credits for using the open api key. After I bought the key and ran the code the error was gone
@ayush07310
Ай бұрын
@@mansibarse8806bro from where we should buy
@farhanpasha5321
Ай бұрын
Same error bro
@farhanpasha5321
Ай бұрын
@@mansibarse8806bro kitne months ke liye purchase Kiya hai api key
@ayush07310
Ай бұрын
@@mansibarse8806 how did you pay I mean I don't get option to pay
Sir lauch genAI course in Hindi
doh, can't set up Google api keys in Europe.
Sir start mlops course in hindi
Not getting free credits sir as you mentioned.
@codebasics
Ай бұрын
Yes, it looks like openai has discontinued the credits. One option is to spend money, it will be probably 3$ or less so in terms of INR, 270 RS (or less) and for learning a crucial skill, I guess most of the people can spend this type of money (actually people spend such money for a lunch or a breakfast so why not on a learning project). The other thing I am planning to do is publish another end to end LLM project using Lllama2 or some other open source model, will need few days for that but I will have it published before the end of the May 2024 on this same channel
@devloper.hs14
Ай бұрын
@@codebasics Sir Agree- Spending around 5$ - Rs 490 for gaining $500 dollars later, is a easy bet. I already invested. I was just sharing if that's the issue.
GIVE US THE ROAD MAP FOR COMPUTER VISION ENGINEER LIKE AI ENGINEER ROAD MAP
getting stuck only becuase of API calling problem from OpenAI feeling sad , leaving whole video project now without doing. Stuck in the starting please make videos more clearly and prcisely by blurring your keys, doing each part step by step. (Not everyone is a heavy coder like you, who is watching.)
I got this error when running the code to store vector index create in local, been searching many sources but still couldn't solve the issue, could you kindly help take a look, thanks in advance ! "TypeError Traceback (most recent call last) in () 2 file_path="vector_index.pkl" 3 with open(file_path, "wb") as f: ----> 4 pickle.dump(vectorindex_openai, f) TypeError: cannot pickle '_thread.RLock' object"
@jashangill4191
28 күн бұрын
Hi did you solve this issue I have same one
@naitikmistry7876
19 күн бұрын
Not sure if you resolved this but may be this is happening because something non serializable in FAISS output. I took a workaround to complete this tutorial. Instead of saving to a file, I used local vector store. Use this code snippet # Save the vector into vectorstore instead of a file: vector_store_openai = FAISS.from_documents(docs, embeddings) vector_store_openai.save_local('vectorstore') #Retrieve it from vector store instead of a file: vector_store_local = FAISS.load_local("vectorstore", OpenAIEmbeddings(), allow_dangerous_deserialization=True) chain = RetrievalQAWithSourcesChain.from_llm(llm = llm, retriever = vector_store_local.as_retriever())
Can i learn this. I know little bit about python
@shishirkj
26 күн бұрын
yes