3-Langchain Series-Production Grade Deployment LLM As API With Langchain And FastAPI

github: github.com/krishnaik06/Update...
LangServe helps developers deploy LangChain runnables and chains as a REST API.This library is integrated with FastAPI and uses pydantic for data validation.In addition, it provides a client that can be used to call into runnables deployed on a server. A JavaScript client is available in LangChain.js.
#krishnaik
---------------------------------------------------------------------------------------------
Support me by joining membership so that I can upload these kind of videos
/ @krishnaik06
-----------------------------------------------------------------------------------
►LLM Fine Tuning Playlist: • Steps By Step Tutorial...
►AWS Bedrock Playlist: • Generative AI In AWS-A...
►Llamindex Playlist: • Announcing LlamaIndex ...
►Google Gemini Playlist: • Google Is On Another L...
►Langchain Playlist: • Amazing Langchain Seri...
►Data Science Projects:
• Now you Can Crack Any ...
►Learn In One Tutorials
Statistics in 6 hours: • Complete Statistics Fo...
End To End RAG LLM APP Using LlamaIndex And OpenAI- Indexing And Querying Multiple Pdf's
Machine Learning In 6 Hours: • Complete Machine Learn...
Deep Learning 5 hours : • Deep Learning Indepth ...
►Learn In a Week Playlist
Statistics: • Live Day 1- Introducti...
Machine Learning : • Announcing 7 Days Live...
Deep Learning: • 5 Days Live Deep Learn...
NLP : • Announcing NLP Live co...
---------------------------------------------------------------------------------------------------
My Recording Gear
Laptop: amzn.to/4886inY
Office Desk : amzn.to/48nAWcO
Camera: amzn.to/3vcEIHS
Writing Pad:amzn.to/3OuXq41
Monitor: amzn.to/3vcEIHS
Audio Accessories: amzn.to/48nbgxD
Audio Mic: amzn.to/48nbgxD

Пікірлер: 55

  • @krishnaik06
    @krishnaik063 ай бұрын

    Support me by joining membership so that I can upload these kind of videos kzread.info/dron/NU_lfiiWBdtULKOw6X0Dig.htmljoin

  • @MeAi-fd8pt
    @MeAi-fd8pt3 ай бұрын

    I have done your nlp deep learning one shot and I will say you have done really great work that you increased my interested in this field. Thanks for this video too. - Somesh Panchal, Pune.

  • @elmflor4365
    @elmflor43653 ай бұрын

    Thank you so excited for the continuation of this great series!!

  • @IdPreferNot1
    @IdPreferNot13 ай бұрын

    Such a great start to this series, thx!

  • @Sy-uc5fy
    @Sy-uc5fy3 ай бұрын

    I'm loving the courses! Thank you so much I'm learning a lot.

  • @tzurdo1
    @tzurdo1Ай бұрын

    Thanks for a great tutorial and a great series!

  • @Nishant-xu1ns
    @Nishant-xu1ns3 ай бұрын

    excellent video sir .keep it up

  • @eventsjamaicamobileapp1426
    @eventsjamaicamobileapp14263 ай бұрын

    Great work!

  • @nikhielsingh748
    @nikhielsingh7483 ай бұрын

    Amazing video !

  • @andrespineiro7609
    @andrespineiro76093 ай бұрын

    Nice work!!!

  • @krishj8011
    @krishj801128 күн бұрын

    Thank you for making amazing tutorial... 👍

  • @theshubhagrwl
    @theshubhagrwlАй бұрын

    langchain and Krish sir makes it super easy!

  • @vinayreddyvarikuti
    @vinayreddyvarikuti3 ай бұрын

    Thank you so much sir..

  • @educationdelightenglish3819
    @educationdelightenglish38193 ай бұрын

    Excellent video on KZread! No other videos can match such great things on planet as far as AI learning is concerned! I need to know minimum hardware configuration to run all these program! 1. Can I run the program without NVIDIA graphics processor! If at all I have to purchase, what should be the configuration as there is no such requirements.txt for Hardware ! Kindly let us know, if possible make one video simpley stating LLM vs Hardware Configuration and Price as well as renting remote VPS for deployment!

  • @velpaul9917
    @velpaul99173 ай бұрын

    Great video. Clear and crisp explaination of the concept and code. Can we use this use case for the comparing different LLM model response? or somthing else.

  • @nishantchoudhary3245
    @nishantchoudhary32453 ай бұрын

    waiting for next video

  • @KAMAT_JI72
    @KAMAT_JI723 ай бұрын

    ❤❤

  • @santhoshr8943
    @santhoshr89432 ай бұрын

    Please provide a video with deepseek Krish Thanks for your hardwork really helping me.

  • @SantK1208
    @SantK12083 ай бұрын

    Thank you Krish, when you will start RAG system using Langchain

  • @rashedin6356
    @rashedin63563 ай бұрын

    Sir can you make a playlist of gen ai and llm course and project videos

  • @balajin5395
    @balajin53953 ай бұрын

    Hi Krish, when you starting the 1% data scientist programme? I am eagerly waiting for that.

  • @rakesh-purple
    @rakesh-purple3 ай бұрын

    Hi Krish, I wanted to share some feedback. I'm a regular viewer of your videos, and I often find it challenging to locate a specific video when I don't remember its title. Implementing a consistent naming convention or series titles could significantly improve the searchability of your content. I truly value the insights your videos provide.

  • @lixiasong3459
    @lixiasong34593 ай бұрын

    Sir, Thank you for the insightful video; regarding hosting, could we utilize Hugging Face for hosting? Thank you very much again.

  • @rajarams3722
    @rajarams3722Ай бұрын

    Thanks ! But the first add_routes() was not needed. Not sure why that was added.

  • @siddharthchauhan3404
    @siddharthchauhan34043 ай бұрын

    Hi Krish, First of all want to great work on videos really learning a lot from your videos. I have question, can you please share how can we deploy langgraph using langserve? Thanks

  • @sweetsforpauper
    @sweetsforpauper3 ай бұрын

    Can you make a video on how to adapt an LLM model to its specific use case? Is fine-tuning the right approach, or should one tie the model to a database (RAG) that provides the necessary information? In my case, I'm currently trying to integrate a 'learning coach' chatbot within a Moodle course. Naturally, it should know the contents of the Moodle course to be able to provide targeted help...

  • @ninadpawar2062
    @ninadpawar20623 ай бұрын

    Hello Krish, I'm currently working on a PostgreSQL query using LangChain. I'm interested in obtaining the output in Excel format. Could you please advise on how to achieve this?

  • @spusuluri4804
    @spusuluri48042 ай бұрын

    Hi sir can we use langchain in real production environment in large scale

  • @Vir-se2kb
    @Vir-se2kb2 ай бұрын

    Hi Kris. plz explain the reason in details for every line of code. Explaining on a high level keeps confusing. Like the add_routes section - you should explain it in more detail.

  • @mahikhan5716
    @mahikhan57163 ай бұрын

    @krish please try to explain some little things like why u used chatpromptemplate.from_template why other project u have used .from_messge otherwise it's type of confusion not for all but those who we are poor students

  • @user-hb8xc1qv6e
    @user-hb8xc1qv6e3 ай бұрын

    what about multiple users using at a time.does that increase latency sir

  • @pranaygupta6034
    @pranaygupta6034Ай бұрын

    Hey Krish! Great video. But im encountering an error after creating the routes where it is asking me to add a runnable sequence. How do i solve it?

  • @hamidraza1584
    @hamidraza15843 ай бұрын

    How I can create API key for back end llm,s

  • @ridj41
    @ridj413 ай бұрын

    Krish, can you make a video on how to get an internship in Generative AI field, I have worked a lot on genai, and currently also learning, now wanted some real world experience in the field.

  • @Vir-se2kb
    @Vir-se2kb2 ай бұрын

    Hi Kris. You are just writing codes by watching your left side screen, please explain the concepts in more detail.

  • @studology67

    @studology67

    23 күн бұрын

    yes this is what i want, why are we creating api in the first place?

  • @ayyappahemanth7134
    @ayyappahemanth71343 ай бұрын

    Hi sir, I'm not able to use 'gemma' instead of 'llama2', don't know why?, I'm able to run llama2 successfully, Is there any changes to be done to use gemma. I'm able to run from cmd line using ollama! Please help.

  • @saurabhjain507
    @saurabhjain5073 ай бұрын

    Can you please show how to stream the response using fastapi to streamlit?

  • @shubhajitkotal6201
    @shubhajitkotal6201Ай бұрын

    I am getting some error on the prompt1 line of code .

  • @pragneshsolanki8243
    @pragneshsolanki82433 ай бұрын

    There is conflict coming in langserve, langsmith, langchain_core version. I am getting errors due to this library. Please share the version of this library to install. Thanks

  • @NoDoglapan
    @NoDoglapan3 ай бұрын

    Hi Krish - a small bug in your code because of which it is not generating a poem - instead of prompt|llm it should be prompt|model for the poem routes add_routes( app, prompt2|llm, path="/poem"

  • @rishiraj2548
    @rishiraj25483 ай бұрын

    🙂🙏

  • @Ishaheennabi
    @Ishaheennabi3 ай бұрын

    How can high school developers get placed❤ plz reply

  • @YogeshPatil-es8bw
    @YogeshPatil-es8bw2 ай бұрын

    Hi guys , how to solve this error: json.decoder.jsondecodeerror: expecting value: line 1 column 1 (char 0)

  • @ridj41
    @ridj413 ай бұрын

    Hey krish , there is an error , whenever I try to run the app.py file, I go to the url, then do /docs, then there appears that the API load has failed, please make one non-openai version of this video as well, since those not having tokens in openai are unable to execute what is provided in this video, I think that is the reason , since I did not add os.environ, to my code since I did not have tokens in my openai account.

  • @mahmadmusffir8459
    @mahmadmusffir84593 ай бұрын

    how we will add memory in apis

  • @keshavchhabra6419

    @keshavchhabra6419

    3 ай бұрын

    by using a vector database

  • @mahmadmusffir8459

    @mahmadmusffir8459

    3 ай бұрын

    @@keshavchhabra6419 i mean chat history

  • @studology67
    @studology6723 күн бұрын

    why are we creating API, whats the benefit

  • @shubham-itachi
    @shubham-itachi3 ай бұрын

    Sir ML vs ds vs dl vs Generative Ai kiya sikhu mai. Smaj nahi aa rha 🙏🙏🙏🙏😢😢🙏🙏🙏🙏🙏🙏🙏🙏

  • @SantK1208

    @SantK1208

    3 ай бұрын

    Sab seekh le

  • @ridj41

    @ridj41

    3 ай бұрын

    maine sab sikha hua hai, sabse important data analytics aur ml hai jobs perspective se, par sabse kam competition generative ai mein hai kyuki baaki sab cheeze seekhne k baad genai seekhte hai directly nhi. GenAI ki prereq NLP hai, aur NLP ki prereq- ML/DL/etc.

  • @evanluo4605
    @evanluo460512 күн бұрын

    from the api it clearly seems llama needs to get updated, its very inaccurate in producing results as compared to others