Build and Deploy LLM Application in AWS Lambda - BedRock - LangChain

Building and deploying a Large Language Model (LLM) application on AWS Lambda, leveraging the power of BedRock and LangChain. We explore how to create a serverless LLM chain application that allows users to ask natural language questions.
⭐️ Contents ⭐️
00:00 Introduction
1:57 Bedrock and Lambda Service
4:23 Create Lambda Function
8:04 Deployment and Test
9:17 Create and Add Custom Lambda Layer
16:47 Test
17:29 Summary and Conclusion
📚 Resources 📚
▸ ARN for popular packages: api.klayers.cloud/api/v2/p3.1...
▸ Amazon ECR Public Gallery - SAM : gallery.ecr.aws/sam/build-pyt...
▸ Official Documentation: aws.amazon.com/blogs/compute/...
▸ Docker: docs.docker.com/desktop/insta...
▸ Article and Code: / build-and-deploy-llm-a...
__________________________________________________________________________________________________
🔔 My Newsletter and Featured Articles: abonia1.github.io/newsletter/
🔗 Linkedin: / aboniasojasingarayar
🔗 Find me on Github : github.com/Abonia1
🔗 Medium Articles: / abonia

Пікірлер: 20

  • @user-ht5ev7il3h
    @user-ht5ev7il3h3 ай бұрын

    Please do more on AWS Bedrock to develop on RAG applications......your explanation is simple and effective.......stay motivated and upload more videos about LLM

  • @AboniaSojasingarayar

    @AboniaSojasingarayar

    3 ай бұрын

    Thanks for your kind words! Sure I will do it.

  • @akshaykotawar5816

    @akshaykotawar5816

    3 ай бұрын

    Yes same thing i want ​@@AboniaSojasingarayar

  • @AboniaSojasingarayar

    @AboniaSojasingarayar

    2 ай бұрын

    Here the tutorial link to Deploying a Retrieval-Augmented Generation (RAG) in AWS : kzread.info/dash/bejne/mZ2X1cRyoJrbmpc.html

  • @RajuSubramaniam-ho6kd
    @RajuSubramaniam-ho6kdАй бұрын

    Thanks for the video. Very useful for me as I am new to AWS lambda and bedrock. Can you please upload the lambda function source code? Thanks again!

  • @AboniaSojasingarayar

    @AboniaSojasingarayar

    Ай бұрын

    Glad it helped. Sure you can find the code and complete the article on this topic in the description. In any way here is the link to the code : medium.com/@abonia/build-and-deploy-llm-application-in-aws-cca46c662749

  • @akshaykotawar5816
    @akshaykotawar58163 ай бұрын

    Very Informative thanks for uploading

  • @AboniaSojasingarayar

    @AboniaSojasingarayar

    3 ай бұрын

    Glad it helped!

  • @zerofive3699
    @zerofive36993 ай бұрын

    Very informative

  • @AboniaSojasingarayar

    @AboniaSojasingarayar

    3 ай бұрын

    Glad it was helpful!

  • @Bumbblyfestyle
    @Bumbblyfestyle3 ай бұрын

    👍👍

  • @AboniaSojasingarayar

    @AboniaSojasingarayar

    3 ай бұрын

    😊😊

  • @humayounkhan7946
    @humayounkhan7946Ай бұрын

    Hi Abonia, thanks for the thorough guide, but i'm abit confused with the lambda_layer.zip file, why did you have to create it through docker? is there an easier way to provide the dependencies in a zip file without going through docker? Thanks in advance!

  • @AboniaSojasingarayar

    @AboniaSojasingarayar

    Ай бұрын

    Hi Humayoun Khan, Yes we can but Docker facilitates the inclusion of the runtime interface client for Python, making the image compatible with AWS Lambda. Also it ensures a consistent and reproducible environment for Lambda function's dependencies. This is crucial for avoiding discrepancies between development, testing, and production environments. Hope this helps.

  • @NJ-hn8yu
    @NJ-hn8yuАй бұрын

    Hi Abonia, thanks for sharing. I am facing this error . can you please tell how to resolve it "errorMessage": "Unable to import module 'lambda_function': No module named 'langchain_community'",

  • @AboniaSojasingarayar

    @AboniaSojasingarayar

    Ай бұрын

    Hello, You are most welcome. You must prepare your ZIP file with all the necessary packages. You can refer to the instructions starting at the 09:04

  • @fkeb37e9w0
    @fkeb37e9w02 ай бұрын

    Can we use openai and chromadb on aws??

  • @AboniaSojasingarayar

    @AboniaSojasingarayar

    2 ай бұрын

    Yes we can! In the below tutorial I have demonstrated how we can create and deploy lambda layer via container for larger dependencies : kzread.info/dash/bejne/mZ2X1cRyoJrbmpc.htmlsi=F_X7-6YCAb0Kz3Jc

  • @fkeb37e9w0

    @fkeb37e9w0

    2 ай бұрын

    @@AboniaSojasingarayar yes but can this be done without eks or containers?

  • @AboniaSojasingarayar

    @AboniaSojasingarayar

    2 ай бұрын

    Yes! You can try it by creating a custom lambda layer.If you face issue try to use only the required libraries and remove any unnecessary dependencies from your zip file.Hope this helps.