RAG with Azure AI Search and Azure Open AI in 9 minutes

Ғылым және технология

Equipment used
Blue Yeti Microphone [ www.amazon.in/Blue-Recording-... ]
RAG [ Retrieval-Augmented Generation ] concept explained
📍 How we do we ingest data into our RAG architecture?
📍 How we do we query from our RAG architecture?
📍 Detailed use of Azure AI Search and Azure OpenAI in RAG
📍 Demo of our built in RAG application
Code: github.com/ambarishg/AZURE-AI...
Playlist provided is [ • Generative AI ]

Пікірлер: 38

  • @UmairMateenKhan
    @UmairMateenKhanАй бұрын

    Awesome tutorial Ambarish. Keep up the good work.

  • @paullopez_ai
    @paullopez_ai5 ай бұрын

    Great video! Thanks for sharing the code too, greatly appreciated.

  • @ambarishg

    @ambarishg

    5 ай бұрын

    Glad to help!

  • @samosertogo
    @samosertogo4 ай бұрын

    Well done! Brilliant work and very replicable. Thanks a lot!

  • @ambarishg

    @ambarishg

    4 ай бұрын

    Many thanks!

  • @pooblock4092
    @pooblock40923 күн бұрын

    Does this work with files with size large than 16mb?

  • @murtuza.chawala
    @murtuza.chawala2 ай бұрын

    Awesome Video I tried it too wanted to know any way we can do reinforcement learning making the bot train on our feedback

  • @pedromoraes5197
    @pedromoraes51973 ай бұрын

    Great video, Man!! Thanks for sharing.

  • @ambarishg

    @ambarishg

    3 ай бұрын

    Thanks for watching!

  • @davemcshane5292
    @davemcshane52925 ай бұрын

    brilliant video!! Much better than the marketing ones from microsoft :)

  • @ambarishg

    @ambarishg

    5 ай бұрын

    Wow, thanks!

  • @italoaguiar
    @italoaguiar4 ай бұрын

    thanks! very informative video!

  • @ambarishg

    @ambarishg

    4 ай бұрын

    Glad it was helpful!

  • @andonii46
    @andonii463 ай бұрын

    Amazing video! One question, if you have the data source a blob storage, if you delete a pdf file from that blob storage, when you run the indexer is the reference and information about this deleted document deleted from the index as well? thanks!

  • @ambarishg

    @ambarishg

    3 ай бұрын

    The data is stored in the Azure AI Search index. Please note that if we have to remove a document from the index, we have to delete it from the index. Please also note that in the file upload_docs.ipynb, the function remove_from_index can remove documents from the index

  • @indrayne1840
    @indrayne18403 ай бұрын

    Sir I have one doubt, like we are using Azure Cognitive search and the index updates everyday midnight. So we have both new content and old content with us. Now what I want is to retrieve the most recent content first and than old content. How can I implement it?

  • @mohammadsohail6534
    @mohammadsohail65344 ай бұрын

    Hi @ambarishg Great video Will the Azure Search AI store the indexed data or it is stored in StorageAcount

  • @ambarishg

    @ambarishg

    4 ай бұрын

    In Azure AI Search

  • @LumityGaming
    @LumityGaming4 ай бұрын

    Hi Ambarish, amazing video! Thank you so much for taking the time to make it. Would you be able to help me understand where I can locate the config information? I apologize if some are self-explanatory, I dont even know where to begin on a few of them searchservice = values_env['searchservice'] index = values_env['index'] searchkey = values_env['searchkey'] category=values_env['category'] #AZURE STORAGE CONFIGURATION storageaccount = values_env['storageaccount'] container=values_env['container'] storagekey=values_env['storagekey'] localpdfparser=values_env['localpdfparser'] verbose=values_env['verbose'] FILE_PATH = values_env['FILE_PATH'] formrecognizerservice=values_env['formrecognizerservice']

  • @ambarishg

    @ambarishg

    4 ай бұрын

    Please create a .env file. In the .env file , put the key in the format = ; example searchservice= I should have put a .env.example file for clarity. Will put that shortly and explain it.

  • @ambarishg

    @ambarishg

    4 ай бұрын

    Added the .env.sample file in the repository.Hope this helps

  • @limjuroy7078
    @limjuroy70782 ай бұрын

    Here is my little 2 cents', can you do an end-to-end tutorial on how you do this, including creating Azure AI Service, Azure Storage as well as the coding part? 😅😅😅

  • @ambarishg

    @ambarishg

    2 ай бұрын

    Great suggestion!

  • @xyz-vv5tg

    @xyz-vv5tg

    Ай бұрын

    Please. I need it. I have no idea on Azure or any of its services. I'm just exploring and getting confused

  • @krishnavasu3499
    @krishnavasu34993 ай бұрын

    Great video! Very helpful. Instead of azure AI search, if I wanted my retriever to be Qdrant, would it be possible? I have a few files in Qdrant and would like to use Azure open AI to get the output from Qdrant and give the result to the user. If possible, how could I do it?

  • @ambarishg

    @ambarishg

    3 ай бұрын

    Yes you can! kzread.info/dash/bejne/X2ln2ruLZty3cbw.html This shows RAG with QDRANT [ RAG with Opensource Tools - Qdrant and Mistral in 6 minutes ]. You may please modify this for Azure Open AI

  • @ambarishg

    @ambarishg

    3 ай бұрын

    kzread.info/dash/bejne/mmh6kpufh8vfmMo.html This shows RAG with LlamaIndex - Qdrant and Azure OpenAI in 9 minutes

  • @sarak8467
    @sarak84674 ай бұрын

    Hi Ambarish, thank you for the very helpful video! I have an enquiry and I hope you could help me with it. So, on the Azure Platform, I have created a a Search Service and an OpenAI Service and connected both in order to be able to ask questions about the data stored on an index. The data is in a Blob Storage container that has multiple folders in it. What I want to do when searching for information, is to filter the folders; I want to choose the folder (either by name or path), so that the search service only returns the content of that folder, and then the openAI service uses that content as a reference to generate an answer to my question. Do you know how I could do that?

  • @ambarishg

    @ambarishg

    4 ай бұрын

    In the code we have added metadata while putting data into the search index. Please add your customized metadata while putting the data into the search index. While doing the Search on Azure AI , we should provide the filter with the proper metadata and it should filter accordingly. Hope this helps. May be I should so a followup video explaining this in detail. Thanks again for your questions.

  • @sarak8467

    @sarak8467

    4 ай бұрын

    @@ambarishg Thank you so muh for your reply! IT would be perfect if you could show us how to do it. If you can, please show us how to do it on Azure and through code. (I use either Python or C#) Thanks again!

  • @ankan54
    @ankan545 ай бұрын

    have you tried creating a vector index in ACS? will vector search be better than semantic search?

  • @ambarishg

    @ambarishg

    5 ай бұрын

    Good suggestion will try. Usually Hybrid search is better

  • @ambarishg

    @ambarishg

    4 ай бұрын

    @ankan54 . Please have a look at the video kzread.info/dash/bejne/o36glaudc67Mpqg.html where we discuss the following RAG with Azure AI Search with Azure OpenAI with different search techniques and Langchain with Conversation Chain, Prompt Template and Conversation Buffer 📍 Vector Search 📍 Hybrid Search 📍 Exhaustive KNN Search 📍 Hybrid Search with Semantic reranking 📍 RAG with Azure AI Search with Azure OpenAI 📍 Use Langchain with Conversation Chain 📍 Use Langchain with Prompt Template 📍 Use Langchain with Conversation Buffer

  • @limjuroy7078
    @limjuroy70782 ай бұрын

    What if I want the app "also" has the ability to upload our own PDF file and query the content of the just uploaded file through UI?

  • @ambarishg

    @ambarishg

    2 ай бұрын

    Yes it is possble

  • @user-pm1lh3kr9k
    @user-pm1lh3kr9k4 ай бұрын

    hey can you please put sample env file and explain the parameters

  • @ambarishg

    @ambarishg

    4 ай бұрын

    Sure.I will add the ENV File

  • @ambarishg

    @ambarishg

    4 ай бұрын

    Added the .env.sample file in the repository.Hope this helps

Келесі