This was really great, seriously the best tutorial I've seen on Azure integration with LangChain! Just wanted to add some dependencies I needed to integrated on my end as of the date I post this comment that I needed to install on top of the requirements.txt. Some potential additional dependencies people might need to add are: pip install unstructured pip install unstructured[pdf] # if you want to upload PDF files pip install tiktoken pip install azure-search pip install openai pip install azure-search-documents==11.4.0b8 pip install azure-identity Also, if you're building your docker container from an M1 Mac you may need to transpile your container using --platform=linux/amd64, so my command for build looked more like: docker buildx build --platform=linux/amd64 -t . I was running into issues with my app service but after building my docker container like this on my M1 mac it appeared to fix it. Thanks once again for this great tutorial!

@codingcrashcourses8533

6 ай бұрын

Thank you. I pinned your comment

Awesome walkthrough. These cloud service UIs are so convoluted and overwhelming when just getting started. This video really puts together all pieces of the puzzle. Thank you for sharing

Very educational and informative content, thank you very much!

Man this is brilliant. One of the few creators who go beyond Notebooks.

Always elevating your content level. Thanks!

this is a magnificent tutorial, ty!

Thank you for this great tutorial! The most I learned was during fixing all the errors you luckily kept in the video. Please keep it that way, as barely all goes smooth from beginning. Due to the new API version of OpenAI, i faced even more issues, but could finally make it run.

@codingcrashcourses8533

7 ай бұрын

The langchain Team currently works on integrating openai 1.0. Will work Soon hopefully

Thanks for uploading this. It is one of the best, simplest and working solutions available online. I created my first AI application after learning from this video. Please keep up the good work. And once again, thanks a ton. 😊

@codingcrashcourses8533

3 ай бұрын

Thank you

Very good video !!

This is so helpful. Please do more of videos covering azure services with LLM-powered Applications.

@codingcrashcourses8533

10 ай бұрын

thanks. Thought of something like tracking changes in a blogstorage and trigger building a new index with azure functions. I am also still experimenting with this, since there are few best practices :)

Excellent video, nicely explained. Thank You! Pls share if you have video for leveraging Azure COSMOS DB as a Vector store.

Excelente video papa

Amazing video, along with the retrieved answer, how do I allow the user to print the relevant document as reference from the blob storage.

Thank you for the great content. Quick question. Why did you upload your data to Azure blob instead of just loading the txt file using TextLoader?

@codingcrashcourses8533

7 ай бұрын

Just to integrate more azure features. If you have an app in production, your data will probably not live in a persons PC:)

Nice step by step tutorial. Now, how do I add custom metadata to cognitive search as custom fields and make it part of vector_store.add_documents() method?

@codingcrashcourses8533

8 ай бұрын

add_documents takes list of Documents. These contain a metadata field which you can update as you wish. Take a look at it´s implementation, it´s one of the core classes of langchain. [ Document { pageContent: "Hello world", metadata: { id: 2 } }

Thank you for this excellent video! I followed your instructions and created the vector store in a Search service, pushed the Docker image to a container registry, and created the App service. However, I encountered some issues when I tried to run it. The Log stream showed this error message: “Container appXXX didn’t respond to HTTP pings on port: 80”. I have tried various solutions, such as changing the python-lite versions, adding EXPOSE 80 to Dockerfile, adding WEBSITES_PORT 80 to the app service, and so on, but none of them worked. I also got this error from Azure diagnostics: “The error message indicates that the container is unable to start due to an exec format error…exec /usr/local/bin/streamlit: exec format error”. I am really stuck and frustrated. Could you please give me some advice on how to fix this problem? I would really appreciate your help.

@codingcrashcourses8533

10 ай бұрын

Does the App run on 0.0.0.0? Thats is needed for a Container. Otherwise it is only accessible from inside the container. EXPOSE does not have any effect by the way.

@LURASASA

10 ай бұрын

The Docker image built on my macOS M1 wasn't compatible with Azure Linux environment. Forced Docker to build the image for AMD64 and it was solved. Hope it helps.

hi, thank you very much for such a beautiful content. does any of the steps mentioned requires payment?

@codingcrashcourses8533

10 ай бұрын

The Image registry costs a few bucks, but you can also deploy the app as Code instead of a container

How to load the PDF files on the blob? If the directory on the blob have multi file types as pdf, txt, csv,... How to load it? thanks.

@codingcrashcourses8533

8 ай бұрын

Azure has a very good Python SDK, which allows you to do that easily. If you have different files, you have to use different Loaders. You can use a Factory Pattern to select the correct loader, based on the file ending

Do you have an idea how to delete these files? You just have to delete them from the blob, or how do you delete them from the cognitive search index?

@codingcrashcourses8533

6 ай бұрын

You could use Azure Functions which are triggered by an Event in your Blob Storage. That function then triggers the indexing logic in ACS.

Please make more videos on Azure OpenAI. Thank you for the video

@codingcrashcourses8533

8 ай бұрын

I will probably make a full course on that for Udemy with event driven document updates, blobstorage, ACS and more :)

@saurabhjain507

8 ай бұрын

I am going to enroll in that course for sure!

Does anyone know if running the docker builds will eat all the computer space? Using docker desktop

@codingcrashcourses8533

2 ай бұрын

What you mean? You ask what to do If that happens or you want to know what to do against it?

Hi. Thank you for this interesting video. Why don't you use Azure OpenAI?

@codingcrashcourses8533

10 ай бұрын

Its currently not available for everybody. I am at least not allowed to create a Ressource.

@nicolaslee5722

10 ай бұрын

I'm using azure open ai, would there be Any modification to the files

Hi is there any option to download the output file

@codingcrashcourses8533

7 ай бұрын

can you say what exact part of the video you relate to and what you want to download? then I may help you :)

many thanks, could you explain by example how I can create data source, skillset, index and indexer on Azure AI Search :) pllllllllllllllllz 🤗

@codingcrashcourses8533

4 ай бұрын

Currently no plans to do that, sorry! I don´t like ACS at all :/

Hi, i need 1 small help, i am able to load container, but what about if i have to load a directory under a container, not entire container.

@codingcrashcourses8533

9 ай бұрын

Can you be a little bit more specific, with an example?

@prateeklath

9 ай бұрын

@codingcrashcourses8533 yes. I want to load documents from container/myfolder directory for chunking. The example shows only for container. But when i m trying to put slash after container it is showing me error

@codingcrashcourses8533

9 ай бұрын

@@prateeklath what error? path not found? Make sure you are accessing the correct path. You can maybe try use the docker exec command to debug this: stackoverflow.com/questions/30172605/how-do-i-get-into-a-docker-containers-shell

@prateeklath

9 ай бұрын

@codingcrashcourses8533 yes invalid resource uri. I will be trying azur bobclient service to test. I have to add multiple files from directory under container for chunking

@prateeklath

9 ай бұрын

@codingcrashcourses8533 i resolved the problem by passing myfolder/filename in blob name parameter

I tried but I could not get this to run, when attempting to create the index I get the following errors: dimensions is not a known attribute of class and will be ignored azure.core.exceptions.HttpResponseError: (InvalidRequestParameter) The request is invalid. Details: definition : The vector field 'content_vector' must have the property 'dimensions' set. Code: InvalidRequestParameter Message: The request is invalid. Details: definition : The vector field 'content_vector' must have the property 'dimensions' set. Exception Details: (InvalidField) The vector field 'content_vector' must have the property 'dimensions' set. Parameters: definition

@codingcrashcourses8533

10 ай бұрын

99% the wrong version of azure-cognitive-search. Which one do you use?

@paulatreides7547

9 ай бұрын

Thanks, I changed the version and now it runs but I'm working through another error. I can create the indexes and store the documents. When I try to run the application the streamlit service starts and I can input a question then it crashes. I'm getting the following error: raise Exception(f"Error in search request: {response}") Exception: Error in search request:

@eriklindquist5025

9 ай бұрын

What version did you change it to and how?

@eriklindquist5025

9 ай бұрын

I have a similar error but it is related to failing to make a connection and I am using azure-search-documents 11.4.0b8 azure.core.exceptions.ServiceRequestError: : Failed to establish a new connection: [Errno 11001] getaddrinfo failed

@codingcrashcourses8533

9 ай бұрын

@@eriklindquist5025 for me that looks like an DNS misconfiguration, not something related to the package

That was great! I just got an error on the live app, everytime I search says MissingSchema: Invalid URL on File "/usr/local/lib/python3.11/site-packages/requests/models.py", line 439, in prepare_url raise MissingSchema(

@codingcrashcourses8533

3 ай бұрын

Did you enter your own URL? Please check if you made any mistakes. My guess would be that the format is wrong