Use Open AI (ChatGPT) On Your Own Large Data -Part 1

Ғылым және технология

Part 1: Is your dataset large enough that you cannot fit in just one prompt to call Open AI models?
If yes, use embeddings! In this video we will create simple web application for a OpenAI-enabled document search to be able to use these language models even over your large data. We Azure OpenAI Service for creating embeddings vectors from documents. For answering the question of a user, it retrieves the most relevant document and then uses GPT-3 to extract the matching answer for the question.
☎️ Do you need any career or technical help? Book a call with me: calendly.com/mg_cafe
Part 2: • Use ChatGPT On Your Ow...
Open AI+ Azure = Revolutionize the Way You Do Business
• Open AI+ Azure = Revol...
ChatGPT Came To Azure:
• ChatGPT Came To Azure!
Repo used in this video:
github.com/ruoccofabrizio/azu...
*******************
LET'S CONNECT!
*******************
Join Discord Channel: / discord
✅ You can contact me at:
LinkedIn: / mohammad-ghodratigohar
Email: mo.ghodrati95@gmail.com
Twitter: / mg_cafe01
🔔 Subscribe for more cloud computing, data, and AI analytics videos
by clicking on the subscribe button so you don't miss anything.
#ChatGPT #Azure #OpenAI #AI #artificialintelligence #machinelearning #cloudcomputing #chatbot #virtualassistant #customerservice #developers #technews #innovation #Microsoft #CognitiveServices #BotService #naturalanguageprocessing #NLP #conversationalAI #videotutorial #tutorial #learningAI #AIchatbot #AIassistant #AzureAPI #AzureTools #MG #embeddings #wordEmbeddings

Пікірлер: 103

  • @mingtakwong8664
    @mingtakwong8664 Жыл бұрын

    Great video! Is it possible to identify the source document the answer refers to? How?

  • @MG_cafe

    @MG_cafe

    Жыл бұрын

    yes you can and here I have explained how in part 2 : kzread.info/dash/bejne/hJeY08aQdbzdYqQ.html

  • @kalaiarasankalai9471

    @kalaiarasankalai9471

    Жыл бұрын

    ⁷😊😊😊😊😊😊😊😊😊😊😊😊😊😊😊😊😊😊

  • @GothicDragonX
    @GothicDragonX Жыл бұрын

    Dude, that intro is epic. I like it. At first thought you were twins, but then I focused on finding a shadow between both sides and where it cuts off, and I found it. The dialogue alone sold me at first.

  • @MG_cafe

    @MG_cafe

    Жыл бұрын

    haha, you made my day, Thanks so much buddy!

  • @ericolendzian
    @ericolendzian Жыл бұрын

    1:15 into this video and I have no idea how good it is going to be at the end, but man can you act. The synchro is un believable. The best I've seen of people doing this kind of videos.

  • @emrahe468
    @emrahe468 Жыл бұрын

    Amazing intro, that summarizes the problems we are currently having about chatgpt

  • @shahram9217
    @shahram921726 күн бұрын

    MG, I'm so proud of you as an Iranian!

  • @seanconnollymv
    @seanconnollymv Жыл бұрын

    Thanks MG! The are very informative and helpful. What is often left out of videos is the fact that many developers want to create SaaS platforms using the techniques you present. This generally involves a multi-tenant / user scenario. Yes this adds complexity, but it would be great if you could elaborate on siloing customers data in a saas model approach using cognitive search and openAI.

  • @georgemarkets1
    @georgemarkets1 Жыл бұрын

    What are the operating costs of Azure? I've seen some implement embeddings with langchain & pinecone, even though your method seems simpler.

  • @JeanCharlesChabot
    @JeanCharlesChabot Жыл бұрын

    Very well done, congratulation ! Very high quality presentation and information ! 🙏❤🙏

  • @papariding5865
    @papariding5865 Жыл бұрын

    Really informative, I would like to use azure sql instead of redis. is it possble?

  • @narniashasta
    @narniashasta Жыл бұрын

    Thank you. Is there a similar way to solve the exact problem on AWS?

  • @craigdallen
    @craigdallen Жыл бұрын

    Excellent video.. Thank you!!

  • @evie3311
    @evie3311 Жыл бұрын

    thanks for the information. Is it only open for Company accounts? I was stuck in "Request Access to Azure OpenAI Service"

  • @rajivkumar2385
    @rajivkumar23858 ай бұрын

    killing ending.. salute your motivation

  • @arunthakur03
    @arunthakur037 ай бұрын

    Great Stuff!!

  • @vish515
    @vish515 Жыл бұрын

    Thanks a lot for the awesome video. I have successfully deployed it. I also added one document. It has not computed the embeddings yet. Any idea on how long does that take? I used Bank of America report, that was used in the video..

  • @MicrosoftAzureAI
    @MicrosoftAzureAI8 ай бұрын

    How different is this from the Add your data option in Azure Open AI that is available?

  • @TeylorMoretoGuaitolini
    @TeylorMoretoGuaitolini Жыл бұрын

    Great video! Thank you so much.

  • @turgutylmaz1043
    @turgutylmaz1043 Жыл бұрын

    Great Video Thanks ! Can I use the question part as an API for my application ?

  • @darkmatter5310
    @darkmatter531011 ай бұрын

    Thanks a lot MG! One issue I am facing after setup environment and upload documents; for Index I am getting error: Traceback (most recent call last): File "/usr/local/lib/python3.9/site-packages/openai/api_requestor.py", line 672, in _interpret_response_line data = json.loads(rbody) File "/usr/local/lib/python3.9/json/init.py".... it is long list of error. What I am doing wrong?

  • @sumangupta871
    @sumangupta8713 ай бұрын

    Hi, thanks for the nice video.. It would be great if you prepare a end to end tutorial video explaining the codes to develop such application from scratch.

  • @renetachon
    @renetachon9 ай бұрын

    Is this process suitable for sensitive data that should not be shared?

  • @ramvideo1
    @ramvideo111 ай бұрын

    OpenAI has private trained model for enterprises. Does it have Role-based access control for the Privately trained data in OpenAI? (like employees can access only their data; another employee cannot access his/her data)

  • @akshaysaju6223
    @akshaysaju62239 ай бұрын

    if i want to convert one programming language to another will this method useful?

  • @adilmajeed8439
    @adilmajeed8439 Жыл бұрын

    Great stuff, whats the possibility of using this as an api using power app so instead of using stand alone application

  • @Garycarlyle
    @Garycarlyle Жыл бұрын

    Could this be used for large data sets from a spreadsheet?

  • @machinegun1879
    @machinegun1879 Жыл бұрын

    what type of subscription do you have? what is the minimum subscription needed to do this?

  • @yixuangong5369
    @yixuangong53699 ай бұрын

    What a great video! I have one question regarding embeddings, I found current embeddings model is not working well in handling document with tables, do you have any ideas how to handle tables?

  • @MG_cafe

    @MG_cafe

    9 ай бұрын

    Thanks so much , please check out the video I posted : chat with your tabular /SQL data

  • @mhabert
    @mhabert7 ай бұрын

    How to deal with general questions related to my own documents ? Example: suppose i upload documents of a meeting transcription, and I my questions are: "how many people asked something during the meeting?" or "who many people participated in the meeting?" I understand that the embedding solution is good for specific questions, but my doubt is, can it deal with those type of general questions?

  • @nhannguyenvanhoang9638
    @nhannguyenvanhoang9638 Жыл бұрын

    I'm totally new to microsoft Azure, so which Azure's products (storage accounts, database,... ) should I choose in order to process this kind of model, and could you share the approximately price to run the model on monthly basis

  • @MG_cafe

    @MG_cafe

    Жыл бұрын

    you dont host the model. Microsoft will host and handle everything and you just call these models through API and get charged for it

  • @eje6265
    @eje6265 Жыл бұрын

    Can people outside of enterprise customers still get access to Azure OpenAI?

  • @xvmx.mp3
    @xvmx.mp3 Жыл бұрын

    Please make a video on how to do this locally in Python with Conda or venv. Thanks for the great video btw.

  • @shubham1993ification
    @shubham1993ification6 ай бұрын

    Will this work with CSV files as well?

  • @indianguy6683
    @indianguy668311 ай бұрын

    Is it possible to feed openai with search console api data of my site and get seo insights from it ?

  • @JohanNordberg
    @JohanNordberg Жыл бұрын

    I’m what ways is this different from connecting Cognitive Services Search to Azure OpenAI?

  • @drazmix
    @drazmix Жыл бұрын

    The questions look less open than what is possible via chatgpt3 or chatgpt4. It's as if you had to look for a direct quote from the text. Should we deduce that these data uploaded on the clood do not allow to ask questions as freely as on chatgpt itself ?

  • @MG_cafe

    @MG_cafe

    Жыл бұрын

    The questions were just for demo purpose but you can certainly question much more complex scenarios as you ask from ChatGPT. also check out Part 2 : kzread.info/dash/bejne/hJeY08aQdbzdYqQ.html

  • @midlifecrisis920
    @midlifecrisis920 Жыл бұрын

    Great video. I had a question. Does exposing your data to chatgpt make it public? Is it possible for me to not allow access to my data and yet train it using chatgpt algorithm? Much appreciate a response..

  • @gj4927

    @gj4927

    Жыл бұрын

    If you’re using the API they don’t store data or train their base model with your data… unless you opt in to allow them.

  • @sethitsseth
    @sethitsseth Жыл бұрын

    I subbed because of the message at the end

  • @MG_cafe

    @MG_cafe

    Жыл бұрын

    you made my day, thanks so much!

  • @a1b2c3452
    @a1b2c3452 Жыл бұрын

    How secure is this?sharing data with OpenAI?

  • @crazymohan2008
    @crazymohan2008 Жыл бұрын

    I can do this with a CSV file that has problem & solution columns?

  • @MG_cafe

    @MG_cafe

    Жыл бұрын

    definately you can

  • @adamlimh
    @adamlimh Жыл бұрын

    Is it more advantageous to utilize GPT-3.5 instead of Davinci for improved performance?

  • @xvmx.mp3

    @xvmx.mp3

    Жыл бұрын

    From my own experience, yes.

  • @adamlimh

    @adamlimh

    Жыл бұрын

    ​@@xvmx.mp3 i tried to deploy GPT3.5 on OpenAI engine but did not work

  • @saiprasad9183
    @saiprasad9183 Жыл бұрын

    hii their it was great exploitation , I have a doubt where dose the embeddings store and will we able to access them

  • @basemshoukry7018
    @basemshoukry70189 ай бұрын

    Is it possible to integrate ChatGPT with my existing database that contains around 40K products? I'm planning to create a chatbot using ChatGPT which can intelligently respond to user queries based on our current product availability. I'd appreciate any guidance or tips on how to achieve this.

  • @MG_cafe

    @MG_cafe

    9 ай бұрын

    Yes it is possible . Please check chat with SQL data video I uploaded

  • @Data_scientist_t3rmi
    @Data_scientist_t3rmi Жыл бұрын

    Hello, is it free to use ? i have azure but i do not know how much that will cost me. can i deploy it in local ? if yes is it free ?

  • @MG_cafe

    @MG_cafe

    Жыл бұрын

    You need to have azure open AI service deployed which is not free and it will be charging based as you go usage

  • @madanmaram276
    @madanmaram27610 ай бұрын

    Azure open ai fine-tuning is still unavailable, did anyone facing this issue, plz help me how to resolve this? My resource group region is South Central US not able to do custom fine-tuning..

  • @duckbreeder
    @duckbreeder5 ай бұрын

    謝謝!

  • @MG_cafe

    @MG_cafe

    5 ай бұрын

    Thanks so much !

  • @salimmimouni6465
    @salimmimouni6465 Жыл бұрын

    you need to set up an azure account, it is a hell and should take 2-3 working days. After half a day, I still cannot figure out where to find/define the key access to the blob storage service...

  • @MG_cafe

    @MG_cafe

    Жыл бұрын

    Open your storage account in the portal, click on the key on the left side and you should be able to see the key. if you already have azure evnoremnt with Open AI, it should be just several minutes to deploy this solution

  • @1242elena
    @1242elena10 ай бұрын

    Amazing 😍 any updates?

  • @Udayanverma
    @Udayanverma Жыл бұрын

    How can I set this up locally? I don’t wish to use any cloud service. Pl suggest

  • @MG_cafe

    @MG_cafe

    Жыл бұрын

    in the same github, try the local deployment option

  • @RandyEsguerra-ef2lv
    @RandyEsguerra-ef2lv Жыл бұрын

    Great video! Is it possible to feed data to chatGPT via API?

  • @MG_cafe

    @MG_cafe

    Жыл бұрын

    This is what this demo does

  • @massibob2004
    @massibob2004 Жыл бұрын

    Really good. How can we display the source of the document which contain the answer ?

  • @MG_cafe

    @MG_cafe

    Жыл бұрын

    Please check out part 2

  • @massibob2004

    @massibob2004

    Жыл бұрын

    @@MG_cafe I did. But I meant, without azure search 😉

  • @joeish
    @joeish Жыл бұрын

    I tried to deploy, all went well until I tried to use it. It just kept throwing errors at me.

  • @MG_cafe

    @MG_cafe

    Жыл бұрын

    double-check if you have the models deployed in your Azure OPen AI service with the same name chosen oni form deployment

  • @dilipkumaryadav9733
    @dilipkumaryadav973311 ай бұрын

    Can WE use sharepoint as data source?

  • @MG_cafe

    @MG_cafe

    11 ай бұрын

    Yes , check this out : kzread.info/dash/bejne/e5erxMx9j9G-d5c.html

  • @HombresTopG-bf9se
    @HombresTopG-bf9se Жыл бұрын

    Sent application to get the Azure Chatgpt permission. They expect a lot of company information, including company website, company phone number etc... Seems like they don't want anyone to just be playing around with it.

  • @user-ft5jj4lx2y
    @user-ft5jj4lx2y Жыл бұрын

    Is there a way to do website links?

  • @MG_cafe

    @MG_cafe

    Жыл бұрын

    Which website?

  • @umeshwartiwari5378
    @umeshwartiwari5378 Жыл бұрын

    बाते अच्छी हैं लेकिन विज्ञापन भययुक्त है।

  • @ashishjohnsonburself
    @ashishjohnsonburself Жыл бұрын

    Can I use chatgpt with cognitive search ?

  • @MG_cafe

    @MG_cafe

    Жыл бұрын

    Absolutely you can ! :)

  • @ashishjohnsonburself

    @ashishjohnsonburself

    Жыл бұрын

    @@MG_cafe is it like we use cognitive search to get all the relevant docs and then pass it on to chatgpt for completion of the query ?

  • @MG_cafe

    @MG_cafe

    Жыл бұрын

    @@ashishjohnsonburself Exactly! Check this put : github.com/Azure-Samples/azure-search-openai-demo

  • @ashishjohnsonburself

    @ashishjohnsonburself

    Жыл бұрын

    @@MG_cafe Thanks for this link. I'm building enterprise grade solutions(where scalability matters) to the customers. Should i go with (Cognitive search+chatgpt) combination or (redis + chatgpt) combination or (langchain+chatgpt) combination ?

  • @ashishjohnsonburself

    @ashishjohnsonburself

    Жыл бұрын

    @MG if my question doesn't make sense, please do let me know. Thanks

  • @AntonioKrizmanic
    @AntonioKrizmanic10 ай бұрын

    I love this video. However, please be careful - the way this is implemented and the way the methods are used results in some major problems. 1) There are some (surprisingly high) costs - I have spent 60$ on the search alg in the background of the site application that gets deployed on Azure. This has happened with less than 20 documents with less than 2000 tokens uploaded. There is no justification for such a cost other than the implementation not being that great or the algs/chains in the background being needlessly complex. 2) The control you have over the little, but important parts of your implementations is not optimal. Examples and history have to be manually given to the prompt, you have no power over the way in which the files are sliced when the embedding is happening, you have no control over the size of the docs being retrieved from your index (dataset of text slices). 3) The flexibility is not that great and you need to go the extra mile to change the models used (for translation, embedding and chat), you do not know how many instances of them are running in the background, nothing. I know this is extremely convenient, but I think it is cheaper and overall better to spend three days on learning LangChain than it is to depend on this solution - automatic example generation and selection, easy to use prompt templates, different kinds of history generation that can be combined into one that culminate into one great solution for building ChatBots.

  • @Just-My-Opinion

    @Just-My-Opinion

    8 ай бұрын

    Is langchang able to run private? I believe azure openai is HIPPA compliant

  • @holliday69
    @holliday6910 ай бұрын

    You guys are hilarious.

  • @darrenfinch9815
    @darrenfinch9815 Жыл бұрын

    Ive been trying to convert data into a table, less than one page of data, Chatgpt only does less than half, not worth using it at this stage

  • @MG_cafe

    @MG_cafe

    Жыл бұрын

    GPT4 has higher token limit which can help further

  • @silentobserver964

    @silentobserver964

    Жыл бұрын

    I thought what you’re doing here is not limited to the token size?

  • @shaliniksshaliniks8934
    @shaliniksshaliniks8934 Жыл бұрын

    .......durgaparamesvari devi.......

  • @mjlone6016

    @mjlone6016

    Жыл бұрын

    😊

  • @DihelsonMendonca
    @DihelsonMendonca Жыл бұрын

    ⚠️ I'd like ChatGPT read all my book's library, so that I could research easily.

  • @MG_cafe

    @MG_cafe

    Жыл бұрын

    certainly possible :)

  • @jagatchaitanyaprabhala8668
    @jagatchaitanyaprabhala8668 Жыл бұрын

    its document embedding not word embedding

  • @will201084
    @will2010846 ай бұрын

    Aka give your data to the AI machine

  • @brsrkr
    @brsrkr Жыл бұрын

    iranians?

  • @Because_Reasons
    @Because_Reasons Жыл бұрын

    Hilarious

  • @ttclac
    @ttclac Жыл бұрын

    Hi, your video is awesome! I need this for my company. Do you freelance? Pls contact me if you do. Thank you.

  • @MG_cafe

    @MG_cafe

    Жыл бұрын

    Please send me an email , happy to help you : mo.Ghodrati95@gmail.com

  • @ttclac

    @ttclac

    Жыл бұрын

    @@MG_cafe ok I’ll email you. Thank you!

Келесі