How to use Azure OpenAI on your Data with Copilot Studio

Ғылым және технология

You can use Azure OpenAI on your data to add sophisticated AI search capabilities, and then deploy that into Copilot Studio, connecting up your low copilot with Azure AI resources and the latest GPT large language models.
This video takes you end to end through how to set this up:
- Deploy your Azure resources
- Add and index your data using Azure AI Search
- Deploy a model in Azure OpenAI Studio and connect your data
- Deploy your model to Microsoft Copilot Studio
-------------------------------------------------------
Connect with me:
☕ Buy me a coffee: www.buymeacoffee.com/lisacrosbie
🦉 Learn more about AI: aka.ms/learnwithlisa
🖇 LinkedIn: / lisa-crosbie
📼 TikTok: / lisa.crosbie
🐦 X (Twitter): / lisacrosbie
📚Take my LinkedIn Learning Course: Microsoft Power Platform Fundamentals (PL-900) Exam: Power Apps / microsoft-power-platfo...

Пікірлер: 93

  • @LisaCrosbie
    @LisaCrosbie3 ай бұрын

    Connect with me: ☕ Buy me a coffee: www.buymeacoffee.com/lisacrosbie 🦉 Learn more about AI: aka.ms/learnwithlisa 🖇 LinkedIn: www.linkedin.com/in/lisa-crosbie/ 📼 TikTok: www.tiktok.com/@lisa.crosbie 🐦 X (Twitter): twitter.com/LisaCrosbie 📚Take my LinkedIn Learning Course: Microsoft Power Platform Fundamentals (PL-900) Exam: Power Apps www.linkedin.com/learning/microsoft-power-platform-fundamentals-pl-900-cert-prep-power-apps/

  • @manuscripts_wav
    @manuscripts_wavАй бұрын

    This is one of the best Copilot Studio + OpenAI integration demos I've seen so far! Even better that what the official MSFT documentation has to offer. Thank you so much Lisa for putting this amazing content together.

  • @aurikdatta8373
    @aurikdatta83732 ай бұрын

    Hey Lisa! Thanks a bunch for this, it's quite painful to go through all this with just documentation haha. Your videos have been super helpful and informative!

  • @ninabrown7353
    @ninabrown73532 ай бұрын

    Thank you Lisa!! Fantastic video and exactly what I have been looking for

  • @m3-dev
    @m3-dev2 ай бұрын

    Thank you for this! I'd love to see more on taking things to the next level!!

  • @gutosutto123
    @gutosutto1232 ай бұрын

    Fantastic tutorial. I'm going to try implement copilot. I made a chat in the PVA, as you said, I had to build all topics manually in previous version. But now it seems so easy to create and more effective. Thank you for teaching.

  • @ArohShukla
    @ArohShukla2 ай бұрын

    Great video and it can be used in many organization. Thanks for sharing.

  • @SolvedSystems
    @SolvedSystems2 ай бұрын

    Thanks for the video. I am a dev myself and i'm trying to learn low code RAG stack. This is wonderful and helped me consolidate my ideas.

  • @denwo1982
    @denwo19822 ай бұрын

    Very good Lisa! Yes more content please, especially around pdf uploads

  • @makarandkhadakban8281
    @makarandkhadakban8281Ай бұрын

    Thank you Lisa, your videos makes me learn things faster than going through documentation. And as you mentioned I'm interested in detailed videos on copilot studio with azure studio.

  • @khallinan1
    @khallinan12 ай бұрын

    This video describes a game changer! Thank you!

  • @PowerAppsTutorial
    @PowerAppsTutorial3 ай бұрын

    Thanks @lisa! I need to get to learning Copilot Studio!! I'd love to learn what this fabric thing is too!!

  • @EihabFitness
    @EihabFitnessАй бұрын

    Fantastic video thank you, waiting for the SPO one :)

  • @samrahman6985
    @samrahman6985Ай бұрын

    Great content. Learnt alot in 15 minutes!

  • @fallinginthed33p
    @fallinginthed33p23 күн бұрын

    This is great: a low-code RAG setup combining Azure OpenAI, AI/Cognitive Search, Sharepoint or Blob Storage. No more rolling your own by gluing together different vector databases, embedding models and large language models and hoping it all works.

  • @StephenDix

    @StephenDix

    17 күн бұрын

    That tech is so 2023! 😆

  • @RodrigoTrindade100
    @RodrigoTrindade1002 ай бұрын

    Hello Lisa, the video content is wonderful. I was looking for this solution, but it's hard to find even in English, let alone in Portuguese, my language. I work in a multi-family office with process management, and AI is breaking the paradigm. I've done some things with AI Builder, but there are certain limitations. Thank you very much for the content, and I would love to delve deeper. I'm building a model where employees will insert the descriptions of their processes via Power Apps in a structured way, and AI will unify it into a single content, being the brain of the company. From this point, we will have an unimaginable gain in business management, knowledge, and change... and much more. I'm very excited about all this. Thank you very much.

  • @krunaltrivedi4154
    @krunaltrivedi415412 күн бұрын

    Awesome !

  • @user-qm4px8bv1o
    @user-qm4px8bv1o2 ай бұрын

    Hi it was Great video loved it. Does the create generative answer return only maximum of 3 references.

  • @karliszemitis8264
    @karliszemitis8264Ай бұрын

    Good demo

  • @progurlz
    @progurlz2 ай бұрын

    Thank you for the video, Lisa! Is it fairly straightforward to then host this copilot on a Sharepoint site?

  • @marcoerlwein2165
    @marcoerlwein21652 ай бұрын

    Thanks Lisa, very illustrative, can I integrate the new Copilot created from Powerapps or from a Web Application, or can I only use it from Copiloit Studio?

  • @RobFahndrich1
    @RobFahndrich12 ай бұрын

    Great video. Is it possible to connect to a data model that is in Fabric?

  • @jerrysantana3698
    @jerrysantana3698Ай бұрын

    Super clear and concise! Just one question though, wouldn't be better to have a centralize place for a Copilot design? It's super confusing which tools are the right ones to develop a simple copilot: - Copilot studio - Open AI studio - Power apps - .. azure AI resources. I think it would be amazing to have a simple, centralized place for all AI experience. If you can make a video explaining each tool, that would be super helpful! Thank you!

  • @user-yj6jn6ld2c
    @user-yj6jn6ld2c2 ай бұрын

    Hi, thanks for the great video! I've been testing Azure OpenAI on your Data, as well as 365 Copilot (mainly 365 Chat) and comparing the performance for the purpose of getting quick answers to information contained in PDFs (and other types of documents as well). 365 Copilot Chat does okay with general questions ("Summarize this document", "What are the main takeaways of this contract?"), but really struggles with more precise questions ("What is the agreed bonus on this contract?", "What are the special clauses pertaining to confidentiality in this document?"). FYI, I use it mainly with PDFs stored on a SharePoint team site. In comparison, Azure OpenAI on your Data is much better. It is able to answer with great precision on even the most specific questions. Why do you think that is? I was under the assumption that Microsoft would use the capabilities present in "Azure OpenAI on your Data" for their 365 Copilot. Do you think it might improve with time, until we actually get the same performance on both? Thanks !

  • @wernerkoegelenberg2721
    @wernerkoegelenberg2721Ай бұрын

    Great demo @LisaCrosbie. My AI Studio only has a "Export to as Web App". Am I doing something wrong?

  • @lornasimes6654
    @lornasimes665419 күн бұрын

    This was so informative, thank you Lisa. I'd love to see a video with Sharepoint as the data source, and perhaps using Power Automate and the Graph API to extract the data and push it forward into Generative Answers. I'm hoping that something like this would "get around" the two levels down search limitation for Sharepoint. Thoughts??

  • @Holiodjdj
    @HoliodjdjАй бұрын

    Thank you for the great explanation. I have question here. I am working at a cloud billing position and hope i can use azureAI and copilot studio instantly for my tasks.(overview each subscription's monthly and annual cost / automatically make an esimate) Is it possible for now or impossible since it says it's only preview version?

  • 2 ай бұрын

    Excellent Lisa! So, we can say that you connected a GTP-4 model to your copilot, right? in that case, if you ask something that is not in the data source, for example: "what is the number of countries in Asia ?" the chatbot will be able to answer that? I´m interesting in creating a chatbot in Copilot Studio that uses GPT-3.5 turbo model enhanced with some data, so if I ask the chatbot about the data it will give some references but if I ask the chatbot about a general question, like the example above, it will be able to answer that too

  • @thedatascientist-lg4ls
    @thedatascientist-lg4ls29 күн бұрын

    That's a great video, Lisa. However, can Microsoft Copilot Studio chatbot both use custom data for specific info like order tracking and be conversational (using an LLM or GPT)? For instance, offering choices like: "Your order is damaged. Would you prefer a refund or a replacement?

  • @SgMechanic
    @SgMechanicАй бұрын

    Thank you for this insightful video! It's been just as helpful as your previous ones. However, I'm encountering an issue that I can't seem to pinpoint the source of. In Azure Open AI Studio, there are two possible ways to deploy your chatbot with your own data : through the web application or using the Copilot studio. Yet, I'm facing some confusion. It's my understanding that the Copilot studio utilizes a connection with Azure Open AI. So, why are the responses different between these two methods? The index that was created from the indexer that point to a blob starage with documents, deployment model, and all parameters remain consistent. What could be the reason behind these differing responses, or even worse, the lack of response to certain prompts?

  • @nathanhaws5838
    @nathanhaws58383 ай бұрын

    Brilliant video. I'm getting my license to Copilot studio this week and I'm very excited to test it out. For this video, what other licenses did you need to achieve this? I thought I saw Visual Studio Enterprise on screen at one point. Thanks!

  • @cwanja89

    @cwanja89

    2 ай бұрын

    No other Power Platform licenses, but you would need Azure credits or pay for Azure consumption against the Azure resources you deployed.

  • @LisaCrosbie

    @LisaCrosbie

    2 ай бұрын

    Yes, you need an Azure Subscription (mine is called Visual Studio Enterprise), and then you pay for whatever yo consume, the Azure AI Search resource here has varying prices depending on how complex your data and search needs to be. Then you pay for the usage of whatever model you deploy in OpenAI Studio.

  • @nhtna4706

    @nhtna4706

    Ай бұрын

    What is the pricing like?? Any realistic numbers given a scenario where u use it the whole month?

  • @mmouz2
    @mmouz22 ай бұрын

    The room details are not showing up in the mapping field. Is it because its a complex type?

  • @MichaelJulyusChristopher
    @MichaelJulyusChristopherАй бұрын

    Thank you for the great tutorial. However, how to build a Copilot chatbot in Power BI that can answer questions based on the data we use in the Power BI report? Because the copilot currently available in Power BI can only answer simple questions and create simple summaries based on existing visualizations. Thanks in advance, Lisa!

  • @flyingbrains1978
    @flyingbrains19782 ай бұрын

    it would be great to see an implementation with data from PowerBI or Where the PVA uses Flow as a skill to complete an action

  • @bi-ome

    @bi-ome

    2 ай бұрын

    Getting data from Power BI would require AI to be good at writing DAX (unless you’re pre-baking all the queries). Maybe we will get there soon. 😅

  • @LisaCrosbie

    @LisaCrosbie

    2 ай бұрын

    Power BI has its own natural language/Copilot experience, i'd be looking at that rather than trying to build it. Or else connect this (PVA) Copilot to the original data source underneath Power BI.

  • @khallinan1
    @khallinan12 ай бұрын

    Would be great to see a video where multiple copilots created in this form can work cooperatively.

  • @khushrah22
    @khushrah222 ай бұрын

    Thanks for sharing the valuable topic, I am definitely going to try the hands on it as I have the use case ready and was waiting for client approval :D

  • @LisaCrosbie

    @LisaCrosbie

    2 ай бұрын

    Awesome, good luck!

  • @indianapapi
    @indianapapi2 ай бұрын

    Great video, Lisa. I am new to your content and really enjoyed the knowledge. Could you zoom in next time so that we can see what you are working on more clearly? You know, for us 40-year-olds, lol!

  • @LisaCrosbie

    @LisaCrosbie

    2 ай бұрын

    Oh, i feel that pain too - noted for future, thanks.

  • @rocio6454
    @rocio64542 ай бұрын

    Hello, thanks for the video. I am currently working on a project and i am finding a big issue. I would like to know from your expertise to see if there is a possible solution. I have documents with sensitive data that i have to extract, however it seems that the new security features do not allow to extract names, dni, nif, etc. Some months ago this solution worked but now, not anymore. Do you know if there is any way to fix it? Thank you so much, i hope you or someone can help me.

  • @microsoftbizappsfico
    @microsoftbizappsfico2 ай бұрын

    Hi Lisa, Do you have any information on the additional costs of the Azure Open AI integration to Copilot Studio?

  • @LisaCrosbie

    @LisaCrosbie

    2 ай бұрын

    Here's the pricing azure.microsoft.com/en-au/pricing/details/cognitive-services/openai-service/

  • @libran3king
    @libran3kingАй бұрын

    what is the significance of Azure bot service now ? when and how it can be used in conjunction with copilot studio ?

  • @kulabs
    @kulabsАй бұрын

    I have a content website that has multiple layers of subpages which have content on webpage. How do I ensure that the right subpage is picked based on the chat context. For example - country details with pages by country and based on the chat how can I ensure it determines the right country and accesses the right page?

  • @rupeshvr1006
    @rupeshvr1006Ай бұрын

    Fantastic video; it would be amazing if you could do a video using Sharepoint as your data source.

  • @LisaCrosbie

    @LisaCrosbie

    Ай бұрын

    Working on it! Thanks.

  • @abktmxcf
    @abktmxcfАй бұрын

    Hi Lisa, Great content as always!! For some reason I am unable to get the Connection to register in Copilot Studio after completing all the other steps. I know that it goes to Default and have seen ways to get past that (unsuccessfully though). Can you point me in a direction here, video or any other points I might be missing?

  • @abktmxcf

    @abktmxcf

    Ай бұрын

    BTW, I am unable to create a new Azure Open AI Connection in Power Plat

  • @LisaCrosbie

    @LisaCrosbie

    Ай бұрын

    At the moment it only works in a US environment and goes to the default environment. If you are outside the US, here's the workaround (which is what I used, I just didn't record it). powerusers.microsoft.com/t5/General/Azure-OpenAI-on-your-data-deploying-to-a-different-environment/m-p/2316247/thread-id/6412#M6413

  • @aurikdatta8373
    @aurikdatta83732 ай бұрын

    is there any way to skip the OpenAI resource here? Could I directly connect an Azure AI Search resource with Copilot Studio?

  • @3attialeo
    @3attialeoАй бұрын

    we need to integrate the questions and answers to be voice to your created system workflow

  • @islamshaban216
    @islamshaban2163 ай бұрын

    Nice 😊 Can we use the Azure AI search for multiple bots or one AI search per bot?

  • @LisaCrosbie

    @LisaCrosbie

    2 ай бұрын

    It should work to add the same AI search to multiple bots. In each bot go into the Conversation Boost topic and edit the data source and select your Azure OpenAI deployment.

  • @Bhrugujani
    @Bhrugujani2 ай бұрын

    Hi thanks for the tutorial - it is really useful. somehow I am not able to add OpenAI connection in copilot - are you entering it manually (14.35 frame) ? there must be connection

  • @LisaCrosbie

    @LisaCrosbie

    2 ай бұрын

    At the moment it only works in a US environment and goes to the default environment. If you are outside the US, here's the workaround (which is what I used, I just didn't record it). powerusers.microsoft.com/t5/General/Azure-OpenAI-on-your-data-deploying-to-a-different-environment/m-p/2316247/thread-id/6412#M6413

  • @krunaltrivedi4154
    @krunaltrivedi415422 күн бұрын

    Hey @LisaCrosbie. I am trying to implement it but I do not get Azure OpenAI option when I deploy my OpenAI model to Copilot Studio and add Conversational Boosting Topic. Would you please guide me? Thanks in advance

  • @MohsinKhanAli
    @MohsinKhanAliАй бұрын

    How I can integrate on prem. Confluence site with copilot studio chat bot? Is there any easy solution?

  • @blacktergum
    @blacktergum2 ай бұрын

    Hi Lisa, thanks for the video. I tested it for myself and somehow the topic "conversational boosting" is not created automatically when i deploy it from Azure OpenAI Studio. Do you have any tips to get it working?

  • @LisaCrosbie

    @LisaCrosbie

    2 ай бұрын

    At the moment it only works in a US environment and goes to the default environment. If you are outside the US, here's the workaround (which is what I used, I just didn't record it). powerusers.microsoft.com/t5/General/Azure-OpenAI-on-your-data-deploying-to-a-different-environment/m-p/2316247/thread-id/6412#M6413

  • @blacktergum

    @blacktergum

    Ай бұрын

    @@LisaCrosbie thanks for the link. yeah I'm outside the US. When clicking on the deploy to Copilot Studio button it is directing me to the correct environment and a connection is automatically created. Just the automatically created chatbot is not getting the "conversational boosting" topic automatically. I can enable the conversational boosting in the chatbot settings, then it gets created. In the create generative answer activity I can select the azure open connection, but it is not working. I always get an empty response back. Do you have any advice for that?

  • @user-wg4pb4py8q
    @user-wg4pb4py8q2 ай бұрын

    Hey Lisa! I noticed that for you the connection was automatically made, when my copilot is created nothing is automatically made, do you know why this is the case?

  • @LisaCrosbie

    @LisaCrosbie

    2 ай бұрын

    At the moment it only works in a US environment and goes to the default environment. If you are outside the US, here's the workaround (which is what I used, I just didn't record it). powerusers.microsoft.com/t5/General/Azure-OpenAI-on-your-data-deploying-to-a-different-environment/m-p/2316247/thread-id/6412#M6413

  • @user-wg4pb4py8q

    @user-wg4pb4py8q

    2 ай бұрын

    Hey @@LisaCrosbie Thanks for the reply! I took a look at the article and it still does not work as expected in the france central env. It also specifically states: "as of now, only environments located in the US region can have that feature)" Did you also deploy your Copilot on an EU env or an US one?

  • @mruminer
    @mruminer19 күн бұрын

    Lisa, what tool(s) do you use to make your videos?

  • @LisaCrosbie

    @LisaCrosbie

    19 күн бұрын

    I have a Shure M7 microphone, Elgato Facecam, one Elgato key light, Camtasia for recording and editing. The microphone and webcam are recent upgrades, I did everything for the first 3 years with a Logitech C920 webcam and blue yeti microphone. Nothing fancy.

  • @mruminer

    @mruminer

    19 күн бұрын

    @@LisaCrosbie Excellent. Thank you. Seems Camtasia has come a long way since the last time I looked at it. Well done.

  • @Bhrugujani
    @Bhrugujani2 ай бұрын

    Would you please export conversational boosting topic as it is no longer available for me in my Environment

  • @LisaCrosbie

    @LisaCrosbie

    2 ай бұрын

    Check that in settings - Generative AI - you have generative answers switched on. If that doesn't solve it, I'd suggest posting in the Copilot studio community forum for help. powerusers.microsoft.com/t5/Copilot-Studio-Community/ct-p/PVACommunity

  • @vatsalyaupadhyay9718
    @vatsalyaupadhyay971819 күн бұрын

    i want to make copilot studio make learn how is it possible

  • @alsakrr2011
    @alsakrr2011Ай бұрын

    Thanks for the video, very helpful. However, after I publish to Copilto Studio from OpenAI portal, the OpenAI connection isn't appearing under the data sources. Additionally, when I attempt to add the connection manually, it displays "No connection to show." . Any idea what might be the reason?

  • @pooneh1894

    @pooneh1894

    Ай бұрын

    I also have a similar problem. I can see the connection and select it but it doesn't fill the other fields automatically. Have you found a solution?

  • @deonemyr3949

    @deonemyr3949

    Ай бұрын

    Same problem too@@pooneh1894

  • @alsakrr2011

    @alsakrr2011

    Ай бұрын

    @@pooneh1894 No, I can't even find the connection in the first place :/

  • @Tarak_Tech
    @Tarak_Tech18 күн бұрын

    Kindly provide a video for sharepoint online as datasource please

  • @LisaCrosbie

    @LisaCrosbie

    15 күн бұрын

    It’s on my (very long!) list, thanks for upvoting it ☺️

  • @pooneh1894

    @pooneh1894

    14 күн бұрын

    @@LisaCrosbie Cant wait to see that video. Thanks

  • @user-gc4pq5jv3p
    @user-gc4pq5jv3p2 ай бұрын

    Hello Lisa, I tried to do the exaxt same steps as you did in te video, but the copilot doesnt work properly, the system topic about conversational bossting does not appeard and when i tried to do the topic manually the conecction doesnt work as is should, because all the details like the Deployment are in blank, could it be because im in Europe? thanks in advance

  • @LisaCrosbie

    @LisaCrosbie

    2 ай бұрын

    Yes, it is because you're in Europe. This only works on a US environment at the moment - here's the workaround for now. powerusers.microsoft.com/t5/General/Azure-OpenAI-on-your-data-deploying-to-a-different-environment/m-p/2316247/thread-id/6412#M6413

  • @pooneh1894

    @pooneh1894

    14 күн бұрын

    @@LisaCrosbie does this integration between Copilot Studio and Azure Open AI works in Europe now?

  • @t00nfish
    @t00nfishАй бұрын

    „No more darkmode, I’m afraid“ 😎

  • @mruminer
    @mruminer14 күн бұрын

    Found one issue in this. It seems having access to Azure OpenAI Studio is beyond the limits of most of us mere mortals. 🙂 Those of us not coming through an org or being an MVP/RD Will have to wait for it to become truly publicly available.

  • @LisaCrosbie

    @LisaCrosbie

    14 күн бұрын

    At this stage yes, you do have to apply for access if you have a use case.

  • @mruminer

    @mruminer

    14 күн бұрын

    I got into the preview. Not sure how that happened. :-)

  • @DarinThornton
    @DarinThornton16 күн бұрын

    Just giving a heads up to anyone trying to follow this tutorial. Using the exact steps in the video the responses are very poor outside of the one shown in the video. Asking about different states and cities returns Hotels from wrong states, and none of the data outside of the descriptions are accessible by the model, making almost all the data in the table useless.

  • @LisaCrosbie

    @LisaCrosbie

    15 күн бұрын

    Can you give me the exact questions you’re using and I’ll give it a try.

  • @AudrieGordon
    @AudrieGordon16 күн бұрын

    Awesome!

Келесі