[PowerApps] MULTIMODAL GPT-4 and WHISPER in Canvas Apps

In this video I show how you can connect to the new OpenAI models - MULTIMODAL GPT-4 VISION and the transcription model WHISPER in Power Apps with the help of Power Automate.
Also interesting:
• [PowerApps] Finally co... Connect to ChatGPT
• [PowerApps] Use the in... OpenAI Connector
Music from musicfox.com

Пікірлер: 8

  • @daniellesutton6059
    @daniellesutton60592 ай бұрын

    awesome video! i've been having troubles with the json, is there any chance you could share the json code?

  • @R2Power

    @R2Power

    2 ай бұрын

    OpenAI documentation is pretty good and has good examples. They can explain their API better than I ever could 😉 platform.openai.com/docs/api-reference/chat

  • @shreyayadav2131
    @shreyayadav2131Ай бұрын

    How to use it for mobile . I am facing the error of unsupported audio format

  • @R2Power

    @R2Power

    Ай бұрын

    Haven't found a solution for that. Seems like the API doesn't support the Android/iOS audio formats 😢

  • @robinsovasco1900
    @robinsovasco19003 ай бұрын

    Hello, how do you get full screen in development mode?

  • @R2Power

    @R2Power

    2 ай бұрын

    Press F11 (works in every Browser Window)

  • @Amersfoort10
    @Amersfoort105 ай бұрын

    I use the following command without a flow to convert a microphone recording to a text: Set(mySpokenText; Whisper.Speech2Text(Microphone.Audio; "audio.wbmp"; "whisper-1"; {'Content-Type': "multipart/form-data"})) What is the advantage of your flow solution?

  • @R2Power

    @R2Power

    5 ай бұрын

    No, just didn't get it to work... Could you upload the yaml/JSON for your connector?