How To Use the NEW Streaming Feature in OpenAI Assistants API

Ғылым және технология

⚡️ Discover how streaming transforms AI agent interactions, making them faster and more intuitive than ever before-unlock the full potential of OpenAI's Assistants API! 🚀
📝 Collab notebook:
colab.research.google.com/dri...
🤖 AI Agents for Your Business:
agents.vrsen.ai/
🔋 OAI-Widget (My SaaS)👇
www.oai-widget.com/
🚀 Custom AI Projects:
www.vrsen.ai/
🤝 Consulting/coaching:
calendly.com/vrsen/ai-project...
🐦 Twitter:
/ __vrsen__
💬 Discord:
/ discord
00:00 - Intro
00:45- What is Streaming?
03:30 - Assistants API Streaming Tutorial
08:47 - Agency Swarm with Streaming
10:30 - Production Tips
About: Uncover the pivotal role of streaming in optimizing AI agents within OpenAI's Assistants API in this insightful video. Streaming isn't just about real-time data; it's a game-changer for AI interactions, significantly reducing latency to enhance user experiences. Discover how streaming benefits both users and AI agents, like ChatGPT, by facilitating immediate and engaging communication. This guide offers a step-by-step tutorial on integrating streaming into your AI applications, using the Assistants API and the Agency Swarm framework. Whether you're developing front-end applications or curious about backend integrations, learn how to leverage streaming for better responsiveness and satisfaction. Dive into the essentials of streaming for AI agents today and ensure your business stays ahead in the AI revolution. Subscribe for more expert advice on AI advancements.

Пікірлер: 39

  • @vrsen
    @vrsen2 ай бұрын

    Hey everyone👋, we are currently looking for AI Agent Developers to join our team. Please apply in our discord in job-posts channel if you are interested. (link in description) Thanks!

  • @ailxes

    @ailxes

    2 ай бұрын

    Im interested in creating an AI agent for a small project with a finite amount of knowledge database with use for RAG purely for context with fixed API costs. How do I contact you?

  • @AIPlayGrounds
    @AIPlayGrounds2 ай бұрын

    Bro you are a gem, other creators didn’t understand the streaming that’s why they didn’t talk about it. Great value 👏

  • @vrsen

    @vrsen

    2 ай бұрын

    🙌

  • @alexanderholmefjord-sarabi3402
    @alexanderholmefjord-sarabi34022 ай бұрын

    thanks for the videos, i think you're one of the very few whose ideas have change the way i approach these tools

  • @ronsijm
    @ronsijm2 ай бұрын

    Streaming is sick. I made an internal slack bot for people to chat with. First I wasn't using steaming, and whenever people were chatting with it, I needed to wait for the entire request, and everyone was complaining the bot was shit and slow. Then I build in a streaming function, now the bot is creating a slack message almost instantly, and then editting the message as the words are coming in from OpenAI. Now the bot is preferred over using the ChatGPT web-interface, because people don't have to context-switch from slack to the browser

  • @IdPreferNot1
    @IdPreferNot12 ай бұрын

    Love the details.

  • @7polletes
    @7polletes2 ай бұрын

    By the way i’d love to learn about your saas development process. It would be incredible.

  • @amandamate9117
    @amandamate91172 ай бұрын

    did you tried to use your agency swarm with some Claude 3 model like the cheap Haiku that is beating gpt-4?

  • @raymondwienand8177
    @raymondwienand81772 ай бұрын

    Great info! I would like your opinion on Devin.

  • @MushtaqPatel-up1fb
    @MushtaqPatel-up1fbАй бұрын

    Hello Arsenni, Thanks for the all informative nad great value videos. Could you please create the playlist so it we will easy to follow and watch? Currently, there is no order in video which one to go first.

  • @vrsen

    @vrsen

    Ай бұрын

    Right, will do. Thanks

  • @NiklasOtto
    @NiklasOtto2 ай бұрын

    Hello @vrsen, what are the advantages/disadvantages of Agency Swarm compared to Crew AI?

  • @itaitevet
    @itaitevet2 ай бұрын

    Hi, how could you add a knowledge base to agency swarm? For example, how would you train the AI based on your previous Facebook posts to create new ones with a similar style? Thanks!

  • @AiDevHamza
    @AiDevHamza2 ай бұрын

    Hey nice video! I would really love to know the development process of your saas platform, I want to Launch my own AI SAAS but I have a lot questions and confusions in my head.

  • @jakobdango170
    @jakobdango1702 ай бұрын

    Hey just curious have u stuided cs or gathered team of devs and u mostly run ideas and business and sales

  • @vrsen

    @vrsen

    2 ай бұрын

    Yes, I studied CS, but dropped out of college after my first year. After that I read a ton of books on AI and worked as a freelance ML engineer for 3 years. I am still quite involved in coding, however I am trying to focus more and more on design work, rather than on implementation.

  • @ytvids.io123

    @ytvids.io123

    2 ай бұрын

    @@vrsen Hey do you have a way to account the tokens in my loved framework Agency Swarm.. Appreciate your efforts!

  • @7polletes
    @7polletes2 ай бұрын

    Go go go!!

  • @selftaughtDevv
    @selftaughtDevv2 ай бұрын

    hi VRSEN can you create a video based on perplexity online llms and can I use their API endpoint which offers vast LLMs for creating agents

  • @djilalifaycal2191
    @djilalifaycal21912 ай бұрын

    hi ,i have app use twilio to get a vioce query from user than take that query to gpt model to get a response than sand this response to twilio to respod to user my probleme is whene user speak its take so long to respond any idea

  • @vrsen

    @vrsen

    2 ай бұрын

    I don’t think you can use gpt streaming, because if you are sending back a text, you need to have a complete response anyway. The only way to reduce latency in this case is use a smaller model. However, if you are sending back voice on a call, you could probably use streaming when generating voice from TTS model.

  • @sendmepackets
    @sendmepackets2 ай бұрын

    Such a brilliant approach

  • @____2080_____
    @____2080_____2 ай бұрын

    Definitely would like to hear a video but is that something that someone can call you and consult about?

  • @vrsen

    @vrsen

    2 ай бұрын

    Yes, of course. You can use a link in the description. I reveal any secrets and insights for my consulting clients

  • @cesargaray5809

    @cesargaray5809

    Ай бұрын

    ​@@vrsen The website does not work in the creation part of openai

  • @cesargaray5809
    @cesargaray5809Ай бұрын

    The website does not work in the creation part of openai

  • @zackmartin00
    @zackmartin002 ай бұрын

    Do you work with smb?

  • @vrsen

    @vrsen

    2 ай бұрын

    Yes, checkout agents.vrsen.ai/

  • @cesargaray5809

    @cesargaray5809

    Ай бұрын

    @@vrsen kzread.info/dash/bejne/m3yKspmMm9O7eKg.html

  • @kazmi401
    @kazmi4012 ай бұрын

    This man is nice. But why is so underrated on youtube. Keep it up man.❣

  • @2008tmp
    @2008tmp2 ай бұрын

    The big problem is that assistants API costs are uncontrollable. Until they fix the back-end and billing model, they are useless for anything but a demo.

  • @vrsen

    @vrsen

    2 ай бұрын

    Yes you are right. They definitely need a way to control amount of tokens that goes into the model. I am sure they will add it soon. In the meantime, I recommend just creating new threads as needed

  • @technologyforyou7621
    @technologyforyou76212 ай бұрын

    All talks n no practice step by step funct

  • @cesargaray5809

    @cesargaray5809

    Ай бұрын

    The website does not work in the creation part of openai

Келесі