Sources
Additional media
Loading...

OpenAI has recently launched its new Realtime API, which supports both text and audio inputs and outputs, utilizing WebSockets for persistent connections. This API enables real-time communication and function calling capabilities, allowing users to interact with AI models in innovative ways. The Realtime API has been integrated into various applications, including voice agents that can control browsers and crawl websites. Notable integrations include Chainlit Realtime and LangChain's TypeScript example. Additionally, OpenAI has introduced the o1 model, which enhances AI reasoning capabilities, making it more useful for scientific applications. Researchers have praised the o1 model for its significant improvements in chatbot functionality.



