
OpenAI has launched its Realtime API, which is now in public preview on Azure OpenAI Service. This new API enables real-time, human-like conversations and multilingual mastery for applications. The Realtime API was announced during OpenAI's Dev Day and is expected to be a game-changer for developers looking to build lifelike voice-to-voice experiences. The API supports function calling and will soon be multimodal, handling both text and audio inputs and outputs. Microsoft has also announced new products and features for the Azure OpenAI Service, including the GPT-4o-Realtime-Preview with advanced audio and speech capabilities. The GPT-4o Audio Realtime API promises a 300ms response time.