Sources
Additional media



LLaMA-Omni, an open-source AI model, is emerging as a strong competitor to established voice assistants like Siri and Alexa. Developed with a backbone of Llama 3.1 8B Instruct, it features a speech encoder using Whisper Large v3 and a speech decoder called HuBERT (UnitY). The model is designed for low-latency speech interaction, capable of generating both text and speech responses simultaneously with less than 250 ms latency. This Apache licensed innovation positions LLaMA-Omni as a significant player in the AI and voice assistant market.