Sources
Additional media









Recent advancements in artificial intelligence have introduced several innovative models aimed at improving efficiency and performance in various domains. GemFilter, a new training-free and broadly applicable approach, significantly accelerates long-context LLM inference and reduces GPU memory consumption by 1000x token reduction, achieving 2.4x faster inference and 30% lower GPU memory usage. Another model, MIO, built on multimodal tokens, demonstrates potential in interleaved video-text generation and visual reasoning. The MINI-SEQUENCE TRANSFORMER (MST) extends the maximum context length of models like Qwen, Mistral, and Gemma-2 by 12-24x and improves perplexity by 2.7x with 30k context length. Additionally, AT-EDM framework enhances image generation speed without retraining, and the 'Imagine yourself' model by Meta addresses image generation issues using synthetic paired data and multi-stage finetuning.