Alibaba Cloud has launched Qwen-2.5 72B and Qwen-2 VL 72B on Tune Chat, marking a significant upgrade in knowledge, coding, and math skills. These models support 29 languages and can process long contexts up to 128K tokens. Additionally, Qwen2.5-95B-Instruct has been introduced, leveraging layer similarity analysis to enhance performance. The AI community is also seeing advancements in custom floating-point formats, such as Near-Lossless FP6 and FP2 to FP7, which improve throughput and save memory. Tools like llmcompressor are making open-source LLMs faster and more cost-effective by applying quantization with a single line of code. These developments also include MacOS support on Apple Silicon.