Sources
Loading...
Additional media
Loading...
DeepNewz, mobile.
People-sourced. AI-powered. Unbiased News.
Microsoft has unveiled its new AI model, GRIN-MoE (GRadient-INformed Mixture-of-Experts), which has demonstrated superior performance in coding and math tasks. The model, which was pre-trained on 4 trillion tokens, has set key benchmarks, outperforming competitors in scalability and accuracy. GRIN-MoE allows smaller models to achieve high accuracy by leveraging a novel approach to training large Mixture-of-Experts language models.
Microsoft released GRIN MoE, GRIN allows smaller models to achieve high accuracy, Its like a team of specialized experts. Here's how it works: https://t.co/vIW5CrZX1E
CodeMaker AI Breakthrough in Software Development: Achieves 91% Accuracy in Recreating 90,000 Lines of Code, Setting a New Benchmark for AI-driven code Generation and Fine-Tuned Model Read the full article here: https://t.co/8uNEsf7eWi @CodeMakerAI
Microsoft has just released a paper and model on GRIN (GRadient-INformed MoE). Don't know who comes up with these names but it's a novel approach to training large Mixture-of-Experts (MoE) language models. 1. Pre-training: - GRIN MoE was pre-trained on 4T tokens as a causal… https://t.co/9vKvRFrf6m
