DeepNewz, mobile.
People-sourced. AI-powered. Unbiased News.
Download on the App Store
Screenshot of DeepNewz app showing story detail view.
Feb 10, 07:52 PM
Researchers from Max-Planck Institute and University of Maryland Enhance AI Reasoning with 3.5 Billion Parameter Model
AI Modeling
AI

Researchers from Max-Planck Institute and University of Maryland Enhance AI Reasoning with 3.5 Billion Parameter Model

Authors
  • Towards Data Science
  • elvis
  • Data Science Dojo
13

Researchers have introduced a novel approach to enhance the reasoning capabilities of language models through a method called 'Scaling up Test-Time Compute with Latent Reasoning: A Recurrent Depth Approach.' This technique involves scaling computation during inference by iterating a recurrent block, allowing the model to reason implicitly in latent space. Unlike traditional models that increase computation by generating more tokens, this method does not require specialized training data and can function with small context windows. The study, conducted by researchers from the Max-Planck Institute for Intelligent Systems and the University of Maryland, scaled a proof-of-concept model to 3.5 billion parameters and 800 billion tokens. The model demonstrated improved performance on reasoning benchmarks, with performance enhancements up to a computation load equivalent to 50 billion parameters.

Written with ChatGPT .

Additional media

Image #1 for story researchers-max-planck-institute-university-maryland-enhance-ai-reasoning-3-5-5d09d2fb
Image #2 for story researchers-max-planck-institute-university-maryland-enhance-ai-reasoning-3-5-5d09d2fb
Image #3 for story researchers-max-planck-institute-university-maryland-enhance-ai-reasoning-3-5-5d09d2fb
Image #4 for story researchers-max-planck-institute-university-maryland-enhance-ai-reasoning-3-5-5d09d2fb
Image #5 for story researchers-max-planck-institute-university-maryland-enhance-ai-reasoning-3-5-5d09d2fb
Image #6 for story researchers-max-planck-institute-university-maryland-enhance-ai-reasoning-3-5-5d09d2fb
Image #7 for story researchers-max-planck-institute-university-maryland-enhance-ai-reasoning-3-5-5d09d2fb
Image #8 for story researchers-max-planck-institute-university-maryland-enhance-ai-reasoning-3-5-5d09d2fb
Image #9 for story researchers-max-planck-institute-university-maryland-enhance-ai-reasoning-3-5-5d09d2fb
Image #10 for story researchers-max-planck-institute-university-maryland-enhance-ai-reasoning-3-5-5d09d2fb
Image #11 for story researchers-max-planck-institute-university-maryland-enhance-ai-reasoning-3-5-5d09d2fb
Image #12 for story researchers-max-planck-institute-university-maryland-enhance-ai-reasoning-3-5-5d09d2fb
Image #13 for story researchers-max-planck-institute-university-maryland-enhance-ai-reasoning-3-5-5d09d2fb