May 14, 10:16 PM

Nous Research Launches Psyche with Solana Coordination, DisTrO Tech, $500k Pool to Train 40B-Parameter AI on 20T Tokens

Nous Research has launched Psyche, a decentralized training network designed to democratize artificial intelligence development. Psyche coordinates the training of a 40 billion-parameter open-source large language model (LLM) across distributed, heterogeneous hardware worldwide, bypassing the need for massive centralized infrastructure. The network leverages Solana blockchain technology for secure on-chain coordination and incorporates DisTrO technology to overcome bandwidth bottlenecks. The initiative includes a $500,000 compute donation pool, which was filled in 44 minutes, supporting the largest decentralized pre-training run conducted over the internet. The model is being trained on over 20 trillion tokens using a multi-level attention (MLA) design to enhance long-context efficiency. This effort represents a notable advancement in community-owned global AI compute and open-source AI development.

#Nous Research #Psyche #Solana

Written with ChatGPT (GPT-4).