Tokyo-based @SakanaAILabs, founded Transformers paper author @YesThisIsLion and fellow Google Brain researcher @hardmaru, is using evolution-inspired techniques to “breed” multiple generations of LLMs: https://t.co/CuwfnYU02r
They could use Gemini 1.5 https://t.co/jJYknB5hiz
Gemini 1.5 Pro is a very good model, by the way. Appears to beat Gemini 1.0 Ultra which was itself GPT-4 class on the stats. Also impressive that Google can more widely release massive context windows. Google seems to be moving quickly.

Japanese startup Sakana AI Labs, founded by former Google researchers, is pioneering innovation in AI by evolving new foundational models through an evolutionary process. Their approach leverages open-source AI models to efficiently produce powerful AI models. Gemini 1.5 with a 1M context size API is generating excitement for its potential to revolutionize AI work by enabling multi-modal input and extensive context analysis.
