Sources
LocalAI🚀🎉 New model alert! Introducing "Cobalt", a math-instruct model built on Llama 3.1 8b. Install it with `local-ai run llama3.1-8b-cobalt` #LocalAI #AIModel #NewRelease
LocalAINew model alert! Check out "celestial-harmony-14b-v1.0-experimental-1016-i1"! 🚀 This experimental model is a merge of pre-trained language models. Learn more and install via local-ai run celestial-harmony-14b-v1.0-experimental-1016-i1 #LocalAI #machinelearning #NLPmodels
Groq IncIn the words of @sundeep "Ok, fine we'll do spec decode too 😉" Check out the video: Llama 3 70B running at >2200 tokens per second. Great performance and price for inference with our 14nm V1 LPU. ...and 4nm V2 is coming next year! https://t.co/dKU2CWv03c




