Sources
Loading...
Additional media
Loading...

Simplismart, a new AI inference engine developed by former Oracle and Google engineers, has raised $7 million from Accel for its public launch. The engine is designed to supercharge AI performance with personalized, software-optimized inference capabilities. Simplismart's MLOps platform runs the Llama3.1 8B model at a peak throughput of 501 tokens per second, providing enterprises with rapid inference and full control over their AI models. Simplismart is faster than TogetherAI and FireworksAI.