Aug 3, 04:17 PM

Hyperbolic Labs Supports Llama 3.1 405B on OpenRouterAI, FLUX.1 Requires Up to 75GB VRAM

Hyperbolic Labs has become the first to support the Llama 3.1 405B BASE model on OpenRouterAI, a significant development for open AI research. This model has been highly requested by AI researchers. Additionally, Hyperbolic Labs is working on integrating the Llama 3.1 405B Instruct bf16 model and has extended the context lengths of Llama 3.1 405B Base (fp8). The FLUX.1 image generation model is also being served, with users reporting improved performance and reduced memory usage on NVIDIA RTX 4090. Training and fine-tuning FLUX.1 requires substantial VRAM, with some configurations needing up to 75GB, 38.5GB, or 48G.

#Hyperbolic Labs #OpenRouterAI #Llama #NVIDIA

Written with ChatGPT (GPT-4o).

Sources

PrimerYang@yangzhizheng1
2 years ago
I have found how to train FLUX.1 lora，It seems like need 48G VRAM at least，here is a guidelines for training. https://t.co/8sUpYY1eDM @bdsqlsz @araminta_k @AIWarper @ZHOZHO672070 @camenduru @cubiq
Ostris@ostrisai
2 years ago
Doing a full transformer finetune of FLUX.1 schnell at bf16 with T5 at 8bit is using ~ 75GB VRAM. https://t.co/8YzFKH9AwP https://t.co/zZUtMUBKzj
Ostris@ostrisai
2 years ago
Testing training a LoRA for FLUX.1 ... 38.5gb VRAM!! Gradient checkpointing Rank 256 (Big, I know) T5 in 8bit Full BF16 It is a big boy. https://t.co/EMmiW6W7jC

Hyperbolic Labs Supports Llama 3.1 405B on OpenRouterAI, FLUX.1 Requires Up to 75GB VRAM

Sources

Additional media

Similar Stories