Sources
Loading...
Additional media
Loading...
DeepNewz, mobile.
People-sourced. AI-powered. Unbiased News.
Recent tweets discuss the cost and efficiency of training advanced AI models like GPT-3.5 and GPT-4. Training costs have decreased significantly, with estimates ranging from $10 million to $100 million for GPT models. The open-source community is credited for driving down costs and improving efficiency in AI model training.
It’s crazy to think that GPT4 reportedly cost as much as $100M to train, or approximately 1/3 the cost of a single F22.
Just $10M and two months to train from scratch a GPT3.5 - Llama2 level model. For context, it probably cost 10-20x more to OAI just a year ago! The more we improve as a field thanks to open-source, the cheaper & more efficient it gets! All companies should now train their own… https://t.co/3xnoNwt03p
I will just leave this here - You can train a GPT-4 class model with ~$100M
