Nvidia ($NVDA) CEO Unveils GPT-4 or GPT-5 with 1.8 Trillion Parameters, Foresees AI Milestone

Jensen Huang, the CEO of Nvidia ($NVDA), announced during the GTC 2024 keynote that OpenAI's latest model, presumed to be GPT-4 or potentially GPT-5, has 1.8 trillion parameters. This development suggests a significant advancement in the capabilities of language models. Huang also hinted at the potential for a 'chatGPT moment' for bots, indicating a breakthrough in conversational AI may be imminent. Additionally, it was revealed that the model required an extensive amount of computational power for training, utilizing 30 billion quadrillion FLOPS. There was some confusion regarding the exact number of tokens the model used for training, with figures ranging from 1.7 to 2-3 trillion tokens mentioned.