Sources
Loading...
Additional media
Loading...
DeepNewz, mobile.
People-sourced. AI-powered. Unbiased News.
HuggingFace Releases 🍷 FineWeb: A New Large-Scale (15-Trillion Tokens, 44TB Disk Space) Dataset for LLM Pretraining Hugging Face has introduced 🍷 FineWeb, a comprehensive dataset designed to enhance the training of large language models (LLMs). Published on May 31, 2024, this…
Is Fineweb-edu the best open text dataset ever released? A big step in empowering all companies to train their own GPT5! https://t.co/fSEngn3Eou https://t.co/Z8YJRQzB7N
🍷Preparing Fineweb - A Finely Cleaned Common Crawl Dataset🍷 Credit to @RealGDT, @HKydlicek, @LoubnaBenAllal1, @anton_lozhkov, @colinraffel, @lvwerra, @Thom_Wolf of @huggingface for the fine dataset and blog. TIMESTAMPS: 0:00 Common Crawl Data Processing Pipeline 0:42 Video… https://t.co/7PRsNm4G6B
Hugging Face, a company in AI, has launched an open-source AI assistant maker to compete with OpenAI's custom GPTs. The release includes FineWeb, a large-scale dataset for LLM pretraining. The dataset is designed to improve the training of large language models.