Sources
Additional media
Loading...

AnthropicAI has introduced Contextual Retrieval, a significant advancement in Retrieval-Augmented Generation (RAG) that enhances text segmentation by adding contextual information to chunks. This technique, which involves prepending metadata to each chunk to detail its position within the document, is made cost-effective through prompt caching. The approach has shown improvements in various data evaluations, including code, fiction, and arXiv. Additionally, the use of bm25 and semantic retrieval remains standard in RAG. Collaborations such as the one between VAST Data and NVIDIA, leveraging tools like VAST InsightEngine, are contributing to the mainstream adoption of generative AI by leveraging these advancements in RAG.













