HNGlance

Top Best New Show

The retrieval loss problem: why your AI memory / RAG fails at scale

https://www.youtube.com/watch?v=IVzMj-nwZjc

by shawkatkabbara • 9 months ago

1 1 9 months ago

YO

Related Stories

Loading related stories...

Comments

1

shawkatkabbara• 9 months ago

In this episode, I sat down with Shawkat Kabbara, Founder & CEO of Papr AI, to discuss why traditional RAG systems fundamentally break at scale.

Key insights: • Why retrieval gets WORSE with more data (backed by Google research) • The 400-500ms latency requirement that kills personalized voice AI • How multi-agent systems create hallucination cascades • Brain-inspired predictive memory architecture as the solution • Why you need to predict context, not just retrieve it

We dive into retrieval loss metrics, the working memory approach inspired by the prefrontal cortex, and why Paper built prediction layers instead of another search-based system. Perfect for developers building production AI systems who are hitting the limits of RAG.

Source preview

youtube.com

HNGlance

© 2024-2026 HN Glance. Story content belongs to its original sources.

Privacy
Terms