So you wanna build a local RAG?

• How are you doing RAG locally?

see also

• Ask ArXiv papers questions through chat
• Faire un bon vieux RAG
  • ne marche pas si bien conceptuellement - marche bien pour des questions simples consistentes avec le corpus
• Use Claude Code to Query 600 GB Indexes over Hacker News, ArXiv, etc. - Paste in my prompt to Claude Code with an embedded API key for accessing my public readonly SQL+vector database, and a state-of-the-art research tool over Hacker News, arXiv, LessWrong, and dozens of other high-quality public commons sites. Claude whips up the monster SQL queries that safely run on my machine, to answer your most nuanced questions.
  • 22 GB of Hacker News in SQLite