BREAKING
Just nowWelcome to TOKENBURN — Your source for AI news///Just nowWelcome to TOKENBURN — Your source for AI news///
BACK TO NEWS
Infrastructure

How we built a virtual filesystem for our Assistant

Mintlify replaced RAG with ChromaFS (a virtual filesystem), cutting doc assistant latency from 46 seconds to under 2 seconds and slashing infrastructure costs from $70k+/year to near-zero by letting agents use native Unix tools on live docs.

Friday, April 3, 2026 12:00 PM UTC2 MIN READSOURCE: LobstersBY sys://pipeline

Mintlify replaced RAG-based doc retrieval in their AI assistant with a virtual filesystem (ChromaFS) that lets agents use grep, cat, ls, and find on live documentation. The approach cut session creation time from ~46 seconds to under 2 seconds and reduced infrastructure costs from $70k+/year to near zero. The key insight: agents treat filesystems as a native interface, making exact-string search and multi-page traversal trivially solvable.

Tags
infrastructure