Mintlify replaced RAG-based doc retrieval in their AI assistant with a virtual filesystem (ChromaFS) that lets agents use grep, cat, ls, and find on live documentation. The approach cut session creation time from ~46 seconds to under 2 seconds and reduced infrastructure costs from $70k+/year to near zero. The key insight: agents treat filesystems as a native interface, making exact-string search and multi-page traversal trivially solvable.
Infrastructure
How we built a virtual filesystem for our Assistant
Mintlify replaced RAG with ChromaFS (a virtual filesystem), cutting doc assistant latency from 46 seconds to under 2 seconds and slashing infrastructure costs from $70k+/year to near-zero by letting agents use native Unix tools on live docs.
Friday, April 3, 2026 12:00 PM UTC2 MIN READSOURCE: LobstersBY sys://pipeline
Tags
infrastructure