RAG Local Setup
Local retrieval-augmented generation system — now operational.
Overview
Vector database + Claude CLI (Max plan) for querying 721K+ document chunks across 9 knowledge domains.
Current Stack
| Component | Technology |
|---|---|
| Vector DB | ChromaDB (4.5GB+) |
| Embeddings | sentence-transformers/all-MiniLM-L6-v2 |
| GPU Acceleration | CUDA (RTX 2060 SUPER) |
| LLM Provider | Claude CLI (Max plan - unlimited) |
Corpora
| Domain | Chunks |
|---|---|
| science | 554,335 |
| engineering | 87,746 |
| tech | 43,067 |
| math | 26,311 |
| knowledge_base | 7,127 |
| greek | 1,135 |
| esoteric | 846 |
| quantum_biology | 555 |
| biohacking | 153 |
Total: 721,275+ chunks
Related
- Knowledge RAG Setup — Full documentation
- PatentBot — Patent discovery using this system