7-Stage Ingestion Pipeline
Each document passes through a deterministic sequence from raw file to dual-indexed knowledge base entry.
Supported Document Formats
| Format | Parser Engine | Vector Core | Scanned Fallback | Status |
|---|---|---|---|---|
| Multi-Layer Document Parser | LexVector™ | Visual OCR placeholder | Live | |
| DOCX / DOC | Structured Document Engine | LexVector™ | Automated court layout renderer | Live |
| XLSX / XLS / CSV | Forensic Tabular Ingestion Core | FinVector™ | Visual Table OCR | Live |
| Markdown (.md) | Native Structured Parser | LexVector™ | N/A | Live |
| Hypertext Notes (.wiki) | Sovereign Dossier Parser | LexVector™ | N/A | Live |
| Plain Text (.txt) | Native UTF-8 Parser | LexVector™ | N/A | Beta |
Interactive vs Batch Ingestion
Configured per-case in workspace policy — choose supervision level based on the importance of the document set.
Interactive Mode
For critical documents — Resolution Plans, CIRP applications. The agent reads the document, posts a 3–5 bullet "what I found" brief, then pauses and asks which section to prioritise before committing vectors.
Batch Mode
For surveillance cases with large document volumes — financial reports, court registry extracts. Queues all ingestion jobs in an async task queue, processing sequentially to prevent SQLite lock collisions.
Built-in Safety & Intelligence
Every stage of the pipeline is hardened for CIRP-grade reliability and legal privilege protection.
Serialised Ingestion Queue
All concurrent ingestFile and registerUnprocessedFile tasks are serialised in an in-memory queue, awaiting vector indexing and KV extraction to complete before the next job starts. Eliminates SQLITE_BUSY errors under concurrent document uploads.
Rename Sync & Deduplication
File system watcher debounces deletions by 200ms and matches incoming files using SHA-256 content hashes. Renamed documents are automatically relinked to existing SQLite records, bypassing OCR and vector re-processing entirely.
Dual-Domain Vector Routing
Document type is classified at ingestion by structured schema heuristics. Legal filings route into LexVector™ while financial schedules route into FinVector™. The domain index enforces strict statutory and forensic retrieval segregation during inference.
Scanned Document Guard
Fully scanned PDFs with average text density below 30 characters per page are rejected at upload with a clear warning. Hybrid pages with scanned tables inject a structured [!WARNING] placeholder block to flag unextracted visual data for the practitioner.
Smart Model Idle Eviction
A background resource monitor tracks vector memory activity. Sovereign model pipelines are automatically evicted from unified memory after idle inactivity, releasing local RAM back to the operating system without manual intervention.
Ingestion Sequence Integrity
Evidential records are registered in the master case ledger with transaction consistency before lexical and vector index generation. This guarantees relational referential integrity across all evidential sections.