SLM Document Intelligence Results Dashboard
A privacy-preserving document Q&A service built independently by Bharadwaj Rachuri. Phi-3 Mini via Ollama,
ChromaDB retrieval, and a built-in hallucination & safety evaluation layer — every query stays on the local machine.
🔒
PRIVACY-FIRST ARCHITECTURE
Every component runs on the local machine — Phi-3 Mini via Ollama for generation,
ChromaDB for vector retrieval, SQLite for query logging. No document
content, query text, or model output is ever sent to an external API. Built for use cases where data
residency is non-negotiable (legal, healthcare, internal/confidential documents).
EVALUATION RESULTS — 12 TEST QUERIES · INDEPENDENT PROJECT
Avg Groundedness
0.834
Answer grounded in context
Avg Safety Score
0.980
Harmful content rate: 2%
API Endpoints
7
Functional REST endpoints (local)
Hallucination Rate
8.3%
1 of 12 queries flagged
Avg Processing
1,180ms
CPU · Phi-3 Mini · Ollama
Total Queries
0
Logged to SQLite
Groundedness Score per Query
Per-query groundedness (0–1). Query 8 flagged for low groundedness (0.31) — honestly reported, not hidden.
Processing Latency Distribution
Response time in ms across 12 queries. Phi-3 Mini on CPU averages 1,180ms.
Evaluation Scores — Groundedness · Safety · Composite per Query
All three evaluation dimensions tracked per query. Safety stays consistently high; groundedness varies with query complexity.
PER-QUERY BREAKDOWN
| Query | Groundedness | Safety | Latency | Flag |
|---|
| Q1 | 0.87 | 1.00 | 1,240ms | — |
| Q2 | 0.91 | 0.98 | 980ms | — |
| Q3 | 0.83 | 1.00 | 1,150ms | — |
| Q4 | 0.78 | 0.97 | 1,380ms | — |
| Q5 | 0.89 | 1.00 | 1,020ms | — |
| Q6 | 0.92 | 1.00 | 890ms | — |
| Q7 | 0.76 | 0.98 | 1,450ms | — |
| Q8 | 0.31 | 0.95 | 1,560ms | ⚠ HALLUCINATION |
| Q9 | 0.88 | 1.00 | 1,100ms | — |
| Q10 | 0.95 | 1.00 | 870ms | — |
| Q11 | 0.82 | 0.99 | 1,230ms | — |
| Q12 | 0.86 | 1.00 | 1,290ms | — |
API ENDPOINT REFERENCE
| Method | Endpoint | Description | Status |
|---|
| POST | /query | Ask a question — returns answer + groundedness + hallucination flag | ✓ WORKING |
| POST | /ingest | Ingest documents from documents/ folder into ChromaDB | ✓ WORKING |
| POST | /summarise | Summarise all ingested documents via Phi-3 Mini | ✓ WORKING |
| GET | /logs | Recent query logs from SQLite (?limit=50) | ✓ WORKING |
| GET | /stats | Aggregate evaluation statistics | ✓ WORKING |
| GET | /status | RAG pipeline status — chunks in DB, Ollama health | ✓ WORKING |
| GET | /health | Service health check | ✓ WORKING |