Back to all work
Case study · 02 / 03

Atlas

Generic enterprise scenario
Backend, evaluation, UI

Domain-tuned retrieval over 9 years of regulatory filings for a compliance team.

Year
2025
Duration
11 weeks
Type
AI/RAG
Role
Backend, evaluation, UI
Atlas — citation surface
Atlas
Find current filing obligations
Answer draft
Citation span
Reviewer note
Source graph
Eval pass
01The challenge

What we were asked to solve.

A compliance team buried in 40,000+ filings needed answers in minutes, not days — but generic LLM tools hallucinated citations and missed the regulatory subtext their analysts lived in.

02The solution

What we shipped.

We built a hybrid retrieval pipeline (BM25 + dense + reranker) with a custom annotation UI for analysts to label citations. The system grades its own answers against a held-out eval set on every deploy.

Solution artifact
Atlas
Find current filing obligations
Answer draft
Citation span
Reviewer note
Source graph
Eval pass
03Published body

Published rich content.

Domain-tuned retrieval over 9 years of regulatory filings for a compliance team.

A compliance team buried in 40,000+ filings needed answers in minutes, not days — but generic LLM tools hallucinated citations and missed the regulatory subtext their analysts lived in.

We built a hybrid retrieval pipeline (BM25 + dense + reranker) with a custom annotation UI for analysts to label citations. The system grades its own answers against a held-out eval set on every deploy.

04Tech stack

What it's built on.

PythonFastAPIPostgrespgvectorClaudeModal
05Results

What changed.

RAG
reference flow
Eval
answer checks
Cites
source-first UX
Detail artifact
Atlas
Find current filing obligations
Answer draft
Citation span
Reviewer note
Source graph
Eval pass
Detail artifact
Atlas
Find current filing obligations
Answer draft
Citation span
Reviewer note
Source graph
Eval pass
Next case study

LumenA patient-side mobile app for tracking chronic symptoms across multiple care providers..