← Back to architecture

LLM Audit Database — Prompt/Response Logging & Compliance Trail

Complete observability for all LLM interactions: capture → index → analyze → report → comply · immutable audit trail for regulatory, safety, and cost governance

Captured fields
Request ID (UUID)
Timestamp (UTC)
User / session ID
Full prompt (enc.)
Full response
Model + version
Token metrics
Input tokens
Output tokens
Total tokens
Token cost ($)
Latency (ms)
TTFT (ms)
Context metadata
Agent type
Tool calls made
RAG sources used
Temperature setting
System prompt hash
Guardrail outcome
Quality signals
Confidence score
Hallucination flag
User feedback
Regeneration count
Task completion
Error code (if any)
Compliance tags
PII detected (y/n)
Redaction applied
Financial advice flag
Regulatory category
Data residency zone
Retention class
Hot tier (0-7 days)
PostgreSQL (primary)
Full text indexed
Real-time queries
Auto-partitioned
Warm tier (7-90 days)
S3 + Athena
Parquet format
Columnar queries
Cost-optimized
Cold tier (90d-7yr)
S3 Glacier
Compliance archive
Legal hold capable
Retrieval: 12hr
Search indices
OpenSearch (full-text)
Vector embeddings
Metadata filters
Faceted search
Security
AES-256 at rest
TLS 1.3 in transit
Field-level encrypt
WORM compliance
Cost analytics
Cost per agent
Cost per user
Cost per task type
Model cost compare
Budget vs actual
Quality analytics
Hallucination rate
Accuracy trend
Satisfaction score
Error rate by model
Latency percentiles
Usage patterns
Peak hours
Popular topics
Session depth
Feature adoption
User cohort analysis
Safety analytics
Guardrail trigger rate
PII exposure attempts
Jailbreak frequency
Content policy hits
Escalation volume
Anomaly detection
Cost spike alert
Quality drop alert
Safety anomaly
Drift detection
Latency outliers
Regulatory reports
AI decision log (EU)
Fair lending audit
BSA/AML review
Consumer complaint
SOC 2 evidence
Access logs
Change management
Data integrity
Availability metrics
GDPR / CCPA
Data subject requests
Deletion certificates
Consent tracking
Cross-border log
Internal audit
Model card updates
Bias monitoring
Explainability log
Human override log
Retention policies
Financial: 7 years
General: 2 years
PII-free: 5 years
On legal hold: ∞
Access roles
Admin (full access)
Compliance (read all)
Engineer (own team)
Analyst (aggregated)
Query controls
Row-level security
Column masking
Query rate limit
Export approval
Data lifecycle
Auto-tier migration
Scheduled purge
Anonymization
Backup (cross-region)
Integration APIs
REST query API
GraphQL explorer
Streaming export
Webhook alerts
Scale metrics
Records/day
2.4M
Storage
18TB
Query p95
120ms
Uptime
99.99%