LLM Audit Database — Prompt/Response Logging & Compliance Trail
Complete observability for all LLM interactions: capture → index → analyze → report → comply · immutable audit trail for regulatory, safety, and cost governance
1 Real-time capture & ingestion
Captured fields
Request ID (UUID)
Timestamp (UTC)
User / session ID
Full prompt (enc.)
Full response
Model + version
Token metrics
Input tokens
Output tokens
Total tokens
Token cost ($)
Latency (ms)
TTFT (ms)
Context metadata
Agent type
Tool calls made
RAG sources used
Temperature setting
System prompt hash
Guardrail outcome
Quality signals
Confidence score
Hallucination flag
User feedback
Regeneration count
Task completion
Error code (if any)
Compliance tags
PII detected (y/n)
Redaction applied
Financial advice flag
Regulatory category
Data residency zone
Retention class
2 Storage architecture & indexing
Hot tier (0-7 days)
PostgreSQL (primary)
Full text indexed
Real-time queries
Auto-partitioned
Warm tier (7-90 days)
S3 + Athena
Parquet format
Columnar queries
Cost-optimized
Cold tier (90d-7yr)
S3 Glacier
Compliance archive
Legal hold capable
Retrieval: 12hr
Search indices
OpenSearch (full-text)
Vector embeddings
Metadata filters
Faceted search
Security
AES-256 at rest
TLS 1.3 in transit
Field-level encrypt
WORM compliance
3 Analytics & pattern detection
Cost analytics
Cost per agent
Cost per user
Cost per task type
Model cost compare
Budget vs actual
Quality analytics
Hallucination rate
Accuracy trend
Satisfaction score
Error rate by model
Latency percentiles
Usage patterns
Peak hours
Popular topics
Session depth
Feature adoption
User cohort analysis
Safety analytics
Guardrail trigger rate
PII exposure attempts
Jailbreak frequency
Content policy hits
Escalation volume
Anomaly detection
Cost spike alert
Quality drop alert
Safety anomaly
Drift detection
Latency outliers
4 Compliance reporting & audit support
Regulatory reports
AI decision log (EU)
Fair lending audit
BSA/AML review
Consumer complaint
SOC 2 evidence
Access logs
Change management
Data integrity
Availability metrics
GDPR / CCPA
Data subject requests
Deletion certificates
Consent tracking
Cross-border log
Internal audit
Model card updates
Bias monitoring
Explainability log
Human override log
Retention policies
Financial: 7 years
General: 2 years
PII-free: 5 years
On legal hold: ∞
5 Access control & data governance
Access roles
Admin (full access)
Compliance (read all)
Engineer (own team)
Analyst (aggregated)
Query controls
Row-level security
Column masking
Query rate limit
Export approval
Data lifecycle
Auto-tier migration
Scheduled purge
Anonymization
Backup (cross-region)
Integration APIs
REST query API
GraphQL explorer
Streaming export
Webhook alerts