Real-Time Request Pipeline Architecture
p95 Latency: 1,840 ms
Per-Query Token Decomposition Waterfall
2,220 Total Tokens
Prompt
120 t
Web Context
1,650 t
Citations (Est)
0 t
Output Gen
450 t