Weight Footprint
70.0 GB
70B @ INT8
KV-Cache Footprint
134.2 GB
Batch 32 × 8k Context
Decode Speed Ceiling
1,175.8 tok/s
HBM Bandwidth Bound
Primary Bottleneck
HBM-Bound
0.0 GB Tier Spillover
Hardware Topology & Active Data Paths
Real-Time Interconnect Saturation Visualization
Memory Allocation & Tier Spillover Breakdown
| Tier / Component | Allocated Capacity | Total Active Footprint | Interconnect Saturation | Status |
|---|