Hardware Serving & Sizing Engine
Feasible
KV-Cache Footprint
65.5 GB
Decode Throughput
78.4 tok/s
Hardware Verdict: Fits 8x H100 with 128k KV-cache headroom (42% VRAM utilization). Memory bandwidth allows high real-time throughput.
ARCHITECTURAL LINEAGE PROFILE
| Model |
Base Architecture |
Reasoning Mode |
Active Params |
| Ox Alpha (Zai) |
MoE Frontier Hybrid |
Inference-Time Tree Search |
37B / 280B MoE |
| GLM-5.3 (Zai Open) |
Dense + MoE Base |
Standard RLHF + CoT |
32B Active |
| DeepSeek-R1 / V3 |
MLA Sparse MoE |
Large-Scale RL Reasoning |
37B / 671B MoE |
| Claude 3.5 Sonnet |
Frontier Dense MoE |
System CoT + Scratchpad |
Proprietary |