SC

Software Factory Benchmark Harness Simulator

SlopCodeBench Opus 5 Dynamics & Evaluation Rig
PRESETS:
Benchmark Optimization Trajectory
Pass Rate (%)
Context Saturation
Overfit / Error Rate
Context Noise & Signal Decay
Failure Mode Breakdown
Max Pass Rate
0.0%
Optimal iteration 0
Saturation Point
Iter 0
Context limit warning
Overfit Risk Score
0.00
Low Oscillation
Harness Accuracy
0.0%
Verification confidence
Status: READY Click 'Run Benchmark' to trigger step trajectory.
Harness & Model Rig Config
Optimization Algorithm
Optimization Step Size 0.08
Feedback Frequency 0.80
Context Noise Ratio 0.35
Regularization Weight 0.05
Harness Verification Rigor 0.75
Plateau Diagnostics

Software factories plateau when LLM code context becomes saturated with synthetic feedback logs, causing gradient updates to overfit harness assertions.

High context degradation coupled with low harness rigor creates feedback loop oscillations that artificially cap benchmark benchmarks.

Enjoy this tool? Build your own with Super