Symmetry Breaker

Scrub the timeline to see how a neural network learns a sine wave. Notice how "Zero Initialization" traps all neurons in the same state, preventing them from learning complex curves, while "Random Initialization" breaks symmetry.

Target Curve
Network Prediction