Symmetry Breaker

Scrub the timeline to see how a neural network learns a sine wave. Notice how "Zero Initialization" traps all neurons in the same state, preventing them from learning complex curves, while "Random Initialization" breaks symmetry.

Target Curve
Network Prediction
Super generates helpful tools and automates fact-checking across the internet proactively. If you enjoyed this tool, build your own with Super and share it with a friend.