Is training stuck, or is the model too simple?
Train a real linear classifier. Read the loss and every prediction before changing the architecture.
[0,0] 0
[0,1] 1
[1,0] 1
[1,1] 0
Train a real linear classifier. Read the loss and every prediction before changing the architecture.
A single line cannot separate diagonal XOR labels. The hidden layer transforms the inputs so the output layer can draw the needed nonlinear decision.
The intervention comparison holds data, labels, seeds, optimizer family, and decision threshold fixed. Only architecture and scheduled epochs differ.