SDCA Optimization Race

Visualizing Shalev-Shwartz & Zhang (2013): Stochastic Dual Coordinate Ascent vs SGD

0.01
Class A
Class B
SGD
SDCA

Decision Boundary

Left click: Class A (Blue)
Shift+Click: Class B (Orange)

Primal Loss