SYMMETRY-BREAKING CONVERGENCE ANALYSIS OF CERTAIN TWO-LAYERED NEURAL NETWORKS WITH RELU NONLINEARITY
YuandongTianFacebookAIResearchhttp://openreview.net/pdf?id=Hk85q85eeInthispaper,weusedynamicalsystemtoanalyzethenonlinearweightdynamicsoftwo-layeredbias-freenetworksintheformof,whereσ(·)isReLUnonlinea