AIbase
Product LibraryTool Navigation

Dynamical-Isometry-from-Orthogonality-Neural-Nets

Public

Mathematical consequences of orthogonal weights initialization and regularization in deep learning. Experiments with gain-adjusted orthogonal regularizer on RNNs with SeqMNIST dataset.

Creat2019-07-07T04:06:35
Update2023-12-16T00:36:47
17
Stars
0
Stars Increase