Absorbing Phase Transitions in Artificial Deep Neural Networks
https://arxiv.org/abs/2307.02284
To summarize, we believe that the this work places the order-to-chaos transition in the initialized artificial deep neural networks in the broader context of absorbing phase transitions, & serves as the first step toward the systematic comparison between natural/biological & artificial neural networks.
...
#NeuralNetworks #MeanFieldTheory #SignalPropagation #PhaseTransitions #backpropagation #feedforward
