Evidence
Same model and position · retrieved passages supplied · first output
A growing body of work highlights striking similarities between spiking neural networks that model biological networks and recurrent, binary neural networks, yet comparatively few studies examine the parallels between the learning dynamics of deep artificial neural networks and synaptic plasticity in spiking networks. This gap is largely attributable to the mismatch between the dynamical properties of synaptic plasticity and the requirements of gradient backpropagation.
Passages supplied to the Evidence version
Synaptic Plasticity Dynamics for Deep Continuous Local Learning (DECOLLE)
A growing body of work underlines striking similarities between spiking neural networks modeling biological networks and recurrent, binary neural networks. A relatively smaller body of work, however, discuss similarities between learning dynamics employed in deep artificial neural networks and synap…
Read full passage excerpt
A growing body of work underlines striking similarities between spiking neural networks modeling biological networks and recurrent, binary neural networks. A relatively smaller body of work, however, discuss similarities between learning dynamics employed in deep artificial neural networks and synaptic plasticity in spiking neural networks. The challenge preventing this is largely due to the discrepancy between dynamical properties of synaptic plasticity and the requirements for gradient backpropagation. Here, we demonstrate that deep learning algorithms that locally approximate the gradient backpropagation updates using locally synthesized gradients overcome this challenge. Locally synthesized gradients were initially proposed to decouple one or more layers from the rest of the network so as to improve parallelism.
Model-reported card use
The model did not report that any card materially affected this completion.