Evidence
Same model and position · retrieved passages supplied · first output
The bidirectional exchange between neuroscience and artificial intelligence is thus not merely a historical curiosity but an ongoing methodological necessity. As the surveyed work demonstrates, the most promising advances arise when biological principles are abstracted rather than copied, and when the resulting models are evaluated on their own computational merits.
Passages supplied to the Evidence version
Cortical microcircuits as gated-recurrent neural networks
However, such principles have remained largely elusive. Inspired by gated-memory networks, namely long short-term memory networks (LSTMs), we introduce a recurrent neural network in which information is gated through inhibitory cells that are subtractive (subLSTM). We propose a natural mapping of su…
Read full passage excerpt
However, such principles have remained largely elusive. Inspired by gated-memory networks, namely long short-term memory networks (LSTMs), we introduce a recurrent neural network in which information is gated through inhibitory cells that are subtractive (subLSTM). We propose a natural mapping of subLSTMs onto known canonical excitatory-inhibitory cortical microcircuits. Our empirical evaluation across sequential image classification and language modelling tasks shows that subLSTM units can achieve similar performance to LSTM units. These results suggest that cortical circuits can be optimised to solve complex contextual problems and proposes a novel view on their computational function. Overall our work provides a step towards unifying recurrent networks as used in machine learning with their biological counterparts. † † footnotetext: * These authors contributed equally to this work.
Model-reported card use
The model did not report that any card materially affected this completion.