We just put up a new preprint https://www.biorxiv.org/content/10.1101/2020.06.29.176925v1 in which we take a careful look at what makes surrogate gradients work. Spiking neural networks are notoriously hard to train using gradient-based methods due to their binary spiking nonlinearity. To deal …

Preprint: The remarkable robustness of surrogate gradient learning for instilling complex function in spiking neural networks Read more »

Tagged with: , , , , ,

Excited that our preprint “Improved multitask learning through synaptic intelligence” just went life on the arXiv (https://arxiv.org/abs/1703.04200). This article, by Ben Poole, Surya and myself, illustrates the benefits of complex synaptic dynamics on continual learning in neural networks. Here a …

Role of complex synapses in continual learning Read more »

Tagged with: , , , ,