We just put up a new preprint https://www.biorxiv.org/content/10.1101/2020.06.29.176925v1 in which we take a careful look at what makes surrogate gradients work. Spiking neural networks are notoriously hard to train using gradient-based methods due to their binary spiking nonlinearity. To deal …

Preprint: The remarkable robustness of surrogate gradient learning for instilling complex function in spiking neural networks Read more »

Tagged with: , , , , ,

Please try this at home! I just put up a beta version of a tutorial showing how to train spiking neural networks with surrogate gradients using PyTorch: https://github.com/fzenke/spytorch Emre, Hesham, and myself are planning to release a more comprehensive collection …

Tutorial on surrogate gradient learning in spiking networks online Read more »

Tagged with: , ,

I am eagerly anticipating fun discussions at Cosyne 2019. We have a poster at the main meeting and I will give two talks at the workshops. If biological learning and spiking neural networks tickle your fancy, come along. I will …

Cosyne 2019 — Talks & poster resources Read more »

Tagged with: , , , , ,

Thrilled to share the latest results on learning in multi-layer spiking networks using biologically plausible surrogate gradients at the “Third workshop on advanced methods in theoretical neuroscience” at the Max Planck Institute for Dynamics and Self-Organization, Göttingen, Germany. Thanks to …

Talk at MPI Göttingen on June 28th Read more »

Tagged with: , , ,