DelGrad: exact event-based gradients for training delays and weights on spiking neuromorphic hardware
Spiking neural networks (SNNs) inherently rely on the timing of signals for representing and processing information. Augmenting SNNs with trainable transmission delays, alongside synaptic weights, has recently shown to increase their accuracy and parameter efficiency. However, existing training meth...
Gespeichert in:
| Hauptverfasser: | , , , , , , , |
|---|---|
| Dokumenttyp: | Article (Journal) |
| Sprache: | Englisch |
| Veröffentlicht: |
09 September 2025
|
| In: |
Nature Communications
Year: 2025, Jahrgang: 16, Pages: 1-10 |
| ISSN: | 2041-1723 |
| DOI: | 10.1038/s41467-025-63120-y |
| Online-Zugang: | Verlag, kostenfrei, Volltext: https://doi.org/10.1038/s41467-025-63120-y Verlag, kostenfrei, Volltext: https://www.nature.com/articles/s41467-025-63120-y 
|
| Verfasserangaben: | Julian Göltz, Jimmy Weber, Laura Kriener, Sebastian Billaudelle, Peter Lake, Johannes Schemmel, Melika Payvand & Mihai A. Petrovici |
MARC
| LEADER | 00000naa a2200000 c 4500 | ||
|---|---|---|---|
| 001 | 1962391515 | ||
| 003 | DE-627 | ||
| 005 | 20260224104731.0 | ||
| 007 | cr uuu---uuuuu | ||
| 008 | 260224s2025 xx |||||o 00| ||eng c | ||
| 024 | 7 | |a 10.1038/s41467-025-63120-y |2 doi | |
| 035 | |a (DE-627)1962391515 | ||
| 035 | |a (DE-599)KXP1962391515 | ||
| 040 | |a DE-627 |b ger |c DE-627 |e rda | ||
| 041 | |a eng | ||
| 084 | |a 29 |2 sdnb | ||
| 100 | 1 | |a Göltz, Julian |e VerfasserIn |0 (DE-588)1197708723 |0 (DE-627)1679440802 |4 aut | |
| 245 | 1 | 0 | |a DelGrad |b exact event-based gradients for training delays and weights on spiking neuromorphic hardware |c Julian Göltz, Jimmy Weber, Laura Kriener, Sebastian Billaudelle, Peter Lake, Johannes Schemmel, Melika Payvand & Mihai A. Petrovici |
| 264 | 1 | |c 09 September 2025 | |
| 300 | |b Illustrationen | ||
| 300 | |a 10 | ||
| 336 | |a Text |b txt |2 rdacontent | ||
| 337 | |a Computermedien |b c |2 rdamedia | ||
| 338 | |a Online-Ressource |b cr |2 rdacarrier | ||
| 500 | |a Gesehen am 24.02.2026 | ||
| 520 | |a Spiking neural networks (SNNs) inherently rely on the timing of signals for representing and processing information. Augmenting SNNs with trainable transmission delays, alongside synaptic weights, has recently shown to increase their accuracy and parameter efficiency. However, existing training methods to optimize such networks rely on discrete time, approximate gradients, and full access to internal variables such as membrane potentials. This limits their precision, efficiency, and suitability for neuromorphic hardware due to increased memory and I/O-bandwidth demands. Here, we propose DelGrad, an analytical, event-based training method to compute exact loss gradients for both weights and delays. Grounded purely in spike timing, DelGrad eliminates the need to track any other variables to optimize SNNs. We showcase this key advantage by implementing DelGrad on the BrainScaleS-2 mixed-signal neuromorphic platform. For the first time, we experimentally demonstrate the parameter efficiency, accuracy benefits, and stabilizing effect of adding delays to SNNs on noisy hardware. DelGrad thus provides a new way for training SNNs with delays on neuromorphic substrates, with substantial improvements over previous results. | ||
| 650 | 4 | |a Computational science | |
| 650 | 4 | |a Electronics | |
| 650 | 4 | |a Learning algorithms | |
| 650 | 4 | |a photonics and device physics | |
| 700 | 1 | |a Weber, Jimmy |e VerfasserIn |4 aut | |
| 700 | 1 | |a Kriener, Laura |e VerfasserIn |0 (DE-588)113836181X |0 (DE-627)895871386 |0 (DE-576)492500061 |4 aut | |
| 700 | 1 | |a Billaudelle, Sebastian |d 1991- |e VerfasserIn |0 (DE-588)118726153X |0 (DE-627)1666378356 |4 aut | |
| 700 | 1 | |a Lake, Peter |e VerfasserIn |4 aut | |
| 700 | 1 | |a Schemmel, Johannes |e VerfasserIn |0 (DE-588)1025834607 |0 (DE-627)72488291X |0 (DE-576)370821440 |4 aut | |
| 700 | 1 | |a Payvand, Melika |e VerfasserIn |4 aut | |
| 700 | 1 | |a Petrovici, Mihai A. |e VerfasserIn |0 (DE-588)1072021005 |0 (DE-627)826788823 |0 (DE-576)433488700 |4 aut | |
| 773 | 0 | 8 | |i Enthalten in |t Nature Communications |d [London] : Springer Nature, 2010 |g 16(2025), Artikel-ID 8245, Seite 1-10 |h Online-Ressource |w (DE-627)626457688 |w (DE-600)2553671-0 |w (DE-576)331555905 |x 2041-1723 |7 nnas |a DelGrad exact event-based gradients for training delays and weights on spiking neuromorphic hardware |
| 773 | 1 | 8 | |g volume:16 |g year:2025 |g elocationid:8245 |g pages:1-10 |g extent:10 |a DelGrad exact event-based gradients for training delays and weights on spiking neuromorphic hardware |
| 856 | 4 | 0 | |u https://doi.org/10.1038/s41467-025-63120-y |x Verlag |x Resolving-System |z kostenfrei |3 Volltext |7 0 |
| 856 | 4 | 0 | |u https://www.nature.com/articles/s41467-025-63120-y |x Verlag |z kostenfrei |3 Volltext |7 0 |
| 951 | |a AR | ||
| 992 | |a 20260224 | ||
| 993 | |a Article | ||
| 994 | |a 2025 | ||
| 998 | |g 1025834607 |a Schemmel, Johannes |m 1025834607:Schemmel, Johannes |d 130000 |d 700000 |d 720000 |e 130000PS1025834607 |e 700000PS1025834607 |e 720000PS1025834607 |k 0/130000/ |k 0/700000/ |k 1/700000/720000/ |p 6 | ||
| 998 | |g 118726153X |a Billaudelle, Sebastian |m 118726153X:Billaudelle, Sebastian |d 130000 |d 130700 |e 130000PB118726153X |e 130700PB118726153X |k 0/130000/ |k 1/130000/130700/ |p 4 | ||
| 998 | |g 1197708723 |a Göltz, Julian |m 1197708723:Göltz, Julian |d 130000 |d 700000 |d 720000 |e 130000PG1197708723 |e 700000PG1197708723 |e 720000PG1197708723 |k 0/130000/ |k 0/700000/ |k 1/700000/720000/ |p 1 |x j | ||
| 999 | |a KXP-PPN1962391515 |e 4921702446 | ||
| BIB | |a Y | ||
| SER | |a journal | ||
| JSO | |a {"origin":[{"dateIssuedDisp":"09 September 2025","dateIssuedKey":"2025"}],"type":{"bibl":"article-journal","media":"Online-Ressource"},"physDesc":[{"extent":"10 S.","noteIll":"Illustrationen"}],"id":{"eki":["1962391515"],"doi":["10.1038/s41467-025-63120-y"]},"name":{"displayForm":["Julian Göltz, Jimmy Weber, Laura Kriener, Sebastian Billaudelle, Peter Lake, Johannes Schemmel, Melika Payvand & Mihai A. Petrovici"]},"person":[{"given":"Julian","role":"aut","family":"Göltz","display":"Göltz, Julian"},{"display":"Weber, Jimmy","family":"Weber","role":"aut","given":"Jimmy"},{"given":"Laura","role":"aut","family":"Kriener","display":"Kriener, Laura"},{"given":"Sebastian","role":"aut","family":"Billaudelle","display":"Billaudelle, Sebastian"},{"family":"Lake","display":"Lake, Peter","given":"Peter","role":"aut"},{"family":"Schemmel","display":"Schemmel, Johannes","given":"Johannes","role":"aut"},{"given":"Melika","role":"aut","family":"Payvand","display":"Payvand, Melika"},{"display":"Petrovici, Mihai A.","family":"Petrovici","role":"aut","given":"Mihai A."}],"relHost":[{"language":["eng"],"note":["Gesehen am 13.06.24"],"id":{"issn":["2041-1723"],"eki":["626457688"],"zdb":["2553671-0"]},"title":[{"title_sort":"Nature Communications","title":"Nature Communications"}],"pubHistory":["2010-"],"type":{"media":"Online-Ressource","bibl":"periodical"},"physDesc":[{"extent":"Online-Ressource"}],"recId":"626457688","part":{"volume":"16","text":"16(2025), Artikel-ID 8245, Seite 1-10","pages":"1-10","extent":"10","year":"2025"},"disp":"DelGrad exact event-based gradients for training delays and weights on spiking neuromorphic hardwareNature Communications","origin":[{"dateIssuedDisp":"[2010]-","publisher":"Springer Nature ; Nature Publishing Group UK","publisherPlace":"[London] ; [London]"}]}],"recId":"1962391515","title":[{"title_sort":"DelGrad","subtitle":"exact event-based gradients for training delays and weights on spiking neuromorphic hardware","title":"DelGrad"}],"note":["Gesehen am 24.02.2026"],"language":["eng"]} | ||
| SRT | |a GOELTZJULIDELGRAD0920 | ||