Spiking neurons with short-term synaptic plasticity form superior generative networks
Spiking networks that perform probabilistic inference have been proposed both as models of cortical computation and as candidates for solving problems in machine learning. However, the evidence for spike-based computation being in any way superior to non-spiking alternatives remains scarce. We propo...
Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Article (Journal) |
| Language: | English |
| Published: |
13 July 2018
|
| In: |
Scientific reports
Year: 2018, Volume: 8 |
| ISSN: | 2045-2322 |
| DOI: | 10.1038/s41598-018-28999-2 |
| Online Access: | Verlag, kostenfrei, Volltext: http://dx.doi.org/10.1038/s41598-018-28999-2 Verlag, kostenfrei, Volltext: https://www.nature.com/articles/s41598-018-28999-2 
|
| Author Notes: | Luziwei Leng, Roman Martel, Oliver Breitwieser, Ilja Bytschok, Walter Senn, Johannes Schemmel, Karlheinz Meier & Mihai A. Petrovici |
MARC
| LEADER | 00000caa a2200000 c 4500 | ||
|---|---|---|---|
| 001 | 1578092760 | ||
| 003 | DE-627 | ||
| 005 | 20210815182327.0 | ||
| 007 | cr uuu---uuuuu | ||
| 008 | 180731s2018 xx |||||o 00| ||eng c | ||
| 024 | 7 | |a 10.1038/s41598-018-28999-2 |2 doi | |
| 035 | |a (DE-627)1578092760 | ||
| 035 | |a (DE-576)508092760 | ||
| 035 | |a (DE-599)BSZ508092760 | ||
| 035 | |a (OCoLC)1264004437 | ||
| 040 | |a DE-627 |b ger |c DE-627 |e rda | ||
| 041 | |a eng | ||
| 084 | |a 29 |2 sdnb | ||
| 100 | 1 | |a Leng, Luziwei |d 1990- |e VerfasserIn |0 (DE-588)1163617431 |0 (DE-627)1027932908 |0 (DE-576)508090601 |4 aut | |
| 245 | 1 | 0 | |a Spiking neurons with short-term synaptic plasticity form superior generative networks |c Luziwei Leng, Roman Martel, Oliver Breitwieser, Ilja Bytschok, Walter Senn, Johannes Schemmel, Karlheinz Meier & Mihai A. Petrovici |
| 264 | 1 | |c 13 July 2018 | |
| 300 | |a 11 | ||
| 336 | |a Text |b txt |2 rdacontent | ||
| 337 | |a Computermedien |b c |2 rdamedia | ||
| 338 | |a Online-Ressource |b cr |2 rdacarrier | ||
| 500 | |a Gesehen am 31.07.2018 | ||
| 520 | |a Spiking networks that perform probabilistic inference have been proposed both as models of cortical computation and as candidates for solving problems in machine learning. However, the evidence for spike-based computation being in any way superior to non-spiking alternatives remains scarce. We propose that short-term synaptic plasticity can provide spiking networks with distinct computational advantages compared to their classical counterparts. When learning from high-dimensional, diverse datasets, deep attractors in the energy landscape often cause mixing problems to the sampling process. Classical algorithms solve this problem by employing various tempering techniques, which are both computationally demanding and require global state updates. We demonstrate how similar results can be achieved in spiking networks endowed with local short-term synaptic plasticity. Additionally, we discuss how these networks can even outperform tempering-based approaches when the training data is imbalanced. We thereby uncover a powerful computational property of the biologically inspired, local, spike-triggered synaptic dynamics based simply on a limited pool of synaptic resources, which enables them to deal with complex sensory data. | ||
| 700 | 1 | |a Breitwieser, Oliver |d 1987- |e VerfasserIn |0 (DE-588)1163617652 |0 (DE-627)1027933408 |0 (DE-576)508090997 |4 aut | |
| 700 | 1 | |a Bytschok, Ilja |e VerfasserIn |0 (DE-588)1072021145 |0 (DE-627)826788904 |0 (DE-576)433488778 |4 aut | |
| 700 | 1 | |a Schemmel, Johannes |e VerfasserIn |0 (DE-588)1025834607 |0 (DE-627)72488291X |0 (DE-576)370821440 |4 aut | |
| 700 | 1 | |a Meier, Karlheinz |d 1955-2018 |e VerfasserIn |0 (DE-588)1025835115 |0 (DE-627)724884114 |0 (DE-576)370822269 |4 aut | |
| 700 | 1 | |a Petrovici, Mihai A. |e VerfasserIn |0 (DE-588)1072021005 |0 (DE-627)826788823 |0 (DE-576)433488700 |4 aut | |
| 773 | 0 | 8 | |i Enthalten in |t Scientific reports |d [London] : Springer Nature, 2011 |g 8(2018) Artikel-Nummer 10651, 11 Seiten |h Online-Ressource |w (DE-627)663366712 |w (DE-600)2615211-3 |w (DE-576)346641179 |x 2045-2322 |7 nnas |a Spiking neurons with short-term synaptic plasticity form superior generative networks |
| 773 | 1 | 8 | |g volume:8 |g year:2018 |g extent:11 |a Spiking neurons with short-term synaptic plasticity form superior generative networks |
| 856 | 4 | 0 | |u http://dx.doi.org/10.1038/s41598-018-28999-2 |x Verlag |x Resolving-System |z kostenfrei |3 Volltext |
| 856 | 4 | 0 | |u https://www.nature.com/articles/s41598-018-28999-2 |x Verlag |z kostenfrei |3 Volltext |
| 951 | |a AR | ||
| 992 | |a 20180731 | ||
| 993 | |a Article | ||
| 994 | |a 2018 | ||
| 998 | |g 1072021005 |a Petrovici, Mihai A. |m 1072021005:Petrovici, Mihai A. |d 130000 |d 130700 |e 130000PP1072021005 |e 130700PP1072021005 |k 0/130000/ |k 1/130000/130700/ |p 8 |y j | ||
| 998 | |g 1025835115 |a Meier, Karlheinz |m 1025835115:Meier, Karlheinz |d 130000 |d 130700 |e 130000PM1025835115 |e 130700PM1025835115 |k 0/130000/ |k 1/130000/130700/ |p 7 | ||
| 998 | |g 1025834607 |a Schemmel, Johannes |m 1025834607:Schemmel, Johannes |d 130000 |d 130700 |e 130000PS1025834607 |e 130700PS1025834607 |k 0/130000/ |k 1/130000/130700/ |p 6 | ||
| 998 | |g 1072021145 |a Bytschok, Ilja |m 1072021145:Bytschok, Ilja |d 130000 |d 130700 |e 130000PB1072021145 |e 130700PB1072021145 |k 0/130000/ |k 1/130000/130700/ |p 4 | ||
| 998 | |g 1163617652 |a Breitwieser, Oliver |m 1163617652:Breitwieser, Oliver |d 130000 |d 130700 |e 130000PB1163617652 |e 130700PB1163617652 |k 0/130000/ |k 1/130000/130700/ |p 3 | ||
| 998 | |g 1163617431 |a Leng, Luziwei |m 1163617431:Leng, Luziwei |d 130000 |d 130700 |e 130000PL1163617431 |e 130700PL1163617431 |k 0/130000/ |k 1/130000/130700/ |p 1 |x j | ||
| 999 | |a KXP-PPN1578092760 |e 3019786754 | ||
| BIB | |a Y | ||
| SER | |a journal | ||
| JSO | |a {"language":["eng"],"person":[{"display":"Leng, Luziwei","role":"aut","family":"Leng","given":"Luziwei"},{"given":"Oliver","family":"Breitwieser","role":"aut","display":"Breitwieser, Oliver"},{"given":"Ilja","family":"Bytschok","role":"aut","display":"Bytschok, Ilja"},{"role":"aut","display":"Schemmel, Johannes","given":"Johannes","family":"Schemmel"},{"display":"Meier, Karlheinz","role":"aut","family":"Meier","given":"Karlheinz"},{"given":"Mihai A.","family":"Petrovici","role":"aut","display":"Petrovici, Mihai A."}],"type":{"bibl":"article-journal","media":"Online-Ressource"},"id":{"eki":["1578092760"],"doi":["10.1038/s41598-018-28999-2"]},"physDesc":[{"extent":"11 S."}],"relHost":[{"physDesc":[{"extent":"Online-Ressource"}],"title":[{"title":"Scientific reports","title_sort":"Scientific reports"}],"language":["eng"],"note":["Gesehen am 12.07.24"],"disp":"Spiking neurons with short-term synaptic plasticity form superior generative networksScientific reports","type":{"bibl":"periodical","media":"Online-Ressource"},"id":{"eki":["663366712"],"zdb":["2615211-3"],"issn":["2045-2322"]},"pubHistory":["1, article number 1 (2011)-"],"part":{"text":"8(2018) Artikel-Nummer 10651, 11 Seiten","volume":"8","extent":"11","year":"2018"},"origin":[{"publisher":"Springer Nature ; Nature Publishing Group","dateIssuedDisp":"2011-","dateIssuedKey":"2011","publisherPlace":"[London] ; London"}],"recId":"663366712"}],"title":[{"title":"Spiking neurons with short-term synaptic plasticity form superior generative networks","title_sort":"Spiking neurons with short-term synaptic plasticity form superior generative networks"}],"recId":"1578092760","name":{"displayForm":["Luziwei Leng, Roman Martel, Oliver Breitwieser, Ilja Bytschok, Walter Senn, Johannes Schemmel, Karlheinz Meier & Mihai A. Petrovici"]},"note":["Gesehen am 31.07.2018"],"origin":[{"dateIssuedKey":"2018","dateIssuedDisp":"13 July 2018"}]} | ||
| SRT | |a LENGLUZIWESPIKINGNEU1320 | ||