Activation functions in non-negative neural networks
Optical neural networks (ONNs) have the potential to overcome scaling limitations of transistor-based systems due to their inherent low latency and large available bandwidth. However, encoding the information directly in the physical properties of light fields also imposes new computational constrai...
Gespeichert in:
| Hauptverfasser: | , , , , , |
|---|---|
| Dokumenttyp: | Article (Journal) |
| Sprache: | Englisch |
| Veröffentlicht: |
28 October 2025
|
| In: |
IEEE access
Year: 2025, Jahrgang: 13, Pages: 182474-182480 |
| ISSN: | 2169-3536 |
| DOI: | 10.1109/ACCESS.2025.3622408 |
| Online-Zugang: | Verlag, kostenfrei, Volltext: https://doi.org/10.1109/ACCESS.2025.3622408 Verlag, kostenfrei, Volltext: https://ieeexplore.ieee.org/document/11205509 
|
| Verfasserangaben: | Marlon Becker, Dominik Drees, Frank Brückerhoff-Plückelmann, Carsten Schuck, Wolfram Pernice, and Benjamin Risse |
| Zusammenfassung: | Optical neural networks (ONNs) have the potential to overcome scaling limitations of transistor-based systems due to their inherent low latency and large available bandwidth. However, encoding the information directly in the physical properties of light fields also imposes new computational constraints, for example the restriction to only positive intensity values for incoherent photonic processors. In this work, we investigate the fundamental yet underexplored design and training challenges of physically constrained information processing with a particular focus on activation functions in non-negative neural networks (4Ns). Building on biological inspirations we revisit the concept of inhibitory (decreasing) and excitatory (increasing) activation functions, explore their effects experimentally and introduce a general approach for weight initialization of non-negative neural networks. Our results indicate the importance of both inhibitory and excitatory elements in activation functions in incoherent ONNs which should be considered for future design of optical activation functions for ONNs. Code is available at https://nnnn.cvmls.org |
|---|---|
| Beschreibung: | Gesehen am 24.02.2026 |
| Beschreibung: | Online Resource |
| ISSN: | 2169-3536 |
| DOI: | 10.1109/ACCESS.2025.3622408 |