analiza aiqbench
This research proposes TIDAL-Net, a hardware-efficient architecture for physical neural networks that overcomes weight adjustment bottlenecks through time-multiplexed layer reuse. By leveraging inherent timescale separations between fast dynamics and slow trainable parameters, the approach effectively increases network depth without incurring significant implementation costs. Numerical results on image classification and NLP tasks demonstrate that this method achieves performance gains with only minor modifications to existing PNN prototypes.
Time-multiplexed layer reuse for physical neural networks
arXiv:2511.00044v3 Announce Type: replace Abstract: Physical neural networks (PNNs) are promising candidates for next-generation computing, but existing demonstrations remain several orders of magnitude smaller than modern digital neural networks, whose recent advances have been driven by rapid growth in trainable parameters. This situation resembles the constraints of early digital neural networks, which led to ideas around parameter reuse. We investigate what similarly efficient hardware architectures may look like, focusing specifically on the common bottleneck of slow re-adjustment of the weights in PNNs. We propose the Time-Indexed Deep Alternating Layers Network (TIDAL-Net), which occupies an intermediate regime between recurrent and deep neural networks, specifically aimed at the scales and restrictions of common PNN prototypes. TIDAL-Net leverages the timescale separation found in many PNNs between fast forward dynamics and slowly trainable weights and biases, using layer-by-layer time multiplexing to increase effective depth while limiting implementation cost. Numerical experiments on image classification and natural language processing tasks show that TIDAL-Net improves performance with only minor modifications to conventional PNNs.
Abstract:Physical neural networks (PNNs) are promising candidates for next-generation computing, but existing demonstrations remain several orders of magnitude smaller than modern digital neural networks, whose recent advances have been driven by rapid growth in trainable parameters. This situation resembles the constraints of early digital neural networks, which led to ideas around parameter reuse. We investigate what similarly efficient hardware architectures may look like, focusing specifically on the common bottleneck of slow re-adjustment of the weights in PNNs. We propose the Time-Indexed Deep Alternating Layers Network (TIDAL-Net), which occupies an intermediate regime between recurrent and deep neural networks, specifically aimed at the scales and restrictions of common PNN prototypes. TIDAL-Net leverages the timescale separation found in many PNNs between fast forward dynamics and slowly trainable weights and biases, using layer-by-layer time multiplexing to increase effective depth while limiting implementation cost. Numerical experiments on image classification and natural language processing tasks show that TIDAL-Net improves performance with only minor modifications to conventional PNNs.
Machine Learning (cs.LG); Adaptation and Self-Organizing Systems (nlin.AO)
arXiv:2511.00044 [cs.LG]
(or arXiv:2511.00044v3 [cs.LG] for this version)
Text integral sub licența deschisă a publicației · 177 cuvinte
Subiecte conexe
Time-multiplexed layer reuse for physical neural networks
arXiv · 7 oct. 2026
News
Quantum Computing Report · 25 iul. 2026
The hard physics and complex economics of AI’s insatiable hunger for power
SiliconANGLE · 11 sept. 2026
The Lab Mistake That Might Revolutionize Computing
IEEE Spectrum · 29 iun. 2026