Publications

2024

Training Coupled Phase Oscillators as a Neuromorphic Platform using Equilibrium Propagation

Training Coupled Phase Oscillators as a Neuromorphic Platform using Equilibrium Propagation

Qingshan Wang, Clara C. Wanjura, Florian Marquardt

Neuromorphic Computing and Engineering 4 034014 (2024) | Journal | PDF

Given the rapidly growing scale and resource requirements of machine learning applications, the idea of building more efficient learning machines much closer to the laws of physics is an attractive proposition. One central question for identifying promising candidates for such neuromorphic platforms is whether not only inference but also training can exploit the physical dynamics. In this work, we show that it is possible to successfully train a system of coupled phase oscillators—one of the most widely investigated nonlinear dynamical systems with a multitude of physical implementations, comprising laser arrays, coupled mechanical limit cycles, superfluids, and exciton-polaritons. To this end, we apply the approach of equilibrium propagation, which permits to extract training gradients via a physical realization of backpropagation, based only on local interactions. The complex energy landscape of the XY/Kuramoto model leads to multistability, and we show how to address this challenge. Our study identifies coupled phase oscillators as a new general-purpose neuromorphic platform and opens the door towards future experimental implementations.

Fully Non-Linear Neuromorphic Computing with Linear Wave Scattering

Fully Non-Linear Neuromorphic Computing with Linear Wave Scattering

Clara C. Wanjura, Florian Marquardt

Nature Physics 20 1434-1440 (2024) | Journal | PDF

The increasing complexity of neural networks and the energy consumption associated with training and inference create a need for alternative neuromorphic approaches, e.g. using optics. Current proposals and implementations rely on physical non-linearities or opto-electronic conversion to realise the required non-linear activation function. However, there are significant challenges with these approaches related to power levels, control, energy-efficiency, and delays. Here, we present a scheme for a neuromorphic system that relies on linear wave scattering and yet achieves non-linear processing with a high expressivity. The key idea is to inject the input via physical parameters that affect the scattering processes. Moreover, we show that gradients needed for training can be directly measured in scattering experiments. We predict classification accuracies on par with results obtained by standard artificial neural networks. Our proposal can be readily implemented with existing state-of-the-art, scalable platforms, e.g. in optics, microwave and electrical circuits, and we propose an integrated-photonics implementation based on racetrack resonators that achieves high connectivity with a minimal number of waveguide crossings.

Training of Physical Neural Networks

Training of Physical Neural Networks

Ali Momeni, Babak Rahmani, Benjamin Scellier, Logan G. Wright, Peter L. McMahon, Clara C. Wanjura, Yuhang Li, Anas Skalli, Natalia G. Berloff, et al.

arXiv 2406.03372 (2024) | Preprint | PDF

Physical neural networks (PNNs) are a class of neural-like networks that leverage the properties of physical systems to perform computation. While PNNs are so far a niche research area with small-scale laboratory demonstrations, they are arguably one of the most underappreciated important opportunities in modern AI. Could we train AI models 1000x larger than current ones? Could we do this and also have them perform inference locally and privately on edge devices, such as smartphones or sensors? Research over the past few years has shown that the answer to all these questions is likely "yes, with enough research": PNNs could one day radically change what is possible and practical for AI systems. To do this will however require rethinking both how AI models work, and how they are trained - primarily by considering the problems through the constraints of the underlying hardware physics. To train PNNs at large scale, many methods including backpropagation-based and backpropagation-free approaches are now being explored. These methods have various trade-offs, and so far no method has been shown to scale to the same scale and performance as the backpropagation algorithm widely used in deep learning today. However, this is rapidly changing, and a diverse ecosystem of training techniques provides clues for how PNNs may one day be utilized to create both more efficient realizations of current-scale AI models, and to enable unprecedented-scale models.

Detailed balance in non-equilibrium dynamics of granular matter: derivation and implications

Detailed balance in non-equilibrium dynamics of granular matter: derivation and implications

Clara C. Wanjura, Amelie Mayländer, Othmar Marti, Raphael Blumenfeld

arXiv 2404.05059 (2024) | Preprint | PDF

Discovering fundamental principles governing the dynamics of granular media has been a long-standing challenge. Recent predictions of detailed balance steady states (DBSS), supported by experimental observations in cyclic shear experiments of planar granular systems, called into question the common belief that the detailed balance principle is only a feature of equilibrium. Here, we first show analytically that DBSS in planar granular dynamics arise when a certain conditional cell order distribution is independent of the condition. We then demonstrate that this condition is met in rotational shear experiments, which indeed also give rise to robust DBSS. This suggests that DBSS not only exist but are also quite common. We also show that, when the unconditional cell order distribution maximises the entropy, as has been found recently, then this distribution is determined by a single parameter - the ratio of splitting and merging rates of cells of any arbitrary order. These results simplify the modelling of the complex dynamics of planar granular systems to the solution of recently proposed evolution equations, demonstrating their predictive power.<br>

Optomechanical realization of the bosonic Kitaev chain

Optomechanical realization of the bosonic Kitaev chain

Jesse J. Slim, Clara C. Wanjura, Matteo Brunelli, Javier del Pino, Andreas Nunnenkamp, Ewold Verhagen

Nature 627 767-771 (2024) | Journal

The fermionic Kitaev chain is a canonical model featuring topological Majorana zero modes. We report the experimental realization of its bosonic analogue in a nanooptomechanical network, in which the parametric interactions induce beam-splitter coupling and two-mode squeezing among the nanomechanical modes, analogous to hopping and p-wave pairing in the fermionic case, respectively. This specific structure gives rise to a set of extraordinary phenomena in the bosonic dynamics and transport. We observe quadrature-dependent chiral amplification, exponential scaling of the gain with system size and strong sensitivity to boundary conditions. All these are linked to the unique non-Hermitian topological nature of the bosonic Kitaev chain.<br>We probe the topological phase transition and uncover a rich dynamical phase diagram by controlling interaction phases and amplitudes. Finally, we present an experimental demonstration of an exponentially enhanced response to a small perturbation. These results represent the demonstration of a new synthetic phase of matter whose bosonic dynamics do not have fermionic parallels, and we have established a powerful system for studying non-Hermitian topology and its applications for signal manipulation and sensing.

Contact

Research Group Clara Wanjura

Max Planck Institute for the Science of Light
Staudtstr. 2
91058 Erlangen, Germany

clara.wanjura@mpl.mpg.de

MPL Research Centers and Schools