Symmetry-aware reservoir computing

Wendson A. S. Barbosa, Aaron Griffith, Graham E. Rowlands, Luke C. G. Govia, Guilhem J. Ribeill, Minh-Hai Nguyen, Thomas A. Ohki, and Daniel J. Gauthier
Phys. Rev. E 104, 045307 – Published 13 October 2021

Abstract

We demonstrate that matching the symmetry properties of a reservoir computer (RC) to the data being processed dramatically increases its processing power. We apply our method to the parity task, a challenging benchmark problem that highlights inversion and permutation symmetries, and to a chaotic system inference task that presents an inversion symmetry rule. For the parity task, our symmetry-aware RC obtains zero error using an exponentially reduced neural network and training data, greatly speeding up the time to result and outperforming artificial neural networks. When both symmetries are respected, we find that the network size N necessary to obtain zero error for 50 different RC instances scales linearly with the parity-order n. Moreover, some symmetry-aware RC instances perform a zero error classification with only N=1 for n7. Furthermore, we show that a symmetry-aware RC only needs a training data set with size on the order of (n+n/2) to obtain such a performance, an exponential reduction in comparison to a regular RC which requires a training data set with size on the order of n2n to contain all 2n possible n-bit-long sequences. For the inference task, we show that a symmetry-aware RC presents a normalized root-mean-square error three orders-of-magnitude smaller than regular RCs. For both tasks, our RC approach respects the symmetries by adjusting only the input and the output layers, and not by problem-based modifications to the neural network. We anticipate that the generalizations of our procedure can be applied in information processing for problems with known symmetries.

  • Figure
  • Figure
  • Figure
  • Figure
  • Figure
  • Figure
  • Figure
  • Received 29 January 2021
  • Revised 19 July 2021
  • Accepted 22 September 2021

DOI:https://doi.org/10.1103/PhysRevE.104.045307

©2021 American Physical Society

Physics Subject Headings (PhySH)

Nonlinear DynamicsNetworks

Authors & Affiliations

Wendson A. S. Barbosa1,*, Aaron Griffith1, Graham E. Rowlands2,†, Luke C. G. Govia2, Guilhem J. Ribeill2, Minh-Hai Nguyen2, Thomas A. Ohki2, and Daniel J. Gauthier1,‡

  • 1Department of Physics, The Ohio State University, 191 W. Woodruff Ave., Columbus, Ohio 43210, USA
  • 2Quantum Engineering and Computing, Raytheon BBN Technologies, Cambridge, Massachusetts 02138, USA

  • *desabarbosa.1@osu.edu
  • graham.rowlands@raytheon.com
  • gauthier.51@osu.edu

Article Text (Subscription Required)

Click to Expand

References (Subscription Required)

Click to Expand
Issue

Vol. 104, Iss. 4 — October 2021

Reuse & Permissions
Access Options
Author publication services for translation and copyediting assistance advertisement

Authorization Required


×
×

Images

×

Sign up to receive regular email alerts from Physical Review E

Log In

Cancel
×

Search


Article Lookup

Paste a citation or DOI

Enter a citation
×