Emerging opportunities and challenges for the future of reservoir computing – Nature Communications
Graves, A., Mohamed, A. R. & Hinton, G. Speech recognition with deep recurrent neural networks. In IEEE International Conference on Acoustics, Speech and Signal Processing, 66456649 (IEEE, 2013).
LeCun, Y., Bengio, Y. & Hinton, G. E. Deep learning. Nature 521, 436444 (2015).
Google Scholar
He, K., Zhang, X., Ren, S. & Sun, J. Deep residual learning for image recognition. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 770778 (IEEE, 2016).
Silver, D. et al. Mastering the game of go with deep neural networks and tree search. Nature 529, 484489 (2016).
Google Scholar
Krizhevsky, A., Sutskever, I. & Hinton, G. E. Imagenet classification with deep convolutional neural networks. Commun. ACM 60, 8490 (2017).
Google Scholar
Jumper, J. et al. Highly accurate protein structure prediction with alphafold. Nature 596, 583589 (2021).
Google Scholar
Brown, T. et al. Language models are few-shot learners. NeurIPS 33, 18771901 (2020).
Khan, A., Sohail, A., Zahoora, U. & Qureshi, A. S. A survey of the recent architectures of deep convolutional neural networks. Artif. Intell. Rev. 53, 54555516 (2020).
Google Scholar
Schuman, C. D. et al. Opportunities for neuromorphic computing algorithms and applications. Nat. Comput. Sci 2, 1019 (2022).
Google Scholar
Christensen, D. V. et al. 2022 roadmap on neuromorphic computing and engineering. Neuromorph. Comput. Eng. 2, 022501 (2022).
Google Scholar
Jaeger, H. The echo state approach to analysing and training recurrent neural networks-with an erratum note. Bonn, Germany: German Nat. Res. Center for Inf. Technol. GMD Tech. Rep. 148, 13 (2001). The first paper developing the concept and framework of echo state networks, e.g. reservoir computing. The paper provides propositions on how to construct ESNs and how to train them. The paper also shows that the ESN is able to learn and predict chaotic time series (Mackey-Glass equations).
Maass, W., Natschlger, T. & Markram, H. Real-time computing without stable states: A new framework for neural computation based on perturbations. Neural Comput. 14, 25312560 (2002). The first paper proposing the idea of liquid state machines. The model is able to learn from abundant perturbed states so as to learn various sequences, and can also fulfill real-time signal processing for time-varying inputs. This paper demonstrates that LSMs can be used for learning tasks such as spoken-digit recognition.
Google Scholar
Verstraeten, D., Schrauwen, B., DHaene, M. & Stroobandt, D. The unified reservoir computing concept and its digital hardware implementations. In Proceedings of the 2006 EPFL LATSIS Symposium, 139140 (EPFL, Lausanne, 2006).
Zhu, Q., Ma, H. & Lin, W. Detecting unstable periodic orbits based only on time series: When adaptive delayed feedback control meets reservoir computing. Chaos 29, 093125 (2019).
Google Scholar
Bertschinger, N. & Natschlger, T. Real-time computation at the edge of chaos in recurrent neural networks. Neural Comput. 16, 14131436 (2004).
Google Scholar
Rodan, A. & Tino, P. Minimum complexity echo state network. IEEE Trans. Neural Netw. 22, 131144 (2010).
Google Scholar
Verzelli, P., Alippi, C., Livi, L. & Tino, P. Input-to-state representation in linear reservoirs dynamics. IEEE Trans. Neural Netw. Learn. Syst. 33, 45984609 (2021).
Google Scholar
Gallicchio, C., Micheli, A. & Pedrelli, L. Deep reservoir computing: A critical experimental analysis. Neurocomputing 268, 8799 (2017).
Google Scholar
Gallicchio, C., Micheli, A. & Pedrelli, L. Design of deep echo state networks. Neural Netw. 108, 3347 (2018).
Google Scholar
Gallicchio, C. & Scardapane, S. Deep randomized neural networks. In Recent Trends in Learning From Data: Tutorials from the INNS Big Data and Deep Learning Conference, 4368 (Springer Cham, Switzerland, 2020).
Pathak, J., Hunt, B., Girvan, M., Lu, Z. & Ott, E. Model-free prediction of large spatiotemporally chaotic systems from data: A reservoir computing approach. Phys. Rev. Lett. 120, 024102 (2018). This paper proposes a parallel RC architecture to learn the behavior of Kuramoto-Sivashinsky (KS) equations. The work shows the exciting potential of RC in learning the computational behavior and state evolution of PDEs.
Google Scholar
Vlachas, P. R. et al. Backpropagation algorithms and reservoir computing in recurrent neural networks for the forecasting of complex spatiotemporal dynamics. Neural Netw. 126, 191217 (2020).
Google Scholar
Bianchi, F. M., Scardapane, S., Lkse, S. & Jenssen, R. Reservoir computing approaches for representation and classification of multivariate time series. IEEE Trans. Neural Netw. Learn. Syst. 32, 21692179 (2020).
Google Scholar
Gauthier, D. J., Bollt, E., Griffith, A. & Barbosa, W. A. Next generation reservoir computing. Nat. Commun. 12, 18 (2021). This work reveals an intriguing link between traditional RC and regression methods and in particular shows that nonlinear vector autoregression (NVAR) can equivalently represent RC while requiring fewer parameters to tune, leading to the development of so-called next-generation RC, shown to outperform traditional RC with less data and higher efficiency, pushing forward a significant step for constructing an interpretable machine learning.
Google Scholar
Joy, H., Mattheakis, M. & Protopapas, P. Rctorch: a pytorch reservoir computing package with automated hyper-parameter optimization. Preprint at https://doi.org/10.48550/arXiv.2207.05870 (2022).
Griffith, A., Pomerance, A. & Gauthier, D. J. Forecasting chaotic systems with very low connectivity reservoir computers. Chaos 29, 123108 (2019).
Google Scholar
Yperman, J. & Becker, T. Bayesian optimization of hyper-parameters in reservoir computing. Preprint at https://doi.org/10.48550/arXiv.1611.05193 (2016).
Appeltant, L. et al. Information processing using a single dynamical node as complex system. Nat. Commun. 2, 16 (2011).
Google Scholar
Paquot, Y. et al. Optoelectronic reservoir computing. Sci. Rep. 2, 16 (2012).
Google Scholar
Larger, L. et al. High-speed photonic reservoir computing using a time-delay-based architecture: Million words per second classification. Phys. Rev. X 7, 011015 (2017).
Dong, J., Rafayelyan, M., Krzakala, F. & Gigan, S. Optical reservoir computing using multiple light scattering for chaotic systems prediction. IEEE J. Sel. Top. Quantum Electron. 26, 112 (2019).
Google Scholar
Rafayelyan, M., Dong, J., Tan, Y., Krzakala, F. & Gigan, S. Large-scale optical reservoir computing for spatiotemporal chaotic systems prediction. Phys. Rev. X 10, 041037 (2020).
Google Scholar
Du, C. et al. Reservoir computing using dynamic memristors for temporal information processing. Nat. Commun. 8, 110 (2017). The work develops a physical RC system based on memristor arrays, finding that such a system is able to perform well in realizing handwritten digit recognition and solving a second-order nonlinear dynamic tasks with less than 100 reservoir nodes.
Google Scholar
Moon, J. et al. Temporal data classification and forecasting using a memristor-based reservoir computing system. Nat. Electron. 2, 480487 (2019).
Google Scholar
Zhong, Y. et al. Dynamic memristor-based reservoir computing for high-efficiency temporal signal processing. Nat. Commun. 12, 19 (2021).
Google Scholar
Sun, L. et al. In-sensor reservoir computing for language learning via two-dimensional memristors. Sci. Adv. 7, eabg1455 (2021).
Google Scholar
Lin, W. & Chen, G. Large memory capacity in chaotic artificial neural networks: A view of the anti-integrable limit. IEEE Trans. Neural Netw. 20, 13401351 (2009).
Google Scholar
Silva, N. A., Ferreira, T. D. & Guerreiro, A. Reservoir computing with solitons. New J. Phys. 23, 023013 (2021).
Google Scholar
Ghosh, S., Opala, A., Matuszewski, M., Paterek, T. & Liew, T. C. Quantum reservoir processing. npj Quantum Inf. 5, 16 (2019). Proposed a platform for quantum information processing developed on the principle of reservoir computing.
Google Scholar
Govia, L. C. G., Ribeill, G. J., Rowlands, G. E., Krovi, H. K. & Ohki, T. A. Quantum reservoir computing with a single nonlinear oscillator. Phys. Rev. Res. 3, 013077 (2021).
Google Scholar
Buehner, M. & Young, P. A tighter bound for the echo state property. IEEE Trans. Neural Netw. 17, 820824 (2006).
Google Scholar
Jaeger, H. Short Term Memory in Echo State Networks. Technical Report 152 (GMD, Berlin, 2001).
Duan, X. Y. et al. Embedding theory of reservoir computing and reducing reservoir network using time delays. Phys. Rev. Res. 5, L022041 (2023).
Google Scholar
Boyd, S. & Chua, L. Fading memory and the problem of approximating nonlinear operators with volterra series. IEEE Trans. Circuits Syst. 32, 11501161 (1985).
Google Scholar
Grigoryeva, L. & Ortega, J. P. Echo state networks are universal. Neural Netw. 108, 495508 (2018).
Google Scholar
Gonon, L. & Ortega, J. P. Fading memory echo state networks are universal. Neural Netw. 138, 1013 (2021).
Google Scholar
Gonon, L. & Ortega, J. P. Reservoir computing universality with stochastic inputs. IEEE Trans. Neural Netw. Learn. Syst. 31, 100112 (2019).
Google Scholar
Hart, A., Hook, J. & Dawes, J. Embedding and approximation theorems for echo state networks. Neural Netw. 128, 234247 (2020).
Google Scholar
Hart, A. G., Hook, J. L. & Dawes, J. H. Echo state networks trained by tikhonov least squares are l2 () approximators of ergodic dynamical systems. Physica D Nonlinear Phenomena 421, 132882 (2021).
Google Scholar
Gonon, L., Grigoryeva, L. & Ortega, J. P. Risk bounds for reservoir computing. J. Mach. Learn. Res. 21, 96849744 (2020).
Google Scholar
Bollt, E. On explaining the surprising success of reservoir computing forecaster of chaos? the universal machine learning dynamical system with contrast to var and dmd. Chaos 31, 013108 (2021).
Google Scholar
Krishnakumar, A., Ogras, U., Marculescu, R., Kishinevsky, M. & Mudge, T. Domain-specific architectures: Research problems and promising approaches. ACM Trans. Embed. Comput. Syst. 22, 126 (2023).
Google Scholar
Subramoney, A., Scherr, F. & Maass, W. Reservoirs learn to learn. Reservoir Computing: Theory, Physical Implementations, and Applications, 5976 (Springer Singapore, 2021).
Tanaka, G. et al. Recent advances in physical reservoir computing: A review. Neural Netw. 115, 100123 (2019).
Google Scholar
Jiang, W. et al. Physical reservoir computing using magnetic skyrmion memristor and spin torque nano-oscillator. Appl. Phys. Lett. 115, 192403 (2019).
Google Scholar
Coulombe, J. C., York, M. C. & Sylvestre, J. Computing with networks of nonlinear mechanical oscillators. PLOS ONE 12, e0178663 (2017).
Google Scholar
Larger, L., Goedgebuer, J. P. & Udaltsov, V. Ikeda-based nonlinear delayed dynamics for application to secure optical transmission systems using chaos. C. R. Phys. 5, 669681 (2004).
Google Scholar
Brunner, D., Soriano, M. C., Mirasso, C. R. & Fischer, I. Parallel photonic information processing at gigabyte per second data rates using transient states. Nat. Commun. 4, 1364 (2013).
Google Scholar
Katayama, Y., Yamane, T., Nakano, D., Nakane, R. & Tanaka, G. Wave-based neuromorphic computing framework for brain-like energy efficiency and integration. IEEE Trans. Nanotechnol. 15, 762769 (2016).
Google Scholar
Dion, G., Mejaouri, S. & Sylvestre, J. Reservoir computing with a single delay-coupled non-linear mechanical oscillator. J. Appl. Phys. 124, 152132 (2018).
Google Scholar
Cucchi, M. et al. Reservoir computing with biocompatible organic electrochemical networks for brain-inspired biosignal classification. Sci. Adv. 7, eabh0693 (2021).
Google Scholar
Rowlands, G. E. et al. Reservoir computing with superconducting electronics. Preprint at https://doi.org/10.48550/arXiv.2103.02522 (2021).
Verstraeten, D., Schrauwen, B. & Stroobandt, D. Reservoir computing with stochastic bitstream neurons. In Proceedings of the 16th Annual Prorisc Workshop, 454459 (2005). https://doi.org/https://biblio.ugent.be/publication/336133.
Schrmann, F., Meier, K. & Schemmel, J. Edge of chaos computation in mixed-mode vlsi-a hard liquid. NeurIPS, 17, (NIPS, 2004).
Torrejon, J. et al. Neuromorphic computing with nanoscale spintronic oscillators. Nature 547, 428431 (2017). First demonstration of RC implementation using a spintronic oscillator, opens up a route to realizing large-scale neural networks using magnetization dynamics.
Google Scholar
Vandoorne, K. et al. Experimental demonstration of reservoir computing on a silicon photonics chip. Nat. Commun. 5, 16 (2014). First demonstration of on-chip integrated photonic reservoir neural network, paves the way for the high density and high speeds photonic RC architecture.
Google Scholar
Larger, L. et al. Photonic information processing beyond turing: an optoelectronic implementation of reservoir computing. Opt. Express 20, 32413249 (2012). This paper proposed optical-based time-delay feedback RC architecture with a single nonlinear optoelectronic hardware. The experiment shows that the RC performs well in spoken-digit recognition and one-time-step prediction tasks.
Google Scholar
Duport, F., Schneider, B., Smerieri, A., Haelterman, M. & Massar, S. All-optical reservoir computing. Opt. Express 20, 2278322795 (2012). The first paper to develop RC system with a fiber-based all-optical architecture. The experiments show that the RC can be utilized in channel equalization and radar signal prediction tasks.
Google Scholar
Brunner, D. & Fischer, I. Reconfigurable semiconductor laser networks based on diffractive coupling. Opt. Lett. 40, 38543857 (2015).
Google Scholar
Gan, V. M., Liang, Y., Li, L., Liu, L. & Yi, Y. A cost-efficient digital esn architecture on fpga for ofdm symbol detection. ACM J. Emerg. Technol. Comput. Syst. 17, 115 (2021).
Google Scholar
Elbedwehy, A. N., El-Mohandes, A. M., Elnakib, A. & Abou-Elsoud, M. E. Fpga-based reservoir computing system for ecg denoising. Microprocess. Microsyst. 91, 104549 (2022).
Google Scholar
Lin, C., Liang, Y. & Yi, Y. Fpga-based reservoir computing with optimized reservoir node architecture. In 23rd International Symposium on Quality Electronic Design (ISQED), 16 (IEEE, 2022).
Bai, K. & Yi, Y. Dfr: An energy-efficient analog delay feedback reservoir computing system for brain-inspired computing. ACM J. Emerg. Technol. Comput. Syst. 14, 122 (2018).
Google Scholar
Petre, P. & Cruz-Albrecht, J. Neuromorphic mixed-signal circuitry for asynchronous pulse processing. In IEEE International Conference on Rebooting Computer, 14 (IEEE, 2016).
Nowshin, F., Zhang, Y., Liu, L. & Yi, Y. Recent advances in reservoir computing with a focus on electronic reservoirs. In International Green and Sustainable Computing Workshops, 18 (IEEE, 2020).
Soriano, M. C. et al. Delay-based reservoir computing: noise effects in a combined analog and digital implementation. IEEE Trans. Neural Netw. Learn. Syst. 26, 388393 (2014).
Google Scholar
Marinella, M. J. & Agarwal, S. Efficient reservoir computing with memristors. Nat. Electron. 2, 437438 (2019).
Google Scholar
Sun, W. et al. 3d reservoir computing with high area efficiency (5.12 tops/mm 2) implemented by 3d dynamic memristor array for temporal signal processing. In IEEE Symposium on VLSI Technology and Circuits (VLSI Technology and Circuits), 222223 (IEEE, 2022).
Allwood, D. A. et al. A perspective on physical reservoir computing with nanomagnetic devices. Appl. Phys. Lett. 122, 040501 (2023).
Google Scholar
Shen, Y. et al. Deep learning with coherent nanophotonic circuits. Nat. Photonics 11, 441446 (2017).
Google Scholar
Van der Sande, G., Brunner, D. & Soriano, M. C. Advances in photonic reservoir computing. Nanophotonics 6, 561576 (2017).
Google Scholar
Maass, W., Natschlger, T. & Markram, H. A model for real-time computation in generic neural microcircuits. NeurIPS 15 (NIPS, 2002).
Verstraeten, D., Schrauwen, B., Stroobandt, D. & Van Campenhout, J. Isolated word recognition with the liquid state machine: a case study. Inf. Process. Lett. 95, 521528 (2005).
Google Scholar
Verstraeten, D., Schrauwen, B. & Stroobandt, D. Reservoir-based techniques for speech recognition. In IEEE International Joint Conference on Neural Network Proceedings, 10501053 (IEEE, 2006).
Jalalvand, A., Van Wallendael, G. & Van de Walle, R. Real-time reservoir computing network-based systems for detection tasks on visual contents. In 7th International Conference on Computational Intelligence, Communication Systems and Networks, 146151 (IEEE, 2015).
Nakajima, M., Tanaka, K. & Hashimoto, T. Scalable reservoir computing on coherent linear photonic processor. Commun. Phys. 4, 20 (2021).
Google Scholar
Cao, J. et al. Emerging dynamic memristors for neuromorphic reservoir computing. Nanoscale 14, 289298 (2022).
Google Scholar
Jaeger, H. & Haas, H. Harnessing nonlinearity: Predicting chaotic systems and saving energy in wireless communication. Science 304, 7880 (2004).
Google Scholar
Nguimdo, R. M. & Erneux, T. Enhanced performances of a photonic reservoir computer based on a single delayed quantum cascade laser. Opt. Lett. 44, 4952 (2019).
Google Scholar
Argyris, A., Bueno, J. & Fischer, I. Photonic machine learning implementation for signal recovery in optical communications. Sci. Rep. 8, 113 (2018).
Google Scholar
Argyris, A. et al. Comparison of photonic reservoir computing systems for fiber transmission equalization. IEEE J. Sel. Top. Quantum Electron. 26, 19 (2019).
Google Scholar
Sackesyn, S., Ma, C., Dambre, J. & Bienstman, P. Experimental realization of integrated photonic reservoir computing for nonlinear fiber distortion compensation. Opt. Express 29, 3099130997 (2021).
Google Scholar
Sozos, K. et al. High-speed photonic neuromorphic computing using recurrent optical spectrum slicing neural networks. Comms. Eng. 1, 24 (2022).
Google Scholar
Jaeger, H. Adaptive nonlinear system identification with echo state networks. In NeurIPS, 15 (NIPS, 2002).
Soh, H. & Demiris, Y. Iterative temporal learning and prediction with the sparse online echo state gaussian process. In International Joint Conference on Neural Networks (IJCNN), 18 (IEEE, 2012).
Kim, J. Z., Lu, Z., Nozari, E., Pappas, G. J. & Bassett, D. S. Teaching recurrent neural networks to infer global temporal structure from local examples. Nat. Mach. Intell. 3, 316323 (2021).
Google Scholar
Li, X. et al. Tipping point detection using reservoir computing. Research 6, 0174 (2023).
Google Scholar
Goudarzi, A., Banda, P., Lakin, M. R., Teuscher, C. & Stefanovic, D. A comparative study of reservoir computing for temporal signal processing. Preprint at https://doi.org/10.48550/arXiv.1401.2224 (2014).
Walleshauser, B. & Bollt, E. Predicting sea surface temperatures with coupled reservoir computers. Nonlinear Process. Geophys. 29, 255264 (2022).
Google Scholar
Okamoto, T. et al. Predicting traffic breakdown in urban expressways based on simplified reservoir computing. In Proceedings of AAAI 21 Workshop: AI for Urban Mobility, (2021). https://aaai.org/conference/aaai/aaai-21/ws21workshops/.
Yamane, T. et al. Application identification of network traffic by reservoir computing. In International Conference on Neural Information Processing, 389396 (Springer Cham, 2019).
Ando, H. & Chang, H. Road traffic reservoir computing. Preprint at https://doi.org/10.48550/arXiv.1912.00554 (2019).
Wang, J., Niu, T., Lu, H., Yang, W. & Du, P. A novel framework of reservoir computing for deterministic and probabilistic wind power forecasting. IEEE Trans. Sustain. Energy 11, 337349 (2019).
Google Scholar
Joshi, P. & Maass, W. Movement generation and control with generic neural microcircuits. In International Workshop on Biologically Inspired Approaches to Advanced Information Technology, 258273 (Springer, 2004).
Burgsteiner, H. Training networks of biological realistic spiking neurons for real-time robot control. In Proceedings of the 9th international conference on engineering applications of neural networks, 129136 (2005). https://users.abo.fi/abulsari/EANN.html.
Burgsteiner, H., Krll, M., Leopold, A. & Steinbauer, G. Movement prediction from real-world images using a liquid state machine. In Innovations in Applied Artificial Intelligence: 18th International Conference on Industrial and Engineering Applications of Artificial Intelligence and Expert Systems, 121130 (Springer, 2005).
Schwedersky, B. B., Flesch, R. C. C., Dangui, H. A. S. & Iervolino, L. A. Practical nonlinear model predictive control using an echo state network model. In IEEE International Joint Conference on Neural Networks (IJCNN), 18 (IEEE, 2018).
Canaday, D., Pomerance, A. & Gauthier, D. J. Model-free control of dynamical systems with deep reservoir computing. J. Phys. Complexity 2, 035025 (2021).
Google Scholar
Baldini, P. Reservoir computing in robotics: a review. Preprint at https://doi.org/10.48550/arXiv.2206.11222 (2022).
Arcomano, T., Szunyogh, I., Wikner, A., Hunt, B. R. & Ott, E. A hybrid atmospheric model incorporating machine learning can capture dynamical processes not captured by its physics-based component. Geophys. Res. Lett. 50, e2022GL102649 (2023).
Google Scholar
Arcomano, T. et al. A machine learning-based global atmospheric forecast model. Geophys. Res. Lett. 47, e2020GL087776 (2020). This work extends the parallel RC framework in the application of weather forecasting, suggesting great potential of RC in challenging real-world scenarios at a fraction of the cost of deep neural networks.
Google Scholar
Latva-Aho, M. & Leppnen, K. Key drivers and research challenges for 6g ubiquitous wireless intelligence. https://urn.fi/URN:ISBN:9789526223544 (2019).
Rong, B. 6G: The Next Horizon: From Connected People and Things to Connected Intelligence. IEEE Wirel. Commun. 28, 88 (2021).
Google Scholar
Mytton, D. & Ashtine, M. Sources of data center energy estimates: A comprehensive review. Joule 6, 20322056 (2022).
Google Scholar
Jung, J. H. & Lim, D. G. Industrial robots, employment growth, and labor cost: A simultaneous equation analysis. Technol. Forecast. Soc. Change 159, 120202 (2020).
Google Scholar
Boschert, S. & Rosen, R. Digital twin-the simulation aspect. In Mechatronic Futures: Challenges and Solutions for Mechatronic Systems and Their Designers Page 5974 (Springer Cham, Switzerland, 2016).
Kao, C. K. Nobel lecture: Sand from centuries past: Send future voices fast. Rev. Mod. Phys. 82, 2299 (2010).
Google Scholar
Hillerkuss, D., Brunner, M., Jun, Z. & Zhicheng, Y. A vision towards f5g advanced and f6g. In 13th International Symposium on Communication Systems, Networks and Digital Signal Processing (CSNDSP) 483487 (IEEE, 2022).
Liu, X. Optical Communications in the 5G Era (Academic Press, Cambridge, 2021).
Liu, Q., Ma, Y., Alhussein, M., Zhang, Y. & Peng, L. Green data center with iot sensing and cloud-assisted smart temperature control system. Comput. Netw. 101, 104112 (2016).
Google Scholar
Magno, M., Polonelli, T., Benini, L. & Popovici, E. A low cost, highly scalable wireless sensor network solution to achieve smart led light control for green buildings. IEEE Sens. J. 15, 29632973 (2014).
Google Scholar
Shen, S., Roy, N., Guan, J., Hassanieh, H. & Choudhury, R. R. Mute: bringing iot to noise cancellation. In Proceedings of the 2018 Conference of the ACM Special Interest Group on Data Communication, 282296 (ACM, 2018).
Mokrani, H., Lounas, R., Bennai, M. T., Salhi, D. E. & Djerbi, R. Air quality monitoring using iot: A survey. In IEEE International Conference on Smart Internet of Things (SmartIoT), 127134 (IEEE, 2019).
Raissi, M., Perdikaris, P. & Karniadakis, G. E. Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations. J. Comput. Phys. 378, 686707 (2019).
Google Scholar
Amil, P., Soriano, M. C. & Masoller, C. Machine learning algorithms for predicting the amplitude of chaotic laser pulses. Chaos 29, 113111 (2019).
Google Scholar
Antonik, P. et al. Online training of an opto-electronic reservoir computer applied to real-time channel equalization. IEEE Trans. Neural Netw. Learn. Syst. 28, 26862698 (2016).
Google Scholar
Porte, X. et al. A complete, parallel and autonomous photonic neural network in a semiconductor multimode laser. J. Phys. Photon. 3, 024017 (2021).
Google Scholar
Gholami, A., Yao, Z., Kim, S., Mahoney, M. W., and Keutzer, K. Ai and memory wall. RiseLab Medium Post, University of Califonia Berkeley. https://medium.com/riselab/ai-and-memory-wall-2cb4265cb0b8 (2021).
Dai, Y., Yamamoto, H., Sakuraba, M. & Sato, S. Computational efficiency of a modular reservoir network for image recognition. Front. Comput. Neurosci. 15, 594337 (2021).
Google Scholar
Komkov, H. B. Reservoir Computing with Boolean Logic Network Circuits. Doctoral dissertation, (University of Maryland, College Park, 2021).
Zhang, Y., Li, P., Jin, Y. & Choe, Y. A digital liquid state machine with biologically inspired learning and its application to speech recognition. IEEE Trans. Neural Netw. Learn. Syst. 26, 26352649 (2015).
Google Scholar
Dai, Z. et al. A scalable small-footprint time-space-pipelined architecture for reservoir computing. IEEE Trans. Circuits Syst. II: Express Briefs 70, 30693073 (2023).
Bai, K., Liu, L. & Yi, Y. Spatial-temporal hybrid neural network with computing-in-memory architecture. IEEE Trans. Circuits Syst. I: Regul. Pap. 68, 28502862 (2021).
Google Scholar
Watt, S., Kostylev, M., Ustinov, A. B. & Kalinikos, B. A. Implementing a magnonic reservoir computer model based on time-delay multiplexing. Phys. Rev. Appl. 15, 064060 (2021).
Google Scholar
Qin, J., Zhao, Q., Yin, H., Jin, Y. & Liu, C. Numerical simulation and experiment on optical packet header recognition utilizing reservoir computing based on optoelectronic feedback. IEEE Photonics J. 9, 111 (2017).
Susandhika, M. A comprehensive review and comparative analysis of 5g and 6g based mimo channel estimation techniques. In International Conference on Recent Trends in Electronics and Communication (ICRTEC), 18 (IEEE, 2023).
Chang, H. H., Liu, L. & Yi, Y. Deep echo state q-network (deqn) and its application in dynamic spectrum sharing for 5g and beyond. IEEE Trans. Neural Netw. Learn. Syst. 33, 929939 (2020).
Google Scholar
Zhou, Z., Liu, L., Chandrasekhar, V., Zhang, J. & Yi, Y. Deep reservoir computing meets 5g mimo-ofdm systems in symbol detection. In Proceedings of the AAAI Conference on Artificial Intelligence 34, 12661273 (AAAI, 2020).
Zhou, Z., Liu, L. & Xu, J. Harnessing tensor structures-multi-mode reservoir computing and its application in massive mimo. IEEE Trans. Wirel. Commun. 21, 81208133 (2022).
Google Scholar
Wanshi, C. et al. 5g-advanced towards 6g: Past, present, and future. IEEE J. Sel. Areas Commun. 41, 15921619 (2023).
Google Scholar
Mller, T. et al. Distributed fibre optic sensing for sinkhole early warning: experimental study. Gotechniqu 73, 701715 (2023).
Google Scholar
Liu, X. et al. Ai-based modeling and monitoring techniques for future intelligent elastic optical networks. Appl. Sci. 10, 363 (2020).
Google Scholar
Saif, W. S., Esmail, M. A., Ragheb, A. M., Alshawi, T. A. & Alshebeili, S. A. Machine learning techniques for optical performance monitoring and modulation format identification: A survey. IEEE Commun. Surv. Tutor. 22, 28392882 (2020).
Google Scholar
Song, H., Bai, J., Yi, Y., Wu, J. & Liu, L. Artificial intelligence enabled internet of things: Network architecture and spectrum access. IEEE Comput. Intell. Mag. 15, 4451 (2020).
Google Scholar
Nyman, J., Caluwaerts, K., Waegeman, T. & Schrauwen, B. System modeling for active noise control with reservoir computing. In 9th IASTED International Conference on Signal Processing, Pattern Recognition, and Applications, 162167 (IASTED, 2012).
Hamedani, K. et al. Detecting dynamic attacks in smart grids using reservoir computing: A spiking delayed feedback reservoir based approach. IEEE Trans. Emerg. Top. Comput. Intell. 4, 253264 (2019).
Google Scholar
Patel, Y. S., Jaiswal, R. & Misra, R. Deep learning-based multivariate resource utilization prediction for hotspots and coldspots mitigation in green cloud data centers. J. Supercomput. 78, 58065855 (2022).
Google Scholar
Antonelo, E. A. & Schrauwen, B. On learning navigation behaviors for small mobile robots with reservoir computing architectures. IEEE Trans. Neural Netw. Learn. Syst. 26, 763780 (2014).
Google Scholar
Dragone, M., Gallicchio, C., Guzman, R. & Micheli, A. RSS-based robot localization in critical environments using reservoir computing. In The 24th European Symposium on Artificial Neural Networks (ESANN, 2016).
Sumioka, H., Nakajima, K., Sakai, K., Minato, T. & Shiomi, M. Wearable tactile sensor suit for natural body dynamics extraction: case study on posture prediction based on physical reservoir computing. In IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 95049511 (IEEE, 2021).
Wang, K. et al. A review of microsoft academic services for science of science studies. Front. Big Data 2, 45 (2019).
Smolensky, P., McCoy, R., Fernandez, R., Goldrick, M. & Gao, J. Neurocompositional computing: From the central paradox of cognition to a new generation of ai systems. AI Mag. 43, 308322 (2022).
Callaway, E. it will change everything: Deepminds ai makes gigantic leap in solving protein structures. Nature 588, 203205 (2020).
Google Scholar
Callaway, E. The entire protein universe: Ai predicts shape of nearly every known protein. Nature 608, 1516 (2022).
Google Scholar
Lee, P., Bubeck, S. & Petro, J. Benefits, limits, and risks of gpt-4 as an ai chatbot for medicine. N. Engl. J. Med. 388, 12331239 (2023).
Google Scholar
Hu, Z., Jagtap, A. D., Karniadakis, G. E. & Kawaguchi, K. Augmented physics-informed neural networks (apinns): A gating network-based soft domain decomposition methodology. Eng. Appl. Artif. Intell. 126, 107183 (2023).
Google Scholar
Kashinath, K. et al. Physics-informed machine learning: case studies for weather and climate modelling. Philos. Trans. R. Soc. A 379, 20200093 (2021).
Google Scholar
Min, Q., Lu, Y., Liu, Z., Su, C. & Wang, B. Machine learning based digital twin framework for production optimization in petrochemical industry. Int. J. Inf. Manag. 49, 502519 (2019).
Google Scholar
Kamble, S. S. et al. Digital twin for sustainable manufacturing supply chains: Current trends, future perspectives, and an implementation framework. Technol. Forecast. Soc. Change 176, 121448 (2022).
Google Scholar
Rhm, A. et al. Reconstructing seen and unseen attractors from data via autonomous-mode reservoir computing. In AI and Optical Data Sciences IV Page PC124380E (SPIE, Bellingham, 2023).
Kong, L. W., Weng, Y., Glaz, B., Haile, M. & Lai, Y. C. Reservoir computing as digital twins for nonlinear dynamical systems. Chaos 33, 033111 (2023).
Google Scholar