ISSN:1390-9266 e-ISSN:1390-9134 LAJC 2024
15
DOI:
LATIN-AMERICAN JOURNAL OF COMPUTING (LAJC), Vol XI, Issue 2, July 2024
10.5281/zenodo.12169048
L. Campos, A.Dias, J. Dutra and W. da Silva,
“Exploring Digital Twins of Nonlinear Systems through Meta-Modeling with Echo State Networks”,
Latin-American Journal of Computing (LAJC), vol. 11, no. 2, 2024.
Networks (FNNs) and Recurrent Neural Networks (RNNs).
RNNs offer computational advantages for dynamic process
systems owing to their inherent feedback loops. However,
training traditional RNNs can be complicated due to issues
like the "vanishing gradient" problem [10]. To address this,
[11] introduced the Echo State Network (ESN). Unlike
traditional RNNs that adjust all synaptic weights, ESNs
maintain fixed input and recurrent connections, focusing
solely on training output connections through a relatively
simple linear regression process. This approach circumvents
the complexities of training recurrent connections and
mitigates gradient-related challenges. Consequently, ESNs
present an effective solution for harnessing the power of
RNNs while mitigating training complexities, particularly
in scenarios where efficient learning is essential.
This article proposes using an Echo State Network as a
meta-model to approximate dynamic nonlinear models and
evaluate the performance in a closed-loop application. This
work assesses the potential of this approach for this purpose,
analyzing the performance of different methodologies in
modeling a CSTR reactor through the construction of a
digital twin. Section 2 presents a brief background on the
metamodeling problem. Section 3 elaborates a case study
based on a simulated bioreactor and details the data
acquisition procedure. The theory, rationale, and
construction of the Echo State Network are described in
Section 4, followed by the discussion of simulation results.
The contribution of this article lies in presenting initial
steps towards developing digital twins of chemical
processes using ESN-driven meta-modeling. By
demonstrating the efficacy of ESNs in generating
computationally efficient surrogate representations of a
classical nonlinear dynamical system, this work opens space
for online process monitoring and optimized control of
industrial plants.
II. T
HE METAMODELING PROBLEM
A meta-model (or surrogate model) can be conceived as
a "model of a model" [6], functioning as a simplified
representation of a high-fidelity simulation model [12]. It
emulates the response by delineating the relationship
between inputs () and outputs () based on data acquired
with known precision or uncertainty [13]. The importance
of metamodeling lies in its ability to balance accuracy and
computational efficiency. Hence, metamodeling emerges as
an essential approach to navigating real-world system
intricacies, especially those characterized by nonlinear
relationships, numerous variables, and complex behaviors.
In industrial settings, meta-models are employed for
tasks which necessitate the establishment of a (complex)
relationship between the inputs and outputs of a process
system. This relationship can be encapsulated by an
extended meta-model equation that incorporates the
feedback signal (1):
Where
represents the current output,
denotes the
current inputs,
is the previous output (feedback
signal), is the relationship that incorporates inputs and
feedback, and represents error or uncertainty in the meta-
model prediction.
By offering a simplified representation of burdensome
simulations, meta-models facilitate quicker evaluations and
decision-making - crucial aspects in industries that demand
real-time solutions. This approach enables approaching
complex systems without the need of resource-intensive
full-scale simulations, which can be computationally
demanding and time-consuming. Some commonly used
metamodeling techniques encompass polynomial surface
response models, Kriging, Radial Basis Functions, Support
Vector Regression, and Artificial Neural Networks
[13][14]. These techniques generate approximated
mappings from inputs to outputs. The choice depends on
problem characteristics, available data, and required
predictions.
Metamodeling using neural networks adopts a data-
driven approach that harnesses the principles of ANNs to
construct efficient approximations of complex systems.
This methodology entails training the neural network on a
dataset that reflects the system behavior under scrutiny. This
dataset consists of input variables paired with corresponding
output values, that facilitates the network identification of
underlying patterns and correlations. Following training, the
neural network can provide predictions for new input data,
substantially which alleviates computational burdens
compared to resource-intensive full-scale simulations.
The increased processing speed has dramatically
expanded the applicability of neural network-based
metamodeling. For example, [15] employed a neural
network as a meta-model to approximate a copper porphyry
mine comminution circuit, which leads to a significant
acceleration of simulations compared to traditional
phenomenological models. Additionally, [16] utilized
neural networks in the metamodeling of reactive transport,
and this reduces computational time for scenarios requiring
multiple realizations. These studies highlight the versatility
of neural network-based metamodeling in improving
efficiency, accuracy, and computational performance across
various domains.
Modeling and Data Generation
The mathematical model employed to generate the data
was adapted from [17], outlining the dynamic behavior of a
bioreactor. The equations that govern substrate balance, S,
and cell balance, , are expressed by (2) and (3),
respectively, while the reaction rate, (), is defined by (4),
where is defined as the dilution rate, that represents the
ratio between the volumetric feed flow rate and the reactor
volume, and
stands for the substrate feed concentration.
(2)
(3)
(4)
All code implementations were developed in Python,
with the free Spyder development environment (version