Machine Learning Methods
Machine Learning Methods
2024
AVIATION
Volume 28
Issue 2
Pages 64–71
https://doi.org/10.3846/aviation.2024.21472
Article History: Abstract. The thermal conductivity coefficient of epoxy composites for aircraft, which are reinforced with
■ received 19 November 2023 glass fiber and filled with aerosil, γ-aminopropylaerosil, aluminum oxide, chromium oxide, respectively, was
■ accepted 24 January 2024 simulated. To this end, various machine learning methods were used, in particular, neural networks and boost-
ed trees. The results obtained were found to be in good agreement with the experimental data. In particular,
the correlation coefficient in the test sample was 0.99%. The prediction error of neural networks in the test
samples was 0.5; 0.3; 0.2%, while that of boosted trees was 1.5; 0.9%.
Keywords: epoxy-based composites, fillers, modelling, aircraft, aerospace applications, machine learning.
This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0/),
which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Aviation, 2024, 28(2), 64–71 65
between the surfaces of the filler and the polymer. The ary. In the other case, it leads to a decrease in l due to
thermal expansion of polymers is characterized by cer- a higher defectiveness of the boundary layer. In addition,
tain features in the range of glass transition temperature. thermal resistance also increases in response to the elevat-
These features are known to depend on the temperature ed temperature caused by failure of physical nodes. At the
variation rate. Therefore, investigations into the thermo- same time, the thermal conductivity of the filler accounts
physical properties that affect the service characteristics for an increase in the filler content with an increase in the
remain topical. thermal conductivity of the matrix.
This research aims at predicting the thermal conduc- In general, the thermophysical properties of epoxy
tivity coefficient of the epoxy composites reinforced with composite materials depend both on the nature and
glass fiber and filled with aerosil, γ-aminopropylaerosil, amount of the filler and the specifics of the particle sur-
aluminum oxide, chromium oxide, respectively, during their face. In addition, these characteristics can be improved by
heating. For this purpose, various machine learning meth- introducing the fillers that are chemically active in relation
ods are used, in particular, neural networks and boosted to the matrix. These fillers form a strong bond between the
decision trees. The results obtained are compared. binder macromolecules and the filler surface, which occurs
as a result of the chemical and chemisorption interaction.
OUT jl F (NET jl − q jl ) ;
= (2) 3. Results and discussion
x mj (l +1) = OUTml , (3) 3.1. Composition of the filled epoxy polymers
reinforced with basalt and glass fiber
where i is the number of entry into the layer; j is the neu-
ron number in the layer; l is the layer number; xijl is the i-th The introduction of fillers into epoxy composite materials
input signal of the j-th neuron in layer l; wijl is the weight in known to increase the heat resistance of the compos-
coefficient of the i-th input of the j-th neuron of layer l; ites compared to that of the polymer binder. Accordingly,
NETjl is the NET signal of the j-th neuron of layer l; Outjl the heat resistance of epoxy composites depends both on
is the output signal; F is the nonlinear activation function; the filler’s nature and the specifics of the particle surface.
qjl is the threshold level of a particular neuron. In particular, the presence of active (g-aminopropylaerosil
The choice of the neural network architecture, learning and aerosil) and inert (Al2O3 and Cr2O3) fillers allows in-
algorithm, error function, and activation function of the creasing the thermal stability limits of epoxy composites.
hidden and output layers is important when building a Therefore, the introduction of fillers that are chemically
network. In addition, the stopping parameter of the neural active in relation to the matrix provides for a more signifi-
network learning was the number of epochs, which in this cant effect, which manifests itself in increasing the tem-
research was equal to 1000. perature of thermal fracture of the filled polymer materials
The algorithm of boosted trees is a powerful method compared to Al2O3 and Cr2O3. In the formation of epoxy
of the intelligent data analysis (Alpayndin, 2010). It is com- CMs, the ED-20 epoxy dian oligomer (GOST 10587-84) was
monly used to predict data and in situations when the chosen as the main binding component characterized by
results of one decision affect those of the subsequent one, high adhesive and cohesive strength, low shrinkage and
that is, in order to make sequential decisions. The model high manufacturability during application.
structure is tree-like (Figure 2). In general, a boosted tree Polyethylene polyamine PEPA hardener (TU 6-05-241-
consists of internal nodes and leaves that are added dur- 202-78) was used for crosslinking epoxy compositions, mak-
ing learning depending on the problem complexity. In par- ing it possible for the materials to harden at room tempera-
ticular, ovals are the decision nodes, while rectangles are tures. PEPA is known (Dobrotvor et al., 2021) to be a low
the leaf nodes. The univariate decision node splits along molecular weight substance with the following chemical for-
one axis, and successive splits are orthogonal to each mula: [-CH2-CH2-NH-]n. CMs were cross-linked by introduc-
other. After the first split, {x | x1 < w10} is pure and is not ing a hardener into the composition at a stoichiometric ratio
split further. of components by content (wt %) – ED-20: PEPA – 100: 10.
The major advantage of the boosted trees is versatility The scheme of the epoxy composite is given in Table 1.
and ease of data interpretation. Table 1. Composition of the filled epoxy polymers
Using the Mean Absolute Percent Error (MAPE) for- reinforced with basalt and glass fiber
mula, the prediction error is calculated as follows:
Filler Concentration, wt % Reinforcing fibrous filler
yi − yi Aerosil 2 glass fiber
1 n ( true ) ( prediction )
MAPE
= 100% ⋅
n ∑ i =1
yi
, (4) basalt fiber
(true ) 6 glass fiber
basalt fiber
where yi(prediction) is the predicted element of the sample;
12 glass fiber
yi(true) is the real value of the element of the sample; n is
basalt fiber
the size of the study sample.
g-aminopropy- 2 glass fiber
laerosil basalt fiber
6 glass fiber
basalt fiber
12 glass fiber
basalt fiber
Cr2O3 30 glass fiber
basalt fiber
50 glass fiber
basalt fiber
100 glass fiber
basalt fiber
Al2O3 30 glass fiber
basalt fiber
50 glass fiber
Figure 2. Example of a data set and the corresponding basalt fiber
decision tree (Alpayndin, 2010) 100 glass fiber
basalt fiber
Aviation, 2024, 28(2), 64–71 67
3.2. Thermal conductivity coefficients of filled To model the dependence of the thermal conductivity
epoxy polymers coefficient on the mass fraction concentration of the filler
and temperature, the thermal conductivity coefficient λ
To model the dependence of the thermal conductivity co-
served as an input parameter, while the mass fraction con-
efficient on the mass fraction concentration of the filler
centration of the filler and temperature were considered
and temperature, the mass fraction concentration of the
as output parameters.
filler and temperature served as input parameters, while
Machine learning methods were used to construct the
the thermal conductivity coefficient λ was considered as
dependences of the experimental data relating to the ther-
an output parameter.
mal conductivity coefficient on the predicted data (Fig-
The thermal conductivity coefficient of epoxy poly-
mers reinforced with glass fiber and filled with aerosil, ures 3–6). The prediction results were found to be in good
γ-aminopropylaerosil, aluminum oxide, chromium oxide, agreement with the experimental ones.
respectively, was predicted on the basis of the experimen- It is noteworthy that points are located close to the
tal data obtained in Mykytyshyn (2002) by various meth- bisector of the first coordinate angle in Figures 3–6, in-
ods of machine learning, in particular, neural networks and dicating a linear relationship between the predicted
boosted decision trees. and experimental data. The NN method gives an er-
In the process of learning, the data set was divided ror of 0.5% for epoxy composites filled with aerosil and
into two unequal parts – the training sample and the test γ-aminopropylaerosil, 0.3% and 0.2% for epoxy composites
sample. The sample contained 4,000 elements for each filled with aluminum oxide and chromium oxide, respec-
epoxy polymer reinforced with fiberglass and filled with tively. At the same time, the error of the boosted deci-
aerosil and γ-aminopropylaerosil, respectively, and 28,000 sion tree method is 1.5% for epoxy composites filled with
elements for the polymer filled with aluminum oxide and aerosil, γ-aminopropylaerosil, and aluminum oxide, respec-
chromium oxide, respectively, of which 80% were ran- tively, and 0.9% for epoxy composite filled with chromium
domly selected for the learning sample, and 20% were left oxide. Figures 7–10 show the dependence of the predicted
to assess the prediction quality. In particular, to achieve thermal conductivity coefficient on the mass fraction con-
this number of elements, the dataset was expanded using centration of the filler and temperature of the test sample
spline interpolation. obtained by various methods of machine learning.
(a) (b)
Figure 3. Predicted and experimental dependences of the thermal conductivity coefficient for an epoxy composite filled with
aerosil obtained by the method of neural networks (a) and boosted decision trees (b)
(a) (b)
Figure 4. Predicted and experimental dependences of the thermal conductivity coefficient for an epoxy composite filled with
γ-aminopropylaerosil obtained by the method of neural networks (a) and boosted decision trees (b)
68 O. Yasniy et al. Machine learning methods as applied to modelling thermal conductivity of epoxy-based composites with different...
(a) (b)
Figure 5. Predicted and experimental dependences of the thermal conductivity coefficient for an epoxy composite filled with
aluminum oxide obtained by the method of neural networks (a) and boosted decision trees (b)
(a) (b)
Figure 6. Predicted and experimental dependences of the thermal conductivity coefficient for an epoxy composite filled with
chromium oxide obtained by the method of neural networks (a) and boosted decision trees (b)
(a) (b)
Figure 7. Temperature dependence of changes in the thermal conductivity coefficient for the composite filled with aerosil
obtained by the method of neural networks (a) and boosted decision trees (b)
(a) (b)
Figure 8. Temperature dependence of changes in the thermal conductivity coefficient for the composite filled with
γ-aminopropylaerosil obtained by the method of neural networks (a) and boosted decision trees (b)
Aviation, 2024, 28(2), 64–71 69
(a) (b)
Figure 9. Temperature dependence of changes in the thermal conductivity coefficient for the composite filled with aluminum
oxide obtained by the method of neural networks (a) and boosted decision trees (b)
(a) (b)
Figure 10. Temperature dependence of changes in the thermal conductivity coefficient for the epoxy composite filled with
chromium oxide obtained by the method of neural networks (a) and boosted decision trees (b)
The main parameters of machine learning algorithms, They were found to be concentrated around zero and have
in particular, neural networks and boosted decision trees, a normal distribution.
are given in Table 2–3. The statistical graph used for the Figures 11–14 show frequency for epoxy compos-
data analysis presents as a histogram of residual values, ites reinforced by glass fiber and filled with Aerosil,
which shows the frequency of each interval of values ver- γ-aminopropylaerosil, aluminum oxide, chromium oxide,
sus residual values. In particular, the residuals show the respectively, using different machine learning methods,
difference between the experimental and predicted values. in particular, neural networks and boosted decision trees.
(a) (b)
Figure 11. Frequency in the test set for the epoxy composite filled with aerosil obtained by the method of neural networks (a)
and boosted decision trees (b)
(a) (b)
Figure 12. Frequency in the test set for the epoxy composite filled with γ-aminopropylaerosil obtained by the method of
neural networks (a) and boosted decision trees (b)
(a) (b)
Figure 13. Frequency in the test set for the epoxy composite filled with aluminum oxide obtained by the method of neural
networks (a) and boosted decision trees (b)
(a) (b)
Figure 14. Frequency in the test set for the epoxy composite filled with chromium oxide obtained by the method of neural
networks (a) and boosted decision trees (b)
Aviation, 2024, 28(2), 64–71 71