Taking into Account Mutual Correlations during Selection of Significant Input Features in Neural Network Solution of Inverse Problem s of Spectroscopy

7 Jul 2022, 17:35
15m
Presentation Track 3. Machine Learning in Natural Sciences Session 3. Machine learning in Biology and Other Natural Sciences

Speaker

Nickolay Shchurov (Faculty of Physics Lomonosov Moscow State University)

Description

In neural network solutions to many physical problems, there is a need to reduce the dimension of the input data in order to achieve a more accurate and stable solution while reducing computational complexity.
When solving an inverse problem in spectroscopy, multicollinearity is often observed between the input features, making it necessary to use a selection method that takes into account the correlation between the input features.
The method used in this study is based on the iterative selection of features with the highest correlation with respect to the target variable and on the elimination of features with high mutual correlation.
The paper compares the quality of a neural network solution to the problem of determining the concentrations of heavy metal ions in water by Raman spectra on the complete set of input features and on its subsets compiled using the selection method under consideration, as well as using traditional methods of selecting significant input features.

Agreement to place Participants agree to post their abstracts and presentations online at the workshop website. All materials will be placed in the form in which they were provided by the authors

Primary authors

Nickolay Shchurov (Faculty of Physics Lomonosov Moscow State University) Igor Isaev Dr Sergei Burikov (Faculty of Physics, M.V.Lomonosov Moscow State University, Moscow, Russia; D.V.Skobeltsyn Institute of Nuclear Physics, M.V.Lomonosov Moscow State University, Moscow, Russia) Dr Tatiana Dolenko (Faculty of Physics, M.V.Lomonosov Moscow State University, Moscow, Russia; D.V.Skobeltsyn Institute of Nuclear Physics, M.V.Lomonosov Moscow State University, Moscow, Russia) Dr Kirill Laptinskiy (D.V.Skobeltsyn Institute of Nuclear Physics, M.V.Lomonosov Moscow State University, Moscow, Russia) Sergei Dolenko (D.V.Skobeltsyn Institute of Nuclear Physics, M.V.Lomonosov Moscow State University)

Presentation materials