SCIENCE BRINGS NATIONS TOGETHER 6th International Workshop on Deep Learning in Computational Physics (DLCP-2022)

6 Jul 2022, 09:00 → 8 Jul 2022, 20:00 Europe/Moscow

We are pleased to invite you to participate to the DLCP-2022 – The 6th International Workshop on Deep Learning in Computational Physics which will be held in the Meshcheryakov Laboratory of Information Technologies (MLIT) of the Joint Institute for Nuclear Research (JINR) on July 6-8, 2022. 
The workshop will be held in a mixed format: face-to-face and remote. However, the poster section will be held in face-to-face only.

The workshop primarily focuses on the use of machine learning in particle astrophysics and high energy physics, but is not limited to this area. Topics of interest are various applications of artificial neural networks to physical problems, as well as the development of new modern machine learning methods for analyzing various scientific data, including big data.

The working languages are English and Russian.

All relevant information on the workshop website: dlcp2022.jinr.ru.

The group photo will be on July 7 before lunch at 13:00!

Organizers

Joint Institute for Nuclear Research, Meshcheryakov Laboratory of Information Technologies (MLIT JINR, Dubna, Russia) and
M.V. Lomonosov Moscow State University, D.V. Skobeltsyn Institute of Nuclear Physics (SINP MSU, Moscow, Russia).

The main topics

The list is not limited these themes.

Track 1. Machine Learning in Particle Astrophysics and High Energy Physics 

• Machine learning methods in particle astrophysics and high energy physics
• Fast event generators based on machine learning for modelling of physics phenomena.
• Multi-messenger data analysis of experimental data.
• Application machine learning for data analysis in LHC, NICA, TAIGA and other experimental facilities.

Track 2. Modern Machine Learning Methods

• Convolutional neural networks.
• Recurrent neural networks.
• Graph neural networks.
• Modern trends in machine learning.

Track 3. Machine Learning in Natural Sciences

• Biology and bioinformatics.
• Engineering sciences.
• Climate prediction and Earth monitoring.

Track 4. Machine Learning in Education

• Machine learning in High education.
• Outreach knowledge in machine learning.

The workshop will feature:

• invited presentations – 30 minutes,
• regular presentations – 15 minutes,
• posters (only face to face) – A1 or A0 format, vertical arrangement.

Program committee

A. Kryukov (SINP MSU, Moscow) — Co-Chair
V. Korenkov, professor (MLIT JINR, Dubna) — Co-Chair
E. Boos, corresponding member of the RAS (SINP MSU, Moscow) 
A. Demichev (SINP MSU, Moscow)
V. Ilyin (NIC “Kurchatov Institute”, Moscow)
G. Ososkov, professor (MLIT JINR, Dubna)
O. Streltsova (MLIT JINR, Dubna)
P. Zrelov (MLIT JINR, Dubna)

Local organizing Committee

A. Kryukov (SINP MSU, Moscow) — Co-Chair 
V. Korenkov (MLIT JINR, Dubna) — Co-Chair 
D. Priakhina (MLIT JINR, Dubna) — Scientific Secretary
M. Plyashkevich (MLIT JINR, Dubna)
O. Rumyantseva (MLIT JINR, Dubna)
I. Sokolov (MLIT JINR, Dubna)
D. Stankus (MLIT JINR, Dubna)
O. Streltsova (MLIT JINR, Dubna)
T. Strizh (MLIT JINR, Dubna)
А. Vorontsov (MLIT JINR, Dubna)
T. Zaikina (MLIT JINR, Dubna)

Important dates

Abstract submission — June 22, 2022 June 27, 2022
Notification of acceptance — June 29, 2022 
Registration — until July 4, 2022
The Workshop — July 6-8, 2022
Paper submission — August 9, 2022 August 15, 2022
Notification of paper acceptance — September 19, 2022

The review process has been completed.

We apologize for the increase in the time of reviewing papers.
 
Until November 1, 2022 authors will receive an information letter with the results of the  review and further instructions.

Registration and abstract submission

The registration and abstract submission should be done via the website: Registration and Call for Abstracts.
No fee for participation.

Proceedings

Selected articles will be recommended for publication in the scientific journals:

• Numerical Methods and Programming (indexed in RSCI);
• Computer Research and Modeling (indexed in RSCI, Scopus);

The journals is included in the Higher Attestation Commission (Russian Federation).

Also all accepted articles will be published online in the proceedings of the workshop in the Proceedings of Science and submitted for indexing by Scopus.

We invite two types of submissions:
REGULAR PAPERS describe research not published or submitted elsewhere (10-12 pages).
SHORT PAPERS may be position papers, descriptions of research prospects, challenges, projects, ongoing works, or applications (5-9 pages).

Place and transportation

JINR (Dubna, Russia). Directions to the meeting venue, information about trains and buses can be found on the conference website: Place & Transportation.

The workshop will be held face to face. However, given the epidemiological situation on COVID-19, it will be possible to participate remotely too.
The ZOOM link will only be sent to registered participants 2 days before the start of the workshop.

Accommodation

Information about accommodation can be found on the conference website: Accommodation.
The Organizing Committee will allocate rooms in the hotel "Dubna", but Participants themselves must call and book a room. While booking, participants must indicate that they are from the DLCP 2022 conference (the organizing committee sends a list of participants to the hotel).

Contacts

All correspondence concerning the workshop should be addressed by e-mail.

Conference e-mail: dlcp2022@jinr.ru.
 

Sponsors

 

Call for paper

Wednesday 6 July

13:00 Registration

Session 1. ML in Particle Astrophysics and High Energy Physics

1 Welcome words

Speaker: Vladimir Korenkov (JINR)

2022_07_06_Korenkov_DLCP.pdf

2 Machine Learning in MLIT. History, Challenges, and Prospects

Machine learning (ML) methods began to be used in the MLIT laboratory from the very beginning of its organization in 1966, when one of the main tasks of the LVTA was the automation of film data processing used at that time in physics experiments. This included the problems of automating film measurements and calibration of the then-built scanning machines Spiral Reader and AELT (Automat on Elektron Tube) scanning tables, as well as the acquired HPD scanner. These tasks of event reconstruction, calibrating measuring devices and physical hypothesis testing were still relevant, although they were solved by classical methods of computational statistics, first on tube and later on transistor computers, not yet equipped with programming languages at the time.

With the advent of experiments with electronic data acquisition directly into the memory of more powerful computers equipped with programming languages such as Fortran, it became possible to apply robust fitting methods and wavelet analysis, the LVTA was one of the first among other physics centers in the 1990s to apply neural networks and cellular automata for tracking and other applied tasks in biology, medicine, earth physics and pattern recognition.

However, the real heyday of neural network methods application in physics and related fields came with new advances in computer technology, GPU cards, Supercomputers and the advent of the Big Data era. Big Data required radically new approaches, and new technologies made possible the application of deep neural networks with their amazing ability to solve most basic ML problems in classification, pattern recognition, prediction and hypothesis testing. The diversity of tasks coming to MLIT from JINR laboratories and collaborating institutes required the use of a wide range of different types of deep neural networks: multilayer perceptrons, autoencoders, convolutional, recurrent and graph neural networks, and recently, transformers with their attention mechanism used to increase weights of the most important features of objects under study. The depth of these neural networks, i.e. increase in the number of hidden layers allows to significantly strengthen the descriptive side of neuromodels, i.e. to expand the number of features of the phenomenon under study, though inevitably poses very complicated problems of their training and validation. These problems can be solved in many ways by using different program libraries written in interpretive Python language, using PyTorch framework. Nevertheless, to solve different event reconstruction problems in many High Energy Physics (HEP) experiments, a special library Ariadne, developed at MLIT with participation of performers from Dubna and SPbSU Universities, was required.

Among the problems solved in recent years in MLIT using deep learning methods, we can mention first of all the tasks of processing track data from the experiments BM@N, BES-III, SPD, modeling fine structures in mass distributions of nuclear reaction products, as well as such problems from related fields as atmospheric pollution monitoring using satellite imagery, detection and prevention of agricultural plant diseases.

Prospects for further development of machine learning methods are dictated primarily by new high luminosity and multiplicity HEP experiments, leading to exabyte streams of experimental information, requiring their online filtering and new approaches for ultrafast processing. Most applications from other fields are characterized by the lack of large databases required for training neural networks, which also requires the development of new approaches in the choice of neural network types, their structure and training methods.

Speaker: Gennady Ososkov (Joint Institute for Nuclear Research)

Ососков_Г_А доклад на DLCP-2022.pdf

Ососков_Г_А доклад на DLCP-2022.pdf

3 Deep learning in the collider physics

Different aspects of deep learning applications in the collider physics will be discussed in the talk. The main topic of the talk is the methodology of data analysis optimizations with deep neural networks. Short overview of the methods to search for "new physics" with neural network technique will be presented.

Speaker: Lev Dudko (SINP MSU)

dlcp22_nn.pdf

4 Machine learning approach to identify cores of EAS observed by the GRAPES-3 experiment

The GRAPES-3 experiment located in Ooty consists of a dense array of 400 plastic scintillator detectors spread over an area of 25,000 $m^2$ and a large area (560 $m^2$) tracking muon telescope. Everyday, the array records about 3 million showers in the energy range of 1 TeV - 10 PeV induced by the interaction of primary cosmic rays in the atmosphere. These showers are reconstructed in order to find several shower parameters such as shower core, size, and age. High-energy showers landing far away from the array often trigger the array and are found to have their reconstructed cores within the array even though their true cores lie outside, due to reconstruction of partial information. These showers contaminate and lead to an inaccurate measurement of energy spectrum and composition. Such showers can be removed by applying quality cuts on various shower parameters, manually as well as with machine learning approach. The improvements achieved by the use of machine learning will be presented.

Speaker: Medha Chakraborty (Tata Institute of Fundamental Research)

DLCP_2022_merged_Final.pdf

5 Energy reconstruction in analysis of Cherenkov telescopes images in TAIGA experiment using Deep Learning methods

Imaging Atmospheric Cherenkov Telescopes (IACT) of TAIGA astrophysical complex allow to observe high energy gamma radiation helping to study many astrophysical objects and processes. TAIGA-ACT enables us to select gamma quanta from the total cosmic radiation flux and recover their primary parameters, such as energy and direction of arrival. The traditional method of processing the resulting images is an image parameterization - so-called the Hillas parameters method. At the present time Machine Learning methods, in particular Deep Learning methods have become actively used for IACT image processing.
This report presents the analysis of simulated Monte Carlo images by several Deep Learning methods for a single telescope (mono-mode) and multiple IACT telescopes (stereo-mode). The estimation of the quality of energy reconstruction was carried out and their energy spectra were analyzed using several types of neural networks. Using the developed methods the obtained results were also compared with the results obtained by traditional methods based on the Hillas parameters. The work was financially supported by the Russian Science Foundation, grant No. 22-21-00442.

Speaker: Elizaveta Gres (Irkutsk State University)

dlcp2022-gres.pdf

6 Application of convolutional neural networks for data analysis in TAIGA-HiSCORE experiment

The TAIGA experimental complex is a hybrid observatory for high-energy gamma-ray astronomy in the range from 10 TeV to several EeV. The complex consists of such installations as TAIGA-IACT, TAIGA-HiSCORE and a number of others. The TAIGA-HiSCORE facility is a set of wide-angle synchronized stations that detect Cherenkov radiation scattered over a large area. With TAIGA-HiSCORE data provides an opportunity to reconstruct shower characteristics, such as shower energy, direction of arrival, and axis coordinates. The main idea of ​​the work is to apply convolutional neural networks to analyze HiSCORE events, considering them as images. The distribution of registration times and amplitudes of events recorded by HiSCORE stations is used as input data. The paper presents the results of using convolutional neural networks to determine the characteristics of air showers. It is shown that even a simple model of convolutional neural network provides the accuracy of recovering EAS parameters comparable to the traditional method. Preliminary results of air shower parameters reconstruction obtained in a real experiment and their comparison with the results of traditional analysis are presented. The work was supported by the Russian Science Foundation, grant №22-21-00442

Speakers: Anna Vlaskina (Moscow State University), Alexander Kryukov (SINP MSU)

dlcp2022-vlaskina-v2.pdf

16:00 Coffee break

Session 1. ML in Particle Astrophysics and High Energy Physics

7 ML in particle astrophysics

Speaker: Alexander Kryukov (SINP MSU)

dlcp2022-ktyukov-v1.3.pdf

8 Using conditional variational autoencoders to generate images from atmospheric Cherenkov telescopes

Monte Carlo method is commonly used to simulate Cherenkov telescope images of atmospheric events caused by high-energy particles. We investigate the possibility of augmentation the Monte Carlo-generated sets using other methods. One of these methods is variational autoencoders.
We trained conditional variational autoencoders (CVAE) using a set of Monte Carlo-generated images from one Cherenkov telescope of TAIGA experiment for atmospheric events caused by gamma quanta (gamma events). Images generated by the trained autoencoders are similar to the Monte Carlo images, in particular, an average score by a classifier trained to distinguish Monte Carlo generated images of gamma events is 0.982-0.986 for one of the autoencoders, compared to 0.99 for Monte Carlo images.
This work was funded by the Russian Science Foundation (grant No. 22-21-00442).

Speaker: Stanislav Polyakov (SINP MSU)

dlcp2022-polyakov.odp

dlcp2022-polyakov.pdf

9 Using Conditional GAN to Control the Statistical Characteristics of the Generated Images from Imaging Atmospheric Cherenkov Telescopes

Currently, generative adversarial networks (GANs) are a promising tool for image generation in the astronomy domain. Of particular interest are conditional GANs (CGANs), which allow you to divide images into several classes according to the value of some property of the image, and then specify the required class when generating images. In the case of images from Imaging Atmospheric Cherenkov Telescopes (IACT), an important property is the total brightness of all image pixels (image size), which is directly connected to the energy of primary particles. We used a CGAN technique to generate images of the Cherenkov telescope of the TAIGA-IACT experiment. As a training set, we used a sample of 2D images obtained using TAIGA Monte Carlo simulation software. We applied an artificial division of the images of the training set into 10 classes, sorting them by size and defining the boundaries of the classes so that the same number of images fall into each class. We then used these classes while training our CGAN. The paper shows that for each class, the size distribution of the generated images is close to normal with an average value located approximately in the middle of the corresponding class. We also show that for the generated images, the size distribution summed over all classes is close to the original distribution in the training set. The results obtained will be useful for data augmentation and more accurate generation of realistic synthetic images similar to the ones taken by IACT. This work was funded by the Russian Science Foundation (grant No. 22-21-00442).

Speaker: Yulia Dubenskaya (SINP MSU)

dlcp2022-jdubenskaya.pdf

10 Energy reconstruction with machine learning techniques in JUNO: aggregated features approach

The Jiangmen Underground Neutrino Observatory (JUNO) is a neutrino experiment under construction with a broad physics program. The main goals of JUNO are the determination of the neutrino mass ordering and the high precision measurement of neutrino oscillation properties. High quality reconstruction of reactor neutrino energy is crucial for the success of the experiment.

The JUNO detector is equipped with a huge number of photomultiplier tubes (PMTs) of two types: 17 612 20-inch PMTs and 25 600 3-inch PMTs. The detector is designed to provide an energy resolution of 3% at 1 MeV. Compared to traditional reconstruction methods, Machine Learning (ML) is significantly faster for the detector with so many PMTs.

In this work we studied ML approaches for energy reconstruction from the signal gathered by the PMT array and presented fast models using aggregated features: fully connected deep neural network and boosted decision trees. The dataset for training and testing is generated with full simulation using the official JUNO software.

Speaker: Arsenii Gavrikov (HSE University, JINR)

DLCP_2022_Slides_Gavrikov.pdf

11 Deep neural network applications for particle tracking at the BM@N and SPD experiments

Particle tracking is an essential part of any high-energy physics experiment. Well-known tracking algorithms based on the Kalman filter are not scaling well with the amounts of data being produced in modern experiments. In our work we present a particle tracking approach based on deep neural networks for the BM@N experiment and future SPD experiment. We have already applied similar approaches for BM@N Run 6 and BES-III Monte-Carlo simulation data, which are relatively simpler and produce less data during the experiment. This work is the next step in our ongoing study of tracking with the help of machine learning — revised algorithms (combination of Recurrent Neural Network (RNN) and Graph Neural Network (GNN) for the BM@N Run 7 Monte-Carlo simulation data, and GNN for the preliminary SPD Monte-Carlo simulation data) are presented. Encouraging results in terms of track efficiency and processing speed for both experiments are demonstrated.

Speaker: Mr Pavel Goncharov (Joint Institute for Nuclear Research)

MLIT_Goncharov.pptx

12 Study of the VH(bb) production by MVA methods

Taking into account that, at a Higgs boson mass of 125 GeV, the probability of its decay into bb is greater than the sum of the probabilities of all other decay channels, this channel makes a great contribution to the study of the Higgs boson. A more suitable channel for the production of the Higgs boson for studying it in bb decay is associative production with a vector boson. It was in this channel that the decay of the Higgs boson into a pair of b-quarks was observed for the first time. Therefore, the VH(bb) process is a very important channel for studying the properties of the Higgs boson.
In LHC experiments, multivariate VH(bb) analysis began to be used after 2013, before that, cut-based analysis was used. As a multivariate analysis, among the multivariate techniques, the Boosted Decision Tree (BDT) in ATLAS and the Deep Neural Network (DNN) in CMS were used. In this work, these two methods were compared to find out which one can achieve the best performance. The 2L channel (ZH(bb), where Z decays into 2 charged leptons) from the three lepton channels (0L, 1L, 2L) was chosen, which includes the VH(bb) analysis. The list of input variables for BDT or DNN is similar to those used in the analysis in the ATLAT experiment. Up to 0.4 million signals and the same number of background events were used for training. The settings used in the ATLAS analysis, which has the best performance, were chosen to tune the BDT hyperparameters. Various number of events (2K, 5K, 10K, 0.1M, 0.2M and 0.4M) are trained and different settings for NN are obtained, providing performance that exceeds that of BDT. It turns out that for any number of training events, it is possible to find corresponding NN settings with better performance than BDT. The only problem with NN training is that it is computationally intensive compared to BDT.

Speaker: Faig Ahmadov (JINR & IP ANAS)

VHbb_BDT_NN.pdf

13 Decision trees as an alternative for particle identification with TPC and TOF detector system

Machine Learning methods are wildly used for particle identification (PID) in experimental high energy physics nowadays. Particle identification plays an important role in high-energy physics analysis therefore determines the success of the performing an experiment. This determines importance of using machine learning to the PID problem. This report gives a preliminary status of application of decision tree to particle identification problem with TPC and TOF detector system.

Speaker: Vladimir Papoyan (JINR)

PID_DLCP_2022_Papoyan.pdf

14 Identification of similarities and differences in water bodies in terms of photosynthetic activity and response to toxicants using Machine Learning methods

During the experiment, 9 water bodies located in the Pskov region were studied: the pond of the Mirozhka River, the delta of the Velikaya River, the Kamenka River, lakes Kalatskoye, Teploe, Lesitskoye, Tiglitsy, Chudskoye (Peipsi), Pskovskoye. Water samples with phytoplankton were taken from each water body, and toxicants (CdSO$_4$ or K$_2$Cr$_2$O$_7$) were added at a concentration of 20 μM and 50 μM. These samples (together with control samples without toxicant addition) were incubated for several days. The chlorophyll fluorescence transients (OJIP-curves) were recorded using AquaPen–C 100 (Photon System Instruments, Czech Republic) fluorometer at actinic light intensity of 1000 µmol photons/m$^2$/s and wavelength of 650 nm every 3–5 hours of incubation (with breaks for the night). 465 fluorescence induction curves were obtained, for each of which 16 JIP test parameters (V$_J$, V$_I$, ABS/RC, ET$_0$/RC, TR$_0$/RC, DI$_0$/RC, S$_m$, S$_s$, M$_0$, N, $\Phi_Po$, $\Phi_Eo$, $\Phi_Dо$, $\Phi_Pav$, $\Psi_0$, PI$_{ABS}$). The resulting dataset was analyzed using the Python programming language. Cluster analysis together with data dimension reduction methods (PCA, t-SNE, UMAP) made it possible to put forward a hypothesis about the presence among the considered water bodies of 2 groups, the phytoplankton of which differ in the dynamics of resistance to the toxic effects of heavy metals. Machine learning methods have made it possible to identify the forms of induction curves typical for each type of water bodies and the dynamics of their change during toxic exposure. To reveal the biophysical mechanisms associated with such a different reaction, it is necessary to analyze the shape of the induction curves using mathematical models based on the ideas about the structure of the photosynthetic electron transport chain.

This research was carried out as part of the Scientific Project of the State Order of the Government of Russian Federation to Lomonosov Moscow State University No. 121032500060-0 with partial support by the Russian Science Foundation (projects 20-64-46018 and 22-11-00009).

Speakers: Sergei Khruschev (Lomonosov Moscow State University), Mr Roman Chervitsov (Lomonosov Moscow State University)

C_3_KHR.pptx

15 Model interpretability methods for high energy physics analysis

Most modern machine learning models are known as black-box models. By default, these predictors don't provide an explanation as to why a certain event or example has been assigned a particular class or value. Model explainability methods aim to interpret the decision-making process of a black-box model and present it in a way that is easy for researchers to understand. These methods can provide local (figuring why a specific input has been assigned a specific output) an global (uncovering general dependencies between input features and the output of the model) explanations. In this talk we will cover several popular model-agnostic explainability methods and compare them in explaining the output of a neural network in the scope of high-energy physics analysis. We will also use a modern high accuracy glass-box machine learning model (Explainable Boosting Machine) and show how its predictions can be used to better understand the data.

Speaker: Andrei Zaborenko (Moscow State University)

Model_interpretability_methods_for_high_energy_physics_analysis.pdf

Thursday 7 July

Session 2. Modern Machine Learning Methods

16 TAIGA Astrophysical Complex – status, results, plans

Speaker: L. Kuzmichev (SINP MSU)

dlcp2022-kuzmichev.pdf

17 Decomposition of Spectral Contour into Gaussian Bands using Gender Genetic Algorithm

One of the methods for analysis of complex spectral contours (especially for spectra of liquid objects) is their decomposition into a limited number of spectral bands with physically reasonable shapes (Gaussian, Lorentzian, Voigt etc.). Consequent analysis of the dependencies of the parameters of these bands on some external conditions in which the spectra are obtained may reveal some regularities bearing information about the physical processes taking place in the object.
The problem with the required decomposition is that such decomposition is an inverse problem that is often ill-conditioned or even incorrect, especially in presence of noise in spectra. Therefore, this problem is often solved by advanced optimization methods less subject to be stuck in local minima, such as genetic algorithms (GA).
In the conventional version of GA, all individuals are similar regarding the probabilities and implementation of the main genetic operators (crossover and mutation) and the procedure of selection. In this study, we test a new version of GA – gender GA (GGA), where the individuals of the two genders differ by the probability of mutation (higher for the male gender) and by the procedures of selection for crossover. In this study, we compare the efficiency of gradient descent, conventional GA and GGA in solving the problems of decomposition of the Raman valence band of liquid water into Gaussian bands.
This study has been funded by the SINP MSU state budget topic 6.1 (01201255512).

Speaker: Dr Sergei Dolenko (D.V.Skobeltsyn Institute of Nuclear Physics, M.V.Lomonosov Moscow State University)

DLCP-22_Dolenko.pdf

18 Relation Extraction from Texts Containing Pharmacologically Significant Information on base of Multilingual Language Models

In this paper we estimate accuracy of solving the task of relation extraction from texts containing pharmacologically significant information on the set of corpora in two languages:
1) the expanded version of RDRS corpus, that contains texts of internet reviews on medications in Russian;
2) the DDI2013 dataset containing MEDLINE abstracts and documents from DrugBank database in English;
3) the PhaeDRA corpus containing MEDLINE abstracts in English.

Relation extraction accuracy for Russian and English was estimated with comparison of two multilingual Language models: XLM-RoBERTa-large and XLM-RoBERTa-sag-large. Additionaly we used the State-of-the-Art specialized models aimed at English language: bioBERT, bioALBERT, bioLinkBERT. Earlier research proved XLM-RoBERTa-sag-large to be the most efficient language model for the previous version of the RDRS dataset. We used the same approach to relation extraction included two steps: named entity recognition and relation extraction on predicted entities. Each step was estimated separately.

As a result, it is shown, that multilingual XLM-RoBERTa-sag model achieves relation extraction macro-averaged f1-score equal to 85.42% on the ground-truth named entities, 53.83% on the predicted named entities on new version of RDRS corpus. Additionally, XLM-RoBERTa-sag was estimated on the datasets for relation extraction in English (DDI2013, PhaeDRA) and achieves accuracy comparable with the top specialized models.

Consequently, XLM-RoBERTa-sag model sets the state-of-the-art for considered type of texts in Russian, and achieves accuracy comparable with the SotA results in Engilsh.

Speaker: Anton Selivanov (NRC "Kurchatov Institute")

Selivanov_RE_LM_comparison_RDRS_2022_v2.pptx

11:00 Coffee break

Session 2. Modern Machine Learning Methods

19 Sponsor report - Softline

Speaker: V. Nesterov (Softline )

20 Quantum end-to-end-IT of self-organized intelligent controller design based on quantum deep machine learning: Quantum neural networks and quantum genetic algorithms applications in quantum intelligent control of classical systems – quantum supremacy

V.V. Korenkov, A.G. Reshetnikov, S.V. Ulyanov, P.V. Zrelov
MLIT, JINR

The physical interpretation of self-organization control process on quantum level is discussed based on the quantum information-thermodynamic models of the exchange and extraction of quantum (hidden) value information from/between classical particle’s trajectories in particle swarm [1,2]. Main physics and information thermodynamics aspects of quantum intelligent control of classical control objects discussed and described from control Benchmark models viewpoint design on the basis of new laws of quantum Lagrange / Hamilton deep machine learning.
1. Physics of quantum hidden information phenomena. New types of quantum correlations (as behavior control coordinator with quantum computation by communication) and information transport (value information) between particle swarm trajectories (communication through a quantum link) are introduced.
2. Quantum logic of intelligent classical system control. The structure of developed quantum fuzzy inference (QFI) model includes necessary self-organization properties and realizes a self-organization process as a new quantum search algorithm (QSA). In particular case, in intelligent control system (ICS) structure, QFI system is a QSA block, which performs post-processing of the results of fuzzy inference of each independent fuzzy controller (FC) and produces the generalized control signal output. In this case the on-line output of QFI is an optimal robust control signal, which combines best features of each independent FC outputs (self-organization principle). For design of FC - KB original structures of quantum neural networks and quantum genetic algorithm developed and applied.
3. Quantum software engineering of quantum intelligent control physics law. Quantum soft computing optimizer toolkit of KB – design processes is described. Benchmarks of robust KB design from imperfect FC - KB as the new quantum synergetic information effects of extracted quantum information demonstrated. Moreover, the new force control law from quantum thermodynamic described: with extracted hidden quantum information from classical control signal states (on micro-level) possible to design in on-line new control force that can produce on macro-level more value work amount than the work losses on the extraction of this amount of hidden quantum information.
It is a new control law of physics-cybernetics open hybrid systems including port-Hamiltonian controlled dynamic objects [3].
4. Applications. Effective application of new quantum intelligent controller in mega-science project NICA, intelligent cognitive robotics and quantum drones for applications in project “Industry 5.0” demonstrated [4]. Perspective applications of quantum software engineering discussed.
Conclusions
Therefore, the operation area of such ICS can be expanded greatly as well as its robustness. Robustness of control signal is the background for support the reliability of control accuracy in uncertainty environments. The effectiveness of the developed QFI model is illustrated for important case - the application to design of robust intelligent control system of unstable essentially nonlinear control object in unpredicted control situations (autonomous mobile robots, robotic manipulators, swarm robotics with information exchange etc.).

References
1. Ulyanov S.V. System and method for control using quantum soft computing. - US patent No 6,578,018B1, 2003.
2. Ulyanov S.V. Self-organizing quantum robust control methods and systems for situations with uncertainty and risk. - Patent US 8788450 B2, 2014.
3. Ulyanov S. V. Quantum Algorithm of Imperfect KB Self-organization Pt I: Smart Control - Information-Thermodynamic Bounds // Artificial Intelligence Advances. - 2021. - Vol. 3. - No 2. - Pp. 13-36; https://doi.org/10.30564/aia.v3i2.3171.
4. Korenkov V.V., Reshetnikov A.G., Ulyanov S.V., Zrelov P.V. Intelligent cognitive robotics. Vol. 2, Pt. 2: Quantum supremacy of quantum intelligent control – quantum neural networks and quantum genetic algorithms in quantum deep learning. – M.: Kurs, 2022.

Speaker: Prof. Sergey Ulyanov (JINR)

21 Stochastic vs. BFGS Training in Neural Discrimination of RF-Modulation

Neuromorphic classification of RF-Modulation type is an on-going topic
in SIGINT applications. Neural network training approaches are varied,
each being suited to a certain application. For exemplification I show
the results for BFGS (Broyden-Fletcher-Goldfarb-Shanno) optimisation
in discriminating AM vs FM modulation and of stochastic optimisation
for the challenging case of AM-LSB vs. AM-USB discrimination. Although
slower than BFGS, the stochastic training of a neural network avoids
better local minima, obtaining a stable neurocore.

Speaker: Maria Dima (JINR - MLIT)

DEEP-2022.ppsx

22 Deep learning approach to high dimensional problems of quantum mechanics

Traditional linear approximation of quantum mechanical wave functions are not practically applicable for systems with more than 3 degrees of freedom due to the “the curse of dimensionality”. Indeed, the number of parameters required to describe a wave function in high-dimensional space grows exponentially with the number of degrees of freedom. Inevitably, strong model assumptions should be used when studying such systems numerically. There are, however, estimates of the complexity of a function reproduced by a deep neural network (DNN) that demonstrate the same exponential growth with respect to the number of the network layers. The number of parameters for DNN grows only linearly with the number of layers. This gives us a hope that application of DNN as an approximant for a wave function in high-dimensional space might moderate the computational requirements for reproducing such systems and make 4- or higher-dimensional systems feasible for direct numerical modeling.

We present a study of DNN approximation properties for a multi-dimensional quantum harmonic oscillator. We demonstrate that the computational resources required to reproduce the wave function depend on the dimensionality of the problem and the quantum numbers of the state. Increasing the number of hidden layers in a fully-connected direct propagation DNN we can reproduce some excited states of a multidimensional system with computational resources comparable to low-dimensional cases. Using the DNN as an approximant for a wave function paves a way to developing a new class of computational schemes for solving the Schroedinger equation for high-dimensional systems.

Speaker: Vladimir Roudnev (St-Petersburg State University)

23 Neural Networks Application to Classification of Credit Institutions

The paper presents the application of the methodology of machine learning (artificial neural networks) and the method of principal component analysis to the problem of classifying data on the base of credit institutions.
The feed-forward neural network (multilayer perceptron with hidden layers) was applied to specially prepared input data. As a result, the set of credit institutions was successfully splat to the groups: reliable and unreliable (the institutions whose licenses were revoked).
Principal component analysis (PCA) was applied to the input data aiming to reduce data dimension. Wherein, the result of classifying the reduced data with the neural network remained practically at the same level.

Speaker: Ms Anastasiya Prikazchikova

Neural Networks Application Akishina Ivanov Prikazchikova.pdf

24 A spiking neural network with fixed synaptic weights based on logistic maps for a classification task

Spiking neural networks which model action potentials in biological neurons are increasingly popular for machine learning applications thanks to ongoing progress in the hardware implementation of spiking networks in low-energy-consuming neuromorphic hardware. However, obtaining a spiking neural network model that solver a classification task as accurately as a formal neural network remains a challenge.
We study a spiking neural network model with non-trainable synaptic weights preset on base of logistic maps, similarly to what was proposed recently in the literature for formal neural networks. We show that one layer of spiking neurons with such weights can transform input vectors preserving the information about the classes of the input vectors, so that this information can be extracted from the neuron's output spiking rates by a subsequent classifier, such as Gradient Boosting.
The accuracy obtained on the Fisher's Iris classification task is 95%, with the deviation range of 5% over the five cross-validation folds.

Speaker: Mr Dmitriy Kunitsyn (National Research Nuclear University MEPhI)

A spiking neural network with fixed synaptic weights based on logistic maps for a classification task (1).pptx

A spiking neural network with fixed synaptic weights based on logistic maps for a classification task.pptx

13:05 Lunch

Session 3. Machine learning in Biology and Other Natural Sciences

25 IT ecosystem based on machine learning methods and data analysis technologies for radiobiological research

Speaker: Oksana Streltsova (JINR)

presentation_-dlcp_strel-2022.pdf

26 Application of a neural network approach to the task of the arena marking for the behavioral test «Open Field»

In the framework of the joint project of LIT and LRB JINR, aimed to the creation of an information system for the tasks of radiation biology, a module is being developed to study the behavioral patterns of small laboratory animals exposed to radiation. The module for behavioral analysis automates the analysis of video data obtained by testing of the laboratory animals in the different test systems. The «Open Field» installation is one of the systems. The considered installation has a form of round arena with the chequered-marked sectors and holes. The observation procedure on the laboratory animals takes 3-6 minutes. The “Open Field” test-system allows to register the general activity of animals. To this aim, we fix the quantity of passed sectors together with the number of intersections of the marked center. Also, we check how many burrows, standings upright with/without supports, standings still and motions on one place the animals did.

Therefore, one of our tasks is to develop an algorithm for the installation field marking. The report presents the algorithms for the field marking of the «Open Field» test system based on computer vision methods together with the method of key points within the neural network approach.

Speaker: Anastasia Anikina (Igorevna)

10_Anikina_dlcp_final_eng.pdf

27 Google Earth Engine and machine learning for Earth monitoring

Hyperspectral images are a unique source for obtaining many kinds of information about the Earth's surface. Modern platforms support users to perform complex analyses with a collection of images without the use of any specialized software. Google Earth Engine (GEE) is a planetary-scale platform for Earth science data & analysis. Atmospheric, radiometric, and geometric corrections have been made on number of image collections at GEE. While working with row data, it Is possible to use build-in GEE function to filter data and create composites to get cloud score threshold and the percentile. It is also possible to use custom algorithms for atmospheric corrections. There are over 100 satellite image collections and modeled datasets. Some collections have a spatial resolution of up to 15 meters. GEE has the JavaScript online editor to create and verify code and Python API for advanced applications. All that made GEE very convenient tool for different Earth monitoring projects. Over the last decades there has been considerable progress in developing a machine learning methodology for a variety of Earth Science applications involving trace gases, retrievals, aerosol products, land surface products, vegetation indices, fire and flood tracking, ocean applications, and many others. In this report, we will review basic GEE functions and practice, some examples of successful applications, and our experience in environmental monitoring.

Speaker: Alexander Uzhinskiy (Dr.)

Google Earth Engine and machine learning for Earth monitoring.pptx

28 Data-driven approximation of downward solar radiation flux based on all-sky optical imagery using machine learning models trained on DASIO dataset.

Cloud cover is the main physical factor limiting the downward shortwave (SW) solar radiation flux. In modern models of climate and weather forecasts, physical models describing radiative transfer through clouds may be used. However, this is a computationally expensive option. Instead, one may use parameterizations which are simplified schemes for approximating environmental variables. The purpose of our study is to assess the capability of machine learning models in the scenario of statistical approximation of radiation flux based on all-sky optical imagery. We applied various machine learning (ML) models within the assumption that an all-sky photo fully encapsulates information about the downward shortwave radiation. We examine several types of ML models: some classic ML models along with a convolutional neural network (CNN). These models were trained using the dataset of all-sky imagery accompanied by SW radiation flux measurements. The Dataset of All-Sky Imagery over the Ocean (DASIO) is collected in Indian, Atlantic and Arctic oceans during several expeditions from 2014 till 2021. When training our CNN, we applied heavy source data augmentation in order to force the CNN to become invariant to brightness variations and, thus, approximating a relationship between the visual structure of cloudiness and SW flux. We demonstrate that the CNN supersedes existing parameterizations known from literature in terms of RMSE of flux. Our results allow us to assume that one may acquire downward shortwave radiation flux directly from all-sky imagery. We also demonstrate that CCNs are capable of estimating downward SW radiation flux based on clouds' visible structure.

Speaker: Vasilisa Koshkina (Moscow Institute of Physics and Technology (National Research University))

DLCP-2.pptx

DLCP.pdf

29 Аrtificial neural networks for multi-label cloud types classification from all-sky optical imagery over the ocean.

Cloudiness plays an important role in the hydrological cycle of the atmosphere. Cloud types and other cloud spatial and temporal characteristics privide the ability to make short-term in situ weather forecasts. With the help of clouds, one may also track the content of various impurities in the air. Most importantly, clouds are the major obstacle on the pathway of incoming solar radiation, thus, classifying cloud types may be useful for solar energy plants. In our study, we use artificial neural networks for classifying cloud types in all-sky optical imagery of the visible hemisphere of the sky. The problem is soft classification due to presence of several cloud types at once in most of images. We constructed a convolutional neural network based on SE-ResNeXt101 architecture. The DASIO (Dataset of All-Sky Imagery over the Ocean) dataset for our study is collected in Indian, Atlantic and Arctic oceans from 2014 till 2021 and contains over 1.5 million images. For the 80`000 of them, the visual observations of cloud types are provided by experienced meteorologists. Being trained with this dataset, our model achieved high performance: sample-averaged F1-score is 0.7 which is state of the art compared to contemporary studies.

Speaker: Nikita Veremev

Presentation_VNA_f.pptx

30 Approximation of high-resolution surface wind speed in the North Atlantic using discriminative and generative neural models based on RAS-NAAD 40-year hindcast

Surface wind is one of the most important fields in climate change research. Accurate prediction of high-resolution surface wind has a wide variety of applications, such as renewable energy and extreme weather forecasts. Downscaling is a methodology for high-resolution approximation of physical variables from low-resolution modeling outputs. Statistical downscaling methods allow to avoid computationally expensive high-resolution hydrodynamic simulations. Deep learning methods, including artificial neural networks (ANNs), are one of the typical machine-learning approaches approximating complex nonlinear functional relationships. In our study, we explored the capabilities of statistical 5x downscaling of surface wind over the ocean in the North Atlantic region. We applied several downscaling methods, including cubic interpolation as a reference solution, various convolutional ANNs, and generative adversarial networks (GANs). We compared downscaling results in terms of several quality measures including the ones representing the reconstruction of extreme winds. We evaluated the performance and the quality of different methods and reference solution to identify advantages and lacks of machine-learning downscaling. We consider GANs as the most promising ANN architectures for surface wind downscaling based on both performance and quality.

Speaker: Vadim Rezvov (MIPT)

Rezvov_DLCP-2022.pdf

31 Underwater biotope mapping: automatic processing of underwater video data

The task of analysing the inhabitants of the underwater world is applicable to a wide range of applied problems: construction, fishing, and mining. Currently, this task is applied on an industrial scale by a rigorous review done by human experts in the field of underwater life. In this work, we present a tool that we have created that allows us to significantly reduce the time spent by a person on video analysis. Our technology offsets the painstaking video review task to AI, creating a shortcut that allows experts to only verify the accuracy of the results. To achieve this we have developed an observation pipeline by dividing the video into frames; assessing their degree of noise and blurriness; performing corrections via resolution increase; analysing the number of animals on each frame; building a report on the content of the video, and displaying the obtained data of the biotope on the map. This greatly reduces the time spent analysing underwater video data.

Speaker: Oleg Iakushkin (Saint-Petersburg State University)

Iakushkin_BGH_2022.pdf

16:00 Coffee break

Session 3. Machine learning in Biology and Other Natural Sciences

32 Hazy Images Dataset With Localized Light Sources For Experimental Evaluation Of Dehazing Methods

Recently, the haze removal methods have taken increasing attention of researchers. An objective comparison of haze removal methods struggles because of the lack of real data. Capturing pairs of images of the same scene with presence/absence of haze in real environment is a very complicated task. Therefore, the most of modern haze datasets contain artificial images, generated by some model of atmospheric scattering and known scene depth. Among the few real datasets, there are almost no datasets consisting of images obtained in low light conditions with artificial light sources, which allows evaluating the effectiveness of nighttime haze removal techniques. In this paper, we present such dataset, consisting of images of 2 scenes at 4 lighting levels and 4 levels of haze intensity. The scenes has vary "complexity" - the first scene consists of objects with a simpler texture and shape (smooth, rectangular and round objects); the second scene is more complex - it consists of objects with small details, protruding parts and localized light sources. All the images were taken indoor in controlled environment. An experimental evaluation of state-of-the art haze removal methods was carried out on the resulting dataset.

Speaker: Andrei Filin (Tula State University)

Filin.pdf

Filin.pptx

33 Neural network recovery of missing data of one geophysical method from known data of another one in solving inverse problems of exploration geophysics.

This study is devoted to the inverse problems of exploration geophysics, which consist in reconstructing the spatial distribution of the properties of the medium in the Earth's thickness from the geophysical fields measured on its surface. We consider the methods of gravimetry, magnetometry, and magnetotelluric sounding, as well as their integration, i.e. simultaneous use of data from several geophysical methods to solve the inverse problem. In their previous studies, the authors have shown that the integration of geophysical methods allows improving the quality of the solution of the inverse problem in comparison with the individual use of each of them.
One of the obstacles to using the integration of geophysical methods can be the situation when for some measurement points there is no data from one of the geophysical methods used. At the same time, the data spaces of different integrated geophysical methods are interconnected, and the values of the observed quantities (fields) for one of the methods can be possibly recovered from the known values of the observed quantities of another geophysical method by constructing a preliminary adaptive mapping of one of the spaces to another.
In this study, we investigate the neural network recovery of missing data of one geophysical method from the known data of another one and compare the quality of the solution of the inverse problem on full and on recovered data.
This study has been performed at the expense of the grant of the Russian Science Foundation no. 19-11-00333, https://rscf.ru/en/project/19-11-00333/.

Speaker: Mr Igor Isaev (D.V.Skobeltsyn Institute of Nuclear Physics, M.V.Lomonosov Moscow State University, Moscow, Russia; Kotelnikov Institute of Radio Engineering and Electronics, Russian Academy of Sciences, Moscow, Russia)

34 Предсказание матрицы контактов для коротких пептидов с использованием свёрточной нейронной сети

В данной работе предлагается рассмотреть метод предсказания матрицы контактов для пептидов. В данной статье были выбраны пептиды с длинной до 45 аминокислотных остатков для упрощения расчётов. Для предсказания использовались свёрточные нейронные сети (CNN) из-за схожести пространства признаков белков и изображений, к котором обычно успешно применяются свёрточные нейронные сети. Признаки были созданы с использованием инструмента SCRATCH (генерации вторичной структуры, растворимости и профиля белка PSSM). CNN реализована на языке программирования Python c применением библиотеки Keras. Для работы со структурами белков использовался модуль BioPython, позволяющий извлекать матрицу расстояний между атомами каркаса белка и на основе этой матрицы рассчитывать матрицу контактов нативной структуры. В результате были сформированы обучающие, валидационные и тестовые выборки. Была построена многослойная свёрточная нейронная сеть для решения задачи мультивыходной бинарной классификации. Для оценки качества предсказания были построены матрицы неточностей для порога в 8 и 12 $\dot{А}$, рассчитаны метрики F1-score (0.78), recall (0.73) и precision (0.86). Также был использован инструмент FT-COMAR для восстановления третичной структуры из предсказанной матрицы контактов и сравнения с нативной структурой по метрики RMSD. Среднее значение метрики RMSD по выборке белков равно 6.76 и 5.84 $\dot{А}$ для порогов 8 и 12 $\dot{А}$ соответственно.

Speaker: Artem Maminov (FRC CSC RAS)

DLCP-22-Maminov.pdf

DLCP-22-Maminov.pptx

35 Visual clustering of ocean sediment grains using a combination of unsupervised machine learning methods.

Quantitative, granulometric and classification-based distribution of oceanic sediment grains are important indicators in paleo-reconstruction of the characteristics of marine waters. Currently, the classification of grains is performed visually by an expert on a limited subset of a sediment sample using a binocular microscope. It is a highly time-consuming process in which geological expertise is required of the observer. In this study, we propose a method to automate and accelerate this kind of work using a combination of machine learning algorithms. We photograph sediment samples prepared for examination using a digital optical microscope. We then apply a clustering algorithm including classical and neural machine learning techniques. An experienced marine geologist then identifies the resulting clusters. Our method significantly reduces the time consumption of the expert. We demonstrate that the proposed method is able to divide sediment grains into homogeneous groups suitable for further accurate classification. This will allow further evaluation of important characteristics (paleoindicators), such as the ratio of biogenic carbonate grains and therigenic grains, as well as the ratio of whole shells and shell fragments. The clustering results obtained using our algorithm may be used to train a more accurate classification algorithm.

Speaker: Viktor Golikov

доклад DLCP eng.pptx

36 Accuracy of COVID-19 evolution models for different forecast horizons

Currently, there are more than two years of statistics accumulated on COVID-19 for a large number of regions, which allows the use of algorithms that require large training sets, such as neural networks, to predict the dynamics of the disease.
The article provides a comparative analysis of various COVID-19 models based on forecasting for the period from 07/20/2020 to 05/05/2022 using statistics on the regions of the Russian Federation and US states The forecast target is the sum of confirmed cases over the forecast horizon.
Models based on the Exponential Smoothing (ES) and LSTM methods were considered.
The training set included data from all regions. The MAPE metric was used for model comparison, the evaluation of the effectiveness of the LSTM in the learning process was carried out using cross-validation and the MSE metric.
Comparisons were made with models from literature sources, as well as with the baseline model “tomorrow like today” (sum for forecast horizon equals today cases multiplied by forecast horizon).
It is shown that on small horizons (up to 28 days) the “tomorrow like today” and ES algorithms show better accuracy than LSTM. In turn, on longer horizons (28 days or more), the preference should be given to the more complex LSTM model.

Speaker: Mr Saveliy Zavertyaev (National Research Centre "Kurchatov Institute")

DLCP_COVID.pptx

37 Taking into Account Mutual Correlations during Selection of Significant Input Features in Neural Network Solution of Inverse Problem s of Spectroscopy

In neural network solutions to many physical problems, there is a need to reduce the dimension of the input data in order to achieve a more accurate and stable solution while reducing computational complexity.
When solving an inverse problem in spectroscopy, multicollinearity is often observed between the input features, making it necessary to use a selection method that takes into account the correlation between the input features.
The method used in this study is based on the iterative selection of features with the highest correlation with respect to the target variable and on the elimination of features with high mutual correlation.
The paper compares the quality of a neural network solution to the problem of determining the concentrations of heavy metal ions in water by Raman spectra on the complete set of input features and on its subsets compiled using the selection method under consideration, as well as using traditional methods of selecting significant input features.

Speaker: Nickolay Shchurov (Faculty of Physics Lomonosov Moscow State University)

DLCP_2022_Shchurov_NO.pptx

38 In situ wind speed nowcasting using data-driven approach.

The weather forecast has a significant impact on a variety of human industries. In particular, knowledge of the short-term wind speed conditions is essential for fishery, energy management, surfing and others. One of the most effective neural network models for time series forecasting is LSTM (Long short-term memory), however, the accuracy of its forecast decreases significantly with increasing forecasting range. At the same time, numerical models based on physical laws make it possible to achieve accurate results even over long-term intervals. In an attempt to combine these 2 types of models, an LSTM-based neural network was developed using wind speed data at the forecast point and atmospheric parameters in a domain of size covering mesoscale wind events. Based on these weather characteristics and numerical model data, the neural network makes a short-term forecast of the wind speed module at the point. In the current state, our model outperforms the persistent forecast. In the future, the results can be improved by adjusting hyperparameters and introducing the ability to use the result of numerical models as a basis for the final forecast.

Speaker: Viktor Golikov

windpred eng.pptx

Friday 8 July

Session 4. Machine Learning in Education

39 Sponsor report - Softline

Speaker: E. Surzhikov (Softline)

40 Sponsor report - RSC group

Speaker: A. Katenev (RSC group )

41 ML/DL/HPC Ecosystem of the HybriLIT Heterogeneous Platform (MLIT JINR): New Opportunities for Applied Research

The report presents the possibilities for using the ML/DL/HPC ecosystem deployed on the HybriLIT Heterogeneous Platform (MLIT JINR) on top of JupyterHub, which provides opportunities for solving tasks not only in the field of machine learning and deep learning, but also for the convenient organization of calculations and scientific visualization. The ecosystem allows one to develop and implement program modules in Python, as well as to carry out methodical computations. The relevance of deploying such an environment is primarily associated with the great demand for software modules that are provided to a group of researchers or the scientific community, when all stages of the study can be reproduced; the code has been modified and used by the scientific community. Using the example of solving a specific problem to study the dynamics of magnetization in a Phi-0 Josephson Junction (Superconductor-Ferromagnet-Superconductor structure), a methodology for developing software modules is presented; it enables not only to carry out calculations, but also to visualize the results of the study and accompany them with the necessary formulas and explanations. In addition, the possibility of parallel implementation of the algorithm for performing computations for various values of parameters of the model based on the Joblib Python library is shown, and the results of computational experiments demonstrating the efficiency of parallel data processing are presented.
Another example of the capabilities of the ML/DL/HPC ecosystem is the development of modules with the integration of the MATLAB code in the Jupyter Notebook, which allows one to effectively perform applied computations for image analysis.
This work was supported by Russian Science Foundation grant No 22-71-10022.

Speaker: Maxim Zuev (JINR)

dlcp2022_zuev.pdf

42 Analytical platform for intellectual labour market analysis

The paper presents an analytical platform that implements automated monitoring and analysis of the labor market in the Russian Federation. The platform is based on Big Data solutions and technologies. End-to-end processing corresponds to the general scheme of step-by-step solving of the problem - from data collection, their transformation, analysis, and modeling to services for visualization of results and decision-making. The analytical core of the system is a module for intelligent analysis of texts of job advertisements in the labor market. Vacancy data is collected from the most extensive databases in Russia (HeadHunter, TrudVsem, and SuperJob). The matching of job descriptions and the official list of professions of the Ministry of Labor and Social Protection of the Russian Federation using semantic analysis based on neural models trained on large bodies of texts. The results are presented using several services developed within the MS Power BI business intelligence system. Data collection has been ongoing since 2015. About 500 thousand active vacancies per day are processed.

Speaker: Anna Ilina (Joint Institute for Nuclear Research)

Analytical platform for intellectual labour market analysis.pdf

Posters

43 Algorithmic block for behavioral tests in the BIOHLIT information system for radiobiological studies

The BIOHLIT information system (IS) for analyzing behavioral and pathomorphological changes in the central nervous system when studying the effect of ionizing radiation on laboratory animals. Information system is being jointly developed by specialists from MLIT and LRB JINR.
The IS is necessary for storing data in a single information space, enhancing the detection of laboratory animals in the behavioral tests (Open Field, T-maze, etc.) arena, calculating individual behavioral patterns, as well as for reducing time and energy costs, minimizing the human factor when dealing with histological slides. This will allow processing experimental data in no time and defining qualitative and quantitative changes in the central nervous system after exposing to ionizing radiation. For these purposes, on the basis of modern technologies of computer vision and machine learning, an algorithm was developed; it enables to automate the analysis of the behavioral reactions of experimental animals through video files.
To solve this problem, it was necessary to develop several subgroups of algorithms: algorithms for the automated marking of the field of experimental setups, algorithms for tracking the animal’s position in experimental setups of different types and algorithms for evaluating the animal’s behavioral patterns that characterize its emotional status and orienting-exploratory reactions. As a result of the operation of this algorithm, the information obtained is stored in different forms: a visualized track of the laboratory animal’s movement, a video file with tracking the laboratory animal’s position, a heat map by sectors and a JSON file that stores all the information obtained from the video file for subsequent statistical analysis. The JSON file contains information on automated marking by the sectors and boundaries of the experimental setup, a track of the animal’s movement by frame coordinates, the characteristics of the original video file (frame size, number of frames per second). These data are required for additional analysis (statistical, etc.).

Speaker: Yuri Butenko (JINR)

DLCP2022.pdf

44 Application of machine learning methods to determine the state of the cardiovascular system based on the analysis of indicators of a quantum phase space of the rhythm of the cardiovascular system

The most complete information about the state of the human cardiovascular system is provided by the analysis of the array of cardiointervals (RR-intervals) of 24-hour holter monitoring (HM).
The most important task of analyzing a large array of HM RR-intervals is the introduction of the main parameters that most adequately reflect the properties of this array. One way to solve this problem is to construct an extended quantum phase space Seq of the instantaneous heart rate and search for the main parameters that describe its properties.
The Seq space provides a powerful tool for studying non-deterministic chaotic systems. In particular, it allows one to visualize HM data by presenting digital information in a form convenient for observation and analysis.
In particular, it allows one to visualize HM data by presenting digital information in a form convenient for observation and analysis. The forms of the obtained graphs differ significantly visually in their form.
It is proposed to use the profiles of graphs of the regularity I_r and irregularity I_nr^+,I_nr^- indexes respectively of the Seq space as markers of the state of the cardiovascular system, reflecting the properties of an array of cardiointervals, and to carry out their detailed analysis for a large number of patients using machine learning methods. To train the neural network, data arrays of cases of cardiac conditions with a known pathology or norm are used.

Speaker: A.I. Tsvetkov (Tver state university)

Poster_Tsvetkov.TvGU.pdf

45 NARX Neural Prediction of Oscilational Instability at the IBR-2M reactor

During the start-up regime of the IBR-2M power fluctuations appear, which
the AR system dampens. Their origin is not completely clear, however it
is known that the major reactivity sources are from design - respectively
the OPO and DPO reflectors (axial fluctuations towards the active zone and
their relative phase of intersecting each other facing the center of the
active zone).
A neuromorphic solution is sought to anticipate (5-10 s) such fluctuations.
I present encouraging preliminary results obtained with a Non-linear
Autoregressive Exogenous neural network, the main features of the
fluctuations being anticipatable.

Speaker: Mihai-Tiberiu Dima (JINR - MLIT)

Mihai Tiberiu Dima - Poster.pdf

46 Neuromorphic Improvement of the Weizsaecker Formula

Yearly nuclide mass data is fitted to improved versions of the Weizsaecker formula. The present attempt at furthering the precision of this endeavour aims to reach beyond just precision, and obtain predictive capability about the "Stability Island" of nuclides. The method is to perform a fit to a recent improved liquid drop model with isotonic shift. The residuals are then fed to a neural network, with a number of "feature" quantities. The results are then discussed in view of their perspective to predict the "Stability Island".

Speaker: Mihai-Octavian Dima (JINR - MLIT)

A0.pdf

47 Sampling of Integrand for Integral Calculation Using Shallow Neural Network

We present the effect of using the Metropolis-Hastings algorithm for sampling the integrand on the accuracy of calculating the value of the integral. In addition, a hybrid method for sampling the integrand is proposed, in which part of the training sample is generated by applying the Metropolis-Hastings algorithm, and the other part includes points of a uniform grid. Numerical experiments show that when integrating in high-dimensional domains, sampling of integrands both by the Metropolis-Hastings algorithm and by a hybrid method is more efficient with respect to the points of a uniform grid.

Speaker: Vladimir Papoyan (JINR)

Poster_NNI_DLCP_2022 (1).pdf

48 The Monte Carlo simulation of MiniSPD stand

The Spin Physics Detector, a universal facility for studying the nucleon spin structure and other spin-related phenomena with polarized proton and deuteron beams. It will be placed in one of the two interaction points of the NICA collider that is under construction at the Joint Institute for Nuclear Research (Dubna, Russia). The main objective of the proposed experiment is the comprehensive study of the unpolarized and polarized gluon content of the nucleon.

In accordance with the possible configuration of the SPD setup, our collaboration manufactured the MiniSPD stand. At present, this stand is used for testing SPD detector prototypes with cosmic muons, the Data Acquisition System (DAQ) and the Detector Control System (DCS).

Using GEANT4 software and ROOT framework, we have been carried out Monte Carlo simulation of three modules of two-sided silicon plates of MiniSPD stand for two cases: with and without taking into account operation of the scintillator triggers. We illustrate the solution of the alignment task which is the important part of any experiment. Our simulation silicon detectors are agreed well with experimental data on cosmic muons.

We are currently engaged in modeling and processing experimental data at the MiniSPD stand, so this device does not involve the use of machine learning methods. But when there is a transition to a full SPD installation, when processing data, machine learning methods will be needed and with our performance we would like to interest and attract specialists from this field.

Speakers: Nurlan Barlykov, Vladimir Dudin (Dmitrievich)

Poster_MiniSPD.pdf

49 Анализ данных в образовательной деятельности университета «Дубна»

В 2020 году университет «Дубна» столкнулся с вынужденным выходом на дистанционное обучение. Была сформирована цифровая среда университета, включающая в себя различные ресурсы для помощи в информировании студентов и организации образовательного процесса.

Цель данной работы провести анализ накопленных данных, проверить степень влияния дистанционного обучения на уровень успеваемости студентов и установить взаимосвязь между данными успеваемости студентов и их уровнем удовлетворенности образованием.

После первичной обработки (~ 70 тыс. строк) и анализа данных из 1С была установлена положительная динамика успеваемости студентов Института САУ университета «Дубна» в период дистанционного обучения. Однако, следует отметить, что данные не равномерно распределены по годам, связано это в первую очередь с цифровизацией образования, которая начала набирать обороты лишь несколько лет назад.

Speaker: Кристина Жаткина

Poster.pdf

50 Closing

DLCP-2022_Results.pdf

13:00 BBQ