Russian data lake prototype as an approach towards national federated storage for Megascience.

8 Jul 2021, 13:30
15m
407 or Online - https://jinr.webex.com/jinr/j.php?MTID=m573f9b30a298aa1fc397fb1a64a0fb4b

407 or Online - https://jinr.webex.com/jinr/j.php?MTID=m573f9b30a298aa1fc397fb1a64a0fb4b

https://jinr.webex.com/jinr/j.php?MTID=m573f9b30a298aa1fc397fb1a64a0fb4b
Sectional reports 6. Data Management, Organisation and Access Data Management, Organization and Access

Speaker

Andrey Kiryanov (PNPI)

Description

A substantial data volume growth will appear with the start of the HL-LHC era. It is not well covered by the current LHC computing model, even taking into account the hardware evolution. The WLCG DOMA project was established to provide data management and storage researches. National data lake r&d's, as a part of the DOMA project, should address the study of possible technology solutions for the organization of intelligent distributed federated storage. This talk will present the current status of the Russian Scientific Data lake prototype and the methodology, which is used for the validation and functional testing of deployed infrastructure.

Primary authors

Co-authors

Aleksandr Alekseev (National Research Tomsk Polytechnic University) Alexei Klimentov (Brookhaven National Lab) Danila Oleynik (JINR LIT) Sergey Smirnov Tatiana Korchuganova (Ivannikov Institute for System Programming of the RAS) Valery Mitsyn (JINR)

Presentation materials