The ATLAS EventIndex using the HBase/Phoenix storage solution

5 Jul 2021, 15:30
15m
310 or Online - https://jinr.webex.com/jinr/j.php?MTID=m326d389213a5963a1114b8cbf9613612

310 or Online - https://jinr.webex.com/jinr/j.php?MTID=m326d389213a5963a1114b8cbf9613612

Plenary reports 3. Computing for MegaScience Projects Computing for MegaScience Projects

Speaker

Elizaveta Cherepanova (Laboratory of Nuclear Problems)

Description

The ATLAS EventIndex provides a global event catalogue and event-level metadata for ATLAS analysis groups and users. The LHC Run 3, starting in 2022, will see increased data-taking and simulation production rates, with which the current infrastructure would still cope but may be stretched to its limits by the end of Run 3. This talk describes the implementation of a new core storage service that will provide at least the same functionality as the current one for increased data ingestion and search rates, and with increasing volumes of stored data. It is based on a set of HBase tables, coupled to Apache Phoenix for data access; in this way we will add to the advantages of a BigData based storage system the possibility of SQL as well as NoSQL data access, which allows the re-use of most of the existing code for metadata integration.

Primary authors

Evgeny Alexandrov (JINR) Igor Alexandrov (JINR) Dario Barberis (University and INFN Genova (Italy)) Luca Canali (CERN) Elizaveta Cherepanova (Laboratory of Nuclear Problems) Alvaro Fernandez Casani (IFIC Valencia) Elizabeth Gallas (University of Oxford (UK)) Carlos Garcia Montoro (IFIC Valencia (ES)) Santiago Gonzalez de la Hoz (IFIC Valencia (ES)) Julius Hrivnac (IJCLab Orsay (FR)) Andrei Kazymov (JINR) Mikhail Mineev (JINR) Fedor Prokoshin (JINR) Grigori Rybkin (IJCLab Orsay (FR)) Jose Salt Cairols (IFIC Valencia (ES)) Fco. Javier Sanchez Martinez (IFIC Valencia (ES)) Miguel Villaplana Perez (IFIC Valencia (ES)) Alexander Yakovlev (JINR)

Presentation materials