Data Knowledge Base evolution for a stable usage and operation

3 Jul 2023, 17:00
15m
MLIT Conference Hall

MLIT Conference Hall

Distributed Computing Systems Distributed Computing Systems

Speaker

Viktor Kotliar (Institute for High Energy Physics named by A.A. Logunov of National Research Center “Kurchatov Institute”)

Description

The Data Knowledge Base (DKB) project is aimed at knowledge acquisition and metadata integration which consists of DKB python library and API service. Due to its ETL workflow engine it allows to build a single system with integrated and pre-processed information behind distributed metadata infrastructure. Such system provides fast and efficient response for summary reports, monitoring tasks (aggregation queries), multi-system join queries and others. In this work the resent improvements and a current status of the project are shown as well as its usage in WLCG for operation metadata analysis.

Primary author

Viktor Kotliar (Institute for High Energy Physics named by A.A. Logunov of National Research Center “Kurchatov Institute”)

Presentation materials