A Unified Middleware for Data, Workflow, and Workload Management in SPD Online Filter

29 Oct 2025, 12:30
15m
4th floor, 456 (MLIT)

4th floor, 456

MLIT

Oral Information Technology Information Technology

Speaker

Nikita Greben

Description

The SPD Online Filter is a crucial intermediate system that bridges the continuous data stream from the DAQ and the offline computing system. SPD Online Filter is designed for the initial processing of high-throughput, multi-step primary data from the SPD detector. It's composed of several layers: a dedicated compute cluster; applied physics software, and the middleware which is an intermediate software layer that connects both hardware resources and applied software.
The middleware integrates three core components: Data and Storage Management (DSM), Workflow Management System (WfMS), and Workload Management System (WMS). We describe the design principles, component interactions, deployment, that enable flexible workflow definition, efficient job scheduling, and robust data lifecycle management.

Author

Nikita Greben

Co-authors

Dr Danila Oleynik (JINR MLIT) Leonid Romanychev Полина Коршунова (JINR, NRNU MEPhI)

Presentation materials