Speaker
Description
The SPD Online Filter is a crucial intermediate system that bridges the continuous data stream from the DAQ and the offline computing system. SPD Online Filter is designed for the initial processing of high-throughput, multi-step primary data from the SPD detector. It's composed of several layers: a dedicated compute cluster; applied physics software, and the middleware which is an intermediate software layer that connects both hardware resources and applied software.
The middleware integrates three core components: Data and Storage Management (DSM), Workflow Management System (WfMS), and Workload Management System (WMS). We describe the design principles, component interactions, deployment, that enable flexible workflow definition, efficient job scheduling, and robust data lifecycle management.