Design and development of application software for MPD distributed computing infrastructure

6 Jul 2021, 13:45
15m
Conference Hall or Online - https://jinr.webex.com/jinr/j.php?MTID=m6e39cc13215939bea83661c4ae21c095

Conference Hall or Online - https://jinr.webex.com/jinr/j.php?MTID=m6e39cc13215939bea83661c4ae21c095

Sectional reports 3. Computing for MegaScience Projects Computing for MegaScience Projects

Speaker

Igor Pelevanyuk (Joint Institute for Nuclear Research)

Description

Multi-Purpose Detector collaboration began using distributed computing for centralized Monte-Carlo generation in the mid of 2019. DIRAC Interware is used as a platform for the integration of heterogeneous distributed computing resources. Since that time workflows of job submission, data transfer, and storage were designed, tested, and successfully applied. Moreover, we observe the growth of interest in access to the computing system from users. One way to provide such access for the users is to allow them direct jobs submission to DIRAC. But direct access to the resources imposes high responsibility on the users and must be restricted. For this reason, another approach was chosen: to design and develop a dedicated application that collects requirements from a user and starts a required amount of the jobs. That approach requires additional efforts: elaboration of requirements, designing of application, and development. But, it allows greater control over workload submitted by other users, reducing possible failures and inefficient usage of resources.

Primary authors

Andrey Moshkin (JINR) Igor Pelevanyuk (Joint Institute for Nuclear Research) Oleg Rogachevskiy (JINR)

Presentation materials