JINR Container Distribution Service

7 Jul 2023, 11:30
15m
Room 403

Room 403

Сloud Technologies Сloud Technologies

Speaker

Mr Nikita Balashov (JINR)

Description

Containers are gaining more and more traction both in industry and science. The HEP community is also showing significant interest in adopting container technologies for software distribution. Encapsulating software inside of containers helps scientists create portable and reproducible research environments. However, running containerized workloads at scale via distributed computing infrastructures has some challenges, one of which is efficient container delivery. In a typical scenario thousands of copies of user containers need to be delivered to the worker nodes simultaneously posing excessive load on the container registry. The talk describes how a container registry able to cope with such high loads can be built, reviews existing major public services based on CVMFS and shows an example of such a service implementation at JINR using GitLab.

Primary author

Presentation materials