Distributed Management and Processing of ALICE Monitoring Data with Onedata
Summary
This paper presents an architecture for the distributed management and processing of monitoring data generated within the ALICE experiment. The proposed approach uses the Onedata platform as a data plane, enabling live streaming of monitoring data from MonALISA and its storage on S3-based resources. The data can be accessed through POSIX, S3, and REST interfaces from HPC, cloud, and external MLOps environments. Onedata enables data to be transparently transferred and cached close to computational tasks, supporting efficient processing in a hybrid infrastructure. The solution also provides metadata management, access control, data integrity, hierarchical organization, and long-term archiving, facilitating reliable management of distributed scientific datasets.
Cite this article
@inproceedings{orzechowski_distributed_2024,
title = {Distributed Management and Processing of ALICE Monitoring Data with Onedata},
author = {Michał Orzechowski and Bartosz Baliś and Łukasz Dutka and Jacek Kitowski},
booktitle = {CHEP 2024 [online] : conference on Computing in High Energy and Nuclear Physics : October 19-25, 2024, [Kraków, Poland] : book of abstracts.},
year = {2024},
pages = {196--197},
} Michał Orzechowski, Bartosz Baliś, Łukasz Dutka, Jacek Kitowski, Distributed Management and Processing of ALICE Monitoring Data with Onedata, CHEP 2024 [online] : conference on Computing in High Energy and Nuclear Physics : October 19-25, 2024, [Kraków, Poland] : book of abstracts., 2024, Pages 196-197