Portable Acceleration of CMS Computing Workflows with Coprocessors as a Service

dc.citation.articleNumber17en_US
dc.citation.journalTitleComputing and Software for Big Scienceen_US
dc.citation.volumeNumber8en_US
dc.contributor.authorCMS Collaborationen_US
dc.date.accessioned2024-10-01T14:03:58Zen_US
dc.date.available2024-10-01T14:03:58Zen_US
dc.date.issued2024en_US
dc.description.abstractComputing demands for large scientific experiments, such as the CMS experiment at the CERN LHC, will increase dramatically in the next decades. To complement the future performance increases of software running on central processing units (CPUs), explorations of coprocessor usage in data processing hold great potential and interest. Coprocessors are a class of computer processors that supplement CPUs, often improving the execution of certain functions due to architectural design choices. We explore the approach of Services for Optimized Network Inference on Coprocessors (SONIC) and study the deployment of this as-a-service approach in large-scale data processing. In the studies, we take a data processing workflow of the CMS experiment and run the main workflow on CPUs, while offloading several machine learning (ML) inference tasks onto either remote or local coprocessors, specifically graphics processing units (GPUs). With experiments performed at Google Cloud, the Purdue Tier-2 computing center, and combinations of the two, we demonstrate the acceleration of these ML algorithms individually on coprocessors and the corresponding throughput improvement for the entire workflow. This approach can be easily generalized to different types of coprocessors and deployed on local CPUs without decreasing the throughput performance. We emphasize that the SONIC approach enables high coprocessor usage and enables the portability to run workflows on different types of coprocessors.en_US
dc.identifier.citationThe CMS Collaboration. (2024). Portable Acceleration of CMS Computing Workflows with Coprocessors as a Service. Computing and Software for Big Science, 8(1), 17. https://doi.org/10.1007/s41781-024-00124-1en_US
dc.identifier.digitals41781-024-00124-1en_US
dc.identifier.doihttps://doi.org/10.1007/s41781-024-00124-1en_US
dc.identifier.urihttps://hdl.handle.net/1911/117903en_US
dc.language.isoengen_US
dc.publisherSpringer Natureen_US
dc.rightsExcept where otherwise noted, this work is licensed under a Creative Commons Attribution (CC BY) license.  Permission to reuse, publish, or reproduce the work beyond the terms of the license or beyond the bounds of fair use or other exemptions to copyright law must be obtained from the copyright holder.en_US
dc.rights.urihttps://creativecommons.org/licenses/by/4.0/en_US
dc.titlePortable Acceleration of CMS Computing Workflows with Coprocessors as a Serviceen_US
dc.typeJournal articleen_US
dc.type.dcmiTexten_US
dc.type.publicationpublisher versionen_US
Files
Original bundle
Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
s41781-024-00124-1.pdf
Size:
2.28 MB
Format:
Adobe Portable Document Format