Title :
Interactive Exploitation of Nonuniform Cloud Resources for LHC Computing at CERN
Author :
Berzano, Dario ; Blomer, Johannes ; Buncic, Predrag ; Ganis, Gerardo ; Lestaris, Georgios ; Meusel, Rene
Author_Institution :
CERN PH-SFT, Geneva, Switzerland
fDate :
June 28 2013-July 3 2013
Abstract :
Computing at LHC is based on the Grid model, where geographically distributed local batch farms are federated using proper middleware. Several computing centers are considering a conversion to private clouds, capable of supporting alternative computing models along with the Grid one: CERN is pioneering such conversion. Computing tasks at LHC are mostly performed using ROOT, a framework for simulation, reconstruction and data analysis. In High Energy Physics (HEP) data are independent physics collision events. PROOF (Parallel ROOT Facility) is a cluster model built on top of ROOT, capable of processing such events interactively and in parallel. Given the increasing availability of cloud resources, running virtual PROOF clusters has become an appealing alternative. We will show how PROOF interactivity naturally fits into the cloud model: in particular by overcoming VM performance diversity via dynamic workload assignment. Several technologies are combined: the CernVM ecosystem provides the base VM image, APIs for cloud federation and a distributed filesystem for LHC software distribution, HTCondor and PROOF on Demand (PoD) control scheduling of leases and affect the lifecycle of VMs opportunistically. We will illustrate the current status of the project, and the conjoint efforts on PROOF and CernVM to create a reference implementation suiting the needs of all LHC experiments. The final product will be a personal and elastic "Analysis Facility as a Service" where the user connects using ROOT itself as standard LHC client.
Keywords :
cloud computing; grid computing; high energy physics instrumentation computing; CERN; CernVM ecosystem; LHC computing; LHC software distribution; PROOF on demand control scheduling; data analysis; dynamic workload assignment; grid model; high energy physics data; independent physics collision events; interactive exploitation; nonuniform cloud resources; parallel ROOT facility; virtual PROOF clusters; Cloud computing; Computational modeling; Data analysis; Ecosystems; Large Hadron Collider; Physics; CERN; CernVM; HTCondor; LHC; PROOF; PoD; analysis facility; cloud; elasticity; parallelism;
Conference_Titel :
Cloud Computing (CLOUD), 2013 IEEE Sixth International Conference on
Conference_Location :
Santa Clara, CA
Print_ISBN :
978-0-7695-5028-2
DOI :
10.1109/CLOUD.2013.88