Managing Large-Scale Workflow Execution from Resource Provisioning to Provenance Tracking: The CyberShake Example

Author

Deelman, Ewa ; Callaghan, Scott ; Field, Edward ; Francoeur, Hunter ; Graves, Robert ; Gupta, Nitin ; Gupta, Vipin ; Jordan, Thomas H. ; Kesselman, Carl ; Maechling, Philip ; Mehringer, John ; Mehta, Gaurang ; Okaya, David ; Vahi, Karan ; Zhao, Li

Author_Institution

USC Information Sciences Institute, USA

fYear

2006

fDate

Dec. 2006

Firstpage

14

Lastpage

14

Abstract

This paper discusses the process of building an environment where large-scale, complex, scientific analysis can be scheduled onto a heterogeneous collection of computational and storage resources. The example application is the Southern California Earthquake Center (SCEC) CyberShake project, an analysis designed to compute probabilistic seismic hazard curves for sites in the Los Angeles area. We explain which software tools were used to build to the system, describe their functionality and interactions. We show the results of running the CyberShake analysis that included over 250,000 jobs using resources available through SCEC and the TeraGrid.

Keywords

Buildings; Collaboration; Earthquakes; Environmental management; Geology; Geophysics computing; Hazards; Large-scale systems; Production; Resource management;

fLanguage

English

Publisher

ieee

Conference_Titel

e-Science and Grid Computing, 2006. e-Science '06. Second IEEE International Conference on

Conference_Location

Amsterdam, The Netherlands

Print_ISBN

0-7695-2734-5

Type

conf

DOI

10.1109/E-SCIENCE.2006.261098

Filename

4030987