Title :
Supercomputing and Scientific Workflows Gaps and Requirements
Author :
Critchlow, Terence ; Chin, George, Jr.
Author_Institution :
Pacific Northwest Nat. Lab., Richland, WA, USA
Abstract :
Over the past decade, workflows have been successfully applied to a number of scientific domains with great success. Workflow engines are now commonly used across scientific disciplines to automate mundane tasks, collect provenance, and orchestrate complex processes. However, workflows have not yet made significant strides managing fine-grain, concurrent tasks directly on supercomputing platforms. As scientific computing becomes an increasingly important discovery method and high performance computing environments become more complex, addressing this gap becomes critical. Using a simple use case as motivation, this paper describes the current barriers to using workflow engines in a supercomputing environment and outlines the new capabilities that must be provided if workflows are to be successfully applied in this context.
Keywords :
concurrency control; mainframes; workflow management software; concurrent tasks; fine-grain management; high performance computing; scientific computing; scientific workflow; supercomputing; workflow engine; Analytical models; Computational modeling; Data models; Engines; Fault tolerance; Motion pictures; Supercomputers; fault tolerance; high performance computing; scalability; scheduling; scientific workflows;
Conference_Titel :
Services (SERVICES), 2011 IEEE World Congress on
Conference_Location :
Washington, DC
Print_ISBN :
978-1-4577-0879-4
Electronic_ISBN :
978-0-7695-4461-8
DOI :
10.1109/SERVICES.2011.32