Pegasus on the virtual grid: a case study of workflow planning over captive resources

As scientific applications in a variety of disciplines are being actively developed and computing environments become ever more complicated and dynamic, it is becoming challenging to leverage existing cyber-infrastructures and achieve robust and efficient computing. This paper presents a case study of planning and executing application workflows over provisioned resources. This work integrates the Pegasus workflow framework with the Virtual Grid resource provisioning system. Through this preliminary study, we have identified two key issues that need to be addressed: 1) developing a resource capacity estimate which synthesizes efficient resource descriptions for the Virtual Grid from application workflows and 2) execution site information publication which provides resource configurations for Pegasus through the devirtualization of provisioned resources. In addition, we discuss the challenges and research opportunities that we need to explore in order to exploit the advanced features of the systems.