• DocumentCode
    2098793
  • Title

    Bridging VisTrails Scientific Workflow Management System to High Performance Computing

  • Author

    Jia Zhang ; Votava, Petr ; Lee, Tien Jung ; Chu, Owen ; Li, Cong ; Liu, Deming ; Liu, Kun ; Xin, Norman ; Nemani, Ramakrishna

  • Author_Institution
    Carnegie Mellon Univ. - Silicon Valley, San Jose, CA, USA
  • fYear
    2013
  • fDate
    June 28 2013-July 3 2013
  • Firstpage
    29
  • Lastpage
    36
  • Abstract
    NASA Earth Exchange (NEX) is a collaboration platform whose goal is to accelerate Earth science research, by leveraging NASA´s vast collections of global satellite data together with access to NASA´s High-End Computing (HEC) facilities. NEX also aims to facilitate the sharing of experimental results as well as scientific processes (workflows) with the Earth science community through integration with VisTrails workflow management system. While VisTrails is used internally, it is not easily accessible from remote computers without directly logging into the NASA HEC systems through twofactor authentication and a bastion host. This paper describes the initial design of an extensible architecture that facilitates easier workflow interaction on NEX, by enabling users to develop and execute workflows in a supercomputing environment directly from their local VisTrails installation. This architecture helps domain scientists seamlessly leverage distributed computing and storage resources and it is potentially applicable to other scientific workflow management software. We further describe the architecture of the VisTrails-HEC plugin (as well as the VisTrails-Amazon plugin) and the implementation of a working prototype to demonstrate the feasibility of our solution.
  • Keywords
    Earth; geophysics computing; parallel processing; workflow management software; Earth science research; NASA Earth Exchange; NASA HEC systems; NASA high-end computing facilities; NEX collaboration platform; National Atmospheric and Space Administration; VisTrails scientific workflow management system; VisTrails-Amazon plugin; bastion host; distributed computing resource; high performance computing; storage resource; supercomputing environment; two-factor authentication; workflow interaction; Bridges; Computer architecture; Geoscience; Monitoring; NASA; Servers; Time factors;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Services (SERVICES), 2013 IEEE Ninth World Congress on
  • Conference_Location
    Santa Clara, CA
  • Print_ISBN
    978-0-7695-5024-4
  • Type

    conf

  • DOI
    10.1109/SERVICES.2013.64
  • Filename
    6655672