Big Data Applications Using Workflows for Data Parallel Computing

Author

Jianwu Wang ; Crawl, Daniel ; Altintas, Ilkay ; Weizhong Li

Author_Institution

San Diego Supercomput. Center, Univ. of California, San Diego, La Jolla, CA, USA

Volume

16

Issue

4

fYear

2014

fDate

July-Aug. 2014

Firstpage

11

Lastpage

21

Abstract

In the Big Data era, workflow systems need to embrace data parallel computing techniques for efficient data analysis and analytics. Here, the authors present an easy-to-use, scalable approach to build and execute Big Data applications using actor-oriented modeling in data parallel computing. They use two bioinformatics use cases for next-generation sequencing data analysis to verify the feasibility of their approach.

Keywords

Big Data; bioinformatics; parallel programming; Big Data applications; actor-oriented modeling; bioinformatics use cases; data analytics; data parallel computing techniques; easy-to-use-scalable approach; next-generation sequencing data analysis; workflow systems; Big data; Data handling; Data storage systems; Distributed databases; Information management; Parallel processing; Programming; Big Data workflow; actor-oriented programming; bioinformatics application; data parallelization; scientific computing; scientific programming;

fLanguage

English

Journal_Title

Computing in Science & Engineering

Publisher

ieee

ISSN

1521-9615

Type

jour

DOI

10.1109/MCSE.2014.50

Filename

6799151