Title :
A Scalable Cloud Platform using Matlab Distributed Computing Server Integrated with HDFS
Author :
Dutta, Ritaban ; Annappa, B.
Author_Institution :
Dept. of Comput. Sci. & Eng., Nat. Inst. of Technol. Karnataka, Surathkal, India
Abstract :
The Hadoop Distributed File System (HDFS) is a large data storage system which exhibits several features of a good distributed file system. In this paper we integrate Mat lab Distributed Computing Server (MDCS) with HDFS to build a scalable, efficient platform for scientific computations. We use an FTP server on top of HDFS for data transfer from the Mat lab system to HDFS. The motivation of using HDFS for storage with MDCS is to provide an efficient, fault-tolerant file system and also to utilize the resources efficiently by making each system serve as both data node for HDFS and worker for MDCS. We test the storage efficiency of HDFS and compare with normal file system for data transfer operations through MDCS.
Keywords :
cloud computing; distributed databases; fault tolerance; file servers; mathematics computing; network operating systems; resource allocation; FTP server; HDFS; Hadoop distributed file system; MDCS; Matlab distributed computing server; cloud platform; data transfer operations; fault-tolerant file system; large data storage system; normal file system; resource utilization; scientific computations; Cloud computing; Computer architecture; Data transfer; File systems; MATLAB; Servers; Distributed Computing; HDFS; Matlab; PaaS;
Conference_Titel :
Cloud and Services Computing (ISCOS), 2012 International Symposium on
Conference_Location :
Mangalore
Print_ISBN :
978-1-4673-4854-6
DOI :
10.1109/ISCOS.2012.17
