Data-intensive analysis for scientific experiments at the Large Scale Data Facility

Author

García, A.O. ; Bourov, S. ; Hammad, A. ; Hartmann, V. ; Jejkal, T. ; Otte, J.C. ; Pfeiffer, S. ; Schenker, T. ; Schmidt, C. ; Neuberger, P. ; Stotzka, R. ; van Wezel, J. ; Neumair, B. ; Streit, A.

Author_Institution

Steinbuch Centre for Comput., Karlsruhe Inst. of Technol., Karlsruhe, Germany

fYear

2011

fDate

23-24 Oct. 2011

Firstpage

125

Lastpage

126

Abstract

The Large Scale Data Facility (LSDF) was conceived and launched at the Karlsruhe Institute of Technology (KIT) end of 2009 to address the growing need for value-added storage services for data intensive experiments. The LSDF main focus is to support scientific experiments producing large data sets reaching into the petabyte range with adequate storage, support and value added services for data management, processing and preservation. In this work we describe the approach taken to perform data analysis in LSDF, as well as for data management of the scientific datasets.

Keywords

data analysis; educational institutions; storage management; Karlsruhe Institute of Technology; LSDF; data intensive experiments; data management; data preservation; data processing; data-intensive analysis; large scale data facility; scientific experiments; value-added storage services; Communities; Data visualization; Distributed databases; Protocols; Software; Three dimensional displays; Throughput;

fLanguage

English

Publisher

ieee

Conference_Titel

Large Data Analysis and Visualization (LDAV), 2011 IEEE Symposium on

Conference_Location

Providence, Rl

Print_ISBN

978-1-4673-0156-5

Type

conf

DOI

10.1109/LDAV.2011.6092331

Filename

6092331