PetaCache: A memory-Based Data-Server System

Author

Boeheim, C. ; Gowdy, Stephen J. ; Hanushevsky, Andy ; Leith, David ; Melen, Randy ; Mount, Richard ; Pulliam, Teela ; Weeks, Bill

fYear

0

fDate

0-0 0

Firstpage

349

Lastpage

350

Abstract

Scientific advances depend increasingly on agility in the analysis of data, along with access to massive computation. The PetaCache project addresses the data-access issue by recognizing that the future for intense, non-sequential, data access must be based on low latency solid-state storage. The PetaCache architecture aims at a minimum unit cost, highly scalable hardware and software approach that can take advantage of existing and emerging solid-state storage technologies providing data-access latencies in the range 10-100 microseconds. A prototype system has been constructed as a cluster of 64 nodes hosting a total of one terabyte of memory. Client processors retrieve data from the data-server nodes over a switched Ethernet infrastructure using SLAC´s xrootd data-server software. The system is in use for performance testing, optimization and trial deployments for scientific data analysis. It also provides an excellent platform for testing new data access paradigms

Keywords

cache storage; data analysis; file servers; memory architecture; PetaCache architecture; SLAC xrootd data-server software; client processor; data access; memory-based data-server system; switched Ethernet infrastructure; Computer architecture; Costs; Data analysis; Delay; Ethernet networks; Hardware; Information retrieval; Prototypes; Software prototyping; Solid state circuits;

fLanguage

English

Publisher

ieee

Conference_Titel

High Performance Distributed Computing, 2006 15th IEEE International Symposium on

Conference_Location

Paris

ISSN

1082-8907

Print_ISBN

1-4244-0307-3

Type

conf

DOI

10.1109/HPDC.2006.1652178

Filename

1652178