Title :
Performance of Splunk for the TDAQ information service at the ATLAS experiment
Author :
Yasu, Yoshiji ; Kazarov, Andrei
Author_Institution :
High Energy Accel. Res. Organ., Tsukuba, Japan
Abstract :
The ATLAS Trigger and Data Acquisition (TDAQ) is a large, distributed system composed of several thousand interconnected computers and tens of thousands software processes. Monitoring data produced by multiple sources are selected, aggregated and correlated to perform the analysis of the monitored data. Then they can finally be visualized and presented to the user. Any system implementing these functions has to be flexible in order to adapt to the amount of data produced and requested by the users for analysis and visualization. Due to the size of the ATLAS TDAQ system, the scalability is also important from the performance point of view. Splunk, a commercial product produced by Splunk Inc., is a general-purpose search, analysis & reporting engine and a distributed, non-relational, semi-structured database for time-series text data. This paper describes the evaluation of Splunk for the functionality and the performance.
Keywords :
data acquisition; data analysis; data visualisation; distributed databases; high energy physics instrumentation computing; search engines; text analysis; time series; ATLAS Experiment; ATLAS TDAQ system; ATLAS trigger and data acquisition; Splunk; TDAQ Information Service; data visualization; distributed nonrelational semistructured database; distributed system; general-purpose analysis engine; general-purpose reporting engine; general-purpose search engine; interconnected computers; monitored data analysis; monitoring data aggregation; monitoring data correlation; monitoring data selection; software processes; time-series text data; Data visualization; Distributed databases; Indexing; Monitoring; Software;
Conference_Titel :
Real Time Conference (RT), 2014 19th IEEE-NPSS
Print_ISBN :
978-1-4799-3658-8
DOI :
10.1109/RTC.2014.7097473
