Title :
Analyzing web application log files to find hit count through the utilization of Hadoop MapReduce in cloud computing environment
Author :
Narkhede, Sayalee ; Baraskar, Trupti ; Mukhopadhyay, Debajyoti
Author_Institution :
Dept. of Inf. Technol., Maharashtra Inst. of Technol., Pune, India
Abstract :
MapReduce has been widely applied in various fields of data and compute intensive applications and also it is important programming model for cloud computing. Hadoop is an open-source implementation of MapReduce which operates on terabytes of data using commodity hardware. We have applied this Hadoop MapReduce programming model for analyzing web log files so that we could get hit count of specific web application. This system uses Hadoop file system to store log file and results are evaluated using Map and Reduce function. Experimental results show hit count for each field in log file. Also due to MapReduce runtime parallelization response time is reduced.
Keywords :
cloud computing; parallel processing; public domain software; Hadoop MapReduce utilization; Hadoop file system; MapReduce runtime parallelization response time; Web application log files; Web log files; cloud computing environment; commodity hardware; hit count; log file; open-source implementation; Abstracts; Analytical models; Computational modeling; Data models; Load modeling; Three-dimensional displays; User interfaces; Hadoop; cloud computing; data processing; file system; mapreduce;
Conference_Titel :
IT in Business, Industry and Government (CSIBIG), 2014 Conference on
Print_ISBN :
978-1-4799-3063-0
DOI :
10.1109/CSIBIG.2014.7056950
