Comparison of Tools for Data Mining and Retrieval in High Volume Data Stream

Applications querying real time data streams in order to identify trends, patterns, or anomalies can often benefit from comparing the live stream data with archived historical stream data. This is especially true for applications involving live & unpredictable data like in traffic analysis & stock markets. However this data mining in DSMSs have turned out to be a costly proposition. In this paper, perform a comparative analysis between various tools available that can handle this historical data & hence facilitate in the Data Mining. For comparing the tools for data retrieval, we cover inclemently, from using traditional DBMS to the more sophisticated tools that utilize Bit-Map indexing or Hoeffding Algorithm. We will see how these tools can simultaneously analyze (1) live streams with high data rates and maintain (2) a large repository of historical stream data.