• DocumentCode
    702787
  • Title

    Crawler intelligence with machine learning and Data Mining integration

  • Author

    Darshakar, Abhiraj

  • Author_Institution
    Dept. of Electron. & Telecommun., Pune Inst. of Comput. Technol., Pune, India
  • fYear
    2015
  • fDate
    8-10 Jan. 2015
  • Firstpage
    1
  • Lastpage
    6
  • Abstract
    This paper presents a study conducted on intelligent crawlers used in search engines, competitive intelligence etc. Data mining algorithms identified by IEEE International Conference on Data Mining (ICDM) were used to aid machine learning and introduce intelligence into the crawler. A statistical analysis of performance of intelligent crawler is presented in this paper. Further in this paper the data mining algorithms are compared on basis of usability in crawlers.
  • Keywords
    data mining; learning (artificial intelligence); search engines; statistical analysis; competitive intelligence; crawler intelligence; data mining integration; intelligent crawlers; machine learning; search engines; statistical analysis; Algorithm design and analysis; Classification algorithms; Clustering algorithms; Crawlers; Data mining; Support vector machines; Training data; C4.5; Crawler; Data mining; K-mean; Machine Learning; Support Vector Machine; Web Intelligence;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Pervasive Computing (ICPC), 2015 International Conference on
  • Conference_Location
    Pune
  • Type

    conf

  • DOI
    10.1109/PERVASIVE.2015.7087203
  • Filename
    7087203