• DocumentCode
    120781
  • Title

    Task shape classification and workload characterization of google cluster trace

  • Author

    Rasheduzzaman, Md ; Islam, M.A. ; Islam, Tarikul ; Hossain, Tahmid ; Rahman, Rashedur M.

  • Author_Institution
    Dept. of Electr. Eng. & Comput. Sci., North South Univ., Dhaka, Bangladesh
  • fYear
    2014
  • fDate
    21-22 Feb. 2014
  • Firstpage
    893
  • Lastpage
    898
  • Abstract
    Understanding workload characteristics is crucial for optimizing and improving the performance of large scale data produced by different industries. In this paper, we analyse a large scale production workload trace (version 2) [1] which is recently made publicly available by Google. We discuss statistical summary of the data. Further we perform k-means clustering to identify common groups of job. Cluster analysis provides insight into the data by dividing the objects into groups (clusters) of objects, such that objects in a cluster are more similar to each other than to the objects in other clusters. This work presents a simple technique for constructing workload characteristics and also provides production insights into understanding workload performance in cluster machine.
  • Keywords
    cloud computing; data analysis; pattern classification; pattern clustering; search engines; Google cluster trace; cloud computing; cluster analysis; cluster machine; k-means clustering; large scale data performance; large scale production workload trace analysis; statistical summary; task shape classification; workload characterization; Algorithm design and analysis; Cloud computing; Clustering algorithms; Conferences; Google; Indexes; Production; Cloud computing; Cumulative Distribution Function (CDF); Workload; k-means clustering;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Advance Computing Conference (IACC), 2014 IEEE International
  • Conference_Location
    Gurgaon
  • Print_ISBN
    978-1-4799-2571-1
  • Type

    conf

  • DOI
    10.1109/IAdCC.2014.6779441
  • Filename
    6779441