• DocumentCode
    1720856
  • Title

    Data placement and buffer management for concurrent mergesorts with parallel prefetching

  • Author

    Wu, Kun-Lung ; Yu, Philip S. ; Teng, James Z.

  • Author_Institution
    IBM Thomas J. Watson Res. Center, Yorktown Heights, NY, USA
  • fYear
    1994
  • Firstpage
    418
  • Lastpage
    427
  • Abstract
    Various data placement policies are studied for the merge phase of concurrent mergesorts using parallel prefetching, where initial sorted runs (input) of a merge and its final sorted run (output) are stored on multiple disks but each run resides only on a single disk. Since the merge phase involves only sequential references, parallel prefetching can be attractive an reducing the average response time for concurrent merges. However, without careful buffer control, severe thrashing may develop under certain run placement policies, reducing the benefits of prefetching. The authors examine through detailed simulations three different run placement policies. The results show that even though buffer thrashing can be almost avoided by placing the output run of a job on the same disk with at least one of its input runs, this thrashing-avoiding run placement policy can be substantially outperformed by other policies that use buffer thrashing control. With buffer thrashing avoidance, the best performance as achieved by a run placement policy that uses a proper subset of disks dedicated for writing the output runs while the rest of the disks are used for prefetching the input runs in parallel
  • Keywords
    buffer storage; parallel algorithms; sorting; storage management; buffer management; concurrent mergesorts; data placement; initial sorted runs; multiple disks; parallel prefetching; run placement policies; thrashing; Databases; Delay; Prefetching; Query processing; Sorting; Throughput; Writing;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Data Engineering, 1994. Proceedings.10th International Conference
  • Conference_Location
    Houston, TX
  • Print_ISBN
    0-8186-5402-3
  • Type

    conf

  • DOI
    10.1109/ICDE.1994.283063
  • Filename
    283063