A small-file writing acceleration mechanism for distributed file system

Throughput and latency are the two important performance indicators for distributed file systems. Google has achieved a great success with Google File System (GFS) when operating big files, but the latency is too big when reading and writing small files. In this paper, we propose a small-file writing acceleration mechanism (SFWM) for distributed file system. SFWM optimizes access paths of writing to disks and uses an asynchronous method to accelerate the writing. Experiments in the distributed file system, SandBox show that the time to write small-file using SFWM is significantly reduced compared with the writing time in MooseFS and the throughput of writing using SFWM is improved.