Compilation server - design and implementation

Compilation Server (CS) is a server-assist mechanism to eliminate or reduce the compilation overhead. CS can compile and optimize code on behalf of clients. Modern JVM implementations interleave execution with compilation of “hot” methods to achieve reasonable performance. Since compilation overhead impacts the execution time of the application and induces run-time pauses, we explore offloading compilation onto a compilation server. In this paper, we present the design and implementation of compilation server which compiles and optimizes Java bytecodes on behalf of its clients. CS provides the following benefits: (i) lower execution time by reducing the overhead of optimization; (ii) lower memory management load on the client by eliminating allocation coming from optimizing compilation and by reducing the footprint of the optimizing compiler; (iii) lower execution time of the application due to sharing of profile information across different runs of the same application and runs of different applications.