Enabling Web Services to Consume and Produce Large Datasets

Service-oriented architectures and Web services are well-established paradigms for developing distributed applications. However, Web services face problems when accessing, moving, and processing large datasets. To address this problem, the authors present ProxyWS, which uses myriad protocols to transport large amounts of data. ProxyWS undertakes data transfers on behalf of legacy Web services and can serve as an interface for developing new Web services that can stream data. Experiments show how this approach facilitates scalable data transports for two data-intensive applications.