Title :
Store, schedule and switch - A new data delivery model in the big data era
Author :
Weiqiang Sun ; Fengqin Li ; Wei Guo ; Yaohui Jin ; Weisheng Hu
Author_Institution :
State Key Lab. of Adv. Opt. Commun. Syst. & Networks, Shanghai Jiao Tong Univ., Shanghai, China
Abstract :
The big data era is posing unprecedented challenges on the existing network infrastructure. In today´s networks, data are transferred across the network as a combination of a series of packets, delivered one by one, without considering the data in their entirety with respective service level requirements. The so called elephant data, which may be less sensitive to transfer delay, compete precious network resources with mice data, in most cases from interactive and delay sensitive applications. Consequently, the Quality of Service (QoS) of interactive applications is hard to provision, and the utility of network is low. We propose a new data transfer model to complement the existing per-packet forwarding paradigm. In the new data transfer model, a service level requirement is assigned (by the data source) to each big data transfer request. Instead of transferring these data on per-packet bases immediately upon entering the network, the network stores the data until it find necessary, or enough network resource is available for that transfer. The scheduled data delivery is realized through the use of dynamic circuit switching. We also present some preliminary simulation results of SSS networks.
Keywords :
circuit switching; computer networks; formal specification; formal verification; quality of service; resource allocation; scheduling; QoS; SSS networks; big data era; data delivery model; data delivery scheduling; data transfer; data transfer model; delay sensitive applications; dynamic circuit switching; elephant data; interactive applications; mice data; network infrastructure; network resources; network stores; quality of service; service level requirement; service level requirements; transfer delay; Data handling; Data models; Data storage systems; Delays; Information management; Optical switches; Big Data; Data Delivery; Dynamic Circuit Switching; Network Resource Management; OpenFlow;
Conference_Titel :
Transparent Optical Networks (ICTON), 2013 15th International Conference on
Conference_Location :
Cartagena
DOI :
10.1109/ICTON.2013.6602860