• DocumentCode
    3097389
  • Title

    Store, schedule and switch - A new data delivery model in the big data era

  • Author

    Weiqiang Sun ; Fengqin Li ; Wei Guo ; Yaohui Jin ; Weisheng Hu

  • Author_Institution
    State Key Lab. of Adv. Opt. Commun. Syst. & Networks, Shanghai Jiao Tong Univ., Shanghai, China
  • fYear
    2013
  • fDate
    23-27 June 2013
  • Firstpage
    1
  • Lastpage
    4
  • Abstract
    The big data era is posing unprecedented challenges on the existing network infrastructure. In today´s networks, data are transferred across the network as a combination of a series of packets, delivered one by one, without considering the data in their entirety with respective service level requirements. The so called elephant data, which may be less sensitive to transfer delay, compete precious network resources with mice data, in most cases from interactive and delay sensitive applications. Consequently, the Quality of Service (QoS) of interactive applications is hard to provision, and the utility of network is low. We propose a new data transfer model to complement the existing per-packet forwarding paradigm. In the new data transfer model, a service level requirement is assigned (by the data source) to each big data transfer request. Instead of transferring these data on per-packet bases immediately upon entering the network, the network stores the data until it find necessary, or enough network resource is available for that transfer. The scheduled data delivery is realized through the use of dynamic circuit switching. We also present some preliminary simulation results of SSS networks.
  • Keywords
    circuit switching; computer networks; formal specification; formal verification; quality of service; resource allocation; scheduling; QoS; SSS networks; big data era; data delivery model; data delivery scheduling; data transfer; data transfer model; delay sensitive applications; dynamic circuit switching; elephant data; interactive applications; mice data; network infrastructure; network resources; network stores; quality of service; service level requirement; service level requirements; transfer delay; Data handling; Data models; Data storage systems; Delays; Information management; Optical switches; Big Data; Data Delivery; Dynamic Circuit Switching; Network Resource Management; OpenFlow;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Transparent Optical Networks (ICTON), 2013 15th International Conference on
  • Conference_Location
    Cartagena
  • ISSN
    2161-2056
  • Type

    conf

  • DOI
    10.1109/ICTON.2013.6602860
  • Filename
    6602860