• DocumentCode
    1208771
  • Title

    Estimating flow distributions from sampled flow statistics

  • Author

    Duffield, Nick ; Lund, Carsten ; Thorup, Mikkel

  • Author_Institution
    AT&T Labs.-Res., USA
  • Volume
    13
  • Issue
    5
  • fYear
    2005
  • Firstpage
    933
  • Lastpage
    946
  • Abstract
    Passive traffic measurement increasingly employs sampling at the packet level. Many high-end routers form flow statistics from a sampled substream of packets. Sampling controls the consumption of resources by the measurement operations. However, knowledge of the statistics of flows in the unsampled stream remains useful, for understanding both characteristics of source traffic, and consumption of resources in the network. This paper provides methods that use flow statistics formed from sampled packet stream to infer the frequencies of the number of packets per flow in the unsampled stream. A key task is to infer the properties of flows of original traffic that evaded sampling altogether. We achieve this through statistical inference, and by exploiting protocol level detail reported in flow records. We investigate the impact on our results of different versions of packet sampling.
  • Keywords
    IP networks; maximum likelihood estimation; measurement errors; sampling methods; telecommunication traffic; transport protocols; IP flow; flow distribution estimation; maximum likelihood estimation; measurement error; packet level sampling; passive traffic measurement; protocol level; resource consumption; sampled flow statistics; Bandwidth; Communication system traffic control; Fluid flow measurement; Frequency; Maximum likelihood estimation; Protocols; Sampling methods; Statistical distributions; Statistics; Telecommunication traffic; IP flows; maximum likelihood estimation; measurement; measurement errors; packet sampling; sampling methods;
  • fLanguage
    English
  • Journal_Title
    Networking, IEEE/ACM Transactions on
  • Publisher
    ieee
  • ISSN
    1063-6692
  • Type

    jour

  • DOI
    10.1109/TNET.2005.852874
  • Filename
    1528485