Title :
Maximum pseudo likelihood estimation in network tomography
Author :
Liang, Gang ; Yu, Bin
Author_Institution :
Dept. of Stat., California Univ., Berkeley, CA, USA
Abstract :
Network monitoring and diagnosis are key to improving network performance. The difficulties of performance monitoring lie in today´s fast growing Internet, accompanied by increasingly heterogeneous and unregulated structures. Moreover, these tasks become even harder since one cannot rely on the collaboration of individual routers and servers to measure network traffic directly. Even though the aggregative nature of possible network measurements gives rise to inverse problems, existing methods for solving inverse problems are usually computationally intractable or statistically inefficient. A pseudo likelihood approach is proposed to solve a group of network tomography problems. The basic idea of pseudo likelihood is to form simple subproblems and ignore the dependences among the subproblems to form a product likelihood of the subproblems. As a result, this approach keeps a good balance between the computational complexity and the statistical efficiency of the parameter estimation. Some statistical properties of the pseudo likelihood estimator, such as consistency and asymptotic normality, are established. A pseudo expectation-maximization (EM) algorithm is developed to maximize the pseudo log-likelihood function. Two examples, with simulated or real data, are used to illustrate the pseudo likelihood proposal: 1) inference of the internal link delay distributions through multicast end-to-end measurements; 2) origin-destination matrix estimation through link traffic counts.
Keywords :
Internet; computational complexity; delays; fault diagnosis; inverse problems; matrix algebra; maximum likelihood estimation; monitoring; multicast communication; network topology; optimisation; statistical analysis; telecommunication traffic recording; tomography; Internet topology; computational complexity; inverse problems; link delay distribution; link traffic; maximum pseudo likelihood estimation; multicast end-to-end measurements; network diagnosis; network monitoring; network tomography; network traffic; origin-destination matrix estimation; parameter estimation; pseudo expectation-maximization algorithm; pseudo log-likelihood function; statistical efficiency; Collaboration; Computer networks; Delay estimation; Internet; Inverse problems; Monitoring; Network servers; Telecommunication traffic; Tomography; Web server;
Journal_Title :
Signal Processing, IEEE Transactions on
DOI :
10.1109/TSP.2003.814464