DocumentCode :
1147903
Title :
On the Jensen–Shannon Divergence and Variational Distance
Author :
Tsai, Shi-Chun ; Tzeng, Wen-Guey ; Wu, Hsin-Lung
Author_Institution :
Dept. of Comput. Sci., Nat. Chiao-Tung Univ., Hsinchu, Taiwan
Volume :
51
Issue :
9
fYear :
2005
Firstpage :
3333
Lastpage :
3336
Abstract :
We study the distance measures between two probability distributions via two different distance metrics, a new metric induced from Jensen–Shannon divergence, and the well known L_1 metric. We show that several important results and constructions in computational complexity under the L_1 metric carry over to the new metric, such as Yao\´s next-bit predictor, the existence of extractors, the leftover hash lemma, and the construction of expander graph based extractor. Finally, we show that the useful parity lemma in studying pseudorandomness does not hold in the new metric.
Keywords :
computational complexity; graph theory; information theory; probability; Jensen-Shannon divergence; computational complexity; graph based extractor; leftover hash lemma; parity lemma; probability distribution; variational distance; Complexity theory; Computational complexity; Computer science; Extraterrestrial measurements; Graph theory; Mutual information; Probability distribution; Sampling methods; Jensen–Shannon divergence; expander; extractors; leftover hash lemma; parity lemma;
fLanguage :
English
Journal_Title :
Information Theory, IEEE Transactions on
Publisher :
ieee
ISSN :
0018-9448
Type :
jour
DOI :
10.1109/TIT.2005.853308
Filename :
1499065
Link To Document :
بازگشت