Title :
Study on information entropy of combinatorics coding
Author :
Jun, Lu ; Da-Xin, Liu
Author_Institution :
Coll. of Comput. Sci. & Technol., Heilongjiang Univ., Harbin, China
Abstract :
Ideas of combinatorics coding and decoding are expatiated in this paper. It predicates that if only repetition exists,redundancy is inevitable. The relation between ordinal space and sequence space is studied. It opens out the characteristic that ordinal space is smaller than sequence space. By making use of this characteristic, combinatorics coding can be used to compress data. Combinatorics coding belongs to universal coding and is probability-independent. To compare with information entropy, average code length of combinatorics coding can be computed approximatively. It is proved that average code length of combinatorics coding can come to information entropy when the length of the section is long enough.
Keywords :
data compression; decoding; entropy codes; probability; code length; combinatoric coding; combinatoric decoding; data compression; information entropy; ordinal space; probability-independent coding; sequence space; universal coding; Combinatorial mathematics; Computer science; Data compression; Educational institutions; Information entropy; Information theory; Probability; Random variables; Source coding; Space technology; Combinatorics Coding; Combinatorics Compression; Data Coding; Information Entropy;
Conference_Titel :
Computer Design and Applications (ICCDA), 2010 International Conference on
Conference_Location :
Qinhuangdao
Print_ISBN :
978-1-4244-7164-5
Electronic_ISBN :
978-1-4244-7164-5
DOI :
10.1109/ICCDA.2010.5541100