Context Quantization Based on the Modified K-Means Clustering

Article Preview

Abstract:

The context quantization forsource based on the modified K-means clustering algorithm is present in this paper. In this algorithm, the adaptive complementary relative entropy between two conditional probability distributions, which is used as the distance measure for K-means instead, is formulated to describe the similarity of these two probability distributions. The rules of the initialized centers chosen for K-means are also discussed. The proposed algorithm will traverse all possible number of the classes to search the optimal one which is corresponding to the shortest adaptive code length. Then the optimal context quantizer is achieved rapidly and the adaptive code length is minimized at the same time. Simulations indicate that the proposed algorithm produces better coding result than the result of other algorithm.

You might also be interested in these eBooks

Info:

Periodical:

Advanced Materials Research (Volumes 756-759)

Pages:

4068-4072

Citation:

Online since:

September 2013

Authors:

Export:

Price:

Permissions CCC:

Permissions PLS:

Сopyright:

© 2013 Trans Tech Publications Ltd. All Rights Reserved

Share:

Citation:

[1] J. Rissanen, A universal data compression system, IEEE Trans. Information Theory, 29(5): 656–664, Sept. (1983).

DOI: 10.1109/tit.1983.1056741

Google Scholar

[2] M.J. Weinberger, J. Rissanen, and M. Feder, A universal finite memory source, IEEE Trans. Information Theory, vol. 41, p.643–652, (1995).

DOI: 10.1109/18.382011

Google Scholar

[3] J. Rissanen, Universal coding, information, prediction and estimation, IEEE Trans. Inform. Theory, vol. 30, p.629–636, July (1984).

DOI: 10.1109/tit.1984.1056936

Google Scholar

[4] J. Chen, Context modeling based on context quantization with application in wavelet image coding, IEEE Transactions on Image Processing 13 (1) (January 2004) 26–32.

DOI: 10.1109/tip.2003.819224

Google Scholar

[5] S. Forchhammer, X. Wu, J.D. Andersen, Optimal context quantization in lossless compression of image data sequences, IEEE Trans on Image Processing 13 (4) (April 2004) 509–517.

DOI: 10.1109/tip.2003.822613

Google Scholar

[6] S. Forchhammer, X. Wu, Context quantization by minimum adaptive code length, in: Proceedings of IEEE International Symposium on Information Theory, Nice, France, June 2007, p.246–250.

DOI: 10.1109/isit.2007.4557234

Google Scholar

[7] P.S. Bradley and U. Fayyad, Refining Initial Points for K-means Clustering, Proc. 15th Intel Conf. Machine Learning, pp.91-99, (1998).

Google Scholar

[8] S. Arya, D.M. Mount, N.S. Netanyahu, R. Silverman and A.Y. Wu, An Optimal Algorithm for Approximate Nearest Neighbor Searching, J. ACM, vol. 45, pp.891-923, (1998).

DOI: 10.1145/293347.293348

Google Scholar