Evaluating the impact of information distortion on normalized compression distance
Entity
UAM. Departamento de Ingeniería InformáticaPublisher
Springer Berlin HeidelbergDate
2008Citation
10.1007/978-3-540-87448-5_8
Coding Theory and Applications: Second International Castle Meeting, ICMCTA 2008, Castillo de la Mota, Medina del Campo, Spain, September 15-19, 2008. Proceedings. Lecture Notes in Computer Science, Volumen 5228. Springer, 2008. 69-79.
ISSN
0302-9743 (print); 1611-3349 (online)ISBN
978-3-540-87447-8 (print); 978-3-540-87448-5 (online)DOI
10.1007/978-3-540-87448-5_8Funded by
This work was supported by TIN 2004-04363-CO03-03, TIN 2007-65989, CAM S-SEM-0255-2006, TIN2007-64718 and TSI 2005-08255-C07-06. We would also like to thank Franscico Sánchez for his useful comments on this draft.Project
Comunidad de Madrid. S2006/SEM-0255/OLFACTOSENSE; Gobierno de España. TIN2004-04363-CO03-03; Gobierno de España. TIN2007-65989; Gobierno de España. TIN2007-64718; Gobierno de España. TSI2005-08255-C07-06Editor's Version
http://dx.doi.org/10.1007/978-3-540-87448-5_8Subjects
Coding and Information Theory; Algebra; Algebraic Geometry; InformáticaNote
The final publication is available at Springer via http://dx.doi.org/10.1007/978-3-540-87448-5_8Proceedings of Second International Castle Meeting, ICMCTA 2008, Castillo de la Mota, Medina del Campo, Spain, September 15-19, 2008.
Rights
© Springer-Verlag Berlin Heidelberg 2008Abstract
In this paper we apply different techniques of information distortion on a set of classical books written in English. We study the impact that these distortions have upon the Kolmogorov complexity and the clustering by compression technique (the latter based on Normalized Compression Distance, NCD). We show how to decrease the complexity of the considered books introducing several modifications in them. We measure how the information contained in each book is maintained using a clustering error measure. We find experimentally that the best way to keep the clustering error is by means of modifications in the most frequent words. We explain the details of these information distortions and we compare with other kinds of modifications like random word distortions and unfrequent word distortions. Finally, some phenomenological explanations from the different empirical results that have been carried out are presented.
Files in this item
Google Scholar:Granados Fontecha, Ana
-
Cebrián Ramos, Manuel
-
Camacho, David
-
Rodríguez Ortiz, Francisco Borja
This item appears in the following Collection(s)
Related items
Showing items related by title, author, creator and subject.