Title :
Mining Historical Documents for Near-Duplicate Figures
Author :
Rakthanmanon, Thanawin ; Zhu, Qiang ; Keogh, Eamonn J.
Author_Institution :
Dept. of Comput. Sci. & Eng., Univ. of California, Riverside, CA, USA
Abstract :
The increasing interest in archiving all of humankind´s cultural artifacts has resulted in the digitization of millions of books, and soon a significant fraction of the world´s books will be online. Most of the data in historical manuscripts is text, but there is also a significant fraction devoted to images. This fact has driven much of the recent increase in interest in query-by-content systems for images. While querying/indexing systems can undoubtedly be useful, we believe that the historical manuscript domain is finally ripe for true unsupervised discovery of patterns and regularities. To this end, we introduce an efficient and scalable system which can detect approximately repeated occurrences of shape patterns both within and between historical texts. We show that this ability to find repeated shapes allows automatic annotation of manuscripts, and allows users to trace the evolution of ideas. We demonstrate our ideas on datasets of scientific and cultural manuscripts dating back to the fourteenth century.
Keywords :
data mining; document handling; history; cultural artifacts; cultural manuscripts; historical manuscripts; historical texts; indexing systems; mining historical documents; nearduplicate figures; querying systems; scientific manuscripts; shape patterns; text analysis; Approximation algorithms; Bioinformatics; Data mining; Force; Pathology; Scalability; Shape; cultural artifacts; duplication detection; repeated patterns;
Conference_Titel :
Data Mining (ICDM), 2011 IEEE 11th International Conference on
Conference_Location :
Vancouver,BC
Print_ISBN :
978-1-4577-2075-8
DOI :
10.1109/ICDM.2011.102