Authors : Siti Sakira Kamaruddin, Yuhanis Yusof, Farzana Kabir Ahmad and Mohammed Ahmed Taiye
Abstract: The abundance of text data have been witnessed with the growth of web and other text repositories. There is an important need to provide improved mechanism to effectively represent and retrieve text data. This study advocates the construction of Canonical Data Models for mapping contents of multi-documents into a few general models that can represent the corpus. However, to construct Canonical Data Model for text, it involves non-trivial text mining techniques prior to the actual construction process. Furthermore, constructing Canonical Data Models for all terms in a set of documents will be costly and will not reduce the sparsity problem that are associated with text document processing. In order to solve this problem we propose a two tier dimensionality reduction step adopting commonly used feature extraction and feature selection methods. The reduced features are then used to construct a Canonical Data Model. A Canonical Data Model for text documents can be used as a general model that has potential to act as a reference model for text comparison in a wide variety of text mining tasks such as text clustering, text classification, text summarization and text deviation detection. Experimental result reveals that the proposed approach produces better results compared to methods without Canonical Data Model.
Siti Sakira Kamaruddin, Yuhanis Yusof, Farzana Kabir Ahmad and Mohammed Ahmed Taiye, 2017. Canonical Data Model for Text Document Clustering. Journal of Engineering and Applied Sciences, 12: 5554-5559.