Show simple item record

Restructuring Sparse High Dimensional Data for Effective Retrieval

dc.date.accessioned2004-10-08T20:37:10Z
dc.date.accessioned2018-11-24T10:21:29Z
dc.date.available2004-10-08T20:37:10Z
dc.date.available2018-11-24T10:21:29Z
dc.date.issued1998-05-01en_US
dc.identifier.urihttp://hdl.handle.net/1721.1/6674
dc.identifier.urihttp://repository.aust.edu.ng/xmlui/handle/1721.1/6674
dc.description.abstractThe task in text retrieval is to find the subset of a collection of documents relevant to a user's information request, usually expressed as a set of words. Classically, documents and queries are represented as vectors of word counts. In its simplest form, relevance is defined to be the dot product between a document and a query vector--a measure of the number of common terms. A central difficulty in text retrieval is that the presence or absence of a word is not sufficient to determine relevance to a query. Linear dimensionality reduction has been proposed as a technique for extracting underlying structure from the document collection. In some domains (such as vision) dimensionality reduction reduces computational complexity. In text retrieval it is more often used to improve retrieval performance. We propose an alternative and novel technique that produces sparse representations constructed from sets of highly-related words. Documents and queries are represented by their distance to these sets. and relevance is measured by the number of common clusters. This technique significantly improves retrieval performance, is efficient to compute and shares properties with the optimal linear projection operator and the independent components of documents.en_US
dc.format.extent5435006 bytes
dc.format.extent502542 bytes
dc.language.isoen_US
dc.titleRestructuring Sparse High Dimensional Data for Effective Retrievalen_US


Files in this item

FilesSizeFormatView
AIM-1636.pdf502.5Kbapplication/pdfView/Open
AIM-1636.ps5.435Mbapplication/postscriptView/Open

This item appears in the following Collection(s)

Show simple item record