Zusammenfassung
Similarity search in text has proven to be an interesting problem
from the qualitative perspective because of inherent redundancies
and ambiguities in textual descriptions. The methods used in search
engines in order to retrieve documents most similar to user-defined
sets of keywords are not applicable to targets which are medium
to large size documents, because of even greater noise effects stemming
from the presence of a large number of words unrelated to the overall
topic in the document. The inverted representation is the dominant
method for indexing text, but it is not as suitable for document-to-document
similarity search, as for short user-queries. One way of improving
the quality of similarity search is Latent Semantic Indexing (LSI),
which maps the documents from the original set of words to a concept
space. Unfortunately, LSI maps the data into a domain in which it
is not possible to provide effective indexing techniques. In this
paper, we investigate new ways of providing conceptual search among
documents by creating a representation in terms of conceptual word-chains.
This technique also allows effective indexing techniques so that
similarity queries can be performed on large collections of documents
by accessing a small amount of data. We demonstrate that our scheme
outperforms standard textual similarity search on the inverted representation
both in terms of quality and search efficiency.
Nutzer