@dbenz

Pairwise document similarity in large collections with MapReduce

, , и . Proceedings of the 46th Annual Meeting of the Association for Computational Linguistics on Human Language Technologies: Short Papers, стр. 265--268. Stroudsburg, PA, USA, Association for Computational Linguistics, (2008)

Аннотация

This paper presents a MapReduce algorithm for computing pairwise document similarity in large document collections. MapReduce is an attractive framework because it allows us to decompose the inner products involved in computing document similarity into separate multiplication and summation stages in a way that is well matched to efficient disk access patterns across several machines. On a collection consisting of approximately 900,000 newswire articles, our algorithm exhibits linear growth in running time and space in terms of the number of documents.

Описание

Pairwise document similarity in large collections with MapReduce

Линки и ресурсы

тэги

сообщество

  • @thoni
  • @dblp
  • @dbenz
@dbenz- тэги данного пользователя выделены