Know your neighbors: web spam detection using the web topology.
SIGIR, page 423-430. ACM, (2007)Abstract
Web spam can significantly deteriorate the quality of search
engine results. Thus there is a large incentive for commercial
search engines to detect spam pages efficiently and accurately.
In this paper we present a spam detection system
that uses the topology of the Web graph by exploiting the
link dependencies among the Web pages, and the content
of the pages themselves. We find that linked hosts tend to
belong to the same class: either both are spam or both are
non-spam. We demonstrate three methods of incorporating
the Web graph topology into the predictions obtained by
our base classifier: (i) clustering the host graph, and assigning
the label of all hosts in the cluster by majority vote, (ii)
propagating the predicted labels to neighboring hosts, and
(iii) using the predicted labels of neighboring hosts as new
features and retraining the classifier. The result is an accurate
system for detecting Web spam that can be applied in
practice to large-scale Web data.
Categories and Subject Descriptors: H.4.m Information
Systems Applications: Miscellaneous
General Terms: Algorithms, Measurement.
Keywords: Link spam, Content spam, Web spam
