Web spam pages use various techniques to achieve
higher-than-deserved rankings in a search engine’s
results. While human experts can identify
spam, it is too expensive to manually evaluate a
large number of pages. Instead, we propose techniques
to semi-automatically separate reputable,
good pages from spam. We first select a small set
of seed pages to be evaluated by an expert. Once
we manually identify the reputable seed pages, we
use the link structure of the web to discover other
pages that are likely to be good. In this paper
we discuss possible ways to implement the seed
selection and the discovery of good pages. We
present results of experiments run on the World
Wide Web indexed by AltaVista and evaluate the
performance of our techniques. Our results show
that we can effectively filter out spam from a significant
fraction of the web, based on a good seed
set of less than 200 sites.
P. Singer, D. Helic, A. Hotho, and M. Strohmaier. Proceedings of the 24th International Conference on World Wide Web, page 1003--1013. Republic and Canton of Geneva, Switzerland, International World Wide Web Conferences Steering Committee, (2015)
J. Huang, Z. Zhuang, J. Li, and C. Giles. Proceedings of the 2008 International Conference on Web Search and Data Mining, page 107--116. New York, NY, USA, ACM, (2008)
G. Stumme. Proceedings of the International Conference on Database and Expert Systems Applications (DEXA), volume 2453 of LNCS, page 534-546. Springer, (2002)
M. Atzmueller, L. Thiele, G. Stumme, and S. Kauffeld. Proc. Annual Machine Learning Conference of the Benelux (Benelearn 2017), Eindhoven, The Netherlands, Eindhoven University of Technology, (2017)
M. Musolesi, and C. Mascolo. Proceedings of the 2nd international workshop on Multi-hop ad hoc networks: from theory to reality, page 31--38. ACM, (2006)