Web spam pages use various techniques to achieve
higher-than-deserved rankings in a search engine’s
results. While human experts can identify
spam, it is too expensive to manually evaluate a
large number of pages. Instead, we propose techniques
to semi-automatically separate reputable,
good pages from spam. We first select a small set
of seed pages to be evaluated by an expert. Once
we manually identify the reputable seed pages, we
use the link structure of the web to discover other
pages that are likely to be good. In this paper
we discuss possible ways to implement the seed
selection and the discovery of good pages. We
present results of experiments run on the World
Wide Web indexed by AltaVista and evaluate the
performance of our techniques. Our results show
that we can effectively filter out spam from a significant
fraction of the web, based on a good seed
set of less than 200 sites.
G. Feng, T. Liu, Y. Wang, Y. Bao, Z. Ma, X. Zhang, and W. Ma. Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval - SIGIR \textquotesingle06, ACM Press, (2006)
A. Borisov, M. Wardenaar, I. Markov, and M. de Rijke. The 41st International ACM SIGIR Conference on Research &\#38; Development in Information Retrieval, page 45--54. New York, NY, USA, ACM, (2018)
D. Gomes, M. Costa, D. Cruz, J. Miranda, and S. Fontes. Proceedings of the 22Nd International Conference on World Wide Web, page 1059--1066. New York, NY, USA, ACM, (2013)
R. Jäschke, and S. Rudolph. Contributions to the 11th International Conference on Formal Concept Analysis, page 19--34. Technische Universität Dresden, (May 2013)
C. Krishnan, S. Rajakumari, and M. Mehraj. International Journal on Recent and Innovation Trends in Computing and Communication, 3 (4):
1750--1754(April 2015)
M. Bhosale, N. Jagdale, S. Gawali, and V. Dhotre. International Journal on Recent and Innovation Trends in Computing and Communication, 3 (3):
1609--1612(March 2015)
M. Ageev, Q. Guo, D. Lagun, and E. Agichtein. Proceedings of the 34th international ACM SIGIR conference on Research and development in Information Retrieval, page 345--354. New York, NY, USA, ACM, (2011)
R. Jäschke, and S. Rudolph. Contributions to the 11th International Conference on Formal Concept Analysis, page 19--34. Technische Universität Dresden, (May 2013)
M. Costa, D. Gomes, F. Couto, and M. Silva. Proceedings of the 22nd International Conference on World Wide Web Companion, page 1045--1050. Republic and Canton of Geneva, Switzerland, International World Wide Web Conferences Steering Committee, (2013)
D. Goyal, and M. Kalra. Proceedings of the International Conference on Signal Propagation and Computer Technology (ICSPCT), page 257--262. IEEE, (July 2014)
R. Baeza-Yates, C. Hurtado, and M. Mendoza. Current Trends in Database Technology - EDBT 2004 Workshops, volume 3268 of Lecture Notes in Computer Science, Springer Berlin Heidelberg, (2005)
M. Baldonado, and T. Winograd. Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems, page 11--18. New York, NY, USA, ACM, (1997)
H. Zeng, Q. He, Z. Chen, W. Ma, and J. Ma. Proceedings of the 27th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, page 210--217. New York, NY, USA, ACM, (2004)
R. Jäschke, and S. Rudolph. Contributions to the 11th International Conference on Formal Concept Analysis, page 19--34. Technische Universität Dresden, (May 2013)
O. Hoeber. Proceedings of the 2008 IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology - Volume 03, page 29--32. Washington, DC, USA, IEEE Computer Society, (2008)
A. Muralidharan, Z. Gyongyi, and E. Chi. Proceedings of the 2012 ACM annual conference on Human Factors in Computing Systems, page 1085--1094. New York, NY, USA, ACM, (2012)
R. Jäschke, and S. Rudolph. Contributions to the 11th International Conference on Formal Concept Analysis, page 19--34. Technische Universität Dresden, (May 2013)
D. Skoutas, M. Alrifai, and W. Nejdl. Proc. of 4th International Workshop on Personalized Access, Profile Management, and Context Awareness in Databases (PersDB), in conjunction with VLDB 2010., (2010)
T. Joachims. Proceedings of the eighth ACM SIGKDD international conference on Knowledge discovery and data mining, page 133--142. New York, NY, USA, ACM, (2002)
F. Shipman, III, C. Marshall, and M. LeMere. Proceedings of the tenth ACM Conference on Hypertext and hypermedia : returning to our diverse roots: returning to our diverse roots, page 121--130. New York, NY, USA, ACM, (1999)
D. Donato, F. Bonchi, T. Chi, and Y. Maarek. Proceedings of the 19th international conference on World wide web, page 321--330. New York, NY, USA, ACM, (2010)
B. Yu, and M. Singh. Cooperative Information Agents IV - The Future of Information Agents in Cyberspace, volume 1860 of Lecture Notes in Computer Science, Springer, Berlin/Heidelberg, (2000)
B. Yu, and M. Singh. Proceedings of the second international joint conference on Autonomous agents and multiagent systems, page 65--72. New York, NY, USA, ACM, (2003)
P. Jurczyk, and E. Agichtein. Proceedings of the sixteenth ACM conference on Conference on information and knowledge management, page 919--922. New York, NY, USA, ACM, (2007)
M. Morris. Proceedings of the twenty-sixth annual SIGCHI conference on Human factors in computing systems, page 1657--1660. New York, NY, USA, ACM, (2008)
K. McNally, M. O'Mahony, B. Smyth, M. Coyle, and P. Briggs. Proceedings of the 15th international conference on Intelligent user interfaces, page 179--188. New York, NY, USA, ACM, (2010)
B. Smyth, P. Briggs, M. Coyle, and M. O’Mahony. User Modeling, Adaptation, and Personalization, volume 5535 of Lecture Notes in Computer Science, Springer, Berlin/Heidelberg, (2009)
J. Pickens, G. Golovchinsky, C. Shah, P. Qvarfordt, and M. Back. Proceedings of the 31st annual international ACM SIGIR conference on Research and development in information retrieval, page 315--322. New York, NY, USA, ACM, (2008)
M. Morris, and E. Horvitz. Proceedings of the 20th annual ACM symposium on User interface software and technology, page 3--12. New York, NY, USA, ACM, (2007)