Social bookmarking systems and their emergent information structures, known as folksonomies, are increasingly important data sources for Semantic Web applications. A key question for harvesting semantics from these systems is how to extend and adapt traditional notions of similarity to folksonomies, and which measures are best suited for applications such as navigation support, semantic search, and ontology learning. Here we build an evaluation framework to compare various general folksonomy-based similarity measures derived from established information-theoretic, statistical, and practical measures. Our framework deals generally and symmetrically with users, tags, and resources. For evaluation purposes we focus on similarity among tags and resources, considering different ways to aggregate annotations across users. After comparing how tag similarity measures predict user-created tag relations, we provide an external grounding by user-validated semantic proxies based on WordNet and the Open Directory. We also investigate the issue of scalability. We find that mutual information with distributional micro-aggregation across users yields the highest accuracy, but is not scalable; per-user projection with collaborative aggregation provides the best scalable approach via incremental computations. The results are consistent across resource and tag similarity.
M. Stubbemann, T. Hanika, and G. Stumme. Advances in Intelligent Data Analysis XVIII - 18th International Symposium on Intelligent Data Analysis, IDA 2020, Konstanz, Germany, April 27-29, 2020, Proceedings, volume 12080 of Lecture Notes in Computer Science, page 496--508. Springer, (2020)
M. Stubbemann, and G. Stumme. Machine Learning and Knowledge Discovery in Databases: Research Track - European Conference, ECML PKDD 2023, Turin, Italy, September 18-22, 2023, Proceedings, Part III, volume 14171 of Lecture Notes in Computer Science, page 177--192. Springer, (2023)
M. Kibanov, M. Atzmueller, C. Scholz, and G. Stumme. Proceedings of the 2013 IEEE Cyber, Physical and Social Computing, CPSCom 2013, Beijing, China, 20-23 August, 2013, page 993--1000. Los Alamitos, CA, USA, IEEE Computer Society, (2013)
J. Mueller, and G. Stumme. 9th International ACM Web Science Conference 2017 (WebSci 2017), Troy, NY, USA, June 26-28, 2017. Accepted for Publication, New York, NY, USA, ACM, (June 2017)
J. Mueller, and G. Stumme. 5th ASE International Conference on Social Informatics (SocInfo 2016), Union, NJ, USA, August 15-17, 2016. Proceedings, page 47:1--47:8. New York, NY, USA, ACM, (August 2016)
M. Atzmueller, A. Schmidt, B. Kloepper, and D. Arnu. New Frontiers in Mining Complex Patterns. Postproceedings NFMCP 2016, volume 10312 of LNAI, Berlin/Heidelberg, Germany, Springer Verlag, (2017)