To help researchers investigate relation extraction, we’re releasing a human-judged dataset of two relations about public figures on Wikipedia: nearly 10,000 examples of “place of birth”, and over 40,000 examples of “attended or graduated from an institution”. Each of these was judged by at least 5 raters, and can be used to train or evaluate relation extraction systems. We also plan to release more relations of new types in the coming months.
Neil Ireson, Fabio Ciravegna, Marie Elaine Califf, Dayne Freitag, Nicholas Kushmerick, Alberto Lavelli: Evaluating Machine Learning for Information Extraction, 22nd International Conference on Machine Learning (ICML 2005), Bonn, Germany, 7-11 August, 2005
B. Powley, and R. Dale. Large Scale Semantic Access to Content (Text, Image, Video, and Sound), page 618--632. Paris, France, France, LE CENTRE DE HAUTES ETUDES INTERNATIONALES D'INFORMATIQUE DOCUMENTAIRE, (2007)
G. Sautter, and K. Böhm. Proceedings of the Second International Conference on Theory and Practice of Digital Libraries, page 370--382. Berlin/Heidelberg, Springer, (2012)
J. Strötgen, and M. Gertz. Proceedings of the 5th International Workshop on Semantic Evaluation, page 321--324. Stroudsburg, PA, USA, Association for Computational Linguistics, (2010)
O. Gunes, C. Schallhart, T. Furche, J. Lehmann, and A. Ngomo. Proceedings of the 3rd Workshop on the People's Web Meets NLP: Collaboratively Constructed Semantic Resources and their Applications to NLP, page 29--33. Association for Computational Linguistics, (July 2012)
J. Lafferty, A. McCallum, and F. Pereira. Proceedings of the Eighteenth International Conference on Machine Learning, page 282--289. San Francisco, CA, USA, Morgan Kaufmann Publishers Inc., (2001)
M. Granitzer, M. Hristakeva, R. Knight, K. Jack, and R. Kern. Proceedings of the 2nd International Conference on Web Intelligence, Mining and Semantics, page 19:1--19:8. New York, NY, USA, ACM, (2012)
Y. Li, A. Wen, Q. Lin, R. Li, and Z. Lu. Web-Age Information Management, volume 6897 of Lecture Notes in Computer Science, Springer, Berlin/Heidelberg, (2011)