We propose a novel attention network for document annotation with user-generated tags. The network is designed according to the human reading and annotation behaviour. Usually, users try to digest the title and obtain a rough idea about the topic first, and then read the content of the document. Present research shows that the title metadata could largely affect the social annotation. To better utilise this information, we design a framework that separates the title from the content of a document and apply a title-guided attention mechanism over each sentence in the content. We also propose two semanticbased loss regularisers that enforce the output of the network to conform to label semantics, i.e. similarity and subsumption. We analyse each part of the proposed system with two real-world open datasets on publication and question annotation. The integrated approach, Joint Multi-label Attention Network (JMAN), significantly outperformed the Bidirectional Gated Recurrent Unit (Bi-GRU) by around 13%-26% and the Hierarchical Attention Network (HAN) by around 4%-12% on both datasets, with around 10%-30% reduction of training time.
H. Dong, W. Wang, K. Huang, and F. Coenen. Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers), page 1348--1354. Minneapolis, Minnesota, Association for Computational Linguistics, (June 2019)
Y. Chen, H. Dong, and W. Wang. Proceedings of the 2018 International Conference on Data Science and Information Technology, page 138--143. New York, NY, USA, ACM, (2018)
A. Hotho, R. Jäschke, C. Schmitz, and G. Stumme. Proceedings of the 3rd European Semantic Web Conference, volume 4011 of LNCS, page 411-426. Budva, Montenegro, Springer, (June 2006)
J. Mueller, S. Doerfel, M. Becker, A. Hotho, and G. Stumme. Proceedings of the Fifth ACM RecSys Workshop on Recommender Systems and the Social Web co-located with the 7th ACM Conference on Recommender Systems (RecSys 2013) Hong Kong, China, October 13, 2013., 1066, CEUR-WS, (2013)
T. Niebler, M. Becker, D. Zoller, S. Doerfel, and A. Hotho. Proceedings of the 25th ACM International on Conference on Information and Knowledge Management, New York, NY, USA, ACM, (2016)forthcoming.
R. Jäschke, L. Marinho, A. Hotho, L. Schmidt-Thieme, and G. Stumme. Workshop Proceedings of Lernen - Wissensentdeckung - Adaptivität (LWA 2007), page 13-20. Martin-Luther-Universität Halle-Wittenberg, (September 2007)
R. Jäschke, B. Krause, A. Hotho, and G. Stumme. Proceedings of the Second International Conference on Weblogs and Social Media (ICWSM 2008), page 192--193. Menlo Park, CA, USA, AAAI Press, (2008)
C. Cattuto, D. Benz, A. Hotho, and G. Stumme. Proceedings of the 7th International Conference on The Semantic Web, 5318, page 615--631. Springer-Verlag, (2008)
S. Doerfel, D. Zoller, P. Singer, T. Niebler, A. Hotho, and M. Strohmaier. 23rd International World Wide Web Conference, WWW '14, Seoul, Republic of Korea, April 7-11, 2014, Companion Volume, page 251--252. New York, NY, USA, ACM, (2014)
A. Hotho, R. Jäschke, C. Schmitz, and G. Stumme. Informatik 2006 - Informatik für Menschen, volume 94 of Lecture Notes in Informatics, page 305--312. Bonn, Gesellschaft für Informatik, (October 2006)
R. Jäschke, A. Hotho, C. Schmitz, and G. Stumme. Proc. 18. Workshop Grundlagen von Datenbanken, page 80-84. Halle-Wittenberg, Martin-Luther-Universität, (June 2006)
A. Hotho, R. Jäschke, C. Schmitz, and G. Stumme. Proceedings of the 3rd European Semantic Web Conference, volume 4011 of LNCS, page 411-426. Budva, Montenegro, Springer, (June 2006)
R. Jäschke, L. Marinho, A. Hotho, L. Schmidt-Thieme, and G. Stumme. Workshop Proceedings of Lernen - Wissensentdeckung - Adaptivität (LWA 2007), page 13-20. Martin-Luther-Universität Halle-Wittenberg, (September 2007)
R. Jäschke, B. Krause, A. Hotho, and G. Stumme. Proceedings of the Second International Conference on Weblogs and Social Media(ICWSM 2008), AAAI Press, (2008)
R. Jäschke, L. Marinho, A. Hotho, L. Schmidt-Thieme, and G. Stumme. Knowledge Discovery in Databases: PKDD 2007, 11th European Conference on Principles and Practice of Knowledge Discovery in Databases, Warsaw, Poland, September 17-21, 2007, Proceedings, volume 4702 of Lecture Notes in Computer Science, page 506-514. Springer, (2007)
A. Hotho, R. Jäschke, C. Schmitz, and G. Stumme. Proceedings of the Conceptual Structures Tool Interoperability Workshop at the 14th International Conference on Conceptual Structures, page 87-102. (2006)
J. Illig, A. Hotho, R. Jäschke, and G. Stumme. Knowledge Processing and Data Analysis, volume 6581 of Lecture Notes in Computer Science, page 136--149. Berlin/Heidelberg, Springer, (2011)
B. Krause, C. Schmitz, A. Hotho, and G. Stumme. AIRWeb '08: Proceedings of the 4th international workshop on Adversarial information retrieval on the web, page 61--68. New York, NY, USA, ACM, (2008)
B. Krause, R. Jäschke, A. Hotho, and G. Stumme. HT '08: Proceedings of the nineteenth ACM conference on Hypertext and hypermedia, page 157--166. New York, NY, USA, ACM, (2008)