We propose a novel attention network for document annotation with user-generated tags. The network is designed according to the human reading and annotation behaviour. Usually, users try to digest the title and obtain a rough idea about the topic first, and then read the content of the document. Present research shows that the title metadata could largely affect the social annotation. To better utilise this information, we design a framework that separates the title from the content of a document and apply a title-guided attention mechanism over each sentence in the content. We also propose two semanticbased loss regularisers that enforce the output of the network to conform to label semantics, i.e. similarity and subsumption. We analyse each part of the proposed system with two real-world open datasets on publication and question annotation. The integrated approach, Joint Multi-label Attention Network (JMAN), significantly outperformed the Bidirectional Gated Recurrent Unit (Bi-GRU) by around 13%-26% and the Hierarchical Attention Network (HAN) by around 4%-12% on both datasets, with around 10%-30% reduction of training time.
C. Cattuto, D. Benz, A. Hotho, и G. Stumme. The Semantic Web - ISWC 2008, том 5318 из Lecture Notes in Computer Science, стр. 615--631. Springer Berlin / Heidelberg, (2008)
A. Hotho, R. Jäschke, C. Schmitz, и G. Stumme. Informatik 2006 - Informatik für Menschen. Band 2, том P-94 из Lecture Notes in Informatics, Bonn, Gesellschaft für Informatik, (октября 2006)Proc. Workshop on Applications of Semantic Technologies, Informatik 2006.
R. Jäschke, A. Hotho, C. Schmitz, и G. Stumme. Proceedings of the 15th International Conference on Conceptual Structures (ICCS 2007), том 4604 из Lecture Notes in Artificial Intelligence, стр. 283--295. Berlin, Heidelberg, Springer-Verlag, (июля 2007)
M. Grahl, A. Hotho, и G. Stumme. 7th International Conference on Knowledge Management (I-KNOW '07), стр. 356-364. Graz, Austria, Know-Center, (сентября 2007)
A. Hotho, R. Jäschke, C. Schmitz, и G. Stumme. Proc. First International Conference on Semantics And Digital Media Technology (SAMT), том 4306 из Lecture Notes in Computer Science, стр. 56-70. Springer, (2006)
A. Hotho, R. Jäschke, C. Schmitz, и G. Stumme. The Semantic Web: Research and Applications, том 4011 из Lecture Notes in Computer Science, стр. 411--426. Berlin/Heidelberg, Springer, (июня 2006)
J. Mueller, S. Doerfel, M. Becker, A. Hotho, и G. Stumme. Recommender Systems and the Social Web Workshop at 7th ACM Conference on Recommender Systems, RecSys 2013, Hong Kong, China -- October 12-16, 2013. Proceedings, стр. New York, NY, USA. ACM, (2013)accepted for publication.
A. Hotho, R. Jäschke, C. Schmitz, и G. Stumme. The Semantic Web: Research and Applications, том 4011 из Lecture Notes in Computer Science, стр. 411--426. Berlin/Heidelberg, Springer, (июня 2006)
R. Jäschke, B. Krause, A. Hotho, и G. Stumme. Proceedings of the Second International Conference on Weblogs and Social Media(ICWSM 2008), AAAI Press, (2008)
A. Hotho, R. Jäschke, C. Schmitz, и G. Stumme. Informatik 2006 - Informatik für Menschen, том 94 из Lecture Notes in Informatics, стр. 305--312. Bonn, Gesellschaft für Informatik, (октября 2006)
B. Krause, R. Jäschke, A. Hotho, и G. Stumme. HT '08: Proceedings of the Nineteenth ACM Conference on Hypertext and Hypermedia, стр. 157--166. New York, NY, USA, ACM, (2008)
A. Hotho, R. Jäschke, C. Schmitz, и G. Stumme. Proceedings of the Conceptual Structures Tool Interoperability Workshop at the 14th International Conference on Conceptual Structures, стр. 87-102. (2006)
B. Krause, R. Jäschke, A. Hotho, и G. Stumme. HT '08: Proceedings of the nineteenth ACM conference on Hypertext and hypermedia, стр. 157--166. New York, NY, USA, ACM, (2008)
A. Hotho, R. Jäschke, C. Schmitz, и G. Stumme. Proc. First International Conference on Semantics And Digital Media Technology (SAMT), том 4306 из Lecture Notes in Computer Science, стр. 56-70. Springer, (2006)
J. Mueller, S. Doerfel, M. Becker, A. Hotho, и G. Stumme. Recommender Systems and the Social Web Workshop at 7th ACM Conference on Recommender Systems, RecSys 2013, Hong Kong, China -- October 12-16, 2013. Proceedings, 1066, Aachen, Germany, CEUR-WS, (2013)
B. Krause, R. Jäschke, A. Hotho, и G. Stumme. HT '08: Proceedings of the nineteenth ACM conference on Hypertext and hypermedia, стр. 157--166. New York, NY, USA, ACM, (2008)
M. Grahl, A. Hotho, и G. Stumme. 7th International Conference on Knowledge Management (I-KNOW '07), стр. 356-364. Graz, Austria, Know-Center, (сентября 2007)
C. Schmitz, A. Hotho, R. Jäschke, и G. Stumme. Data Science and Classification (Proc. IFCS 2006 Conference), стр. 261-270. Ljubljana, Springer, (июля 2006)
A. Hotho, R. Jäschke, C. Schmitz, и G. Stumme. Proceedings of the First Conceptual Structures Tool Interoperability Workshop at the 14th International Conference on Conceptual Structures, стр. 87-102. Aalborg, Aalborg Universitetsforlag, (2006)
C. Schmitz, A. Hotho, R. Jäschke, и G. Stumme. Data Science and Classification. Proceedings of the 10th IFCS Conf., стр. 261--270. Heidelberg, Springer, (июля 2006)
V. Zacharias, и S. Braun. Workshop on Social and Collaborative Construction of Structured Knowledge (CKC), 16th International World Wide Web Conference (WWW 2007), (8-12 05 2007)
R. Jäschke, A. Hotho, C. Schmitz, и G. Stumme. Proceedings of the 15th International Conference on Conceptual Structures, Sheffield, England, (июля 2007)
B. Krause, R. Jäschke, A. Hotho, и G. Stumme. Proceedings of the nineteenth ACM conference on Hypertext and hypermedia (HT '08), стр. 157--166. New York, NY, USA, ACM, (2008)
R. Jäschke, B. Krause, A. Hotho, и G. Stumme. Proceedings of the Second International Conference on Weblogs and Social Media(ICWSM 2008), AAAI Press, (2008)