@aho

Seeing the Big Picture from Microblogs: Harnessing Social Signals for Visual Event Summarization

, and . Proceedings of the 20th International Conference on Intelligent User Interfaces, page 62--66. New York, NY, USA, ACM, (2015)
DOI: 10.1145/2678025.2701385

Abstract

We propose an approach to automatically select a set of representative images to generate a concise visual summary of a real-world event from the Tumblr microblogging platform. Central to our approach is a unified graph model with heterogeneous nodes and edges to capture the interrelationship among various entities (e.g., users, posts, images, and tags) in online social media. With the graph representation, we then cast the summarization problem as a graph-based ranking problem by identifying the most representative images regarding to an event. The intuition behind our work is that not only can we crowdsource social media users as sensors to capture and share data, but we can also use them as filters to identify the most useful information through analyzing their interaction in the microblogging network. In addition, we propose a greedy algorithm to encourage diversity among top ranked results for the generation of temporal highlights of targeted events. Our approach is flexible to support different query tasks and is adaptable to additional graph entities and relationships.

Links and resources

Tags

community