@flawed

Using “Annotator Rationales” to Improve Machine Learning for Text Categorization

, , and . Proceedings of NAACL HLT, (2007)

Abstract

We propose a new framework for supervised machine learning. Our goal is to learn from smaller amounts of supervised training data, by collecting a richer kind of training data: annotations with “rationales.” When annotating an example, the human teacher will also highlight evidence supporting this annotation—thereby teaching the machine learner why the example belongs to the category. We provide some rationale-annotated data and present a learning method that exploits the rationales during training to boost performance significantly on a sample task, namely sentiment classification of movie reviews. We hypothesize that in some situations, providing rationales is a more fruitful use of an annotator’s time than annotating more examples.

Description

user gets queried for significant (word) features

Links and resources

Tags

community

  • @flawed
  • @dblp
@flawed's tags highlighted