Welcome to the InfoSci Platform
Reference Hub4
The User-Language Paraphrase Corpus

The User-Language Paraphrase Corpus

Philip M. McCarthy, Danielle S. McNamara
Copyright: © 2012 |Pages: 17
ISBN13: 9781613504475|ISBN10: 1613504470|EISBN13: 9781613504482
DOI: 10.4018/978-1-61350-447-5.ch006
Cite Chapter Cite Chapter

MLA

McCarthy, Philip M., and Danielle S. McNamara. "The User-Language Paraphrase Corpus." Cross-Disciplinary Advances in Applied Natural Language Processing: Issues and Approaches, edited by Chutima Boonthum-Denecke, et al., IGI Global, 2012, pp. 73-89. https://doi.org/10.4018/978-1-61350-447-5.ch006

APA

McCarthy, P. M. & McNamara, D. S. (2012). The User-Language Paraphrase Corpus. In C. Boonthum-Denecke, P. McCarthy, & T. Lamkin (Eds.), Cross-Disciplinary Advances in Applied Natural Language Processing: Issues and Approaches (pp. 73-89). IGI Global. https://doi.org/10.4018/978-1-61350-447-5.ch006

Chicago

McCarthy, Philip M., and Danielle S. McNamara. "The User-Language Paraphrase Corpus." In Cross-Disciplinary Advances in Applied Natural Language Processing: Issues and Approaches, edited by Chutima Boonthum-Denecke, Philip M. McCarthy, and Travis Lamkin, 73-89. Hershey, PA: IGI Global, 2012. https://doi.org/10.4018/978-1-61350-447-5.ch006

Export Reference

Mendeley
Favorite

Abstract

The corpus in this challenge comprises 1998 target-sentence/student response text-pairs, or protocols. The protocols have been evaluated by extensively trained human raters; however, unlike established paraphrase corpora that evaluate paraphrases as either true or false, the User-Language Paraphrase Corpus evaluates protocols along 10 dimensions of paraphrase characteristics on a six point scale. Along with the protocols, the database comprising the challenge includes 10 computational indices that have been used to assess these protocols. The challenge posed for researchers is to describe and assess their own approach (computational or statistical) to evaluating, characterizing, and/or categorizing, any, some, or all of the paraphrase dimensions in this corpus. The purpose of establishing such evaluations of user-language paraphrases is so that ITSs may provide users with accurate assessment and subsequently facilitative feedback, such that the assessment would be comparable to one or more trained human raters. Thus, these evaluations will help to develop the field of natural language assessment and understanding (Rus, McCarthy, McNamara, & Graesser, 2008 [a]).

Request Access

You do not own this content. Please login to recommend this title to your institution's librarian or purchase it from the IGI Global bookstore.