The IRMA Community
Newsletters
Research IRM
Click a keyword to search titles using our InfoSci-OnDemand powered search:
|
The User-Language Paraphrase Corpus
Abstract
The corpus in this challenge comprises 1998 target-sentence/student response text-pairs, or protocols. The protocols have been evaluated by extensively trained human raters; however, unlike established paraphrase corpora that evaluate paraphrases as either true or false, the User-Language Paraphrase Corpus evaluates protocols along 10 dimensions of paraphrase characteristics on a six point scale. Along with the protocols, the database comprising the challenge includes 10 computational indices that have been used to assess these protocols. The challenge posed for researchers is to describe and assess their own approach (computational or statistical) to evaluating, characterizing, and/or categorizing, any, some, or all of the paraphrase dimensions in this corpus. The purpose of establishing such evaluations of user-language paraphrases is so that ITSs may provide users with accurate assessment and subsequently facilitative feedback, such that the assessment would be comparable to one or more trained human raters. Thus, these evaluations will help to develop the field of natural language assessment and understanding (Rus, McCarthy, McNamara, & Graesser, 2008 [a]).
Related Content
|
Reinaldo Padilha França, Ana Carolina Borges Monteiro, Rangel Arthur, Yuzo Iano.
© 2021.
21 pages.
|
|
Abdul Kader Saiod, Darelle van Greunen.
© 2021.
28 pages.
|
|
Aswini R., Padmapriya N..
© 2021.
22 pages.
|
|
Zubeida Khan, C. Maria Keet.
© 2021.
21 pages.
|
|
Neha Gupta, Rashmi Agrawal.
© 2021.
20 pages.
|
|
Kamalendu Pal.
© 2021.
14 pages.
|
|
Joy Nkechinyere Olawuyi, Bernard Ijesunor Akhigbe, Babajide Samuel Afolabi, Attoh Okine.
© 2021.
19 pages.
|
|
|