Normalization in Context: Inter-Annotator Agreement for Meaning-Based Target Hypothesis AnnotationOctober 30th, 2018
FiledOctober 30th, 2018We explore the contribution of explicit task contexts in the annotation of word-level and sentence-level normalizations for learner lan- guage. We present the annotation schemes and tools used to annotate both word- and sentence-level target hypotheses given an ex- plicit task context for the Corpus of Reading Exercises in German (Ott et al., 2012) and dis- cuss a range of inter-annotator agreement mea- sures appropriate for evaluating target hypoth- esis and error annotation.