PAT Workbench: Annotation and evaluation of text and pictures in multimodal instructionsvan der Sluis, I., Kloppenburg, L. & Redeker, G., 11-Dec-2016, Proceedings of the Workshop on Language Technology Resources and Tools for Digital Humanities (LT4DH) at COLING2016. p. 131-139 9 p.
Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Academic › peer-review
relation(s) between them have not been researched in a systematic manner. We present the PAT Workbench, a tool to store, annotate and retrieve MIs based on a validated coding scheme with currently 42 categories that describe instructions in terms of textual features, pictorial elements, and relations between text and pictures. We describe how the PAT Workbench facilitates collaborative annotation and inter-annotator agreement calculation. Future work on the tool includes expanding its functionality and usability by (i) making the MI annotation scheme dynamic for adding relevant features based on empirical evaluations of the MIs, (ii) implementing algorithms for automatic tagging of MI features, and
(iii) implementing automatic MI evaluation algorithms based on results obtained via e.g. crowdsourced assessments of MIs.
|Title of host publication||Proceedings of the Workshop on Language Technology Resources and Tools for Digital Humanities (LT4DH) at COLING2016|
|Number of pages||9|
|Publication status||Published - 11-Dec-2016|
|Event||LT for DH: Language Technology Resources and Tools for Digital Humanities - Osaka, Osaka, Japan|
Duration: 11-Dec-2016 → 11-Dec-2016
|Workshop||LT for DH: Language Technology Resources and Tools for Digital Humanities|
|Period||11/12/2016 → 11/12/2016|
LT for DH: Language Technology Resources and Tools for Digital Humanities
11/12/2016 → 11/12/2016Osaka, Japan
- annotation multimodal evaluation instructions