Did Somebody Say 'Gest-IT'? A Pilot Exploration of Multimodal Data Management
| Authors | |
|---|---|
| Year of publication | 2024 |
| Type | Article in Proceedings |
| Conference | Proceedings of the Tenth Italian Conference on Computational Linguistics (CLiC-it 2024) |
| Citation | |
| Keywords | Blindness; Corpora; Gestuality; Multimodality; Universal Dependencies |
| Description | The paper presents a pilot exploration of the construction, management and analysis of a multimodal corpus. Through a three-layer annotation that provides orthographic, prosodic, and gestural transcriptions, the Gest-IT resource allows to investigate the variation of gesture-making patterns in conversations between sighted people and people with visual impairment. After discussing the transcription methods and technical procedures employed in our study, we propose a unified CoNLL-U corpus and indicate our future steps. |