2024-03-29T06:30:36Z
https://pub.uni-bielefeld.de/oai
oai:pub.uni-bielefeld.de:2955643
2023-06-28T13:24:57Z
journal_article
doc-type:article
Modelling gesture as speech: A linguistic approach
Gibbon, Dafydd ; https://orcid.org/0000-0002-9825-5516
Gibbon D. Modelling gesture as speech: A linguistic approach. <em>Poznań Studies in Contemporary Linguistics</em>. 2011;47(3):470–508.
Gesture communication, like prosody and paralinguistic voice features, strikes the atten-tion when there is too little of it, too much of it, or when it does not seem to fit the words or the situation. The present study follows the principle that gesture is similar to some aspects of speech, particularly prosody and parts of the lexicon. Description of visual gesture articulation is therefore treated as a conservative extension of descriptions of vo-cal speech gesture articulation. Well-tried models of speech forms and functions are de-ployed, together with accounts from gesture studies from psychology to robotics. Evi-dence is taken from video data of story-telling in Ega, an African language, and in Ger-man, and the adequacy of descriptive and computational models of the forms and func-tions of speech is discussed, with a proposal for the formal modelling of speech-like tim-ing of gesture articulators by means of Time Types in the Linear-Feature-Timing-Realtime (LFTR) model. Finally, an integrative model for combining visual and vocal gesture articulations into a comprehensive functional model of multimodal communica-tion is proposed: the Rank Interpretation Model (RIM).
Walter de Gruyter GmbH
2011
http://purl.org/coar/resource_type/c_6501
info:eu-repo/semantics/article
doc-type:article
text
https://pub.uni-bielefeld.de/record/2955643
eng
info:eu-repo/semantics/altIdentifier/doi/10.2478/psicl-2011-0026
info:eu-repo/semantics/altIdentifier/issn/0137-2459
info:eu-repo/semantics/altIdentifier/issn/1897-7499
info:eu-repo/semantics/altIdentifier/wos/000298277000003
info:eu-repo/semantics/closedAccess