Gestures are a powerful communication medium which has also been found to make human-machine communication more natural. The hands can be used to express shape flexibly and immediately in the spatial medium, gestures are an ideal modality for describing pictorial content. This publication investigates the principles according to which gesture and speech express shape-related content, and presents a computational approach towards the interpretation of such multimodal expressions. For that purpose a corpus of speech-gesture shape descriptions acquired from an empirical study is described and analyzed. The empirical results are used to inform a formal representation model for a unified description of shape conveyed via gesture and speech. Building on this, an implemented process model is described which can algorithmically interpret input from the two modalities and generate an internal representation of shape.IOS Press is an international science, technical and medical publisher of high-quality books for academics, scientists, and professionals in all fields.  Some of the areas we publish in: -Biomedicine -Oncology -Artificial intelligence -Databases and information systems -Maritime engineering -Nanotechnology -Geoengineering -All aspects of physics -E-governance -E-commerce -The knowledge economy -Urban studies -Arms control -Understanding and responding to terrorism -Medical informatics -Computer Sciences

Understanding Coverbal Ionic Gestures in Shape Descriptions (Dissertations in Artificial in)

Computers & Technology

T. Sowa

Computer Science

IOS Press

See the best price to sell, buy, or rent books by T. Sowa. BookScouter helps to compare book prices from 25+ online bookstores and 30+ buyback vendors with a single search.

Books by T. Sowa

See the best price to sell, buy, or rent books by T. Sowa. BookScouter helps to compare book prices from 25+ online bookstores and 30+ buyback vendors with a single search.

Understanding Coverbal Ionic Gestures in Shape Descriptions (Dissertations in Artificial in)