Electronic Resource
Boston, USA and Oxford, UK
:
Blackwell Publishers Inc
Computational intelligence
15 (1999), S. 0
ISSN:
1467-8640
Source:
Blackwell Publishing Journal Backfiles 1879-2005
Topics:
Computer Science
Notes:
A dialogue plays an important role in learning how to solve a problem and form a concept. We are developing a problem solving and knowledge acquisition system based on co-reference between drill texts and dialogue with a teacher, focusing on first-grade mathematics. This paper presents a method of cooperative understanding of utterances and gestures within dialogue. We first describe our system design principles, which provide the basis for the integration of multimodal information during a dialogue. We define a principle of complementarity, explain its implementation, and describe the architecture of the problem solving system. We then show how to integrate our algorithms for utterance and gesture analysis within that software architecture. A feature-based approach is used for gesture recognition, derived from a sequence of images arising during the cooperative analysis of utterances. We conclude with an evaluation of the system against the design principles.
Type of Medium:
Electronic Resource
URL:
http://dx.doi.org/10.1111/0824-7935.00089
|
Location |
Call Number |
Expected |
Availability |
