The result of four years of intensive research in a large multimodal dialogue project involving 12 partners from academia and industry, SmartKom is one of the most advanced multimodal dialogue systems worldwide and is a landmark project in the history of intelligent user interfaces. The system provides symmetric multimodality in a mixed-initiative dialogue system with an embodied conversational agent. The same software architecture and components are used in three fully operational application scenarios. The theoretical and practical foundations of SmartKom represent a new generation of multimodal dialogue systems that deal not only with simple modality integration and synchronization, but cover the full spectrum of multimodal dialogue. With contributions by leading scientists in the field, this book gives the first comprehensive overview of the results of this seminal project.This chapter presents SPIN, a newly developed template-based semantic parser used for the task of natural language ... approach is a powerful template language to provide easy creation and maintenance of the templates and flexible processing. ... representation is already on a high semanticapragmatic level and encodes direct instructions for the action planner. ... or([road map], [car map], [ vehicle map]) roadMap() $S=word(semCat:SIGHT) sight(location(locationName:$ S)) [or(theanbsp;...
|Title||:||SmartKom: Foundations of Multimodal Dialogue Systems|
|Publisher||:||Springer Science & Business Media - 2006-09-05|