Multimodal Dialog Systems


Multimodal Dialog Systems


[BOOK] SmartKom: Foundations of Multimodal Dialogue Systems (Cognitive Technologies) W Wahlster – 2006 – dl.acm.org Hugo Pinto, Yorick Wilks, Roberta Catizone, Alexiei Dingli, The senior companion  multiagent dialogue system, Proceedings of the 7th international joint conference on  Autonomous agents and multiagent systems, May 12-16, 2008, Estoril, Portugal Cited by 110 – Related articles – Library Search – All 4 versions

Method and system for interpreting verbal inputs in multimodal dialog system CC Ma, HM Bliss… – US Patent 7,584,099, 2009 – Google Patents (57) ABSTRACT A method, a system and a computer program product for interpreting a  verbal input in a multimodal dialog system are provided. The method includes assigning  (302) a confidence value to at least one word generated by a verbal recognition … Related articles – All 3 versions

[PDF] A 3d gesture recognition system for multimodal dialog systems [PDF] from liu.seR Neßelrath… – … Reasoning in Practical Dialogue Systems, 2009 – ida.liu.se Abstract We present a framework for integrating dynamic gestures as a new input modality  into arbitrary applications. The framework allows training new gestures and recognizing  them as user input with the help of machine learning algorithms. The precision of the … Cited by 6 – Related articles – View as HTML – All 6 versions

[PDF] Releasing a multimodal dialogue system into the wild: User support mechanisms [PDF] from mit.eduA Gruenstein… – … on Discourse and Dialogue, 2007 – groups.csail.mit.edu Abstract We present City Browser, a web-based platform which provides multimodal access  to urban information. We concentrate on aspects of the system that make it compelling for  sustained interaction, yet accessible to new users. First, we discuss the architecture’s … Cited by 21 – Related articles – View as HTML – All 11 versions

Reliable Evaluation of Multimodal Dialogue Systems F Metze, I Wechsung, S Schaffer… – … Interaction Methods and …, 2009 – Springer Usability evaluation is an indispensable issue during the development of new interfaces and  interaction paradigms [1]. Although a wide range of reliable usability evaluation methods  exists for graphical user interfaces, mature methods are rarely available for speech-based … Cited by 6 – Related articles – All 3 versions

A multimodal dialogue system for an ambient intelligent application in home environments N Ábalos, G Espejo, R López-Cózar… – … , Speech and Dialogue, 2011 – Springer This paper presents a multimodal dialogue system called Mayordomo which aims at easing  the interaction with home appliances using speech and a graphical interface within an  Ambient Intelligence environment. We present the methods employed for implementing … Cited by 4 – Related articles – All 3 versions

Natural and intuitive multimodal dialogue for in-car applications: The SAMMIE system [PDF] from 184.182.233.192T Becker, N Blaylock, C Gerstenberger… – Proceeding of the 2006 …, 2006 – dl.acm.org Abstract We present SAMMIE, a laboratory demonstrator of an in-car showcase of a  multimodal dialogue system developed in the TALK project TALK (Talk and Look: Tools for  Ambient Linguistic Knowledge) www. talk-project. org is funded by the EU as project No. … Cited by 16 – Related articles – BL Direct – All 9 versions

… of the 4th IEEE tutorial and research workshop on Perception and Interactive Technologies for Speech-Based Systems: Perception in Multimodal Dialogue Systems E André, L Dybkjær, W Minker, H Neumann… – 2008 – dl.acm.org … Proceedings of the 4th IEEE tutorial and research workshop on Perception and Interactive Technologies for Speech-Based Systems: Perception in Multimodal Dialogue Systems. …  All 2 versions

A Multimodal Dialogue System for Playing the Game Guess the card [PDF] from sepln.orgI Meza, E Pérez, L Salinas, H Avilés… – … de Lenguaje Natural, 2010 – journal.sepln.org Resumen In this paper a dialogue system with spoken Spanish and computer vision that  plays the game Guess the card with members of the general public in a permanent stand of  the science museum Anonymous at the Anonymous is presented. The conceptual and … Cited by 4 – Related articles – All 8 versions

[CITATION] Quality aspects of multimodal dialog systems: identity, stimulation and success C Kühnel, B Weiss, M Schulz… – 2011 Related articles

Measuring stress and cognitive load effects on the perceived quality of a multimodal dialogue system [PDF] from utwente.nlAI Niculescu, E van Dijk, Y Cao… – 2010 – eprints.eemcs.utwente.nl Abstract In this paper we present the results of a pilot study investigating the impact of stress  and cognitive load on the perceived interaction quality of a multimodal dialogue system for  crisis management. Four test subjects interacted with the system in four differently … Cited by 1 – Related articles – All 7 versions

[CITATION] Perception in Multimodal Dialogue Systems: Proceedings Institute of Electrical and Electronics Engineers – 2008 – Springer Library Search

Information Seeking Spoken Dialogue Systems-Part II: Multimodal Dialogue [PDF] from uwindsor.caA Potamianos, E Fosler-Lussier… – Multimedia, IEEE …, 2007 – ieeexplore.ieee.org Abstract For pt. 1see ibid., vol. 9, p. 3 (2007). In this paper, the task and user interface  modules of a multimodal dialogue system development platform are presented. The main  goal of this work is to provide a simple, application-independent solution to the problem of … Cited by 11 – Related articles – All 6 versions

Towards adapting fantasy, curiosity and challenge in multimodal dialogue systems for preschoolers [PDF] from tuc.grT Kannetis… – … international conference on Multimodal …, 2009 – dl.acm.org Abstract We investigate how fantasy, curiosity and challenge contribute to the user  experience in multimodal dialogue computer games for preschool children. For this purpose,  an on-line multimodal platform has been designed, implemented and used as a starting … Cited by 5 – Related articles – All 2 versions

[PDF] Adding a Speech Cursor to a Multimodal Dialogue System [PDF] from gu.seS Larsson, A Berman… – 2011 – ling.gu.se Abstract This paper describes Dico II+, an in-vehicle dialogue system demonstrating a novel  combination of flexible multimodal menu-based dialogue and a “speech cursor” which  enables menu navigation as well as browsing long list using haptic input and spoken … Cited by 1 – Related articles – All 3 versions

A mobile multimodal dialogue system for public transportation navigation evaluated T Hurtig – Proceedings of the 8th conference on Human- …, 2006 – dl.acm.org Abstract As the technical capabilities of latest mobile devices are combined with mobile  broadband internet access, we are ready to make use of free and natural speech in mobile  services by utilizing optional and complementary means of input. In these kinds of … Cited by 16 – Related articles – All 2 versions

Automatic evaluation tool for multimodal dialogue systems H Wesseling, M Bezold… – … in Multimodal Dialogue Systems, 2008 – Springer This paper presents a system built for improving the evaluation process of multimodal  dialogue systems by providing a graphical representation of event-based recording data.  Low-level information from recordings can visually be combined to form higher-level … Cited by 4 – Related articles – BL Direct – All 3 versions

A platform for output dialogic strategies in natural multimodal dialogue systems [PDF] from psu.eduM Horchani, L Nigay… – Proceedings of the 12th international …, 2007 – dl.acm.org Abstract The development of natural multimodal dialogue systems remains a very difficult  task. The flexibility and naturalness they offer result in an increased complexity that current  software tools do not address appropriately. One challenging issue we address here is the … Cited by 9 – Related articles – All 7 versions

Incremental speech understanding in a multimodal web-based spoken dialogue system [PDF] from mit.eduJR Glass, S Seneff – 2009 – dspace.mit.edu In most spoken dialogue systems, the human speaker interacting with the system must wait  until after finishing speaking to find out whether his or her speech has been accurately  understood. The verbal and nonverbal indicators of understanding typical in human-to- … Cited by 2 – Related articles – All 4 versions

[BOOK] … in Multimodal Dialogue Systems: 4th IEEE Tutorial and Research Workshop on Perception and Interactive Technologies for Speech-Based Systems, PIT … E André – 2008 – books.google.com This book constitutes the refereed proceedings of the 4th IEEE Tutorial and Research  Workshop on Perception and Interactive Technologies for Speech-Based Systems, PIT  2008, held in Kloster Irsee, Germany, in June 2008. The 37 revised full papers presented … Library Search – All 2 versions

Knowledge and data flow architecture for reference processing in multimodal dialog systems [PDF] from online.frA Choumane… – … 10th international conference on Multimodal …, 2008 – dl.acm.org Abstract This paper is concerned with the part of the system dedicated to the processing of  the user’s designation activities for multimodal search of information. We highlight the  necessity of using specific knowledge for multimodal input processing. We propose and … Cited by 3 – Related articles – All 2 versions

Context-sensitive language modeling for large sets of proper nouns in multimodal dialogue systems [PDF] from mit.eduA Gruenstein… – Spoken Language Technology …, 2006 – ieeexplore.ieee.org Abstract We explore several language modeling strategies for increasing the recognition  accuracy among large sets of proper nouns in a map-based multimodal dialogue system  which provides restaurant information. In particular, we evaluate several mechanisms for … Cited by 13 – Related articles – All 14 versions

Fantasy, curiosity and challenge as adaptation indicators in multimodal dialogue systems for preschoolers [PDF] from tuc.grT Kannetis, A Potamianos… – Proceedings of the 2nd …, 2009 – dl.acm.org Abstract In this paper, we investigate how fantasy, curiosity and challenge contribute to the  user experience in multimodal dialogue computer games for preschool children. For this  purpose, an on-line multimodal platform has been designed, implemented and used as a … Cited by 2 – Related articles – All 2 versions

RavenCalendar: A multimodal dialog system for managing a personal calendar [PDF] from upenn.eduS Stenchikova, B Mucha, S Hoffman… – Proceedings of Human …, 2007 – dl.acm.org Abstract Dialog applications for managing calendars have been developed for every  generation of dialog systems research (Heidorn, 1978; Yankelovich, 1994; Constantinides  and others, 1998; Horvitz and Paek, 2000; Vo and Wood, 1996; Huang and others, 2001). … Cited by 4 – Related articles – All 25 versions

LOGOS: A Multimodal Dialogue System for Controlling Smart Appliances [PDF] from upatras.grT Kostoulas, I Mporas, T Ganchev… – New Directions in …, 2008 – Springer The present work details a multimodal dialogue system, which offers user-friendly access to  information, entertainment devices and white good appliances. We focus on the speech  interface and the spoken dialogue management, with extensive description of the system’s … Cited by 1 – Related articles – All 2 versions

[CITATION] … Multimodal Dialog Systems and Applications-Modeling the Expressivity of Input Text Semantics for Chinese Text-to-Speech Synthesis in a Spoken Dialog … Z Wu, HM Meng, H Yang… – IEEE transactions on audio, speech, and language …, 2009

Visual perception, language and gesture: A model for their understanding in multimodal dialogue systems [PDF] from archives-ouvertes.frF Landragin – Signal Processing, 2006 – Elsevier The way we see the objects around us determines speech and gestures we use to refer to  them. The gestures we produce structure our visual perception. The words we use have an  influence on the way we see. In this manner, visual perception, language and gesture … Cited by 14 – Related articles – All 10 versions

[HTML] User concepts for in-car speech dialogue systems and their integration into a multimodal human-machine interface [HTML] from nbn-resolving.deS Mann – 2010 – nbn-resolving.de Kurzfassung auf Englisch: In the automotive environment an increasing number of assisting  systems as well as luxury features has found its way into vehicles over the past years: radio,  CD, MP3, DVD, on-board address book, organisers, mobile phones, PDAs, destination … Related articles – Cached – All 4 versions

Method and system for assisting users in interacting with multi-modal dialog systems WK Thompson, HS Lee… – US Patent 7,548,859, 2009 – Google Patents A method and system for assisting a user in interacting with a multi-modal dialog system  (104) is provided. The method includes interpreting a “What Can I Do?(WCID)” question  from a user in a turn of the dialog. A multi-modal grammar (212) is generated, based on … Related articles – All 3 versions

Multimodal dialog description language for rapid system development [PDF] from upenn.eduM Araki… – … SIGdial Workshop on Discourse and Dialogue, 2009 – dl.acm.org Abstract In this paper, we explain a rapid development method of multimodal dialogue sys- tem using MIML (Multimodal Interaction Markup Language), which defines dialogue patterns  between human and various types of interactive agents. The feature of this language is … Cited by 8 – Related articles – All 18 versions

A multi-modal spoken dialog system for interactive TV [PDF] from demokritos.grR Balchandran, ME Epstein… – … on Multimodal …, 2008 – dl.acm.org Abstract In this demonstration we present a novel prototype system that implements a multi- modal interface for control of the television. This system combines the standard TV remote  control with a dialog management based natural language speech interface to allow users … Cited by 5 – Related articles – All 4 versions

Improving Speech Recognition Using Semantic and Reference Features in a Multimodal Dialog System [PDF] from postech.ac.krK Kim, M Jeong… – … , 2007. RO-MAN 2007. The 16th …, 2007 – ieeexplore.ieee.org Abstract Current Speech-based dialog system undergo a practical problem; a speech  recognizer is defective due to inevitable errors. Even in multimodal dialog systems, which  have multiple input channels, errors in the speech recognition are a major problem … Cited by 4 – Related articles – All 8 versions

A mobile multimodal dialogue system for location based services [PDF] from dit.ieN Schutte, J Kelleher… – 2009 – arrow.dit.ie Abstract This paper describes ongoing work on the dialogue management components for  LOK8, a multimodal dialogue system. We describe our plans for a basic architecture of the  system, the rough modules and outline the kinds of models in the project, as well as the … Cited by 1 – Related articles – All 3 versions

R-Flow: An Extensible XML Based Multimodal Dialog System Architecture L Li, Q Li, W Chou… – … MMSP 2007. IEEE 9th Workshop on, 2007 – ieeexplore.ieee.org Abstract This paper presents an approach for an extensible multimodal interaction dialogue  system, R-Flow, based on a recursive application of Model-View-C’ontroller (MVC) design  patterns to derive system components and interfaces. This approach leads to a clear … Cited by 3 – Related articles – All 3 versions

[CITATION] A multimodal dialogue system for interacting with large audio databases in the car S Mann, A Berton… – Elektronische Sprachsignalverarbeitung Studientexte …, 2007 Cited by 3 – Related articles

Incorporation of external knowledge in multimodal dialog systems M Helbing… – US Patent 7,668,716, 2010 – Google Patents A device improves speech recognition accuracy by utilizing an external knowledge source.  The device receives a speech recognition result from an automatic speech recognition  (ASR) engine, the speech recognition result including a plurality of ordered interpretations … Related articles – All 3 versions

Context-sensitive interface widgets for multi-modal dialog systems S Bangalore… – US Patent 7,890,324, 2011 – Google Patents A system and method of presenting widgets to a user during a multi-modal interactive dialog  between a user and a computer is presented. The system controls the multi-modal dialog;  and when user input would help to clarify or speed up the presentation of requested … Related articles – All 3 versions

Dialogue systems go multimodal: The SmartKom experience W Wahlster – … : foundations of multimodal dialogue systems, 2006 – Springer Multimodal dialogue systems exploit one of the major characteristics of humanhuman  interaction: the coordinated use of different modalities. Allowing all of the modalities to refer  to and depend upon each other is a key to the richness of multimodal communication. We … Cited by 12 – Related articles – All 3 versions

Midos: multimodal interactive dialogue system AD Adler… – 2009 – dl.acm.org Abstract Interactions between people are typically conversational, multimodal, and  symmetric. In conversational interactions, information flows in both directions. In multimodal  interactions, people use multiple channels. In symmetric interactions, both participants … Cited by 3 – Library Search

SYSTEM AND METHOD OF HANDLING PROBLEMATIC INPUT DURING CONTEXT-SENSITIVE HELP FOR MULTI-MODAL DIALOG SYSTEMS P Ehlen, H Hastie… – US Patent App. 12/267,183, 2008 – Google Patents A method of presenting a multi-modal help dialog move to a user in a multi-modal dialog  system is disclosed. The method comprises presenting an audio portion of the multi-modal  help dialog move that explains available ways of user inquiry and presenting a …

[CITATION] Spoken and Multimodal Dialog Systems and Applications-Interrelation Between Speech and Facial Gestures in Emotional Utterances: A Single Subject … C Busso… – IEEE Transactions on …, 2007 – Piscataway, NJ: IEEE, 2006-

The SmartKom architecture: A framework for multimodal dialogue systems [PDF] from dfki.deG Herzog… – … : Foundations of Multimodal Dialogue Systems, 2006 – Springer SmartKom provides an adaptive and reusable dialogue shell for multimodal interaction that  has been employed successfully to realize fully-fledged prototype systems for various  application scenarios. Taking the perspective of system architects, we review the overall … Cited by 7 – Related articles – All 6 versions

IDesign Principles for Multimodal Spoken Dialogue Systems A Potamianos… – Multimodal Processing and Interaction, 2008 – Springer Speech input can be combined with different modalities on a variety of devices. The most  common combination of spoken input is with keypad input on fixed and mobile phones, with  keyboard and mouse input on computer desktops, and with pen input on personal digital …

Very-High-Fidelity Prototyping for Both Presentation and Dialogue Parts of Multimodal Interactive Systems R Bastide, P Dragicevic, D Navarre… – IFIP Lecture Notes in …, 2011 – dl.ifip.org Abstract This paper presents a tool suite (made up of two previously unrelated approaches)  for the engineering of multimodal Post-WIMP Interactive Systems. The first element of this  integration is ICOM (a data-flow model dedicated to low-level input modelling) and its … Cached

[HTML] Dico: A Multimodal Menu-based In-vehicle Dialogue System [HTML] from google.comJ Villing… – Brandial, 2006 – books.google.com Dico: A Multimodal Menu-based In-vehicle Dialogue System Jessica Villing Department of Linguistics  Goteborg University Sweden jessica@ ling. gu. se Staffan Larsson Department of Linguistics  Goteborg University Sweden sl@ ling. gu. se Abstract 2 GoDiS and TrindiKit We present a …  Cited by 11 – Related articles – All 9 versions

[PDF] Multimodal dialog system using hidden information state dialog manager [PDF] from postech.ac.krK Kim… – … ninth international conference on multimodal …, 2007 – isoft.postech.ac.kr ABSTRACT This demo presents a multimodal dialog system that uses Hidden Information  State (HIS) approach to manage the human-machine multimodal interaction. HIS dialog  manager is a variation of classic Partially Observable Markov Decision Process (POMDP), … Cited by 2 – Related articles – View as HTML – All 5 versions

Assessment of speech dialog systems using multi-modal cognitive load analysis and driving performance metrics [PDF] from qut.edu.auT Kleinschmidt, P Boyraz, H Brril… – … and Safety (ICVES) …, 2009 – ieeexplore.ieee.org Abstract In this paper, cognitive load analysis via acoustic-and CAN-Bus-based driver  performance metrics is employed to assess two different commercial speech dialog systems  (SDS) during in-vehicle use. Several metrics are proposed to measure increases in stress, … Cited by 2 – Related articles – All 10 versions

[PDF] Natural multimodal dialogue systems: a configurable dialogue and presentation strategies component [PDF] from francetelecom.frM Horchani, B Caron, L Nigay… – … on Multimodal …, 2007 – perso.rd.francetelecom.fr ABSTRACT In the context of natural multimodal dialogue systems, we address the  challenging issue of the definition of cooperative answers in an appropriate multimodal form.  Highlighting the intertwined relation of multimodal outputs with the content, we focus on … Cited by 2 – Related articles – View as HTML – All 3 versions

Multi-modal dialogue system with sign language capabilities M Hrúz, P Campr, Z Krnoul, M Železný… – The proceedings of the …, 2011 – dl.acm.org Abstract This paper presents the design of a multimodal sign-language-enabled dialogue  system. Its functionality was tested on a prototype of an information kiosk for the deaf people  providing information about train connections. We use an automatic computer-vision- … Related articles

[PDF] The dico project: A multimodal menu-based in-vehicle dialogue system [PDF] from gu.seS Larsson… – Proceedings of the 7th International Workshop on …, 2007 – ling.gu.se Dico is a multimodal in-car dialogue system application1. An obvious advantage of spoken  dialogue in the vehicle environment is thath the driver does not have to take the eyes-and  the attention-off the road. DICO (with capital letters) is also a recently started research … Cited by 5 – Related articles – View as HTML – All 6 versions

MIDOS: Multimodal Interactive DialOgue System [PDF] from mit.eduR Davis, AD Adler – 2009 – dspace.mit.edu Interactions between people are typically conversational, multimodal, and symmetric. In  conversational interactions, information flows in both directions. In multimodal interactions,  people use multiple channels. In symmetric interactions, both participants communicate … Related articles – All 2 versions

Multimodal meaning representation for generic dialogue systems architectures [PDF] from arxiv.orgF Landragin, A Denis, A Ricci… – Arxiv preprint cs/0703091, 2007 – arxiv.org Abstract: An unified language for the communicative acts between agents is essential for the  design of multi-agents architectures. Whatever the type of interaction (linguistic, multimodal,  including particular aspects such as force feedback), whatever the type of application ( … Cited by 6 – Related articles – All 23 versions

SYSTEM AND METHOD FOR PROVIDING DIALOG MANAGEMENT AND ARBITRATION IN A MULTI-MODAL ENVIRONMENT DM Coffman, RA HOSN, J Kleindienst… – EP Patent …, 2010 – freepatentsonline.com 1. A method for managing dialog of one or more applications, comprising the steps of:  instantiating a dialog manager and arbitrator DNA interface comprising a hierarchical tree  structure comprising a root DMA (30) and one or more application DMAs (33, 34); sending … Related articles – Cached

Text generation in the smartweb multimodal dialogue system R Engel… – KI 2007: Advances in Artificial Intelligence, 2007 – Springer This paper presents the text generation module of SmartWeb, a multimodal dialogue system.  The generation module bases on NipsGen which combines SPIN, originally a parser  developed for spoken language, and a tree-adjoining grammar framework for German. … Related articles – BL Direct – All 3 versions

[CITATION] Incremental Concept Understanding in a Multimodal Web-Based Spoken Dialogue System G Matthias – Master’s thesis, Massachusets Institute of Technology, 2008 Cited by 2 – Related articles

Multimodal fusion: a new hybrid strategy for dialogue systems [PDF] from us.esPM Portillo, GP García… – … Conference on Multimodal …, 2006 – dl.acm.org Abstract This is a new hybrid fusion strategy based primarily on the implementation of two  former and differentiated approaches to multimodal fusion [11] in multimodal dialogue  systems. Both approaches, their predecessors and their respective advantages and … Cited by 10 – Related articles – All 24 versions

Evaluation of facial direction estimation from cameras for multi-modal spoken dialog system A Kobayashi, K Kayama, E Mizukami… – … Dialogue Systems for …, 2010 – Springer This paper presents the results of an evaluation of image-processing techniques for  estimating facial direction from a camera for a multi-modal spoken dialog system on a large  display panel. The system is called the “proactive dialog system” and aims to present … Related articles – All 3 versions

SD-TEAM: Interactive Learning, Self-Evaluation and Multimodal Technologies for Multidomain Spoken Dialog Systems [PDF] from upm.esMI Torres, E Lleida, R Córdoba Herralde… – 2009 – oa.upm.es Resumen Speech technology currently supports the development of dialogue systems that  function in limited domains for which they were trained and in conditions for which they were  designed, that is, speci?c acoustic conditions, speakers etc. The international scienti?c … All 7 versions

Evaluation of multimodal dialogue systems F Schiel – … : Foundations of Multimodal Dialogue Systems, 2006 – Springer In this chapter we will give a brief overview about what different methods of evaluation were  applied to the SmartKom prototypes and which of them resulted in utilizable results and why  others did not. Since there are no established benchmarking methods yet for multimodal … Cited by 6 – Related articles

SYSTEM AND METHOD OF HANDLING PROBLEMATIC INPUT DURING CONTEXT-SENSITIVE HELP FOR MULTI-MODAL DIALOG SYSTEMS P Ehlen, H Hastie… – US Patent App. 20,090/ …, 2008 – freepatentsonline.com This application is a continuation of US patent application Ser. No. 11/619,325, filed Jan. 3,  2007, which is a continuation of US patent application Ser. No. 10/326,629, filed Dec. 19,  2002, now US Pat. No. 7,177,816, which claims priority to US Provisional Application No. … Cached

Blending speech and visual input in multimodal dialogue systems [PDF] from tuc.grM Perakakis, M Toutoudakis… – … Workshop, 2006. IEEE, 2006 – ieeexplore.ieee.org Abstract In this paper the efficiency and usage patterns of input modes in multimodal  dialogue systems is investigated for desktop and personal digital assistant (PDA) working  environments. For this purpose a form-filling travel reservation system is designed and … Cited by 4 – Related articles – All 5 versions

[CITATION] A Platform for Output Dialogic Strategies in Natural Multimodal Dialogue Systems F Panaget – 2007 Related articles

[CITATION] SmartKom: Foundations of Multimodal Dialogue Systems (Cognitive Technologies). pringer-Verlag New York W Wahlster – Inc., Secaucus, NJ, USA, 2006 Cited by 2 – Related articles

MIMUS: a multimodal and multilingual dialogue system for the home domain [PDF] from upenn.eduJG Amores, G Pérez… – … of the 45th Annual Meeting of the …, 2007 – dl.acm.org Abstract This paper describes MIMUS, a multimodal and multilingual dialogue system for the  in–home scenario, which allows users to control some home devices by voice and/or clicks.  Its design relies on Wizard of Oz experiments and is targeted at disabled users. MIMUS … Cited by 4 – Related articles – BL Direct – All 38 versions

[CITATION] Incremental Speech Understanding in a Multimodal Web-based Spoken Dialogue System M Matthias Gary… – 2009 – Massachusetts Institute of … Library Search

[PDF] Design of multimodal dialogue-based systems [PDF] from epfl.chM Melichar – 2008 – biblion.epfl.ch Human-computer interfaces have come a long way from the early days of punched cards  and manual switches. At that time, people working with computers were skilled machine  operators (experts) rather than ordinary end-users. This has gradually changed with the … Cited by 3 – Related articles – Library Search – All 9 versions

Dynamic Aspects of Character Rendering in the Context of Multimodal Dialog Systems YA Jung – 2011 – tuprints.ulb.tu-darmstadt.de Kurzfassung Virtual characters offer a great potential as intuitive man-machine interface,  because they allow simulating non-verbal communicative behavior as well, which requires  the coordinated use of various modalities (eg, speech and gesture). In this sense, … Cached – All 4 versions

System and method of handling problematic input during context-sensitive help for multi-modal dialog systems P Ehlen, H Hastie… – US Patent 7,177,816, 2007 – Google Patents (57) ABSTRACT A method of presenting a multi-modal help dialog move to a user in a multi- modal dialog system is disclosed. The method comprises presenting an audio portion of the  multimodal help dialog move that explains available ways of user inquiry and presenting a … Cited by 2 – Related articles – All 4 versions

[CITATION] Spoken and Multimodal Dialog Systems and Applications-Constrained Minimization and Discriminative Training for Natural Language Call Routing I Zitouni – IEEE transactions on audio, speech, and language …, 2008

Design of a multimodal input interface for a dialogue system [PDF] from inesc-id.ptJ Neto, R Cassaca, M Viveiros… – Computational Processing of …, 2006 – Springer In this paper we described our initial work on the development of an embodied  conversational agent platform. In the present stage our main focus it is on the development  of a multimodal input interface to the system. In this paper we will present an Input and … Cited by 9 – Related articles – BL Direct – All 4 versions

The SAMMIE system: multimodal in-car dialogue [PDF] from upenn.eduT Becker, P Poller, J Schehl, N Blaylock… – Proceedings of the …, 2006 – dl.acm.org Abstract The SAMMIE system is an in-car multi-modal dialogue system for an MP3  application. It is used as a testing environment for our research in natural, intuitive mixed- initiative interaction, with particular emphasis on multimodal output planning and … Cited by 10 – Related articles – All 21 versions

[PDF] A multimodal dialogue interface for flexible tutoring systems [PDF] from psu.eduV Pallotta, G Coray… – 2007 – Citeseer Abstract This paper presents an environment for the design and implementation of an  Intelligent Tutoring System based on a multimodal dialogue interface and user modelling.  The system exploits existing web-based on-line courses and superimposes a rhetorical … Related articles – View as HTML – All 5 versions

[CITATION] SmartKom: Foundations of Multimodal Dialogue Systems R Engel… – 2006 – Springer, Berlin, Germany Cited by 2 – Related articles

[PDF] Speed Up Strategies for the Creation of Multimodal and Multilingual Dialogue Systems [PDF] from upm.esLF D’Haro… – 2009 – www-gth.die.upm.es Abstract In this paper we will summarize the work done in the PhD thesis that follows the  same title as this document. In the thesis we propose different innovative, dynamic, and  intelligent acceleration strategies applied to a development platform for reducing the … Cited by 2 – Related articles – View as HTML – All 7 versions

VoiceXML dialog system of the multimodal IP-Telephony-The application for voice ordering service [PDF] from psu.eduMJ Tsai – Expert Systems with Applications, 2006 – Elsevier The development of IP-Telephony in recent years has been substantial. The improvement in  voice quality, the integration between voice and data, especially the interaction with  multimedia has made the 3G communication more promising. The value added services … Cited by 7 – Related articles – All 6 versions

[CITATION] The SmartKom: Foundations of Multimodal Dialogue Systems G Herzog… – Springer, Heidelberg, 2006 Cited by 3 – Related articles

[CITATION] Multimodal fusion: A new hybrid strategy for dialogue systems P Manchón, G Pérez… – … of International Congress of Multimodal Interfaces …, 2006 Cited by 7 – Related articles

System and method of context-sensitive help for multi-modal dialog systems P Ehlen, H Hastie, M Johnston – US Patent 7,177,815, 2007 – Google Patents A method of presenting a multi-modal help dialog move to a user in a multi-modal dialog  system is disclosed. The method comprises presenting an audio portion of the multi-modal  help dialog move that explains available ways of user inquiry and presenting a … Cited by 1 – Related articles – All 3 versions

System and method of handling problematic input during context-sensitive help for multi-modal dialog systems P Ehlen, H Hastie… – US Patent 7,451,088, 2008 – Google Patents A method of presenting a multi-modal help dialog move to a user in a multi-modal dialog  system is disclosed. The method comprises presenting an audio portion of the multi-modal  help dialog move that explains available ways of user inquiry and presenting a … Related articles – All 2 versions

An Agent-Based Dialog System for Adaptive and Multimodal Interface: A Case Study N Taghezout – Advanced Materials Research, 2011 – Trans Tech Publ Abstract Graphical Interfaces using an agent-based dialog can handle errors and  interruptions, and dynamically adapts to the current context and situation, the needs of the  task performed, and the user model. This is especially true for the design of multimodal … Related articles

Context-Aware Dialog Strategies for Multimodal Mobile Dialog Systems J Ko, F Murase, T Mitamura, E Nyberg, M Tateishi… – Journal on AAAI, 2006 – aaai.org Abstract Multimodal mobile dialog systems face new challenges which do not exist in  traditional spoken dialog systems. A mobile dialog system should provide robust task  management during network loss, and intelligent assistance in new environments. To … Cited by 3 – Related articles – All 2 versions

[PDF] DS-UCAT: A new multimodal dialogue system for an academic application [PDF] from helsinki.fiR López-Cózar, Z Callejas… – Proc. of Interspeech, 2006 – ling.helsinki.fi Abstract This paper presents our latest research efforts in the field of multimodal dialogue  systems, concerned with setting up a system to assist professors and students in several of  their daily activities within an academic centre (eg a University’s Faculty). A distinct feature … Cited by 1 – Related articles – View as HTML

Building Multimodal Dialogue Applications: System Integration in SmartKom [PDF] from psu.eduG Herzog… – … : Foundations of Multimodal Dialogue Systems, 2006 – Springer We report on the experience gained in building large-scale research prototypes of fully  integrated multimodal dialogue systems in the context of the SmartKom project. The  development of such systems requires a flexible software architecture and adequate … Cited by 2 – Related articles – All 4 versions

[PDF] EVALUATION OF A MULTIMODAL SYSTEM BASED ON DIALOGUE MODELS AND TRANSFORMATIONS [PDF] from psu.eduR Schaefer… – 2007 – Citeseer ABSTRACT To provide user interfaces for a rich set of devices and interaction modalities, we  follow a model-based development methodology and devised an architecture which deploys  user interfaces specified as dialogue models with abstract interaction objects and allows … Related articles – View as HTML – All 8 versions

[PDF] Language Technology II: Language-Based Interaction Multimodal Dialogue Systems [PDF] from uni-saarland.deI Kruijff-Korbayová – 2006 – coli.uni-saarland.de Compare-A: Among the selected restaurants, the following offer exceptional overall value.  Uguale’s price is 33$. It has excellent food quality and good decor. Da Andrea’s price is 28$.  It has very good food quality an good decor. John’s Pizzeria’s price is 20$. It has very good … Related articles – View as HTML

MMSDS: Ubiquitous Computing and WWW-Based Multi-modal Sentential Dialog System JH Kim… – Embedded and Ubiquitous Computing, 2006 – Springer In this study, we suggest and implement Multi-Modal Sentential Dialog System (MMSDS)  integrating 2 sensory channels with speech and haptic information based on ubiquitous  computing and WWW for clear communication. The importance and necessity of MMSDS … Cited by 3 – Related articles – BL Direct – All 2 versions

[CITATION] Human-Centred Design OfAn Assistive Ubiquitous Multimodal Dialogue System C Nugent… – Smart Homes And Beyond: Icost 2006, 4th …, 2006 – IOS Press Related articles

New Multimodal Dialogue System For An Academic Intelligent Environment [PDF] from uam.esR López-Cózar, Z Callejas… – Smart homes and beyond: …, 2006 – books.google.com Abstract. This paper presents a new multimodal dialogue system that we are developing to  assist professors and students in some of their daily activities within an academic centre (eg  a University’s Faculty). The centre is called” intelligent environment” because it features … Related articles – All 6 versions

Setting Up a Multimodal Dialogue System for Ubiquitous Environmen R López-Cózar, Z Callejas, M Gea… – HCI related papers of …, 2006 – Springer ABSTRACT This paper presents our current activities in the development of a system to  assist students and teachers in their activities in educational environments. The system  combines features of two different technologies: multimodal dialogue systems and … Related articles – All 2 versions

[CITATION] … and Conversational Dialogue-Flexible Multi-modal Interaction Technologies and User Interface Specially Designed for Chinese Car Infotainment System C Yang, N Chen, P Zhang… – Lecture Notes in …, 2007 – Berlin: Springer-Verlag, 1973-

[CITATION] Multimodal Fusion: A New Hybrid Strategy for Dialogue Systems PMPGP Garcia… – … International Conference on Multimodal …, 2006 – ACM Related articles

[CITATION] … . Her research interests and activities have been related to speech technologies and include dialogue systems, multimodal systems, and ambient intel- … N Ábalos – Conversational Agents and Natural …, 2011 – Information Science Reference

[PDF] Multi-modal dialogue systems for industrial applications [PDF] from liu.seA Jönsson – 2008 – photon.isy.liu.se • Vi har, tillsammans med IBM Almaden i USA, utvecklat världens första helt  ögonrörelsestyrda dialogsystem. Systemet utvärderades och resultaten visar att det fungerar  och att användarna är positiva till systemet [36, 42, 39]. Systemet utvecklades baserat pa … Related articles – View as HTML – All 3 versions

System and method for dynamically adapting performance of interactive dialog system basd on multi-modal confirmation S Bangalore, M Johnston… – EP Patent 1,705,554, 2006 – freepatentsonline.com A method of using user feedback to adapt performance in a multi-modal dialog system is  disclosed. The method comprises presenting the user with a single or multiple options for  confirmation of received user input, receiving and storing a user selection of one of the … Cached

METHOD AND SYSTEM FOR CONTROLLING INPUT MODALTIES IN A MULTIMODAL DIALOG SYSTEM AK GUPTA… – WO Patent WO/2006/076,304, 2006 – wipo.int Abstract: A method and a system for controlling a set of input modalities in a multimodal  dialog system are provided. The method includes selecting (302) a sub-set of input  modalities that a user can use to provide user inputs during a user turn. The method … Cached – All 2 versions

METHOD AND SYSTEM FOR GENERATING INPUT GRAMMARS FOR MULTI-MODAL DIALOG SYSTEMS HS LEE… – WO Patent WO/2006/062,620, 2006 – wipo.int Abstract: A method for operating a multi-modal dialog system (104) is provided. The multi- modal dialog system (104) comprises a plurality of modality recognizers (202), a dialog  manager (206), and a grammar generator (208). The method interprets a current context … Cached – All 2 versions

[CITATION] Advanced Spoken Language Dialogue Systems for Database Queries with Multimodal Output in Mobile Situations H Hemsen – 2006 – afhandling. Library Search

Incorporation of external knowledge in multimodal dialog systems M Helbing… – US Patent App. 20,070/038,445, 2006 – freepatentsonline.com 1. A method of improving speech recognition, comprising: receiving a speech recognition  result from an automatic speech recognition (ASR) engine, the speech recognition result  including a plurality of ordered interpretations, wherein each of the ordered interpretations … Cached

[CITATION] Probabilistic Planning with Multimodal: Human-robot Dialog Systems R Kästner – 2006 – Ilmenau Library Search

A multimodal dialogue system for playing the game “Guess the card” [PDF] from ua.esIV Meza Ruiz, E Pérez Pavón, L Salinas Pinacho… – 2010 – rua.ua.es Abstract: En este artículo se presenta un sistema conversacional en español hablado y con  visión computacional que juega el juego de “adivina la carta” con el público en una cabina  de la exhibición permanente del museo de las ciencias Universum de la Universidad …

… in Multimodal Dialogue Systems (Paperback): 4th IEEE Tutorial and Research Workshop on Perception and Interactive Technologies for Speech-Based Systems, PIT … E ANDRé – 2008 – lavoisier.fr This book constitutes the refereed proceedings of the 4th IEEE Tutorial and Research  Workshop on Perception and Interactive Technologies for Speech-Based Systems, PIT  2008, held in Kloster Irsee, Germany, in June 2008. The 37 revised full papers presented … Cached – All 2 versions