Notes:
DFKI SmartKom is a research project focused on developing a multimodal dialogue system for natural human-machine communication. The project is being carried out by the German Research Center for Artificial Intelligence (DFKI), one of the world’s leading research institutions in the field of artificial intelligence. The goal of the SmartKom project is to create a system that can communicate with humans using multiple modalities, such as text, voice, images, and video, in a way that is natural, intuitive, and engaging. The system is designed to understand and interpret the meaning of human language and respond appropriately, using a variety of methods such as text-to-speech synthesis, image generation, and video generation. The project has resulted in the development of several multimodal dialogue systems and applications, including a virtual assistant for customer service, a language translation system, and a multimodal chatbot.
Resources:
- smartkom.org .. foundations of multimodal dialogue systems
Wikipedia:
References:
- SmartKom: Foundations of Multimodal Dialogue Systems (2006)
See also:
Smartweb: Mobile applications of the semantic web
W Wahlster – Annual Conference on Artificial Intelligence, 2004 – Springer
… or program his navigation system to find a souvenir shop). SmartWeb is the follow-up project to SmartKom (www.smartkom.org), carried out from 1999 to 2003. SmartKom is a multimodal dialog system that combines speech …
SmartKom: adaptive and flexible multimodal access to multiple applications
N Reithinger, J Alexandersson, T Becker… – Proceedings of the 5th …, 2003 – dl.acm.org
… system reduces errors in the communication. With SmartKom (www.smartkom.org) we look into the combination of multiple modalities for input and output to reach these goals [21]. SmartKom features the situated understanding …
Smartkom: Symmetric multimodality in an adaptive and reusable dialogue shell
W Wahlster – … of the human computer interaction status …, 2003 – pdfs.semanticscholar.org
… interface. Our SmartKom system (www.smartkom.org) is designed to support a wide range of collaborative and multimodal help dialogues, that allow users to intuitively and efficiently access the functionalities needed for their task …
Dialogue systems go multimodal: The SmartKom experience
W Wahlster – SmartKom: foundations of multimodal dialogue …, 2006 – Springer
… Our SMARTKOM system (http://www.smartkom.org) is designed to support a wide range of collaborative and multimodal help dialogues that allow users to intuitively and efficiently access the functionalities needed for their task …
An integration framework for a mobile multimodal dialogue system accessing the semantic web
N Reithinger, D Sonntag – Ninth European Conference on Speech …, 2005 – isca-speech.org
… Verbmobil 6 [9], Smartkom 7 6 http://verbmobil.dfki.de 7 http://www.smartkom.org [10], Miamm 8 [11], and Comic 9 [12], and for various integra- tion platforms. All these components are written in Java. Another requirement of our …
Scoring functions for overlay and their application in discourse processing
N Pfleger, J Alexandersson, T Becker – 2002 – dfki.de
… Fi- nally, a conclusion and current work is outlined in section 5. 2 The SmartKom Project SmartKom is a multi-modal dialog system cur- rently being developed by several academic and in- dustrial partners (see www.smartkom.org) …
SNOW-A multimodal approach for mobile maintenance applications
R Burmeister, C Pohl, S Bublitz… – … , 2006. WETICE’06. 15th …, 2006 – ieeexplore.ieee.org
… Siemens, Sony, Sympalog. SmartKom: Dialog-based Human-Technology Interaction by Coordinated Analysis and Generation of Multiple Modalities, 2004. http:// www.smartkom.org. [6] R. Gemello, F. Mana, and RD Mori. A modified …
Situated multimodal interaction in SmartKom
N Reithinger, G Herzog, A Ndiaye – Computers & Graphics, 2003 – Elsevier
… speaks in this context of full symmetric multimodality. With SmartKom (www.smartkom. org) we look into the combination of multiple modalities for input and output to reach these goals [3,4]. This paper presents the basic ideas of …
Design patterns for context-aware adaptation
G Rossi, S Gordillo, F Lyardet – Applications and the Internet …, 2005 – ieeexplore.ieee.org
… [12 ] D. Salber, A. Dey, G. Abowd, “The Context Toolkit: Aiding the Development of Context-Enabled Applications” Proceedings of ACM CHI 1999, pp 434-441. [13 ] SmartKom Project, http://www.smartkom.org/ [14] UWA Project. www.uwaproject.org …
Prosody generation in the SmartKom project
A Schweitzer, N Braunschweiler… – Speech Prosody 2002 …, 2002 – isca-speech.org
… Workshop on Speech Synthesis. Perthshire, Scotland. [5] Schweitzer, A., 1999. Intonationsbestimmung auf der Ba- sis von Wortklassen. Master thesis, University of Stuttgart. [6] The Smartkom Project, http://www.smartkom.org.
Situated delegation-oriented multimodal presentation in SmartKom
J Müller, P Poller, V Tschernomas – Workshop Intelligent Situation-Aware …, 2002 – aaai.org
… SmartKom (www.smartkom.org) is a multimodal dialog system that supports the situated understanding of pos- sibly imprecise, ambiguous, or partial multimodal input and the generation of coordinated, cohesive, and coherent multimodal presentations (Wahlster, Reithinger, & …
An interface for annotating natural interactivity
NO Bernsen, L Dybkjær, M Kolodnytsky – Current and New Directions in …, 2003 – Springer
… interaction. SmartKom uses tools developed elsewhere: in Verbmobil for audio annotation, Anvil for mimics and gesture coding. See www.smartkom.org Tool: SyncWriter. NIMM aspects addressed: Speech and gesture. Brief …
Practical, template–based natural language generation with tag
T Becker – Proceedings of the Sixth International Workshop on …, 2002 – aclweb.org
… Finally we present the current work, including some tools that are under development. 2. The SmartKom Project SMARTKOM is a multi-modal, dialogue system currently being developed at several academic and industrial partners (see www.smartkom.org) …
Data, annotation schemes and coding tools for natural interactivity
L Dybkjær, NO Bernsen – Seventh International Conference on …, 2002 – isca-speech.org
… SmartKom uses tools developed elsewhere: in Verbmobil for audio annotation, Anvil for mimics and gesture coding. See www.smartkom.org 11. SyncWriter is a commercial tool for transcription and annotation of synchronous “events” such as speech and video data …
An exemplary interaction with SmartKom
N Reithinger, G Herzog – SmartKom: Foundations of Multimodal Dialogue …, 2006 – Springer
… The SMARTKOM Web site, located at http://www.smartkom.org, provides a comprehensive video that complements the description of the integrated SMARTKOM prototype given here. Page 2. 42 Norbert Reithinger and Gerd Herzog 2 From Dialogue Drafts to Dialogue Protocols …
Magical Mirror: multimedia, interactive services in home automation
L Ceccaroni, X Verdaguer – AVI 2004, 2004 – academia.edu
Page 18. 10 Magical Mirror: multimedia, interactive services in home automation Luigi Ceccaroni and Xavier Verdaguer : tmtfactory> Edificio Forum de la TecnologÍa, c. Marie Curie s/n, 08042 Barcelona luigi@ tmtfactory. com, xavier@ tmtfactory. com Abstract …
Distributed audio-visual speech synchronization
P Poller, J Müller – Seventh International Conference on Spoken …, 2002 – isca-speech.org
… SmartKom (www.smartkom.org) is a multimodal dialog system that supports the situated understanding of possibly imprecise, am- biguous, or partial multimodal input and the generation of coordi- nated, cohesive, and coherent multimodal presentations based on the situated …
The Dynamic, Multi-lingual Lexicon in SmartKom
S Goronzy, Z Valsan, M Emele… – … Conference on Speech …, 2003 – isca-speech.org
… 7. References [1] “http://www.smartkom.org.” [2] W. Wahlster, N. Reithinger, and A. Blocher, “SmartKom: Multimodal Communication with a Life-like Character,” in 7th European Conference on Speech Communication and Technology, vol …
Towards context-adaptive utterance interpretation
R Porzel, I Gurevych – Proceedings of the 3rd SIGdial workshop on …, 2002 – dl.acm.org
… We, then, show how nat- ural language analysis can employ models that iFor example within the DA PACommunicator (www.darpa.mil/ito/research/com/index.html) or the S martKom (www.smartkom.org)researchframeworks …
Hucomtech multimodal corpus annotation
K Pápay, S Szeghalmy, I Szekrényes – Argumentum, 2011 – argumentum.unideb.hu
Page 1. Kinga Pápay, Szilvia Szeghalmy & István Szekrényes: HuComTech Multimodal Corpus Annotation Argumentum 7 (2011), 330-347 Debreceni Egyetemi Kiadó 330 Working paper Kinga Pápay, Szilvia Szeghalmy & István Szekrényes …
An innovative framework to support multimodal interaction with Smart Environments
F Gabbanini, L Burzagli, PL Emiliani – Expert Systems with Applications, 2012 – Elsevier
Skip to main content …
A state model for the realization of visual perceptive feedback in Smartkom
P Poller, N Reithinger – Eighth International Conference on Spoken …, 2004 – isca-speech.org
… next utterance. If we transfer this behaviour to human-computer interaction, systems should constantly 1http://www.smartkom.org provide adequate and adaptive feedback about the sys- tem’s internal processing state. In this …
Steps towards multi-modal data services in GPRS and in UMTS or WLAN networks
G Niklfeld, M Pucher, R Finan… – ISCA Tutorial and …, 2002 – isca-speech.org
… SMADA: Speech driven multi-modal automatic directory assis- tance. http://smada.research.kpn. com. Smartkom Consortium (2002). SmartKom. http://www.smartkom.org. Speechworks (2002). Company web-site. http://www.speechworks.com. SPEECON Consortium (2002) …
Robust multimodal discourse processing
N Pfleger, R Engel… – … of the 7th Workshop on the …, 2003 – researchgate.net
… Though the present status has been heavily coloured by the SMARTKOM project (www.smartkom.org), parts of the backbone are and have been used in several mono- as well as multimodal dialogue systems including monomodal and multimodal as well as typed and …
Reducing the Effect of Room Acoustics on
D Gelbart – in Applied Voice Input/Output Society Conference …, 2002 – Citeseer
CiteSeerX – Document Details (Isaac Councill, Lee Giles, Pradeep Teregowda): Hands-free use of speech recognition (ie, not requiring a microphone worn or held by the user) introduces the technical challenges of room acoustics and background noise. In this paper, I will start by …
Trends, challenges and opportunities in spoken dialogue research
M McTear – Spoken dialogue systems technology and design, 2011 – Springer
Page 1. Chapter 6 TRENDS, CHALLENGES AND OPPORTUNITIES IN SPOKEN DIALOGUE RESEARCH Michael McTear University of Ulster, Computer Science Research Institute Ulster, Northern Ireland mf.mctear@ulster.ac.uk …
Using speech and gesture to explore user states in multimodal dialogue systems
RP Shi, J Adelhardt, V Zeißler, A Batliner… – … Conference on Audio …, 2003 – isca-speech.org
… SmartKom, as mentioned above, is an automatic dialogue di- alogue system, which can communicate with the user in a multimodal way, ie, through speech, gesture and facial ex- pression with the configuration depicted in Figure 1 (see also http://www.smartkom.org for exact …
A context-aware middleware for multimodal dialogue applications with context tracing
MT Tran, B Hirsbrunner, M Courant – … of the 3rd international workshop on …, 2005 – dl.acm.org
Page 1. A Context-Aware Middleware for Multimodal Dialogue Applications with Context Tracing Manh-Thang Tran Department of Informatics University of Fribourg Chemin du Musée 3 1700 Fribourg, Switzerland tranmanh.thang@unifr.ch …
Overview of System Architecture
A Kellner – Spoken Multimodal Human-Computer Dialogue in …, 2005 – Springer
… Notes 1. http://www.smartkom.org/ 2. http://communicator.sourceforge.net/ 3. http://www.voicexml. org 4. http://www.w3.org/Voice 5. http://www.w3.org/2002/mmi/ 6. http://www.saltforum.org/ References Aust, H., Oerder, M., Seide, R, and Steinbiss, V. (1995) …
A multimodal fission approach with a Presentation agent in the dialog system SmartKom
J Müller, P Poller, V Tschernomas – Annual Conference on Artificial …, 2003 – Springer
… 1 Introduction SmartKom (www.smartkom.org) is a multimodal dialog system that supports the situated understanding of possibly imprecise, ambiguous or partial multi- modal input and the generation of coordinated, cohesive, and coherent multi- modal presentations …
Challenges in modelling a richly annotated diachronic corpus of German
S Dipper, L Faulstich, U Leser… – Workshop on XML …, 2004 – linguistics.ruhr-uni-bochum.de
… 10http://www.ling.upenn.edu/mideng/ 11http://www.ling.lancs.ac.uk/newsbooks/ 12http://www.blb-karlsruhe.de/blb/blbhtml/ nib/uebersicht.html 13For examples of multi-modal corpora, see the SmartKom corpus (http://www.smartkom.org/) or the GeM cor- pus (http://www …
Research issues for the next generation spoken dialogue systems revisited
E Nöth, M Boros, J Fischer, F Gallwitz, J Haas… – … Conference on Text …, 2001 – Springer
… us. References 1. SmartKom Project. http://www.smartkom.org. 2. VoiceXML Forum. http://www.voicexml.org. 3. Proc. of the Workshop on Multi-Lingual Speech Communication, Kyoto, Japan, 2000. Page 8. 348 E. Nöth et al …
Language Technology–a Survey of the State of the Art Language Resources–Multimodal Language Resources
MT Maybury – MITRE Corporation, 2002 – researchgate.net
… Figure 6 illustrates several steps in a multimodal conversation between a human and a virtual agent (named Smartakus) in the SmartKom system (www.smartkom.org) (Wahlster 2001). The user’s spoken language, gesture, and facial expressions serve as primary input …
Companion-technology: an overview
S Biundo, D Höller, B Schattenberg, P Bercher – KI-Künstliche Intelligenz, 2016 – Springer
… http://www.semaine-project.eu. 30. SmartKom. http://www.smartkom.org. 31. Augusto JC, Callaghan V, Cook D, Kameas A, Satoh I (2013) Intelligent environments: a manifesto. Hum Centric Comput Inf Sci 3(1):1–18. doi:10.1186/2192-1962-3-12 CrossRefGoogle Scholar. 32 …
Facts and Figures About the SmartKom Project
A Blocher – SmartKom: Foundations of Multimodal Dialogue …, 2006 – Springer
… The economic and scientific impact of the SMARTKOM project is described in Wahlster (2006). A list of SMARTKOM-related scientific papers, keynotes, talks and presentations is available at the web site http://www.smartkom.org. 3.2 Public Relations …
SmartKom: Towards Multimodal Dialogues with Anthropomorphic Interface Agents
WWNRA Blocher – paulmckevitt.com
… information overload, increasing system complexity, and shrinking task time lines [cf. 2]. SmartKom (www.smartkom.org) is a multimodal dialogue system (see Fig. 1) that combines speech, gesture, and facial expressions for input and …
Breakthroughs in Human Technology Interaction
B Reuse – Field and Service Robotics, 2003 – Springer
… more application-oriented. Page 4. 34 B. Reuse SmartKom: Dialogue-based Human Computer Interaction through Coordi- nated Analysis and Generation of Multiple Modalities (www.smartkom.org). Computer without keyboard …
THE NITE WORKBENCH
NO Bernsen, L Dybkjær, M Kolodnytsky – Citeseer
… graphical user interfaces and gesture and mimetic interaction. SmartKom uses tools developed elsewhere: in Verbmobil for audio annotation, Anvil for mimics and gesture coding. See www.smartkom.org Tool: SyncWriter. NIMM aspects addressed: Speech and gesture …
Intuitive Authentication in Multi-Modal Devices-A new approach in multi-modal biometrics
M Schuster, S Grashey, HJ Heger… – ISCA Tutorial and …, 2002 – isca-speech.org
… Publishers, 327-344. [2] SmartKom(2002). Dialog-based Human-Technology Interaction by Coordinated Analysis and Generation of Multiple Modalities. http://www.smartkom.org. [3] U. Dieckmann (1997). SESAM: A biometric …
Language Technology II: Language-Based Interaction Multimodal Dialogue Systems
I Kruijff-Korbayová – 2006 – coli.uni-saarland.de
… “MATCH: An architecture for Multimodal Dialogue Systems.” In Proc. Of the 40th Annual Meeting of ACL. pp. 376-383. 2002. • N. Pfleger et al. “Robust Multimodal Discourse Processing.” In Proc. Of DiaBruck. pp. 107-114. 2003. SmartKom website: http://www.smartkom.org/
A path to multimodal data services for telecommunications
G Niklfeld, M Pucher, R Finan, W Eckhart – Spoken Multimodal Human …, 2005 – Springer
… org/workprogram/ReportJWorkltem. asp?WKI_ID= 9948. 8. http://communicator.sourceforge.net/ 9. http://www.smartkom.org/ 10. ftp://ftp.cordis.lu/pub/ist/docs/istagscenarios2010.pdf 11. http://www.dcs.shef.ac.uk/spandh/projects/m4/ 12. http: //www. loria. fr/pro jets/MIAMM/ 13 …
Speech centric multimodal interfaces for mobile communication systems
K Kvale, N Warakagoda, JE Knudsen – Telektronikk, 2003 – telenor.com
Page 106. Telektronikk 2.2003 1 Introduction Since small mobile terminals have limited key- pads and small screens we have to use alterna- tive communication channels when interacting with these terminals. Speech is a natural …
Context Dependent Error Handling by a Three Layered Processing Model
M Streit – ISCA Tutorial and Research Workshop on Error …, 2003 – isca-speech.org
… 6. Overview of SmartKom SmartKom (www.smartkom.org) is a multimodal dialog system that supports the situated understanding of possibly imprecise, ambiguous, or partial multi-modal input [15] and provides a symmetric use of modalities in input and output …
Speech Processing in the Networked Home Environment-A View on the Amigo Project
R Haeb-Umbach, B Kladis… – … Conference on Speech …, 2005 – isca-speech.org
… More informations on ”www.amigo- project.org” 8. References [1] www.amigo-project.org [2] www.hitech-projects.com/euprojects/ambience [3] www.extra.research.philips.com/euprojects/ ozone [4] www.ambient-agoras.org [5] www.smartkom.org [6] E. Warsitz and R. Haeb …
Fade-an integrated approach to multimodal fusion and discourse processing
N Pfleger – Proceedings of the Dotoral Spotlight at ICMI, 2005 – pdfs.semanticscholar.org
… of FADE. 6. Conclusion and Future Work Previous versions of the two subcomponents of FADE were employed in several multimodal dialogue systems like SmartKom (see http://www.smartkom.org) and COMIC (see http://www …
The SmartKom mobile car prototype system for flexible human-machine communication
D Bühler, W Minker – Spoken Multimodal Human-Computer Dialogue in …, 2005 – Springer
… Blocher, A., HauBler, J., Kaiser, J., and Reithinger, N. (2003). SmartKom video demonstration, http://www.smartkom.org/. Buhler, D., Minker, W., Haussler, J., and Kriiger, S. (2002). The SmartKom Mobile multi-modal dialogue system …
Evaluation and usability of multimodal spoken language dialogue systems
L Dybkjaer, NO Bernsen, W Minker – Speech Communication, 2004 – Elsevier
Skip to main content …
Natural Interactivity Resources-Data, Annotation Schemes and Tools.
L Dybkjær, NO Bernsen – LREC, 2002 – spokendialogue.dk
… SmartKom uses tools developed else- where: in Verbmobil for audio annotation, Anvil for mimics and gesture coding. See www.smartkom.org 11. SyncWriter is a professional tool for transcription and annotation of synchronous “events” such as speech and video data …
Device independent Multimodal Dialogue Systems: An application-centered Perspective
J Kreutel – Ubiquitous Services and Applications: Exploiting the …, 2005 – books.google.com
Page 116. Device independent Multimodal Dialogue Systems: An application-centered Perspective Jorn Kreutel SemanlicEdge GmbH joern. kreutel@ semanticedge. com Abstract The paper reports on the results of an industrial …
Some Issues in the Design of Character Scripting and Specification Languages
T Rist – Life-Like Characters: Tools, Affective Functions, and …, 2013 – books.google.com
Page 460. Some Issues in the Design of Character Scripting and Specification Languages –a Personal View Thomas Rist DFKI GmbH, Stuhlsatzenhausweg 3, D–66123 Saarbrücken, Germany rist (Qdfki. de Summary. The increasing …
Design Spaces, Mechanisms and Architectures for Multimodal Interfaces
JAJ ter Heerdt – 2004 – Citeseer
Page 1. Design Spaces, Mechanisms and Architectures for Multimodal Interfaces Jeroen AJ ter Heerdt Group for Human Media Interaction Department of Computer Science University of Twente ABSTRACT Multimodal interfaces …
Generating non-native pronunciation variants for lexicon adaptation
S Goronzy, S Rapp, R Kompe – Speech Communication, 2004 – Elsevier
Skip to main content ScienceDirect. Sign in Sign in using your ScienceDirect credentials. Username. Password. Remember me. Forgotten username or password? Sign in via your institution …
Some Issues in the Design of Character Scripting and Specification Languages—a Personal View
T Rist – Life-Like Characters, 2004 – Springer
… In: Proceedings of HCI 2001 (2001) 6. Wahlster, W., Reithinger, N., Blocher, A.: SmartCom: Towards multimodal dia- logues with anthropomorphic interface agents. Technical Report 15, SmartCom project. www.smartkom.org/reports/Report-NR-15.pdf (2001)
User focus management in agent worlds
W Pasman – 2003 – mmi.tudelft.nl
… PROMISE – A Procedure for Multimodal Interactive System Evaluation. Technical Report 23, SmartKom Project, Ludwig-Maximilians-Universität, München, Germany. Available Internet: http://www.smartkom.org/reports/Report-NR-23.pdf. [Blaylock01] Blaylock, N. (2001) …
Towards symmetric multimodality: Fusion and fission of speech, gesture, and facial expression
W Wahlster – Annual Conference on Artificial Intelligence, 2003 – Springer
… interface. Our SmartKom system (www.smartkom.org) is designed to sup- port a wide range of collaborative and multimodal help dialogues, that allow users to intuitively and efficiently access the functionalities needed for their task …
Multimodal Interfaces to Mobile Terminals–A Design-For-All Approach
K Kvale, ND Warakagoda – User interfaces, 2010 – intechopen.com
Page 1. 3,200+ OPEN ACCESS BOOKS 105,000+ INTERNATIONAL AUTHORS AND EDITORS 110+ MILLION DOWNLOADS BOOKS DELIVERED TO 151 COUNTRIES AUTHORS AMONG TOP 1% MOST CITED SCIENTIST …
Cognitive-model-based interpretation of emotions in a multi-modal dialog system
M Streit, A Batliner, T Portele – Tutorial and Research Workshop on …, 2004 – Springer
… of reactions to these states. 2 Emotion Processing in the SmartKom System SmartKom (www.smartkom.org) is a multi-modal dialog system that provides access to multiple applications [10]. In addition to input-modalities that …
Mobile Multimodality—Design and Development of the SmartKom Companion
D Bühler, W Minker – International Journal of Speech Technology, 2005 – Springer
… Notes 1. Web site: http://www.smartkom.org/ 2. Web site: http://www.onstar.com 3. Linux distribution suitable for the StrongARM processor family. References … SmartKom video demonstration. http://www.smartkom.org/. Bühler, D., Minker, W., Häussler, J., and Krüger, S. (2002) …
Face expression recognition: A brief overview of the last decade
CD C?leanu – … Intelligence and Informatics (SACI), 2013 IEEE …, 2013 – ieeexplore.ieee.org
… Rep., 2006. [35] SmartKom, “Smartkom database,” 2003. [Online]. Available: www.smartkom.org – 161 – 8th IEEE International Symposium on Applied Computational Intelligence and Informatics • May 23–25, 2013 • Timisoara, Romania
An architectural framework for natural language interfaces to agent systems.
C Kemke – Computational Intelligence, 2006 – researchgate.net
… Proceedings of CAIA-94, pp. 381-388, 1994. 33. Verbmobil. http://verbmobil.dfki.de/ 34. SmartKom. http://www.smartkom.org/ 35. SFB 360 – Situated Artificial Communicators. http://www.sfb360. uni-bielefeld.de/sfbengl.html 36. CoSy. http://www.dfki.de/pas/f2w.cgi?ltp/cosy-e
State of the art review: Multimodal fission
ME Foster – COMIC project Deliverable, 2002 – researchgate.net
Page 1. Author: Mary Ellen Foster (University of Edinburgh) Date: 27 September 2002 Deliverable 6.1 State of the art review: Multimodal fission Document history Date Editor Explanation Status 27 September MEF Removed …
CHAPTER TEN THE SPEECH-GESTURE SYSTEM IN THE EUROPEAN PARLIAMENT CARMEN DEL SOLAR VALDÉS, UNIVERSITY OF SEVILLE, SPAIN
CDELS VALDÉS – Discourse and Politics, 2009 – books.google.com
Page 182. CHAPTER TEN THE SPEECH-GESTURE SYSTEM IN THE EUROPEAN PARLIAMENT CARMEN DEL SOLAR VALDÉS, UNIVERSITY OF SEVILLE, SPAIN Introduction Speaking and gesturing are in many ways related to each other …
Developing multimodal web interfaces by encapsulating their content and functionality within a multimodal shell
I Mlakar, M Rojc – Analysis of Verbal and Nonverbal Communication and …, 2011 – Springer
… interfaces. The SmartWeb [12] is an extension project of the SmartKom (www.smartkom.org) project, one of the multimodal dialog systems that combine speech and gestures with facial expressions for both input and output …
Joint interpretation of input speech and pen gestures for multimodal human-computer interaction
PY Hui, HM Meng – Ninth International Conference on Spoken …, 2006 – isca-speech.org
… ACL, 1 [6] Wu, L. et al., “Multimodal Integration – A Statistical View,” IEEE Transactions on Multimed [7] Wahlster, W. et al., SmartKom (www.smartkom.org) Johnston, M. & S. Bangalore, “Finite-state Multimod [8] al (2):263– 311, 1993. Parsing and Understanding,” Proc …
Emotion Analysis and Emotion-Handling Subdialogues
M Streit, A Batliner, T Portele – SmartKom: Foundations of Multimodal …, 2006 – Springer
… Page 4. 320 Michael Streit, Anton Batliner, and Thomas Portele 2 Emotion Processing in the SmartKom System SMARTKOM (http://www.smartkom.org) is a multimodal dialogue system that pro- vides access to multiple applications (Wahlster, 2003) …
Intelligent Visual Interfaces
MT Maybury – Citeseer
Page 1. Intelligent Visual Interfaces: AVI 2010 Intelligent Visual Interfaces: An Introduction Mark T. Maybury maybury@mitre.org itc.mitre.org Tutorial Notes Advanced Visual Interfaces (AVI-10) 29 May 2010 Rome Italy Rome, Italy MITRE …
Multimedia Interface with an Intelligent Wheelchair
B Martins, E Valgôde, P Faria… – … Modelling of Objects …, 2018 – books.google.com
Page 286. Computational Modelling of Objects Represented in Images– João Manuel RS Tavares & RM Natal Jorge (eds) © 2007 Taylor & Francis Group, London, ISBN 978-0-415-43349-5 Multimedia interface with an intelligent …
Human-agent service matching using natural language queries: system test and training
W Pasman, J Lindenberg – Personal and Ubiquitous Computing, 2006 – dl.acm.org
… http:// www.philips.com/Assets/Downloadablefile/LEAFLET8x- 1504.pdf 4. Smartkom (2004) SmartKom: dialog-based human-technology interaction by coordinated analysis and generation of multiple Modalities.http://www.smartkom.org 5. Blaylock N (2002) Managing …
Automatic pronunciation modelling for multiple non-native accents
S Goronzy, K Eisele – … , 2003. ASRU’03. 2003 IEEE Workshop …, 2003 – ieeexplore.ieee.org
Page 1. AUTOMATIC PRONUNCIATION MODELLING FOR MULTIPLE NON-NATIVE ACCENTS Silke Goronzy, Kathrin Eisele Sony International (Europe) GmbH Sony Corporate Labs Europe – Advanced Software Lab Hedelfinger Str …
Circumstantial Knowledge Management For Human-Like Interaction
AB Gomez – researchgate.net
Page 1. UNIVERSIDAD CARLOS III DE MADRID ESCUELA POLITÉCNICA SUPERIOR BACHELOR IN COMPUTER SCIENCE AND ENGINEERING BACHELOR THESIS CIRCUMSTANTIAL KNOWLEDGE MANAGEMENT FOR HUMAN-LIKE INTERACTION …
From a stationary prototype to telephone translation services
H Kirchmann, A Ndiaye, A Klüter – Verbmobil: Foundations of Speech-to …, 2000 – Springer
Page 1. From a Stationary Prototype to Telephone Translation Services Heinz Kirchmann, Alassane Ndiaye, and Andreas Kliiter DFKI GmbH, Kaiserslautem, Germany Abstract. In addition to the face-to-face system, Verbmobil …
Circumstancial knowledge management for human-like interaction
A Baldominos Gómez – 2012 – e-archivo.uc3m.es
Page 1. UNIVERSIDAD CARLOS III DE MADRID ESCUELA POLITÉCNICA SUPERIOR BACHELOR IN COMPUTER SCIENCE AND ENGINEERING BACHELOR THESIS CIRCUMSTANTIAL KNOWLEDGE MANAGEMENT FOR HUMAN-LIKE INTERACTION …
Building usable spoken dialogue systems. Some approaches
NO Bernsen, L Dybkjoer – Sprache und Datenverarbeitung, 2005 – nislab.dk
… Since Waxholm, many research projects have begun to nibble into the challenges posed by multimodal SDSs, including large projects, such as German SmartKom 1998-2003 [http://www.smartkom.org/] which investigated task-oriented spoken Page 4. 4 …
Conversational agents, humorous act construction, and social intelligence
A Nijholt – Proceedings AISB, 2005 – Citeseer
Page 14. Conversational Agents, Humorous Act Construction, and Social Intelligence Anton Nijholt University of Twente, PO Box 217, 7500 AE Enschede The Netherlands anijholt@ cs. utwente. nl Abstract Humans use humour …
Virtual Learning Environments and Intelligent Tutoring Systems Survey of current approaches and design methodologies
K Muñoz, P Mc Kevitt, T Lunney… – Review Paper available …, 2013 – karlamunoz.net
Page 1. REVIEW PAPER Virtual Learning Environments and Intelligent Tutoring Systems Survey of current approaches and design methodologies Karla Muñoz • Paul Mc Kevitt • Tom Lunney • Intelligent Systems Research Centre …
MediaHub: An Intelligent MultiMedia Distributed Platform Hub
G Campbell, T Lunney, P Mc Kevitt – 2005 – researchgate.net
Page 1. MediaHub: An Intelligent Multimedia Distributed Platform Hub Glenn Campbell Supervisors: Dr. Tom Lunney, Prof. Paul Mc Kevitt First year report Date: 22 June 2005 Presented as a requirement for Ph.D. in School of …
A Thematic Bibliography on Dialogue Processing
A Popescu-Belis, A Clark, M Georgescul, M Starlander… – 2003 – researchgate.net
Page 1. MULTIMODAL DIALOGUE MANAGEMENT http://www.im2.ch http://www.issco.unige. ch/projects/im2/mdm/ ISSCO/TIM/ETI, Université de Genève A Thematic Bibliography on Dialogue Processing Andrei Popescu-Belis Alexander Clark Maria Georgescul …
A flexible architecture for ambient intelligence systems supporting adaptive multimodal interaction with users
S Piva, C Bonamico, C Regazzoni, F Lavagetto – Ambient Intelligence, 2005 – isip40.it
Page 1. Ambient Intelligence 97 G. Riva, F. Vatalaro, F. Davide, M. Alcañiz (Eds.) IOS Press, 2004, http://www.ambientintelligence.org 6 A Flexible Architecture for Ambient Intelligence Systems Supporting Adaptive Multimodal Interaction with Users …
Does multimodality really help? the classification of emotion and of On/Off-focus in multimodal dialogues-two case studies.
E Noth, C Hacker, A Batliner – ELMAR, 2007, 2007 – ieeexplore.ieee.org
… Subsequently, several annotations were carried out. The recorded speech represents thus a special variety of non-prompted, spontaneous speech typical for human-machine- communication in 1 www.smartkom.org 2 www.smartweb.dfki.de 9 Page 2 …
The Need for Suitable User Interfaces for Mobile Devices in on Site Inspection in Health and Safety at Work
A Frankfurth, O Gerstheimer, M Knopp – Proceedings of Euro mGov, 2006 – m4life.org
… Retrieved Apr 10, 2006 from http://files.fh-aargau.ch/files/pdf/- Forschung_und_Gestaltu ng_FHA-00-10-032.pdf. SmartKom: Retrieved Apr 27, 2006 from http://www.smartkom.org/ start_en.html. Stiftung Warentest (2004): Ein eheähnliches Verhältnis …
A reliable natural language interface to household appliances
A Yates, O Etzioni, D Weld – … of the 8th international conference on …, 2003 – dl.acm.org
Page 1. A Reliable Natural Language Interface to Household Appliances Alexander Yates University of Washington Computer Science Seattle, WA 98105 USA 206-616-1844 ayates@cs.washington.edu Oren Etzioni University …
Multimodal interfaces: combining interfaces to accomplish a single task
P Barthelmess, SL Oviatt – HCI Beyond the GUI, Morgan …, 2008 – books.google.com
Page 410. 12 CHAPTER 12.1 Multimodal Interfaces: Combining Interfaces to Accomplish a Single Task Paulo Barthelmess, Sharon Oviatt NATURE OF THE INTERFACE 12.1. 1 An essential distinguishing capability of multimodal …
Modelling proactive behaviour of conversational interfaces
M L’Abbate – 2007 – tuprints.ulb.tu-darmstadt.de
Page 1. Modelling Proactive Behaviour of Conversational Interfaces Vom Fachbereich Informatik der Technischen Universität Darmstadt zur Erlangung des akademischen Grades eines Doktor-Ingenieurs (Dr.-Ing.) genehmigte Dissertation von …
ITRI-03-21 And Now with Feeling: Developments in Emotional Language Generation
A Belz – 2003 – ofai.at
Page 1. ITRI-03-21 And Now with Feeling: Developments in Emotional Language Generation Anja Belz November, 2003 Supported by the EU under the IST Programme (Project Number IST-2000-28580). Information Technology …
Dialogue-based Exploration of Graphics for Users with a Visual Disability
J Plhák – 2014 – is.muni.cz
Page 1. MASARYK UNIVERSITY FACULTY OF INFORMATICS }w¡¢£¤¥ &123456789@ ACDEFGHIPQRS`ye| Dialogue-based Exploration of Graphics for Users with a Visual Disability PH.D. THESIS Jarom?r Plh´ak Brno, 2014 Page 2. Declaration …
Information requirements of hotel guests for location based services: identifying characteristic segments
H Murphy, R Schegg – … and Communication Technologies in Tourism 2006, 2006 – Springer
… Zipf, A. & Malaka, R. (2002). Developing Location Based Services for Tourism. The Service Providers View. European Media Laboratory – EML – 69118 Heidelberg, Germany (http://www.smartkom.org/Vortraege/EML/Developing_LBS.pdf, [February 2, 2005]) …
General ontology baseline
S Farrar, J Bateman – Deliverable D1, I1-[OntoSpace], 2004 – fb10.uni-bremen.de
Page 1. OntoSpace Project Report University of Bremen Germany SFB/TR 8: I1-[OntoSpace] General Ontology Baseline Deliverable D1 I1-[OntoSpace]; Workpackage 1 Scott Farrar and John Bateman December 2005 Version: 2.0 …
Proactivity in Spoken Dialog Systems
H Hofmann, U Ehrlich, A Berton – 3rd IUI Workshop on Interacting …, 2014 – researchgate.net
Page 7. Proactivity in Spoken Dialog Systems Hansjörg Hofmann, Ute Ehrlich, André Berton Daimler AG Ulm, Germany 1hansjoerg. hofmann, ute. ehrlich, andre. bertonl@ daimler. com ABSTRACT Proactive speech interfaces have been a hot research topic for many years …
Usage patterns and latent semantic analyses for task goal inference of multimodal user interactions
PY Hui, WK Lo, H Meng – … of the 15th international conference on …, 2010 – dl.acm.org
Page 1. Usage Patterns and Latent Semantic Analyses for Task Goal Inference of Multimodal User Interactions Pui-Yu Hui, Wai-Kit Lo and Helen M. Meng Human-Computer Communications Laboratory The Chinese University …
Project ref. no. IST-1999-10647
VP Olsen, N Reithinger, C Soria – spokendialogue.dk
Page 1. Project ref. no. IST-1999-10647 Project title ISLE Natural Interactivity and Multimodality Working Group Deliverable status Public Contractual date of delivery October 2000 Actual date of delivery January 2001 Deliverable number D11.1 …
Probabilistic models in building automation: recognizing scenarios with statistical methods
D Bruckner – 2007 – sima.ict.tuwien.ac.at
Page 1. DISSERTATION Probabilistic Models in Building Automation: Recognizing Scenarios with Statistical Methods Submitted at the Faculty of Electrical Engineering and Information Technology, Vienna University of Technology …
Contractual date of delivery
MW Knudsen, JC Martin, L Dybkjær, MJM Ayuso… – 2001 – nislab.dk
Page 1. Project ref. no. IST-1999-10647 Project title ISLE Natural Interactivity and Multimodality Working Group Deliverable status Public Contractual date of delivery 30 September 2001 Actual date of delivery February 2002 Deliverable number D9.1 …
Multimodal interaction with mobile devices: fusing a broad spectrum of modality combinations
R Wasinger – 2006 – books.google.com
Page 1. DISKI 305 Multi modal Interaction with Mobile Devices: Fusing a Broad Spectrum of Modality Combinations Rainer Wasinger (jj) infix Page 2. Page 3. DISKI 305 This One TfiAA-FI II-7ATF Page 4. DISKI Dissertationen …
Ontologies and adaptivity in dialogue for question answering
D Sonntag – 2010 – books.google.com
Page 1. ONTOLOGIES AND ADAPTIVITY IN DIALOGUE FOR QUESTION ANSWERING Page 2. Studies on the Semantic Web Semantic Web has grown into a mature field of research. Its methods find innovative applications on and off the World WideWeb …
State of the art in speech and audio processing
K Daoudi – 2004 – dsc.ufcg.edu.br
Page 1. State of the art in speech and audio processing Khalid Daoudi September 20, 2004 Page 2. 2 Page 3. Chapter 1 State of the art in Acoustic Speech Recognition K. Daoudi and D. Fohr INIRIA-Parole, France 1.1 Statistical speech recognition …
Generic command interpretation algorithms for conversational agents
L Mazuel, N Sabouret – Web Intelligence and Agent Systems …, 2008 – content.iospress.com
Page 1. Web Intelligence and Agent Systems: An International Journal 6 (2008) 43–57 43 DOI 10.3233/WIA-2008-0129 IOS Press Generic command interpretation algorithms for conversational agents Laurent Mazuel ? and …
Overview of the state of the art in fusion of speech and pen input
LG Vuurpijl, LFM ten Bosch, JPA de Ruiter… – 2002 – repository.ubn.ru.nl
Page 1. PDF hosted at the Radboud Repository of the Radboud University Nijmegen The following full text is an author’s version which may differ from the publisher’s version. For additional information about this publication click this link. http://hdl.handle.net/2066/62179 …
Interface cultures: artistic aspects of interaction
C Sommerer, L Mignonneau, D King – 2015 – books.google.com
Page 1. -2 – º º–of)- CHRISTA SOMMERER, LAURENT MIGNONNEAU, DOROTHEE KING (EDS.) INTERFACE CULTURES Artistic Aspects of Interaction Page 2. Christa Sommerer, Laurent Mignonneau, Dorothée King (eds.) Interface Cultures. Artistic Aspects of Interaction …
Real-time automatic emotion recognition from speech
T Vogt – 2010 – pub.uni-bielefeld.de
Page 1. Real-time automatic emotion recognition from speech DISSERTATION zur Erlangung des akademischen Grades Doktor der Ingenieurwissenschaften (Dr. Ing.) eingereicht an der Technischen Fakultät der Universität Bielefeld von Frau Dipl.-Inform. Thurid Vogt Mai 2010 …
Interfacing ambient intelligence
M Hartmann – 2005 – Citeseer
Page 1. Interfacing Ambient Intelligence Marius Hartmann Department of Digital Aesthetics and Communication IT University of Copenhagen A thesis submitted for the degree of Doctor of Philosophy April 25 2005 Page 2. Acknowledgements …
Verbmobil from a software engineering point of view: System design and software integration
A Klüter, A Ndiaye, H Kirchmann – Verbmobil: Foundations of Speech-to …, 2000 – Springer
Page 1. Verbmobil From a Software Engineering Point of View: System Design and Software Integration Andreas Kliiter, Alassane Ndiaye, and Heinz Kirchmann * DFKI GmbH, Kaiserslautem, Germany Abstract. The distributed …
On the usability of spoken dialogue systems
LB Larsen – Aalborg University Denmark, Diss, 2003 – vbn.aau.dk
… Agency. ATIS – Air Traffic Information System 5. http://www.speechdat.org/ 6. http://www.smartkom.org/start_en.html 7. http://www.etsi.org/frameset/home.htm?/ technicalactiv/dsr/dsr.htm 8. http://cpk.auc.dk/FACE/ Page 15. 2 als …
Benchmarking Location Based Systems And Services 2004-2005
P Sharma, D Nugent, L Dawson, S Foster, P Hawking… – 2006 – researchgate.net
Page 1. BENCHMARKING LOCATION BASED SYSTEMS AND SERVICES 2004-2005 Pramod Sharma, Devon Nugent, Linda Dawson, Susan Foster, Paul Hawking, Andrew Stein and John Zeleznikow Page 2. BENCHMARKING …
Speed Up Strategies for the Creation of Multimodal and Multilingual Dialogue Systems
LF D’Haro, R de Cordoba – 2009 – pdfs.semanticscholar.org
Page 1. UNIVERSIDAD POLITÉCNICA DE MADRID ESCUELA TÉCNICA SUPERIOR DE INGENIEROS DE TELECOMUNICACIÓN Speed Up Strategies for the Creation of Multimodal and Multilingual Dialogue Systems TESIS DOCTORAL LUIS FERNANDO D’HARO …
DOKTOR-INGENIEURS (DR.-ING.)
H Hofmann – d-nb.info
Page 1. Intuitive Speech Interface Technology for Information Exchange Tasks DISSERTATION zur Erlangung des akademischen Grades eines DOKTOR-INGENIEURS (DR.-ING.) der Fakultät für Ingenieurwissenschaften und Informatik der Universität Ulm von …
Automatic evaluation of tracheoesophageal substitute voices
T Haderlein – 2007 – opus4.kobv.de
Page 1. Automatic Evaluation of Tracheoesophageal Substitute Voices Der Technischen Fakultät der Universität Erlangen–N¨urnberg zur Erlangung des Grades DOKTOR–INGENIEUR vorgelegt von Tino Haderlein Erlangen — 2007 Page 2. Als Dissertation genehmigt von der …
Speech centric multimodal interfaces for disabled users
K Kvale, ND Warakagoda – Technology and Disability, 2008 – content.iospress.com
… Technology, 2006. [34] SMARTCOM – Dialog-based Human-Technology Interaction by Coordinated Analysis and Generation of Multiple Modali- ties, http://www.smartkom. org/start en.html presence verified 24/5/07. [35] W3C …
Cross-modality semantic integration with hypothesis rescoring for robust interpretation of multimodal user interactions
PY Hui, HM Meng – IEEE transactions on audio, speech, and …, 2009 – ieeexplore.ieee.org
Page 1. 486 IEEE TRANSACTIONS ON AUDIO, SPEECH, AND LANGUAGE PROCESSING, VOL. 17, NO. 3, MARCH 2009 Cross-Modality Semantic Integration With Hypothesis Rescoring for Robust Interpretation of Multimodal User Interactions …