Speech Grammar & Dialog Systems

Notes:

A speech grammar is a set of rules that describes the structure and content of valid speech inputs for a spoken dialog system. It defines the words, phrases, and sentence structures that the system should recognize and understand as valid inputs. The grammar helps to constrain the system’s recognition capabilities to a specific domain, making it more robust against noise and errors.

Most Spoken Dialog Systems use speech grammars, along with frame and slot semantics, to interpret and understand user inputs. A frame is a template that describes a specific topic or task, while slot semantics are used to capture specific pieces of information within the frame. Together, the speech grammar, frame, and slot semantics work to help the system understand the user’s communicative intent and extract the relevant information needed to complete the task.

JSGF stands for Java Speech Grammar Format, it is a format that is used to specify grammars for speech recognition systems. It was developed by Sun Microsystems and is used in the Java Speech API (JSAPI) and other speech recognition systems. JSGF is a simple, text-based format that allows developers to specify grammars using a set of rules and regular expressions. It is designed to be easy to use and understand, and it’s a widely accepted format for speech grammars.

Java Speech Grammar Recognizer (JSGR) is a software component that is part of the Java Speech API (JSAPI) and it is used to recognize speech inputs based on a grammar specified in the Java Speech Grammar Format (JSGF). The JSGR can take a JSGF grammar as input and generates a recognizer that can be used to understand the spoken input by comparing it to the grammar rules.

JSGR allows developers to easily create speech-enabled applications that can recognize spoken commands and inputs from users, by providing a way to define grammars for speech recognition. The JSGR can also be used to improve the performance of a speech recognition system by constraining the system’s recognition capabilities to a specific domain, making it more robust against noise and errors.

JSGR is designed to be easy to use and integrate with other components, such as Text-To-Speech (TTS) synthesizers and dialog systems, to create complete speech-enabled applications. It can be used in various applications, such as voice-controlled systems, interactive voice response (IVR) systems, and voice assistants.

HALEF: An Open-Source Standard-Compliant Telephony-Based Modular Spoken Dialog System: A Review and An Outlook D Suendermann-Oeft, V Ramanarayanan… – … Dialog Systems and …, 2015 – Springer … 5.2 describes the basic architecture and components of the HALEF spoken dialog system. … 1Popular grammar formats include JSGF (Java Speech Grammar Format), SRGS (speech recogni- tion grammar specification) and ARPA (Advanced Research Projects Agency) formats. … Cited by 6 Related articles All 21 versions

[BOOK] Designing interactive speech systems: From first ideas to user testing NO Bernsen, H Dybkjær, L Dybkjær – 2012 – books.google.com … 5.5 Iterating the Interaction Model ….. 5.6 Uses of WOZ Implementational Issues 6.1 The Overall Dialogue System ….. … This book describes our experiences from developing and evaluating the interaction model for the Danish Dialogue System. … Cited by 313 Related articles All 3 versions

Spoken dialog systems for automated survey interviewing M Johnston, P Ehlen, FG Conrad, MF Schober… – the proceedings of the …, 2013 – aclweb.org … W3C Recommendation 16 March 2004. http://www.w3.org/TR/speech-grammar/. Diane Litman, Julia Hirschberg, and MGJ Swerts. 2006. Characterizing and Predicting Corrections in Spoken Dialogue Systems. Computational Linguis- tics 32:3, pp. 417-438. … Cited by 3 Related articles All 13 versions

Bootstrapping Development of a Cloud-Based Spoken Dialog System in the Educational Domain From Scratch Using Crowdsourced Data V Ramanarayanan… – ETS Research …, 2016 – Wiley Online Library … We use the open-source HALEF dialog system1 to develop conversational applications within the crowdsourcing framework. … VoiceXML 2.1 and can process SIP traffic and which incorporates support for multiple grammar standards, such as Java Speech Grammar Format (JSGF … Related articles

Crowdsourcing street-level geographic information using a spoken dialogue system R Meena, JBGSJ Gustafson – 15th Annual Meeting of the Special Interest …, 2014 – aclweb.org … If the 1 http://www. w3. org/TR/speech-grammar/ concept type is inappropriate the DM queries the user once more (albeit using different utterance forms). … The dialogue system has been imple- mented using the IrisTK framework (Skantze & Al Moubayed, 2012). … Cited by 7 Related articles All 15 versions

A distributed cloud-based dialog system for conversational application development V Ramanarayanan… – … Annual Meeting of …, 2015 – anthology.aclweb.org … Enabled and Free) framework leverages different open-source components to form a spoken dialog system (SDS) framework that is … HALEF includes support for popular grammar formats, including JSGF (Java Speech Grammar Format), SRGS (Speech Recognition Grammar … Cited by 3 Related articles All 16 versions

Building multimodal dialog user interfaces in the context of the internet of services D Porta, M Deru, S Bergweiler, G Herzog… – Towards the Internet of …, 2014 – Springer … Building multimodal dialogue applications: system integration in smartkom, in SmartKom: Foundations of Multimodal Dialogue Systems, ed. by … recognition grammar specification version 1.0 – W3C recommendation (Mar 2004), http://www.w3.org/TR/speech-grammar/. … Cited by 8 Related articles All 3 versions

A multimodal multi-device discourse and dialogue infrastructure for collaborative decision-making in medicine D Sonntag, C Schulz – Natural Interaction with Robots, Knowbots and …, 2014 – Springer … mobile dialogue system for radiology annotations, which is tuned for the standardised radiology reporting process. Our solution not only provides more robustness compared to speech-to-text systems (we use a rather small, dedicated, and context-based speech grammar which … Cited by 7 Related articles All 5 versions

Evaluation of Freely Available Speech Synthesis Voices for Halef M Mory, P Lange, T Mehrez… – … and Cognitive Science …, 2015 – books.google.com … 1 Introduction Spoken dialog systems (SDSs) developed in academic environments often sub- stantially differ from those in industrial environments [1 … SDSs; see Figure 1. In addition, Halef adheres to the following industrial standards: –JSGF (Java Speech Grammar Format) as … Related articles All 12 versions

Speeding up multilingual grammar development by exploiting linked data to generate pre-terminal rules S Walter, C Unger, P Cimiano – … on Applications of Natural Language to …, 2014 – Springer … Similarly, when developing a dialog system that is able to perform conversions between different currencies, one needs a list of the relevant currencies that exist world- wide. … 1–2. Association for Computational Lin- guistics (2012) 8 http://www.w3.org/TR/speech-grammar/ Related articles All 7 versions

Development and evaluation of automotive speech interfaces: useful information from the human factors and the related literature VEW Lo, PA Green – International Journal of Vehicular Technology, 2013 – hindawi.com … The dialogue system uses the CMU Sphinx-II speech recognizer for speech recognition and Phoenix Parser for semantic parsing. … on the standard Linguatronic system using the following methods to match the user speech: spell matcher, Java Speech Grammar Format, voice … Cited by 19 Related articles All 7 versions

SiAM-dp: A Platform for the Model-Based Development of Context-Aware Multimodal Dialogue Applications. R Nesselrath, M Feld – Intelligent Environments, 2014 – researchgate.net … These rules describe 3http://www.w3.org/TR/speech-grammar/ Page 7. Thin GUI TTS Grammar Adaptation … Actual presentation (possibly with further internal parsing / processing) Presentation Task (abstract) Presentation Task (fully specified) Dialog System Core … … Cited by 6 Related articles All 4 versions

Implementing Dialog Management M McTear, Z Callejas, D Griol – The Conversational Interface, 2016 – Springer … Formats supported by VoiceXML platforms include the W3C Speech Recognition Grammar Specification (SRGS), 2 the Augmented BNF (ABNF), 3 and the Java Speech Grammar Format (JSGF). 4. Grammars are specified using the element within a . … Related articles

Development of a toolkit handling multiple speech-oriented guidance agents for mobile applications S Hara, H Kawanami, H Saruwatari… – Natural Interaction with …, 2014 – Springer … had a major alteration made by Cincarek [1]. He rewrote the whole system in Ruby and maintained it as “a Dialogue System Toolkit written … It used a simple speech grammar for a mathematics calculator of four arithmetic operations; eg, the system could accept “What is the sum … Related articles All 4 versions

A Policy-Based Dialogue System for Physical Access Control. M Ababneh, D Wijesekera, JB Michael – STIDS, 2012 – ceur-ws.org … Based on the policy and the user’s presence information, our dialog system automatically produces a series of questions and answers that … 6, 2012 [3] World Wide Web Consortium, Speech Grammar Recognition Specification, white paper available at URL: http://www.w3.org/TR … Cited by 5 Related articles All 5 versions

RadSpeech’s mobile dialogue system for radiologists D Sonntag, C Schulz, C Reuschling… – Proceedings of the 2012 …, 2012 – dl.acm.org … system on the iPad and iPhone, which is tuned for the radiology domain and makes the complete system unique. Our solution not only provides more robustness compared to speech-to-text systems (we use a rather small, dedicated, and context-based speech grammar which … Cited by 4 Related articles All 4 versions

Dynamically Generating Policy Compliant Dialogues for Physical Access Control M Ababneh, D Wijesekera – Procedia Technology, 2013 – Elsevier … [2]; Ababneh, M.,Wijesekera, D., Michael, JB, 2012, “A Policy-based Dialogue System for Physical Access Control … [12]; Speech Recognition Grammar Specification, URL: http://www.w3.org/TR/ speech-grammar/, accessed April. 20, 2013. [13]; Massie, T., Wijesekera, D., 2008. … Cited by 4 Related articles All 2 versions

Speech Mashups G Di Fabbrizio, T Okken, J Wilpon – Semantic Mashups, 2013 – Springer Cited by 1 Related articles All 3 versions

Spoken dialogue system design in 3 weeks T Valenta, J Švec, L Šmídl – International Conference on Text, Speech and …, 2012 – Springer … chosen to be the results of the work and also features of the resulting dialogue system. In Section 3 we describe the first phase of the process, which is data acquisition and processing. In Section 4 the knowledge (semantic analysis and speech grammars) incorporated into the … Cited by 5 Related articles All 3 versions

Two-Layer Semantic Entity Detection and Utterance Validation for Spoken Dialogue Systems A Chýlek, J Švec, L Šmídl – International Conference on Text, Speech, and …, 2014 – Springer … in our data set and assign semantic information to user’s input which will be useful in further dialogue system development. … In: World Wide Web Consortium, Recommendation REC-speech-grammar-20040316 (March 2004) 4. Mairesse, F., Gasic, M., Jurcicek, F., Keizer, … Related articles All 4 versions

Modeling Graphical and Speech User Interfaces with Widgets and Spidgets D Massonie, C Hacker, T Sowa – Speech Communication; 11. …, 2014 – ieeexplore.ieee.org … Such dialog systems manage thousands of views, states, and properties. We are now headed to open this tooling to a broader audience. … [9] W3C, Speech Recognition Grammar Specification Version 1.0. http://www.w3.org/TR/speech- grammar/, accessed on April 25th, 2014. … Related articles All 3 versions

IrisTK: a statechart-based toolkit for multi-party face-to-face interaction G Skantze, S Al Moubayed – Proceedings of the 14th ACM international …, 2012 – dl.acm.org … to regulate turn-taking in multi-party dialog, as compared to a 2D screen [8]. The setting of a public exhibition in a museum poses considerable challenges to a multimodal dialog system. … 3 http://www.w3.org/TR/speech-grammar/ 4 http://www.w3.org/TR/semantic-interpretation/ … Cited by 36 Related articles All 7 versions

The W3C multimodal architecture and interfaces standard DA Dahl – Journal on Multimodal User Interfaces, 2013 – Springer … components from multiple sources. Keywords Multimodal interaction · Spoken dialog systems · Multimodal architectures · Extensible multi-modal annotation (EMMA) · Multimodal systems 1 Overview Computer-human interaction … Cited by 16 Related articles All 6 versions

Knowledgeable talking robots LC Aiello, E Bastianelli, L Iocchi, D Nardi… – … Conference on Artificial …, 2013 – Springer … 3 http://www.microsoft.com/en-us/download/details.aspx?id=24974 4 http://www.w3.org/TR/speech- grammar/ Page 5. … 336–340. IEEE (2007) 11. Nisimura, R., Uchida, T., Lee, A., Saruwatari, H., Shikano, K., Matsumoto, Y.: Aska: receptionist robot with speech dialogue system. … Cited by 6 Related articles All 10 versions

Speech technologies for advanced applications in service robotics S Ondáš, J Juhár, M Pleva, M Lojka… – Acta Polytechnica …, 2013 – uni-obuda.hu … Previous sentence is the definition of dialogue management technology, which creates a core of spoken dialogue systems [5]. To close the … Approximately 200 voice commands were constructed and the speech grammar was prepared, which defines a recognition network. … Cited by 7 Related articles All 4 versions

A Multimodal Conversational Agent for Personalized Language Learning D Griol, I Baena, JM Molina, AS de Miguel – Ambient Intelligence-Software …, 2014 – Springer … The application consists of the set of core components for multimodal dialog systems (speech recognition, spoken language understanding, dialog management … To do this, we follow the Java Speech Grammar Format (JSGF, www.w3.org/TR/jsgf/), which allows specifying these … Related articles All 3 versions

Multi-party interaction with a virtual character and a human-like robot Z Yumak, N Magnenat-Thalmann – … of the 19th ACM Symposium on …, 2013 – dl.acm.org … 1http://thrift.apache.org/ 2http://www.w3.org/TR/speech-grammar/ 154 Page 3. … 3.2 Dialogue and behavior generator Spoken dialogue systems include several components such as natu- ral language understanding, dialogue management and natural lan- guage generation. … Cited by 2 Related articles

Modeling users emotional state for an enhanced human-machine interaction D Griol, JM Molina – … Conference on Hybrid Artificial Intelligence Systems, 2015 – Springer … This is the case of most information providing spoken dialog systems, in which a baseline algorithm which always chooses “neutral … and the grammars for automatic speech recognition are also implemented in VoiceXML-compliant formats (eg, Java Speech Grammar Format or … Cited by 2 Related articles

Tuning Sphinx to Outperform Google’s Speech Recognition API P Lange, D Suendermann-Oeft – Proc. of the ESSV, 2014 – antikenschlacht.com … from CMU’s Let’s Go bus information system comprising 258k utterances of telephony speech recorded in the bus information dialog system of Pittsburgh … In addition to Sphinx’s support of the ARPA language model format [20] and the Java Speech Grammar Format (JSGF), there … Cited by 3 Related articles All 15 versions

An architecture to develop multimodal educative applications with chatbots D Griol, Z Callejas – International Journal of Advanced Robotic …, 2013 – search.proquest.com … as Speech Graffiti, is to design a universal interface independent of the application domain to facilitate the development of dialogue systems. … Grammars are encoded following the Java Speech Grammar Format (JSGF, www.w3.org/TR/jsgf/), supported by any VoiceXML platform … Cited by 7 Related articles All 5 versions

Spoken Language Understanding M McTear, Z Callejas, D Griol – The Conversational Interface, 2016 – Springer … In the examples above, there were utterances about setting alarms, finding restaurants, getting information about spoken dialog systems, and asking about personal feelings. … Dialog state tracking involves estimating a user’s goal in a spoken dialog system. … Related articles All 11 versions

Plan-based social interaction with a robot bartender RPA Petrick, ME Foster – Proceedings of the ICAPS 2013 Application …, 2013 – Citeseer … For speech recognition, we use the Microsoft Kinect and the Microsoft Speech API, with a scenario-specific speech grammar to constrain the … actions are modelled as part of a PKS planning domain, rather than using specialised tools as is common in many dialogue systems. … Cited by 1 Related articles All 3 versions

Multimodal multiparty social interaction with the Furhat head S Al Moubayed, G Skantze, J Beskow… – Proceedings of the 14th …, 2012 – dl.acm.org … Using multimodal input events such as speech input, entry and movements of interlocutors, the demonstrator will show a social dialogue system that supports mixed initiatives (the system and the … 3 http://www.w3.org/TR/speech-grammar/ 4 CereProc ltd: http://www.cereproc.com … Cited by 4 Related articles All 6 versions

Multimodal fusion in human-agent dialogue E André, JC Martin, F Lingenfelser… – Coverbal Synchrony in …, 2013 – books.google.com … Usually, such dialogue systems rely on a personification of the user interface by means of embodied conversational agents or social robots. The driving force behind this work is the insight that a user interface is more likely to be accepted by the user if the machine Page 403. … Cited by 1 Related articles All 5 versions

[BOOK] Practical speech user interface design JR Lewis – 2016 – books.google.com Page 1. PRACTICAL SPEECH USER INTERFACE DESIGN * | || g|| || | ill t- | |M|| || | T” James R. Lewis Page 2. PRACTICAL SPEECH USER INTERFACE DESIGN Page 3. Human Factors and Ergonomics Series … Cited by 17 Related articles All 7 versions

The Geranium System: Multimodal Conversational Agents for E-learning D Griol, JM Molina, AS de Miguel – Distributed Computing and Artificial …, 2014 – Springer … In our system, grammars are encoded following the Java Speech Grammar Format (JSGF, www.w3.org/TR/jsgf/), supported by any VoiceXML … Expert Systems with Applications 38(5), 5486–5499 (2011) 3. Roda, C., Angehrn, A., Nabeth, T.: Dialog systems for Advanced Learning … Related articles All 3 versions

Data-Driven Methods in Industrial Spoken Dialog Systems R Pieraccini, D Suendermann – … for Adaptive Spoken Dialogue Systems, 2012 – Springer … http://www.w3.org/TR/2004/REC-speech-grammar-20040316 (2004). 8. Levin, E., Pieraccini, R., Eckert, W.: A stochastic model of human-machine interaction for … 8(1), 11–23 (2000)CrossRef. 9. Levin, E., Pieraccini, R.: Value-Based Optimal Decision for Dialog Systems. … Cited by 1 Related articles All 4 versions

Mobile radiology interaction and decision support systems of the future D Sonntag, S Zillner, P Ernst, C Schulz… – Towards the Internet of …, 2014 – Springer … dialog system on the iPad and iPhone, which is tuned for the radiology domain and makes the complete system unique. Our solution not only provides more robustness compared to speech-to-text systems (we use a rather small, dedicated, and context-based speech grammar … Cited by 3 Related articles All 3 versions

Giving Voice to the Internet by Means of Conversational Agents D Griol, AS de Miguel, JM Molina – International Conference on Intelligent …, 2014 – Springer … Pietquin and Dutoit [5] described a similar proposal based on a graphical inter- face dedicated to ease the development of VoiceXML-based dialog systems. The … system. Speech grammars are not automatized by the proposal. … Related articles All 3 versions

Conversational Interfaces: Past and Present M McTear, Z Callejas, D Griol – The Conversational Interface, 2016 – Springer … 4.2.1 A Typical Interaction with a Spoken Dialog System. The following example illustrates the sorts of issues that were being addressed in spoken dialog systems research in the period from the early 1990s to up around 2000. … 4.2.3 Spoken Dialog Systems. … Related articles

[BOOK] Voice application development for Android MF McTear, Z Callejas – 2013 – books.google.com … He has been researching in the field of spoken dialogue systems for more than15years and isthe author ofthe widely used text book SpokenDialogue Technology: Towardthe Conversational User Interface(Springer Verlag, 2004). … Cited by 22 Related articles All 5 versions

SiAM-dp: an open development platform for massively multimodal dialogue systems in cyber-physical environments R Neßelrath – 2016 – scidok.sulb.uni-saarland.de Page 1. SiAM-dp: An open development platform for massively multimodal dialogue systems in cyber-physical environments Robert Neßelrath … 21 2.2.5 Presentation Planning and Multimodal Fission . . . . . 24 2.3 Dialogue Systems . . . . . … Related articles All 2 versions

Speaky for robots: the development of vocal interfaces for robotic applications E Bastianelli, D Nardi, LC Aiello, F Giacomelli… – Applied …, 2016 – Springer Page 1. Appl Intell DOI 10.1007/s10489-015-0695-5 Speaky for robots: the development of vocal interfaces for robotic applications Emanuele Bastianelli1 · Daniele Nardi1 · Luigia Carlucci Aiello1 · Fabrizio Giacomelli2 · Nicolamaria Manes2 … Cited by 1 Related articles All 4 versions

Timed Petri nets for fluent turn-taking over multimodal interaction resources in human-robot collaboration C Chao, A Thomaz – The International Journal of Robotics …, 2016 – ijr.sagepub.com … In speech-only dialogue systems, the speaking floor is the only resource, so explicit resource modeling is often disregarded. … The diversity of these cues demonstrates the highly multimodal nature of the turn-taking process. 2.3. Spoken dialogue systems. … Related articles

Natural language processing: past, present and future DA Dahl – Mobile Speech and Advanced Natural Language …, 2013 – Springer … Retrieved November 9, 2012, from http://www.w3.org/TR/speech-grammar/. Jackson E et al (1991) A template matcher for robust NL … Retrieved November 9, 2012, from http://www.w3.org/TR/emma/. Jokinen K, McTear M (2010) Spoken dialog systems. … Cited by 2 Related articles All 4 versions

Approaching qualitative spatial reasoning about distances and directions in robotics G Gemignani, R Capobianco, D Nardi – Congress of the Italian Association …, 2015 – Springer … Finally, in [5] a sophisticated robot is described, equipped with a symbolic high-level spoken dialogue system that uses Discourse Representation Structures [6] to represent the meaning of the dialogues that occur with user. … 2 http://www.w3.org/TR/speech-grammar/ Page 8. … Cited by 1 Related articles All 5 versions

Children and adults in dialogue with the robot head Furhat-corpus collection and initial analysis. M Blomberg, G Skantze, S Al Moubayed, J Gustafson… – WOCCI, 2012 – speech.kth.se … using a newly developed framework based on the notion of statecharts [8]. Statecharts avoid the problem of state and transition explo- sion that traditional FSMs typically lead to when modelling more complex dialogue systems. … 4 http://www.w3.org/TR/speech-grammar/ Page 3. … Cited by 3 Related articles All 8 versions

Talking with furhat-multi-party interaction with a backprojected robot head S Al Moubayed, J Beskow, M Blomberg, B Granström… – FONETIK 2012, 2012 – Citeseer … Technical setup in the museum The setting of a public exhibition in a museum poses considerable challenges to a multimodal dialogue system. In … cereproc. com/ 3 http://www. w3. org/TR/speech-grammar/ 110 Page 119. FONETIK … Cited by 2 Related articles All 6 versions

MMIR Framework: Multimodal Mobile Interaction and Rendering. A Ruß – GI-Jahrestagung, 2013 – pdfs.semanticscholar.org … mostly on HTML and Javascript for realizing the UI (User Interface) and XML (eXtendible Markup Language) for message exchange; JSGF (Java Speech Grammar Format) is used for specifying the speech grammar used in the … [CLMR12] present a dialog system for multimodal … Cited by 3 Related articles

Face-to-Face with a Robot: What do we actually talk about? N Mirnig, A Weiss, G Skantze… – … Journal of Humanoid …, 2013 – World Scientific … This relieves statecharts from the problem of state and transition explosion that traditional FSMs typically lead to when modeling more complex dialog systems. … c http://www.cereproc.com/. d http://www.w3.org/TR/speech-grammar/. N. Mirnig et al. 1350011-8 Page 9. 4.2. … Cited by 4 Related articles All 4 versions

Towards a Distributed Open-Source Spoken Dialog System Following Industry Standards T von Oldenburg, J Grupp… – ITG-Fachbericht- …, 2012 – vde-verlag.de … Spoken dialog systems have been subject to academic re- search for quite some time. … Even more so, when multiple industrial players sat together and agreed on com- mon standards for speech grammars [4], semantic interpre- tation [5], language models [6], and dialog … Cited by 1 Related articles All 20 versions

Recognizing Young Readers’ Spoken Questions W Chen, J Mostow – International Journal of Artificial …, 2013 – content.iospress.com … When little training data from a real user is available, researchers in dialog systems have built language models from hand written grammars (Jurafsky & Martin … It also shows the equivalent regular expression in Java Speech Grammar Format (JSGF) (Sun.Microsystems, 1998). … Cited by 4 Related articles All 8 versions

Call routing based on a combination of the construction-integration model and latent semantic analysis: A full system G Jorge-Botana, R Olmos, A Barroso – Informatica, 2015 – search.proquest.com … This recognition engine accepts grammars programmed in the standard .grxml (SGRS Speech Grammar Recognition Specification) so it is a good … and No Target Domain Data, in Perception in Multimodal Dialog Systems, Proceedings of the 4th IEEE Tutorial and Research … Cited by 1 Related articles All 13 versions

HIS-OwlSpeak: A Model-Driven Dialogue Manager with Multiple Control Modes S Ultes, W Minker – … (IE), 2013 9th International Conference on, 2013 – ieeexplore.ieee.org … Spoken Dialogue Systems have to deal with uncertainty, eg, regarding the actual user action. … Thus, the domain information, ie, the system actions, the speech grammar, etc., is stored in the model while the view and the presenter, which contains the generic dialogue logic, are … Related articles All 4 versions

Let’s talk! speaking virtual counselor offers you a brief intervention U Yasavur, C Lisetti, N Rishe – Journal on Multimodal User Interfaces, 2014 – Springer … We present our spoken dialog system design and its evaluation. We developed our dialog system based on Markov decision processes framework and optimized it by using rein- forcement learning algorithms with data we collected from real user interactions. … Cited by 4 Related articles All 4 versions

A dynamic dialog system using semantic web technologies M Ababneh – 2014 – ebot.gmu.edu Page 1. A DYNAMIC DIALOG SYSTEM USING SEMANTIC WEB TECHNOLOGIES by … Date: Spring Semester 2014 George Mason University Fairfax, VA Page 2. A Dynamic Dialog System Using Semantic Web Technologies … Related articles All 4 versions

An approach to develop intelligent learning environments by means of immersive virtual worlds D Griol, JM Molina, Z Callejas – Journal of Ambient Intelligence …, 2014 – content.iospress.com … Our ap- proach extends the typical architecture described for spoken dialogue systems with the visual modalities provided by 3D immersive … inte- grated modules for semantic understanding and dia- logue management [25], which are based on speech grammars following the … Cited by 4 Related articles All 8 versions

A spoken dialogue smartphone application for “text and walk/drive” J Takeuchi, M Nakano, Y Todo – Soft Computing and Intelligent …, 2012 – ieeexplore.ieee.org … org/TR/speech-grammar/ IV. … One of our future works is to reduce Japanese text errors caused by homophonic kanji characters in free formatted texts. We also will try to realize more natural dialogues that is important for current spoken dialogue systems. … Cited by 1 Related articles All 2 versions

User-Centred Spoken Dialogue Management F Nothdurft, S Ultes, W Minker – Next Generation Intelligent Environments, 2016 – Springer … Recent work in Spoken Dialogue Systems focuses on the integration of user-centred adaptation means to alter the content, flow and structure of the ongoing dialogue. … For enabling the dialogue system to react adaptively, the AE must be determined. … Related articles All 4 versions

User Satisfaction and Acceptability of Dialogue Systems for Detecting Counterfeit Drugs OM Olufemi – Proceedings of World Academy of Science, …, 2013 – search.proquest.com … A dialogue system or a voice application can therefore, be defined as a computer system that communicates with a human. … The VoiceXML language supports a speech grammar format, namely the XML form of the W3C Speech Recognition Grammar Specification. … Related articles All 4 versions

Social state recognition and knowledge-level planning for human-robot interaction in a bartender domain RPA Petrick, ME Foster, A Isard – AAAI 2012 Workshop on …, 2012 – research.ed.ac.uk … potential solutions to the problem of action selection in task-based interactive systems, as an alternative to more specialised methods, such as those used in many mainstream natural language dialogue systems. … http://www.w3.org/TR/2004/ REC-speech-grammar-20040316/. … Cited by 9 Related articles All 7 versions

Chatbots as interface to ontologies A Augello, G Pilato, G Vassallo, S Gaglio – Advances onto the Internet of …, 2014 – Springer … Even if the simple technology allows to easily implement a dialogue system, the obtained conversation is limited by pattern matching rules on … The speech recognition process is carried out through an “ad-hoc” built-in speech grammar, including a set of rules which specifies … Cited by 3 Related articles All 3 versions

Modern conversational agents D Suendermann-Oeft – Technologien für digitale Innovationen, 2014 – Springer … Kontakt: suendermann@dhbw-stuttgart.de 1 The work described in this chapter was carried out primarily at the Spoken Dialog System Research Center at DHBW Stuttgart. … JSGF (Java Speech Grammar Format) (Hunt 2000) and SRGS (Speech Recognition Grammar … Cited by 4 Related articles All 3 versions

Passing an enhanced Turing test–interacting with lifelike computer representations of specific individuals AJ Gonzalez, J Leigh, RF DeMara… – Journal of Intelligent …, 2013 – degruyter.com … Six hours of recording based on a script derived from the knowledge system was cleaned, manipulated, and produced into a database of utterances that can be combined to create a number of phrases determined by the dialogue system. 4.4 Rendering. … Cited by 2 Related articles All 8 versions

[BOOK] Speech and Language Technology for Language Disorders K Beals, D Dahl, R Fink, M Linebarger – 2015 – books.google.com … 19 Analyzing meaning 19 Information about intermediate structure 24 Converting language to action 25 Limits of current natural language understanding systems 26 Availability of natural-language-processing technology 26 Dialog systems 27 What are dialog systems? … Related articles All 2 versions

Gazing the Text for Fun and Profit R Biedert, G Buscher, A Dengel – Eye Gaze in Intelligent User Interfaces, 2013 – Springer … about various topics which can be queried by the user. As with many dialog systems usually there are multiple ways the user can ask about a certain topic to receive an answer. For example “I want to know what X did.”, “What … Related articles All 3 versions

Development & evaluation of multilingual multimodal dialogue systems on mobile devices N Tsourakis – 2013 – Citeseer … applications in this area. Page 6. We start by presenting our framework for designing multilingual spo- ken dialogue systems on mobile devices. In this respect, we incor- porate two architectures that present different advantages and disad- vantages. … Cited by 1 Related articles All 5 versions

Application of backend database contents and structure to the design of spoken dialog services LF D’Haro, R de Córdoba, JM Montero… – Expert Systems with …, 2012 – Elsevier … The platform also includes accelerations for creating speech grammars and prompts, and the SQL queries for accessing the database at runtime. … Highlights. ? Accelerations strategies to speed up the design of spoken-dialog systems. … Related articles All 13 versions

Using a Discourse and Dialogue Infrastructure for Collaborative Radiology D Sonntag, C Schulz – 35th German Conference on Artificial Intelligence …, 2012 – dfki.de … dialogue system on the iPad and iPhone, which is tuned for the standard- ised radiology reporting process. Our solution not only provides more robust- ness compared to speech-to-text systems (we use a rather small, dedicated, and context-based speech grammar which is … Related articles All 4 versions

Voice-Driven Computer Game in Noisy Environments. A Janicki, D Wawer – IJCSA, 2013 – pdfs.semanticscholar.org … It can be treated as a special type of a dialog system, in which in some cases the game may actually predict what the user … precise and yet flexible language modeling (LM), based most often on N-grams [Young (2008)] or grammars, such as Java Speech Grammar Format (JSGF … Cited by 1 Related articles All 2 versions

An innovative framework to support multimodal interaction with Smart Environments F Gabbanini, L Burzagli, PL Emiliani – Expert Systems with Applications, 2012 – Elsevier Interaction with future coming Smart Environments requires research on methods for the design of a new generation of human–environment interfaces. The paper o. Cited by 2 Related articles All 5 versions

Adapting existing games for education using speech recognition CJ Cai – 2013 – groups.csail.mit.edu … scores and knowledge about dialogue progress, to reduce recognition error rates in dialogue systems for second language learning [41]. However, little research has been … side, we provide the language model written using the JSGF (Java Speech Grammar Format) standard2. … Cited by 2 Related articles All 7 versions

Multimodal Interfaces for Augmented Reality M Billinghurst, M Lee – Expanding the Frontiers of Visual Analytics and …, 2012 – Springer … Speech input was recognized by the Microsoft Speech API and sent to the Ariadne spoken dialog system for spoken dialog understanding. To create a speech grammar structure, objects were imported from an SQL database which contained an OBJECT_NAME attribute for all … Cited by 2 Related articles All 3 versions

A Proposal to Create Learning Environments in Virtual Worlds Integrating Advanced Educative Resources. D Griol, JM Molina, AS de Miguel, Z Callejas – J. UCS, 2012 – jucs.org … Our approach extends the typical architecture described for spoken dialog systems with the visual modalities provided by 3D immersive environments … 2012b], which are based on speech grammars following the W3C SRGS specification (http://www.w3.org/TR/speech-grammar … Cited by 6 Related articles All 8 versions

Statistical Dialog Management for Health Interventions U Yasavur – 2014 – digitalcommons.fiu.edu … Research endeavors on spoken dialogue systems in the 1990s and 2000s have led to the deployment of commercial spoken dialogue systems (SDS) in microdomains … based on the brief intervention counseling style via spoken dialogue systems. … Related articles All 3 versions

Speech as Interface in Web Applications for Visually Challenged P Verma – 2013 – content.grin.com Page 1. Prabhat Verma Speech as Interface in Web Applications for Visually Challenged Doctoral Thesis / Dissertation Computer Science Page 2. Page 3. Bibliographic information published by the German National Library: … Related articles

Bringing together commercial and academic perspectives for the development of intelligent AmI interfaces D Griol, JM Molina, Z Callejas – Journal of Ambient Intelligence …, 2012 – content.iospress.com … di- alog model and construct the speech grammars to then complete the VoiceXML application. The remainder of the paper is organized as follows. Section 2 describes the related work about industrial and research perspectives of the development of spo- ken dialog systems. … Cited by 11 Related articles All 7 versions

Integrating Dialogue Systems with Images I Kope?ek, R Ošlejšek, J Plhák – International Conference on Text, Speech …, 2012 – Springer … Page 8. Integrating Dialogue Systems with Images 639 References … on Internet Computing, ICOMP 2009, pp. 296–300. CSREA Press (2009) 16. Hunt, A., McGlashan, S.: Speech recognition grammar specification version 1.0 (2004), http://www.w3.org/TR/speech-grammar/ 17. … Related articles All 4 versions

Separation of concerns on the orchestration of operations in flexible manufacturing G Veiga, P Malaca, J Norberto Pires… – Assembly …, 2012 – emeraldinsight.com … Statechart XML (SCXML) is a W3C specification (Barnett et al., 2008) that can be described as an attempt to render Harel Statecharts in XML. The aim of this standard is to provide a basis for future standards in the area of multimodal dialogue systems. … Cited by 3 Related articles All 4 versions

[BOOK] The Conversational Interface M McTear, Z Callejas, D Griol – 2016 – Springer … With the evolution of speech recognition and natural language technologies, IVR systems rapidly became more sophisticated and enabled the creation of complex dialog systems that could handle natural language queries and many turns of interaction. … Related articles All 2 versions

VoiceXML for Pervasive Environments S Radomski, D Schnelle-Walka – International Journal of Mobile …, 2012 – igi-global.com Page 1. 18 International Journal of Mobile Human Computer Interaction, 4(2), 18-36, April-June 2012 Copyright © 2012, IGI Global. Copying or distributing in print or electronic forms without written permission of IGI Global is prohibited. … Cited by 3 Related articles All 5 versions

Towards a Persuasive Dialog System Supporting Personal Health Management V Götzmann – 2015 – isl.anthropomatik.kit.edu Page 1. Towards a Persuasive Dialog System Supporting Personal Health Management Bachelor Thesis of Vera Götzmann at the Institute for Anthropomatics and Robotics, Interactive Systems Lab KIT … 1 1.2. Introduction to Spoken Dialog Systems . . . . . … Related articles

Building World Event Representations From Linguistic Representations T Bruland – 2013 – diva-portal.org … In order to build applications like dialogue systems or question- answering systems, we need to create a natural language processing system that can connect the linguistic representations to a domain ontology and then reason with the domain ontology elements. … Cited by 1 Related articles All 8 versions

Towards a UML profile on formal semantics for modeling multimodal interactive systems-concepts for modeling interactive systems using standard tools of software … M Dausend – 2012 – oparu.uni-ulm.de … This redefinition means that the resulting behavior significantly depends on the dialog system processing the model. Goronzy et al. … (b) Stereotypes to integrate multimodal UI aspects to UML state (left to right): graphical elements (?GUI?), speech grammar (?Grammar?) and … Related articles All 6 versions

Manitou: A multimodal interaction platform R Hak, J Dolezal, T Zeman – Wireless and Mobile Networking …, 2012 – ieeexplore.ieee.org … 1 http://www.w3.org/TR/2004/REC-speech-grammar-20040316/ 2 http://www.ietf.org/rfc/rfc4463 … 31-40. [3] M. Johnston et al., “MATCH: An architecture for multimodal dialogue systems,” in Proceedings of the 40th Annual Meeting on Association for Computational Linguistics … Cited by 1 Related articles All 3 versions

Crowd-supervised training of spoken language systems IC McGraw – 2012 – dspace.mit.edu … 33 2-4 The plot above depicts two years of development early in the life of the Jupiter weather information dialogue system. … The second experiment conducted was for a multimodal spoken dialogue system, which we deployed directly inside the mTurk interface. This time, how- … Cited by 5 Related articles All 5 versions

A Framework for Intelligent Voice-Enabled E-Education Systems AA Azeta – 2012 – eprints.covenantuniversity.edu.ng Page 1. A FRAMEWORK FOR INTELLIGENT VOICE-ENABLED E-EDUCATION SYSTEMS BY AZETA, Agbon Ambrose (CUGP050134) A THESIS SUBMITTED TO THE DEPARTMENT OF COMPUTER AND INFORMATION SCIENCES, … Cited by 1 Related articles All 17 versions

Finnish Language Speech Recognition for Dental Health Care S PUHEENTUNNISTUS – 2012 – aaltodoc.aalto.fi Page 1. FINNISH LANGUAGE SPEECH RECOGNITION FOR DENTAL HEALTH CARE SUOMENKIELINEN PUHEENTUNNISTUS HAMMASHUOLLON SOVELLUKSISSA A THESIS SUBMITTED TO THE DEPARTMENT OF INFORMATION AND COMPUTER SCIENCE OF … Related articles All 3 versions

Towards a composite event-based language for describing multimodal interactions F Cuenca Lucero – 2016 – uhdspace.uhasselt.be Page 1. Towards a composite event-based language for describing multimodal interactions Fredy Cuenca Promotor: Prof. Dr. Karin Coninx Copromotor: Prof. Dr. Kris Luyten January 27, 2016 Page 2. i I am weary of my wisdom … Related articles All 3 versions