Talking Heads & Dialog Systems 2013

Notes:

  • Artificial companion
  • Interactive online character
  • Robotic companion
  • Virtual companion

Wikipedia:

See also:

100 Best Robotic Animal VideosTalking Head | Talking Head Papers | Talking Head Researchers | Talking Heads & Dialog Systems 2014


D64: A corpus of richly recorded conversational interaction C Oertel, F Cummins, J Edlund, P Wagner… – Journal on Multimodal …, 2013 – Springer … A statistical model of conversational involvement might be used in a third-party observers scenario such as in the case of a talk show moderator. A talking head such as the “Furhat talking head” [2] could be used to moderate a conversation. … Cited by 40 Related articles All 15 versions

The Furhat Back-Projected Humanoid Head–Lip Reading, Gaze And Multi-Party Interaction SAL MOUBAYED, G Skantze… – International Journal of …, 2013 – World Scientific … Keywords: Robot head; humanoid; android; facial animation; talking heads; gaze; Mona Lisa e?ect; avatar; dialog system; situated interaction; back-projection; gaze perception; Furhat; lip reading; multimodal interaction; multiparty interaction. 1. Introduction … Cited by 14 Related articles All 4 versions

Which ASR should I choose for my dialogue system F Morbini, K Audhkhasi, K Sagae, R Artstein… – Proceedings of the 14th …, 2013 – sail.usc.edu … All spoken dialogue systems are similar in some respects, in that there is speech by a user (or users) that needs to be recognized, and this … Will the audio be clean, coming from a close-talking head or lapel-mounted microphone, or will it need to be picked up from a broader … Cited by 11 Related articles All 12 versions

Training and evaluation of an MDP model for social multi-user human-robot interaction S Keizer, ME Foster, O Lemon, A Gaschler… – Proceedings of …, 2013 – sigdial.org … In spoken dialogue systems research, statisti- cal methods for spoken language understanding, dialogue management, and natural language gen- eration have … with vision and speech input processing modules, as well as modules controlling two robot arms and a talking head. … Cited by 15 Related articles All 8 versions

Comparing task-based and socially intelligent behaviour in a robot bartender M Giuliani, R Petrick, ME Foster, A Gaschler… – Proceedings of the 15th …, 2013 – dl.acm.org … Parser State Manager Planner/ Execution Monitor Output Planner Talking-Head Controller Robot Motion Planner … Sit- ting on the main robot torso is an animatronic talking head capable of producing facial expressions, rigid head motion, and synthesised speech. … Cited by 13 Related articles All 7 versions

Planning for Social Interaction in a Robot Bartender Domain. RPA Petrick, ME Foster – ICAPS, 2013 – homepages.inf.ed.ac.uk … Sitting on the main robot torso is an animatronic talking head capable of producing facial expressions, rigid head motion, and lip-synchronised … part of a simple PKS planning domain, rather than using specialised tools as is common practice in many modern dialogue systems. … Cited by 16 Related articles All 4 versions

Multimodal synthesizer for Russian and Czech sign languages and audio-visual speech A Karpov, Z Krnoul, M Zelezny, A Ronzhin – Universal Access in Human- …, 2013 – Springer … blind and non-disabled people, so it is the universal synthesizer designed especially for HCI, interactive dialogue systems, and communication … urgency of the system and positively estimated intelligibility and naturalness of lips articulation of the talking head and recognizability … Cited by 3 Related articles All 2 versions

Avatar and dialog turn-yielding phenomena L Kunc, Z Míkovec, P Slavík – International Journal of Technology …, 2013 – igi-global.com … In this work we employ ECA in a spoken dialog system to assess its ability to transmit turn-yielding cues well enough for a … complex turn- yielding signals is done in this experiment where participants watch and listen to videos of conversation between a talking head avatar as … Cited by 3 Related articles All 3 versions

The furhat social companion talking head. S Al Moubayed, J Beskow, G Skantze – INTERSPEECH, 2013 – speech.kth.se The Furhat Social Companion Talking Head … The demonstrator will present a social dialogue system with Furhat that allows for several simultaneous interlocutors, and takes advantage of several verbal and nonverbal input signals such as speech input, real-time multi-face … Cited by 1 Related articles All 6 versions

Production and delivery of interactive narratives based on video snippets W Müller, U Spierling, C Stockhausen – Interactive Storytelling, 2013 – Springer … The platform’s procedural output, 3D talking heads (in Java 3D) with real-time syn- thetic text-to-speech (TTS), has been ideal during the development process … Concluding, the system is not to be compared with a general conversational dialog system, as it pursues different goals … Cited by 5 Related articles All 3 versions

3D Talking-Head Mobile App: A Conceptual Framework for English Pronunciation Learning among Non-Native Speakers AZM Ali, K Segaran – English Language Teaching, 2013 – ccsenet.org … Berlin: Springer. Massaro, DW (2006b). The psychology and technology of talking heads: Applications in Language Learning. In O. Bernsen, L. Dybkjaer, & J. van Kuppevelt (Eds.), Natural, Intelligent and Effective Interaction in Multimodal Dialogue Systems (pp. 183-214). … Cited by 2 Related articles All 4 versions

Design of Dialog-Based Intelligent Tutoring Systems to Simulate Human-to-Human Tutoring S D’Mello, A Graesser – Where Humans Meet Machines, 2013 – Springer … are conversationally smooth. We move beyond the basic AutoTutor system to novel dialog systems that model and respond to emotions and disengagement behaviors in addition to knowledge levels. These include systems … Cited by 3 Related articles All 3 versions

Enhancing human-robot interaction by a robot face with facial expressions and synchronized lip movements V Seib, J Giesen, D Grüntjens, D Paulus – 2013 – otik.uk.zcu.cz … Further information is available at http://ros.org/wiki/agas-ros-pkg. Keywords Robot Face, Talking Head, Animated Dialogue System, Human-Robot Interaction, ROS 1 INTRODUCTION In recent years robots have found their ways into many homes around the world. … Cited by 3 Related articles All 5 versions

Development and validation of the conversational agents scale (CAS). I Wechsung, B Weiss, C Kühnel, P Ehrenbrink… – …, 2013 – dev.qu.tu-berlin.de … [4] Larsen, LB, “Assessment of spoken dialogue system usability – what are we really measuring?”, in Proccedings of EUROSPEECH 2003, 1945–1948, 2003. … [13] Weiss, B., Kühnel, C., Wechsung, I., Fagel, S., Möller, S., “Quality of talking heads in different interaction and media … Cited by 2 Related articles All 3 versions

How can i help you’: comparing engagement classification strategies for a robot bartender ME Foster, A Gaschler, M Giuliani – Proceedings of the 15th ACM on …, 2013 – dl.acm.org … to resemble hu- man arms. Sitting on the main robot torso is an animatronic talking head capable of producing facial expressions, rigid head motion, and lip-synchronised synthesised speech. The robot bartender sup- ports … Cited by 12 Related articles All 3 versions

Co-present or Not? J Edlund, S Al Moubayed, J Beskow – Eye Gaze in Intelligent User …, 2013 – Springer … J Robot Mechatron 18(4):504–505. Hjalmarsson A, Wik P, Brusk J (2007) Dealing with DEAL: a dialogue system for conversation training. … 100:78–100 CrossRef. Kuratate T, Matsusaka Y, Pierce B, Cheng G (2011) Mask-bot: a life-size robot head using talking head animation for … Cited by 1 Related articles

Tutoring Robots: Multiparty multimodal social dialogue with an embodied tutor S Al Moubayed, J Beskow, B Bollepalli… – 2013 – people.bath.ac.uk … well as the requirements and development of the different technologies required to build a completely autonomous embodied dialogue system that could … After that, we describe a dialogue sys- tem setup where the human-tutor is replaced with the Furhat embodied talking head. … Cited by 1 Related articles All 5 versions

[BOOK] A survey of listener behavior and listener models for embodied conversational agents E Bevacqua – 2013 – books.google.com … Nakano et al.(1999) developed a spoken dialogue system, called WIT, that enables robust utterance understanding and real-time listener’s … INES, graphically represented by a talking head, provides emotional feedback according to the level of correctness of the student’s actions … Cited by 1 Related articles All 5 versions

Talking Head Animation as Pedagogical Agent in Language Learning: A Review on Instructional Strategy and Media K Segaran, AZM Ali, TW Hoe – Malaysian Journal of Distance …, 2013 – mjde.usm.my … Berlin: Springer. ———. 2006b. The psychology and technology of talking heads: Applications in language learning. In Natural, intelligent and effective interaction in multimodal dialogue systems, eds. O. Bernsen, L. Dybkjaer and J. van Kuppevelt, 183–214. … Related articles

Understanding computer-directed utterances in multi-user dialog systems D Wang, D Hakkani-Tur, G Tur – Acoustics, Speech and Signal …, 2013 – ieeexplore.ieee.org … In a multi-user, multi-domain dialog system, where the users can switch topics of their utterances, parts of the conversational context may not be relevant for interpreting … The continuous stream of user utterances are also captured by individual close-talking head- set microphones … Cited by 1 Related articles All 7 versions

Situated multiparty interaction between humans and agents A Pappu, M Sun, S Sridharan, A Rudnicky – Human-Computer Interaction. …, 2013 – Springer … is significantly clearer (p < 0.05 for each question) when talking head is used. Fig.5 describes the subjective questions and the average score, variance of each question. 5 Conclusion In this study, we designed and implemented a multiparty spoken dialog system which can … Cited by 2 Related articles All 4 versions

Deploying speech interfaces to the masses A Pappu, A Rudnicky – Proceedings of the companion publication of the …, 2013 – dl.acm.org … Phone and situated dialog systems use standard voice activity detection techniques to seamlessly interact with a user. … The front-end is sim- ilar to one used in the first application with talking head (using gif images) instead of streetview. … Related articles All 2 versions

Evaluating a synthetic talking head using a dual task: Modality effects on speech understanding and cognitive load CJ Stevens, G Gibert, Y Leung, Z Zhang – International Journal of Human- …, 2013 – Elsevier … method and manipulating key variables of interest, the present study develops a dual task paradigm to gauge sensitively the cognitive demand imposed by the presence of a synthetic talking head. … (2010) to evaluate interface decisions in spoken dialogue systems, the dual task … Related articles All 5 versions

Towards rich multimodal behavior in spoken dialogues with embodied agents S Al Moubayed – … ), 2013 IEEE 4th International Conference on, 2013 – ieeexplore.ieee.org … Multimodal dialogue systems typically have a visual representation (or embodiment) with which they can transfer information through bodily movements, and a set of … The solution to build a talking head using the technique used in Furhat is superior in that: 1) Using a three … Related articles All 3 versions

Technology and Phonetics R Hincks – The Encyclopedia of Applied Linguistics, 2013 – Wiley Online Library … in speech synthesis focus, for example, on adding a visual component by integrating the synthesis with an embodied agent, or talking head (Beskow, 2003 … ASR is a key component of dialogue systems for communicating with computers, but it is only the first step in the process. … Related articles All 3 versions

Intelligent facial animation. J Serra – FDG, 2013 – fdg2013.org … model will be implemented to generate realis- tic facial animation, possibly based on step 4. After this, a talking head that combines … it will have great impact not only in casual videogames and films, but also other interactive applications such as dialogue systems and in serious … Related articles

Plan-Based Social Interaction with a Robot Bartender RPA Petrick, ME Foster – macs.hw.ac.uk … Talking-Head Controller Robot Motion Planner … Planning Interactions for Social Behaviour The robot’s available high-level actions are modelled as part of a PKS planning domain, rather than using specialised tools as is common in many dialogue systems. For instance, Page 4. … Related articles All 2 versions

On the Modelling of Prosodic Cues in Synthetic Speech–What are the Effects on Perceived Uncertainty and Naturalness? E Lasarcyk, C Wollermann, B Schröder… – Natural Language …, 2013 – coli.uni-saarland.de … [17] Marsi, E., Rooden, F. van (2007) Expressing Uncertainty with a Talking Head in a Multimodal Question-Answering System. … [20] Pon-Barry, H., Schultz, K., Bratt, EO, Clark, B., Peters, S. (2006) Responding to Student Uncertainty in Spoken Tutorial Dialogue Systems. … Related articles All 2 versions

Development & evaluation of multilingual multimodal dialogue systems on mobile devices N Tsourakis – 2013 – archive-ouverte.unige.ch … applications in this area. Page 7. We start by presenting our framework for designing multilingual spo- ken dialogue systems on mobile devices. In this respect, we incor- … In the avatar version the talking head changes its expression according to the recognition result . . . . . … Related articles All 2 versions

MRI in linguistics and its applications: interdisciplinary approach G Kedrova, N Anisimov – istina.msu.ru … The German ‘talking head’ – 2D and 3D articulatory model gave very encouraging results in therapy of speech disorders even with young children [41]. … 2011. [36] Hjalmarsson A., Wik P. & Brusk J. Dealing with DEAL: a dialogue system for conversation training // Proceedings of … Related articles All 2 versions

Conversational Agents as Full-Pledged BDI Agents for Ambient Intelligence A Mustapha, MS Ahmad, A Ahmad – Ambient Intelligence-Software and …, 2013 – Springer … Aside from the interpreter, dialogue manager and response generator, a dialogue system may consists input decoder such as for speech, handwriting or ges- tures and output renderer such a text-to-speech (TTS) engine, avatar or a talking head. … Related articles All 3 versions

Avatar Therapy: an audio M Huckvale – researchgate.net … An important parameter in the design of a dialogue system with a synthetic voice is the method of generating the synthetic utterances … to creating the separation between the therapist and the avatar is ensuring that only the avatar’s utterances are passed through the talking head. … Related articles All 2 versions

Interaction style detection based on Fused Cross-Correlation Model in spoken conversation WL Wei, CH Wu, JC Lin, H Li – Acoustics, Speech and Signal …, 2013 – ieeexplore.ieee.org … human- computer interaction. Since speakers generally express their intents in different Interaction Styles (ISs), the responses of a spoken dialogue system should be versatile instead of invariable and planned. This paper presents … Related articles

Challenges Of Natural Language Communication With Machines. V DELIC, M SECUJSKI, N JAKOVLJEVIC… – DAAAM International …, 2013 – daaam.info … words: automatic speech recognition, text-to-speech synthesis, emotions in human-machine interaction, human-machine dialogue systems, challenges for … systems appropriate visual output can be generated as well (eg a talking head), enhancing the efficiency and naturalness … Cited by 1 Related articles All 2 versions

Computer-Assisted Language T Kawahara, N Minematsu, S Aspect – ar.media.kyoto-u.ac.jp … Page 5. Visual Presentation of Articulation • Talking Head showing correct articulation [Massaro 2006] • Acoustic-to-articulatory inversion to estimate the articulatory Tutorial on CALL in INTERSPEECH2012 by T.Kawahara and N.Minematsu 9 … Related articles

Embodied Virtual Agents as a Means to Foster E-Inclusion of Older People D Noy, P Ribeiro, IA Iurgel – A Multimodal End-2-End Approach to …, 2013 – Springer … Social dialogue with embodied conversational agents. In Advances in natural multimodal dialogue systems (pp. 23–54). … CrossRef; Gong, L. (2007). Is happy better than sad even if they are both non-adaptive? Effects of emotional expressions of talking-head interface agents. … Cited by 1 Related articles All 2 versions

Recommendations for the generalized intelligent framework for tutoring based on the development of the deeptutor tutoring service V Rus, N Niraula, M Lintean, R Banjade… – AIED 2013 Workshops …, 2013 – ceur-ws.org … standards for rep- resenting knowledge proposed by the Semantic Web community, standards for au- thoring behavior of dialogue systems (see the … to send the DeepTutor server important information about the user, eg user actions such as turning the talking head off, typed … Cited by 4 Related articles All 3 versions

Evaluation of the MeMo User Simulation—Use Case Inspire Smart Home System KP Engelbrecht – Estimating Spoken Dialog System Quality with User …, 2013 – Springer … K.-P. Engelbrecht, Estimating Spoken Dialog System Quality with User Models, T-Labs Series in Telecommunication Services, DOI: 10.1007/978-3-642-31591-6_3, © Springer-Verlag Berlin … In the second metaphor (”talking head”), a speaking puppet was displayed on a screen. … All 2 versions

AIML Knowledge Base Construction from Text Corpora G De Gasperis, I Chiari, N Florio – Artificial Intelligence, Evolutionary …, 2013 – Springer … Chatbots (or chatter-bots, conversational agents, dialogue systems) are ap- plications that simulate human conversation through a textual … at entertainment and simulation games, are associated to speech synthesis and multidimensional avatars and talking heads and embodied … Related articles All 6 versions

Computational models of expressive behaviors for a virtual agent R Niewiadomski, SJ Hyniewska… – Social Emotions in …, 2013 – books.google.com Page 154. Computational Models of Expressive Behaviors for a Virtual Agent Rados?aw Niewiadomski, Sylwia Julia Hyniewska, & Catherine Pelachaud 1. Introduction Embodied conversational agents, ECAs, are virtual entities with human-like communicative capabili- ties. … Cited by 2 Related articles All 2 versions

Why do survey respondents disclose more when computers ask the questions? LH Lind, MF Schober, FG Conrad, H Reichert – Public opinion quarterly, 2013 – AAPOR We use cookies to enhance your experience on our website. By continuing to use our website, you are agreeing to our use of cookies. You can change your cookie settings at any time. Find out more. Skip Navigation. … Cited by 4 Related articles All 7 versions

Evaluation of Embodied Conversational Agents C Brandão, LP Reis, AP Rocha – Information Systems and …, 2013 – ieeexplore.ieee.org … 28, July 2010 in: http://cleverbot.com [12] Schumaker, Robert P.; Ginsburg, Mark; Chen, Hsinchun and Liu, Ying (2006) Evaluating Mass Knowledge Acquisition using the ALICE Chatterbot: The AZ-ALICE Dialog System in International … literacy: Is it the dialog or the talking head? … Related articles

Characteristics and heuristics of human intelligence DMW Powers – … Intelligence for Human-like Intelligence (CIHLI), …, 2013 – ieeexplore.ieee.org … phonemes by correlating and decorrelating across audio and video streams [16][17], whilst a related variant is simply to untangle speakers by matching components of audio and video streams, and thus determine who’s talking in the context of a Talking Head system for an … Related articles All 4 versions

Metacognition and learning technologies: an overview of current interdisciplinary research R Azevedo, V Aleven – International handbook of metacognition and …, 2013 – Springer … The chapter by Litman and Forbes-Riley focuses on ITSpoke, a dialogue system for quali- tative physics, which engages students in a spo … Typically, the agent is visible in the interface (sometimes as a “talking head,” sometimes dis- played “head to toe”) and produces speech out … Cited by 7 Related articles

Using embodied multimodal fusion to perform supportive and instructive robot roles in human-robot interaction M Giuliani, A Knoll – International Journal of Social Robotics, 2013 – Springer … The robot has a pair of manipulator arms with grippers, mounted in position to re- semble human arms, and an animatronic talking head [31] capable of producing facial expressions, rigid head motion … Multimodal fusion has been applied mainly in multi- modal dialogue systems. … Cited by 1 Related articles All 4 versions

The Effect Of Pedagogical Agents In Learning Conditions And Their Possible Impact On Learning Gains SNAB Mohamad – i-learn.uitm.edu.my … André (2004). Endowing spoken language dialogue systems with emotional intelligence. In Proceedings Affective Dialogue Systems 2004. Springer, Berlin. … AutoTutor improves deep learning of computer literacy: Is it the dialog or the talking head? … Related articles

Speech-enabled Systems for Language Learning A Tewari – 2013 – escholarship.org … targeted at very young children. Massaro in 2003 [51] described Baldy (Figure 2.1), a virtual talking head on a screen with focus on helping users learn how to pronounce the phonemes properly as a virtual teacher. This is by far … Cited by 1 Related articles All 5 versions

Implementation of two variants of the Mixelgram algorithm to perform Audio-Visual Speaker Association P Klaosen – 2013 – wiki.csem.flinders.edu.au … available with 124 subjects, created in 1996 it was designed to assist research in various aspects of visual speech including facial image segmentation, speech/person recognition and the synthesis of talking heads. Although this corpus was not specifically designed for AVSA, …

Intelligent Tutoring of Teams JD Fletcher, RA Sottilare – Design Recommendations for …, 2013 – books.google.com … Because of their dynamic qualities, they are particularly suited to tutorial dialogue systems that must generate instructional and problem solving guidance on demand, in real time. … (2003). AutoTutor improves deep learning of computer literacy: Is it the dialog or the talking head. … Related articles

Formal semantics for perceptual classification S Larsson – Journal of Logic and Computation, 2013 – Oxford Univ Press Page 1. Language Corner Formal semantics for perceptual classification STAFFAN LARSSON, Department of Philosophy, Linguistics and Theory of Science, University of Gothenburg, Box 200, SE40530 Göteborg, Sweden. E-mail: sl@ling.gu.se Abstract … Cited by 8 Related articles All 2 versions

Shared Mental Models of Cognition for Intelligent Tutoring of Teams JD Fletcher, RA Sottilare – Design Recommendations for Intelligent …, 2013 – eduworks.com … Because of their dynamic qualities, they are particularly suited to tutorial dialogue systems that must generate instructional and problem solving guidance on demand, in real time. … (2003). AutoTutor improves deep learning of computer literacy: Is it the dialog or the talking head. … Cited by 2 Related articles All 8 versions

[BOOK] International handbook of metacognition and learning technologies R Azevedo, VA Aleven – 2013 – Springer … across seven sections: Models and Components of Metacognition, Assessing and Modeling Metacognitive Knowledge and Skills, Scaffolding Metacognition and Learning with Hypermedia and Hypertext, Intelligent Tutoring Systems and Tutorial Dialogue Systems, Multi-Agent … Cited by 19 Related articles All 4 versions

Interacting with Philosophy Through Natural Language Conversation W XUAN – 2013 – scholarbank.nus.edu.sg Page 1. INTERACTING WITH PHILOSOPHY THROUGH NATURAL LANGUAGE CONVERSATION WANG XUAN B.Eng.(Hons.), NUS A THESIS SUBMITTED FOR THE DEGREE OF DOCTOR OF PHILOSOPHY NUS GRADUATE SCHOOL FOR INTEGRATIVE … Related articles All 2 versions

[BOOK] The FAT Manual D Quaranta, G Juárez – 2013 – books.google.com Page 1. s’, FAT THE MANUAL SMK Page 2. THE MANUAL Page 3. The FAT Manual Edited by: Domenico Quaranta, Geraldine Juárez Designed by: Fabio Paris Published by: Link Editions, Brescia 2013 www.linkartcenter.eu … Related articles

EAI Endorsed Transactions P Cipresso, M Hoogendoorn, M Klein, A Matic – 2013 – researchgate.net … The structure of the Virtual Agent is more complex. The Virtual Agent consists of a Graphical User Interface (GUI) and a talking head (the “Agent”). … Dialogue System controls the flow of messages, using scripts to ensure the correct wording where clinically relevant. … Related articles

Artificial companions with personality and social role C Clavel, C Faur, JC Martin, S Pesty… – … for Creativity and …, 2013 – ieeexplore.ieee.org Page 1. Artificial Companions with Personality and Social Role Expectations from Users and Impact on the Design of Groups of Companions C. Clavel, C. Faur, J.YC. Martin LIMSIYCNRS Orsay, France {celine.clavel, caroline.faur, martin}@limsi.fr … Cited by 2 Related articles All 6 versions