Talking Heads & Dialog Systems 2014


Notes:

In 2014, half of the number of academic papers were published on “talking heads” in dialog systems than in either of the previous two years, in other words showing a possibly significant declining interest.

See also:

100 Best Robotic Animal VideosTalking Head | Talking Head Papers | Talking Head Researchers | Talking Heads & Dialog Systems 2013


GRASS: The Graz corpus of read and spontaneous speech B Schuppler, M Hagmüller, JA Morales-Cordovilla… – Proceedings of …, 2014 – ugr.es … all speak- ers in the recording studio of the SPSC Laboratory of the Graz University of Technology with a close talking head- set (AKG … These recordings might be used in the future for the study of gestures, which is relevant for the development of multi- modal dialogue systems. … Cited by 7 Related articles All 2 versions

A statistical parametric approach to video-realistic text-driven talking avatar L Xie, N Sun, B Fan – Multimedia Tools and Applications, 2014 – Springer … A dialogue system usually uses a text-driven approach since the spoken text is known. … Video-based approaches can achieve more realistic animations, while model-based approaches are more flexible since the talking head can be rendered in any view and lighting conditions. … Cited by 7 Related articles All 2 versions

Head and facial gestures synthesis using PAD model for an expressive talking avatar J Jia, Z Wu, S Zhang, HM Meng, L Cai – Multimedia Tools and Applications, 2014 – Springer Page 1. Head and facial gestures synthesis using PAD model for an expressive talking avatar Jia Jia & Zhiyong Wu & Shen Zhang & Helen M. Meng & Lianhong Cai © Springer Science+Business Media New York 2013 Abstract … Cited by 5 Related articles All 6 versions

Animated Lombard speech: Motion capture, facial animation and visual intelligibility of speech produced in adverse conditions S Alexanderson, J Beskow – Computer Speech & Language, 2014 – Elsevier … words, there seem to be some tolerance for mismatch in sound and motion in the perception of an animated talking head, but too … This is likely to be a useful feature for eg multimodal dialogue systems or social robots operating in acoustically dynamic or challenging conditions. … Cited by 1 Related articles All 6 versions

Recognizing signals of social attitude in interacting with Ambient Conversational Systems B De Carolis, N Novielli – Journal on Multimodal User Interfaces, 2014 – Springer … signals for providing feedback, showing empathy and emotions in their behavior [2,3]. Multimodal interaction paradigms that combine several modalities are a powerful approach to promote natural and effortless experi- ence [4]. Moreover, multimodal dialog systems allow AmI … Cited by 1 Related articles All 2 versions

Task-based evaluation of context-sensitive referring expressions in human–robot dialogue ME Foster, M Giuliani, A Isard – Language, Cognition and …, 2014 – Taylor & Francis … We then introduce the JAST human–robot dialogue system, which was designed to support similar joint construction tasks together with a … of manipulator arms with grippers, mounted in a position to resemble human arms, along with an animatronic talking head (van Breemen … Cited by 2 Related articles

El-WOZ: a client-server wizard-of-oz interface T Pellegrini, V Hedayati, A Costa – lrec-conf.org … WOZ) plateform. In this setup, users interact with a fake automated dialog system controled by a human wizard. It was implemented as a client-server application and the subjects interact with a talking head. The human wizard … Related articles

User Experience and Social Attribution for an Embodied Spoken Dialog System B Weiss, S Willkomm – ceur-ws.org … 1 Introduction Spoken dialog systems (SDS) can provide a natural and intuitive way of inter- acting due to an interface operated by voice. … This virtual visitor guide is a speech operated system with an audio-visual synthesis in the form of a lip-synchronous talking head. … Cited by 1 Related articles

Toward a Polish Intelligent Virtual Tutor: An Overview Of Existing Work I Truck, M Durand, M Watorek – … in Decision and Control, page to …, 2014 – World Scientific … It consists of a dialogue system planning implemented in Prolog for the tutor’s movements, a rule- based tagging, an expert model to compare given and expected answers Page 5. 476 by latent semantic analysis, and an interface with a talking head (speech synthesis) with … Related articles

Conversational Strategies for Robustly Managing Dialog in Public Spaces A Pappu, M Sun, SSAI Rudnicky – EACL 2014, 2014 – aclweb.org … To implement dialog systems that operate in public spaces, we have to relax some of these constraints and deal with addi- tional challenges. … is a potential interlocutor in the vicinity and their current position, using skele- tal and azimuth information.(3) Talking Head that conveys … Cited by 1 Related articles All 6 versions

A Natural Conversational Virtual Human with Multimodal Dialog System IR Ali, G Sulong, AH Basori – Jurnal Teknologi, 2014 – jurnalteknologi.utm.my … animation video. The development of modules of dialog systems containing integration of voice intonation and correct talking speed is an important future research topic towards the synthesis of human-like talking head. In the … Related articles

Structural Model and Behavior Scenarios of Information Navigation Mobile Robot M Prischepa, V Budkov – Speech and Computer, 2014 – Springer … to the respondents, the most con sensory menus (41% of women and 70% of men), and eans is a “talking head” avatar and … 3), 458–461 (2011) 2. Foster, ME, Giuliani, M., Knoll, A.: Comparing Objective and Subjective Measures of Usability in a Human-Robot Dialogue System. … Cited by 1 Related articles All 3 versions

Natural Communication about Uncertainties in Situated Interaction T Pejsa, D Bohus, MF Cohen, CW Saw… – Proceedings of the 16th …, 2014 – dl.acm.org … For example, dialog systems reason about uncertainties that arise in recognizing natural language via measures of recognition confidence and may employ clarification strategies such as explicit or implicit confirmations to keep a conversation on track. … Related articles All 9 versions

A novel speech synthesizer using 3D facial model with gestures A Rathinavelu, C Sandhiya, K Saranya – International Journal on Disability … – degruyter.com … and is automated as much as possible. An animated talking head can fulfill these needs. Meanwhile, applications involving such multimodal dialogue systems enable humans to interact with systems narrating synthetic voice. … Related articles

Pauses and resumptions in human and in computer speech J Edlund, F Edelstam, J Gustafson – … , June 9-11, 2014 PERILUS XXIV …, 2014 – diva-portal.org … Background Pauses and resumptions in spoken dialogue systems There are a number of good reasons to equip SDSs–be they robots, machines … hourglass (as in a popular computer operating sys- tem) with one where the SDS’s avatar (an animated talking head) simply looks … Related articles All 3 versions

User behavior fusion in dialog management with multi-modal history cues M Yang, J Tao, L Chao, H Li, D Zhang, H Che… – Multimedia Tools and …, 2014 – Springer … An effective multi-modal behavior fusion model and flexible behavior sensitive DM are necessary for practical human computer dialog systems. … In real practice dialog system, V21–V22 could be calculated synchronously with speech recognition. … Cited by 1 Related articles All 2 versions

Conversational Agents in Experiential and Ludic Design MP Aylett, CS Edinburgh – cs.toronto.edu … to create a speech synthesis voice, and using the text of the book to effect the character of the linguistic output from a dialogue system. … to an automated personal assis- tant is to produce a CA with a helpful, attitude free, educated 1www.nutbots.net/talking head 2www.idyacy.com … Related articles

TTS-driven Expressive Embodied Conversation Agent EVA for UMB-SmartTV M Rojc, M Presker, Z Ka?i?, I Mlakar – naun.org … communicative behavior may be evoked, giving the spoken dialogue system within smart TV platforms the ability to shape and adjust the dialogue to … ECA implementations can be in the form of eg talking heads [37], to agents that can move and use the whole representation of … Related articles All 2 versions

History of Conversational System Development T Nishida, A Nakazawa, Y Ohmoto… – Conversational …, 2014 – Springer … In the 1980s, speech dialogue systems were extended to multimodal interfaces. … The agent, Phil, had a life-like appearance. Phil was modeled as an animated talking head embedded in a multimodal interaction environment (Fig. 3.6). … Related articles All 3 versions

Joint audiovisual hidden semi-markov model-based speech synthesis D Schabus, M Pucher, G Hofer – Selected Topics in Signal …, 2014 – ieeexplore.ieee.org … Index Terms—Audiovisual speech synthesis, talking head, facial animation, hidden Markov model, HMM-based speech synthesis, speech synthesis … Likewise, talking virtual agents in dialogue systems need Copyright (c) 2013 IEEE. Personal use of this material is permitted. … Cited by 6 Related articles All 2 versions

AutoTutor and Family: A Review of 17 Years of Natural Language Tutoring BD Nye, AC Graesser, X Hu – … Journal of Artificial Intelligence in Education, 2014 – Springer … Using a domain-independent reactive planner to implement a medical dialogue system. In T. Bickmore (Ed.), AAAI fall symposium on systems for health communication (pp. 24–31). … AutoTutor improves deep learning of computer literacy: Is it the dialog or the talking head? … Cited by 2 Related articles

Tutoring Robots S Al Moubayed, J Beskow, B Bollepalli… – Innovative and Creative …, 2014 – Springer … well as the requirements and development of the different technologies required to build a completely autonomous embodied dialogue system that could … After that, we describe a dialogue sys- tem setup where the human-tutor is replaced with the Furhat embodied talking head. … Related articles All 2 versions

Automatic dialogue act recognition with syntactic features P Král, C Cerisara – Language Resources and Evaluation, 2014 – Springer … 1996 ) or talking head animation. For instance, in dialogue systems, dialogue acts might be used to recognize the intention of the user and thus differentiate situations where the user is requesting some information from situations where the user is simply giving some information … Related articles All 4 versions

Questions, pictures, answers M Theune, B van Schooten, R Op den Akker, W Bosma… – pure.uvt.nl … This Information Assistant is personified in the form of a Dutch-speaking version of the Rutgers University Talking Head (RUTH).2 Regarding the nature and difficulty level … Enabling the user to give feedback on her information need is one of the purposes of our dialogue system. … Related articles

Chatbots as Interface to Ontologies A Augello, G Pilato, G Vassallo, S Gaglio – Advances onto the Internet of …, 2014 – Springer … Even if the simple technology allows to easily implement a dialogue system, the obtained conversation is limited by pattern matching rules … Heylen, D.: Talking head says “Cheese!” humour as an impetus for embodied conversational agent research CHI-2003 workShop: humour … Related articles All 3 versions

Machine Learning for Social Multiparty Human–Robot Interaction S Keizer, M Ellen Foster, Z Wang… – ACM Transactions on …, 2014 – dl.acm.org … The robot hardware consists of a pair of manipulator arms with grippers, mounted to resemble human arms, along with an animatronic talking head capable of producing facial expressions, rigid head motion, and lip-synchronized synthesized speech. … Cited by 3 Related articles

Interacting with Traditional Chinese Culture through Natural Language X Wang, ET Khoo, R Nakatsu, A Cheok – Journal on Computing and …, 2014 – dl.acm.org … language interfaces General Terms: Algorithms, Design Additional Key Words and Phrases: Conversational agents, dialogue systems, intangible cultural … 1999], a talking head representing the Swedish author August Stringberg, which was displayed at the Stockholm Cultural … Related articles

WASABI for affect simulation in human-computer interaction C Becker-Asano – … on Emotion Representations and Modelling for …, 2014 – becker-asano.de … Never- theless, the emotion display is achieved by an animated talking head displayed on a touchscreen attached to the robot. … In: Affective Dialogue Systems. LNAI 3068, Springer (2004) 154–165 25. Damasio, A.: Descartes’ Error, Emotion Reason and the Human Brain. … Cited by 2 Related articles

Generic data processing & analysis architecture of a personal health system to manage daily interactive sessions in patients with major depression A Bresó Guardado – 2014 – riunet.upv.es … Patients interact with the system through a VA which takes the form of a realistic talking head (Figure 4). The VA-patient interaction facilitates the remote … 1 Edinburgh’s School of Informatics was involved on: Coordination of the Project, clinical expertise, and dialogue systems … Related articles All 2 versions

Context?Sensitive Natural Language Generation: From Knowledge?Driven to Data?Driven Techniques N Dethlefs – Language and Linguistics Compass, 2014 – Wiley Online Library … They generate facial displays for a talking head, which are sensitive to the utterance context in terms of its words, its pitch-accent specification … and Lemon (2010) present an interesting application of RL to audience design in the context of a spoken dialogue system, which helps … Cited by 2 Related articles All 3 versions

Wizard of Oz Experimentation for Language Technology Applications: Challenges and Tools S Schlögl, G Doherty, S Luz – Interacting with Computers, 2014 – iwc.oxfordjournals.org … In addition interviewees, especially from the NLP domain, stressed the value of WOZ for collecting data (stated by eight interviewees): You generate data without having a dialogue system and you create from this small dataset, you create simulated environments, and in that … Cited by 1 Related articles All 2 versions

Steps Towards Creating Socially Competent Game Characters J Brusk – 2014 – gupea.ub.gu.se … SCXML State Chart XML SD Social Distance SDS Spoken Dialogue System SISR Semantic Interpretation for Speech Recognition SRGS Speech Recognition Grammar Specification TH Talking Head TTS Text-To-Speech UI User Interface UML Unified Modelling Language … Cited by 3 Related articles All 3 versions

[BOOK] Conversational Informatics: A Data-Intensive Approach with Emphasis on Nonverbal Communication T Nishida, A Nakazawa, Y Ohmoto, Y Mohammad – 2014 – books.google.com … For sure, this text book will become an inspiring resource for students, teachers, and researchers that wish to go beyond traditional dialog systems and investigate the power and potential of social signals in human–computer interaction. Prof. … Cited by 6 Related articles All 3 versions

Triggering effective social support for online groups R Kumar, CP Rosé – … Transactions on Interactive Intelligent Systems (TiiS …, 2014 – dl.acm.org … In line with recent developments in data-driven approaches for building dialog systems, we present a novel technique for learning behavior- specific triggering policies, deploying it as part of our efforts to improve a socially capable conversational tutor agent that supports … Cited by 2 Related articles

An Empathic Virtual Buddy for Social Support JM Van der Zwaan – 2014 – repository.tudelft.nl Page 1. Page 2. Page 3. An Empathic Virtual Buddy for Social Support Page 4. Page 5. An Empathic Virtual Buddy for Social Support Proefschrift ter verkrijging van de graad van doctor aan de Technische Universiteit Delft, op gezag van de Rector Magnificus prof. ir. … Cited by 1 Related articles All 2 versions