Talking Heads & Dialog Systems 2011

See also: 

100 Best Robotic Animal VideosTalking Head | Talking Head Papers | Talking Head Researchers | Talking Heads & Dialog Systems 2010 

Emotion representation, analysis and synthesis in continuous space: A survey [PDF] from H Gunes, B Schuller, M Pantic… – Automatic Face & …, 2011 – … The difference between a Spoken Dialogue System and an ECA lies in the latter ‘having an identity and a persona’ [99]. … both quantised and continuous) representation and prediction of emo- tions, ranging from human-computer (eg, Sensitive Talking Heads [107], Sensitive … Cited by 16 – Related articles – All 7 versions

Realistic facial expression synthesis for an image-based talking head K Liu… – Multimedia and Expo (ICME), 2011 IEEE …, 2011 – … information services and video games has been the focus of the computer graphics community in recent years [1]. These applications will use facial animation techniques combined with dialog systems extensively in the future [2]. The current image-based talking heads [2] [3 … Cited by 1 – Related articles – All 2 versions

The IMIX demonstrator: An information search assistant for the medical domain D Hofs, B Schooten… – Interactive Multi-modal Question- …, 2011 – Springer … Enabling the user to give feedback on their information need is one of the purposes of the dialogue system. … The right corner shows RUTH, the talking head. The buttons allow the user to select the input modality, speech or text, and to signal the start of a new dialogue. … Cited by 1 – Related articles – All 2 versions

Czech senior COMPANION: wizard of Oz data collection and expressive speech corpus recording and annotation [PDF] from M Gruber, M Legát, P Ircing, J Romportl… – … . Challenges for Computer …, 2011 – Springer … No dialogue system can be designed without prior knowledge about the specifics of the conversations that such system is going to deal with … Only the speech produced by a computer was genuinely generated using a TTS system coupled with 3D avatar (“talking head”) [4], which … Cited by 1 – Related articles – All 5 versions

Multi-modal dialogue system with sign language capabilities M Hrúz, P Campr, Z Krnoul, M Železný… – The proceedings of the …, 2011 – … the concatenation that puts together trajectories of hands with the articulatory trajectories generated by the talking head system and provides the control over a signed utterance. Reader can find more details in [2]. 4. CONCLUSION We have presented a dialogue system with SL … Related articles

Quality of Experiencing Multi-Modal Interaction B Weiss, S Möller, I Wechsung… – Spoken Dialogue Systems …, 2011 – Springer … Other factors have also an significant impact on over- all quality of talking heads: Ie overall system quality, how entertaining the embodiment is due to non … The last scenario presented here are multi-modal dialog systems which can be controlled by different input modalities. … Related articles

[PDF] An Emotional Talking Head for a Humoristic Chatbot [PDF] from A Augello, O Gambino, V Cannella, R Pirrone… – … The research in human-computer interaction on conversational agents, named also chatbots, and natural language dialogue systems equipped with audio-video interfaces has grown as well. … These kind of systems are called Talking Heads. … Related articles – View as HTML – All 2 versions

Audio-Visual Isolated Words Recognition for Voice Dialogue System [PDF] from J Chaloupka – Analysis of Verbal and Nonverbal Communication and …, 2011 – Springer … We have developed several multimodal voice dialog systems in our lab where audio-visual speech synthesis (talking head) is included [1]. We would like to add a subsystem for audio- visual automatic speech recognition (AV ASR) to our multimodal voice dialogue system; we … Related articles – All 3 versions

Head X: Customizable Audiovisual Synthesis for a Multi-purpose Virtual Head M Luerssen, T Lewis… – AI 2010: Advances in Artificial …, 2011 – Springer … 436-447. Springer, Berlin (2004) 7. Massaro, DW: From multisensory integration to talking heads and language learn- ing. In: Calvert, G., Spence, C., Stein, BE (eds.) Advances in Natural, Multimodal Dialogue Systems, pp. 153-176. … Related articles

Animated Faces for Robotic Heads: Gaze and Beyond S Al Moubayed, J Beskow, J Edlund… – Analysis of Verbal and …, 2011 – Springer … give access to. Keywords: Facial Animation, Talking Heads, Shader Lamps, Robotic Heads, Gaze, Mona Lisa Effect, Avatar, Dialogue System, Situated In- teraction, 3D Projection, Gaze Perception. 1 Introduction During the … Cited by 1 – Related articles – All 2 versions

On the development of a talking head system based on the use of PDE-based parametic surfaces M Athanasopoulos, H Ugail… – … on computational science …, 2011 – Springer … Real-time dialog systems can include personality, emotions and interactive dialog in a human-computer or computer-computer sit- uation. … with the use of chatterbots where actions such as personality, emotions and respond can be in- tegrated within the talking head system [2 … Related articles – All 3 versions

Hierarchical dialogue system for guide robot in shopping mall environments M Prischepa… – Text, Speech and Dialogue, 2011 – Springer … The template-based models for key phrases were prepared in each sub-dialogue for promotion, inquiry, and guide modes of the mobile robot. Keywords: Spoken dialogue system, dialogue management, multimodal inter- faces, talking head, speaker localization. 1 Introduction … Related articles – All 3 versions

Corrected Human Vision System and the McGurk Effect [PDF] from L Kunc… – HCI International 2011-Posters’ Extended Abstracts, 2011 – Springer … Spoken dialog systems provide new interaction modalities for user. … Seeing virtual faces further humanizes computer user interfaces and makes them more acceptable for a common user [2]. For example talking heads provide means for additional nonverbal communication. … Related articles – All 2 versions

Animating a Chinese interactive virtual character [PDF] from K Mu, J Tao… – Machine Learning for Signal …, 2011 – … Since the facial expression is weakened in virtual agent compared to the talking head, the Chinese phoneme-viseme pairs[17] can be simplified for lip movements (shown in Table … All of the actions are designed for each sentence in the dialog system used in the Control Module. … Related articles – All 3 versions

[PDF] Evolution of attention mechanisms for early visual processing [PDF] from T Müller… – Society of Photo-Optical Instrumentation Engineers ( …, 2011 – … The human-robot dialog system being built as part of the project3, 4 is designed as a platform to integrate the projects empirical findings on cognition and dialog with … The robot (Figure 1) consists of a pair of mechanical arms with grippers and an animatronic talking head. … Related articles – View as HTML – All 7 versions

Talking avatar for web-based interfaces [PDF] from J Nunes, L Sá… – … -International Conference on …, 2011 – … Keywords: talking heads; speech animation;model adjustment; … Graph. and App., 2003, pp. 66-75 [3] J. Neto, R. Cassaca, M. Viveiros, M. Mourão, “Design of a multimodal input interface for a dialogue system”, in Proc. Int. Conf. Process. … Related articles – All 2 versions

A multimodal approach of generating 3D human-like talking agent [PDF] from M Yang, J Tao, K Mu, Y Li… – Journal on Multimodal User Interfaces, 2011 – Springer … Text-driven face animation is often applied to an automatic and intelligent dialogue system, in which the speech is usually rendered by a Text-to-Speech (TTS) system. … Natural head motion is an indispensable part of talking head. … Related articles – All 2 versions

[PDF] JAMES: Joint Action for Multimodal Embodied Social Systems [PDF] from R Petrick – 2011 – … Social Skills Executor Output Planner Talking-Head Controller Motion Planner Learned Policies Robot Simulator … Adapt techniques recently applied to spoken dialogue systems. • Social robotics and embodiment (fortiss GmbH, Germany) – Robot simulation framework. … Related articles – View as HTML

Quality aspects of multimodal dialog systems: identity, stimulation and success C Kühnel, B Weiss, M Schulz… – Twelfth Annual Conference …, 2011 – … [3] L. Dybkjær, NO Bernsen, and W. Minker, “Evaluation and us- ability of multimodal spoken language dialogue systems,” Speech Communication, vol. … [17] C. Kühnel, B. Weiss, and S. Möller, “Talking heads for interacting with spoken dialog smart-home systems,” in Proc. … Related articles – All 2 versions

Dialog model development of a mobile information and reference robot V Budkov, M Prishchepa… – Pattern Recognition and Image …, 2011 – Springer … and moving object tracking and human face, and audio-visual synthesis of Rus sian speech as a “virtual talking head.” The integration of … Dialog system development is a complex task, and in dialogue framework development, first of all, expert knowledge of the object domain is … Related articles – All 7 versions

Kinetic Data for Large-Scale Analysis and Modeling of Face-to-Face Conversation J Beskow, S Alexandersson… – Auditory-Visual …, 2011 – … Our own research context is rooted in the technical development of audio-visual synthesis and the deployment of talking head agents in experimental dialogue systems [1,2]. Fundamental research goals for this kind of application are to increase our understanding of how visual … Related articles

System and method for triphone-based unit selection for visual speech synthesis E Cosatto, HP Graf… – US Patent 7,933,772, 2011 – Google Patents … Without this technique, one could not generate photo-realistic talking heads in real time and therefore no interactive applications, such as customer ser- vice, would be … 1. The text can be generated from any source, such as a dialog manager in a spoken dialogue system. … Related articles – All 2 versions

Evaluating Supportive and Instructive Robot Roles in Human-Robot Interaction M Giuliani… – Social Robotics, 2011 – Springer … a pair of manipulator arms with grippers, mounted in position to resemble human arms, and an animatronic talking head [10] capable … function, we employed a procedure similar to that used in the PARADISE evaluation framework (PAradigm for DIalogue System Evaluation) [11 … Related articles – All 2 versions

[PDF] Multilingual and Multimodal Corpus-Based Text-to-Speech System-PLATTOS- [PDF] from M Rojc… – … The need to repeat and the misinterpretation of speaking terms are common features regarding the majority of users. Such behaviour usually leads towards less-functional and less-efficient spoken dialogue systems (Cassell, 2000). … Cited by 1 – Related articles – View as HTML – All 2 versions

On Speech and Gestures Synchrony A Esposito… – … of Verbal and Nonverbal Communication and …, 2011 – Springer … been mainly devoted to model and synchronize speech production and facial movements for implementing more natural “talking heads” or “talking … of this gestural information would bring to the implementation of more natural and user-friendly interactive dialog systems and may … Related articles – All 3 versions

[PDF] Planning for natural language: instruction giving, robot dialogue, and social interaction [PDF] from R Petrick – 2011 – … Dialogue systems are computer systems designed to carry out natural language conversations with human users. A central component of most dialogue systems is the dialogue manager which is responsible for making appropriate conversational moves. … Related articles – View as HTML

Embodied Conversational Characters: Representation Formats for Multimodal Communicative Behaviours B Krenn, C Pelachaud, H Pirker… – Emotion-Oriented Systems, 2011 – Springer … The embodiment of ECAs ranges from talking heads to full-bodied 2D and 3D characters. … VHML (Beard and Reid, 2002)2 is an example for this type of languages. It has been designed for creating interactive multimodal applications with talking heads or full-bodied ECAs. … Related articles – All 2 versions

Predicting Speaker Changes and Listener Responses with and without Eye-Contact [PDF] from D Neiberg… – Twelfth Annual Conference of the …, 2011 – … Adding the appropriate turn-taking cues to a talking head has been found to elicit turn- taking [4]. To mimic human speaker shifts, a dialog system should be able to reproduce the response times between speaker shifts seen in human-human interaction. … Cited by 1 – Related articles – All 3 versions

Intelligent assistance for conversational storytelling using story patterns [PDF] from PY Chi… – Proceedings of the 16th international conference …, 2011 – Page 1. Intelligent Assistance for Conversational Storytelling Using Story Patterns Pei-Yu (Peggy) Chi MIT Media Lab 20 Ames St. Cambridge, MA, USA Henry Lieberman MIT Media Lab & MIT Mind-Machine Project 20 Ames St. … Cited by 2 – Related articles – All 6 versions

Intelligent Tutoring Systems A Keles… – 2011 – … to comprehend learner contributions that are entered by keyboard, for- mulates dialog moves that are sensitive to the learner’s contributions (such as short feedback, pumps, prompts, elaborations, corrections, and hints), and delivers the dialog moves with a talking head. … Related articles – All 3 versions

Trends, Challenges and Opportunities in Spoken Dialogue Research M McTear – Spoken Dialogue Systems Technology and Design, 2011 – Springer … Following this some chal- lenges are identified, in particular, the issues faced by individual researchers and those in small groups who wish to build viable end-to-end dialogue systems and the difficulties that are often encountered by academic researchers when research. … Related articles

Does it really matter whether students’ contributions are spoken versus typed in an intelligent tutoring system with natural language? SK D’Mello, N Dowell… – Journal of Experimental …, 2011 – … information in the same modality. The ITS we tested (AutoTutor, which will be described later) has a talking head with facial expressions, diagrams on the subject matter, and three windows with text information. The visual channel is … Cited by 3 – Related articles – All 4 versions

Bridging the gap between social animal and unsocial machine: A survey of social signal processing [PDF] from A Vinciarelli, M Pantic, D Heylen… – Affective Computing …, 2011 – Page 1. IEEE TRANSACTIONS ON AFFECTIVE COMPUTING 1 Bridging the Gap Between Social Animal and Unsocial Machine: A Survey of Social Signal Processing Alessandro Vinciarelli, Maja Pantic, Dirk Heylen, Catherine … Cited by 5 – Related articles – All 11 versions

Automatic fingersign-to-speech translation system M Hrúz, P Campr, E Dikici, AA Kindiroglu… – Journal on Multimodal …, 2011 – Springer Page 1. J Multimodal User Interfaces DOI 10.1007/s12193-011-0059-3 ORIGINAL PAPER Automatic fingersign-to-speech translation system Marek Hrúz · Pavel Campr · Erinç Dikici · Ahmet Alp Kindiro?glu · Zdenek Kr noul · Alexander … Related articles – All 2 versions

[PDF] Enhancement of Conversational Agents by Means of Multimodal Interaction [PDF] from R López-Cózar, Z Callejas, G Espejo… – Conversational Agents and …, 2011 – … Many multimodal agents adopt a graphical human-like appearance in order to provide a more natural and friendly interaction to the user. De- pending on the portion of body shown on screen, they are usually called Talking Heads or Embodied Conversational Agents (ECAs). … View as HTML – All 5 versions

Approaches to Verbal Persuasion in Intelligent User Interfaces M Guerini, O Stock, M Zancanaro… – Emotion-Oriented …, 2011 – Springer … on. For instance, a talking head may express the mood of the message origina- tor, a music theme may emphasize a given emotional aspect, or simply, a relevant image can be combined with the produced text. Multimodality … Cited by 2 – Related articles

ELECTRONIC PERSONAL INTERACTIVE DEVICE A Poltorak – US Patent 20,110,283,190, 2011 – … To achieve this result, Beskow makes use of neural networks. Beskow further notes several uses of “talking heads”. . These include virtual language tutors, embodied conversational agents in spoken dialogue systems, and talking computer game characters. … Cached – All 2 versions

Introducing interactive story creators to conversation modelling U Spierling – Proceedings of the 8th International Conference on …, 2011 – … Figure 1. General model of a spoken dialogue system. … The available prototyping system [22] connects animated 3D talking heads to several chatbots, ad-hoc audibly speaking via a text-to-speech (TTS) system, while the user types text as input. … Related articles

Fundamentals of agent perception and attention modelling [PDF] from C Peters, G Castellano, M Rehm, E André… – Emotion-Oriented …, 2011 – Springer … movements to point towards objects of interest). Their experiments on the interaction between a realistic talking head and a user during a virtual card game study the growth of user’s interest. Most of the previous approaches process … Cited by 1 – Related articles – All 9 versions

Face Synthesis [PDF] from Y Wang, Z Liu… – Handbook of Face Recognition, 2011 – Springer … Many human-machine dialog systems use realistic-looking human faces as visual representation of the computer agent that interacts with the human user. Face synthesis techniques have also been used for talking head compression in the video conferencing scenario. … Related articles – All 2 versions

My science tutor: A conversational multimedia virtual tutor for elementary school science [PDF] from W Ward, R Cole, D Bolaños… – ACM Transactions on …, 2011 – … While spoken dialogue systems have been developed for science tutoring for university-level students, and for children for reading and lan- guage assessment, we have no … In comparisons of programs with and without talking heads or human voices, children learned more and … Cited by 8 – Related articles – All 3 versions

State-of-the-art of Virtual Reality technologies for children on the autism spectrum [DOC] from S Parsons… – European Journal of Special Needs …, 2011 – Taylor & Francis … [CrossRef], [PubMed], [Web of Science (r)] View all references) developed a three-dimensional computer-animated talking head (called ‘Baldi … workshop on language-enabled educational technology and development and evaluation of robust spoken dialogue systems at the 17th … Cited by 6 – Related articles – All 3 versions

Two acts of social intelligence: the effects of mimicry and social praise on the evaluation of an artificial agent M Kaptein, P Markopoulos, B de Ruyter… – AI & Society, 2011 – Springer Page 1. ORIGINAL ARTICLE Two acts of social intelligence: the effects of mimicry and social praise on the evaluation of an artificial agent Maurits Kaptein • Panos Markopoulos • Boris de Ruyter • Emile Aarts Received: 26 February … Related articles – All 5 versions

Synthesizing mood-affected signed messages: Modifications to the parametric synthesis F López-Colino… – International Journal of Human-Computer …, 2011 – Elsevier … Most extended embodied agents are displayed as talking heads (Beskow, 2004); their basic implementation is focused only on visual speech synthesis by means of lip movements. However, the studies performed by Brave et al. … Related articles

[PDF] In search of the conversational homunculus [PDF] from J EDLUND – 2011 – … [Wallers et al., 2006] BOOK CHAPTER Jonas Beskow, Jens Edlund & Magnus Nordstrand (2005): A model for multi-modal dialogue system output applied to an animated talking head. This paper describes a formalism for describing multimodal dialogue system output. … Related articles – View as HTML – All 2 versions

Conversational interfaces for task-oriented spoken dialogues: design aspects influencing interaction quality [PDF] from AI Niculescu – 2011 – … Thus, conversational interfaces is a global term which can refer to an interactive voice user interface, a spoken dialogue system, a multimodal question … The an- swers consisting of text and images were displayed on the screen and spoken by an anthropomorphic talking head. … Related articles – All 4 versions

[PDF] The Virtual Language Teacher [PDF] from P Wik – 2011 – … A different type of feedback, similarity measures, is investigated, and two different ways to interact with the VLT with- in the Simicry paradigm are explored. Chapter 9 opens with an introduction to spoken dialogue systems and how they may be utilized for CALL purposes. … Related articles – View as HTML – All 4 versions

[BOOK] Handbook of natural language processing and machine translation: DARPA global autonomous language exploitation J Olive – 2011 – … was aimed. For dictation, WER above 10 percent is not acceptable, but for a dialogue system, a much higher rate can be tolerated as long as the system can enable a user to complete a specific task successfully. Initial studies … Cited by 6 – Related articles – Library Search – All 5 versions

Impact of different speech interfaces of personal devices on users’ perception [PDF] from M Wadea – 2011 – Page 1. IMPACT OF DIFFERENT SPEECH INTERFACES OF PERSONAL DEVICES ON USERS’ PERCEPTION Mazen Wadea A thesis submitted to Auckland University of Technology in partial fulfilment of the requirements for the degree of … Related articles