Notes:
The text discusses the use of virtual humans and robots in various applications, such as training simulations, virtual environments, and remote communication. The virtual humans and robots are equipped with various technologies, including speech recognition, natural language processing, nonverbal behavior generation, and animation, to enable them to interact with users in a natural and realistic manner. The use of these technologies allows virtual humans and robots to mimic human behavior and create a sense of presence in the virtual or physical environment. The text also discusses the use of planning algorithms and behavior generation techniques to enable virtual humans and robots to adapt their behavior to the user and the environment. The text also mentions the importance of creating realistic and believable virtual humans and robots, as well as the challenges involved in achieving this.
Planning algorithms are used in virtual humans to help them make decisions about their actions and behaviors in response to various stimuli and situations. These algorithms are designed to analyze the available data and options, and to determine the most appropriate course of action based on the virtual human’s goals, preferences, and other factors. In the context of virtual humans, planning algorithms are often used to enable the virtual human to engage in natural and realistic behaviors, such as engaging in conversations, navigating complex environments, and responding to various stimuli in a realistic and appropriate manner. They can also be used to help virtual humans adapt and adjust their behaviors over time in response to changing circumstances, allowing them to be more flexible and responsive to their environment.
See also:
SimSensei Kiosk: A virtual human interviewer for healthcare decision support
D DeVault, R Artstein, G Benn, T Dey, E Fast… – Proceedings of the …, 2014 – dl.acm.org
… All core functionalities of SimSensei Kiosk (dialogue processing, multimodal perception, and non- verbal behavior generation) followed this design methodol- ogy … In the experiments reported here, we show the potential of our fully automatic virtual human interviewer in a user …
Human-like behavior generation based on head-arms model for robot tracking external targets and body parts
Z Zhang, A Beck… – IEEE transactions on …, 2014 – ieeexplore.ieee.org
… 8, AUGUST 2015 Human-Like Behavior Generation Based on Head-Arms Model for Robot Tracking … Page 2. ZHANG et al.: HUMAN-LIKE BEHAVIOR GENERATION BASED ON HEAD-ARMS MODEL FOR ROBOT TRACKING EXTERNAL TARGETS AND BODY PARTS 1391 …
Modelling multi-party interactions among virtual characters, robots, and humans
Z Yumak, J Ren, NM Thalmann, J Yuan – Presence: Teleoperators and …, 2014 – MIT Press
… Abstract 3D virtual humans and physical human-like robots can be used to interact with people in a remote location in order to increase the feeling of presence … Page 3. 174 PRESENCE: VOLUME 23, NUMBER 2 Figure 1. System setup with the virtual human and the robot …
An architecture for fluid real-time conversational agents: integrating incremental output generation and input processing
S Kopp, H van Welbergen, R Yaghoubzadeh… – Journal on Multimodal …, 2014 – Springer
… 23, 48] and goes beyond, on the one hand, technical software architectures for multi-component ECA systems (as the Virtual Human Toolkit [15 … Likewise, input processing must be informed about concurrent behavior generation, eg, to be able to focus on subtle cues that would …
Mobile personal healthcare mediated by virtual humans
A Leuski, R Gowrisankar, T Richmond… – Proceedings of the …, 2014 – dl.acm.org
… In this paper we introduce Ally, a Virtual Human, that listens to the user’s health concerns, collects and processes data from the … This is the first time we brought together language processing, dialogue management, and behavior generation previously used in desktop-based …
Human–robot interaction by understanding upper body gestures
Y Xiao, Z Zhang, A Beck, J Yuan… – … : teleoperators and virtual …, 2014 – MIT Press
Page 1. Yang Xiao Zhijun Zhang* Aryel Beck Institute for Media Innovation Nanyang Technological University Singapore Junsong Yuan School of Electrical and Electronic Engineering Nanyang Technological University Singapore …
Effects of virtual human animation on emotion contagion in simulated inter-personal experiences
Y Wu, SV Babu, R Armstrong… – IEEE transactions on …, 2014 – ieeexplore.ieee.org
… 6 DISCUSSION Our empirical evaluation focused on the benefits of virtual human an- imation (or non-verbal behavior generation) in evoking affective re- sponses in simulated inter-personal situations. The static versus dy- namic …
Multi-robot behavior adaptation to local and global communication atmosphere in humans-robots interaction
LF Chen, ZT Liu, M Wu, FY Dong, Y Yamazaki… – Journal on Multimodal …, 2014 – Springer
… There are six virtual eye robots (eye movement is the only behavior but simple and typical) and six virtual human agents, and they are … used, and it can cover greedy case by adjusting the parameter (ie, temperature), thus, the Boltzmann function is used for behavior generation …
Intelligent tutoring support for learners interacting with virtual humans
M Core, HC Lane, D Traum – Design Recommendations for …, 2014 – books.google.com
… in production rules. In addition, speech recognition, speech synthesis, and non-verbal behavior generation (Lee & Marsella, 2006) allow commu- nication between the learner and the virtual human. The virtual human’s model …
Look me in the eyes: A survey of eye and gaze animation for virtual agents and artificial systems
K Ruhland, S Andrist, J Badler, C Peters, N Badler… – 2014 – hal.inria.fr
… synthesis has not yet reached the levels of realism required to convince users’ perceptual systems that a virtual human is the real … overs with efforts made in social robotics (Section 5.2), especially when characters are to be endowed with behaviour generation competencies that …
In search of interoperability standards for human behaviour representation
G Gunzelmann, C Gaughan, W Huiskamp… – Proceedings of the …, 2014 – members.ziggo.nl
… HBMs are most often used to generate behaviour of virtual humans in simulations and games to create training opportunities in representative … increasing demand for realistic HBMs, there is a need for flexible and generic architectures that support behaviour generation across a …
Erisa: Building emotionally realistic social game-agents companions
A Chowanda, P Blanchfield, M Flintham… – … Conference on Intelligent …, 2014 – Springer
… verbally. A similar framework is the ICT Virtual Human [7] framework. It contains a number of components that cover automatic speech recognition, emotion sen- sors, natural language processing, and behaviour generation. This …
On designing migrating agents: from autonomous virtual agents to intelligent robotic systems
K Hassani, WS Lee – SIGGRAPH Asia 2014 Autonomous Virtual Humans …, 2014 – dl.acm.org
… Liu and Lu 2006] is an extension of BDI architecture that enhances the knowledge representation and inference capabilities, and is suitable for simulating virtual humans … SAIBA [Kopp 2006] is a popular framework that defines a pipeline for abstract behavior generation …
Multimodal fusion in human-agent dialogue
E André, JC Martin, F Lingenfelser… – Coverbal Synchrony in …, 2014 – books.google.com
… In this section, we will discuss applications with virtual humans and social robots that make use of mechanisms for fusing social and emotional signals. We will start off by discussing a number of design decisions that have to be made for the development of such systems …
The right agent for the job?
L Ring, D Utami, T Bickmore – International Conference on Intelligent …, 2014 – Springer
… 12] and Bailenson [2] found that social influence within immersive virtual environments is higher with virtual humans with high … using a hierarchical state-machine-based dialogue engine, template-based text generation, conversational nonverbal behavior generation using BEAT …
Representing communicative functions in saiba with a unified function markup language
A Cafaro, HH Vilhjálmsson, T Bickmore… – … on Intelligent Virtual …, 2014 – Springer
… in the various discussions on FML were The Tactical Language and Cul- ture Training System (TLCTS) [10] and the Virtual Human Toolkit [5] developed at the Institute of Creative Technologies (ICT) which uses FML-like concepts in the Non- Verbal Behavior Generator module …
A transparent and decentralized model of perception and action for intelligent virtual agents
G Anastassakis, T Panayiotopoulos – International Journal on …, 2014 – World Scientific
… with multiple virtual agents acting multimodally and asynchronously14; to adapt findings in the field of virtual humans to the … AI methods to the intelligent virtual environment domain especially regarding intelligent virtual agent cognition and behaviour-generation, these works are …
Switching Wizard of Oz for the online evaluation of backchannel behavior
R Poppe, M ter Maat, D Heylen – Journal on multimodal user interfaces, 2014 – Springer
… Several systems have been introduced that combine online observation and behavior generation. Recently, Huang et al … This threshold was fixed for all experiment sessions. For the animation of the virtual agent, we used the Elckerlyc virtual human platform [28] …
Designing of a personality based emotional decision model for generating various emotional behavior of social robots
HS Ahn – Advances in Human-Computer Interaction, 2014 – dl.acm.org
… Each of them has different properties, such as priority and duration. Kshirsagar and Magneat-Thalmann suggested a system that has personality for an emotional virtual human using a five factor model [23]. Ushida et al … 2.3. Behavior Generation Process …
Describing and animating complex communicative verbal and nonverbal behavior using Eva-framework
I Mlakar, Z Ka?i?, M Rojc – Applied Artificial Intelligence, 2014 – Taylor & Francis
… templates (with predefined structures and suggestive temporal and end-pose values) and/or by specify- ing the structures, dynamics (kinematics), and expressive features “online,” in the form of behavioral events (eg, produced by a nonverbal-behavior generator, captured by …
A Natural Conversational Virtual Human with Multimodal Dialog System
IR Ali, G Sulong, AH Basori – Jurnal Teknologi, 2014 – jurnalteknologi.utm.my
… In an animation, the synthesized virtual human character shall become a natural actor if engaged in a conversation where a correct … Hence, in SAIBA framework5 for interactive agents, three stages of the behavior generation were discovered which are usually independent of …
Learning two-person interaction models for responsive synthetic humanoids
D Vogt, H Ben Amor, E Berger, B Jung – Journal of Virtual Reality and …, 2014 – jvrb.org
… Abstract. Imitation learning is a promising approach for generating life-like behaviors of virtual humans and humanoid robots … The interaction model can be applied both to the animation of virtual characters as well as to the behavior generation for humanoid robots …
Multimodal human-machine interaction including virtual humans or social robots
NM Thalmann, D Thalmann, Z Yumak – SIGGRAPH Asia 2014 Courses, 2014 – dl.acm.org
… Thalmann (60 minutes) • Modelling Behaviour for social robots and virtual humans Nadia Magnenat Thalmann (60 minutes) • Multi-modal fusion, decision making and behaviour generation Zerrin Yumak (60 minutes) • Questions and …
A bizarre virtual trainer outperforms a human trainer in foreign language word learning
M Macedonia – International Journal of Computer Science and Artificial …, 2014 – pure.mpg.de
… Behavior from XML Representations in MURML,” paper presented at the Workshop on Multimodal Behavior Generation, Reykjavik … Kopp, S., and Eyssel, F. (2010), “Individualized Gesturing Outperforms Average Gesturing – Evaluating Gesture Production in Virtual Humans,” in J …
Multi-party interaction with a virtual character and human-like robot: A case study
Z Yumak, J Ren, NM Thalmann, J Yuan – 2014 – pdfs.semanticscholar.org
… Abstract 3D virtual humans and physical human-like robots can be used to interact with people in a remote location in order to increase the feeling of presence … In case the human behind the robot and/or virtual human leaves, multi-party interaction should be handed to …
A trialogue-based spoken dialogue system for assessment of English language learners
CM Mitchell, K Evanini… – … Workshop on Spoken …, 2014 – pdfs.semanticscholar.org
… The virtual human front-end also integrates with the speech recognition module, allow- ing users to indicate when they are speaking, or to enter text and bypass … VHTK also generates gestures and lip-syncing for the delivered utterances via its Non-Verbal Behavior Generator …
Simulation and HRI recent perspectives with the MORSE simulator
S Lemaignan, M Hanheide, M Karg… – … on Simulation, Modeling …, 2014 – Springer
… work in the Embodied Virtual Agent (EVA) com- munity usually provides higher-level functionality, such as simulated emotion dynamics, behavior generation based on action … In this particular scenario, a robot must report the location of a virtual human in a domestic environment …
Modeling and simulating the walking behavior of small pedestrian groups
YW Fu, M Li, JH Liang, XQ Hu – Asian Simulation Conference, 2014 – Springer
… object of most existing methods, which have greatly improved the authenticity of the collision avoidance behavior for virtual human, is usually … Researchers have proposed a number of methods for crowd behavior generation[3]. For instance, Qiu[4] studied on the structure of the …
Metaphoric gestures: towards grounded mental spaces
M Lhommet, S Marsella – International Conference on Intelligent Virtual …, 2014 – Springer
… Beyond providing virtual humans with better communication skills, address- ing such questions will inform both the representation of the mental space and the dynamic processes resulting … Lee, J., Marsella, SC: Nonverbal behavior generator for embodied conversational agents …
Evaluating the perception of group emotion from full body movements in the context of virtual crowds
MR Carretero, A Qureshi, C Peters – … of the ACM Symposium on Applied …, 2014 – dl.acm.org
… lation of virtual humans, individuals and crowds [Reynolds 1987; Musse and Thalmann 1997] has been studied extensively, includ- ing research into collision avoidance behaviors [Guy et al … 3.1 Crowd and behavior generation …
Review of spoken dialogue systems
R López-Cózar, Z Callejas, D Griol, JF Quesada – Loquens, 2014 – loquens.revistas.csic.es
… For example, Collagen is an application for building conversational assistants and collaborative agents (Rich & Sidner, 1998). AVATALK provides natural, interactive dialogues with responsive virtual humans (Hubal & Day, 2006) …
Gesture and speech in interaction: An overview
P Wagner, Z Malisz, S Kopp – 2014 – Elsevier
Skip to main content …
A panorama of artificial and computational intelligence in games
GN Yannakakis, J Togelius – IEEE Transactions on …, 2014 – ieeexplore.ieee.org
… with respect to believ- ability [49], [50]. Most notably, studies on interactive virtual and conversational agents [49] as well as virtual humans [50] have been built on planning algorithms. • Search and planning ? General game AI …
AI challenge problem: Scalable models for patterns of life
JT Folsom-Kovarik, S Schatz, RM Jones, K Bartlett… – AI Magazine, 2014 – aaai.org
… 2002, Wray et al. 2005) may offer initial points of exploration for het- erogeneous behavior generation for POL. In … Musse, SR, and Thalmann, D. 2001. Hierarchical Model for Real Time Simulation of Virtual Human Crowds. IEEE …
A Demonstration of Dialogue Processing in SimSensei Kiosk
F Morbini, D DeVault, K Georgila, R Artstein… – Proceedings of the 15th …, 2014 – aclweb.org
… Figure 1: Ellie, the virtual human interviewer in SimSensei Kiosk … Additional agent mod- ules include nonverbal behavior generation, which matches appropriately timed body movements to the agent’s speech; character animation in a vir- tual 3D environment; and rendering in a …
Virtual reality and leadership development
RW Hill Jr – Using experience to develop leadership talent, how …, 2014 – Wiley Online Library
… of a number of technologies: speech recognition, natural language processing, graphics, non-verbal behavior generation, animation, computer vision, and artificial intelligence algorithms. One of the first demonstrations of the potential uses for virtual human technology was the …
Towards Learning Nonverbal Identities from the Web: Automatically Identifying Visually Accentuated Words
AAB Zadeh, K Sagae, LP Morency – International Conference on Intelligent …, 2014 – Springer
… and facial animation [13]. By fo- cusing on behavior rules that would best generalize over a normal population, these approaches enabled automatic nonverbal behavior generation for virtual human. Co-articulation of vocal and …
The Impact of human-agent communication in a collaborative environment on Shared Mental Model and team performance
N Hanna, D Richards – Collaborative Online Organization workshop …, 2014 – cs.siu.edu
… focused on studying a human’s dia- logue and creating a conversation system that mimics human verbal communication to establish mutual understanding with a conversational virtual human [19] … Towards Believable Behavior Generation for Embodied Conversational Agents …
History of Conversational System Development
T Nishida, A Nakazawa, Y Ohmoto… – Conversational …, 2014 – Springer
… 3.4 Embodied Conversational Agents and Intelligent Virtual Humans … After the initial implementation of the ideas introduced in The Knowledge Navigator video, methodological progress was made in scripts, markup languages, and corpus-based behavior generation …
Cultural diversity for virtual characters: Investigating behavioral aspects across cultures
B Endrass – 2014 – books.google.com
Page 1. Birgit Endrass Cultural Diversity for Virtual Characters Page 2. Cultural Diversity for Virtual Characters Page 3. Birgit Endrass Cultural Diversity for Virtual Characters Investigating Behavioral Aspects across Cultures With a foreword by Prof. Dr. Elisabeth André Page 4 …
A dynamic role-playing platform for simulations in legal and political education
D Economou, I Doumanis, V Bouki… – … on Interactive Mobile …, 2014 – ieeexplore.ieee.org
… Users can adapt the basic features of virtual humans (VHs), but also they can create photorealistic 3D representations of themselves to … 3. The non-verbal behaviour generator (NVBG), a rule- based component that analyses an ECA response and proposes appropriate non …
A Shared, Modular Architecture for Developing Virtual Humans
A Hartholt, D Traum, S Marsella… – … and Standards for …, 2014 – biecoll.ub.uni-bielefeld.de
… He leads several projects related to virtual humans, including SmartBody, a vir- tual human animation system, Cerebella, a nonverbal behavior generation system, and PsychSim, a model of social interaction based on theory-of-mind modeling as well as being co-developer of …
Virtual Reflexes
CM Jonker, J Broekens, A Plaat – International Conference on Intelligent …, 2014 – Springer
… 5.1 Behavior Generation and Virtual Reflex-Loops Example … Adv. in Consciousness Research (2005) 7. Core, M., Traum, D., Lane, HC, Swartout, W., Gratch, J., van Lent, M.: Teaching Nego- tiation Skills through Practice and Reflection with Virtual Humans …
Generation of Emergent Navigation Behavior in Autonomous Agents Using Artificial Vision
LO Carneiro, JBC Neto, CA Vidal… – … XVI Symposium on …, 2014 – ieeexplore.ieee.org
Page 1. 2014 XVI Symposium on Virtual and Augmented Reality Geracao de Comportamentos Emergentes de Navegacao em Agentes Autonomos utilizando Vis?o Arti?cial Generation of Emergent Navigation Behavior in Autonomous …
Emergent Navigation Behavior of Autonomous Virtual Agents Endowed with an Evolved Visual Cortex
L de Oliveira Carneiro, J Cavalcante-Neto… – SBC Journal on …, 2014 – researchgate.net
… However, many of the proposed approaches for behavior generation require a de- tailed description of the simulation environment and perception maps to provide relevant information to the agents, which limits their behaviors to those expected by the programmer …
[Complete volume] Proceedings of the Workshop on Architectures and Standards for Intelligent Virtual Agents at IVA 2014
A Cafaro, A Hartholt… – … on Architectures and …, 2014 – biecoll.ub.uni-bielefeld.de
… Based off the SAIBA framework for multimodal behavior generation, an important current research direction for the IVA- community deals with facilitating the collaboration … Table of Contents A Shared, Modular Architecture for Developing Virtual Humans …
Generating Gestures from Speech for Virtual Humans Using Machine LearningApproaches
CC Chiu – 2014 – search.proquest.com
… these characters must addresses a wide range of research challenges in perception, cogni- tion, dialog management and behavior generation. The focus of the work presented here is on providing the virtual human with a capacity to use gestures, specifically coverbal …
Validation of Interpersonal Stances Expressed by Virtual Suspect Characters in a Police Interview Setting
Q Fu – 2014 – essay.utwente.nl
… Three related sub-questions based on the factors that may affect people’s perception of virtual humans are proposed … Since we don’t have a behavior generation mechanism, the simple way to have believable behavior is to fully duplicate human behaviors …
Architectures and Standards for IVAs at the Social Cognitive Systems Group
H van Welbergen, K Bergmann… – … and Standards for …, 2014 – biecoll.ub.uni-bielefeld.de
… Links from input processing to behavior generation allow the generation of behavior based on different levels of understanding (eg, reactive vs … Herwin’s research deals with the development user inter- faces (ranging from social robots to virtual humans to classical mouse …
Virtual crowds, a contributing factor to presence in immersive virtual environments
MA Kyriakou – 2014 – gnosis.library.ucy.ac.cy
… with obstacles and other entities. An interesting challenge is to populate a virtual Crowds in IVEs Crowd behavior generation Crowd Animation Modeling of virtual humans Crowd Simulation Marios Kyriakou Page 23. 4 environment …
Virtual crowds, a contributing factor to presence in immersive virtual environments
?? ????????, MA Kyriakou – 2014 – lekythos.library.ucy.ac.cy
… with obstacles and other entities. An interesting challenge is to populate a virtual Crowds in IVEs Crowd behavior generation Crowd Animation Modeling of virtual humans Crowd Simulation Marios Kyriakou Page 23. 4 environment …
Developing a crowd simulation library for mobile games
A Afanasyeva – 2014 – theseus.fi
… application. In most cases, the terms “agent”, “character”, and “virtual human” are used interchangeably … avoidance in both static and dynamics environments. • Character behaviour generation defines the way the character interacts …
implementing a physics-based model of crowd movement using the Unreal development Kit
MJ Bott, MD Petty – Journal of Gaming & Virtual Worlds, 2014 – ingentaconnect.com
Page 1. 275 JGVW 6 (3) pp. 275–296 Intellect Limited 2014 Journal of Gaming & Virtual Worlds Volume 6 Number 3 © 2014 Intellect Ltd Article. English language. doi: 10.1386/jgvw.6.3.275_1 Keywords crowd modelling crowd …
Cognitive agents in virtual worlds: A middleware design approach
J van Oijen – 2014 – dspace.library.uu.nl
Page 1. Cognitive Agents in Virtual Worlds A Middleware Design Approach Page 2. This research has been supported by the GATE project, funded by the Netherlands Organisation for Scientific Research (NWO) and the Netherlands …
An interaction abstraction model for seamless avatar exchange in CVET
R Bouville, T Lopez, F Nouviale… – 2014 International …, 2014 – ieeexplore.ieee.org
… [11] J. Lee, D. DeVault, S. Marsella, and D. Traum. Thoughts on fml: Behavior generation in the virtual human communication architecture. Proceedings of FML, 2008. [12] B. Lenggenhager, T. Tadi, T. Metzinger, and O. Blanke …
Conversational informatics
T Nishida, A Nakazawa, Y Ohmoto, Y Mohammad – 2014 – Springer
Page 1. Conversational Informatics Toyoaki Nishida Atsushi Nakazawa Yoshimasa Ohmoto Yasser Mohammad A Data-Intensive Approach with Emphasis on Nonverbal Communication Page 2. Conversational Informatics Page 3. Toyoaki Nishida • Atsushi Nakazawa …
Creating partly autonomous expressive virtual actors for computer animation
RE Silva – 2014 – repositorium.sdum.uminho.pt
Page 1. Rogério Eduardo da Silva Junho de 2013 UMinho|2013 Creating Partly Autonomous Expressive Virtual Actors for Computer Animation Universidade do Minho Escola de Engenharia Rogério Eduardo da Silva Creating P artly Autonomous Expressive …
Triggering effective social support for online groups
R Kumar, CP Rosé – … Transactions on Interactive Intelligent Systems (TiiS …, 2014 – dl.acm.org
Page 1. 24 Triggering Effective Social Support for Online Groups ROHIT KUMAR, Raytheon BBN Technologies CAROLYN P. ROS ´E, Carnegie Mellon University Conversational agent technology is an emerging paradigm for …
Simulation, Modeling, and Programming for Autonomous Robots: 4th International Conference, SIMPAR 2014, Bergamo, Italy, October 20-23, 2014 …
D Brugali, J Broenink, T Kroeger, B MacDonald – 2014 – books.google.com
Page 1. Davide Brugali Jan F. Broenink Torsten Kroeger Bruce A. MacDonald (Eds.) Simulation, Modeling, and Programming for Autonomous Robots 4th International Conference, SIMPAR 2014 Bergamo, Italy, October 20–23, 2014 Proceedings 123 Page 2 …