Notes:
This text discusses the development of virtual agents or characters that are able to communicate and interact with users in real-time, with a focus on creating emotionally realistic and responsive agents. The text mentions various systems and frameworks that have been developed for this purpose, including the Virtual Human Toolkit, which is an open-source collection of modules, tools, and libraries that helps researchers and developers create conversational virtual humans. The text also mentions the use of audio-visual prompts and video-blending techniques to create realistic interactions between users and virtual agents. The text also discusses the use of virtual agents in a range of contexts, including healthcare decision support, museum guides, and ehealth advice. The text also mentions the importance of representing communicative functions and incremental grounding in spoken dialogue systems. The text also mentions the use of a reward-seeking dialogue manager and a comprehensive listener feedback model in the development of virtual agents. The text also mentions the use of virtual reality applications and the creation of emotionally realistic social game-agents.
Video-blending techniques refer to methods for combining or blending multiple video streams or sequences in order to create a seamless and cohesive final video. In the context of virtual humans, video-blending techniques may be used to create realistic and natural interactions between users and virtual agents. For example, video-blending techniques may be used to synchronize the movements and gestures of a virtual agent with its audio track, or to create a time-offset interaction interface that allows the virtual agent to respond to user input in real-time. Video-blending techniques can be used to create a sense of presence and immersion for users interacting with virtual agents, making the interaction feel more natural and lifelike. These techniques may be used in a range of applications, including virtual reality, training simulations, and entertainment.
Social game-agents are virtual characters or agents that are designed to interact with users in a social context, typically through a video game or other interactive entertainment platform. Social game-agents are typically designed to exhibit various social behaviors and characteristics, such as communication and interaction skills, emotional expressiveness, and personality traits. The goal of social game-agents is to create a realistic and engaging experience for users, often by simulating the dynamics of social interaction and communication. Social game-agents may be used in a variety of contexts, including educational games, role-playing games, and virtual worlds. The development of social game-agents often involves the use of artificial intelligence and machine learning techniques to enable the agents to exhibit realistic and believable behaviors and responses.
See also:
Virtual Human Toolkit 2010 | Virtual Human Toolkit 2011 | Virtual Human Toolkit 2012 | Virtual Human Toolkit 2013 | Virtual Human Toolkit 2015 | Virtual Human Toolkit 2016 | Virtual Human Toolkit 2017 | Virtual Human Toolkit 2018
SimSensei Kiosk: A virtual human interviewer for healthcare decision support
D DeVault, R Artstein, G Benn, T Dey, E Fast… – Proceedings of the …, 2014 – dl.acm.org
Page 1. SimSensei Kiosk: A Virtual Human Interviewer for Healthcare Decision Support David DeVault? , Ron Artstein, Grace Benn, Teresa Dey, Ed Fast, Alesia Gainer, Kallirroi Georgila, Jon Gratch, Arno Hartholt, Margaux …
Developing virtual reality applications with Unity
J Jerald, P Giokaris, D Woodall… – 2014 IEEE Virtual …, 2014 – ieeexplore.ieee.org
… Page 2. -? the Virtual Human Toolkit. (https://vhtoolkit.ict.usc.edu/download/) … These include the integrated research prototype SASO, the mixed-?reality Gunslinger project, and the Virtual Human Toolkit, which is freely available to the research community …
Towards a computational architecture of dyadic rapport management for virtual agents
A Papangelis, R Zhao, J Cassell – International Conference on Intelligent …, 2014 – Springer
… Interacting with Computers 17(6), 711–735 (2005) 2. Hartholt, A., Traum, D., Marsella, SC, Shapiro, A., Stratou, G., Leuski, A., Morency, L.-P., Gratch, J.: All together now: Introducing the virtual human toolkit. In: Aylett, R., Krenn, B., Pelachaud, C., Shimodaira, H. (eds.) IVA 2013 …
Mr. Clue—A Virtual Agent that Can Play Word-Guessing Games
E Pincus, D DeVault, D Traum – Tenth Artificial Intelligence and Interactive …, 2014 – aaai.org
… Mr. Clue was built on top of the ICT Virtual Human Toolkit, which provides APIs and components for creating virtual humans (Hartholt et al. 2013) … Dialogue Policy Using the Virtual human toolkit architecture, Mr. Clue is ca- pable of accepting speech or text input …
Time-offset interaction with a Holocaust survivor
R Artstein, D Traum, O Alexander, A Leuski… – Proceedings of the 19th …, 2014 – dl.acm.org
… We adapt elements from the publicly available Virtual Human Toolkit [5]1 as well as a new video player and video-blending techniques to create a time-offset interaction interface … 1. The Launcher window (a component of the Virtual Human Toolkit [5]) is used to start the demo …
FLoReS: a forward looking, reward seeking, dialogue manager
F Morbini, D DeVault, K Sagae, J Gerten… – Natural interaction with …, 2014 – Springer
… Finally, the FLoReS dialogue manager will be made available for other researchers through the ICT Virtual Human Toolkit [6] 8 . Footnotes. 1. This approach is similar at a high level to [10], though they do not address its use in dialogue planning specifically. 2 …
A trialogue-based spoken dialogue system for assessment of English language learners
CM Mitchell, K Evanini… – … Workshop on Spoken …, 2014 – pdfs.semanticscholar.org
… The Virtual Human Toolkit (VHTK) [9] allows for quick creation of scenes with multiple computer-animated dialogue agents, but the default dialogue manager, the NPCEditor [14], is de- signed for building question-answering characters [19] and is not easily customi- zable to …
Representing communicative functions in saiba with a unified function markup language
A Cafaro, HH Vilhjálmsson, T Bickmore… – … on Intelligent Virtual …, 2014 – Springer
… Other important systems that featured in the various discussions on FML were The Tactical Language and Cul- ture Training System (TLCTS) [10] and the Virtual Human Toolkit [5] developed at the Institute of Creative Technologies (ICT) which uses FML-like concepts in the Non …
Erisa: Building emotionally realistic social game-agents companions
A Chowanda, P Blanchfield, M Flintham… – … Conference on Intelligent …, 2014 – Springer
… A Human Face, Salt Lake City, USA (2002) 7. Hartholt, A., Traum, D., Marsella, SC, Shapiro, A., Stratou, G., Leuski, A., Morency, L.-P., Gratch, J.: All together now: Introducing the virtual human toolkit. In: Aylett, R., Krenn, B., Pelachaud, C., Shimodaira, H. (eds.) IVA 2013 …
A dynamic role-playing platform for simulations in legal and political education
D Economou, I Doumanis, V Bouki… – … on Interactive Mobile …, 2014 – ieeexplore.ieee.org
… IV. WMIN SGP DEVELOPMENT TOOLS The wmin SG platform has been developed using Unity 3D game platform [14] coupled with the ICT Virtual Human toolkit [15]. The latter is an open-source collection of modules, tools and libraries that facilitates the creation of ECAs …
Research And Development Tools In Affective Computing
MS Hussain, SK D’Mello, RA Calvo – The oxford handbook of …, 2014 – books.google.com
… willowgarage. com) and ICT Virtual Human Toolkit (conflu- ence. ict. usc … ROS is open source and provides useful tools for developing robot applications. Virtual Human Toolkit provides libraries, tools, and modules for creating virtual human characters …
Animated faces, abstractions and autism
D Arellano, V Helzle, UM Schaller, R Rauh – International Conference on …, 2014 – Springer
… 5773, pp. 393–404. Springer, Heidelberg (2009) 7. Hartholt, A., Traum, D., Marsella, SC, Shapiro, A., Stratou, G., Leuski, A., Morency, L.-P., Gratch, J.: All Together Now: Introducing the Virtual Human Toolkit. In: Aylett, R., Krenn, B., Pelachaud, C., Shimodaira, H. (eds.) IVA 2013 …
Relational agents to promote ehealth advice adherence
S Baker, D Richards, P Caldwell – Pacific Rim International Conference on …, 2014 – Springer
… 1, is a model we have adapted from the University of Southern California’s Virtual Human Toolkit (VHT)2. An interesting future direction might be to allow patients and families to select the avatar they prefer from a selection depicting alternative gender and racial features …
Length of smile apex as indicator of faked expression
JD McDaniel, M Si – … on Affective Agents co-located with …, 2014 – pdfs.semanticscholar.org
… Journal of Personality and Social Psychology, vol. 39 (6), 1125–1134 (1980) 4. Harthold, A., Traum, D., Marsella, S., Shapiro, A., Stratou, G., Leuski, A., Morency, L., Gratch, J.: All Together Now: Introducing the Virtual Human Toolkit …
A model for incremental grounding in spoken dialogue systems
T Visser, D Traum, D DeVault… – Journal on multimodal user …, 2014 – Springer
… Our policy is a rudimentary variation on Wang et al.’s [40] comprehensive listener feedback model. An overview of the system including our component is displayed in Fig. 1. Most of the messages shown are standard parts of the virtual human toolkit [13] …
Building a narrative conversational agent using a component-based architecture
W Boisseleau, O Serban, A Pauchet – Proceedings of the 2014 …, 2014 – dl.acm.org
… 35–42. [6] Hartholt, A., Traum, D., Marsella, SC, Shapiro, A., Stratou, G., Leuski, A., Morency, L.-P., and Gratch, J. All together now: Introducing the virtual human toolkit. In International Conference on Intelligent Virtual Humans (Edinburgh, UK, Aug. 2013) …
Affectively aligned cognitive assistance using Bayesian affect control theory
L Lin, S Czarnuch, A Malhotra, L Yu, T Schröder… – … Workshop on Ambient …, 2014 – Springer
… We created a set of audio-visual prompts using a virtual human developed with the USC Virtual Human Toolkit (VHT)3. We built a set of six audio-visual prompts with five different emotional deliveries (eg “bossy”, “motherly” or “bored” – see screenshots in Table 1). An online …
An architecture for fluid real-time conversational agents: integrating incremental output generation and input processing
S Kopp, H van Welbergen, R Yaghoubzadeh… – Journal on Multimodal …, 2014 – Springer
… It thus extends the BML/FML output generation framework [23, 48] and goes beyond, on the one hand, technical software architectures for multi-component ECA systems (as the Virtual Human Toolkit [15]) and, on the other hand, standard multi-agent communication …
A Shared, Modular Architecture for Developing Virtual Humans
A Hartholt, D Traum, S Marsella… – … and Standards for …, 2014 – biecoll.ub.uni-bielefeld.de
… RJ van der Werf, Louis-Philippe Morency, Virtual Rapport, IVA (2006) 6. Arno Hartholt, David Traum, Stacy C. Marsella, Ari Shapiro, Giota Stratou, Anton Leuski, Louis-Philippe Morency, Jonathan Gratch, All Together Now: Introducing the Virtual Human Toolkit, at Intelligent …
Sense of touch for virtual creatures
D Madrigal, F Ramos – 2014 5th IEEE Conference on Cognitive …, 2014 – ieeexplore.ieee.org
… brain or body). For example, ICT Virtual Human Toolkit [8] is a project developed by USC’s Institute for Creative Technologies that aims to help researchers and developers create conversational virtual humans. Other proposals …
Building Discount ECAs for the Study of Rapport
I Gris, D Novick, DA Rivera, M Gutierrez, A Camacho… – pdfs.semanticscholar.org
… and Grace, responsive virtual-human museum guides [3]. • Sergeant Blackwell, a US Army soldier who answers a wide range of questions, including open-ended questions [4]. Powerful platforms for development of ECAs are available (eg, the Virtual Human Toolkit [5]), based …
Effect of Embodiment of Video Instructor on Student’s Learning Process
JS Boon, K Ma, A Sen – pages.cs.wisc.edu
… virtual agent in place of a human. We used Virtual Human Toolkit [6] to create the virtual agent, synchronize its lip movement with the voice in the audio track and generate some gestures. In order to maintain consistency across …
Using Educational DVDs to Enhance Preschoolers’ STEM Education
PBL Beaudoin-Ryan – researchgate.net
Page 1. A Collaborative Project Funded by the National Science Foundation (Grant No. DRL-1252146) Northwestern University University of California at Riverside Georgetown University Prepared By Leanne Beaudoin-Ryan …
Louis-Philippe Morency
C Point – cs.cmu.edu
Page 1. LOUIS-PHILIPPE MORENCY Carnegie Mellon University Language Technologies Institute 5000 Forbes Avenue Pittsburgh, PA 15213, USA Phone: +1 (412) 268-5508 E-mail: morency@cs.cmu.edu Homepage: http …
Multimodal Interaction Modeling
GV Popescu, H Trefftz, GC Burdea – researchgate.net
Page 1. 411 17 Multimodal Interaction Modeling George V. Popescu, Helmuth Trefftz, and Grigore C. Burdea 17.1 IntroductIon Virtual environments (VE) represent advanced, immersive, human–computer interaction (HCI) systems …
What Makes Experience A Memorable One for the Customers of Top Indonesian hotels
H Herjanto, SS Gaur – ASEAN Journal on Hospitality and Tourism, 2014 – journals.itb.ac.id
… 98 Hartholt, A., Traum, D., Marsella, SC, Shapiro, A., Stratour, G., and Leuski, A. (2013), “All Together Now: Introducing the Virtual Human Toolkit”, Proceeding of the 13th International Conference on Intelligent Virtual Agents, Edinburg, UK, pp. 368-381 …
Adaptive Tutoring for Self-Regulated Learning: A Tutorial on Tutoring Systems
RA Sottilare, AM Sinatra – 2014 – apps.dtic.mil
Page 1. Adaptive Tutoring for Self-Regulated Learning: A Tutorial on Tutoring Systems by Robert A Sottilare and Anne M Sinatra ARL-SR-0305 December 2014 Approved for public release; distribution is unlimited. Page 2. NOTICES Disclaimers …
An Assistive Handwashing System with Emotional Intelligence
L Lin – 2014 – uwspace.uwaterloo.ca
Page 1. An Assistive Handwashing System with Emotional Intelligence Using Emotional Intelligence in Cognitive Intelligent Assistant Systems by Luyuan Lin A thesis presented to the University of Waterloo in fulfillment of the …