Notes:
The Virtual Human Toolkit is a software platform that enables the creation of realistic, interactive virtual humans for use in a variety of applications. It provides a range of tools and features for building and animating virtual humans, including support for real-time facial animation, natural language processing, and gesture recognition.
In 2015, the Virtual Human Toolkit was being used in a variety of applications, including virtual training and education, interactive entertainment, and research. For example, the toolkit was being used to create virtual humans that could be used in training simulations for military and emergency response personnel, allowing them to practice and learn in a safe and controlled environment.
The Virtual Human Toolkit was also being used in the development of interactive entertainment products, such as virtual reality games and experiences. It provided a way for game developers to create realistic, interactive characters that could interact with users in natural and intuitive ways, providing a more immersive and engaging user experience.
In the research domain, the Virtual Human Toolkit was being used to study the interactions between humans and virtual agents, and to develop new algorithms and techniques for creating more realistic and intelligent virtual humans. This research was aimed at advancing the state of the art in virtual human technology, and at exploring the potential applications of virtual humans in fields such as education, healthcare, and entertainment.
The references below discuss the use of virtual humans or embodied conversational agents in a range of contexts, including human-machine interaction, ambient intelligence environments, and task environments based on the desktop metaphor. The text mentions the use of various tools and software applications, such as the Virtual Human Toolkit, to aid in the development of virtual humans. The text also mentions the use of audio-visual prompts and virtual agent technologies to create realistic and engaging interactions with users. The text also discusses the use of virtual humans for interaction, assistance, and information provision, and the importance of alignment and coordination of linguistic and nonverbal behaviors in communication. The text also mentions the use of virtual humans in healthcare applications, and the use of virtual humans to explore the role of virtual agents in human-robot teams. The text also mentions the use of virtual humans in the evaluation of dynamic role-playing platforms and the assessment of psychological distress.
The alignment and coordination of linguistic and nonverbal behaviors in virtual humans is accomplished through the use of various techniques and technologies. These may include the use of speech recognition and synthesis systems to enable the virtual human to understand and generate spoken language, the use of natural language processing and machine learning techniques to enable the virtual human to understand and respond to user input, and the use of computer animation and video-blending techniques to synchronize the virtual human’s movements and gestures with its spoken language. Additionally, the virtual human may be programmed to exhibit various nonverbal behaviors, such as facial expressions and body language, in order to create a more realistic and engaging interaction with users. By coordinating these different linguistic and nonverbal behaviors, virtual humans are able to create a sense of presence and immersion for users, and to simulate the dynamics of natural human communication.
See also:
Virtual Human Toolkit 2010 | Virtual Human Toolkit 2011 | Virtual Human Toolkit 2012 | Virtual Human Toolkit 2013 | Virtual Human Toolkit 2014 | Virtual Human Toolkit 2016 | Virtual Human Toolkit 2017 | Virtual Human Toolkit 2018
Toward natural turn-taking in a virtual human negotiation agent
D DeVault, J Mell, J Gratch – 2015 AAAI Spring Symposium Series, 2015 – aaai.org
… In Proceedings of AAMAS. Hartholt, A.; Traum, D.; Marsella, S.; Shapiro, A.; Stratou, G.; Leuski, A.; Morency, L.-P.; and Gratch, J. 2013. All together now, introducing the virtual human toolkit. In IVA. Kelley, HH, and Schenitzki, DP 1972. Bargaining …
Creating a virtual neighbor
C Corbin, F Morbini, D Traum – Natural Language Dialog Systems and …, 2015 – Springer
… Users can interact through face-to-face spoken dialogue, using components from the ICT Virtual human toolkit, or via a chat interface. Keywords … Our system is integrated within the ICT virtual human toolkit (Hartholt et al. 2013) …
SimSensei demonstration: a perceptive virtual human interviewer for healthcare applications
LP Morency, G Stratou, D DeVault, A Hartholt… – Twenty-Ninth AAAI …, 2015 – aaai.org
… Social Emotions in Nature and Artifact 181. Hartholt, A.; Traum, DR; Marsella, SC; Shapiro, A.; Stratou, G.; Leuski, A.; Morency, L.-P.; and Gratch, J. 2013. All together now – introducing the virtual human toolkit. In IVA, 368–381 …
Exploring the implications of virtual human research for human-robot teams
J Gratch, S Hill, LP Morency, D Pynadath… – … Conference on Virtual …, 2015 – Springer
… domains. For example, speech recognizers, parsers, statistical classifiers [25], dialogue managers [26], language generators [27], and speech synthesizers [28], many freely available through the virtual human toolkit [29]. Finally …
Cerebella: automatic generation of nonverbal behavior for virtual humans
M Lhommet, Y Xu, S Marsella – Twenty-Ninth AAAI Conference on Artificial …, 2015 – aaai.org
… Finally, the per- formance is realized by the virtual humans of the Virtual Human Toolkit (Hartholt et al. 2013)(see Figure 1) … Research on Language and Social In- teraction 27(3):201–221. Figure 1: Our demo uses the virtual humans from the Virtual Human Toolkit …
A demonstration of the perception system in SimSensei, a virtual human application for healthcare interviews
G Stratou, LP Morency, D DeVault… – 2015 International …, 2015 – ieeexplore.ieee.org
… 1061–1068. [Online]. Available: http://dl.acm.org/citation.cfm?id=2617388.2617415 [7] A. Hartholt, DR Traum, SC Marsella, A. Shapiro, G. Stratou, A. Leuski, L.-P. Morency, and J. Gratch, “All together now – introducing the virtual human toolkit,” in IVA, 2013, pp. 368–381 …
Negotiation as a challenge problem for virtual humans
J Gratch, D DeVault, GM Lucas, S Marsella – International Conference on …, 2015 – Springer
… Presently, we have completed the face-to-face data collection, designed the basic game environment, and completed several iterations on improving a wizard-controlled system (described below). CRA is implemented with the publicly-available virtual human toolkit [29] …
Prototyping user interfaces for investigating the role of virtual agents in human-machine interaction
N Mattar, H van Welbergen, P Kulms… – … Conference on Intelligent …, 2015 – Springer
… different application scenarios (cf. ICT Virtual Human Toolkit, [1]). However, how to integrate embodied virtual agents into classical task environments based on, eg, the desktop metaphor is still challenging. Therefore, we adopt …
Mixed reality for robotics
W Hoenig, C Milanes, L Scaria, T Phan… – 2015 IEEE/RSJ …, 2015 – ieeexplore.ieee.org
… 1) Technical Details: Typical robot simulators either do not support simulating humans (eg GAZEBO 2+), or use a very simplified model (eg V-REP). We use the game engine UNITY 3D (4.6.2 Free Edition) [11], combined with the Virtual Human Toolkit [12] to simulate humans …
Intelligent Virtual Agents: 15th International Conference, IVA 2015, Delft, the Netherlands, August 26-28, 2015, Proceedings
WP Brinkman, J Broekens, D Heylen – 2015 – books.google.com
… VI Preface agents. In addition four tutorials were given, respectively, on: using annotations for virtual human research; social signal interpretation for virtual agents; design and use of questionnaires in human–computer interaction; and introduction to the virtual human toolkit …
Do We Differ in Our Dispositional Tendency to Perceive Virtual Agents as Animate Beings?
B Liebold, D Pietschmann, P Ohler – International Conference on Human …, 2015 – Springer
… The videos were obtained from the internet and represented different virtual agent technologies and scenarios (Obadiah & Spike, chatting, SEMAINE Project; Sgt. Star, virtual guide, ICT Virtual Human Toolkit; Lt. Rocko, virtual patient, ICT Virtual Human Toolkit) …
Evaluation of a dynamic role-playing platform for simulations based on Octalysis gamification framework.
D Economou, I Doumanis, F Pedersen… – Intelligent …, 2015 – books.google.com
… The wmin SG platform has been developed using Unity 3D game platform [10] coupled with the ICT Virtual Human toolkit [11] … com/ [11] The ICT Virtual Human Toolkit, Institute for Creative Technologies (ICT), University of Southern California, California, USA, 2014 …
An exploratory study into the use of an emotionally aware cognitive assistant
A Malhotra, L Yu, T Schröder, J Hoey – Workshops at the Twenty-Ninth AAAI …, 2015 – aaai.org
… In this paper, we report upon a first step towards this aim by creating a set of audio-visual prompts using a virtual human developed with the USC Virtual Human Toolkit (VHT) … 2 Virtual Human Toolkit (https://vhtoolkit.ict.usc.edu) Table 1. Behavior/Identities and Expected EPA …
Exploring the alignment space–lexical and gestural alignment with real and virtual humans
K Bergmann, HP Branigan, S Kopp – Frontiers in ICT, 2015 – frontiersin.org
Communication is characterized by speakers’ dynamic adaptations and coordination of both linguistic and nonverbal behaviors. Understanding this phenomenon of alignment and its underlying mechanisms and processes in both human-human and human-computer interaction …
Context-Aware Automated Analysis and Annotation of Social Human–Agent Interactions
T Baur, G Mehlmann, I Damian, F Lingenfelser… – ACM Transactions on …, 2015 – dl.acm.org
… behavior. Following bio-sensor and user interface (UI) inputs, as well as context in the form of previously prompted personality traits, the system tries to infer the emotions of the learner. The Virtual Human Toolkit [Hartholt et al. 2013 …
Employing virtual humans for interaction, assistance and information provision in ambient intelligence environments
C Birliraki, D Grammenos, C Stephanidis – International Conference on …, 2015 – Springer
… Virtual humans can be powerful tools in a wide range of areas. The ICT Virtual Human Toolkit [14] was designed to support researchers with the creation of embodied conversational agents … Springer, Heidelberg (2013)CrossRefGoogle Scholar. 15. Virtual Human Toolkit …
Virtual Suspect William
M Bruijnes, R op den Akker, A Hartholt… – … Conference on Intelligent …, 2015 – Springer
… Open image in new window. 2.2 Behaviour Realisation. We used components from the Virtual Human Toolkit [6] to build the virtual suspect. Specifically, we used the NPCEditor [8], a statistical text classifier that provides question-answer matching …
Evaluating spoken dialogue processing for time-offset interaction
D Traum, K Georgila, R Artstein, A Leuski – … of the 16th Annual Meeting of …, 2015 – aclweb.org
… The automatic system is built on top of the com- ponents from the USC ICT Virtual Human Toolkit, which is publicly available.1 Specifically, we use the AcquireSpeech tool for capturing the user’s speech, CMU PocketSphinx2 and Google Chrome ASR3 tools for converting the …
Towards an affective interface for assessment of psychological distress
GM Lucas, J Gratch, S Scherer… – 2015 International …, 2015 – ieeexplore.ieee.org
… Biomed. Eng. IEEE Trans. 58, 574–586. [18] Hartholt, A., et al. (under review). “All Together Now: Introducing the Virtual Human Toolkit.” Intelligent Virtual Agents Conference. [19] Baltrusaitis, T., et al. (2012). “3D constrained …
Evaluating an intelligent Q&A system for mobile cultural learning
I Doumanis, S Smith – EAI Endorsed Transactions on Future …, 2015 – eprints.mdx.ac.uk
… engage visitors with the museum contents. Questions asked by visitors are handled by the NPCEditor, a component that has been made available as part of the Virtual Human Toolkit [10]. The component uses a statistical text …
Creating genuine smiles for digital and robotic characters: an empirical study
M Si, JD McDaniel – 2015 IEEE Games Entertainment Media …, 2015 – ieeexplore.ieee.org
… This experiment recruited 25 subjects in total. 16 of them are male, and 9 are female. 2) Experimental Material and Procedure: In this study, the digital characters were created by using the Virtual Human Toolkit [16]. The two characters used in the study are the …
Intimacy is Induced and Regulated Through Proxemic & Gaze Behaviour-A Study in Immersive Virtual Reality
J Kolkmeier – 2015 – essay.utwente.nl
Page 1. A Study in Immersive Virtual Reality Intimacy is Induced and Regulated Through Proxemic & Gaze Behaviour J. KOLKMEIER FACULTY OF EEMCS MSC HUMAN MEDIA INTERACTION GRADUATION COMMITTEE prof.dr. DKJ Heylen dr. G. Englebienne JH Vroon, MSc …
Boundary interactions: Resolving interdisciplinary collaboration challenges using digitized embodied performances
VJ Flood, M Neff, D Abrahamson – 2015 – repository.isls.org
… 1–6). Hartholt, A., Traum, D., Marsella, SC, Shapiro, A., Stratous, G., & Leuski, A. (2013). All together now: Introducing the Virtual Human Toolkit. In International Conference on Intelligent Virtual Agents (pp. 368–381). Edinburgh: Springer. Henderson, K. (1991) …
2015 multimodal learning and analytics grand challenge
M Worsley, K Chiluiza, JF Grafsgaard… – Proceedings of the 2015 …, 2015 – dl.acm.org
… with sensors from other modalities (Eye Tribe, Q-sensor/Empatica E4, etc.) Additionally, we encouraged participants to leverage existing software applications that ease the process of software development (eg the Institute of Creative Technology’s Virtual Human Toolkit [11] and …
Monday 24 August 2015
S Signal, SSI Framework, H Toolkit – ii.tudelft.nl
… 10.00 – 13.00 Doctoral Consortium, including lunch 12.30 – 13.00 Registration 13.00 – 14.45 Parallel Session 1 Tutorials Using Annotations for Virtual Human Research Social Signal Interpretation for Virtual Agents: Basic Concepts and Implementation in the SSI Framework Design …
Virtual Suspect William
A Hartholt, D Heylen – … , IVA 2015, Delft, The Netherlands, August …, 2015 – books.google.com
… High dominance, attitude to being opposed, and sensitivity to internal pressure. Low affiliation, sensitivity to rapport, and sensitivity to external pressure. 2.2 Behaviour Realisation We used components from the Virtual Human Toolkit [6] to build the virtual suspect …
Exploring the alignment space–lexical and gestural alignment with real and virtual humans
KBHP Branigan, S Kopp – 2015 – researchgate.net
Page 1. Frontiers in Human-Computer Interaction Research Article 22 April 2015 Exploring the alignment space – lexical and gestural alignment with real and virtual humans Kirsten Bergmann1 Holly P. Branigan2 and Stefan …
Evaluation of a dynamic role-playing platform for simulations based on Octalysis gamification framework Daphne Economou1 Ioannis Doumanis2
F Pedersen, P Kathrani, M Mentzelopoulos, V Bouki – 2015 – pdfs.semanticscholar.org
… The wmin SG platform has been developed using Unity 3D game platform [10] coupled with the ICT Virtual Human toolkit [11]. The latter is an open-source collection of modules, tools and libraries that facilitates the creation of ECAs …
Ambient Personal Environment Experiment (APEX): A Cyber-Human Prosthesis for Mental, Physical and Age-Related Disabilities
DJ Atkinson, BJ Dorr, MH Clark, WJ Clancey… – 2015 AAAI Spring …, 2015 – aaai.org
… IEEE Computer. 34(1):61-71. Hartholt, A., Traum, D., Marsella, SC, Shapiro, A., Stratou, G., Leuski, A., Morency, L.-P., and Gratch, J. 2013. All Together Now: Introducing the Virtual Human Toolkit. In International Conference on Intelligent Virtual Humans Edinburgh …
Ambient Personal Environment Experiment (APEX): A Cyber-Human Prosthesis for Mental, Physical and Age-Related Disabilities
T Appear – 2015 – academia.edu
… IEEE Computer. 34(1):61-71. Hartholt, A., Traum, D., Marsella, SC, Shapiro, A., Stratou, G., Leuski, A., Morency, L.-P., and Gratch, J. 2013. All Together Now: Introducing the Virtual Human Toolkit. In International Conference on Intelligent Virtual Humans Edinburgh …
Speech adaptation in extended ambient intelligence environments
BJ Dorr, L Galescu, I Perera… – Twenty-Ninth AAAI …, 2015 – aaai.org
… Hartholt, A., Traum, D., Marsella, SC, Shapiro, A., Stratou, G., Leuski, A., Morency, L.-P., and Gratch, J. 2013. All Together Now: Introducing the Virtual Human Toolkit. In International Conference on Intelligent Virtual Humans, Edinburgh, UK. Kar, S. 2013 …
An Emotional Engine for Behavior Simulators
SG Carbajal, F Polimeni… – Int. J. Serious Games, 2015 – pdfs.semanticscholar.org
… Developed by the Institute for Creative Technologies at the University of Southern California, Virtual Human Toolkit [6] provides a set of tools that aids in the construction of virtual human conversational characters, and is the closest work to the one presented in this paper …
A v (irtual)-City implementation for promoting cultural heritage.
G Tsoumanis, E Kavvadia, K Oikonomou – IJCIStudies, 2015 – researchgate.net
… Figure 6 Discussion example of an intelligent v-Assistant dialogue. Virtual Human toolkit (VH toolkit) [19] can be used in order to train the avatars. The task here is about creating a question and train the avatar to give the desired answer …
Creating automated virtual humans
R Sakpal – 2015 – search.proquest.com
Page 1. CREATING AUTOMATED VIRTUAL HUMANS by Raghavi Sakpal A dissertation submitted to the faculty of The University of North Carolina at Charlotte in partial fulfillment of the requirements for the degree of Doctor of Philosophy in Computing and Information Systems …
How Many Utterances Are Needed to Support Time-Offset Interaction?
R Artstein, A Leuski, H Maio, T Mor-Barak… – The Twenty-Eighth …, 2015 – aaai.org
… SIGDIAL 2010, 245–248. Hartholt, A.; Traum, D.; Marsella, SC; Shapiro, A.; Stra- tou, G.; Leuski, A.; Morency, L.-P.; and Gratch, J. 2013. All together now: Introducing the virtual human toolkit. In International Conference on Intelligent Virtual Humans. Krippendorff, K. 1980 …
The real challenge 2014: Progress and prospects
M Eskenazi, AW Black, S Lee, D Traum – … of the 16th Annual Meeting of …, 2015 – aclweb.org
… Table 3: Next steps resulting from the Workshop type – country student type of help action Academic -US any provide system components Webinar on virtual human toolkit Academic – US KAIST offer of mentorship lectures to high school students, par- ticipation in next round …
Chatbots: On Demand Creation of Conversational Agents
LFAP dos Santos – 2015 – inesc-id.pt
… 29 vii Page 10. 3.1.1 Basic Pandora Bot . . . . . 29 3.2 Virtual Human Toolkit . . . . . 34 3.2.1 Architecture . . . . . 34 …
Expanding Authoring Tools to Support Psychomotor Training Beyond the Desktop
RA Sottilare, SJ Ososky, M Boyce – Design Recommendations for … – researchgate.net
Page 369. 347 CHAPTER 28 Expanding Authoring Tools to Support Psychomotor Training Beyond the Desktop Robert A. Sottilare, Scott J. Ososky, and Michael Boyce US Army Research Laboratory Introduction Today, intelligent …
Intimacy is Induced and Regulated Through Proxemic & Gaze Behaviour
J KOLKMEIER – 2015 – essay.utwente.nl
Page 1. A Study in Immersive Virtual Reality Intimacy is Induced and Regulated Through Proxemic & Gaze Behaviour J. KOLKMEIER FACULTY OF EEMCS MSC HUMAN MEDIA INTERACTION GRADUATION COMMITTEE prof.dr. DKJ Heylen dr. G. Englebienne JH Vroon, MSc …
Domain-Specific Semantic Role Labeling: Portability of Existing Resources
N Reese – 2015 – scholar.colorado.edu
… Page 11. x List of Figures 2.1 Virtual Human Toolkit Architecture … 6. CU Animated 3D Avatar The first four elements of the system in this list were built using the Boulder Language Technology (BLT) Virtual Human Toolkit (VHT). The BLT VHT gives My Science Tutor the ability …