Notes:
SmartBody is a character animation system developed at the University of Southern California Institute for Creative Technologies. It is designed to allow researchers and developers to create realistic, human-like characters that can be controlled using the Behavior Markup Language (BML). BML is a language for specifying character behaviors and gestures, and SmartBody is a platform that can execute these behaviors in real-time. One of the key features of SmartBody is its modular design, which allows developers to easily customize and extend the system to meet their specific needs.
SmartBody allows users to build their own behavior realizers using specialized animation segments called motion controllers. It is designed to animate embodied characters in real-time, with a focus on multimodal and emotional interaction with the user. SmartBody can synchronize speech with gestures and other nonverbal behavior, and it has a retargeting system that allows the transfer of data between different characters. It also has scheduling and synchronization mechanisms for blending and controlling animations. SmartBody is intended to be used in a variety of domains, such as marketing, virtual tutors, advisors, and non-player characters in role-playing games.
Resources:
- asap-project.org .. articulated social agents platform, including asaprealizer
- hapfacs .. a set of facs-based facial expressions on the haptek virtual character platform
- miralab.ch .. nadia magnenat thalmann virtual humans lab in geneva
- pandabmlr .. panda3d bml realizer (bmlr) is a rendering engine and object oriented wrapper for smartbody
- simcoach .. allows users to engage in a dialog about their healthcare concerns with an interactive virtual human
- smartbody.ict.usc.edu .. character animation platform
Wikipedia:
References:
See also:
Behavior Realizers | BML (Behavior Markup Language) & Dialog Systems | Realizers In Natural Language Processing | Virtual Human Toolkit
Smartbody: Behavior realization for embodied conversational agents M Thiebaux, S Marsella, AN Marshall… – Proceedings of the 7th …, 2008 – dl.acm.org … employed in a range of applications. In addition, we envision SmartBody’s open source architecture as a means to facilitate collaboration and as a way for groups to leverage each other’s work. For ex- ample, one group’s gaze … Cited by 192 Related articles All 16 versions
EMBR–A realtime animation engine for interactive embodied agents A Heloir, M Kipp – Intelligent Virtual Agents, 2009 – Springer … The SmartBody open-source framework [6] relates to our work as a freely avail- able system that lets a user build its own behavior realizer by specializing generic animation segments called motion controllers organized in a hierarchical manner. … Cited by 49 Related articles All 13 versions
Real-time animation of interactive agents: Specification and realization A Heloir, M Kipp – Applied Artificial Intelligence, 2010 – Taylor & Francis … The SmartBody open-source framework (Thiebaux et al., 200819. … The BML Realizer 3 http://cadia.ru.is/projects/bmlr View all notes. (BMLR) is an open source project that uses the SmartBody system as an engine and Panda3D as a renderer. … Cited by 31 Related articles All 7 versions
The behavior markup language: Recent developments and challenges H Vilhjálmsson, N Cantelmo, J Cassell, NE Chafai… – Intelligent virtual …, 2007 – Springer … SmartBody7. SmartBody [4] is an open source modular framework for animating embodied characters, based on motion controllers that can be hierarchically interconnected in real-time in order to achieve continuous motion. … Cited by 196 Related articles All 32 versions
All together now A Hartholt, D Traum, SC Marsella, A Shapiro… – Intelligent Virtual …, 2013 – Springer … In addition, SmartBody uses a retargeting system that allows the transfer of groups of data de- signed for one character onto another [29]. 4.5 Other Modules and Tools … Ogre [36] is included as an open source game engine example. … Cited by 50 Related articles All 7 versions
Architecture of an animation system for human characters T Pejša, IS Pandzic – Telecommunications, 2009. ConTEL 2009 …, 2009 – ieeexplore.ieee.org … portion of our system under an open-source license. … REFERENCES [1] M. Thiebaux, AN Marshall, S. Marsella, M. Kallmann, “SmartBody: behavior realization for embodied conversational agents,” in International Conference on Autonomous Agents, 2008, vol. 1, pp. 151-158. … Cited by 8 Related articles All 6 versions
[BOOK] The role of gaming industry and open source philosophy in the creation of affordable virtual heritage solutions AG Bottino, A Martina – 2010 – porto.polito.it … The Role of Computer Games Industry and Open Source Philosophy in the Creation of Affordable Virtual Heritage Solutions … avatars and characters behavior can be implemented with libraries like CHARACTERISE (Virtual Human Open Simulation Framework) and SmartBody. … Cited by 3 Related articles All 6 versions
Using the behavior markup language for human-robot interaction A Holroyd, C Rich – Proceedings of the seventh annual ACM/IEEE …, 2012 – dl.acm.org … In conclusion, we have shown the theory and provided an open-source ROS implementation of an event-driven BML realizer for robots. We used this realizer in [2] and will continue to use it in future research. … Smartbody: Behavior realization for embodied conversational agents. … Cited by 6 Related articles All 4 versions
Research and Development Tools in Affective Computing MS Hussain, SK D’Mello, RA Calvo – The Oxford Handbook of …, 2014 – books.google.com … SmartBody Open-source platform in C++ for character animation (Thiebaux, Marsella, Marshall, & Kallmann, 2008). Generates human-like expressions and animations in real time through behavioral markup language (BML). … Cited by 2 Related articles All 2 versions
A Realtime Animation Engine for Interactive Embodied Agents A Heloir, M Kipp – Citeseer … The SmartBody open-source framework [6] relates to our work as a freely available system that lets a user build its own behavior realizer by specializing generic animation segments called motion controllers organized in a hierarchi- cal manner. … Related articles All 9 versions
Multi-party interaction with a virtual character and a human-like robot Z Yumak, N Magnenat-Thalmann – … of the 19th ACM Symposium on …, 2013 – dl.acm.org … Our virtual human platform is based on the SmartBody open-source character animation library from ICT, University of Southern Cali- fornia5. The 3D characters and animations are designed by a profes- sional 3D designer in Maya6 and loaded to SmartBody. … Cited by 1 Related articles
Brains and Bodies for Interactive Stories S Marsella, J Lee, D Pynadath, A Shapiro – tecfalabs.unige.ch … 5 Status SmartBody is publicly available open source. It has a dual licensing scheme based on Ogre’s model. NVBG’s engine is open binary but the behavior mapping rules that actually do the work are human readable and modifiable. … Related articles
Animated Faces, Abstractions and Autism D Arellano, V Helzle, UM Schaller, R Rauh – Intelligent Virtual Agents, 2014 – Springer … are the work of Magnenat-Thalmann and Thalmann [1], Greta [2], MARC [3], the Augsburg’s Horde3D Game Engine [4], SmartBody [5], or … The Agent Framework is a set of functionalities within our open-source develop- ment platform, Frapper, for the creation of application … Cited by 2 Related articles All 3 versions
Modelling multi-party interactions among virtual characters, robots, and humans Z Yumak, J Ren, NM Thalmann, J Yuan – PRESENCE: Teleoperators and …, 2014 – MIT Press Page 1. Zerrin Yumak* Jianfeng Ren Nadia Magnenat Thalmann Institute for Media Innovation Nanyang Technological University Singapore Junsong Yuan School of Electrical and Electronic Engineering Nanyang Technological University Singapore Presence, Vol. 23, No. … Cited by 7 Related articles All 3 versions
A fast and robust pipeline for populating mobile AR scenes with gamified virtual characters M Papaefthymiou, A Feng, A Shapiro… – SIGGRAPH ASIA 2015 …, 2015 – dl.acm.org … maps integrated in our open- source OpenGL Geometric Application (glGA) framework. Effec- tive character interaction plays fundamental role in attaining high level of believability and makes the AR application more attractive and immersive based on the SmartBody framework …
XNAgent: Authoring Embodied Conversational Agents for Tutor-User Interfaces AM Olney, P Hays, WL Cade – AIED 2013 Workshops Proceedings Volume …, 2013 – Citeseer … Moreover, the recent version of MonoGame, an open source imple- mentation of XNA, promises to make XNAgent cross platform to desktop and mobile … Thiebaux, M., Marsella, S., Marshall, AN, Kallmann, M.: SmartBody: behavior realiza- tion for embodied conversational agents … Related articles All 4 versions
ADAPT: The Agent Developmentand Prototyping Testbed A Shoulson, N Marshak, M Kapadia… – … , IEEE Transactions on, 2014 – ieeexplore.ieee.org … algorithms. SmartBody [53] is an open-source system that combines steering, locomotion, gaze tracking, and reaching. These tasks are accomplished with 15 controllers working in uni- son to share control of parts of the body. … Cited by 25 Related articles All 17 versions
A Simple Embodied Dialog System A Cafaro, L Scagnetti – 2010 – ve-nlp-final-projects.googlecode. … … BML Realizer is an open source animation toolkit for visualizing vir- tual humans in rich 3D environments. … Specifically, they adopted the Panda3D rendering engine and redesigned SmartBody’s communication layer to make it usable in a simple single- application environment. … Related articles All 2 versions
A framework for developing embodied intelligent agents with affective behavior V Lungu – aimas.cs.pub.ro … Language) to convert emotions to behaviour. One first choice to investigate towards embodying our our emotional agents will be the use of SmartBody [15], an open source modular framework for realizing embodied characters. … Related articles
The Charismatic Computer: Examining How Expressive Interfaces Influence Beliefs D Lam – courses.ece.ubc.ca … The SmartBody module allows designers to create a virtual human and define physical features such as gender, skin colour, and clothing. … given by both versions of our virtual character was generated through the MARY Text-to-Speech System, an open source tool originally … Related articles
ION framework–a simulation environment for worlds with virtual agents M Vala, G Raimundo, P Sequeira, P Cuba… – Intelligent virtual …, 2009 – Springer … There are currently systems3 that use these markup languages like SmartBody [15] or ACE (ARticulated Communicator Engine) [10]. … elements, the framework enforces a set guidelines which are applied to all the intervenients4 2 The ION Framework is open-source under GNU … Cited by 30 Related articles All 9 versions
CHASE: character animation scripting environment C Mousas, CN Anagnostopoulos – … on Virtual Reality Continuum and its …, 2015 – dl.acm.org … 2. Balci, K., Not, E., Zancanaro, M., and Pianesi, F. 2007. Xface open source project and smil-agent scripting language for creating and animating embodied conversational agents. … Smartbody. http://smartbody.ict.usc.edu/. 12. Jung, YA 2008. …
Real-time expressive gaze animation for virtual humans M Thiebaux, B Lance, S Marsella – Proceedings of The 8th International …, 2009 – dl.acm.org … face to face interaction. The SBGC is designed to work within SmartBody, an open-source and highly versatile system that can produce interactive animated gaze shifts using a skeleton-independent API. Because the SBGC is … Cited by 22 Related articles All 12 versions
What’s next? the new era of autonomous virtual humans M Kapadia, A Shoulson, CD Boatright, P Huang… – Motion in Games, 2012 – Springer … facilitating efficient pathfinding. SteerSuite [31] is an open-source platform for developing and evaluating steering behaviors. SmartBody [29] is a modular, controller-based full-body character animation system. We hope that … Cited by 4 Related articles All 9 versions
Robots meet IVAs: a mind-body interface for migrating artificial intelligent agents M Kriegel, R Aylett, P Cuba, M Vala, A Paiva – Intelligent Virtual Agents, 2011 – Springer … By releasing CMION as open source we provide a basis for further research into migrating companions and hope that others will … Human-Robot Interaction, a Symposium at AISB (2009) [21] Thiebaux, M., Marsella, S., Marshall, AN, Kallmann, M.: Smartbody: Behavior realization … Cited by 17 Related articles All 12 versions
Multimodal behavior realization for embodied conversational agents A ?erekovi?, IS Pandži? – Multimedia tools and applications, 2011 – Springer … Main contributions of our paper are the following: the full-body and open-source real-time multimodal behavior realization system, a novel … only exception is the modular Nonverbal Behavior Generator [32] which has a layered architecture and uses the SmartBody module for … Cited by 6 Related articles All 15 versions
A controller-based animation system for synchronizing and realizing human-like conversational behaviors A ?erekovi?, T Pejša, IS Pandži? – Development of Multimodal Interfaces: …, 2010 – Springer … of domains, such as marketing, virtual tutors, advisors and communicative non-player characters in role-playing games ? open-source and publicly … The only exception is the Non-verbal Behavior Generator [2] which has a layered architecture and uses the SmartBody module for … Cited by 2 Related articles All 11 versions
Briscola On-Line A Cafaro, L Scagnetti – ve-nlp-final-projects.googlecode. … … is an open source animation toolkit for visualizing virtual hu- mans in rich 3D environments. … Specifically, they adopted the Panda3D rendering engine and redesigned SmartBody’s communication layer to make it usable in a sim- ple single-application environment. … Related articles All 2 versions
Mixed Reality for Robotics W Hönig, C Milanes, L Scaria, T Phan, M Bolas… – www-bcf.usc.edu … A secondary contribution of this work is to provide a testbed for Mixed Reality multi-robot research using small UAVs such as Bitcraze Crazyflie 2.0 [1], and provide open-source access to … Fig. 2. Two virtual humans simulated by SMARTBODY are followed by two quadcopters. …
Sign language avatars: animation and comprehensibility M Kipp, A Heloir, Q Nguyen – Intelligent Virtual Agents, 2011 – Springer … The resulting avatar technology is called Animgen and was used eg for the Virtual Guido avatar [1]. Drawbacks of Animgen are that it is not open source but also the reliance … The SmartBody agent is another well-known avatar technology which focuses on coverbal behaviors [30 … Cited by 34 Related articles All 13 versions
Motion data alignment and real-time guidance in cloud-based virtual training system W Wei, Y Lu, CD Printz, S Dey – … of the conference on Wireless Health, 2015 – dl.acm.org … TRAINING SYSTEM The architecture of the proposed cloud-based virtual training system is shown in Figure 1. An open-source character animation software platform, Smartbody [8], is used offline to pre-recode an avatar instructor’s movements for a physical therapy exercise. …
The Crowd Animation, Visualization, and Simulation Testbed A Beacco, N Pelechano – moving.cs.upc.edu … ADAPT [SMKB13] is an open-source Unity library … Similar to what we aim to do, SmartBody [Sha] is a character animation library that provides synchronized locomotion, steering, object manipulation, lip syncing, gaz- ing and nonverbal behavior in real-time. … Related articles All 5 versions
Nonverbal behavior generator for embodied conversational agents J Lee, S Marsella – Intelligent virtual agents, 2006 – Springer … Figure 1 shows SmartBody, in this case a doctor, whom the trainee interacts with. The next section describes related works. … Finally, BEAT included a commer- cial language tagger, while we are planning to maintain our nonverbal behavior generator open-source. … Cited by 126 Related articles All 19 versions
A virtual human agent for training novice therapists clinical interviewing skills P Kenny, AA Rizzo, TD Parsons, J Gratch… – Annual Review of …, 2007 – vrphobia.com … SmartBody: Synchronizes speech output with gestures and other non-verbal behavior to perform character control over the char- acters in the … The current underlying graphics engine used for the Virtual Envi- ronment, we are exploring lower cost Open Source engines such as … Cited by 7 Related articles All 4 versions
Pedagogically structured game-based training: Development of the ELECT BiLAT simulation RW Hill Jr, J Belanich, HC Lane, M Core, M Dixon… – 2006 – DTIC Document … The scenarios were loosely based on open-source stories about problems encountered in different locales around the world. … The Dialogue Manager (DM) handles turn- by-turn conversation for the virtual character and passes utterances to Smartbody for non-verbal behavior … Cited by 87 Related articles All 13 versions
Greta: Towards an interactive conversational virtual companion E Bevacqua, K Prepin, R Niewiadomski… – … : perspectives on the …, 2010 – researchgate.net … SmartBody (Thiébaux et al., 2008) is a modular, distributed open-source framework for animating ECAs in real time. … It is an open source animation toolkit for visualizing virtual characters in 3D environment that is partially based on the SmartBody framework. … Cited by 22 Related articles All 2 versions
Building interactive virtual humans for training environments P Kenny, A Hartholt, J Gratch, W Swartout… – Proceedings of I/ …, 2007 – ict.usc.edu … In contrast, ICT uses a sophisticated generator of non-verbal behavior based on the agent’s speech output (Lee at al, 2006) and a procedural animation system called SmartBody (Thiebaux et al, 2007), described later in the paper. … Cited by 112 Related articles All 6 versions
Realizing multimodal behavior M Kipp, A Heloir, M Schröder, P Gebhard – Intelligent virtual agents, 2010 – Springer … SmartBody was the first system to implement BML for agent control [6] but required many custom extensions to BML. … Our system is implemented on top of the SEMAINE API, an open-source distributed multi-platform component integration framework for real-time interactive … Cited by 27 Related articles All 15 versions
Cross-media agent platform R Niewiadomski, M Obaid, E Bevacqua… – Proceedings of the 16th …, 2011 – dl.acm.org … It is an open source animation toolkit for visualizing virtual characters in 3D environment that is partially based on the SmartBody framework. As input it also uses BML; the output is generated with the use of the Panda3D rendering engine. RealActor [Cerekovic et al. … Cited by 12 Related articles All 7 versions
Multimodal Behaviour Generation Frameworks in Virtual Heritage Applications: A Virtual Museum at Sverresborg MJ Stokes – 2009 – brage.bibsys.no … Figure 2: A MagiCster virtual agent displays different emotions in response to APML 2.1.4 SmartBody and BML Realiser SmartBody is an open-source character animation system developed to serve the “behaviour realiser” role in the SAIBA framework. It was 7 Page 12. … Related articles All 6 versions
A Virtual Human Agent for Training Novice Therapist Clinical Interviewing Skills Patrick Kenny, Albert A. Rizzo, Thomas D. Parsons, Jonathan Gratch & William … P Kenny – tbt4ebp.googlecode.com … SmartBody: Synchronizes speech output with gestures and other non-verbal behavior to perform character control over the characters in the … The current underlying graphics engine used for the Virtual Environment, we are exploring lower cost Open Source engines such as … Related articles All 3 versions
Challenges for the Animation of Expressive Virtual Characters: The Standpoint of Sign Language and Theatrical Gestures S Gibet, P Carreno-Medrano, PF Marteau – Dance Notations and Robot …, 2016 – Springer … More recently, novel languages and architectures, based on the SAIBA-BML behavior language have been proposed. The SmartBody [1] is an open source modular framework which hierarchically interconnects controllers to achieve continuous motion. …
Multi-party interaction with a virtual character and human-like robot: A case study Z Yumak, J Ren, NM Thalmann… – … Teleoperators and Virtual …, 2014 – eeeweba.ntu.edu.sg Page 1. Multi-party interaction with a virtual character and human-like robot: A case study Zerrin Yumak ? Institute for Media Innovation, Nanyang Technological University, Singapore Jianfeng Ren Institute for Media Innovation, Nanyang Technological University, Singapore … Related articles
Modeling culturally authentic style shifting with virtual peers J Cassell, K Geraghty, B Gonzalez… – Proceedings of the 2009 …, 2009 – dl.acm.org … Language. The visualization of the virtual agent is handled by PandaBMLR [2], which takes the output from SmartBody and renders it in a lifelike environment with Panda3D [11], an open-source rendering package. This allows … Cited by 12 Related articles All 2 versions
Lightweight procedural animation with believable physical interactions ID Horswill – Computational Intelligence and AI in Games, IEEE …, 2009 – ieeexplore.ieee.org … Although not a procedural animation system per se, SmartBody [41] provides a set of scheduling and synchronization mechanisms for blending and controlling animations, including … It is free, open-source software distributed under the Lesser Gnu Public License (LGPL) [50]. IV. … Cited by 20 Related articles All 10 versions
Body-hopping: Migrating Artificial Intelligent Agents between Embodiments RS Aylett, M Kriegel, P Cuba, M Vala, A Paiva, KL Koay… – researchgate.net … We discuss the migration of an intelligent agent between different embodiments, graphical or robotic. We first describe CMION, an open source architecture for coordinating the sensors and effectors of such an agent with its mind, (its high level decision making processes). … Related articles
Automated Culture Training System L Scagnetti – Computer Science, 2012 – en.ru.is … defined with BML code. Figure 4.3 shows the graphics user interface of SmartBody. Figure 4.3: SmartBody GUI. Page 32. 18 Automated Culture Training System 4.5 CADIA BML Realizer CADIA BML Realizer(BMLR)[1] is an open source animation toolkit for visualizing … Related articles All 2 versions
Increasing adaptability of a speech into sign language translation system V López-Ludeña, R San-Segundo, CG Morcillo… – Expert Systems With …, 2013 – Elsevier … parallel corpus. The statistical translation module is based on Moses, an open-source phrase-based translation system released from NAACL Workshops on Statistical Machine Translation (http://www.statmt.org) in 2011. In … Cited by 5 Related articles All 9 versions
Standardized Prototyping and Development of Virtual Agents AS Hill, J Cassell – 2008 – obsolete.eecs.northwestern.edu … An interface between any realizer and Panda3D is attractive to our work because we have been investigating using the open source rendering engine for some time. The SmartBody behavior realizer is a system developed at UCS by Stacy Marsalla and his team working in … Related articles All 6 versions
Simulating Gait and Structural Effects of Aging for Improved Diversity in Virtual Crowds C Gunaratne, P Wimalaratne – Computer Graphics, Imaging and …, 2013 – ieeexplore.ieee.org … SmartBody is an open-source C++ based BML realizer that uses an OGRE (Object-Oriented Graphics Rendering Engine) renderer. Design of character behaviors is done in compliance to the BML-1.0 SAIBA framework standard [13]. … Related articles All 6 versions
A Shared, Modular Architecture for Developing Virtual Humans A Hartholt, D Traum, S Marsella, LP Morency… – ict.usc.edu … audio-visual sens- ing) [21], FLoReS (dialogue manager) [15], Cerebella (nonverbal behavior generation) [14], and SmartBody (character animation) [22 … ELRA, LREC (2008) 2. Bickmore, TW, Schulman D., Shaw, G., DTask & LiteBody: Open Source, Standards- based Tools for … Related articles
Developing INOTS to support interpersonal skills practice J Campbell, M Core, R Artstein… – Aerospace …, 2011 – ieeexplore.ieee.org … student to choose. The underlying messaging architecture utilizes an open source messaging broker, [14] which multicasts all system messages. … This skeleton is manipulated by SmartBody, an in-house developed procedural animation system [20]. … Cited by 5 Related articles All 12 versions
AsapRealizer in practice–a modular and extensible architecture for a BML realizer D Reidsma, H van Welbergen – Entertainment computing, 2013 – Elsevier Building a complete virtual human application from scratch is a daunting task, and it makes sense to rely on existing platforms for behavior generation. When on. Cited by 3 Related articles All 9 versions
Towards Cloth-Manipulating Characters E Miguel, A Feng, Y Xu, A Shapiro… – Proc. of CEIG ( …, 2010 – arishapiro.com … handling. For the locomotion, reaching and posing, grasping and motion blending systems we have used Smartbody [18] animation engine. Compared to the scheme in Fig. … [17] Erwin Coumans et al. Bullet physics library. Open source: bulletphysics. org, 2006. [18] Ari Shapiro. … Related articles All 6 versions
Multimodal Plan Representation for adaptable BML scheduling D Reidsma, H van Welbergen, J Zwiers – Intelligent Virtual Agents, 2011 – Springer … Elckerlyc’s scheduling algorithm is based on the SmartBody Scheduler de- scribed in Section 2.1. … Other applications and scenarios have been described elsewhere; videos and demonstrations may be found on the Elckerlyc web site and in the open source code release. … Cited by 5 Related articles All 17 versions
Live speech driven head-and-eye motion generators BH Le, X Ma, Z Deng – Visualization and Computer Graphics, …, 2012 – ieeexplore.ieee.org … Thiébaux et al. [44] proposed a parameterized gaze controller on top of the open-source SmartBody virtual human system. Ma and Deng [45] proposed an effective technique to synthesize natural eye gaze by modeling the linear coupling between eye and head movement. … Cited by 29 Related articles All 14 versions
Look me in the eyes: A survey of eye and gaze animation for virtual agents and artificial systems K Ruhland, S Andrist, J Badler… – … State-of-the-Art …, 2014 – hal.univ-grenoble-alpes.fr Page 1. Look me in the eyes: A survey of eye and gaze animation for virtual agents and artificial systems Kerstin Ruhland, Sean Andrist, Jeremy Badler, Christopher Peters, Norman Badler, Michael Gleicher, Bilge Mutlu, Rachel Mcdonnell To cite this version: … Cited by 12 Related articles All 24 versions
Embodied conversational agent avatars in virtual worlds: Making today’s immersive environments more responsive to participants JF Morie, E Chance, K Haynes, D Rajpurohit – Believable Bots, 2012 – Springer … The SimCoach can answer typed queries in real time, while the movements are procedurally triggered via SmartBody markups to the … This was made possible, in part, by leveraging an open source software library then known as libsecondlife (now called libOpenMetaverse). … Cited by 4 Related articles All 4 versions
Continuous interaction with a virtual human D Reidsma, I de Kok, D Neiberg, SC Pammi… – Journal on Multimodal …, 2011 – Springer Page 1. J Multimodal User Interfaces (2011) 4:97–118 DOI 10.1007/s12193-011- 0060-x ORIGINAL PAPER Continuous interaction with a virtual human Dennis Reidsma · Iwan de Kok · Daniel Neiberg · Sathish Chandra Pammi … Cited by 29 Related articles All 28 versions
A multimodal approach of generating 3D human-like talking agent M Yang, J Tao, K Mu, Y Li, J Che – Journal on Multimodal User Interfaces, 2012 – Springer … [24] proposed a hierarchically connected ani- mation controllers based on SmartBody, an open source en- gine for animating agent. In [25], authors use baseline, a set of fixed parameters, to present the personalized agent Page 3. J Multimodal User Interfaces (2012) 5:61–68 … Cited by 2 Related articles All 9 versions
The Embodied Conversational Agent Toolkit: A new modularization approach. RJ van der Werf – 2008 – Citeseer … Other systems have focused mainly on the behavior realization component (ACE [41], Gesture Engine [25], Pantomime [17], SmartBody [66]). … ECAT can be seen as a behavior realization system consisting of multiple (open-source) components which can be shared among … Cited by 1 Related articles All 3 versions
The Embodied Conversational Agent Toolkit: a new modularization approach. RJ Werf – 2008 – essay.utwente.nl … Other systems have focused mainly on the behavior realization component (ACE [41], Gesture Engine [25], Pantomime [17], SmartBody [66]). … ECAT can be seen as a behavior realization system consisting of multiple (open-source) components which can be shared among … Related articles
Toward a multi-culture adaptive virtual tour guide agent with a modular approach HH Huang, A Cerekovic, IS Pandzic, Y Nakano… – AI & society, 2009 – Springer … from scratch. Utilizing available software tools is a typical method in implementing ECAs. For example, Smart- Body (Thiebaux et al. 2008) is an open source modular framework for animating ECAs in real time. An EMA emo … Cited by 10 Related articles All 13 versions
Methodology for developing an advanced communications system for the Deaf in a new domain V López-Ludeña, C González-Morcillo… – Knowledge-Based …, 2014 – Elsevier … translation model. The statistical translation module is based on Moses, an open-source, phrase-based translation system released from NAACL Workshops on Statistical Machine Translation (http://www.statmt.org) in 2011. In … Cited by 4 Related articles All 4 versions
Embodied Conversational Agent Avatars in Virtual Worlds: Making Today’s Immersive Environments More JF Morie, E Chance, K Haynes, D Rajpurohit – projects.ict.usc.edu … The SimCoach can answer typed queries in real time, while the movements are procedurally triggered via SmartBody markups to the … This was made possible, in part, by leveraging an open source software library then known as libsecondlife (now called libOpenMetaverse).2 … Related articles All 3 versions
Realization and high level specification of facial expressions for embodied agents R Paul – 2010 – essay.utwente.nl … 22 3.3.4 SmartBody scheduler . . . . . 22 3.3.5 Conclusion . . . . . … Xface is, amongst other things, an open source implementation of MPEG-4 FA [5]. In Xface, users should select a set of vertices for all feature points (zones). … Cited by 1 Related articles All 3 versions
Modeling Human Communication Dynamics for Virtual Human LP Morency, A Shapiro, S Marsella – Coverbal Synchrony in …, 2013 – books.google.com … transform the input into behavior schedules, written in the Behavior Markup Language (BML, Kopp et al., 2006) and then passed to a character animation system (SmartBody, Thiebaux et al … The software was made available online on an open-source website (sourceforge. … Related articles All 2 versions
SimCoach Evaluation: A Virtual Human Intervention to Encourage Service-Member Help-Seeking for Posttraumatic Stress Disorder and Depression D Meeker, JL Cerully, MD Johnson, N Lyer, JR Kurz… – 2015 – DTIC Document Page 1. Daniella Meeker, Jennifer L. Cerully, Megan D. Johnson, Neema Iyer, Jeremy R. Kurz, Deborah M. Scharf SimCoach Evaluation A Virtual Human Intervention to Encourage Service-Member Help-Seeking for Posttraumatic Stress Disorder and Depression …
Enhancing believability: evaluating the application of Delsarte’s aesthetic system to the design of virtual humans M Nixon – 2009 – summit.sfu.ca … 63 3.3.8 Style in gesture….. 65 3.3.9 SmartBody ….. 68 3.4 Embedding Emotions and Style ….. … Cited by 3 Related articles
Multi-actor planning for directable simulations M Kapadia, S Singh, G Reinman… – Digital Media and …, 2011 – ieeexplore.ieee.org … With help from the community, we envision a growing open-source library of actor definitions that can be re-used to direct completely new simulations, with a few … [11] Marcus Thiebaux, Stacy Marsella, Andrew N. Marshall, and Marcelo Kallmann, “Smartbody: behavior realization … Cited by 2 Related articles All 8 versions
Motion Data Alignment For Real-Time Guidance in Avatar Based Physical Therapy Training System D Shen, Y Lu, S Dey – mesdat.ucsd.edu … by the Kinect. Furthermore, Smartbody [11], the open source character animation platform we developed upon, accounts for body size differences between the user and the avatar by retargeting the joint positions. In order to …
A Review of Eye Gaze in Virtual Agents, Social Robotics and HCI: Behaviour Generation, User Interaction and Perception K Ruhland, CE Peters, S Andrist… – Computer Graphics …, 2015 – Wiley Online Library Skip to Main Content. Wiley Online Library. Log in / Register. Log In E-Mail Address Password Forgotten Password? Remember Me. … Cited by 1 Related articles All 2 versions
Generating listening behaviour D Heylen, E Bevacqua, C Pelachaud, I Poggi… – Emotion-oriented …, 2011 – Springer … In order to mask the different recording conditions between the speaker sentence and the feedback, a low-intensity white noise (at – 60 dB) was added to the resulting stimuli. The test was carried out in a web-enabled setup, using the open source tool RatingTest. … Cited by 22 Related articles All 12 versions
Virtual Heritage: new technologies for edutainment A Martina – 2014 – porto.polito.it Page 1. Politecnico di Torino Porto Institutional Repository [Doctoral thesis] Virtual Heritage: new technologies for edutainment Original Citation: Martina A. (2014). Virtual Heritage: new technologies for edutainment. PhD thesis … Related articles All 2 versions
Multimodal plan representation for adaptable BML scheduling H van Welbergen, D Reidsma, J Zwiers – Autonomous agents and multi- …, 2013 – Springer … 3 Our current SmartBody-based scheduling strategy does not make use of this functionality yet, it is provided for future extension. … scenarios have been described elsewhere; videos and demonstrations may be found on the Elckerlyc web site and in the open source code release … Cited by 2 Related articles All 14 versions
Self-reported symptoms of depression and PTSD are associated with reduced vowel space in screening interviews S Scherer, G Lucas, J Gratch, A Rizzo, LP Morency – ieeexplore.ieee.org … In addition to SmartBody, ICT’s Cerebella software automates the generation of physical behaviors for virtual humans, including nonverbal … speech analysis repository available for Matlab and Octave [58]7. COVAREP provides an extensive selection of open-source robust and …
Real Time Animation of Virtual Humans: A Trade-off Between Naturalness and Control HWBJH van Basten, AEZRMH Overmars – herwinvanwelbergen.nl … 3.2.5. Physical Simulation Software and Hardware Several software toolkits can be used for FD and/or impact and friction handling, including the open source software such as the Open Dynamics Engine [Smi08] and the Bul- let Open Source Physics Library [Cou08], and … Related articles All 4 versions
Animating synthetic dyadic conversations with variations based on context and agent attributes L Sun, A Shoulson, P Huang, N Nelson… – … and Virtual Worlds, 2012 – Wiley Online Library … Taking BML as the input, SmartBody [22], an open source modular framework, can realize behavior scheduling, synchronization, and animation. Jan et al.[23] have presented a model for simulating cultural differences in the conversational behavior of virtual agents. … Cited by 4 Related articles All 2 versions
Multimodal HCI Output: Facial Motion, Gestures and Synthesised Speech Synchronisation IS Pandžic – 2010 – books.google.com … Some popular exam- ples are open source engines Ogre, Horde3D and Panda3D1, though there are numerous others. … and synthesis, natural language understanding and generation, nonverbal behaviour generation based on [43] and the SmartBody interactive character … Related articles
Bridging the gap between social animal and unsocial machine: A survey of social signal processing A Vinciarelli, M Pantic, D Heylen… – Affective Computing, …, 2012 – ieeexplore.ieee.org Page 1. IEEE TRANSACTIONS ON AFFECTIVE COMPUTING 1 Bridging the Gap Between Social Animal and Unsocial Machine: A Survey of Social Signal Processing Alessandro Vinciarelli, Maja Pantic, Dirk Heylen, Catherine … Cited by 149 Related articles All 22 versions
The near future of technology in higher education K Rasmussen, GV Davidson-Shivers… – … Integration in Higher …, 2010 – books.google.com Page 350. 326 Chapter 23 The Near Future of Technology in Higher Education Karen L. Rasmussen University of West Florida, USA Gayle V. Davidson-Shivers University of South Alabama, USA Wilhelmina C. Savenye Arizona … Cited by 5 Related articles All 3 versions
TTS-driven Embodied Conversation Avatar for UMB-SmartTV M Rojc, Z Ka?i?, M Presker, I Mlakar – europment.org … Web. 31 Jul. 2013. doi:10.4018/jthi.2013040105. [12] M. Thiebaux, S. Marsella, AN Marshall, M. Kallmann, SmartBody: behavior realization for embodied conversational agents. In proc. … [34] XBMC, Open Source Home Theatre Software, http://xbmc.org/, last visited in July, 2013. … Related articles All 9 versions
Social Spatial Behavior for 3D Virtual Characters N Karimaghalou – 2013 – summit.sfu.ca … SmartBody real-time 3D animation software (Thiebaux, Marsella, Marshall & Kallmann, 2008) developed in University of Southern California1 … Implementing our proposed social navigation model in a two-stage behavior generation process using SmartBody software … Related articles
Describing and Animating Complex Communicative Verbal and Nonverbal Behavior Using Eva-Framework I Mlakar, Z Ka?i?, M Rojc – 2014 – Taylor & Francis … 2008. SmartBody: Behavior realization for embodied conversational agents. In Proceedings of Autonomous Agents and Multi-Agent Systems (AAMAS’08), 151–158. Richland, SC: AAMAS. View all references) is an open-source modular framework for animating those embodied … Related articles All 4 versions
[BOOK] Virtual Crowds: Steps Toward Behavioral Realism M Kapadia, N Pelechano, J Allbeck, N Badler – 2015 – books.google.com … 177 An Open Source Platform for Authoring Functional Crowds. . . . . 181 21.1 ADAPT . . . . … for their generous support through equipment and grants, as well as Autodesk, Unity, and USC ICT’s SmartBody project for their support and use of software. …
Automated Simulation Creation from Military Operations Documents J Balint, JM Allbeck, MR Hieb – cs.gmu.edu … We have written our own visualization software using the open source graphics engine OGRE and added an import option to the Unity game engine development environment. … We are also grateful for the use of ICT’s SmartBody software for human character animation. …
HapFACS 3.0: FACS-Based Facial Expression Generator for 3D Speaking Virtual Characters R Amini, C Lisetti, G Ruiz – ieeexplore.ieee.org … facial expressions. Smartbody [32], [33], for example, provides realistic character modeling such as loco- motion, facial animation (11 AUs), speech synthe- sis, reaching/grabbing, and various automated non- verbal behaviors. It … Related articles All 2 versions
TTS-driven Expressive Embodied Conversation Agent EVA for UMB-SmartTV M Rojc, M Presker, Z Ka?i?, I Mlakar – researchgate.net Page 1. Abstract— The main goal of using non-verbal modalities together with the general text-to-speech (TTS) system is to better emulate human-like course of the interaction between users and the UMB-SmartTV platform. … Related articles
Bridging the Gap between Social Animal and Unsocial Machine: A Survey of Social Signal Processing C Pelachaud, I Poggi, F D’Errico, M Schröder – dcs.gla.ac.uk Page 1. Bridging the Gap between Social Animal and Unsocial Machine: A Survey of Social Signal Processing Alessandro Vinciarelli, Member, IEEE, Maja Pantic, Fellow, IEEE, Dirk Heylen, Catherine Pelachaud, Isabella Poggi, Francesca D’Errico, and Marc Schröder … Related articles All 2 versions
User’s Gestural Exploration of Different Virtual Agents’ Expressive Profiles (Short Paper) M Courgeon, JC Martin… – AAMAS’08 Proceedings …, 2008 – digitalcommons.fiu.edu … animated agents called Maxine. The engine, based on open source tools, allowsmanagement of scenes and virtual characters, and pays special attention to multimodal and emotional interaction with the user. Virtual actors are … Related articles All 9 versions