Notes:
This text discusses the use of virtual humans, also known as chatbots or conversational agents, in dialogue systems. These systems use computer vision, spoken dialogue, and virtual human avatars to engage in conversation with users. They have the potential to provide mental well-being benefits through anonymity and building rapport with users. There are challenges in defining the goals for open-domain chat systems and encoding dialogue strategy into responses. Virtual humans can be made up of modular components for user input, speech recognition, and animation that must work together to create a realistic appearance. Socially-aware dialogue systems, which consider the social context of conversation, are also discussed. The performance of spoken dialogue systems and the importance of backchannels in human-agent conversations are also mentioned. There is potential for virtual humans to be used as tutors in educational settings and to show positive emotion elicitation in conversations. There are both text-based and speech-based chatbots.
Dialogue strategy refers to the set of rules or guidelines that a chatbot follows to determine how to respond to a user’s input. There are various approaches to encoding dialogue strategy into chatbot responses, including rule-based systems, script-based systems, and machine learning-based systems.
In a rule-based system, the chatbot responds to user input based on a set of pre-determined rules. These rules can be as simple as matching keywords in the user’s input to predetermined responses, or they can be more complex and involve logic and decision-making.
In a script-based system, the chatbot responds to user input based on a predefined script of conversation. This approach can be used to create a more natural-sounding conversation, but it is limited in its ability to handle unexpected or off-script input.
In a machine learning-based system, the chatbot is trained on a large dataset of conversation examples and learns to respond to user input based on patterns it has learned from this data. This approach can be more flexible and able to handle unexpected input, but it requires a large amount of training data and can be more complex to set up and maintain.
A socially-aware dialog system is designed to take into account the social context of a conversation, including the social roles of the participants, the social norms and expectations of the conversation, and the social goals of the participants. This can involve considering factors such as the relationship between the participants, the level of formality of the conversation, and the context in which the conversation is taking place.
By considering the social context of a conversation, a socially-aware dialog system can produce more natural and appropriate responses, which can lead to a more engaging and satisfying conversation for the user. This is especially important for chatbots or virtual assistants that are intended to interact with humans, as humans often expect their conversations with other humans to follow certain social norms and expectations.
There are various approaches to building a socially-aware dialog system, including using machine learning to analyze and model social behaviors, incorporating knowledge about social norms and expectations into the dialog system’s design, and using natural language processing techniques to understand the social context of a conversation.
Backchannels are nonverbal cues that listeners give during a conversation to show that they are paying attention and following along with the conversation. These cues can include verbal sounds like “uh-huh” or “mm-hmm,” as well as nonverbal behaviors such as nodding or making eye contact.
In human-agent conversations, backchannels can be used by the chatbot or virtual assistant to show that it is listening and engaged in the conversation. This can help to create a more natural and engaging conversation for the user. Some examples of backchannels that a chatbot or virtual assistant might use include:
- Verbal sounds: The chatbot can make verbal sounds like “uh-huh” or “mm-hmm” to show that it is following along with the conversation.
- Nodding or head movements: The chatbot can nod its head or make other movements to show that it is paying attention and understands what is being said.
- Eye contact: The chatbot can make eye contact with the user to show that it is focused on the conversation.
- Facial expressions: The chatbot can use facial expressions to show emotions or reactions to what is being said.
Backchannels can be an important part of creating a natural and engaging conversation with a chatbot or virtual assistant, as they help to create a sense of connection and interaction between the user and the chatbot.
See also:
Virtual Humans & Dialog Systems 2017 (130x) | Virtual Humans & Dialog Systems 2018 (145x)
A Systematic Review of Health Dialog Systems
WR Kearns, NC Chi, YK Choi, SY Lin… – … of information in …, 2019 – thieme-connect.com
… A, Bengio Y, Courville AC, Pineau J. Building end-to-end dialogue systems using generative … procedures: an experimental test using a virtual character in a dialog systems training application … 122-124; 41 Krishnan V, Foster A, Kopper R, Lok B. Virtual human personality masks …
DS2A: A Dialogue System for Sexual Assault and Harassment Education
D Traum, R Artstein, C Gordon, A Leuski – dialogforgood.org
… video, in conjunction with Natural Language Pro- cessing technology to create a dialogue system, capable of answering questions related to … in the Unity game engine (https: //unity3d.com); it incorporates several com- ponents from the USC ICT Virtual Human Toolkit (Hartholt et …
Multitask prediction of exchange-level annotations for multimodal dialogue systems
Y Hirano, S Okada, H Nishimoto… – … Conference on Multimodal …, 2019 – dl.acm.org
… 2 RELATED WORKS This research is related to a multimodal dialogue system, and multimodal … is useful for detecting system error or inappropriate action by dialogue systems in the … However, various types of virtual human or con- versation robots that communicate with users by …
Comparing cross language relevance vs deep neural network approaches to corpus-based end-to-end dialogue systems
SH Alavi, A Leuski, D Traum – … of the 23rd Workshop on the …, 2019 – www-scf.usc.edu
Page 1. Comparing Cross Language Relevance vs Deep Neural Network Approaches to Corpus-based End-to-end Dialogue Systems ? … 2011. NPCEditor: Creating virtual human dialogue using information retrieval techniques … taking a spoken dialog system to the real world …
Nemsi: A multimodal dialog system for screening of neurological or mental conditions
D Suendermann-Oeft, A Robinson, A Cornish… – Proceedings of the 19th …, 2019 – dl.acm.org
… KEYWORDS dialog systems, multimodal systems, health technology … NEurological and Mental health Screening Instrument), a cloud-based multimodal dialog system that conducts … For example, SimSensei Kiosk [3] is a virtual human interviewer specifically built to render clinical …
Learning Dialogue Strategies for Interview Dialogue Systems that Can Engage in Small Talk
T Nakamura, T Kobori, M Nakano – … Workshop on Spoken Dialogue System …, 2019 – Springer
… result indicates that small-talk utterances are important for continuous use of a dialogue system … Hupp A, Vickers L, Yan H, Zhang C (2013) Spoken dialog systems for automated … Nakano M, Nakamura T (2016) Small talk improves user impressions of interview dialogue systems …
Virtual human standardized patients for clinical training
T Talbot – Virtual reality for psychological and Neurocognitive …, 2019 – Springer
… Due to strengths of their dialogue system AI, VSPs excel at interview and counseling skills applications … As the single student progresses through the scenario, a branching dialog system can lead to various successful and … Health dialog systems for patients and consumers …
Survey on evaluation methods for dialogue
JM Deriu, A Rodrigo, A Otegi, E Guillermo, S Rosset… – 2019 – digitalcollection.zhaw.ch
… There are many different approaches to design a dialogue manager, which are partly dictated by the application of the dialogue system. However, there are three broad classes of dialogue systems, which we encounter in the literature: task-oriented systems, conversational …
Recent advances in conversational NLP: Towards the standardization of Chatbot building
M Mnasri – arXiv preprint arXiv:1903.09025, 2019 – arxiv.org
… 2018. Super- vised clustering of questions into intents for dialog system applications … 2016. A network- based end-to-end trainable task-oriented dialogue system. arXiv preprint arXiv:1604.04562 … 2007. Partially observable Markov decision processes for spoken dialog …
A conversational dialogue manager for the humanoid robot ERICA
P Milhorat, D Lala, K Inoue, T Zhao, M Ishida… – … Social Interaction with …, 2019 – Springer
… 1. Banchs R, Li H (2012) IRIS: a chat-oriented dialogue system based on the vector … T, Raux A, Lane I, Devassy J, Gupta R (2013) Situated multi-modal dialog system in vehicles … Wen TH, Young S (2016) On-line reward learning for policy optimisation in spoken dialogue systems …
Evaluating a Spoken Dialogue System for Recording Systems of Nursing Care
T Mairittha, N Mairittha, S Inoue – Sensors, 2019 – mdpi.com
… It can be based on text-based or speech-based and can also be used on different devices. Typically, dialogue systems can classify into two categories—a task-oriented dialogue system which is used in this paper; and a non-task-oriented dialogue system or chatbot …
CasandRA: A Screenplay Approach to Dictate the Behavior of Virtual Humans in AmI Environments
M Antona – HCI International 2019–Late Breaking Posters: 21st …, 2019 – books.google.com
… CasandRA: A Screenplay Approach to Dictate the Behavior of Virtual Humans 59 social presence and … For example, the ICT Virtual Human Toolkit [16, 17] offers a flexible framework for … of interface is made possible with the help of multimodal dialogue systems, which extend …
A Classification-Based Approach to Automating Human-Robot Dialogue
F Gervits, A Leuski, C Bonial, C Gordon, D Traum – 2019 – hrilab.tufts.edu
… Leuski, A., Traum, D.: Npc editor: Creating virtual human dialogue using information retrieval techniques … C., Marge, M., Voss, CR, Traum, D.: ScoutBot: A Dialogue System for Collaborative … J.: A survey of available corpora for building data-driven dialogue systems: The journal …
CasandRA: A Screenplay Approach to Dictate the Behavior of Virtual Humans in AmI Environments
E Stefanidi, A Leonidis, N Partarakis… – … Conference on Human …, 2019 – Springer
… For example, the ICT Virtual Human Toolkit [16, 17] offers a flexible framework for … the help of multimodal dialogue systems, which extend common speech dialogue systems with additional … However, in order to unleash the power of Virtual Humans as conversational agents in …
Anticipation and its applications in human-machine interaction
S Ondáš, M Pleva – Proceedings of the 19th Conference Information …, 2019 – ceur-ws.org
… [19] K. Sagae, D. DeVault, and DR Traum, “Interpretation of partial utterances in virtual human dialogue systems”, Proc. of the NAACL HLT 2010. Association for Computational Linguistics, Stroudsburg, PA, USA, pp.33-36, 2010 …
Dialogue design and management for multi-session casual conversation with older adults
SZ Razavi, LK Schubert, B Kane, MR Ali… – arXiv preprint arXiv …, 2019 – arxiv.org
… integration of an automated dialogue system for multi-topic conversations into a virtual human (LISSA), designed … We first com- ment on extant work on spoken dialogue systems that are designed to help older adults; then we introduce our virtual agent, LISSA, and briefly …
User intent prediction in information-seeking conversations
C Qu, L Yang, WB Croft, Y Zhang, JR Trippas… – Proceedings of the 2019 …, 2019 – dl.acm.org
… and character level [32]. These new deep learn- ing techniques have been applied in medical dialog systems [4]. In this paper, we focus on user intent prediction in information- seeking conversations. This specific utterance …
Conversation is multimodal: thus conversational user interfaces should be as well
S Schaffer, N Reithinger – … of the 1st International Conference on …, 2019 – dl.acm.org
… A dialogue system with symmetric multimodality must not only understand and represent the user’s multimodal input, but … We therefore argue that the research findings in the area of multimodal dialog systems can be … Dialogue systems go multimodal: The SmartKom experience …
Designing an emotionally realistic chatbot framework to enhance its believability with AIML and information states
R Sutoyo, A Chowanda, A Kurniati… – Procedia Computer …, 2019 – Elsevier
… contributes to the design of a chatbot system with emotions model induced into the dialogue system … The ubuntu dialogue corpus: A large dataset for research in unstructured multi-turn dialogue systems … Evaluating prerequisite qualities for learning end-to-end dialog systems …
Analyzing How a Talk Show Host Performs Follow-Up Questions for Developing an Interview Agent
H Narimatsu, R Higashinaka, H Sugiyama, M Mizukami… – workshop.colips.org
… Recently, an abundance of work on chat-oriented dialogue systems has been re- ported [3, 9]. The typical strategy … This paper adds interviewing skills to a chat-oriented dialogue system in order to produce more engaging dialogue … Counseling dialog system with 5w1h extraction …
A Spoken Dialogue System for Spatial Question Answering in a Physical Blocks World
G Platonov, B Kane, A Gindi, LK Schubert – arXiv preprint arXiv …, 2019 – arxiv.org
… question answering in a holistic way, using a vision system, speech input and output medi- ated by an animated avatar, a dialogue system that robustly … in that (1) it is an end-to-end system using com- puter vision and spoken dialogue with an on-screen virtual human; (2) it did …
Can we use a spoken dialogue system to document endangered languages?
SH Alavi, J Brixey, D Traum – dialogforgood.org
… Dialogue systems could provide a way for speakers of endangered languages to produce au- dio data … that users are willing to engage in summaries and small talk with a dialogue system, so long as … Simsensei kiosk: A virtual human interviewer for healthcare decision support …
Survey on intelligent chatbots: State-of-the-art and future research directions
EH Almansor, FK Hussain – … on Complex, Intelligent, and Software Intensive …, 2019 – Springer
… K., Eskenazi, M.: Generative encoder-decoder models for task-oriented spoken dialog systems with chatting … Banchs, RE, Li, H.: IRIS: a chat-oriented dialogue system based on the vector … of user satisfaction using N-gram-based dialog history model for spoken dialog system …
PRIMER: An Emotionally Aware Virtual Agent.
C Gordon, A Leuski, G Benn, E Klassen, E Fast… – IUI …, 2019 – research.ibm.com
… KEYWORDS Virtual Reality, Virtual Agents, Spoken Dialogue Systems, Mixed- Initiative Dialogue … several interface developments that go beyond previous systems using the virtual human toolkit: User … that will be further elaborated below in the section on the Dialogue System …
Modelling Attitudes of a Conversational Agent.
M Koit – KEOD, 2019 – scitepress.org
… A dialogue system will have both dialogue modeling and dialogue management components (Traum, 2017) … An interesting and useful kind of dialogue systems rapidly developing in the last years are embodied conversational agents (Harthold et al., 2013; Ravenet et al., 2015 …
Empathic dialogue system based on emotions extracted from tweets
S Tahara, K Ikeda, K Hoashi – … of the 24th International Conference on …, 2019 – dl.acm.org
… The proposed dialogue system realizes conversations based on news articles, and responds to user … and Fung, P. Real-time speech emotion and sentiment recognition for interactive dialogue systems … 2016) [2] Bessho, F., Harada, T., and Kuniyoshi, Y. Dialog system using real …
Dialogue Model and Response Generation for Emotion Improvement Elicitation
N Lubis, S Sakti, K Yoshino, S Nakamura – ahcweb01.naist.jp
… approaches have been reported to show promising results for chat-based dialogue systems [30, 31 … level positive emotion elicitation approaches can be combined into a full-fledged dialogue system … Simsensei kiosk: A virtual human interviewer for healthcare decision support …
Joseph Newbold
S Rintel, A Thieme – 2019 – researchgate.net
… of sensitive information; but also risk inviting misperceptions of their emotional capabilities [2, 6, 7]. Recent research suggests that we need to better understand how the design of dialogue systems may impact … It’s only a computer: Virtual humans increase willingness to disclose …
Engagement-based adaptive behaviors for laboratory guide in human-robot dialogue
K Inoue, D Lala, K Yamamoto… – … Dialog System …, 2019 – sap.ist.i.kyoto-u.ac.jp
… Kawahara, T.: Spoken dialogue system for a human-like conversational robot ERICA … AW, Rudnicky, AI: A Wizard-of-Oz study on a non- task-oriented dialog systems that reacts … Yu, Z., Ramanarayanan, V., Lange, P., Suendermann-Oeft, D.: An open-source dialog system with real …
Challenge discussion: advancing multimodal dialogue
J Allen, E André, PR Cohen, D Hakkani-Tür… – The Handbook of …, 2019 – dl.acm.org
… Given the huge variation in this multidimensional space, it is no sur- prise that the most frequently deployed commercial dialogue systems are very sim- ple, including system-initiated Interactive Voice Response systems that take over a conversation and provide a limited set of …
Artificial intelligence for a social world
J Cassell – Issues in Science and Technology, 2019 – JSTOR
… it is called an embodied conversational agent (ECA, pronounced “eh-ka” in Europe), or simply a virtual human … At the most basic level, the ECA is a dialogue system without a body. Dialogue systems are the kind of AI that you speak with when you call United Airlines or AT&T, or …
The Spoken Wikipedia Corpus collection: Harvesting, alignment and an application to hyperlistening
T Baumann, A Köhn, F Hennig – Language Resources and Evaluation, 2019 – Springer
Spoken corpora are important for speech research, but are expensive to create and do not necessarily reflect (read or spontaneous) speech ‘in the wil.
Effects of system response delays on elderly humans’ cognitive performance in a virtual training scenario
M Wirzberger, R Schmidt, M Georgi, W Hardt… – Scientific reports, 2019 – nature.com
… By contrast, a study by 5 showed that a dialogue system with a very short response time (M = 0.37 s) received worse ratings … In this context, spoken dialogue systems become useful and offer a more natural way for humans to interact with these systems …
Multimodal conversational interaction with robots
G Skantze, J Gustafson, J Beskow – The Handbook of Multimodal …, 2019 – dl.acm.org
… body. Hal only stares at the interlocutor with his (now emblematic) red eye. For a long time, spoken dialogue systems developed in research labs and employed in the industry also lacked any physical embodiment. One reason …
Latent character model for engagement recognition based on multimodal behaviors
K Inoue, D Lala, K Takanashi, T Kawahara – … on Spoken Dialogue System …, 2019 – Springer
… In future work, we will implement a spoken dialogue system utilizing the engagement recognition model … Rudnicky AI (2016) A Wizard-of-Oz study on a non-task-oriented dialog systems that reacts … V, Lange P, Suendermann-Oeft D (2017) An open-source dialog system with real …
Digital survivor of sexual assault
R Artstein, C Gordon, U Sohail, C Merchant… – Proceedings of the 24th …, 2019 – dl.acm.org
… JRE) and ActiveMQ are bundled with the system, as are the Virtual Human Toolkit components … We added such questions based on our ex- perience in designing dialogue systems in many different … in order to quickly build a mock-up of the eventual dialogue system which could …
An overview of the features of chatbots in mental health: A scoping review
AA Abd-Alrazaq, M Alajlani, AA Alalwan… – International Journal of …, 2019 – Elsevier
… The first, a scoping review focused on only embodied conversational agents (ie chatbots that show virtual human characters on their screens to mimic main features of human face-to-face conversation, such as verbal and nonverbal behavior) [22] …
A research platform for multi-robot dialogue with humans
M Marge, S Nogar, CJ Hayes, SM Lukin… – arXiv preprint arXiv …, 2019 – arxiv.org
… produces responses using statistical retrieval algorithms from prior dialogue system implementa- tions … NPCEditor: Creating Virtual Human Dialogue Using Infor- mation Retrieval Techniques … OpenDial: A Toolkit for Developing Spoken Dialogue Systems with Probabilistic Rules …
Eye gaze in interaction: towards an annotation scheme for dialogue
V Somashekarappa, C Howes, A Sayeed – semdial.org
… But we are at the verge of breakthroughs in building virtual human avatars, and now, more than ever … cussed above, there is still a need to expand the part of the multimodal dialogue systems literature that … Using eye movements to determine referents in a spoken dialogue system …
Dialog Based Planning in Intelligent Tutoring System
H Elbih, M Elkawkagy, H Tawfic – International Journal of Computers, 2019 – iaras.org
… The goal of the dialog system is to enhance the student’s performance by considering the emotional intelligence … Oxford University Press, ISBN: 978-0-19-506994-5 (1991) [13] S. Marsella, J. Gratch, Modeling coping behavior in virtual humans: Don’t worry, be happy. In Proc …
Employing Conversational Agents in Palliative Care: A Feasibility Study and Preliminary Assessment
M Chatzimina, L Koumakis, K Marias… – 2019 IEEE 19th …, 2019 – ieeexplore.ieee.org
… An embodied Conversational Agent is lifelike virtual human software capable of interacting with humans by understanding speech and producing except from speech, hand gestures or facial expressions … The 17 https://github.com/uber-research/plato-research- dialogue-system …
A taxonomy for virtual and augmented reality in education
J Motejlek, E Alpay – arXiv preprint arXiv:1906.12051, 2019 – arxiv.org
… Intelligent agents are more sophisticated than dialog systems and interact with the user in a more complex way than just textual or … 7.1 Dialog system … V. Aleven, A. Ogan, O. Popescu, C. Torrey, and K. Koedinger, “Evaluating the Effectiveness of a Tutorial Dialogue System for Self …
Physicians’ perceptions of chatbots in health care: Cross-sectional web-based survey
A Palanica, P Flaschner, A Thommandram, M Li… – Journal of medical …, 2019 – jmir.org
… Introduction. Background. Chatbots, also known as conversational agents, interactive agents, virtual agents, virtual humans, or virtual assistants, are artificial intelligence programs designed to simulate human conversation via text or speech …
Investigating Linguistic and Semantic Features for Turn-Taking Prediction in Open-Domain Human-Computer Conversation.
SZ Razavi, B Kane, LK Schubert – INTERSPEECH, 2019 – cs.rochester.edu
… Data-driven models for timing feedback responses in a map task dialogue system,” Com- puter … Optimizing the turn-taking behavior of task-oriented spoken dialog systems,” ACM Trans … Towards deep end-of-turn prediction for situated spoken dialogue systems,” in Interspeech …
Nonverbal behavior in multimodal performances
A Cafaro, C Pelachaud, SC Marsella – The Handbook of Multimodal …, 2019 – dl.acm.org
Page 1. 6Nonverbal Behavior in Multimodal Performances Angelo Cafaro, Catherine Pelachaud, Stacy C. Marsella 6.1 Introduction The physical, nonverbal behaviors that accompany face-to-face interaction convey a wide variety …
B. Rex: a dialogue agent for book recommendations
M Abrams, L Gessler, M Marge – Proceedings of the 20th Annual SIGdial …, 2019 – aclweb.org
… 4Source code for B. Rex is accessible at https://github.com/georgetown-dialogue-systems-2018/ brex, demo at https://youtu.be/3Z1fBu5PMzc 5https://goodreads.com … What Kind of Stories Should a Virtual Human Swap … Pydial: A Multi- domain Statistical Dialogue System Toolkit …
Samvaadhana: A Telugu Dialogue System in Hospital Domain
SR Duggenpudi, KSS Varma, R Mamidi – … of the 2nd Workshop on Deep …, 2019 – aclweb.org
… 2017. A survey on dialogue systems: Recent advances and new frontiers … 2019. Spoken dialogue system using recognition of user’s feedback for rhythmic dialogue. Page 8. 241 … 2011. Npceditor: Cre- ating virtual human dialogue using information re- trieval techniques …
Design Model of a Training Simulator in Virtual Reality
I Petukhov, L Steshina, A Glazyrin… – The Fifth International …, 2019 – researchgate.net
… The typical illustration of CID is the so-called Virtual Human Project (VHP) [46]. The goal of VHP is to create realistic virtual humans to increase the effectiveness of the communication information procedure of interaction between users and avatars …
Toward low-cost automated evaluation metrics for Internet of Things dialogues
K Georgila, C Gordon, H Choi, J Boberg, H Jeon… – … Dialogue System …, 2019 – Springer
… Lee GG (2009) Data-driven user simulation for automated evaluation of spoken dialog systems … the effectiveness of information presentation in a full end-to-end dialogue system … Young S (2005) Quantitative evaluation of user simulation techniques for spoken dialogue systems …
Related Work to Neural Natural-Language Template Matching
KR Zentner – ink-ron.usc.edu
… Mountain: A translation-based approach to natural language gen- eration for dialog systems … NPCEditor: Creating Virtual Human Dialogue Using Informa- tion Retrieval Techniques … Sample efficient deep reinforce- ment learning for dialogue systems with large action spaces …
Target-guided open-domain conversation
J Tang, T Zhao, C Xiong, X Liang, EP Xing… – arXiv preprint arXiv …, 2019 – arxiv.org
… Thus, there is a strong demand to enable the integration of goals and strategy into open- domain dialogue systems, and it imposes chal- lenges to both: first, how to define the goal for an open-domain chat system; and second, how to encode dialogue strategy into the response …
Multimodal databases
M Valstar – The Handbook of Multimodal-Multisensor Interfaces …, 2019 – dl.acm.org
… Virtual Human is a digital anthropomorphic representation of a system with which users can interact with. It combines realistic rendering techniques with intelligent behavior to make the virtual human as believable as possible …
Planning for a Corpus of Continuous Ratings of Spoken Dialog Quality
NG Ward – 2019 – scholarworks.utep.edu
… and J. Weston, “Evaluating prerequisite qualities for learning end-to-end dialog systems,” in ICRL … Y. Bengio, AC Courville, and J. Pineau, “Building end-to-end dialogue systems using generative … L. Charlin, and J. Pineau, “How not to evaluate your dialogue system: An empirical …
Medical and health systems
D Sonntag – The Handbook of Multimodal-Multisensor Interfaces …, 2019 – dl.acm.org
… Application domains include serious games, conversational agents, or dialogue systems for healthy behavior promotion; intelligent interactive … 11.4.1 Case Study 1: A Multimodal Dialog System In this case study, we present a dialogue system for the annotation and retrieval of …
Augmenting abstract meaning representation for human-robot dialogue
C Bonial, L Donatelli, S Lukin, S Tratz… – Proceedings of the First …, 2019 – aclweb.org
… of Abstract Meaning Representation (AMR) for use as a con- duit for natural language understanding (NLU) in a robot dialogue system … important given that the tar- get human-robot dialogue is physically situated and therefore distinct from other dialogue systems, such as chat …
Modelling Negotiation Strategies
M Koit – 2019 IEEE International Symposium on INnovations in …, 2019 – ieeexplore.ieee.org
… A simple dialogue system is implemented which follows the negotiation strategies presented in Section II … 525–532, 2014. [3] Jonathan Gratch, S. Hill, L.-P. Morency, D. Pynadath, and D. Traum, “Exploring the Implications of Virtual Human Research for Human-Robot Teams,” R …
Cognitive predictors of treatment outcome for exposure therapy: do changes in self-efficacy, self-focused attention, and estimated social costs predict symptom …
IL Kampmann, PMG Emmelkamp… – BMC …, 2019 – bmcpsychiatry.biomedcentral.com
Cognitions play an important role in the development and maintenance of social anxiety disorder (SAD). To investigate whether changes in cognitions during the first six sessions of exposure therapy are associated with treatment outcome, we assessed reported self-focused attention …
Mentor-Pal: Growing STEM Pipelines with Personalized Dialogs with Virtual STEM Professionals
BD Nye – 2019 – apps.dtic.mil
… student can patticipate in a natural (voice- input) conversation with virtual humans whose answers are … which could present virtual mentors to students, based on virtual human technology and … Diulog Systems (NLP): This work explored different types of dialog systems to deliver …
Data fusion methods in multimodal human computer dialog
Y Ming-Hao, TAO Jian-Hua – Virtual Reality & Intelligent Hardware, 2019 – Elsevier
… After decades of development, the man-machine dialogue system has developed from the early telephone voice system, such as language … Similarly, in recent human computer dialog system, different kind of channel information is converted into behavior recognition, and then …
A Comparative Study of Self-Diagnosis User Interfaces for Depression: Focusing on Usability of Paper-Based, Text-Based and Voice-Based Conversational Interface
O Mangkang, JY Yun – ?? HCI ?? ????, 2019 – dbpia.co.kr
… do [3] [4]. For these reasons, patients may prefer virtual humans over human … Evaluation (PARADISE) is proposed to evaluate the usability for dialogue system by using … language-benefit: additional evaluation criteria for natural language dialogue systems.” International Journal …
Virtual humans: Today and tomorrow
D Burden, M Savin-Baden – 2019 – books.google.com
… processes of a virtual human Kismet robot Research on dialogue systems for language … architecture WASABI integrated into a virtual human USC virtual human toolkit Representations … matrix Hall’s interpersonal distances An overview of a potential virtual humans-based digital …
Using virtual standardized patients to accurately assess information gathering skills in medical students
KR Maicher, L Zimmerman, B Wilcox, B Liston… – Medical …, 2019 – Taylor & Francis
Introduction: Practicing a medical history using standardized patients is an essential component of medical school curricula. Recent advances in technology now allow for newer approaches for practi…
VICA, a visual counseling agent for emotional distress
Y Sakurai, Y Ikegami, M Sakai, H Fujikawa… – Journal of Ambient …, 2019 – Springer
… Statistical significance of difference in length of interactions involving the same users shows that modern dialogue systems are a substantial … 2014) is virtual human interviewer designed to create an engaging face-to-face interaction where the user feels comfortable talking and …
BEYOND MONOLOGUES
V Ramanarayanan, K Evanini… – … Technologies to Score …, 2019 – books.google.com
… In addition, despite recent technical advances, spoken dialog systems may still make errors in the ASR, language understanding, or dialog management components that result in learners being sent … An interactive dialog system for learning Japanese … Spoken dialogue systems …
Commercialization of multimodal systems
PR Cohen, R Tumuluri – The Handbook of Multimodal-Multisensor …, 2019 – dl.acm.org
Page 1. 15Commercialization of Multimodal Systems Philip R. Cohen, Raj Tumuluri 15.1 Introduction This chapter surveys the broad and accelerating commercial activity in build- ing products incorporating multimodal-multisensor interfaces …
Evaluating Temporal Predictive Features for Virtual Patients Feedbacks
BE Penteado, M Ochs, R Bertrand… – Proceedings of the 19th …, 2019 – dl.acm.org
… Modeling Embodied Feedback with Virtual Humans. In Mod- eling Communication with Robots and Virtual Humans. 18–37. [11] Raveesh Meena, Gabriel Skantze, and Joakim Gustafson. 2014. Data-driven models for timing feedback responses in a Map Task dialogue system …
Usability Evaluation of Self-Diagnosis User Interfaces for Depression: A Comparative Study among Paper-Based, Text-Based, and Voice-Based Conversational …
O Mangkang, JY Yun – ?? HCI ?? ???, 2019 – dbpia.co.kr
… humans can do[6,7]. For these reasons, patients may prefer virtual humans over human … System Evaluation (PARADISE) is proposed to evaluate the usability for dialogue system by using the … novice to expert: The effect of tutorials on user expertise with spoken dialogue systems …
Computational cognitive assessment: Investigating the use of an intelligent virtual agent for the detection of early signs of dementia
B Mirheidari, D Blackburn, R O’Malley… – ICASSP 2019-2019 …, 2019 – ieeexplore.ieee.org
… 7] M. Huckvale, J. Leff, and G. Williams, “Avatar therapy: an audio-visual dialogue system for treating … Rizzo, G. Lucas, J. Gratch, G. Stratou, L. Morency, K. Chavez, R. Shilling, and S. Scherer, “Automatic behavior analysis during a clinical interview with a virtual human.,” in MMVR …
Survey on intelligent dialogue in e-learning systems
FG Hamza-Lup, IR Goldbach – … on mobile, hybrid, and on-line …, 2019 – researchgate.net
… The SimCoach project [17] for example, implements a virtual human (avatar) support agent … to balance their competences between the new, AI driven, intelligent dialogue systems and the … for immediate adoption into virtual facilitators, embodied like virtual humans, for intelligent …
Multimodal dialogue processing for machine translation
A Waibel – The Handbook of Multimodal-Multisensor Interfaces …, 2019 – dl.acm.org
… Field-adaptable and extendable systems. Languages and vocabularies change, and interpreting dialogue systems must evolve alongside such changing languages and vocabularies and adapt to any given dialogue scenario …
Situated interaction
D Bohus, E Horvitz – The Handbook of Multimodal-Multisensor Interfaces …, 2019 – dl.acm.org
… progresses. Dyadic: a term denoting an interaction that involves two participants. Most work in spoken dialog systems has traditionally focused on dyadic settings, where a dialog system interacts with a single human user. Encoding …
Establishing social dialog between buildings and their users
S Khashe, G Lucas, B Becerik-Gerber… – International Journal of …, 2019 – Taylor & Francis
… We examined the role of social dialog, given different personas, on the persuasiveness of virtual humans by directly comparing the compliance … The virtual human first initiated small talk with the respondent by introducing herself and asked the respondents their name and how …
Usability evaluation of spoken humanoid embodied conversational agents in mobile serious games
D Korre – 2019 – era.ed.ac.uk
… the learning effectiveness (Lester et al., 1997) while virtual humans enhance the presentation of information and can significantly provoke learner motivation and retention (Moreno-Ger et al., 2012). According to recent studies, the interaction with spoken dialogue systems …
Intelligent Virtual Assistant for Promoting Behaviour Change in Older People with T2D
J Balsa, P Neves, I Félix, MP Guerreiro, P Alves… – EPIA Conference on …, 2019 – Springer
… Regarding the use of relational agents (virtual humans, designed to build long-term socio-emotional relationships with users), Bickmore et al … Rule-based approaches to dialogue management have been explored, namely in the context of spoken dialogue systems …
Adaptive instructional systems: the evolution of hybrid cognitive tools and tutoring systems
JA DeFalco, AM Sinatra – International Conference on Human-Computer …, 2019 – Springer
… Also, there is use for a virtual tutor by way of tutorial dialogue systems that interact with humans though conversations and adaptively respond to a person’s actions, emotions, and verbal contributions, as seen in AutoTutor [24]. Additionally, virtual human assistants such as …
Abstract meaning representation for human-robot dialogue
CN Bonial, L Donatelli, J Ervin… – Proceedings of the …, 2019 – scholarworks.umass.edu
… research, we begin to tackle the challenge of natural language understanding (NLU) in the context of the development of a robot dialogue system … This stands in con- trast to many other dialogue systems, such as task- oriented chat bots, which do not require establish- ing and …
Conversational AI: An Overview of Methodologies, Applications & Future Scope
P Kulkarni, A Mahabaleshwarkar… – 2019 5th …, 2019 – ieeexplore.ieee.org
… Zhu W., Chowanda A., Valstar M. (2016) Topic Switch Models for Dialogue Management in Virtual Humans … Kashioka and Satoshi Nakamura, “Statistical dialog management applied to WFST- based dialog systems,” 2009 IEEE … Machine Learning for Spoken Dialogue Systems …
Text-to-speech synthesis using found data for low-resource languages
EL Cooper – 2019 – academiccommons.columbia.edu
… Text-to-speech synthesis (TTS) is a key component of interactive, speech-based technology such as spoken dialogue systems, virtual personal assistants and speech- to-speech translation, and typically, building a high-quality voice requires collecting dozens of hours …
Automatic Isolated Arabic Speech Recognition and Its Transformation into Signs
SM Qaisar, B Alhassani… – 2019 IEEE 4th International …, 2019 – ieeexplore.ieee.org
… international Journal of Computer applications, 131(11), 28Y31. [6] sagae, K., DeVault, D., &Traum, DR (2010, June). interpretation of partial utterances in virtual human dialogue systems. in Proceedings of the NaaCL HLT 2010 Demonstration session (pp. 33Y36) …
Realistic natural interaction with virtual statues in x-reality environments.
G Margetis, G Papagiannakis, C Stephanidis – International Archives of …, 2019 – d-nb.info
… to focus on selected information with importance or interest; and (iii) decision- making and motion synthesis for virtual humans … Several Neural Network approaches pursue realistic spoken dialogue systems, such as Recurrent Neural Networks, Recursive Neural Networks or …
Transcription Guidelines for Army Research Laboratory (ARL) Human-Robot Dialogue Corpus
C Bonial, C Henry, R Artstein, M Marge – 2019 – apps.dtic.mil
… SimSensei Kiosk: a virtual human interviewer for healthcare decision support … Lukin SM, Gervits F, Hayes CJ, Leuski A, Moolchandani P, Rogers III JG, Traum D. Scoutbot: a dialogue system for collaborative navigation. Ithaca (NY): Cornell University; 2018 …
Privacy concerns of multimodal sensor systems
G Friedland, MC Tschantz – The Handbook of Multimodal-Multisensor …, 2019 – dl.acm.org
Page 1. 16Privacy Concerns of Multimodal Sensor Systems Gerald Friedland, Michael Carl Tschantz 16.1 Introduction This chapter explains that ignoring the privacy risks introduced by multimodal sys- tems could have severe consequences for society in the long term …
Automotive multimodal human-machine interface
D Schnelle-Walka, S Radomski – The Handbook of Multimodal …, 2019 – dl.acm.org
… Dialogue planner Presentation manager Multimodal dialogue system Driving context … Driving performance Cognitive load Figure 12.3 Components influencing cognitive load and driving performance of an in-car multi- modal dialog system (after [Neßelrath and Feld 2013]) …
Exploring virtual agents for augmented reality
I Wang, J Smith, J Ruiz – Proceedings of the 2019 CHI Conference on …, 2019 – dl.acm.org
… 2.1 Embodied Conversational Agents Embodied Conversational Agents [17], or ECAs, are dialogue systems that not only utilize a natural speech interface but also feature an embodiment, giving the agent a human (or … [10] detailed the creation of virtual humans in AR that both …
Designing emotional BDI agents: good practices and open questions
Y Sánchez-López, E Cerezo – The Knowledge Engineering …, 2019 – search.proquest.com
… & Lansky, 1987). Since then, BDI agents have been created and used in several application such as the tourist guide of Corchado et al. (2004) or the virtual humans training system of Van Oijen et al. (2011). The growing popularity …
Early integration for movement modeling in latent spaces
R Hornung, N Chen, P van der Smagt – The Handbook of Multimodal …, 2019 – dl.acm.org
Page 1. 8Early Integration for Movement Modeling in Latent Spaces Rachel Hornung, Nutan Chen, Patrick van der Smagt 8.1 Introduction In this chapter, we will show how techniques of advanced machine and deep learn- ing …
Embedded multimodal interfaces in robotics: applications, future trends, and societal implications
EA Kirchner, SH Fairclough, F Kirchner – The Handbook of Multimodal …, 2019 – dl.acm.org
Page 1. 13Embedded Multimodal Interfaces in Robotics: Applications, Future Trends, and Societal Implications Elsa A. Kirchner, Stephen H. Fairclough, Frank Kirchner 13.1 Introduction In the past, robots were primarily used …
Multimodal integration for interactive conversational systems
M Johnston – The Handbook of Multimodal-Multisensor Interfaces …, 2019 – dl.acm.org
Page 1. IPART MULTIMODAL LANGUAGE AND DIALOGUE PROCESSING Page 2. Page 3. 1Multimodal Integration for Interactive Conversational Systems Michael Johnston 1.1 Introduction This chapter discusses the challenges …
Automatic evaluation of end-to-end dialog systems with adequacy-fluency metrics
LF D’Haro, RE Banchs, C Hori, H Li – Computer Speech & Language, 2019 – Elsevier
… the original fluency metric (FM) to adapt it to the evaluation of dialogue systems, which is … Dialog systems have been a topic of interest for several years given its potential to automate … A dialog system is expected to understand user’s requests, ask follow-up questions in case that …
Software platforms and toolkits for building multimodal systems and applications
M Feld, R Ne?elrath, T Schwartz – The Handbook of Multimodal …, 2019 – dl.acm.org
… It basically updates the context and determines how to react to dialogue acts. Dialogue Platforms are underlying frameworks that are used to execute a dialogue system. Dialogue Systems are software agents that allow users to converse with a machine in a coherent structure …
Cooperation Between Human And Agents In Holonic Manufacturing Systems
P Grznár, M Kraj?ovi?, Š Mozol… – CBU International …, 2019 – ojs.journals.cz
… Khurana, P., Patidar, M., Bisht, V., Bansal, R., Sachan, P., Kumar, R. (2018) Knadia: Enterprise knowledge assisted dialogue systems using deep … J., Gosh, S., Chollet, M., Ly, S., Mozgai, Sh., Scherer, S. (2018) NADiA – Neural Network Driven Virtual Human Conversation Agents …
Socially-Aware Dialogue System
R Zhao – 2019 – lti.cs.cmu.edu
… SAPA) This chapter reviews our knowledge-inspired socially-aware dialogue system in a … we lay out the building blocks for socially-aware dialogue systems, including conversational … recognition of conversational strategies in the service of a socially-aware dialog system …
Ergonomics for the design of multimodal interfaces
A Heloir, F Nunnari, M Bachynskyi – The Handbook of Multimodal …, 2019 – dl.acm.org
Page 1. IIPART MULTIMODAL BEHAVIOR Page 2. Page 3. 7Ergonomics for the Design of Multimodal Interfaces Alexis Heloir, Fabrizio Nunnari, Myroslav Bachynskyi 7.1 Introduction There are many ways a machine can infer …
Hardware and Software Enhancements: Conversational Computer Agents with Initiative
DM Davis, E Jaksha, S Guizani – hpc-educ.org
… Several ethical issue that will likely arise with the advent of a virtual human with initiative One of the … Virtually all of the work involving Virtual Humans reported in this paper came from a series of research projects … A Mixed-initiative Conversational Dialogue System for Healthcare …
Standardized representations and markup languages for multimodal interaction
R Tumuluri, D Dahl, F Paternò… – The Handbook of …, 2019 – dl.acm.org
Page 1. 9Standardized Representations and Markup Languages for Multimodal Interaction Raj Tumuluri, Deborah Dahl, Fabio Patern`o, Massimo Zancanaro 9.1 Introduction This chapter discusses some standard languages …
Human-inspired socially-aware interfaces
D Schiller, K Weitz, K Janowski, E André – International Conference on …, 2019 – Springer
… the interruption response timing for a virtual agent in an interactive dialogue system … attempts have been made to implement empathic behaviors in computer-based dialogue systems … Morency, LP, et al.: SimSensei demonstration: a perceptive virtual human interviewer for …
Why is the Doctor a Man Reactions of Older Adults to a Virtual Training Doctor
A Constantin, C Lai, E Farrow, B Alex… – Extended Abstracts of …, 2019 – dl.acm.org
… and assessment of self-medication consultation skills, allowing students in Pharmaceutical Sciences to communicate with Virtual Humans (VH) in … of the participants had worked in computer science (CS) and were familiar with virtual characters and dialogue systems (CS group …
Multimodal Analysis and Estimation of Intimate Self-Disclosure
M Soleymani, K Stefanov, SH Kang, J Ondras… – 2019 International …, 2019 – dl.acm.org
… Therefore, virtual humans are well positioned to deliver men- tal well-being benefits by leveraging both anonymity and rapport … work on automatic recog- nition of self-disclosure has been limited to language under- standing in interactions with spoken dialogue system [35], online …
Neural-network-based memory for a social robot: learning a memory model of human behavior from data
M Doering, T Kanda, H Ishiguro – ACM Transactions on Human-Robot …, 2019 – dl.acm.org
… There also exist data-driven systems for designing behaviors for virtual humans … of-Oz setting and was designed for “adding memory to goal-oriented dialog systems” [42] … Janarthanam and Lemon presented a finite-state-based dialog system for setting up home broad- band …
First Impressions Count! The Role of the Human’s Emotional State on Rapport Established with an Empathic versus Neutral Virtual Therapist
H Ranjbartabar, D Richards, A Bilgin… – IEEE transactions on …, 2019 – ieeexplore.ieee.org
… However, in human interactions with virtual humans, commonly also referred to as Embodied Con- versational Agents (ECAs), as presented in the next … This application seemed like an ideal situation for a virtual human and also a novel testbed for exploring whether the addition …
When chatbots meet patients: one-year prospective study of conversations between patients with breast cancer and a chatbot
B Chaix, JE Bibault, A Pienkowski, G Delamon… – JMIR cancer, 2019 – cancer.jmir.org
Patient-Centered Innovations, Education and Technology for Cancer Care and Cancer Research.
Age-related differences in referential production: A multiple-measures study.
R Saryazdi, J Bannon, CG Chambers – Psychology and aging, 2019 – psycnet.apa.org
… We evaluated whether speakers’ descriptions provided listeners with sufficient information for identification, and whether speakers spontaneously adapt their speech for different addressee types (younger adult, older adult, automated dialogue system) …
A model of social explanations for a conversational movie recommendation system
F Pecune, S Murali, V Tsai, Y Matsuyama… – Proceedings of the 7th …, 2019 – dl.acm.org
Page 1. A Model of Social Explanations for a Conversational Movie Recommendation System Florian Pecune florian.pecune@glasgow.ac.uk University of Glasgow Shruti Murali shrutim@andrew.cmu.edu Carnegie Mellon University …
How emotions drive opinion polarization: An agent-based model
F Schweitzer, T Krivachy, D Garcia – arXiv preprint arXiv:1908.11623, 2019 – arxiv.org
… Further applications of this framework have focused on modelling how bots and dialog systems could drive collective mood in a discus- sion [26, 38, 44] and to drive the emotion dynamics of 3D virtual humans in real-time interaction [1] …
Conversational interfaces for health: bibliometric analysis of grants, publications, and patents
Z Xing, F Yu, J Du, JS Walker, CB Paulson… – Journal of medical …, 2019 – jmir.org
… To identify grants, publications, and patents, we created a search strategy adapted from previously published works that include CI-related terms [1,2,21,26], such as spoken dialogue system, conversational agent, chatbot, social robot, virtual agent, and question-answer system …
Design for fast request fulfillment or natural interaction? insights from an experiment with a conversational agent
S Diederich, AB Brendel, S Lichtenberg, L Kolbe – 2019 – aisel.aisnet.org
… via spoken language, often referred to as virtual personal assistants, or through written text, often called chatbots or dialogue systems (Gnewuch et al … The participants viewed the CA as a “virtual human” and compared it to customer service employees rather than to self-service …
Blended Agents: Manipulation of Physical Objects within Mixed Reality Environments and Beyond
S Schmidt, OJA Nunez, F Steinicke – Symposium on Spatial User …, 2019 – dl.acm.org
… language processing enables VAs to understand their human communica- tion partners while speech synthesis and natural dialogue systems generate human … Synchronized with the animations of a blended agent, the illusion of a virtual human writing on a physical piece of …
A high-fidelity open embodied avatar with lip syncing and expression capabilities
D Aneja, D McDuff, S Shah – 2019 International Conference on …, 2019 – dl.acm.org
… 2012. Ren- der me real?: investigating the effect of render style on the perception of animated virtual humans. ACM Transactions on Graphics (TOG) 31, 4 (2012), 91 … 2016. Building end-to-end dialogue systems using generative hierarchical neural network models …
Anthropomorphic Virtual Assistant to Support Self-care of Type 2 Diabetes in Older People: A Perspective on the Role of Artificial Intelligence.
G Magyar, J Balsa, AP Cláudio, MB Carmo… – VISIGRAPP (1 …, 2019 – scitepress.org
… Keywords: Virtual Humans, Relational Agents, Artificial Intelligence, Health Care, Behaviour Change, Type 2 Diabetes … D. and Sidner, CL (2011) ‘A reusable framework for health counseling dialogue systems based on a … (2014) ‘SimSensei Kiosk: A Virtual Human Interviewer for …
A Photo-realistic Voice-bot
J Alexander – 2019 – upcommons.upc.edu
… response with semantic meaning from a user query (a dialogue system); synthesis of … Literature Review 2.1 Photo-realistic Voice-bot Although there is a plethora of research regarding dialog systems, speech synthesis … Also notably miss- ing is an integration of a dialog system …
A Wizard-of-Oz experiment to study phonetic accommodation in human-computer interaction
I Gessinger, B Möbius, N Fakhar, E Raveh… – International Congress of …, 2019 – assta.org
… A growing number of studies is ex- ploring whether humans accommodate to the speech output of spoken dialogue systems (SDSs) and how accommodating behavior on the part of an SDS is perceived by the … Toward natu- ral turn-taking in a virtual human negotiation agent …
Web System Prototype based on speech recognition to construct medical reports in Brazilian Portuguese
TF de Toledo, HD Lee, N Spolaôr, CSR Coy… – International journal of …, 2019 – Elsevier
… An adaptive dialogue system for assessing post traumatic stress disorder [5], 2013, Developed by the authors [5], English, Not informed … Mobile personal healthcare mediated by virtual humans [7], 2014, Apple’s dictation services, English, Not informed …
Medical and Health
D Sonntag – The Handbook of Multimodal-Multisensor Interfaces …, 2019 – books.google.com
… Page 453. 11.1 Introduction 427 Glossary Application domains include serious games, conversational agents, or dialogue systems for healthy behavior promotion; intelligent … Case Study 1: A Multimodal Dialog System In this case study, we present a dialogue system for the …
Statement Analysis using NLP
MS Vinu, P Mohan, SG Moorthy, M Gobinath – 2019 – ijsret.com
… Despite its domain-free property, the EBDM approach has not yet been studied to its full potential for affective dialogue systems. An example is a micro-counseling dialogue system that uses the example-based approach to select a template for slot-filling response generation [3 …
Nonverbal Behavior in
A Cafaro, C Pelachaud… – The Handbook of …, 2019 – books.google.com
… 2014] provides a collec- tion of software modules for building social robots and virtual humans … Flipper is a library for specifying dialogue rules for dialogue systems, that uses XML-templates to … left) and Brad (right) are the two representative ECAs of the Virtual Human Toolkit …
Physical Robot Swarm Testbed at ARL: Specifications and Experimental Design Possibilities
J Humann, KA Pollard, SG Hill, OA Ayorinde, AN Foots… – 2019 – apps.dtic.mil
… of Southern California. This project is researching the use of a natural language dialogue interface with a virtual human spokesperson, which acts as an intermediary between the human operator and the swarm. With input and …
Framework Of Malay Intelligent Autonomous Helper (Min@ H): Text, Speech And Knowledge Dimension Towards Artificial Wisdom For Future Military Training System
S Marzukhi, Z Zainol, H Muhamed… – … and Data Sciences …, 2019 – ieeexplore.ieee.org
… Therefore, the main component is to form the capabilities of Malay AWS’s dialog systems (ie MIN@H) to manage ‘long-term … towards users questions by producing output of AWS delivered in Malay natural sound speech aligned with Malay virtual human behavioral image …
Adding communicative and affective strategies to an embodied conversational agent to enhance second language learners’ willingness to communicate
E Ayedoun, Y Hayashi, K Seta – International Journal of Artificial …, 2019 – Springer
… Previous studies have amply demonstrated the importance of such backchannels during human-agent conversations, considering them an important milestone for building engaging and natural virtual humans (Kopp et al. 2008; Morency et al … Page 6. Spoken Dialogue Systems …
Understanding and measuring user experience in conversational interfaces
AB Kocaballi, L Laranjo, E Coiera – Interacting with Computers, 2019 – academic.oup.com
… UX. There is very little work on evaluating UX in conversational interfaces. One approach specifically focusing on assessing user experience of multimodal dialogue systems is SUXES proposed by (Turunen et al., 2009). It is …
A Compression-based BiLSTM for Treating Teenagers’ Depression Chatbot
J YIN – DEStech Transactions on Computer Science and …, 2019 – dpi-proceedings.com
… This type of program is called Chatbot [2]. The Chatbot is a virtual human-computer interaction system derived from Chat Robot that allows … Semantically conditioned lstm-based natural language generation for spoken dialogue systems[J]. arXiv preprint arXiv:1508.01745, 2015 …
Follow-up Question Generation
Y Mandasari – 2019 – essay.utwente.nl
… database, wherein the questions from the users can be matched to the stored questions in the QA database when they are talking with virtual human Alice … systems … of images [22], and a dialogue system to answer questions about Alice in Wonderland …
A Study on the Client Experience using Chatbot based on Counseling Theory.
A Lee, HC Kim, MC Cha, YG Ji – Journal of the Ergonomics …, 2019 – search.ebscohost.com
… ?? ???(Task-oriented dialogue system)? ????? ?? ??? (Non task-oriented dialogue system)?? ???? … Jokinen, K. and McTear, M., Spoken dialogue systems … GM, Gratch, J., King, A. and Morency, LP, It’s only a computer: Virtual humans increase willingness …
ET-GAN: Cross-language emotion transfer based on cycle-consistent generative adversarial networks
X Jia, J Tai, H Zhou, Y Li, W Zhang, H Du… – arXiv preprint arXiv …, 2019 – arxiv.org
… synthesized speech is becoming more obvious. Chiba et al. [7] point out that even in a non-task-oriented dialogue system, emotional speech can signifi- cantly improve user experience. Moreover, with the rapid develop- ment …
Conversational agents in the treatment of mental health problems: mixed-method systematic review
H Gaffney, W Mansell, S Tai – JMIR mental health, 2019 – mental.jmir.org
Journal of Medical Internet Research – International Scientific Journal for Medical Research, Information and Communication on the Internet.
M-path: a conversational system for the empathic virtual agent
ÖN Yalç?n, S DiPaola – Biologically Inspired Cognitive Architectures …, 2019 – Springer
… In this work, we proposed and implemented a dialogue system to equip empathic behaviors in a conversational agent … D, Artstein R, Benn G, Dey T, Fast E, Gainer A, Georgila K, Gratch J, Hartholt A, Lhommet M et al (2014) Simsensei kiosk: a virtual human interviewer for …
Exploring the Relation Between Emotional Reception of CAV Technology and Its Acceptance: The SUaaVE? Concept
D Paudel, N Palomares, JM Belda-Lois, S Iranzo… – suaave.eu
… 02 Immersive Virtual Human Centred Design platform (V-HCD) Development of an immersive CAV simulator, exploited to assess acceptance of the technology through active involvement of future users … In Affective Dialogue Systems, pages 36–48, Berlin, Heidelberg, 2004 …
My Science Tutor and the MyST Corpus
W Ward, R Cole, S Pradhan – 2019 – researchgate.net
… dialog sessions, the results of the summative evaluations, and analyses of the performance of the spoken dialog system, and feedback … annotators reviewed the output of the speech recognizer, and the parsing of students’ utterances by the Phoenix Spoken Dialogue system …
Dialogue Structure Annotation Guidelines for Army Research Laboratory (ARL) Human-Robot Dialogue Corpus
C Bonial, D Traum, T Henry, SM Lukin, M Marge… – 2019 – apps.dtic.mil
… 1. Introduction and Annotation Overview Dialogue systems for robot or agent interaction can yield multiple benefits to the user … We aim to support natural language understanding within the broader context of ongoing research to develop a spoken dialogue system (Marge et al …
An end-to-end conversational style matching agent
R Hoegen, D Aneja, D McDuff… – Proceedings of the 19th …, 2019 – dl.acm.org
… ACM, 396–403. [5] Timothy Bickmore and Justine Cassell. 2005. Social dialogue with embodied conversational agents. Advances in natural multimodal dialogue systems 30 (2005), 23–54. [6] Dan Bohus, Sean Andrist, and Mihai Jalobeanu. 2017 …
Virtual reality and augmented reality
Y El Miedany – Rheumatology Teaching, 2019 – Springer
… Complex virtual patient architectures may consist of many different modular components for user input, speech recognition, patient response, animation, audio and lip-syncing that must work in tandem to present a realistic virtual human, potentially making the development of …
Should robots replace teachers?: AI and the future of education
N Selwyn – 2019 – books.google.com
Page 1. Should Robots Replace Teachers? Neil Selwyn Page 2. CONTENTS Cover Front Matter Preface Notes 1 AI, Robotics and the Automation of Teaching Robots and artificial intelligence Teachers and teaching AI and teaching …
Computational Framework for Facilitating Intimate Dyadic Communication
D Utami – 2019 – repository.library.northeastern.edu
… In Chapter 4, I introduced the research platform used throughout the experiments in the dissertation, including the Furhat robot and the IrisTK dialog system. In Chapter 5, I answer the first research question by presenting a study on the acceptance …
Positive emotion elicitation in chat-based dialogue systems
N Lubis, S Sakti, K Yoshino… – IEEE/ACM Transactions …, 2019 – ieeexplore.ieee.org
… Despite its domain-free property, the EBDM approach has not yet been studied to its full potential for affective dialogue systems. An example is a micro-counseling dialogue system that uses the example-based approach to select a template for slot-filling response generation [3 …
The next generation: chatbots in clinical psychology and psychotherapy to foster mental health–a scoping review
E Bendig, B Erb, L Schulze-Thuesing… – Verhaltenstherapie, 2019 – karger.com
… There are text-based chatbots (often referred to in the literature as conversational agents or chatbots) and chatbots that use nat- ural-language, speech-based interfaces in dialogue systems (such as Apple’s Siri, Amazon’s Alexa, Microsoft’s Cortana, and Google’s Allo …
A dynamic speaker model for conversational interactions
H Cheng, H Fang, M Ostendorf – Proceedings of the 2019 Conference of …, 2019 – aclweb.org
Page 1. Proceedings of NAACL-HLT 2019, pages 2772–2785 Minneapolis, Minnesota, June 2 – June 7, 2019. c 2019 Association for Computational Linguistics 2772 A Dynamic Speaker Model for Conversational Interactions …
Virtual Standardized Patient Simulation: Case Development and Pilot Application to High-Value Care
WF Bond, TJ Lynch, MJ Mischler, JL Fish… – Simulation in …, 2019 – journals.lww.com
Introduction High-value care (HVC) suggests that good history taking and physical examination shou.
Changing of Participants’ Attitudes in Argument-based Negotiation.
M Koit – ICAART (2), 2019 – scitepress.org
… Our aim is to develop a dialogue system (DS) which interacts with the user in a natural language following norms and rules of human communication. For that reason, we study human- human spoken dialogues … Toward natural turn-taking in a virtual human negotiation agent …
Interaction with an Embodied Conversational Agent in Virtual Reality
T Hariri – 2019 – search.proquest.com
… virtual humans. SmartBody used a kinematic chain of joints which contained head, eyes, neck and spinal cord for gaze motion … Recording Answer Figure 2: Design Dialog System I downloaded the character from Turbosquid and created the fourteen blend-shapes for …
An Investigation on the Effectiveness of Multimodal Fusion and Temporal Feature Extraction in Reactive and Spontaneous Behavior Generative RNN Models for …
HH Huang, M Fukuda, T Nishida – … of the 7th International Conference on …, 2019 – dl.acm.org
… do. The SEMAINE project [16, 18] was launched to build a Sensitive Artifi- cial Listener (SAL). SAL is a multimodal dialogue system with the social interaction skills needed for a sustained conversation with the user. They focused …
Robot Data-Driven Imitation Learning of Human Social Behavior with Time-Persistent Interaction Context
M Robert Doering – 2019 – ir.library.osaka-u.ac.jp
… There also exist data-driven systems for designing behaviors for virtual humans … of-Oz setting and was designed for “adding mem- ory to goal-oriented dialog systems” [26] … Janarthanam and Lemon presented a finite-state based dialog system for setting up home broadband …
Embodiment in socially interactive robots
E Deng, B Mutlu, M Mataric – arXiv preprint arXiv:1912.00312, 2019 – arxiv.org
Page 1. Embodiment in Socially Interactive Robots Eric Deng University of Southern California denge@usc.edu Bilge Mutlu University of Wisconsin–Madison bilge@cs.wisc.edu Maja J Matari? University of Southern California mataric@usc.edu December 3, 2019 Abstract …
Who should be my teammates: Using a conversational agent to understand individuals and help teaming
Z Xiao, MX Zhou, WT Fu – … of the 24th International Conference on …, 2019 – dl.acm.org
Page 1. Who Should Be My Teammates: Using A Conversational Agent to Understand Individuals and Help Teaming Ziang Xiao University of Illinois at Urbana-Champaign Urbana, IL, USA zxiao5@illinois.edu Michelle X. Zhou Juji. Inc. San Jose, CA, USA mzhou@acm.org …
Towards cognitive systems for assisted cooperative processes of goal finding and strategy change
A Wendemuth, S Kopp – 2019 IEEE International Conference …, 2019 – ieeexplore.ieee.org
… First approaches to this exist in the field of dialogue systems and conversational agents [31]. VII … Situated interaction with a virtual human – perception, action, and cognition. In G. Rickheit & I. Wachsmuth (Eds.), Situated Communication (pp. 287-323). Berlin: Mouton de Gruyter …
Equity beyond bias in language technologies for education
E Mayfield, M Madaio, S Prabhumoye… – Proceedings of the …, 2019 – aclweb.org
Page 1. Proceedings of the Fourteenth Workshop on Innovative Use of NLP for Building Educational Applications, pages 444–460 Florence, Italy, August 2, 2019. c 2019 Association for Computational Linguistics 444 Equity Beyond Bias in Language Technologies for Education …
A review of computational approaches for human behavior detection
S Nigam, R Singh, AK Misra – Archives of Computational Methods in …, 2019 – Springer
… users with respect to time. The Virtual Human Action Silhouette ViHASi [125] is a large body of video data of human silhouette generated for recognition of human behavior in different environments. The Multimodal Multi-view …
Linguistic Entrainment in Multi-Party Spoken Dialogues
Z Rahimi – 2019 – d-scholarship.pitt.edu
… entrainment. The first step towards this end goal of implementing dialogue systems with en- trainment capabilities is to understand human entrainment behavior and to present measures … proximity, synchrony, and convergence. Having children interact with a virtual human in …
Trusting virtual agents: The effect of personality
MX Zhou, G Mark, J Li, H Yang – ACM Transactions on Interactive …, 2019 – dl.acm.org
… Therefore, our work aims at answering this line of questions. 2.3 Intelligent Virtual Agents for Interviewing Our effort of building AI interviewers is directly related to a line of work on developing embodied “virtual human interviewers” (eg, see Refs [22, 30, 46, 59, 71]) …
Unsupervised Text Representation Learning with Interactive Language
H Cheng – 2019 – digital.lib.washington.edu
… Some recent work on the interactive model includes neural conversational models [34, 35] and neural-based spoken dialogue systems [36, 37] … Page 24. 13 tion scenario takes place between a human user and a dialogue system powered by conversational …
Long-term personalization of an in-home socially assistive robot for children with autism spectrum disorders
C Clabaugh, K Mahajan, S Jain, R Pakkar… – Frontiers in Robotics …, 2019 – frontiersin.org
Socially assistive robots (SAR) have shown great potential to augment the social and educational development of children with autism spectrum disorders (ASD). As SAR continues to substantiate itself as an effective enhancement to human intervention, researchers have sought …
You’ll be Great: Virtual Agent-based Cognitive Restructuring to Reduce Public Speaking Anxiety
E Kimani, T Bickmore, H Trinh… – 2019 8th International …, 2019 – ieeexplore.ieee.org
… [10] T. Bickmore and T. Giorgino, “Health dialog systems for patients … A. Hartholt, M. Lhommet, G. Lucas, S. Marsella, F. Morbini,A. Nazarian, S. Scherer, G. Stratou, A. Suri, D. Traum, R. Wood,Y. Xu, A. Rizzo, and L.–P. Morency, “Simsensei kiosk: A virtual human interviewer for …
Emma: An emotion-aware wellbeing chatbot
A Ghandeharioun, D McDuff… – 2019 8th …, 2019 – ieeexplore.ieee.org
… [3] GM Lucas, J. Gratch, A. King, and L.-P. Morency, “Its only a computer: Virtual humans increase willingness to … [5] D. DeVault, R. Artstein, G. Benn, T. Dey, E. Fast, A. Gainer, K. Georgila, J. Gratch, A. Hartholt, M. Lhommet et al., “Simsensei kiosk: A virtual human interviewer for …
Intelligent Conversational Agent Assisted Health Coaching System: The CoachAI Approach
A Fadhil – researchgate.net
… With the rise of deep learning and increased computing power, it became possible to build complex domain dependent dialogue systems … Text Dialog state tracking Fig. 7. CoachAI – Task-oriented dialog system overview. F. Dialog Engine …
Towards understanding emotional intelligence for behavior change chatbots
A Ghandeharioun, D McDuff… – 2019 8th …, 2019 – ieeexplore.ieee.org
… J. Gratch, A. Hartholt, M. Lhommet et al., “Simsensei kiosk: A virtual human interviewer for … Gratch, A. King, and L.-P. Morency, “Its only a computer: Virtual humans increase willingness … interactive human eval- uation with self-play for open-domain dialog systems,” arXiv preprint …
Designing with Gaze: Tama–a Gaze Activated Smart-Speaker
D McMillan, B Brown, I Kawaguchi, R Jaber… – Proceedings of the …, 2019 – dl.acm.org
… 2.2 Speech Agents Speech dialogue systems that can perform talk in a relatively natural way with users have been a goal for designers, engineers, and researchers ever since Bell Labs’ Homer Dudley developed the Vocoder [21], the first electronic machine that produced …
Learning socially appropriate robot approaching behavior toward groups using deep reinforcement learning
Y Gao, F Yang, M Frisk, D Hemandez… – 2019 28th IEEE …, 2019 – ieeexplore.ieee.org
… 17, no. 1, pp. 1334–1373, 2016. [4] E. Ferreira and F. Lefevre, “Reinforcement-learning based dialogue system for human–robot interactions with socially-inspired rewards,” Computer Speech & Language, vol. 34, no. 1, pp. 256–274, 2015 …
The Evaluation of a Serious Game to Improve Cross-Cultural Competence
B An, D Brown, S Guerlain – IEEE Transactions on Learning …, 2019 – ieeexplore.ieee.org
… The avatars were each modelled and developed in Blender and Adobe Mixamo Fuse. Fig. 2 shows a depiction of the Classroom scene. Using the Unity3D plugin Pixel Crushers Dialogue System, we created a branching text and voice dialogue tree for each scene …
Design and implementation of embodied conversational agents
F Geraci – 2019 – rucore.libraries.rutgers.edu
Page 1. c 2019 Fernando Geraci ALL RIGHTS RESERVED Page 2. DESIGN AND IMPLEMENTATION OF EMBODIED CONVERSATIONAL AGENTS By FERNANDO GERACI A thesis submitted to the School of Graduate Studies Rutgers, The State University of New Jersey …
Towards a deep learning question-answering specialized chatbot for objective structured clinical examinations
J El Zini, Y Rizk, M Awad… – 2019 International Joint …, 2019 – ieeexplore.ieee.org
Page 1. Towards A Deep Learning Question-Answering Specialized Chatbot for Objective Structured Clinical Examinations Julia El Zini?, Yara Rizk ?, Mariette Awad?, Jumana Antoun† ? Department of Electrical & Computer …
FANTASIA: a framework for advanced natural tools and applications in social, interactive approaches
A Origlia, F Cutugno, A Rodà, P Cosi… – Multimedia Tools and …, 2019 – Springer
… Specialised frameworks thought to manage this kind of interaction and focus mainly on virtual human management are presently available. In these frameworks, game engines have been sometimes used but only as rendering modules …
Ai-mediated communication: How the perception that profile text was written by ai affects trustworthiness
M Jakesch, M French, X Ma, JT Hancock… – Proceedings of the 2019 …, 2019 – dl.acm.org
Page 1. AI-Mediated Communication: How the Perception that Profile Text was Written by AI Affects Trustworthiness Maurice Jakesch1, Megan French2, Xiao Ma1, Jeffrey T. Hancock2, Mor Naaman1 1Cornell Tech, Cornell University 2Stanford University …
Exploring Users’ Perception of Chatbots in a Mobile Commerce Environment: Creating a Better User Experience by Implementing Anthropomorphic Visual and …
LM Assink – 2019 – essay.utwente.nl
… user satisfaction (Deshpande, Shahane, Gadre, Deshpande, & Joshi, 2017). Similarly, Higashinaka, Minami, Dohsaka, and Meguro (2010) state that the dialogue quality of a virtual human assistant can lead to an improvement in customer satisfaction …
Towards Socially Assistive Robot Support Methods for Physical Activity Behavior Change
K Swift-Spong – 2019 – search.proquest.com
Page 1. Towards Socially Assistive Robot Support Methods for Physical Activity Behavior Change by Katelyn Swift-Spong A Dissertation Presented to the FACULTY OF THE GRADUATE SCHOOL UNIVERSITY OF SOUTHERN …
Conceptual representations for computational concept creation
P Xiao, H Toivonen, O Gross, A Cardoso… – ACM Computing …, 2019 – dl.acm.org
Page 1. 9 Conceptual Representations for Computational Concept Creation PING XIAO, HANNU TOIVONEN, and OSKAR GROSS, University of Helsinki AMÍLCAR CARDOSO, JOÃO CORREIA, PENOUSAL MACHADO, PEDRO …
Designing a social robot to support children’s inquiry learning: A contextual analysis of children working together at school
DP Davison, FM Wijnen, J van der Meij… – International journal of …, 2019 – Springer
Page 1. International Journal of Social Robotics https://doi.org/10.1007/s12369-019- 00555-6 Designing a Social Robot to Support Children’s Inquiry Learning: A Contextual Analysis of Children Working Together at School Daniel …
ScratchThat: Supporting Command-Agnostic Speech Repair in Voice-Driven Assistants
J Wu, K Ahuja, R Li, V Chen, J Bigham – Proceedings of the ACM on …, 2019 – dl.acm.org
Page 1. 63 ScratchThat: Supporting Command-Agnostic Speech Repair in Voice-Driven Assistants JASON WU, Carnegie Mellon University, USA KARAN AHUJA, Carnegie Mellon University, USA RICHARD LI, Georgia Institute …
Autonomy, social agency, and the integration of human and robot environments
J Thomas – 2019 – summit.sfu.ca
Page 1. Autonomy, Social Agency, and the Integration of Human and Robot Environments by Jack Thomas M.Math, University of Waterloo, 2014 B.CS, University of New Brunswick, 2012 BA, University of New Brunswick, 2012 …
Enabling deaf or hard of hearing accessibility in live theaters through virtual reality
MRS Teófilo – 2019 – tede.ufam.edu.br
… That is, recognizing speech of humans talking to machines, either reading out loud in read speech (which simulates the dictation task), or conversing with speech dialogue systems, is relatively easy. Recognizing the speech of two Page 23. Chapter 2. Background 22 …
A Brief Encounter with Vincent: The Effect on Self-Compassion from a Single Interaction with a Chatbot That Gives or Asks for Help
N van As – pure.tue.nl
Page 1. Eindhoven University of Technology MASTER A brief encounter with Vincent the effect on self-compassion from a single interaction with a chatbot that gives or asks for help van As, NL Award date: 2019 Link to publication …
Learning Based Algorithms for Speech Applications Under Domain Mismatch Conditions
S Ranjan – 2019 – utd-ir.tdl.org
… and Childers, 1991). Gender identification from speech is important for knowledge extraction to direct model selection/weighting in Automatic Speech Recognition (ASR), dialog systems, and diariza- tion applications. While …