Affect Listener & Dialog Systems

Notes:

Affect listeners are artificial dialog systems that are designed to study the role of emotions in communication. They are equipped with algorithms and techniques that allow them to detect and adapt to the affective states of users, and to meaningfully respond to their utterances in a way that takes into account both the content and the emotional context of the conversation.

Affect listeners are used in a variety of contexts, including research on emotion recognition, natural language processing, and human-computer interaction. They can be used to study how people express and perceive emotions in different situations, and how these emotions can affect communication dynamics and outcomes.

Affect listeners can be implemented in a variety of forms, such as chatbots, virtual assistants, or other conversational systems. They may be used in online forums, social media platforms, or other virtual environments where people communicate and interact with each other.

Affect Listener Dialog Scripting (ALDS) refers to the process of creating and designing dialog scripts for affect listeners, which are artificial dialog systems that are designed to detect and adapt to the affective states of users. ALDS involves designing the dialogue flow, content, and response strategies of the affect listener in a way that takes into account the emotional context of the conversation.
Affective profile is a representation of a person’s emotional characteristics, including their tendencies, preferences, and patterns of emotional expression and response. Affective profiles are often used in affective computing and natural language processing to model and understand how people express and perceive emotions.
Affective systems are artificial systems that are designed to detect and respond to the affective states of users. These systems may use a variety of techniques, such as natural language processing, machine learning, and emotion recognition algorithms, to identify and interpret emotional cues in communication.
AL-AIML (Affect Listener AIML) is a programming language that is specifically designed for creating affect listeners. It is based on the AIML (Artificial Intelligence Markup Language) standard, which is a popular language for creating chatbots and other conversational systems.
Interactive affective systems are artificial systems that are designed to detect and respond to the affective states of users in real-time, during an ongoing conversation or interaction. These systems may use techniques such as natural language processing and machine learning to interpret the emotional context of the conversation and adjust their responses accordingly.

Wikipedia:

References:

Affect listeners: Acquisition of affective states by means of conversational systems
M Skowron – Development of Multimodal Interfaces: Active Listening …, 2010 – Springer
… Dialog and Interaction Management. As presented above, the tasks of Affect Listener systems differ from tasks of domain specific dialog systems (eg, ticket reservation, guidance systems). The requirements for Affect Listener …

The good, the bad and the neutral: affective profile in dialog system-user communication
M Skowron, S Rank, M Theunis… – … Conference on Affective …, 2011 – Springer
… Schumaker, RP, Liu, Y., Ginsburg, M., Chen, H.: Evaluating mass knowledge acquisition using the alice chatterbot: The az-alice dialog system. Int. J. of Man- Machine Studies 64(11), 1132–1140 (2006) 18. Skowron, M.: Affect listeners: Acquisition of affective states by means of …

Effect of affective profile on communication patterns and affective expressions in interactions with a dialog system
M Skowron, M Theunis, S Rank, A Borowiec – International Conference on …, 2011 – Springer
… This paper presents analysis of users communication recorded during new ex- periments with a revision of the dialog system, based on the “Affect Listeners” platform [19], in a setting typical for online, real-time, text-based communica- tion (ie, chat-rooms), equipped with three …

Affect and Social Processes in Online Communication–Experiments with an Affective Dialog System
M Skowron, M Theunis, S Rank… – IEEE Transactions on …, 2013 – ieeexplore.ieee.org
… level is linked to a basic tenet of appraisal theories, namely that personal relevance is associated with increased affective responses.1 This paper presents an integrated view on a series of recent experiments conducted with an affective dialog system, the Affect Listener …

Affect listeners-from dyads to group interactions with affective dialog systems
M Skowron, S Rank – Proc. of AISB/IACAP World Congress 2012 …, 2012 – academia.edu
Affect Listeners are applied as tools for studying the role of emotions in online communication. They need to interact both in dyads as well as in group settings with multiple users. In this paper, we present the evolution of such affective dialog systems from a focus …

No peanuts! Affective cues for the virtual bartender.
M Skowron, H Pirker, S Rank, G Paltoglou, J Ahn… – FLAIRS Conference, 2011 – aaai.org
… The adaptation of a more generic Affect Listener AIML set (Skowron 2010) for the Affect Bartender system was twofold, aiming at enabling the system to gen- erate response candidates that: (i … Affective Dialogue Systems, Tutorial and Re- search Workshop (ADS 2004), LNAI 3068 …

Affect bartender—affective cues and their application in a conversational agent
M Skowron, G Paltoglou – Affective Computational Intelligence …, 2011 – ieeexplore.ieee.org
… human-computer conversations that consider emotional cues is also a central area of interest in the design of Affective Dialog Systems (ADSs) … The implementation of the system is based on the concept of Affect Listeners [26], conversational agents aiming to detect and adapt to …

Applying a text-based affective dialogue system in psychological research: case studies on the effects of system behaviour, interaction context and social exclusion
M Skowron, S Rank, A ?widerska, D Küster… – Cognitive …, 2014 – Springer
… Affective Dialogue System. The variants of the Affect Listener system applied in the presented studies communicate with users in a text modality and use the integrated sentiment analysis and affect detection components to recognize and categorize expressions of affective states …

The additive effect of turn-taking cues in human and synthetic voice
A Hjalmarsson – Speech Communication, 2011 – Elsevier
… aim of this work is to investigate experimentally how turn-taking cues form a complex signal and affect listeners’ expectations of … of using behaviours that affect turn-taking in human–human conversation to generate appropriate turn-taking behaviour in spoken dialogue systems …

The hippocampus and the flexible use and processing of language
MC Duff, S Brown-Schmidt – Frontiers in human neuroscience, 2012 – frontiersin.org
Fundamental to all human languages is an unlimited expressive capacity and creative flexibility that allow speakers to rapidly generate novel and complex utterances. In turn, listeners interpret language “on-line”, incrementally integrating multiple sources of information as words …

Sentiment analysis of informal textual communication in cyberspace
G Paltoglou, S Gobron, M Skowron, M Thelwall… – In Proc. Engage 2010 …, 2010 – Citeseer
… dialog coherence” modules, conversational systems aim at a realistic interac- tion flow at the emotional level eg, Affect Listeners [35] and … constitute of short, informal, textual exchanges, it is essential that the sentiment analysis component integrated in the dialog system is able …

Dyads to groups: modeling interactions with affective dialog systems
S Rank, M Skowron, D Garcia – Int. J. Comput. Linguistics Res, 2013 – dline.info
… 2 This article is an extended version of the paper: M.Skowron, S.Rank, “Affect Listeners – From dyads to group interactions with affective dialog systems”, presented at LaCATODA, AISB/IACAPWorld Congress 2012 [42]. 3 http …

An Interdisciplinary VR-architecture for 3D Chatting with Non-verbal Communication.
S Gobron, J Ahn, Q Silvestre, D Thalmann, S Rank… – EGVE …, 2011 – researchgate.net
… This study is complementary to the current paper as they fo- cus on the dialog system and not on the general architecture … The Affect Listener Dialog Scripting (ALDS) as applied in the Affect Bartender condition is responsible for close-domain, task oriented di- alog management …

Emotional chatting machine: emotional conversation generation with internal and external memory
H Zhou, M Huang, T Zhang, X Zhu, B Liu – arXiv preprint arXiv:1704.01074, 2017 – arxiv.org
… zxy-dcs@tsinghua.edu.cn, liub@cs.uic.edu Abstract Emotional intelligence is one of the key factors to the success of dialogue systems or conversational agents. In this paper, we propose Emotional Chatting Machine (ECM) which …

CYBEREMOTIONS–collective emotions in cyberspace
J Ahn, A Borowiec, K Buckley, D Cai, A Chmiel… – Procedia Computer …, 2011 – Elsevier
… world. Affect Listeners – artificial dialog systems applied for studying communication processes – are used to investigate the role of emotions in online, synchronous natural-language-based communication. Experiments demonstrated …

Interacting with collective emotions in e-communities
M Skowron, S Rank – Collective Emotions: Perspectives from …, 2014 – books.google.com
… 117–122). Palm Beach, FL: AAAI Press. Skowron, M., & Rank, S.(2012). Affect listener—from dyads to group interactions with affective dialog systems. In Proceedings of AISB/IACAP World Congress 2012, LaCATODA 2012 (pp. 55–60). Birmingham, UK …

Modelling emotional trajectories of individuals in an online chat
M Galik, S Rank – German Conference on Multiagent System …, 2012 – Springer
… of online-communities. As part of the Cy- berEmotions project, the development and experimental evaluation of affective dialog systems that interact with users online is undertaken: Affect Listeners [18]. Potential applications …

Toward improving dialogue coordination in spoken dialogue systems
R Lunsford – 2012 – digitalcommons.ohsu.edu
… March 2012 Toward improving dialogue coordination in spoken dialogue systems Rebecca Lunsford Follow this and additional works at: http://digitalcommons.ohsu.edu/etd … Page 2. Toward Improving Dialogue Coordination in Spoken Dialogue Systems Rebecca Lunsford …

Development of Multimodal Interfaces: Active Listening and Synchrony: Second COST 2102 International Training School, Dublin, Ireland, March 23-27, 2009 …
A Esposito, N Campbell, C Vogel, A Hussain, A Nijholt – 2010 – books.google.com
… together about 60 European and 6 overseas scientific laboratories whose aim is to develop interactive dialogue systems and intelligent … 157 Jonas Beskow, Jens Edlund, Björn Granström, Joakim Gustafson, and David House Affect Listeners: Acquisition of Affective States by …

Zooming in: studying collective emotions with interactive affective systems
M Skowron, S Rank, D Garcia, JA Ho?yst – Cyberemotions, 2017 – Springer
… 14.4 Interaction Scenarios for Experiments with an Affective Dialog System … 14.2 Participant’s mean ratings on all dependent variables, of their interactions with the dialog system (DS) with three different affective profiles (positive, neutral, negative) (Skowron et al. 2011c) …

The dynamics of emotional chats with Bots: Experiment and agent-based simulations
B Tadi?a, V Gligorijevi?a, M Skowronc, M Šuvakova – 2013 – pdfs.semanticscholar.org
… Experiment with Affective Dialog System The Affective Dialog System (DS) communicates with users in a textual modality, in a natural … The control layer uses an information state based dialog management component: Affect Listener Dialog Scripting (ALDS) [26] for the closed …

The dynamics of emotional chats with bots: experiment and agent-based simulations
B Tadic, V Gligorijevic, M Skowron… – arXiv preprint arXiv …, 2014 – arxiv.org
… The Affective Dialog System (DS) communicates with users in a textual modality, in a natural language form, and uses integrated … The control layer uses an information state based dialog management component: Affect Listener Dialog Scripting (ALDS) [26] for the closed …

Classifying emotions in customer support dialogues in social media
J Herzig, G Feigenblat, M Shmueli-Scheuer… – Proceedings of the 17th …, 2016 – aclweb.org
… technique. 2.2 Emotion Expression Prediction The works in (Skowron, 2010) and (D’Mello et al., 2009) presented dialogue systems that sense the user emotions, such that the system further op- timizes its affect response. Both …

Aij D 0.
A Listeners – Cyberemotions, 2017 – Springer
… If there is a link between nodes i and j then Aij D 1, otherwise Aij D 0. Affect Listeners Conversational systems aiming to detect and adapt to affective states of users, and … Dialog System Is a computer system intended to converse with a human, with a coherent structure …

Sex differences in the evaluation of and communication with conversational agents
B Krenn, S Schreiter, M Skowron – XXI BIENNIAL INTERNATIONAL …, 2012 – ofai.at
… Erlbaum Publishers (2001) 5. Skowron, M.: Affect Listeners … pp. 117–122. AAAI Press (2011) 7. Skowron, M., Rank, S., Theunis, M., Sienkiewicz, J.: The good, the bad and the neu- tral: affective profile in dialog system-user communication …

CYBEREMOTIONS
J Ho?yst, A Chmiel, A Czaplicka, J Sienkiewicz… – stephane-gobron.net
Page 1. Affective dialog systems Affect Listeners are dialog systems applied for studying communication processes. These tools are used to investigate the role of emotions in online, synchronous natural- language-based communication …

Synthesising uncertainty: the interplay of vocal effort and hesitation disfluencies
E Székely, J Mendelson, J Gustafson – 18th Annual Conference of …, 2017 – isca-speech.org
… This work investigates how the vocal effort of the synthetic speech together with added disfluencies affect listeners’ per- ception of the degree of … At the same time, it provides insight into what extent spoken dialogue systems using a syn- thetic voice would be capable of …

The present study is concerned with the blind source separation (BSS) of speech and speech-shaped noise sources. All recordings were carried out in an anechoic …
G Almpanidis, C Kotropoulos – Speech Communication, 2008 – infona.pl
… We examined whether filled pauses (FPs) affect listeners’ predictions about the complexity of upcoming phrases in Japanese. Studies of spontaneous speech corpora show that constituents tend to be longer or more complex …

Building Emotional Conversation Systems Using Multi-task Seq2Seq Learning
R Zhang, Z Wang, D Mai – National CCF Conference on Natural Language …, 2017 – Springer
… Skowron, M.: Affect listeners: acquisition of affective states by means of conversational systems … Skowron, M., Rank, S., Theunis, M., Sienkiewicz, J.: The good, the bad and the neutral: affective profile in dialog system-user communication …

Damping sentiment analysis in online communication: discussions, monologs and dialogs
M Thelwall, K Buckley, G Paltoglou, M Skowron… – … on Intelligent Text …, 2013 – Springer
… As an example of the latter, dialog systems have been developed that react differently to users depending on the sentiment expressed (Skowron, 2010) and in one online environment … Skowron, M.: Affect listeners: Acquisition of affective states by means of conversational systems …

Emotional Human-Machine Conversation Generation Based on Long Short-Term Memory
X Sun, X Peng, S Ding – Cognitive Computation, 2017 – Springer
… Several attempts have been made to endow dialog systems or conversational agents with emotion [2, 33]. Kadish et al … [37] proposed a natural language dialog system that can estimate the user’s emotion from utterances and respond on the basis of the estimated emotion …

Development of Multimodal Interfaces: Active Listening and Synchrony
AENC CarlVogel, AHA Nijholt – 2010 – Springer
… together about 60 European and 6 overseas scientific laboratories whose aim is to develop interactive dialogue systems and intelligent … 157 Jonas Beskow, Jens Edlund, Björn Granström, Joakim Gustafson, and David House Affect Listeners: Acquisition of Affective States by …

Application of speech technology in vehicles
F Chen, M Jonsson, J Villing, S Larsson – Speech Technology, 2010 – Springer
… The trend is pointing toward multimodal user interfaces, but does this hold for in-vehicle dialogue systems as well … Characteristics of the voice affect listeners perception of liking and credibility of what is said either by another human or by a speech-based system [6]. The …

User Behavior Modeling & Recommendation System Based On Social Networks
A Shah – 2014 – academia.edu
… development of realistic and interactive dialog systems. Such systems serve var … With the aid of dialog coherence” modules, conversational systems aim at a realistic interaction flow at the emotional level eg, Affect Listeners [36] and can greatly benefit from the …

Entropy-growth-based model of emotionally charged online dialogues
J Sienkiewicz, M Skowron, G Paltoglou… – Advances in Complex …, 2013 – World Scientific
Page 1. Advances in Complex Systems Vol. 16, Nos. 4 & 5 (2013) 1350026 (25 pages) c© World Scientific Publishing Company DOI: 10.1142/S0219525913500264 ENTROPY-GROWTH-BASED MODEL OF EMOTIONALLY CHARGED ONLINE DIALOGUES …

Sonic branding in sport: A model for communicating brand identity through musical fit
K Ballouli, B Heere – Sport Management Review, 2015 – Elsevier
… Based on a common understanding that popularity and likability affect listeners’ mood states, we present a traditional model for applying music to marketing that illustrates how classical conditioning utilizes these constructs as moderators in the music-mood relationship (see Fig …

How Online Emotions Influence Community Life
J Sienkiewicz, A Chmiel, P Sobkowicz, JA Ho?yst – Cyberemotions, 2017 – Springer
Emotions expressed online as well as individual activities are usually far from equilibrium. In such a setting, the non-stationarity can be understood. As a condition necessary for discussion to be st.

Thesis Material-Rasmus Dall
R Dall – 2017 – datashare.is.ed.ac.uk
Page 1. Statistical Parametric Speech Synthesis Using Conversational Data and Phenomena Rasmus Dall T H E U NIVER S I T Y O F E DI NBU R G H Doctor of Philosophy Institute for Language, Cognition and Computation School of Informatics University of Edinburgh 2017 …

Statistical parametric speech synthesis using conversational data and phenomena
R Dall – 2017 – era.lib.ed.ac.uk
Page 1. This thesis has been submitted in fulfilment of the requirements for a postgraduate degree (eg PhD, MPhil, DClinPsychol) at the University of Edinburgh. Please note the following terms and conditions of use: This work …