Notes:
iristk (Intelligent Real-Time Interactive Systems Toolkit) is a toolkit for building intelligent real-time interactive systems, such as virtual assistants, chatbots, and other conversational agents. It is an open-source toolkit that provides a variety of tools and resources for developing and deploying these types of systems, including libraries for natural language processing, speech recognition and synthesis, and machine learning.
iristk is designed to be user-friendly and flexible, and it can be used to develop systems for a wide range of applications and platforms. It is developed and maintained by the iris group at the University of Copenhagen, and it is used by researchers, developers, and organizations around the world to build intelligent real-time interactive systems.
Resources:
- iristk.net .. intelligent real-time interactive systems toolkit
See also:
Modelling situated human-robot interaction using IrisTK
G Skantze, M Johansson – … Interest Group on Discourse and Dialogue, 2015 – aclweb.org
In this demonstration we show how situated multi-party human-robot interaction can be modelled using the open source framework IrisTK. We will demonstrate the capabilities of IrisTK by showing an application where two users are playing a collaborative card sorting …
Fluent human–robot dialogues about grounded objects in home environments
A Persson, S Al Moubayed, A Loutfi – Cognitive Computation, 2014 – Springer
… To orchestrate the dialogue system, the IrisTK dialogue platform is used … Integration. The anchoring framework and its sensors use the ROS communication system and protocol, while the IrisTK dialogue platform uses a designated protocol that is specific to dialogue …
The Tutorbot Corpus – A Corpus for Studying Tutoring Behaviour in Multiparty Face-to-Face Spoken Dialogue.
M Koutsombogera, S Al Moubayed, B Bollepalli… – LREC, 2014 – lrec-conf.org
… of multiparty multimodal dialogue system using the robot head Furhat (Al Moubayed et al., 2012) and the newly developed IrisTK dialogue platform (Skantze & Al … Facilitating multiparty dialog with gaze, gesture, and speech … Towards an ISO Standard for Dialogue Act Annotation …
Human-robot collaborative tutoring using multiparty multimodal spoken dialogue
S Al Moubayed, J Beskow, B Bollepalli… – Proceedings of the …, 2014 – dl.acm.org
… Human-Robot Interaction, Multiparty interaction, human-robot collaboration, Spoken dialog, Furhat robot … of the corpus, into an implementa- tion of multiparty multimodal dialogue system, using the … interactions [3,4], togeth- er with the newly developed IrisTK dialogue platform [5 …
Combining chat and task-based multimodal dialogue for more engaging HRI: A scalable method using reinforcement learning
I Papaioannou, O Lemon – Proceedings of the Companion of the 2017 …, 2017 – dl.acm.org
… [8] G. Skantze and S. Al Moubayed. Iristk: a statechart-based toolkit for multi-party face-to-face interaction … [10] A. van Woudenberg. A Chatbot Dialogue Manager … [11] S. Young, M. Gasic, B. Thomson, and JD Williams. Pomdp-based statistical spoken dialog systems: A review …
OpenDial: A toolkit for developing spoken dialogue systems with probabilistic rules
P Lison, C Kennington – Proceedings of ACL-2016 System …, 2016 – aclweb.org
… as Olym- pus/Ravenclaw (Bohus and Rudnicky, 2009), the AT&T Statistical Dialog toolkit (Williams et al., 2010), InproTK (Baumann and Schlangen, 2012) or IrisTK (Skantze and … finite-state automata or logical methods to represent and reason over the current dialogue …
Towards rich multimodal behavior in spoken dialogues with embodied agents
S Al Moubayed – … ), 2013 IEEE 4th International Conference on, 2013 – ieeexplore.ieee.org
… IrisTK comes with several tools that support the communication of XML events in between programs, and over … the inherent unpredictability and ambiguity of nonverbal behaviour is what turns a dialogue from a … [10] D. Bohus and E. Horvitz, “Facilitating multiparty dialog with gaze …
How to Catch A Werewolf
J Beskow – artes.ucp.pt
… In this project we will focus on the implementation of the roles of the “villager” and the “werewolves” using the IrisTK dialogue framework and the robot head Furhat. To be more precise, the aim of this project is to use multi-modal …
Spot the Difference-A dialog system to explore turn-taking in an interactive setting
A Hjalmarsson, M Zellers – SEMDIAL 2015 goDIAL, 2015 – christinehowes.com
… Figure 2: Human-human dialog excerpt. 3.1 System implementation and setup The dialog system was implemented using IrisTK (Skantze & Al … Language, 50, 696-735. Schlangen, D., & Skantze, G.(2011). A General, Abstract Model of Incremental Dialogue Processing …
Far-Field Audio-Visual Scene Perception Of Multi-Party Human-Robot Interaction For Children And Adults
A Tsiami, PP Filntisis, N Efthymiou, P Koutras… – cvsp.cs.ntua.gr
… The latter choice is primarily driven by the 3D photorealistic appearance of the Furhat robotic head, its abilities to speak and turn towards a desired di- rection “engaging” the user, and accompanying software integration environment within the IrisTK dialog framework [23] …
Assembling the jigsaw: How multiple open standards are synergistically combined in the HALEF multimodal dialog system
V Ramanarayanan, D Suendermann-Oeft… – … Interaction with W3C …, 2017 – Springer
… OpenDial 11. the Virtual Human Toolkit [9]. Metalogue, 12 a multimodal dialog system. IrisTK, 13 a multimodal dialog system … Where do we go from here? Research and commercial spoken dialog systems. In 6th SIGdial Workshop on Discourse and Dialogue.Google Scholar. 19 …
Data-driven models for timing feedback responses in a Map Task dialogue system
R Meena, G Skantze, J Gustafson – Computer Speech & Language, 2014 – Elsevier
… 1. Download full-size image. Fig. 1. The user interface of the Map Task dialogue system, showing the map. The system is implemented using the IrisTK dialogue system framework (Skantze and Al Moubayed, 2012). The basic components of the system can be seen in Fig …
Spontaneous spoken dialogues with the furhat human-like robot head
S Al Moubayed, J Beskow, G Skantze – Proceedings of the 2014 ACM …, 2014 – dl.acm.org
… The dialogue design is performed using the IrisTK [4] dialogue au- thoring … State diagrams; D.2.11 [Software Engi- neering] Software Architectures – Languages Keywords Human-Robot Interaction, Multiparty interaction, Gaze, Gesture, Speech, Spoken dialog, Facial animation …
Tutoring robots
S Al Moubayed, J Beskow, B Bollepalli… – … Summer Workshop on …, 2013 – Springer
… system, using the robot head Furhat [9], and the newly developed IrisTK dialogue platform [10 … Multiparty turn-taking in dialog systems has been addressed with regards to the … Communicative feedback gives evidence of the collaborative nature of dialogue while the participants …
Design and Architecture of a Robot-Child Speech-Controlled Game
S Al Moubayed, J Lehman – Proceedings of the Tenth Annual ACM/IEEE …, 2015 – dl.acm.org
… ABSTRACT We describe the conceptual design, architecture, and implementation of a multimodal, robot-child dialogue system in a fast-paced, speech-controlled collaborative game … 4. DIALOG ARCHITECTURE We used the IrisTK state-charts dialog authoring tool …
Multi-party language interaction in a fast-paced game using multi-keyword spotting
JF Lehman, N Wolfe, A Pereira – International Conference on Intelligent …, 2016 – Springer
… this flexibility includes separate processes for the game engine, speech recognition, and robot control, coordinated by an IrisTK dialog module [10 … J., Edelstam, F., Gustafson, J.: Human pause and resume behaviours for unobtrusive human like in-car spoken dialogue systems …
Crowdsourcing street-level geographic information using a spoken dialogue system
R Meena, J Boye, G Skantze, J Gustafson – … on Discourse and Dialogue …, 2014 – aclweb.org
… slot and proceeds with the dialogue. For speech synthesis, we use the CereVoice system developed by CereProc2. The dialogue system has been imple- mented using the IrisTK framework (Skantze & Al Moubayed, 2012) …
The effect of a physical robot on vocabulary learning
A Wedenborn, P Wik, O Engwall… – … . Int. Work. Spok. Dialogue …, 2016 – speech.kth.se
… IrisTK provides an API for developers including designing flow based dialogue systems, controlling an an- imated face and modules for using speech synthesizers. Page 3. The effect of a physical robot on vocabulary learning 3 …
A Virtual Poster Presenter using Mixed Reality
V Avramova, F Yang, C Li, C Peters… – … Conference on Intelligent …, 2017 – Springer
… [3]). 2 Platform The platform involves four major components: The IrisTK multi-modal dialogue framework (www.iristk.net), a full-body animation controller [6], Unity3D, and the Microsoft HoloLens. An overview of the architecture …
A Collaborative Human-Robot Game as a Test-bed for Modelling Multi-party, Situated Interaction
G Skantze, M Johansson, J Beskow – International Conference on …, 2015 – Springer
… Two behaviour controllers based on the Harel statechart mechanism offered by IrisTK run in parallel: The Dialog Flow and the … The Dialogue Flow module orchestrates the spoken interaction, based on input from the speech recognizers, together with events from the Situation …
A computational model for phonetically responsive spoken dialogue systems
E Raveh, I Steiner, B Möbius – Proc. Interspeech 2017, 2017 – coli.uni-saarland.de
… 2012 release,” in NAACL-HLT Workshop on Future Directions and Needs in the Spoken Dialog Community: Tools … 2–5. [14] P. Lison and C. Kennington, “OpenDial: A toolkit for developing spoken dialogue systems with … [15] G. Skantze and S. Al Moubayed, “IrisTK: a statechart …
The Future of Human-Robot Spoken Dialogue: from Information Services to Virtual Assistants NII Shonan Meeting Report
RE Banchs, S Sakti, E Mizukami – 2015 – shonan.nii.ac.jp
… have developed several tools for conducting this research, including the dialogue system frame- work IrisTK (released as … on the analysis of Spoken Utterances and Statistical Modelling for User-centred Adaptive Spoken Dialogue Systems. Spoken dialog technologies in NICT …
Proceedings of the 16th Annual Meeting of the Special Interest Group on Discourse and Dialogue
A Koller, G Skantze, F Jurcicek, M Araki… – … Discourse and Dialogue, 2015 – aclweb.org
… Reinforcement Learning of Multi-Issue Negotiation Dialogue Policies Alexandros Papangelis and Kallirroi … Fast and easy language understanding for dialog systems with Microsoft Language … Modelling situated human-robot interaction using IrisTK Gabriel Skantze and Martin …
Enabling robust and fluid spoken dialogue with cognitively impaired users
R Yaghoubzadeh, S Kopp – … SIGdial Meeting on Discourse and Dialogue, 2017 – aclweb.org
… Skantze and Moubayed (2012), with IrisTK, presented another hybrid approach that combined a generic ‘attention manager’ with a hierarchical task and dialogue model (IrisFlow) based on a generalized, extended version of Harel statecharts, which can be conveniently …
Architecture and representation for handling dialogues in human-robot interactions
E Retamino, S Nair, A Vijayalingam… – Signal and Information …, 2015 – ieeexplore.ieee.org
… 85–96, 2003. [2] G. Skantze and SA Moubayed, “Iristk: a statechart … [3] R. Iida, M. Yasuhara, and T. Tokunaga, “Multi-modal reference resolution in situated dialogue by integrating … [4] T. Misu, A. Raux, I. Lane, J. Devassy, and R. Gupta, “Situated multi- modal dialog system in …
Conversational Strategies for Robustly Managing Dialog in Public Spaces
A Pappu, M Sun, S Sridharan, A Rudnicky – … Workshop on Dialogue in …, 2014 – aclweb.org
… 2013. Situated multi-modal dialog system in vehicles … 2014. Integration of multiple sound source localization results for speaker identifica- tion in multiparty dialogue system … 2012. Iristk: a statechart-based toolkit for multi-party face-to-face interaction. In Proc …
Towards a generic framework for multi-party dialogue with virtual humans
R Harel, Z Yumak, F Dignum – … of the 31st International Conference on …, 2018 – rharel.com
… trindikit. py: An open-source Python library for developing ISU-based dialogue systems. Proc … [16] Antoine Raux and Maxine Eskenazi. 2009. A finite-state turn-taking model for spoken dialog systems … 2012. IrisTK: a statechart-based toolkit for multi-party face-to-face interaction …
Towards a Persuasive Dialog System Supporting Personal Health Management
V Götzmann – National Research Center, 2015 – isl.anthropomatik.kit.edu
… 9 Page 18. 10 2. Background Of course, this trend was not missed by spoken dialog developers, naming healthcare as “an im- portant new domain for spoken dialogue applications.”. [JM09] Graph based spoken systems were …
A Natural Conversational Virtual Human with Multimodal Dialog System
IR Ali, G Sulong, AH Basori – academia.edu
… The development of modules of dialog systems containing integration of voice intonation and correct talking speed is an important future … 2006. Dialogue Systems Go Multimodal The SmartKom Experience … IrisTK: a Statechart-based Toolkit for Multi-party Face-to-face Interaction …
A Toolkit For 3D-Gesture And Speech Dialog In Automotive Environments
T Sowa, A Richter, D Fey – essv2018.de
… On gesture recognition, an event is fired that may lead to a transition in another state machine (causing a display/menu to pop up or a speech dialog to be initiated) … [6] SKANTZE, G. and S. AL MOUBAYED: IrisTK: a statechart-based toolkit for multi-party face-to-face interaction …
Engagement Recognition in Spoken Dialogue via Neural Network by Aggregating Different Annotators’ Models
K Inoue, D Lala, K Takanashi… – Proc. Interspeech …, 2018 – isca-speech.org
… [3] G. Skantze and M. Johansson, “Modelling situated human-robot interaction using IrisTK,” in SIGdial … [6] L. Cerrato and N. Campbell, “Engagement in dialogue with social … Henkin, AW Black, and AI Rudnicky, “A Wizard-of-Oz study on a non-task-oriented dialog systems that …
Dialog Technology Bibliography
NG Ward, G Skantze – cs.utep.edu
… In Proceedings of the 8th SIGdial Workshop on Discourse and Dialogue, 200–211 … Optimizing dialog man- agement with reinforcement learning: Ex- periments with the NJFun system … 9 Page 10. IrisTK: a statechart-based toolkit for multi-party face-to-face interaction. In ICMI …
The Spot the Difference corpus: a multi-modal corpus of spontaneous task oriented spoken interactions
J Lopes, N Hemmingsson, O Åstrand – arXiv preprint arXiv:1805.05091, 2018 – arxiv.org
… 3.2. Infrastructure The game was implemented with IrisTK (Skantze and Al Moubayed, 2012), already envisaging a future implemen- tation in a dialogue system. IrisTK was running in parallel in two different machines, they were communicating with one another sending event …
Spoken dialogue systems: architectures and applications
JM Olaso Fernández – 2017 – addi.ehu.es
… way in which each of the modules is responsible for performing each of the mentioned tasks, interacting together to carry out the dialogue. Text To Speech Natural Language Generator Natural Language Understanding Automatic Speech Recognition Dialog Manager Backend …
DICE-R: defining human-robot interaction with composite events
J Van den Bergh, K Luyten – … of the ACM SIGCHI Symposium on …, 2017 – dl.acm.org
… 2013. A Dialogue System for Multimodal Human-robot Interaction … 2007. Integrating language, vision and action for human robot dialog systems … 2012. IrisTK: A Statechart- based Toolkit for Multi-party Face-to-face Interaction …
A psychotherapy training environment with virtual patients implemented using the Furhat robot platform
R Johansson, G Skantze, A Jönsson – International Conference on …, 2017 – Springer
… IrisTK has a flexible design and uses a statechart-based XML formalism for designing the dialog flow. 184 … Page 3. the dialog flow in the Furhat robot … Below is an example dialogue between a therapist and a virtual patient in the system …
Exploring turn-taking cues in multi-party human-robot discussions about objects
G Skantze, M Johansson, J Beskow – Proceedings of the 2015 ACM on …, 2015 – dl.acm.org
… complete interaction can be seen at https://www.youtube.com/watch?v=5fhjuGu3d0I 2 http://www.iristk.net … Figure 3: Dialogue fragment from an interaction (translated from Swedish … There are four states the Attention Flow can be in (as instructed by the Dialog Flow): Idle (looking …
Separating representation, reasoning, and implementation for interaction management
ME Foster, RPA Petrick – … Workshop on Spoken Dialogue System …, 2016 – research.ed.ac.uk
… J, Wrede B (2011) The curious robot as a case-study for comparing dialog systems … Rich C, Sidner CL (2012) Using collaborative discourse theory to partially automate dialogue tree authoring … Skantze G, Al Moubayed S (2012) IrisTK: A statechart-based toolkit for multi-party face …
Psychotherapists’ interest in using the Furhat social robot for clinical training
R Johansson – … Uppsala University anders. arwestrom. jansson@ it …, 2017 – diva-portal.org
… The practice environment uses the Furhat social robot (Moubayed, Beskow, Skantze, & Granström, 2012) and the open-source toolkit IrisTK (Skantze & Al Moubayed, 2012) to implement simulated patients in a dialog system …
Opportunities and obligations to take turns in collaborative multi-party human-robot interaction
M Johansson, G Skantze – … Interest Group on Discourse and Dialogue, 2015 – aclweb.org
… Two behaviour controllers based on the Harel statechart mecha- nism offered by IrisTK run in … The dialog system was exhibited at the Swedish National Museum of Science and Technology, in … selected for training and tuning the turn-taking model, and one dialogue was selected …
The furhat social companion talking head.
S Al Moubayed, J Beskow, G Skantze – INTERSPEECH, 2013 – pdfs.semanticscholar.org
… Turn-taking Control Using Gaze in Multiparty Human-Computer Dialog: Effects of 2D and 3D Displays … Furhat at Robotville: A Robot Head Harvesting the Thoughts of the Public through Multi-party Dialogue … IrisTK: a statechart- based toolkit for multi-party face-to-face interaction …
Social talk: making conversation with people and machine
E Gilmartin, M Collery, K Su, Y Huang, C Elias… – Proceedings of the 1st …, 2017 – dl.acm.org
… We have built a spoken dialog system and collected a corpus of dyadic conversations as described below. 2 CARA DIALOGUE SYSTEM CARA is a custom-built Java-based spoken dialog system based on the architectural principles used in SEMAINE and in the IrisTK 31 …
Making turn-taking decisions for an active listening robot for memory training
M Johansson, T Hori, G Skantze, A Höthker… – … Conference on Social …, 2016 – Springer
… sometimes might ask counter-questions, a Question detection module is used to either react to the question or to ask a follow-up question that will advance the dialog to a … The system was implemented using the open source dialogue system framework IrisTK [18], which …
Action Selection for Interaction Management: Opportunities and Lessons for Automated Planning
R Petrick, ME Foster – 2016 – eprints.gla.ac.uk
… Peltason, J., and Wrede, B. 2011. The curious robot as a case-study for comparing dialog systems … Using collaborative discourse theory to partially automate dialogue tree authoring … IrisTK: A statechart-based toolkit for multi-party face-to-face interaction …
Comparison of human-human and human-robot turn-taking behaviour in multiparty situated interaction
M Johansson, G Skantze, J Gustafson – Proceedings of the 2014 …, 2014 – dl.acm.org
… In Proc. of IJCAI Workshop on Knowledge and Reasoning in Practical Dialogue Systems (pp … [22] Allen, JF, & Core, M. (1997). Draft of DAMSL: Dialog act markup in several layers … IrisTK: a statechart-based toolkit for multi-party face-to-face interaction. In Proceedings of ICMI …
Talking with ERICA, an autonomous android
K Inoue, P Milhorat, D Lala, T Zhao… – … Discourse and Dialogue, 2016 – aclweb.org
… For practical use, we recorded many backchannel voices varied in forms and levels, and choose the appropriate sam- ple in real time. A dialogue example is as follows. U1 It is nice weather today. E1 Un … 2015. Modelling situ- ated human-robot interaction using IrisTK. In Proc …
FARMI: A Framework for Recording Multi-Modal Interactions
J Patrik, B Mattias, F Per, D Kontogiorgos, L Jose… – LREC, 2018 – diva-portal.org
… IrisTK enables the recording of multi-modal data collections, however, data stream synchronisation is not fully solved … Processors Dialogue act recogniser Facial expression recogniser … IEEE. Bohus, D. and Horvitz, E. (2009). Dialog in the open world: platform and applications …
Machine Learning and Social Robotics for Detecting Early Signs of Dementia
P Jonell, J Mendelson, T Storskog, G Hagman… – arXiv preprint arXiv …, 2017 – arxiv.org
… confusion. 3 The Furhat dialogue system … mask. This feature will be exploited in the participatory design study (Section 5.2). The Furhat robot includes a multi-modal dialog system, implemented using the IrisTK framework [26]. It …
Regulating turn-taking in multi-child spoken Interaction
S Al Moubayed, J Lehman – International Conference on Intelligent Virtual …, 2015 – Springer
… S., Skantze, G.: Turn-taking control using gaze in multiparty human-computer dialogue: effects of … Bohus, D., Horvitz, E.: Facilitating multiparty dialog with gaze, gesture, and speech … 100, 78–100 (1986)CrossRefGoogle Scholar. Skantze, G., Al Moubayed, S.: IrisTK: a statechart …
Exploring the effects of gaze and pauses in situated human-robot interaction
G Skantze, A Hjalmarsson, C Oertel – Proceedings of the SIGDIAL 2013 …, 2013 – aclweb.org
… Apart from the real-time nature of spoken in- teraction, spoken dialog technology has for a long time also neglected the physical space in which the interaction takes place … The dialogue sys- tem was implemented using the IrisTK frame- work developed at KTH …
A Model of Continuous Intention Grounding for HRI
J Hough, D Schlangen – 2017 – pub.uni-bielefeld.de
… In Proceedings of the 11th Annual Meeting of the Special Interest Group on Discourse and Dialogue. ACL, 2010 … Iristk: a statechart-based toolkit for multi-party face-to-face interaction … ACM, 2012. [13] JD Williams. A belief tracking challenge task for spoken dialog systems …
Expressive virtual characters for social demonstration games
F Yang, C Li, R Palmberg… – Virtual Worlds and …, 2017 – ieeexplore.ieee.org
… The conversation controller can be integrated with the IrisTK [26] dialogue system to develop multi-modal interactions. Moreover, the copy controller can be extended to recognize body movement and gestures [27]. 223 Page 8. Fig …
Separating representation, reasoning, and implementation for interaction management: Lessons from automated planning
ME Foster, RPA Petrick – Dialogues with Social Robots, 2017 – Springer
… Bohus, D., Rudnicky, AI: The RavenClaw dialog management framework: architecture and systems … Lison, P.: A hybrid approach to dialogue management based on probabilistic rules … Skantze, G., Al Moubayed, S.: IrisTK: a statechart-based toolkit for multi-party face-to-face …
Towards closed feedback loops in HRI: integrating InproTK and PaMini
B Carlmeyer, D Schlangen, B Wrede – Proceedings of the 2014 …, 2014 – dl.acm.org
… [7] F. Doshi and N. Roy. Efficient model learning for dialog management … A general, abstract model of incremental dialogue processing. Dialogue and Discourse, 2(1):83–111, 2011 … Iristk: A statechart-based toolkit for multi-party face-to-face interaction …
A robotic couples counselor for promoting positive communication
D Utami, TW Bickmore, LJ Kruger – Robot and Human …, 2017 – ieeexplore.ieee.org
… The system was implemented in the open source dialogue system framework IrisTK [44 … Bohus and E. Horvitz, “Models for multiparty engagement in open- world dialog,” presented at … 10th Annual Meeting of the Special Interest Group on Discourse and Dialogue, London, United …
Real-Time Coordination in Human-Robot Interaction Using Face and Voice.
G Skantze – AI Magazine, 2016 – pdfs.semanticscholar.org
… 1 A video of the interaction can be seen at https://www.youtube.com/watch?v=5fhjuGu3d0I 2 http://www.iristk.net … Traditionally, spoken dialogue systems have rested on a very simplistic model of turn-taking, where a certain amount of silence (say 700-1000ms) is … Dialog Flow …
Analysis of engagement and user experience with a laughter responsive social robot
BB Türker, Z Buçinca, E Erzin… – Proc. 18th Annu …, 2017 – pdfs.semanticscholar.org
… IrisTK platform [16] is used with Furhat robot head, which provides functionalities, such as … In our experiments, CEs are extracted through the logged dialog components and sensory data … Data-driven models for timing feedback responses in a map task dialogue system,” Com …
Multimodal Robot Behavior Learning
M Moeini – International Journal Artificial Intelligent and Informatics, 2018 – ijarlit.org
… Gabriel Skantze and Martin Johansson. Modelling situated human-robot in- teraction using iristk. In Proceedings of the 16th Annual Meeting of the Special Interest Group on Discourse and Dialogue, pages 165–167, 2015. Gabriel Skantze and Samer Al Moubayed …
Adaptive robot language tutoring based on bayesian knowledge tracing and predictive decision-making
T Schodde, K Bergmann, S Kopp – Proceedings of the 2017 ACM/IEEE …, 2017 – dl.acm.org
… interface realized via a HTML website. For the implementation of the interaction and di- alogue structure, the state-chart based dialogue-manager IrisTK has been used [28]. NAOqi4 has been applied as middleware between …
Turn-taking, feedback and joint attention in situated human–robot interaction
G Skantze, A Hjalmarsson, C Oertel – Speech Communication, 2014 – Elsevier
… The dialogue system was implemented using the IrisTK framework developed at KTH (Skantze and Al Moubayed, 2012; www.iristk.net), which provides a set of modules for input and output, including control of Furhat (facial gestures, eye and head movements), as well as an …
Towards developing a model for group involvement and individual engagement
C Oertel – Proceedings of the 15th ACM on International …, 2013 – dl.acm.org
… In an online dialog system, however, much more noise will be introduced … A gaze-based method for relating group involvement to individual engagement in multimodal multiparty dialogue … Iristk: a statechart-based toolkit for multi-party face-to-face interaction. In Proc …
Supporting Spoken Assistant Systems with a Graphical User Interface that Signals Incremental Understanding and Prediction State
C Kennington, D Schlangen – … Interest Group on Discourse and Dialogue, 2016 – aclweb.org
… provide a good review of work that show how backchannels facilitate grounding, feedback, and clarifications in human spoken dialogue, and apply … Our work is also comparable to SDS toolkits such as IrisTK (Skantze and Moubayed, 2012) and Open- Dial (Lison, 2015) which …
Effects of multimodal cues on children’s perception of uncanniness in a social robot
M Paetzel, C Peters, I Nyström… – Proceedings of the 18th …, 2016 – dl.acm.org
… The commercial software CereProc [1] was used as a human-like synthesizer with William as the male and Sarah as the female version [22]. We used the Java- based dialog framework IrisTK [24] to control the robot. Both speech and animation behavior was fully pre-script …
KILLE: a Framework for Situated Agents for Learning Language Through Interaction
S Dobnik, EW de Graaf – Proceedings of the 21st Nordic Conference on …, 2017 – ep.liu.se
… for incre- mental interaction (Schlangen and Skantze, 2011) IrisTK (Skantze and Al Moubayed, 2012) and In- proTK (Kennington et al., 2014). The difference is that instead of starting from the perspective of in- cremental language processing and dialogue man- agement we …
Investigating fluidity for human-robot interaction with real-time, real-world grounding strategies
J Hough, D Schlangen – … Interest Group on Discourse and Dialogue, 2016 – aclweb.org
… Julian Hough and David Schlangen Dialogue Systems Group // CITEC // Faculty of Linguistics and Literature Bielefeld University firstname.lastname@uni-bielefeld.de Abstract … mechanisms which deal with the inherent uncer- tainty in situated dialogue for a robot …
Estimating response obligation in multi-party human-robot dialogues
T Sugiyama, K Funakoshi, M Nakano… – … ), 2015 IEEE-RAS …, 2015 – ieeexplore.ieee.org
… doi.acm.org/10.1145/2522848.2522872 [3] G. Skantze and S. AI Moubayed, “Iristk: A statechart … [5] ——, “Models for multiparty engagement in open-world dialog,” in Proceedings of Annual Meeting of the Special Interest Group on Discourse and Dialogue, 2009, pp …
A physical robot’s effect on vocabulary learning
A Wedenborn – 2015 – diva-portal.org
… In the study the virtual language teacher Ville1 and the role-playing and dialogue system called DEAL2, based on Ville, were … IrisTK was developed together with Furhat and … Page 22. 18 help is needed. It can present you with an interactive dialog and situation simulation, or it …
It’s Not What You Do, It’s How You Do It: Grounding Uncertainty for a Simple Robot
J Hough, D Schlangen – Proceedings of the 2017 ACM/IEEE …, 2017 – dl.acm.org
… Julian Hough and David Schlangen Dialogue Systems Group // CITEC Faculty of Linguistics and Literature Bielefeld University firstname.lastname@uni-bielefeld.de … The first modification is that the robot’s actions have the same status as dialogue acts …
Towards modelling multimodal and multiparty interaction in educational settings
M Koutsombogera, M Deligiannis, M Giagkou… – Toward Robotic Socially …, 2016 – Springer
… Specifically, the target is to integrate this task modelling into the implementation of context-aware and adaptive dialogue systems able to grasp and infer individual as well as multi-party effects, and at the same time generate rich, socially believable behavior … IrisTK [26]) …
The furhat back-projected humanoid head–lip reading, gaze and multi-party interaction
SAL MOUBAYED, G Skantze… – International Journal of …, 2013 – World Scientific
… of interest in the shared space of attention, but also communicate naturally with the users, a process that involves multiparty dialogue regulation using … However, there are other studies which indicate that it may still be possible to have a multi-party dialog with an agent presented …
Towards building an attentive artificial listener: on the perception of attentiveness in audio-visual feedback tokens
C Oertel, J Lopes, Y Yu, KAF Mora… – Proceedings of the 18th …, 2016 – dl.acm.org
… as one strategy for establishing rapport between a human and a virtual human, or [22], who used backchannels in their dialogue system to … 3) were inserted at the same place in which a backchannel had occurred in the original recording, and sent into the IRISTK [21] toolkit to …
Towards Building an Attentive Artificial Listener
C Oertel, J Lopes, Y Yu, KAF Mora, J Gustafson… – idiap.ch
… as one strategy for establishing rapport between a human and a virtual human, or [22], who used backchannels in their dialogue system to … 3) were inserted at the same place in which a backchannel had occurred in the original recording, and sent into the IRISTK [21] toolkit to …
Trope
TBAN ATTENTIVE, A LISTENER – 2016 – pdfs.semanticscholar.org
… as one strategy for establishing rapport between a human and a virtual human, or [16], who used backchannels in their dialogue system to … 3) were inserted at the same place in which a backchannel had occurred in the original recording and, sent into the IRISTK [15] toolkit to …
Chatbots’ Greetings to Human-Computer Communication
MJ Pereira, L Coheur, P Fialho, R Ribeiro – arXiv preprint arXiv …, 2016 – arxiv.org
… easily written using the Pandorabot’s utility Pandorawriter, which allows to “convert free-format dialog into AIML … clear that we exclude from this survey, authoring platforms such as the IrisTK26, the … Toolkit27 (Hartholt et al., 2013), as these target multi-modal dialogue systems and …
Annotation and analysis of listener’s engagement based on multi-modal behaviors
K Inoue, D Lala, S Nakamura, K Takanashi… – Proceedings of the …, 2016 – dl.acm.org
… on Systems, Man, and Cybernetics, 34(2):181–186, 2004. [7] L. Cerrato and N. Campbell. Engagement in dialogue with social robots. In Proc. IWSDS, 2016 … [19] Y. Ma, PA Crook, R. Sarikaya, and E. Fosler-Lussier. Knowledge graph inference for spoken dialog systems. In Proc …
Predicting and Regulating Participation Equality in Human-robot Conversations: Effects of Age and Gender
G Skantze – Proceedings of the 2017 ACM/IEEE International …, 2017 – dl.acm.org
… Studies on human-human dialogue have shown that the more turn-yielding cues are presented together, the more likely it is that the other … However, our main goal here is to cre- ate a believable dialog agent that can be used as a test-bed for stud- ying turn … 2 http://www.iristk.net …
Working with Walt
I El Makrini, SA Elprama… – IEEE Robotics & …, 2018 – ieeexplore.ieee.org
… convey this reaction to the person [1]. Several approaches [18], [2], [4] have been proposed to steer the behavior of the fusion engine, dialog manager, and … [17] P. Lison, “A hybrid approach to dialogue management based … [24] G. Skantze and S. Al Moubayed, “IrisTK: A statechart …
ClaXon: Study and Implementation of Robotic Coworkers in an Industrial Context
I El Makrini, SA Elprama, J Van den Bergh… – 2018 – researchgate.net
… Several approaches [18, 2, 4] have been proposed to steer the behavior of the fusion engine, dialog manager and fission component … A hybrid approach to dialogue management based on probabilistic rules … IrisTK: a statechart-based toolkit for multi-party face-to-face interaction …
Alignment Strategies for Information Retrieval in Prosocial Human-Robot Interaction
BA Kühnlenz – 2013 – mediatum.ub.tum.de
… 26 2.5 Proportionate occurrences of dialog performance-measures in five runs each for the noise-levels of 40 – 80 dB(C) . . . . 37 3.1 Sample dialogue of a game of akinator, looking for R2D2 …
MultiPro: Prototyping Multimodal UI with Anthropomorphic Agents
P Kulms, H van Welbergen, S Kopp – Mensch und Computer 2018 …, 2018 – dl.gi.de
… events as parallel subcharts in each dialog state from which they should trigger a transition, allowing us to track the final state of compound event charts upon which new transitions to the next dialog state can … Iristk: A statechart-based toolkit for multi-party face-to-face interaction …
Speech and language in humanoid robots
A Cangelosi, T Ogata – Humanoid Robotics: A Reference, 2016 – Springer
… For example, the IrisTK is a state-chart toolkit, initially developed for the Furhat Back-Projected … For example, some general dialog management systems, as the one used by Nuance VoCon/DRAGON DICTATE … [41] use WikiTalk, an open access spoken dialogue system for open …
3.28 Qualitative and Multi-Attribute Learning from Diverse Data Collections
M Ben-Chen, F Chazal, LJ Guibas… – … in Geometric Data, 2017 – drops.dagstuhl.de
Page 19. Mirela Ben-Chen, Frédéric Chazal, Leonidas J. Guibas, and Maks Ovsjanikov 17 3.28 Qualitative and Multi-Attribute Learning from Diverse Data Collections Hao Zhang (Simon Fraser University–Burnaby, CA) License …
Lip Syncing Method for Realistic Expressive Three-dimensional Face Model
IRA Al-Rubaye – 2016 – eprints.utm.my
… environments and games. Lip syncing usually has an interface which is backed up by a suitable dialogue manager and knowledge base. The 3D face model are capable of using voice; animated dialogue with lips and face appearances; eye, head, and body …
A First Visit to the Robot Language Café
J Lopes, O Engwall, G Skantze – ISCA workshop on Speech and …, 2017 – diva-portal.org
… the use of a robot as a native conversation leader more achievable: since the expected number of topics is limited, the robot’s dialogue sys- tem … The robot is controlled by the IrisTk framework [15], which inter- faces to components for text-to-speech synthesis, facial anima- tion …
Data-driven HRI: Learning social behaviors by example from human–human interaction
P Liu, DF Glas, T Kanda… – IEEE Transactions on …, 2016 – ieeexplore.ieee.org
… Unlike other works, we focus on training examples based on real human–human interaction, with natural spoken dialogue … The robot JAMES was developed to serve drinks in a bar setting in which a number of supervised (ie, dialog management) and unsupervised learning …
Gestures become more informative when communication is unsuccessful
MW Hoetjes – 2016 – repository.ubn.ru.nl
… Thomas Ousterhout. Investigation of the semantic priming effect with the N400 using symbolic pictures in text Matthias A. Priesters, Kirsten Bergmann and Stefan Kopp. Deriving Individual Gesture Profiles from a Multimodal Dialogue Corpus Isabella Poggi …