WITAS Robotic Dialog Environment (RDE)

Notes:

The Wallenberg AI, Autonomous Systems and Software Program – Humanities and Society (WASP-HS) is a research initiative that was launched by the Knut and Alice Wallenberg Foundation in Sweden in 2017. The goal of the program is to support research on the societal and ethical implications of artificial intelligence (AI) and autonomous systems, and to explore ways in which these technologies can be used to benefit society.

The WASP-HS program is focused on four main research areas:

  1. Ethical, legal, and social aspects of AI and autonomous systems: This research area focuses on the ethical, legal, and social implications of AI and autonomous systems, including issues related to privacy, accountability, and fairness.
  2. Human-machine interaction: This research area focuses on the development of technologies and methods that can enable humans and autonomous systems to work together effectively, and on understanding the social and cultural impacts of these technologies.
  3. Societal impacts of AI and autonomous systems: This research area focuses on the broader societal impacts of AI and autonomous systems, including their economic, political, and cultural effects.
  4. Humanities and society in the age of AI: This research area focuses on the ways in which AI and autonomous systems are transforming society and culture, and on the role that the humanities and social sciences can play in understanding and shaping these changes.

Resources:

Wikipedia:

See also:

Robotics Meta Guide

[PDF] Integration of live video in a system for natural language dialog with a robot [PDF] from liu.seE Sandewall, H Lindblom… – Proceedings of DIALOR, 2005 – informatix.ida.liu.se … We have built a software system, the WITAS Robotic Dialog Environment (RDE) that provides major parts of these services for the English-language dialog with an unmanned helicopter (UAV). More specif- ically, the system …  Cited by 4 – Related articles – View as HTML – All 13 versions

[PDF] The Use of Case-Based Reasoning in a Human-Robot Dialog System [PDF] from the-compost-system.orgK Eliasson – Licentiate of Engineering Thesis of Linköping …, 2006 – the-compost-system.org … The WITAS RDE is described in chapter 5. Chapter 6 states the research problem for phase II and chapter 7 describes CEDERIC and … A third issue is the adapta- tion to the ever changing dynamic environment. … A big issue in robotic dialog systems is how to integrate multimodal- …  Cited by 3 – Related articles – View as HTML – All 15 versions

Transferable multi-modal dialogue systems for interactive entertainment [PDF] from aaaipress.orgO Lemon – AAAI Spring Symposium on Artificial Intelligence in …, 2002 – aaai.org … Information states in a multi-modal dialogue system for human-robot conversation,” in 5th Workshop on Formal Semantics and Pragmatics of Dialogue (Bi-Dialog 2001), Peter … [5] Oliver Lemon, Anne Bracy, Alexander Gruenstein, and Stanley Peters, “The WITAS Multi-Modai …  Cited by 3 – Related articles – All 3 versions

[PDF] Towards a robotic dialogue system with learning and planning capabilities [PDF] from monash.edu.auK Eliasson – … Knowledge and Reasoning in Practical Dialogue …, 2005 – csse.monash.edu.au … [Sandewall et al, 2003] Erik Sandewall, Patrick Doherty, Oliver Lemon, and Stanley Peters. Words at the right time: Real-time dialogues with the witas unmanned aerial vehi- cle. … Integration of live video in a system for natural language dialog with a robot. …  Cited by 2 – Related articles – All 16 versions

An information state approach in a multi-modal dialogue system for human-robot conversation O Lemon, A Bracy, A Gruenstein… – … AND BEYOND NEW …, 2003 – books.google.com … A multi-modal dialogue sys- tem for human-robot conversation. … The WITAS Multi-Modal Dia- logue System I. In Proceedings of 7th European Conference on Speech Communication and Technology (EurospeecW 01), Aalborg. …  Cited by 5 – Related articles – BL Direct – All 2 versions

Case-based techniques used for dialogue understanding and planning in a human-robot dialogue system [PDF] from liu.seK Eliasson – Proc. of IJCAI07, 2007 – aaai.org … CEDERIC is also connected to the robotic control system of the actual helicopter or to a simulator that simulates the robot and the environment. … The first WITAS Dialogue System [Lemon et al., 2002] was a system for multi-threaded robot dialogue using spoken I/O. The …  Cited by 12 – Related articles – All 24 versions

A dialogue manager for multimodal human-robot interaction and learning of a humanoid robot H Holzapfel – Industrial Robot: An International Journal, 2008 – ingentaconnect.com … for the robot Pearl (Montemerlo et al., 2002), which uses a probabilistic approach to cope with recognition errors, or in the dialogue system WITAS for unmanned … The paper tries to motivate the need of and requirements for a dialogue component for robot control and …  Cited by 3 – Related articles – All 5 versions

[PDF] Multi-tasking in Practical Multi-modal Dialogue Systems-demonstration system [PDF] from upenn.eduO Lemon, A Gruenstein, A Battle, E Bratt… – acl.ldc.upenn.edu … The WITAS unmanned aerial vehicle project … Information states in a multi- modal dialogue system for human-robot conversa- tion … In Peter Kühnlein, Hans Reiser, and Henk Zee- vat, editors, 5th Workshop on Formal Semantics and Pragmatics of Dialogue (Bi-Dialog 2001), pages …  Related articles – View as HTML – All 8 versions

[PDF] A Smart Interaction Device for Multi-Modal Human-Robot Dialogue [PDF] from usc.eduG Taylor, R Frederiksen, J Crossman, J Voigt… – Ann Arbor – projects.ict.usc.edu … The WITAS multi-modal dialogue system 1. Paper presented at the Proc. … Semantics and Pragmatics of Questions and Answers for Dialogue Agents. … Figure 2: (a) A user gesturing while speaking to the robot; (b) the map of the task area (10m x13m) with labeled locations and …  Related articles – View as HTML

[CITATION] A Case-Based Approach to Natural Language Understanding K Eliasson – Journal of Artificial Intelligence Research, 2007 Related articles – All 2 versions

[CITATION] Multi-tasking in Practical Multi-modal Dialogue Systems O Lemon, A Gruenstein, A Battle… – Proceedings of the …, 2002 – Morgan Kaufmann Related articles

Targeted Help for Spoken Dialogue Systems: intelligent feedback improves naive users’ performance [PDF] from upenn.eduBA Hockey, O Lemon, E Campana, L Hiatt… – Proceedings of the …, 2003 – dl.acm.org … Interaction in WITAS thus involves joint-activities between an autonomous system and a human operator. … ing its coherence, is tracking the state of current or planned activities of the robot. … their twenties and none of the subjects had prior experience with spoken dialogue systems …  Cited by 22 – Related articles – All 36 versions

Words at the right time: Real-time dialogues with the witas unmanned aerial vehicle [PS] from the-compost-system.orgE Sandewall, P Doherty, O Lemon… – KI 2003: Advances in …, 2003 – Springer … was first written in order to provide an environment in which to test the WITAS dialogue system … capabilities of this simulator were also useful as a platform for a dialogue manager. … represent several kinds of actions in a uniform manner and using Cognitive Robotics Logic, namely …  Cited by 14 – Related articles – BL Direct – All 19 versions

Multi-tasking and collaborative activities in dialogue systems [PDF] from upenn.eduO Lemon, A Gruenstein, A Battle… – … on Discourse and dialogue …, 2002 – dl.acm.org … Figure 1: The WITAS dialogue system architecture … the progress of the dialogue itself … As well as this, the system must potentially be able to deal with a large band- width stream of communications from the robot, and so must be able to intelligently filter them for “relevance” so that …  Cited by 41 – Related articles – All 50 versions

Generation of collaborative spoken dialogue contributions in dynamic task environments [PDF] from aaaipress.orgO Lemon, A Gruenstein, R Gullett, A Battle… – … and Written Dialogue, 2003 – aaai.org … Bracy for her work on the Gemini grammar while at CSLI, Patrick Doherty of WITAS, and the … Information states in a multi-modal dialogue system for human-robot conversation. … Zeevat, H., eds., 5th Workshop on Formal Semantics and Pragmatics of Dialogue (Bi-Dialog 2001), 57 …  Cited by 9 – Related articles – All 10 versions

[PDF] Managing dialogue interaction: A multi-layered approach [PDF] from stanford.eduO Lemon, L Cavedon… – … on Discourse and Dialogue, 2003 – godel.stanford.edu … layer that is designed to handle interaction signals, analogously to agent/robot architectures that … This allows processing outside the full context of a dialogue history when required … This research was partially supported by the Wallen- berg Foundation’s WITAS project, Linköping …  Cited by 19 – Related articles – View as HTML – All 29 versions

Collaborative dialogue for controlling autonomous systems [PDF] from psu.eduO Lemon, A Gruenstein, L Cavedon… – proceedings of AAAI Fall …, 2002 – aaai.org … Note here that the user is able to make explicit queries about the robot’s activities (both current and future), that there are concurrent activities, and that conversational initiative centers around the joint activities currently being … 3See http://www.ida.liu.se/ext/witas … Dialogue Move …  Cited by 7 – Related articles – All 9 versions

A case-based approach to dialogue systems K Eliasson – Journal of Experimental & Theoretical Artificial …, 2010 – Taylor & Francis … references) was a system for multi-threaded robot dialogue using spoken I/O. The dialogue manager in … the user and displays route plans, waypoints and locations of vehicles including the robot has been … The WITAS RDE system (Sandewall, Doherty, Lemon and Peters 200333. …  Cited by 2 – Related articles – All 4 versions

[BOOK] A Representation Scheme for Description and Reconstruction of Object Configurations Based on Qualitative Relations [PDF] from diva-portal.orgHJ Steinhauer – 2008 – liu.diva-portal.org … The second system used in the WITAS Dialogue Technology Project is the Robotic Dialogue Environment (RDE), which is an environment providing the possibility for a natural language dialogue in restricted English, both spoken and written. …  Cited by 1 – Related articles – View as HTML – Library Search – All 9 versions

[PDF] Collaborative Activities and Multi-tasking in Dialogue Systems [PDF] from alexgruenstein.comOLAGS Peters – alexgruenstein.com … Figure 1. A demonstration of the WITAS dialogue system (November 2001) … a wrapper to SRI’s Gemini parser and generator using a grammar for human-robot conversation developed … 4) GUI : an interactive map display of the current operating environment which displays route …  Related articles – View as HTML – All 8 versions

Conceptual spatial representations for indoor mobile robots [PDF] from uni-freiburg.deH Zender, O Martínez Mozos, P Jensfelt… – Robotics and …, 2008 – Elsevier … Examples of robots with more elaborate dialogue capabilities are RoboVie [17], BIRON [18], Godot [19], WITAS [20] and Mel [21]. BIRON is endowed with a system that integrates spoken dialogue and visual localization capabilities on a robotic platform. …  Cited by 55 – Related articles – All 17 versions

[PDF] Biron-the bielefeld robot companion [PDF] from techfak.orgA Haasch, S Hohenner, S Hüwel… – … in Service Robotics, 2004 – techfak.org … [11] O. Lemon, A. Bracy, A. Gruenstein, and S. Peters. The WITAS multi-modal dialogue system I. In Proc. European Conf. … [12] Y. Matsusaka, T. Tojo, and T. Kobayashi. Conversa- tion robot participating in group conversation. IEICE Trans. …  Cited by 91 – Related articles – View as HTML – All 14 versions

An introduction to the anchoring problem [PDF] from oru.seS Coradeschi… – Robotics and Autonomous Systems, 2003 – Elsevier … anchor (shown by double lines) is used by the Follow behavior to control the movement of the robot along the … The domain is an unmanned aerial vehicle (UAV) performing autonomous surveillance tasks in a simulated environment developed within the WITAS project [8 …  Cited by 181 – Related articles – All 27 versions

[PDF] Witas: An intelligent autonomous aircraft using active vision [PDF] from psu.eduG Granlund, K Nordberg, J Wiklund… – Proceedings of the UAV …, 2000 – Citeseer … system software architectures, integration and development of active vision systems and dialogue systems, and … Figure 1: Structure of WITAS control system with vision functions emphasized … in the presence of obstacles (with many similarities to conventional robotic path planning …  Cited by 7 – Related articles – View as HTML – All 15 versions

[PDF] Mixed initiative interaction and robotic systems [PDF] from psu.eduJA Adams, P Rani… – Papers from the 2004 AAAI Workshop on …, 2004 – Citeseer … Lemon, O., Bracy, A., Gruenstein, A., & Peters, S. 2001. The WITAS Multi-Modal Dialogue System I. Proc. … University of South Florida, Center for Robot Assisted Search and Rescue Technical Report, CRASAR-TR2000-11. Öhman, A., Hamm, A., & Hugdahl, K. 2000. …  Cited by 12 – Related articles – View as HTML – All 5 versions

[PDF] Using dialogue context to improve parsing performance in dialogue systems [PDF] from unam.mxI Meza-Ruiz, O Lemon – International Workshop on …, 2005 – turing.iimas.unam.mx … that allows a human operator to interact with a simulated “unmanned aerial vehicle”: a small robotic helicopter. Relevant to this section is the fact that the version of the WITAS system uses the Multi-threaded dialogue manager presented in Lemon et al. …  Cited by 5 – Related articles – View as HTML – All 2 versions

[PDF] Multilevel architectures for natural-activity-oriented dialogues [PDF] from cam.ac.ukO Lemon, L Cavedon – … of EACL 2003 workshop on Dialogue …, 2003 – cl.cam.ac.uk … tion and utterance content planning, analogously to the multi-level architectures used in robotics. 67 … low-level processes, cur- rently implemented in a full working dialogue sys- tem … This research was partially supported by the Wal- lenberg Foundation’s WITAS project, Linköping …  Cited by 3 – Related articles

[PDF] Approximate databases and query techniques for agents with heterogenous perceptual capabilities [PDF] from psu.eduP Doherty, W Lukaszewicz… – Proceedings of the 7th Int. Conf. on …, 2004 – Citeseer … A query mechanism which permits each robotics agent to … values, as in the measurement of the pres- ence or absence of an object such as a red car; integer … An environment E can be viewed as an abstract entity containing a collection of physical at- tributes that are measurable …  Cited by 10 – Related articles – View as HTML – All 7 versions

[PDF] ALEXANDER GRUENSTEIN [PDF] from ed.ac.ukO LEMON – homepages.inf.ed.ac.uk … Section 6 presents an instance of the C onversational I ntelligence Architecture for robot control dia- logues, and the architecture of the dialogue system components (speech recognizer, G U I , and so on) currently in use at E dinburgh U niversity (School of I nformatics) …  Related articles – View as HTML

[PDF] Approximate databases: a support tool for approximate reasoning [PDF] from martinmagnusson.comP Doherty, M Magnusson… – JOURNAL OF APPLIED …, 2006 – martinmagnusson.com … The WITAS UAV Project ended officially in 2004. … In many realistic application domains, such as robotics, the assumption of com- plete information is not feasible. … The embedding environment is simply too dynamic and information about it too sparse. …  Cited by 8 – Related articles – View as HTML – BL Direct – All 7 versions

Tolerance spaces and approximative representational structures P Doherty, W Lukaszewicz… – KI 2003: Advances in Artificial …, 2003 – Springer … This is unfortunate because ? Supported in part by the WITAS project grant under the Wallenberg … 477 being applied to real-world applications in both the cognitive robotics and soft- ware agents … An environment E can be viewed as an abstract entity containing a collection of …  Cited by 32 – Related articles – BL Direct – All 7 versions

Multimodal Interface Technologies for UAV Ground Control Stations [PDF] from us.esI Maza, F Caballero, R Molina, N Peña… – … of intelligent & robotic …, 2010 – Springer … of a GCS, two information flows are usually considered: from GCS to operator, presenting information about the UAV, the environment and the … 374 J Intell Robot Syst (2010) 57:371-391 … An example of these applications in the UAVs context can be found in the WITAS project [21 …  Cited by 1 – Related articles – All 7 versions

[PDF] D3. 1: Extended Information State Modeling [PDF] from eurice.infoI Kruijff-Korbayová, G Amores, N Blaylock… – 2006 – eurice.info … In the case of WITAS the device was a semi-autonomous mobile robot helicopter which could … systems developed so far mostly used only verbal communication (apart from the WITAS system … examples 1 and 2 present dialogue excerpts from a typical interaction with the SAMMIE …  Cited by 5 – Related articles – All 11 versions

Communication between agents with heterogeneous perceptual capabilities [PDF] from mimuw.edu.plP Doherty, W Lukaszewicz… – Information Fusion, 2007 – Elsevier … To add to the difficulty, sensors, by their very nature, introduce uncertainty and noise in the data. In order to provide an adequate representation of a robotic environment, some of this uncertainty, or lack of knowledge, should be reflected in the higher-level knowledge structures. …  Cited by 14 – Related articles – All 5 versions

[PDF] D2. 1: Integration of ontological knowledge with the ISU approach [PDF] from eurice.infoM Gabsdil, S Larsson, O Lemon, P Manchon… – 2005 – eurice.info … D:2.1 5th September 2005 Page 3/89 Chapter 2: Flexible Dialogue The ontology-based approach concentrates on abstracting out domain and task knowledge. The ISU ap- proach concentrates on abstracting out the dialogue state. … Chapter 2 Flexible Dialogue 2.1 Introduction …  Related articles – All 10 versions

Rough sets in perception-based computing [PDF] from mimuw.edu.plA Skowron – Pattern Recognition and Machine Intelligence, 2005 – Springer … Our second example concerns human computer-interfaces that allow for a dialog with experts to transfer to the system their … unrehearsed terrain: Red team tech- nology for Grand Challenge 2004″, Report CMU-RI-TR-04-37, The Robotics In- stitute … WITAS: www.ida.liu.se/ext/witas …  Cited by 19 – Related articles – BL Direct – All 5 versions

[PDF] Aerial Visual Object Tracking and Geolocalisation System Transfer Report PRS to D. Phil. [PDF] from heikohelble.comS Cameron… – 2005 – heikohelble.com … tion, D/GPS navigation, augmented navigation), and mission planning (trajec- tory planning, simulation environment, user interface). … 2005. Their project is named Microprocessor Controlled Aerial Robotics Team … the WITAS UAV Project (1997-2004) [DGK+00, FN02, NDF+02]. …  Related articles – View as HTML – All 2 versions

[PDF] The PLANET Roadmap on AI Planning and Scheduling [PDF] from psu.eduR Aylett, S Biundo, M Ghallab, S de Givry… – 2001 – Citeseer … Surveillance and monitoring of the traffic network • Exploration robots, environment monitoring … of Genoa • MAKRO a robot for sewage maintenance operations at GMD • WITAS, a traffic surveillance aerial robot at the Univ. of Linköping 6 The ROADMAP Page 17. …  Cited by 1 – Related articles – View as HTML – All 7 versions

[PDF] Refactoring der Systemarchitektur eines mobilen Roboters für die multi-modale Mensch-Roboter Interaktion [PDF] from uni-bielefeld.deF Siepmann – 2008 – aiweb.techfak.uni-bielefeld.de … 69 A.1.2 Dialog . . . . . … Im Gegensatz zu CORBA stellt MARIE (Mobile and Autonomous Robotics Integration Environment) nicht nur Infrastruktur für Kommunikation zur Verfügung, sondern auch komplette Softwareblöcke zB zur Ansteuerung von Hardware. …  Cited by 1 – Related articles – View as HTML – All 2 versions

[PDF] Grand Challenges in the Evolution of the Information Society [PDF] from dfki.deW Wahlster – 2004 – dfki.de … 3. The Service Robot Companion: As the European population ages, spiralling health … intelligent and highly adaptive networks will augment the physical environment with new … speaker, gender and language recognition, language and text understanding, dialog handling, audio …  Cited by 3 – Related articles – View as HTML – All 7 versions

[PDF] Domain knowledge and multimodal grounding [PDF] from psu.eduM Cavazza, C Brewster, D Charlton… – 2007 – Citeseer … Recipes in WITAS are characterised as “domain dependent common sense knowledge” but what is … 13 phisticated than in “pure” dialogue systems or in traditional task-oriented dialogue systems. … It has been embodied in a domestic mobile robot, Pearl, developed by Car- negie …  Cited by 2 – Related articles – View as HTML – All 6 versions

[PDF] The Intermediary Agent’s Brain: Supporting Learning to Collaborate at the Inter-Personal Level (Short Paper) [PDF] from psu.eduJ Martínez-Miranda, B Jung, S Payr… – 2008 – Citeseer … The Autominder system [12] [14] is an autonomous mobile robot that can ‘live’ in the home … Several dialogue systems have used plans as underlying knowledge models, in particular for the … plans have been described, for instance, in TRIPS’ “straw plans” [6] or WITAS’ “recipes” [9 …  Related articles – View as HTML – All 8 versions

[BOOK] Desarrollo de sistemas de diálogo oral adaptativos y portables: Reconocimiento de emociones, adaptación al idioma y evaluación de campo [PDF] from ucv.roZC Carrión – 2008 – inf.ucv.ro Page 1. Desarrollo de Sistemas de Diálogo Oral Adaptativos y Portables: Reconocimiento de Emociones, Adaptación al Idioma y Evaluación de Campo Zoraida Callejas Carrión Departamento de Lenguajes y Sistemas Informáticos Universidad de Granada Page 2. Page 3. …  Cited by 1 – Related articles – Library Search – All 14 versions

[PDF] Approximate reasoning in distributed environments [PDF] from mimuw.edu.plA Skowron – Intelligent Technologies for Information Analysis, …, 2004 – logic.mimuw.edu.pl … For example, in case of web mining (see Figure 1.3) one is interested to extract documents relevant for the user query or dialog with the … new granules {(ß, Rule Set (DTß )) : ß is an extension of a and ß ? G} important for decision making in dynamically changing environment. …  Cited by 20 – Related articles – View as HTML – All 4 versions

[PDF] Information granules and rough neurcomputing [PDF] from mimuw.edu.plA Skowron… – Rough Neurocomputing: Techniques …, 2003 – logic.mimuw.edu.pl Page 1. Chapter 3 Information Granules and Rough-Neurocomputing Andrzej Skowron1 and Jaroslaw Stepaniuk2 1 Institute of Mathematics, Warsaw University, Banacha 2, 02-097 Warsaw, Poland skowron@mimuw.edu.pl …  Cited by 64 – Related articles – View as HTML