Notes:
Dialog systems are often used in mixed reality (MR) applications to enable users to interact with virtual objects and environments using natural language. In MR, dialog systems can be integrated with MR headsets, controllers, and other input devices, allowing users to speak commands and queries to the system, and to receive spoken responses and feedback.
One way that dialog systems are used in MR is to enable users to manipulate virtual objects and environments. For example, a user might use a MR headset and a microphone to speak commands to the dialog system, such as “Move the chair to the left,” or “Turn on the light.” The dialog system would then interpret the user’s commands, and use them to control the virtual objects and environment in the MR experience. This can allow users to interact with the MR environment in a more natural and intuitive way, using their voice instead of a keyboard or controller.
Another way that dialog systems are used in MR is to provide users with information and assistance. For example, a user might ask the dialog system questions about the MR environment, such as “What is this object?”, or “How do I open this door?” The dialog system would then use natural language processing (NLP) and other techniques to interpret the user’s questions, and to generate appropriate responses. This can help users to understand and navigate the MR environment more easily, and to access the information and assistance they need.
- Conversational informatics is the study of how people communicate and exchange information through conversation and other forms of dialogue. It is a interdisciplinary field that encompasses a wide range of approaches and techniques, including natural language processing, machine learning, psychology, sociology, and anthropology.
Resources:
- george.papagiannakis.org .. computer scientist specialized in computer graphics and virtual-augmented reality
- vhdplus.sourceforge.net .. a modern, fully component oriented simulation engine and software middleware
Wikipedia:
References:
- Virtual humans in cultural heritage ICT applications: A review (2018)
- Design Recommendations for Intelligent Tutoring Systems: Authoring Tools and Expert Modeling Techniques (2015)
- Conversational Informatics: A Data-Intensive Approach with Emphasis on Nonverbal Communication (2014)
- Dynamic aspects of character rendering in the context of multimodal dialog systems (2011)
- Rapid reconstruction and simulation of real characters in Mixed Reality environments (2011)
See also:
100 Best Augmented Reality Mixed Reality Videos | Mixed Reality News
Observing, coaching and reflecting: a multi-modal natural language-based dialogue system in a learning context
JVAN HELVERT, PV Rosmalen, D Börner… – … Proceedings of the …, 2015 – books.google.com
… Natural conversational interaction, mixed-reality, multi-modal dialogue systems, immersive, debate skills, learning analytics, reflection 1. Introduction As we move towards a world of smart and immersive environments we are seeking new ways of interfacing and engaging with …
Interaction and humans in internet of things
M Turunen, D Sonntag, KP Engelbrecht… – Human-Computer …, 2015 – Springer
… He has worked in natural language processing, multimodal interface design, dialogue systems, and knowledge representation for over … He is particularly interested in practical methods for Augmented Cognition and Mixed Reality, Compensating Cognitive Impairments, (Medical …
Conversational in-vehicle dialog systems: The past, present, and future
F Weng, P Angkititrakul, EE Shriberg… – IEEE Signal …, 2016 – ieeexplore.ieee.org
… Before the realization of a full automation, in-vehicle dialog systems may reduce the driver distraction from many services available through connectivity … Conversational In-Vehicle Dialog Systems The past, present, and future SKY IMA GE LICENSED B Y GRAPHIC S TOCK …
Kognit: Intelligent cognitive enhancement technology by cognitive models and mixed reality for dementia patients
D Sonntag – AAAI Fall Symposium Series, 2015 – aaai.org
… The storyboard’s main purpose is, first, to provide guid- ance while implementing augmented and mixed reality ap- plications, and integrating a companion robot’s multimodal dialogue system. Second, to provide ideas for overall …
Exploring the implications of virtual human research for human-robot teams
J Gratch, S Hill, LP Morency, D Pynadath… – … and Mixed Reality, 2015 – Springer
… VAMR 2015: Virtual, Augmented and Mixed Reality pp 186-196 | Cite as. Exploring the Implications of Virtual Human Research for Human-Robot Teams … Sagae, K., et al.: Towards natural language understanding of partial speech recognition results in dialogue systems …
When Less is More: Studying the Role of Functional Fidelity in a Low Fidelity Mixed-Reality Tank Simulator
C Neubauer, P Khooshabeh, J Campbell – International Conference on …, 2017 – Springer
… The research reported here is supported by the Mixed-Reality lab at the University of Southern California’s Institute for Creative Technologies … 1. Robinson, SM, Roque, A., Vaswani, A., Traum, D.: Evaluation of a spoken dialogue system for virtual reality call for fire training …
Designing a learning analytics application to improve learner success in interactions based on multimodal dialogue systems
EF Olivares, P Albert, J van Helvert… – … Conference on Immersive …, 2016 – Springer
… Anasol, C., Rios, P.: Exploring Mixed Reality in Distributed Collaborative Learning Environments, Ph.D. thesis, University of Essex, p. 71 (2016)Google Scholar. 22 … Herzog, G., Reithinger, N.: The SmartKom architecture: a framework for multimodal dialogue systems …
Like having a really bad PA: the gulf between user expectation and experience of conversational agents
E Luger, A Sellen – Proceedings of the 2016 CHI Conference on Human …, 2016 – dl.acm.org
… Similar developments have been seen within a range of spheres such as gaming [19], mixed reality environments [14], tourism [29], train … work in this field, focus upon a single modality has faded and subsequently the majority of HCI work around dialogue systems is somewhat …
User interaction for interactive storytelling
M Cavazza, F Charles – Handbook of Digital Games and Entertainment …, 2017 – Springer
… 231–235 (2003) M. Cavazza, F. Charles, S. Mead, Multi-modal acting in mixed reality interactive storytelling … tutorial and research workshop on Perception and Interactive Technologies for Speech-Based Systems: Perception in Multimodal Dialogue Systems, Springer-Verlag …
A Comparison of Visualisation Methods for Disambiguating Verbal Requests in Human-Robot Interaction
E Sibirtseva, D Kontogiorgos, O Nykvist… – arXiv preprint arXiv …, 2018 – arxiv.org
… In a controlled exper- iment with a YuMi robot, we investigated real-time augmentations of the workspace in three conditions – mixed reality, augmented re- ality, and a monitor as the baseline – using objective measures such as time and accuracy, and subjective measures like …
Shihbot: A facebook chatbot for sexual health information on hiv/aids
J Brixey, R Hoegen, W Lan, J Rusow, K Singla… – Proceedings of the 18th …, 2017 – aclweb.org
… Evaluation will include metrics for satisfying social work goals as well as dialogue system goals. 2 Motivation … 2009. At the virtual frontier: Introducing Gunslinger, a multi-character, mixed-reality, story-driven experi- ence. In International Workshop on Intelligent Vir- tual Agents …
Dialogue enabling speech-to-text user assistive agent system for hearing-impaired person
S Lee, S Kang, DK Han, H Ko – Medical & biological engineering & …, 2016 – Springer
… hearing-impaired. The future work is to improve on the intelligent assistive agent by combining automatic context awareness method to establish the active location-based dialogue system. Notes. Acknowledgments. This research …
Intelligent Support for Surgeons in the Operating Room
R Malaka, F Dylla, C Freksa, T Barkowsky… – Anticipation and …, 2017 – Springer
… Despite the fact that research in Medical Image Computing and Computer Assisted Interventions is a well-established topic, there has been little focus on the integration of mixed reality technologies, novel interaction paradigms … Modeling output in a multimodal dialogue system …
Developing Virtual Patients with VR/AR for a natural user interface in medical teaching
MA Zielke, D Zakhidov, G Hardee… – Serious Games and …, 2017 – ieeexplore.ieee.org
… Mixed Reality is a term used to describe the varying types of devices that fall along this continuum [28] … It is also possible to simulate an AR-like mixed reality experience inside a VR headset by feeding a live recording of the user’s surroundings via head mounted cameras [30] …
SiAM-dp: an open development platform for massively multimodal dialogue systems in cyber-physical environments.
R Neßelrath – 2016 – d-nb.info
Page 1. SiAM-dp: An open development platform for massively multimodal dialogue systems in cyber-physical environments Robert Neßelrath … 21 2.2.5 Presentation Planning and Multimodal Fission . . . . . 24 2.3 Dialogue Systems …
A preliminary study of a hybrid user interface for augmented reality applications
F Manuri, G Piumatti – Intelligent Technologies for Interactive …, 2015 – ieeexplore.ieee.org
… workshop on Development and Evaluation of Robust Spoken Dialogue Systems for Real Applications, Riva del Garda, Italy, 2006 [19] JY Lee, GW Rhee and DW Seo, Hand gesture-based tangible in- teractions for manipulating virtual objects in a mixed reality environment, The …
Persuasive AI Technologies for Healthcare Systems
D Sonntag – AAAI Fall Symposium Series, 2016 – aaai.org
… Neßelrath, R. 2016. SiAM-dp: an open development plat- form for massively multimodal dialogue systems in cyber- physical environments … Sonntag, D. 2015. Kognit: Intelligent cognitive enhance- ment technology by cognitive models and mixed reality for dementia patients …
Multimodal Visualization Using Augmented Reality and Large Displays
E Butler – 2017 – search.proquest.com
… virtual, augmented, or mixed reality. Microsoft announced its arrival to the scene in 2015 with the Windows Mixed Reality platform, along with a MR headset named the HoloLens … put and output devices: a speech-based dialogue system, a head-mounted augmented …
Curriculum Vitae: Markku Turunen
M Turunen – 2018 – sis.uta.fi
… “MIRACLE – Mixed Reality Applications for Culture and Learning Experiences” (Tekes, 2015 – 2017)* 15. “Cloud-based editor for interactive 360-videos” (Industry, 2016)* 16 … of Tampere. (*) 9. “Dialogue System Architectures”, 2008. Charles University (*) 10 …
Virtual reality standardized patients for clinical training
A Rizzo, T Talbot – The Digital Patient: Advancing Healthcare …, 2015 – books.google.com
… to provide future social workers with the opportunity to practice motivational interviewing (MI) skills in a mixed?reality setting with a VSP … As the single student progresses through the scenario, a branching dialog system can lead to various successful and unsuccessful outcomes …
Seamless and Contextualised Learning
D Börner, R Klemke, A Antonaci – 2015 – dspace.ou.nl
… real-world tasks AR is considered by Milgram and Kishino as a portion of the overall subject area of mixed reality, represented as a continuum —> because the elements which compose both AR and VR are the same but mixed in a different way; on the left the real environment …
Immersive Learning Research Network: Second International Conference, iLRN 2016 Santa Barbara, CA, USA, June 27–July 1, 2016 Proceedings
C Allison, L Morgado, J Pirker, D Beck, J Richter, C Gütl – 2016 – books.google.com
… review features of a learning analytics tool that is part of an e-learning multimodal dialogue system, which, in turn, is part … 3 Christian Gütl, Lisa Maria Tomes, Johanna Pirker, and Vanessa Chang Strategies to Design a Mixed-Reality Immersive Environment and Influence Teen …
The EASEL project: towards educational human-robot symbiotic interaction
D Reidsma, V Charisi, D Davison, F Wijnen… – … on Biomimetic and …, 2016 – Springer
… The EASEL Scope offers a mixed reality interface that allows the student to interact with the learning scenario materials … ISBN 978-1-4673-0366-8Google Scholar. ter Maat, M., Heylen, D.: Flipper: An Information State Component for Spoken Dialogue Systems …
The devices and interfaces for elderly healthcare
YM Fang, C Lin, SY Huang – Applied System Innovation (ICASI) …, 2017 – ieeexplore.ieee.org
… (a) (b) Fig. 5 Apple Watch. (a) Sports and health interface. (b) Dialog system. Page 3 … The development of science and technology has divided the presentation of information of virtual interactive devices into three types, namely, virtual reality, augmented reality, and mixed reality …
Multimodal adaptive social interaction in virtual environment (MASI-VR) for children with Autism spectrum disorders (ASD)
E Bekele, J Wade, D Bian, J Fan… – Virtual Reality (VR) …, 2016 – ieeexplore.ieee.org
… in Fig. 6. Fig. 6. The spoken conversation and the emotion recognition The VR-based facial emotional recognition in the presence of conversational dialog system presented a total of 12 conversational dialog missions. At the …
A multimodal adaptive session manager for physical rehabilitation exercising
K Tsiakas, M Huber, F Makedon – Proceedings of the 8th ACM …, 2015 – dl.acm.org
… IEEE. [16] Duff, M., Chen, Y., Attygalle, S., Herman, J., Sundaram, H., Qian, G.,& Rikakis, T. (2010). An adaptive mixed reality training system for stroke rehabilitation … A Dialogue System for Ensuring Safe Rehabilitation. In Universal Access in Human- Computer Interaction …
Monitoring physiology and behavior using Android in phobias
T Cruz, S Brás, SC Soares… – Engineering in Medicine …, 2015 – ieeexplore.ieee.org
… Using augmented reality (AR) through the device’s screen allows the user to get a mixed reality presentation of the surrounding environment while … N. Kang, D. de Vliegher, IL Kampmann, N. Morina, PGM Emmelkamp, and M. Neerincx, “A virtual reality dialogue system for the …
Communication system and team situation awareness in a multiplayer real-time learning environment: application to a virtual operating room
CP Lelardeux, D Panzoli, V Lubrano, V Minville… – The Visual …, 2017 – Springer
… Despite all technological advances, models and technology involved in spoken dialogue system, speech and recognition technology and artificial intelligence … Therefore, as indicated in the figure, the most straightforward way to view a mixed reality learning environment is one …
Multimodality Evaluation Metrics for Human-Robot Interaction Needed: A Case Study in Immersive Telerobotics
I Aaltonen, S Aromaa, K Helin… – … Conference on Applied …, 2017 – Springer
… Although PROMISE was developed for multimodal dialogue systems, some of the measures are applicable to HRI, such as user/system turns and semantics … 1. Left: Robot system. Right: User with HMD and data glove in a mixed reality laboratory. The hand posture is IDLE …
Intelligent User Interfaces-A Tutorial
D Sonntag – arXiv preprint arXiv:1702.05250, 2017 – arxiv.org
… interpreting multimodal input in real-time and providing mixed reality visualisations in real-time. In addition, the Intelligent User Interfaces department at DFKI develops the basics for multi-modal human-computer interaction and personalised dialogue systems integrating speech …
Interactive storytelling in mixed reality
M Nakevska – 2015 – pure.tue.nl
Page 1. Interactive storytelling in mixed reality Nakevska, M. Published: 01/01/2015 Document Version Publisher’s PDF, also known as Version of Record (includes final page, issue and volume numbers) … Page 7. Page 8. Interactive Storytelling in Mixed Reality Summary …
Immersive Learning Research Network
C Allison, L Morgado, J Pirker, D Beck, J Richter, C Gütl – 2016 – Springer
… review features of a learning analytics tool that is part of an e-learning multimodal dialogue system, which, in turn, is part … 3 Christian Gütl, Lisa Maria Tomes, Johanna Pirker, and Vanessa Chang Strategies to Design a Mixed-Reality Immersive Environment and Influence Teen …
Multimodal interaction with virtual worlds XMMVR: eXtensible language for MultiModal interaction with virtual reality worlds
H Olmedo, D Escudero, V Cardeñoso – Journal on Multimodal User …, 2015 – Springer
… Keywords. Spoken interaction Graphical interaction Human–computer interaction Multimodality Dialogue systems Avatar Virtual environments 3D virtual reality Rich internet applications Behavior. Download fulltext PDF. 1 Motivation and strategy …
A Framework to Support Multiple Levels of Interaction.
D Di Mauro – DC@ CHItaly, 2015 – pdfs.semanticscholar.org
… Could we create a mixed reality in which the perceived world is extended and fused with a virtual and interactive one, as more naturally and … work, a large part of the work will be de- voted to an high-level interaction, based on gestures, augmented reality, dialog systems and 3D …
Breathe Deep: A Breath-Sensitive Interactive Meditation Coach
A Shamekhi, T Bickmore – 2018 – relationalagents.com
… skin conductivity in a VR environment has been shown to be useful for pain manage- ment [18], and Roo showed the effectiveness of a mixed-reality environment that … The agent dialog system allows users to signal that they are ready to continue by simply taking a deep breath …
Entertainment Computing–ICEC 2017: 16th IFIP TC 14 International Conference, Tsukuba City, Japan, September 18-21, 2017, Proceedings
N Munekata, I Kunita, J Hoshino – 2017 – books.google.com
… 392 Letizia Jaccheri Lifestyle Agent: The Chat-Oriented Dialogue System for Lifestyle Management … Exploring Strategies for the Design of Persuasive Virtual, Augmented and Mixed Reality Games …
The Rise of Emotion-aware Conversational Agents: Threats in Digital Emotions
M Mensio, G Rizzo, M Morisio – … of the The Web Conference 2018 …, 2018 – researchgate.net
… 2 Replika3 is another example, which became very popular re- cently because of the open-source release of its dialog system4 that … body language [2], or being able to analyze the facial expressions [16], is actually an active field of research for Virtual/Mixed Reality technologies …
Emotion-Based 3D CG Character Behaviors
K Kaneko, Y Okada – Encyclopedia of Computer Graphics and Games, 2017 – Springer
… The model was applied to their pro- totype application which has a dialogue system and a talking head with synchronized speech and facial … Augmented Reality (AR) and Mixed Reality (MR) can be available in another field for the intelligent agents to play an active role …
Adding physical objects to an interactive game improves learning and enjoyment: Evidence from earthshake
N Yannier, SE Hudson, ES Wiese… – ACM Transactions on …, 2016 – dl.acm.org
… By combining the advantages of the physical environment and computer technologies, tangible in- terfaces [Ullmer and Ishii 2000] and mixed-reality environments [Rogers et al … 1.1.2. Mixed-Reality Environments and Tangible Interfaces for Learning …
Future modes: How ‘new’new media transforms communicative meaning and negotiates relationships
A Ensslin – The Routledge handbook of language and media, 2017 – researchgate.net
… in real time (such as the touch of a finger via a ‘tele-hug ring’ called ‘Ring U’; Mixed Reality Lab 2015) … and Li, Ya (2015) ‘Expressivity in interactive speech synthesis; Some paralinguistic and nonlinguistic issues of speech prosody for conversational dialogue systems’, in Keikichi …
Input Forager: a user-driven interaction adaptation approach for head worn displays
M Al-Sada, F Ishizawa, J Tsurukawa… – Proceedings of the 15th …, 2016 – dl.acm.org
… 2005. Immersive Mixed-Reality Configuration of Hybrid User Interfaces … 127-136). ACM. 20. B¨uhler, D., Minker, W., H¨aussler, J., and Kr¨uger, S. The SmartKom Mobile Multi-Modal Dialogue System. In Proceedings of ITRW 2002 (Irsee, Germany, June 2002). 21 …
Semantic mapping for mobile robotics tasks: A survey
I Kostavelis, A Gasteratos – Robotics and Autonomous Systems, 2015 – Elsevier
Skip to main content …
Epilog
T Nishida – Human-Harmonized Information Technology, Volume 2, 2017 – Springer
… User Generated Dialogue Systems: uDialogue (PI: Keiichi Tokuda) … The first exhibition, by Naemura and his colleagues, entitled “The Studio—Extend Your Real World—” 6 demonstrated display design in a mixed-reality environment, mounted for 164 days from July 3, 2013, to …
Constructing Virtual Role-Play Simulations
WL Johnson – … for Adaptive Intelligent Tutoring Systems: Authoring …, 2015 – researchgate.net
… tool to create the first character, Hassan, after which two subject matter experts without previous experience building dialogue systems used the … so that it can run on personal computers and mobile devices, in web browsers, immersive games, mixed-reality environments, and …
I Probe, Therefore I Am: Designing a Virtual Journalist with Human Emotions
KK Bowden, T Nilsson, CP Spencer, K Cengiz… – arXiv preprint arXiv …, 2017 – arxiv.org
… KK Bowden is with the Natural Language and Dialog Systems Lab, University of California, Santa Cruz, USA. Email: kkbowden@ucsc.edu. T. Nilsson is with The Mixed Reality Laboratory, University of Nottingham, UK, and The National Institute of Mental Health, Klecany, Czech …
Applications of Virtual Reality
TA Garner – Echoes of Other Worlds: Sound In Virtual Reality, 2018 – Springer
… Mixed reality applications such as these can provide most of the enhanced functionality of VR in terms of interactivity and three … this, defining an auditory display as a much broader concept that encompasses sonification but also can include dialogue systems and speech …
Conversational informatics: Toward cultivating wisdom from conversational interaction
T Nishida – Procedia Computer Science, 2015 – Elsevier
… The most successful case was HEARSAYYII speech dialogue system.24 In the second approaches,29 scripts and marNYup languages were … Smart conversation space is a shared interaction environment, created by mixed reality ranging from virtual reality to augmented reality …
Improvised theatre alongside artificial intelligences
KW Mathewson, P Mirowski – Association For The …, 2017 – pdfs.semanticscholar.org
… Additional evaluation metrics must be devised to score these open-domain dialog systems (Liu et al … With the growing popularity of interactive mixed-reality experiences, as well as recent advances in natural language processing, speech, and music generation, there are exciting …
Social influence of humor in virtual human counselor’s self?disclosure
SH Kang, DM Krum, P Khooshabeh… – … and Virtual Worlds, 2017 – Wiley Online Library
… The current study is part of ongoing research investigat- ing virtual humans in counseling interviews and the first step to explore a virtual human’s jokes in the interviews. Future studies would use conversational spontaneous jokes with a machine dialog system …
VR-OOM: Virtual Reality On-rOad driving siMulation
D Goedicke, J Li, V Evers, W Ju – … of the 2018 CHI Conference on Human …, 2018 – dl.acm.org
Page 1. VR-OOM: Virtual Reality On-rOad driving siMulation David Goedicke1,2,3, Jamy Li1, Vanessa Evers1, Wendy Ju2, 3 1University of Twente, The Netherlands 2Stanford University, USA 3Cornell Tech, USA dg536@cornell …
Identification and distance estimation of users and objects by means of electronic beacons in social robotics
F Alonso-Martín, A Castro-González, M Malfaz… – Expert Systems with …, 2017 – Elsevier
… In order to show the advantages of the system during human-robot interaction, first, we present the integration of the information provided by these devices in the robot’s dialog system; and after, a hidden toy hunt game is described as a case study of a scenario where electronic …
Robots That Can Mix Serious with Fun
IA Hameed, G Strazdins, HAM Hatlemark… – … on Advanced Machine …, 2018 – Springer
… If the robot can detect the person, it returns its name and other information to be used in the dialogue system so the user profile can … C.-W., Lee, J.-H., Wang, C.-Y., Chen, G.-D.: Improving the authentic learning experience by integrating robots into the mixed-reality environment …
SWRL 130 tacit knowledge 298 Takagi-Sugeno 96 task 244 teacher professional development 197
O SoundS – op Pro ernatio ent En, 2015 – books.google.com
… classroom Markov decision processes mathematics medical education message organization message sharing mixed reality 220, mobile devices mobile environments mobile learning 150, MOOC multi-agent systems multi-modal dialogue systems multitasking multiuser virtual …
Using augmented reality to elicit pretend play for children with autism
Z Bai, A Blackwell, G Coulouris – IEEE Transactions on …, 2015 – ieeexplore.ieee.org
Page 1. 1077-2626 (c) 2013 IEEE. Personal use is permitted, but republication/ redistribution requires IEEE permission. See http://www.ieee.org/ publications_standards/publications/rights/index.html for more information. This …
I remember you!: Interaction with memory for an empathic virtual robotic tutor
H Hastie, MY Lim, S Janarthanam… – Proceedings of the …, 2016 – dl.acm.org
… H. Hastie, A. Deshmukh, and R. Aylett, “Towards a serious game playing empathic robotic tutorial dialogue system,” in Proceedings … Malek, and B. Kreczmer, “Companion migration- initial participants’ feedback from a video-based prototyping study,” in Mixed Reality and Human …
Entertainment, Culture, and Media Art 30
R Nakatsu, N Tosa, M Rauterberg, W Xuan – Handbook of Digital Games …, 2017 – Springer
… Another representative example is the project ALICE, which is an interactive installation that enables users to be immersed in a mixed reality environment featuring the … Microphones recorded the utterances of the visitor, and a simple dialogue system manages the conversation …
Entertainment, culture, and media art
R Nakatsu, N Tosa, M Rauterberg, W Xuan – 2015 – Springer
… Another representative example is the project ALICE, which is an interactive installation that enables users to be immersed in a mixed reality environment featuring the story of the book Alice in Wonderland by Lewis Carroll …
Culture-specific models of negotiation for virtual characters: multi-attribute decision-making based on culture-specific values
E Nouri, K Georgila, D Traum – AI & society, 2017 – Springer
… reinforcement learning (IRL). We apply this model to the Ultimatum Game and integrate it into a virtual human dialog system. We show … et al. 2008), which facilitates rapid development of virtual human dialog systems. The authoring environment …
WoZ Way: Enabling real-time remote interaction prototyping & observation in on-road vehicles
N Martelaro, W Ju – Proceedings of the 2017 ACM Conference on …, 2017 – dl.acm.org
Page 1. WoZ Way: Enabling Real-Time Remote Interaction Prototyping & Observation in On-Road Vehicles Nikolas Martelaro Center for Design Research Stanford University Stanford, CA, USA nikmart@stanford.edu Wendy …
The Cognitively Supporting Behavior of AmI Systems: Context Awareness, Explicit Natural (Touchless) Interaction, Affective Factors and Aesthetics, and Presence
SE Bibri – The Human Face of Ambient Intelligence, 2015 – Springer
The aim of this chapter is to explore and discuss the different features of the cognitively supporting behavior of AmI systems, namely cognitive context awareness, explicit natural (touchless) interac.
The state-of-the-art in autonomous wheelchairs controlled through natural language: A survey
T Williams, M Scheutz – Robotics and Autonomous Systems, 2017 – Elsevier
Skip to main content …
Extensions for Distributed Moving Base Driving Simulators
A Andersson – 2017 – books.google.com
Page 1. Linköping Studies in Science and Technology Licentiate Thesis No. 1777 Extensions for Distributed Moving Base Driving Simulators Anders Andersson Page 2. Linköping Studies in Science and Technology Licentiate Thesis No …
Introduction to Human-Harmonized Information Technology
T Nishida – Human-Harmonized Information Technology, Volume 1, 2016 – Springer
… 1967. Formula Manipulation System Macsyma by J. Moses. 1967. Dendral for Mass Spectrum Analysis by E. Feigenbaum. 1971. Natural Language Dialogue System SHRDLU, by T. Winograd. 1973 … P16. \(^a\)User Generated Dialogue Systems: uDialogue (PI: Keiichi Tokuda). P17 …
Wizard of Oz experimentation for language technology applications: Challenges and tools
S Schlögl, G Doherty, S Luz – Interacting with Computers, 2015 – ieeexplore.ieee.org
… While WOZ can be applied in a variety of interaction scenarios, ranging from mixed-reality simulations (Dow et al., 2005a) to human–robot … stressed the value of WOZ for collecting data (stated by eight interviewees): You generate data without having a dialogue system and you …
Virtual Reality and Game Mechanics in Generalized Social Phobia Treatment
KJ Niechwiadowicz – 2017 – essay.utwente.nl
Page 1. Faculty of Electrical Engineering, Mathematics & Computer Science Virtual Reality and Game Mechanics in Generalized Social Phobia Treatment Karolina Niechwiadowicz M.Sc. Thesis July 2017 Supervisors: prof. dr. DKJ Heylen prof. dr. ET Bohlmeijer dr. ir …
Interaction and Communication in an Immersive Learning Game: The Challenges of Modelling Real-Time Collaboration in a Virtual Operating Room
D Panzoli, CP Lelardeux, M Galaup… – Serious Games and …, 2017 – Springer
… Practically, simulation in healthcare education is defined as using an equipment, a computer software, a mixed reality system – which is a combination of both real and virtual – or a standardised patient for replicating a medical environment and/or a healthcare situation …
A review of eye gaze in virtual agents, social robotics and hci: Behaviour generation, user interaction and perception
K Ruhland, CE Peters, S Andrist… – Computer Graphics …, 2015 – Wiley Online Library
By continuing to browse this site you agree to us using cookies as described in About Cookies. Remove maintenance message …
Right mix of speech and non-speech: hybrid auditory feedback in mobility assistance of the visually impaired
I Hussain, L Chen, HT Mirza, G Chen… – Universal Access in the …, 2015 – Springer
… 60703040, 61332017), Science and Technology Department of Zhejiang Province (Nos. 2007C13019, 2011C13042). References. 1. Fallah, N.: AudioNav: a mixed reality navigation system for individuals who are visually impaired. ACM SIGACCESS Access. Comput …
Voice Interfaces in Everyday Life
M Porcheron, JE Fischer, S Reeves… – Proceedings of the 2018 …, 2018 – dl.acm.org
… Martin Porcheron*, Joel E. Fischer*, Stuart Reeves*, and Sarah Sharples† *Mixed Reality Laboratory School of Computer Science University … the wealth of enabling research in computational linguistics such as natural language processing, dialogue systems, and …
Interaction Design for 3D User Interfaces: The World of Modern Input Devices for Research, Applications, and Game Development
FR Ortega, F Abyarjoo, A Barreto, N Rishe, M Adjouadi – 2016 – books.google.com
Conwiz: The contextual wizard of oz
T Grill, O Polacek, M Tscheligi – Journal of Ambient …, 2015 – content.iospress.com
… The Wizard of Oz method is still popular to test new dialog systems using automatic speech recognition [15,33,36]. Klemmer et al … The DART design environment [13] was built to support prototyping of applications in augmented reality, mixed reality and ubiquitous computing …
Real-time Virtual Collaborative Environment Designed for Risk Management Training: Communication and Decision Making (Environnement
MV Minville – 2017 – core.ac.uk
Page 1. THÈSE en vue de l’obtention du DOCTORAT DE L’UNIVERSITÉ DE TOULOUSE délivré par Université Paul Sabatier présentée et soutenue par Catherine PONS LELARDEUX le 17 octobre 2017 Real-time Virtual Collaborative Environment …
HCI International 2015-Posters’ Extended Abstracts: International Conference, HCI International 2015, Los Angeles, CA, USA, August 2-7, 2015. Proceedings
C Stephanidis – 2015 – books.google.com
… Conference on Engineering Psychology and Cognitive Ergo- nomics (EPCE 2015) • 9th International Conference on Universal Access in Human-Computer Interaction (UAHCI 2015) • 7th International Conference on Virtual, Augmented and Mixed Reality (VAMR 2015) • 7th …
Interactive Learning and Adaptation for Personalized Robot-Assisted Training
F Makedon – 2018 – uta-ir.tdl.org
… Leadership Summit, 2012 . . . . . 26 2.6 The proposed Dialogue System for Safe Rehabilitation. . . . . 28 2.7 ReADAPT manager formulated as a Reinforcement Learning problem. 29 2.8 Simulated user models . . . . . 32 …
The Human Face of Ambient Intelligence
SE Bibri – 2015 – Springer
… The book series ‘Atlantis Ambient and Pervasive Intelligence’ publishes high quality titles in the fields of Pervasive Computing, Mixed Reality, Wearable Computing, Location-Aware Computing, Ambient Interfaces, Tangible Interfaces, Smart Environments, Intelligent Interfaces …
Universal communication model and evaluation with the elderly society
J Muschiol – 2015 – repositorio.ucam.edu
… 66 3.3.2 Symmetric Multimodal Dialogue System with Semantic Conversation Analysis … Mixed Reality MS-DOS ….. Microsoft Disk Operating System MTC …
Security vulnerabilities in speech recognition systems
M Bispham – 2016 – ora.ox.ac.uk
Page 1. CDT Technical Paper 01/16 Security Vulnerabilities in Speech Recognition Systems Mary Bispham Page 2. 1 Security Vulnerabilities in Speech Recognition Systems Mary K. Bispham, Michael Goldsmith and Steve Moyle …
Social robotics
C Breazeal, K Dautenhahn, T Kanda – Springer handbook of robotics, 2016 – Springer
This chapter surveys some of the principal research trends in Social Robotics and its application to human–robot interaction (HRIhuman–robotinteraction). Social (or Sociable) robots are designed to in.
On Active Passengering: Supporting In-Car Experiences
K Matsumura, DS Kirk – Proceedings of the ACM on Interactive, Mobile …, 2018 – dl.acm.org
… Similarly, Hakkila et al. proposed a mixed reality concept car window [13]. Using a see-through display, they explored the possibility of enhancing the physical landscape with location- specific information. Also, there are several studies on windshield applications in the car …
Sustaining Emotional Communication when Interacting with an Android Robot
E Vlachos – 2015 – vbn.aau.dk
Page 1. Aalborg Universitet Sustaining Emotional Communication when Interacting with an Android Robot Vlachos, Evgenios DOI (link to publication from Publisher): 10.5278/vbn.phd.hum.00037 Publication date: 2015 Document …
Multimodal Content Delivery for Geo-services
K Gardiner – 2015 – arrow.dit.ie
… Local Area Network) LBS (Location-Based Services) LNCS (Lecture Notes in Computer Science) LOS (Line-Of-Sight) MEMS (Mobile Environmental Management System) MMT (Mobile Mapping Technology) MSI (Mobile Spatial Interaction) MR (Mixed Reality) NASA (National …
Cross-cultural computing: an artist’s journey
N Tosa – 2016 – Springer
Page 1. Springer Series on Cultural Computing Naoko Tosa Cross-Cultural Computing: An Artist’s Journey Page 2. Springer Series on Cultural Computing Editor-in-Chief Ernest Edmonds, University of Technology, Sydney, Australia Editorial Board …
HCI International 2017–Posters’ Extended Abstracts: 19th International Conference, HCI International 2017, Vancouver, BC, Canada, July 9–14, 2017 …
C Stephanidis – 2017 – books.google.com
… Environments (Part III), edited by Margherita Antona and Constantine Stephanidis LNCS 10280, Virtual, Augmented and Mixed Reality, edited by … and Jun Munemori Collection of Example Sentences for Non-task-Oriented Dialog Using a Spoken Dialog System and Comparison …
Design and Evaluation of a Collaborative Virtual Environment (CoMove) for Autism Spectrum Disorder Intervention
L Zhang, Q Fu, A Swanson, A Weitlauf… – ACM Transactions on …, 2018 – dl.acm.org
Page 1. 11 Design and Evaluation of a Collaborative Virtual Environment (CoMove) for Autism Spectrum Disorder Intervention LIAN ZHANG and QIANG FU, Department of Electrical Engineering & Computer Science, Vanderbilt …
Persuasive Teachable Agent for Intergenerational Learning
SF Lim – arXiv preprint arXiv:1601.07264, 2016 – arxiv.org
Page 1. Persuasive Teachable Agent for Intergenerational Learning [A Book Draft] By Su Fang Lim 27 Jan 2016 Page 2. i Abstract Teachable agents are computer agents based on the pedagogical concept of learning-by- teaching …
2017 ARL Summer Student Program. Volume II: Compendium of Abstracts
R Pesce-Rodriguez – 2017 – dtic.mil
Page 1. ARL-SR-0388 ? DEC 2017 US Army Research Laboratory 2017 ARL Summer Student Program, Volume II: Compendium of Abstracts Compiled by Rose Pesce-Rodriguez Approved for public release; distribution is unlimited. Page 2. NOTICES Disclaimers …
Mastering C++ game development: create professional and realistic 3D games using C++ 17
M Macdonald – 2018 – books.google.com
… a scripting language 226 Why a scripting language 227 Introducing LUA 229 Implementing LUA 231 Building a dialog system 235 Constructing … Vive 299 Open Source Virtual Reality (OSVR) development kit 300 Sony PlayStation VR 301 Windows Mixed Reality headsets 301 …
Computing Bodies: Gender Codes and Anthropomorphic Design at the Human-Computer Interface
C Draude – 2017 – Springer
… Social robotics or virtual agents hold the po- tential to provide the public with artifacts that are very convincing once they function properly and start populating virtual worlds or mixed-reality environments. Furthermore, software shapes how humans can perform specific tasks …
Universal Access in Human-Computer Interaction. Users and Context Diversity: 10th International Conference, UAHCI 2016, Held as Part of HCI International …
M Antona, C Stephanidis – 2016 – books.google.com
… Conference on Engineering Psychology and Cognitive Ergo- nomics (EPCE 2016) • 10th International Conference on Universal Access in Human-Computer Interaction (UAHCI 2016) • 8th International Conference on Virtual, Augmented and Mixed Reality (VAMR 2016) • 8th …
Learning data-driven models of non-verbal behaviors for building rapport using an intelligent virtual agent
R Amini – 2015 – digitalcommons.fiu.edu
… The overall goal is to explore the possibilities of using machine learning techniques to move away from hand-crafted rule-based models employed in most of the current health-related dialogue systems (Discussed in Section 2), toward modeling human’s non-verbal behaviors …
Human-Computer Interaction. User Interface Design, Development and Multimodality: 19th International Conference, HCI International 2017, Vancouver, BC …
M Kurosu – 2017 – books.google.com
… Conference on Engineering Psychology and Cognitive Ergo- nomics (EPCE 2017) • 11th International Conference on Universal Access in Human–Computer Interac- tion (UAHCI 2017) • 9th International Conference on Virtual, Augmented and Mixed Reality (VAMR 2017) • 9th …
Linguistic Linked Open Data: 12th EUROLAN 2015 Summer School and RUMOUR 2015 Workshop, Sibiu, Romania, July 13-25, 2015, Revised Selected …
D Trandab??, D Gîfu – 2016 – books.google.com
Page 1. Diana Trandab?? Daniela Gîfu (Eds.) Communications in Computer and Information Science 588 Linguistic Linked Open Data 12th EUROLAN 2015 Summer School and RUMOUR 2015 Workshop Sibiu, Romania, July 13–25, 2015 Revised Selected Papers 123 Page 2 …
Mass Effect 3: The power of free will
J Sanchez – 2016 – search.proquest.com
Page 1. Mass Effect 3: The Power of Free Will by Jonathan Sanchez 10/07/2016 Submitted in Plirtilil Fulfillment of the Requirements for the Degree of Master of Arts in Communication Arts/Electronic Media SI. Thomas University Miami Gardens, Florida Approved: ~~JJ) …
Linguistic Linked Open Data
D Trandab??, D Gîfu – 2016 – Springer
Page 1. 123 Diana Trandab?? Daniela Gîfu (Eds.) 12th EUROLAN 2015 Summer School and RUMOUR 2015 Workshop Sibiu, Romania, July 13–25, 2015 Revised Selected Papers Linguistic Linked Open Data Communications in Computer and Information Science 588 Page 2 …
A survey of workload assessment algorithms
J Heard, CE Harriott, JA Adams – IEEE Transactions on Human …, 2018 – ieeexplore.ieee.org
Page 1. This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination. IEEE TRANSACTIONS ON HUMAN-MACHINE SYSTEMS 1 A Survey of Workload Assessment Algorithms …
Digital Guest Experience: Tools to help hotels to manage and optimize the digital guest experience
B Radde – 2017 – books.google.com
… Automatic voice assistants and dialog systems such as Apple’s Siri, Google’s Allo and Microsoft’s Cortana are being increasingly used.30 Users are growing increasingly accustomed to using their smartphones to chat, ask questions and formulate tasks …
A retro-projected robotic head for social human-robot interaction
FC Delaunay – 2016 – pearl.plymouth.ac.uk
Page 1. This copy of the thesis has been supplied on condition that anyone who consults it is understood to recognise that its copyright rests with its author and that no quotation from the thesis and no information derived from it …