Unity3d & Multimodal Agents

Notes:

Multimodal agents are intelligent agents that can interact with the world using multiple modes of communication, such as natural language, gestures, and facial expressions. In the context of the Unity game engine, multimodal agents can be used to create virtual characters that can communicate with players using multiple modes of communication.

Unity is a popular game engine that is widely used for creating 2D and 3D games. It has a built-in AI system that allows developers to create intelligent agents that can navigate and interact with the game world. By incorporating multimodal communication capabilities into these agents, developers can create more realistic and engaging virtual characters that can communicate with players in a more natural and intuitive way.

Multimodal agents can be used in a variety of ways in Unity games. For example, they can be used to create non-player characters (NPCs) that can hold conversations with players and respond to their gestures and facial expressions. They can also be used to create virtual assistants that can help players navigate the game world and provide them with information and guidance.

Agents are digital entities or characters with autonomy, intelligence, and interactivity, designed to engage with users, environments, or other agents in lifelike ways. Leveraging features like natural language processing, emotion recognition, and decision-making capabilities, virtual agents can provide assistance, entertainment, companionship, or act as user representatives in various applications such as video games, virtual reality experiences, and digital assistants.
Augmented reality (AR) refers to the technology that integrates digital entities, characters, or objects into the user’s view of the real world, creating an immersive and interactive experience. These virtual beings, often designed with autonomy and intelligence, can interact with users and their surroundings in real-time, providing enhanced experiences in gaming, education, healthcare, and other industries. By overlaying virtual agents onto the physical environment, AR enables users to engage with these digital characters in a more seamless and natural way, blurring the boundaries between the virtual and real worlds.
Avatars are the graphical or visual representations of users or digital entities within virtual environments, such as online games, social media platforms, or virtual reality experiences. These avatars serve as the user’s virtual embodiment or identity, allowing them to interact with other users, virtual agents, or digital elements in the virtual space. Avatars can be customized to reflect the user’s personality, preferences, or desired appearance, enabling a personalized and immersive experience in the virtual world. They act as the bridge between the user and the virtual environment, fostering engagement and communication with other virtual beings or users.
Cloud-based refers to the delivery and access of virtual characters, environments, or experiences over the internet, rather than relying on local hardware or infrastructure. By utilizing cloud computing resources, virtual beings can be easily accessed, updated, and scaled across multiple devices and platforms. This approach offers improved efficiency, cost savings, and performance for both developers and users. Cloud-based virtual beings can be part of applications such as online games, digital assistants, or virtual reality experiences, enabling users to interact with them seamlessly from any device with an internet connection, without the need for extensive local computing power.
Cloud hosting refers to the process of hosting, managing, and delivering virtual characters, environments, or experiences on remote servers over the internet. This approach leverages the power of cloud computing to provide scalable, reliable, and cost-effective infrastructure for virtual beings, enabling developers to build and deploy complex, resource-intensive applications without the need for local hardware or extensive maintenance. Users can access and interact with cloud-hosted virtual beings across multiple devices and platforms, benefiting from the flexibility and performance advantages of cloud-based services. This approach is especially useful for applications such as online games, virtual reality experiences, and digital assistants that require high computing power and real-time responsiveness.
Cloud platform refers to an internet-based infrastructure that provides developers with the necessary tools, services, and resources to create, deploy, and manage virtual characters, environments, or experiences. By leveraging the power of cloud computing, developers can efficiently build and scale virtual beings without the need for local hardware or extensive maintenance. Cloud platforms offer a range of services, such as data storage, computing power, and networking capabilities, which enable the creation of complex, resource-intensive applications like online games, virtual reality experiences, and digital assistants. Users can access and interact with these virtual beings across multiple devices and platforms, benefiting from the flexibility, reliability, and performance advantages provided by cloud-based services.
Cloud server refers to a remote, virtualized server that is hosted and managed on a cloud computing infrastructure. These servers provide the necessary computing power, storage, and resources required for the creation, deployment, and management of virtual characters, environments, or experiences. By utilizing cloud servers, developers can efficiently build and scale virtual beings without the need for local hardware or extensive maintenance. Users can access and interact with virtual beings hosted on cloud servers from any device with an internet connection, benefiting from the flexibility, reliability, and performance advantages provided by cloud-based services. Cloud servers play a crucial role in supporting applications such as online games, virtual reality experiences, and digital assistants that demand high computing power and real-time responsiveness.
Cloud service refers to any internet-based service that facilitates the creation, deployment, management, or interaction with virtual characters, environments, or experiences. By leveraging the power of cloud computing, developers can efficiently build and scale virtual beings, while users can access and interact with them across multiple devices and platforms without the need for local hardware or extensive maintenance. Cloud services can include various offerings such as data storage, computing power, networking capabilities, or tools for building and deploying virtual beings. These services play a key role in supporting applications like online games, virtual reality experiences, and digital assistants, providing users with the flexibility, reliability, and performance advantages inherent in cloud-based solutions.
Real-time refers to the immediate and continuous interaction, responsiveness, or processing that occurs between users, virtual characters, or environments without any noticeable delay. Real-time interactions are crucial for creating immersive and seamless experiences when engaging with virtual beings, as they mimic the natural flow of communication and action found in the real world. Applications such as online games, virtual reality experiences, and digital assistants rely on real-time processing to ensure that virtual beings can understand, respond, and adapt to user inputs, environmental changes, or other virtual agents instantly, fostering a sense of presence and natural engagement within the virtual environment.
Virtual reality (VR) refers to a fully immersive, computer-generated environment that users can interact with using specialized hardware, such as VR headsets and controllers. Within this environment, virtual beings serve as autonomous digital entities or user avatars that can engage with users, other virtual characters, or the virtual environment itself. The integration of virtual beings in VR applications adds depth, interactivity, and realism to the user experience, as they can communicate, collaborate, or compete with users or other virtual agents. Virtual reality experiences featuring virtual beings can be found in various applications such as gaming, social VR platforms, education, training simulations, and virtual therapy, enhancing user engagement and immersion in the virtual world.

Resources:

makehumancommunity.org .. open source tool for making 3d characters
multiplay.com .. enterprise game server hosting
naturalfront.com .. efficient way to do 3d facial animation
passervr.com .. create a virtual reality experience with realistic avatar movement
photonengine.com .. multiplayer game development made easy
uniquitous.wpi.edu .. open source cloud-based game system implemented in unity
unity3d.ai .. unity machine learning tools and resources

Wikipedia:

References:

FPGA-Based Real Time Hand Gesture and AR Marker Recognition and Tracking for Multi Augmented Reality Applications
AO Alghabri, FH Osman, NY Ahmed – Arab Journal of Nuclear …, 2017 – esnsa-eg.com
… (13) Z. Huang, W. Li, C. Peylo, and P. Hui, “CloudRidAR: A cloud-based architecture … (16) W. Piekarski, R. Smith, G. Wigley, B. Thomas, and D. Kearney, “Mobile hand tracking using FPGAs for low powered augmented reality,” in 8th … (18) Unity, <https://unity3d.com/ > 2016.11.16 …

Adaptive fog-based output security for augmented reality
S Ahn, M Gorlatova, P Naghizadeh, M Chiang… – … Reality and Augmented …, 2018 – dl.acm.org
… In VR/AR Network’18: ACM SIGCOMM 2018 Morning Workshop on Virtual Reality and Augmented Reality Network , August 24 … run training simulations offline to generate context-specific security policies, potentially with the aid of cloud servers … https://unity3d.com [19] TensorFlow …

CloudVR: Cloud Accelerated Interactive Mobile Virtual Reality
T Kämäräinen, M Siekkinen, J Eerikäinen… – 2018 ACM Multimedia …, 2018 – dl.acm.org
… the rotational latency is only dependent on the client device even in cloud-based VR … Most existing implementations of video stream players, even in the context of virtual reality, rely on … such as MPEG-DASH or HLS, which makes them unsuitable for a real-time system (Section 2 …

Simultaneous data exchange between BIM and VR for collaborative decision making
J Du, Z Zou, Y Shi, D Zhao – Computing in Civil Engineering 2017, 2017 – ascelibrary.org
… BVRS includes a Revit plugin that gathers BIM metadata on a regular basis, a Cloud server that … Occlusion Culling.” <https://docs.unity3d.com/Manual/OcclusionCulling … effects of image persistence in low frame rate virtual environments.” Proc., 2015 IEEE Virtual Reality (VR), IEEE …

Concept and architecture for programming industrial robots using augmented reality with mobile devices like microsoft HoloLens
J Guhl, S Tung, J Kruger – 2017 22nd IEEE International …, 2017 – ieeexplore.ieee.org
… Included are different visualizing methods like augmented and virtual reality … robotics tend to use distributed control systems and algorithms the infrastructure shall be easily adoptable and integrable to those cloud based approaches … 3https://unity3d.com/ 4https://www.vuforia.com …

Cloud-based augmented reality remote maintenance through shop-floor monitoring: a product-service system approach
D Mourtzis, A Vlachou… – Journal of …, 2017 – … .asmedigitalcollection.asme.org
2

Real Time Cross Platform Collaboration Between Virtual Reality & Mixed Reality
NS Seth – 2017 – search.proquest.com
… superimposes a computer-generated image on a user’s view of the real world, thus providing a composite view.” (“Define Augmented Reality,” nd) … HMD (“The Sword of Damocles (Virtual Reality),” nd) … The document is stored on cloud and it can be accessed by “n” …

Agency detection in predictive minds: a virtual reality study
M Andersen, T Pfeiffer, S Müller… – Religion, Brain & …, 2019 – Taylor & Francis
… In comparison to Unity3D (Version 5.3.2, https://unity3d.com/ de), which was also evaluated in the beginning, it allowed us to … Going forward, we believe that virtual reality and eye tracking are ideally suited to address such questions … Faces in the clouds: A new theory of religion …

Multi-agent collaborative planning in smart environments
F Amato, N Mazzocca, F Moscato, F Xhafa – International Conference on …, 2017 – Springer
… of new technologies grows up fast, namely, distributed sensors networks, virtual reality and smart … T.: A digital contents management system using a real booklet interface with augmented reality … Moscato, V., Picariello, A.: A framework for semantic interoperability over the cloud …

A distributed tool to perform dynamic therapies for social cognitive deficit through avatars
M García-Sánchez, MA Teruel, E Navarro… – … Computing and Ambient …, 2017 – Springer
… sent, a networking layer will transmit them to the patient’s side application by using cloud network services … In order to make this interaction more immersive, patients use a Virtual Reality (VR) headset featuring eye … Unity UNET: https://docs.unity3d.com/Manual/UNetOverview.html …

Battling the fear of public speaking: Designing software as a service solution for a virtual reality therapy
J Salkevicius, L Navickas – … Future Internet of Things and Cloud …, 2018 – ieeexplore.ieee.org
… 1https://unity3d.com … VRET environments for public speaking anxiety were design, developed and made available as part of our cloud service … A. Virtual Reality environments During the multiple therapy sessions the patient experi- ences public speaking scenarios starting from a …

Lightweight websim rendering framework based on cloud-baking
C Liu, J Jia, Q Zhang, L Zhao – Proceedings of the 2017 ACM SIGSIM …, 2017 – dl.acm.org
… CCS Concepts •Computing methodologies ? Real-time simulation; •Human- centered computing ? Virtual reality; •Information systems ? Multimedia … Measuring the latency of cloud gaming systems … Cloudlight: A system for amortizing indirect lighting in real-time rendering …

PRACTICA. A Virtual Reality Platform for Specialized Training Oriented to Improve the Productivity
JML Enríquez, MÁ López, VM García, M López… – IJIMAI, 2019 – dialnet.unirioja.es
… a new environment for creating and executing 3D virtual reality and augmented reality applications, called … platforms, such as Android, Windows and even PlayStation, which support Virtual Reality devices and … which is simple to interpret and easy to share through cloud hosting …

Large scale collaborative autonomous vehicle simulation and analysis using smartphones
A Kemeny, E Icart, A Sepchat, F Colombet, S Espié… – 2018 – hal.archives-ouvertes.fr
… The city used for the latter scene was created using assets from the Modern City pack (https://www.assetstore.unity3d.com/en/#!/content/1 8005) … Figure 12 – Illustration of the Photon Cloud working principle … Figure 13 – A user of 3D AV explore, running the virtual reality mode …

A Low-cost Distributed IoT-based Augmented Reality Interactive Simulator For Team Training.
P Piazzolla, M Gribaudo, S Colombo, D Manca… – ECMS, 2017 – scs-europe.net
… 11] offers a comprehensive review of the functional complexity of connecting real-world objects to the Internet with tiny sensors, while in [12] a Cloud centric vision for … [2] P. Vichitvejpaisal, N. Yamee, and P. Marsertsri, “Firefighting simulation on virtual reality platform,” in … com …

Affective impact of social presence in immersive 3D virtual worlds
E Dzardanova, V Kasapakis… – 2017 IEEE Symposium …, 2017 – ieeexplore.ieee.org
… human models were imported into Mixamo12, which is a cloud-based platform … 3D character model mesh to the skeleton (https://docs.unity3d.com/Manual/Preparingacharacterfromscratch … Virtual Reality Participants’ navigation and interaction within the virtual clothing store and …

An approach for exoskeleton integration in manufacturing lines using Virtual Reality techniques
A Karvouniari, G Michalos, N Dimitropoulos, S Makris – Procedia CIRP, 2018 – Elsevier
… results are to be modelled in a semantic data model, in a format such as owl or linked data and stored in a cloud database for … In Proceedings of the ACM symposium on Virtual reality software and technology, ACM, pp … 38] Unity, Retreived June, 28, 2018 from https://unity3d.com/.

Towards Augmenting IVR Communication with Physiological Sensing Data
C George, M Hassib – Extended Abstracts of the 2019 CHI Conference …, 2019 – dl.acm.org
… Apparatus We connected two remote desktops and HTC Vives with Photon Cloud … CHI 2019, May 4–9, 2019, Glasgow, Scotland, UK LBW2222, Page 3 Page 4. virtual reality games were created with Unity (https://unity3d.com/) and open source code [5, 12] 1 …

Ambient bot: delivering daily casual information through eye contact with an intimate virtual creature
K Gushima, H Akasaki, T Nakajima – Proceedings of the 21st …, 2017 – dl.acm.org
… in Figure 4 displays a jellyfish as a virtual creature in a user’s surrounding space with augmented reality technologies, and the … weather.livedoor.com/forecast/webservice/json/v1 7 https://dev.twitter.com/overview/api 8 https://cloud.voicetext.jp/webapi 9 http://japan.unity3d.com …

Augmented reality application assessment for disseminating rock art
S Blanco-Pons, B Carrión-Ruiz, JL Lerma – Multimedia Tools and …, 2019 – Springer
… ARToolkit provides a camera calibration service, a cloud-and-crowd-based solution for generating and downloading calibration parameters for different … Blanco-Pons S, Carrión-Ruiz B, Lerma JL (2016) Review of augmented reality and virtual reality techniques in rock art …

Combining traditional and indirect augmented reality for indoor crowded environments. A case study on the Casa Batlló museum
J Gimeno, C Portalés, I Coma, M Fernández… – Computers & …, 2017 – Elsevier
… In those cases where high-level authoring tools are proposed, most of the time markers, point clouds or 3D models … Augmenting assets with traditional augmented reality … As pointed out earlier, in traditional AR the real scene is captured in real time by the mobile devices camera …

A social virtual reality-based application for the physical and cognitive training of the elderly at home
S Arlati, V Colombo, D Spoladore, L Greci, E Pedroli… – Sensors, 2019 – mdpi.com
… Exergames enabled by the use of virtual reality (VR) allow for the creation of ecological and … Photon Cloud is built using a room-based architecture, which means that players are aware … the route, as illustrated in Figure 5, whose interpolation occurs in real time using quaternion …

Creating Social Virtual Reality in Campus Environments
DB Handojo – 2017 – cloudfront.escholarship.org
… understand the size of clouds [1]. Users of the social media application would all be placed into a digital and scaled-down representation of the earth … 21 APPENDIX R’Welcome: Virtual Reality Campus Tour … Available: https://www.assetstore.unity3d.com/en/#!/ content/10032 …

A comparison between two different approaches for a collaborative mixed-virtual environment in industrial maintenance
F De Pace, F Manuri, A Sanna… – Frontiers in Robotics and AI, 2019 – frontiersin.org
… interaction systems: the remote operator gives assistance using an immersive Virtual Reality (VR) device, whereas the local user interacts using a wearable Augmented Reality (AR) device … remote operator to modify the virtual assets and instructions in real-time to give …

Design and development of a collaborative virtual reality environment
M McMenamin – 2018 – theseus.fi
… services. The market size for VR and AR (Augmented Reality) combined is predicted to … applications. In Lumberyard, developers can include different Virtual Reality Gems to … servers or cloud hosting than AWS. (Amazon 2018b) Lumberyard is free to use and its …

Unlocking the door to mobile social VR: Architecture, experiments and challenges
L Zhang, L Sun, W Wang, J Liu – IEEE Network, 2017 – ieeexplore.ieee.org
… com/) to achieve the social sync flow … Room (https://www.assetstore.unity3d.com/ en/\#!/content/85732), City (https://www.asset- store.unity3d.com/en/\#!/content/65679) and Nature (https://www.assetstore.unity3d.com/ en/\#!/content … [7] R. Shea et al., “Cloud Gaming: Architecture …

Cooperative Ramp Merging System: Agent-Based Modeling and Simulation Using Game Engine
Z Wang, G Wu, K Boriboonsomsin, M Barth – SAE Int. J. of CAV, 2019 – researchgate.net
… to communicate with other vehicles on the road, roadside infrastructure, and the “Cloud” [4]. Automated … 1) Some of the methods are not always suitable for real-time implementation due … Conversely, game engines are able to model complex virtual reality environ- ments and also …

Advantages, Critics and Paradoxes of Virtual Reality Applied to Digital Systems of Architectural Prefiguration, the Phenomenon of Virtual Migration
A Basso – Multidisciplinary Digital Publishing Institute …, 2017 – mdpi.com
… in the possibility of not invasive investigation, resulting from a preventive acquisition of cloud data from … unreal-engine-htc-vive/; Figure S3: http://www.virtualrealityguide.com/history-of- virtual-reality, Figure S3 … Available online: https://unity3d.com/ (accessed on 10 August 2017) …

Augmented reality-based vision-aid indoor navigation system in GPS denied environment
S Rajeev, Q Wan, K Yau, K Panetta… – … and Applications 2019, 2019 – spiedigitallibrary.org
… capture the field of vision using the front-facing camera in a real-time manner … paraphrase the same information contained in conventional textual, graphical or even virtual reality systems [12 … locally on a 3D map, and provides visual navigation aid on an augmented reality device …

Multi-robot Systems, Virtual Reality and ROS: Developing a New Generation of Operator Interfaces
JJ Roldán, E Peña-Tapia, D Garzón-Ramos… – Robot Operating System …, 2019 – Springer
… Augmented Reality … Among the Unity assets, the SteamVR plugin is specially useful, since it contains the basic interactions required by virtual reality, such as … some robots: eg a spotlight that points the robot that performs the most relevant task and a smoke cloud which indicates …

The utilization of virtual reality as a system of systems research tool
J Lwowski, M Joordens, A Majumdar… – 2018 13th Annual …, 2018 – ieeexplore.ieee.org
… R. Toscano, and P. Baert, “Simulation of manufacturing processes via virtual reality,” in Robotics … and auctioning algorithms for heterogeneous robotic swarms operating on a cloud network,” in … Available: https: //www.assetstore.unity3d.com/en/#!/content/51662 [18] RenderPeople …

GeoFort: Mobile Game for Motivating Physical Activity using Gamification and Augmented Reality
A Eklund, A Nygårds, D Smeds – 2018 – diva-portal.org
… Augmented Reality (AR) is a subset of Virtual Reality (VR) [1]. VR replaces the real world … Since Firebase has other features such as Authentication and Cloud messaging which will help with our … 1 and more detailed in Figure 2. This makes up our Augmented Reality framework …

Breaking out of the cloud: Local trust management and rendezvous in Named Data Networking of Things
W Shang, Z Wang, A Afanasyev, J Burke… – Proceedings of the …, 2017 – dl.acm.org
… Combined with emerging virtual and augmented reality technologies, IoT offers the promise of … and services from different vendors; • Interactive user experience that emphasize real-time feed- back … Existing home IoT systems often depend on cloud-based services provided by …

Development of an online multiplayer game with augmented reality capabilities for android devices
M Prades Carceller – 2017 – repositori.uji.es
… Virtual Reality is building virtual spaces with avatars in which the people can … process of obtaining synthetic images in real time, taking into account the pipeline of current graphic processors … By using together multiplayer functions, Augmented Reality and a compelling …

Crowd simulation incorporating thermal environments and responsive behaviors
L Chen, CR Jung, SR Musse, M Moneimne… – PRESENCE …, 2018 – MIT Press
… We therefore seek to add a thermal presence dimension to both user and virtual agent experiences … Because both simulations run in real time, this thermal environ- ment may be perceived by as well as affected by a virtual reality user …

Visualizing IoT systems and data with Augmented Reality
AH Nilsson – 2019 – muep.mau.se
… be used, and it correlates the virtual and the physical realities, providing a seamless way to extend physical reality with virtual reality and interfaces … Augmented Reality (AR) was a concept and idea mentioned as early as 1901 and an AR system was invented in the early … Cloud …

Development a modular factory with modular software components
J Um, K Fischer, T Spieldenner, D Kolberg – Procedia Manufacturing, 2017 – Elsevier
… services for smart and digital factories in which devices, factories and clouds are interconnected … efforts of this implementation are occurred in the integration with cloud and factory … utilize open-source based software components in the development of real-time virtual reality of a …

An intelligent maintenance planning framework prototype for production systems
S Kranzer, D Prill, D Aghajanpour… – 2017 IEEE …, 2017 – ieeexplore.ieee.org
… 7578870/ [18] YS Chang, HC Choi, SY Sung and SJ Mun, A Study of Cloud Based Maintenance System … [32] Beyond Reality, IN2AR, A Cross-platform Augmented Reality Engine, last … [35] Unity Technologies, Unity 3D Framework, last accessed: 12.10.2016: https://unity3d.com/.

Virtual Reality Graded Exposure Therapy for Chronic Low Back Pain: A Pilot Study
M Kraus, B Geng, C Fæster, AV Nielsen – 2018 – projekter.aau.dk
… point outwards and down to both track controllers with LED’s and perform real time simultaneous localization … The chosen virtual reality system for this application is the HTC Vive … of the trackers on the human body was taking from the Unity’s Humanoid Avatar (Unity Technologies …

2D, 3D or Speech? A Case Study on which User Interface is Preferable for what Kind of Object Interaction in Immersive Virtual Reality
D Hepperle, Y Weiß, A Siess, M Wölfel – Computers & Graphics, 2019 – Elsevier
… modalities to further improve interaction and satisfaction of a virtual or augmented reality application … Unity3D we used Valve’s SteamVR 10 and the open source Virtual Reality Toolkit 11 . To realize the SI, we communicated asynchronously with Google Cloud Speech API 12 …

Design and Implementation of a Virtual Reality Laboratory for Mechanical Maintenance
AES Cano – 2018 – scholarworks.moreheadstate.edu
… methodologies. Nevertheless, the use of virtual and augmented reality (VR/AR) technologies … Page 24. 12 2.4.3 Solid Works 3D modeling was a large part of the design and implementation of the Virtual Reality training environment … from different free cloud-based websites …

Framework for Interactive M3 Visualization of Microscopic Traffic Simulation
H Yang, Y Shen, M Hasan, D Perez… – Transportation …, 2018 – journals.sagepub.com
Full comprehension of microscopic traffic simulation (MTS) models has necessitated the development of proper visualizations. Existing MTS models only provide li…

Double Shellf: What Psychological Effects can be Caused through Interaction with a Doppelganger?
Y Hatada, S Yoshida, T Narumi, M Hirose – Proceedings of the 10th …, 2019 – dl.acm.org
… At the end of the capturing, the captured model is sent to the itSeez3D’s cloud server and … 6https://unity3d.com/unity/whatsnew/unity-2017.4.1 7https://developer.vive.com/us/vive-tracker … unity.com/packages/tools/animation/final-ik-14290 13https://assetstore.unity.com/packages/3d …

Integrating Game Engines into the Mobile Cloud as Micro-services
Q Liu – 2018 – harvest.usask.ca
… inside a personal mobile device cloud as micro-services; … network technologies for communication inside device clouds are reviewed in section 3.5. 3.1 Game Engines … engines are explored as feature-rich but low-cost alternatives to high-end virtual reality software …

Gesture Controlled Virtual Reality Based Conferencing
N George, VK Maurya, G Martin – 2019 – dspace.dbit.in
… 35 Table 5.3 Photon Cloud and Server comparison[33] 48 … Page 16. 5 i. They use Kinect data to create point clouds of image for greater visualization ii … “Lightweight palm and finger tracking for real-time 3D gesture control.” Virtual Reality Conference (VR), 2011 IEEE. IEEE …

User performance evaluation and real-time guidance in cloud-based physical therapy monitoring and guidance system
W Wei, Y Lu, E Rhoden, S Dey – Multimedia Tools and Applications, 2019 – Springer
… and performance evaluation using real network profiles and on a real cloud environment, and … Besides, the proposed GB-DTW-A algorithm enables real-time evaluation and guidance for the … In [5], an augmented reality mirror and colored circles/lines overlaid on the user’s body …

Little botany: A mobile game utilizing data integration to enhance plant science education
S Jamonnak, E Cheng – International Journal of Computer Games …, 2017 – hindawi.com
… real-world location data and real-time weather data to create a virtual reality garden for … More specifically, Little Botany is using real-time weather data for the garden location to simulate … This cloud storage provides us the ability to develop our game application without worrying …

Virtual Reality Application in Data Visualization and Analysis
X Zhang – 2017 – epb.bibl.th-koeln.de
… 20 that Microsoft also released its AR (Augmented Reality) product HoloLens. With AR, the headset … 14 “A Critical Look at Virtual Reality.” Page 25. 25 … It announced Avatars, Parties and Rooms to allow users to have their own avatar in the VR world, to host voice calls with 8 …

Technical Opportunities and Challenges in Mobile Augmented Reality Prototyping: CASE: Haaga-Helia UAS Freshman application
T Muilu – 2019 – theseus.fi
… Augmented Reality (AR) originates from virtual reality. In 1968, Ivan Sutherland created the … smartphones and pad computer to be considered MAR. Recently, augmented reality … 11 content. Offline content that is pre-loaded in the application or cloud-based, where content …

Collaborative immersive planning and training scenarios in VR
C Eller, T Bittner, M Dombois, U Rüppel – Workshop of the European …, 2018 – Springer
… Photon provides a free cloud-based option which is able to manage a multitude of … Another useful package is the virtual reality toolkit (VRTK) [24] which includes extensive functionality via … 2. Dörner, R., Broll, W., Grimm, PF, Jung, B. (eds.): Virtual und Augmented Reality (VR/AR …

Perspective Shifts in Mixed Reality: Persuasion through Collaborative Gaming.
D Jacoby, Y Coady – PPT@ PERSUASIVE, 2017 – pdfs.semanticscholar.org
… 3 http://www.youtube.com/watch?v=8T7ux3DXP_w&ab_channel=TomScott 4 http://unity3d.com/ unity … Head Mounted Displays for individualized Virtual Reality … of conversational systems and rich attitudinal modeling is more challenging, but using powerful cloud-based cognitive …

Impact assessment of reinforced learning methods on construction workers’ fall risk behavior using virtual reality
Y Shi, J Du, CR Ahn, E Ragan – Automation in Construction, 2019 – Elsevier
… of simulating hazardous situations in the real world, a multi-user Virtual Reality (VR) system … To achieve multi-user functionality, a third-party cloud server Photon Unity Networking (PUN) [98 … On the avatar receiver side, the avatars update this information in real-time through the …

MYR: A Web-Based Platform for Teaching Coding Using VR
C Berns, G Chin, J Savitz, J Kiesling… – Proceedings of the 50th …, 2019 – dl.acm.org
… MYR includes a cloud-based data collection system with which the scenes that have been rendered are captured and … virtual reality offers an effective platform for immersive, educational experiences, we have the opportunity to bring virtual reality to the … https://unity3d.com [6] [nd …

3D visualization and reflexive archaeology: A virtual reconstruction of Çatalhöyük history houses
N Lercari – Digital applications in archaeology and cultural …, 2017 – Elsevier
… System (GIS) platform ESRI ArcScene, or the in the custom virtual reality software for … of Lifeliqe are: (a) ability to display high quality 3D interactive real-time visualizations; (b … 3D reconstructions displayed in Lifeliqe directly in a PowerPoint; (f) augmented reality capabilities that …

Application of a Non-Immersive VR, IoT Based Approach to Help Moroccan Students Carry Out Practical Activities in a Personal Learning Style
M Fahim, B Ouchao, A Jakimi, L El Bermi – Future Internet, 2019 – mdpi.com
… Another study talked about the impact of four different technologies on education; namely, cloud computing, IoT, data mining, and triple play were suggested … Virtual Reality in Education … The 3D virtual objects were made using the famous game engine Unity (https://unity3d.com) …

A Dynamic Time Warping Based Algorithm to Evaluate Kinect-Enabled Home-Based Physical Rehabilitation Exercises for Older People
X Yu, S Xiong – Sensors, 2019 – mdpi.com
… system, we calculate the joint position data based on a local coordinate system of the human model, which would be updated in real time … The main scene of the exergame is implemented with two avatars: virtual trainer and trainee (Figure 3). The avatar-based rendering …

Virtually rebuilding Çatalhöyük history houses
N Lercari – 2018 – escholarship.org
… 2011. “Virtual Heritage in the Cloud: New Perspectives for the Virtual Museum of Bologna.” Paper presented at VAST: International Symposium on Virtual Reality, Archaeology, and Intelligent Cultural Heritage, Prato, Italy, October 18–21, 153–60 … https://unity3d.com …

Improved User Experience with Realistic Virtual Environments and Environmental States
J Sepponen – 2019 – jultika.oulu.fi
… AR Augmented Reality – superimposing computer- generated view on top of real world to aid … feedback, this interactive play is straightly comparative to immersive virtual reality with auditory … Besides the familiar setting of university environment, the real-time day and night cycles …

Inverse Kinematics Using Arduino and Unity for People with Motor Skill Limitations
NV Barrera, OJS Parra, LC Sánchez – International Conference on …, 2018 – Springer
… only memorize various human poses but also generate them through a cloud of possible … phone is required which must be connected to a PC that supports virtual reality … https://assetstore.unity. com/packages/tools/input-management/android-microcontrollers-bluetooth-16467. 12 …

Demonstration of an Industrial Framework for an Implementation of a Process Digital Twin
JM Eyre, TJ Dodd, C Freeman… – ASME 2018 …, 2018 – … .asmedigitalcollection.asme.org
… the connected “things” generate real- time data that is analyzed in the cloud utilizing contextual data … MQTT – Message Queuing Telemetry Transport PLC – Programmable Logic Controller PLM – Product lifecycle management VR – Virtual Reality … Available: https://unity3d.com …

Molecular visualization on the holodeck
TD Goddard, AA Brilliant, TL Skillman… – Journal of molecular …, 2018 – Elsevier
… the computer-generated scene on the actual physical surroundings, while virtual reality (VR) devices … these applications are based on a video game engine Unity3D (https://unity3d.com) which does … by different groups of researchers, ChimeraX could start a cloud-based server …

Navigation Instruction Validation Tool and Indoor Wayfinding Training System for People with Disabilities
L Ding – 2017 – scholarworks.umass.edu
… learning, experimentation or development of certain skills [3]. In this paper, we introduce Unity game engine [4] based virtual reality system that will … augmented reality. The proposed system in the paper not only aims to the blind people, it can also … cloud …

Monitoring traffic in future cities with aerial swarms: Developing and optimizing a behavior-based surveillance algorithm
P Garcia-Aunon, JJ Roldán, A Barrientos – Cognitive Systems Research, 2019 – Elsevier
… of drones to collect data of polluting gases in the city, as well as a cloud-based system … The agents considered in this work are quadrotors, which are able to fly in any direction and hover at … The intelligence of each agent generates the position of the next cell to visit, and the low …

Developing a Kinect based Holoportation System
S Chiday – 2018 – etd.ohiolink.edu
… 1.2. Augmented Reality AR is also called as Mixed Reality. Unlike Virtual Reality, it enhances the visualization of the real world by adding virtual objects to the real world … With distributed apps that wirelessly connected to the cloud infrastructure, it shows an extremely promising …

Learning by playing: An LBG for the Fortification Gates of the Venetian walls of the city of Heraklion.
K Vassilakis, O Charalampakos… – EAI Endorsed Trans …, 2018 – researchgate.net
… and make the individual tracking of the objects captured by the video camera in real time … system with advanced cross-layer management features and IoT equipment.,” in Cloud and Fog … [12] E. FitzGerald, R. Ferguson, A. Adams and M. Gaved, “Augmented reality and Mobile …

Simulation for Training and Testing Intelligent Systems
DW Carruth – 2018 World Symposium on Digital Intelligence for …, 2018 – ieeexplore.ieee.org
… immediate access is best, the computational resources can be local or cloud-based resources … [14] “NVIDIA DRIVE Constellation: Virtual reality autonomous vehicle … 10.1109/ICCV.2017.243 [18] “Unity Machine Learning,” [Online], Available: https://unity3d.com/machine-learning …

Beyond data visualization: A context-realistic construction equipment training simulators
F Vahdatikhaki, K El Ammari, AK Langroodi… – Automation in …, 2019 – Elsevier
… In recent years, Virtual Reality (VR)-based simulators are used to train apprentices in many … While some manufacturers have recently started to introduce agent-driven mobility in the training … years, the advancements of the Internet of Things (IoT) and Real-time Location Systems …

A Cloud-based Development Environment using HLA and Kubernetes for the Co-simulation of a Corporate Electric Vehicle Fleet
K Rehman, O Kipouridis, S Karnouskos… – 2019 IEEE/SICE …, 2019 – ieeexplore.ieee.org
… kept up with recent technological advances such as big data, cloud computing, graphics … fine-grained visibility of assets and processes, timely integration of real-time data, as … Furthermore, coupling simulation and modern 3D or even augmented/virtual reality visualizations can …

High-precision gestural input for immersive large-scale distributed virtual environments
J Botev, S Rothkugel – Proceedings of the 9th Workshop on Massively …, 2017 – dl.acm.org
… 5h p://www.unity3d.com/ 6h p://developer.microso .com/kinect 8 Page 3 … 1996. Virtual Reality History, Applica- tions, Technology and Future. Technical Report … [16] Kjetil Raaen, Ragnhild Eg, and Carsten Griwodz. 2014. Can Gamers Detect Cloud Delay …

DelivAR: An Augmented Reality Mobile Application to Expedite the Package Identification Process for Last-mile Deliveries
D Tatasciore – 2018 – researchgate.net
… world. The Anchors are registered and stored in the Anchor Cloud. The Cloud data can be … ARToolKit: an open-source library for the creation of Augmented Reality application … work is also written in JavaScript, and it is used for building virtual reality experience. However …

Medical procedural training in virtual reality
T Gåsbakk, H Snarby – 2017 – ntnuopen.ntnu.no
… In 2016, Augmented Reality (AR) got public notice by Microsoft’s announcement of their Hololens … to terminology and concepts regarding user design and development of virtual reality applications in a … Instead of receiving feedback in real-time, the feedback is presented after a …

REVAM: a virtual reality application for inducing body size perception modifications
C Buche, N Le Bigot – 2018 International Conference on …, 2018 – ieeexplore.ieee.org
… to realize this transformation, we must first re-sample the two models to transform them into ”clouds” of points … The participant is immersed in the virtual environment wearing a virtual reality headset to enhance the feeling of presence in … 1www.unity3d.com 2www.oculusvr.com/rift …

Detecting and adapting conversational agent strategy to user’s emotions in video games
B Cagnol – 2017 – macs.hw.ac.uk
… virtual reality, video games’ experiences are getting more and more immersive. In this … Most TTS services are cloud based so games using them would not be playable offline … In Tom Clancy’s EndWar [Ubisoft, 2008], a real-time strategy game, the player can control …

Logging Interactions in Explorable Immersive VR/AR Applications
J Floty?ski, P Soboci?ski – 2018 International Conference on …, 2018 – ieeexplore.ieee.org
… 1. INTRODUCTION Immersive virtual reality (VR) and augmented reality (AR) applications become increasingly popular … city models, which enables the use of CAD data and point clouds … Wie%C5%BCowiec-Miastoprojektu-w-Poznaniu ; https://assetstore.unity.com/packages/3d …

FiVES: An Aspect-Oriented Virtual Environment Server
T Spieldenner, S Byelozyorov… – … on Cyberworlds (CW …, 2017 – ieeexplore.ieee.org
… org 4http://www.ogre3d.org/ 5http://clb.demon.fi/knet/ 6http://www.unity3d.com 7https://www … But the work does not yet consider efficiency of real-time communi- cation and overall performance of … We omit the avatar and the authentication plugin, as connected users only view the …

“Twhirleds”: Spun and whirled affordances controlling multimodal mobile-ambient environments with reality distortion and synchronized lighting to preserve …
M Cohen, R Ranaweera, B Ryskeldiev… – Scientific Phone Apps …, 2017 – Springer
… monitoring is used for head-tracking by Google Cardboard 21 and HMDs, as well as augmented reality applications such … c 2 nd -order, 2 nd -person mixed-virtuality fantasy scene with ambidextrous avatar and affordance projection … 2015) (seen in the top left of the cloud in Fig …

Realistic Simulation of Cultural Heritage
C Kiourt, G Pavlidis, A Koutsoudis… – International Journal of …, 2017 – igi-global.com
… technologies, such as multimedia, 3D computer graphics, spatial sound and virtual reality, can be … ARCO was also, evaluated as an Augmented Reality Interface (ARIF) (Sylaiou, Mania, Karoulis, & … for the 3D virtual environment to be more realistic, some real-time image effects …

Augmented Reality, Virtual Reality, and Computer Graphics: 4th International Conference, AVR 2017, Ugento, Italy, June 12-15, 2017, Proceedings
LT De Paolis, P Bourdot, A Mongelli – 2017 – books.google.com
… the activities that are being carried out to create a cloud-based platform … Dieter Kranzlmüller Measuring the Impact of Low-Cost Short-Term Virtual Reality on the … Feedback for Embedded Computing Learning Activity Using Pedagogical Virtual Machine with Augmented Reality …

Process Measures of Dyadic Collaborative Interaction for Social Skills Intervention in Individuals with Autism Spectrum Disorders
J Wade, A Sarkar, A Swanson, A Weitlauf… – ACM Transactions on …, 2017 – dl.acm.org
… and sampling fre- quency), scalability (eg, dynamic application hosting in the cloud), and accessibility … partitioning the methods into categories such as Virtual and Augmented Reality (VR/AR … DOSE was implemented using the game engine Unity3D (www.unity3d.com) because …

Low-end haptic devices for knee bone drilling in a serious game
M Nguyen, M Melaisi, B Cowan… – World Journal of …, 2017 – emeraldinsight.com
… is currently seeing great effort and emphasis placed on the use of virtual reality (VR) and … For haptic rendering, the burr is represented as a cloud of sample points evenly … shop/touch 3. Unity Haptic Plugin for Geomagic OpenHaptics, www.assetstore.unity3d.com/en/#!/content …

Artificial intelligence based holograph
ZA Khan – 2019 – aiktcdspace.org
… We are also imposing a technology called augmented reality in our holograph which … home devices. ?GET ANSWERS Get real-time answers including the latest on weather, traffic, finance or sports … 35. CES 2019 Like Live Translator or Interpreter (Needs Cloud Speech). 36 …

Virtually Being Lenin Enhances Presence and Engagement in a Scene From the Russian Revolution
MM Slater, X Navarro, J Valenzuela… – Frontiers in Robotics …, 2018 – discovery.ucl.ac.uk
… Virtual reality delivered by a head-tracked head-mounted display (HMD) can be programmed so … Moreover, real-time motion capture can be used so that when the participants move their … Implementation The project was implemented within the Unity 3D engine (unity3d.com) …

Room-Scale Virtual Reality for Interprofessional Collaborative Healthcare Training-Developing a Multi-Interface Application for a Smart Virtual University Hospital
H Trandem – 2017 – ntnuopen.ntnu.no
… 80 Figure 34: A phone being held by a room-scale avatar ….. 81 … space where people can meet and interact with others, with agents or with virtual artifacts [5] … Project Motivation 1.2.1 Possibilities of Room-Scale Virtual Reality …

Design and Implementation of a 4D Web Application for Analytical Visualization of Smart City Applications
S Murshed, A Al-Hyari, J Wendel, L Ansart – ISPRS International Journal …, 2018 – mdpi.com
… For example, the Smart Dubai project [40] was develop on an ESRI platform that streams real-time 3D data to the public … specification for streaming massive heterogeneous 3D geospatial datasets such as imagery, 3D contents including buildings, trees, point clouds, and vector …

Holomuseum: A Prototype of Interactive Exhibition with Mixed Reality Glasses HoloLens
AG Bottino, AM García, E Occhipinti – 2017 – webthesis.biblio.polito.it
… the first, in the virtual reality nothing is real and everything is virtual: it is a completely … augmented reality system, and a forward facing camera to capture an image of the user for other … product development process, supporting the real-time interaction between engineers and …

FlightGoggles: Photorealistic Sensor Simulation for Perception-driven Robotics using Photogrammetry and Virtual Reality
W Guerra, E Tal, V Murali, G Ryou… – arXiv preprint arXiv …, 2019 – arxiv.org
… as shown in Figure 1. Second, we utilize a novel virtual-reality system to … its photorealistic assets enables users to straightforwardly generate additional data, including real-time photorealistic renders … can be run headlessly on an Amazon Web Services (AWS) cloud instance to …

An Objective Evaluation Method for Rehabilitation Exergames
RH Osgouei, D Soulsbv, F Bello – 2018 IEEE Games …, 2018 – ieeexplore.ieee.org
… With the advances in virtual reality technologies, various virtual rehabilitation platforms have been introduced … of tele-rehabilitation exercises is employed in [18], whereas a cloud-based physical … a program in Unity 3D game engine (Unity Technologies – unity3d.com) to capture …

Development of In-Browser Simulators for Medical Education: Introduction of a Novel Software Toolchain
J Šilar, D Polák, A Mládek, F Ježek, TW Kurtz… – Journal of medical …, 2019 – jmir.org
… and manipulation of anatomical models of several human systems and organs in augmented reality … clear that teaching simulators are not as sensitive to latency as real-time gaming, low … consider the client-side approach more suitable because renting a cloud service providing …

Multi-Robot Simulation Framework
A Hideg, L Blázovics, B Forstner – 2018 9th IEEE International …, 2018 – ieeexplore.ieee.org
… 1https://unity3d.com … In [13] the authors have shown that the use of a virtual reality environment can achieve considerably faster and more efficient learning … as the tests increase in complexity or volume, it can be outsourced to be executed in a cloud computation environment …

3d virtual object tracking and registration based on marker tecnology for AR apps
L Ibern Ortega – 2017 – upcommons.upc.edu
… Non-immersive VR is commonly used on video-games that do not require special hardware. • Immersive Virtual Reality: The Immersive VR is achieved using … 2.2. Augmented Reality (AR) … Combines real and virtual elements • Interactive in real time registering in 3D …

Navigating Virtual Environments At Scale
J Bhandari – 2017 – scholarworks.unr.edu
… joystick etc. Teleportation is the most widely adopted technique in virtual reality applica … To implement legomotion, Tango’s real world observed delta displace- ments are used to move the user’s avatar. Real time step detection and translation to virtual motion was implemented …

Playing with Virtual Reality: Early Adopters of Commercial Immersive Technology
MH Foxman – 2018 – academiccommons.columbia.edu
… I’m a typical researcher. I have my head in the clouds.” However, he was … mobile tech, cloud computing and other technology clusters that opened VR to users through … In Virtual Reality: Representations in Contemporary Media, Melanie Chan (2015) dissects Virtual Reality as a …

Using Image Recognition Technology as a Gameplay Mechanic
AL Ray, TJ Meehan, Y Nachum – 2017 – digitalcommons.wpi.edu
… CamFind is a tech demo for Cloud Sight’s image recognition API … It also allows users to view other searches in real time … The game consists of the main gameplay loop (the scavenger hunt), two secondary mechanics involving a simple form of augmented reality, and a final …

Comparison Of Two Approaches For Web-Based 3D Visualization Of Smart Building Sensor Data
M Badri – 2017 – pdfs.semanticscholar.org
… API Application programming interface AR Augmented reality ART Renderer Autodesk Raytracer Renderer BAS Building automation … control protocol UI User interface VE Virtual environment VR Virtual reality VS-CaSP … Network monitoring and visualization happens in real time …

Assessing the impact of the awareness level on a co-operative game
MA Teruel, N Condori-Fernandez, E Navarro… – Information and …, 2018 – Elsevier
… the revival of Virtual Reality [5], [6]. It has been estimated that consumer spending on Virtual Reality hardware and … their enjoyment when playing two different games, namely a First-Person Shooter and a Real Time Strategy one … Next abilities, What will the avatar’ abilities have …

A Future Framework: Virtual Reality as an Architectural Instrument
J Holth – 2017 – researcharchive.vuw.ac.nz
… Augmented Reality (AR) – Technology that layers a digital environment on top of the existing … literature in three areas; workplace environments, digital environments and virtual reality environments/ representation, as … Whether a human or a digital avatar is used, factors such as …

Virtual reality in urban search and rescue: a time and accuracy assessment of the use of virtual reality as a tool for urban search and rescue after earthquakes
L Fischell – 2018 – run.unl.pt
Page 1. Virtual reality in Urban Search and Rescue Lisa Fischell – B.Sc. Applied Geography – a time and accuracy assessment of the use of … after earthquakes Page 2. i Virtual reality for Urban Search and Rescue – a temporal requirement and accuracy assessment of the use …

A survey on developing personalized content services in museums
D Kosmopoulos, G Styliaras – Pervasive and Mobile Computing, 2018 – Elsevier
… That content can have various forms such as multimedia presentations, virtual reality (VR), augmented reality (AR) or … However, recommendation options embedded in the guidance systems are less frequent, and even fewer options exist for real-time RSs that exploit sensor …

Prototyping a Digital Twin for Real Time Remote Control Over Mobile Networks: Application of Remote Surgery
H Laaki, Y Miche, K Tammi – IEEE Access, 2019 – ieeexplore.ieee.org
… was established through a OpenVPN server which was running on a cloud server in … at all, because they either failed to orient themselves in VR or Virtual Reality Induced Symptoms … Augmented reality (AR) and mixed real- ity (MR) are similar concepts with the difference in real …

A therapy-driven gamification framework for hand rehabilitation
I Afyouni, FU Rehman, AM Qamar, S Ghani… – User Modeling and User …, 2017 – Springer
… Session data are stored and indexed using cloud-based services … path is generated by the game engine and reflects the best path to be followed in real-time by the … For example, places of interest to be visited, source and destination locations, and the visual avatar can be easily …

Maintaining Mental Wellbeing of Elderly at Home
E Vogiatzaki, A Krukowski – Enhanced Living Environments, 2019 – Springer
… problem with acceptance is when it comes to visors, especially closed Virtual Reality ones … On the other hand, open Augmented Reality glasses, though generally more expensive, are more accepted … to move to Intel Prime Sensor cameras for using their cloud-powered solutions …

Responsive IoT: using biosignals to connect humans and smart devices
A Armengol Urpi – 2018 – dspace.mit.edu
… This effort is a first step towards connecting room occupants and smart A/C devices, which can enable real-time adjustments of indoor conditions. In the second part of the thesis, brain signals are used as the interface to navigate in a Virtual Reality (VR) environment …

Engineering Queerness in the Game Development Pipeline
E Freedman – Game Studies: The International Journal of …, 2018 – gamestudies.org
… in Kitchen, as part of a tech demo for Sony’s virtual reality headset, Project … by formally opening up the Unity development pipeline to integrated Watson cloud services … http://www.capcom-unity. com/gregaman/blog/2012/04/05/how_dragons_dogma_changed_the_mt_framework …

Development of Interactivity Game using Facial Landmarks
TK Goh – 2017 – eprints.utar.edu.my
… Page 2 Figure 1-1: Facial Landmarks and Face Recognition Preview (Google Cloud, 2016) … categorize as an augmented reality (AR) game. It was available on both PC and mobile … could work concurrently with any real-time service using webcam such as Skype …

Creating Good User Experience in a Hand-Gesture-Based Augmented Reality Game
B Lam, J Nilsson – 2019 – diva-portal.org
… the technical documentations, Etteplan is providing Augmented Reality and Virtual Reality (VR) services … awards, among them are “best developer tool” and “best augmented reality browser” … 3D recognition and tracking, image recognition and tracking, cloud recognition, location …

Survey of Virtual and Augmented Reality lmplementations for Development of Prototype for Practical Technician Training
T Lindvall, Ö Mirtchev – 2017 – diva-portal.org
… Different course components can in real- time display cockpit panels, show 3D models of the aircraft or show diagrams and panels to monitor electric, hydraulic and fuel … This was achieved by using available techniques in Virtual Reality (VR) and Augmented Reality (AR) to …

3D Character Animation Using Sign Language
ACA Ferreira – 2017 – repositorio-aberto.up.pt
… be used to display a 3D animation through a humanoid avatar. 1.3 Objectives The … proposed: 1. Describe the state of the art of Sign Language translation systems based on 3D animated avatars in order to identify areas of improvement. 2 …

Potential of Low Cost Motion Sensors Compared to Programming Environments
J Miha?ov, E Pietriková, A Baláž, B Madoš… – Acta Polytechnica …, 2018 – uni-obuda.hu
… Readers interested in virtual reality are advised to check the very innovative sensor combinations available in the Oculus Rift and Oculus Touch devices … They described their challenges with augmented reality issues as well … 6 Unity 3D homepage, https://Unity3D.com …

Discrete Viewpoint Control to Reduce Cybersickness in Virtual Environments
Y Farmani – 2018 – curve.carleton.ca
… Abstract Cybersickness in virtual reality (VR) is an on-going problem, despite recent advances in head-mounted displays (HMDs) … Due to advent of low-cost head-mounted displays (HMDs) and tracking solutions, virtual reality (VR) is now accessible to more people than ever …

Evaluating the Effects of Pre-Attentive Processing on Player Performance and Perception in Platform Video Games
O Warnhag, N Wedzinga – 2019 – diva-portal.org
… 53 6.2.6 Virtual Reality … The lack of saliency maps (a way to highlight saliency differences in an image) for 3D real-time in-motion … In a study by Halik [22], Bertin’s visual variables were tested in a cartography en- vironment, specifically augmented reality navigational applications …

Rule-based human motion tracking for rehabilitation exercises: Realtime assessment, feedback, and guidance
W Zhao, MA Reinthal, DD Espy, X Luo – IEEE Access, 2017 – ieeexplore.ieee.org
… Subsequently, we describe the design and implementation of an avatar-based guidance system that incorporates the rule-based framework. The usability of the system is validated via a human subject study with eight healthy subjects. II. RELATED WORK …

Cyber Physical Approach and Framework for Micro Devices Assembly
SH Albuhamood – 2017 – shareok.org
… desired products. 1.4 Virtual Reality (VR) based Simulation Approaches … 13 Figure 5: Augmented Reality Daqri Smart Helmet [121] Monferrer et al … Zhang et al. [41] proposed a cloud-based monitoring system that monitors activities of different sectors using the help of VR …

A prototype exercise–empowerment mobile video game for children with cancer, and its usability assessment: developing digital empowerment interventions …
CS Bruggers, S Baranowski, M Beseris… – Frontiers in …, 2018 – frontiersin.org
… Integrative dynamic graphic and sound mixers, and animation features linked with audiovisual effects provide immediate real-time speed, direction, and acceleration player feedback. Coding was done in Javascript and C# (48) …

Sistema multi-cámara distribuido basado en UNITY
M González Jiménez – 2017 – repositorio.uam.es
… This virtual system must be able to manage several distributed cameras in real time, configure camera’s properties and possibility to transmit … 1https://en.wikipedia.org/wiki/ Orthographic_projection 2https://unity3d.com/es 3A game engine is a software framework …

Augmented Reality as a Potential Tool for Filmmaking
P Blachfield – 2018 – arrow.dit.ie
… elements on this spectrum include Virtual Reality (VR) and Mixed Reality (MR) … 7https://next.reality. news/news/u2-takes-fans-behind-scenes-its-new-augmented-reality-tour … www.trustedreviews. com/news/what-is-project-tango-2941129 14https://docs.unity3d.com/Manual/vuforia …

Augmented reality game development
M Lanham – 2017 – books.google.com
… has a lot of experience in developing augmented reality as well as virtual reality applications … More details about Unity system requirements may be found at: https://unity3d.com/uni ty … an AR World, allows the player to interact with those virtual locations Augmented Reality AR has …

LeaPhysio: games enhanced physical rehabilitation
FCP Lourenço – 2017 – repositorio.iscte-iul.pt
… new working tools for physiotherapy based on Virtual Reality (VR) and Augmented Reality (AR) … The use of gloves requires a special configuration in the virtual reality scenario for each patient … Figure 2.5 – Avatar control in Tux Racer game using sensors [17] …

Supporting Facilitators of Collaborative Learning using Mixed Reality-Helping Experts in Teamwork Facilitators observe groups collaborating in Virtual Reality
J Husebø, S Torjussen – 2018 – ntnuopen.ntnu.no
… Augmented Reality Augmented Reality(AR) is the concept of a real environment with digital elements superimposed … that occlude your view to present a digital expe- rience are virtual reality … Unity also features ser- vices like cloud building, multiplayer network, version control …

Multi-Robot Systems, Virtual Reality and ROS: Developing a new generation of operator interfaces
JJ Roldán, E Peña-Tapia… – … System (ROS): The …, 2018 – books.google.com
… com … Page 50. Multi-robot Systems, Virtual Reality and ROS: Developing a New Generation… 41 • Robot mark … in order to guide the attention of the operator to some robots: eg a spotlight that points the robot that performs the most relevant task and a smoke cloud which indicates …

Novel Hybrid-Cast Approach to Reduce Bandwidth and Latency for Cloud-Based Virtual Space
X Hou, Y Lu, S Dey – ACM Transactions on Multimedia Computing …, 2018 – dl.acm.org
… 1 INTRODUCTION In recent years, virtual reality (VR) has become increasingly popular and triggered great … on the cloud needs to be encoded and streamed from the cloud to each … optimal algorithm for grouping is computationally expensive and impractical for real-time use due …

Robust robot tracking for next-generation collaborative robotics-based gaming environments
G Piumatti, F Lamberti, A Sanna… – IEEE Transactions on …, 2017 – ieeexplore.ieee.org
… Real-time tracking: the tracking system must be able to work in real-time, ie, it must be able to process data collected from available sensors as quickly as they are produced … Real-time tracking is an essential requisite to correctly implement the illusion of mixed reality …

Towards a first implementation of the WLIMES approach in living system studies advancing the diagnostics and therapy in augmented personalized medicine
PL Simeonov – Biosystems, 2017 – Elsevier
… to biomathematics and biocomputation that suitably addresses self-organized, self-referential and anticipatory systems with multi-temporal multi-agents … This is presented to the modeller via a formal augmented reality language as a first step towards practical modelling and …

Yôkai no Kôgeki
AS Moran, J Abel, WE Suriner – 2018 – digitalcommons.wpi.edu
… 111 Figure 6.5. Word cloud of how people described their experience 111 Figure 6.6 … was built off of, implementation of virtual reality, and all the changes made to the base model to … tower defense game. This game also incorporates Augmented Reality to allow for a more …

Exploring context-sensitive collaborative augmented reality applications
M Konsti – 2017 – utupub.fi
… elements is a challenge and there is little knowledge about these kinds of multi- agent systems … According to this definition augmented reality is a technology that (1) combines real and virtual objects in a real world setting, (2) runs interactively in real-time and (3) incor …

Virtual Reality games and gamified exercises in physioterapeutic treatment of non-specific low back pain patients with kinesiophobia
TF Larsen – 2019 – bora.uib.no
… 24 2.2.1 Virtual Reality … or more areas on top of scene geometry that is considered ”walkable” or traversible (often by characters and/or Artificial Intelligence agents). For example, in a Unity scene, a 3D robot character with a NavMesh agent behaviour will be able to move freely …

Human-robot motion: an attention-based approach
R Paulin – 2018 – tel.archives-ouvertes.fr
… 51 5.2 Application architecture for real-time many-objective path planning . . . 52 5.3 Simulation platform … Rios-Martinez, Spalanzani, and Laugier [34] and Rios-Martinez et al. [35] present a simple way to estimate these spaces in the case of two agents interacting (based …

Virtutello: Balancing Physical and Digital Interaction in a Mixed Reality Sculpting Tool
J Van Der Kroon – 2019 – qspace.library.queensu.ca
… world. Virtual reality combined with hand tracking allows the user sculpting while using their head … We know from previous research that giving users the ability to use their hands to sculpt in virtual reality makes it easier for them to learn how to sculpt [28] …

Enhancing Healthcare with Virtual Reality
P Xia – 2018 – aut.researchgateway.ac.nz
… either a virtual reality or augmented reality experience (Hasan & Yu, 2015). The … simulation (SBS) and 3-dimensional virtual reality (3D VR) and their implementations … The VPs will be represented in the form of an avatar, and such avatars could simulate high …

Serious gaming/gamification elements for apps promoting physical activity
D Van Dyck – 2017 – uhdspace.uhasselt.be
… avatar. The growth of their fish is a function of the amount of steps they take during a certain period … humans. Although the performance of AI agents has been improving the last decades … to make real-time decisions, model their opponents, deal with only partial informa …

Building an RPG with Unity 2018: Leverage the power of Unity 2018 to build elements of an RPG.
V Karamian – 2018 – books.google.com
… founder of Noorcon Inc., a software consulting firm in Burbank, CA, providing services in the field of augmented reality and virtual reality used in … inventory Determining item types Creating an inventory item Creating the prefab Adding an inventory item agent Inventory items …

Interactive Wargaming Cyberwar: 2025
DT Long, CM Mulch – 2017 – apps.dtic.mil
Page 1. NAVAL POSTGRADUATE SCHOOL MONTEREY, CALIFORNIA CAPSTONE Approved for public release. Distribution is unlimited. INTERACTIVE WARGAMING CYBERWAR: 2025 by David Tyler Long Christopher M. Mulch December 2017 Thesis Advisor …

Designing Joint Attention Systems for robots that assist children with autism spectrum disorders
L Fermoselle – 2018 – diva-portal.org
… of attention focus which can be applied, for example, as a real-time feedback to a robot controller to build more adaptive interactive be- haviours. Also related to joint attention is the social presence concept. Better simulations of joint attention in an artificial agent might result in …

Human-Computer Interaction. Interaction Contexts: 19th International Conference, HCI International 2017, Vancouver, BC, Canada, July 9-14, 2017 …
M Kurosu – 2017 – books.google.com
… 397 Jürgen Engel, Christian Märtin, and Peter Forbrig How Cloud Computing Is Addressed for … Contents – Part I XXV Design of Hand Gestures for Manipulating Objects in Virtual Reality … Adamson, Alan Barr, and David Rempel A Widely Applicable Real-Time Mono/Binocular …

SimCEC: A collaborative VR-based simulator for surgical teamwork education
PVF Paiva, LS Machado, AMG Valença… – … in Entertainment (CIE), 2018 – dl.acm.org
… 1 INTRODUCTION Virtual reality (VR) is a well-established area of investigation for applying computing in … For example, only the 3DVOR system provides automated feedback (in real time/online … system has two versions: the Local SimCEC (LAN) and the SimCEC Cloud (Internet …

Creating Augmented 360 Experiences with Focus on People with Mobility Impairments
JA Tapia Escobar, R Abou Torab – 2018 – diva-portal.org
… control over where the movie will take him or her, by joining smaller movie clips in real time … development of the ‘Sensorama’ Figure 2a as one of the first devices to deliver virtual reality … be different from the reality, we can embody a different character or even an artificial avatar …

CCMUG: a model for the development of mobile and ubiquitous games focused on chronic diseases
KC Sá – 2018 – repositorio.jesuita.org.br
… interfere with active agents. This definition was made through a set of dichotomies … Otherwise, it is a challenge; 4. If a challenge has no active agent to oppose the player, it is a puzzle … which employs ubiquity and augmented reality concepts along with the features of new …

Learn Unity for Android Game Development: A Guide to Game Design, Development, and Marketing
A Sinicki – 2017 – books.google.com
… 185 ?Chapter 11: An Introduction to 3D Game Development and Virtual Reality … 205 ?Chapter 11: An Introduction to 3D Game Development and Virtual Reality 207 Creating a 3D World …

Design and implementation of an integrative system for configurable exergames targeting the senior population
TCM Paulino – 2019 – digituma.uma.pt
… The use-cases in blue can only be achieved if there is internet access since it relies on cloud database data….. 26 … cloud-based (Database API). … 31 …

The Social Brain in Virtual Reality. Changing Perspective on Self and Others in Immersive Virtual Environments
S Neyret – 2018 – tdx.cat
… 109 Figure 51: Word cloud showing the word frequency of the participants in the control condition … 84 Table 10: Words selected for the creation of the word-clouds (in both conditions) … In the second experiment, we use virtual reality as a tool to explore how being embodied …

Videogame ecologies: interaction, aesthetics, affect
C Mckeown – 2018 – theses.gla.ac.uk
… fictional planet thrives and decays in real time … The three languages that 18 Unity 3D, “Public Relations” (online resource), <unity3d.com/public-relations> [last accessed 19/07/2016]. Page 14 … It is difficult not to recall a short sequence from The Matrix.32 Late in the movie, ‘Agent …

A survey of augmented, virtual, and mixed reality for cultural heritage
MK Bekele, R Pierdicca, E Frontoni… – Journal on Computing …, 2018 – dl.acm.org
… 2001): (i) It combines real-world and virtual objects, (ii) runs in real time, and (iii … In general, both augmented reality and mediated reality aim to enhance our perception of and interaction … Virtual Reality (VR), on the other hand, when fully exploited, completely immerses users in a …

TV Concierge: A Proposal for an Interactive TV Recommendation System Based on Viewing Context
B Cardoso, J Abreu – … of the 6th Iberoamerican Conference on …, 2017 – sedici.unlp.edu.ar
Page 82. TV Concierge: A Proposal for an Interactive TV Recommendation System Based on Viewing Context Bernardo Cardoso, Jorge Abreu University of Aveiro, Aveiro, Portugal {bernardoc, jfa}@ ua. pt Abstract. With the …

Adapting a Formal Model Theory to Applications in Augmented Personalized Medicine
PL Simeonov, AC Ehresmann – arXiv preprint arXiv:1710.03571, 2017 – arxiv.org
… to biomathematics and biocomputation that suitably addresses self-organized, self-referential and anticipatory systems with multi-temporal multi-agents … This is presented to the modeller via a formal augmented reality language as a first step towards practical modelling and …

Towards a First Implementation of the WLIMES Approach in Living System Studies Advancing the Diagnostics and Therapy in Personalized Medicine
PL Simeonov, AC Ehresmann – Biosystems. Elsevier. ISSN, 2017 – researchgate.net
… to biomathematics and biocomputation that suitably addresses self-organized, self-referential and anticipatory systems with multi-temporal multi-agents … This is presented to the modeller via a formal augmented reality language as a first step towards practical modelling and …