Notes:
Microsoft Kinect is a motion sensing device that was developed by Microsoft for use with the Xbox 360 and Xbox One video game consoles, and Windows PCs. It uses a combination of cameras, infrared sensors, and microphone arrays to detect and track the movement of people and objects within its field of view.
Kinect is primarily used as a gaming controller, allowing users to control games and other interactive experiences by moving their bodies in front of the sensor. It can also be used for other applications, such as gesture recognition, voice control, and 3D scanning.
In addition to its use in gaming, Kinect has also been used in a variety of other applications, such as medical rehabilitation, education, and research. It has also been used in artistic performances, such as music and dance performances, as a way to control and manipulate audio and visual effects in real-time.
Project Natal was a research and development project announced by Microsoft in 2009 that focused on creating technology for natural user interfaces. It was later rebranded as Kinect when it was released as a commercial product in 2010. Kinect is a motion sensing input device that allows users to control and interact with their computers, video game consoles, and other devices using gestures and voice commands. It was originally developed for the Xbox 360 video game console, but later versions were also released for the Xbox One and Windows PC. Kinect uses a combination of cameras, microphones, and infrared sensors to track the movements and voice of the user, allowing for a wide range of applications including gaming, entertainment, and computer-based tasks such as facial recognition and voice recognition.
In the context of vtubers (virtual YouTubers), Kinect can be leveraged in a number of ways. One potential use is as a motion capture device, where the Kinect can be used to track the movements of a vtuber’s body and head, which can then be used to animate a virtual character in real-time. This allows vtubers to perform actions and movements that are more natural and expressive, which can help to make their virtual performances more engaging and lifelike.
Another potential use for Kinect in vtubering is for facial tracking and animation. The Kinect’s depth-sensing cameras can be used to track the movements of a vtuber’s face, allowing them to control the expressions and movements of their virtual character’s face in real-time. This can help to add another level of realism and expressiveness to virtual performances, and can also be used to enable more interactive and dynamic conversations between vtubers and their audiences.
Resources:
- brekel.com .. affordable motion capture tools
- depthkit.tv .. create volumetric experiences for vr, ar and visual effects
- driver4vr.com .. full body tracking in steamvr
- immotionar.com .. mix tracking sensors with headsets
- kinecthacks.com .. supporting the kinect, hacking news and community
- kinectvr.com .. unity plugin for room scale vr
- leapmotion.com .. advanced hand tracking
Wikipedia:
References:
- Introducing Project Kinect for Azure (08 May 2018)
See also:
100 Best Unity3d HTC Vive Videos
- KINECT LEAP MOTION VIRTUAL REALITY
- VR | KINECT V.3
- RichTech_TCL Kinect+VR in GERMAN IFA
- Beat Saber – Kinect VR Test 2 – This Is Me – The Greatest Showman (with inVR view)
- Beat Saber – Kinect VR test – Marvel Avengers (including inVR view)
- HOW TO SETUP SEEKING DAWN WITH PSVR ON PC // Playstation VR, Kinect 360, Nolo VR & Trinus PSVR
- HOW TO SETUP FULL BODY TRACKING ON VRCHAT // Playstation VR, Kinect 360, Nolo VR & Trinus PSVR
- Playstation VR vs Kinect – Round 3 – Playstation 4 vs Xbox One – Videojuegos Puerto Rico
- VRChat Kinect – Reality vs VR Comparison 1
- VR Based “9-Square Matrix” Exergame for Older Adults using Microsoft Kinect – App Demo
- VR-Based “9-Square Matrix” Exergame for Older Adults using Microsoft Kinect – Game Play Demo
- Aquila in VR – Beat Saber – Kinect Star Wars “I’m Han Solo”
- VR Kinect with Signs Proposal
- VR Chat: Kinect (Xbone) tracking dancing test
- PSVR DRIVER4VR POSITIONAL TRACKING ON PC – PART 2 // Playstation VR, Kinect 360 & Trinus PSVR
- PSVR DRIVER4VR POSITIONAL TRACKING ON PC – PART 1 // Playstation VR, Kinect 360 & Trinus PSVR
- Cheaper Full Body Tracking For Most VR headsets With Kinect & Driver4VR (Review on Oculus Rift)
- Beat Saber in Virtual Reality with Liv Vivr and Kinect green screen
- VRChat JustDance Vive Tracker n Kinect (4K Magic)
- VRChat JustDance Vive Tracker n Kinect (Rasputin)
- Testing LIV and VIVR with Kinect 360 V1 using Beat Saber VR
- Beat Saber in VR with a Kinect and virtual Green-screen – Virtual Reality
- [NEW] Instructions: Body Tracking Kinect as Vive Trackers in SteamVR, VRChat
- InnoVEX – Medical Technology Kinect AR VR
- InnoVEX – Medical Technology Kinect AR VR
- Kinect Virtual Reality
- Body movement tracking with a kinect in Virtual Reality
- First Person VR Monopoly game with Kinect
- FULL BODY TRACKING VR – Kinect y Driver4VR – Tutorial #2
- FULL BODY TRACKING VR – KINECT 360 O KINECT ONE Y MODIFICACIONES – TUTORIAL #1
- Mixed Reality Cat Sorter VR with Kinect Green Screen and WMR
- HTC Vive + Kinect = Augumented Virtuality
- VR studio even at home – Event was filmed with two Kinect v2 setup using EF EVE™ camera app
- GAMEPLAY and CONCLUSION – KINECT Full Body Tracking VR – From start to Finish – Ep. 3
- Soccer header simulator mobile VR with Kinect Tracking
- Software and Calibration – KINECT Full Body Tracking VR – From start to Finish – Ep. 2
- Preparing the Kinect – KINECT Full Body Tracking VR – From start to Finish – Ep. 1 [4K]
- Part 2 – Kinect To VR Calibration
- VR in Kinect point cloud
- Driver4VR 4.0 in VRChat: Lower Body Tracking with Kinect almost like Vive Trackers – Oculus
- Episode 60: PUBG Cheaters, Vive Pro, RIP Kinect and Pro Overwatch
- Fishtank VR test using kinect v2
- EPM2 – Full body tracking in VR with kinect
- LAMIF VR KINECT
- Kinect in VR – Spooky UE4 Plugin
- Shooting Game Simulation VR+Kinect Demo (SSVR)
- Vr and Kinect Xbox 360 and Xbox one ultimate giveaway
- Kinect Motion Capture seen from VR
- “Space Frenzy” – Kinect/Rift Full Body VR for SD Hacks 2017
- Kinect and Vive first steps to fully articulated VR avatar
- Next Art & VRScout Art Show 2017 – 04 Vive & Kinect
- Next Art & VRScout Art Show 2017 – 02 Vive & Kinect
- Next Art & VRScout Art Show 2017 – 01 Vive & Kinect
- Trinus Or Riftcat? + vr Gamplay and Room Scale With Xbox 360 Kinect
- Skeleton tracking using a Microsoft Kinect for visualization in HTC Vive VR glasses
- Kinect driver4vr Trinus sync and foot kick test test simulating vive foot and hip tracker
- Driver4VR: Body Tracking Kinect in SteamVR VRChat – with Oculus, Vive, Nolo
- Full body VR using Kinect and smartphone
- Preview: Lower body tracking in SteamVR with Kinect a’la Vive Trackers – with Oculus, Vive, Nolo
- Unity VR Kinect Green Screen
- A Virtual Reality Experiment in Paris – Macarena Project using a Kinect sensor
- Eating Mixed Reality Cheetos – TouchDesigner with Vive & Kinect
- Game Designer Brian Fargo says, unlike Kinect, VR has the passion
- Full body VR using Kinect and smartphone
- Oculus Kinect Fruit Ninja in Virtual Reality HD
- Kinect+VIVE MR testing
- Final Demo – Football simulator in virtual reality using Kinect and HTC Vive
- Vive + Kinect + Leap Integration
- Vive Kinect and Leap working together for full body and finger tracking
- Vive + Kinect synchronized positions
- Deus Deorum Final Demo [Kinect + Oculus VR]
- DEUS DEORUM Kinect VR – Reveal Trailer
- Sample Kinect motion on Unity VR Project
- MaxMSP HTC Vive Kinect 360
- 360 Video – BTL Activation – VR and Kinect Interactive Wall by Spinar+
- BTL Activation – VR and Kinect Interactive Wall by Spinar+
- Kinect+Android+Unity=Gear VR Room Scale Tracking Real World Physical Position
- Gibberish – Just Dance VR – Full Gameplay 5 Stars KINECT VR
- Games Project Demo 2 with Kinect v2 & Oculus VR
- Games Project Demo 1 with VR/Kinect
- INVISIBLE Virtual Reality Experience – Built with Processing / Kinect / Cardboard VR
- Combining Kinect v2 with VR for full body visualization
- Unreal Engine 4 VR (Oculus Rift + Kinect v2) [alpha test]
- [OSVR-Kinect + PSMove] Google Earth VR
- HTC Vive + kinect experiment #1
- A Kinect sorsára juthat a VR? | Otherside #2
- Fake HTC Vive + Leap Motion + Kinect = Full Body Precense Test 1
- Using a kinect for movement with the cardboard htc vive!
- PlayStation VR vs. Xbox Kinect
- Unreal Engine + Vive + Kinect
- VR + Kinect on Xbox 360
- Reaction on Virtual Reality Demo with Oculus Rift 2 + Xbox Kinect sensor
- Hololens, HTC Vive, and Kinect Integration
- How to play HTC Vive games with a Kinect and Google Cardboard
- Real-time Mixed Reality – Proof of concept: Kinect v2 + VR (HTC Vive) + Unity
- Kinect VR 0.6 Beta Samsung Gear VR multiplayer
- OSVR-fusion: Room Scale VR with Rift DK1, Kinect and Wiimotes
- Kinect v2 Volumetric Video in Unity 5 Player, VR Enabled
- Lay’s virtual reality free kick [Oculus/Kinect App + BTL]
- VR/AR and Kinect Solution for a Historical Museum by ARworks
- 3D CAD working with KINECT & Rift/Vive VR? Autodesk leaked registry hint
- VR – Kinect Version 3
- Oculus and Kinect – The new dimension of VR
- Kinect + Unity Integration for Virtual Reality
- Retro Rant – Virtual Reality, the next Kinect?
- Flying Skull VR (Oculus DK2 + Kinect + Leap Motion + Teddy)
- Box VR – Kinect Support
- Gear VR + Kinect
- Virtual Reality: Kinect DEMO
- Immersive Virtual Reality – Kinect+Cardboard
- Will PlayStation VR Go the Way of Kinect? – Game Scoop! 360
- Kinect V2 Playing with virtual reality
- VR & Behavior Recognition by CHi’s Front 3D Camera (not Kinect or ToF-based skills)
- Virtual Reality with LabVIEW using the Oculus Rift and the Microsoft Kinect
- VR Living Room (Kinect + Leap Motion + Oculus Rift)
- Head Tracking for VR Gaming using the Kinect
- Virtual Reality with Kinect – House Browsing & Painting
- VR MMD with Kinect and Unity
- A first application with Kinect + Unity 3D – Virtual Reality
- Virtual Reality with Kinect – House Browsing & Painting
- VirtualMohrhuhn – A collaborative distributed Virtual Reality Game using 3D Mouse and Kinect
- Virtual Reality game using Kinect, Android and Panda3D
- Kinect + 3D TV = Virtual Reality
- UGA VR Project 1: Angry Birds 3D + Kinect
- Kinect VR : 3D Virtual Reality using Kinect Hack