This is a set of Azure Kinect and Femto Bolt/Mega camera examples that use several major scripts, grouped in one folder. The package contains over thirty five demo scenes. In addition to the Azure Kinect, Femto Bolt and Femto Mega sensors, the K4A-package supports Kinect-v2 camera (aka Kinect for Xbox One), as well as iPhone-Pro LiDAR cameras.
Web | Forum | Twitter/X | LinkedIn | Docs | Tips&Tricks
The avatar-demo scenes show how to utilize Kinect-controlled avatars in your scenes, gesture demo – how to use discrete and continuous gestures in your projects, fitting room demos – how to overlay or blend the user’s body with virtual models, background removal demo – how to display user silhouettes on virtual background, point cloud demos - how to present the real environment or users as meshes in your scene, etc. Short descriptions of all demo-scenes are available in the online documentation.
This package works with Azure Kinect, Femto Bolt and Femto Mega sensors, Kinect-v2 (aka Kinect for Xbox One) and iPhone-Pro LiDAR sensors. It can be used with all versions of Unity – Free, Plus & Pro.
If you need a package with similar functionality, components and demo scenes that works with regular cameras, please look at Computer Vision Examples for Unity.
How to Run the Demo Scenes:
1a. (Azure Kinect) Download and install the latest release of Azure-Kinect Sensor SDK. The download link is below. Then open 'Azure Kinect Viewer' to check, if the sensor works as expected.
1b. (Femto Bolt and Mega) Download and unzip the latest release of Orbbec Viewer, as well as Orbbec SDK K4A Wrapper. The download links are below. Then first open 'Orbbec Viewer' and then 'K4A Viewer' to check, if the sensor works as expected.
2. (Azure Kinect and Femto Bolt/Mega) Follow the instructions on how to download and install the latest release of Azure-Kinect Body Tracking SDK. It is used by all body-tracking related scenes, regardless of the camera. The download link is below.
3. (Kinect-v2) Download and install Kinect for Windows SDK 2.0. The download link is below.
4. (iPhone Pro) For integration with the iPhone Pro's LiDAR sensor, please look at this tip.
5a. Import this package into a new Unity project.
5b. (Femto Bolt and Mega) Please follow the steps in this tip.
6. Open ‘File / Build settings’ and make sure that ‘Windows’ is the current active platform, and the architecture is set to 'Intel 64 bit'.
7. Make sure that 'Direct3D11' is the first option in the ‘Auto Graphics API for Windows’-list setting, in 'Player Settings / Other Settings / Rendering'.
8. Open and run a demo scene of your choice from a subfolder of the 'AzureKinectExamples/KinectDemos'-folder. Short descriptions of all demo-scenes are available in the online documentation.
* The latest Azure Kinect Sensor SDK (v1.4.1) can be found here.
* The latest release of Orbbec Viewer can be found here.
* The latest Orbbec SDK K4A-Wrapper (K4A Viewer) can be found here.
* The latest Azure Kinect Body Tracking SDK (v1.1.2) can be found here.
* Older releases of Azure Kinect Body Tracking SDK can be found here.
* Instructions how to install the body tracking SDK can be found here.
* Kinect for Windows SDK 2.0 can be found here.
* RealSense SDK 2.0 can be found here.
One request:
Please don't share this package or its demo scenes in source form with others, or as part of public repositories, without my explicit consent.
Troubleshooting:
* If the Femto camera only updates user pose once then stops, please open the camera in 'k4aviewer' (part of Orbbec's K4A-wrapper) and check if the timestamps of the camera streams are still rolling. If they've stopped, please repeat step 3b of this tip. Then run again 'k4aviewer' and the Unity project, to check if the camera works without issues.
* If Unity editor freezes or crashes at the scene start, please make sure the path where the Unity project resides does not contain any non-English characters.
* If you get errors like ‘Texture2D’ does not contain a definition
Description sourced from the Unity Asset Store listing.