ofxAddon that allows you to use Azure Kinect in openFrameworks.
- Get depth, color, depth to world, and color in depth frames as
ofPixelsorofTexture. - Get point cloud VBO with texture coordinates in depth space.
- Get body tracking skeleton and index texture.
- Use multiple sensors per machine (tested up to 4!)
- Set up sync mode (standalone, master, subordinate) with multiple devices when connected with sync cables.
- Record and playback streams.
Forked from prisonerjohn/ofxAzureKinect, added example-pointcloudonly and improved addons setup for Windows.
The instructions below are based on the Azure Kinect Sensor SDK Usage page.
- Install the Azure Kinect Sensor SDK.
- Copy c:\Program Files\Azure Kinect SDK v1.4.1\sdk contents to ofxAzureKinect\libs\azure_sdk
- For each project copy all DLLs from azure_sdk into project's bin folder
For body tracking:
-
Install the Azure Kinect Body Tracking SDK. 5 Add an environment variable for
AZUREKINECT_BODY_SDKand set it to the Body SDK installation path (no trailing slash). The default isC:\Program Files\Azure Kinect Body Tracking SDK. -
Clone this repository in your openFrameworks
addonsfolder. -
Use the OF Project Generator to generate projects with the appropriate headers and libraries included.
Windows:
- Copy ofxAzureKinectConfig.h from any of examples to project's src folder.
- Copy all DLLs from libs/azure_sdk to project's bin folder
- To use body tracking:
- Uncomment #define USE_BODYTRACKER at ofxAzureKinectConfig.h
- Copy all DLLs, PDB, JSON and XML from libs/azure_body_sdk to project's bin folder
- Copy the cuDNN model file
dnn_model_2_0.onnxfrom the Body SDKtoolsfolder into your project'sbinfolder!
- Build as x64 (not 32 bit)
- Configure the Linux Software Repository for Microsoft. Note that for Ubuntu you'll need to set up the repo for 18.04 even if you're running newer versions.
- Install the Azure Kinect Sensor SDK packages:
libk4a1.3libk4a1.3-devk4a-tools - Install the Azure Kinect Body Tracking SDK packages:
libk4abt1.0libk4abt1.0-dev - Setup udev rules by copying this file to
/etc/udev/rules.d/99-k4a.rules. - Install libjpeg-turbo.
- Clone this repository in your openFrameworks
addonsfolder. - You can then use the OF Project Generator to generate projects with the appropriate headers and libraries included.
Tested with:
- openFrameworks 0.10.x / 0.11.x
- Windows 10, Visual Studio 2017 / 2019
- Ubuntu 19.10, Qt Creator
example-pointcloudonlydemonstrates pure point cloud renderingexample-pointClouddemonstrates how to draw the basic point cloud VBO from the device.example-streamsdemonstrates how to get depth, color, infrared textures from the device.example-shaderdemonstrates how to reconstruct a point cloud using LUTs in a shader.example-bodiesdemonstrates how to get the body tracking index texture, and skeleton joint information.example-multidemonstrates how to use multiple devices in a single app.example-recorddemonstrates how to record and playback device streams.
Use the OF Project Generator to create the example project files. If everything is installed correctly, it should properly locate all required include and library files. Also on Windows do the following:
- Copy all DLLs, PDB, JSON and XML from libs/azure_sdk to project's bin folder
- If example uses body tracking:
- Uncomment #define USE_BODYTRACKER at ofxAzureKinectConfig.h
- Copy all DLLs from libs/azure_body_sdk to project's bin folder
- Copy the cuDNN model file
dnn_model_2_0.onnxfrom the Body SDKtoolsfolder into your project'sbinfolder!
- Build as x64 (not 32 bit)