NVIDIA AR Body Tracker Skeleton
Control skeletal rigs from a camera feed with NVIDIA AR.
NVIDIA AR Body Tracker Skeleton
Method #
This node applies the tracked skeleton from the NVIDIA AR Body Tracker to the skeleton of a connected rigged character.
This node requires the installation of the NVIDIA AR SDK, which can be downloaded here : NVIDIA AR SDK. Make sure you get the correct driver for your GPU, Turing (20XX), Ampere (30XX) and Ada (40XX) use different drivers and they are not cross compatible.
For best results, use a character with a rig generated from Mixamo. Other skeletons can be used, but results may vary.
This node outputs the normal transformation and translation values, but it also outputs geometry which can be modified with Deformer nodes, or used as a mesh sources for nodes which accept mesh connections, such as the Field 3D Object Emitter or the Procedural 3D Object.
Parameters
These properties control the 3D transforms of the node. Transforms will generally be inherited by child nodes, although they can be ignored through the Inherit Transform Channels attributes.
Parameter Details
Position X Move along the local x-axis.
Position Y Move along the local y-axis.
Position Z Move along the local z-axis.
Rotation Heading Rotate around the local y-axis.
Rotation Pitch Rotate around the local x-axis.
Rotation Bank Rotate around the local z-axis.
Scale X Scale along the local x-axis.
Scale Y Scale along the local y-axis.
Scale Z Scale along the local z-axis.
Toggle which transform channels should be inherited from the parent node. By default, all transforms will be inherited.
Parameter Details
Position X Toggle inheritance of the X Position from the parent.
Position Y Toggle inheritance of the Y Position from the parent.
Position Z Toggle inheritance of the Z Position from the parent.
Rotation Heading Toggle inheritance of the Rotation Heading from the parent.
Rotation Pitch Toggle inheritance of the Rotation Pitch from the parent.
Rotation Bank Toggle inheritance of the Rotation Bank from the parent.
Scale X Toggle inheritance of the X Scale from the parent.
Scale Y Toggle inheritance of the Y Scale from the parent.
Scale Z Toggle inheritance of the Z Scale from the parent.
World Position Only Inherit the world position from the parent only, rotation and scale will be ignored. Overrides above properties.
Inherit Time Toggle inheritance of time from the parent.
These properties control the core behaviours of the node.
Parameter Details
Input Skeleton Scale Scale the size of the input skeleton.
Smoothing How much smoothing is applied to the output skeletons motion.
Mirrored Mirror the movements of the incoming mobcap data along the x axis.
Flip Z Flip the Z axis of the skeleton, to match a model with a flipped z axis.
Tracking Confidence Threshold Threshold for how confident the tracking data needs to be before applying to the skeleton rig.
Inputs
These properties control the 3D transforms of the node. Transforms will generally be inherited by child nodes, although they can be ignored through the Inherit Transform Channels attributes.
| Parameter | Details |
|---|---|
| Position X | Move along the local x-axis. |
| Position Y | Move along the local y-axis. |
| Position Z | Move along the local z-axis. |
| Rotation Heading | Rotate around the local y-axis. |
| Rotation Pitch | Rotate around the local x-axis. |
| Rotation Bank | Rotate around the local z-axis. |
| Scale X | Scale along the local x-axis. |
| Scale Y | Scale along the local y-axis. |
| Scale Z | Scale along the local z-axis. |
Toggle which transform channels should be inherited from the parent node. By default, all transforms will be inherited.
| Parameter | Details |
|---|---|
| Position X | Toggle inheritance of the X Position from the parent. |
| Position Y | Toggle inheritance of the Y Position from the parent. |
| Position Z | Toggle inheritance of the Z Position from the parent. |
| Rotation Heading | Toggle inheritance of the Rotation Heading from the parent. |
| Rotation Pitch | Toggle inheritance of the Rotation Pitch from the parent. |
| Rotation Bank | Toggle inheritance of the Rotation Bank from the parent. |
| Scale X | Toggle inheritance of the X Scale from the parent. |
| Scale Y | Toggle inheritance of the Y Scale from the parent. |
| Scale Z | Toggle inheritance of the Z Scale from the parent. |
| World Position Only | Inherit the world position from the parent only, rotation and scale will be ignored. Overrides above properties. |
| Inherit Time | Toggle inheritance of time from the parent. |
These properties control the core behaviours of the node.
| Parameter | Details |
|---|---|
| Input Skeleton Scale | Scale the size of the input skeleton. |
| Smoothing | How much smoothing is applied to the output skeletons motion. |
| Mirrored | Mirror the movements of the incoming mobcap data along the x axis. |
| Flip Z | Flip the Z axis of the skeleton, to match a model with a flipped z axis. |
| Tracking Confidence Threshold | Threshold for how confident the tracking data needs to be before applying to the skeleton rig. |
| Name | Description | Typical Input |
|---|---|---|
| NVIDIA AR Body Tracker | Required body tracker input, for generating a tracked skeleton | NVIDIA AR Body Tracker |
| Hierarchy Root | Connect the skeleton root node to drive the rest of the skeleton from. | Imported 3D Scene |
| Transform Modifiers | Apply the transforms of another node to this node. | Null |
| Target Node | Modifiy the rotations of the node to always direct the z axis towards the input. | Null |
| Local Transform Override | Apply the transforms of another node to this node, relative to its parent. | Null |