🕶️
NRSDK(Old)
New DocumentationSDK DownloadAPI Reference
v2.2.1
v2.2.1
  • NRSDK Fundamentals
    • NRSDK Overview
    • XREAL Devices
      • XREAL Glasses
      • Controller
      • Compatibility
    • Getting Started with NRSDK
    • Sample Code
    • Tutorials
    • Release Note
      • NRSDK 2.2.1
      • NRSDK 2.2.0
      • NRSDK 2.1.1
      • NRSDK 2.1.0
      • NRSDK 1.10.2
      • NRSDK 1.9.5
      • NRSDK 1.9.3
      • NRSDK 1.9.1
      • NRSDK 1.8.0
      • NRSDK 1.7.0
      • NRSDK 1.6.0
  • Development
    • Input and Camera
      • NRInput
      • Interact with Unity UI (Tutorial)
      • Customize Controller UI
      • NRCameraRig
    • Hand Tracking
    • Image Tracking
      • XREAL Markers
    • Plane Detection (Tutorial)
      • Overview
      • Import the package
      • Detect planes in the real world
      • Perform a hit test against detected planes
      • Add a car
      • Add gems
      • Wrap up
    • Depth Mesh
      • Meshing Manager Overview
      • Use Meshes in the Editor
      • Tutorial: Mesh Collision
    • Spatial Anchor
      • Mapping Example Scene
      • Tutorial: Halloween Treasure Hunt
        • Handle the Situation of Failed Anchor Saving
      • Tutorial: Sharing Anchors
        • Setting Up Photon
        • Cloud Storage: Firebase (optional)
        • Cloud Storage: Aliyun OSS (optional)
        • Implementing Cloud Save and Load
        • Sharing Anchors with Photon
    • Tools
      • Single Pass Stereo Rendering
      • First Person View
      • Emulator
      • XR Streaming
      • Dual Screen Display
    • Miscellaneous
      • Access RGB Camera
      • NRSDK Coordinate Systems
      • MRTK2 Integration
      • MRTK3 Integration
      • Notification popup
      • Reset Camera
      • Render Metrics
      • Render MonoMode(Obsolete)
  • API Reference
  • Frequently Asked Questions
  • Design Guide
    • Design Guide Overview
    • Displaying
    • Interacting
    • Controlling
    • Navigating
Powered by GitBook
On this page
  • Overview
  • Examples and Scene Settings
  • Features

Was this helpful?

  1. Development
  2. Miscellaneous

MRTK2 Integration

NRSDK 1.9.3 & MRTK 2.8.0 Integration with Sample Projects

PreviousNRSDK Coordinate SystemsNextMRTK3 Integration

Last updated 1 year ago

Was this helpful?

Overview

This github repo () contains extension that adds compatibility for NRSDK, including hand tracking and controller support, to Microsoft's open source Mixed Reality Toolkit () for Unity.

Required Environments:

  • Unity 2020.3.X

  • MRTK 2.8.0

  • NRSDK 1.9.3

Examples and Scene Settings

This repo includes two projects, each containing several pre-configured scenes:

  • Assets/HandTrackingDemo

    • HandTrackingHub (Manager scene)

    • HandTrackingHubMainMenu

    • Clipping

    • ColorPicker

    • Dock

    • HandInteraction

    • HandMenu

    • HandMenuLayout

    • Joystick

    • NonNativeKeyboard

    • PressableButton

    • ScrollingObjectCollection

  • Assets/Surfaces

    • StartupScene (Manager scene)

    • Bubble

    • Ephemeral

    • Flock

    • Goop

    • Growbies

    • Lava

    • Lighting

    • Volume

    • Xylophone

These scenes do not require additional configuration and serve as a blueprint for XREAL's MRTK integration, while HandTrackingHub and StartupScene work as manager scene (configured via MRTK's Scene System) of each project respectively.

Features

This following MRTK Features are supported:

Supported Features in MRTK

  • Hand Tracking

  • Hand Meshing

  • Hand Skeleton / Gestures

  • XREAL Phone Controller / Dev Kit Controller

  • Gaze Input (aka Eye Tracking)

Unsupported Features in MRTK

  • Planes Detection

  • Native Keyboard

  • Voice Input (Using Google speech to text)

  • Scene Meshing

It also contains two open-source sample apps from Microsoft's Mixed Reality Design Labs - Hand Tracking Hub (originally as MRTK examples hub and Surfaces (), which demonstrates NRSDK's hand tracking algorithmic capabilities with MRTK's input system.

https://github.com/microsoft/MRDL_Unity_Surfaces
https://github.com/nreal-ai/NRSDK-MRTK
MRTK