Controlling
Last updated
Last updated
This section will explore mediums users can use to convert their thoughts and actions (input) into the mixed-reality world.
As of the current version, there are two 3 Degree-of-Freedom hand-held controllers as well as the 6 Degree-of-Freedom head position gaze. Other means of controlling, like 6DoF controllers, voice and hand gesture input are being actively worked on and will be made available in the near future.
Controlling with a light and minimal disk shaped controller that measures self rotation but not its own position.
Features
3 DoF (rotation) hand tracking
Suitable for most ray based selection and manipulation when the ray center does not have to be controlled by hand.
6 DoF head tracking-based ray center
You can translate and rotate the controller's ray center by moving your head.
Pressable buttons
Gesture compatible trackpad
Feedbacks
Controller vibration
Common visual feedback
on hover - possible feedbacks include subject enlargement, change in color, animation from static, and bounding box.
on select - possible feedbacks include subject pulsates in size, brightness, and bounding box color.
Common auditory feedback
on enter
on select
on step backwards
on ray reset
on manipulation through trackpad swipes
You can use the phone as a 3 DoF controller that is essentially identical to the previously mentioned disk shaped 3 DoF controller. To make controlling even easier though, the phone utilizes its extra space for a few added swipe gestures.
Features
3 DoF (rotation) hand tracking
Suitable for most ray-based selection and manipulation, when the ray center does not need to be controlled by hand.
6 DoF head tracking-based ray center
You can translate and rotate the controller's ray center by moving your head.
Gestures compatible touchscreen
Feedbacks
Phone vibration
Common visual feedback
on hover - possible feedbacks include subject enlargement, change in color, animation from static, and bounding box.
on select - possible feedbacks include subject pulsates in size, brightness, and bounding box color.
Common auditory feedback
on enter
on select
on step backwards
on ray reset
on manipulation through trackpad swipes
Controlling with the position and direction that the user is facing. It is best to use gaze in coordination with controller methods to enhance user experience. However, on rare occasions where both of the user's hands are occupied, gaze can be used to provide a dependable way for targeting and selecting.
Features
6 DoF Head Tracking
Suitable for areal attention directing
6 DoF Head Tracking with vision center
Suitable for targeting during extremely light interactions
Suitable for targeting when both hands are not available
Feedbacks
Visual feedback
on areal attention - possible feedbacks include subject enlargement, coloration, and start of animation. This effect is created by including a "not looking" mode where the app is less pronounced when attention is not directed to it. Some apps can go to sleep when they leave attention for a given amount of time.
on enter - possible feedbacks include subject enlargement, change in color, animation from static, and bounding box.
on select - possible feedbacks include subject pulsates in size, brightness, and bounding box color.
on dwell select - display timer over vision center.
Auditory feedback
on enter
on select
To learn more on the details in developing apps that utilizes controllers and even try out a sample app, check out the XREAL Controller Guide.
| Button | Action | Example Use Case |
|---|---|---|
| Gesture | Example Use Case |
|---|---|
| Common Use Case | Action | Vibration Count | Vibration Duration |
|---|---|---|---|
| Gesture | Exemplar Use Case |
|---|---|
| Common Use Case | Action | Vibration Count | Vibration Duration |
|---|---|---|---|
Track pad
Click Hold Double Click
Select Manipulation - Drag Manipulation - Lock-on
Home (Bottom)
Click Long Press
Open HomePage Reset laser
Left
Click
Last item to the left
Right
Click
Next item to the right
Swipe from bottom to top
Shuffling menu items to the top [on Hover] Rotating objects to face up [Locked-on] Moving objects further away
Swipe from top to bottom
Shuffling menu items to the bottom [on Hover] Rotating objects to face down [Locked-on] Moving objects closer
Swipe from left to right
Shuffling menu items to the right [on Hover] Rotating objects to face right [Locked-on] Enlarging objects
Swipe from right to left
Shuffling menu items to the left [on Hover] Rotating objects to face left [Locked-on] Shrinking objects
On entering a selectable object
--
single
short
Select
On release
single
short
Step backwards
On release
double
short
Ray reset
On press
single
long
Returning to launcher
On hold On execution
single single
on hold short
Selecting an adjacent object through swipe or click
On execution
single
short
Object manipulation via swipe or circle drawing
On finger movement
multiple
very short
Tap on trackpad
Select
Press and hold on trackpad
Manipulation (Drag)
Double tap on trackpad
Manipulation (Lock-on)
Tap on home (bottom) Swipe from either edge towards the center
Back a step
Long press on home (bottom)
Reset laser
Tap on app (top)
Ray reset
Swipe from left to right
Shuffling menu items to the right [on Hover] Rotating objects to face right [Locked-on] Enlarging objects
Swipe from right to left
Shuffling menu items to the left [on Hover] Rotating objects to face left [Locked-on] Shrinking objects
Swipe from bottom to top
Shuffling menu items to the top [on Hover] Rotating objects to face up [Locked-on] Moving objects further away
Swipe from top to bottom
Shuffling menu items to the bottom [on Hover] Rotating objects to face down [Locked-on] Moving objects closer
On entering a selectable object
--
single
short
Select
On release
single
short
Step backwards
On release
double
short
Ray reset
On press
single
long
Returning to launcher
On hold On execution
single single
on hold short
Selecting an adjacent object trough swipe or click
On execution
single
short
Object manipulation via swipe or circle drawing
On finger movement
multiple
very short
