We do often include affiliate links to earn us some pennies. See more here.

After working on it for a while, Collabora developer Moses Turner has announced that their "Mercury" hand-tracking for Monado, their open source XR runtime, is now ready for use.

Since it's been a while after last talking about Monado: "Monado is an open source XR runtime delivering immersive experiences such as VR and AR on mobile, PC/desktop, and other devices. Monado aims to be a complete and conformant implementation of the OpenXR API made by Khronos. The project is currently being developed for GNU/Linux and aims to support other operating systems such as Windows in the near future."

Work on the hand-tracking system has been going for over a year, and now ready for public use. Currently it works on the Valve Index, Windows Mixed Reality headsets (Reverb G2 v2 video below), Oculus Rift S (early support), and Luxonis cameras (video shows a OAK-D Pro W Dev mounted on a North Star). They said it "estimates hand pose accurately, supports limited hand-over-hand interactions, tracks fast hand movements, and is useable for drawing, typing and UI interaction".

YouTube Thumbnail
YouTube videos require cookies, you must accept their cookies to view. View cookie preferences.
Accept Cookies & Show   Direct Link

Makes me continue to wonder if Valve will be using Monado for the long rumoured Deckard VR HMD.

Article taken from GamingOnLinux.com.
13 Likes
About the author -
author picture
I am the owner of GamingOnLinux. After discovering Linux back in the days of Mandrake in 2003, I constantly came back to check on the progress of Linux until Ubuntu appeared on the scene and it helped me to really love it. You can reach me easily by emailing GamingOnLinux directly.
See more from me
3 comments

Julius Feb 28
I guess this is something Valve is at least partially funding for their rumoured Deckard standalone VR headset.
scaine Feb 28
View PC info
  • Contributing Editor
  • Mega Supporter
If you google Northstar VR, it sounds like they have a competing hand-tracking project, also open-source?? Or is it the same one... because it doesn't look the same!

https://developer.leapmotion.com/northstar

This looks incredible though, and I do especially like the idea of a Northstar mixed-reality headset, instead of the more fully immersive VR experience. Obviously they do very different things, of course.
Lachu Mar 3
I think it is place for Windows Hello, but I am not expert of it. Windows Hello is a set of IR cameras and normal cameras, so It could *probably* track hands.
While you're here, please consider supporting GamingOnLinux on:

Reward Tiers: Patreon. Plain Donations: PayPal.

This ensures all of our main content remains totally free for everyone with no article paywalls. We also don't have tons of adverts, there's also no tracking and we respect your privacy. Just good, fresh content. Without your continued support, we simply could not continue!

You can find even more ways to support us on this dedicated page any time. If you already are, thank you!
Login / Register

Or login with...
Sign in with Steam Sign in with Google
Social logins require cookies to stay logged in.