Join us on the Linux Gaming community on Lemmy, the federated open source alternative to Reddit.

Virtual Reality and Augmented Reality (XR) is continuing to be a very interesting space with lots of innovation going on and Collabora are at the front of this with Monado, the open source OpenXR runtime.

Reminder: Monado is the first OpenXR runtime for Linux. Monado aims to jump-start development of an open source XR ecosystem and provide the fundamental building blocks for device vendors to target the GNU/Linux platform.

In a recent blog post update, the team behind it talked about ways of tracking hand poses and the challenges that come along with it. So what are they doing to improve it? Hooking up Machine Learning / AI instead of just relying on vision-based methods of tracking.

[…] as part of a project backed by INVEST-AI, a program managed by IVADO Labs, we have developed a multi-stage neural network-based solution that accurately locates and tracks the hands despite complex background noise and occlusion between hands […]

Marcus Edel, Collabora

Check out their demo in the below video:

YouTube Thumbnail
YouTube videos require cookies, you must accept their cookies to view. View cookie preferences.
Accept Cookies & Show   Direct Link

See the full post for all the details, they'll be sharing more another day.

It's impressive work, and anything that can help the accuracy is going to help the overall experience, especially while gaming. Looking forward to seeing what Collabora come up with next as Monado matures.

Article taken from
We do often include affiliate links to earn us some pennies. We are currently affiliated with GOG and Humble Store. See more here.
About the author -
author picture
I am the owner of GamingOnLinux. After discovering Linux back in the days of Mandrake in 2003, I constantly came back to check on the progress of Linux until Ubuntu appeared on the scene and it helped me to really love it. You can reach me easily by emailing GamingOnLinux directly.
See more from me
1 comment

scaine 26 Apr
View PC info
  • Contributing Editor
  • Mega Supporter
That's incredibly cool. I suppose they'll have to factor that recognition when holding a Valve Knuckle too though, since you'll stick want to use the various capabilities of those devices, like the thumbstick, A/B buttons and sliders.
While you're here, please consider supporting GamingOnLinux on:

Patreon, Liberapay or PayPal Donation.

This ensures all of our main content remains totally free for everyone with no article paywalls. We also don't have tons of adverts, there's also no tracking and we respect your privacy. Just good, fresh content. Without your continued support, we simply could not continue!

You can find even more ways to support us on this dedicated page any time. If you already are, thank you!
Login / Register

Or login with...
Sign in with Steam Sign in with Twitter Sign in with Google
Social logins require cookies to stay logged in.