Check out our Monthly Survey Page to see what our users are running.
We do often include affiliate links to earn us some pennies. See more here.

Virtual Reality and Augmented Reality (XR) is continuing to be a very interesting space with lots of innovation going on and Collabora are at the front of this with Monado, the open source OpenXR runtime.

Reminder: Monado is the first OpenXR runtime for Linux. Monado aims to jump-start development of an open source XR ecosystem and provide the fundamental building blocks for device vendors to target the GNU/Linux platform.

In a recent blog post update, the team behind it talked about ways of tracking hand poses and the challenges that come along with it. So what are they doing to improve it? Hooking up Machine Learning / AI instead of just relying on vision-based methods of tracking.

[…] as part of a project backed by INVEST-AI, a program managed by IVADO Labs, we have developed a multi-stage neural network-based solution that accurately locates and tracks the hands despite complex background noise and occlusion between hands […]

Marcus Edel, Collabora

Check out their demo in the below video:

YouTube Thumbnail
YouTube videos require cookies, you must accept their cookies to view. View cookie preferences.
Accept Cookies & Show   Direct Link

See the full post for all the details, they'll be sharing more another day.

It's impressive work, and anything that can help the accuracy is going to help the overall experience, especially while gaming. Looking forward to seeing what Collabora come up with next as Monado matures.

Article taken from
About the author -
author picture
I am the owner of GamingOnLinux. After discovering Linux back in the days of Mandrake in 2003, I constantly came back to check on the progress of Linux until Ubuntu appeared on the scene and it helped me to really love it. You can reach me easily by emailing GamingOnLinux directly. Find me on Mastodon.
See more from me
The comments on this article are closed.
1 comment

scaine Apr 26, 2021
View PC info
  • Contributing Editor
  • Mega Supporter
That's incredibly cool. I suppose they'll have to factor that recognition when holding a Valve Knuckle too though, since you'll stick want to use the various capabilities of those devices, like the thumbstick, A/B buttons and sliders.
While you're here, please consider supporting GamingOnLinux on:

Reward Tiers: Patreon. Plain Donations: PayPal.

This ensures all of our main content remains totally free for everyone with no article paywalls. We also don't have tons of adverts, there's also no tracking and we respect your privacy. Just good, fresh content. Without your continued support, we simply could not continue!

You can find even more ways to support us on this dedicated page any time. If you already are, thank you!
The comments on this article are closed.