Zack freedman made a video [0] last year where he created a wearable glove that tracked hand movements to achieve something similar to what you describe. Seemed really cool, and I'm sure we will get something better than this in the not-too-distant future.
[0]: https://www.youtube.com/watch?v=6raRftH9yxM
Zack is a good guy, I ran into him at a conference years ago, where I was wearing my own mobile setup with a HUD and a Twiddler and we hit it off b/c we were both trying to solve the same problems, however his design was way better!
I'm glad to see this iteration, as it looks like it is getting closer and closer to reality. He is definitely on the cutting edge of these things in terms of usability.
Definitely cool! I guess I'm just being impatient. I would definitely like to be an early adopter of this type of tech. I'm kinda sad the initial mainstream hype around wearables died down so quickly, but looks like I need to source out details specifically for more info. Thanks for sharing!