Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

I'm actually already working on exactly that -- after trying it out on a couple of mini-games such as https://github.com/mristin/pop-that-balloon-desktop, https://github.com/mristin/cactusss-desktop and https://github.com/mristin/ski-leu-desktop.

Please let me know if you want to join forces! You can find my contact information at: https://github.com/mristin.

I figured that I don't mind my kids playing computer games as long as they move. The first stage for me is to find a workable approach to DOS games. In particular, I thought about adapting ski-leu to race games such as Outrun & ilks.




Excellent, I'll reach out! Your balloon game looks a bit more like my face keyboard interface: https://github.com/everythingishacked/CheekyKeys#readme


For some idea sourcing, you guys could consider mapping to musical notes as well. Then each melody maps to a particular dance.


Hmm like a camera-based full-body theremin?


>> I figured that I don't mind my kids playing computer games as long as they move.

These could also be of interest for inspiration as well - basic idea this Youtuber is doing is to use console gamer joystick re-mapper hardware to convert joycon acceleration readings to button presses/button combos.

Can you Lose weight by playing Breath of the Wild? - Ringfit Controller Mod Explained Version

https://www.youtube.com/watch?v=HYn3pWXMPF8

- Today we talk about the Ringfit Adventure controller mod for Zelda: Breath of the Wild. With this mod you can Exercise and play BotW at the same time.

I made a Ring Fit Adventure Mod for Mario Kart - Controller Bending

https://www.youtube.com/watch?v=CNZSfunw85A

- Today on Controller Bending we mod the Ring fit controller to play Mario Kart 8 Deluxe with. With this Ring-con mod you have to run to drive. Literally. Squeezing the ring-con activates items!

I'd imagine a lot of similar mods could be done via computer vision instead of using joycon accel readings.

I think the key would be to show up to a gaming console as a PS4/XBox controller instead of just a keyboard. I think there are Python libraries to do this [1] or just stick to Steam games that just need WASD controls. This allows you to tap into already huge library of high quality games and just focus on the OpenCV movement-> joystick button remapping part.

[1] Something like this - although it might be Windows only https://pypi.org/project/vgamepad/


Cool ideas!

I implemented a couple of mini-games using a dance mat as well:

https://github.com/mristin/dance-a-mole-desktop

https://github.com/mristin/judo-dance-desktop/

https://github.com/mristin/dance-cat-to-mouse

https://github.com/mristin/burpee-frog-desktop

https://github.com/mristin/dance-runaway-desktop

Dance mat could be even easier to integrate as it acts just as a normal joystick. The problem, though, is that many games expect reaction times achievable with a keyboard & mouse, but leg movements are a bit slower.

The problem with the dance mat is that you can not use it in a school class as you need extra equipment. It worked well in a dojo for my judo classes, though.


Cool stuff!


Demo is very cool, how do I run these games on Unix? Looks like it's an exe file. Is there a way to build this myself.


I'll try to package it for Linux this morning. So far nobody asked for it.


Even instructions on which python files to run would also work for me :)


You can find the packages here:

https://github.com/mristin/ski-leu-desktop/releases/download...

https://github.com/mristin/pop-that-balloon-desktop/releases...

If you want to run the code manually, install it in the virtual environment. Then you can simply run commands `ski-leu` or `pop-that-balloon`.

Btw., I use pop-that-balloon for basketball dribbling training, and a friend uses it for boxing. Have fun & please let me know if you use it for yet another sport :).

Edit: removed bullet points




Consider applying for YC's Fall 2025 batch! Applications are open till Aug 4

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: