Fully voice (pitch) control Super Mario Bros., an extremely hard new challenge.
First episode (to 8-1): • I Play Super Mario Bros. with My Voic...
My method: I use pitch detection with Waves Tune Real-Time, and I've written an AutoHotKey script to read note information from the screen.
The voice input delay using this method is large, making it extremely difficult to do precise jumps and movements.
I set 13 notes, from A2 to G4, combining them with key inputs, listed on the screen. For example, when I sing B3, corresponding → + B, Mario runs to the right.
Please like and comment if you like this idea. Hopefully I'll beat SMB with my voice one day.
Please contact me if you can improve my technique to reduce the delay. Thanks.