Future Rhythm Games

Here’s a visualization of what rhythm games/music trainers of the future might look like:

YouTube Preview Image

There’s currently a trainer/game for midi keyboards called Synthesia that is already similar. What we have here though is visualization of integration of an augmented reality heads-up display for the “piano roll” style of note scrolling. Bemani’s Keyboardmania is also very similar – it would be interesting to see if any Keyboardmania players picked up real piano skills, but my money’s on the fact that most players of that game probably had some previous piano instruction to begin with (look it’s an Asian thing ok).

I’m not sure if the guitar/bass visualization would necessarily work without a wider fretboard that could be projected above the real fretboard for note comprehension. Additionally, the bars might benefit from having numbers to reinforce which fret needs to be fretted. Also, this method does not address what bends, pinch harmonics, or other more advanced guitar techniques would look like. If we’re working in 3d space, a bend might be represented by the note “widening” as it goes into the fretboard, but it would be difficult to convey exactly how far the bend needs to go.

Drums face the problem of a single plane of reference for where the downbeat is. This visualization is admittedly almost unusable as a training technique, but golly it sure looks cool.

Production on this video was pretty basic – just shot some plates from a rough POV perspective of me running through the various instruments of the song. Then, in Photoshop, I created a super long image for Brandon to lay in for the correct notes. The song is composed very specifically in such a way to minimize a lot of work in the post production (guitar solo basically sticks to one note, e.g.). Post wise, it’s simply a matter of matching the notes with the plate, where I played along to the song.



46 Responses to “Future Rhythm Games”

  1. [...] de agosto de 2010 – Compartir / Guardar Así van a ser los juegos como Rock Band. Por lo menos eso cree Freddie Wong, autor de esta animación sobre el futuro de los juegos de ritmo y de entrenamiento musical en [...]

  2. haddip says:

    How many hours did you spend on this ?

  3. [...] real instruments. Guitar geek Freddie W. has answered with the most convincing affirmative to date: 'Future Rhythm Games.' Freddie doesn't think it's practical quite yet, but we, to paraphrase that song from 'Rock Band 2,' [...]

  4. Alan says:

    Please do a full version of this music! i would buy at itunes :D

  5. [...] Por cierto, que Gizmodo os traerá dentro de poco una sorpresita Bemani, fans del Guitar Hero estad atentos porque en las próximas semanas os mostraremos algo muy especial que os va a encantar, no puedo deciros justo cuando pero os puedo asegurar de que os va a gustar…— ani Burón [Freddiew] [...]

  6. mbhunter says:

    You’ve solved the only problem I have with RB: the instruments aren’t the real thing.

    This idea is worth tens of millions.

  7. [...] real instruments. Guitar geek Freddie W. has answered with the most convincing affirmative to date: ‘Future Rhythm Games.’ Freddie doesn’t think it’s practical quite yet, but we, to paraphrase that song from [...]

  8. [...] Band – Official Website | Lowyat.NET Forums – [PlayStation 3 | Wii | Xbox 360] Freddie Wong – Official Website | YouTube [...]

  9. Are the instruments’ glows actually tracking the instruments’ silhouettes, or are they just blurry images in the shape of the instruments that are tracking the movement of the instruments?

  10. sarah says:

    wow this was truly awsome i love your vidoes me and my brother watch them all the time i am truly a big fan

  11. [...] real instruments. Guitar geek Freddie W. has answered with the most convincing affirmative to date: ‘Future Rhythm Games.’ Freddie doesn’t think it’s practical quite yet, but we, to paraphrase that song from [...]

  12. michael says:

    Haha, who’s feet is that in the upper left corner around 0:43-0:47? Love your work Freddie.

  13. [...] Rhythm Games Blogpost and Video September 2nd, 2010 | mosm | Category: English, Game, [...]

  14. Bilingual keyboards sometimes create a lot of work.

  15. Wilton Musto says:

    Finally, I located the information I was searching for. I have been doing research on this subject, and for four days I keep finding websites that are supposed to have what I am looking for, only to be disappointed with the lack of what I wanted. I wish I would have located your website quicker! I had about 25% of what I needed and your web-site has that, and the rest of what I need to finish my research. Thank you and I will report back on how it goes!

  16. Mike Boyne says:

    This is excellent inforation – thanks for the write up. I really enjoy your blog and will be certainly coming back.

  17. Awesome Post, thanks for your fine Post. I will come back later . Great information about learning and mastering the guitar: learn and master guitar

  18. Teddy Gerych says:

    Great Post, thanks for this fine Post. I will come back soon ? Great information about ps3 hacks: PS3 Hack

  19. Hello; Cool informations for me. Your post has good quality. I want to has valuable posts like yours in my blog. How do you find these posts? And you have a problem about your template.You should fix your problem about your template … I recently came across your blog and have been readingalong. I think I would leave my first comment. I don’t know what to say except that I have enjoyed reading. Great blog. I will keep reading this website very often.Good day…

  20. rihanna_tour says:

    “The fame of great men ought always to be estimated by the means used to acquire it.”

  21. [...] Official Website | Lowyat.NET Forums – [PlayStation 3 | Wii | Xbox 360] Freddie Wong – Official Website | YouTube [...]

  22. I just discovered the web site through Bing search engine. You truly created a meaningful point. In the future I Really like to read new posts from your weblog.

  23. Lol this guy says he discovered some Runescape hacks… do you think he’s kidding? Is that even possible since Runescape is a client side MMORPG?

  24. health says:

    I wish success to a very high quality posts./12.01.2011 23:17:19

  25. Devin Arthur says:

    Sorry for the huge review, but I’m really loving the new Zune, and hope this, as well as the excellent reviews some other people have written, will help you decide if it’s the right choice for you.

  26. video says:

    OMG. This is awsome. Thank you

  27. Hey There. I found your blog using msn. This is a really well written article. I’ll make sure to bookmark it and return to read more of your useful info. Thanks for the post. I will definitely return.

  28. Have you at any time considered as about which include a small little bit way in surplus of just your articles? I mean, anything you say is beneficial and everything. however envision from the event you added some very good pics or movies to produce your posts more, “pop”! Your content material is great but with pics and video clip clips, this web page could undeniably be one unique while using instead best in its niche. very good blog!

  29. Kenda Franze says:

    Excellent blog! Do you have any helpful hints for aspiring writers? I’m planning to start my own blog soon but I’m a little lost on everything. Would you propose starting with a free platform like WordPress or go for a paid option? There are so many choices out there that I’m completely overwhelmed .. Any suggestions? Many thanks!

  30. I will begin a series of articles about games and the steps involved. Articles will cover fundamentals of the game preparation, and conduct pedagogical approach animator. And then the good part is that more posts will follow with games following certain criteria that will help. Spor posts and expect to follow suggestions. cooking games[/url

  31. Its your inspiration that drives you to post great things like this, keep it going, we will support you all the way.

  32. Russel Gruba says:

    I actually such as this blog, please don’t quit!

  33. Joshua H says:

    Cool man… that would be pretty sick

  34. Amparo Beser says:

    You will need to wait a matter of seconds while the camera resets and also refocuses for an additional shot. Took me a short time to read all of the remarks, but I really appreciated the content. This proved to be really beneficial to me and I am certain to all the commenters here! It really is continuously good whenever feasible not just learn, but additionally engaged! Now i’m good you’d enjoyable writing this post.

  35. Terry Danoff says:

    Can you concept myself with some tips about how exactly you have made this website seem this particular awesome, I’d enjoy it!

  36. When operated Twenty-four hours during Per day weeks, the majority of activity happens when the Town Stock market is undoubtedly receptive. In addition keep in mind that current market might be conventionally a bit more unstable mid-week, and then more calm over Mon in addition to vendredi1.

  37. Sylvia Nasar says:

    all your videos totally awesome! today i subscribe your youtube channel, i see many your video talks about future :) i like this!

  38. Superb website…

    [...]always a big fan of linking to bloggers that I love but don’t get a lot of link love from[...]……

  39. game says:

    Goodarticle. Just what I was trying to find!

  40. Vashti Macbride says:

    Enjoy full videos absolutely free

  41. sex cams says:

    Ultimately, I located the information I used to be shopping for. I’ve been doing analysis on Morpeth Rant, and for four days I maintain finding sites which might be alleged to have what I’m looking out for, solely to be discouraged with the shortage of what I needed. I wish I would have stumbled on your website online sooner! I had about 25% of what I was hunting for and your site has that, and the rest of what I needed to have to end my research. Thanks and sustain the great work!

  42. seo says:

    Simply desire to say your article is as astonishing. The clarity in your post is simply nice and i could assume you are an expert on this subject. Well with your permission allow me to grab your RSS feed to keep updated with forthcoming post. Thanks a million and please carry on the enjoyable work.

  43. Fanny Lassa says:

    The name will live on . . Rest In Peace Sergio (you lived a great life)

  44. Anna Davis says:

    Anna Davis…

    [...]i The info is a great help to me, thanks you so much. m nj[...]…

Leave a Reply