I'm currently in my last quarter at the University of Washington, which of course means finishing up those one or two credits that you need. I chose to fulfill one of my science credits with PHYS 207: Physics of Music.
Now, this is a bit of a weird choice for me. While I'm not exactly tone deaf, I'm pretty close. A great example is the following video:
It's a great song, and makes many people cringe, but I can't really hear anything wrong with it.
Why is this important? It's really not, but it helps make the next part make a bit more sense. For Physics of Music, I'm apparently supposed to both write a term paper (easy) and perform musically in front of the class (terrible).
So I figured that I'd base my term paper on teaching someone (me) how to play piano! The title of my paper is:
Teaching Music Through Augmented Reality
Essentially, I am going to convert my Oculus Rift DK1 (An excellent pair of Virtual Reality goggles) into functional Augmented Reality goggles through the addition of two webcams. I will then create a virtual scene in which a pair of virtual hands play a piano piece. This virtual image will be overlaid onto the webcam textures, so the student will be able to follow the hands and play along.
This project was heavily inspired by William Steptoe's documentation of his AR-Rift. (The cameras I use, for example, are what he suggests).
Eventually, all of the hardware and software for this project will be opened and released... but first I need to actually build all of that!