Music Everywhere
Microsoft HoloLens AR Piano App | Apr.2017 - Dec.2017
Music Everywhere is the first product from my startup Music Everywhere, Inc. Our team consisted of two programmers, one musician and one designer—me. Our goal: build an Augmented Reality (AR) piano learning tool.
My Role
I led the design and built all UI components (2D/3D UI, animations) of Music Everywhere on the Microsoft HoloLens, and team’s global launch of the product on the Microsoft App store.
We won the 1st place in the Microsoft HoloLens Contest. Along with the $100K grand prize.
The Experience
With AR technology, we align the 3D interface (the piano instructions) directly on the physical piano keys. This makes discerning our AR instructions with the actual instrument easier and more intuitive.
To read more about the AR Interface Design, please see this NIME2017 paper my team published.
1. Pick a lesson package
3. A Virtual musician step towards the user to teach them how to play
2. Pick a lesson inside the package
4. Enjoy playing with the virtual band!
