Instant Musician is an iOS app that guides people through playing music on the piano. It leverages ARKit, and is a sister product to our award-winning HoloLens app, Music Everywhere. This product is the second AR music app from my startup Music Everywhere, Inc which consists of one programmer, one musician and one designer - me.
My Role
I built the design (ui/ux, interaction, visual) of Instant Musician on the iPhone with ARKit technology from scratch, and led the team to launch the product on the U.S Apple App store.
AR On Your Phone - A Shortcut To Play
Using Augmented Reality with mobile phones, we let people bypass this tough music learning curve, and skip to fun part - playing songs!
It takes 6 months~1year to learn how to play songs
With Instant Musician, users can play songs in 1 day
User Persona
Lee used to play piano when she was a kid. However, she felt left behind by traditional music education, and eventually dropped out. Now, she is a young professional, and wanted to pick it up piano again, but she has no time to practice.
Time to Play!
In Instant Musician, users can play songs they like from the Songbook with the AR guidance system easily.
1. Spawn the AR interface with a dollar bill
2. Pick a song from Songbook
3. Prepare to play
4. Play and hit all the notes! :)
Visual Elements
Below are the visual materials I created that represented our app’s design and experience.

