TuneTrain, Music Education iOS App

Spring 2013, TuneTrain(App Store), 200,000+ download, a music education iOS Application, encourage children to create music by drawing. Position: Programmer for Voice Detection, Midi-to-Notation Algorithm, Sequencer (team of 7)

cover

 

We are creating a stimulating experience that is easy to use, highly educational, and fun to play with. Kids are able to utilize gestural touchscreen interactions to generate melodic phrases. At the same time, they will learn about how music is put together without any need of prior musical instruction. With the aid of features like automatic audio accompaniment and pitch graph to sheet music conversion, children will have the power to create music that they are proud of and want to share with others.

 

 

 

Notation Generation Algorithm

Musical notation conversion is a system that helps to emphasize the musical foundations of the experience.  This feature processes the user’s drawn melody line into equivalent musical notation in real time . Transcribing a song to musical notation is a difficult algorithmic task that requires identifying many unique cases, such as when to beam notes together, or when to tie notes together . Implementing such a system requires an appreciable amount of time and can be intimidating, and I managed to finish the algorithm design and implementation within 3 weeks.

notation explaination

Notation work picture

 Prototyping Notation Generation Algorithm

 

Playtest with Elementary School Children

 

playtest2

 Internal Playtest

 

130508-4681

the Team Bravura!

Leave a Reply

Celestia, Vocal Interaction Game

Celestia, a vocal interaction music game, finalist of Indiecade 2014, showcase@PAX East 2014, showcase@ E3 2014, a poster at SIGGRAPH 2013, and one of ACM-CHI Game Competition Finalists(May 2013, Paris).

Celestia on Polygon!

Cheng’s Music

performance

 


Pulse Matrix, Audio Visualization Tool

August 2011, Pulse Matrix, sound visualization application, Independent work, Position: Programmer/Designer for audio and visual .

 

Be A Perfect Green

BAPerfectGreen

April 2015, A simple game made with Processing in two weeks, a little game about balance the color, and the lost of yourself. Position: Design/Programming/Audio Design

Aquaria Simulation

behind scene1 copy

October 2013, Aquaria Simulation Studying, part of Sony Project, including fish flocking prey-predator algorithm, and fish natural movement algorithm

FL•U, iOS Bio-Surveillance App

FL•U cover

Summer 2013, FL•U, a gamified iOS multi-lingual influenza surveillance and disease prevention app. Position: Programmer (team of 3)

TuneTrain, Music Education iOS App

cover

Spring 2013, TuneTrain(App Store), 200,000+ download, a music education iOS Application, encourage children to create music by drawing. Position: Programmer for Voice Detection, Midi-to-Notation Algorithm, Sequencer (team of 7)

Fitbit Data Visualization

sleep data

CMU-ETC-Building Virtual World

ETC_LOGO

MaKey MaKey & Happy Birthday

MaKey MaKey little experiment

Herb Ensemble, Interactive Installation

herbEnsemble

Pulse Matrix as Multiple Pulse Sensor

pulseSensor

About Me…

profile

 

Sound Design

midilearning

works with 3Ds Max

fish-素模