Celestia, Vocal Interaction Game

Celestia, a vocal interaction music game, finalist of Indiecade 2014, showcase@PAX East 2014, showcase@ E3 2014, a poster at SIGGRAPH 2013, and one of ACM-CHI Game Competition Finalists(May 2013, Paris).

Celestia on Polygon!



Users use voice to guide a newborn star through the universe with melody, help her grow up by absorbing small planets and survive by dodging comets, nebulae.


CELESTIA @ E3 2014 | April 2014, LOS ANGELES, CA

With Celestia


Celestia was accepted for inclusion in the CHI 2013 conference Student Game Competition. Celestia team presented the project in the conference.


In the demo session, people stopped by and checked out this amazing interaction music game. Players love it and gave positive feedbacks and suggestions,
“We really enjoyed your game!! I will most definitely download it. I’ll anxiously await iOS version!!”
“I think this was my favorite game that I tried today, I wanted to express the following ideas about learning how to play…”
“I’m very much interested in such beautiful project, if you need some help at some point, feel free to ask, I’m always happy if I can be of any use!”



Presenting Celestia



Celestia was accepted to be presented as a Poster at the SIGGRAPH 2013 Conference in Anaheim, California. People gravitated to Celestia’s unique aesthetic art style and wondered how to interact with Celestia with voice. Many of them shows interests in such innovative and intuitive game and looks forward to Celestia iOS version.


 Celestia Poster






This game uses voice as input based on pitch recognition and refers to several behaviors of planet in astronomical environment. It not only detects specific pitches but also reacts to volume variation which determines what extension of the effect that can be achieved on a certain pitch.

Namely, the louder the volume is, the better the result will be on the premise that users hit the given pitch. In gameplay respect, since Celestia detects three specific pitches that are the roots of major chord of the background music (D3, G3, D4 for female, A2, C3, D#3 for male). The purpose of the setting is to make the background music as guidance for calibration. Users can sing with improvised melody only using those pitches as game progresses.


Tutorial Interface


Users sing a particular pitch (D3/A2) to expand the diameter of the star’s corona, and then the star could swallow the little planets that are within reach. When successfully absorbing planets, the star scatters splendid sparks and evolves to the next phase for every six planets.


Users sing another distinguish pitch (G3/C3) to elevate the star, and then it can dodge the comets coming from either side. When impacted by comets, the star burns for a few seconds and degrade to the last phase for every three comets.


Users sing the third different pitch (D4/D#3) to release a burst of energy from the star’s core, and then explode the nebulae to clear the way. When missing one nebula, the star will degrade to the last phase directly.



We introduced Celestia to a professional female singer Anneke Harger, the following picture was taken when Anneke  “performing”  the game in ETC BVW show. The show turned out to be a great success and we received positive feedbacks like “it is visually and aurally appealing.”





  1. ispmedia says:

    *Hello! I just would like to give a huge thumbs up for the great info you have here on this post. I will be coming back to your blog for more soon.

  2. I must thank you for the efforts you have put in writing this blog.I really hope to view the same high-grade blog postsfrom you in the future as well. In fact, your creativewriting abilities has inspired me to get my very own blog now 😉

  3. I really thankful to find this site on bing, just what I was looking for : D also bookmarked.

  4. woh I love your blog posts, saved to fav! .

RSS feed for comments on this post. /

Leave a Reply

Celestia, Vocal Interaction Game

Celestia, a vocal interaction music game, finalist of Indiecade 2014, showcase@PAX East 2014, showcase@ E3 2014, a poster at SIGGRAPH 2013, and one of ACM-CHI Game Competition Finalists(May 2013, Paris).

Celestia on Polygon!

Cheng’s Music



Pulse Matrix, Audio Visualization Tool

August 2011, Pulse Matrix, sound visualization application, Independent work, Position: Programmer/Designer for audio and visual .


Be A Perfect Green


April 2015, A simple game made with Processing in two weeks, a little game about balance the color, and the lost of yourself. Position: Design/Programming/Audio Design

Aquaria Simulation

behind scene1 copy

October 2013, Aquaria Simulation Studying, part of Sony Project, including fish flocking prey-predator algorithm, and fish natural movement algorithm

FL•U, iOS Bio-Surveillance App

FL•U cover

Summer 2013, FL•U, a gamified iOS multi-lingual influenza surveillance and disease prevention app. Position: Programmer (team of 3)

TuneTrain, Music Education iOS App


Spring 2013, TuneTrain(App Store), 200,000+ download, a music education iOS Application, encourage children to create music by drawing. Position: Programmer for Voice Detection, Midi-to-Notation Algorithm, Sequencer (team of 7)

Fitbit Data Visualization

sleep data

CMU-ETC-Building Virtual World


MaKey MaKey & Happy Birthday

MaKey MaKey little experiment

Herb Ensemble, Interactive Installation


Pulse Matrix as Multiple Pulse Sensor


About Me…



Sound Design


works with 3Ds Max