Taylor, R., Torres, D., Boulanger, P. (2005) Using Music to Interact with a Virtual Character. 5th International Conference on New Interfaces for Musical Expression, Vancouver, Canada, May 26-28, pp. 220-223.
We present a real-time system which allows musicians to interact with synthetic virtual characters as they perform. Using Max/MSP to parameterize keyboard and vocal in- put, meaningful features (pitch, amplitude, chord informa- tion, and vocal timbre) are extracted from live performance in real-time. These extracted musical features are then mapped to character behaviour in such a way that the mu- sician's performance elicits a response from the virtual char- acter. The system uses the ANIMUS framework to generate believable character expressions. Experimental results are presented for simple characters.
Back to to publications.