Get 20M+ Full-Text Papers For Less Than $1.50/day. Start a 14-Day Trial for You or Your Team.

Learn More →

A NIME Reader2003: Designing, Playing, and Performing with a Vision-Based Mouth Interface

A NIME Reader: 2003: Designing, Playing, and Performing with a Vision-Based Mouth Interface [The role of the face and mouth in speech production as well as non-verbal communication suggests the use of facial action to control musical sound. Here we document work on the Mouthesizer, a system which uses a headworn miniature camera and computer vision algorithm to extract shape parameters from the mouth opening and output these as MIDI control changes. We report our experiences with various gesture-to-sound mappings and musical applications, and describe a live performance which used the Mouthesizer interface.] http://www.deepdyve.com/assets/images/DeepDyve-Logo-lg.png

A NIME Reader2003: Designing, Playing, and Performing with a Vision-Based Mouth Interface

Part of the Current Research in Systematic Musicology Book Series (volume 3)
Editors: Jensenius, Alexander Refsum; Lyons, Michael J.
Lyons, Michael J.; Hähnel, Michael; Tetsutani, Nobuji
A NIME Reader — Mar 7, 2017
Download PDF
17 pages

Loading next page...
 
/lp/springer-journals/a-nime-reader-2003-designing-playing-and-performing-with-a-vision-OV2rYgSz4m
Publisher
Springer International Publishing
Copyright
© Springer International Publishing AG 2017
ISBN
978-3-319-47213-3
Pages
107 –124
DOI
10.1007/978-3-319-47214-0_8
Publisher site
See Chapter on Publisher Site

Abstract

[The role of the face and mouth in speech production as well as non-verbal communication suggests the use of facial action to control musical sound. Here we document work on the Mouthesizer, a system which uses a headworn miniature camera and computer vision algorithm to extract shape parameters from the mouth opening and output these as MIDI control changes. We report our experiences with various gesture-to-sound mappings and musical applications, and describe a live performance which used the Mouthesizer interface.]

Published: Mar 7, 2017

Keywords: Augmented Reality; Vocal Tract; Sound Production; Live Performance; Audio Effect

There are no references for this article.