Computing Reviews
Today's Issue Hot Topics Search Browse Recommended My Account Log In
Review Help
Search
Natural user interfaces to support and enhance real-time music performance
De Prisco R., Malandrino D., Zaccagnino G., Zaccagnino R.  AVI 2016 (Proceedings of the International Working Conference on Advanced Visual Interfaces, Bari, Italy, Jun 7-10, 2016)204-211.2016.Type:Proceedings
Date Reviewed: Jul 27 2016

Research on using natural user interfaces for a virtual musical instrument is described in this paper. This technology was initially used in video game consoles, such as the Wii. The user moves her hands as if playing an instrument, and the system understands the movements and plays the music. The system maps the hands’ configurations into music in real time. The paper shows related work and compares these systems with the one developed by the authors.

The natural user interface (NUI) is presented as a concept that learns increasingly complex interactions such as touch, voice, and motion. The authors use Leap Motion, a device that recognizes the motion of the fingers and the hands. Then, artificial neural networks are used to interpret the hand movements. The system allows the user to select the instrument (such as piano or violin), and is trained to understand the hand configuration. A couple of pages show the mathematical formalism of the movements’ representation in a computer.

An important section evaluates the system in terms of quality and efficiency. Based on the results of testing on a number of users, the system shows encouraging results. The paper details future enhancements that could improve the recognition and offer a better user experience for the virtual music players.

The research is well presented, and the explanation of the benefits is balanced with the details of the scientific work. The paper could be used by user interface designers or people interested in playing music with a computer.

Reviewer:  Claudiu Popescu Review #: CR144634 (1611-0842)
Bookmark and Share
  Featured Reviewer  
 
User Interfaces (H.5.2 )
 
 
Neural Nets (I.5.1 ... )
 
 
User-Centered Design (H.5.2 ... )
 
 
Sound And Music Computing (H.5.5 )
 
Would you recommend this review?
yes
no
Other reviews under "User Interfaces": Date
Computers as theatre
Laurel B., Addison-Wesley Longman Publishing Co., Inc., Boston, MA, 1991. Type: Book (9780201510485)
Dec 1 1991
Intelligent user interfaces
Sullivan J., Tyler S., ACM Press, New York, NY, 1991. Type: Book (9780201503050)
Feb 1 1993
Electronic performance support systems
Gery G., Weingarten Pub., Inc., Boston, MA, 1991. Type: Book (9780961796815)
Sep 1 1992
more...

E-Mail This Printer-Friendly
Send Your Comments
Contact Us
Reproduction in whole or in part without permission is prohibited.   Copyright 1999-2024 ThinkLoud®
Terms of Use
| Privacy Policy