Computing Reviews
Today's Issue Hot Topics Search Browse Recommended My Account Log In
Review Help
Search
Gestures that people can understand and use
Ardito C., Costabile M., Jetter H. Journal of Visual Languages and Computing25 (5):572-576,2014.Type:Article
Date Reviewed: Mar 26 2015

Computing devices often include sensors to track the body, limbs, hands, and fingers of a user. User interfaces rely on these capabilities to recognize gestures, and considerable energy is being devoted to the development of a core set of gestures. The authors distinguish between two types of gestures. Symbolic gestures rely on the mapping of a sign (“thumbs up,” for example) to an interpretation (“approval”). Manipulation gestures are based on activities grounded in the way humans deal with spatial and physical aspects of objects, like moving an object. Convergence on a core set of manipulation gestures (tapping on an object to select it, or pinching to zoom in and out) seems possible, but less so for abstract gestures.

As an example, the authors discuss gestures that draw a checkmark or an X, with the intendend interpretations of “approval” and “rejection.” These gestures are problematic since the mapping of the signs is ambiguous: on forms, approval or selection of an item is often expressed by marking a box with either a check mark or an X. On touch-based interfaces, selection of an object (which could be a check box) is more intuitive by tapping. Performing the same check mark and X gestures midair (without a touch panel) becomes even worse since the start and end points of a (partial) gesture are not clearly defined.

Our familiarity with the spatial surroundings in which we live, and the way objects behave in the real world, provides us with a good basis for a common set of manipulation gestures. The same, unfortunately, does not seem to apply to more abstract gestures, requiring user effort to learn the mapping between gestures and their intended interpretations. In this relatively short viewpoint paper, the authors emphasize the distinction between gestural manipulations and symbolic gestures. Since manipulation gestures are grounded in the real world, there is a good basis for a common core set of gestures, while the abstract mapping between symbolic gestures and the respective commands may have significant variations in their potential interpretations, and thus can’t be easily captured in such a common core set.

Reviewer:  Franz Kurfess Review #: CR143283 (1506-0481)
Bookmark and Share
  Featured Reviewer  
 
Visual Programming (D.1.7 )
 
 
Concept Learning (I.2.6 ... )
 
 
Language Parsing And Understanding (I.2.7 ... )
 
 
Video Analysis (I.2.10 ... )
 
Would you recommend this review?
yes
no
Other reviews under "Visual Programming": Date
Visual programming in data flow environments (videotape)
Upson C., University Video Communications, Stanford, CA, 1992. Type: Book
Apr 1 1993
Windows 95 programming with custom controls
Cilwa P., Coriolis Group Books, Scottsdale, AZ, 1996. Type: Book (9781883577735)
Feb 1 1997
Visual language theory
Marriott K. (ed), Meyer B. (ed), Springer-Verlag New York, Inc., New York, NY, 1998. Type: Book (9780387983677)
May 1 2000
more...

E-Mail This Printer-Friendly
Send Your Comments
Contact Us
Reproduction in whole or in part without permission is prohibited.   Copyright 1999-2024 ThinkLoud®
Terms of Use
| Privacy Policy