Gestural User Interfaces

I am working on 3D Interfaces that incorporate logical hand devices into 3D environments. My logical hand device will perform more than what a single six-degree-of-freedom pointer in 3D space can do.

Gesture Recognition & Composition (static only)

The following textual description of ASL-like gestures provides a framework for gesture recognition & composition. The description is easy for non-ASL users to recognize and memorize.

The V-shaped gesture is defined as follows:

        V::   F3,F4: FULLY_CURVED;
              F1,F2: STRAIGHT, ABDUCTED;
              F0:    INWARD, OVER_FINGERS;
              PALM:  SUPERIOR, ANTERIOR.

"I love you" gesture is defined as follows (the combination of gestures I, L, and Y):

I_LOVE_YOU :: F1,F4: STRAIGHT;
              F2,F3: FULLY_CURVED;
              F0:    OUTWARD;
              PALM:  SUPERIOR, ANTERIOR.

where the capitalized words are tokens defined in the language,
F0 is to denote the thumb,
F1 the index finger,
F2 the middle finger,
F3 the ring finger,
and F4 the little finger;
the direction of fingers' side of the palm is pointing up ("SUPERIOR"),
and the direction of the palm is pointing away from signer ("ANTERIOR").

Equipments

Virtual Technologies CyberGloves (a right-handed glove and a left-handed glove)
Ascension Technology Flock of Birds (one transmitter & six receivers)
StereoGraphics CrystalEyes VR shutter glasses with built-in Logitech head tracker
SiliconGraphics Indigo2 XZ

Augustine Su (su@csdl.tamu.edu)