[CEATEC] Clap Hands to Control Volume, Make Gestures to Change Channels

Oct 4, 2007
Mayuko Uno, Nikkei Electronics

Victor Company of Japan Ltd. (JVC) demonstrated a "handclap & gesture recognition TV" at CEATEC Japan 2007, which opened Oct. 2, 2007.

Users operate it using handclaps and hand gestures. JVC has conducted a research and development of the TV operation using handclaps and gestures since about two years ago, the company said.

In the demonstration, the company operated the TV using its capability to sense the sound of handclaps and the gesture of a hand and fingers. The TV collects the sound of handclaps using the microphone on its top and distinguishes commands based on the timing and number of handclaps.

If you clap hands twice when you are watching TV as normal, for example, volume control and channel icons will be displayed in the center of the screen. As the two icons turn red, you can choose and determine the icon by clapping your hands once while the desired icon is lit. The company devised the sound filter in an effort to prevent the TV from making error operations due to the sound from the TV itself and the surroundings, according to JVC.

The TV detects hand gestures in the video being monitored with its camera and lets the user specify an icon by locating the hand on it and click an icon by bending and extending a finger.

Specifically, users operate the TV as follows. First, icons will line the center of the screen when the user claps his or her hands three times. The image of a hand being monitored with the camera is layered behind the icons and works like a pointer. The user chooses an icon by placing his or her fingertip on it and clicks it by hooking the finger.

For the demonstration, JVC made the screen display easy for users to understand adopting 3D images for operation buttons on the screen. The company has not scheduled the technology's commercialization yet.

Demonstrating the operation of the "handclap & gesture recognition TV" with a camera monitoring a hand, which can operate the TV through its location and gestures. The camera is equipped on top of the TV. In the blue square frame in the center of the TV screen, six icons and the image of a hand being monitored with the camera were displayed. This user operated the TV with the hand raised up high to make it easy to distinguish a hand from the background, JVC said. As the TV recognizes a hand based on its shape, other things like sticks are not detected. If multiple hands are detected, the TV will give priority to the one at upper right, said JVC.
Demonstrating the operation of the "handclap & gesture recognition TV" with a camera monitoring a hand, which can operate the TV through its location and gestures. The camera is equipped on top of the TV. In the blue square frame in the center of the TV screen, six icons and the image of a hand being monitored with the camera were displayed. This user operated the TV with the hand raised up high to make it easy to distinguish a hand from the background, JVC said. As the TV recognizes a hand based on its shape, other things like sticks are not detected. If multiple hands are detected, the TV will give priority to the one at upper right, said JVC.
[Click to enlarge image]
The screen display when an icon is chosen. The 3D image displayed other icons as paper pages that can be flipped.
The screen display when an icon is chosen. The 3D image displayed other icons as paper pages that can be flipped.
[Click to enlarge image]