KR20030021988A - Finger remote-controller using image processing - Google Patents

Abstract

PURPOSE: A finger remote controller by using image process is provided to be operated by only a finger signal using image process result information by accurately search a finger of a user in a real time, analyze the pattern of the finger, and processing an image of the finger. CONSTITUTION: An image input unit receives information of user environment by using an image acquisition board. An image information storage device continuously stores images inputted in a real time, and provides the stored images to a finger signal recognizing device in a real time. The finger signal recognizing device analyzes finger information of a televiewer from the inputted image. An operation function selecting device converts a command of the televiewer into a function of a finger remote controller using information obtained in the finger signal recognizing device. An operation command signal generating device converts a command of the finger remote controller into an electric signal for operating a TV and household appliances.

Description

Finger remote controller using image processing {Finger remote-controller using image processing}

The remote finger controller using image processing is part of the realization of user-centered machine environment for operating human-friendly TV viewing and home appliances, and the human-machine interface that implements the human-machine communication system. The main purpose of the remote finger controller is to control home appliances and office electronics with only a hand signal commanded by the user, for convenience of machine operation, simplifying the use environment, and quantitative simplification of the electronic product. The overall system configuration of the present invention is as shown in Fig. 1. In Fig. 1, an image input device which adjusts electronic products with a user's hand signal, and is attached to an operation object such as a TV or a computer, acquires the user's hand signal as an image and then uses a remote finger. Transmits to the input of the controller, and the remote finger controller interprets the hand signal Fig. 2 is a general operation sequence of the remote finger controller, which acquires a hand signal expressed in real time as an image, stores it in a storage device, and analyzes the hand signal in the hand signal recognition device. Based on the information, a proper operation is indicated The detailed operation of the hand signal analysis and the remote finger controller is as shown in Fig. 3. The partial image corresponding to the finger is extracted from the input image including the background noise, and the extracted finger image is preliminary. The meaning of the user's current finger is accurately determined by comparison with the user's finger image sample collected in.

After the discrimination process is performed, the operation appropriate to the hand signal of the user is determined. Finally, the remote finger controller uses the information processed above to determine the function of the remote finger controller to operate, and the user's hand gestures by instructing the control signal of the remote finger controller equipped with the dedicated processor for the electronic product to be operated. Will perform the operation indicated by.

Development of remote finger controller using image processing to realize human-friendly TV viewing and operation environment of home appliances and office electronics

The present invention is in the field of human-friendly technology development, which is currently being actively researched as a new field of research, and in the field of human-machine interface research, which transmits information to machines similar to human communication. There is no system for recognizing and manipulating hand signals using the pattern recognition image processing technique developed by users of home appliances and office electronics. Related technical fields include image processing technology for acquiring and storing images in real time, image segmentation and image recognition technology for detecting, recognizing and tracking moving objects, hardware for manufacturing a remote controller based on image processing information, and Software technology. No such technique has been applied to remote controls using image processing.

Development of pattern recognition image processing technology that accurately detects and analyzes the shape of user's finger in real time, moving in the obstacles and background noises of surroundings, as in general TV viewing environment, and the result information of image processing It is a technical problem to achieve by developing a remote controller that operates only by the hand signal of the user's finger shape.

1 is an overall system diagram of a remote finger controller operated by an image processing method.

2 is an overall operation sequence of the remote finger controller. Image processing for acquiring and storing a hand signal image in real time, hand signal recognition processing for recognizing and reading a hand signal corresponding to a finger shape in an input image, and finally an operation adjustment process for generating an operation command.

3 is a detailed functional description of the hand signal recognizer and the remote finger controller. The hand signal recognizer includes a finger recognizer and a hand signal decoder, and the remote finger controller includes a function selector and a command controller.

The configuration of the present invention consists of a real-time image processing system, a hand signal recognition system, and a remote finger controller. The real-time image processing system includes an image processing input unit for acquiring a user's finger image in real time, a memory for storing the image, and a dedicated processor for managing the image processing system. The hand signal recognition system is a system that recognizes and interprets a hand signal intended by a user from an input image. The remote finger controller is composed of a system that converts the interpreted hand signal into a motion signal to achieve actual motion.

The present invention can provide TV viewers and home appliance users with the simplicity of remote operation. Since the remote control device does not require a separate remote control device, the operation is performed by the manipulation of a finger, thus performing the necessary operation with a minimum physical load. In addition, by pioneering technical and academic related technologies, we can pioneer the field of application of human-friendly human-machine interface technology to secure excellent advanced technology in the country, and create high value-added profits in related economic fields. In addition, it is expected to be the cornerstone of new technology development by suggesting the feasibility of using image processing for human-friendly product development that will be continued. In addition, considering that the propensity to integrate PCs and home appliances will be accelerated in the future, using PC cameras, CCD cameras, and high-speed processors of PCs, the development cost of remote finger controllers can be reduced, and remote control functions of TVs and home appliances can be improved. It will be easy to implement.

Claims (2)

In realizing the remote finger remocon system which operates by hand signal by recognizing the position and shape of the finger of TV viewer and home appliance user through image processing technique, Acquiring in real time image information about a viewer environment in which a user's finger is input from an image information input device such as a CCD camera; A hand signal analysis step of accurately recognizing the shape changing every moment by finding the user's finger in consideration of the background noise in the image of the input user environment; Comparing the interpreted user hand signal information with a predetermined hand signal command pattern to read a hand signal command instructing a TV and a home appliance by a user; A function selection step of the remote finger controller for determining the operation of the TV and the home appliance to be performed based on the received hand signal command; A method of generating a command signal of a remote finger adjuster for delivering the determined execution command to the TV and the home appliance, thereby causing the target system to execute the command. In realizing the remote finger remocon system which operates by hand signal by recognizing the position and shape of the finger of TV viewer and home appliance user through image processing technique, An image input unit which receives information of the user environment using an image acquisition board to receive image information about the user environment input from an image information input device such as a CCD camera; An image information storage unit for continuously storing an image input in real time and providing the received image signal as an input of a hand signal recognizer in real time; A viewer number signal recognition device configured with a pattern recognition image processing method for analyzing finger information of the viewer from an input image; A motion function selection device that converts a user's command into a function of a remote finger controller using information obtained from a recognition device; An operation command signal generator for converting a command of a remote finger controller into an electric signal to operate a TV and a home appliance.