JPS61196317A - Information input system - Google Patents

Abstract

PURPOSE:To detect 3-dimensional position information by setting plural TV cameras with different visual field angles and processing image pickup signals. CONSTITUTION:The X, Y and Z coordinates are detected in response to the finger pointing positions of both cameras 1 and 2. Then the results of detection are delivered to an information processor 4. An information input device 5 calculates the coefficient of a straight line connecting a reference point B given from a reference point input device 5 and a finger pointing position P. This coefficient is delivered to the processor 4. Then the coordinates are decided for an object on the straight line.

Description

[Detailed Description of the Invention] [Industrial Application Field] The present invention directly captures the movement of a movable object such as a human hand as an image, and uses image processing to convey the human intention expressed by the movement of nuclear particles to a computer. The present invention relates to an inexpensive and simple information input method.

[Conventional technology]

Now, displays with keyboards, light pens, tablets, mice, joysticks, and the like are devices for inputting information into computers that have been widely used in the past.

On the other hand, throughout the ages, human gestures have played an important role as the most basic means of communicating intentions. In particular, hand and head movements are a means of transmitting information that humans come to use before words as they grow from babies to toddlers. If it were possible to directly understand human hand and head movements using a computer, this would have great significance as a way to supplement input from devices such as keyboards and realize a more natural human-machine interface. Conceivable.

Patent No. 1144011 (Suenaga, Yamagishi Ni “Information input method”, Special Publication No. 57-1009, Patent Application No. 51-10408)
) partially solves the above problems and detects the position of the fingertip or indicator from the image input from the TV camera, but its scope of use is limited to inputting two-dimensional position information within the field of view of the TV camera. It had the disadvantage of being limited.

[Problem that the invention seeks to solve]

Therefore, the problem to be solved by the present invention is to make it possible to detect the position rIt of a fingertip or pointer as three-dimensional position information from an image input from a TV camera and input it into a computer.

Therefore, it is an object of the present invention to provide an information input method that makes the above possible.

[Means and effects for solving the problem] The present invention arranges a plurality of TV cameras with different viewing angles for a movable object such as a human fingertip, and processes the imaging signals from each camera. This makes it possible to detect six-dimensional positional information such as the position of a fingertip.

〔Example〕

The present invention will now be described in detail with reference to the drawings.

FIG. 1 is an explanatory diagram showing an embodiment of the present invention when two TV cameras are used. In the figure, 1 is a TV camera #1 that captures a planar image; 2 is a TV camera #2 that captures an elevational image; and 6 is an information input device that processes the captured image and outputs the three-dimensional coordinates of the target point; 4 is an information processing device that uses three-dimensional coordinates, and 5 is a reference point input device.

Note that the reference point input device 5 may be incorporated into the information input device 3.

Further, in the figure, the numbers 6 to 9 are for explaining the movements, and 6 indicates an example of a reference point, which here indicates the center of the person's face. 7 is a hand that indicates the position; 8.
9 is the position of each fingertip.

Next, the operation will be explained. First, images of the hand 7 are inputted from two TV cameras 1 and 2 placed above and on the side in the arrangement shown in FIG. Dimensional coordinate position P-(X,
Y, Z) (8 and 9 in the figure) and outputs the results to the information processing device 4.

Here, when the information input device 3 calculates the coefficient of a straight line connecting the reference point B (6 in the figure) given by the reference point input device 5 and the point P and outputs it to the information processing device 4, an object that intersects with the straight line Alternatively, the coordinates of a point can be determined.

The purpose can be achieved by simply setting an appropriate fixed point in space as reference point B, but for example, fixing the center position of the face and inputting its coordinates as the reference point By inputting and using the device 5, it becomes possible to use it more naturally when inputting human gestures. In the future, it will also be possible to recognize and input the center position of the face using a TV camera or the like and use this as the reference point B.

Next, the information input device 3 first internally calculates a set of two two-dimensional coordinates. For this purpose, the device is
A processing method such as that described in the specification of No. 011 is used as a specific processing method. However, in the method of the patent, since there is little variation in the distance of the object from the TV camera, it is almost unnecessary (or unnecessary) to correct the position in the image plane to the position in real space based on the variation in distance from the TV camera. (easy)
Met.

To use this method directly, it is necessary to use a TV camera lens with a large focal length. Therefore, the information input device 3 performs position correction so that detection can be performed even if the camera is placed at a relatively close position using a normal lens. This correction operation will be explained with reference to FIG.

FIG. 2 is a diagram showing the arrangement of FIG. 1 viewed from the origin 0 in the Y-axis direction. First, equations of two three-dimensional straight lines 11 and 12 are calculated from the absolute position coordinates of the two TV cameras and the coordinates of the indicated point P(8) in the video. Each of these straight lines corresponds to camera #1. This is the line of sight (10° 11) with respect to the designated point P(8) of @2. Next, when the intersection point of this two-pronged equation is calculated, it becomes the three-dimensional coordinates of the indicated point P(8) to be sought.

In addition, in the above example, two TV cameras were used, but six
Similar processing can also be performed using more than one TV camera at the same time. In this case, the processing method is a little more complicated, but the principle is the same, and the detection accuracy can be improved when the hand or pointer is pointed in various directions.

〔Effect of the invention〕

According to the present invention, in addition to providing two or more TV cameras, an information input device, and in some cases a reference point input device, a three-dimensional video tablet, a virtual pointing stick in a three-dimensional space, and a wireless remote control are provided. Switches etc. can be realized. Moreover, human hand movements are originally used for various meanings, and by developing various identification methods for the three-dimensional point sequence input using the method of the present invention, it is possible to input numerical values and commands. It is believed that the present invention can be used in a wide range of applications, such as:

As explained above, according to the present invention, it is possible to input position information and direction information in a six-dimensional space without using expensive special equipment, so an inexpensive and easy-to-use three-dimensional information device can be obtained. It has the advantage that it can be realized.

[Brief explanation of drawings]

FIG. 1 is an explanatory diagram showing one embodiment of the present invention, and FIG.
It is a layout diagram of the TV camera seen along the Y-axis direction from the origin O in the figure. Description of symbols 1.2...TV camera, 3...Information input device, 4...Information processing device, etc., deceased...
Reference point input device, 6...Reference point, 7...
・Hand, 8.9...Fingertip position, 10.11...
... Camera's line of sight (3-dimensional straight line) Agent Patent attorney Akio Namiki Agent Patent attorney Kiyoshi Matsuzaki Figure 1 Figure 2 Inside camera #2 / W

Claims (1)

[Scope of Claims] 1) A plurality of television cameras arranged at different viewing angles with respect to a movable object, and imaging signals of the movable object from each camera are input and processed to capture images within the three-dimensional space. and an information input device that determines and outputs the coordinate position of. 2) A plurality of television cameras are arranged at different viewing angles with respect to the movable object, and the imaging signals of the movable object from each camera are input and processed to determine the coordinate position in the three-dimensional space. and an information input device that outputs the information, the information input method comprising: a reference input device for inputting into the information input device a coordinate position of a reference point located at a position different from the coordinate position of the movable object; An information input method characterized in that the input device uses the two sets of coordinate positions to determine and output the coordinate position of a specific point on a straight line connecting the two sets.