JPH08315118A - Man-machine interface - Google Patents

Abstract

PURPOSE: To provide a man-machine interface which can improve the input operation efficiency while suppressing the fatigue of a user. CONSTITUTION: This man-machine interface is equipped with a camera device 10 and a recognizing means 11. The camera device 10 is so set that the user 12 is present in its image pickup area and an image of the face part 13, eyes 13A, and month 13B of the user 12 is picked up. When the recognizing means 11 recognizes that the face part 13, eyes 13A, and month 13B move in previously set order by a previously set method, a previously specified indication command corresponding to the operation is generated and a mouse cursor is moved according to the operation of the face part 13. Consequently, the user can input information only by moving part of the body in a specific direction and the man- machine interface can greatly be improved.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a man-machine interface for computer equipment, for example, and more particularly to an improvement of an input device as a man-machine interface for computer equipment.

[0002]

2. Description of the Related Art Generally, a keyboard or a mouse or a tablet as a pointing device for controlling coordinates on a display screen is used for inputting information to a computer device or the like. These input devices are
Although it is possible to master the operation with simple practice, it was difficult to dramatically improve the man-machine interface. The main reason is that these operations require movements of hands. In addition, the operation of these input devices is very inconvenient for a user with a handicap. The present invention relates to improvement of an input device as a man-machine interface for computer equipment and the like, which will be described below with reference to specific examples.

An example of a conventional man-machine interface (input device) will be described with reference to FIG. FIG. 3 is a perspective view showing a general computer device of the prior art.

Referring to FIG. 3, a computer device 1 according to the prior art includes a computer main body 2, a CRT monitor 3 for displaying data (information) and images attached to the computer main body 2, and a computer main body 2 via a mouse input connector 4A. A mouse 4 having a strobe switch 4B connected thereto, a keyboard 5 for inputting data and instruction commands connected to the computer main body 2 via a keyboard input connector 5A, and the like are configured.

The operation of the conventional computer device will be described. After activating the computer main body 2, the user presses a function key on the keyboard 5 to input desired data and an instruction command. The data and instruction commands input by the user are displayed on the display screen of the CRT monitor 3.

When the user operates the mouse 4, the mouse 4 is moved based on the area 6 or the mouse cursor 7 displayed on the display screen of the CRT monitor 3. For example, when the user moves the mouse 4 to the left, the computer body 2 moves the mouse cursor 7 to the left on the CRT monitor 3 according to the amount of movement of the mouse 4. That is, the normal mouse 4 and the mouse cursor 7 are sensuously moved in the same direction, and the mouse cursor 7 is moved in the moving direction of the mouse 4.

Then, when the user operates the mouse 4 so that the mouse cursor 7 is aligned with the area 6 and clicks the strobe switch 4B, the object in the area 6 is confirmed, and the computer main body 2 executes the program in the area. To be executed. For example, when the user moves the mouse cursor 7 to the area 6 displayed as "CR-ROM file name" and clicks the strobe switch 4B of the mouse 4, "CR-RO" appears on the display screen of the CRT monitor 3.
M file name "is disclosed. The user has disclosed" C
A desired file name is selected from the list of "R-ROM file name" by the same operation and is confirmed by clicking the strobe switch. In this manner, the computer device is operated by the mouse 4.

[0008]

As described above, a keyboard, a mouse, etc. are mainly used as the man-machine interface (input device) of the prior art.
Then, when the user uses these man-machine interfaces together, it is necessary to change the position of the hand many times, such as operating the mouse, operating the keyboard, and then operating the mouse again. There is a problem that the work efficiency of the user is reduced.

Further, in commercial equipment such as a switcher of a broadcasting station, a large number of switches are generally present, and it is not uncommon for the operation console to be comparable to the top plate of a desk. for that reason,
The user has to move his / her hand largely for the operation, and there is a problem that he / she is easily tired by the operation for a long time.

The present invention has been made in consideration of the above points, and an object of the present invention is to provide a man-machine interface capable of improving work efficiency while suppressing user fatigue.

[0011]

In order to solve such a problem, in the man-machine interface of the present invention, an image pickup means for picking up an image of a part of a human body existing in a predetermined area to form an image signal, and an image Recognizing means for recognizing a part of the movement of the human body based on the signal and outputting a predetermined control command (instruction command) set in advance when the movement of the part of the human body coincides with a preset movement. Equipped with. Further, the part of the human body is the face of the user, the eyes and mouth of the face, or at least a part of the hands, fingers, and arms to solve the above-mentioned problems.

[0012]

In the man-machine interface of the present invention,
Images of the user's facial movements, eye and mouth movements, or hand, finger, and arm movements within a predetermined area are captured, and when those movements match preset or stored movements, instructions are given in advance. The predetermined instruction command is output to control the computer device. Therefore, according to the present invention, the user can input information to the computer device only by moving a part of the human body in a predetermined direction, and the man-machine interface can be dramatically improved. .

[0013]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT An embodiment of the man-machine interface of the present invention will be described below with reference to FIGS. It should be noted that parts common to those described in the related art are designated by the same reference numerals, and description thereof will be partially omitted.

First Embodiment First, the configuration of a first embodiment of the man-machine interface of the present invention will be described with reference to FIG. FIG. 1 is a side view showing a first example of the man-machine interface of the present invention.

In FIG. 1, in addition to the components such as the computer main body 2, the CRT monitor 3 provided in the computer main body 2, the mouse input connector 4A, and the keyboard 5, a characteristic of the present invention is a camera device as an image pickup means. 10, recognition means (processor) 11 provided with a memory
Is newly added. The output of the camera device 10 is connected to the recognition means 11 by a cable 10A,
The output of the recognition means 11 is connected to the mouse input connector 4A by a cable 11A. Furthermore, the camera device 1
The user 12 exists in the imaging area of 0 and the camera device 10
Is the face 13 of the user 12, more specifically, the eye 13 of the face 13.
A and mouth 13B are set to be imaged.

Next, the operation of the man-machine interface of this embodiment will be described. The user is the computer 2
After being activated by a predetermined means, a normal operation of pressing a function key of the keyboard 5 to input data or an instruction command is performed. The data and instruction commands input by the user are displayed on the display screen of the CRT monitor 3.

The operation when the user 12 operates the computer device by using a part of the body will be described. The camera device 10, which is an image pickup unit, photographs the face portion 13 of the user 12 and forms an image signal of the face portion 13 of the user 12.
The image signal is transmitted to the recognition means 11 via the cable 10A. The recognizing means 11 constantly recognizes the neck-down motion of the face portion 13, the direction of the eyes 13A and the movement of the mouth 13B by image processing.

When the recognizing means 11 recognizes that the motions of the face portion 13 and the motions of the eyes 13A and the mouth 13B have operated in a preset method or order, a predesignated instruction corresponding to the motions. Generate a command. The instruction command generated by the recognition means 11 is set in the same format as the mouse in this embodiment, and the instruction command is input to the computer main body 2 from the mouse input connector 4A via the cable 11A. The computer main body 2 receives the instruction command, and moves the mouse cursor on the CRT monitor according to the movement amount of the face portion 13 by the same operation as described above.

To explain the specific example, the user 12
When the person moves the face portion 13 up and down, left and right, the recognition means 11 recognizes the movement through the camera device 10, and generates and outputs the same instruction command as when the mouse is moved up and down and left and right on the desk. . In the computer device, the mouse cursor displayed on the CRT monitor 3 is moved according to the movement of the face portion 13.

When the eye 13A is double winked (twice twice within a predetermined period), the same instruction command as when the mouse strobe switch is double-clicked is generated. The double wink can be replaced by opening and closing the mouth 13B twice instead of the eye 13A. Further, it is possible to recognize the movement of the mouth 13B itself and directly input a command such as "Migi" or "Hidari". As described above, according to the present embodiment, the user 12 can perform the same operation as the mouse only by the movement of the face portion 13, and the troublesomeness of repeatedly operating the mouse and the keyboard is released, and the work efficiency is improved. In addition, the user can also perform an input operation while pointing to the data, and the man-machine interface can be improved. Furthermore, even a user with limited hand ability can easily perform input operations.

Embodiment 2 This embodiment is an example in which, instead of the movement of the face portion in the above-mentioned first embodiment, movements of hands, fingers and arms are detected and an instruction command is generated. 2 will be described. Since the configuration of the computer device is the same as that of the first embodiment, its description is omitted. FIG. 2 is a side view showing a second example of the man-machine interface of the present invention.

In the image pickup area of the camera device 10 in this embodiment, the user's hand 14 exists, and the camera device 1
0 is set so as to image the user's hand 14, finger 14A, and arm 14B.

The operation of the man-machine interface of this embodiment will be described. When the user tries to operate the computer device using the hand 14 after starting the computer main body, the camera device 10 as the imaging means is photographing the hand 14 of the user, and the image signal thereof is the cable 10A. Is transmitted to the recognition means (processor) 11 via. In the recognition means 11, for example, the finger 14A of the hand 14
When the action of the finger 14A is recognized by image processing and the action of the finger 14A is performed in a preset method or order, a predesignated instruction command corresponding to the action is generated and output to the computer device. In a computer device (not shown), the mouse cursor is moved on the CRT monitor according to the movement amount of the finger 14A by the same operation as described above. When the finger 14A is tapped twice on the desk, the same command command as when the strobe switch of the mouse is double-clicked is generated.

Also, instead of the fingers 14A of the hand 14, the arm 14B
It is also possible to control the mouse cursor by.
In that case, the camera device 10 recognizes the movement of the arm 14B, and when it is recognized that the arm 14B has operated in a preset method or order, a pre-specified instruction command corresponding to the operation is generated. Output to a computer device. In the computer device, the mouse cursor is moved by the same operation as described above. As described above, according to the present embodiment, the man-machine interface of the computer device or the like can be easily operated by using the hand, more specifically, one finger, and the man-machine interface can be dramatically improved. be able to.

The present invention is not limited to the above embodiments, and various embodiments can be adopted. For example, in the above embodiment,
Although the recognition device is exemplified as an adapter separate from the terminal device, the recognition device may be built in the terminal device and integrally configured. Further, it is needless to say that the present invention can be applied to a portable electronic device or the like having a built-in small camera, and can be applied to various forms without departing from the gist of the invention.

[0026]

As described above, according to the man-machine interface of the present invention, the movement of the user's face, the movement of the eyes and mouth, or the movement of the hands, fingers and arms existing within a predetermined area can be detected. When an image is picked up and those actions match a preset action, a predetermined command designated in advance is output to control the computer device. Therefore, when the user inputs information to the computer device, it becomes possible to input the information only by moving a part of the movement of the human body in a predetermined direction, which saves the input operation and speeds up the operation of the user. Fatigue can be reduced.

Further, according to the present invention, it is useful for simplifying the input operation even in an electronic device having a large number of switches such as a business device, and man-machine
The interface can be dramatically improved.

[Brief description of drawings]

FIG. 1 is a side view showing a first example of a man-machine interface of the present invention.

FIG. 2 is a side view showing a second example of the man-machine interface of the present invention.

FIG. 3 is a perspective view showing a general computer device of the related art.

[Explanation of symbols]

 1 Computer Device 2 Computer Body 3 CRT Monitor 4 Mouse 5 Keyboard 6 Area 7 Mouse Cursor 10 Camera Device 11 Recognition Means 12 User 13 Face 14 Hand

Claims (2)

[Claims] 1. An image pickup means for picking up a part of a human body existing in a predetermined area to form an image signal, and recognizing a motion of the part of the human body based on the image signal so as to recognize a part of the human body. And a recognition means for outputting a predetermined control command set in advance when the above-mentioned operation matches the preset operation. 2. The man-machine interface according to claim 1, wherein the part of the human body is at least a part of the face, eyes, mouth or hands, fingers and arms of the user. .