JP2000187551A - Input device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To make an input device for a computer simplified, light in weight and miniaturized. SOLUTION: For instance, first, a finger and a hand are photographed by using a television camera and a digital camera. Next, the positions, directions and movements of the finger and the hand are analyzed from the images. Further, it is possible to obtain a keyboard input by using analysis results. For instance, a keyboard drawn on paper is placed in front of a camera. The hands are moved to the keyboard drawn on the paper, and the movement of the hands are photographed by the camera. The hands movement for the keyboard can be analyzed from the images and keyboard inputs can be obtained by using the analysis results. The keyboard drawn on the paper is a means showing the arrangement of keys. As for a means showing the arrangement of keys, it is possible to use a keyboard in which an electric circuit is not built in. When the keyboard of such an electric circuit is used, it is possible to obtain physical feelings being the same as a conventional keyboard.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

[0001] 1. Field of the Invention [0002] The present invention relates to an input technology of a computer, a mobile device, a telephone, a facsimile and the like.

[Prior art]

Conventionally, when inputting a command or the like to a computer using an input device, it has been necessary to connect the input device and the arithmetic unit by wire or wirelessly. Further, all of the input information has been transmitted from the input device to the arithmetic unit by wire or wireless. Also,
The detection of the input to the device was performed using a switch or a sensor.

[Problems to be solved by the invention]

[0003] However, when the device and the arithmetic unit are connected by wire, a code is required. In the case of wireless connection, it is necessary to attach a wireless transmitter to the device. In addition, inputs to the device were detected by switches and sensors. These codes, transmitters, switches or sensors have been obstacles to the miniaturization, simplification and weight reduction of computer input devices. In addition, for example, in a current keyboard, most of confirmations of a relative position of a hand or a finger with respect to a key involve movement of a visual field. That is, when confirming the position, the field of view had to be moved from the screen to the key or from the key to the screen. Training was required to enable key input without moving the field of view from the screen to the key or from the key to the screen.

[Means for Solving the Problems]

The present invention relates to a method for inputting an arithmetic unit using a hand or a finger, wherein a means for indicating a position where the hand or the finger should be at the time of inputting a value and an orientation of the hand based on image data obtained by photographing the hand or the finger. Means for analyzing hand position, hand movement, finger direction, finger position or finger movement, and an input method for obtaining an input value corresponding to the analysis result using the analysis result. Is the solution.

Further, according to the present invention, when inputting a value in the above input method, means for indicating a position of a hand or finger should be provided.
An object of the present invention is to solve the above problem by using an input method using an image output device, an input device having a mechanical mechanism, or using sound.

Further, according to the present invention, in the above input method, an input device or an image output device having a mechanical mechanism as a means for indicating a position of a hand or a finger when inputting a value, and a means for photographing a hand or a finger. Another object of the present invention is to solve the above-mentioned problem by using an input method including means for photographing a hand or a finger.

Further, according to the present invention, in the above input method, when inputting a value, a part or all of an input made to an input device having a mechanical mechanism as a means for indicating a position of a hand or a finger should be performed. An object of the present invention is to solve the above-described problem by using an input method including means for transmitting data from an input device having a mechanical mechanism to a computer.

Further, according to the present invention, in the above input method, when inputting a value indicated by a moving distance of a pointer or an input device or an image output device of a mechanical mechanism, a hand or a finger from a desired position is input. Another object of the present invention is to solve the above problem by using an input method that is a relative position of a finger.

Further, the present invention provides the above input method, wherein an input device having a mechanical mechanism as means for indicating a position of a hand or a finger when inputting a value is a keyboard, a numeric keypad or a switch. Thus, the above-mentioned problem is solved.

Further, according to the present invention, there is provided the above-mentioned input method, wherein the image output device as a means for indicating a position of a hand or a finger when inputting a value is a liquid crystal display or a display. Is what you do.

Further, according to the present invention, in an input device of an arithmetic unit using a hand or a finger, means for indicating a position where the hand or the finger should be when inputting a value, and a direction of the hand based on image data obtained by photographing the hand or the finger. Means for analyzing hand position, hand movement, finger direction, finger position or finger movement, and an input device for obtaining an input value corresponding to the analysis result using the analysis result. Is the solution.

Further, according to the present invention, in the above input device, the means for indicating a position of a hand or finger when inputting a value uses an image output device or an input device having a mechanical mechanism. Another object of the present invention is to solve the above problem by using an input device using sound.

Further, according to the present invention, there is provided an input device or image output device having a mechanical mechanism as a means for indicating a position of a hand or finger when inputting a value, and a means for photographing a hand or finger. Another object of the present invention is to solve the above-described problem by using an input device including means for photographing a hand or a finger.

Further, according to the present invention, in the above input device, when inputting a value, a part or all of the input made to the input device having a mechanical mechanism as a means for indicating a position where a hand or a finger should be located. An object of the present invention is to solve the above-described problem by using an input device having a means for transmitting the data from the input device having the mechanical mechanism to the arithmetic unit.

Further, according to the present invention, in the above input device, when inputting a value indicated by a moving distance of a pointer or an input device or an image output device of a mechanical mechanism, a hand or a finger from a desired position is input. Another object of the present invention is to solve the above problem by using an input device that is a relative position of a finger.

The present invention also provides the input device, wherein the input device having a mechanical mechanism as a means for indicating a position of a hand or finger when inputting a value is a keyboard, a numeric keypad, or a switch. Thus, the above-mentioned problem is solved.

Further, according to the present invention, there is provided the input method, wherein the image output device as a means for indicating a position of a hand or finger when inputting a value is an input device which is a liquid crystal display or a display. Is what you do.

BEST MODE FOR CARRYING OUT THE INVENTION

The first embodiment will be described as a computer input using a keyboard. First, a finger or a hand is photographed using a television camera, a digital camera, or the like. Next, the position, direction and movement of the finger and hand are analyzed from the image. Further, it is possible to obtain a keyboard input using the analysis result.
For example, a keyboard drawn on paper is set in front of the camera. Move your hand against the keyboard drawn on the paper, and use your camera to capture the movement of your hand. From that image,
It is possible to analyze hand movements with respect to the keyboard,
It is possible to obtain a keyboard input using the analysis result. A keyboard drawn on paper is a means for indicating the key arrangement. As a means for indicating the arrangement of the keys, it is possible to use a keyboard without an electric circuit. When a keyboard without such an electric circuit is used, the same physical sensation as a conventional keyboard can be obtained. Furthermore, since there is no electric circuit, the weight, size, and simplification of the keyboard can be reduced. Foldable keyboards and the like can also be created. It is easy to secure a storage space for a keyboard in a mobile device or the like. Further, a screen output can be used as a means for indicating the key arrangement. First, a keyboard image is output on the screen. Next, the hand or finger in front of the camera is photographed.
Further, the position, direction, and movement of the hand or finger are analyzed. The analysis result and the keyboard image are combined. At this time,
The position of the hand or finger is not always the correct key input position. The input user can correct the position of his or her hand or finger in front of the camera to a correct key input position by viewing the synthesized image.

In the current keyboard, which key has been input is transmitted to the arithmetic unit via a wire or wirelessly. Rather than transmitting information on whether or not an input has occurred on each key, information on whether or not an input has occurred on the entire keyboard is transmitted to the computer as ON and OFF signals. However, it is also possible to use image processing to analyze which key the input has occurred. As described above, the keyboard using the image processing can determine the key input from multiple sides. In addition, since the number of mechanical mechanisms required for the keyboard is reduced, the keyboard can be reduced in weight, simplified, and reduced in size.

Further, by displaying the relative positions of the keys and the hands or fingers on the screen, the relative positions can be confirmed without keeping an eye on the screen. In addition, by analyzing the image data and generating a sound in a specific case such as when the finger comes to the home position, the convenience of keyboard input is improved. Simply projecting an image will make the keys under the finger invisible, but when displaying the analysis results, re-display the characters of the keys below or enlarge them to confirm them. It can be easier.

The second embodiment will be described as a computer input using a pointer. For example, suppose a hand placed in front of a camera makes a fist, and the fist points to a mouse. The movement of the fist is photographed, and the movement amount of the corresponding pointer is analyzed based on the image data. For example, pointer input becomes possible by associating a click when the fist is opened.

The third embodiment is an input device for a multifunctional device. It is assumed that the input method differs for each function. For example, in the case of the telephone function, numeric input is required, and in the case of the mail function, keyboard input is required,
When using the organizer function, pad input is required. In such a case, the function is selected first. Next, a board corresponding to each function is arranged in front of the camera. This board has
For example, in the case of the telephone function, it is assumed that a switch with a number is drawn. The position, direction and movement of the hand and finger on this board are photographed, and the image data is analyzed. It is possible to obtain an input value corresponding to each board from the analysis result.

It is also possible to arrange a liquid crystal instead of a board and switch the screen to be displayed for each function. In this case, the function of the touch panel can be configured without disposing a sensor on the panel side. For example, it is assumed that a liquid crystal and a hand or a finger are photographed, the position, movement, and direction of the hand or the finger are analyzed from the image data, and the analysis result is displayed on the liquid crystal as a pointer. By capturing the position of the pointer again as an image, analyzing the image, and redisplaying the pointer so that the position of the finger matches the position of the pointer, the accuracy of the analysis can be increased. In addition, it is possible to prevent the hand or finger from hiding the screen by intentionally not matching the displayed pointer position with the finger position. In this case, by confirming on the screen the position of the pointer that does not match the finger, the input user can recognize which position on the screen the current finger position corresponds to.

The fourth embodiment will be described using a method of photographing the direction, position, and movement of a hand or finger with a plurality of cameras. By arranging a camera on the upper surface, the front surface, and the side surface of a hand or a finger to be photographed, it is possible to three-dimensionally analyze the movement of the finger or the hand. An input value can be obtained using this analysis result. For example, it is assumed that a three-dimensional object is arranged in a screen, and further analyzed hands and fingers are combined with the screen. Then, it is possible to virtually touch or operate the object on the screen. It is also possible to actually arrange and photograph a three-dimensional object.

It is also possible to analyze image data of a photographed hand or finger and execute a specific command when the finger or hand has a specific movement, position, orientation, or the like.

【Example】

As an embodiment, it is possible to obtain an input device similar to an input device such as a keyboard, a pointing device, a joystick, a touch panel, a switch, and the like, and a device having a function added thereto. In addition, an input device that handles a three-dimensional object can be configured.

As described above, according to the present invention, various input devices can be easily configured. Further, it is possible to simplify, reduce the size, and reduce the weight of the input device.
Further, the convenience of the input device is improved.

Claims (14)

[Claims] 1. An input method for an arithmetic unit using a hand or a finger, comprising: means for indicating a position of the hand or finger when inputting a value; Means for analyzing the position of the hand, the movement of the hand, the direction of the finger, the position of the finger or the movement of the finger, and an input method for obtaining an input value corresponding to the analysis result using the result of the analysis. 2. The input method according to claim 1, wherein the means for indicating the position of the hand or finger when inputting a value uses an image output device or an input device having a mechanical mechanism. Or an input method that uses sound. 3. The input method according to claim 1, wherein the input device or the image output device and the hand or the finger have a mechanical mechanism as a means for indicating a position of the hand or the finger when inputting a value. An input method comprising means for photographing a hand or a finger or a finger. 4. The input method according to claim 1, wherein when inputting a value, one of the inputs made to an input device having a mechanical mechanism as means for indicating a position of a hand or a finger should be. An input method comprising means for transmitting part or all of the information from the input device having the mechanical mechanism to the arithmetic unit. 5. The input method according to claim 1, wherein the input value should be a hand or a finger when inputting a value indicated by a moving distance of a pointer or an input device or an image output device having a mechanical mechanism. An input method that is the relative position of the hand or finger from the position. 6. The input method according to claim 1, wherein the input device having a mechanical mechanism as a means for indicating a position of a hand or finger when inputting a value is a keyboard, a numeric keypad, or a switch. input method. 7. The input method according to claim 1, wherein the image output device as a means for indicating a position of a hand or a finger when inputting a value is a liquid crystal or a display. 8. An input device for an arithmetic unit using a hand or a finger, means for indicating a position where the hand or the finger should be at the time of inputting a value, and a direction of the hand or a hand based on image data obtained by photographing the hand or the finger. Means for analyzing the position, hand movement, finger direction, finger position or finger movement, and an input device for obtaining an input value corresponding to the analysis result using the result of the analysis. 9. The input device according to claim 8, wherein the means for indicating the position of the hand or finger when inputting the value uses an image output device or an input device having a mechanical mechanism. Alternatively, an input device using sound. 10. An input device or image output device having a mechanical mechanism as means for indicating a position of a hand or finger when inputting a value, and a hand or finger. An input device comprising means for photographing an image or means for photographing a hand or finger. 11. The input device according to claim 8, wherein when inputting a value, one of the inputs made to the input device having a mechanical mechanism as a means for indicating a position of a hand or a finger should be. An input device comprising means for transmitting part or all of the information from the input device having the mechanical mechanism to the arithmetic unit. 12. The input device according to claim 8, wherein the input value should be a hand or a finger when inputting a value indicated by a moving distance of a pointer or an input device or an image output device having a mechanical mechanism. An input device that is the relative position of a hand or finger from a position. 13. An input device according to claim 8, wherein the input device having a mechanical mechanism as a means for indicating a position of a hand or finger when inputting a value is a keyboard, a numeric keypad, or a switch. Input device. 14. The input device according to claim 8, wherein the image output device as a means for indicating a position of a hand or finger when inputting a value is a liquid crystal or a display.