JP2005190283A - Information input apparatus - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a small-sized information input apparatus having a high resolution and accuracy. <P>SOLUTION: A ranging means 13 measures a distance to an object by capturing specific wave irradiation and a reflected wave. A focus adjustment means 11 adjusts the focal length of a photographing means 12 in accordance with the distance measured by the ranging means 13. The photographing means 12 photographs the picture of a given space. A picture processing means 14 specifies the object of an information input instruction from the pictures photographed by the photographing means 12 and detects the position and movement of the object. A control means 21 recognizes the information input instruction generated by the object on the basis of the position and movement of the object detected by the picture processing means 14 and executes processing complying with the information input instruction. A display means 23 displays the picture reflecting the position and movement of the object detected by the picture processing means 14 and the processing executed by the control means 21. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

  The present invention relates to an information input device for inputting information instructed by an operator in an information device, and more particularly to a non-contact type information input device.

  A general device for inputting information is a device (contact type information input device) that is operated by touching with a hand, such as an operation switch, a keyboard, a mouse, a touch panel, and a remote controller. However, in recent years, the use of information equipment has expanded and is used in various situations and situations. In some cases, it may be difficult to touch the information input device with a hand depending on the scene or situation used. In such a case, it is preferable to use a non-contact type information input device.

  For example, when inputting information to an information device in a kitchen, it is preferable that information can be input without contact even when a hand during cooking is wet. Similarly, it is preferable that information can be input without contact at a construction site, an operating room, or the like. In some cases, the information input device is large, or the information input device is too far away to reach the information input device.

  On the other hand, various non-contact information input devices have been proposed conventionally.

  As an example, Patent Document 1 discloses an information input device that uses a display in which photodetectors are embedded at a plurality of specific locations and an instruction device that emits light to the display. The information input device recognizes an information input instruction by detecting light emitted from a pointing device to a photodetector at a specific location on the display surface. The operator can input information to the information device by irradiating light to the photodetector using the pointing device.

  As another example, infrared light is scanned into a predetermined space corresponding to the display surface, and an infrared sensor detects that the object entering the space is irradiated with infrared light, and a specific location on the display surface is detected. Patent Document 2 discloses an information input device that positions and outputs a predetermined operation command based on the position designation. According to this information input device, information can be input to the information device by placing an object (for example, a human fingertip) at a specific location in the space.

As another example, an information input device for inputting information to an in-vehicle information device such as a car navigation system, wherein input information is obtained from a video signal obtained by imaging a part of a human body with a camera. What is determined is disclosed in Patent Document 3. According to this information input device, it is not necessary to touch an information device, and information can be input without looking at the information input device or the display.
Japanese Patent Laid-Open No. 01-142591 Japanese Patent Laid-Open No. 08-202480 JP 2000-75991 A

  Since the information input device disclosed in Patent Document 1 detects light from the pointing device with a photodetector embedded in a specific location, input information can be determined only at the location where the photodetector is embedded, and thus various information is available. I couldn't input correctly. In addition, since this information input device is configured to obtain resolution at the position of the photodetector, if the information to be recognized increases, it becomes difficult to reduce the size of the display.

  Since the information input device disclosed in Patent Document 2 is configured to dynamically track an object with infrared rays using a plurality of mirrors and detect the position with a plurality of infrared sensors, an optical system that depends on mechanical elements It was difficult to reduce the size.

  The information input device disclosed in Patent Document 3 is for an operator to perform an input operation without looking at the display, and the display on the display is for subsequent confirmation or confirmation by another person. In this information input device, the operator cannot determine the input information while visually grasping the selected portion, and it is difficult to input the information with high accuracy. That is, this information input device does not extend to information input performed by looking at the screen in terms of certainty of operation. Furthermore, an erroneous input may occur due to an unintended object entering a predetermined space.

  An object of the present invention is to provide a small-sized information input device with high resolution and high accuracy.

In order to achieve the above object, an information input device according to the present invention is an information input device for inputting information to an information device, and an imaging means for imaging an image of a predetermined space;
An image processing unit that identifies an object for which information input is instructed from the image captured by the imaging unit and detects the position and movement of the object, and the position of the object detected by the image processing unit And a control means for recognizing an information input instruction made by the object based on the movement and executing a process according to the information input instruction, and a position and a movement of the object detected by the image processing means. Display means for displaying a screen reflecting the processing executed by the control means.

  Therefore, according to the present invention, the image capturing means captures an image, the image processing means obtains the object and its movement by a temporary analysis, and the control means specifies the input instructed information by the secondary analysis. It can be reflected in processing.

  The information input device according to the present invention includes a distance measuring unit that measures a distance to the object by irradiating a specific wave and capturing a reflected wave, and the photographing unit according to the distance measured by the distance measuring unit. It may be further provided with a focus adjusting means for adjusting the focal length. Therefore, since the focal length of the imaging unit is adjusted according to the distance to the object, the imaging unit can capture a good image even if the distance to the object changes.

  Alternatively, it further includes a distance measuring unit that determines whether or not the object exists in the predetermined space by irradiating a specific wave and capturing a reflected wave, and notifies the control unit of the determination result, Based on the determination result by the distance measuring means, when the object does not exist in the predetermined space, power supply to the photographing means, the image processing means, and the display means may be stopped. Therefore, power feeding can be controlled to a minimum according to the presence or absence of the object.

  Alternatively, it further includes a distance measuring unit that determines whether or not the object exists in the predetermined space by irradiating a specific wave and capturing a reflected wave, and notifies the control unit of the determination result, An information input screen may be displayed on the display means when the object is present in the predetermined space based on the determination result by the distance measuring means. Therefore, an information input screen such as a menu screen can be displayed when the operator wants to input information.

  Moreover, the said imaging | photography means is good also as having one fixed camera part. Therefore, it is possible to input information with a small and simple configuration composed of one camera.

  In addition, the control unit configures a virtual planar operation panel in the predetermined space, and recognizes an information input instruction to the virtual planar operation panel from the position and movement of the object in the predetermined space. It is good to do. Therefore, the information input device of the present invention can grasp the position and movement of the object on the surface by the virtual plane operation panel.

  Further, the object may be an object having a specific form. Therefore, an object can be easily specified by a specific shape and size.

  According to the present invention, the image capturing unit captures an image, the image processing unit obtains the object and its movement by a temporary analysis, and the control unit specifies the input instructed information by the secondary analysis for processing. Thus, the operator can input information with high resolution and high accuracy without touching the information device while viewing the screen display, and can be realized with a small device configuration without physically controlling the optical system.

  In addition, since the focal length of the imaging unit is adjusted according to the distance to the object, the imaging unit can capture a good image even if the distance to the object changes, and high accuracy regardless of the distance. It is possible to input information.

  In addition, since power feeding can be controlled to a minimum according to the presence or absence of an object, the power consumption of the information device can be reduced.

  In addition, since the information input screen such as the menu screen can be displayed when the operator wants to give an information input instruction, the operability is improved.

  In addition, information can be input with a small and simple configuration including a single camera.

  In addition, since the information input device of the present invention captures the position and movement of an object by a virtual plane operation panel, it can recognize a high-level information input instruction equivalent to a contact-type information input device with high accuracy. it can.

  In addition, since the object can be easily specified by a specific shape and size, erroneous recognition can be reduced and detection time can be shortened.

  An embodiment of the present invention will be described in detail with reference to the drawings.

  FIG. 1 is a block diagram showing a configuration of an information input device according to an embodiment of the present invention. Referring to FIG. 1, the information input device includes an image input block 10 and a control block 20. The image input block 10 includes a focus adjustment unit 11, a camera unit 12, a distance measurement unit 13, and an image processing unit 14. The control block 20 includes a control unit 21, a display control unit 22, and a display 23.

  The camera unit 12 includes a lens unit (not shown) and a light receiving element unit (not shown) that converts an optical image into an electrical information signal. The camera unit 12 has a range (view angle) in which an object in a predetermined space in front of the display 23 can be photographed, and is disposed in a position and a direction in which the predetermined space can be photographed, and passes through the lens unit. The image is converted into electrical image information by the light receiving element unit. Since the position where the object can issue an information input instruction is within a predetermined space, the information input instruction can be specified from the image information obtained by one fixed camera unit 12. The information device according to the present embodiment may have only one camera unit 12 and is fixed, so that a driving mechanism and a driving circuit are unnecessary, and the size can be reduced.

  Here, the predetermined space is a space where an operator performs an operation (operation) of an information input instruction while looking at the display 23, for example, a space corresponding to the area of the display 23 in front of the display unit of the display 23.

  In the predetermined space, an object inputs an information input instruction for a menu displayed on the display 23 in front of the display 23. Here, the object is an operator's hand. The operator performs an operation (operation) for inputting information while viewing the display 23. The display 23 displays a menu screen and a screen for inputting information, and the operator performs an operation (operation) according to the screen display. The camera unit 12 captures a predetermined range, acquires the video information, and sends it to the image processing unit 14.

  The distance measuring unit 13 measures the distance to the object photographed by the camera unit 12 and acquires distance information. At that time, the distance measuring unit 13 measures the presence / absence of an object to be input and the distance to the object by irradiating the specific wave and capturing the reflected wave. For example, the distance measuring unit 13 can be configured by an irradiation unit (not shown) that irradiates an object with infrared rays, laser, microwaves, or ultrasonic waves, and a receiving unit (not shown) that receives a reflected wave from the object. . The distance measuring unit 13 sends the acquired distance information to the image processing unit 14 and the control unit 21.

  The focus adjustment unit 11 adjusts the focal length of the camera unit 12 according to the control from the image processing unit 14.

  The image processing unit 14 receives the video information from the camera unit 12 and the distance information from the distance measuring unit 13, performs image processing using the information, specifies an object, and controls the image processing information of the specified result. Send to part 21. At that time, the image processing unit 14 controls the focus adjustment unit 14 based on the distance information in order to obtain an optimal image. Further, the image processing unit 14 specifies the presence and position of the object from the position, size, color, shape, etc. of each part of the image information of the video information from the camera unit 12, and the position, size, shape, Image processing information including object information such as movement amount, speed, and acceleration is sent to the control unit 21. The object information includes at least information on the position and movement of the object.

  The control unit 21 has a central processing control function for controlling the entire information device. When inputting information, the control unit 21 requests and acquires image processing information from the image processing unit 14 at a predetermined timing. The control unit 21 recognizes an information input instruction from the operator based on the image processing information from the image processing unit 14. At that time, the control unit 21 estimates the operation of the operator based on the object information included in the image processing information, and specifies the information input instruction in association with the screen display. For example, assuming that a virtual plane operation panel (for example, a touch panel) exists in the space, when the operator moves his / her hand so as to operate it, the control unit 21 performs information on the virtual touch panel according to the operation. Identify input instructions. In the present embodiment, the object and its movement can be captured by a surface with a resolution equivalent to the number of effective pixels of the camera unit 12, so compared to a method of scanning the infrared rays and capturing the object with a point or line in space. Advanced information input instructions are possible. In addition, since the information device according to the present embodiment captures an object and its movement from the surface, it recognizes an advanced information input instruction equivalent to that of a touch panel with a simple configuration using one camera unit 12 with high accuracy. Can do.

  Then, the control unit 21 instructs the display control unit 22 to reflect the information in accordance with the specified information input instruction, the status of the processing according to the information, and the result on the screen. For example, the control unit 21 selects an item in the menu according to information input by the operator, executes a process corresponding to the item, and updates the screen.

  The display control unit 22 displays an image or information on the display 23 according to an instruction from the control unit 21.

  In the present embodiment, the focal length adjustment unit 11 adjusts the focal length of the camera unit 12 based on the distance information measured by the ranging unit 13 in order to enable highly accurate information input regardless of the distance. However, depending on the spatial range in which the operator inputs information, the focal length may be fixed and the focus adjustment unit 11 may be omitted.

  Further, since the distance measuring unit 13 has a function of measuring the distance to the object, the function may be used to detect whether or not the object exists. For example, when there is no target object within a predetermined distance that is an imaging target range, it may be determined that the target object does not exist. Then, when there is no object, the power consumption of the information device can be reduced by minimizing the power supply in the information device. For example, when there is no target, the control unit 21 that receives the notification from the distance measuring unit 13 may stop power supply to the control unit 21 itself and other parts other than the distance measuring unit 13.

  Further, when the object does not exist in the predetermined space in front of the display 23, the display of the information input screen such as the menu screen of the display 23 is stopped, and the information input screen is displayed only when the object comes into the predetermined space. It may be done. Thereby, operativity can be improved by the screen display according to an operator's intention.

  In addition, the information device according to the present embodiment inputs information by the operation of the operator, but in addition to that, the display 23 may have an existing touch panel function so that information can be input by either contact or non-contact. The operator can select an input method according to the situation, and can provide higher operability.

  According to the information apparatus of the present embodiment, when the operator performs an information input instruction operation (operation) according to the display content of the display 23, the camera unit 12 captures an image, and the image processing unit 14 performs temporary analysis. Since the information on the presence and movement of the operator's hand, which is the object (object information), is obtained, the control unit 21 specifies the input instructed information by the secondary analysis and reflects it in the processing of the information device. High-resolution and high-precision information input can be realized with a small device configuration without touching the information device and without physically controlling the optical system.

  A specific operation example of the information device of this embodiment will be described.

  FIG. 2 is a diagram for explaining an operation example of the information device according to the present embodiment. Referring to FIG. 2, the camera unit 12 and the distance measuring unit 13 are installed above the display 23. There is an operator's hand that is the object 30 in the imageable range 31 in front of the display 23.

  When the object 30 is placed in the shootable range 31 for a certain time or longer, the distance measuring unit 13 detects the presence of the object 30 and notifies the control unit 21 of it. The control unit 21 instructs the display control unit 22 to display the menu screen on the display 23.

  Further, the control unit 21 instructs the image processing unit 14 to start the operation. The image processing unit 14 detects the shape, position, and movement of the object based on the image taken by the camera unit 12.

  In addition, the control unit 21 acquires the object information from the image processing unit 14 and reflects it on the screen of the display 23. In FIG. 2, an arrow 32 corresponding to the hand of the operator who is the object 30 is displayed on the screen of the display 23. If the operator moves his hand, the arrow 32 moves accordingly. The operator can perform an information input operation while looking at a menu (not shown) and an arrow 32 displayed on the display 23.

  As described above, the information input operation can be performed by moving the hand in a space at an appropriate distance so as not to contact the display 23 in front of the display 23. The operator can input information while confirming by viewing the display 23, so that information can be input with the same feeling as a contact-type information input device as if a virtual touch panel exists in the space. is there.

  FIG. 3 is a diagram illustrating a state in which an operator issues an information input instruction to a virtual touch panel in space. Referring to FIG. 3, a virtual touch panel 40 is shown in the front space of the display 23. When the operator manually inputs information to the virtual touch panel 40, the instruction is specified by the control unit 21 and reflected in the processing. For example, when the operator performs an operation of pressing the button 41 on the virtual touch panel 40 by hand, the control unit 21 performs a process corresponding to pressing the button on the touch panel. Further, the processing by the control unit 21 is also reflected on the display 23, and it is displayed on the display 23 that the button 42 displayed there has been pressed. As described above, since the control unit 21 of the present embodiment specifies the information input instruction of the operator on the virtual touch panel 40 by the movement of the object (operator's hand) 30 and performs the information input instruction, High-precision information input can be performed easily.

  In the present embodiment, an example in which the object 30 is an operator's hand has been described, but the present invention is not limited thereto. For example, the specific form may be the object 30. Here, the specific form is an object having a specific shape and size, for example, a pointer. The specific form may have a specific color. Since a specific form can be specified by its shape and size, it can input information with high accuracy and fewer misrecognitions than when an information input instruction is given with a wide shape and size like a human hand. In addition, the detection time can be shortened. The configuration using the specific form is effective in a situation where a presentation is performed using a display screen, for example.

It is a block diagram which shows the structure of the information input device by one Embodiment of this invention. It is a figure for demonstrating the operation example of the information equipment by this embodiment. It is a figure which shows a mode that an operator performs the information input instruction with respect to the virtual touch panel in space.

Explanation of symbols

DESCRIPTION OF SYMBOLS 10 Image input block 11 Focus adjustment part 12 Camera part 13 Distance measuring part 14 Image processing part 20 Control block 21 Control part 22 Display control part 23 Display 30 Target object 31 Shootable range 32 Arrow 40 Touch panel 41, 42 Button

Claims (7)

An information input device for inputting information to an information device,
Photographing means for photographing an image of a predetermined space;
Image processing means for identifying an object for which information input is instructed from the image photographed by the photographing means, and detecting the position and movement of the object;
Control means for recognizing an information input instruction made by the object based on the position and movement of the object detected by the image processing means, and executing processing according to the information input instruction;
An information input device comprising: display means for displaying a screen reflecting the position and movement of the object detected by the image processing means and the processing executed by the control means. Ranging means for measuring the distance to the object by irradiating a specific wave and capturing a reflected wave;
The information input device according to claim 1, further comprising: a focus adjusting unit that adjusts a focal length of the photographing unit according to a distance measured by the distance measuring unit. It is further determined whether or not the object exists in the predetermined space by irradiating the specific wave and capturing the reflected wave, and further includes a distance measuring unit that notifies the control unit of the determination result,
The control means stops power supply to the imaging means, the image processing means, and the display means when the object does not exist in the predetermined space based on the determination result by the distance measuring means. 1. The information input device according to 1. It is further determined whether or not the object exists in the predetermined space by irradiating the specific wave and capturing the reflected wave, and further includes a distance measuring unit that notifies the control unit of the determination result,
The information input device according to claim 1, wherein the control unit causes the display unit to display an information input screen when the object is present in the predetermined space based on the determination result by the distance measuring unit. The information input device according to claim 1, wherein the photographing unit has a fixed camera unit. The control unit configures a virtual planar operation panel in the predetermined space, and recognizes an information input instruction to the virtual planar operation panel from the position and movement of the object in the predetermined space. The information input device according to any one of claims 1 to 5. The information input device according to claim 1, wherein the object is an object having a specific form.

Images