JP5957611B1 - Non-contact input device and method - Google Patents

Abstract

A plurality of first and second micro-reflecting surfaces 20 and 21 intersecting in plan view are arranged on the same plane, and are provided on one side of the light imaging means 13. The image 11a of the display 11 is formed as the first real image 12 on the other side of the optical imaging means 13, and the image position of the pointing means 34 that has touched the first real image 12 is optically determined. In the non-contact input device 10 that detects, the surface of the display 11 has a light sensor 26 provided with a sensor element 28 that detects only light from the front side, and the reflected light from the instruction means 34 is optically imaged. A second real image 35 is formed on the display 11 via the means 13, and the position of the second real image 35 is detected by the optical sensor 26.

Description

The present invention relates to a non-contact input device and method that can form a real image in the air and can input a signal by operating an instruction means (for example, a finger) while viewing the real image (for example, a touch panel image) (that is, an indication position of a reproduction image) And non-contact detection apparatus and method).

It is conventionally known that an image is displayed on a display (display device), and when a specific place of the image is pressed with a finger, the XY coordinates of the pressed portion are detected by a pressure sensor or the like, and the next operation is performed by this input signal. (For example, refer to Patent Document 1).

Also, as described in Patent Document 2, a matrix is formed by arranging a number of light emitting elements and light receiving elements in parallel along the XY axes directly above the display, and the surface of the display is touched with an obstacle such as a finger or a pen. In such a case, it has been proposed to detect the position where the obstacle is in contact with the display by crossing the matrix.

On the other hand, Patent Document 3 discloses first and second light control panels in which a large number of first and second planar light reflecting portions are arranged in parallel and at regular intervals inside a transparent flat plate. Using the optical imaging means placed in contact with or close to each other so that the planar light reflecting portion is in an orthogonal state in plan view, the image on the display and the image on which the infrared rays are irregularly reflected on the display surface are simultaneously reproduced in the air as a reproduced image There has been proposed a method and an apparatus for detecting the position of the reproduction image by detecting the position of the instruction means displayed and touching the reproduction image with a two-dimensional infrared camera.

Also, as described in Patent Document 4, a device has been proposed in which an optical sensor is built in a transistor shape surface constituting a liquid crystal panel to recognize the shape of multi-touch with a finger on the surface of the liquid crystal or the movement of a touch pen. Yes.

JP 2006-39745 A JP 2000-55928 A Japanese Patent No. 5509391 JP 2011-29919 A

However, the touch panels described in Patent Documents 1 and 2 have a flat display, a specific flat image is displayed on the display, and the input position can be detected by pressing a specific position on the display. It was. Therefore, when an image is pressed with a finger or a pen, the display surface or the touch panel surface is always contacted or collided, and the display or the like may become dirty or the display may be wrinkled.

In Patent Document 3, an infrared generation means (infrared light), an infrared diffuse reflection surface, and an infrared camera are required in addition to the display, and the apparatus configuration becomes more complicated. In addition, since the infrared generation means and the infrared camera are arranged at positions different from the display and the optical imaging means, there is a problem that an installation space is required. In addition, since the infrared diffuse reflection surface is placed on the front side of the display, there is a problem that a part of the light of the display is absorbed. Further, in Patent Document 3, since the optical imaging means is used, there is no focal length for imaging as in the case of a lens. However, particularly when an infrared camera is used, the installation position is selected, and It is necessary to adjust the focus on the image.
Patent Document 4 proposes an optical touch panel including a liquid crystal panel with a backlight and an optical sensor that detects that the liquid crystal panel is touched by reflected light, but the touch panel is not an aerial imaging type.

Furthermore, although a touch panel using a display is also used in ATMs and the like, it is not hygienic because an unspecified number of people touch the screen, and is not effective in preventing contact infection.
Moreover, when light is irradiated toward the display, the reflected light is emitted from the display, and the display may be difficult to see.

The present invention has been made in view of such circumstances, and an image to be formed is a spatial image that is not reflected light from another light source, and a specific position of the spatial image is pointed to by a pointing means such as a finger, a pointing stick, or a touch pen. An object of the present invention is to provide a non-contact input device and method capable of detecting the position and inputting a signal without physically touching the display.

In the non-contact input device according to the present invention that meets the object, a plurality of first and second micro-reflecting surfaces intersecting each other in plan view are arranged on the same plane, and each of the first micro-reflections is arranged. An optical imaging means for receiving the first reflected light from the surface by the corresponding second micro-reflecting surface and making the second reflected light; and a distance on one side of the optical imaging means. A non-contact type image forming apparatus configured to form an image of the display as a first real image on the other side of the optical imaging unit and optically detecting an image position of the pointing unit that has touched the first real image. In the input device,
On the other side of the optical imaging means, the infrared illuminators is provided a first real image shines range formed on the surface of the display, the infrared sensor device that detects only the infrared light from the front side lined provided sheet-shaped optical sensor provided, the second real image light reflected on said display through the optical imaging means of an infrared (sometimes referred to as infrared light) from the instruction unit And the position of the second real image is detected by the optical sensor.

In the non-contact input device according to the present invention, it is preferable that a part or all of the light emitted from the display is high-frequency modulated (for example, several kHz to 200 MHz).
Moreover, it is preferable that the light emitted from the display includes an infrared ray, and each sensor element is an infrared sensor element.

And in the non-contact input device which concerns on this invention, it is preferable that the said each sensor element is provided with the non-light-transmissive material in the back side. When the sensor element is a visible light sensor element, a non-translucent material that blocks visible light is used. When the sensor element is an infrared sensor element, a non-translucent material that blocks infrared light is used.

In the non-contact input method according to the present invention that meets the object, a plurality of first and second micro-reflecting surfaces intersecting each other in plan view are arranged on the same plane, The first reflected light from the minute reflecting surface is received by the corresponding second minute reflecting surface to be the second reflected light, and a distance is provided on one side of the light imaging means. The display is provided, and an image on the display is formed as a first real image on the other side of the optical imaging unit, and an image position of the pointing unit that touches the first real image is optically detected. In the contact input method,
On the other side of the optical imaging means, the illuminator infrared illuminating range of the first real image is formed is provided, on the surface of the display, side by side infrared sensor elements for detecting the infrared light from the front side A sheet-like optical sensor is provided, and an image of the pointing means that is irradiated with infrared light and touches the first real image is displayed on the surface of the display via the light imaging means. And the position of the second real image is detected by the optical sensor that detects infrared light .

In the non-contact input method according to the present invention, it is preferable that the light emitted from the display includes infrared rays, and each of the sensor elements is an infrared sensor element.

A non-contact input device and a non-contact input method according to the present invention include a photosensor in which sensor elements that detect only infrared light from the front side are arranged on the surface of a display, and reflected light from an instruction unit. Is formed as a second real image on the display via the optical image forming means, and the position of the second real image is detected by the optical sensor, so that it is relatively simple without providing a special infrared ray generating means or an infrared camera. In addition, the position of the pointing means can be detected.
In addition, unlike the lens (camera), the optical imaging means does not have a special focal length, so even if the display position changes, the image on the indication means is imaged on the original display, giving a more accurate indication. The position of the means (for example, finger, pen tip, etc.) can be detected.

In particular, in the non-contact input device and the non-contact input method according to the present invention, when the light emitted from the display includes infrared rays and the sensor element of the optical sensor is an infrared sensor element, the position of the indication means is determined by infrared rays that are not visible. Can be detected.
Further, in the non-contact input device according to the present invention, when the optical sensor is formed in a sheet shape, it is easy to manufacture a display having the optical sensor, and a normal display can be adopted. Further, when using visible light as light, a conventional “photosensor liquid crystal pad” can be used as it is for a display. In this case, the sensor element is preferably provided with a non-light-transmitting material on the back side so as to detect only light from the front side. In addition, when mounting an optical sensor on a display as a sheet form, the thing of a structure different from a display may be sufficient.
The second real image received by the sheet-like optical sensor is subjected to arithmetic processing such as searching for the position of the center of gravity from the light reception data of each sensor element to obtain the position of the pointing means (for example, fingertip).

Here, when the display image is a keyboard or the like, it is preferable to provide a special light image (for example, a spotlight) at the center of each keyboard. Accordingly, the detection accuracy can be improved by matching the position of the optical sensor with the light image.

It is explanatory drawing of the non-contact input device which concerns on one Example of this invention. It is explanatory drawing of the optical image formation means used for the non-contact input device. (A), (B) is explanatory drawing of the display used for the non-contact input device, respectively.

Next, embodiments of the present invention will be described with reference to the accompanying drawings.
As shown in FIG. 1, a non-contact input device 10 according to an embodiment of the present invention is formed so as to be separated from a flat display 11 and an angle α of, for example, 30 to 60 degrees with the display 11. There is provided an optical imaging means 13 that receives an image 11a (see FIG. 2) displayed on the display 11 and forms the image 11a of the display 11 as a first real image 12 at a symmetrical position. Here, in addition to a flat plate-like display such as a normal liquid crystal display, a three-dimensional display having a light source inside, or a display having irregularities only on one side such as a keyboard can be used as the display. In some cases, a signboard (a still image display such as an electric display) having a light source (backlight) inside can be used. In particular, the still image may be three-dimensional or planar.

Further, when the light imaging means 13 uses a transparent material such as transparent plastic or glass as a main material, the transparent material enters the transparent material from the air and emits the light from the transparent material into the air. Since the refraction caused by the material is generated, the position of the display 11 is determined in consideration of the refraction angle. Note that the position of the display with respect to the optical imaging means is somewhat free, and focusing is not necessary when using a lens system.

As shown in detail in FIG. 2, the optical imaging means 13 is a flat plate-shaped first, which has a thickness of t <b> 1 and t <b> 2 (e.g., 0.1 to 5 mm), which are arranged in contact or close to each other. Second light control panels 14 and 15 are provided. Inside the first and second light control panels 14 and 15, a large number of strip-shaped planar light reflecting portions 18 and 19 are formed side by side at a constant pitch (p1 and p2) perpendicular to the surface on one side. Yes. Here, the planar light reflecting portions 18 and 19 erected on the first and second light control panels 14 and 15 are arranged so as to intersect in a plan view (in an orthogonal state in this embodiment).

The first and second light control panels 14 and 15 are formed of a transparent material such as glass or transparent plastic, except for the planar light reflecting portions 18 and 19. The planar light reflecting portions 18 and 19 are preferably made of a metal sheet with good reflection efficiency, a deposited metal, a metal sheet having an adhesive layer in the middle portion, or a mirror surface sheet, and both front and back surfaces are reflective surfaces. The present invention is applied even when only one surface is a reflecting surface. A method for manufacturing the optical imaging means 13 is described in, for example, WO2009 / 131128A1. In addition, examples of metals having high reflection efficiency include aluminum, silver, titanium, nickel, and chromium.

Usually, the pitches p1 and p2 of the planar light reflecting portions 18 and 19 are the same, and the thicknesses t1 and t2 of the first and second light control panels 14 and 15 are preferably the same for production efficiency. The pitch of the planar light reflecting portions 18 and 19 is treated as p, and the thickness of the first and second light control panels 14 and 15 is treated as t. When the light imaging means 13 is viewed in plan, the planar light reflecting portions 18 and 19 intersect to form a large number of square frames, as shown in the partially enlarged view of FIG. In this case, the aspect ratio γ (height / width) of one frame (that is, one frame) is thickness (t) / pitch (p). The aspect ratio γ is about 1 to 4.5. However, in order to obtain a brighter first real image 12 by being reflected by the single planar light reflecting portions 18 and 19 a plurality of times, 2.5 to 4.5 ( In more detail, it is preferable to set it to more than 3 and 4.5 or less.

First and second minute reflecting surfaces 20 and 21 intersecting in plan view are formed at one frame portion of the first and second light control panels 14 and 15. A large number of the first and second minute reflecting surfaces 20 and 21 are erected on the same plane. Therefore, the light from the display 11 arranged on one side of the light imaging means 13 is reflected by each first minute reflecting surface 20 of the first light control panel 14 on the front side (display 11 side) ( The first reflected light) is further reflected by the corresponding second minute reflecting surface 21 of the second light control panel 15 (second reflected light), and the first real image is formed on the other side of the light imaging means 13. 12 is formed. The first real image 12 is formed in the space and has the same size as the image 11 a formed on the display 11. In addition, the incident light and the reflected light include not only the case where the light is reflected only within one frame but also the case where the incident light and the reflected light are reflected by jumping over one frame.

Next, the display 11 used for the non-contact input device 10 will be described with reference to FIGS. 1, 3 </ b> A, and 3 </ b> B. The display 11 is basically a liquid crystal type, and includes a backlight 24, a liquid crystal display unit 25, a sheet-like infrared sensor 26 which is an example of an optical sensor, and a transparent protective plate 28a on the surface. ing.
The backlight 24 emits visible light and preferably emits infrared light. In this case, it is preferable to apply high-frequency modulation to light (part or all) from the backlight 24. When both the light emitting means A for emitting visible light and the light emitting means B for emitting infrared light are separately provided in the backlight 24, only the light emitting means B may be subjected to high frequency modulation. As the backlight 24, a light emitting diode or a fluorescent lamp can be used. Further, for example, organic or inorganic electroluminescence can be used as the display.

As shown in FIGS. 3A and 3B, the sheet-like infrared sensor 26 provided on the surface of the display 11 has a large number of infrared sensor elements (an example of sensor elements) 28 arranged in a lattice pattern. Conductor wires 29 and 30 are disposed on the surface. A conductive or non-conductive non-translucent material 27 is provided on the back side of the infrared sensor element 28 so that the infrared sensor element 28 detects only light from the front side. Reference numeral 25a denotes a transparent sheet.
The infrared sensor element 28 and the conductor wires 29 and 30 are transparent and allow visible light and infrared light to pass well. This infrared sensor 26 reacts only with infrared rays and generates electromotive force. A sensor that reacts to visible light and infrared light may be used as the infrared sensor element, and a filter that passes only infrared light may be provided on the upper part. Either or both of the infrared sensor element and the conductor line may be opaque. In this case, it is preferable to increase the aperture ratio of the display by reducing the area and width as much as possible.

The liquid crystal display unit 25 has a well-known structure, and R (red), G (green), and B (blue) color filters, which are part of the visible light emitting unit, are arranged in parallel, and R, G, B A liquid crystal cell is disposed immediately below each color filter, and visible light is emitted by light from a lower part of the backlight 24 which is turned on / off and adjusted in luminance by the liquid crystal cell. Therefore, the liquid crystal display unit 25 displays an image 11a having a predetermined shape (for example, a keyboard).

The present invention can also be applied to a display having a structure using light emitting diodes of R, G, B (or other colors) in parallel. The light emitting diodes of R, G, and B and the infrared sensor may be arranged as a single block, and the display may be a flat arrangement of the blocks.
Here, when visible light is used as light and a visible light optical sensor is used, an infrared shielding sheet may be provided on each block arranged in a plane.

When it is not possible to emit a sufficiently strong infrared ray from the display, an infrared illuminator that illuminates the entire range where the first real image 12 of the image 11a of the display 11 is formed on the other side of the optical imaging means 13. 32 can also be arranged. The light (infrared rays) from the illuminator 32 is provided with a hood (reflector) so that it does not enter the infrared sensor 26 and the optical imaging means 13. The light from the illuminator 32 is distinguished from natural light by high frequency modulation. Naturally, when the infrared sensor receives high-frequency modulated infrared light and performs signal processing, a specific part of the light (converted into an electrical signal) incident on the control circuit is received by the infrared sensor element 28. An electrical filter circuit that inputs only the frequency (high frequency) as a signal is provided.

Next, a non-contact input method using the non-contact input device 10 will be described.
As shown in FIG. 1, the optical imaging means 13 is disposed at a predetermined position, and the display 11 is disposed on one side thereof. For example, an image 11a of the touch panel is displayed on the display 11 and can be changed to an arbitrary image by, for example, a changeover switch. Since the display 11 emits light, the first real image 12 of the image 11a formed on the display 11 is reproduced at a symmetrical position with the light imaging means 13 as the center when the light passes through the light imaging means 13. Is done.

In this case, the first real image 12 is formed in the space, and even if the position of the display 11 is changed, the first real image 12 is not blurred and a clear image is reproduced. When the finger 34, which is an example of an instruction unit, touches the first real image 12, the finger 34 is irradiated with light (infrared rays) from the display 11, and reflected light (image of the finger 34) from the finger 34 is optically imaged. An image is formed as a second real image 35 on the display 11 via the means 13. Note that r1 to r4 indicate reflected light from the finger 34.
Since the second real image 35 is a clear image, its position is optically detected by the infrared sensor 26. Thereby, it is possible to clearly recognize which part of the first real image 12 the finger 34 has pressed. The second real image 35 is a clear image regardless of the position of the display 11. In FIG. 1, θ indicates that the pointing unit (finger 34) and the second real image 35 are symmetric with respect to the optical imaging unit 13. Here, in the case where infrared rays having a certain level of light intensity are not emitted from the display 11, it is preferable to use an infrared illuminator 32.
The position of the second real image 35 is detected by detecting which infrared sensor element 28 of the sheet-like (planar) infrared sensor 26 has received light, and performing image processing on the detected data.

In the above embodiments, infrared light that cannot be visually observed is used as light for detecting a real image. However, the present invention can be applied even to visible light. In this case, it can be distinguished from disturbance light by applying high frequency modulation to visible light. Here, the optical sensor can be incorporated as a visible light sensor in the block of the R, G, and B light emitting units.
In this case, it is preferable to provide a light shielding member on the back surface of each sensor element to detect only light from the front side of the display. The sensor element and the conductor wire connected to the sensor element are preferably transparent, but the present invention can be applied even if the sensor element is not light-transmitting. When infrared light is not used, a normal liquid crystal panel may be used, but a light emitting diode group that emits a predetermined color may be used.

The present invention is not limited to the above embodiments. For example, the image on the display may be a monochrome image instead of a color image.
In the present invention, the display includes not only an image but also a real image that is illuminated or transmitted. That is, when a light-transmitting member (a flat member or a curved member) is used as a display as a normal signboard, it is preferable to provide a light-shielding member on the back side of each sensor element. Those that detect only light (visible light or infrared light) may be used.
The present invention is also applied when a non-contact input device is formed by combining the components described above.
Further, the sensor sheet may be separable from the display or may have a joined structure.

The non-contact input device and method according to the present invention (device and method for detecting the indication position of a reproduced image in a non-contact manner), when used for an operation panel of various machines, have an operation panel (for example, a keyboard or a touch panel). When the reproduced image is displayed in the space and the operation button of the reproduced image is pressed, an input signal can be obtained. Therefore, the non-contact input device and method according to the present invention can be optimally used not only for operation panels of factory machines but also for touch panels of mobile phones, personal computers, automobiles, ships, and the like.

10: non-contact input device, 11: display, 11a: image, 12: first real image, 13: light imaging means, 14: first light control panel, 15: second light control panel, 18, 19 : Planar light reflecting portion, 20: first minute reflecting surface, 21: second minute reflecting surface, 24: backlight, 25: liquid crystal display portion, 25a: transparent sheet, 26: infrared sensor, 27: non-light-transmitting Material: 28: Infrared sensor element, 28a: Transparent protective plate, 29, 30: Conductor wire, 32: Illuminator, 34: Finger, 35: Second real image

Claims (4)

A large number of first and second micro-reflecting surfaces intersecting each other in plan view are arranged on the same plane, and the first reflected light from each of the first micro-reflecting surfaces corresponds to the corresponding first A light image forming means that receives the light from the two micro-reflecting surfaces as second reflected light, and a display provided at a distance on one side of the light image forming means. In a non-contact input device that forms a first real image on the other side of the imaging means and optically detects the image position of the pointing means that has touched the first real image,
On the other side of the optical imaging means, the infrared illuminators is provided a first real image shines range formed on the surface of the display, the infrared sensor device that detects only the infrared light from the front side Sheet-like photosensors provided side by side are provided , and infrared reflected light from the indicating means is formed as a second real image on the display via the optical imaging means, and the second real image A non-contact input device, wherein the position is detected by the optical sensor. 2. The non-contact input device according to claim 1, wherein a part or all of light emitted from the display is high-frequency modulated. 3. The non-contact input device according to claim 1, wherein each infrared sensor element is provided with a non-translucent material on the back side. A large number of first and second micro-reflecting surfaces intersecting each other in plan view are arranged on the same plane, and the first reflected light from each of the first micro-reflecting surfaces corresponds to the corresponding first An optical imaging means that receives the light from the two minute reflecting surfaces and generates a second reflected light, and a display provided at a distance on one side of the optical imaging means. In a non-contact input method of forming a first real image on the other side of the image means and optically detecting the image position of the pointing means that has touched the first real image,
On the other side of the optical imaging means, the illuminator infrared illuminating range of the first real image is formed is provided, on the surface of the display, side by side infrared sensor elements for detecting the infrared light from the front side A sheet-like optical sensor is provided, and an image of the pointing means that is irradiated with infrared light and touches the first real image is displayed on the surface of the display via the light imaging means. The non-contact input method is characterized in that the position of the second real image is detected by the optical sensor configured to detect infrared light .

Images