JP2017142577A - Non-contact display input device and method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a non-contact display input device and method which use an image displayed on a display as a space image and detect the specific position on the space image by pointing the specific position with pointing means such as a finger, a pointing bar and a touch pen.SOLUTION: A non-contact display input device 10: includes optical image formation means 13 in which first and second minute reflection surfaces 20, 21 intersecting each other in a plan view are erected in a large number and arranged on the same plane, and a display 11 which is provided on one side of the optical image formation means 13; forms an image 11a of the display 11 as a first image 12 on the other side of the optical image formation means 13; and optically detects the image position of pointing means 45 touching the first image 12. The non-contact display input device further includes an optical sensor 34 for detecting only light from the front side on the surface of the display 11, and forms a second image 46 of reflection light from the pointing means 45 on the display 11 via the optical image formation means 13, and detects the position of the second image 46 by the optical sensor 34.SELECTED DRAWING: Figure 1

Description

The present invention provides a non-contact display input device and a non-contact display input method (i.e., a method for inputting a signal by operating a pointing unit (e.g., a finger) while forming an image in space and viewing the image (e.g., a touch panel image). , An apparatus and a method for detecting a designated position of a reproduced image formed in a space without contact.

It is conventionally known that an image is displayed on a display (display device), and when a specific place of the image is pressed with a finger, the XY coordinates of the pressed portion are detected by a pressure sensor or the like, and the next operation is performed by this input signal. (For example, refer to Patent Document 1).

Also, as described in Patent Document 2, a matrix is formed by arranging a number of light emitting elements and light receiving elements in parallel along the XY axes directly above the display, and the surface of the display is touched with an obstacle such as a finger or a pen. In such a case, it has been proposed to detect the position where the obstacle is in contact with the display by crossing the matrix.

On the other hand, Patent Document 3 discloses first and second light control panels in which a large number of first and second planar light reflecting portions are arranged in parallel and at regular intervals inside a transparent flat plate. Using the optical imaging means placed in contact with or close to each other so that the planar light reflecting portion is in an orthogonal state in plan view, the image on the display and the image on which the infrared rays are irregularly reflected on the display surface are simultaneously reproduced in the air as a reproduced image. There has been proposed a method and an apparatus for detecting the position of the reproduction image by detecting the position of the instruction means displayed and touching the reproduction image with a two-dimensional infrared camera.

Also, as described in Patent Document 4, a device has been proposed in which an optical sensor is built in a transistor shape surface that constitutes a liquid crystal panel, and multi-touch with a finger on the liquid crystal surface, movement of a touch pen, and shape are recognized. Yes.

JP 2006-39745 A JP 2000-55928 A Japanese Patent No. 5509391 JP 2011-29919 A

However, the touch panels described in Patent Documents 1 and 2 have a flat display, a specific flat image is displayed on the display, and the input position can be detected by pressing a specific position on the display. It was. Therefore, when an image is pressed with a finger or a pen, the display surface or the touch panel surface is always contacted or collided, and the display or the like may become dirty or the display may be wrinkled.

In Patent Document 3, there is a problem that, in addition to the display, an infrared generation means (infrared light), an infrared diffuse reflection surface, and an infrared camera are required, and the device configuration becomes more complicated. In addition, since the infrared generation means and the infrared camera are arranged at positions different from the display and the optical imaging means, there is a problem that an installation space is required. In addition, since the infrared diffuse reflection surface is placed on the front side of the display, there is a problem that a part of the light of the display is absorbed. Further, in Patent Document 3, since the optical imaging means is used, there is no focal length for imaging as in the case of a lens. However, particularly when an infrared camera is used, the installation position is selected, and It is necessary to adjust the focus on the image.
Patent Document 4 proposes an optical touch panel that includes a liquid crystal panel with a backlight and an optical sensor that detects that the liquid crystal panel has been touched by reflected light, but the image on the touch panel is an aerial imaging type. Absent.

Furthermore, although a touch panel using a display is also used in ATMs and the like, it is not hygienic because an unspecified number of people touch the screen, and is not effective in preventing contact infection.
Moreover, when light is irradiated toward the display, the reflected light is emitted from the display, and the display may be difficult to see.

The present invention has been made in view of such circumstances, and an image to be displayed on a display is a spatial image, and a specific position of the spatial image is pointed by a pointing means such as a finger, a pointing stick, or a touch pen, and the position is detected. An object of the present invention is to provide a non-contact display input device and method capable of inputting a signal without physically touching.

In the non-contact display input device according to the first aspect of the present invention, a large number of first and second minute reflecting surfaces intersecting each other in plan view are arranged on the same plane. The first reflected light from the minute reflecting surface is received by the corresponding second minute reflecting surface to be the second reflected light, and a distance is placed between one side of the light imaging means. A non-contact display input device for forming an image of the display as a first image on the other side of the optical imaging means,
Reflected light from the pointing means that touched the first image from the front side is imaged as a second image on the display via the light imaging means, and the first image is detected by an optical sensor provided on the display. 2 detects the position of the indicating means, and the light detected by the optical sensor is signal-modulated.

In the non-contact display input device according to the first aspect of the invention, the reflected light from the instruction means may be visible light, but is preferably infrared light emitted from an infrared light emitter. Here, the infrared light emitter may be incorporated in the display, or the infrared light emitter may be provided outside the display. Furthermore, the infrared light emitter may be provided at one end of the optical imaging means.

Further, in the non-contact display input device according to the first aspect of the present invention, the photosensor is built in the display, and the photosensor is formed of a sheet-like photosensor sheet and is provided on the front side of the display. There may be.

In the non-contact display input device according to the first aspect of the present invention, the reflected light from the instruction means includes visible light emitted from a display, and the optical sensor is composed of a sheet-shaped optical sensor sheet capable of detecting visible light. You can also. In this case, a frame can be provided around the photosensor sheet.

In the non-contact display input method according to the second invention, a large number of first and second micro-reflecting surfaces intersecting each other in plan view are arranged on the same plane, and each of the first micro-reflecting surfaces is arranged. The first reflected light from the first image is received by the corresponding second minute reflecting surface to be the second reflected light, and is provided at a distance on one side of the light imaging means A non-contact display input for forming an image of the display as a first image on the other side of the optical imaging means and optically detecting an image position of the pointing means touching the first image. In the method
In addition to the display, an infrared light emitter emitting signal-modulated infrared light for illuminating the first image from the back side is provided, and the reflected light of the infrared light irradiated on the indication means for pressing the first image from the front side is provided. The light image forming means forms a second image on the display, and the position of the indicating means is detected by an optical sensor provided on the display.

In the non-contact display input method according to the second invention, it is preferable that the optical sensor is an optical sensor sheet for detecting the infrared ray provided on a display.

The non-contact display input device and the non-contact display input method according to the first and second aspects of the present invention detect light reflected from the indication means on the surface of the display or inside (light sensor elements are provided side by side). The sensor has a sensor and forms reflected light from the pointing means that touches (i.e., touches) the first image as a second image on the display via the light imaging means, and the position of the second image is determined as light. Since the detection is performed by the sensor, the position of the instruction means can be detected relatively easily without providing a special infrared camera or the like.
In addition, unlike the lens (camera), the optical imaging means does not have a special focal length, so even if the display position changes, the image on the indication means is imaged on the original display, giving a more accurate indication. The position of the means (for example, finger, pen tip, etc.) can be detected.

In particular, in the non-contact display input device and the method thereof according to the first and second inventions, when the reflected light from the indication means includes infrared rays and the optical sensor is an infrared light sensor, the indication means is caused by infrared rays that are not visible. Can be detected.
Further, in the non-contact display input device according to the first invention, when the photosensor is formed in a sheet shape (that is, the photosensor sheet), it becomes easy to manufacture a display having the photosensor. Adoption is also possible. Further, when using visible light as light, a conventional “photosensor liquid crystal pad” can be used as it is for a display. In this case, it is preferable to arrange a non-translucent material on the back side of the optical sensor so that only the light from the front side is detected. In addition, when mounting an optical sensor on a display as a sheet form, the thing of a structure different from a display may be sufficient.
For example, the second image received by the sheet-like optical sensor is subjected to arithmetic processing such as searching for the position of the center of gravity from the light reception data (only the position or the position and the amount of received light) of each optical sensor element constituting the optical sensor. The position of the instruction means (for example, fingertip) is obtained.

Here, when the display image is a keyboard or the like, it is preferable to provide a special light image (for example, a spotlight) at the center of each keyboard. Accordingly, the detection accuracy can be improved by matching the position of the optical sensor with the light image.
In addition, when a 2nd image is divided into plurality, it is preferable to detect each 2nd image independently with an optical sensor. In addition, since the second image has an area, it is preferable to calculate the center of gravity of the second image and determine the exact designated position of the second image.

It is explanatory drawing of the non-contact display input device which concerns on the 1st Embodiment of this invention. It is explanatory drawing of the optical image formation means used for the non-contact display input device. (A), (B) is explanatory drawing of the display used for the non-contact display input device, respectively. It is explanatory drawing of the display which concerns on the modification used for the non-contact display input device. (A), (B) is explanatory drawing of the display used for the non-contact display input device which concerns on the 2nd Embodiment of this invention, respectively. It is explanatory drawing of the non-contact display input device which concerns on the 3rd Embodiment of this invention. It is explanatory drawing of the display used for the non-contact display input device which concerns on the 4th Embodiment of this invention. (A) is explanatory drawing of the optical sensor sheet | seat used for the non-contact display input device, (B) is explanatory drawing of the display used for the non-contact display input device.

Next, embodiments of the present invention will be described with reference to the accompanying drawings.
As shown in FIGS. 1 and 2, the non-contact display input device 10 according to the first embodiment of the present invention is formed apart from a flat display 11 with an angle α of 20 to 70 degrees. The image forming unit 13 includes a light image forming unit 13 that receives the image 11 a displayed on the display 11 and forms the image on the display 11 as a first image 12 at a symmetrical position. Here, in addition to a flat plate-like display such as a normal liquid crystal display, a three-dimensional display having a light source inside, or a display having irregularities only on one side such as a keyboard can be used as the display. . When the display is a keyboard, a bright portion brighter than the surrounding can be provided in the center, which facilitates operation. When a liquid crystal display is used, data of many types of images can be stored in a memory, and these images can be reproduced in space by the optical imaging means 13 (the same applies to the following embodiments).

Further, when the light imaging means 13 uses a transparent material such as transparent plastic or glass as a main material, the transparent material enters the transparent material from the air and emits the light from the transparent material into the air. Since the refraction caused by the material is generated, the position of the display 11 is determined in consideration of the refraction angle (the same applies to the following embodiments). Note that the position of the display with respect to the optical imaging means 13 is somewhat free, and focusing is not necessary when using a lens system. The image 12 is formed symmetrically with the image 11a with the optical imaging means 13 at the center.

As shown in detail in FIG. 2, the optical imaging means 13 is a flat plate-shaped first, which has a thickness of t <b> 1 and t <b> 2 (e.g., 0.1 to 5 mm), which are arranged in contact or close to each other. Second light control panels 14 and 15 are provided. Inside the first and second light control panels 14 and 15, a large number of strip-shaped planar light reflecting portions 18 and 19 are formed side by side at a constant pitch (p 1, p 2) perpendicular to the surface on one side. Yes. Here, the planar light reflecting portions 18 and 19 of the first and second light control panels 14 and 15 are arranged so as to intersect with each other in a plan view (in an orthogonal state in this embodiment).

The first and second light control panels 14 and 15 are formed of a transparent material such as glass or transparent plastic, except for the planar light reflecting portions 18 and 19 whose front and back surfaces act as mirror surfaces. The planar light reflecting portions 18 and 19 are preferably made of a metal sheet having good reflection efficiency, vapor deposited metal, a metal sheet having an adhesive layer in the middle, or a mirror surface sheet, and both the front and back surfaces are reflecting surfaces. The present invention is applied even when only one surface is a reflecting surface. A method for manufacturing the optical imaging means 13 is described in, for example, WO2009 / 131128A1. Examples of metals having high reflection efficiency include aluminum, silver, titanium, nickel, and chromium.

Usually, the pitches p1 and p2 of the planar light reflecting portions 18 and 19 are the same, and the thicknesses t1 and t2 of the first and second light control panels 14 and 15 are preferably the same for the production efficiency. The pitch of the planar light reflecting portions 18 and 19 is treated as p, and the thickness of the first and second light control panels 14 and 15 is treated as t. When the light imaging means 13 is viewed in plan, the planar light reflecting portions 18 and 19 intersect to form a large number of square frames, as shown in the partially enlarged view of FIG. In this case, the aspect ratio γ (height / width) of one frame (that is, one frame) is thickness (t) / pitch (p). The aspect ratio γ is about 1 to 4.5, but in order to obtain a brighter image 12 by being reflected by a single planar light reflecting portion 18 and 19 a plurality of times, the aspect ratio γ is 2.5 to 5.5. (More specifically, it is better to exceed 3 and below 5).

First and second minute reflecting surfaces 20 and 21 intersecting in plan view are formed at one frame portion of the first and second light control panels 14 and 15. A large number of the first and second minute reflecting surfaces 20 and 21 are erected on the same plane. Accordingly, the light from the display 11 arranged at a distance on one side of the light imaging means 13 is transmitted to each first minute reflecting surface 20 of the first light control panel 14 on the front side (display 11 side). Is reflected (first reflected light) and further reflected by the corresponding second minute reflecting surface 21 (second reflected light) to form the image 12 on the other side of the light imaging means 13. This image 12 is formed in the space and has the same size as the image 11 a formed on the display 11. In addition, the incident light and the reflected light include not only the case where the light is reflected only within one frame but also the case where the incident light and the reflected light are reflected by jumping over one frame.

Next, the display 11 used in the non-contact display input device 10 will be described with reference to FIGS. 3 (A), 3 (B), and 4. The display 11 is basically a liquid crystal type, and includes an R light emitting means 26, a G light emitting means 27, and a B light emitting means 28, which are examples of a backlight 24, a liquid crystal section 25, and a light emitting section for visible light. A plurality of cells (light emission blocks) 29 having the following (hereinafter also simply referred to as RGB light emitting means 26 to 28) have a display unit 30 arranged in a grid pattern. Here, the R light emitting means 26, the G light emitting means 27, and the B light emitting means 28 do not emit light themselves, and when the light of the backlight 24 passes through the liquid crystal unit 25, R (red), G (green), B ( The part that emits light in blue) can be replaced with a simple color filter.

The liquid crystal unit 25 has a well-known structure, and is supplied with power by strip-like transparent electrodes 31 and 32 arranged in a grid in the X and Y directions above and below, and is in cell units (ie, RGB) in a light shielding state and a light transmitting state. Light emitting means 26-28 units). The cells 29 arranged in the display unit 30 include, in addition to the RGB light emitting units 26 to 28, in units of cells 29, an infrared light emitting unit (a part of an infrared light emitter, one cell) 33 and an infrared sensor 34 as an example of a light sensor. have. Note that the infrared light emitter emits infrared light that is signal-modulated (for example, high-frequency modulation and signal is superimposed) that illuminates the first image 12 from the back side. Above and below each infrared sensor (more precisely, the infrared sensor element) 34, strip-shaped transparent electrodes 36 and 37 that obtain optical signals from the infrared sensor 34 (which may be supplied with power) are arranged vertically in a grid pattern. 3A and 3B, 39 to 41 and 41a denote transparent protective plate materials, 42 denotes a deflection filter, and 43 denotes a barrier of each cell 29. Further, as the light source of the backlight 24, a light source including red, blue, and green visible light and including infrared light is used. The liquid crystal unit 25 is controlled using the transparent electrodes 31 and 32, and the infrared sensor 34 is controlled using the transparent electrodes 36 and 37. Here, reference numeral 25a denotes a liquid crystal unit main body. The transparent electrodes 31, 32, 36, and 37 shown in FIG. 4 are shown in different directions from the transparent electrodes 31, 32, 36, and 37 shown in FIG. Therefore, the display 11 shown in FIG. 4 is a modification of the display 11 shown in FIG. In addition, the optical sensor may be provided in all of the light emitting blocks, or may be provided in some of the light emitting blocks. A non-translucent material is disposed at the bottom of the infrared sensor 34, which is an example of the optical sensor, and has a structure that does not detect light from the back surface (the same applies to the following embodiments).

The operation of this display 11 will be described. When the backlight 24 is turned on, when the liquid crystal unit 25 corresponding to (that is, directly below) the RGB light emitting means 26 to 28 and the infrared light emitting unit 33 in each cell 29 is turned on and off via the transparent electrodes 31 and 32, Visible light and infrared light are generated from one cell 29. As a result, an image 11 a can be formed on the display 11 and infrared light having a uniform illuminance is generated from the display 11.

As shown in FIG. 1, light (for example, r1, r2) from the image 11a displayed on the display 11 enters the light imaging means 13 and exits from the light imaging means 13 (r′1, r). '2) forms an image 12 on the other side. The image 11 and the image 12 on the display 11 are formed bilaterally or vertically symmetrical about the optical imaging means 13. In this case, the infrared rays emitted from the infrared light emitting unit 33 of the display 11 are formed in a planar shape and overlapped with the position of the image 12, but cannot be visually recognized.

Here, as shown in FIG. 1, when a predetermined position of the image 12 is touched from the front side with a finger (which may be a touch pen, a pointing stick, or the like) as an example of the indication unit 45, reflected light of infrared rays is generated from the indication unit 45. The image is formed as a second image 46 on the display 11 side (that is, on the display 11) via the light imaging means 13. As shown in FIG. 1, the infrared reflected light from the indicating means 45 enters the light imaging means 13 on the return path r3, r4, is bent and reflected by the light imaging means 13, and r'3, r '. The second image 46 is formed through four return paths. Since the second image 46 is formed by infrared rays, it cannot be visually observed. In FIG. 1, α indicates that the first image 12 and the second image 46 are formed symmetrically with respect to the optical imaging means 13.

Here, the infrared sensor 34 arranged on the display 11 detects the infrared image of the instruction means 45, and thereby it can be detected which part of the image 12 is pressed. For example, when the image 12 is a keyboard or the like, the pressed position of the keyboard can be detected.
Therefore, the non-contact display input device 10 does not require an external infrared light emitting unit or an infrared camera, but the display 11 is not provided with an infrared light emitting unit, and an infrared light emitting device 45a is provided at one end of the optical imaging means. 45b (any one of them) may be provided, and the infrared emitters 45a and 45b may be provided with a suitable hood so that the infrared rays irradiate the entire first image 12 and not the other portions. preferable. Note that the positions of the infrared light emitting units 45a and 45b are arbitrary, but it is preferable that the infrared light emitting units 45a and 45b be arranged at a position and an angle that do not enter the eyes of the person who operates the second image 12 as much as possible.
Further, as shown in FIG. 1, a rectangular frame 46 a can be provided around the first image 12, whereby the operation area of the instruction means 45 can be clarified. The frame 46a can also be displayed on the display 11.

Subsequently, a non-contact display input device 50 according to a second embodiment of the present invention will be described. The entire configuration of the non-contact display input device 50 shown in FIG. 1 is the same as that of the non-contact display input device 10 according to the first embodiment except for the display 11. In the display 51, a light emitting diode is used instead of the liquid crystal (the liquid crystal display and the display using the light emitting diode are also provided in the following embodiments).
As shown in FIGS. 1 and 2, the non-contact display input device 50 is formed so as to be separated from a flat display 51 with an angle α of 20 to 70 degrees, and an image 11 a displayed on the display 51 is displayed. Optical image forming means 13 is provided for entering light and forming an image 12 at a symmetrical position.

A partially enlarged view of the display 51 is shown in FIG. 5A, and a cross-sectional enlarged portion of the display 51 is shown in FIG. The display 51 of the non-contact display input device 50 forms an image using a light emitting diode type instead of a liquid crystal type. Accordingly, the display 51 includes, in addition to the R light emitting means 52, the G light emitting means 53, and the B light emitting means 54 (visible light emitting parts) each formed of a light emitting diode, an infrared light emitting part 55 made of a light emitting diode, and a photodiode. A number of cells (light-emitting blocks) 58 having an infrared sensor (an example of an optical sensor) 56 made of the like are provided. 57 is a barrier that divides each cell 58 (one cell is shown by hatching in FIG. 5A), and 60 and 61 are power supplies to the respective light emitting diodes of the R light emitting means 52, the G light emitting means 53, and the B light emitting means 54 A band-shaped transparent electrode is shown which supplies and receives a signal from the infrared sensor 56. The transparent electrode 61 may be opaque. Reference numeral 63 denotes a transparent protective plate, 64 denotes a protective plate, and 65 denotes a polarizing filter, but the polarizing filter 65 can be omitted. In addition, an infrared light emitter that performs planar light emission is formed by a plurality of infrared light emitting units 55 arranged on a plane (the same applies to the above-described embodiment).

As a result, a visible light image including red, green and blue light and an infrared ray can be emitted from the display 51, and the image 11 a displayed on the display 51 is a space at a symmetrical position via the light imaging means 13. An image 12 is formed in
When the image means 12 is brought into contact with the instruction means 45, the reflected light (infrared ray) is imaged as an infrared image (second image 46) on the surface of the display 51 through the optical imaging means 13, and the position is detected by the infrared sensor 56. Can be detected.
In addition, the infrared light emission part 55 can be removed from the display 51 here, and the infrared light emission part 55 can also be arrange | positioned in a position different from a display.

FIG. 6 shows a display of the non-contact display input device according to the third embodiment of the present invention. The R light-emitting means 67, the G light-emitting means 68, the B light-emitting means 69, and the infrared sensor, each of which is a light-emitting diode, are shown. 70 is provided in one light emitting block (cell) 71. In this case, as shown in FIG. 1, the infrared light emitters 45 a and 45 b are located outside the display, for example, at the end of the optical imaging means 13. , They may be arranged at different positions. Reference numeral 72 denotes a barrier that partitions each light emitting block 71.

Subsequently, a non-contact display input device 75 according to a fourth embodiment of the present invention will be described with reference to FIGS.
The non-contact input device 75 is formed so as to be separated from the flat display 76 with an angle α of, for example, 30 to 60 degrees, and receives an image (for example, a keyboard, a switch panel, etc.) 77 displayed on the display 76. Optical imaging means 79 (same structure as the optical imaging means 13 used in the first embodiment) is provided which forms an image 77 of the display 76 as a first image 78 at a symmetrical position by light.

Next, the display 76 will be described. The display 76 is basically a liquid crystal type, and is an example of a backlight 80, a liquid crystal display unit 81, and a sheet-like photosensor (photosensor sheet) as shown in FIG. 8B. A sheet-like infrared sensor 82 and a transparent protective plate 83 on the surface are provided.
The backlight 80 emits visible light and preferably emits infrared light. In this case, it is preferable to apply high-frequency modulation (an example of signal modulation) to light (part or all) from the backlight 80. . When both the light emitting means A for emitting visible light and the light emitting means B for emitting infrared light are separately provided in the backlight 80, only the light emitting means B may be subjected to high frequency modulation. A light emitting diode or a fluorescent lamp can be used as the backlight 80. In addition, for example, organic or inorganic electroluminescence can be used as the display (the same applies to the above embodiments).

As shown in FIGS. 8A and 8B, the sheet-like infrared sensor 82 provided on the surface of the display 76 has a large number of infrared sensor elements (an example of sensor elements) 84 arranged in a lattice pattern. Conductor wires 86 and 87 are arranged in the (thickness direction). A conductive or non-conductive non-translucent material 89 is provided on the back side of the infrared sensor element 84 so that the infrared sensor element 84 detects only light from the front side. Reference numeral 90 denotes a transparent sheet.

The conductor lines 86 and 87 are transparent and allow visible light and infrared light to pass well. This infrared sensor element 84 reacts only with infrared rays and generates electromotive force. A sensor that reacts with visible light and infrared light may be used as the infrared sensor element, and a filter that allows only infrared light to pass through may be provided on the light incident side. Either or both of the infrared sensor element and the conductor line may be opaque. In this case, it is preferable to increase the aperture ratio of the display by reducing the area and width as much as possible.
The sheet-like infrared sensor 82 can be provided separately from the display 76 and can be provided on the surface of the display 76 later by bonding or the like.
In this embodiment, infrared light is used as the optical sensor sheet, but visible light may be used. A frame 91 can also be provided around the optical sensor sheet.

The liquid crystal display unit 81 has a well-known structure, and R (red), G (green), and B (blue) color filters, which are part of the visible light emitting unit, are arranged in parallel, and R, G, B A liquid crystal cell is disposed immediately below each of the color filters. The light emission of the visible light is controlled by 1) on / off of the liquid crystal cell, 2) brightness adjustment, or 3) light adjustment from the lower part of the backlight 80. Accordingly, the liquid crystal display unit 81 displays an image 77 having a predetermined shape (for example, a keyboard).

The present invention can also be applied to a display having a structure using light emitting diodes of R, G, B (or other colors) in parallel. The light emitting diodes of R, G, and B and the infrared sensor may be arranged as a single block, and the display may be a flat arrangement of the blocks.
Here, when visible light is used as light and a visible light optical sensor is used, an infrared shielding sheet may be provided on each block arranged in a plane.

The present invention is not limited to the above embodiment, and for example, the image on the display may be a black and white image instead of a color image.
In the present invention, the display includes not only an image but also a real image that is illuminated or transmitted. That is, when a light-transmitting member (a flat member or a curved member) is used as a display as a normal signboard, a light-shielding member is preferably provided on the back side of each optical sensor element. You may use what detects only the light (visible light or infrared light) from the front side.
The present invention is also applied to the case where the non-contact display input device and the method thereof are formed by combining the components described above.
Further, the optical sensor sheet may be separable from the display or may have a joined structure.
The present invention is also applied to the case where the display, the optical imaging means, and the optical sensor are formed by combining those according to the first to fourth embodiments.

10: non-contact display input device, 11: display, 11a: image, 12: first image, 13: light imaging means, 14: first light control panel, 15: second light control panel, 18, 19: plane light reflecting portion, 20: first minute reflecting surface, 21: second minute reflecting surface, 24: backlight, 25: liquid crystal portion, 25a: liquid crystal portion main body, 26: R light emitting means, 27: G Light emitting means, 28: B light emitting means, 29: cell, 30: display section, 31, 32: transparent electrode, 33: infrared light emitting section, 34: infrared sensor, 36, 37: transparent electrode, 39-41, 41a: protection Plate material: 42: Deflection filter, 43: Barrier, 45: Instruction means, 45a, 45b: Infrared light emitter, 46: Second real image, 46a: Frame, 50: Non-contact display input device, 51: Display, 52: R Light emitting means, 53: G light emitting means, 54: B Light means, 55: infrared light emitting section, 56: infrared sensor, 57: barrier, 58: cell, 60, 61: transparent electrode, 63: transparent protective plate material, 64: protective plate material, 65: polarizing filter, 67: R light emitting means 68: G light emission means, 69: B light emission means, 70: infrared sensor, 71: light emission block, 72: barrier, 75: non-contact display input device, 76: display, 77: image, 78: first image, 79: Light imaging means, 80: Backlight, 81: Liquid crystal display unit, 82: Infrared sensor, 83: Transparent protective film, 84: Infrared sensor element, 86, 87: Conductor wire, 89: Non-translucent material, 90: Transparent sheet, 91: Frame

Claims (11)

A large number of first and second micro-reflecting surfaces intersecting each other in plan view are arranged on the same plane, and the first reflected light from each of the first micro-reflecting surfaces corresponds to the corresponding first A light image forming means that receives the light from the two micro-reflecting surfaces as second reflected light, and a display provided at a distance on one side of the light image forming means. In the non-contact display input device that forms the first image on the other side of the imaging means,
Reflected light from the pointing means that touched the first image from the front side is imaged as a second image on the display via the light imaging means, and the first image is detected by an optical sensor provided on the display. A non-contact display input device characterized in that the image of 2 is detected to determine the position of the pointing means, and the light detected by the optical sensor is signal-modulated. 2. The non-contact display input device according to claim 1, wherein the reflected light from the instruction means is infrared light emitted from an infrared light emitter. 3. The non-contact display input device according to claim 2, wherein the infrared light emitter is incorporated in the display. The non-contact display input device according to claim 2, wherein the infrared light emitter is provided outside the display. 5. The non-contact display input device according to claim 4, wherein the infrared light emitter is provided at one end of the optical imaging means. The non-contact display input device according to claim 1, wherein the optical sensor is built in the display. 6. The non-contact display input device according to claim 1, wherein the photosensor is a sheet-like photosensor sheet, and is provided on the front side of the display. Display input device. 2. The non-contact display input device according to claim 1, wherein the reflected light from the instruction means includes visible light emitted from the display, and the optical sensor is formed of a sheet-like optical sensor sheet capable of detecting visible light. Non-contact display input device characterized by. 9. The non-contact display input device according to claim 7, wherein a frame is provided around the optical sensor sheet. A large number of first and second micro-reflecting surfaces intersecting each other in plan view are arranged on the same plane, and the first reflected light from each of the first micro-reflecting surfaces corresponds to the corresponding first An optical imaging means that receives the light from the two minute reflecting surfaces and generates a second reflected light, and a display provided at a distance on one side of the optical imaging means. In the non-contact display input method for optically detecting the image position of the pointing means formed as the first image on the other side of the image means and touching the first image,
In addition to the display, an infrared light emitter emitting signal-modulated infrared light for illuminating the first image from the back side is provided, and the reflected light of the infrared light irradiated on the indication means for pressing the first image from the front side is provided. A non-contact display input method, wherein the light image forming means forms a second image on the display, and the position of the indicating means is detected by an optical sensor provided in the display. 11. The non-contact display input method according to claim 10, wherein the optical sensor is an optical sensor sheet that detects the infrared ray provided on the display.

Images