WO2019163339A1

WO2019163339A1 - Non-contact input device and non-contact input method

Info

Publication number: WO2019163339A1
Application number: PCT/JP2019/001284
Authority: WO
Inventors: 誠大坪
Original assignee: 株式会社アスカネット
Priority date: 2018-02-22
Filing date: 2019-01-17
Publication date: 2019-08-29
Also published as: JPWO2019163339A1

Abstract

A display (14) is positioned to one side of a half-mirror (12), and a sheet-shaped infrared sensor (15) is disposed on said display (14). A first image displayed on the display (14) is formed to the other side of the half-mirror (12) as a second image via the half-mirror (12) and retro-reflective bodies (11, 11a). An infrared beam is radiated toward the second image, and the infrared beam that has been reflected by a pointing means (38) having manipulated the second image and that has passed through the half-mirror (12) and the retro-reflective bodies (11, 11a) forms an image on the display (14). The position at which the image of the pointing means (38) has been formed is sensed by the infrared sensor (15).

Description

Non-contact input device and non-contact input method

The present invention provides a non-contact input device and a non-contact input method (that is, a reproduced image) in which a real image is formed in the air and a signal can be input by operating an instruction unit (for example, a finger) while viewing the real image (for example, a touch panel image). And a method for detecting the designated position in a non-contact manner.

An image is displayed on the display (display device), and a specific place of the image is pressed with a finger via a touch panel provided on the surface of the display, and a pressure sensor or the like provided on the back side of the touch panel is used to It has been conventionally known that the XY coordinates are detected and the next operation is performed by this input signal (see, for example, Patent Document 1).
However, in the technique described in Patent Document 1, there is a problem that it is necessary to directly press the touch panel surface and it cannot be operated with a dirty finger, and a problem that it is not hygienic because many unspecified people touch it.

Therefore, in order to solve the above problem, Patent Document 2 discloses a light imaging means in which a plurality of first and second strip-shaped light reflecting surfaces orthogonal to each other in plan view are arranged on the same plane. And a display provided on one side of the light imaging means so as to be inclined with respect to the light imaging means, and an image of the display (for example, a keyboard) is transmitted to the other side space via the light imaging means. Forming an image of the pointing means (for example, a finger) touching the first image on the screen of the display as the second image using the optical imaging means, A non-contact input device that detects the position of the second image with an optical sensor provided on the display has been proposed.
However, the technique described in Patent Document 2 uses optical imaging means in which a large number of first and second strip-shaped light reflecting surfaces orthogonal to each other in plan view are arranged on the same plane. There is a problem that it is difficult to manufacture a large non-contact input device, and even if manufactured, it is expensive.

On the other hand, Patent Document 3 discloses a retroreflector having first to third light reflecting surfaces arranged orthogonal to each other, can be formed into a flat plate shape, and can be mass-produced. In some cases, a retroreflector that can also be used as a stereoscopic image display device has been proposed.
However, Patent Document 3 is a disclosure of a retroreflector and a manufacturing method thereof, and there is a description about processing an image using a display and using a retroreflector as part of a non-contact input device. Absent.

JP 2006-39745 A JP 2017-142577 A Japanese Patent No. 6118004

The present invention has been made in view of such circumstances, and provides a non-contact input device and a non-contact input method that can be mass-produced, can cope with an increase in size, and can input signals without physically touching a display. The purpose is to do.

The non-contact input device according to the present invention that meets the above-described object includes a retroreflector, a half mirror that is erected on the functional side of the retroreflector, and a distance between the half mirror and one side of the half mirror. And a display for displaying the first image set in advance, the display surface being directed toward the half mirror, wherein the display detects infrared light irradiated toward the display An infrared light sensor is provided, and the first image displayed on the display is formed as a second image on the other side of the half mirror via the half mirror and the retroreflector. Infrared rays are emitted from the half mirror side toward the second image by an infrared irradiator, and reflected infrared rays from the instruction means that has operated the second image are reflected on the half mirror and the recursive reaction. Is imaged on the display through the body, to detect the imaging position of the indicating means by said infrared light sensor. Here, it is preferable to use a half mirror having a light transmittance of 35 to 65%.
Here, the retroreflector is preferably planar, but may be nonplanar (for example, a curved surface or a curved surface) as long as it reflects light in a specific direction.

In the non-contact input device according to the present invention, it is preferable that the infrared light sensor detects only the infrared light that has been optically modulated (for example, high frequency modulation or digital modulation). This can be distinguished from natural infrared light.

In the non-contact input device according to the present invention, it is preferable that the half mirror has a thickness (substantially transparent sheet thickness) in the range of 10 to 500 μm. As a result, the deviation of the light passing through the half mirror can be reduced, resulting in clearer image formation. Even if the thickness of the half mirror exceeds 500 μm, the present invention is applicable, but the second image is not clear.

In the non-contact input device according to the present invention, it is preferable that a support for keeping the half mirror flat is provided above and below or around the half mirror. As a result, the half mirror can be held flat.

In the non-contact input device according to the present invention, it is preferable that the retroreflector is disposed horizontally, and the retroreflector is divided into left and right with the half mirror as a center.
Further, in the non-contact input device according to the present invention, the left and right retroreflectors are respectively orthogonal first and second light reflecting surfaces and perpendicular light orthogonal to the first and second light reflecting surfaces. The micro retroreflective block of the retroreflector formed on the left and right sides of the half mirror includes a plurality of micro retroreflective blocks having a reflective surface, and each vertical light reflecting surface faces the half mirror side. It is good to have.

In the non-contact input device according to the present invention, the retroreflector can be formed by arranging a large number of cubic corners having three light reflecting surfaces orthogonal to each other in a plane. In this case, it is preferable that the center line of the cubic corner is vertical.

In the non-contact input device according to the present invention, the infrared light sensor is formed in a sheet shape, and is disposed in contact with a display surface (image display surface) of the display (including a case where it is joined). preferable. In this case, it is preferable that the back surface of the sheet-like infrared light sensor is subjected to a non-translucent process and is not affected by light from the display.

The non-contact input method according to the present invention includes, for example, a planar retroreflector, a half mirror erected on the functional side of the retroreflector, and the half mirror on one side of the half mirror. The display surface is arranged at a distance and facing the half mirror, and a display that displays a preset first image is used, and infrared light irradiated toward the display is detected on the display. An infrared light sensor
The first image displayed on the display is formed as a second image on the other side of the half mirror via the half mirror and the retroreflector, and the half image is directed toward the second image. Infrared light is irradiated from the mirror side, and the reflected infrared light from the instruction means that has operated the second image is imaged on the display via the half mirror and the retroreflector, and the infrared light sensor The imaging position of the instruction means is detected.

In the non-contact input device and the non-contact input method according to the present invention, since a retroreflector is used, a large non-contact input device can be manufactured at a relatively low cost.

It is explanatory drawing of the non-contact input device which concerns on one Example of this invention. (A), (B) is explanatory drawing of a display. It is explanatory drawing of the light ray which passes a half mirror. (A), (B) is explanatory drawing of the support body of a half mirror. (A), (B) is an expansion explanatory view of J section of Drawing 1, (C), (D) is an expansion explanatory view of K section of Drawing 1.

Subsequently, embodiments of the present invention will be described with reference to the accompanying drawings for understanding of the present invention.
As shown in FIG. 1, the non-contact input device 10 according to an embodiment of the present invention includes a

horizontal retroreflector

11, 11 a and a function side of the

retroreflector

11, 11 a (this In the embodiment, the half mirror 12 erected in the center (front side, upper side), and the display surface 13 is arranged facing the half mirror 12 at a distance from the half mirror 12 on one side of the half mirror 12 and set in advance. And a display 14 for displaying the first image, and an infrared irradiator 16 provided on the other side of the half mirror 12 to illuminate the anti-half mirror 12 side. In this embodiment, the retroreflector is divided into left and right, but a single retroreflector may be used, or it may be further divided into three or more.

The display 14 is provided with a sheet-like infrared light sensor 15 that detects infrared light irradiated toward the display surface 13 of the display 14. As shown in FIGS. 2A and 2B, the infrared light sensor 15 is connected to a large number of infrared light sensor cells 17 arranged in a lattice pattern and to the upper and lower portions of the infrared light sensor cell 17. It has transparent conducting

wires

19 and 20 wired in a matrix and insulating transparent

protective sheets

22 and 23, and is attached to the display surface 13 of the display 14.

The back surface of the infrared light sensor cell 17 is subjected to an opaque process (blind process) so that the infrared light sensor cell 17 does not react to the light emitted from the display 14. With such a structure, a commercially available display can be used, and the entire apparatus can be manufactured at low cost. A connector for connecting data obtained by the sheet-like infrared light sensor 15 to a control device (including a computer) 37 is provided at the X-direction end and the Y-direction end of the sheet-like infrared light sensor 15. Is provided.

As shown in FIG. 3, the half mirror 12 includes a transparent film 25 and a half mirror layer 26 formed on one side thereof. Since the thickness of the half mirror layer 26 is 2 μm or less, the thickness of the half mirror 12 is preferably 10 to 500 μm (preferably 10 to 100 μm) based on the thickness t 1 of the film 25. In this case, since the half mirror 12 itself has no strength, as shown in FIG. 4 (A), a frame 27 is provided around it, or as shown in FIG. A weight bar 27b is provided. These serve as a support that keeps the half mirror 12 flat. In this embodiment, the angle formed by the half mirror 12 and the display 14 is 35 to 60 degrees, but the present invention can be applied to other angles.

As shown in FIG. 3, the light L (including visible light and infrared light) L enters the half mirror 12 from an oblique direction, so the thickness of the half mirror 12 is selected to be 10 to 500 μm as described above. doing. The reason will be described with reference to FIG. The light beam L incident on the film 25 at the point P at the angle θ1 is bent at the angle θ2, passes through the half mirror layer 26, and exits from the point Q of the half mirror layer 26 at the angle θ1. On the other hand, the light beam L1 reflected at the point Q of the half mirror layer 26 is reflected from the back surface at the point R of the film 25 and becomes the light beam L2 toward the half mirror layer 26. Since the back surface reflectance of the half mirror layer 26 is as large as about 10%, for example, the light beam L1 that has passed through the half mirror 12 having a thickness causes birefringence and a clear image cannot be obtained. Therefore, in this embodiment, the thickness of the half mirror 12 is reduced. d1 indicates the optical path difference between the light beam L2 and the light beam L3 that has passed through the half mirror 12, and is proportional to the thickness t1 of the half mirror 12. However, in the case of a push button switch or the like in which the image on the display 14 is turned on and off, the image may be rough, and thus, for example, a thick half mirror using glass can be used.

Subsequently, the

retroreflectors

11 and 11a will be described with reference to FIGS. 1 and 5A to 5D. In this embodiment, as the

retroreflectors

11 and 11a, those described in Patent Document 3 (Patent No. 6118004) are used. That is, the

retroreflectors

11 and 11a arranged on the left and right (horizontal) with the half mirror 12 in the center are spaced apart from the

light reflecting grooves

29 and 29a arranged in parallel above the

flat blocks

28 and 28a. And

partition walls

30 and 30a orthogonal to the

light reflection grooves

29 and 29a. The

light reflection grooves

29 and 29a are orthogonal to the first and second light reflection surfaces 31, 32, 31a and 32a. The

partition walls

30 and 30a are provided with a draft angle that becomes narrower toward the upper side, and are perpendicular to the first and second

light reflecting surfaces

31, 32, 31a, and 32a on one side. 33, 33a. The first and second

light reflecting surfaces

31 and 32 and the vertical light reflecting surface 33 constitute the first minute retroreflective block, and the first and second

light reflecting surfaces

31a and 32a and the vertical light reflecting surface are formed. It has the surface 33a and constitutes a second minute retroreflective block.

In this embodiment, the vertical

light reflecting surfaces

33 and 33a of the first and second micro retroreflective blocks provided on the left and

right retroreflectors

11 and 11a face each other and face the half mirror 12 side. It is suitable. As a result, the optical axis of each retroreflector element (small retroreflective block) of the left and

right retroreflectors

11 and 11a can be tilted toward the half mirror 12 to increase the reflection efficiency. Note that a large number of corner cubes (cubic corners) having a cube corner shape and three orthogonal light reflecting surfaces can be arranged in a planar shape and used as a retroreflector. In this case, it is preferable that the center axis of the corner cube is arranged vertically or inclined to the half mirror 12 side.

The infrared irradiator 16 provided on the other side of the half mirror 12 will be described. The infrared irradiator 16 is arranged so as to irradiate the entire display 14 and the symmetric area 35 with infrared rays with the half mirror 12 at the center. Infrared light to be irradiated is modulated by high frequency or digital, and the infrared light sensor 15 detects only predetermined infrared light.

Next, a non-contact input method using the non-contact input device 10 and its operation will be described. In FIG. 1, on the display surface 13 of the display 14, a sheet-like infrared light sensor 15 is disposed in a sticking state, and its output is output to a control device (including a computer) 37, which infrared light It is detected whether the sensor cell 17 has detected a predetermined infrared ray.

When the light beam L from the first image displayed on the display 14 hits the half mirror 12, a part of the light beam L3 passes through the half mirror 12, and the other part of the light beam L1 is reflected by the half mirror 12. . The light beam L3 that has passed through the half mirror 12 is retroreflected by the retroreflector 11, the reflected light L3a is reflected by the half mirror 12, and the reflected light L4 contributes to image formation. Further, the light beam L1 directed toward the retroreflector 11a is also retroreflected by the retroreflector 11a and passes through the half mirror 12 to contribute to the image formation. Accordingly, the first image displayed on the display 14 forms an image as the second image at the symmetrical position (the other side of the half mirror 12) with the half mirror 12 as the center. In this embodiment, since the vertical

light reflecting surfaces

33 and 33a of the left and

right retroreflectors

11 and 11a face the half mirror 12, the utilization factor of the retroreflector is improved, and the half mirror 12 is also Since it has a film shape, the second image becomes clearer.

Here, when the second image is touched by the pointing means 38 such as a finger from the outside (the side opposite to the side where the half mirror 12 is present), infrared rays are emitted from the infrared irradiator 16 toward the pointing means 38 (second image). Since it is irradiated, the reflected infrared rays from the instruction means 38 are imaged on the display 14 via the half mirror 12 and the

retroreflectors

11 and 11a, and the image 38a of the instruction means 38 is displayed. Since the display 14 is provided with the sheet-like infrared light sensor 15, the imaging position is detected from the image 38a of the pointing means 38 such as a finger. The position of the image 38a of the instruction means 38 is performed by calculating the centroid (same as the center of gravity) position of the image. In this case, if the instruction unit 38 such as a finger is inserted to the back of the second image, the accurate position data of the image 38a of the instruction unit 38 may not be obtained. The position of the means 38 is preferably measured when the position is within a proper area (for example, 0.6 to 2 cm ² ).

By using the non-contact input device 10 described above, the operation of a specific electric device can be performed hygienically only by touching the second image formed in the space. The first image displayed on the display 14 can be changed.
In this embodiment, the half mirrors 11 and 11a are provided on both sides of the half mirror 12, but the present invention is applicable to either one of them.

The non-contact input device and non-contact input method according to the present invention (device and method for detecting the indication position of a reproduced image in a non-contact manner), when used for an operation panel of various machines, have an operation panel (for example, a keyboard). , A touch panel) is displayed in space, and an operation signal button is pressed to obtain an input signal.
Therefore, the non-contact input device and the non-contact input method according to the present invention can be optimally used not only for an operation panel of a factory machine but also for a touch panel of a mobile phone, a personal computer, an automobile, a ship, and the like.

10:

Non-contact input device

11, 11a: Retroreflector, 12: Half mirror, 13: Display surface, 14: Display, 15: Infrared light sensor, 16: Infrared irradiator, 17: Infrared light sensor cell 19, 20: transparent conductor, 22, 23: protective sheet, 25: film, 26: half mirror layer, 27: frame, 27a: support bar, 27b: weight bar, 28, 28a: flat block, 29, 29a : Light reflection groove, 30, 30a: partition wall, 31, 31a: first light reflection surface, 32, 32a: second light reflection surface, 33, 33a: vertical light reflection surface, 35: symmetry region, 37: Control device, 38: instruction means, 38a: image of instruction means

Claims

A retroreflector, a half mirror erected on the functional side of the retroreflector, a distance from the half mirror on one side of the half mirror, and a display surface facing the half mirror A display that displays a preset first image, and the display is provided with an infrared light sensor that detects infrared light emitted toward the display,
The first image displayed on the display is formed as a second image on the other side of the half mirror via the half mirror and the retroreflector, and the half image is directed toward the second image. Infrared rays are irradiated from the mirror side by an infrared irradiator, and reflected infrared rays from the pointing means that has operated the second image are imaged on the display via the half mirror and the retroreflector, and the infrared rays A non-contact input device, wherein an image forming position of the indicating means is detected by an optical sensor.
2. The non-contact input device according to claim 1, wherein the infrared light sensor detects only the light-modulated infrared light.
3. The non-contact input device according to claim 1, wherein the half mirror has a thickness in a range of 10 to 500 μm.
The non-contact input device according to any one of claims 1 to 3, further comprising a support body that keeps the half mirror flat on and above or around the half mirror.
The non-contact input device according to any one of claims 1 to 4, wherein the retroreflector is horizontally arranged, and the retroreflector is divided into left and right with the half mirror as a center. Non-contact input device.
6. The non-contact input device according to claim 5, wherein each of the left and right retroreflectors includes first and second light reflecting surfaces orthogonal to each other, and vertical light reflection orthogonal to the first and second light reflecting surfaces. The micro retroreflective blocks of the retroreflector formed on the left and right sides of the half mirror have a plurality of micro retroreflective blocks having a surface, and the vertical light reflecting surfaces of the micro retroreflective blocks face the half mirror side. A non-contact input device.
6. The non-contact input device according to claim 1, wherein the retroreflector is formed by arranging a number of cubic corners having three orthogonal light reflecting surfaces arranged in a plane. Contact input device.
8. The non-contact input device according to claim 1, wherein the infrared light sensor is formed in a sheet shape and disposed in contact with a display surface of the display. apparatus.
A retroreflector, a half mirror erected on the functional side of the retroreflector, a distance from the half mirror on one side of the half mirror, and a display surface facing the half mirror Using a display that displays a preset first image, and providing the display with an infrared light sensor that detects infrared light emitted toward the display,
The first image displayed on the display is formed as a second image on the other side of the half mirror via the half mirror and the retroreflector, and the half image is directed toward the second image. Infrared light is irradiated from the mirror side, and the reflected infrared light from the instruction means that has operated the second image is imaged on the display via the half mirror and the retroreflector, and the infrared light sensor A non-contact input method characterized by detecting an imaging position of an instruction means.