JP2019074933A - Non-contact input device - Google Patents

Abstract

To enable sensing even if a sensor is placed at a location apart from an aerial image so as to enable the sensor to be held in a casing of a device, thereby achieving downsizing of the device.SOLUTION: A sensor 40 capable of detecting a specified position on an aerial image AM in a non-contact manner includes: a sensor main block that includes a plurality of light pulse emitters 41 which is oriented one-dimensionally, and which projects detection light L1 along a plane parallel to the aerial image AM so as to form a detection region DA, a plurality of detectors 42 which is oriented one-dimensionally, and which detects reflected light L2 of the detection light L1 by a reflection object in the detection region DA, and a one-dimentional lens 43 located at the aerial-image-AM side relative to the plurality of light pulse emitters 41 and the plurality of detectors 42; and an optical element 46 which is located between the sensor main block and the aerial image AM, and which collects the incident reflected light L2 to the plurality of detectors 42.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a non-contact input device that detects an indicated position of an aerial image in a non-contact manner.

In recent years, there has been proposed a technology capable of non-contacting pointing of an aerial image formed in the air using a special optical element. If the aerial image can be indicated in a non-contact manner, it can be input without touching the screen directly like a touch panel, so that information can be hygienically input at, for example, a food processing plant or a medical site.
In Patent Document 1, in order to input information on an aerial image, the aerial image is irradiated with infrared light in a curtain shape, and an apparatus that detects a position where a finger or a pen contacts the infrared curtain with an infrared camera. Is disclosed.
Further, Patent Document 2 discloses a technique of irradiating infrared light parallel to an aerial image, and detecting the reflected light of a finger, a pen or the like that intercepts the light by a sensor using a light detector (photodiode). There is.

International Publication No. 2014/196088 U.S. Patent Application Publication No. 2014/0364218

  However, among the aerial images formed in the air, in order to sense the position away from the sensor, it is necessary to arrange the sensor close to the aerial image, and it is difficult to put the sensor in the housing of the device There is a case.

  An object of the present invention is to perform sensing even when the sensor is disposed at a location away from the aerial image, thereby enabling the sensor to be housed in the housing of the device, thereby achieving downsizing of the device. .

In order to solve the above-mentioned subject, invention of Claim 1 is a non-contact input device,
It has a plurality of reflecting surfaces orthogonal to each other in a plan view, reflects light from an object by the plurality of reflecting surfaces, guides the light to the air on the opposite side to the incident side of the light, and transmits the light to the object An optical plate having a function of forming a corresponding aerial image in the air;
And a sensor capable of contactlessly detecting a designated position on the aerial image imaged in the air,
The sensor is
A plurality of light pulse emitters arranged in one dimension to form a detection area by projecting detection light along a plane parallel to the aerial image, and a reflection object in the detection area arranged in one dimension A plurality of detectors for detecting the reflected light of the detection light; and a plurality of light pulse emitters and a primary lens positioned on the aerial image side of the plurality of detectors, the plurality of light pulse emitters and the plurality of light pulse emitters A sensor body that synchronously operates a plurality of detectors and specifies a two-dimensional position of the reflective object in the detection area;
And an optical element located between the sensor main body and the aerial image for condensing the reflected light incident on the plurality of detectors.

  According to the present invention, sensing can be performed even when the sensor is disposed at a location away from the aerial image, whereby the sensor can be accommodated in the housing of the device, and the device can be miniaturized. .

(A) is a perspective view of a non-contact input device, (B) is a cross-sectional view for explaining the structure etc. of the non-contact input device. It is a conceptual diagram explaining an optical plate. (A) is a cross-sectional view along the detection area of the sensor, (B) is a cross-sectional view of the sensor. It is a conceptual diagram explaining the detection method of the pointing position by a pointing object. It is a conceptual diagram explaining the positional relationship of an aerial image and the range of the detection region by a sensor. It is a conceptual diagram explaining the method of covering the range which a detection light does not reach.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. However, although various limitations preferable for carrying out the present invention are given to the embodiments described below, the technical scope of the present invention is limited to the following embodiments and the illustrated example. Absent.

The non-contact input device 10 shown in FIGS. 1A and 1B includes a display panel 20 which is an object to be displayed and an optical plate 30 for forming an aerial image AM corresponding to the display panel 20 in the air. A sensing device 40 for detecting the position of a fingertip FG as a pointing object in the vicinity of the aerial image AM, a device main body 50 for supporting the optical plate 30 and storing the display panel 20, and the display panel 20. A display circuit 61, and a control unit 90 that comprehensively manages the operation states of the display panel 20 and the sensing device 40 are provided.
Here, the pointing object (that is, the reflecting object) blocks the detection light L1 such as a pen other than the user's finger FG, which is used to indicate the predetermined position of the aerial image AM as described above. I mean one.

The device body 50 is housed inside the housing 52, and is mounted with various devices such as the display panel 20, the optical plate 30, and the sensing device 40.
The housing 52 in which the apparatus main body 50 is housed has a front part 52a and a back part 52b which is integrated with the front part 52a. In the front portion 52a, a window having a shape corresponding to the optical plate 30 and the window 51 (described later) of the apparatus main body 50 is formed.

In the non-contact input device 10, the display panel 20 is a plate-like device, and is fixed to the device main body 50 in an inclined state. Specifically, the display panel 20 is fixed such that the display surface 21 is appropriately inclined by rotation around the axis α with respect to a reference plane parallel to the XY plane in which the optical plate 30 extends. .
Here, the axis α is parallel to the XY plane, and forms, for example, the same angle with the X axis and the Y axis.
The display panel 20 is an image display element capable of two-dimensional drawing, and includes a display unit such as an LCD and a light source unit for illuminating the display unit, although not shown.
The display panel 20 is not limited to a transmissive element, but may be a reflective element such as LCOS (Liquid Crystal On Silicon) or DMD (Digital Micromirror Device). For example, a keyboard is displayed on the display panel 20, but a display screen of a smartphone or a tablet terminal can also be displayed.

  The optical plate 30 is a rectangular plate-like device, and is fixed so as to cover the window 51 of the device main body 50. The optical plate 30 extends along a reference plane parallel to the XY plane.

FIG. 2 is an enlarged view for explaining the specific structure of the optical plate 30. As shown in FIG. The optical plate 30 uses, for example, the aerial image display device described in International Publication No. 2017/014221.
The optical plate 30 is configured by bonding two flat optical panels 31 and 32.
The optical panels 31 on one side (specifically, the lower side and the incident side) are mutually separated within a plane (XY plane in the illustrated example) perpendicular to the stacking direction of the optical panels 31 and 32 (Z direction in the illustrated example). A plurality of mirror elements 31a are formed side by side and adhered with an adhesive in one of two perpendicular directions (for example, the X direction).
The other (specifically, the upper side and the emission side) optical panel 32 is formed by arranging a plurality of mirror elements 32 a in the other direction (for example, the Y direction) of the above two directions and adhering them with an adhesive. There is.

The mirror element 31a of one optical panel 31 has a rectangular parallelepiped transparent substrate 81a. The transparent substrate 81a extends in the Y direction, and a reflective film 81b is formed by vapor deposition or the like on one or both of two opposing surfaces (for example, two surfaces along the YZ surface).
The mirror element 32a of the other optical panel 32 has a rectangular parallelepiped transparent substrate 82a. The transparent substrate 82a extends in the X direction, and a reflective film 82b is formed by vapor deposition or the like on one or both of two opposing surfaces (for example, two surfaces along the XZ surface).

By arranging the plurality of mirror elements 31a extending in the Y direction adjacent to each other in the X direction, the plurality of reflective films 81b are arranged in the X direction at intervals corresponding to the width of the mirror elements 31a in the X direction. Similarly, by arranging the plurality of mirror elements 32a extending in the X direction adjacent to the Y direction, the plurality of reflective films 82b are arranged in the Y direction at an interval corresponding to the width of the mirror element 32a in the Y direction. .
Due to the arrangement of the plurality of mirror elements 31a and 32a, the reflection film (reflection surface) 81b of each mirror element 31a and the reflection film (reflection surface) 82b of each mirror element 32a are viewed in plan (Z-axis direction As seen from the point of view), they are in a positional relationship orthogonal to each other, but in a state of being displaced in the Z-axis direction as in the relationship of twist.

The object OB (in the present embodiment, an image displayed on the display panel 20) located below the optical plate 30 by the optical plate 30 as shown in FIG. It can be projected as an aerial image AM. That is, the optical plate 30 reflects the light from the object OB by the reflection films (reflection surfaces) 81b and 82b of the plurality of mirror elements 31a and 32a, and guides the light to the air on the opposite side to the light incident side The aerial image AM of the object OB is imaged in the air.
Specifically, the plurality of light beams LB emitted from the point light source P on the object OB are reflected by the reflecting surfaces (reflecting films 81 b and 82 b) parallel to the Z axis, and the point light source with respect to the X axis The light is collected at a position P ′ (a position symmetrical to the point light source P and the X axis) opposite to P. At this time, similar reflections occur at a plurality of grid point-like locations where the plurality of reflective films 81 b and 82 b arranged periodically cross each other, and a real image of the point P is formed at the position P ′.
Here, the object OB of the point light source P is an image displayed on the display surface 21 of the display panel 20 in the case of the present embodiment. That is, the image displayed on the display surface 21 of the display panel 20 can be displayed as an aerial image AM inclined above the optical plate 30.

Referring back to FIG. 1, the sensing device 40 is an application of the optical proximity sensor described in, for example, US Patent Application Publication No. 2014/0364218, and is fixed to the outside of the window 51 of the device body 50 to be optical The approach operation of the pointing object, that is, the fingertip FG to the detection area DA adjacent to the aerial image AM formed by the plate 30 is detected.
The sensing device 40 is a rod-like device and extends along an axis α parallel to one side of the window 51 of the device body 50.

  Here, the aerial image AM is formed in mirror symmetry on the opposite side of the display panel 20 across the optical plate 30. That is, the aerial images AM are arranged in a line-symmetrical relationship in which the display panel 20 is rotated by 180 ° around an axis of symmetry parallel to the axis β extending along the optical plate 30.

The sensing device 40 has a sensor body and an optical element 46 provided on the front side of the sensor body.
As shown in FIGS. 3A and 3B, the sensor main body in the sensing device 40 includes a plurality of laser diodes (LDs) 41 as a plurality of light pulse emitters and a plurality of detectors in a housing 40a. A plurality of photodiodes 42 (photo detectors) are alternately arranged in the direction of the axis α, and a collimator lens 43 as a primary lens is provided in front of each laser diode 41 and each photodiode 42. Prepare.
The laser diode 41 and the collimator lens 43 function as a detection light emitting unit that emits the detection light L1 for detecting the position of the fingertip FG which is the pointing object.
The photodiode 42 and the collimator lens 43 function as an indication position detection unit that detects the position indicated by the fingertip FG in a non-contacting manner by detecting the reflected light L2 of the detection light L1 on the surface of the fingertip FG which is an indication object. Do.
That is, in the sensing device 40 of the present embodiment, the detection light emitting unit and the pointing position detection unit are arranged in the same housing 40 a of the sensing device 40. Thereby, the apparatus can be miniaturized as compared with the case where the detection light emitting unit and the pointing position detecting unit are separately disposed.
The laser diode 41 emits infrared light which is invisible light, and the photodiode 42 detects infrared light which is invisible light. Since the detection light L1 is invisible light, the position of the pointing object can be detected with a good S / N ratio even in an environment where a large amount of ambient light such as general illumination or outdoor light is present. Specifically, by detecting only invisible light in the pointing position detection unit, it is possible to detect the reflected light L2 on the pointing object while minimizing the influence of disturbance light.

The optical element 46 is provided on the front side of the sensor body (the side on which the aerial image AM is projected), and is located between the sensor body and the aerial image.
Such an optical element 46 is a lens that condenses the reflected light incident on the plurality of photodiodes 42, can reduce the apparent object distance, and has a function of adjusting the sensing range.
More specifically, the optical element 46 is a condenser lens having a positive power, and a cylindrical and aspheric positive Fresnel lens or a cylindrical and aspheric positive fθ lens is preferably employed.

  For example, if the sensing range is expanded by increasing the length of the sensing device 40, sensing can be performed even if the sensing device 40 is disposed at a location away from the aerial image AM, but in this case, the device body The size of the housing 50 and the housing 52 can not be avoided. Therefore, the length of the sensor main body is set as short as possible, and the optical element 46 is also set as short as possible. In the present embodiment, it is assumed that the miniaturization of the device is also achieved by thus shortening the length of the sensing device 40.

To briefly explain an example of the operation of the sensing device 40, the detection light L1 from the laser diode 41 is collimated by the collimator lens 43 and emitted in the front direction, and the planar detection area DA shown in FIG. Illuminate from the side.
Here, the detection area DA is a curtain-shaped irradiation area, and extends in parallel to and adjacent to the aerial image AM. The detection area DA is used to indicate the aerial image AM with a fingertip FG or extract an action of moving the fingertip FG along the aerial image AM.
The collimator lens 43 prevents the detection light L1 from the laser diode 41 from spreading in a direction parallel to the plane of the aerial image AM, but hardly to spread in a direction perpendicular to the plane of the aerial image AM.
By limiting the range of the irradiation area or detection area DA of the detection light L1, the detection light L1 can be always irradiated near the aerial image AM in a thin curtain shape along the plane of the aerial image AM. An approach can be detected accurately.
The detection light emitting unit including the laser diode 41 and the collimator lens 43 is disposed on an extension of a plane parallel to the aerial image AM (the detection area DA in which the detection light L1 is distributed). As described above, in the present embodiment, the arrangement of the detection light emitting unit is simplified.

As shown in FIG. 4A, when the fingertip FG which is the pointing object enters the detection area DA, the pointing position detection unit (that is, the photodiode 42 and the collimator lens 43) of the sensing device 40 is the pointing object. When the reflected light L2 which is the return light from a certain finger tip FG is detected and the finger tip FG which is a pointing object recedes from the detection area DA as shown in FIG. 4B, the pointing position detection unit of the sensing device 40 , The reflected light L2 is not detected.
When the optical element 46 is not used, the laser diode 41 is sequentially turned on temporally to emit the detection light L1 in the front direction, and the photodiode 42 selects the reflected light L2 from the oblique direction by the collimator lens 43. Detect. More specifically, a diagonal grid or mesh shape is formed on the detection area DA by a large number of photodiodes 42 arranged at equal intervals and a collimator lens 43 disposed so as to straddle the pair of photodiodes 42. Since the detection point is formed, a position on the two-dimensional detection area DA or on the aerial image AM from which the fingertip FG which is the pointing object has entered and moved from the combination of the photodiodes 42 simultaneously detecting the reflected light L2 Can be identified. Thus, when the optical element 46 is not used, for example, the reflected light L2 when the pointing object is at the point S1 shown in FIG. 3A is the detector 42 at the "I" position and the detection of the "VI" position The device 42 detects the largest number, and can determine the position of the pointing object.
On the other hand, in the case of using the optical element 46 as in the present embodiment, since the apparent object distance can be reduced as described above, as shown in FIG. 3A, the position of the actual pointing object is Even at the point S1, it can be detected as if the pointing object is located at the point S2. More specifically, by using the optical element 46, the detector 42 that detects the most reflected light of the pointing object becomes the detector 42 at the "II" position and the detector 42 at the "IV" position. The pointing object can be recognized nearby. In other words, compared to the case where the optical element 46 is not used, detection of the pointing object is possible to a far position.

In addition, as a sensing method by the sensing device 40, a so-called "principle of triangular ranging" in which a distance is measured by the principle of triangulation based on reflected light is used.
Further, the specification of the position of the pointing object (reflecting object) can be determined depending on which of the plurality of detectors 42 detects the most reflected light L2.

FIG. 5A is an example in the case where the optical element 46 is not used, and the sensing possible area (the detection area DA) by the sensing device 40 does not overlap the area where the aerial image AM is displayed. The sensing impossible area A1 is generated at a position far from the device 40.
On the other hand, FIG. 5 (B) is an example in the case of using the optical element 46, and the sensing possible area (detection area DA) by the sensing device 40 overlaps the area where the aerial image AM is displayed. The entire area of the aerial image AM can be sensed.

Further, by configuring at least the optical element 46 of the sensor main body and the optical element 46 to be position adjustable, the range of the detection area DA can be adjusted.
More specifically, the optical element 46 can be positionally adjusted in the direction of the arrow Y1 shown in FIG. 5B by, for example, providing an extendable arm between the sensor body and the housing 40a. There is.
In addition to making the optical element 46 movable as described above, the sensor main body may be configured to be position adjustable. In that case, the movable rail is provided between the sensor main body and the apparatus main body 50 to which the sensor main body is attached, and the position can be adjusted in the direction of the arrow Y1 shown in FIG. 5 (B).
In addition, although the telescopic arm was mentioned as a mechanism for making the optical element 46 movable, and the rail for movement was mentioned as a mechanism for making a sensor main body movable, These movable mechanisms are not specifically limited, The telescopic arm and the moving rail may be used in combination, or another movable mechanism may be adopted.

  Although not shown, the sensing device 40 incorporates a drive circuit for operating the laser diode 41 and the photodiode 42. All or part of such a drive circuit can also be incorporated into the device body 50.

  Returning to FIG. 1, the display circuit 61 housed together with the display panel 20 in the device main body 50 causes the display panel 20 to perform a display operation, and causes the display surface 21 to perform two-dimensional display. , And forms an image corresponding to the aerial image AM on the display surface 21.

The control unit 90 causes the display panel 20 to perform the display operation via the display circuit 61, and operates the sensing device 40 as appropriate to set the finger tip FG as the pointing object at any position on the detection area DA or on the aerial image AM. It is monitoring whether it has entered. Thereby, when the aerial image AM is, for example, a keyboard, it can be determined which key constituting this virtual keyboard has been pressed, and the instruction content of the user operating the non-contact input device 10 is received. Can.
The control unit 90 is also communicable with a computer or other external device 100 connected to the non-contact input device 10, and outputs the instruction content from the user acquired by the non-contact input device 10 to the external device 100. .

  Although the non-contact input device 10 in this embodiment is used so that the Z direction is the vertical direction, it may be used such that the Z direction is the horizontal direction, or an aerial image may be used. The plane parallel to the AM may be used as the horizontal plane. That is, it is assumed that it is used in an orientation that is easy for the user to operate, or an orientation that is appropriate for the device etc. on which the non-contact input device 10 is mounted.

  As described above, according to the present embodiment, the sensing device 40 detects the designated position on the aerial image AM imaged in the air without contact, and the sensor body and the aerial. Since the optical element 46 located between the image AM and the reflected light L2 incident on the plurality of detectors 42 is included, the pointing object in the detection area DA can be recognized near. As a result, the sensing device 40 can be disposed at a position distant from the aerial image AM, and even if the sensing device 40 is disposed at a position distant from the aerial image AM, sensing can be performed. As a result, the sensing device 40 can be housed in the housing 52 of the non-contact input device 10, and the non-contact input device 10 can be miniaturized.

  Further, of the sensor main body and the optical element 46, at least the optical element 46 is configured to be position adjustable, so that the range of the detection area DA can be adjusted, so that the range of sensing is the area of the aerial image AM. The position can be adjusted in a corresponding manner. This makes it possible to sense the entire area of the aerial image AM.

  Further, since the optical element 46 is a cylindrical and aspheric positive Fresnel lens or a cylindrical and aspheric positive fθ lens, the pointing object separated from the sensing device 40 can be recognized near. Thereby, the sensing device 40 can be disposed at a distance from the aerial image AM.

[Modification]
The embodiment to which the present invention can be applied is not limited to the above-described embodiment, and can be appropriately changed without departing from the spirit of the present invention. Hereinafter, modified examples will be described. The following modifications may be combined as much as possible.

When the optical element 46 is used, as shown in FIG. 6A, the detection light L1 projected from the plurality of laser diodes 41 may be trapezoidal (in a depressed state). That is, as the detection light L1 travels farther, the range of the detection area DA narrows, and a sensing impossible area A2 in which the detection light L1 does not reach is formed on the side of the detection area DA.
Therefore, in the present modification, another light source (another sensing device 140, another light source 60) for causing the detection light L1 to reach the non-sensing area A2 is used in combination with the sensing device 40.

In the example shown in FIG. 6B, the sensing device 40 and another sensing device 140 configured similarly to the sensing device 40 are arranged in two stages. In the present modification, the other sensing device 140 is disposed in the upper stage, but may be disposed in the lower stage, and is not particularly limited.
The other sensing device 140 disposed in the upper stage is configured in the same manner as the sensing device 40, and thus includes an optical element 46. Then, the other sensing device 140 is disposed to be inclined with respect to the lower sensing device 40.
In addition, the sensing devices 40 and 140 arranged in a two-tiered manner are fixed at appropriate positions on the front side of the device main body 50. The sensing devices 40 and 140 have different sharing positions in the common detection area DA due to a slight difference in position and arrangement angle.
With such a configuration, the detection light L1 can be made to reach the undetectable area A2 to which the detection light L1 does not reach with the light source of the other sensing device 140 in the upper stage and the sensing device 40 in the lower side. It can sense without lowering it. In particular, it is preferable that the upper other sensing device 140 be disposed in an inclined manner, because an error in detection of the pointing position by the pointing object can be minimized.

In the example shown in FIG. 6C, another light source 60 is disposed on the sensing device 40 in a superimposed manner.
The other light source 60 disposed in the upper stage is a light source that can emit the detection light L1 although the optical element 46 is not provided. Then, the other light source 60 is disposed to be inclined with respect to the lower side sensing device 40. Further, the detection light L1 emitted from the other light source 60 is emitted so as to spread as it is separated from the light source.
Furthermore, the sensing device 40 and the other light sources 60 arranged in a two-tiered manner are fixed in place on the front side of the device body 50. The sensing device 40 and the other light sources 60 have different sharing positions in the common detection area DA due to slight differences in positions and arrangement angles.
With such a configuration, the detection light L1 can be made to reach the sensing impossible area A2 to which the detection light L1 does not reach with the sensing device 40 in the lower stage by the other light source 60 in the upper stage, so that the accuracy is lowered. Can be sensed without In particular, it is preferable that the upper other sensing device 140 be disposed in an inclined manner, because an error in detection of the pointing position by the pointing object can be minimized.

10 Non-Contact Input Device 20 Display Panel 30 Optical Plate 31 Optical Panel 31a Mirror Element 32 Optical Panel 32a Mirror Element 40 Sensing Device 40a Case 41 Laser Diode (Light Pulse Emitter)
42 Photodiode (Detector)
43 Collimator lens (primary lens)
46 optical element 50 apparatus main body 51 window 52 housing 52a front part 52b back part 90 control part 100 external device AM aerial image OB object DA detection area FG fingertip (pointing object)
L1 Detection light L2 Reflected light

Claims (5)

It has a plurality of reflecting surfaces orthogonal to each other in a plan view, reflects light from an object by the plurality of reflecting surfaces, guides the light to the air on the opposite side to the incident side of the light, and transmits the light to the object An optical plate having a function of forming a corresponding aerial image in the air;
And a sensor capable of contactlessly detecting a designated position on the aerial image imaged in the air,
The sensor is
A plurality of light pulse emitters arranged in one dimension to form a detection area by projecting detection light along a plane parallel to the aerial image, and a reflection object in the detection area arranged in one dimension A plurality of detectors for detecting the reflected light of the detection light; and a plurality of light pulse emitters and a primary lens positioned on the aerial image side of the plurality of detectors, the plurality of light pulse emitters and the plurality of light pulse emitters A sensor body that synchronously operates a plurality of detectors and specifies a two-dimensional position of the reflective object in the detection area;
A non-contact input device, comprising: an optical element located between the sensor body and the aerial image, for condensing the reflected light incident on the plurality of detectors.   The range of the detection area can be adjusted by at least the optical element of the sensor body and the optical element being adjustable. Input device.   The non-contact input device according to claim 1 or 2, wherein the optical element is a cylindrical and aspherical positive Fresnel lens or a cylindrical and aspherical positive fθ lens. There are a plurality of the sensors, and the plurality of sensors are arranged in two stages,
The non-contact input device according to any one of claims 1 to 3, wherein the sensor in the upper stage is disposed to be inclined with respect to the sensor in the lower stage. Another light source is placed over the sensor,
The non-contact input device according to any one of claims 1 to 3, wherein the other light source is arranged to be inclined with respect to the sensor.

Images