JP2021022065A - Detection system and detection method - Google Patents

Abstract

To reduce the influence of irradiation characteristics of a projector, in a detection system which detects operation on a display device.SOLUTION: A detection system comprises a plurality of projectors for projecting light to an operation area of a display device, and a light receiver for receiving reflected light from the operation area. The detection system includes: an acquisition unit which acquires first light receiving signals by adjacent first and second projectors of the above projectors projecting light with different projection timings; a generation unit which generates second light receiving signals on the basis of light receiving signals acquired when the adjacent first and second projectors of the above projectors project light; and a determination unit which determines whether the operation area has been operated or not, on the basis of each of the first receiving signals and the second receiving signals.SELECTED DRAWING: Figure 6

Description

The present invention relates to a detection system and a detection method.

Conventionally, a detection system that detects an operation on a display device by incorporating a proximity detection device (for example, an infrared LED (Light Emitting Diode) and an infrared PD (Photo Detector)) in the display device and controlling the light emission and reception of infrared rays. It has been known. In the detection system, infrared rays are projected onto the operation area of the display device, and a light receiving signal generated by receiving the reflected light from the operation area is used to determine whether or not the display device is operated.

JP-A-2009-216888 Japanese Unexamined Patent Publication No. 2013-218549

On the other hand, a floodlight such as an infrared LED has an irradiation characteristic that the irradiation light intensity in the center direction of the optical axis is high. Therefore, when a plurality of infrared LEDs are arranged, the irradiation light intensity at each irradiation position in the arrangement direction is not uniform, and for example, when a swipe operation or the like is performed on the display device, the irradiation light intensity becomes high. There is a problem that the operation at a low irradiation position cannot be detected stably.

The present invention has been made in view of the above problems, and an object of the present invention is to reduce the influence of the irradiation characteristics of a floodlight in a detection system that detects an operation on a display device.

According to one aspect, the detection system has the following configuration. That is,
A detection system having a plurality of floodlights that project light onto an operation area of a display device and a receiver that receives reflected light from the operation area.
Among the plurality of floodlights, an acquisition unit that acquires a first light receiving signal by projecting light at different projection timings between the adjacent first floodlight and the second floodlight.
A generator that generates a second light receiving signal based on a light receiving signal acquired when the adjacent first light flooding device and the second floodlight project light among the plurality of floodlights.
It has a determination unit for determining the presence or absence of an operation on the operation region based on each of the first light receiving signal and the second light receiving signal.

In the detection system that detects the operation of the display device, the influence of the irradiation characteristics of the floodlight can be reduced.

It is a figure which shows the arrangement example of the proximity detection device in the display device, and the example of the projection of infrared rays. FIG. 1 is a first diagram showing an example of a system configuration of a detection system and a functional configuration of a control device. It is a figure which shows an example of the hardware composition of a control device. It is a figure which shows an example of the 1st light projection timing and the 1st light receiving signal. It is a figure which shows an example of the 2nd light projection timing and the 2nd light receiving signal. It is a figure for demonstrating the outline of the detection process by a detection system. It is a 1st flowchart which shows the flow of the detection process by a detection system. It is a figure which shows an example of the effect of the detection processing by a detection system. FIG. 2 is a second diagram showing an example of a system configuration of a detection system and a functional configuration of a control device. It is a 2nd flowchart which shows the flow of the detection process by a detection system.

In each of the following embodiments, in a detection system in which a plurality of floodlights having irradiation characteristics having high irradiation light intensity in the center direction of the optical axis are arranged, two types of light receiving signals are used to determine whether or not there is an operation on the display device. .. As a result, even an operation at an irradiation position where the irradiation light intensity is low can be stably detected, and the influence of the irradiation characteristics of the floodlight can be reduced.

Of these, in the first embodiment,
-An adjacent floodlight projects light at the first light projection timing (light projection in which the irradiation light intensity is not uniform), and the presence or absence of operation is determined using the first light receiving signal acquired by the light projection. And at the same time
-Adjacent floodlights project light at the second projection timing (projection with increased irradiation light intensity at the irradiation position where the irradiation light intensity decreases), and based on the received light signal acquired by the projection. The presence or absence of operation is determined using the generated second received signal.

Further, in the second embodiment,
-An adjacent floodlight projects light at the first light projection timing (light projection in which the irradiation light intensity is not uniform), and the presence or absence of operation is determined using the first light receiving signal acquired by the light projection. And at the same time
-A second light receiving signal is generated by performing an operation on the first light receiving signal to increase the intensity of the reflected light from the irradiation position where the irradiation light intensity decreases, and the generated second light receiving signal is used. , Judge the presence or absence of operation.

In this way, by determining the presence or absence of operation using two types of light receiving signals that complement each other, according to the first and second embodiments, the operation at the irradiation position where the irradiation light intensity is low is stable. Can be detected. As a result, the influence of the irradiation characteristics of the floodlight can be reduced.

Hereinafter, details of each embodiment will be described with reference to the accompanying drawings. In the present specification and the drawings, components having substantially the same functional configuration are designated by the same reference numerals to omit duplicate explanations.

[First Embodiment]
<Example of arrangement of proximity detection device in display device and example of infrared projection>
First, an example of arrangement of the proximity detection device and an example of projection of irradiation light (infrared rays) in the display device to which the detection system according to the first embodiment is applied will be described. FIG. 1 is a diagram showing an example of arrangement of a proximity detection device in a display device and an example of infrared projection.

As shown in FIG. 1A, the display device 100 has an operating area 110 and a non-operating area 120. Of these, the operation area 110 is an area in which an image is displayed and an operation is performed by the operator. On the other hand, the non-operation area 120 is located in the outer peripheral area of the operation area 110, and is an area in which the proximity detection device 130 is arranged.

As shown in FIG. 1A, the proximity detection device 130 has a first infrared LED (Light Emitting Diode) 131 to a fourth infrared LED 134, which is an example of a floodlight. Further, the proximity detection device 130 has a PD (Photo Detector) 140, which is an example of a light receiver. In the following, the first infrared LED to the fourth infrared LED will be simply abbreviated as the first LED to the fourth LED.

The first LEDs 131 to the fourth LEDs 134 emit infrared rays to the operation area 110 for detecting an operation on the display device 100. The first LEDs 131 to the fourth LEDs 134 are arranged at substantially equal intervals in the width direction of the display device 100.

In the example of FIG. 1A, the case where four LEDs (first LED 131 to fourth LED 134) are arranged in the width direction of the display device 100 is shown, but the number of LEDs arranged in the display device 100 is Not limited to four.

The PD 140 receives the reflected light from the operation area 110 when infrared rays are projected onto the operation area 110. Specifically, when the operator performs an operation on the operation area 110 and a part of the infrared rays projected on the operation area 110 is reflected by the operator's hand, the PD140 performs the operation. Receives the reflected light reflected by the person's hand. Further, the PD 140 outputs a light receiving signal generated by receiving the reflected light.

In the example of FIG. 1A, the case where one PD 140 is arranged is shown, but the number of PDs arranged in the display device 100 is not limited to one. Further, in the example of FIG. 1A, the case where the PD 140 is arranged at the center position in the width direction of the display device 100 is shown, but the position where the PD 140 is arranged is limited to the center position in the width direction of the display device 100. Not done.

FIG. 1B shows an example of the irradiation range in the operation region 110 in which each of the first LED 131 to the fourth LED 134 is irradiated by emitting infrared rays (see the broken line). As shown in FIG. 1B, each of the first LED 131 to the fourth LED 134 can cover almost the entire range in the operation area 110 as a detection range by projecting infrared rays into the irradiation range indicated by the broken line.

However, all of the first LEDs 131 to the fourth LEDs 134 have an irradiation characteristic that the irradiation light intensity in the center direction of the optical axis is high. Therefore, the infrared irradiation light intensity becomes non-uniform at each irradiation position in the width direction of the operation region 110 (for example, each irradiation position on the broken line 150). For example, among the infrared irradiation positions (see arrow 160) projected from the first LED 131, the infrared irradiation light intensity is high near the center of the arrow, and the infrared irradiation light intensity is low near the end of the arrow. Become.

<System configuration of detection system and functional configuration of control device>
Next, the system configuration of the detection system including the proximity detection device 130 and the functional configuration of the control device included in the detection system will be described. FIG. 2 is a first diagram showing an example of a system configuration of a detection system and a functional configuration of a control device. As shown in FIG. 2, the detection system 200 is configured as a part of the display device 100, and has a proximity detection device 130 and a control device 210.

Further, the control device 210 has a light projection control unit 220 and a detection unit 230. The light projection control unit 220 further includes a first control unit 221 and a second control unit 222, and outputs a control signal for controlling infrared light projection by the first LEDs 131 to the fourth LED 134. Of these, the first control unit 221 outputs a control signal so that the first LEDs 131 to the fourth LEDs 134 emit infrared rays at different light projection timings (first light projection timings). Specifically, the first control unit 221
・ First LED131,
・ Second LED 132,
・ Third LED 133,
・ Fourth LED 134,
It is controlled to emit infrared rays in the order of.

On the other hand, the second control unit 222 outputs a control signal so that two adjacent LEDs emit infrared rays at the same projection timing (second projection timing). Specifically, the second control unit 222
・ 1st LED131 + 2nd LED132,
・ 2nd LED132 + 3rd LED133,
・ Third LED 133 + 4th LED 134,
It is controlled to emit infrared rays in the order of.

The detection unit 230 further includes a first acquisition unit 231 and a second acquisition unit 232 and a determination unit 233. Of these, the first acquisition unit 231 acquires the first light receiving signal generated by the PD140 receiving the reflected light when the first LEDs 131 to the fourth LEDs 134 project infrared rays at the first light projection timing. To do. Further, the second acquisition unit 232 acquires a light receiving signal generated by the PD140 receiving the reflected light when infrared rays are projected at the second light projection timing, and generates a second light receiving signal.

The determination unit 233 determines whether or not there is an operation on the operation area 110 by using the first light receiving signal and the second light receiving signal.

<Hardware configuration of control device>
Next, the hardware configuration of the control device 210 will be described. FIG. 3 is a diagram showing an example of the hardware configuration of the control device. As shown in FIG. 3, the control device 210 includes an arithmetic unit 301, a storage device 302, an output device 303, and an input device 304. The hardware constituting the control device 210 is connected to each other via the bus 305.

The arithmetic unit 301 is an integrated circuit that functions as a floodlight control unit 220 and a detection unit 230. The storage device 302 is used for determining information processed when the arithmetic unit 301 functions as the light projection control unit 220 and the detection unit 230 (for example, a first light receiving signal, a second light receiving signal, and presence / absence of operation). It is a memory that stores threshold values, etc.).

The output device 303 is an output device that outputs a control signal from the arithmetic unit 301 to the first LEDs 131 to the fourth LEDs 134. The input device 304 is an input device that receives the light receiving signal output from the PD 140 and inputs it to the arithmetic unit 301.

<Explanation of the first light projection timing and the first light receiving signal>
Next, a control signal output by the first control unit 221 of the light projection control unit 220 when the first LEDs 131 to the fourth LEDs 134 project infrared rays at the first light projection timing will be described. Further, a first light receiving signal acquired by the first acquisition unit 231 of the detection unit 230 when the PD 140 receives the reflected light when infrared rays are projected at the first light projection timing will be described.

FIG. 4 is a diagram showing an example of the first light projection timing and the first light receiving signal. Of these, FIG. 4A shows the output timing of the control signal output by the first control unit 221 of the light projection control unit 220 to the first LEDs 131 to the fourth LED 134. Note that FIG. 4A also shows the acquisition timing of the light receiving signal acquired by the first acquisition unit 231 of the detection unit 230 when the PD 140 receives the reflected light.

In FIG. 4A, the horizontal axis represents time, and the vertical axis represents ON / OFF of the output of the control signal (or ON / OFF of acquisition of the received light signal). As shown in FIG. 4A, the first control unit 221 of the light projection control unit 220 with respect to the first LED 131 to the fourth LED 134 so that the first LEDs 131 to the fourth LED 134 emit infrared rays at different timings. Output control signals at different timings. The cycle in which the first control unit 221 of the light projection control unit 220 outputs the control signal to the first LEDs 131 to the fourth LEDs 134 is measured, for example, at a frequency sufficient for determining the presence or absence of operation (100 times per second). The time to do this is 10 [msec].

Further, as shown in FIG. 4A, the timing at which the first acquisition unit 231 of the detection unit 230 acquires the received light signal is synchronized with the timing at which the first LEDs 131 to the fourth LEDs 134 emit infrared rays.

On the other hand, FIG. 4B shows each of the cases where the first LED 131 to the fourth LED 134 project infrared rays at the first projection timing when there is a reflecting object at each irradiation position in the width direction of the operation region 110. It shows the intensity of the reflected light from the reflected object at the irradiation position. That is, in FIG. 4B, the horizontal axis represents the irradiation position in the width direction of the operation region 110, and the vertical axis represents the intensity of the reflected light. In the following,
A signal indicating the intensity of the reflected light from the reflecting object at each irradiation position when the first LED 131 emits infrared rays is the first light receiving signal A1.
A signal indicating the intensity of the reflected light from the reflecting object at each irradiation position when the second LED 132 emits infrared rays is the first light receiving signal A2.
A signal indicating the intensity of the reflected light from the reflecting object at each irradiation position when the third LED 133 emits infrared rays is the first light receiving signal A3.
A signal indicating the intensity of the reflected light from the reflecting object at each irradiation position when the fourth LED 134 emits infrared rays is the first light receiving signal A4.
Called.

As shown in FIG. 4B, the first light receiving signal A1 appears at a position corresponding to each irradiation position (see arrow 160) in the width direction of the operation region 110 where the first LED 131 emits infrared rays. However, since the intensity of the irradiation light is not uniform, the intensity of the reflected light is not constant, and the intensity is highest near the center of each irradiation position (see arrow 160) and low near the end.

Similarly, the first light receiving signal A2 appears at a position corresponding to each irradiation position in the width direction of the operation region 110 where the second LED 132 emits infrared rays. However, since the irradiation light intensity is not uniform, the intensity of the reflected light is not constant, and the intensity is highest near the center of each irradiation position and low near the edges.

Hereinafter, similarly, the first light receiving signals A3 to A4 also appear at positions corresponding to the respective irradiation positions in the width direction of the operation region 110 in which the third LEDs 133 to the fourth LEDs 134 emit infrared rays, respectively. The intensity of each reflected light is highest near the center of each irradiation position and low near the edges.

FIG. 4C is a diagram generated by superimposing the first light receiving signals A1 to A4. FIG. 4C shows the intensity of the reflected light in the entire width direction of the operation region 110 when infrared rays are reflected by the reflecting object at each irradiation position in the width direction of the operation region 110. It is a thing. In FIG. 4C, the dotted line 400 represents a threshold value used for determining the presence or absence of a reflecting object.

In the case of FIG. 4C, the reflected light at the irradiation position indicated by reference numeral 401 is reflected light regardless of whether the first LED 131 emits infrared rays or the second LED 132 emits infrared rays. The strength of the light is low and does not exceed the dotted line 400.

Similarly, with respect to the reflecting object at the irradiation position indicated by reference numeral 402, the intensity of the reflected light is low regardless of whether the second LED 132 emits infrared rays or the third LED 133 emits infrared rays. Does not exceed the dotted line 400.

Similarly, with respect to the reflecting object at the irradiation position indicated by reference numeral 403, the intensity of the reflected light is low regardless of whether the third LED 133 emits infrared rays or the fourth LED 134 emits infrared rays, and the dotted line Does not exceed 400.

As described above, in the case of the first light receiving signals A1 to A4, the position where the intensity of the reflected light from the reflecting object does not exceed the threshold value (that is, the reflecting object is detected) in each irradiation position in the width direction of the operation region 110. Positions that cannot be done) are included.

Therefore, in the first embodiment, light projection (projection in which the irradiation light intensity is increased at the irradiation position where the irradiation light intensity is reduced) is performed at the second light projection timing to generate a second light receiving signal. Then, the first light receiving signals A1 to A4 detect the reflecting object at the irradiation position that cannot be detected. Hereinafter, the second light receiving signal generated by performing the light projection at the second light projection timing will be described.

<Explanation of the second light projection timing and the second light receiving signal>
First, a control signal output by the second control unit 222 of the light projection control unit 220 will be described when the first LEDs 131 to the fourth LEDs 134 project infrared rays at the second light projection timing. Further, a second light receiving signal generated by the second acquisition unit 232 of the detection unit 230 when the PD 140 receives the reflected light when infrared rays are projected at the second light projection timing will be described.

FIG. 5 is a diagram showing an example of the second light projection timing and the second light receiving signal. Of these, FIG. 5A shows the output timing of the control signal output by the second control unit 222 of the light projection control unit 220 to the first LED 131 to the fourth LED 134. Note that FIG. 5A also shows the acquisition timing of the light receiving signal acquired by the second acquisition unit 232 of the detection unit 230 when the PD 140 receives the reflected light.

In FIG. 5A, the horizontal axis represents time, and the vertical axis represents ON / OFF of the output of the control signal (or ON / OFF of acquisition of the received light signal). As shown in FIG. 5A, the second control unit 222 of the light projection control unit 220 refers to the first LED 131 and the second LED 132 so that the adjacent first LED 131 and the second LED 132 emit infrared rays at the same timing. , Outputs the control signal at the same timing.

Subsequently, the second control unit 222 of the light projection control unit 220 sends a control signal to the second LED 132 and the third LED 133 at the same timing so that the adjacent second LED 132 and the third LED 133 emit infrared rays at the same timing. Output.

Subsequently, the second control unit 222 of the light projection control unit 220 sends a control signal to the third LED 133 and the fourth LED 134 at the same timing so that the adjacent third LED 133 and the fourth LED 134 emit infrared rays at the same timing. Output.

The cycle in which the second control unit 222 of the light projection control unit 220 repeatedly outputs these control signals is, for example, 10 [msec].

Further, as shown in FIG. 5A, the timing at which the second acquisition unit 232 of the detection unit 230 acquires the received light signal is synchronized with the timing at which the two adjacent LEDs emit infrared rays.

On the other hand, FIG. 5B shows the intensity of the reflected light received from the reflector at each irradiation position by projecting infrared rays at the second projection timing of the first LEDs 131 to 4th LEDs 134. That is, in FIG. 5B, the horizontal axis represents the irradiation position in the width direction of the operation region 110, and the vertical axis represents the intensity of the reflected light. In the following,
A signal indicating the intensity of the reflected light from the reflector at each irradiation position when the first LED 131 and the second LED 132 emit infrared rays is the second light receiving signal B1.
A signal indicating the intensity of the reflected light from the reflector at each irradiation position when the second LED 132 and the third LED 133 emit infrared rays is the second light receiving signal B2,
A signal indicating the intensity of the reflected light from the reflector at each irradiation position when the third LED 133 and the fourth LED 134 emit infrared rays is the second light receiving signal B3,
Called.

As shown in FIG. 5B, the second light receiving signal B1 appears at a position corresponding to each irradiation position in the width direction of the operation region 110 in which the first LED 131 and the second LED 132 emit infrared rays. The intensity of the reflected light is the combined intensity of the first light receiving signal A1 and the first light receiving signal A2.

Similarly, although not shown in FIG. 5B, the second light receiving signal B2 appears at a position corresponding to each irradiation position in the width direction of the operation region 110 in which the second LED 132 and the third LED 133 emit infrared rays. To do. The intensity of the reflected light is the combined intensity of the first light receiving signal A2 and the first light receiving signal A3.

Similarly, as shown in FIG. 5B, the second light receiving signal B3 appears at a position corresponding to each irradiation position in the width direction of the operation region 110 in which the third LED 133 and the fourth LED 134 emit infrared rays. The intensity of the reflected light is the combined intensity of the first light receiving signal A3 and the first light receiving signal A4.

FIG. 5C is a diagram generated by superimposing the second light receiving signals B1 to B3. Further, in FIG. 5 (d), the second light receiving signals B1 to so that the maximum value of the intensity of the reflected light of FIG. 5 (c) becomes equal to the maximum value of the intensity of the reflected light of FIG. 4 (c). It is a figure which shows the 2nd light receiving signal B1'to B3' generated by correcting B3.

In other words, FIG. 5D normalizes the intensity of the reflected light when infrared rays are reflected by the reflecting object at each irradiation position in the width direction of the operating area 110, and shows the operating area. It is shown about the whole width direction of 110. In FIG. 5D, the dotted line 400 represents a threshold value used for determining the presence or absence of a reflecting object.

In the case of FIG. 5D, with respect to the reflecting object at the irradiation position indicated by reference numeral 401, the intensity of the reflected light is increased because the first LED 131 and the second LED 132 simultaneously emit infrared rays, which exceeds the dotted line 400. ing.

Similarly, with respect to the reflecting object at the irradiation position indicated by reference numeral 402, the intensity of the reflected light is increased by the simultaneous projection of infrared rays by the second LED 132 and the third LED 133, which exceeds the dotted line 400. Similarly, with respect to the reflecting object at the irradiation position indicated by reference numeral 403, the intensity of the reflected light is increased by the simultaneous projection of infrared rays by the third LED 133 and the fourth LED 134, which exceeds the dotted line 400.

In this way, light projection (projection in which the irradiation light intensity is increased at the irradiation position where the irradiation light intensity decreases) is performed at the second light projection timing to generate the second light receiving signals B1'to B3'. Therefore, it is possible to detect a reflecting object at a position that cannot be detected by the first light receiving signals A1 to A4.

<Overview of detection processing by the detection system>
Next, the outline of the detection process by the detection system 200 will be described. FIG. 6 is a diagram for explaining an outline of the detection process by the detection system. The first control unit 221 of the light projection control unit 220 first outputs the control signal shown on the left side of FIG. 6A so that the first LEDs 131 to the fourth LEDs 134 emit infrared rays at the first light projection timing. .. Subsequently, the first acquisition unit 231 of the detection unit 230 acquires the first light receiving signals A1 to A4 shown in FIG. 6B (here, for convenience of explanation, when there is a reflecting object at each irradiation position). It shows the received signal).

Subsequently, the second control unit 222 of the light projection control unit 220 outputs the control signal shown on the right side of FIG. 6A so that the first LEDs 131 to the fourth LEDs 134 emit infrared rays at the second light projection timing. To do. Subsequently, the second acquisition unit 232 of the detection unit 230 generates the second light receiving signals B1'to B3' shown in FIG. 6 (c) (again, for convenience of explanation, there is a reflecting object at each irradiation position. The light-receiving signal generated based on the light-receiving signal in the case is shown).

Subsequently, the determination unit 233 of the detection unit 230 determines whether or not there is an operation on the operation area 110 based on the first light receiving signals A1 to A4. Further, the determination unit 233 of the detection unit 230 determines whether or not there is an operation on the operation area 110 based on the second light receiving signals B1'to B3'.

As shown in FIG. 6D, for any of the reflecting objects at any of the irradiation positions in the width direction of the operation region 110, the reflecting object is based on the received light signal having an intensity exceeding the threshold value indicated by the dotted line 400. The presence or absence can be determined.

That is, by executing the detection process using the first light receiving signals A1 to A4 and the second light receiving signals B1'to B3', the reflecting object at any position of each irradiation position in the width direction of the operation region 110. Can also be detected.

<Flow of detection processing by detection system>
Next, the flow of the detection process by the detection system 200 will be described. FIG. 7 is a flowchart showing the flow of detection processing by the detection system. In step S701, the first control unit 221 of the light projection control unit 220 controls the first LEDs 131 to the fourth LEDs 134 to project infrared rays at the first light projection timing. Further, the first acquisition unit 231 of the detection unit 230 acquires the first light receiving signals A1 to A4.

In step S702, the determination unit 233 of the detection unit 230 determines whether or not the intensity of the reflected light of any of the acquired first received light signals A1 to A4 is equal to or greater than the threshold value. If it is determined in step S702 that the intensity of any of the reflected light is equal to or greater than the threshold value (yes in step S702), the process proceeds to step S705. In step S705, the determination unit 233 determines that the operation area 110 of the display device 100 has been operated.

On the other hand, if it is determined in step S702 that the intensity of any reflected light is not equal to or greater than the threshold value (if No in step S702), the process proceeds to step S703. In step S703, the second control unit 222 of the light projection control unit 220 controls the first LEDs 131 to the fourth LEDs 134 to project infrared rays at the second light projection timing. Further, the second acquisition unit 232 of the detection unit 230 generates the second light receiving signals B1'to B3'.

In step S704, the determination unit 233 of the detection unit 230 determines whether or not the intensity of the reflected light of any of the generated second light receiving signals B1'to B3' is equal to or greater than the threshold value. If it is determined in step S704 that the intensity of any of the reflected light is equal to or greater than the threshold value (yes in step S704), the process proceeds to step S705. In step S705, the determination unit 233 of the detection unit 230 determines that there has been an operation on the operation area 110 of the display device 100.

On the other hand, if it is determined in step S704 that the intensity of any reflected light is not equal to or higher than the threshold value (if No in step S704), the process proceeds to step S706. In step S706, the light projection control unit 220 determines whether or not to end the detection process.

If it is determined in step S706 that the detection process is not completed (No in step S706), the process returns to step S701. On the other hand, when it is determined in step S706 to end the detection process (in the case of Yes in step S706), the detection process ends.

<Effect of detection processing>
Next, the effect of the detection process by the detection system 200 will be described. FIG. 8 is a diagram showing an example of the effect of the detection process by the detection system. Of these, FIG. 8A shows, as a comparative example, the presence or absence of an operation on the operation region 110 using the first light receiving signals A1 to A4 acquired by projecting infrared rays at the first projection timing. It shows how the judgment was made. Here, a case where the operator performs a swipe operation is shown.

As shown in FIG. 8A, in the case of the first light receiving signals A1 to A4 acquired by projecting infrared rays at the first projection timing, the inside of each irradiation position in the width direction of the operation region 110 Includes a position where the intensity of the reflected light is not sufficient (a position where the operator's hand cannot be detected). Therefore, when the swipe operation shown in FIG. 8A is performed, the operator's hand cannot be detected at the position marked with "x" in FIG. 8A (that is, the swipe operation is stable). Cannot be detected).

On the other hand, FIG. 8B uses the second light receiving signals B1'to B3', which are generated by projecting infrared rays at the second light projection timing, in addition to the first light receiving signals A1 to A4. It shows how it is determined whether or not there is an operation on the operation area 110.

As shown in FIG. 8B, in the case of the second light receiving signals B1'to B3'generated by projecting infrared rays at the second light emitting timing, the first light receiving signals A1 to A4 It is possible to detect the operator's hand at an irradiation position that cannot be detected. Therefore, when the swipe operation shown in FIG. 8B is performed, the operator's hand can be detected at all positions (in the case of FIG. 8B, the "x" mark disappears and the swipe operation is performed. It can be detected stably).

<Summary>
As is clear from the above description, the detection system according to the first embodiment is
-It has the first LED to the fourth LED that emits infrared rays to the operation area of the display device, and a PD that receives the reflected light from the operation area.
-Of the first LED to the fourth LED, the adjacent LED emits infrared rays at different timings to acquire the first received signal.
-A second light receiving signal is generated based on a light receiving signal acquired when adjacent LEDs of the first LED to the fourth LED emit infrared rays at the same timing.
-Based on each of the first received signal and the second received signal, it is determined whether or not there is an operation on the operation area.

In this way, by determining the presence or absence of an operation using two types of light receiving signals that complement each other, according to the first embodiment, the operation at an irradiation position where the irradiation light intensity is low is stable. It can be detected.

As a result, according to the first embodiment, it is possible to reduce the influence of the irradiation characteristics of the floodlight in the detection system that detects the operation of the display device.

[Second Embodiment]
In the first embodiment, the first light receiving signal is acquired and the second light receiving signal is generated by projecting infrared rays at the first light projection timing and the second light projection timing, respectively. It was configured to be.

On the other hand, in the second embodiment, the first light receiving signal is acquired by projecting infrared rays at the first light emitting timing, and the second light receiving signal is obtained based on the acquired first light receiving signal. Generates a light receiving signal. Hereinafter, the second embodiment will be described focusing on the differences from the first embodiment.

<System configuration of detection system and functional configuration of control device>
First, the system configuration of the detection system 200 and the functional configuration of the control device 210 included in the detection system 200 according to the second embodiment will be described. FIG. 9 is a second diagram showing an example of the system configuration of the detection system and the functional configuration of the control device. The difference from the functional configuration of the control device 210 shown in FIG. 2 is that in the case of the control device 210 of FIG. 9, the floodlight control unit 910 has a first control unit 221 and a second control unit 222. It is a point that is not. Further, in the case of the control device 210 of FIG. 9, the detection unit 920 has a generation unit 921 instead of the second acquisition unit 232.

Since the first control unit 221 and the first acquisition unit 231 and the determination unit 233 shown in FIG. 9 have already been described in FIG. 2, description thereof will be omitted here. The generation unit 921 performs an operation on the first light receiving signals A1 to A4 acquired by the first acquisition unit 231 to increase the intensity of the reflected light from the irradiation position where the irradiation light intensity decreases, and the second light receiving unit 921 performs the calculation. Generate signals B1'to B3'.

Specifically, the generation unit 921 adds the first light receiving signals A1 and A2 acquired by the first acquisition unit 231 to generate the second light receiving signal B1 (infrared rays at the second projection timing). The received signal acquired when the light is projected) is calculated. Further, the generation unit 921 generates the second light receiving signal B1'by correcting the calculated second light receiving signal B1.

Similarly, the generation unit 921 projects the second light receiving signal B2 (infrared rays at the second light projection timing) by adding the first light receiving signals A2 and A3 acquired by the first acquisition unit 231. The received light signal acquired when the above is performed) is calculated. In addition, the generation unit 921 generates the second light receiving signal B2'by correcting the calculated second light receiving signal B2.

Similarly, the generation unit 921 projects the second light receiving signal B3 (infrared rays at the second light projection timing) by adding the first light receiving signals A3 and A4 acquired by the first acquisition unit 231. The received light signal acquired when the above is performed) is calculated. Further, the generation unit 921 generates the second light receiving signal B3'by correcting the calculated second light receiving signal B3.

<Flow of detection processing by detection system>
Next, the flow of the detection process by the detection system 200 according to the second embodiment will be described. FIG. 10 is a second flowchart showing the flow of detection processing by the detection system. In step S1001, the first control unit 221 of the light projection control unit 910 controls the first LEDs 131 to the fourth LEDs 134 to emit infrared rays at the first light projection timing. Further, the first acquisition unit 231 of the detection unit 920 acquires the first light receiving signals A1 to A4.

In step S1002, the determination unit 233 of the detection unit 920 determines whether or not the intensity of the reflected light of any of the acquired first received light signals A1 to A4 is equal to or greater than the threshold value. If it is determined in step S1002 that the intensity of any of the reflected light is equal to or greater than the threshold value (yes in step S1002), the process proceeds to step S1005. In step S1005, the determination unit 233 determines that the operation area 110 of the display device 100 has been operated.

On the other hand, if it is determined in step S1002 that the intensity of any reflected light is not equal to or higher than the threshold value (if No in step S1002), the process proceeds to step S1003. In step S1003, the generation unit 921 of the detection unit 920 generates the second light receiving signals B1'to B3' from the first light receiving signals A1 to A4.

In step S1004, the determination unit 233 of the detection unit 920 determines whether or not the intensity of the reflected light of any of the generated second light receiving signals B1'to B3' is equal to or greater than the threshold value. If it is determined in step S1004 that the intensity of any of the reflected light is equal to or greater than the threshold value (yes in step S1004), the process proceeds to step S1005. In step S1005, the determination unit 233 determines that the operation area 110 of the display device 100 has been operated.

On the other hand, if it is determined in step S1004 that the intensity of any reflected light is not equal to or higher than the threshold value (if No in step S1004), the process proceeds to step S1006. In step S1006, the light projection control unit 910 determines whether or not to end the detection process.

If it is determined in step S1006 that the detection process is not completed (if No in step S1006), the process returns to step S1001. On the other hand, when it is determined in step S1006 that the detection process is terminated (in the case of Yes in step S1006), the detection process is terminated.

<Summary>
As is clear from the above description, the detection system according to the second embodiment is
-It has the first LED to the fourth LED that emits infrared rays to the operation area of the display device, and a PD that receives the reflected light from the operation area.
-Of the first LED to the fourth LED, the adjacent LED emits infrared rays at different timings to acquire the first received signal.
-A second light receiving signal is generated based on the result of calculating the light receiving signal of the adjacent LED in the first light receiving signal among the first LED to the fourth LED.
-Based on each of the first received signal and the second received signal, it is determined whether or not there is an operation on the operation area.

In this way, by determining the presence or absence of an operation using two types of light receiving signals that complement each other, according to the second embodiment, the operation at an irradiation position where the irradiation light intensity is low is stable. It can be detected.

As a result, according to the second embodiment, it is possible to reduce the influence of the irradiation characteristics of the floodlight in the detection system that detects the operation of the display device.

[Other Embodiments]
In the second embodiment, when generating the second light receiving signals B1'to B3', the first light receiving signals A1 and A2, A2 and A3, and A3 and A4 are added together. However, the method of generating the second light receiving signals B1'to B3' is not limited to this, and the second light receiving signals B1'to B3' can be generated by correlating the first light receiving signal by another calculation method. It may be generated.

For example, a second light receiving signal B1'is generated from the weighted average and / or geometric mean and / or harmonic mean of the first light receiving signal A1 and the first light receiving signal A2, and / or the calculation results thereof. You may. Similarly, from the weighted average and / or geometric mean and / or harmonic mean of the first light receiving signal A2 and the first light receiving signal A3, and / or these calculation results, the second light receiving signal B2'is obtained. It may be generated. Similarly, from the weighted average and / or geometric mean and / or harmonic mean of the first light receiving signal A3 and the first light receiving signal A4, and / or these calculation results, the second light receiving signal B3'is obtained. It may be generated.

Further, in the first and second embodiments, it is configured to determine whether or not an operation has been performed on the display device for each cycle, but whether or not an operation has been performed on the display device has been made. The determination method of is not limited to this. For example, it may be configured to comprehensively determine whether or not an operation has been performed on the display device based on the received signals for a plurality of cycles.

The present invention is not limited to the configurations shown here, such as combinations with other elements in the configurations and the like described in the above embodiments. These points can be changed without departing from the spirit of the present invention, and can be appropriately determined according to the application form thereof.

100: Display device 110: Operation area 120: Non-operation area 130: Proximity detection device 131-134: First to fourth infrared LEDs
140: PD
200: Detection system 210: Control device 220: Floodlight control unit 221: First control unit 222: Second control unit 230: Detection unit 231: First acquisition unit 232: Second acquisition unit 233: Judgment unit 910: Floodlight Control unit 920: Detection unit 921: Generation unit

Claims (7)

A detection system having a plurality of floodlights that project light onto an operation area of a display device and a receiver that receives reflected light from the operation area.
Among the plurality of floodlights, an acquisition unit that acquires a first light receiving signal by projecting light at different projection timings between the adjacent first floodlight and the second floodlight.
A generator that generates a second light receiving signal based on a light receiving signal acquired when the adjacent first light flooding device and the second floodlight project light among the plurality of floodlights.
A detection system having a determination unit for determining the presence or absence of an operation on the operation area based on each of the first light receiving signal and the second light receiving signal. Among the plurality of floodlights, a first control unit that controls adjacent first floodlights and second floodlights to project light at different projection timings.
The detection system according to claim 1, further comprising a second control unit that controls the adjacent first floodlight and the second floodlight to project light at the same flood timing among the plurality of floodlights. The acquisition unit acquires the first received signal by receiving the reflected light when the light is projected at different projection timings.
The detection system according to claim 2, wherein the generation unit generates the second light receiving signal based on the light receiving signal acquired by receiving the reflected light when the light is projected at the same light projection timing. .. The generator
The second light receiving signal is corrected by correcting the light receiving signal acquired by receiving the reflected light when the light is projected at the same projection timing based on the maximum value of the first light receiving signal. The detection system according to claim 3, which is generated. The detection system according to claim 1, further comprising a control unit that controls the adjacent first floodlight and the second floodlight to project light at different flood timings among the plurality of floodlights. The acquisition unit acquires the first received signal by receiving the reflected light when the light is projected at different projection timings.
The generation unit calculates the first light receiving signal acquired by projecting the first floodlight and the first light receiving signal acquired by projecting the second floodlight. The detection system according to claim 5, wherein the second light receiving signal is generated based on the result. It is a detection method in a detection system having a plurality of floodlights that project light onto an operation area of a display device and a receiver that receives reflected light from the operation area.
Among the plurality of floodlights, an acquisition step of acquiring a first light receiving signal by projecting light at different projection timings between the adjacent first floodlight and the second floodlight.
A generation step of generating a second light receiving signal based on a light receiving signal acquired when the first and second floodlights adjacent to each other among the plurality of floodlights are flooded.
A detection method including a determination step of determining the presence or absence of an operation on the operation region based on each of the first light receiving signal and the second light receiving signal.

Images