JP2022061242A

JP2022061242A - Proximity position detecting device, display unit and information processing system

Info

Publication number: JP2022061242A
Application number: JP2020169126A
Authority: JP
Inventors: 禎一伊知川; Teiichi Ichikawa
Original assignee: Alps Alpine Co Ltd
Current assignee: Alps Alpine Co Ltd
Priority date: 2020-10-06
Filing date: 2020-10-06
Publication date: 2022-04-18
Anticipated expiration: 2040-10-06

Abstract

To provide "a proximity position detecting device, a display unit and an information processing system" that suppress a false recognition of a gesture by a user's hand.SOLUTION: Four LEDs and two photodiodes are arranged side by side in the sequence of an LED1, a PD1, an LED2, an LED3, a PD2 and an LED4, and are placed slightly below the lower side of a display screen. With a position corresponding to the weighted center of a detection signal being as a position G of a hand, a position corresponding to the peak of the detection signal is calculated as a peak position GC from a detection signal L1 by the PD2 when the LED1 lights up, a detection signal L2 by the PD1 when the LED2 lights up, a detection signal L3 by the PD2 when the LED3 lights up, and a detection signal L4 by the PD2 when the LED4 lights up. The position G of the hand is corrected in such a way that the larger the detection signal E1 by the PD2 when the LED1 lights up and the detection signal E2 by the PD1 when the LED4 lights up are, the closer the position of the hand becomes relative to the peak position GC.SELECTED DRAWING: Figure 3

Description

本発明は、ディスプレイの表示面に近接した手の位置を検出する技術に関するものである。 The present invention relates to a technique for detecting the position of a hand close to the display surface of a display.

ディスプレイの表示面に近接した手の位置を検出する技術としては、ディスプレイの下辺に沿って配置した、ディスプレイの前方の空間に向けて上方に赤外光を照射する複数のＬＥＤを順次点灯すると共に、フォトダイオードでユーザの手による赤外光の反射光を検出し、各ＬＥＤ点灯時に検出された反射光の強度よりディスプレイの表示面に近接した手の位置を推定し、推定した位置の推移よりディスプレイの表示面に近接した手によるジェスチャを認識する検知システムが知られている（たとえば、特許文献１）。 As a technique for detecting the position of a hand close to the display surface of a display, a plurality of LEDs arranged along the lower side of the display and irradiating infrared light upward toward the space in front of the display are sequentially turned on. , The photodiode detects the reflected light of infrared light by the user's hand, estimates the position of the hand near the display surface of the display from the intensity of the reflected light detected when each LED is lit, and from the transition of the estimated position. A detection system that recognizes a gesture by hand close to the display surface of a display is known (for example, Patent Document 1).

特開２０１９-７４４６５号公報Japanese Unexamined Patent Publication No. 2019-74465

上述した検知システムにおいてディスプレイの表示面に近接した水平方向の手の位置を、より高分解能に求める場合には、各ＬＥＤ点灯時に検出された反射光の強度の重心位置を水平方向の手の位置として算定することが考えられる。 In the above-mentioned detection system, when the position of the hand in the horizontal direction close to the display surface of the display is obtained with higher resolution, the position of the center of gravity of the intensity of the reflected light detected when each LED is lit is the position of the hand in the horizontal direction. It is conceivable to calculate as.

すなわち、図１０ａ、ｂに示すように、ディスプレイＤに対して、左右方向、上下方向、前後方向を定めるものとして、赤外光を照射するＬＥＤ１、ＬＥＤ２、ＬＥＤ３、ＬＥＤ４の４つのＬＥＤを、当該順序で左から右に向かって、ディスプレイＤの下辺の少し下の位置におおよそ等間隔で配置する。また、ＰＤ１とＰＤ２との赤外光を検出する２つのフォトダイオードを、ＰＤ１が、ＬＥＤ１とＬＥＤ２の中間の位置し、ＰＤ２が、ＬＥＤ３とＬＥＤ４の中間の位置するように設ける。 That is, as shown in FIGS. 10a and 10b, the four LEDs of LED1, LED2, LED3, and LED4 that irradiate infrared light are used to determine the left-right direction, the up-down direction, and the front-back direction with respect to the display D. Arrange them at approximately equal intervals from left to right in order, slightly below the bottom edge of the display D. Further, two photodiodes for detecting infrared light between PD1 and PD2 are provided so that PD1 is located between LED1 and LED2 and PD2 is located between LED3 and LED4.

そして、図１１に示すサイクルを繰り返し行う。
各サイクルは、ＬＥＤ１のみを点灯しＰＤ１に入射した赤外光の強度を表す強度信号L1を得るピリオドと、ＬＥＤ２のみを点灯しＰＤ１に入射した赤外光の強度を表す強度信号L2を得るピリオドと、ＬＥＤ３のみを点灯しＰＤ２に入射した赤外光の強度を表す強度信号L3を得るピリオドと、ＬＥＤ４のみを点灯しＰＤ２に入射した赤外光の強度を表す強度信号L4を得るピリオドとを含む。 Then, the cycle shown in FIG. 11 is repeated.
Each cycle has a period in which only LED1 is turned on to obtain an intensity signal L1 indicating the intensity of infrared light incident on PD1, and a period in which only LED2 is turned on to obtain an intensity signal L2 indicating the intensity of infrared light incident on PD1. A period in which only the LED 3 is turned on to obtain an intensity signal L3 indicating the intensity of the infrared light incident on the PD2, and a period in which only the LED 4 is turned on to obtain an intensity signal L4 indicating the intensity of the infrared light incident on the PD2. include.

そして、各ＬＥＤ点灯時に検出された反射光の強度の重心位置Gを、X1＜x2＜x3＜x4として∥
g={(x1×L1)+(X2×L2)＋(X3×L3)+(X4×L4)}/(L1+L2+L3+L4)
によって、水平方向の手の位置として算定する。 Then, the center of gravity position G of the intensity of the reflected light detected when each LED is lit is set to X1 <x2 <x3 <x4.
g = {(x1 × L1) + (X2 × L2) ＋ (X3 × L3) + (X4 × L4)} / (L1 + L2 + L3 + L4)
Is calculated as the position of the hand in the horizontal direction.

しかし、このように重心位置Gを水平方向の手の位置とすると次のような問題が生じる。
すなわち、一般にＬＥＤの照射特性は指向性を持った点光源として近似でき、ＬＥＤ１、ＬＥＤ２、ＬＥＤ３、ＬＥＤ４の４つのＬＥＤによるの照射分布は例えば図１２ａに示すようになる。 However, if the center of gravity position G is set to the position of the hand in the horizontal direction in this way, the following problems occur.
That is, in general, the irradiation characteristics of the LED can be approximated as a point light source having directivity, and the irradiation distribution by the four LEDs of LED1, LED2, LED3, and LED4 is shown in FIG. 12a, for example.

図示するように、ディスプレイＤの下部では、各ＬＥＤからの照射光が拡がっていないため、この位置にある対象物（たとえばＰ２）は１つのＬＥＤのみの照射を強く受けがちである一方、ディスプレイＤの上部では、各ＬＥＤの照射が拡がってくるため、この位置にある対象物（たとえばＰ１）は複数のＬＥＤからの照射を受けるようになる。 As shown in the figure, since the irradiation light from each LED does not spread in the lower part of the display D, the object (for example, P2) at this position tends to be strongly irradiated by only one LED, while the display D. In the upper part of the above, the irradiation of each LED spreads, so that the object (for example, P1) at this position receives the irradiation from a plurality of LEDs.

そして、この影響により、X1=1、X2=2、X3=3、X4=4として、
G={(1×L1)+(2×L2)＋(3×L3)+(4×L4)}/(L1+L2+L3+L4)
により重心位置Gを算定する場合について、対象物の位置と当該位置にある対象物に対して算定される重心位置Gとの関係を図１２ｂに示したように、水平方向の位置が同じ対象物（たとえば図１２ａのＰ１に位置する対象物とＰ２に位置する対象物）に対して、上下方向の位置に応じて異なる重心位置Gが水平方向の手の位置として算定されてしまう。 And, due to this influence, X1 = 1, X2 = 2, X3 = 3, X4 = 4,
G = {(1 × L1) + (2 × L2) ＋ (3 × L3) + (4 × L4)} / (L1 + L2 + L3 + L4)
When calculating the center of gravity position G by (For example, an object located at P1 and an object located at P2 in FIG. 12a), a different center of gravity position G is calculated as the position of the hand in the horizontal direction depending on the position in the vertical direction.

そして、対象物の位置と重心位置Gとの関係が、図１２ｂに示したように、位置が上方となるにつれて、より中央値(図１２ｂでは2.5)に近づく重心位置Gが算定され、左右端に近づくほど、上下方向の位置によって重心位置Gが大きく変化する関係となるために、重心位置Gを水平方向の手の位置として手のジェスチャを検出すると、ジェスチャを誤認識する場合が生じる。 Then, as shown in FIG. 12b, the relationship between the position of the object and the center of gravity position G is calculated as the center of gravity position G closer to the center value (2.5 in FIG. 12b) as the position becomes higher, and the left and right ends. Since the center of gravity position G changes greatly depending on the position in the vertical direction as it approaches, if the gesture of the hand is detected with the center of gravity position G as the position of the hand in the horizontal direction, the gesture may be erroneously recognized.

すなわち、たとえば、ディスプレイＤに近接させた手を左から右にディスプレイＤの画面幅の75%以上動かすジェスチャをスワイプ動作として検出する場合、画面の上部中央において画面幅の75%の長さは図１２ｃのM1となり、M1に対応する重心位置Gの変化幅は2.25となる。 That is, for example, when a gesture that moves a hand close to the display D from left to right by 75% or more of the screen width of the display D is detected as a swipe operation, the length of 75% of the screen width at the upper center of the screen is shown in the figure. It becomes M1 of 12c, and the change width of the center of gravity position G corresponding to M1 becomes 2.25.

一方、画面の下部中央において重心位置Gの変化幅2.25に対応する長さは、図１２ｃの画面幅のおよそ40%の長さM2となる。
したがって、画面の上部中央に合わせて、重心位置Gが2.25以上変化したときにスワイプ動作を検出するようにすると、画面の下部中央において、ユーザが手を左から右にディスプレイＤの画面幅の40%程度だけ動かしたときにもスワイプ動作として誤認識してしまう。 On the other hand, the length corresponding to the change width 2.25 of the center of gravity position G in the lower center of the screen is M2, which is about 40% of the screen width in FIG. 12c.
Therefore, if the swipe operation is detected when the center of gravity position G changes by 2.25 or more according to the center of the upper part of the screen, the user hands the hand from left to right at the center of the lower part of the screen, which is 40 of the screen width of the display D. Even if you move it by about%, it will be mistakenly recognized as a swipe operation.

また、ディスプレイＤが左ハンドル車の自動車のダッシュボードの運転席と助手席の間の位置に配置されたものである場合に、ドライバが手でディスプレイＤの下方にあるエアコン等の走査パネルを操作するような動作を図１２ｃのJ1のように行ったときにも、重心位置Gが2.25以上変化しスワイプ動作として誤認識してしまう。 Further, when the display D is arranged at a position between the driver's seat and the passenger seat on the dashboard of a left-hand drive vehicle, the driver manually operates a scanning panel such as an air conditioner below the display D. Even when such an operation is performed as shown in J1 in FIG. 12c, the center of gravity position G changes by 2.25 or more and is erroneously recognized as a swipe operation.

そこで、本発明は、手によるジェスチャを適正に認識できるように、ディスプレイの表示面に近接した手の位置を検出することを課題とする。 Therefore, it is an object of the present invention to detect the position of the hand close to the display surface of the display so that the gesture by the hand can be properly recognized.

前記課題達成のために、本発明は、ディスプレイの表示面に近接した手の水平方向の位置を検出する近接位置検出装置に、ディスプレイの表示面の外側に当該表示面の水平方向の一辺である第１辺に沿って並べて配置された、当該表示面の前方を通る赤外光を出射する複数の赤外光源と、前記表示面の外側に前記第１辺に沿って並べて配置された複数の光検出器と、近接位置算定部とを設けたものである。前記近接位置算定部は、前記複数の赤外光源の各々について、当該赤外光源に予め定めた対応に従って対応づけられている光検出器で検出した、当該赤外光源が出射した赤外光の反射光の強度を、当該赤外光源の出射光の第１の検出反射強度として、各赤外光源の出射光の第１の検出反射強度から推定される反射光の水平方向の分布の重心に対応する水平方向の位置を重心位置として算定する重心位置算定部と、前記複数の赤外光源のうちの一つもしくは複数の赤外光源を対象赤外光源として、各対象赤外光源について、当該対象赤外光源である赤外光源に前記対応に従って対応づけられている光検出器よりも、当該対象赤外光源に対して離れている光検出器で検出した、当該対象赤外光源が出射した赤外光の反射光の強度を、当該対象赤外光源の出射光の第２の検出反射強度として、各第２の検出反射強度の大きさの程度を表す位置指標を算定する位置指標算定部と、各赤外光源の出射光の前記第１の検出反射強度から推定される、反射光のピークが現れる水平方向の位置をピーク位置として算定するピーク位置算定部と、前記位置指標が大きいほど前記ピーク位置の値に近づくように前記重心位置を補正した位置を補正後重心位置として算定する補正後重心位置算定部と、前記補正後重心位置を用いて、ディスプレイの表示面に近接した手の水平方向の位置を表す検出位置を算定する検出位置算定部とを備えている。 In order to achieve the above problems, the present invention provides a proximity position detecting device for detecting the horizontal position of a hand close to the display surface of the display, which is a horizontal side of the display surface outside the display surface of the display. A plurality of infrared light sources that emit infrared light passing in front of the display surface arranged side by side along the first side, and a plurality of infrared light sources arranged side by side along the first side outside the display surface. It is provided with an optical detector and a proximity position calculation unit. The proximity position calculation unit detects the infrared light emitted by the infrared light source with a light detector associated with each of the plurality of infrared light sources according to a predetermined correspondence. The intensity of the reflected light is defined as the first detected reflection intensity of the emitted light of the infrared light source, and is set as the center of gravity of the horizontal distribution of the reflected light estimated from the first detected reflected intensity of the emitted light of each infrared light source. For each target infrared light source, the center of gravity position calculation unit that calculates the corresponding horizontal position as the center of gravity position and one or more infrared light sources among the plurality of infrared light sources are set as the target infrared light sources. The target infrared light source detected by a light detector farther from the target infrared light source than the light detector associated with the target infrared light source according to the above correspondence is emitted. Position index calculation unit that calculates a position index indicating the degree of magnitude of each second detected reflection intensity, with the intensity of the reflected light of the infrared light as the second detected reflection intensity of the emitted light of the target infrared light source. And the peak position calculation unit that calculates the horizontal position where the peak of the reflected light appears, which is estimated from the first detected reflection intensity of the emitted light of each infrared light source, as the peak position, and the larger the position index is, the larger the position index is. Using the corrected center of gravity position calculation unit that calculates the corrected position of the center of gravity so as to approach the value of the peak position as the corrected center of gravity position, and the corrected center of gravity position, the hand close to the display surface of the display. It is equipped with a detection position calculation unit that calculates the detection position that represents the position in the horizontal direction.

ここで、このような近接位置検出装置は、前記補正後重心位置が前記表示面の左右方向の中央の位置を表す場合の補正後重心位置の値を中央値として、前記検出位置算定部において、前記補正後重心位置算定部で算定された算定された前記補正後重心位置の値を、前記中央値との値の差が所定の割合で縮小するように補正した値を持つ前記検出位置を算定するよう構成してもよい。 Here, in such a proximity position detection device, in the detection position calculation unit, the value of the corrected center of gravity position when the corrected center of gravity position represents the center position in the left-right direction of the display surface is set as the center value. The detection position having a value obtained by correcting the value of the corrected center of gravity position calculated by the corrected center of gravity position calculation unit so that the difference between the value and the center value is reduced by a predetermined ratio is calculated. It may be configured to do so.

または、前記補正後重心位置が前記表示面の左右方向の中央の位置を表す場合の補正後重心位置の値を中央値として、前記検出位置算定部において、前記補正後重心位置算定部で算定された前記補正後重心位置の値を、当該値と前記中央値との値の差が小さいほど、前記中央値との値の差がより縮小するように補正した値を持つ前記検出位置を算定するよう構成してもよい。 Alternatively, the value of the corrected center of gravity position when the corrected center of gravity position represents the center position in the left-right direction of the display surface is set as the center value, and the value is calculated by the corrected center of gravity position calculation unit in the detection position calculation unit. The value of the corrected center of gravity is calculated so that the smaller the difference between the value and the median value, the smaller the difference between the corrected center of gravity and the center of gravity. It may be configured as follows.

また、このような近接位置検出装置は、前記赤外光源の前記第１辺に沿った並び中の順番をiとし、Xiをiが大きくなるほど大きくなる値とし、i番目の赤外光源の出射光の第１の検出反射強度をLiとして、前記重心位置算定部において、Σ(Li×Xi)/Σ(Li)を、前記重心位置として算定するよう構成してもよい。 Further, in such a proximity position detecting device, the order in which the infrared light source is arranged along the first side is set to i, Xi is set to a value that increases as i increases, and the i-th infrared light source is output. The first detected reflection intensity of the light source may be Li, and the center of gravity position calculation unit may be configured to calculate Σ (Li × Xi) / Σ (Li) as the center of gravity position.

また、このような近接位置検出装置は、前記赤外光源の前記第１辺に沿った並び中の順番をiとし、i番目の赤外光源の出射光の第１の検出反射強度をLiとし、j番目の対象赤外光源の出射光の第２の検出反射強度をEｊとして、前記位置指標算定部において、Eｊの総和またはEｊの最大値をAとし、Liの総和またはLiの最大値をBとして、A/Bを、前記位置指標として算定するよう構成してもよい。 Further, in such a proximity position detection device, the order in which the infrared light source is arranged along the first side is set to i, and the first detected reflection intensity of the emitted light of the i-th infrared light source is set to Li. , The second detected reflection intensity of the emitted light of the j-th target infrared light source is Ej, the sum of Ej or the maximum value of Ej is A, and the sum of Li or the maximum value of Li is set in the position index calculation unit. As B, A / B may be configured to be calculated as the position index.

また、このような近接位置検出装置は、前記赤外光源の前記第１辺に沿った並び中の順番をiとし、i番目の赤外光源の出射光の第１の検出反射強度をLiとし、Xiをiが大きくなるほど大きくなる値とし、kiを、Liが第１の検出反射強度のうちで最大か２番目に大きいときに１となり他のときに０となる値として、前記ピーク位置算定部において、
Σ(Xi×ki)/Σ(Li×ki)
により前記ピーク位置を算定するよう構成してもよい。 Further, in such a proximity position detection device, the order in which the infrared light source is arranged along the first side is set to i, and the first detected reflection intensity of the emitted light of the i-th infrared light source is set to Li. , Xi is a value that increases as i increases, and ki is a value that becomes 1 when Li is the maximum or the second largest of the first detected reflection intensities and 0 at other times. In the department
Σ (Xi × ki) / Σ (Li × ki)
May be configured to calculate the peak position.

または、前記赤外光源の前記第１辺に沿った並び中の順番をiとし、i番目の赤外光源の出射光の第１の検出反射強度をLiとし、Xiをiが大きくなるほど大きくなる値として、
前記ピーク位置算定部において、Liの最大値をLmaxとし、Q=Lmax×S（0＜S＜１）とし、Li'=Li-Qとし、Li'＞0の場合はLi"=Li'、Li'≦0の場合はLi"=0として、
GC=Σ(Li"×Xi)/Σ(Li")
によりピーク位置GCを算定するよう構成してもよい。 Alternatively, i is the order in which the infrared light source is arranged along the first side, Li is the first detected reflection intensity of the emitted light of the i-th infrared light source, and Xi becomes larger as i becomes larger. As a value
In the peak position calculation unit, the maximum value of Li is Lmax, Q = Lmax × S (0 <S <1), Li'= Li-Q, and when Li'> 0, Li "= Li', If Li'≤ 0, set Li "= 0 and set
GC = Σ (Li "× Xi) / Σ (Li")
May be configured to calculate the peak position GC.

以上のような近接位置検出装置において、赤外光源から比較的離れた光検出器で算出される第２の検出反射強度の大きさの程度を表す位置指標は対象物の上下方向の推定位置を示すものとなる。そして、本近接位置検出装置によれば、対象物の位置と重心位置との関係が、図１２ｂに示したように、位置が上方となるにつれて、より中央値に近づく重心位置が算定され、左右端に近づくほど、上下方向の位置によって重心位置が大きく変化する関係にあっても、これを位置指標が表す対象物の上下方向の推定位置に応じて補正し、対象物の位置と当該位置を表す検出位置との関係を、検出位置に基づくジェスチャの誤認識を抑制できる関係とすることができる。 In the proximity position detection device as described above, the position index indicating the degree of the magnitude of the second detected reflection intensity calculated by the photodetector relatively far from the infrared light source is the estimated position in the vertical direction of the object. It will be shown. Then, according to this proximity position detection device, as shown in FIG. 12b, the relationship between the position of the object and the position of the center of gravity is calculated as the position becomes higher, and the position of the center of gravity closer to the center value is calculated. Even if the position of the center of gravity changes greatly depending on the position in the vertical direction as it gets closer to the edge, this is corrected according to the estimated position in the vertical direction of the object represented by the position index, and the position of the object and the position concerned are corrected. The relationship with the represented detection position can be a relationship that can suppress erroneous recognition of gestures based on the detection position.

ここで、本発明は、さらに、以上の近接位置検出装置と、当該近接位置検出装置と一体化された前記ディスプレイを備えたディスプレイユニットを提供する。
また、本発明は、以上の近接位置検出装置と、前記ディスプレイと、前記ディスプレイを表示出力に用いるデータ処理装置を備えた情報処理システムを提供する。前記近接位置検出装置は、前記検出位置を前記データ処理装置に通知し、前記データ処理装置は、通知された検出位置の推移より、ディスプレイの表示面に近接した手によるジェスチャを認識し、認識したジェスチャに応じた処理を行う。 Here, the present invention further provides a display unit including the above proximity position detection device and the display integrated with the proximity position detection device.
The present invention also provides an information processing system including the above proximity position detection device, the display, and a data processing device using the display for display output. The proximity position detection device notifies the data processing device of the detection position, and the data processing device recognizes and recognizes a gesture by a hand close to the display surface of the display from the transition of the notified detection position. Perform processing according to the gesture.

以上のように、本発明によれば、手によるジェスチャを適正に認識できるように、ディスプレイの表示面に近接した手の位置を検出することができる。 As described above, according to the present invention, it is possible to detect the position of the hand close to the display surface of the display so that the gesture by the hand can be properly recognized.

本発明の実施形態に係る情報処理システムの構成を示すブロック図である。It is a block diagram which shows the structure of the information processing system which concerns on embodiment of this invention. 本発明の実施形態に係るディスプレイの配置を示す図である。It is a figure which shows the arrangement of the display which concerns on embodiment of this invention. 本発明の実施形態に係る近接検出センサの配置を示す図である。It is a figure which shows the arrangement of the proximity detection sensor which concerns on embodiment of this invention. 本発明の実施形態に係る近接検出センサの動作シーケンスを示す図である。It is a figure which shows the operation sequence of the proximity detection sensor which concerns on embodiment of this invention. 本発明の実施形態に係る近接検出センサの動作シーケンスの他の例を示す図である。It is a figure which shows the other example of the operation sequence of the proximity detection sensor which concerns on embodiment of this invention. 本発明の実施形態に係る位置算定処理を示すフローチャートである。It is a flowchart which shows the position calculation process which concerns on embodiment of this invention. 本発明の実施形態に係る位置算定処理の動作を示す図である。It is a figure which shows the operation of the position calculation process which concerns on embodiment of this invention. 本発明の実施形態に係る位置算定処理の動作を示す図である。It is a figure which shows the operation of the position calculation process which concerns on embodiment of this invention. 本発明の実施形態に係る位置算定処理の動作の他の例を示す図である。It is a figure which shows the other example of the operation of the position calculation process which concerns on embodiment of this invention. 本発明の課題を示す図である。It is a figure which shows the subject of this invention. 本発明の課題を示す図である。It is a figure which shows the subject of this invention. 本発明の課題を示す図である。It is a figure which shows the subject of this invention.

以下、本発明の実施形態について説明する。
図１に、本実施形態に係る情報処理システムの構成を示す。
情報処理システムは自動車に搭載されるシステムであり、カーナビゲーションアプリケーションやメディアプレイヤアプリケーション等を実行するデータ処理装置１、データ処理装置１が映像表示に用いるディスプレイ２、近接位置検出装置３、データ処理装置１が利用する、その他の周辺装置４を備えている。 Hereinafter, embodiments of the present invention will be described.
FIG. 1 shows the configuration of the information processing system according to the present embodiment.
The information processing system is a system mounted on an automobile, and is a data processing device 1 that executes a car navigation application, a media player application, etc., a display 2 that the data processing device 1 uses for video display, a proximity position detection device 3, and a data processing device. It is provided with other peripheral devices 4 used by 1.

ディスプレイ２は、たとえば、図２に示すように、近接位置検出装置３と一体化されたディスプレイユニット１０の形態で、自動車のダッシュボードの運転席と助手席の間の位置に表示面を後方に向けて配置される。 As shown in FIG. 2, the display 2 is in the form of a display unit 10 integrated with a proximity position detecting device 3, and the display surface is rearward at a position between the driver's seat and the passenger's seat on the dashboard of an automobile. Placed towards.

そして、近接位置検出装置３は、ディスプレイ２の表示面への近接したユーザの手の水平方向の位置を検出し、検出位置としてデータ処理装置１に通知し、データ処理装置１は、通知された検出位置の推移より、スワイプ動作などの、ディスプレイ２の表示面に近接した手によるジェスチャを認識し、認識したジェスチャに応じた処理を行う。 Then, the proximity position detection device 3 detects the horizontal position of the user's hand close to the display surface of the display 2 and notifies the data processing device 1 as the detection position, and the data processing device 1 is notified. From the transition of the detection position, a gesture such as a swipe operation by a hand close to the display surface of the display 2 is recognized, and processing according to the recognized gesture is performed.

図１に戻り、近接位置検出装置３は、近接検出センサ３１と近接検出コントローラ３２を備えている。
近接検出センサ３１は、ＬＥＤ１、ＬＥＤ２、ＬＥＤ３、ＬＥＤ４の４つの赤外線ＬＥＤと、ＰＤ１とＰＤ２の、赤外光を検出する２つのフォトダイオードを備えている。
また、近接検出コントローラ３２は、ＬＥＤ１、ＬＥＤ２、ＬＥＤ３、ＬＥＤ４を駆動して発光させる駆動部３２１、ＰＤ１とＰＤ２が出力する電流信号をＰＤ１とＰＤ２に入射した赤外光の強度を表す強度信号に変換し出力する検出部３２２、駆動部３２１と検出部３２２の動作を制御すると共に、検出部３２２が出力する強度信号が表す赤外光の強度より、ディスプレイ２の表示面に近接したユーザの手の水平方向の位置を検出し、検出位置としてデータ処理装置１に通知する検出制御部３２３とを備えている。 Returning to FIG. 1, the proximity detection device 3 includes a proximity detection sensor 31 and a proximity detection controller 32.
The proximity detection sensor 31 includes four infrared LEDs of LED1, LED2, LED3, and LED4, and two photodiodes of PD1 and PD2 for detecting infrared light.
Further, the proximity detection controller 32 converts the current signal output by the drive unit 321, PD1 and PD2 that drives the LED1, LED2, LED3, and LED4 to emit light, and converts the current signal that is incident on the PD1 and PD2 into an intensity signal that represents the intensity of the infrared light incident on the PD1 and PD2. The user's hand closer to the display surface of the display 2 than the intensity of the infrared light represented by the intensity signal output by the detection unit 322 while controlling the operations of the detection unit 322, the drive unit 321 and the detection unit 322 that are converted and output. It is provided with a detection control unit 323 that detects the horizontal position of the light and notifies the data processing device 1 as the detection position.

次に、図３ａ、ｂに示すように、ディスプレイ２に対して前後左右上下を定めるものとして、ＬＥＤ１、ＬＥＤ２、ＬＥＤ３、ＬＥＤ４は、当該順序で左から右に向かって、ディスプレイ２の下辺の少し下の位置におおよそ等間隔で配置されている。ただし、前方向はディスプレイ２の表示方向である。 Next, as shown in FIGS. 3a and 3b, the LED1, LED2, LED3, and LED4 are slightly arranged on the lower side of the display 2 from left to right in this order, assuming that the front, back, left, right, top, and bottom are determined with respect to the display 2. They are arranged at approximately equal intervals in the lower positions. However, the front direction is the display direction of the display 2.

また、ＰＤ１は、ＬＥＤ１とＬＥＤ２の中間の位置に配置され、入射する赤外光の反射光を電流信号に変換し、ＰＤ２は、ＬＥＤ３とＬＥＤ４の中間の位置に配置され、入射する赤外光の反射光を電流信号に変換する。 Further, PD1 is arranged at an intermediate position between LED1 and LED2 to convert the reflected light of incident infrared light into a current signal, and PD2 is arranged at an intermediate position between LED3 and LED4 and incident infrared light. Converts the reflected light of the to a current signal.

図３ａ、ｂ中の矢印は、ＬＥＤ１、ＬＥＤ２、ＬＥＤ３、ＬＥＤ４の指向角の中心軸を表しており、ＬＥＤ１、ＬＥＤ２、ＬＥＤ３、ＬＥＤ４は、ディスプレイ２の前方上方に向けて斜めに赤外光を照射する。 The arrows in FIGS. 3a and 3b represent the central axes of the directivity angles of LED1, LED2, LED3, and LED4, and the LEDs 1, LED2, LED3, and LED4 emit infrared light diagonally toward the front and upper side of the display 2. Irradiate.

図３ｃは、ＬＥＤ１、ＬＥＤ２、ＬＥＤ３、ＬＥＤ４による赤外光の照射強度の分布を表しており、各ＬＥＤからの照射光は上方に向かって拡がっていくため、ディスプレイ２の下部の位置では１つのＬＥＤのみの照射を強く受けがちである一方、ディスプレイ２の上部の位置では複数のＬＥＤからの照射を受けるようになる。 FIG. 3c shows the distribution of the irradiation intensity of the infrared light by the LEDs 1, LED2, LED3, and LED4. Since the irradiation light from each LED spreads upward, one is displayed at the lower position of the display 2. While it tends to be strongly irradiated only by the LED, it will be irradiated from a plurality of LEDs at the upper position of the display 2.

次に、近接検出コントローラ３２の検出制御部３２３は、図４ａに示すサイクルが繰り返し行われるように、駆動部３２１と検出部３２２の動作を制御する。
図４ａに示すサイクルは、駆動部３２１がＬＥＤ１のみを発光し、検出部３２２がＰＤ１に入射した赤外光の強度を表す強度信号L1を出力するピリオドと、駆動部３２１がＬＥＤ２のみを発光し、検出部３２２がＰＤ１に入射した赤外光の強度を表す強度信号L2を出力するピリオドと、駆動部３２１がＬＥＤ３のみを発光し、検出部３２２がＰＤ２に入射した赤外光の強度を表す強度信号L3を出力するピリオドと、駆動部３２１がＬＥＤ４のみを発光させ、検出部３２２がＰＤ２に入射した赤外光の強度を表す強度信号L4を出力するピリオドと、駆動部３２１がＬＥＤ１のみを発光し、検出部３２２がＰＤ２に入射した赤外光の強度を表す強度信号E1を出力するピリオドと、駆動部３２１がＬＥＤ４のみを発光させ、検出部３２２がＰＤ１に入射した赤外光の強度を表す強度信号E2とを出力するピリオドとを含む。 Next, the detection control unit 323 of the proximity detection controller 32 controls the operations of the drive unit 321 and the detection unit 322 so that the cycle shown in FIG. 4a is repeated.
In the cycle shown in FIG. 4a, the drive unit 321 emits only LED 1 and the detection unit 322 emits only LED 2 with a period for outputting an intensity signal L1 indicating the intensity of infrared light incident on PD1. , The period in which the detection unit 322 outputs an intensity signal L2 indicating the intensity of the infrared light incident on the PD1, and the drive unit 321 emits only the LED3, and the detection unit 322 indicates the intensity of the infrared light incident on the PD2. A period that outputs the intensity signal L3, a period in which the drive unit 321 emits only LED4, and a period in which the detection unit 322 outputs an intensity signal L4 indicating the intensity of the infrared light incident on the PD2, and the drive unit 321 emits only LED1. A period that emits light and the detection unit 322 outputs an intensity signal E1 indicating the intensity of the infrared light incident on the PD2, and the drive unit 321 emits only the LED4, and the detection unit 322 emits the intensity of the infrared light incident on the PD1. Includes a period that outputs an intensity signal E2 that represents.

次に、図４ｂに検出部３２２の構成を示す。
図示するように、検出部３２２は、信号処理部３２２１と、一つのアナログデジタル変換器３２２２（Ａ/Ｄ３２２２）と、マルチプレクサ３２２３（ＭＰＸ３２２３）とを備える。 Next, FIG. 4b shows the configuration of the detection unit 322.
As shown in the figure, the detection unit 322 includes a signal processing unit 3221, one analog-to-digital converter 3222 (A / D3222), and a multiplexer 3223 (MPX3223).

マルチプレクサ３２２３は、図４ａに示したサイクルにおいて、検出部３２２がＰＤ１に入射した赤外光の強度を表す強度信号L1、L2、E2を出力するピリオドでは、ＰＤ１の出力する電流信号を選択して信号処理部３２２１に出力し、検出部３２２がＰＤ２に入射した赤外光の強度を表す強度信号L3、L4、E1を出力するピリオドでは、ＰＤ２の出力する電流信号を選択して信号処理部３２２１に出力する。信号処理部３２２１は、マルチプレクサ３２２３から入力する電流信号の電圧信号への変換などの信号処理を行い、アナログデジタル変換器３２２２は、同セットの信号処理部３２２１が出力する電圧信号をデジタル変換して検出制御部３２３に出力する。 In the cycle shown in FIG. 4a, the multiplexer 3223 selects the current signal output by the PD1 in the period in which the detection unit 322 outputs the intensity signals L1, L2, and E2 indicating the intensity of the infrared light incident on the PD1. In the period of outputting to the signal processing unit 3221 and outputting the intensity signals L3, L4, and E1 indicating the intensity of the infrared light incident on the PD2 by the detection unit 322, the current signal output by the PD2 is selected and the signal processing unit 3221 is selected. Output to. The signal processing unit 3221 performs signal processing such as conversion of the current signal input from the multiplexer 3223 into a voltage signal, and the analog-to-digital converter 3222 digitally converts the voltage signal output by the signal processing unit 3221 of the same set. Output to the detection control unit 323.

ここで、近接検出コントローラ３２の検出制御部３２３は、図４ａに示すサイクルに代えて、図５ａに示すサイクルが繰り返し行われるように、駆動部３２１と検出部３２２の動作を制御してもよい。 Here, the detection control unit 323 of the proximity detection controller 32 may control the operations of the drive unit 321 and the detection unit 322 so that the cycle shown in FIG. 5a is repeated instead of the cycle shown in FIG. 4a. ..

図５ａに示すサイクルは、駆動部３２１がＬＥＤ１のみを発光し、検出部３２２がＰＤ１に入射した赤外光の強度を表す強度信号L1とＰＤ２に入射した赤外光の強度を表す強度信号E1とを出力するピリオドと、駆動部３２１がＬＥＤ２のみを発光し、検出部３２２がＰＤ１に入射した赤外光の強度を表す強度信号L2を出力するピリオドと、駆動部３２１がＬＥＤ３のみを発光し、検出部３２２がＰＤ２に入射した赤外光の強度を表す強度信号L3を出力するピリオドと、駆動部３２１がＬＥＤ４のみを発光させ、検出部３２２がＰＤ２に入射した赤外光の強度を表す強度信号L4とＰＤ１に入射した赤外光の強度を表す強度信号E2とを出力するピリオドとを含む。 In the cycle shown in FIG. 5a, the drive unit 321 emits only the LED 1, and the detection unit 322 emits an intensity signal L1 indicating the intensity of the infrared light incident on the PD1 and an intensity signal E1 indicating the intensity of the infrared light incident on the PD2. A period in which the drive unit 321 emits only LED2, and a period in which the detection unit 322 outputs an intensity signal L2 indicating the intensity of the infrared light incident on the PD1 and the drive unit 321 emits only LED3. , A period in which the detection unit 322 outputs an intensity signal L3 indicating the intensity of the infrared light incident on the PD2, and a drive unit 321 emits only the LED4, and the detection unit 322 indicates the intensity of the infrared light incident on the PD2. It includes a period that outputs an intensity signal L4 and an intensity signal E2 indicating the intensity of infrared light incident on PD1.

ここで、このように、近接検出コントローラ３２の検出制御部３２３が、図５ａに示すサイクルが繰り返し行われるように、駆動部３２１と検出部３２２の動作を制御する場合、検出部３２２は、図４ｂに示す構成に代えて、図５ｂに示すように構成する。 Here, when the detection control unit 323 of the proximity detection controller 32 controls the operations of the drive unit 321 and the detection unit 322 so that the cycle shown in FIG. 5a is repeated, the detection unit 322 is shown in the figure. Instead of the configuration shown in 4b, the configuration is as shown in FIG. 5b.

図５ｂの検出部３２２は、ＰＤ１とＰＤ２の二つのフォトダイオードのそれぞれに対応して設けた信号処理部３２２１とアナログデジタル変換器３２２２（Ａ/Ｄ３２２２）のセットを備えている。 The detection unit 322 of FIG. 5b includes a set of a signal processing unit 3221 and an analog-to-digital converter 3222 (A / D3222) provided corresponding to each of the two photodiodes PD1 and PD2.

各セットの信号処理部３２２１は、対応するフォトダイオードが出力する電流信号の電圧信号への変換などの信号処理を行い、各セットのアナログデジタル変換器３２２２は、同セットの信号処理部３２２１が出力する電圧信号をデジタル変換して検出制御部３２３に出力する。 The signal processing unit 3221 of each set performs signal processing such as conversion of the current signal output by the corresponding photodiode into a voltage signal, and the analog-to-digital converter 3222 of each set is output by the signal processing unit 3221 of the same set. The voltage signal to be output is digitally converted and output to the detection control unit 323.

次に、近接検出コントローラ３２の検出制御部３２３が行う位置算定処理について説明する。
図６に、この位置算定処理の手順を示す。
図示するように、検出制御部３２３は、図４ａまたは図５ａに示す各回のサイクルにおいて、強度信号L1、L2、L3、L4、E1、E2を検出部３２２から取得する（ステップ６０２）。 Next, the position calculation process performed by the detection control unit 323 of the proximity detection controller 32 will be described.
FIG. 6 shows the procedure of this position calculation process.
As shown in the figure, the detection control unit 323 acquires the intensity signals L1, L2, L3, L4, E1, and E2 from the detection unit 322 in each cycle shown in FIG. 4a or FIG. 5a (step 602).

ここで、ＬＥＤ１のみを発光したときのＰＤ２に入射した赤外光の強度を表す強度信号E1は、図７ａに示すように、ディスプレイ２の左側上方の領域において反射が発生したときに有意な値を示すと共に、反射が発生した位置が上方であるほど大きな値を示す傾向がある。 Here, the intensity signal E1 indicating the intensity of the infrared light incident on the PD2 when only the LED1 is emitted is a significant value when reflection occurs in the upper left region of the display 2 as shown in FIG. 7a. In addition, the higher the position where the reflection occurs, the larger the value tends to be.

これは、ディスプレイ２の左方上方の領域は、ＬＥＤ１の出射する赤外光によって比較的強い強度で照射されており、かつ、ＬＥＤ１とＰＤ２との位置関係が、当該領域内で生じた反射によるＬＥＤ１の出射する赤外光の反射光がＰＤ２に比較的強い強度で到達する位置関係にあり、また、当該領域内においては、より上方の位置で発生した赤外光の反射光がＰＤ２に、より到達しやすいからである。 This is because the upper left region of the display 2 is irradiated with relatively strong intensity by the infrared light emitted by the LED 1, and the positional relationship between the LED 1 and the PD 2 is due to the reflection generated in the region. There is a positional relationship in which the reflected infrared light emitted by the LED1 reaches the PD2 with a relatively strong intensity, and within the region, the reflected infrared light generated at a higher position reaches the PD2. This is because it is easier to reach.

また、同様に、ＬＥＤ４のみを発光したときのＰＤ１に入射した赤外光の強度を表す強度信号E2は、ディスプレイ２の右側上方の領域において反射が発生したときに有意な値を示すと共に、反射が発生した位置が上方であるほど大きな値を示す。 Similarly, the intensity signal E2 indicating the intensity of the infrared light incident on the PD1 when only the LED 4 is emitted shows a significant value when reflection occurs in the region above the right side of the display 2 and is reflected. The higher the position where is generated, the larger the value.

図６に戻り、検出制御部３２３は、次に、近接有無評価値Vを、V=f1(L1,L2,L3,L4)により算出する（ステップ６０４）。f1(L1,L2,L3,L4)は、たとえば、強度信号L1、L2、L3、L4の最大値を与える関数とする。ただし、f1は、強度信号L1、L2、L3、L4から、発生している反射光の大きさを与える関数であれば他の関数であってもよい。 Returning to FIG. 6, the detection control unit 323 then calculates the proximity presence / absence evaluation value V by V = f1 (L1, L2, L3, L4) (step 604). f1 (L1, L2, L3, L4) is, for example, a function that gives the maximum value of the intensity signals L1, L2, L3, and L4. However, f1 may be another function as long as it is a function that gives the magnitude of the reflected light generated from the intensity signals L1, L2, L3, and L4.

そして、ステップ６０４で算出したVとしきい値Thを比較し（ステップ６６）、Vがしきい値Ｔｈより大きくなければ、そのままステップ６０２に戻り、次回のサイクルの強度信号L1、L2、L3、L4、E1、E2の検出部３２２からの取得を待つ。 Then, V calculated in step 604 is compared with the threshold value Th (step 66), and if V is not larger than the threshold value Th, the process returns to step 602 as it is, and the intensity signals L1, L2, L3, and L4 of the next cycle are returned. , E1 and E2 are waiting for acquisition from the detection unit 322.

一方、Vがしきい値Thより大きい場合には、重心位置Gを、G=f2(L1,L2,L3,L4)により算出する（ステップ６０８）。
f2(L1,L2,L3,L4)は、たとえば、X1、X2、X3、X4を、X1＜X2＜X3＜X4を満たす値として、
G={(X1×L1)+(X2×L2)＋(X3×L3)+(X4×L4)}/(L1+L2+L3+L4)
を与える関数とする。 On the other hand, when V is larger than the threshold value Th, the center of gravity position G is calculated by G = f2 (L1, L2, L3, L4) (step 608).
For f2 (L1, L2, L3, L4), for example, X1, X2, X3, X4 are set as values that satisfy X1 <X2 <X3 <X4.
G = {(X1 × L1) + (X2 × L2) ＋ (X3 × L3) + (X4 × L4)} / (L1 + L2 + L3 + L4)
Is a function that gives.

ただし、以下では、X1=1、X2=2、X3=3、X4=4であるものとして説明を行う。
なお、この場合、f2(L1,L2,L3,L4)は、たとえば、
G={(1×L1)+(2×L2)＋(3×L3)+(4×L4)}/(L1+L2+L3+L4)
を与える関数とする。 However, in the following, it is assumed that X1 = 1, X2 = 2, X3 = 3, and X4 = 4.
In this case, f2 (L1, L2, L3, L4) is, for example,
G = {(1 × L1) + (2 × L2) ＋ (3 × L3) + (4 × L4)} / (L1 + L2 + L3 + L4)
Is a function that gives.

重心位置Gは、先に、図１２ｂを用いて説明したように、反射発生位置が上方となるにつれて、より中央値に近づく重心位置Gが算定され、反射発生位置が左右端に近づくほど、上下方向の位置によって重心位置Gが大きく変化する図７ｂに示す関係となる。 As described above with reference to FIG. 12b, the center of gravity position G is calculated as the center of gravity position G closer to the center value as the reflection generation position becomes higher, and the center of gravity position G moves up and down as the reflection generation position approaches the left and right ends. The relationship shown in FIG. 7b is such that the position of the center of gravity G changes greatly depending on the position in the direction.

図６に戻り、検出制御部３２３は、次に、位置指標EYを、EY=f3(E1,E2)/f4(L1,L2,L3,L4)により算出する（ステップ６１０）。
f3(E1,E2)は、たとえば、(E1+E2)を与える関数や、E1、E2の最大値を与える関数とし、f4(L1,L2,L3,L4)は、たとえば、(L1+L2+L3+L4)を与える関数や、L1、L2、L3、L4の最大値を与える関数とする。 Returning to FIG. 6, the detection control unit 323 then calculates the position index EY by EY = f3 (E1, E2) / f4 (L1, L2, L3, L4) (step 610).
f3 (E1, E2) is, for example, a function that gives (E1 + E2) or a function that gives the maximum value of E1 and E2, and f4 (L1, L2, L3, L4) is, for example, (L1 + L2 +). Let it be a function that gives L3 + L4) or a function that gives the maximum values of L1, L2, L3, and L4.

図７ａに示したE1、E2と反射発生位置との関係に対して、位置指標EYは、図７ｂに示すように、ディスプレイ２の左側上方の領域と右側上方の領域において反射が発生したときに有意な値を示す。また、位置指標EYは、反射が発生した位置が、上方であるほど大きくなると共に、画面の左右方向中央から左右に離れるほど大きくなる値を示す。 With respect to the relationship between E1 and E2 shown in FIG. 7a and the reflection generation position, the position index EY is set when reflection occurs in the upper left region and the upper right region of the display 2 as shown in FIG. 7b. Shows a significant value. Further, the position index EY indicates a value that increases as the position where the reflection occurs increases as the distance from the center in the left-right direction of the screen increases to the left and right.

したがって、位置指標EYは、反射発生位置の上下方向の位置や左右方向の位置を表す指標となる。
図６に戻り、検出制御部３２３は、次に、ピーク位置GCを、GC=f5(L1,L2,L3,L4)により算出する（ステップ６１２）。
f5(L1,L2,L3,L4)は、L1、L2、L3、L4のうちで最大のものと、２番目に大きいものとを用いてピークの位置を算出する関数であり、f5(L1,L2,L3,L4)は、たとえば、ki(iは、１、２、３、４）を、LiがL1、L2、L3、L4のうちで最大か２番目に大きいときに１となり他のときに０となる値として、
GC={(1×k1)+(2×k2)+(3×k3)+(4×k4)}/{(L1×k1)+(L2×k2)+(L3×k3)+(L4×k4)}
を与える関数とする。 Therefore, the position index EY is an index indicating the vertical position and the horizontal position of the reflection generation position.
Returning to FIG. 6, the detection control unit 323 then calculates the peak position GC by GC = f5 (L1, L2, L3, L4) (step 612).
f5 (L1, L2, L3, L4) is a function that calculates the peak position using the largest and second largest of L1, L2, L3, and L4, and f5 (L1, L1,). L2, L3, L4) becomes 1, for example, ki (i is 1, 2, 3, 4) when Li is the largest or the second largest among L1, L2, L3, and L4, and at other times. As a value that becomes 0 in
GC = {(1 × k1) + (2 × k2) + (3 × k3) + (4 × k4)} / {(L1 × k1) + (L2 × k2) + (L3 × k3) + (L4 ×) k4)}
Is a function that gives.

ここで、図７ｃに、このようにして求まるピーク位置GCを示す。
図示するように、画面上部では、左から右への反射発生位置の変化に対してピーク位置GCは比較的スムーズに１から４まで変化するが、画面下部では、各ＬＥＤの光が拡がっていないために、左から右への反射発生位置の変化に対してピーク位置GCはステップ的に変化する。 Here, FIG. 7c shows the peak position GC thus obtained.
As shown in the figure, at the upper part of the screen, the peak position GC changes relatively smoothly from 1 to 4 with respect to the change of the reflection generation position from the left to the right, but at the lower part of the screen, the light of each LED does not spread. Therefore, the peak position GC changes stepwise with respect to the change of the reflection generation position from the left to the right.

図６に戻り、検出制御部３２３は、次に、補正後重心位置G'を、G'=G×(1-α)+GC×αにより算出する（ステップ６１４）。
αは、０以上１以下の数であって、位置指標EYが大きいほど大きくなるように設定する。
この結果、αは、位置指標EYに従って、反射発生位置が上方であるほど大きくなると共に、反射発生位置が画面の左右方向中央から左右に離れるほど大きくなるので、補正後重心位置G'と反射発生位置との関係は図８ａに示すようになる。 Returning to FIG. 6, the detection control unit 323 then calculates the corrected center of gravity position G'by G'= G × (1-α) + GC × α (step 614).
α is a number of 0 or more and 1 or less, and is set so that the larger the position index EY is, the larger the number is.
As a result, according to the position index EY, the reflection generation position becomes larger as the reflection generation position is higher, and the reflection generation position becomes larger as the reflection generation position is separated from the center in the left-right direction of the screen to the left and right. The relationship with the position is shown in FIG. 8a.

図示するように補正後重心位置G'は、反射発生位置が上方であるほど、かつ、反射発生位置が画面の左右方向中央から左右に離れるほど、算定される補正後重心位置G'が中央値（2.5）から離れるように、図７ｂに示した反射発生位置と重心位置Gの関係を補正したものとなる。 As shown in the figure, the corrected center of gravity position G'is the center value of the corrected center of gravity position G'calculated as the reflection generation position is higher and the reflection generation position is farther from the left-right center of the screen to the left and right. The relationship between the reflection generation position and the center of gravity position G shown in FIG. 7b is corrected so as to be away from (2.5).

なお、図７ｃに示したように画面下部で左から右への反射発生位置の変化に対してピーク位置GCはステップ的に変化するが、位置指標EYに従って画面下部ではαは０もしくはほぼ０となってピーク位置GCは補正後重心位置G'に反映されないので、このようなステップ的な変化による影響は抑制される。 As shown in FIG. 7c, the peak position GC changes stepwise with respect to the change in the reflection generation position from left to right at the lower part of the screen, but α becomes 0 or almost 0 at the lower part of the screen according to the position index EY. Since the peak position GC is not reflected in the corrected center of gravity position G', the influence of such a step change is suppressed.

図６に戻り、検出制御部３２３は、次に、最終重心位置G"をG"=f7(G')により算出する（ステップ６１６）。
f7(G')は、Tを定数として、G"=2.5+T(G'-2.5)を与える関数であり、定数Tは、0＜t＜1であり∥補正後重心位置G'と中央値2.5との差よりも、当該補正後重心位置G'より算定される最終重心位置G"と中央値2.5との差が縮小する。 Returning to FIG. 6, the detection control unit 323 then calculates the final center of gravity position G "by G" = f7 (G') (step 616).
f7 (G') is a function that gives G "= 2.5 + T (G'-2.5) with T as a constant, and the constant T is 0 <t <1. The difference between the final center of gravity position G "calculated from the corrected center of gravity position G'and the median value 2.5 is smaller than the difference from the value 2.5.

また、定数Tは、図８ｂに示すように、図８ａに示した反射発生位置と補正後重心位置G'の関係が水平方向に線形に伸張され、反射発生位置が画面の左上角であるときにG"=1となり、反射発生位置が画面の、右上角であるときにG"=4となるように定める。 Further, as shown in FIG. 8b, the constant T is when the relationship between the reflection generation position and the corrected center of gravity position G'shown in FIG. 8a is linearly extended in the horizontal direction and the reflection generation position is the upper left corner of the screen. G "= 1 and G" = 4 when the reflection generation position is the upper right corner of the screen.

図６に戻り、最後に、検出制御部３２３は、算出した最終重心位置G"を検出位置としてデータ処理装置１に通知し（ステップ６１８）、ステップ６０２からの処理に戻る。
以上、検出制御部３２３が行う位置算定処理について説明した。
図８ｂに示した反射発生位置と最終重心位置G"の関係によれば、図８ｃに示すように、最終重心位置G"の変化幅に対する画面の上部における左右方向の長さM'1と画面の下部における左右方向の長さM'2を、ほぼ同様の長さとすることができる。 Returning to FIG. 6, finally, the detection control unit 323 notifies the data processing device 1 of the calculated final center of gravity position G "as the detection position (step 618), and returns to the processing from step 602.
The position calculation process performed by the detection control unit 323 has been described above.
According to the relationship between the reflection generation position and the final center of gravity position G "shown in FIG. 8b, as shown in FIG. 8c, the length M'1 in the left-right direction at the upper part of the screen with respect to the change width of the final center of gravity position G" and the screen. The length M'2 in the left-right direction at the lower part of the can be made to have almost the same length.

よって、たとえば、ディスプレイ２に近接させた手を左から右にディスプレイ２の画面幅の75%以上動かすジェスチャをスワイプ動作として検出する場合、画面の上部と下部とで、ほぼ同じ移動量を超える手の移動に対してのみスワイプ動作を検出することができる。 Therefore, for example, when a gesture that moves a hand close to the display 2 from left to right by 75% or more of the screen width of the display 2 is detected as a swipe operation, a hand that exceeds almost the same amount of movement at the top and bottom of the screen. Swipe motion can be detected only for the movement of.

また、画面の下部における左右方向の反射位置の変化幅に対する最終重心位置G"の変化幅が、図７ｂに示した重心位置Gの場合に比べて小さいので、ディスプレイ２が左ハンドル車の自動車のダッシュボードの運転席と助手席の間の位置に配置されたものである場合に、ドライバが手でディスプレイ２の下方にあるエアコン等の走査パネルを操作するような動作を図８ｃのJ1のように行ったときに、これをスワイプ動作として誤認識してしまうことを排除できる。 Further, since the change width of the final center of gravity position G "with respect to the change width of the reflection position in the left-right direction at the lower part of the screen is smaller than that in the case of the center of gravity position G shown in FIG. When the vehicle is located between the driver's seat and the passenger seat on the dashboard, the driver manually operates the scanning panel such as the air conditioner below the display 2, as shown in J1 in FIG. 8c. It is possible to eliminate the misrecognition of this as a swipe operation when going to.

したがって、本実施形態によれば、ディスプレイ２の表示面に近接した手によるジェスチャを、より適正に検出することができる。
以上、本発明の実施形態について説明した。
ところで、以上の実施形態における図６の位置算定処理のステップ６１２ではピーク位置GCを、L1、L2、L3、L4のうちで最大のものと、２番目に大きいものとから求めたが、このようにすると２番目に大きいものと３番目に大きいものとが、ほぼ同じ大きさであったときに、正しいピークの位置をピーク位置GCとして求めることができない。 Therefore, according to the present embodiment, gestures by hand close to the display surface of the display 2 can be detected more appropriately.
The embodiment of the present invention has been described above.
By the way, in step 612 of the position calculation process of FIG. 6 in the above embodiment, the peak position GC is obtained from the largest one among L1, L2, L3, and L4 and the second largest one. Then, when the second largest one and the third largest one have almost the same size, the correct peak position cannot be obtained as the peak position GC.

そこで、ステップ６１２ではピーク位置GCを、次のように算出してもよい。
すなわち、L1、L2、L3、L4の最大値Lmaxを求め、Q=Lmax×S（0＜S＜1であり、Sはたとえば1/3）とする。そして、L1'＝L1-Q、L2'＝L2-Q、L3'＝L3-Q、L4'＝L4-Qとし
L1'＞0の場合はL1"=L1'、L1'≦0の場合はL1"=0、
L2'＞0の場合はL2"=L2'、L2'≦0の場合はL2"=0、
L3'＞0の場合はL3"=L3'、L3'≦0の場合はL3"=0、
L4'＞0の場合はL4"=L4'、L4'≦0の場合はL4"=0
として、
GC={(1×L1")+(2×L2")＋(3×L3")+(4×L4")}/(L1"+L2"+L3"+L4")
によりピーク位置GCを算出する。 Therefore, in step 612, the peak position GC may be calculated as follows.
That is, the maximum value Lmax of L1, L2, L3, and L4 is obtained, and Q = Lmax × S (0 <S <1, where S is, for example, 1/3). Then, L1'= L1-Q, L2'= L2-Q, L3'= L3-Q, L4'= L4-Q
L1 "= L1'when L1'> 0, L1" = 0 when L1'≤0,
L2 "= L2'when L2'> 0, L2" = 0 when L2'≤ 0,
L3 "= L3'when L3'> 0, L3" = 0 when L3'≤0,
L4 "= L4'when L4'> 0, L4" = 0 when L4'≤0
As,
GC = {(1 x L1 ") + (2 x L2") + (3 x L3 ") + (4 x L4")} / (L1 "+ L2" + L3 "+ L4")
Calculate the peak position GC by.

また、以上の実施形態における図６の位置算定処理のステップ６１６で最終重心位置G"の算定に用いたf7(G')は、図８ａに示した反射発生位置と補正後重心位置G'の関係を水平方向に非線形に伸張する関係としてもよい。 Further, f7 (G') used for calculating the final center of gravity position G "in step 616 of the position calculation process of FIG. 6 in the above embodiment is the reflection generation position and the corrected center of gravity position G'shown in FIG. 8a. The relationship may be a relationship that extends non-linearly in the horizontal direction.

すなわち、f7(G')として、図９ａに示す、補正後重心位置G'が中央値2.5に近いほど、補正後重心位置G'と中央値2.5との差よりも、当該補正後重心位置G'より算定される最終重心位置G"と中央値2.5との差が、より縮小する非線形な変換を行う関数を用いてもよい。このような関数を用いることにより、図９ｂに示すように画面の左右方向の中央に近いほど、左右方向の反射位置の変化幅に対する最終重心位置G"の変化幅が小さくなるように、補正後重心位置G'は最終重心位置G"に補正される。 That is, as f7 (G'), the closer the corrected center of gravity position G'is shown in FIG. 9a to the median value 2.5, the more the corrected center of gravity position G'is rather than the difference between the corrected center of gravity position G'and the median value 2.5. You may use a function that performs a non-linear transformation in which the difference between the'final center of gravity position G calculated from'and the median value 2.5 is further reduced. By using such a function, the screen is as shown in FIG. 9b. The corrected center-of-gravity position G'is corrected to the final center-of-gravity position G'so that the closer to the center of the left-right direction, the smaller the change width of the final center-of-gravity position G "with respect to the change width of the reflection position in the left-right direction.

このように最終重心位置G"を求めることにより、画面の下部の左右方向中央部分において左右方向の反射位置の変化幅に対する最終重心位置G"の変化幅をより小さくし、上述したドライバが手でディスプレイ２の下方にあるエアコン等の走査パネルを操作するような動作J1に対して、これをスワイプ動作として誤認識してしまうことを、より確実に排除できる。
または、以上の実施形態における図６の位置算定処理のステップ６１６、６１８を廃して、補正後重心位置G'を、そのまま検出位置としてデータ処理装置１に通知し、ステップ６０２からの処理に戻るようにしてもよい。
このようにしても、検出位置の変化幅に対する画面の上部における左右方向の長さと画面の下部における左右方向の長さを、ほぼ同様の長さとすることができる。 By obtaining the final center of gravity position G "in this way, the change width of the final center of gravity position G" with respect to the change width of the reflection position in the left-right direction in the central portion in the left-right direction at the bottom of the screen can be made smaller, and the above-mentioned driver can manually perform the change. It is possible to more reliably eliminate the erroneous recognition of the operation J1 such as operating the scanning panel of the air conditioner or the like below the display 2 as the swipe operation.
Alternatively, the steps 616 and 618 of the position calculation process of FIG. 6 in the above embodiment are abolished, the corrected center of gravity position G'is notified to the data processing device 1 as the detection position as it is, and the process returns from step 602. You may do it.
Even in this way, the length in the left-right direction at the upper part of the screen and the length in the left-right direction at the lower part of the screen with respect to the change width of the detection position can be set to substantially the same length.

また、以上の実施形態では、ＬＥＤ１、ＬＥＤ２、ＬＥＤ３、ＬＥＤ４の４つの赤外線ＬＥＤと、ＰＤ１、ＰＤ２の２つのフォトダイオードを用いたが、赤外線ＬＥＤの数は４以外の数であって良く、フォトダイオードの数は２以外の数であって良い。 Further, in the above embodiment, four infrared LEDs of LED1, LED2, LED3, and LED4 and two photodiodes of PD1 and PD2 are used, but the number of infrared LEDs may be a number other than 4, and the photo The number of diodes may be a number other than 2.

ただし、この場合には、たとえば、複数の赤外線ＬＥＤと複数のフォトダイオードの並びの一方の端を第１端、第１端と反対側の端を第２端として、第１端に近い赤外線ＬＥＤを点灯したときの、当該赤外線ＬＥＤの強度信号を検出するフォトダイオードよりも第２端に近いフォトダイオードで検出した強度信号と、第２端に近い赤外線ＬＥＤを点灯したときの、当該赤外線ＬＥＤの強度信号を検出するフォトダイオードよりも第１端に近いフォトダイオードで検出した強度信号を、上述した強度信号E1、E2に代えて用いるようにする。 However, in this case, for example, one end of a row of a plurality of infrared LEDs and a plurality of photodiodes is set as the first end, and the end opposite to the first end is set as the second end, and the infrared LED close to the first end. The intensity signal detected by the photodiode closer to the second end than the photodiode that detects the intensity signal of the infrared LED when lit, and the intensity signal of the infrared LED when the infrared LED closer to the second end is lit. The intensity signal detected by the photodiode closer to the first end than the photodiode that detects the intensity signal is used instead of the above-mentioned intensity signals E1 and E2.

１…データ処理装置、２…ディスプレイ、３…近接位置検出装置、４…周辺装置、１０…ディスプレイユニット、３１…近接検出センサ、３２…近接検出コントローラ、３２１…駆動部、３２２…検出部、３２３…検出制御部、３２２１…信号処理部、３２２２…アナログデジタル変換器、３２２３…マルチプレクサ。 1 ... Data processing device, 2 ... Display, 3 ... Proximity position detection device, 4 ... Peripheral device, 10 ... Display unit, 31 ... Proximity detection sensor, 32 ... Proximity detection controller, 321 ... Drive unit, 322 ... Detection unit, 323 ... Detection control unit, 3221 ... Signal processing unit, 3222 ... Analog-to-digital converter, 3223 ... multiplexer.

Claims

A proximity position detector that detects the horizontal position of the hand close to the display surface of the display.
A plurality of infrared light sources that emit infrared light that passes in front of the display surface and are arranged side by side along the first side that is one horizontal side of the display surface on the outside of the display surface of the display.
A plurality of photodetectors arranged side by side along the first side on the outside of the display surface, and
It has a proximity position calculation unit and
The proximity position calculation unit
For each of the plurality of infrared light sources, the intensity of the reflected light of the infrared light emitted by the infrared light source detected by the light detector associated with the infrared light source according to a predetermined correspondence is determined. As the first detected reflection intensity of the emitted light of the infrared light source, the horizontal position corresponding to the center of gravity of the horizontal distribution of the reflected light estimated from the first detected reflection intensity of the emitted light of each infrared light source is set. The center of gravity position calculation unit that calculates the position of the center of gravity,
One or a plurality of infrared light sources among the plurality of infrared light sources are set as target infrared light sources, and each target infrared light source is associated with the infrared light source which is the target infrared light source according to the above correspondence. The intensity of the reflected light of the infrared light emitted by the target infrared light source detected by the light detector farther from the target infrared light source than the light detector is the intensity of the emitted light of the target infrared light source. As the second detected reflection intensity of, the position index calculation unit that calculates the position index indicating the degree of the magnitude of each second detected reflection intensity, and
A peak position calculation unit that calculates the horizontal position where the peak of the reflected light appears, which is estimated from the first detected reflection intensity of the emitted light of each infrared light source, as the peak position.
The corrected center of gravity position calculation unit calculates the position where the center of gravity position is corrected so that the larger the position index is, the closer to the value of the peak position is the corrected center of gravity position.
A proximity position detection device comprising a detection position calculation unit that calculates a detection position representing a horizontal position of a hand close to a display surface of a display by using the corrected center of gravity position.

The proximity position detection device according to claim 1.
The detection position calculation unit is calculated by the corrected center of gravity position calculation unit, with the value of the corrected center of gravity position when the corrected center of gravity position represents the center position in the left-right direction of the display surface as the center value. A proximity position detecting device having a value obtained by correcting the corrected value of the center of gravity position so that the difference between the value and the center value is reduced by a predetermined ratio.

The proximity position detection device according to claim 1.
The detection position calculation unit is calculated by the corrected center of gravity position calculation unit, with the value of the corrected center of gravity position when the corrected center of gravity position represents the center position in the left-right direction of the display surface as the center value. The value of the corrected center of gravity is calculated so that the difference between the value and the center value is smaller, the difference between the value and the center value is smaller. A featured proximity position detector.

The proximity position detecting device according to claim 1, 2 or 3.
Let i be the order in which the infrared light source is arranged along the first side, let Xi be a value that increases as i becomes larger, and let Li be the first detected reflection intensity of the emitted light of the i-th infrared light source. ,
The center of gravity position calculation unit is a proximity detection device characterized in that Σ (Li × Xi) / Σ (Li) is calculated as the center of gravity position.

The proximity position detecting device according to claim 1, 2 or 3.
Let i be the order in which the infrared light source is arranged along the first side, Li be the first detected reflection intensity of the emitted light of the i-th infrared light source, and let Li be the emitted light of the j-th target infrared light source. The second detected reflection intensity of is Ej,
The proximity detection device is characterized in that the position index calculation unit calculates A / B as the position index, where A is the sum of Ej or the maximum value of Ej, B is the sum of Li or the maximum value of Li. ..

The proximity position detecting device according to claim 1, 2 or 3.
Let i be the order in which the infrared light source is arranged along the first side, Li be the first detected reflection intensity of the emitted light of the i-th infrared light source, and let Xi be a value that increases as i increases. , Ki as a value that becomes 1 when Li is the maximum or the second largest of the first detected reflection intensities and becomes 0 at other times.
The peak position calculation unit
Σ (Xi × ki) / Σ (Li × ki)
A proximity detection device, characterized in that the peak position is calculated by the above method.

The proximity position detecting device according to claim 1, 2 or 3.
Let i be the order in which the infrared light source is arranged along the first side, Li be the first detected reflection intensity of the emitted light of the i-th infrared light source, and let Xi be a value that increases as i increases. ,
In the peak position calculation unit, the maximum value of Li is Lmax, Q = Lmax × S (0 <S <1), Li'= Li-Q, and when Li'> 0, Li "= Li', If Li'≤ 0, set Li "= 0 and set
GC = Σ (Li "× Xi) / Σ (Li")
Proximity detection device characterized by calculating the peak position GC by.

The proximity position detection device according to claim 4.
Let Ej be the second detected reflection intensity of the emitted light of the j-th target infrared light source.
The position index calculation unit calculates A / B as the position index, where A is the sum of Ej or the maximum value of Ej, B is the sum of Li or the maximum value of Li, and the position index is calculated.
Ki is set as a value that becomes 1 when Li is the maximum or the second largest of the first detected reflection intensities and becomes 0 at other times.
The peak position calculation unit
Σ (Xi × ki) / Σ (Li × ki)
A proximity detection device, characterized in that the peak position is calculated by the above method.

The proximity position detection device according to claim 4.
Let Ej be the second detected reflection intensity of the emitted light of the j-th target infrared light source.
The position index calculation unit calculates A / B as the position index, where A is the sum of Ej or the maximum value of Ej, B is the sum of Li or the maximum value of Li, and the position index is calculated.
In the peak position calculation unit, the maximum value of Li is Lmax, Q = Lmax × S (0 <S <1), Li'= Li-Q, and when Li'> 0, Li "= Li', If Li'≤ 0, set Li "= 0 and set
GC = Σ (Li "× Xi) / Σ (Li")
Proximity detection device characterized by calculating the peak position GC by.

A display unit comprising the proximity position detecting device according to claim 1, 2, 3, 4, 5, 6, 7, 8 or 9, and the display integrated with the proximity position detecting device.

The proximity position detection device according to claim 1, 2, 3, 4, 5, 6, 7, 8 or 9, the display, and a data processing device that uses the display for display output are provided.
The proximity position detection device notifies the data processing device of the detection position, and the proximity position detection device notifies the data processing device.
The data processing device is an information processing system characterized in that it recognizes a gesture by a hand close to the display surface of the display based on the transition of the notified detection position and performs processing according to the recognized gesture.