JP2004240634A - Coordinate input device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To enhance operability in a coordinate input device for detecting spatial coordinates and outputting relative coordinates. <P>SOLUTION: The spatial coordinates are detected by the coordinate input device and a coordinate processing method. The device includes a means for performing a processing to correct the difference coordinate value of at least one axis through the use of the difference coordinate value of at least one axis concerning a prescribed value and a detected coordinate value and also the difference coordinate value of at least another axis, and then, outputting the processed difference coordinate value. <P>COPYRIGHT: (C)2004,JPO&NCIPI

Description

よって求めるべき任意の音波発生源４３と検出センサ３間の距離Ｌは
Ｌ＝Ｖ×ｔ＝Ｖ×（ｔ＊−ｔ_ｉｎｉ＊）＋Ｌ_ｉｎｉ （８）
【００３８】
上記、既知の距離Ｌ_ｉｎｉ、及びその距離における時間計測値ｔ_ｉｎｉ ^＊（群遅延時間Ｔｇ_ｉｎｉ ^＊、もしくは位相遅延時間Ｔｐ_ｉｎｉ ^＊の両者）を、出荷時等に不揮発性メモリ等に記憶することによって、任意の距離における音波発生源４３と検出センサ３間の距離を精度良く算出することが可能となる。
【００３９】
さて今、図６の様な座標系に検出センサ３＿Ｓａ〜３＿Ｓｄが配置された時、音波発生源４３の位置座標（ｘ、ｙ、ｚ）を求める方法について説明する。上記の方法により正確に求められた振動発生源４３と各検出センサ３までの距離を各々Ｌａ〜Ｌｄ、Ｘ方向の検出センサ間距離をＸｓ−ｓ、Ｙ方向の検出センサ間距離をＹｓ−ｓとすれば、
【００４０】

【００４１】
同様にして

【００４２】
以上示したように少なくとも３個の振動発生源４３と検出センサ３までの距離が測定できれば、容易に音波発生源４３の位置座標を求めることが可能となる。本願発明の実施例では、検出センサを４個用いており、例えば、距離が最も遠い情報を使わず（この場合、検出センサ３で出力される信号は、距離が遠いために信号レベルが最も小さくなっている）、残り３個の距離情報のみで、座標を算出することで、信頼性の高い座標算出を可能としている。また、この距離が遠いセンサの情報を活用することで、出力された座標値の信頼性が高いものか判定することも可能である。具体的方法としては、例えば、距離情報Ｌａ、Ｌｂ、Ｌｃで算出された座標値と、距離情報Ｌｂ、Ｌｃ、Ｌｄで算出された座標値は同一の値を出力するはずであり（距離情報の組み合わせを変更して演算する）、両者が一致しない場合には、いずれかの距離情報が不正、つまり誤検出したことになるので、その場合には、座標値を出力しない、と言った信頼性を向上させる構成も実施可能となる。
【００４３】
次に本座標入力装置の動作モードについて説明する。再び図２を用いて説明すれば、指示具であるところの座標入力ペン４は、ペン先ＳＷ４１、及び２個のペンサイドＳＷ４２＿ａ、４２＿ｂを具備してなり、各ＳＷ（スイッチ）の動作モードについて表１、図７を用いて説明を加える。
【００４４】
操作者が、座標入力ペン４を握って座標入力面を押圧することで、ペン先ＳＷ４１が動作する（ステップＳ４０２）。この時、所定周期で駆動回路４５により音波発生源４３が動作し、所定周期で音波が空中に放射されるように動作する（ペンダウン状態、Ｓ４０６）。この時検出された座標値が、表示領域内の座標値（図６においてｘ＜±Ｄｉｓｐ＿Ｘ、ｙ＜±Ｄｉｓｐ＿Ｙの範囲）であれば、通常の紙と鉛筆の様な関係で、指示具４の移動に伴なう軌跡が、表示画面上に出力される事になる。一方、ペン先ＳＷ４１が動作しているのに、検出された座標値が表示領域外である時には、例えば操作者の手によって無意識のうちにペン先ＳＷが動作してしまっている状態が想定されるので、この場合には、座標出力を禁止するように構成されている。同様にペン先ＳＷが動作している状態は、指示具により座標入力面である表示面を押圧する状態であるから、この時検出されるＺ軸座標値は、ほぼ『０』であるはずであり、『０』とならない場合には、やはり操作者による誤操作が想定されるので、この場合も座標出力を禁止するように構成する。
【００４５】
一方、ペン先ＳＷ４１がオフ状態の場合は、操作者により座標入力面を押圧する事で筆記動作している状態にはなっていない。しかしながら、座標入力面近傍、或いは座標入力面であるところの表示ディスプレイから離れた位置で、さらにはディスプレイの表示領域の外側で、例えば表示されているカーソルを移動したり、アイコンをダブルクリック等して、所望の画面操作ができることは非常に利点が大きいい。そのため、ペンサイドＳＷ４２のどちらか一方を押圧する（ステップＳ４０３〜ステップＳ４０５）ことで、音波が空中に放射されるように動作し、カーソルの移動等を可能にする（ペンアップ状態、ステップＳ４０７）。また、ペンサイドＳＷ４３の両方を押圧する（ステップＳ４０３〜ステップＳ４０５）ことで、ペン先ＳＷ４１が動作していなくても、ペンダウン状態となるように構成している（ステップＳ４０６）。このペンアップ／ペンダウンを判別する方法としては、前述したスタートタイミング信号（本実施例の場合、スタートタイミング信号を座標入力ペンに内蔵されたＬＥＤ等により光信号として放射する手段を有する）に重畳させて、制御信号検出回路２１１で検波する事により、演算制御回路１のその情報を検出力しても良い。さらには、状態に応じて、例えば放射する音波の周波数を変更し、それを検波することで、モードを判定することも可能である。
【００４６】
一方、図２に示すように、ペンサイドＳＷ４２＿ａと４２＿ｂの両者は、座標入力ペンの断面方向において、約９０度方向に配置され、操作者が握ったときに、右利き、左利き関係なく、その一方に親指が、その他方に人差し指が自然に触れるような位置に設定される。そのようにスイッチを配置することと、どちらか一方のみのＳＷがＯＮすることによって設定される同一の動作モード（本願実施例の場合、ペンアップ状態）と、両者がともにＯＮされる状態のみで動作する動作モード（同様にペンダウン状態）を設定することで、利き腕に関係なく、使い勝手の良い座標入力ペン４を構成している。
【００４７】
このペンサイドＳＷの他の実施例としては、１つのスイッチで２段階の切り替えをするスイッチも有効である。つまり、軽押圧の場合に１段目のスイッチが動作し（ペンアップ状態）、さらに押圧することで２段目のスイッチが動作（ペンダウン状態）する構成であって、この場合も同一のペンで、利き腕に関係なく、使い勝手の良い座標入力ペン４を実現することが可能となる。
【００４８】
さて、ペンサイドＳＷを動作させることで、ディスプレイ６の表示面から離れた位置で座標を入力し、カーソルを移動（ペンアップ状態）したり、あるいは筆記（ペンダウン状態）できる方法について説明したが、この様な場合（直接ディスプレイ６の表面に接触はしていない、ペン先ＳＷ４１が動作していない状態）において、ディスプレイ６の表示面上、あるいは表示面の近傍（表示面の近くの空中にあって、ペン先ＳＷが動作していない状態）で動作させる場合と、表示面から離れた位置、或いは表示領域の外側で座標入力動作をさせる場合とでは操作上、要求される仕様が異なる。
【００４９】
まず、前者の場合、座標入力ペン４を移動することで、例えば表示されているカーソルを直感的に、しかもダイレクトに所望の位置に正確に移動することが要求される。しかし後者の場合においては、例えば表示されているカーソルを所望の位置に移動させるためには、座標入力ペンの移動に応じて、カーソルを相対的に移動させることが要求される。つまり操作者が、大型のディスプレイを使ってプレゼンをしようとする場合、直接画面をタッチ（座標入力）することで、表示情報を制御したり、情報（文字、図形）等を筆記することができる（紙と鉛筆の関係）手段であるとともに、単に情報を指し示す場合に有っては、操作者がその場に行って指し示すのではなく、離れた場所、言い換えれば聞き手側からみて表示されている情報が操作者によって隠されることが無い状態で、所望の画面制御や情報の追加ができるのが好ましい。さらには、この種の大型の入出力一体のシステムを考慮して大勢の参加者を想定した打ち合わせ考えれば、上述したような操作者が直接画面をタッチしたりすることでパソコンを制御するばかりでなく、例えば画面を見ながら発表内容を聞いている会議参加者が、質問、或いは反論のための証拠資料を開示できるように、画面から離れた位置においても、画面を操作したり、必要に応じてネットワークより情報を引き出せるような構成になるのが好ましい形態であると言える。
【００５０】
本願発明は、この点を鑑みなされたものであり、本願発明の座標入力装置は、検出された座標値（ｘ、ｙ、ｚ）を基に、その座標値をどのような形態で出力するかを判定する手段を有する。さらには、前述検出された座標値（ｘ、ｙ、ｚ）の情報と、指示具４のスイッチ状態の情報を組み合わせて、座標出力の形態、あるいは出力制御を行うように構成する。
【００５１】
さらには、検出された座標値（Ｘｓａｍｐ，Ｙｓａｍｐ，Ｚｓａｍｐ）と所定の座標値を比較して、所定値のとの移動量（差分値）を出力する形態に有っては、少なくとも１軸の値を他の１軸の値を補正する補正情報として用い、得られた空間（３次元）座標を平面（２次元）座標▲２▼変換して出力する様に構成する。
【００５２】
具体的に図８を用いて説明すれば、ステップＳ５０１にて処理を開始することになるが、ステップＳ５０２で座標演算に必要な信号が各検出センサ３、もしくは、スタート信号を受信したかを判定して、有効と判定した場合には、ステップＳ５０３で座標入力ペン４の位置座標（ｘ、ｙ、ｚ）を導出する。次に、演算された位置座標（ｘ、ｙ、ｚ）を基に、まずＺ軸の値が０、つまり指示具４が座標入力面上に位置して、座標入力が行われたのかを判定する（ステップＳ５０４）。仮にＺ＝０ならばステップＳ５０５にて検出された（ｘ、ｙ）座標が表示領域の領域内にあるかを判定し、領域内に有れば、検出された座標値（ｘ、ｙ）を確定値として外部機器等に出力する（ステップＳ５０８）。また検出された座標値（ｘ、ｙ）が表示領域の領域外にあると判定された時には、何らかの誤操作によって座標入力が行われたものとして、検出した座標値の出力を中止して処理を修了する。図８のフローチャートには直接は示さないが、例えば指示具４のペン先ＳＷ４１の情報をスタート信号である光信号に重畳させ、制御信号検出回路２１１で制御信号として復調すれば、このペン先ＳＷ４１の情報を用いて、座標算出の信頼性を増すことも可能である。つまりペン先スイッチが動作した状態は、座標入力面であるところの表示領域を押圧してスイッチが動作するのが通常であり、ペン先ＳＷ４１が動作しているにも関わらず、Ｚ軸の検出値がＺ＝０とならない場合には、やはり何らかの誤操作によって座標入力が行われたものとして、検出した座標値の出力を中止することが可能となり、誤動作防止と言う観点で、より信頼性の高い構成が得られるようになる（表１参照）。
【００５３】
【表１】

【００５４】
一方、検出された座標値がＺ＝０でない場合には、ステップＳ５０６にてあらかじめ設定された所定値１と比較され、所定値１よりＺ軸の値が小さい場合（この場合、指示具４は座標入力面であるところの表示面近傍、あるいは比較的近い位置に位置していると判断できる）、ステップＳ５０７で検出された座標値（ｘ、ｙ）が表示領域の領域内にあるかを判定し、領域内あるときはステップＳ５０８にて検出された座標値（ｘ、ｙ）をそのまま出力する。この状態は、操作者が比較的表示面に近いところで指示具を操作している状態で、指示具の４の移動動作に伴ない、カーソルを移動したり、文字、図形等の情報を追記したりして、表示情報を制御している状態となる。
【００５５】
一方ステップＳ５０７にて表示領域内に無いと判定した場合は、操作者は表示面近傍かつ表示領域の脇ににあって、聞き手に対して表示情報をさえぎることなく、表示内容を制御しながらプレゼンテーションしている状態を想定でき、指示具４の動作によりカーソルを相対的に移動できるように構成する。この相対的にカーソルを移動する方法について説明を続ければ、操作者は比較的表示機に近い位置にあって、しかも表示機の脇に位置していると判断されたので、検出された座標値のｘ軸、ｙ軸、ｚ軸の値を所定の座標値（Ｘ１ｓｔ，Ｙ１ｓｔ，Ｚ１ｓｔ）として記憶し（ステップＳ５０９）、ステップＳ５１０にて座標が連続的に入力されているかを判定する。この『連続的に入力されているか』という定義は、この種の座標入力装置は例えば座標出力を５０回／秒（座標サンプリングレート）行えるものとすれば、０．０２ｍｓｅｃ毎に座標出力が行われるのであって、この周期を計測することで、連続的に座標入力が行われているかを判定することができる。本願発明の座標入力装置に有っては、例えば制御信号検出回路２１１のスタート信号（図４参照）の発生タイミングを監視（この場合、サンプリングレートを５０回／秒とすれば、０．０２秒毎にスタート信号が発生する）しても良いし、直接超音波信号（例えば図３における信号１０２）の到達間隔（この場合は、指示具４の移動を伴って指示具４とセンサ３の距離が絶えず変化するので、サンプリングレートに基づく時間（サンプリングレートを５０回／秒とすれば０．０２秒）に距離変化に伴なう音波の伝達時間の差が増減される。従って『約０．０２秒程度』の周期（理論的には０〜０．０４秒の範囲内に必ず信号が受信される）と言う表現になり、実用上０．０２秒以内におけるペンの最大移動量を鑑み、例えば０．０３秒以内に信号が受信できたときには連続して座標入力が行われていると判定する）を監視することで実現する。ステップＳ５１０で連続的に座標検知が行われていると判定した場合には、ステップＳ５１１にて位置座標（ｘ，ｙ、ｚ）を算出する。
【００５６】
さてここで、操作者が表示機の脇にて指示具４を用いて画面を操作する場合について考えてみる。
【００５７】
図１０を用いて説明すれば、操作者は座標入力面である表示機の近傍にあって、しかも表示領域の外側にて指示具４を操作している状態にあって、指示具４の移動方向と移動距離に応じて、カーソルがその分移動するためには、操作者が想定した仮想の座標入力面（あたかも操作者がその空間内に操作平面を想定して、指示具４をその平面内で移動させている）が、図１０（Ａ）の様に、表示面と平行（言い換えれば、座標入力装置のＸＹ平面と操作者が想定した仮想の座標入力面が平行）となっている事が必要である。図１０（Ｂ）の様に仮想の入力面が平行にない時には、Ｘ軸方向の移動量が、指示具４の移動量に比べ小さくなる（操作者の仮想平面でのＸ軸方向移動量Ｘ′と表示面上でのカーソルのＸ軸方向移動量Ｘ^＊は、Ｘ^＊＝Ｘ′ｓｉｎΘの関係にある。操作者が表示面近傍の脇において、表示情報を制御しようとする場合には、表示面を見ながら操作するのであって、仮想の入力面を想定する場合には、図１０（Ａ）の状態よりも、図１０（Ｂ）の状態を想定するの一般的であり、操作性にも優れる。そこで本願発明では、操作者が表示面近傍の脇に位置していると判断された時は、表示面の水平方向であるＸ軸方向の差分値とＺ軸方向の差分値の平方和を表示機上での例えばカーソルの移動量として割り当てる。この様にする事で、操作者が想定した仮想の入力面が、座標入力装置のＸＹ平面と平行でなくても、操作者の指示具４の移動量とその方向に応じて、より忠実にカーソルがその動きを再現できるように構成したものである。
【００５８】
再び図８に戻って、前述記憶した所定の座標値（Ｘ１ｓｔ，Ｙ１ｓｔ，Ｚ１ｓｔ）と検出した座標値（ｘ、ｙ、ｚ）より、表示機の水平方向であるｘ軸方向の差分値をまず計算し（ステップＳ５１２）、差分値の正負を判定する（ステップＳ５１３）。その後、指示具４のＸ軸方向の差分値、及びＺ軸方向の差分値の平方和（＝ＳＱＲ［（Ｘ−Ｘ１ｓｔ）^２＋（Ｚ−Ｚ１ｓｔ）^２］：ＳＱＲは平方根）を演算し、所定値に対するＸ軸方向の移動量として決定する。この際、先に求めたステップＳ５１３における符号により、移動量の方向としての符号を決定する（ステップＳ５１４、ステップＳ５１５）。
【００５９】
その後ふたたびステップＳ５１０に戻って、連続入力中かを判定し、連続入力が終了すると、動作を終了する。
【００６０】
さてステップＳ５０６にてステップＳ５０３で検出された座標値（ｘ、ｙ、ｚ）のＺ軸の値があらかじめ設定された所定値１より大きい場合について考えてみる。この状態は指示具４が座標入力面であるところの表示面からＺ軸方向に離れた位置にあることを意味、つまりプレゼンテーションを行っている操作者が、表示機よりかなり離れた位置にいるか、もしくはプレゼンテーションを聞いている聞き手によって座標入力が行われたものと想定できる。つまり、遠隔操作によって、表示情報を制御したり、文字、図形等の追記を行おうとしている状態であると言える。
【００６１】
この画面から離れた状態について考察してみると、操作者が所望の位置と思われる位置で座標入力を行い、その所望の位置に例えばカーソルを移動しようとする場合、表示機との距離が大きくなる（Ｚの値が大きくなる）につれての所望の位置との位置ずれは大きくなり、直感的にダイレクトに所望の位置を指し示す事ができなくなる。つまり離れた位置でカーソルを移動しようとする場合、所望の位置を指し示したと思って指示具４のペンサイドＳＷを動作させて座標を入力する事になるが、得られた座標値に基づくカーソルの位置は、前述の所望の位置とは異なり、カーソルの位置を視認しながら、操作者が指示具を移動させることによって、所望の位置へカーソルを移動すると言う目的を実現することになる。
【００６２】
言い換えれば、遠隔入力（表示装置から離れた位置で座標を入力し、例えばカーソルを移動させる動作）の場合は、操作者による視覚情報に基づき操作者の脳が補正動作を行う（指示具４を移動させる）ループを繰り返して、目的を達成することになるのであって、ダイレクトに所望の位置を指し示すことは困難なのである。
【００６３】
この様に、表示装置等に表示されている画像情報（ＸＹ平面上に座標系を有する画像情報）に対して、何らかの遠隔入力操作を行おうとする場合、操作者が一連の座標入力を行おうとする際の最初の１点目の座標値と前述の画像情報の座標値は、一致させることができない。このことは、例えばＯＨＰ等により表示されている表示画像を指示する道具としてレーザポインタが普及しているが、やはりレーザ発光時の最初の１点目は、どこを指示するか解らず、指示されたポイント位置を見ながら、位置修正動作をして所望の位置にレーザを照射することができる様になることを考えれば明らかである。
【００６４】
そこで本願発明では、ステップＳ５０６にてｚ軸の値が所定値以上である場合（遠隔入力）には、ステップＳ５０９以降の、先ほど述べた相対座標を出力するルーチンに移動する。操作者が表示機の脇に有って、操作性を追及するにはΘ（図１０参照）を考慮する必要性が有ることは前述したが、この遠隔操作の場合であっても、やはりΘの影響を考慮する事は重要である。おそらく、操作者が画面正面の離れた位置にあるときは、操作者の想定する仮想入力面と、座標入力装置のＸＹ軸は、ほぼ一致することになるが、正面の位置からずれる事によって、操作者の仮想入力面は傾く事が容易に想像される。従って、Ｚ軸の差分値を基に表示機のＸ軸方向の値を修正する事は、この場合であっても有効な方法となりえる。
【００６５】
この様に構成する事で、操作者の使用場面に応じて、検出した座標値に基づき座標出力形態を自動的に決定し、操作者にとって使い勝手の良い操作環境を提供する事ができるようになった。
【００６６】
なお、出力される座標値が絶対座標（ｘ、ｙ）であるか、或いは（Δｘ，Δｙ）であるのかを区別するために、別途、その情報を確定座標値と共に出力する構成であってもかまわない。また本願発明の実施例として、超音波を利用した座標入力装置を採用したが、空間座標検出可能な座標入力装置であればその実施は可能である事は言うまでもない。
【００６７】
さて、直接画面をタッチする事でダイレクトに座標を入力する場合には、大型表示機であることを考慮すれば、画面の端から端までカーソルを移動しようとすると、必ず体の移動を伴なう。しかしながら遠隔操作の場合には、例えば質問者が起立をしてその場で質問するのが通常（大勢の聞き手がいる場合は、必然的に移動は困難）であり、体を移動せずその場において全領域を指し示す事ができることが望まれる。本願構成は、この点についても解決するものであり、図９（Ａ）を用いて説明すれば、相対座標出力範囲において、大勢の聞き手に対して、大画面を有するディスプレイを用いて操作者がプレゼンテーションをしようとしている場面を想定する。カーソルの位置を図面上▲１▼の位置から▲３▼の位置へ移動しようとした場合、従来では座標指示具であるところのペンを▲３▼の位置に持っていって、その位置で座標入力を行えば、カーソルは▲１▼の位置から▲３▼の位置に移動することになる（この場合、操作者は▲３▼の位置を指す事ができる位置にいる）。しかしながら、▲１▼の位置で作業した後（操作者は▲１▼の位置近傍にいる）、▲３▼の位置へ移動しようとする場合には、画面を横断するように操作者が移動するので、多くの聞き手にとっては情報を遮られ、プレゼンの内容理解に支障をきたす。特に大型表示装置がフロントプロジェクション、ＯＨＰ（投射型の表示装置）等の場合には、その画像が大きく歪むのでなお更である。それに対し操作者が表示装置の脇にあって、カーソルが▲１▼の位置にあったと仮定する。操作者がＡに位置指示具４を配置し、ペンサイドＳＷ４２の少なくともどちらか一方を動作させることで、指示具４からは音波が放射され、指示具４の位置座標を検出することになる。この時、指示具４は表示画面の表示領域外、或いは表示機より離れた位置（Ｚ＞所定値１）にあるので、最初に検出された位置座標は記憶され（図８ステップＳ５０９）、カーソルは▲１▼の位置から移動することはない。引き続き、操作者がペンサイドＳＷ４２を動作させて、連続的に座標を検出するように動作させ、指示具４をＢの位置に移動させた後、ペンサイドＳＷ４２の動作をＯＦＦさせたとする。そうすると、操作者の指示具４の移動動作（地点ＡからＢへの移動）にともない、その移動方向と移動距離応じた量だけ、カーソルが▲１▼の位置から▲２▼の位置へ移動することになる。さらに操作者は、指示具４をＢの位置からＣの位置へ、ペンサイドＳＷ４２をＯＦＦ状態で移動させた後（この時カーソルは▲２▼の位置で動かない）、ペンサイドＳＷ４２の少なくともどちらか一方を動作させて指示具４をＤの位置へ移動すれば、ペンサイドＳＷ４２が動作して最初に検出された座標値がステップＳ５１０にて再度記憶され、その後に検出された座標値と記憶された座標値の差分量だけカーソルが移動して、操作者の指示具４の移動動作（地点ＣからＤへの移動）にともない、その移動方向と移動距離応じた量だけ、カーソルが▲２▼の位置から▲３▼の位置へ移動することになる。本願発明は、このような使用用途に対し、カーソルのＸ方向の移動量を、操作者が想定した仮想入力面の移動量として定義し、Ｘ方向の差分量とＺ軸方向の差分量の平方和、及び方向（正方向か負方向かを判定する）を検出して、指示具４の移動量を表示機に表示されている例えばカーソルの移動量として変換している。
【００６８】
以上説明したように、操作者は入力面であるところの表示面から離れた位置、或いは表示機から離れた位置に有っても、現状のカーソルの位置から、スムーズに所望の位置にカーソルを移動することが可能となるばかりでなく、遠隔操作等による操作者が想定した仮想入力面を指示具４を移動させる事で、文字や図形を入力したりすることができる優れた効果が得られる。つまり文字を入力しようとする場合、図１０（Ｂ）を用いて説明すれば、所望の位置へまずカーソルを移動し（ペンサイドＳＷのどちらか一方を動作させる▲１▼→▲２▼：ペンアップ）、その後ペンサイドＳＷの両者を動作させてペンダウン状態として、指示具４の移動動作に伴い、その移動方向と移動量に応じた軌跡が画面上に残る（▲２▼→▲３▼）。その後一方のペンサイドＳＷをＯＦＦして（残りの一方はまだ動作中であり、連続的に座標が算出されている状態は維持されている；ペンアップ状態）所望の位置へカーソルを移動し（▲３▼→▲４▼）、ＯＦＦしたペンサイドＳＷを再び動作させることで、カーソルが移動した地点から再び軌跡が入力されることになるのである（▲４▼→▲５▼）。操作者は、カーソルを視認ながら指示具の移動動作により最初の▲２▼の位置まではカーソルを移動する必要があるが、その後の『い』と言う文字の筆記には、カーソルを視認しなくても指示具４の絶対的な移動量、つまり直感的な手、腕の操作で文字入力が行えるのである。つまり、連続入力期間中の最初の有効な座標値を基準とすることで、その連続期間中に出力される座標は相対的になるが、操作者からみれば、その期間中はカーソルの移動量と手、腕の動作が対応しており、あたかも空間に座標入力面があるが如く、直感的な入力動作で文字入力動作を実現することができる優れた効果を有する。
【００６９】
以上説明した様に、操作者は自然な動作によって表示情報を制御したり、文字、図形等の情報を追記することが可能であり、また多くの聞き手にとっては、表示情報が遮られること無く、操作者である話し手の意図する内容を効率良く理解することが可能となるのである。さらには本願発明は、大画面を有するシステムの使い勝手を考慮し、絶対座標を出力するモードと相対座標を出力するモードが算出される座標値によって自動的に切り替わるので、操作者にとって特別な動作（例えば、座標入力装置の出力モードをスイッチ手段等により切り替える）を必要とせず、プレゼンテーションに集中できるという優れた操作環境を提供することが可能となる。
【００７０】
また本願発明は、相対座標を出力する状態にあって、検出した座標値との差分を得るための所定の座標値（Ｘ１ｓｔ，Ｙ１ｓｔ，Ｚ１ｓｔ）を、連続入力期間中に最初に有効となる座標値と定義している。この理由を詳述すれば、操作者にとって表示領域近傍においては表示領域の境界を認識するのは容易であるが、表示領域から離れるに従ってこの認識はあいまいなものになる。さらにはＺ軸方向の所定値１の値は、操作者が設定可能な数値であってかまわないが、その数値を認識していたとしても、実際の境界を区別するのは困難に近い。一方最初に座標を入力する事によって、操作者が絶対座標の形態で出力が行われているのか、相対座標の形態で出力が行われているのかを認識するのは、例えば指示具４の位置とカーソル位置の関係で容易に理解できる。しかしながら、例えば出力形態が変更となる境界付近で動作させた場合、モードの切替動作が多発すると、出力形態の変更が多発し、操作者にとって扱い難い仕様となってしまう。そこで本願発明では、指示具４から放射されるスタート信号の周期を監視して、連続的に座標入力が行われているのかを判定し、連続入力期間に最初に有効となった座標値を基準座標値とし、連続入力期間中、それ以降に算出された座標値と基準座標値との差分を出力する様に構成したので、ペンサイドＳＷ４２のいずれかが（もしくはペン先ＳＷ４１）動作している限りは、この基準座標が保持され、たとえ切替領域の近傍での座標入力動作であっても、少なくとも相対座標入力から絶対座標入力へ、座標系が変化する事はなく、操作性の良い座標入力装置を構成する事ができる優れた利点を有する（図８の実施例からは、絶対座標から相対座標へ変化する場合があるが、この場合も、ステップＳ５０８に連続入力を監視する工程を設ければ、連続入力期間中、絶対座標に固定する事は可能となる）。
【００７１】
本願実施例では絶対座標で出力するか相対座標で出力するかを得られた絶対座標値に基づき決定しているので、そのモードを固定するために連続入力期間を監視し、所定値をその期間内に最初に有効となる点としているが、本願発明はこの部分に限定されるものでなく、相対座標を出力する座標入力装置、あるいは検出した座標値に基づきその座標値を処理する方法であって、少なくとも１軸の差分値とその他の１軸、或いはその他の２軸の差分値の平方和を導出して、その値を前述少なくとも１軸の差分値として出力する形態を有する事を特徴としている。従って、その所定値は直前に検出された座標値との差分値であっても良い事は言うまでもない。
【００７２】
【発明の効果】
以上説明したように、主に表示装置に重ねて配置した座標入力装置の座標処理方法であって、座標入力ペンの位置座標（ｘ、ｙ、ｚ）データに基づき、（ｘ、ｙ）平面を有する表示機に対して、検出されたｚ軸の座標値により、表示機の水平方向であるＸ軸座標値を補正する事で、操作者の指示具の移動動作を忠実に表示機の例えばカーソルの移動として再現できるように構成したので、座標入力面から離れた位置での座標入力動作であっても、操作性に優れる操作環境を実現する優れた効果が得られるようになった。
【図面の簡単な説明】
【図１】概略構成図
【図２】座標入力ペン４のブロック図
【図３】信号処理のタイミングチャート
【図４】信号処理のブロック図
【図５】演算制御回路１のブロック図
【図６】座標系を説明する説明図
【図７】ペンＳＷの動作を説明するフローチャート
【図８】座標出力モードを説明するフローチャート
【図９】操作の一例を示す説明図
【図１０】操作領域と仮想入力面を説明する説明図
【符号の説明】
１ 演算制御回路
２ 信号波形検出回路
３ 検出センサ
４ 座標入力ペン（指示具）
６ 表示ディスプレイ
４１ ペン先ＳＷ
４２ ペンサイドＳＷ
４３ 音波発生源[0001]
TECHNICAL FIELD OF THE INVENTION
The present invention relates to a coordinate input device that can constitute an input / output integrated device when used in combination with a display system. More specifically, the present invention relates to a coordinate input device used to control an externally connected computer or to write characters, graphics, and the like by directly inputting coordinates on a display screen with a pointing tool.
[0002]
[Prior art]
2. Description of the Related Art Conventionally, a coordinate input device capable of inputting coordinates is disposed on a display surface of a display device such as a CRT display, a liquid crystal display (LCD), or a projector, so that pointing or handwriting performed by an operator can be performed. 2. Description of the Related Art Devices that can be displayed on a display and realize a relationship like paper and a pencil are known. Examples of the coordinate input device include a resistive film type, an electrostatic type, an ultrasonic type that transmits ultrasonic waves to a coordinate input surface such as glass, an ultrasonic type, a type having a transparent input plate, an optical type, or a type in which sound waves are transmitted in the air. A mechanism for calculating coordinates is placed on the back side of the display device, and a transparent protective plate is placed on the front of the display device, such as a method of detecting the position by radiating, or an electromagnetic induction (electromagnetic transfer) method. Some information devices constitute an integrated input / output information device.
[0003]
Such devices began with small electronic organizers with portability, and with the increase in the size of display devices such as pen-input computers, relatively large-sized information devices have come to be seen, as well as front projectors. In combination with a large display device such as a rear projector or a PDP, it has begun to be used for a presentation device, a TV conference system, and the like. With regard to the large-sized liquid crystal display and PDP display, the image quality is being improved and the cost is being reduced at present. In addition, with the digitization of satellite broadcasting and the like, the specification form of the television is entering a transitional state.
[0004]
In addition, these large-sized display devices are replaced with, for example, whiteboards or electronic blackboards used in offices. It is starting to be used In this case, the information displayed on the display is controlled by directly touching the screen to update the display information by the operator or the attendees, such as a whiteboard. Is configured to be able to switch the display content.
[0005]
[Problems to be solved by the invention]
However, in this type of coordinate input device, it is difficult to configure a completely transparent input plate in a coordinate input device of a resistive film type, an electrostatic type, or the like, and it is said that image quality of a display device is deteriorated. Problems arise. Furthermore, in the ultrasonic method that requires a propagator such as glass, it is necessary to optically treat the surface of the glass, for example, to prevent reflection of a fluorescent lamp when used indoors. Significant cost increases are unavoidable in terms of maintaining image quality. In addition, in the electromagnetic induction method, electrodes on a matrix are arranged on the back side of the display surface, and electromagnetic signals are transmitted and received between the input pen, so in principle, if the display device becomes large and the thickness of the device increases, in principle, It is difficult to calculate coordinates, and when configuring a large-scale coordinate input device such as a conference use or a presentation use, there is a disadvantage that the device becomes very expensive.
[0006]
When a large-sized display system is adopted, it is expected that a large number of audiences will appreciate the image, and sufficient performance is required for the viewing angle or contrast of an image. Therefore, when combining these large display systems with coordinate input measures, it is important not only that the coordinates can be accurately calculated at a sufficiently low cost, but also that the image quality of the display device is not deteriorated. .
[0007]
Furthermore, when considering this type of large-scale integrated input / output system, considering the meeting with a large number of participants, or considering the network age, the operator controls the personal computer by directly touching the screen, The configuration in which the operator can appropriately display necessary information is superior to the operator (presenter) in terms of operability. In addition, a large number of listeners can obtain information such as the operator's instruction point, the operator's facial expression and gestures together with the information displayed on the screen by operating the information on the screen directly by the operator. So that it is possible to deepen understanding. However, if the operator performs an action such as an instruction on such a large-sized display device, the information on the screen is interrupted as the operator moves. In particular, a projection type display device such as a front projector or an OHP is employed. In the system, the image is greatly distorted, which can be a major obstacle in terms of difficulty in viewing.
[0008]
As a method of solving such inconveniences such as interrupting the optical path, the operator performs a mouse-like operation (for example, an operation of moving a cursor using relative coordinates instead of absolute coordinates) on the spot using an indicator. There is a method of moving the cursor from the current cursor position to a desired position. The method of inputting the relative coordinates will be described in detail. It is assumed that, for example, the coordinate value (X1, Y1) is detected at a certain point in time by the operation of the operator, and thereafter, the pointing tool is moved and the coordinate value (X2, If the coordinate input device detects (Y2), the movement amount is (ΔX, ΔY) (ΔX = X2-X1, ΔY = Y2-Y1). If the cursor is moved using the movement amount (ΔX, ΔY) as the movement amount from the current arbitrary cursor position, the intention (the direction and the moving distance of the operator is equal to the moving direction and the moving amount of the pointing tool). ), The cursor can be moved. In other words, the operator can move the cursor to the predetermined position while the operator is present, without directly positioning the pointing tool at the predetermined position on the large screen.
[0009]
Of course, as a coordinate input device, by directly touching the screen, character input and drawing (as if by moving the pointing tool in a relationship like paper and pencil, handwriting remains at the moving location as an echo back), Alternatively, command generation by an operation such as double-clicking an icon is an important function. That is, in this type of system, the operation mode for outputting the absolute coordinates is indispensable, and it is an important subject to make the operation mode compatible with the relative operation described above. Various configurations are disclosed as a method for switching the mode. For example, as shown in Japanese Patent Application Laid-Open No. 4-299724, a display area is divided into an area where absolute coordinates can be input and an area where relative coordinates can be input. A method of dividing, a method of providing relative / absolute coordinate input switching means as disclosed in JP-A-5-298014 or JP-A-10-333817, and a method of automatically switching according to an application are disclosed. I have. Furthermore, as disclosed in Japanese Patent Application Laid-Open No. H10-149253, a method of setting an offset value with respect to absolute coordinates and a method of processing coordinates according to the moving speed of the pointing tool are disclosed.
[0010]
The method of dividing the area or switching the mode according to the application is based on the premise that the coordinates in the display area are detected, and discloses how to process the detected coordinates. If an absolute point instruction is to be performed in the area of the area in which the point can be set, the area to be set must be set again, and the area of the desired point position must be set as the area for absolute coordinate detection. Needless to say, some setting is necessary even in a method by an application, and the operation is very troublesome. Furthermore, the configuration having the switching means and the method of setting the offset amount by the specific operation are not sufficient configurations from the viewpoint that a specific operation such as switching occurs depending on the application and the operability is excellent. I want to. Also, the method of processing coordinates based on the moving speed of the pointing tool is a means that can realize a large movement of the cursor with a small hand movement, but from the viewpoint of inputting characters and drawing figures. It must be said that the specifications are very difficult to handle.
[0011]
On the other hand, when considering this type of large-scale integrated input / output system, in the case of a meeting that assumes a large number of participants, or considering the network age, the operator directly touches the screen as described above. In addition to controlling the PC, the user can operate the screen away from the screen, for example, so that conference participants who are listening to the presentation while watching the screen can disclose evidence for questions or rebuttals It can be said that the preferred form is that the information can be extracted from the network as needed.
[0012]
Further, in the above-described remote operation or the usage mode in which the operator operates the screen beside the screen, the operator operates the pointing device in space, and touches the display screen to directly input absolute position coordinates. Unlike the case where the input plane is used, there is usually no absolute plane (input plate) that is the input plane. That is, the operator intends to input the coordinates on the XY plane and performs the coordinate input operation. However, the operator is actually inputting the spatial coordinates (three-dimensional coordinates) and becomes the target. It is difficult to make the movement of the object (for example, the movement of the cursor displayed on the display device and the two-dimensional movement of the display surface) one-to-one with the movement of the pointing device. It is in.
[0013]
The present invention has been made by focusing on the above points, and has as its object to improve the operability of a coordinate input device that detects spatial coordinates and outputs relative coordinates.
[0014]
[Means for Solving the Problems]
In order to solve the above problems, the present invention has the following configuration.
[0015]
By operating a coordinate input pen, which is a pointing device, on a display screen of a display device, the spatial (three-dimensional) position coordinates of the pointing device of a device capable of controlling display information or additionally writing information can be displayed. A coordinate input device capable of detecting, wherein a coordinate system of the coordinate input device is a display surface of the display device as an XY plane, a horizontal direction thereof is an X axis, a vertical direction is a Y axis, and a normal line of the display surface. If the direction is defined as the Z-axis, Z is determined from the predetermined coordinate values (X1st, Y1st, Z1st), the detected coordinate values (Xsamp, Ysamp, Zsamp), and the difference value (ΔX, ΔY, ΔZ) between them. The configuration is such that the square sum ΔXZ of the difference value ΔZ in the direction and the difference value ΔX in the X direction is calculated, and the movement amount for a predetermined coordinate value is output as (ΔXZ, ΔY).
[0016]
This can be further summarized as follows.
[0017]
(1) A coordinate input device for detecting spatial (three-dimensional) position coordinates (x, y, z) of a pointing device, wherein a difference value (Δx, Δy, Δz) between the detected coordinate value and a predetermined coordinate value is provided. A relative coordinate deriving means for calculating the difference value, a determining means for determining whether the difference value of the derived difference Δx is positive or negative, a coordinate value processing means for calculating a square root of a sum of squares of the difference value Δx and the difference value Δz, and the determining means. Determining means for determining the sign of the square root calculated by the coordinate value processing means in accordance with the output result; and outputting the sign, the square root, and Δy as a difference value of the predetermined coordinate value. apparatus.
[0018]
(2) In the coordinate input device according to (1), the predetermined coordinate value at the time of outputting the difference value is a coordinate value (x, y, z) detected immediately before, and stores the coordinate value. A coordinate input device comprising storage means for performing the above operation.
[0019]
(3) In the coordinate input device according to (1), the predetermined coordinate value at the time of outputting the difference value is a coordinate value that is first effective during a period in which coordinate input is continuously performed. A coordinate input device comprising storage means for storing a coordinate output value that is first valid and detected during the period.
[0020]
(4) An input / output integrated device in which the display device and the coordinate input device according to (1) are overlapped and arranged, wherein the Z axis is a normal direction of a display surface of the display device, and X A coordinate input device, wherein an axis is a horizontal direction on a display surface, and a Y axis is a vertical direction on the display surface.
[0021]
BEST MODE FOR CARRYING OUT THE INVENTION
FIG. 1 shows a schematic configuration of a coordinate input device capable of detecting three-dimensional (space) coordinates in the present embodiment. In the figure, reference numeral 4 denotes a coordinate input pen, which is a writing implement, which is configured to generate a sound wave in the air by a coordinate input operation by an operator. The generated sound wave is detected by a plurality of detection sensors 3 (in this embodiment, four detection sensors 3_Sa to Sd are used), processed by a signal waveform detection circuit 2 by a method described later, and then processed by an arithmetic control circuit. 1 is configured to calculate the source position coordinates (X, Y) of the writing implement 4. The arithmetic and control circuit 1 controls the entire apparatus, moves the cursor displayed on the display 6 via the display driving circuit 7 based on the obtained coordinate data, or writes handwritten information such as writing on the display 6. It is configured so that it can be displayed and additionally recorded. As described above, by combining the coordinate input device and the display device, it becomes possible to provide a man-machine interface capable of realizing a relationship like "paper and pencil".
[0022]
Hereinafter, the present invention will be described in detail with reference to the drawings.
[0023]
First, the outline of the configuration of the coordinate input pen 4 will be described with reference to FIG. The sound source 43 incorporated in the coordinate input pen 4 includes a pen power supply 46, a timer and an oscillation circuit, a control circuit for detecting and controlling a plurality of switch information provided in the coordinate input pen 4, and the like. The driving circuit 45 is driven. The drive signal of the sound source 43 is a pulse signal generated by a timer and repeated at a predetermined cycle, and is applied to the sound source 43 after being amplified by a predetermined gain by an oscillation circuit. The electric drive signal is converted into mechanical vibration by the sound source 43 and emits its energy in the air. On the other hand, a signal synchronized with the emission timing of the sound wave is transmitted to an LED or the like. Output from the light emitting means 44.
[0024]
The coordinate input pen 4 according to the present embodiment includes a pen tip switch (SW) 41 that operates by pressing a pen tip, which is a writing implement, and a plurality of pen sides provided on a casing of the coordinate input pen 4. A switch (SW) 42 is provided.
[0025]
By the way, the drive circuit 45 outputs the coordinates every predetermined period (for example, every 10 msec, in which case, a sound wave is emitted 100 times per second, so that the coordinate output sampling rate of the coordinate input device is 100 times / second). A signal for driving the sound source 43 in the input pen 4 is output, and a light signal which is a timing signal and a sound wave is emitted into the air. The sound wave is at a distance from the sound source to each of the detection sensors 3_Sa to Sd. , And arrive and be detected. This type of coordinate input device derives a distance between a sound source of the coordinate input pen 4 and each detection sensor 3 by a product of a known sound speed of a sound wave and its arrival time, and obtains position information of each detection sensor. This is a system based on obtaining geometrically the position information of the above-mentioned sound wave transmission source using the same.
[0026]
Therefore, a method of detecting the arrival time of the sound wave will be described first.
[0027]
FIG. 3 is a timing chart for explaining the arrival time detecting method, and FIG. 4 is a circuit block diagram for realizing the method. Reference numeral 101 denotes a drive signal generated by a drive circuit 45 in the coordinate input pen 4. The drive signal 101 generates a drive signal 101 and emits an optical signal from a light emitting unit 44 such as an infrared LED to generate a start signal. This optical signal is received by the light receiving element 5 (see FIG. 1), demodulated by the control signal detecting circuit 211 in the signal waveform detecting circuit 2, and the emission timing of the sound wave from the vibration input pen is output to the microcomputer 301. , The timer 303 in the arithmetic and control circuit 1 is started. On the other hand, the sound wave radiated into the air is delayed by the distance between the sound wave source 43 and the detection sensor 3 and detected by the detection sensor 3. Reference numeral 102 indicates a detection signal detected by the detection sensor 3 and amplified by the preamplifier circuit 201 to a predetermined level. This signal is processed by an envelope detection circuit 203 composed of an absolute value circuit and a low-pass filter, and only the envelope 103 of the detection signal is extracted.
[0028]
Focusing on this envelope, the sound velocity at which the waveform propagates is the group velocity Vg. When a unique point of this envelope, for example, a peak of the envelope or an inflection point of the envelope is detected, a delay time tg relating to the group velocity Vg is obtained. Can be The envelope singularity detection circuit 206 for detecting the peak or inflection point of the envelope can be easily detected using a differentiating circuit and a zero-cross comparator. In this embodiment, the signal 106 is formed by performing second-order differentiation. The inflection point of the envelope is detected with reference to the gate signal 105 compared with the threshold level 104 and the signal 103 (signal 107). By stopping the timer 303 operating by the above-described start signal using the signal 107, the group delay time Tg related to the group velocity Vg can be detected (strictly speaking, this group delay time). Although Tg includes the delay of the circuit related to the waveform processing, its influence is completely removed by a method described later, and therefore, in order to simplify the description, it is assumed here that there is no circuit delay time. Add a description). Therefore, the distance L between the sound wave source 43 and the detection sensor 3 can be obtained by the following equation.
[0029]
L = Vg × Tg (1)
On the other hand, a method for performing more accurate distance detection will be described. The output signal 103 of the detection sensor 3 is input to the Tp signal detection circuit 209 after removing extra frequency components by the band-pass filter 208. . The Tp signal detection circuit 209 includes a zero-cross comparator, a multivibrator, and the like. The Tp signal detection circuit 209 first generates a signal 109 related to a zero-cross point of the signal output by the band-pass filter 208. A signal 110 that outputs the first zero-crossing point where the phase of the signal waveform output at 208 crosses, for example, from the negative side to the positive side is generated. Similarly, by stopping the timer 303 operating by the start signal using the signal 110, the phase extension time Tp related to the phase speed Vp can be detected (similarly, this group). Although the delay time Tp includes a delay of a circuit related to the waveform processing, its influence is completely removed by a method described later, and therefore, there is no circuit delay time in order to simplify the description. Add a description as if).
[0030]
Here, points to be noted when the gate signal 105 generated by the gate signal generation circuit 205 based on the envelope detection circuit 203 is used will be described.
[0031]
The signal level detected by the detection sensor 3 varies depending on the following factors.
1) Electro-mechanical conversion efficiency of the sound wave source 43 and the detection sensor 3
2) Distance between sound wave source 43 and detection sensor 3
3) Environmental fluctuations such as temperature and humidity in the air where sound waves propagate
4) Directivity of sound wave source 43 regarding sound wave radiation and sensitivity directivity of detection sensor 3
[0032]
Item 1 is a factor that occurs due to component tolerances, and sufficient care must be taken when mass-producing devices. Item 2 is an item related to attenuation of sound waves. As the distance between the sound source 43 and the detection sensor 3 increases, the signal level of sound waves propagating in the air generally attenuates exponentially. Besides being known, its damping constant also changes in the environment according to item 3. Furthermore, since the present invention operates as a coordinate input device, the coordinate input pen 4, which is a writing instrument, always changes its posture due to the writing operation by the operator, that is, the pen holding angle fluctuates, so that the sound source of the sound source is changed. There is a fluctuation in the detection signal level due to the sound wave radiation characteristic (directivity). Furthermore, even if the angle formed between the coordinate input pen 4 and the detection sensor 3 fluctuates due to the sensitivity directivity of the detection sensor 3, the detection level also fluctuates. At this time, for example, if it is assumed that the detection level has become smaller, the threshold signal level (reference numeral 104) is fixed, so that the gate signal generation period becomes shorter (signal 111), for example, signal 110. It is quite possible that something changes to signal 112 due to a decrease in signal level. At this time, the time difference between the signal 110 and the signal 112 is an integral multiple of the phase cycle of the signal 108 (corresponding to one cycle in the illustrated case). Using the wavelength λp of the wave (= Vp × T = Vp / f: f is the frequency) and the integer n, the following is obtained.
[0033]
L = Vp × Tp + n × λp (2)
However, it is possible to obtain the integer n from equations (1) and (2).
n = Int [(Vg × Tg−Vp × Tp) /λp+0.5] (3)
Therefore, by substituting the value of the integer n into the equation (2), the distance L can be derived with high accuracy.
[0034]
FIG. 5 is a block diagram showing a schematic configuration of the arithmetic and control circuit 1 according to the present embodiment. Each component and an outline of its operation will be described below. In the figure, reference numeral 301 denotes a microcomputer which controls the arithmetic control circuit 1 and the entire coordinate input device, and includes an internal counter, a ROM storing operation procedures, a RAM used for calculations and the like, and a nonvolatile memory storing constants and the like. It is configured. As described above, the start signal synchronized with the drive timing of the sound source 43 in the coordinate input pen 4 by the drive circuit 44 is emitted as a light signal by an infrared LED or the like built in the coordinate input pen 4, and the signal is transmitted. The detection by the control signal detection circuit 211 causes the timer 303 (for example, constituted by a counter or the like) in the arithmetic and control circuit 1 to be started. With this configuration, the drive timing for driving the sound wave source 43 in the coordinate input pen 4 and the synchronization with, for example, a timer in the arithmetic and control circuit 1 can be obtained. It is possible to measure the time required to reach each of the detection sensors 3 from the sound wave source 43.
[0035]
A vibration arrival timing signal (signal 107, and signal 110 that enables more accurate detection) from each of the vibration sensors 3_Sa to 3_Sd output from the signal waveform detection circuit 2 is a detection signal input port 306. To the latch circuit 304 (304_a processes the Tg signal, 304_b processes the Tp signal). When each of the latch circuits 304_a and 304_b receives the timing signal from the corresponding sensor, it latches the time value of the timer 303 at that time. When the determination circuit 305 determines that all the detection signals necessary for coordinate detection have been received in this way, it outputs a signal to the microcomputer 301 to that effect. When the microcomputer 301 receives the signal from the determination circuit 305, it reads the vibration arrival time from the latch circuits 304_a to 304_b to each vibration sensor from the latch circuit, performs a predetermined calculation, and calculates the coordinate position of the coordinate input pen 4. (In the figure, only a latch circuit for one sensor is shown, but latch circuits corresponding to the number of sensors are appropriately arranged). The result obtained by processing the obtained coordinate values (absolute coordinate values) by a method described later is output to the display drive circuit 7 via the I / O port 307, and, for example, a dot or the like is displayed at a corresponding position on the display 6. It was configured to be able to do. Further, by outputting coordinate position information to the interface circuit via the I / O port 307, the coordinate value can be output to an external device.
[0036]
In the above-described embodiment, the detected time includes an electric processing time by a circuit and the like, in addition to a time when the sound wave reaches the sound source 43 and each detection sensor 3. Therefore, here, a method of removing extra time measured in addition to the time when the sound wave propagates will be described. The group delay time Tg or the phase delay time Tp latched by the latch circuit includes a group circuit delay time etg and a phase circuit delay time etp, respectively. The circuit delay time always includes the same value for each time measurement. Therefore, a time measured by a certain measurement circuit when propagating between the sound wave source 43 and the detection sensor 3 is represented by t.^*If the circuit delay time in the measurement circuit is e and the time required for the sound wave to actually propagate between the sound source 43 and the detection sensor 3 is t,
t^*= T + e (4)
[0037]
On the other hand, the distance between the sound wave source 43 and the detection sensor 3 is a known distance L_iniIs the time measurement at_ini ^*Where e is the circuit delay time of the measurement circuit, and t is the time when the sound wave actually propagates._inigiven that
t_ini* = T_ini+ E (5)
Therefore
t^*-T_ini ^*= Tt_ini                        (6)
Now, if the sound speed of the sound wave is V,

Therefore, the distance L between any sound source 43 and the detection sensor 3 to be determined is
L = V × t = V × (t * −t_ini*) + L_ini      (8)
[0038]
The known distance L_ini, And the time measurement t at that distance_ini ^*(Group delay time Tg_ini ^*Or the phase delay time Tp_ini ^*Both are stored in a non-volatile memory or the like at the time of shipment or the like, so that the distance between the sound wave source 43 and the detection sensor 3 at an arbitrary distance can be accurately calculated.
[0039]
Now, a method for obtaining the position coordinates (x, y, z) of the sound source 43 when the detection sensors 3_Sa to 3_Sd are arranged in the coordinate system as shown in FIG. 6 will be described. The distance between the vibration source 43 and each of the detection sensors 3 accurately obtained by the above method is La to Ld, the distance between the detection sensors in the X direction is Xs-s, and the distance between the detection sensors in the Y direction is Ys-s. given that,
[0040]

[0041]
In the same way

[0042]
As described above, if the distance between at least three vibration sources 43 and the detection sensor 3 can be measured, the position coordinates of the sound source 43 can be easily obtained. In the embodiment of the present invention, four detection sensors are used, and, for example, information at the longest distance is not used (in this case, the signal output from the detection sensor 3 has the lowest signal level because the distance is long. ), And by calculating coordinates using only the remaining three pieces of distance information, highly reliable coordinates can be calculated. In addition, it is possible to determine whether or not the reliability of the output coordinate value is high by utilizing the information of the sensor having a long distance. As a specific method, for example, the coordinate value calculated based on the distance information La, Lb, Lc and the coordinate value calculated based on the distance information Lb, Lc, Ld should output the same value (the value of the distance information). If the two do not match, either one of the distance information is incorrect, that is, a false detection has been made, and in that case, the coordinate value is not output. Can be implemented.
[0043]
Next, an operation mode of the present coordinate input device will be described. Referring again to FIG. 2, the coordinate input pen 4, which is a pointing tool, includes a pen tip SW41 and two pen side SWs 42_a and 42_b. The operation mode of each SW (switch) is described. An explanation will be given with reference to Table 1 and FIG.
[0044]
When the operator grips the coordinate input pen 4 and presses the coordinate input surface, the pen tip SW 41 operates (step S402). At this time, the sound wave generation source 43 is operated by the drive circuit 45 at a predetermined cycle, and operates so that a sound wave is emitted into the air at a predetermined cycle (pen down state, S406). If the coordinate value detected at this time is a coordinate value in the display area (in the range of x <± Disp_X, y <± Disp_Y in FIG. 6), the pointing tool 4 has a relationship similar to a normal paper and pencil. The trajectory accompanying the movement is output on the display screen. On the other hand, when the detected coordinate value is outside the display area while the pen tip SW 41 is operating, it is assumed that the pen tip SW has been operated unknowingly by the operator's hand, for example. Therefore, in this case, the coordinate output is configured to be prohibited. Similarly, the state in which the pen tip SW is operating is a state in which the display surface, which is the coordinate input surface, is pressed by the pointing tool. Therefore, the Z-axis coordinate value detected at this time should be substantially “0”. If it does not become "0", an erroneous operation by the operator is also assumed, so that the coordinate output is also prohibited in this case.
[0045]
On the other hand, when the pen tip SW 41 is in the off state, the writing operation is not in a state where the operator presses the coordinate input surface. However, for example, by moving the displayed cursor or double-clicking the icon at a position near the coordinate input surface or away from the display which is the coordinate input surface, and further outside the display area of the display. It is very advantageous to be able to perform a desired screen operation. Therefore, by pressing one of the pen side SWs 42 (steps S403 to S405), the sound wave is radiated into the air, and the cursor can be moved (pen-up state, step S407). . In addition, by pressing both of the pen side SWs 43 (steps S403 to S405), a pen down state is established even when the pen tip SW 41 is not operating (step S406). As a method of discriminating the pen-up / pen-down, as described above, the start timing signal is superimposed on the above-described start timing signal (in the case of the present embodiment, the start timing signal is provided as a light signal by an LED or the like built in the coordinate input pen). The information of the arithmetic and control circuit 1 may be detected by the detection by the control signal detection circuit 211. Further, it is also possible to determine the mode by changing the frequency of the radiated sound wave and detecting it, for example, according to the state.
[0046]
On the other hand, as shown in FIG. 2, both the pen side SWs 42_a and 42_b are arranged in a direction of about 90 degrees in the cross-sectional direction of the coordinate input pen, and when the operator grips the pen, no matter whether they are right-handed or left-handed, The thumb is set at a position where the index finger naturally touches the other side. Such a switch arrangement, the same operation mode (pen-up state in the case of the present embodiment) set by turning on only one of the SWs, and a state in which both are turned on. By setting an operation mode in which the operation is performed (similarly, a pen down state), the coordinate input pen 4 that is easy to use is configured regardless of the dominant arm.
[0047]
As another embodiment of the pen-side SW, a switch that performs two-stage switching with one switch is also effective. In other words, the first-stage switch operates (pen-up state) when lightly pressed, and the second-stage switch operates (pen-down state) when pressed further. In this case, the same pen is used. It is possible to realize the coordinate input pen 4 that is easy to use regardless of the dominant arm.
[0048]
By the way, the method of operating the pen side SW to input coordinates at a position away from the display surface of the display 6 and move the cursor (pen up state) or write (pen down state) has been described. In such a case (in a state in which the surface of the display 6 is not directly in contact with the pen tip SW 41 is not operated), the display 6 is located on the display surface or in the vicinity of the display surface (in the air near the display surface). The specifications required in operation are different between the case where the operation is performed in a state where the pen tip SW is not operated) and the case where the coordinate input operation is performed at a position away from the display surface or outside the display area.
[0049]
First, in the former case, by moving the coordinate input pen 4, for example, it is required to intuitively and directly move a displayed cursor to a desired position accurately. However, in the latter case, for example, in order to move the displayed cursor to a desired position, it is required to relatively move the cursor in accordance with the movement of the coordinate input pen. That is, when the operator intends to make a presentation using a large display, the display information can be controlled or information (characters, figures, etc.) can be written by directly touching (coordinate input) the screen. (Relationship between paper and pencil) In addition to the means, if the information is simply pointed to, the operator does not go to the place to indicate it, but is displayed at a remote location, in other words, viewed from the listener's side. It is preferable that desired screen control and information addition can be performed without the information being hidden by the operator. Furthermore, considering this type of large-scale integrated input / output system and considering meetings with a large number of participants, the operator directly controls the PC by directly touching the screen as described above. For example, the meeting participants who are listening to the presentation while watching the screen can operate the screen even if they are away from the screen, as necessary, so that they can disclose evidence for questions or rebuttals. It can be said that it is a preferable mode that the information is extracted from the network.
[0050]
The present invention has been made in view of this point, and the coordinate input device according to the present invention outputs the coordinate values based on the detected coordinate values (x, y, z) in what form. Is determined. Further, information on the detected coordinate values (x, y, z) and information on the switch state of the pointing device 4 are combined to perform a coordinate output form or output control.
[0051]
Further, in a mode in which the detected coordinate value (Xsamp, Ysamp, Zsamp) is compared with a predetermined coordinate value, and a movement amount (difference value) from the predetermined value is output, at least one axis is output. The value is used as correction information for correcting the value of another axis, and the obtained space (three-dimensional) coordinates are converted into plane (two-dimensional) coordinates {circle over (2)} and output.
[0052]
Specifically, referring to FIG. 8, the process starts in step S501. In step S502, it is determined whether a signal required for coordinate calculation has received each of the detection sensors 3 or a start signal. If it is determined that the coordinates are valid, the position coordinates (x, y, z) of the coordinate input pen 4 are derived in step S503. Next, based on the calculated position coordinates (x, y, z), it is first determined whether the value of the Z axis is 0, that is, whether the pointing tool 4 is located on the coordinate input surface and the coordinate input has been performed. (Step S504). If Z = 0, it is determined whether the (x, y) coordinate detected in step S505 is within the display area, and if it is, the detected coordinate value (x, y) is determined. The value is output to the external device or the like as a fixed value (step S508). When it is determined that the detected coordinate value (x, y) is outside the display area, it is determined that the coordinate input has been performed due to some erroneous operation, and the output of the detected coordinate value is stopped to complete the processing. I do. Although not directly shown in the flowchart of FIG. 8, for example, if the information of the pen tip SW 41 of the pointing tool 4 is superimposed on the optical signal as the start signal and demodulated as a control signal by the control signal detection circuit 211, the pen tip SW 41 It is also possible to increase the reliability of the coordinate calculation by using the above information. That is, when the pen tip switch is operated, it is normal that the switch is operated by pressing the display area which is the coordinate input surface, and the Z-axis detection is performed even though the pen tip SW 41 is operated. If the value does not become Z = 0, the output of the detected coordinate values can be stopped assuming that the coordinate input has been performed by some kind of erroneous operation, and from the viewpoint of preventing malfunction, higher reliability can be obtained. A configuration is obtained (see Table 1).
[0053]
[Table 1]

[0054]
On the other hand, if the detected coordinate value is not Z = 0, it is compared with a predetermined value 1 set in advance in step S506, and if the value of the Z axis is smaller than the predetermined value 1 (in this case, the indicator 4 is It can be determined that it is located near or relatively close to the display surface, which is the coordinate input surface), and it is determined whether the coordinate value (x, y) detected in step S507 is within the display area. If it is within the area, the coordinate value (x, y) detected in step S508 is output as it is. In this state, the cursor is moved and information such as characters and figures are added with the movement of the pointing tool 4 while the operator is operating the pointing tool relatively close to the display surface. To control the display information.
[0055]
On the other hand, if it is determined in step S507 that the display is not within the display area, the operator is present near the display surface and beside the display area while controlling the display content without interrupting the display information to the listener. And the cursor can be relatively moved by the operation of the pointing tool 4. Continuing the description of this method of relatively moving the cursor, it is determined that the operator is relatively close to the display device and is positioned beside the display device. Are stored as predetermined coordinate values (X1st, Y1st, Z1st) (step S509), and it is determined in step S510 whether coordinates are continuously input. The definition of "whether input is continuous" means that if this type of coordinate input device can output coordinates 50 times / second (coordinate sampling rate), for example, it outputs coordinates every 0.02 msec. Therefore, by measuring this cycle, it can be determined whether coordinate input is being performed continuously. In the coordinate input device of the present invention, for example, the generation timing of the start signal (see FIG. 4) of the control signal detection circuit 211 is monitored (in this case, if the sampling rate is 50 times / second, 0.02 seconds) A start signal may be generated every time), or an arrival interval of a direct ultrasonic signal (for example, the signal 102 in FIG. 3) (in this case, the distance between the indicator 4 and the sensor 3 with the movement of the indicator 4) Is constantly changed, the difference in transmission time of the sound wave accompanying the change in the distance is increased or decreased in the time based on the sampling rate (0.02 seconds when the sampling rate is 50 times / second). The period is about 02 seconds "(theoretically, the signal is always received within the range of 0 to 0.04 seconds). In consideration of the maximum movement amount of the pen within 0.02 seconds in practical use, For example, within 0.03 seconds No. is realized by monitoring the determining) that the coordinate input continuously being performed when the successfully received. If it is determined in step S510 that coordinate detection is being performed continuously, position coordinates (x, y, z) are calculated in step S511.
[0056]
Now, consider a case where the operator operates the screen using the pointing tool 4 beside the display device.
[0057]
To explain with reference to FIG. 10, when the operator is operating the pointing tool 4 near the display which is a coordinate input surface and outside the display area, the operator moves the pointing tool 4. In order for the cursor to move correspondingly in accordance with the direction and the moving distance, a virtual coordinate input surface assumed by the operator (as if the operator assumed an operation plane in the space, and moved the pointing tool 4 to the plane) 10A) is parallel to the display surface (in other words, the XY plane of the coordinate input device and the virtual coordinate input surface assumed by the operator are parallel) as shown in FIG. Things are necessary. When the virtual input surface is not parallel as shown in FIG. 10B, the movement amount in the X-axis direction is smaller than the movement amount of the pointing tool 4 (the X-axis movement amount X in the virtual plane of the operator). 'And the amount of movement X of the cursor on the display surface in the X-axis direction^*Is X^*= X'sinΘ. When the operator tries to control the display information beside the display surface, the operator operates while looking at the display surface. When assuming a virtual input surface, the state shown in FIG. More generally, the state shown in FIG. 10B is assumed, and the operability is excellent. Therefore, in the present invention, when it is determined that the operator is located beside the display surface, the sum of squares of the difference value in the X-axis direction, which is the horizontal direction of the display surface, and the difference value in the Z-axis direction is displayed. For example, it is assigned as a moving amount of a cursor on the machine. By doing in this way, even if the virtual input surface assumed by the operator is not parallel to the XY plane of the coordinate input device, more faithful according to the moving amount and the direction of the pointing tool 4 of the operator. The structure is such that the cursor can reproduce the movement.
[0058]
Returning to FIG. 8 again, the difference value in the x-axis direction, which is the horizontal direction of the display device, is first determined from the stored predetermined coordinate values (X1st, Y1st, Z1st) and the detected coordinate values (x, y, z). Calculation is performed (step S512), and the sign of the difference value is determined (step S513). Thereafter, the sum of squares of the difference value of the pointing tool 4 in the X-axis direction and the difference value in the Z-axis direction (= SQR [(XX1st))²+ (Z-Z1st)²]: SQR is calculated as a square root, and is determined as a movement amount in the X-axis direction with respect to a predetermined value. At this time, the sign as the direction of the movement amount is determined from the sign obtained in step S513 (step S514, step S515).
[0059]
Thereafter, the flow returns to step S510 again to determine whether continuous input is being performed, and when the continuous input ends, the operation ends.
[0060]
Now, let us consider a case where the Z-axis value of the coordinate value (x, y, z) detected in step S503 in step S506 is larger than a predetermined value 1 set in advance. This state means that the pointing tool 4 is located at a position distant in the Z-axis direction from the display surface, which is the coordinate input surface, that is, whether the operator performing the presentation is located far away from the display device, Alternatively, it can be assumed that coordinate input has been performed by a listener listening to the presentation. In other words, it can be said that this is a state in which display information is controlled by remote control, and characters, graphics, and the like are being added.
[0061]
Considering the state away from this screen, if the operator performs coordinate input at a position considered to be a desired position and attempts to move a cursor to the desired position, for example, the distance to the display is large. (As the value of Z increases), the positional deviation from the desired position increases, and it becomes impossible to intuitively and directly indicate the desired position. In other words, when trying to move the cursor at a distant position, the pen side SW of the pointing tool 4 is operated and the coordinates are input, assuming that the cursor is pointing to a desired position. The position is different from the desired position described above, and achieves the purpose of moving the cursor to the desired position by the operator moving the pointing tool while visually recognizing the position of the cursor.
[0062]
In other words, in the case of a remote input (operation of inputting coordinates at a position distant from the display device and moving a cursor, for example), the operator's brain performs a correction operation based on visual information by the operator (instruction of the pointing tool 4). The objective is achieved by repeating the loop (moving), and it is difficult to directly point to a desired position.
[0063]
As described above, when performing any remote input operation on image information (image information having a coordinate system on the XY plane) displayed on a display device or the like, the operator attempts to perform a series of coordinate inputs. In this case, the coordinate value of the first point cannot be matched with the coordinate value of the image information. This is because, for example, a laser pointer is widely used as a tool for indicating a display image displayed by an OHP or the like. However, the first point at the time of laser emission is also determined without knowing where to indicate. Obviously, it is possible to irradiate a laser to a desired position by performing a position correcting operation while watching the point position.
[0064]
Therefore, in the present invention, when the value of the z-axis is equal to or more than the predetermined value (remote input) in step S506, the process proceeds to the routine for outputting the relative coordinates described above after step S509. As described above, it is necessary for the operator to consider Θ (see FIG. 10) in order to pursue the operability by the operator beside the display device. It is important to consider the effects of Probably, when the operator is at a position distant from the front of the screen, the virtual input surface assumed by the operator and the XY axes of the coordinate input device will almost coincide with each other, but by deviating from the front position, It is easy to imagine that the virtual input surface of the operator is inclined. Therefore, correcting the value of the display in the X-axis direction based on the difference value of the Z-axis can be an effective method even in this case.
[0065]
With this configuration, it is possible to automatically determine the coordinate output form based on the detected coordinate values in accordance with the usage scene of the operator, and to provide a user-friendly operation environment. Was.
[0066]
In order to distinguish whether the output coordinate value is the absolute coordinate (x, y) or (Δx, Δy), the information is separately output together with the fixed coordinate value even if the information is output. I don't care. Also, as an embodiment of the present invention, a coordinate input device using an ultrasonic wave is adopted, but it goes without saying that the present invention is applicable to any coordinate input device capable of detecting spatial coordinates.
[0067]
By the way, when inputting coordinates directly by touching the screen directly, considering that it is a large display, if you try to move the cursor from one end of the screen to the other, U. However, in the case of remote control, for example, it is normal for a questioner to stand up and ask a question on the spot (it is necessarily difficult to move when there are a large number of listeners). It is desirable to be able to point out the entire area in. The configuration of the present application solves this point as well, and if described with reference to FIG. 9A, the operator can use a display having a large screen for a large number of listeners in the relative coordinate output range. Suppose you are giving a presentation. When trying to move the cursor from the position (1) to the position (3) on the drawing, conventionally, the pen, which is a coordinate pointing device, is held at the position (3), and the coordinates are set at that position. When an input is made, the cursor moves from the position (1) to the position (3) (in this case, the operator is at a position capable of pointing to the position (3)). However, after working at the position (1) (the operator is near the position (1)), if the operator attempts to move to the position (3), the operator moves across the screen. Therefore, for many listeners, the information is obstructed, which hinders understanding of the content of the presentation. In particular, when the large display device is a front projection, an OHP (projection display device) or the like, the image is greatly distorted, which is even more so. On the other hand, it is assumed that the operator is beside the display device and the cursor is located at the position (1). When the operator places the position indicator 4 on A and operates at least one of the pen side SWs 42, a sound wave is emitted from the indicator 4 and the position coordinates of the indicator 4 are detected. At this time, since the pointing device 4 is located outside the display area of the display screen or at a position distant from the display (Z> predetermined value 1), the first detected position coordinates are stored (step S509 in FIG. 8) and the cursor is moved. Does not move from the position (1). Subsequently, it is assumed that the operator operates the pen side SW 42 to continuously detect the coordinates, moves the pointing tool 4 to the position B, and then turns off the operation of the pen side SW 42. Then, as the operator moves the pointing device 4 (moves from the point A to the point B), the cursor moves from the position (1) to the position (2) by an amount corresponding to the moving direction and the moving distance. Will be. Further, the operator moves the pointing tool 4 from the position B to the position C with the pen side SW 42 in the OFF state (at this time, the cursor does not move at the position of {circle around (2)}), and at least one of the pen side SWs 42 is moved. If either of them is operated to move the pointing tool 4 to the position D, the pen side SW 42 is operated and the first detected coordinate value is stored again in step S510, and then the detected coordinate value and the stored value are stored. The cursor moves by an amount corresponding to the difference between the coordinate values, and the cursor moves by an amount corresponding to the moving direction and the moving distance according to the moving operation (movement from the point C to the point D) of the pointing tool 4 by the operator. It moves from the position of ▼ to the position of ③. According to the present invention, for such a usage, the movement amount of the cursor in the X direction is defined as the movement amount of the virtual input surface assumed by the operator, and the square of the difference amount in the X direction and the difference amount in the Z axis direction is defined. The sum and the direction (determining whether the direction is the positive direction or the negative direction) are detected, and the movement amount of the pointing tool 4 is converted as the movement amount of the cursor displayed on the display device.
[0068]
As described above, the operator can smoothly move the cursor from the current cursor position to a desired position even if the operator is at a position away from the display surface, which is the input surface, or at a position away from the display device. In addition to being able to move, by moving the pointing tool 4 on the virtual input surface assumed by the operator by remote control or the like, an excellent effect of being able to input characters and graphics can be obtained. . That is, in the case of inputting a character, as described with reference to FIG. 10B, first, the cursor is moved to a desired position (one of the pen side SWs is operated (1) → (2): the pen is operated). Up), and then both the pen side SWs are operated to make the pen down, so that a locus corresponding to the moving direction and the moving amount of the pointing tool 4 remains on the screen with the moving operation of the pointing tool 4 ([2] → [3]). . Then, one of the pen side switches is turned off (the other is still operating and the state where the coordinates are continuously calculated is maintained; the pen-up state), and the cursor is moved to a desired position ( (3) → (4)), by operating the pen side SW that has been turned off again, the trajectory is input again from the point where the cursor has moved ((4) → (5)). The operator needs to move the cursor to the first position (2) by moving the pointing tool while visually recognizing the cursor, but does not visually recognize the cursor when writing the character "i" thereafter. However, the character input can be performed by the absolute movement amount of the pointing tool 4, that is, the intuitive operation of the hand and arm. In other words, the coordinates output during the continuous period are relatively based on the first valid coordinate value during the continuous input period, but the movement amount of the cursor during that period is viewed from the operator. And the movements of the hands and arms correspond to each other, and have an excellent effect that a character input operation can be realized by an intuitive input operation as if there is a coordinate input surface in space.
[0069]
As described above, the operator can control the display information by a natural operation or add information such as characters and graphics, and for many listeners, the display information is not obstructed. This makes it possible to efficiently understand the content intended by the speaker who is the operator. Further, in the present invention, in consideration of the usability of a system having a large screen, the mode for outputting absolute coordinates and the mode for outputting relative coordinates are automatically switched according to the calculated coordinate value. For example, it is possible to provide an excellent operation environment in which the user can concentrate on the presentation without requiring the output mode of the coordinate input device to be switched by switch means or the like.
[0070]
Further, according to the present invention, in a state where relative coordinates are output, a predetermined coordinate value (X1st, Y1st, Z1st) for obtaining a difference from the detected coordinate value is set to a coordinate which becomes first effective during a continuous input period. Value. To explain the reason in detail, it is easy for the operator to recognize the boundary of the display area in the vicinity of the display area, but this recognition becomes vague as the operator moves away from the display area. Further, the value of the predetermined value 1 in the Z-axis direction may be a numerical value that can be set by the operator, but it is almost difficult to distinguish an actual boundary even if the numerical value is recognized. On the other hand, by inputting the coordinates first, the operator recognizes whether the output is performed in the form of the absolute coordinates or the output is performed in the form of the relative coordinates, for example, by determining the position of the pointing tool 4. It can be easily understood from the relationship between the cursor position. However, for example, when the operation is performed near the boundary where the output form is changed, if the mode switching operation occurs frequently, the output form is frequently changed, and the specification becomes difficult for the operator to handle. Therefore, in the present invention, the period of the start signal radiated from the pointing tool 4 is monitored to determine whether or not the coordinate input is being performed continuously, and the coordinate value that becomes effective first during the continuous input period is used as a reference. Since the difference between the coordinate value calculated thereafter and the reference coordinate value is output as the coordinate value during the continuous input period, one of the pen side SWs 42 (or the pen tip SW 41) operates. As long as this reference coordinate is retained, even if the coordinate input operation is in the vicinity of the switching area, the coordinate system does not change at least from relative coordinate input to absolute coordinate input, and coordinate input with good operability is performed. It has an excellent advantage that the apparatus can be configured (from the embodiment of FIG. 8, the coordinates may change from the absolute coordinates to the relative coordinates. In this case also, a step of monitoring the continuous input is provided in step S508). During continuous input period is allowed be fixed in absolute coordinates).
[0071]
In the embodiment of the present application, whether to output in absolute coordinates or to output in relative coordinates is determined based on the obtained absolute coordinate values, so that a continuous input period is monitored to fix the mode, and a predetermined value is set to the period. However, the present invention is not limited to this part, but is a coordinate input device that outputs relative coordinates, or a method of processing the coordinate values based on the detected coordinate values. The difference value of at least one axis and the sum of squares of the difference values of the other one axis or the other two axes, and outputting the value as the difference value of the at least one axis. I have. Therefore, it is needless to say that the predetermined value may be a difference value from the coordinate value detected immediately before.
[0072]
【The invention's effect】
As described above, this is a coordinate processing method of a coordinate input device mainly arranged on a display device, in which a (x, y) plane is defined based on position coordinate (x, y, z) data of a coordinate input pen. By correcting the X-axis coordinate value in the horizontal direction of the display device based on the detected z-axis coordinate value for the display device having the display device, the moving operation of the pointing tool of the operator can be faithfully performed by, for example, a cursor of the display device. Since the configuration is such that it can be reproduced as the movement of the object, an excellent effect of realizing an operation environment with excellent operability can be obtained even in a coordinate input operation at a position distant from the coordinate input surface.
[Brief description of the drawings]
FIG. 1 is a schematic configuration diagram
FIG. 2 is a block diagram of a coordinate input pen 4;
FIG. 3 is a timing chart of signal processing.
FIG. 4 is a block diagram of signal processing.
FIG. 5 is a block diagram of the arithmetic and control circuit 1.
FIG. 6 is an explanatory diagram illustrating a coordinate system.
FIG. 7 is a flowchart for explaining the operation of a pen SW;
FIG. 8 is a flowchart illustrating a coordinate output mode.
FIG. 9 is an explanatory diagram showing an example of an operation.
FIG. 10 is an explanatory diagram illustrating an operation area and a virtual input surface.
[Explanation of symbols]
1 Operation control circuit
2 Signal waveform detection circuit
3 Detection sensor
4 Coordinate input pen (pointer)
6 Display
41 Pen tip SW
42 Pen Side SW
43 Sound source

Claims (4)

A coordinate input device for detecting spatial (three-dimensional) position coordinates (x, y, z) of the pointing tool,
A relative coordinate deriving means for calculating a difference value (Δx, Δy, Δz) between the detected coordinate value and a predetermined coordinate value; a determining means for determining whether the difference value of the derived difference Δx is positive or negative; Coordinate value processing means for calculating the square root of the sum of squares of the difference value Δz, and determination means for determining the sign of the square root calculated by the coordinate value processing means according to the output result of the determination means,
A coordinate input device for outputting the sign, the square root, and Δy as a difference value between the predetermined coordinate values. The coordinate input device according to claim 1,
The predetermined coordinate value when outputting the difference value is the coordinate value (x, y, z) detected immediately before,
A coordinate input device comprising storage means for storing the coordinate values. The coordinate input device according to claim 1,
The predetermined coordinate value at the time of outputting the difference value is the first valid coordinate value during a period in which coordinate input is continuously performed, and the first valid coordinate value during that period is detected. A coordinate input device comprising storage means for storing an output value. An input / output integrated device in which a display device and the coordinate input device according to claim 1 are overlapped with each other, wherein the Z axis is a normal direction of a display surface of the display device, and the X axis is a display surface. A coordinate input device characterized in that the horizontal direction in the inside and the Y axis are the vertical direction in the display surface.

Images