JP2004310351A - Coordinate input system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a coordinate input technique for improving the visibility of an indicated position. <P>SOLUTION: The input coordinate of a position on a coordinate input surface indicated by an operator is detected. An enlargement reference point to be a reference for enlarging the input coordinate is input, and an enlargement rate reference point for determining an enlargement rate to enlarge the input coordinate is input. Next, the enlargement rate is determined, based on a positional relationship between the input coordinate and the enlargement rate reference point. Then, coordinate which is the input coordinate enlarged in the direction of connecting the enlargement reference point and the input coordinate is calculated, based on the enlargement rate and the enlargement reference point, and the calculated coordinate is output. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

となる。同様にして、
【０２２５】

となる。
【０２２６】
以上示したように、少なくとも３個の振動発生源４３と検出センサ３までの距離が測定できれば、容易に音波発生源４３の位置（空間）座標を求めることが可能となる。
【０２２７】
本発明では、検出センサを４個用いており、例えば、距離が最も遠い情報を使わず（この場合、検出センサ３で出力される信号は、距離が遠いために信号レベルが最も小さくなっている）、残り３個の距離情報のみで、座標を算出することで、信頼性の高い座標算出を可能としている。
【０２２８】
また、この距離が遠いセンサの距離情報を活用することで、出力された座標値の信頼性が高いものか判定することも可能である。
【０２２９】
具体的な方法としては、例えば、距離情報Ｌａ、Ｌｂ、Ｌｃで算出された座標値と、距離情報Ｌｂ、Ｌｃ、Ｌｄで算出された座標値は同一の値を出力するはずであり（距離情報の組み合わせを変更して演算する）、両者が一致しない場合には、いずれかの距離情報が不正、つまり、誤検出したことになるので、その場合には、座標値を出力しないといった信頼性を向上させる構成も実施可能となる。
【０２３０】
以上説明したように、実施形態６によれば、画面１０２の表示領域外の領域に於いても座標入力が可能なので、基準点となる肩及び肘等の位置を入力する際に、表示領域外でも座標入力ペン２１で実際の身体部分の位置を入力できるので、より自然な仮想指示棒の操作感が得られる。
【０２３１】
また、仮想指示棒に関する設定時のみならず、座標入力ペン２１を用いて実際に座標入力を行う場合にも表示領域外入力が可能なので、操作範囲に領域制限が少なくなる。
【０２３２】
更に、実施形態６の座標入力装置のように、Ｚ軸方向の座標入力が可能な場合には、例えば、Ｚ座標に応じて、仮想指示棒の長さを自動的に変化させて仮想支持棒先端指示座標（Ｘ，Ｙ）を算出してもよい。
【０２３３】
具体的には、Ｚ座標に肘からペン先（指先）までの長さと所望の指示棒先端までの長さの比である拡大率Ｄを比例させることにより、自然な操作感を実現することができる。また、頻繁に拡大率Ｄが変化するのが望ましくない場合には、Ｚ座標の段階的な範囲内の変動に対しては、拡大率Ｄが一定となるようにしても良い。
【０２３４】
尚、本発明は上記実施形態１〜６に限定されず、用途や目的に応じて、この実施形態１〜６を任意に組み合わせて実現される実施形態を構成しても良いことは言うまでもない。
【０２３５】
以上説明した実施形態１〜６における、座標入力装置は、パーソナルコンピュータ等の情報処理装置でもって実現できるし、その機能を実現する手順としての方法の発明として捉えることができる。また、コンピュータにより実現できるわけであるから、本発明はそれぞれの装置で実行されるコンピュータプログラム、更には、そのコンピュータプログラムを格納し、コンピュータが読み込めるＣＤ−ＲＯＭ等のコンピュータ可読記憶媒体にも適用できるのは明らかであろう。
【０２３６】
従って、上記実施形態１〜６に係る実施態様を列挙すると、次の通りである。すなわち、座標入力装置及びその制御方法、プログラムは、次のようになる。
【０２３７】
＜実施態様１＞ 座標入力面上で指示された位置の入力座標を検出し、該入力座標に基づく座標を出力する座標入力装置であって、
操作者によって指示された座標入力面上の位置の入力座標を検出する検出手段と、
前記入力座標を拡大するための基準となる拡大基準点を入力する拡大基準点入力手段と、
前記入力座標を拡大する拡大率を決定するための拡大率基準点を入力する拡大率基準点入力手段と、
前記入力座標と前記拡大率基準点との位置関係に基づいて、前記拡大率を決定する決定手段と、
前記拡大率と前記拡大基準点に基づいて、前記拡大基準点と前記入力座標を結ぶ方向に前記入力座標を拡大した座標を算出する算出手段と、
前記算出手段で算出された座標を出力する座標出力手段と、
を備えることを特徴とする座標入力装置。
【０２３８】
＜実施態様２＞ 前記決定手段は、前記入力座標と前記拡大率基準点との距離に基づいて、前記拡大率を決定する
ことを特徴とする実施態様１に記載の座標入力装置。
【０２３９】
＜実施態様３＞ 操作者の身体情報を記憶する記憶手段とを更に備え、
前記拡大基準点入力手段は、前記身体情報に基づいて、前記拡大基準点を算出することで、該拡大基準点を入力する
ことを特徴とする実施態様１に記載の座標入力装置。
【０２４０】
＜実施態様４＞ 前記拡大基準点入力手段は、前記入力座標と前記身体情報に基づいて、前記拡大基準点を算出することで、該拡大基準点を入力する
ことを特徴とする実施態様３に記載の座標入力装置。
【０２４１】
＜実施態様５＞ 前記拡大基準点は、前記操作者の肘の位置に対応する
ことを特徴とする実施態様１に記載の座標入力装置。
【０２４２】
＜実施態様６＞ 前記拡大基準点は前記操作者の肘の位置に対応し、前記拡大率基準点は前記操作者の肩の位置に対応する
ことを特徴とする実施態様１に記載の座標入力装置。
【０２４３】
＜実施態様７＞ 複数種類の拡大基準点を記憶する記憶手段を更に備え、
前記算出手段は、前記検出手段で検出された入力座標が属する座標入力面上の領域に対応する拡大基準点を前記記憶手段より取得し、その取得した拡大基準点と所定拡大率に基づいて、前記入力座標を拡大した座標を算出する
ことを特徴とする実施態様１に記載の座標入力装置。
【０２４４】
＜実施態様８＞ 前記拡大基準点を、前記座標入力面を複数の領域に分割した各分割領域毎に記憶する記憶手段を更に備え、
前記算出手段は、前記検出手段で検出された入力座標が属する座標入力面上の分割領域に対応する拡大基準点を前記記憶手段より取得し、その取得した拡大基準点と所定拡大率に基づいて、前記入力座標を拡大した座標を算出する
ことを特徴とする実施態様１に記載の座標入力装置。
【０２４５】
＜実施態様９＞ 複数種類の拡大率と拡大基準点を記憶する記憶手段を更に備え、
前記算出手段は、前記検出手段で検出された入力座標が属する座標入力面上の領域に対応する拡大基準点と拡大率を前記記憶手段より取得し、その取得した拡大基準点と拡大率に基づいて、前記入力座標を拡大した座標を算出する
ことを特徴とする実施態様１に記載の座標入力装置。
【０２４６】
＜実施態様１０＞ 前記算出手段は、前記検出手段で検出された入力座標が属する座標入力面上の領域が座標の拡大を行わない等倍領域である場合は、前記入力座標を等倍した座標を算出する
ことを特徴とする実施態様１に記載の座標入力装置。
【０２４７】
＜実施態様１１＞ 前記座標入力面を分割する分割領域と、該分割領域に対応する拡大基準点及び拡大率を設定する設定手段を更に備える
ことを特徴とする実施態様７乃至９のいずれかに記載の座標入力装置。
【０２４８】
＜実施態様１２＞ 前記座標入力面を分割する分割領域と、該分割領域に対応する拡大基準点及び拡大率を記憶する記憶手段を更に備え、
前記設定手段は、前記記憶手段を参照して、前記操作者に関する操作者情報に対応する拡大基準点を設定する
ことを特徴とする実施態様１１に記載の座標入力装置。
【０２４９】
＜実施態様１３＞ 複数種類の拡大率と拡大基準点を記憶する記憶手段を更に備え、
前記検出手段が、前記座標入力面上の複数の分割領域にまたがって連続的に入力座標を検出する場合、前記算出手段は、前記検出手段で最初に検出された入力座標が属する座標入力面上の領域に対応する拡大基準点と拡大率を前記記憶手段より取得し、その取得した拡大基準点と拡大率に基づいて、前記入力座標を拡大した座標を算出する
ことを特徴とする実施態様１に記載の座標入力装置。
【０２５０】
＜実施態様１４＞ 前記検出手段で検出された入力座標に基づいて、前記拡大率を入力する拡大率入力手段を更に備える
ことを特徴とする実施態様１に記載の座標入力装置。
【０２５１】
＜実施態様１５＞ 前記座標入力面を分割する分割領域の内、座標の拡大を行わない等倍領域が設定されている場合、該等倍領域に基づいて、前記拡大率を入力する拡大率入力手段を更に備える
ことを特徴とする実施態様１に記載の座標入力装置。
【０２５２】
＜実施態様１６＞ 前記拡大率に基づいて、座標の拡大を行わない等倍領域を前記座標入力面内に設定する設定手段を更に備える
ことを特徴とする実施態様１に記載の座標入力装置。
【０２５３】
＜実施態様１７＞ 前記座標入力面上を指示するための、音波発生部を有する指示手段とを更に備え、
前記検出手段は、前記座標入力面の周辺部に設けられた複数の検出手段で構成され、前記指示手段から発生した音波を該複数の検出手段が受信した受信タイミングに基づいて、該指示手段によって指示された座標入力面上の位置の入力座標を検出する
ことを特徴とする実施態様１に記載の座標入力装置。
【０２５４】
＜実施態様１８＞ 座標入力面上で指示された位置の入力座標を検出し、該入力座標に基づく座標を出力する座標入力装置の制御方法であって、
操作者によって指示された座標入力面上の位置の入力座標を検出する検出工程と、
前記入力座標を拡大するための基準となる拡大基準点を入力する拡大基準点入力工程と、
前記入力座標を拡大する拡大率を決定するための拡大率基準点を入力する拡大率基準点入力工程と、
前記入力座標と前記拡大率基準点との位置関係に基づいて、前記拡大率を決定する決定工程と、
前記拡大率と前記拡大基準点に基づいて、前記拡大基準点と前記入力座標を結ぶ方向に前記入力座標を拡大した座標を算出する算出工程と、
前記算出工程で算出された座標を出力する座標出力工程と、
を備えることを特徴とする座標入力装置の制御方法。
【０２５５】
＜実施態様１９＞ 座標入力面上で指示された位置の入力座標を検出し、該入力座標に基づく座標を出力する座標入力装置の制御をコンピュータで実現するプログラムであって、
操作者によって指示された座標入力面上の位置の入力座標を検出する検出工程のプログラムコードと、
前記入力座標を拡大するための基準となる拡大基準点を入力する拡大基準点入力工程のプログラムコードと、
前記入力座標を拡大する拡大率を決定するための拡大率基準点を入力する拡大率基準点入力工程のプログラムコードと、
前記入力座標と前記拡大率基準点との位置関係に基づいて、前記拡大率を決定する決定工程のプログラムコードと、
前記拡大率と前記拡大基準点に基づいて、前記拡大基準点と前記入力座標を結ぶ方向に前記入力座標を拡大した座標を算出する算出工程のプログラムコードと、
前記算出工程で算出された座標を出力する座標出力工程のプログラムコードと、
を備えることを特徴とするプログラム。
【０２５６】
以上、実施形態例を詳述したが、本発明は、例えば、システム、装置、方法、プログラムもしくは記憶媒体等としての実施態様をとることが可能であり、具体的には、複数の機器から構成されるシステムに適用しても良いし、また、一つの機器からなる装置に適用しても良い。
【０２５７】
尚、本発明は、前述した実施形態の機能を実現するソフトウェアのプログラム（実施形態では図に示すフローチャートに対応したプログラム）を、システムあるいは装置に直接あるいは遠隔から供給し、そのシステムあるいは装置のコンピュータが該供給されたプログラムコードを読み出して実行することによっても達成される場合を含む。
【０２５８】
従って、本発明の機能処理をコンピュータで実現するために、該コンピュータにインストールされるプログラムコード自体も本発明を実現するものである。つまり、本発明は、本発明の機能処理を実現するためのコンピュータプログラム自体も含まれる。
【０２５９】
その場合、プログラムの機能を有していれば、オブジェクトコード、インタプリタにより実行されるプログラム、ＯＳに供給するスクリプトデータ等の形態であっても良い。
【０２６０】
プログラムを供給するための記録媒体としては、例えば、フロッピー（登録商標）ディスク、ハードディスク、光ディスク、光磁気ディスク、ＭＯ、ＣＤ−ＲＯＭ、ＣＤ−Ｒ、ＣＤ−ＲＷ、磁気テープ、不揮発性のメモリカード、ＲＯＭ、ＤＶＤ（ＤＶＤ−ＲＯＭ，ＤＶＤ−Ｒ）などがある。
【０２６１】
その他、プログラムの供給方法としては、クライアントコンピュータのブラウザを用いてインターネットのホームページに接続し、該ホームページから本発明のコンピュータプログラムそのもの、もしくは圧縮され自動インストール機能を含むファイルをハードディスク等の記録媒体にダウンロードすることによっても供給できる。また、本発明のプログラムを構成するプログラムコードを複数のファイルに分割し、それぞれのファイルを異なるホームページからダウンロードすることによっても実現可能である。つまり、本発明の機能処理をコンピュータで実現するためのプログラムファイルを複数のユーザに対してダウンロードさせるＷＷＷサーバも、本発明に含まれるものである。
【０２６２】
また、本発明のプログラムを暗号化してＣＤ−ＲＯＭ等の記憶媒体に格納してユーザに配布し、所定の条件をクリアしたユーザに対し、インターネットを介してホームページから暗号化を解く鍵情報をダウンロードさせ、その鍵情報を使用することにより暗号化されたプログラムを実行してコンピュータにインストールさせて実現することも可能である。
【０２６３】
また、コンピュータが、読み出したプログラムを実行することによって、前述した実施形態の機能が実現される他、そのプログラムの指示に基づき、コンピュータ上で稼動しているＯＳなどが、実際の処理の一部または全部を行ない、その処理によっても前述した実施形態の機能が実現され得る。
【０２６４】
さらに、記録媒体から読み出されたプログラムが、コンピュータに挿入された機能拡張ボードやコンピュータに接続された機能拡張ユニットに備わるメモリに書き込まれた後、そのプログラムの指示に基づき、その機能拡張ボードや機能拡張ユニットに備わるＣＰＵなどが実際の処理の一部または全部を行ない、その処理によっても前述した実施形態の機能が実現される。
【０２６５】
【発明の効果】
以上説明したように、本発明によれば、指示箇所の視認性を向上することができる座標入力技術を提供できる。
【図面の簡単な説明】
【図１】本発明の実施形態１の座標入力装置による座標入力方法を説明するための図である。
【図２】本発明の実施形態１の座標入力装置による座標入力方法を説明するための図である。
【図３】本発明の実施形態１の座標算出処理を示すフローチャートである。
【図４】本発明の実施形態２の座標入力装置による座標入力方法を説明するための図である。
【図５】本発明の実施形態２の座標算出処理を示すフローチャートである。
【図６】本発明の実施形態３の座標入力装置による座標入力方法を説明するための図である。
【図７】本発明の実施形態３の座標算出処理を示すフローチャートである。
【図８】本発明の実施形態４の座標入力装置による座標入力方法を説明するための図である。
【図９】本発明の実施形態４の座標算出処理を示すフローチャートである。
【図１０】本発明の実施形態５の座標入力装置による座標入力方法を説明するための図である。
【図１１】本発明の実施形態５の座標算出処理を示すフローチャートである。
【図１２】本発明の実施形態６の座標入力装置の座標入力ペンの基本構成を示す図である。
【図１３】本発明の実施形態６の座標入力装置の基本構成を示すブロック図である。
【図１４】本発明の実施形態６の３次元（空間）座標計測可能な座標入力装置の概略構成を示す図である。
【図１５】本発明の実施形態６の座標入力ペンの構成を示す図である。
【図１６】本発明の実施形態６の音波の到達時間検出方法を説明するためのタイミングチャートである。
【図１７】本発明の実施形態６の音波の到達時間検出を実現する検出回路のブロック図である。
【図１８】本発明の実施形態６の演算制御回路の概略構成を示すブロック図である。
【図１９】本発明の実施形態６の３次元（空間）座標入力可能な座標入力装置の座標算出方法を説明するための図である。
【図２０】従来技術を説明するための図である。
【符号の説明】
２１ 座標入力ペン
３０２ 駆動回路
３０３ 発振子
３０４ 座標入力装置
３０５ 超音波センサ
３０６ 波形処理回路
３０７ ＣＰＵ
３０８ 座標算出プログラム
３０９ 文字認識エンジン
３１０ メモリ
３１１ 無線インタフェース
３１２ ＲＯＭ[0001]
TECHNICAL FIELD OF THE INVENTION
The present invention relates to a coordinate input / output technique for detecting input coordinates of a position designated on a coordinate input surface and outputting coordinates based on the input coordinates.
[0002]
[Prior art]
2. Description of the Related Art Conventionally, a coordinate input device capable of inputting coordinates is disposed on a display surface of a display device such as a CRT display, a liquid crystal display (LCD), or a projector, so that pointing or handwriting performed by an operator can be performed. 2. Description of the Related Art Devices that can be displayed on a display and realize a relationship like paper and a pencil are known.
[0003]
Examples of the coordinate input device include a resistive film type, an electrostatic type, an ultrasonic type that transmits ultrasonic waves to a coordinate input surface such as glass, an ultrasonic type, a type having a transparent input plate, an optical type, or a type in which sound waves are transmitted in the air. There is a method of detecting a position by emitting light. Furthermore, as in the electromagnetic induction (electromagnetic transfer) system, a mechanism for calculating coordinates is arranged on the back side of the display device, and a transparent protective plate is arranged on the front of the display device to configure an information device with integrated input and output Some do.
[0004]
Such information devices began with small electronic organizers having portability, and with the increase in size of display devices such as pen input computers, relatively large-sized information devices have come to be seen. Then, in combination with a front projector, a rear projector, or a large display device such as a large liquid crystal display or a plasma display, it has begun to be used for a presentation device, a TV conference system, and the like.
[0005]
These large liquid crystal displays and plasma displays are still being improved in image quality and cost reduction, and with the digitalization of satellite broadcasting and the like, the specification of televisions is entering a transitional state.
[0006]
In addition, these large display devices, for example, in place of a whiteboard or electronic blackboard used in the office, by displaying data for materials prepared in advance in a terminal such as a personal computer on the large display device, It has begun to be used for meetings and meetings. In that case, the information displayed on the display for display is controlled by directly touching the screen to update the display information by the operator or the attendees, such as a whiteboard, for example, the display screen. Is configured to be able to switch the display content.
[0007]
[Problems to be solved by the invention]
However, such a large-sized integrated input / output system has the following problems.
[0008]
This type of large-sized integrated input / output system can be used as a conference system in business, but it is particularly useful for explaining important matters prior to voting, selling new products to customers, explaining new plans, etc. Presentation applications occupy an important place.
[0009]
On the other hand, in a conventional presentation, OHP is often used. In such a case, it is common to use a pointing stick or a pointing stick in order to clarify an explanation place and strengthen an impression. The important thing at the time of presentation is how to convey the contents accurately and impressively to the audience, and have persuasiveness. To that end, it is effective for the presenter to speak in the eyes of the listener.
[0010]
In some cases, it is also required to be flexible, such as changing the way of explanation while listening to the response of the listener, and a presentation using a pointing stick with the face and body directed to the listener is effective. The advantage of the wand is that the presenter can stand by the screen himself and speak to the listener accurately while instructing the contents on the screen, thus giving an effective presentation. It can be said that it is a means of instruction that has been used on a daily basis and has a proven track record. Moreover, since the pointed position is indicated by the tip of the bar, the visibility is good and the listener can easily check the pointed position.
[0011]
However, when the screen is large, there is a drawback that an area that cannot be reached by the length of the pointer cannot be pointed, and in order to solve the problem, the length becomes longer and the weight becomes heavier. In addition, there is a disadvantage that the length of the pointing rod is constant, and the length of the pointing rod cannot be changed depending on the screen size and the pointed position. To improve this, foldable pointer bars also exist, but length and weight problems still remain. In other words, in order to change the length, bothersome stretching work is required, and the length of the extension is limited. Furthermore, there is a concern that the screen may be damaged due to the tip of the indicator stick touching the screen surface.
[0012]
In contrast to this, there is a laser pointer used not only when the screen is large but also when the distance from the screen is large. Since the laser pointer is relatively small and light, it is easy to use and the use thereof is increasing. However, in recent years, there is a concern that the laser beam may cause eye damage, causing a problem in safety, and at the same time, compared with the pointing stick, since the pointing is performed only with the point, it is difficult for the listener to visually recognize the pointed position. There was a drawback that it was difficult to follow.
[0013]
Furthermore, both the conventional pointing rod (pointing rod) and the laser pointer are merely pointing means for a simple display surface, and needless to say, there is no information input function by coordinate input to an information device having a large display device. Not even.
[0014]
On the other hand, as a form of presentation that has been rapidly established in recent years, a computer screen of a personal computer (PC) is projected on a large screen by a projector, and an instruction is given to the computer screen by an input device such as a mouse. It is a form.
[0015]
The presentation using this PC can be visually and effectively appealing using the graphics screen realized by the PC, and the electronic information can be displayed as it is, which is more convenient than the presentation using the conventional OHP. Excellent in nature. However, when using a mouse to indicate an emphasis point or the like, the presenter is located on the PC side and operates the mouse while looking at the PC screen or sitting down. , The visibility of the cursor is inferior. In addition, there is a problem that the presenter lacks persuasiveness because the presenter stands by the screen and does not face the listener.
[0016]
Furthermore, the movement of the mouse cursor is an input device originally designed for the operator to operate while looking at the small display screen of the PC at a short distance from the eyes on the desk, and the repetitive movement of the mouse on the mouse pad is performed. This is a relative coordinate input method for inputting coordinates in response to various operations. As is well known, in the PC, the enlargement ratio when the input coordinates are enlarged and the coordinates are output at a fixed magnification with respect to the moving distance of the mouse can be arbitrarily set. FIG. 20 schematically illustrates the coordinate expansion method in the conventional relative coordinate input method represented by a mouse or the like.
[0017]
In FIG. 20, the start point of a series of operations is defined as a reference point (x₀, Y₀), The locus of the coordinates input by the mouse is represented by O (x₀, Y₀) → a (x, y) trajectory. Here, if the enlargement ratio is set to twice, the output coordinates are O (x₀, Y₀) → Draw a locus of A (X, Y). In this case, since the enlargement ratio is twice as large as the reference point O, which is the starting point, X = 2x and Y = 2y.
[0018]
Here, the starting point of the input coordinates and the output coordinates of the mouse is set to the same point for simplification of description, but there is usually an offset. In addition, because of the relative coordinate system, this offset is generated each time the mouse is repeatedly lifted from the mouse pad (corresponding to pen-up in pen input) and repositioned (corresponds to pen-down in pen input). It is well known that it fluctuates.
[0019]
On the other hand, the movement of the tip of the pointing rod (= output coordinates) is, of course, an absolute coordinate system, and if the position of the hand holding the pointing rod is used as the input coordinates, it is indicated exactly on the extension of the arm around the elbow. The movement of the tip of the bar (= output coordinates) is typical.
[0020]
Therefore, in the above-described relative enlarged (reduced) coordinate system with respect to an arbitrary reference point in a relative coordinate system represented by a conventional mouse, the conventional pointing stick as an effective presentation tool for a large display device. It is difficult to reflect the movement of the (pointing rod), and it is difficult to effectively realize coordinate input like a pointing rod.
[0021]
Specifically, in the relative enlargement (reduction) coordinate system with respect to an arbitrary reference point in the above-described conventional relative coordinate system represented by mouse input, an operation on a display screen of a personal computer having a relatively small screen is as described above. Then, the mouse is lifted from the mouse pad (corresponding to pen-up in pen input) and re-placed (corresponding to pen-down in pen input), and the offset between input coordinates and output coordinates fluctuates. The entire input range can be covered.
[0022]
However, in the large-screen input / output integrated system, which is the main object of the present invention, when realizing usability like a conventional indicator rod, the offset variation of the relative coordinate system as described above may be reduced. Because it is an absolute coordinate system that does not cause operations, it is difficult to specify and cover the entire area of the large screen from the nearest corner part to the farthest corner with the usual fixed magnification setting Is accompanied.
[0023]
In addition, in a relative enlarged (reduced) coordinate system with respect to an arbitrary reference point in a relative coordinate system represented by the above-mentioned conventional mouse input, a continuous series of input states in which the reference point is kept pen-down at the same time as the enlargement ratio. In, the reference point for enlargement is fixed, this is canceled at the time of pen-up, and the start point of the next pen-down becomes the reference point for the next continuous series of input states. However, when the position fluctuation of the reference point is applied to a large-screen input / output integrated system, the reference point fluctuates each time for an input form such as a conventional indicator rod, and the continuity between strokes disappears. Since there is no relation between the reference point and the input operation of the operator, if the relative coordinate system in the conventional mouse input is used as it is for the input of the virtual pointing rod, the usability is a problem.
[0024]
As described above, there has been a demand for a coordinate input unit having excellent operability of a large-screen input / output integrated system having both the usability of a conventional indicator rod.
[0025]
The present invention has been made to solve the above-described problem, and has as its object to provide a coordinate input technique capable of improving the visibility of a designated portion.
[0026]
[Means for Solving the Problems]
A coordinate input device according to the present invention for achieving the above object has the following configuration. That is,
A coordinate input device that detects input coordinates of a position specified on a coordinate input surface and outputs coordinates based on the input coordinates,
Detecting means for detecting input coordinates of a position on the coordinate input surface specified by the operator;
Enlargement reference point input means for inputting an enlargement reference point serving as a reference for enlarging the input coordinates,
Magnification ratio reference point input means for inputting a magnification ratio reference point for determining a magnification ratio for enlarging the input coordinates,
Determining means for determining the magnification, based on the positional relationship between the input coordinates and the magnification reference point,
Calculation means for calculating coordinates obtained by enlarging the input coordinates in a direction connecting the enlargement reference point and the input coordinates, based on the enlargement ratio and the enlargement reference point,
Coordinate output means for outputting the coordinates calculated by the calculation means,
Is provided.
[0027]
BEST MODE FOR CARRYING OUT THE INVENTION
Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.
[0028]
<< First Embodiment >>
First, a coordinate calculation method for calculating output coordinates with respect to input coordinates in a coordinate input means (hereinafter, referred to as a virtual pointing stick) for realizing the usability of a pointing stick (pointing stick) which is the main feature of the present invention will be described with reference to FIG. This will be described using FIG.
[0029]
FIG. 1 is a diagram for explaining a coordinate input method by the coordinate input device according to the first embodiment of the present invention.
[0030]
FIG. 1 assumes a large-screen integrated input / output system in order to better illustrate the features of the present invention. The system shown in FIG. 1 is an example of a system in which a coordinate input device is built in a rear projection display device 101. This device is an integrated input / output system, in which various information output by a computer connected to the system is displayed on a screen 102, and the coordinate input pen 21 inputs coordinate data by directly touching the screen 102. be able to.
[0031]
That is, the coordinate input surface in the integrated input / output system is formed by a surface overlapping the screen 102. The coordinate data input via the coordinate input surface can be used for icon operations (computer operations), cursor movement, graphic drawing (cursor locus), and the like.
[0032]
The coordinate input device calculates the input coordinates of the coordinate input pen 21 and, in order to make the coordinate input pen 21 function as a virtual pointing rod, calculates the virtual pointing rod tip pointing coordinates based on the input coordinates and sends the coordinates to the computer. Send out. On the other hand, the computer causes the screen 102 of the rear projection display device 101 to feed back an image based on the virtual pointing rod tip pointing coordinates. Thus, the operator can use the coordinate input pen 21 as a virtual pointing stick (virtual pointing stick), and can operate the computer with the virtual pointing stick, for example.
[0033]
Although the coordinate input means in the coordinate input device of FIG. 1 uses the coordinate input pen 21, a touch panel method may be used as long as it can input coordinates on the coordinate input surface.
[0034]
The coordinate input device is a standard component (for example, a CPU, a RAM, a ROM, a hard disk, an external storage device, a network interface, a display, a keyboard, a mouse, etc.) mounted on a general-purpose computer such as a personal computer or a workstation. have.
[0035]
Further, the coordinate input device has hardware or software for realizing the coordinate calculation processing of each embodiment described below.
[0036]
Next, a coordinate calculation process performed by the coordinate input device according to the first embodiment will be described with reference to FIGS.
[0037]
FIG. 2 is a diagram for explaining a coordinate input method by the coordinate input device according to the first embodiment of the present invention. FIG. 3 is a flowchart illustrating the coordinate calculation process according to the first embodiment of the present invention.
[0038]
Here, with respect to the coordinates (x, y) input by the coordinate input pen 21 in FIG. 1, the virtual pointing rod tip pointing coordinates (X, y) which are the tip coordinates of the virtual pointing rod are obtained by the coordinate calculation processing of the flowchart shown in FIG. 3. The processing procedure for outputting Y) will be described.
[0039]
Prior to describing the specific coordinate calculation processing of the first embodiment in conjunction with the flowchart shown in FIG. 3, first, the virtual pointing rod based on the position of the elbow moving with the shoulder position as a fulcrum, which is a feature of the present invention, is described. The coordinate calculation principle for calculating the tip designation coordinates will be described. By this coordinate calculation principle, a more natural operation environment for the operation of the operator can be realized.
[0040]
As shown in FIG. 2, the motion of the human arm is not limited to the motion using only the elbow as a fulcrum, but is a composite motion with the motion using the shoulder as a fulcrum.
[0041]
The principle of the coordinate calculation of the present invention is based on the human shoulder reference point O₀(X₀, Y₀) Is constant, the coordinates indicated by the coordinate input pen 21 (or the touch panel) indicated by the hatched area in the figure are the position of the elbow (elbow reference point) Oe (x_e, Y_e), And that it is determined by the function of the elbow angle θe.
[0042]
In this case, the elbow reference point Oe (x_e, Y_e) Satisfies the following equation.
[0043]
(X_e-X₀)²+ (Y_e) -Y₀)²= Re²
On the other hand, the elbow reference point Oe (x_e, Y_e) As a reference, the pen indicated point (x, y) satisfies the following equation:
(Xx_e)²+ (Y-y_e)²= (R-re)²
Therefore, conversely, the shoulder reference point O₀(X₀, Y₀) And the pen pointing point (x, y) are obtained, the position of the elbow (elbow reference point) Oe (x_e, Y_e), And the angle θe of the elbow can be calculated.
[0044]
Here, the elbow reference point Oe (x_e, Y_e) Is (x_e1, Y_e1) And (x_e2, Y_e2)
The angle θe between the elbow and the arm is
θe <90 °
Therefore, the above two points are:
y_e1  <Y_e2
Becomes Therefore, the point satisfying this condition is (x_e1, Y_e1) Calculated by the elbow reference point Oe (x_e, Y_e).
[0045]
Also, θe = tan^-1((Y-y_e1) / (Xx_e1))
Can be calculated.
[0046]
If the pen pointing point (x, y) can be calculated as described above, the reference point Oe (x_e1, Y_e1), And the angle θe between the elbow and the arm can be calculated. Then, based on these data, the tip pointing coordinates (X, Y) of the virtual support bar can be calculated.
[0047]
Explaining a specific coordinate calculation process based on the above conditions, the processing procedure is as shown in FIG.
[0048]
Note that the coordinate expansion processing described in the present invention is, in other words, processing of outputting coordinates obtained by multiplying input coordinates by a magnification (magnification rate) described below. It can also be described as a conversion process for converting input coordinates into different coordinates. Here, for the operator, since the coordinates output by this processing are visually recognized as if the input coordinates are output as enlarged coordinates, in the following description, for the sake of convenience, the above processing will be referred to as the coordinate expansion. Expressed as processing.
[0049]
First, prior to the actual coordinate input operation, in steps F1-1 to 1-5, settings relating to the virtual pointing rod are performed.
[0050]
First, in step F1-1, the shoulder reference point O, which is the position of the shoulder of the operator.₀(X₀, Y₀). This shoulder reference point is an enlargement ratio reference point for determining an enlargement ratio when the input coordinates are enlarged based on the coordinates.
[0051]
Regarding the input of the shoulder reference point, the coordinates corresponding to the shoulder reference point on the coordinate input surface corresponding to the screen 102 may be numerically input by an input device such as a keyboard. Alternatively, the coordinate input pen 21 may be applied to the position of the shoulder to input the position as a shoulder reference point. Further, as the shoulder reference point, not only the coordinates within the coordinate input plane corresponding to the screen 102 but also the coordinates of an area outside the coordinate input plane corresponding to the screen 102 may be input.
[0052]
However, since the input range of the coordinate input pen 21 and the touch panel is usually limited to an area in the coordinate input surface corresponding to the screen 102, there is no problem when inputting the shoulder reference point with an input device such as a keyboard. When the coordinate input pen 21 is applied to the position of the shoulder to input the position as a shoulder reference point, the input range is limited to an area in the coordinate input plane corresponding to the screen 102. Further, the setting of the various setting values (shoulder reference point, elbow reference point, enlargement ratio, etc.) may be performed along a menu screen in application software.
[0053]
Next, in step F1-2, the farthest diagonal point (x₂, Y₂) Enter the coordinates. Since this numerical value is usually a known value as the size of the display screen 102 of the coordinate input device, it may be stored in the memory of the coordinate input device at the time of shipment from the factory, or the coordinate value may be stored in an input device such as a keyboard. May be entered directly. Further, after the power is turned on or every time initial setting is performed before use, various setting values may be input by designating a target position with the coordinate input pen 21 (or touch panel).
[0054]
Next, in step F1-3, the elbow reference point Oe (x_e, Y_e).
[0055]
Regarding the input of the elbow reference point, for example, with the operator holding the coordinate input pen 21, the diagonal furthest point (x₂, Y₂The user touches the coordinate input pen 21 at the position of the operator's elbow when instructing the direction of (1) (or inputs the coordinates of the position of the elbow with an input device such as a keyboard) and inputs the position as an elbow reference point. The elbow reference point is an enlargement reference point for determining a reference when enlarging input coordinates based on the coordinates.
[0056]
In step F1-3, the distance re from the shoulder to the elbow of the operator is set. At the same time, a maximum value bmax of the length b from the elbow to the tip of the virtual pointing rod is set. This bmax is calculated by the following equation.
[0057]
bmax = (x₂-X_e0) Secθ
Where θ = tan^-1((Y₂-Y_e0) / (X₂-X_e0))
It is.
[0058]
Next, in Step F1-4, the pen tip position of the coordinate input pen 21 (or the fingertip position of the touch panel) (x₁, Y₁). Regarding this input, similarly to step F1-3, the operator holds the coordinate input pen 21 and the diagonally distant point (x₂, Y₂) Is input at the time of virtual instruction (or the position of the pointing finger on the touch panel).
[0059]
Also, the length a (= R-re, R: distance from the shoulder to the pen tip position) from the elbow to the pen tip (finger tip), and the shoulder reference point O₀(X₀, Y₀) And a pen (touch panel) designated coordinate (x, y), the maximum value Cmax of the x-coordinate distance C is set.
[0060]
The length a is calculated by the following equation.
[0061]
a = (x₁-X_e0) Secθ
θ = tan^-1((Y₁-Y_e0) / (X₁-X_e0))
= Tan^-1((Y₂-Y_e0) / (X₂-X_e0))
The length a is also the maximum value bmin of the length b from the elbow of the operator to the tip of the virtual pointing rod.
[0062]
The maximum value Cmax is calculated by the following equation.
[0063]
Cmax = x₁-X₀
Steps F1-3 and F1-4 described above may be performed simultaneously as one step.
[0064]
Next, in step F1-5, the nearest point (x₃, Y₃) Enter the coordinates (default). Thereby, the minimum value Cmin of the distance C is set.
[0065]
The minimum value Cmin is calculated by the following equation.
[0066]
Cmin = x₃-X₀
In the above steps F1-1 to F1-5, the setting of various setting values related to the virtual pointing stick and the arm is completed.
[0067]
Regarding the input of the shoulder reference point in step F1-1 and the input of the elbow reference point in F1-3, either an input device such as a keyboard or the coordinate input pen 21 is used as the input method. In any case, since the actual input operation is complicated, for example, a typical reference point candidate may be prepared and easily selected on a menu selection screen.
[0068]
Further, by giving physical information of the operator (distance re from the shoulder to the elbow and length a from the elbow to the pen tip (fingertip)) as a predetermined typical known value, in step F1-3, Diagonal furthest point (x₂, Y₂), The shoulder reference point and the elbow reference point may be automatically calculated by inputting only one point.
[0069]
In the next steps F1-6 to F1-9, in the case of the actual coordinate input pen 21 or the touch panel, the coordinate calculation processing of the virtual support rod tip pointing coordinate corresponding to the touch position is performed, and the calculated coordinate value is output. .
[0070]
First, in step F1-6, input coordinates (x, y) of the operator's actual coordinate input pen 21 (or touch position in the case of a touch panel) are detected. This is a coordinate calculation in a normal coordinate input method.
[0071]
Next, in step F1-7 and step F1-8, the virtual support rod tip instruction is performed based on the set values regarding the operator's shoulder, elbow, and virtual indicator rod calculated by the above-described processing, and the operator's designated coordinates. Calculate the coordinates.
[0072]
First, in step F1-7, the elbow reference point Oe (x) corresponding to the designated coordinates (x, y)_e, Y_e) And the angle θe between the elbow and the arm. Specifically, it is calculated by the following equation.
[0073]
(X_e-X₀)²+ (Y_e) -Y₀)²= Re²
(Xx_e)²+ (Y-y_e)²= (R-re)²
Then, two points (x_e1, Y_e1) And (x_e2, Y_e2)
y_e1<Y_e2Elbow reference point Oe (x_e, Y_e) Is calculated. Also, the calculated elbow reference point Oe (x_e, Y_e), The angle θe between the elbow and the arm is calculated by the following equation.
[0074]
θe = tan^-1((Y-y_e) / (Xx_e))
Next, in step F1-8, the virtual support rod tip designation coordinates (X, Y) are calculated, and the coordinates are output.
[0075]
Specifically, it is calculated and output by the following equation.
[0076]
(X, Y) = (x_e) + (Xx)_e) * D, y_e) + (Yy)_e) * D)
Here, D = b / a. That is, the position of the virtual support rod tip indicating coordinates (X, Y) is enlarged to the length b from the elbow to the virtual pointer tip with respect to the length a from the elbow to the pen tip (fingertip). Represents the magnification.
[0077]
This equation is based on the elbow reference point Oe (x_e, Y_e), The calculation of the coordinates enlarged in the direction connecting the enlargement reference point and the designated coordinates (x, y) which are the detection coordinates at the enlargement ratio D which fluctuates as shown below.
[0078]
The length a and the length b are
a = bmin ≦ b ≦ bmax
Is satisfied, the enlargement ratio D is
1 ≦ D ≦ bmax / a
Range.
[0079]
In the first embodiment, the enlargement ratio D is further set to the shoulder reference point O₀(X₀, Y₀) And pen (touch panel) designated coordinates (x, y) as a function of the distance C of the x coordinate. This is specifically shown by the following equation.
[0080]
D = (α-1) / β * c + 1 + cmin (α-1) / β
α = bmax / a, β = cmax−cmin
According to this formula, the position of the virtual support rod tip designation coordinates (X, Y) is determined by the operator at the diagonally farthest point (x₂, Y₂) Is virtually given, c = cmax. Therefore, the diagonally farthest point (x₂, Y₂), And the closest point (x₃, Y₃), C = cmin, and the enlargement ratio D is 1. Therefore, the nearest point (x₃, Y₃).
[0081]
Thus, the enlargement ratio D is equal to the shoulder reference point O which is the enlargement ratio reference point.₀(X₀, Y₀) And the pen-instructed coordinates (x, y) vary with the x-coordinate distance C, so that the entire area of the display screen 102 can be designated with the virtual pointing stick.
[0082]
In the first embodiment, the distance between the operator's shoulder reference point and the x coordinate of the input coordinate is used as a parameter for changing the enlargement ratio D, but this may be the distance between the two points. Further, the positional relationship between the position of another part of the operator and the designated coordinates may be varied. Further, the enlargement ratio D may be varied not in relation to the operator's part but in relation to, for example, the distance between a predetermined enlargement ratio reference point on the display device 101 and the input coordinates.
[0083]
Further, as shown in FIG. 2, the virtual support rod tip pointing coordinates (X, Y) are calculated from the operator's elbow as an enlargement reference point by the operator's actual coordinate input pen 21 (or in the case of a touch panel, In the angular direction toward the touch position (x, y)), a virtual instruction is given at a position multiplied by an enlargement factor D, which is a ratio of the length from the elbow to the pen tip (fingertip) to the tip of the desired virtual indicator rod. The coordinates of the tip of the bar can be output.
[0084]
Thereby, the reference point and the virtual pointing rod based on the physical condition of the operator, which cannot be realized in the enlarged (reduced) coordinate system for an arbitrary reference point in the relative coordinate system represented by the conventional mouse. Since the coordinates can be calculated based on the set values related to the coordinates, it is possible to realize an operational feeling with the pointing stick using the coordinate input pen 21 or a finger.
[0085]
Further, with the change of the position of the elbow forming the angle of the virtual pointing rod, the reference point also moves, so that an instruction can be given by the virtual pointing rod that is closer to the actual movement of the arm. This is because the elbow reference point corresponding to the input coordinate is always calculated based on the previously input shoulder reference point in accordance with the change of the coordinate input pen 21 or the touch position coordinate, and the angle from the elbow reference point toward the input position is calculated. Is the natural angle of the virtual indicator rod.
[0086]
Next, in step F1-9, it is determined whether or not there is a change in the condition (length and direction) of the virtual pointing rod by changing the various setting values calculated in steps F1-1 to F1-5. If there is a change (YES in step F1-9), the process returns to step F1-1. On the other hand, when there is no change (NO in step F1-9), the process returns to step F1-6.
[0087]
This change operation can be realized by, for example, selection from a menu or a switch of the coordinate input pen 21.
[0088]
In the first embodiment, the relationship between the shoulder and the elbow is described as a relatively simple coordinate input device based on a motion model in which the base of the shoulder is used as a fulcrum and the elbow is rotated about the fulcrum. Is for simplifying the coordinate calculation process, and is not limited to this. For example, corresponding to the actual human movement, the shoulder makes a constant curve movement with respect to the other fulcrum, and further performs coordinate calculation processing based on a more complicated movement model such as taking into account the movement of the wrist, A more accurate and natural movement may be realized.
[0089]
In addition, from the elbow of the operator as a reference point, the pen tip is moved from the elbow in an angular direction toward the input coordinates (x, y) of the operator's actual coordinate input pen 21 (or the touch position in the case of a touch panel). The coordinates of the tip of the virtual indicator rod are output at the position multiplied by the magnification ratio D, which is the ratio of the length to the fingertip and the length to the tip of the desired indicator rod. The coordinates may be output in consideration of the wrist angle in such a case.
[0090]
In other words, in order to output coordinates in a direction obtained by adding the angle θoff of the tilt of the wrist when the pointing rod (pointing rod) is further provided to the angle θ between the elbow and the arm as an angle offset, A configuration in which the angle θoff is set or input by the operation of the operator may be provided in advance.
[0091]
Further, the virtual pointing rod tip pointing coordinates are calculated based on the position of the elbow moving with the shoulder position as a fulcrum. However, the virtual pointing rod tip pointing coordinates may be further simplified to calculate the virtual pointing rod tip pointing coordinates using the elbow position as a fixed value. Good. In this case, the calculation load in the coordinate calculation process can be further reduced.
[0092]
As described above, according to the first embodiment, even when the coordinate input pen 21 (or touch input) is used, the large-screen input / output integrated operability having excellent visibility of the designated portion and excellent usability is excellent. A coordinate input device can be provided.
[0093]
In particular, according to the first embodiment, the virtual pointing rod tip pointing coordinates (for example, a cursor) corresponding to the input coordinates are output following the movement of the physical position of the operator's elbow and further the shoulder and the like. Output coordinates close to the locus of the tip of the conventional pointing rod can be output.
[0094]
The virtual pointing rod tip coordinates output by expanding the input coordinates are performed with respect to the reference point along the operator's motion, and the magnification itself follows the movement of the operator holding the pointing rod. Therefore, a natural input feeling can be obtained, and an instruction can be given to the entire input screen area of the large screen input / output integrated type.
[0095]
Further, it is not only possible to realize the operation like the conventional pointing rod, there is no limitation on the length of the defect of the conventional pointing rod, there is no burden on the hand, and there is little damage to the screen, and Since it is possible to input data to an electronic information device such as a connected PC or the like, a tool for an electronic conference represented by a more efficient presentation can be provided.
[0096]
In realizing the present invention, it is relatively easy to use the conventional input / output integrated device in terms of device limitations, while if the present invention is realized in a coordinate input device capable of three-dimensional input described later. Thus, it is possible to realize a more natural operation environment that is more faithful to the instruction operation of the operator.
[0097]
<< Embodiment 2 >>
In a second embodiment, a modified example of the first embodiment will be described.
[0098]
First, a coordinate calculation process performed by the coordinate input device according to the second embodiment will be described with reference to FIGS.
[0099]
FIG. 4 is a diagram for explaining a coordinate input method by the coordinate input device according to the second embodiment of the present invention. FIG. 5 is a flowchart illustrating a coordinate calculation process according to the second embodiment of the present invention.
[0100]
Here, a processing procedure for outputting the virtual pointing rod tip pointing coordinates (X, Y) by the coordinate calculation processing of the flowchart shown in FIG. 5 with respect to the input coordinates (x, y) by the coordinate input pen 21 in FIG. explain.
[0101]
First, in step F1-11, the input coordinates (x, y) of the operator's actual coordinate input pen 21 (or touch position in the case of a touch panel) are detected.
[0102]
Next, in step F1-21, the area of the area where the input coordinates (x, y) exist is determined.
[0103]
In the second embodiment, as shown in FIG. 4, the screen 102, which is a coordinate input surface, is divided into a left area A and a right area B, and this area information is stored in the coordinate input device in advance. deep.
[0104]
Here, assuming that the lower left corner coordinates of the screen 102 as the coordinate input surface are (0, 0) and the upper right corner coordinates are (a, b), the screen 102 is divided into a left area A and a right area B. The boundary line is x = a / 2.
[0105]
Therefore, in the area determination in step F1-21, it is determined whether or not the x coordinate of the input coordinate (x, y) satisfies x> a / 2. That is, when x> a / 2, the input coordinates (x, y) are determined to be in the right area B, and when X ≦ a / 2, the input coordinates (x, y) are in the left area A. Is determined.
[0106]
In step F1-21, if x> a / 2 (YES in step F1-21), the flow advances to step F1-31 to set the lower right corner coordinates OB (b, 0) of the right region B stored in advance as the enlargement reference. Point (x₀, Y₀). On the other hand, if X ≦ a / 2 (NO in step F1-21), the flow advances to step F1-41 to move the previously stored lower left corner coordinate OA (0, 0) of the left area B to the enlargement reference point (x₀, Y₀).
[0107]
Then, in step F1-51, the input coordinates (x, y) are enlarged by the enlargement ratio D and any one of the enlargement reference points of the reference points in each of the left area A and the right area B, and the tip of the virtual indicator rod is designated. The coordinates (X, Y) are calculated. Specifically, it is calculated and output by the following equation.
[0108]
(X, Y) = (x₀+ (Xx₀) * D, y₀+ (Y-y₀) * D)
The enlargement ratio D is the ratio of the length from the enlargement reference point to the pen tip (fingertip) designated position (x, y) and the length from the desired virtual pointing stick tip, and is stored in the coordinate input device in advance.
[0109]
As can be seen from this equation, the virtual support rod tip pointing coordinates (X, Y) are, as shown in FIG. 4, the input coordinates of the operator's actual coordinate input pen 21 (or the touch position in the case of a touch panel). In accordance with the area where (x, y) is present, the virtual pointing rod tip pointing coordinates are output from the outside of the area toward the center, which is the pointing destination of the virtual pointing rod, at a fixed magnification D. can do.
[0110]
When the operator stands on the left side of the display screen 102 and points to the left area B, the enlargement reference point is at the lower left, and (X_A, Y_AThe cursor is shown as the tip of the virtual pointing stick from the left to the center indicated by ()).
[0111]
On the other hand, in the case of the right side, the opposite is true, and a virtual instruction can be given to a person who is not automatically shaded by the operator based on the instruction position of the operator. This is an operation environment that cannot be realized in a conventional enlarged (reduced) coordinate system for an arbitrary reference point in a relative coordinate system represented by a mouse.
[0112]
Then, in a step F1-61, it is determined whether or not the coordinate input pen 21 is pen-up. If it is not pen-up (NO in step F1-61), the flow returns to step F1-61, and the above processing is repeated until pen-up is determined. On the other hand, if it is pen-up (YES in step F1-61), the process ends.
[0113]
In the second embodiment, the enlargement reference point in each area is provided in the lower corner area of each area. This is set on the premise that it is suitable as a reference point for defining the tip of. However, it is needless to say that, in order to further improve the operability, an enlargement reference point of each area may be set in an area other than the above depending on the shape, specification, and purpose of use of the display device 102.
[0114]
As described above, according to the second embodiment, in addition to the effects described in the first embodiment, the display position of the virtual pointing rod tip pointing coordinates is automatically switched according to the coordinate input area, so that the operation itself and the operation itself are always performed. The virtual pointing rod tip pointing coordinates can be output to a distant position, and the pointing portion can be prevented from being shadowed by the operator.
[0115]
<< Embodiment 3 >>
In the second embodiment, the screen 102, which is a coordinate input surface, is divided into a left area A and a right area B. However, in the third embodiment, in order to further improve operability, as shown in FIG. An intermediate area C is provided between A and the right area B. However, in this intermediate area C, the coordinate enlargement processing is not executed.
[0116]
Hereinafter, a coordinate calculation process performed by the coordinate input device according to the third embodiment will be described with reference to FIGS. 6 and 7.
[0117]
FIG. 6 is a diagram for explaining a coordinate input method by the coordinate input device according to the third embodiment of the present invention. FIG. 7 is a flowchart illustrating a coordinate calculation process according to the third embodiment of the present invention.
[0118]
Here, a processing procedure for outputting the virtual pointing rod tip pointing coordinates (X, Y) by the coordinate calculation processing of the flowchart shown in FIG. 7 with respect to the input coordinates (x, y) by the coordinate input pen 21 in FIG. explain.
[0119]
First, in step F2-1, the input coordinates (x, y) of the operator's actual coordinate input pen 21 (or touch position in the case of a touch panel) are detected.
[0120]
Next, in step F1-2, the area of the area where the input coordinates (x, y) exist is determined.
[0121]
In the third embodiment, as shown in FIG. 5, a left area A and a right area B facing the screen 102, which is a coordinate input surface, and an intermediate area C are provided.
[0122]
Here, assuming that the origin of the screen 102, which is the coordinate input surface, is the lower left corner coordinate (0, 0), the boundary between the left area A and the intermediate area C is X = a, and the boundary between the intermediate area C and the right area B is The boundary line is divided into regions so that X = b. Then, this area information is stored in the coordinate input device in advance.
[0123]
Therefore, in the area determination in step F2-2 and step F2-3, it is determined whether or not the x coordinate of the input coordinate (x, y) is x <a or x> b. That is, when x <a, the input coordinates (x, y) are determined to be in the left area A, and when a ≦ x <b, the input coordinates (x, y) are determined to be in the intermediate area C. If b ≦ x, the input coordinates (x, y) are determined to be in the right area B.
[0124]
Therefore, first, in step F2-2, when the x coordinate of the input coordinates (x, y) is x <a or x> b (YES in step F2-2), the process proceeds to step F2-3, where the input coordinates ( It is determined whether or not the x coordinate of (x, y) satisfies x <a. If x <a (YES in step F2-3), the flow advances to step F2-4 to move the previously stored lower left corner coordinates OA (0, 0) of the left area A to the enlargement reference point (x₀, Y₀). On the other hand, if X <a is not satisfied (NO in step F2-3), the process proceeds to step F2-5, and the lower right corner coordinates OB (c, 0) of the right region B stored in advance are set to the enlargement reference point (x₀, Y₀).
[0125]
Then, in the case of the left area A or the right area B, in step F2-7, the input coordinates (x, y) are enlarged by any of the enlargement reference points in each area and the enlargement ratio D, and the virtual pointing rod tip indication is performed. The coordinates (X, Y) are calculated. Specifically, it is calculated and output by the following equation.
[0126]
(X, Y) = (x₀+ (Xx₀) * D, y₀+ (Y-y₀) * D)
The enlargement ratio D is a ratio of the length from the reference point to the pen point (fingertip) pointed position (x, y) and the length from the desired virtual pointing rod tip, and is stored in the coordinate input device in advance.
[0127]
On the other hand, in step F2-2, if the x coordinate of the input coordinates (x, y) is not x <a or x> b (NO in step F2-2), the process proceeds to step F2-6, where the enlargement ratio D = 1. Is set, and the input coordinates (x, y) are output as they are.
[0128]
Then, in step F2-8, it is determined whether or not the coordinate input pen 21 has pen-uped. If it is not pen-up (NO in step F2-8), the process returns to step F2-1 and repeats the above processing until it is determined that pen-up has occurred. On the other hand, if it is pen-up (YES in step F2-8), the process ends.
[0129]
When the input is performed in the left area A or the right area B by the above processing, the cursor position of the virtual pointing stick suitable for each input position is calculated as in the first embodiment. When an input is made to the intermediate area C, the coordinates of the input position are output.
[0130]
In the instruction on the screen 102, which is a normal coordinate input surface, for example, in the case of input in the area on the left side, depending on the enlargement ratio, if the enlargement ratio is 2 or more, x = a of the screen 102 The virtual pointing rod tip pointing coordinates reach the right end of the screen 102, which is the coordinate input surface, on the left side of / 2, and there is no point in pointing the right side any further. That is, when the enlargement ratio is two times or more, an input area that is not actually used as a virtual pointing stick exists as an intermediate area.
[0131]
Therefore, in the third embodiment, an intermediate area not used for the enlargement instruction is provided as an intermediate area C, and is set as an equal-size area where the coordinates are not enlarged, so that the entire area of the screen 102 as the coordinate input surface can be efficiently used. I'm using
[0132]
Further, even when the enlargement ratio is not always twice or more, when the user actually designates the center area of the screen 102 which is the coordinate input surface, the user frequently uses the simple input rather than the pointing rod. Therefore, the configuration of the third embodiment is effective. Further, the range of the intermediate region C may be arbitrarily set by the operator.
[0133]
Further, for example, when the reference point of the left area A is (0, 0), and when the entire area is to be instructed to be enlarged in the area within the left area A, the boundary line x = In a, it is necessary to set the enlargement ratio so as to indicate x = c at the right end of the screen 102. The magnification in this case is determined by XL / XM = a / c in FIG. Further, the right region B is determined in the same manner.
[0134]
On the other hand, if the enlargement ratio is set to a certain value, on the other hand, the position of the boundary line with the intermediate region C corresponding to the enlargement ratio is determined. Therefore, when the operator sets the range of the intermediate region C, the enlargement ratio may be automatically determined. Conversely, when the operator can set an arbitrary enlargement ratio, the range of the intermediate area C may be automatically determined from the enlargement ratio.
[0135]
As described above, according to the third embodiment, in addition to the effects described in the first and second embodiments, the coordinate input area is divided into a plurality of areas, and each of the areas is assumed in consideration of the operating environment of the operator. By controlling the enlargement of the input coordinates, it is possible to realize the output of the virtual pointing tip pointing coordinates that more reflects the intention of the operator.
[0136]
<< Embodiment 4 >>
In the second embodiment, the enlargement reference point is set in advance at the lower corner of each area. However, the enlargement reference point may be set at an optimum position according to physical characteristics such as the height of the operator who actually operates. Further, the enlargement ratio from the enlargement reference point to the tip of the virtual indicator rod with respect to the designated position may be arbitrarily set.
[0137]
Hereinafter, a coordinate calculation process performed by the coordinate input device according to the fourth embodiment will be described with reference to FIGS. 8 and 9.
[0138]
FIG. 8 is a diagram for explaining a coordinate input method by the coordinate input device according to the fourth embodiment of the present invention. FIG. 9 is a flowchart illustrating a coordinate calculation process according to the fourth embodiment of the present invention.
[0139]
Here, a processing procedure for outputting the virtual pointing rod tip pointing coordinates (X, Y) by the coordinate calculation processing of the flowchart shown in FIG. 9 with respect to the input coordinates (x, y) by the coordinate input pen 21 in FIG. explain.
[0140]
First, in step F3-1, the operator inputs coordinates in a state where the coordinate input pen 21 is held horizontally with the shoulder (or with the touch panel), for example. Based on the input coordinates, the reference point OA (x_A0, Y_A0), The reference point OB (x_B0, Y_B0) Is set and stored in the coordinate input device.
[0141]
It is desirable that the reference point be adjusted at the end of each area in the X coordinate axis direction and the Y coordinate axis direction be adjusted by the input point of the operator described above. However, the reference point is not necessarily limited to these coordinates. Alternatively, any reference point desired by the operator may be set.
[0142]
Next, in step F3-2, with the operator holding the coordinate input pen 21, as shown in FIG. 8, the pen tip position (or the pointing fingertip position on the touch panel) P1 (x₁, Y₁). Further, the operator can select a desired virtual pointing stick tip pointing position P2 (x₂, Y₂) Is input while moving the cursor (displayed on the P1 extension line). The enlargement ratio D is set and stored from the input values based on the series of operator actions. The enlargement ratio D in this case is calculated by the following equation.
[0143]
D = OP2 / OP1 = (x₂-X₀) / (X₁-X₀)
Note that the reference point OA (x_A0, Y_A0) And the reference point OB (x_B0, Y_B0), The enlargement ratio D may be stored in advance based on a typical operator position obtained assuming a general presentation environment. Then, an appropriate reference point OA (x) is set in accordance with operator information about the operator, such as the operator's preference, purpose, position to stand on the screen, height, and dominant arm._A0, Y_A0) And the reference point OB (x_B0, Y_B0), The enlargement ratio D may be selected, or may be selected from a prepared menu.
[0144]
Steps F3-4 to F3-7 described below correspond to steps F1-21 to F1-61 of the second embodiment, respectively, and a description thereof will be omitted.
[0145]
As described above, according to the fourth embodiment, in addition to the effects described in the first to third embodiments, the intention of the operator is more reflected by using the reference point appropriately reflecting the physical characteristics of the operator. It is possible to realize output of the virtual designated tip designated coordinates.
[0146]
<< Embodiment 5 >>
In the second to fourth embodiments, an individual reference point is set for each area of the screen 102 which is a coordinate input surface, and a process of enlarging a coordinate based on the reference point or a process of equal magnification is performed. However, the present invention is not limited to this. For example, in the case of performing an input operation continuously across the boundary of each area, even when moving to an adjacent area, the coordinate calculation processing is performed while maintaining the coordinate expansion processing based on the reference point of the first area. You may do it.
[0147]
Hereinafter, a coordinate calculation process performed by the coordinate input device according to the fifth embodiment will be described with reference to FIGS. 10 and 11.
[0148]
FIG. 10 is a diagram for explaining a coordinate input method by the coordinate input device according to the fifth embodiment of the present invention. FIG. 11 is a flowchart illustrating a coordinate calculation process according to the fifth embodiment of the present invention.
[0149]
Here, a processing procedure for outputting the virtual pointing rod tip pointing coordinates (X, Y) by the coordinate calculation processing of the flowchart shown in FIG. 11 with respect to the input coordinates (x, y) by the coordinate input pen 21 in FIG. explain.
[0150]
FIG. 10 shows a case where an intermediate region C is formed between a left region A and a right region B, as in FIG. 6 of the third embodiment. Here, first, it is assumed that the input of coordinates is started in the left area A, and then the instruction is continuously performed, that is, the instruction is moved to the intermediate area C with the pen down.
[0151]
In the third embodiment, in this case, the first input point (x_A, Y_A), The output coordinates are enlarged, and (X_A, Y_A) = (X₀+ (Xx₀) * D, y₀+ (Y-y₀) * D) is displayed, but when an instruction input enters the intermediate area C at the boundary line x = a and indicates an arbitrary point, the arbitrary point (x_A’, Y_A’) Is output.
[0152]
On the other hand, in the fifth embodiment, even when the instruction input enters the intermediate area C at the boundary line x = a, the first input point (x_A, Y_A), The virtual pointing rod tip pointing coordinates (X_A, Y_A) To expand the coordinates (X_A’, Y_A’).
[0153]
Hereinafter, the details of this processing will be described.
[0154]
First, in step F4-1, input coordinates (x, y) which are the actual coordinate input pen 21 (or touch position in the case of a touch panel) of the operator are detected.
[0155]
Next, in step F4-2, it is determined whether or not Flag = 0 indicating whether or not pen down is continued. Here, Flag = 0 indicates that pen down is not continued, and Flag = 1 indicates that pen down is continued.
[0156]
If Flag = 0 is not set in Step F4-2 (NO in Step F4-2), the process proceeds to Step F4-8. On the other hand, if Flag = 0 (YES in step F4-2), the flow advances to step F4-3.
[0157]
Since Flag = 0 in the initial state, the process proceeds to step F4-3 in step F4-2.
[0158]
Steps F4-3 to F4-8 correspond to steps F2-2 to F2-7 of the third embodiment, respectively, and a description thereof will be omitted.
[0159]
Next, in step F4-9, it is determined whether or not the coordinate input pen 21 has pen-uped. If the coordinates are continuously input, it is determined that the pen-down is continued, the process proceeds to step F4-10, where Flag = 1 is set, and then the process returns to step F4-1.
[0160]
The determination of whether or not pen down is continued can be made, for example, by determining the presence or absence of pen up for each sampling cycle of coordinate detection. You may decide.
[0161]
Returning to step F4-1, after detecting the input coordinates (x, y) in the next sampling cycle, it is determined in step F4-2 whether Flag = 0. In this case, since Flag = 1, the process proceeds to step F4-8. That is, the expansion reference point (x₀, Y₀) Or the enlargement ratio D is the same as in the previous process, and the enlargement process and the coordinate calculation are performed again without change.
[0162]
According to the above coordinate calculation processing, when performing an input operation continuously across the boundary of each area, even if moving to an adjacent area, the coordinates are maintained while maintaining the enlargement reference point and the enlargement ratio of the first area. The calculation is performed.
[0163]
Then, once the pen is up and the continuation of the pen down is released, the process proceeds from step F4-9 to step F4-11, sets Flag = 0, and then returns to step F4-1.
[0164]
As described above, according to the fifth embodiment, in addition to the effects described in the first to fourth embodiments, even when the coordinate input operation extends over the enlarged area and the equal-size area, the coordinate input operation may be continued. For example, it is possible to realize output of the virtual pointing tip pointing coordinates suitable for each area.
[0165]
In the above-described Embodiments 2 to 5, an example has been described in which two left and right coordinate input areas or three areas including an intermediate area are set, but the form of area division is not limited to this. Instead, any configuration may be used as long as a unique reference point or enlargement ratio is set for each area.
[0166]
For example, the coordinate input area is divided into five areas in the horizontal direction, the outermost left and right areas have the largest magnification, the central area is the same size area, and the middle two left and right areas are enlarged. The configuration may be such that the ratio is smaller than that of the outer left and right regions. As a result, even when a coordinate input operation is performed over an area, a change in the enlargement ratio can be suppressed to a small extent, and a comfortable output of the tip of the virtual indicator rod can be realized.
[0167]
<< Embodiment 6 >>
In the coordinate input device according to the first to fifth embodiments, the input of the position of the reference point such as the shoulder and the elbow can be input using an input device such as a keyboard, or the pointing area of the coordinate input pen 21 is a display area. If it is inside, there is no problem. However, when the input area when actually inputting using the coordinate input pen 21 is outside the display area, and when the normal input area of the operator is outside the display area, the coordinate input area is outside the display area. It is necessary to use a coordinate input method which is also provided in the above.
[0168]
Here, the coordinate input method of the coordinate input device is not particularly limited, but is not limited to a case in which the coordinate input device is two-dimensionally outside the display area, and is also used for a computer from a position vertically (Z-axis) away from the screen 102 Can be adopted as a coordinate input device that can remotely control the device.
[0169]
Hereinafter, in the sixth embodiment, a configuration in a case where a coordinate input method using aerial ultrasonic waves is applied to the coordinate input device of the first embodiment will be described.
[0170]
First, the configuration of the coordinate input pen 21 used in the coordinate input device according to the sixth embodiment will be described with reference to FIG.
[0171]
FIG. 12 is a diagram showing a basic configuration of a coordinate input pen of the coordinate input device according to the sixth embodiment of the present invention.
[0172]
When the coordinate input pen 21 presses the pen tip against the screen 102, the pen tip switch 22 is turned on and the oscillation of the ultrasonic wave is started. In the case of remote control, the ultrasonic oscillation is started by pressing the pen side switch 23 or the switch 24.
[0173]
Next, a functional configuration of the coordinate input device according to the sixth embodiment will be described with reference to FIG.
[0174]
FIG. 13 is a diagram illustrating a basic configuration of a coordinate input pen of the coordinate input device according to the sixth embodiment of the present invention.
[0175]
In the coordinate input pen 21, reference numeral 302 denotes a drive circuit for driving an oscillator 303 which is operated by a battery (not shown). The drive circuit 302 controls the oscillator 303 to be driven at a predetermined timing. The ultrasonic signal oscillated from the oscillator 303 is detected by a plurality of ultrasonic sensors 305 in the internal circuit of the coordinate input device main body 304. The detected ultrasonic signal is amplified to a predetermined level by the waveform processing circuit 306 and input to the CPU 307 as a detection timing signal.
[0176]
In this way, when the timing signals detected by the plurality of ultrasonic sensors 305 are aligned, the CPU 307 converts the time information into the distance information, and furthermore, the screen coordinate system of the coordinate input pen 21 (on the screen 102) based on the principle of triangulation. The coordinate position is calculated based on the coordinate system. Further, an operation coordinate system is calculated from the series of coordinates, and the input coordinates of the operator in the screen coordinate system of the coordinate input device 304 are converted into the coordinates of the operation coordinate system (the coordinate system on the operation coordinate input surface based on the operator). Convert.
[0177]
The coordinate calculation and the coordinate conversion are executed by the CPU 307 calling the coordinate calculation program 308 stored in the ROM 312. Then, the calculated coordinate data is stored in the memory 310. The coordinate data is sequentially transferred to an external computer by the wireless interface 311. Further, if necessary, the trajectory obtained from the coordinate data can be subjected to character recognition by the character recognition engine 309, and the recognition result can be stored in the memory 310 as a command or text data.
[0178]
The configuration of the coordinate input system according to the sixth embodiment may employ various configurations other than the above-described configuration. For example, the pointing tool is not limited to a pen shape, and may be a so-called pointing rod shape. In addition, the coordinate input method is not limited to the ultrasonic method, and any coordinate input method capable of calculating three-dimensional coordinates, such as an infrared-based method, a resistive film method, an electromagnetic induction method, or an electrostatic coupling method. Can be adopted.
[0179]
The display device is not limited to the rear projector display device 101, and may be any device that can display computer information, such as a front projector, a liquid crystal display, and a plasma display.
[0180]
Further, the connection between the coordinate input device 304 and an external computer is not limited to the wireless interface 311 and may be a wired interface.
[0181]
<Detailed configuration of coordinate input device>
The configuration of the coordinate input device that operates as described above will be described in more detail.
[0182]
FIG. 14 is a diagram showing a schematic configuration of a coordinate input device capable of measuring three-dimensional (space) coordinates according to Embodiment 6 of the present invention.
[0183]
Reference numeral 21 denotes a coordinate input pen, which is an indicator, and is configured to generate a sound wave in the air by a coordinate input operation by an operator. The generated sound wave is detected by a plurality of detection sensors 3 (in the case of the sixth embodiment, four detection sensors 3_Sa to Sd are used) and processed by the signal waveform detection circuit 2 by a method described later. Thereafter, the arithmetic control circuit 1 is configured to calculate the position (X, Y, Z) of the sound source of the coordinate input pen 21.
[0184]
The arithmetic and control circuit 1 controls the entire coordinate input device, moves the cursor displayed on the display device 101 via the display driving circuit 5 based on the obtained coordinate data, or writes handwriting such as writing. The information is configured to be displayed on the display device 101 and added thereto.
[0185]
As described above, by combining the coordinate input device and the display device, it is possible to provide a man-machine interface capable of realizing a relationship like "paper and pencil".
[0186]
Next, the configuration of the coordinate input pen 21 will be described with reference to FIG.
[0187]
FIG. 15 is a diagram illustrating a configuration of a coordinate input pen according to Embodiment 6 of the present invention.
[0188]
In particular, FIG. 15A is an external view of the coordinate input pen 21, and FIG. 15B is a functional configuration diagram of the coordinate input pen 21.
[0189]
A sound wave source 43 built in the coordinate input pen 21 includes a pen power supply 45, a timer and an oscillation circuit, a control circuit for detecting and controlling a plurality of switch information provided in the coordinate input pen 21, and various kinds of data. It is driven by a drive circuit 44 composed of a memory or the like for storing.
[0190]
The sound wave source 43 is composed of, for example, a piezoelectric element such as PVDF (polyvinylidene fluoride). The PVDF is formed in a film shape and is formed in an annular shape having a predetermined size so that the driving efficiency is maximized at a desired frequency.
[0191]
The drive signal of the sound wave source 43 is a pulse signal generated by a timer and repeated at a predetermined cycle, and is amplified by a predetermined gain by an oscillation circuit and then applied to the sound wave source 43. This electrical drive signal is converted into mechanical vibration by the sound wave source 43, and the energy is emitted into the air.
[0192]
The coordinate input pen 21 according to the sixth embodiment includes a pen tip switch (SW) 22 that operates by pressing the tip of the pen, and a plurality of pen side switches (SW) provided on the casing of the coordinate input pen 21. ) 23 and 24 are provided.
[0193]
The drive circuit 44 outputs the coordinates every predetermined period (for example, every 10 msec, in which case, a sound wave is emitted 100 times per second, so that the coordinate calculation sampling rate of the present coordinate input device is 100 times / second). A signal for driving the sound wave source 43 in the input pen 21 is output, and the sound wave is radiated into the air.
[0194]
This sound wave is delayed according to the distance between the sound wave generation source 43 and each of the detection sensors 3_Sa to Sd, and reaches and is detected. The detection sensors 3_Sa to Sd are, for example, piezoelectric vibrators such as PZT that perform thickness vibration, and have an acoustic matching layer on the front surface. This acoustic matching layer is a thin layer of silicon rubber, etc., which matches acoustic impedance with gas, provides high sensitivity and broadband characteristics, and enables transmission and reception of ultrasonic signals with good pulse response. Has become.
[0195]
This type of coordinate input device calculates the distance between the sound source 43 of the coordinate input pen 21 and each of the detection sensors 3_Sa to Sd based on the product of the known sound speed of the sound wave and its arrival time, and calculates each detection sensor 3_Sa This system is based on obtaining geometrically the position information of the sound source 43 using the position information of Sd. Therefore, a method of detecting the arrival time of the sound wave will be described with reference to FIGS.
[0196]
FIG. 16 is a timing chart for explaining the sound wave arrival time detection method according to the sixth embodiment of the present invention. FIG. 17 is a block diagram of a detection circuit for realizing the detection of the arrival time of the sound wave according to the sixth embodiment of the present invention.
[0197]
Reference numeral 51 denotes a drive signal generated by the drive circuit 44, which generates the drive signal 51 and also generates a start signal. This start signal is transmitted to the arithmetic and control circuit 1 via, for example, an infrared LED or the like (not shown) built in the coordinate input pen 21 and the timer 12 ( 18) is started.
[0198]
On the other hand, the sound waves emitted into the air are delayed according to the distance between the sound wave source 43 and the detection sensors 3_Sa to Sd, and are detected by the detection sensors 3_Sa to Sd. Reference numeral 53 denotes detection signals detected by the respective detection sensors 3_Sa to Sd amplified by the preamplifier circuit 60 to a predetermined level. The detection signal 53 is processed by an envelope detection circuit 61 composed of an absolute value circuit, a low-pass filter, and the like, and only the envelope 54 of the detection signal is extracted.
[0199]
Focusing on the envelope 54, the sound velocity at which the waveform propagates is the group velocity Vg. When a unique point of the envelope 54, for example, a peak or an inflection point of the envelope 54 is detected, the delay time tg related to the group velocity Vg is detected. Is obtained. The envelope singularity detection circuit 62 for detecting the peak or inflection point of the envelope 54 can be easily detected by using a differentiating circuit and a zero-cross comparator.
[0200]
In the sixth embodiment, a signal 55 is formed by second-order differentiation, and an inflection point of the envelope 54 is detected with reference to the gate signal compared with the threshold level 52 and the detection signal 53 (signal 56). If the timer 12 that is operating is stopped by the above-described start signal using the signal 56, the group delay time Tg related to the group velocity Vg can be detected.
[0201]
Strictly speaking, the group delay time Tg includes a delay of a circuit related to the waveform processing, but its influence is completely removed by a method described later. Therefore, in order to simplify the description, description will be made assuming that there is no circuit delay time.
[0202]
From the above, the distance L between the sound wave source 43 and the detection sensors 3_Sa to Sd can be obtained by the following equation.
[0203]
L = Vg × Tg (1)
On the other hand, when calculating the distance L with higher accuracy, the time when the sound wave arrives is calculated from the phase information of the detection signal waveform. More specifically, the output signals 53 of the detection sensors 3_Sa to Sd are input to a Tp signal detection circuit 66 after removing extra frequency components by a band-pass filter 64. The Tp signal detection circuit 66 includes a zero cross comparator, a multivibrator, and the like. Then, the signal related to the zero-cross point of the signal output from the band-pass filter 64 is compared with a gate signal 57 generated by a gate signal generation circuit 65 that compares the signal with a predetermined threshold level 52 to generate a signal 58.
[0204]
Thereafter, the signal 56 for detecting the group delay time Tg described above is referred to as a gate signal (generated by the gate signal generation circuit 63), and the signal waveform output from the band-pass filter 64 during the period of the gate signal 56 is referred to. A signal 59 is generated that outputs the first zero crossing point where the phase crosses from the negative side to the positive side, for example.
[0205]
Then, by using this signal 59 to stop the timer 12 operating by the above-described start signal, it is possible to detect the phase delay time Tp related to the phase speed Vp.
Strictly speaking, the phase delay time Tp includes a delay of a circuit related to the waveform processing, but the effect is completely removed by a method described later. Therefore, in order to simplify the description, description will be made assuming that there is no circuit delay time.
[0206]
From the above, the distance L between the sound wave source 43 and the detection sensors 3_Sa to Sd can be obtained by the following equation.
[0207]
L = Vp × Tp (2)
Here, the effect of using the gate signal 56 generated by the gate signal generation circuit 63 based on the envelope singularity detection circuit 62 will be described.
[0208]
The signal levels detected by the detection sensors 3_Sa to Sd fluctuate due to the following factors.
[0209]
1) Electro-mechanical conversion efficiency of the sound wave source 43 and the detection sensors 3_Sa to Sd
2) Distance between sound wave source 43 and detection sensors 3_Sa to Sd
3) Environmental fluctuations such as temperature and humidity in the air where sound waves propagate
4) Directivity of sound wave source 43 regarding sound wave radiation and sensitivity directivity of detection sensors 3_Sa to Sd
Item 1) is a factor that occurs due to component tolerance, and it is necessary to pay sufficient attention when mass-producing devices. Item 2) relates to attenuation of sound waves. As the distance between the sound source 43 and the detection sensors 3_Sa to Sd increases, the signal level of sound waves propagating in the air may exponentially attenuate. In addition to being generally well known, the damping constant also changes in the environment according to item 3).
[0210]
Further, in item 4), since the present invention operates as a coordinate input device, the posture of the coordinate input pen 21, which is a writing instrument, always changes due to the writing operation by the operator, that is, the pen holding angle changes. Therefore, the level greatly changes due to the fluctuation. Furthermore, due to the sensitivity directivity of the detection sensors 3_Sa to Sd, the detection level fluctuates even if the angle formed between the coordinate input pen 21 and the detection sensors 3_Sa to Sd fluctuates.
[0211]
At this time, for example, when it is assumed that the detection level has become smaller, since the above-described threshold level (for example, the signal 52) is fixed, the signal 58 can sufficiently change to the signal 58 '. It becomes.
[0212]
That is, even if the coordinate input operation is performed at the same point, for example, if the holding angle (direction) of the coordinate input pen 21 is different, the level of the detection signal 53 will be different. Will depend on it. However, since the present invention refers to the gate signal 56 based on the singular point of the envelope 54, the signal 59 can be stably obtained without depending on the detection signal level.
[0213]
Next, a schematic configuration of the arithmetic control circuit 1 according to the sixth embodiment will be described with reference to FIG.
[0214]
FIG. 18 is a block diagram showing a schematic configuration of an arithmetic control circuit according to Embodiment 6 of the present invention.
[0215]
Reference numeral 11 denotes a microcomputer for controlling the arithmetic control circuit 1 and the coordinate input device as a whole. The microcomputer 11 includes an internal counter, a ROM storing operation procedures, a RAM used for calculations and the like, and a nonvolatile memory storing constants and the like. ing.
[0216]
As described above, the start signal synchronized with the drive timing of the sound source 43 in the coordinate input pen 21 by the drive circuit 44 is emitted as an optical signal by an infrared LED or the like (not shown) built in the coordinate input pen 21. The signal is detected by the start signal detection circuit 17 to start the timer 12 (for example, constituted by a counter or the like) in the arithmetic and control circuit 1.
[0217]
With this configuration, the drive timing for driving the sound wave source 43 in the coordinate input pen 21 and the synchronization with the timer 12 in the arithmetic and control circuit 1 can be obtained. It is possible to measure the time required to reach each of the detection sensors 3_Sa to Sd.
[0218]
The vibration arrival timing signals (signal 59) from the detection sensors 3_Sa to Sd output from the signal waveform detection circuit 2 are input to the latch circuits 15_a to 15_d via the detection signal input port 13, respectively. When each of the latch circuits 15_a to 15_d receives the vibration arrival timing signal from the corresponding detection sensor 3_Sa to Sd, it latches the time value of the timer 12 at that time.
[0219]
When the determination circuit 14 determines that all the detection signals necessary for coordinate calculation have been received in this manner, it outputs a signal to the microcomputer 11 to that effect. When the microcomputer 11 receives the signal from the determination circuit 14, the microcomputer 11 reads the vibration arrival time from the latch circuits 15_a to 15_d to the respective detection sensors 3_Sa to Sd from the latch circuits 15_a to 15d, performs a predetermined calculation, and performs coordinate calculation. The coordinate position of the input pen 21 is calculated.
[0220]
Further, in the microcomputer 11, an operation coordinate input plane based on the operator in the operation coordinate system (X, Y, Z) is obtained from a plurality of coordinates input by the operator in the screen coordinate system (x, y, z). Is calculated, and the coordinate position of the coordinate input pen 21 in the screen coordinate system (x, y, z) is converted into coordinates in the operation coordinate system (X, Y, Z).
[0221]
The calculation result is output to the display drive circuit 5 via the I / O port 16, and for example, a dot or the like can be displayed at a corresponding position on the display device 101. Also, by outputting coordinate position information to an interface circuit (not shown) via the I / O port 16, it is possible to output coordinate values to an external device.
[0222]
<Description of coordinate calculation method>
Next, a method of calculating the position coordinates (x, y, z) of the sound source 43 in the screen coordinate system when the detection sensors 3_Sa to Sd are arranged in the screen coordinate system as shown in FIG.
[0223]
The distance between the vibration source 43 and each of the detection sensors 3_Sa to Sd accurately obtained by the above method is La to Ld, the distance between the detection sensors in the X direction is Xs-s, and the distance between the detection sensors in the Y direction is Ys. -S
[0224]

Becomes Similarly,
[0225]

Becomes
[0226]
As described above, if the distance between at least three vibration sources 43 and the detection sensor 3 can be measured, the position (space) coordinates of the sound source 43 can be easily obtained.
[0227]
In the present invention, four detection sensors are used, and for example, information at the longest distance is not used (in this case, the signal output from the detection sensor 3 has the lowest signal level because the distance is long. ), The coordinates are calculated using only the remaining three pieces of distance information, so that highly reliable coordinates can be calculated.
[0228]
Further, by utilizing the distance information of the sensor having a long distance, it is possible to determine whether or not the reliability of the output coordinate value is high.
[0229]
As a specific method, for example, the coordinate value calculated based on the distance information La, Lb, Lc and the coordinate value calculated based on the distance information Lb, Lc, Ld should output the same value (distance information). If the two do not match, either of the distance information is incorrect, that is, it is erroneously detected. In that case, the reliability that the coordinate value is not output is provided. An improved configuration can also be implemented.
[0230]
As described above, according to the sixth embodiment, since coordinates can be input even in an area outside the display area of the screen 102, when inputting the position of the reference point such as the shoulder and elbow, the coordinates outside the display area may be used. However, since the actual position of the body part can be input with the coordinate input pen 21, a more natural operation feeling of the virtual pointing stick can be obtained.
[0231]
In addition, not only at the time of setting regarding the virtual pointing rod, but also when actually inputting coordinates using the coordinate input pen 21, input outside the display area is possible, so that there is less restriction on the operation range.
[0232]
Further, when the coordinate input in the Z-axis direction is possible as in the coordinate input device according to the sixth embodiment, for example, the length of the virtual pointing rod is automatically changed in accordance with the Z coordinate, and the virtual supporting rod is changed. The tip designation coordinates (X, Y) may be calculated.
[0233]
Specifically, a natural operation feeling can be realized by making the Z coordinate proportional to the enlargement ratio D, which is the ratio of the length from the elbow to the pen tip (fingertip) to the tip of the desired pointing rod. it can. If it is not desirable that the enlargement ratio D frequently changes, the enlargement ratio D may be constant with respect to a change in the stepwise range of the Z coordinate.
[0234]
Note that the present invention is not limited to the above-described first to sixth embodiments, and it is needless to say that an embodiment realized by arbitrarily combining the first to sixth embodiments may be configured according to the application and purpose.
[0235]
The coordinate input device in the first to sixth embodiments described above can be realized by an information processing device such as a personal computer, and can be regarded as an invention of a method as a procedure for realizing the function. Further, since the present invention can be realized by a computer, the present invention can be applied to a computer program executed by each device, and further to a computer-readable storage medium such as a CD-ROM which stores the computer program and can be read by a computer. It will be clear.
[0236]
Therefore, the embodiments according to the first to sixth embodiments are listed as follows. That is, the coordinate input device, its control method, and program are as follows.
[0237]
<Embodiment 1> A coordinate input device that detects input coordinates of a position designated on a coordinate input surface and outputs coordinates based on the input coordinates,
Detecting means for detecting input coordinates of a position on the coordinate input surface specified by the operator;
Enlargement reference point input means for inputting an enlargement reference point serving as a reference for enlarging the input coordinates,
Magnification ratio reference point input means for inputting a magnification ratio reference point for determining a magnification ratio for enlarging the input coordinates,
Determining means for determining the magnification, based on the positional relationship between the input coordinates and the magnification reference point,
Calculation means for calculating coordinates obtained by enlarging the input coordinates in a direction connecting the enlargement reference point and the input coordinates, based on the enlargement ratio and the enlargement reference point,
Coordinate output means for outputting the coordinates calculated by the calculation means,
A coordinate input device comprising:
[0238]
<Embodiment 2> The determining unit determines the enlargement ratio based on a distance between the input coordinates and the enlargement ratio reference point.
The coordinate input device according to the first embodiment, wherein:
[0239]
<Embodiment 3> Further comprising a storage unit for storing physical information of the operator,
The enlargement reference point input means inputs the enlargement reference point by calculating the enlargement reference point based on the physical information.
The coordinate input device according to the first embodiment, wherein:
[0240]
<Embodiment 4> The enlargement reference point input means inputs the enlargement reference point by calculating the enlargement reference point based on the input coordinates and the physical information.
A coordinate input device according to a third embodiment, characterized in that:
[0241]
<Embodiment 5> The enlargement reference point corresponds to the position of the elbow of the operator.
The coordinate input device according to the first embodiment, wherein:
[0242]
<Embodiment 6> The enlargement reference point corresponds to the position of the operator's elbow, and the enlargement ratio reference point corresponds to the position of the operator's shoulder.
The coordinate input device according to the first embodiment, wherein:
[0243]
<Embodiment 7> It further includes a storage unit for storing a plurality of types of enlargement reference points,
The calculating means obtains an enlargement reference point corresponding to an area on a coordinate input surface to which the input coordinates detected by the detection means belong from the storage means, and based on the acquired enlargement reference point and a predetermined enlargement ratio, Calculating coordinates obtained by enlarging the input coordinates
The coordinate input device according to the first embodiment, wherein:
[0244]
<Eighth Embodiment> The image processing apparatus further includes a storage unit configured to store the enlargement reference point for each divided area obtained by dividing the coordinate input surface into a plurality of areas,
The calculating means acquires, from the storage means, an enlargement reference point corresponding to a divided area on a coordinate input surface to which the input coordinates detected by the detection means belong, based on the acquired enlargement reference point and a predetermined enlargement ratio. , Calculate coordinates obtained by enlarging the input coordinates
The coordinate input device according to the first embodiment, wherein:
[0245]
<Embodiment 9> The storage apparatus further includes a storage unit that stores a plurality of types of enlargement ratios and enlargement reference points.
The calculating means acquires, from the storage means, an enlargement reference point and an enlargement rate corresponding to an area on a coordinate input surface to which the input coordinates detected by the detection means belong, based on the acquired enlargement reference point and the enlargement rate. Calculate the coordinates obtained by enlarging the input coordinates.
The coordinate input device according to the first embodiment, wherein:
[0246]
<Embodiment 10> When the area on the coordinate input surface to which the input coordinates detected by the detection means belongs is a 1: 1 area in which the coordinates are not enlarged, the calculation means may set the coordinates obtained by equalizing the input coordinates. Calculate
The coordinate input device according to the first embodiment, wherein:
[0247]
<Embodiment 11> The image processing apparatus further includes a division area for dividing the coordinate input surface, and a setting unit for setting an enlargement reference point and an enlargement ratio corresponding to the division area.
The coordinate input device according to any one of embodiments 7 to 9, wherein:
[0248]
<Embodiment 12> The image processing apparatus further includes a division area for dividing the coordinate input surface, and a storage unit for storing an enlargement reference point and an enlargement ratio corresponding to the division area,
The setting unit refers to the storage unit and sets an enlargement reference point corresponding to operator information on the operator
The coordinate input device according to embodiment 11, wherein:
[0249]
<Embodiment 13> The image forming apparatus further includes a storage unit that stores a plurality of types of enlargement ratios and enlargement reference points,
When the detecting means continuously detects the input coordinates over a plurality of divided areas on the coordinate input surface, the calculating means determines on the coordinate input surface to which the input coordinates first detected by the detecting means belong. The enlargement reference point and enlargement ratio corresponding to the area are acquired from the storage unit, and the coordinates obtained by enlarging the input coordinates are calculated based on the acquired enlargement reference point and enlargement ratio.
The coordinate input device according to the first embodiment, wherein:
[0250]
<Embodiment 14> Further provided is an enlargement ratio input unit for inputting the enlargement ratio based on the input coordinates detected by the detection unit.
The coordinate input device according to the first embodiment, wherein:
[0251]
<Embodiment 15> In the case where an equal-magnification area in which the coordinate is not enlarged is set among the division areas dividing the coordinate input surface, an enlargement rate input for inputting the enlargement rate is performed based on the equal-magnification area. Further comprising means
The coordinate input device according to the first embodiment, wherein:
[0252]
<Embodiment 16> The image forming apparatus further includes a setting unit configured to set, on the basis of the enlargement ratio, a unit-size area in which coordinates are not enlarged in the coordinate input surface.
The coordinate input device according to the first embodiment, wherein:
[0253]
<Embodiment 17> An instruction unit having a sound wave generator for instructing on the coordinate input surface is further provided.
The detecting means is constituted by a plurality of detecting means provided in a peripheral portion of the coordinate input surface, and based on a reception timing at which the plurality of detecting means receive a sound wave generated from the indicating means, the detecting means Detect the input coordinates of the position on the specified coordinate input surface
The coordinate input device according to the first embodiment, wherein:
[0254]
<Embodiment 18> A control method of a coordinate input device that detects input coordinates of a position designated on a coordinate input surface and outputs coordinates based on the input coordinates,
A detection step of detecting input coordinates of a position on the coordinate input surface specified by the operator;
An enlargement reference point input step of inputting an enlargement reference point serving as a reference for enlarging the input coordinates,
An enlargement factor reference point input step of inputting an enlargement factor reference point for determining an enlargement factor for enlarging the input coordinates,
A determining step of determining the enlargement ratio based on a positional relationship between the input coordinates and the enlargement ratio reference point;
A calculating step of calculating coordinates obtained by enlarging the input coordinates in a direction connecting the enlargement reference point and the input coordinates, based on the enlargement ratio and the enlargement reference point,
A coordinate output step of outputting the coordinates calculated in the calculation step,
A method for controlling a coordinate input device, comprising:
[0255]
<Embodiment 19> A program for realizing control of a coordinate input device that detects input coordinates of a position designated on a coordinate input surface and outputs coordinates based on the input coordinates by a computer,
A program code for a detection step of detecting input coordinates of a position on the coordinate input surface specified by the operator,
A program code of an enlargement reference point input step of inputting an enlargement reference point serving as a reference for enlarging the input coordinates,
A program code for an enlargement factor reference point input step of inputting an enlargement factor reference point for determining an enlargement factor for enlarging the input coordinates,
A program code for a determining step of determining the magnification, based on a positional relationship between the input coordinates and the magnification reference point;
Program code for a calculation step of calculating coordinates obtained by enlarging the input coordinates in a direction connecting the enlargement reference point and the input coordinates, based on the enlargement ratio and the enlargement reference point;
Program code of a coordinate output step of outputting the coordinates calculated in the calculation step,
A program characterized by comprising:
[0256]
As described above, the embodiment has been described in detail. However, the present invention can take an embodiment as, for example, a system, an apparatus, a method, a program, a storage medium, or the like. The system may be applied to a system including a single device or an apparatus including one device.
[0257]
According to the present invention, a software program (in the embodiment, a program corresponding to the flowchart shown in the drawings) for realizing the functions of the above-described embodiments is directly or remotely supplied to a system or an apparatus, and a computer of the system or the apparatus is provided. Is also achieved by reading and executing the supplied program code.
[0258]
Therefore, since the functions of the present invention are implemented by computer, the program code installed in the computer also implements the present invention. That is, the present invention includes the computer program itself for realizing the functional processing of the present invention.
[0259]
In that case, as long as it has a program function, it may be in the form of an object code, a program executed by an interpreter, script data supplied to an OS, or the like.
[0260]
As a recording medium for supplying the program, for example, a floppy (registered trademark) disk, hard disk, optical disk, magneto-optical disk, MO, CD-ROM, CD-R, CD-RW, magnetic tape, nonvolatile memory card , ROM, DVD (DVD-ROM, DVD-R) and the like.
[0261]
Other methods of supplying the program include connecting to a homepage on the Internet using a browser of a client computer, and downloading the computer program itself of the present invention or a file containing a compressed automatic installation function from the homepage to a recording medium such as a hard disk. Can also be supplied. Further, the present invention can also be realized by dividing the program code constituting the program of the present invention into a plurality of files and downloading each file from a different homepage. That is, the present invention also includes a WWW server that allows a plurality of users to download a program file for implementing the functional processing of the present invention on a computer.
[0262]
In addition, the program of the present invention is encrypted, stored in a storage medium such as a CD-ROM, distributed to users, and downloaded to a user who satisfies predetermined conditions from a homepage via the Internet to download key information for decryption. It is also possible to execute the encrypted program by using the key information and install the program on a computer to realize the program.
[0263]
The functions of the above-described embodiments are implemented when the computer executes the read program, and an OS or the like running on the computer executes a part of the actual processing based on the instructions of the program. Alternatively, all the operations are performed, and the functions of the above-described embodiments can be realized by the processing.
[0264]
Further, after the program read from the recording medium is written into the memory provided in the function expansion board inserted into the computer or the function expansion unit connected to the computer, the function expansion board or the A CPU or the like provided in the function expansion unit performs part or all of the actual processing, and the processing also realizes the functions of the above-described embodiments.
[0265]
【The invention's effect】
As described above, according to the present invention, it is possible to provide a coordinate input technique capable of improving the visibility of a designated portion.
[Brief description of the drawings]
FIG. 1 is a diagram for explaining a coordinate input method by a coordinate input device according to a first embodiment of the present invention.
FIG. 2 is a diagram for explaining a coordinate input method by the coordinate input device according to the first embodiment of the present invention.
FIG. 3 is a flowchart illustrating a coordinate calculation process according to the first embodiment of the present invention.
FIG. 4 is a diagram for explaining a coordinate input method by a coordinate input device according to a second embodiment of the present invention.
FIG. 5 is a flowchart illustrating a coordinate calculation process according to the second embodiment of the present invention.
FIG. 6 is a diagram for explaining a coordinate input method by a coordinate input device according to a third embodiment of the present invention.
FIG. 7 is a flowchart illustrating a coordinate calculation process according to a third embodiment of the present invention.
FIG. 8 is a diagram for explaining a coordinate input method by a coordinate input device according to a fourth embodiment of the present invention.
FIG. 9 is a flowchart illustrating a coordinate calculation process according to the fourth embodiment of the present invention.
FIG. 10 is a diagram for explaining a coordinate input method by a coordinate input device according to a fifth embodiment of the present invention.
FIG. 11 is a flowchart illustrating a coordinate calculation process according to the fifth embodiment of the present invention.
FIG. 12 is a diagram illustrating a basic configuration of a coordinate input pen of a coordinate input device according to a sixth embodiment of the present invention.
FIG. 13 is a block diagram illustrating a basic configuration of a coordinate input device according to a sixth embodiment of the present invention.
FIG. 14 is a diagram illustrating a schematic configuration of a coordinate input device capable of measuring three-dimensional (space) coordinates according to a sixth embodiment of the present invention.
FIG. 15 is a diagram illustrating a configuration of a coordinate input pen according to a sixth embodiment of the present invention.
FIG. 16 is a timing chart for explaining a method of detecting a sound wave arrival time according to a sixth embodiment of the present invention.
FIG. 17 is a block diagram of a detection circuit that realizes detection of arrival time of a sound wave according to a sixth embodiment of the present invention.
FIG. 18 is a block diagram illustrating a schematic configuration of an arithmetic control circuit according to a sixth embodiment of the present invention.
FIG. 19 is a diagram illustrating a coordinate calculation method of a coordinate input device capable of inputting three-dimensional (space) coordinates according to a sixth embodiment of the present invention.
FIG. 20 is a diagram for explaining a conventional technique.
[Explanation of symbols]
21 Coordinate input pen
302 drive circuit
303 oscillator
304 coordinate input device
305 Ultrasonic sensor
306 Waveform processing circuit
307 CPU
308 Coordinate calculation program
309 Character Recognition Engine
310 memory
311 Wireless interface
312 ROM

Claims (1)

A coordinate input device that detects input coordinates of a position specified on a coordinate input surface and outputs coordinates based on the input coordinates,
Detecting means for detecting input coordinates of a position on the coordinate input surface specified by the operator;
Enlargement reference point input means for inputting an enlargement reference point serving as a reference for enlarging the input coordinates,
Magnification ratio reference point input means for inputting a magnification ratio reference point for determining a magnification ratio for enlarging the input coordinates,
Determining means for determining the magnification, based on the positional relationship between the input coordinates and the magnification reference point,
Calculation means for calculating coordinates obtained by enlarging the input coordinates in a direction connecting the enlargement reference point and the input coordinates, based on the enlargement ratio and the enlargement reference point,
Coordinate output means for outputting the coordinates calculated by the calculation means,
A coordinate input device comprising:

Images