JP2004118236A - Device, system, method and program for managing picture data - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a picture data managing device where superposition data superposed on a prescribed document displayed on one picture is reflected on a document of the other picture without using an application of the document. <P>SOLUTION: The picture data managing device 20 managing picture data is provided with a first superposition means 220 which virtually superposes, on first picture data apart from the first picture data, superposition data which is to be superposed on the first picture data and displayed, a superposition position determining means 250 determining a superposition position on which superposition data in second picture data where a part or a whole part is similar to the first picture data is superposed based on a positional relationship between a position on which superposition data in the first picture data is superposed and an arbitrary reference position in the first picture data, and a second superposition means 246 which virtually superposes superposition data in the position determined for the second picture data by the superposition position determining means 250. <P>COPYRIGHT: (C)2004,JPO

Description

・・・（２）
なお、任意の２点は、ユーザにより任意に指定される。任意の２点は、いずれも第１個別画面データ６０内の任意の位置の点であればよく、その位置は限定されない。
【０１０９】
次に、ベクトル算出部２２４は、重畳データの位置としての点Ｂと、点Ａとの間のベクトルＡＢを算出する（Ｓ２２６）。なお、ベクトルＡＢに変えてベクトルＧＢを算出してもよい。ベクトル値から、重畳データの相対的な位置が認識できればよく、ベクトルの始点および終点の位置は特に限定されない。
【０１１０】
そして、重畳データ管理部２２２は、重畳データを共有メモリ２１０へコピーする（Ｓ２２８）。次に、通知情報作成部２２８は、２点間の距離Ｌ＿ｓｒｃとベクトルＡＢの値（座標値）、重畳データのビットマップ領域の縦方向の画素数と横方向の画素数、および共有メモリ上における重畳データのビットマップデータの先頭アドレスを含む重畳関連情報を作成する（Ｓ２３０）。次に、管理ユニット間通信部２１８は、重畳関連情報を管理ユニット間通信部２４４へ送る（Ｓ２３２）。
【０１１１】
一方、ユーザにより共有画面表示ウィンドウ４１が選択されると、図１１（Ｂ）に示すように、共有画面表示ウィンドウ４１がフォーカスウィンドウとなり、第１個別画面表示ウィンドウ４２の上に重なって表示される。さらに、ユーザによって、共有画面データ８０上の基準となる２点が指定されると（Ｓ２４０，Ｙｅｓ）、サーバ通信部１０２は、クライアント通信部２５２に指定された位置のタッチ座標、すなわちユーザによって指定された２点の位置を通知する（Ｓ２４２）。
【０１１２】
この共有画面データ８０上の２点とは、第１個別画面データ６０において指定された２点に対応した位置における２点のことである。例えば、図１１（Ａ）に示す点Ａおよび点Ｇが第１個別画面データ６０における２点として指定された場合における、共有画面データ８０の２点は、図１１（Ｂ）に示す共有画面データ８０中の点Ｈおよび点Ｊである。
【０１１３】
そして、表示比率算出部２４８は、共有画面データ８０中の２点から２点間の距離Ｌ＿ｄｓｔを算出する（Ｓ２４４）。Ｌ＿ｄｓｔは、次式により算出される。
【数２】

・・・（３）
表示比率算出部２４８は、さらに２点間距離Ｌ＿ｄｓｔと、重畳関連情報に含まれる２点間距離Ｌ＿ｓｒｃとから共有画面データ８０と、第１個別画面データ６０との表示倍率の比（表示比率）を算出する（Ｓ２４６）。なお、表示比率は、次式により算出される。
表示比率＝Ｌ＿ｄｓｔ／Ｌ＿ｓｒｃ・・・（４）
【０１１４】
次に、重畳位置決定部２５０は、重畳関連情報に含まれるベクトルＡＢ、および表示比率に基づいて、重畳位置を決定する（Ｓ２４８）。次に、重畳部２４６は表示比率に基づいて、共有メモリ２１０にある重畳データのビットマップデータを変倍処理する（Ｓ２５２）。具体的には、例えば、重畳先の画面データの表示倍率が小さく、表示比率＜１である場合には、重畳データのビットマップデータを表示比率に応じて縮小する。縮小する場合には、例えばビットマップデータを間引きしてもよい。
【０１１５】
そして、重畳部２４６は、共有画面データ８０上の点Ｈの座標値に（ベクトルＡＢ×表示比率）の値を加算した座標位置（点Ｋ）に変倍処理された重畳データ８５のビットマップデータを重畳して貼り付ける（Ｓ２５４）。そして、共有画面データ送信部２４２は、更新後の共有画面データ８０を各表示画面３２，１１０、１２０、１３０に送信する（Ｓ２５６）。
【０１１６】
このように、本実施の形態における電子会議システム１は、異なる倍率で表示されている画面データ間においても、重畳データを重畳することができる。電子会議中においては、共有画面表示ウィンドウ４１に表示された文書の表示倍率が変更される場合がある。この場合においても、容易に重畳データを重畳することができる。
【０１１７】
なお、表示倍率が異なる画面データ間で、手書き描画線を示す重畳データを重畳する場合の電子会議システム１の処理ステップは、図１０において説明した変倍モードにおける電子会議システム１の処理ステップとほぼ同様である。
【０１１８】
手書き描画線を示す重畳データを重畳する場合、表示倍率が異なる場合の処理に、図８および図９を参照しつつ説明した、手書き描画線の場合の処理ステップの変更を反映させればよい。表示倍率が異なる場合には、さらに手書き重畳データを変倍する。具体的には、重畳位置決定段階（Ｓ２４８）において、手書き重畳データに示される各点Ｅｉの相対座標値に表示比率を乗算し、さらにこれに対応する１点の座標値を加算して、重畳位置を決定する。
【０１１９】
このように、個別画面とは表示倍率が異なる共有画面データに対して、手書き描画線を示す重畳データを重畳することもできる。
【０１２０】
（実施の形態２）
次に、実施の形態２にかかる電子会議システム１について説明する。実施の形態１にかかるサーバ２０は、ユーザから指定された基準位置に基づいて、重畳位置を決定したが、実施の形態２にかかるサーバ２０は、ユーザからの指定を受け付けることなく、自動的に重畳位置を決定する。この点で、本実施の形態にかかるサーバ２０は、実施の形態１にかかるサーバ２０と異なる。図１２は、実施の形態２にかかるサーバ２０の機能構成を示すブロック図である。機能構成としては、実施の形態２にかかるサーバ２０の第１個別画面管理ユニット２００は、実施の形態１にかかる第１個別画面管理ユニット２００の構成に加えて、基準領域設定部２３０をさらに備えている。また、実施の形態２にかかる共有画面管理ユニット２０８は、実施の形態１にかかる共有画面管理ユニット２０８の構成に加えて基準領域検出部２５８をさらに備えている。
【０１２１】
基準領域設定部２３０は、第１クライアント受信部２１４からの座標データに基づいて、画面データ中の所定の領域を基準領域として定める。また、基準領域検出部２５８は、共有メモリ２１０に置かれたデータを参照しつつ、共有画面データから基準領域と同一の領域を検出する。
【０１２２】
ここで、図１４を参照しつつ、基準領域について説明する。図１４に示す第１個別画面表示ウィンドウ４２においては、基準領域として重畳データを含む領域６４が設定されている。なお、基準領域６４は、重畳元と重畳先における画面データが同一の領域を特定するために定める領域である。したがって、表示画面における任意の領域であればよく、その大きさおよび位置は特に限定されない。
【０１２３】
本実施の形態においては、基準領域設定部２３０が基準領域を設定する方法は予め定められている。基準領域設定部２３０は、例えば、重畳データが選択されると、重畳データから所定の距離内にある、予め定められた大きさの領域を基準領域として設定する。
【０１２４】
次に、図１３を参照しつつ、重畳データを重畳する場合の、実施の形態２にかかる電子会議システム１の処理ステップを説明する。なお、第１個別画面表示ウィンドウ４２は透明スクリーンが重畳された重畳描画モードにあり、Ａｃｒｏｂａｔ　Ｒｅａｄｅｒの文書の上に重畳データが重畳して貼り付けられている。
【０１２５】
実施の形態１において図７を参照しつつ説明したＳ１００からＳ１０４における処理により、第１個別画面表示ウィンドウ４２に対して、画面間コピーモードが設定される（Ｓ３００）。次に、基準領域設定部２３０は第１個別画面表示ウィンドウ４２に表示されている第１個別画面データ６０における所定の領域を基準領域として決定する（Ｓ３０２）。
【０１２６】
次に、ベクトル算出部２２４は、基準領域設定部２３０が設定した基準領域と、重畳データの間のベクトルを算出する（Ｓ３０４）。
【０１２７】
例えば、図１４に示すように、基準領域６４における左上の点Ｆを、基準領域６４の位置を示す点とし、また、重畳データ６１における左上の点Ｇを、重畳データ６１の位置を示す点とした場合には、ベクトル算出部２２４は、ベクトルＦＧを算出する。
【０１２８】
次に、基準領域設定部２３０は、基準領域６４のビットマップデータを共有メモリ２１０にコピーする（Ｓ３０６）。そして、通知情報作成部２２８は、ベクトルＦＧ、共有メモリ２１０におけるコピーされた基準領域のビットマップデータの先頭アドレス、および基準領域の縦方向の画素数と横方向の画素数を含めた基準領域関連情報を作成し（Ｓ３０７）、管理ユニット間通信部２１８は、基準領域関連情報を管理ユニット間通信部２４４へ送る（Ｓ３０８）。
【０１２９】
次に、基準領域検出部２５８は、管理ユニット間通信部２４４を介して受け取った基準領域関連情報に基づいて、画面バッファ２４０から基準領域と同じデータ領域を抽出する（Ｓ３１０）。そして、検出結果を管理ユニット間通信部２４４を介して管理ユニット間通信部２１８へ送る（Ｓ３１４）。
【０１３０】
基準領域検出部２５８によって、共有画面データ中から基準領域と同一の領域が検出された場合には（Ｓ３１６，Ｙｅｓ）、画面バッファ２４０中の共有画面データにおける同一の領域の位置を重畳位置決定部２５０へ送る（Ｓ３１８）。
【０１３１】
一方、管理ユニット間通信部２１８は、基準領域を検出した旨の通知を受け取ると（Ｓ３２０，Ｙｅｓ）、管理ユニット間通信部２４４に画面間コピーモード設定通知を送る（Ｓ３２２）。そして、重畳データ管理部２２２は、重畳データであるビットマップデータを共有メモリ２１０にコピーする（Ｓ３２４）。さらに、通知情報作成部２２８は、ベクトル算出部２２４によって算出されたベクトルＦＧの値（座標値）、重畳データのビットマップ領域の縦方向の画素数と横方向の画素数、および共有メモリ２１０における重畳データのビットマップデータの先頭アドレスを含む重畳関連情報を作成し（Ｓ３２６）、管理ユニット間通信部２１８は、重畳関連情報を管理ユニット間通信部２４４へ送る（Ｓ３２８）。
【０１３２】
なお、Ｓ３２０において、基準領域の検出に失敗した旨の通知を受け取ると（Ｓ３２０，Ｎｏ）、再びＳ３０２へ戻り、基準領域設定部２３０は、再度基準領域を設定する。なおこのとき、基準領域設定部２３０は、前回設定した基準領域に比べて、小さい領域を基準領域とする。
【０１３３】
一方、管理ユニット間通信部２４４がＳ３２２において画面間コピーモード設定通知を受け取ったときに、共有画面表示ウィンドウ４１に対して重畳描画モードが設定されていない場合（Ｓ３３０，Ｎｏ）、重畳描画モードに設定する（Ｓ３３２）。これ以降（Ｓ３３４〜Ｓ３４２）における共有画面管理ユニット２０８の動作は、図７において説明した実施の形態１における共有画面管理ユニット２０８のＳ１２０〜Ｓ１５６における動作と同様である。
【０１３４】
このように、実施の形態２によれば、ユーザから基準位置の指定を受け付けることなく、自動的に、重畳先を決定することができる。
【０１３５】
なお、これ以外のサーバ２０の機能および構成は、図３を参照しつつ説明した、実施の形態１におけるサーバ２０の機能および構成と同様である。また、クライアント１０の機能および構成も、実施の形態１のクライアント１０の機能および構成と同様である。
【０１３６】
以上、図１３および図１４を参照しつつ、写真などの画像データを自動的に重畳する場合の電子会議システム１における処理ステップについて説明したが、実施の形態２にかかる電子会議システム１は、同様に、手書き描画線を自動的に重畳することができる。
【０１３７】
図１５は、実施の形態２にかかる電子会議システム１によって、手書き描画線を示す重畳データ６２Ａ，６２Ｂと、この重畳データ６２Ａ，６２Ｂに対して設定される基準領域６６，６７とを示している。ユーザによって描画線を含む領域６３が選択されると、描画線を含む領域６３近傍における所定の領域が、基準領域として設定される。図１５（Ａ）においては、基準領域６６が設定されている。基準領域６６に対して、基準領域検出部２５８が基準領域を検出しなかった場合には、図１５（Ｂ）に示すように、元の基準領域６６よりも小さい基準領域６７が新たに設定される。これにより、基準領域と同一の領域を検出することに成功すると、図１６に示すように、共有画面データ８０中に、重畳データ８２Ａ，８２Ｂが重畳される。
【０１３８】
（実施の形態３）
次に実施の形態３にかかる電子会議システム１について説明する。本実施の形態にかかるサーバ２０は、重畳元ウインドウ内で任意の基準位置を指定し、さらにこの基準位置と予め定められた位置および大きさの関係を有する領域に基づいて重畳データの重畳位置を決定する。この点で、他の実施の形態にかかるサーバ２０と異なる。なお、実施の形態３にかかるサーバ２０の機能構成を示すブロック図は図１２と同様である。
【０１３９】
本実施の形態にかかるサーバ２０の処理ステップを図１３を参照しつつ、実施の形態２にかかるサーバ２０の処理ステップと異なる処理について説明する。本実施の形態にかかるサーバ２０は、Ｓ３００において画面間コピーモードに設定されたときにユーザから第１個別画面表示ウィンドウ４２内の任意の点の入力を受け付ける。そして、Ｓ３０２においては、この受け付けた入力点と所定の位置関係にある基準領域が設定される。また、Ｓ３１０において、基準領域検出部２５８は、管理ユニット間通信部２４４を介して受け取った基準領域関連情報に基づいて、画面バッファ２４０から基準領域と同じデータ領域を抽出する。なお、ユーザにより共有画面に基準領域と同じデータ領域が存在するように基準点が指定されるため、検出結果を管理ユニット間通信部２１８へは送信しない。また、共有画面管理ユニット２０８と第１個別画面管理ユニット２００は、基準領域の有無の判断処理（Ｓ３１６，Ｓ３２０）は行わない。
【０１４０】
なお、これ以外のサーバ２０の機能および構成は、図１２を参照しつつ説明した、実施の形態２におけるサーバ２０の機能および構成と同様である。また、クライアント１０の機能および構成も、実施の形態１のクライアント１０の機能および構成と同様である。
【０１４１】
以上、図１３を参照しつつ、写真などの画像データを重畳する場合の電子会議システム１における処理ステップについて説明したが、実施の形態３にかかる電子会議システム１は、同様に、手書き描画線を重畳することができる。
【０１４２】
このように、実施の形態３によれば、ユーザから１つの基準位置の指定を受け付けることにより、重畳先を決定することができる。
【０１４３】
（実施の形態４）
次に実施の形態４にかかる電子会議システム１について説明する。実施の形態１にかかるサーバ２０は、ユーザから２点の入力を受け付け、２点間の距離に基づいて、表示比率を算出したが、実施の形態３にかかるサーバ２０は、ユーザからの指定を受け付けることなく、自動的に表示比率を算出する。この点で、本実施の形態にかかるサーバ２０は、実施の形態１にかかるサーバ２０と異なる。また、共有画面表示ウィンドウ４１および第１個別画面表示ウィンドウ４２には、文書の表示倍率がさらに表示される。
【０１４４】
図１７は、実施の形態４にかかるサーバ２０の機能構成を示すブロック図である。機能構成としては、実施の形態３にかかるサーバ２０の第１個別画面管理ユニット２００は、実施の形態１にかかる第１個別画面管理ユニット２００の２点間距離算出部２２６にかえて、表示倍率検出部２３２を備えている。また、実施の形態４にかかる共有画面管理ユニット２０８は、実施の形態１にかかる共有画面管理ユニット２０８の機能構成に加えて、表示倍率検出部２５６をさらに備えている。
【０１４５】
表示倍率検出部２３２は、第１個別画面データから表示倍率を検出する。同様に、共有画面管理ユニット２０８の表示倍率検出部２５６は、共有画面データから表示倍率を検出する。
【０１４６】
図１８（Ａ）は、本実施の形態において、第１個別画面表示ウィンドウ４２に表示される文書表示ウィンドウ９０を示す。文書表示ウィンドウ９０は、表示倍率を表示する領域を含んでいる。本実施の形態においては、表示倍率を示す領域７０は、文書表示ウィンドウ９０の左下に設けられている。このように、本実施の形態において採用される画面データは、常にウィンドウの所定の位置に表示倍率を表示させている。
【０１４７】
表示倍率検出部２３２は、具体的には、ＯＣＲ（Ｏｐｔｉｃａｌ　Ｃｈａｒａｃｔｅｒ　Ｒｅｃｏｇｎｉｔｉｏｎ）機能によって、ビットマップデータから表示領域７０中の数字を識別する。ＯＣＲは一般的にスキャナから読み取った紙面画像データ中の文字画像データから文字認識を行い、文字をテキストデータとして出力する技術であるが、これを画面データに対して適用させる。
【０１４８】
ビットマップデータはカラー表示用のＲＧＢ形式であるため、これを以下の式を用いて輝度データ（Ｙ）に変換し、この輝度データについて２値化する。
Ｙ＝０．３１Ｒ＋０．５９Ｇ＋０．１１Ｂ
この式は、Ｒ、Ｇ、ＢからＮＴＳＣ（Ｎａｔｉｏｎａｌ　Ｔｅｌｅｖｉｓｉｏｎ　Ｓｙｓｔｅｍ　Ｃｏｍｍｉｔｔｅｅ）の輝度信号Ｙに変換する式である。そして、表示倍率検出部２３２は、この２値化されたビットマップデータについて文字認識を行い、文字をテキストデータとして通知情報作成部２２８へ送る。図１８に示す例では、表示倍率のテキストデータとして「１００％」が検出される。
【０１４９】
なお、文書を表示させているアプリケーションのウィンドウ内における表示倍率の表示位置と表示領域は、各アプリケーションに対応付けてシステムファイルとして予めハードディスクに記憶しておく。例えばＡｃｒｏｂａｔ　Ｒｅａｄｅｒの場合には、この矩形の対角の２点の座標は、ウィンドウの左下の角の座標からの相対座標で表す。そして、この２点の座標値はアプリケーション名に対応付けてシステムファイルとしてハードディスクに記憶しておく。図１８（Ｂ）に示す例において、点Ｅと点Ｆは、表示倍率の表示領域を示しており、点Ｑは、Ａｃｒｏｂａｔ　Ｒｅａｄｅｒのウィンドウの左下の角を示している。この場合、Ａｃｒｏｂａｔ　Ｒｅａｄｅｒに対応付けて、点Ｑからの相対座標で表された点Ｅと点Ｆの座標値をシステムファイルとしてハードディスクに記憶しておく。これにより、アプリケーションに応じて、表示倍率の表示位置を特定することができる。
【０１５０】
また、この表示倍率の表示位置と表示領域は、サーバ２０のタッチ入力装置として機能している大型ディスプレイ装置２のタッチパネル３４上で表示倍率の画面データを矩形で囲むことで指定してもよい。
【０１５１】
なお、第１個別ウィンドウ制御部２２６は、アプリケーションのウィンドウに付加しているタイトルバーの中にそのアプリケーションから受け取った文書などの画面データのファイル名を表示させる。また、第１個別ウィンドウ制御部２２６はその画面データのファイル名からアプリケーションを特定する。例えば、ファイル名の拡張子（”．”の後の部分）が”ｐｄｆ”の場合、この文書はＰＤＦ文書であり、文書表示アプリケーションはＡｃｒｏｂａｔ　Ｒｅａｄｅｒであると判断する。
【０１５２】
次に、図１９を参照しつつ、表示倍率の異なる画面データに対して、重畳データを重畳する場合の、実施の形態４にかかる電子会議システム１の動作を説明する。
【０１５３】
まず、ユーザによって、重畳データの領域内をタッチペン１１を利用してタッチされると（Ｓ４００）、第１個別画面管理ユニット２００はその指定された重畳データを選択する（Ｓ４０３）。さらに画面間コピーボタン３００がタッチされると（Ｓ４０２）、第１個別画面管理ユニット２００は、画面間コピーモードに設定する（Ｓ４０６）。次に、表示倍率検出部２３２は、第１個別画面に表示された文書の表示倍率を検出する（Ｓ４０８）。
【０１５４】
具体的には、まず図１８（Ｂ）に示した文書表示ウィンドウ９０の左下の角の点Ｑの座標を特定する。そして、この画面データに対応付けられた表示倍率７０の表示領域を示す点Ｅと点Ｆの相対座標値（点Ｑからの相対座標）に基づいて、点Ｅと点Ｆの絶対座標を求める。そして、画面バッファ中の点Ｅと点Ｆを対角とする矩形領域の画面データに対して文字認識により表示倍率を検出する。
【０１５５】
以下、Ｓ４０９〜Ｓ４４４における共有画面管理ユニット２０８、第１個別画面管理ユニット２００、および第１クライアント１０における各処理ステップは、図７において説明したＳ１１１〜Ｓ１２０における処理ステップと同様であるので説明を省略する。なお、本実施の形態において作成される重畳関連情報には、表示倍率検出部２３２が検出した表示倍率を示す情報が含まれている。
【０１５６】
Ｓ４４４において、共有画面表示ウィンドウ４１に対して画面間コピーモードが設定されると、次に、表示倍率検出部２５６は、共有画面データ８０に表示された文書の表示倍率Ｍａｇ＿ｄｓｔを検出する（Ｓ４４６）。次に、表示比率算出部２４８は、表示倍率検出部２５６が算出した表示倍率および、重畳関連情報に含まれる第１個別画面データ６０の表示倍率値Ｍａｇ＿ｓｒｃから、表示比率（＝Ｍａｇ＿ｄｓｔ／Ｍａｇ＿ｓｒｃ）を算出する（Ｓ４４８）。そして、重畳部２４６は、表示比率算出部２４８が算出した表示比率に基づいて、重畳データを変倍する（Ｓ４５２）。さらに、サーバ通信部１０２から基準点の通知を受け取ると（Ｓ４６２）、重畳位置決定部２５０は、基準点、および表示比率に基づいて重畳位置を決定する（Ｓ４７０）。次に、重畳部２４６は、透明スクリーン上に重畳データを重畳して貼り付ける（Ｓ４７２）。次に、共有画面データ送信部２４２は、更新後の共有画面データを各表示画面３２，１１０に送信する（Ｓ４７４）。
【０１５７】
このように、実施の形態４によれば、共有画面表示ウィンドウ４１、第１個別画面表示ウィンドウ４２に表示されている文書の表示倍率を読み取ることにより、表示比率を算出することができる。したがって、ユーザからの入力に頼ることなく、自動的に表示比率を算出することができる。
【０１５８】
（実施の形態５）
次に、実施の形態５にかかる電子会議システム１について説明する。実施の形態１〜４にかかる電子会議システム１においては、既に表示されている手書き描画線に対して重畳対象部分を指定して、異なる画面データ上の対応する位置に重畳データを重畳したが、実施の形態５では、ユーザにより手書き描画が行われると、その手書き描画線を示す重畳データをリアルタイムに重畳することができる。
【０１５９】
実施の形態５においては、図２０に示すように、第１個別画面表示ウィンドウ４２に対して、ユーザから手書き描画線７４が入力されると、手書き描画線７４を含む基準領域７２が設定される。そして手書き描画線７４の重畳データと、基準領域７２とに対して、図１３におけるＳ３０２からＳ３４２の処理が行われる。この処理を所定の時間間隔毎に繰り返すことによって、重畳データをリアルタイムに重畳することができる。
【０１６０】
なお、所定の時間間隔毎とは、例えば、ユーザからの手書き描画線の入力が所定の量に達する毎であってもよい。また例えば、一定の時間が経過する毎であってもよい。
【０１６１】
以下では、各実施の形態にかかる電子会議システム１に共通の構成および処理ステップについて説明する。
【０１６２】
まず、表示画面１１０に表示される２つの第１個別画面表示ウィンドウ４２間で、データを重畳する場合について説明する。なお、表示画面１１０は、複数の個別ウィンドウを表示可能である。
【０１６３】
図２１（Ａ）に示す表示画面１１０においては、共有画面表示ウィンドウ４１は、アイコン化されており、第１個別画面表示ウィンドウ４２Ａ，４２Ｂが表示されている。第１個別画面表示ウィンドウ４２Ａ，４２Ｂには異なるアプリケーションが表示されている。例えば、第１個別画面表示ウィンドウ４２Ｂは、Ａｄｏｂｅ　Ｓｙｓｔｅｍｓ社製のＡｃｒｏｂａｔ　Ｒｅａｄｅｒを表示し、第１個別画面表示ウィンドウ４２Ｂは、Ｎｅｔｓｃａｐｅ　Ｃｏｍｍｕｎｉｃａｔｉｏｎｓ社製のＷｅｂブラウザＮｅｔｓｃａｐｅを表示してもよい。
【０１６４】
以下、第１個別画面表示ウィンドウ４２Ａに表示された第１個別画面データ９０中の重畳データ９２のビットマップデータを第１個別画面表示ウィンドウ４２Ｂに表示された第１個別画面データ９６上に重ねられた透明スクリーン上の任意の位置に重畳する方法について説明する。
【０１６５】
まず、図２１（Ａ）に示す表示画面１１０に設けられたフリーズボタン３１０がタッチペン１１でタッチされると、第１個別画面ウィンドウ２２６はこのボタンをリバース表示とし、フリーズ領域３１５の画面データを凍結（フリーズ）する。すなわち、ＮｅｔｓｃａｐｅやＡｃｒｏｂａｔ　Ｒｅａｄｅｒのウィンドウの操作ができない状態となる。なお、第１個別画面表示ウィンドウ４２Ａ，４２Ｂは、フリーズ領域３１５内に表示されている。
【０１６６】
このとき、表示画面１１０に表示された矩形領域指定アイコン３１２がタッチされると、矩形領域設定モードとなる。このモードにある場合、タッチペン１１がタッチパネル１１２に接触された（ペンダウン）点が矩形の左上角となり、タッチパネル１１２から離された（ペンアップ）点が矩形の右下角となる。ここで、ユーザが第１個別画面表示ウィンドウ４２Ａに表示された第１個別画面データ９０における重畳データ９２を囲んだ領域（矩形領域）を指定すると、サーバ２０において重畳データ管理部２２２が重畳データ９２に対応するビットマップデータを画面バッファ２１１に格納する。
【０１６７】
そして、再度フリーズボタン３１０がタッチされると、このボタンを正常表示に戻し、フリーズ領域３１５の画面データのフリーズを解除する。このときさらにユーザにより切換ボタン３１４がタッチされると、重畳モードに設定される。図２１（Ｂ）は、重畳モードに設定されたときの表示画面１１０を示している。なお、図２１（Ｂ）に示す表示画面１１０において、第１個別画面表示ウィンドウ４２Ａは閉じられている。図２１（Ｂ）に示す表示画面１１０には、切換ボタン３１４が押される前に表示されていたフリーズ領域３１５と同じ位置に重畳描画可能領域３１６が設けられている。重畳描画可能領域３１６は、仮想的な透明スクリーンが重畳される領域である。
【０１６８】
また、このとき、フリーズボタン３１０、および矩形領域指定ボタン３１２の表示を消し、かわりに、保存ボタン３１８、読出ボタン３２０、画面間コピーボタン３００、および手書きボタン３０４を表示させる。
【０１６９】
そして、ユーザにより重畳描画可能領域３１６内の任意の位置がタッチされると、先に共有メモリ２１０にコピーした重畳データ９２のビットマップデータをタッチされた位置に重畳して、ユーザが指定した位置に重畳データ９２と同一のデータ９４が表示される。
【０１７０】
次に、図２２を参照しつつ、第１個別画面表示ウィンドウ４２に手書き文字などを描画する方法について説明する。図２２においては、共有画面表示ウィンドウ４１はアイコン化されており、第１個別画面表示ウィンドウ４２のみが表示されている。第１個別画面表示ウィンドウ４２には１つのアプリケーションが表示されている。このアプリケーションプロセスは例えばＡｄｏｂｅ　Ｓｙｓｔｅｍｓ社製のＡｃｒｏｂａｔ　Ｒｅａｄｅｒである。画面に表示された切換ボタン３１４がタッチされると、第１個別画面表示ウィンドウ４２に対して重畳描画モードが設定される。このとき、図２１（Ｂ）に示した重畳描画可能領域３１６と同じ位置に設けられた重畳描画可能領域３１８に対して仮想的な透明重畳スクリーンが重畳される。
【０１７１】
さらに、手書きボタン３０４がタッチされると、このボタンをリバース表示とし、重畳手書き描画モードとなる。また、この時、線種を選択するための線種ボタン３２６、矩形を描画するための矩形ボタン３２８、描画線を消去するための消ゴムボタン３３０、他の画面に重ねるべき手書きの描画領域を指定するための領域指定ボタン３０６等を表示させる。
【０１７２】
重畳手書き描画モードに設定されている場合、第１クライアント受信部２１４は、サーバ通信部１０２から受け取った各座標値が重畳描画可能領域３１８にあるか否かを判断し、２つの連続した座標値がこの領域にあり、かつペンダウン状態（ペンダウンからペンアップまでの期間）である場合には、各座標値間を直線で結んで表示させるための描画コマンドを第１個別ウィンドウ制御部２２６へ送る。
【０１７３】
第１個別ウィンドウ制御部２２６は、この描画コマンドに従った描画を行い、手書きの描画線が第１クライアント１０の第１個別画面表示ウィンドウ４２内に表示される。第１クライアント受信部２１４はまた、サーバ通信部１０２から受け取ったペンダウンからペンアップまでの座標列をストロークデータとしてメインメモリに格納する。
【０１７４】
なお、クライアント端末として本実施例の携帯型表示パッドの代わりに市販のノートパソコンを使用することができ、この場合、ノートパソコンのマウスの左ボタンを押すことによって手書き描画することも可能である。この場合、第１クライアント受信部２１４は、マウスの左ボタンＯＮのイベント受信によりペンダウンを、またマウスの左ボタンＯＦＦのイベント受信によりペンアップを検出する。
【０１７５】
以上、実施の形態１から実施の形態５における電子会議システム１に特徴的な構成および処理ステップについて説明した。なお、以上においては、サーバ２０、大型ディスプレイ装置２、および第１クライアント１０の構成および処理ステップについて説明したが、他のクライアント１２，１４の構成は、第１クライアント１０の構成と同様である。また、以上においては、第１個別画面データ上の重畳データを共有画面データ上に重畳する場合について説明したが、他の個別画面データ、すなわち第２個別画面データ、または第３個別画面データから共有画面データ上に重畳する場合の処理ステップは、各実施の形態において説明した、第１個別画面データから共有画面データ上に重畳する場合の処理ステップと同様である。
【０１７６】
また、実施の形態１から実施の形態５における電子会議システム１においては、第１個別画面データ６０上の重畳データを、共有画面データ８０上に重畳する場合について説明したが、他の例としては、共有画面データ８０上の重畳データを、第１個別画面データ６０上に重畳してもよい。
【０１７７】
なお、実施の形態１〜５において説明した電子会議システム１は、ＶＮＣクライアントサーバシステムによって実現されることができる。図２３を参照しつつ、ＶＮＣクライアントサーバシステムについて説明する。
【０１７８】
図２３（Ａ）は、ＶＮＣプロトコル（ＲＦＢプロトコル）とＸプロトコルとの関係を示す。サーバ２０は、ＶＮＣサーバプロセス３１０（以降、ＶＮＣサーバと記載）およびＸクライアントプロセス３３０として機能し、大型ディスプレイ装置２、各クライアント１０，１２，１４は、ＶＮＣクライアントプロセス３００（以下、「ＶＮＣクライアント」と称する）として機能する。ＶＮＣサーバ３１０は、その起動時に１つの画面バッファを生成し、ＶＮＣクライアント３００はこの画面バッファにある画面データを自装置の表示画面に表示する。
【０１７９】
ＶＮＣサーバ３１０からＶＮＣクライアント３００へ送信される画面データおよびＶＮＣクライアント３００からＶＮＣサーバ３１０へ送信されるユーザの入力データは、ＲＦＢ（Ｒｅｍｏｔｅ　Ｆｒａｍｅ　Ｂｕｆｆｅｒ）プロトコルを使用して転送される。
【０１８０】
ＲＦＢプロトコルは１画面のデータを小領域（矩形）に分割し、さらにこの小領域の画像データを圧縮して送信する機能を持っている。この小領域の最小ブロックはタイルと呼ばれ、１６×１６画素である。このように、ＶＮＣサーバ３１０は、１画面のデータを分割して送信することができるため、１画面の中で変更のあった領域のみを選択して送信することができる。
【０１８１】
なお、サーバ２０に存在するＶＮＣサーバ３１０と各クライアント１０，１２，１４に存在するＶＮＣクライアント３００とはソケットにより通信できるようになっている。
【０１８２】
ＶＮＣサーバ３１０は、ＶＮＣクライアント３００から受信したユーザの入力データをキーイベントまたはポインタイベントとして処理する。これらのイベントを受けると、ＶＮＣサーバ３１０は、Ｘサーバ３２０として動作し、Ｘクライアント３３０に対してＸイベントを通知する。したがって、ＶＮＣクライアント３００は、サーバ２０で動いているＸクライアント３３０（アプリケーション）を操作できる。
【０１８３】
次に、図２３（Ｂ）を参照しつつ、クライアント１０，１２，１４がサーバ２０に接続してサーバ２０で動いているアプリケーション（Ｘクライアント）を操作して、文書を表示するまでの処理ステップについて説明する。
【０１８４】
サーバ２０はまず、必要とされる画面バッファの数だけ、ＶＮＣサーバ３１１，３１２，３１３，３１４を起動する。この画面バッファが複数のクライアントにより共有されないようにする、すなわち、１つのクライアントのみがアタッチするように設定する場合、ＶＮＣサーバの起動コマンドには画面番号のみを指定する。例えば、画面番号を２とした場合のＶＮＣサーバの起動コマンドは「ｖｎｃｓｅｒｖｅｒ：２」となる。
【０１８５】
サーバ２０の画面バッファが複数のクライアントにより共有されるようにする場合には、ＶＮＣサーバの起動コマンドに画面番号に加えて共有を指示するオプションを指定する。例えば、画面番号１を共有とする場合のＶＮＣサーバの起動コマンドは、「ｖｎｃｓｅｒｖｅｒ　−ａｌｗａｙｓｓｈａｒｅｄ　：１」である。
【０１８６】
このようにして、サーバ２０にて画面番号１を共有、画面番号２〜４を各クライアント１０，１２，１４が個別にアタッチするようにＶＮＣサーバを起動しておく。
【０１８７】
そして、各クライアント１０，１２，１４はサーバ２０のＩＰ（Ｉｎｔｅｒｎｅｔ　ｐｒｏｔｏｃｏｌ）アドレスとアタッチする画面番号を指定して各ＶＮＣクライアント３０２，３０３，３０４を起動する。アタッチする画面番号を３とした場合のＶＮＣクライアントの起動コマンドは、例えば「ｖｎｃｖｉｅｗｅｒ１９２．１６８．１．１：３」である。ここで、１９２．１６８．１．１は、ＩＰアドレスを示している。
【０１８８】
各クライアント１０，１２，１４は共有画面（画面番号１）用のＶＮＣクライアントと１つの個別画面（画面番号２〜４）用のＶＮＣクライアントをそれぞれ起動する。そして、各クライアント１０，１２，１４の表示画面１１０，１２０，１３０上にそれぞれ共有画面４１，４３，４５と個別ウィンドウ４２，４４，４６を表示する。
【０１８９】
サーバ２０はまた、共有画面を大型ディスプレイ装置２に表示させるために、自装置のＩＰアドレスと画面番号１を指定してＶＮＣクライアント３０１を起動する。
【０１９０】
このようにして、大型ディスプレイ装置２には共有画面のみが表示され、各クライアント１０，１２，１４には、共有画面と個別画面がそれぞれ表示される。次に、クライアント１０，１２，１４の１つのクライアントにて、共有画面表示ウィンドウにサーバ２０にある任意のアプリケーションを使用して任意の文書を表示させると、同じ文書が大型ディスプレイ装置２とクライアント１０，１２，１４の残りのクライアントの共有画面表示ウィンドウに表示される。
【０１９１】
クライアント１０，１２，１４の各クライアントの個別画面表示ウィンドウには、各クライアント毎にサーバ２０にある任意のアプリケーションを使用して任意の文書を表示させることができる。
【０１９２】
図２３（Ｂ）に示す各アプリケーション３３１，３３２，３３３，３３４，３３５は、それぞれ異なる文書表示アプリケーションプロセスである。複数のＶＮＣサーバが同じ文書表示アプリケーションを起動（起動毎に独立したアプリケーションプロセスが生成）することも可能である。
【０１９３】
また、図２３（Ｂ）では、第２ＶＮＣサーバ３１２の画面においてのみ、２つの文書表示アプリケーションが起動されている。なお、図２３（Ｂ）には図示していないが、サーバ２０には、デスクトップ画面を制御するウィンドウマネージャプロセス（以下、「ウィンドウマネージャ」と称する）が各ＶＮＣサーバ３１１〜３１４毎にそれぞれ存在している。
【０１９４】
第２ＶＮＣサーバ３１２の画面に重畳された透明スクリーンの描画データを第１ＶＮＣサーバ３１１の画面に重畳された透明スクリーンへ重畳する場合、処理に必要なデータを第２ウィンドウマネージャから第１ウィンドウマネージャへ、また第２重畳描画プロセスから第１重畳描画プロセスへそれぞれ渡す必要があるが、これらのデータは、第２ＶＮＣサーバ３１２と第１ＶＮＣサーバ３１１を介して送信する。また、重畳処理の際に、重畳対象の描画データは第１重畳描画プロセスと第２重畳描画プロセスの両方からデータの書き込み、読み出しが可能な共有メモリ２１０上に一旦置かれる。この共有メモリ２１０はメインメモリ上に確保された領域である。
【０１９５】
図２４は、クライアント１０のハードウェア構成を示す図である。クライアント１０は、ＣＰＵ２１、クロック２２、メインメモリ２３、ＲＯＭ２４、ＲＴＣ２５、無線ＬＡＮコントローラ２６、アンテナ２７、ＬＣＤ表示コントローラ２８、ＬＣＤ１１０、タッチパネルコントローラ３０、タッチパネル１１２、ＵＳＢコントローラ３２、ＵＳＢ　Ｉ／Ｆ３３、システムバス３４、バッテリ３５、ＤＣ−ＤＣコンバータ３６、充電回路３７、ＡＣアダプタ３８等から構成されている。
【０１９６】
ＣＰＵ２１は、ＲＯＭ（Ｒｅａｄ　Ｏｎｌｙ　Ｍｅｍｏｒｙ）２４に記憶された制御処理プログラム、ＯＳや各種のアプリケーションプログラムを実行、処理する。クロック２２は、水晶発振子と分周回路から構成されており、ＣＰＵ２１やシステムバス３４の動作タイミングを制御するためのクロックを生成している。
【０１９７】
メインメモリ２３は、ＤＲＡＭ（Ｄｙｎａｍｉｃ　Ｒａｎｄｏｍ　Ａｃｃｅｓｓ　Ｍｅｍｏｒｙ）より構成されており、ＣＰＵ２１のワークエリア等で使用される。ＲＯＭ２４は、システム全体の制御を行うためのプログラムが予め書き込まれている。
【０１９８】
ＲＴＣ（Ｒｅａｌ　Ｔｉｍｅ　Ｃｌｏｃｋ）２５は、日付時計であり、専用バッテリ（図示を省略）によりバックアップされている。無線ＬＡＮコントローラ２６は、ＩＥＥＥ８０２．１１ｂ規格に準拠した無線通信を実行、制御する。
【０１９９】
ＬＣＤ表示コントローラ２８は、文字やグラフィックデータ、またサーバ２０から受信した画面データをＤ／Ａ（Ｄｉｇｉｔａｌ／Ａｎａｌｏｇ）変換するとともに、これらのデータをＬＣＤ１１０に表示するための制御を行う。タッチパネルコントローラ３０は、タッチパネル１１２上でタッチペン１１のペン先が接触した部分を検出し、その位置情報を取り込む。タッチパネル１１２はＬＣＤ１１０と重ね合わせて密着している。ＵＳＢ（Ｕｎｉｖｅｒｓａｌ　Ｓｅｒｉａｌ　Ｂｕｓ）コントローラ３２はＵＳＢ規格に準拠したデータ転送を実行、制御する。
【０２００】
バッテリ３５は、充電が可能な例えばリチウムイオンバッテリ等である。ＤＣ−ＤＣコンバータ３６はＡＣアダプタ３８またはバッテリ３５から供給される電源を所定の電圧に変換してクライアント１０内部に供給するとともに、ＡＣアダプタ３８からの電源供給が無い場合はバッテリ３５からの電源供給に切り換える。充電回路３７はＡＣアダプタ３８から電源が供給されている時にバッテリ３５を充電する。ＡＣアダプタ３８は着脱可能な電源ケーブルと一体化しており、内蔵されたＡＣ−ＤＣコンバータにより、交流電源を所定の電圧の直流に変換する。
【０２０１】
クライアント１０は、ＯＳとしてＬｉｎｕｘ（Ｒ）、ウィンドウシステムとしてＸウィンドウ（Ｒ）を実装している。
【０２０２】
タッチパネル１１２を用いて検出されるタッチ入力座標とＬＣＤ１１０の表示座標との関係について説明する。タッチペン１１がタッチパネル１１２に接触すると、タッチパネルコントローラ３０はこの接触を検出し、ＣＰＵ２１に割り込みを発生させる。ＣＰＵ２１はこの割り込みにより、タッチパネルコントローラ３０から座標値を得る。このタッチ入力座標は、ＬＣＤ１１０の表示領域の左上の角を原点として、右方向をＸ軸の正の方向、下方向をＹ軸の正の方向として表現する。
【０２０３】
ＬＣＤ１１０の表示画素の位置は、ＬＣＤ１１０の表示領域の左上の角にある画素位置を原点として、右方向をＸ軸の正の方向、下方向をＹ軸の正の方向とした表示座標で表現する。すなわち、
表示座標＝（原点位置の画素からのＸ軸方向の画素数，原点位置の画素からのＹ軸方向の画素数）
である。
【０２０４】
説明を簡単にするために、タッチ入力座標の間隔とＬＣＤ１１０の画素間隔は同じであり、タッチ入力座標とＬＣＤ１１０の表示座標は一致しているものとする。なお、タッチ入力座標の原点をＬＣＤ１１０の表示座標の原点に合わせるにはキャリブレーションを実行する。キャリブレーションは、表示座標とタッチ入力座標との対応付けを行うための操作であり、従来から広く知られた技術であるためその説明は省略する。
【０２０５】
以上、クライアント１０のハードウェア構成等について説明したが、他のクライアント１２，１４のハードウェア構成等は、クライアント１０のハードウェア構成等と同様である。
【０２０６】
また、サーバ２０のハードウェア構成は、図２４を参照しつつ説明したクライアント１０のハードウェア構成とほぼ同様である。
【０２０７】
以上、本発明を実施の形態を用いて説明したが、上記実施の形態に多様な変更または改良を加えることができる。
【０２０８】
そうした変更例としては、本実施の形態においてはクライアントサーバシステムを採用した電子会議システム１について説明したが、他の形態としては、スタンドアロン型のコンピュータによって本発明における画面データ管理装置が実現されてもよい。この場合、画面データ管理装置は、図２を参照しつつ説明した、サーバ２０の共有画面管理ユニット２０８および第１個別画面管理ユニット２００、並びにクライアント１０の機能構成を備える。なお、この場合には、各光性は同一装置内に設けられているため、共有画面管理ユニット２０８および第１個別画面管理ユニット２００とクライアント１０の間の無線ＬＡＮなどで接続されなくともよい。なお、本例における画像データ管理装置における共有画面管理ユニット２０８および第１個別画面管理ユニット２００、並びにクライアント１０の機能構成は、図２において説明した実施の形態１にかかる共有画面管理ユニット２０８および第１個別画面管理ユニット２００、並びにクライアント１０の機能構成と同様である。このように、スタンドアロン型のコンピュータにおいても、実施の形態１にかかる電子会議システム１と同様にディスプレイ画面の表示内容を管理することができる。
【０２０９】
【発明の効果】
以上説明したように、請求項１にかかる発明によれば、第１の画面データにおける重畳データが重ねられた位置と、予め定められた基準位置とに基づいて、重畳データが重ねられている位置の、第１の画面データ上における相対的な位置を把握し、第１の画面データと重畳データとの相対的な位置関係と第２の画面データと重畳データとの相対的な位置関係が等しくなるような位置に重畳データを重ねることができる。さらにこの際、画面データのアプリケーションを利用する必要がなく、データ管理装置の利便性を向上させることができるという効果を奏する。
【０２１０】
また、請求項２にかかる発明によれば、第１の画面データに対して設定されている基準位置と、この基準位置に対応する第２の画面データにおける基準位置としてユーザから指定された位置とに基づいて第１の画面データと第２の画面データにおける位置関係を把握し、この位置関係に基づいて重畳位置を決定することができる。すなわち、取得手段が取得した第２の画面データにおける基準位置に基づいて、アプリケーションを利用することなく、位置精度よく第２の画面データ上に重畳データを重畳することができ、画面データ管理装置の利便性を向上させることができるという効果を奏する。
【０２１１】
また、請求項３にかかる発明によれば、取得手段が取得した第１の画面データにおける基準位置に基づいて、アプリケーションを利用することなく、位置精度よく第２の画面データ上に重畳データを重畳することができ、画面データ管理装置の利便性を向上させることができるという効果を奏する。
【０２１２】
また、請求項４にかかる発明によれば、重畳データを所望の位置に重ねることができるので、重畳位置を確定するまでの位置調整が不要となり、画面データ管理装置の利便性を向上させることができるという効果を奏する。
【０２１３】
また、請求項５にかかる発明によれば、第１の画面データと第２の画面データの表示倍率が異なる場合であっても、アプリケーションを利用することなく、位置精度よく重畳データを重畳することができる。このように、重畳データを所望の位置に重ねることができるので、重畳位置を確定するまでの位置調整が不要となり、画面データ管理装置の利便性を向上させることができるという効果を奏する。
【０２１４】
また、請求項６にかかる発明によれば、第１の画面データと第２の画面データの表示倍率が異なる場合であっても、アプリケーションを利用することなく、位置精度よく重畳データを重畳することができる。このように、重畳データを所望の位置に重ねることができるので、重畳位置を確定するまでの位置調整が不要となり、画面データ管理装置の利便性を向上させることができるという効果を奏する。
【０２１５】
また、請求項７にかかる発明によれば、重畳データを適切なサイズで正確な位置に重畳することができる。また、重畳位置の調整やサイズの調整が不要となり、画面データ管理装置の利便性を向上させることができるという効果を奏する。
【０２１６】
また、請求項８にかかる発明によれば、重畳データが手書き描画線である場合には、基準位置と描画線を構成する各点との位置関係に基づいて決定した重畳位置に、手書き描画線を重畳する。したがって、アプリケーションを利用することなく、位置精度よく重畳データとしての手書き描画線を重畳することができる。このように、手書き描画線を示す重畳データを所望の位置に重ねることができるので、重畳位置を確定するまでの位置調整が不要となり、画面データ管理装置の利便性を向上させることができるという効果を奏する。
【０２１７】
また、請求項９にかかる発明によれば、重畳手段は、所定の時間間隔で、重畳データを前記第２の画面データに対して重ねるので、リアルタイムに重畳データを重畳することができるという効果を奏する。
【０２１８】
また、請求項１０にかかる発明によれば、第１の画面データにおける重畳データが重ねられた位置と、予め定められた基準位置とに基づいて、重畳データが重ねられている位置の、第１の画面データ上における相対的な位置を把握し、第１の画面データと重畳データとの相対的な位置関係と第２の画面データと重畳データとの相対的な位置関係が等しくなるような位置に重畳データを重ねることができる。さらにこの際、画面データのアプリケーションを利用する必要がなく、データ管理装置の利便性を向上させることができるという効果を奏する。
【０２１９】
また、請求項１１にかかる発明によれば、第１の画面データにおける重畳データが重ねられた位置と、予め定められた基準位置とに基づいて、重畳データが重ねられている位置の、第１の画面データ上における相対的な位置を把握し、第１の画面データと重畳データとの相対的な位置関係と第２の画面データと重畳データとの相対的な位置関係が等しくなるような位置に重畳データを重ねることができる。さらにこの際、画面データのアプリケーションを利用する必要がなく、データ管理装置の利便性を向上させることができるという効果を奏する。
【０２２０】
また、請求項１２にかかる発明によれば、第１の画面データにおける重畳データが重ねられた位置と、予め定められた基準位置とに基づいて、重畳データが重ねられている位置の、第１の画面データ上における相対的な位置を把握し、第１の画面データと重畳データとの相対的な位置関係と第２の画面データと重畳データとの相対的な位置関係が等しくなるような位置に重畳データを重ねることができる。さらにこの際、画面データのアプリケーションを利用する必要がなく、データ管理装置の利便性を向上させることができるという効果を奏する。
【図面の簡単な説明】
【図１】実施の形態１にかかる電子会議システム１の概略を示す図である。
【図２】サーバ２０の機能的構成を模式的に示す概略ブロック図である。
【図３】各ウィンドウ管理ユニットの機能的構成を示す概略ブロック図である。
【図４】画面バッファにある画面データと、この画面データに重畳する仮想的な透明スクリーンとの関係を模式的に示す図である。
【図５】クライアント１０の機能的構成を示す概略ブロック図である。
【図６】サーバ２０により重畳データが重畳される前後における表示画面１１０を示す図である。
【図７】画像を示す重畳データを重畳する場合の、電子会議システム１の処理を示すフローチャートである。
【図８】手書き描画線を示す重畳データが重畳される前後における表示画面１１０を示す図である。
【図９】手書き描画線を示す重畳データを重畳する場合の、電子会議システム１の処理を示すフローチャートである。
【図１０】異なる表示倍率で表示されている画面データの間で重畳データを重畳する場合の、電子会議システム１の処理を示すフローチャートである。
【図１１】異なる表示倍率で表示されている画面データの間で重畳データを重畳する場合の、重畳前後における表示画面１１０を示す図である。
【図１２】実施の形態２にかかるサーバ２０の機能的構成を示す概略ブロック図である。
【図１３】実施の形態２にかかる電子会議システム１の処理を示すフローチャートである。
【図１４】基準領域を説明するための図である。
【図１５】手書き描画線に対して設定される基準領域を示す図である。
【図１６】共有データに手書き描画線が重畳された後の表示画面１１０を示す図である。
【図１７】実施の形態４にかかるサーバ２０の機能的構成を示すブロック図である。
【図１８】実施の形態４にかかるサーバ２０が表示させる表示画面１１０を示す図である
【図１９】実施の形態４にかかる電子会議システム１の処理を示すフローチャートである。
【図２０】描画途中の手書き描画線を表示する表示画面１１０を示す図である。
【図２１】第１個別画面表示ウィンドウ４２間での重畳の前後における表示画面１１０を示す図である。
【図２２】第１個別画面表示ウィンドウ４２に手書き描画線を描く際に、表示画面１１０に表示される画面を示す図である。
【図２３】ＶＮＣクライアントサーバシステムを示す図である。
【図２４】クライアント１０のハードウェア構成を示す図である。
【符号の説明】
１　電子会議システム
２　大型ディスプレイ装置
１０，１２，１４　クライアント
１１　タッチペン
２０　サーバ
３２，１１０，１２０，１３０　表示画面
４１　共有画面表示ウィンドウ
４２　第１個別画面表示ウィンドウ
５４　透明スクリーン
６０　第１個別画面データ
７４　描画線
８０　共有画面データ
１０２　サーバ通信部
１０４　表示画面制御部
１０６　指示受付部
１１２　タッチパネル
２００，２０２，２０４　個別画面管理ユニット
２０８　共有画面管理ユニット
２１０　共有メモリ
２１１　画面バッファ
２１２　第１個別画面データ送信部
２１４　第１クライアント受信部
２１８　管理ユニット間通信部
２２０　重畳部
２２２　重畳データ管理部
２２４　ベクトル算出部
２２６　第１個別ウィンドウ制御部
２２８　通知情報作成部
２３０　基準領域設定部
２３２　表示倍率検出部
２４０　画面バッファ
２４２　共有画面データ送信部
２４４　管理ユニット間通信部
２４６　重畳部
２４８　表示比率算出部
２５０　重畳位置決定部
２５２　クライアント受信部
２５４　共有ウインドウ制御部
２５６　表示倍率検出部
２５８　基準領域検出部[0001]
TECHNICAL FIELD OF THE INVENTION
The present invention relates to a screen data management device that connects to a plurality of clients that display screen data in a window and controls a window in the client, a screen data management system including the screen data management device, a screen data management method, and a screen. Related to data management programs.
[0002]
[Prior art]
2. Description of the Related Art There has been known an electronic conference system in which a plurality of clients share one document, and a user of each client can add a handwritten annotation to the document or paste bitmap data on the document.
[0003]
For example, a conference server has shared screen data that can be displayed by a plurality of clients, and a plurality of clients can share information by receiving the shared screen data.
[0004]
Other than this, there is known a technique of displaying a joint work area in which a plurality of users work jointly on a single display screen and a personal work area in which each individual works independently (for example, see Patent Document 1). .
[0005]
There is also known a technique in which two documents are simultaneously displayed on one display screen by using an application, and editing of one document can be performed on the other document. In addition, a technology that enables detection of a matching portion between two documents is known (for example, see Patent Document 2).
[0006]
[Patent Document 1]
JP-A-7-210509 (page 5-6, FIG. 3)
[Patent Document 2]
JP-A-8-137656 (pages 3 to 5, FIGS. 8 and 9)
[0007]
[Problems to be solved by the invention]
In the case of using the electronic conference system, each user operating the client can freely add handwritten annotations to the contents displayed on the shared screen, paste bitmap image data such as photos, etc. There is a request to do so.
[0008]
Handwritten data and bitmap data can be easily superimposed on those that cannot be easily added to a document, such as Acrobat Reader (R) manufactured by Adobe Systems or Netscape (R) Web browser manufactured by Netscape Communications. Provision of functions is desired.
[0009]
In addition, when a user adds a handwritten comment to a document displayed on a shared screen or pastes arbitrary bitmap data such as a photograph on a client participating in a meeting, the user may see the document. It has been desired that operations that are not desired, that is, correction of typographical errors at the time of a handwriting retouching operation (erasing with an eraser and rewriting) and fine adjustment of a photo pasting position are not shared.
[0010]
SUMMARY OF THE INVENTION The present invention has been made in view of the above-described problems, and has been disclosed in which a superimposed data virtually superimposed on a predetermined document in one window is displayed in a document displayed in another window without using an application of the document. It is an object to obtain a screen data management device, a screen data management system, a screen data management method, and a screen data management program that can be superimposed on a screen data management device.
[0011]
[Means for Solving the Problems]
To achieve the above object, an invention according to claim 1 is a screen data management device for managing screen data, wherein the superimposed data to be superimposed on the first screen data is displayed on the first screen data. Separately, a first superimposing unit that virtually superimposes the first screen data, a position where the superimposed data is superimposed on the first screen data, and an arbitrary reference in the first screen data Superimposition position determining means for determining a superimposition position at which the superimposition data is to be superimposed on the second screen data, which is partially or entirely the same as the first screen data, based on a positional relationship between the superimposition data and the first screen data; A second superimposing means for virtually superimposing the superimposed data at a position determined by the superimposing position determining means with respect to the second screen data.
[0012]
Here, the reference position is an arbitrary position predetermined in the first screen data. For example, the upper left vertex of the first screen data may be set as the reference position. Further, as another example, one point in a region indicating a characteristic image in the first screen data may be set as the reference position.
[0013]
The screen data management device may manage the first screen data and the second screen data displayed on a display device connected to the screen data management device via, for example, a VGA cable. As an example, the first screen data and the second screen data displayed on a display device connected via a communication line may be managed.
[0014]
According to the first aspect, the superimposition position determination means is configured to perform the superimposition based on a positional relationship between the superimposed data superimposed position in the first screen data and an arbitrary reference position in the first screen data. The superimposition position on which the superimposition data is to be superimposed on the second screen data, which is partially or entirely the same as the first screen data, is determined. The superimposition data is virtually superimposed on the position determined with respect to the superimposition data. Thus, based on the position where the superimposition data is superimposed on the first screen data and the predetermined reference position, the relative position of the position where the superimposition data is superimposed on the first screen data is determined. The position can be grasped, and the superimposed data can be superimposed at a position where the relative positional relationship between the first screen data and the superimposed data is equal to the relative positional relationship between the second screen data and the superimposed data. . Further, at this time, it is not necessary to use a screen data application, and the convenience of the data management device can be improved.
[0015]
The invention according to claim 2 is the screen data management device according to claim 1, wherein the specification of the reference position in the second screen data corresponding to the reference position in the first screen data is obtained. And a superimposition position determining unit that determines the superimposition position on the second screen data based on the reference position and the positional relationship acquired by the acquisition unit. I do.
[0016]
Here, the obtaining unit is a unit that obtains information input by a user via a user interface such as a mouse or a keyboard. When the screen data management device is connected to a network, the obtaining unit may be a unit that obtains information received via the network.
[0017]
According to the second aspect of the present invention, the designation of the reference position in the second screen data corresponding to the reference position in the first screen data acquired by the acquisition means is sent to the superposition position determination means. Can determine the superimposed position on the second screen data based on the reference position and the positional relationship received from the acquisition unit. As described above, the first screen data is set based on the reference position set for the first screen data and the position specified by the user as the reference position in the second screen data corresponding to the reference position. And the positional relationship in the second screen data, and the superimposed position can be determined based on the positional relationship. That is, based on the reference position in the second screen data acquired by the acquiring means, the superimposition data can be superimposed on the second screen data with high positional accuracy without using an application. Convenience can be improved.
[0018]
Further, the invention according to claim 3 is the screen data management device according to claim 1 or 2, further comprising: an acquisition unit configured to acquire designation of the reference position in the first screen data; The determining means determines the superimposed position on the second screen data based on the reference position and the positional relationship acquired by the acquiring means.
[0019]
According to the third aspect of the present invention, the superposition position determining means determines the superposition position on the second screen data based on the reference position and the positional relationship received by the client communication means, so that the application is used. Without superimposition, superimposition data can be superimposed with high positional accuracy. When the reference position on the second screen data is set in advance, the first screen corresponding to the reference position on the second screen data and the reference position of the second screen data acquired by the acquisition unit. The superimposition position on the second screen data can be determined based on the position on the data. In this way, based on the reference position in the first screen data acquired by the acquisition means, the superimposition data can be superimposed on the second screen data with high positional accuracy without using an application, and the screen data management The convenience of the device can be improved.
[0020]
The invention according to Claim 4 is the screen data management device according to any one of Claims 1 to 3, wherein the same area as an arbitrary reference area in the first screen data is stored in the screen data management apparatus. A reference region detecting unit that detects from the second screen data, the superimposition position determining unit includes a positional relationship between a position of the superimposed data superimposed on the first screen data and a position of the reference region. And determining the superimposition position on the second screen data based on the position of the area in the second screen data detected by the reference area detection means.
[0021]
According to the fourth aspect of the present invention, the superposition position determining means detects the positional relationship between the position of the superimposition data superimposed on the first screen data and the position of the reference area, and the position detected by the reference area detection means. Since the superimposition position on the second screen data is determined based on the position of the area in the second screen data, the superimposition screen data can be accurately positioned based on the positional relationship without using an application. Can be superimposed. Further, since no instruction from the user is required, the superimposition data can be efficiently superimposed. As described above, since the superimposition data can be superimposed on a desired position, position adjustment until the superimposition position is determined is unnecessary, and the convenience of the screen data management device can be improved.
[0022]
According to a fifth aspect of the present invention, there is provided the screen data management device according to any one of the first to fourth aspects, wherein a distance between any two points in the first screen data; Further comprising a display ratio calculating means for calculating a ratio to a distance between two points in the second screen data corresponding to the second screen data, wherein the superimposed position determining means calculates the second position based on the positional relationship and the ratio. The superimposition position on the screen data is determined.
[0023]
According to the fifth aspect of the invention, the display ratio calculating means calculates the distance between any two points in the first screen data and the distance between the two points in the second screen data corresponding to the two points. The ratio is calculated, and the superimposition position determination means determines the superposition position on the second screen data based on the positional relationship and the ratio. Therefore, when the display magnification of the first screen data and the second screen data are different. Even in this case, the superimposition data can be superimposed with high positional accuracy without using an application. As described above, since the superimposition data can be superimposed on a desired position, position adjustment until the superimposition position is determined is unnecessary, and the convenience of the screen data management device can be improved.
[0024]
The invention according to claim 6 is the screen data management device according to any one of claims 1 to 4, wherein a display magnification of the first screen data is displayed in the first screen data. And when the display magnification of the second screen data is displayed in the second screen data, the display magnification of the first screen data is detected, and the display of the second screen data is performed. Display magnification detecting means for detecting a magnification, and display ratio calculating means for calculating a ratio between a display magnification of the first screen data and a display magnification of the second screen data, wherein the superposition position determining means comprises: The superimposition position on the second screen data is determined based on the positional relationship and the ratio.
[0025]
According to the invention of claim 6, the display ratio calculating means recognizes the display ratio of the first screen data and the second screen data from the display magnifications displayed in the first window and the second window, respectively. Since the superimposition position determining means determines the superposition position based on the display ratio, even if the display magnification of the first screen data and the second screen data is different, without using the application, The superimposition data can be superimposed with high positional accuracy. As described above, since the superimposition data can be superimposed on a desired position, position adjustment until the superimposition position is determined is unnecessary, and the convenience of the screen data management device can be improved.
[0026]
The invention according to claim 7 is the screen data management device according to claim 5 or 6, wherein the second superimposing unit converts the superimposed data superimposed on the first screen data into the ratio And superimposing the edited superimposed data on the determined position.
[0027]
Here, editing refers to the relative relationship between the size and shape of the first screen data and the superimposed data superimposed on the first screen data, such as enlarging or reducing the size of the superimposed data, and the second This is to convert the superimposition data so that the relative size and shape of the screen data superimposed on the second screen data and the superimposition data superimposed on the second screen data are equal.
[0028]
According to this configuration, the second superimposing unit can edit the superimposed data based on the ratio between the first screen data and the second screen data calculated by the display ratio calculating unit. Therefore, it is possible to superimpose the superimposition data with an appropriate size at an accurate position. As described above, the adjustment of the superposition position and the adjustment of the size are not required, and the convenience of the screen data management device can be improved.
[0029]
The invention according to claim 8 is the screen data management device according to any one of claims 1 to 7, wherein the superimposed data superimposed on the first screen data forms a handwritten drawing line. In the case of the data representing the position, the superimposition position determining means determines the second position based on each positional relationship between the position of each point constituting the drawing line on the first screen data and the reference position. The superimposition position on the screen data is determined, and the second superimposition unit draws the drawing line at the determined superimposition position.
[0030]
According to the invention of claim 8, when the superimposition data superimposed on the first screen data is data representing a handwritten drawing line, the superposition position determining means determines the position of each point constituting the drawing line. The superimposition position on the second screen data is determined based on the positional relationship between the position on the first screen data and the reference position. As described above, when the superimposition data is a handwritten drawing line, the handwritten drawing line is superimposed on the superimposed position determined based on the positional relationship between the reference position and each point constituting the drawing line. Therefore, it is possible to superimpose a handwritten drawing line as superimposition data with high positional accuracy without using an application. As described above, since the superimposition data indicating the handwritten drawing line can be superimposed at a desired position, the position adjustment until the superimposition position is determined becomes unnecessary, and the convenience of the screen data management device can be improved.
[0031]
The invention according to claim 9 is the screen data management device according to claim 7, further comprising an acquisition unit for acquiring the drawing line, wherein the acquiring unit acquires the drawing line, The determining means determines, at a predetermined time interval, a superimposition position on which the superimposition data corresponding to the drawing line is to be superimposed, and the second superimposing means determines whether the superimposition position is determined by the superimposition position. Preferably, the superimposition data is superimposed on the second screen data.
[0032]
According to the ninth aspect of the present invention, when the acquiring unit acquires the handwritten drawing line, the superposition position determining unit determines the superimposition position where the superimposition data corresponding to the drawing line should be superimposed at a predetermined time interval. The superimposition unit superimposes the superimposition data on the second screen data each time the superimposition position determination unit determines the superimposition position, so that the superimposition data can be superimposed in real time.
[0033]
According to a tenth aspect of the present invention, there is provided a screen data management system including: a plurality of clients for displaying screen data in a window; and a screen data management device for managing the screen data to be displayed in the window. First window control means in the client for displaying the first screen data in the first window, and superimposed data to be displayed superimposed on the first screen data, separately from the first screen data. First superimposing means for superimposing the superimposed data on the first screen data, and a position between the superimposed data in the first screen data and an arbitrary reference position in the first screen data. Superimposing the superimposed data on the second screen data, which is partially or entirely the same as the first screen data, based on the positional relationship A superimposition position determining means for determining the position, a second superimposing means for virtually superimposing the superimposition data on a position determined with respect to the second screen data by the superimposition position determining means, and A second window control unit for displaying, in a second window, the second screen data on which the superimposition data is superimposed by the superimposition unit.
[0034]
According to the tenth aspect, based on the position where the superimposition data is superimposed on the first screen data and the predetermined reference position, the first screen at the position where the superimposition data is superimposed is displayed. The relative position on the data is grasped, and the relative position between the first screen data and the superimposed data is superimposed on the position where the relative position between the second screen data and the superimposed data is equal. Data can be overlaid. Further, at this time, it is not necessary to use a screen data application, and the convenience of the data management device can be improved.
[0035]
An invention according to claim 11 is a screen data management method for managing screen data, in which superimposed data to be superimposed and displayed on the first screen data is virtualized separately from the first screen data. A first superimposing step of superimposing on the first screen data, and a position between the superimposed data in the first screen data and a reference position in the first screen data. A superimposition position determining step of determining a superimposition position where the superimposition data is to be superimposed on the second screen data, which is partially or entirely the same as the first screen data, based on the positional relationship; And a second superimposing step of virtually superimposing the superimposed data at a position determined with respect to the second screen data.
[0036]
According to the eleventh aspect of the present invention, based on the position at which the superimposition data is superimposed on the first screen data and the predetermined reference position, the first screen at the position at which the superimposition data is superimposed is displayed. The relative position on the data is grasped, and the relative position between the first screen data and the superimposed data is superimposed on the position where the relative position between the second screen data and the superimposed data is equal. Data can be overlaid. Further, at this time, it is not necessary to use a screen data application, and the convenience of the data management device can be improved.
[0037]
According to a twelfth aspect of the present invention, there is provided a screen data management program for managing screen data, wherein superimposed data to be superimposed and displayed on the first screen data is virtualized separately from the first screen data. A first superimposing step of superimposing on the first screen data, and a position between the superimposed data in the first screen data and a reference position in the first screen data. A superimposition position determining step of determining a superimposition position where the superimposition data is to be superimposed on the second screen data, which is partially or entirely the same as the first screen data, based on the positional relationship; And a second superimposing step of virtually superimposing said superimposed data at a position determined with respect to said second screen data. Is a program.
[0038]
According to the twelfth aspect of the present invention, based on the position where the superimposition data is superimposed on the first screen data and the predetermined reference position, the first screen at the position where the superimposition data is superimposed is displayed. The relative position on the data is grasped, and the relative position between the first screen data and the superimposed data is superimposed on the position where the relative position between the second screen data and the superimposed data is equal. Data can be overlaid. Further, at this time, it is not necessary to use a screen data application, and the convenience of the data management device can be improved.
[0039]
BEST MODE FOR CARRYING OUT THE INVENTION
Hereinafter, preferred embodiments of a screen data management system according to the present invention will be described in detail with reference to the accompanying drawings. In the embodiment, an electronic conference system to which a screen data management system is applied will be described. However, the electronic conference system is an example of a screen data management system, and the screen data management system is not limited to this. Not something.
[0040]
The “first individual window” and the “shared window” described in the embodiments are examples of the “first window” and the “second window” described in the claims, respectively. Further, the “first individual window control unit” and the “shared window control unit” described in the embodiments are respectively referred to as “first window control unit” and “second window control unit” in the claims. This is an example.
[0041]
Further, “first individual screen data” and “shared screen data” described in the embodiments are examples of “first screen data” and “second screen data” described in claims, respectively. .
[0042]
Further, the “superimposition unit” of the first individual window and the “superimposition unit” of the shared window described in the embodiments are “first superimposition unit” and “second superimposition unit” described in the claims, respectively. This is an example. The “client receiving unit” of each screen management unit described in the embodiment is an example of the “acquisition unit” described in the claims.
[0043]
(Embodiment 1)
In the present embodiment, a screen data management system according to the present invention will be described as an electronic conference system which is an example of a screen data management system in which a plurality of clients view and edit a conference material document stored in a server and hold a conference.
[0044]
FIG. 1 is a diagram schematically illustrating an electronic conference system 1 according to the first embodiment. The electronic conference system 1 includes a server 20, a large display device 2 connected to the server 20, and clients 10, 12, and 14 used by each conference participant. The clients 10, 12, and 14 are, for example, portable display pads. These devices are connected by a wireless LAN (for example, IEEE (Institute of Electrical and Electronics Engineers) 802.11b).
[0045]
The server 20 is, for example, a computer having a PC-AT (The Personal Computer for Advanced Technologies) architecture (published by IBM in 1984). The server 20 is equipped with a wireless LAN PC card (PCMCIA (Personal Computer Memory Card International Association) standard) via a PCI adapter board connected to a PCI (Peripheral Component Interconnect) bus (not shown). In addition, the server 20 has Linux (R) as the OS and X Window (R) as the window system. The illustration of the keyboard connected to the server 20 is omitted.
[0046]
The large display device 2 has a display screen 32 and a touch panel 34. The display screen 32 is, for example, a PDP (Plasma Display Panel). A touch panel 34 is attached to the surface of the display screen 32. The large display device 2 is connected to the server 20 via a VGA cable 22 and an RS-232C cable 24. The large display device 2 inputs a screen information signal to be displayed on the display screen 32 from the server 20 via the VGA cable 22. The touch input coordinate data detected by the touch panel 34 is input to the server 20 via the RS-232C cable 24. The server 20 processes the input touch input coordinate data in the same manner as the mouse input data.
[0047]
The client 10 has a display screen 110 for displaying screen data, and a touch panel 112 for receiving an input from the user with the touch pen 11. Further, the client 10 communicates with the server 20 and receives screen data to be displayed on the display screen 110. Further, it transmits text data and handwritten data input by the user to the server 20. The functional configuration of the clients 12 and 14 is the same as the functional configuration of the client 10.
[0048]
FIG. 2 is a schematic block diagram schematically showing the functional configuration of the server 20. The windows displayed on the display screen 32 of the large display device 2 and the display screens 110, 120, and 130 of the clients 10, 12, and 14 will be described with reference to FIG. On the display screen 32, a shared screen display window 40 is displayed. On the display screen 110, a shared screen display window 41 and a first individual screen display window 42 are displayed. On the display screen 120, a shared screen display window 43 and a second individual screen display window 44 are displayed. On the display screen 130, a shared screen display window 45 and a third individual screen display window 46 are displayed. As described above, the server 20 includes the screen data displayed on the display screen 32 of the large display device 2 and the shared screen display windows 40, 41, 43, and 45 that can be displayed on the display screens 110, 120, and 130 of all clients. It has screen data displayed on each of the individual screen display windows 42, 44, 46 that can be displayed only on the display screens 110, 120, 130 of the clients 10, 12, 14.
[0049]
Further, the server 20 includes a shared screen management unit 208 that manages screen data to be displayed in the shared screen display window 40, a first individual screen management unit 200 that manages screen data to be displayed in the first individual screen display window 42, and a second A second individual screen management unit 202 for managing screen data displayed on the individual screen display window 44, a third individual screen management unit 204 for managing screen data displayed on the third individual screen display window 46, and display on each window A shared memory 210 that stores data is provided. As described above, the shared screen display window 40 and the individual screen display windows 42, 44, 46 are controlled by the server 20.
[0050]
Next, a detailed function of each screen management unit will be described with reference to FIG. FIG. 3 is a schematic block diagram showing a functional configuration of the shared screen management unit 208 and the first individual screen management unit 200 shown in FIG.
[0051]
The first individual screen management unit 200 includes a screen buffer 211, a first individual screen data transmission unit 212, a first client reception unit 214, a management unit communication unit 218, a superimposition unit 220, a superimposition data management unit 222, and a vector calculation unit 224. , A first individual window control unit 226 and a notification information creation unit 228.
[0052]
The screen buffer 211 stores screen data to be displayed in the first individual screen display window 42. The first individual screen data transmission unit 212 transmits the screen data stored in the screen buffer 211 to the client 10. The first client receiving unit 214 receives key data and pointer data (mouse data) transmitted from the first client 10. The management unit communication unit 218 exchanges information with another screen management unit.
[0053]
The superimposing unit 220 controls the superimposed data to be superimposed on the screen data displayed by the first individual screen data transmission unit 212 in the first individual screen display window 42 and displayed in the first individual screen display window 42. I do. Here, the superimposition data is data indicating a photographic image, data indicating a handwritten drawing line, or the like, and is an object to be superimposed on predetermined data in the electronic conference system 1 according to the present embodiment.
[0054]
The superimposition data management unit 222 manages data to be superimposed on the screen data displayed in the first individual screen display window 42, and copies the superimposition data from the first individual screen management unit 200 to the shared screen management unit 208. If so, the superimposed data is copied to the shared memory 210. The vector calculation unit 224 receives designation of the positions of two predetermined points in the screen data displayed in the first individual screen display window 42 via the first client receiving unit 214, and based on the positions of the two points, A vector between two points is calculated, and a magnitude of the vector, that is, a distance between the two points is calculated.
[0055]
The notification information creation unit 228 creates information to be sent to the management unit communication unit 244 based on the information received from the vector calculation unit 224, and sends the information to the management unit communication unit 218.
[0056]
The shared screen management unit 208 includes a screen buffer 240, a shared screen data transmission unit 242, a client reception unit 252, an inter-management unit communication unit 244, a superimposition unit 246, a display ratio calculation unit 248, a superimposition position determination unit 250, and a shared screen. A window control unit 254 is provided.
[0057]
The functions of the screen buffer 240, the shared screen data transmission unit 242, the management unit communication unit 244, and the superimposition unit 246 of the shared screen management unit 208 are respectively the screen buffer 211, the first individual screen data transmission unit 212, and the management unit. The functions are the same as those of the communication unit 218 and the superposition unit 220.
[0058]
The client receiving unit 252 receives key data and pointer data (mouse data) transmitted from each client. The display ratio calculation unit 248 is displayed in the shared screen display window 40 or the shared screen display window 41 based on the position designation information received from the client reception unit 252 and the information received via the management unit communication unit 244. The display ratio between the shared screen data and the first individual screen data displayed in the first individual screen display window 42 is calculated.
[0059]
The superimposition position determination unit 250 determines a position where superimposition data is to be pasted, that is, a superposition position, based on information received via the inter-management unit communication unit 244. At this time, the superposition position determination unit 250 may further use the information received from the display ratio calculation unit 248.
[0060]
FIG. 4 is a diagram schematically illustrating a relationship between screen data in a screen buffer and a virtual transparent screen superimposed on the screen data. As shown in FIG. 4A, in the memory of the server 20, shared screen display windows 40, 41, 43, and 45, a first individual screen display window 42, a second individual screen display window 44, and a third individual screen display Screen buffers 50a, 50b, 50c, 50d corresponding to the window 46 are stored. Also, virtual transparent screens 54a, 54b, 54c, 54d are superimposed on the respective screen buffers 50a, 50b, 50c, 50d. Thus, the transparent screens are provided by the number of the screen buffers.
[0061]
As shown in FIG. 4B, screen data in a screen buffer 50 and application windows 52 for displaying the screen data are provided in a hierarchical manner. Further, a transparent screen 54 is virtually superimposed on the application window 52.
[0062]
The superimposing unit 220 causes the transparent screen 54 to display the superimposed data. For example, when the handwritten data is drawn on the screen data, the superimposition unit 220 superimposes the handwritten drawing line displayed on the transparent screen 54 as the superimposed data on the screen data.
[0063]
FIG. 5 is a block diagram showing a detailed functional configuration of the clients 10, 12, and 14. As shown in FIG. The first client 10 includes a server communication unit 102, a display screen control unit 104, and an instruction receiving unit 106.
[0064]
The instruction receiving unit 106 receives an instruction or the like input by the user to the touch panel 112 using the touch pen 11. The instruction receiving unit 106 sends the received data to the server communication unit 102 if the received data is for the shared screen display window 41 or the first individual screen display window 42, or to the display screen control unit 104 if the received data is for any other area. Send to
[0065]
The server communication unit 102 communicates with the server 20 using a wireless LAN. Specifically, information is transmitted and received between the first individual screen management unit 200 and the shared screen management unit 208 in the server 20. The display screen control unit 104 receives an instruction from the server communication unit 102 and the instruction receiving unit 106, and controls screen data to be displayed on the display screen 110 based on the received instruction. That is, the shared screen display window 41 and the first individual screen display window 42 to be displayed on the display screen 110 are controlled.
[0066]
Hereinafter, a process in the electronic conference system 1 when superimposing data superimposed and pasted on the first individual screen data 60 is superimposed on shared screen data will be described with reference to FIGS. 6 and 7. . FIG. 7 is a flowchart showing the processing steps of the electronic conference system 1 at this time.
[0067]
FIG. 6 shows the display screen 110 of the first client 10 before and after the superimposition data is superimposed by the server 20. The display screen 110 shown in FIG. 6A displays a shared screen display window 41 and a first individual screen display window 42. In the first individual screen display window 42, first individual screen data 60 is displayed. In addition, superimposition data 61 is superimposed and pasted on the first individual screen data 60. At this time, the transparent screen 54 is superimposed on the first individual screen display window 42. The shared screen display window 41 displays shared screen data 80.
[0068]
Here, the first individual screen data 60 is, for example, a document of Acrobat Reader manufactured by Adobe Systems. The superimposition data is a photograph copied from a Netscape Web browser. Like the first individual screen data 60, the shared screen data 80 displayed in the shared screen display window 41 displayed after the first individual screen display window 42 is a document of Acrobat Reader manufactured by Adobe Systems. is there.
[0069]
FIG. 6B shows the display screen 110 after the superimposition data 81 identical to the superimposition data 61 is superimposed on the shared screen data 80. In FIG. 6B, superimposition data 81 is superimposed and pasted on shared screen data 80 displayed in shared screen display window 41.
[0070]
Hereinafter, the processing of the electronic conference system 1 when the superimposition data 81 is pasted on the shared screen data 80 as shown in FIG. 6B is performed according to the flowchart shown in FIG.
[0071]
As shown in FIG. 6A, when the superimposition data 61 is superimposed and pasted on the first individual screen data 60 and displayed, the user is an object to be superimposed on the shared screen display window 41. When the area within the superimposition data 61 is touched using the touch pen 11 (S100), the touch coordinates are notified to the first individual screen management unit 200 (S101), and the first individual screen management unit 200 receives the designated coordinates. The superimposition data is selected (S102). Further, when the inter-screen copy button 300 is touched (S103), the touch coordinates are notified to the first management unit 200 (S104), and the first individual screen management unit 200 sets the inter-screen copy mode (S110).
[0072]
Next, the first individual window control unit 226 displays a message 302 "Please designate a reference point" above the horizontal scroll bar along the lower side of the first individual screen display window 42 (S111, S112, S113). Further, the inter-management-unit communication unit 218 sends an inter-screen copy mode setting instruction to the inter-management-unit communication unit 244 (S114).
[0073]
When the management unit communication unit 244 receives this message, the shared screen management unit 208 sets the superimposition drawing mode if the superimposition drawing mode is not set (S116, No) (S118). The superimposition drawing mode is a mode for performing a process of superimposing superimposition data to be virtually superimposed on the screen data. When the superimposition drawing mode is set, the superimposition drawing mode is displayed on the display screen of the shared screen management unit 208. The transparent screen is overlaid.
[0074]
Further, the shared screen management unit 208 sets the inter-screen copy mode (S120). Note that the inter-screen copy mode is a mode for performing a process of superimposing superimposed data superimposed on one of the first individual screen data 60 and the shared screen data 80 on the other.
[0075]
Thereafter, when a reference point in the first individual screen data 60 displayed on the first individual screen display window 42 is designated by the user (S130), the server communication unit 102 sends a message to the first client receiving unit 214. Then, the user is notified of the touch coordinates touched by the user, that is, the position of the reference point (S132). When the first client receiving unit 214 receives the notification of the position of the reference point, the vector calculation unit 224 obtains a vector that is a difference between coordinate values of the reference point and the position of the superimposed data (S134).
[0076]
Here, reference points and vectors will be described with reference to FIG. In FIG. 6A, point A (X1, Y1) is designated as a reference point. A point B (X2, Y2) is set as the position of the superimposition data. Therefore, the vector in this case is a vector connecting AB and is represented by the following equation.
Vector AB = (X2-X1, Y2-Y1) (1)
The reference point is arbitrarily designated by the user. The reference point may be a point at an arbitrary position in the first individual screen data 60, and the position is not limited. Further, the position of the superimposition data may be any position in the superimposition data, and the position of the point is not limited. In the first embodiment, the point B at the upper left corner on the superimposed data is set as a point indicating the position of the superimposed data.
[0077]
Next, the superimposition data management unit 222 stores the bitmap data of the superimposition data in the shared memory 210 (S136). Further, the notification information creation unit 228 calculates the value (coordinate value) of the vector AB calculated by the vector calculation unit 224, the number of pixels in the vertical direction of the bitmap area of the superimposition data managed by the superimposition data management unit 222, and the horizontal The superimposition-related information including the number of pixels in the direction and the head address of the bitmap data of the superimposition data in the shared memory 210 is created (S138). Next, the inter-management-unit communication unit 218 sends the superimposition-related information created by the notification information creation unit 228 to the inter-management-unit communication unit 244 (S140).
[0078]
On the other hand, when the shared screen display window 41 is selected by the user, as shown in FIG. 6B, the shared screen display window 41 becomes the focus window, and the shared screen display window 41 is positioned above the first individual screen display window 42. Is displayed overlapping with. Furthermore, when the reference point of the shared screen data 80 is designated by the user (S142, Yes), the server communication unit 102 sends the touch coordinates touched by the user to the client receiving unit 252 of the shared screen management unit 208. That is, the position of the reference point is notified (S144).
[0079]
Here, the reference point on the shared screen data 80 is a point at a position corresponding to the reference point specified in the individual screen data 60. For example, when the point A (X1, Y1) shown in FIG. 6A is designated as the reference point in the individual screen data 60, the reference point of the shared screen data 80 is the shared screen data shown in FIG. This is point C (X1 ′, Y1 ′) in 80.
[0080]
Then, the client receiving unit 252 notifies the position of the reference point of the shared screen data 80 to the superposition position determining unit 250. The superimposition position determination unit 250 adds the value of the vector AB included in the superimposition-related information received from the management unit communication unit 244 to the coordinate value of the reference point, and superimposes the superimposition data, that is, the point D. (X2 ′, Y2 ′) is determined (S150). Then, the superimposition unit 246 superimposes and pastes the bitmap data of the superimposition data in the shared memory 210 on the transparent screen using the head address of the superimposition data included in the superimposition-related information (S154). Then, the shared screen data transmission unit 242 transmits the shared screen data 80 on which the superimposed data is superimposed, that is, the updated shared screen data 83, to each of the display screens 32, 110, 120, and 130 (S156). Then, the display content of the shared screen display window on the client 10 is updated (S158).
[0081]
As described above, the superimposition unit 220 of the first screen management unit 200 that constitutes the first superimposition unit of the present invention converts the superimposition data to be superimposed on the individual screen data 60 as the first screen data, Apart from the individual screen data 60, it is virtually superimposed on the individual screen data 60. Then, the first client receiving unit 214 constituting the acquiring unit of the present invention acquires the designation of the reference position in the individual screen data 60 from the client 10, and further, the shared client receiving unit 252 of the shared screen management unit 208 The designation of the reference position in the shared screen data 80 as the second screen data corresponding to the reference position in the data 60 is acquired from the client 10.
[0082]
Then, based on the positional relationship between the position where the superimposition data is superimposed on the individual screen data 60 and an arbitrary reference position in the individual screen data 60, the superimposition position determination unit 250 A superimposition position where superimposition data is to be superimposed on the same shared screen data 80 is determined. More specifically, the superimposition position is determined based on the positional relationship between the reference position and the superimposition data in the individual screen data 60 acquired by the first client receiving unit 214 and the reference position acquired by the shared client receiving unit 252. .
[0083]
By the above operation, the superimposed data displayed on the individual screen data can be superimposed on the corresponding position on the shared screen data.
[0084]
Further, according to the electronic conference system 1 of the present embodiment, the superimposition data displayed by the user on the individual screen is changed to the position of the shared screen data corresponding to the position where the superimposition data is superimposed on the individual screen data. , Can be accurately superimposed.
[0085]
As described above, in FIG. 6 and FIG. 7, the operation in the electronic conference system 1 when the superimposed data is bitmap data such as a photograph has been described. However, as another example, the superimposed data is input by a user. It may be superimposition data indicating the created handwritten drawing line.
[0086]
FIG. 8 is a diagram showing the display screen 110 before and after superimposing data. The superimposition data displayed in the transparent window on the display screen 110 shown in FIG. 8 is a handwritten drawing line. This is different from the display content of the display screen 110 shown in FIG.
[0087]
In the first individual screen display window 42 in the display screen 110 shown in FIG. 8A, superimposed data 62A (encircled drawing lines) and 62B (characters of “repair”) of handwritten drawing lines created by input from the user are displayed. ) Are superimposed and pasted. FIG. 8B shows a display screen after superimposition data 82A and 82B identical to superimposition data 62A and 62B are superimposed on shared screen data 80.
[0088]
According to the electronic conference system 1 of the present embodiment, the superimposition data 62A and 62B indicating the handwritten drawing lines displayed on the individual screen data can be superimposed on the shared screen data.
[0089]
Note that the processing steps of the electronic conference system 1 at this time are almost the same as the processing steps of the electronic conference system 1 when the superimposed data is image data such as a photograph described with reference to FIGS.
[0090]
Hereinafter, with reference to FIGS. 8 and 9, among the operations of the electronic conference system 1 when superimposing a handwritten drawing line as superimposition data, processing steps different from those when the superimposition data is image data such as a photograph will be described. I do.
[0091]
If the superimposition data is superimposition data indicating a handwritten drawing line, in S100, an area including the handwritten drawing line to be superimposed is specified. For example, when the user selects the area specifying button 306 displayed on the first individual screen data 60 shown in FIG. 8A and further specifies the area 63 including the drawing line by the user, the handwriting is performed. The superimposition data 62A, 62B indicating the drawing line is selected as the superimposition data.
[0092]
The method of designating the area 63 including the drawing line is such that the point at which the touch pen 11 touches the touch panel 112 (pen down) is defined as the upper left corner of the rectangle, and the point released from the touch panel 112 (pen up) is defined as the lower right corner of the rectangle. .
[0093]
In the case of a handwritten drawing line, the inter-screen handwritten copy mode is set in the first individual screen display window 42 in S110 of FIG. 9 instead of the inter-screen copy mode. In step S120, the inter-screen handwriting copy mode is set in the shared screen display window 41 instead of the inter-screen copy mode. In S118, the superimposed handwriting drawing mode is set in the shared screen display window 41 instead of the superimposed drawing mode. Of the processing performed when the inter-screen handwriting copy mode and the superimposed handwriting drawing mode are set, processing different from the processing in the inter-screen copy mode and the superimposed drawing mode will be described below.
[0094]
In S134, the vector calculation unit 224 calculates a point A (X1, Y1) of each point Ei (X2i, Y2i) constituting the handwritten drawing line, which is designated using the absolute coordinate value in the first individual screen data 60 as a reference point. To relative coordinates. The coordinate data of the vector AEi obtained by the conversion is sent to the notification information creation unit 228 as handwritten superimposition data. Then, in S138, the notification information creating unit 228 creates the superimposition data received from the vector calculation unit 224, superimposition related information including drawing attribute information indicating the thickness of the handwritten drawing line, the color of the line, and the like. That is, in the case of a handwritten drawing line, the superimposition data is not sent to the shared screen management unit 208 via the shared memory 210, but is used as superimposition related information in S140 from the inter-management unit communication unit 218 to the inter-management unit communication unit 244. Sent to
[0095]
Then, in S150, the superimposition position determination unit 250 adds the coordinate value in the superimposition data to the point C (X1 ′, Y1 ′), which is the reference point in the screen data, to determine the position where the handwritten drawing line is to be drawn. A certain point Fi (X2i ', Y2i') is determined. Subsequently, the superimposition unit 246 adds the superimposition data to the superimposition position determined by the superimposition position determination unit 250 according to the drawing attribute of the handwritten drawing line, which is one of the superimposition related information sent from the first individual screen management unit 200. Is superimposed on the handwritten drawing line (S154).
[0096]
Thus, the handwritten drawing line superimposed on the individual screen data can be superimposed on the shared screen data while maintaining the positional relationship between the screen data and the handwritten drawing line.
[0097]
Next, superimposition of superimposition data when the display magnification of first individual screen data 60 displayed in first individual screen display window 42 and shared screen data 80 displayed in shared screen display window 41 is different. explain. In this case, the server 20 receives the designation of two points from the user, and based on the distance between the two points, becomes the superimposition source screen data to which the superimposition data is pasted and the superimposition destination to which the superimposition data is to be pasted. The relative ratio of the display magnification of the screen data is calculated as the display ratio.
[0098]
As described above, when the superimposition data superimposed on the first individual screen data 60 is data representing a handwritten drawing line, the superposition position determination unit 250 determines the first individual screen data 60 of each point constituting the drawing line. The superimposition position on the shared screen data is determined based on each positional relationship between the upper position and the reference position, and the superimposition unit 246 draws a drawing line at the determined position.
[0099]
Then, when the first client receiving unit 214 receives the input of the drawing line, the superimposition position determination unit 250 determines the superposition position where the superimposition data corresponding to the drawing line should be superimposed at a predetermined time interval. Each time the superposition position determination unit 250 determines a superposition position, the superposition data is superimposed on the second screen data.
[0100]
FIG. 10 is a flowchart showing the operation of the electronic conference system 1 at this time. FIG. 11 shows the display screen 110 before and after the superimposition. The display magnification of the shared screen data 80 displayed on the shared screen display window 41 and the display magnification of the first individual screen data 60 displayed on the first individual screen display window 42 are different. Except for this, it is the same as the display screen 110 before and after the superimposition shown in FIG.
[0101]
As shown in FIG. 11A, when the superimposition data 61 is superimposed and pasted on the first individual screen data 60 and displayed, the user is an object to be superimposed on the shared screen display window 41. When the area of the superimposition data 61 is touched using the touch pen 11 (S200), the touch coordinates are notified to the first individual management unit 200 (S201), and the first individual screen management unit 200 transmits the designated superimposition. Data is selected (S202). Subsequently, when the inter-screen copy button 300 is touched (S203), the touch coordinates are notified to the first individual management unit 200 (S204), and the first individual screen management unit 200 sets the inter-screen copy mode (S205). .
[0102]
Further, when the scaling button 308 is touched (S206), the touch coordinates are notified to the first individual management unit 200 (S207), and the first individual screen management unit 200 sets the inter-screen scaling copy mode (S208). ).
[0103]
Here, when the zooming instruction is not received, the electronic conference system 1 performs the process described with reference to FIG. 7 when the display magnification of the screen data is the same.
[0104]
In the inter-screen scaling copy mode, processing related to scaling described below is added in addition to the processing performed in the inter-screen copy mode.
[0105]
Next, the first individual window control unit 226 displays, as shown in FIG. 11A, an upper part of a horizontal scroll bar along a lower side of the screen to specify two points serving as references for determining the magnification. Specify two points "message 310 is displayed (S209, S210, S211).
[0106]
Further, the inter-management-unit communication unit 218 sends an inter-screen scaling copy mode setting instruction to the inter-management-unit communication unit 244 (S212). When the vector calculation unit 224 receives the inter-screen scaling copy mode setting instruction and the superimposition drawing mode is not set for the shared screen display window 41 (S214, No), the superimposition drawing mode is set. Then, the transparent screen is superimposed on the shared screen display window 41 (S216). Further, the inter-screen scaling copy mode is set for the shared screen display window 41 (S218).
[0107]
On the other hand, when the user specifies any two points on the first individual screen data 60 (S220), the server communication unit 102 of the client 10 sends the coordinates of the two points to the first individual screen management unit 200. The value is notified (S222). Then, when the first individual screen management unit 200 is notified of the positions of the two points, the distance calculation unit 226 obtains the distance L_src between the two points based on the coordinate values of the two points (S224).
[0108]
In FIG. 11A, a point A (X1, Y1) and a point G (X3, Y3) are designated as arbitrary two points. Therefore, the distance L_src between the two points in this case can be calculated by the following equation.
(Equation 1)

... (2)
The arbitrary two points are arbitrarily designated by the user. Any two points may be points at any position in the first individual screen data 60, and the positions are not limited.
[0109]
Next, the vector calculation unit 224 calculates a vector AB between the point B as the position of the superimposition data and the point A (S226). Note that the vector GB may be calculated instead of the vector AB. It suffices if the relative position of the superimposition data can be recognized from the vector value, and the positions of the start point and the end point of the vector are not particularly limited.
[0110]
Then, the superimposition data management unit 222 copies the superimposition data to the shared memory 210 (S228). Next, the notification information creation unit 228 calculates the distance L_src between the two points, the value of the vector AB (coordinate value), the number of pixels in the vertical direction and the number of pixels in the horizontal direction of the bit map area of the superimposition data, and The superimposition-related information including the head address of the bitmap data of the superimposition data is created (S230). Next, the inter-management-unit communication unit 218 sends the superimposition-related information to the inter-management-unit communication unit 244 (S232).
[0111]
On the other hand, when the shared screen display window 41 is selected by the user, as shown in FIG. 11B, the shared screen display window 41 becomes a focus window and is displayed over the first individual screen display window 42. . Further, when the user specifies two reference points on the shared screen data 80 (S240, Yes), the server communication unit 102 specifies the touch coordinates of the position specified by the client communication unit 252, that is, the user specifies the touch coordinates. The position of the two points is notified (S242).
[0112]
The two points on the shared screen data 80 are two points at positions corresponding to the two points specified in the first individual screen data 60. For example, when points A and G shown in FIG. 11A are designated as two points in the first individual screen data 60, the two points of the shared screen data 80 are the shared screen data shown in FIG. Points H and J in 80.
[0113]
Then, the display ratio calculation unit 248 calculates a distance L_dst between two points in the shared screen data 80 (S244). L_dst is calculated by the following equation.
(Equation 2)

... (3)
The display ratio calculation unit 248 further calculates the display magnification ratio (display ratio) between the shared screen data 80 and the first individual screen data 60 based on the distance L_dst between two points and the distance L_src between two points included in the superimposition-related information. Is calculated (S246). The display ratio is calculated by the following equation.
Display ratio = L_dst / L_src (4)
[0114]
Next, the superimposition position determination unit 250 determines a superposition position based on the vector AB and the display ratio included in the superimposition-related information (S248). Next, the superimposing unit 246 performs a scaling process on the bitmap data of the superimposed data in the shared memory 210 based on the display ratio (S252). Specifically, for example, when the display magnification of the screen data at the superimposition destination is small and the display ratio <1, the bitmap data of the superimposed data is reduced according to the display ratio. In the case of reduction, for example, bitmap data may be thinned out.
[0115]
Then, the superimposition unit 246 converts the bitmap data of the superimposition data 85 subjected to the scaling process to the coordinate position (point K) obtained by adding the value of (vector AB × display ratio) to the coordinate value of the point H on the shared screen data 80. Are superimposed and pasted (S254). Then, the shared screen data transmitting unit 242 transmits the updated shared screen data 80 to each of the display screens 32, 110, 120, and 130 (S256).
[0116]
As described above, the electronic conference system 1 according to the present embodiment can superimpose superimposed data even between screen data displayed at different magnifications. During the electronic conference, the display magnification of the document displayed in the shared screen display window 41 may be changed. Also in this case, the superimposition data can be easily superimposed.
[0117]
Note that the processing steps of the electronic conference system 1 in the case of superimposing superimposition data indicating a handwritten drawing line between screen data having different display magnifications are substantially the same as the processing steps of the electronic conference system 1 in the variable magnification mode described with reference to FIG. The same is true.
[0118]
When the superimposition data indicating the handwritten drawing line is superimposed, the change in the processing step in the case of the handwritten drawing line described with reference to FIGS. If the display magnification is different, the handwritten superimposed data is further scaled. Specifically, in the superimposition position determining step (S248), the relative coordinate value of each point Ei indicated in the handwritten superimposition data is multiplied by the display ratio, and the coordinate value of one point corresponding to the multiplication is added. Determine the position.
[0119]
As described above, the superimposition data indicating the handwritten drawing line can be superimposed on the shared screen data having a display magnification different from that of the individual screen.
[0120]
(Embodiment 2)
Next, an electronic conference system 1 according to the second embodiment will be described. Although the server 20 according to the first embodiment determines the superposition position based on the reference position specified by the user, the server 20 according to the second embodiment automatically determines the superimposition position without receiving the specification from the user. Determine the superposition position. In this point, the server 20 according to the present embodiment is different from the server 20 according to the first embodiment. FIG. 12 is a block diagram illustrating a functional configuration of the server 20 according to the second embodiment. As a functional configuration, the first individual screen management unit 200 of the server 20 according to the second embodiment further includes a reference area setting unit 230 in addition to the configuration of the first individual screen management unit 200 according to the first embodiment. ing. Further, the shared screen management unit 208 according to the second embodiment further includes a reference area detection unit 258 in addition to the configuration of the shared screen management unit 208 according to the first embodiment.
[0121]
The reference area setting unit 230 determines a predetermined area in the screen data as a reference area based on the coordinate data from the first client receiving unit 214. In addition, the reference area detection unit 258 detects the same area as the reference area from the shared screen data while referring to the data stored in the shared memory 210.
[0122]
Here, the reference area will be described with reference to FIG. In the first individual screen display window 42 shown in FIG. 14, an area 64 including superimposed data is set as a reference area. The reference area 64 is an area determined in order to specify an area where the screen data at the superimposition source and the screen data at the superimposition destination are the same. Therefore, the size and position are not particularly limited as long as they are arbitrary regions on the display screen.
[0123]
In the present embodiment, a method for setting reference region by reference region setting section 230 is predetermined. For example, when superimposition data is selected, the reference area setting unit 230 sets an area of a predetermined size within a predetermined distance from the superimposition data as a reference area.
[0124]
Next, processing steps of the electronic conference system 1 according to the second embodiment when superimposing data are superimposed will be described with reference to FIG. Note that the first individual screen display window 42 is in a superimposition drawing mode in which a transparent screen is superimposed, and superimposition data is superimposed and pasted on a document of Acrobat Reader.
[0125]
By the processing in S100 to S104 described with reference to FIG. 7 in the first embodiment, the inter-screen copy mode is set for the first individual screen display window 42 (S300). Next, the reference area setting unit 230 determines a predetermined area in the first individual screen data 60 displayed in the first individual screen display window 42 as a reference area (S302).
[0126]
Next, the vector calculation unit 224 calculates a vector between the reference region set by the reference region setting unit 230 and the superimposed data (S304).
[0127]
For example, as shown in FIG. 14, an upper left point F in the reference area 64 is a point indicating the position of the reference area 64, and an upper left point G in the superimposition data 61 is a point indicating the position of the superimposition data 61. In this case, the vector calculation unit 224 calculates the vector FG.
[0128]
Next, the reference area setting unit 230 copies the bitmap data of the reference area 64 to the shared memory 210 (S306). Then, the notification information creating unit 228 generates the vector FG, the start address of the copied bitmap data of the reference area in the shared memory 210, and the reference area-related information including the number of vertical pixels and the number of horizontal pixels of the reference area. The information is created (S307), and the inter-management-unit communication unit 218 sends the reference area-related information to the inter-management-unit communication unit 244 (S308).
[0129]
Next, the reference area detection unit 258 extracts the same data area as the reference area from the screen buffer 240 based on the reference area related information received via the management unit communication unit 244 (S310). Then, the detection result is transmitted to the management unit communication unit 218 via the management unit communication unit 244 (S314).
[0130]
If the reference area detecting unit 258 detects the same area as the reference area from the shared screen data (S316, Yes), the position of the same area in the shared screen data in the screen buffer 240 is determined by the superposition position determining unit. 250 (S318).
[0131]
On the other hand, upon receiving the notification that the reference area has been detected (S320, Yes), the inter-management unit communication unit 218 sends an inter-screen copy mode setting notification to the inter-management unit communication unit 244 (S322). Then, the superimposition data management unit 222 copies the bitmap data that is the superimposition data to the shared memory 210 (S324). Furthermore, the notification information creation unit 228 determines the value (coordinate value) of the vector FG calculated by the vector calculation unit 224, the number of pixels in the vertical direction and the number of pixels in the horizontal direction of the bitmap area of the superimposition data, and The superimposition-related information including the head address of the bitmap data of the superimposition data is created (S326), and the inter-management-unit communication unit 218 sends the superimposition-related information to the inter-management-unit communication unit 244 (S328).
[0132]
In step S320, when the notification that the detection of the reference area has failed is received (S320, No), the process returns to step S302, and the reference area setting unit 230 sets the reference area again. At this time, the reference area setting unit 230 sets an area smaller than the previously set reference area as the reference area.
[0133]
On the other hand, when the inter-management unit communication unit 244 receives the inter-screen copy mode setting notification in S322, and the superimposition drawing mode is not set for the shared screen display window 41 (S330, No), the superimposition drawing mode is set. It is set (S332). Thereafter, the operation of the shared screen management unit 208 in (S334 to S342) is the same as the operation in S120 to S156 of the shared screen management unit 208 in the first embodiment described with reference to FIG.
[0134]
As described above, according to the second embodiment, the superimposition destination can be automatically determined without receiving designation of the reference position from the user.
[0135]
Other functions and configurations of the server 20 are the same as those of the server 20 according to the first embodiment described with reference to FIG. The function and configuration of the client 10 are the same as those of the client 10 according to the first embodiment.
[0136]
The processing steps in the electronic conference system 1 in the case of automatically superimposing image data such as photographs have been described with reference to FIGS. 13 and 14, but the electronic conference system 1 according to the second embodiment has the same configuration. In addition, a handwritten drawing line can be automatically superimposed.
[0137]
FIG. 15 shows superimposition data 62A and 62B indicating handwritten drawing lines and reference regions 66 and 67 set for the superimposition data 62A and 62B by the electronic conference system 1 according to the second embodiment. . When the region 63 including the drawing line is selected by the user, a predetermined region near the region 63 including the drawing line is set as the reference region. In FIG. 15A, a reference area 66 is set. When the reference region detection unit 258 does not detect the reference region with respect to the reference region 66, a reference region 67 smaller than the original reference region 66 is newly set as shown in FIG. You. As a result, when the same area as the reference area is successfully detected, the superimposition data 82A and 82B are superimposed on the shared screen data 80 as shown in FIG.
[0138]
(Embodiment 3)
Next, an electronic conference system 1 according to a third embodiment will be described. The server 20 according to the present embodiment specifies an arbitrary reference position in the superimposition source window, and further determines a superimposition position of superimposition data based on an area having a relationship between the reference position and a predetermined position and size. decide. This is different from the server 20 according to the other embodiments. A block diagram illustrating a functional configuration of the server 20 according to the third embodiment is the same as FIG.
[0139]
The processing steps of the server 20 according to the present embodiment that differ from the processing steps of the server 20 according to the second embodiment will be described with reference to FIG. The server 20 according to the present embodiment receives an input of an arbitrary point in the first individual screen display window 42 from the user when the inter-screen copy mode is set in S300. Then, in S302, a reference area having a predetermined positional relationship with the received input point is set. In step S310, the reference area detection unit 258 extracts the same data area as the reference area from the screen buffer 240 based on the reference area related information received via the management unit communication unit 244. Since the reference point is specified by the user such that the same data area as the reference area exists on the shared screen, the detection result is not transmitted to the management unit communication unit 218. Further, the shared screen management unit 208 and the first individual screen management unit 200 do not perform the process of determining the presence or absence of the reference area (S316, S320).
[0140]
The other functions and configurations of server 20 are the same as those of server 20 according to the second embodiment described with reference to FIG. The function and configuration of the client 10 are the same as those of the client 10 according to the first embodiment.
[0141]
The processing steps in the electronic conference system 1 when superimposing image data such as a photograph have been described with reference to FIG. 13, but the electronic conference system 1 according to the third embodiment Can be superimposed.
[0142]
As described above, according to the third embodiment, it is possible to determine a superimposition destination by receiving designation of one reference position from a user.
[0143]
(Embodiment 4)
Next, an electronic conference system 1 according to a fourth embodiment will be described. The server 20 according to the first embodiment accepts input of two points from the user and calculates the display ratio based on the distance between the two points. However, the server 20 according to the third embodiment accepts the specification from the user. The display ratio is automatically calculated without receiving it. In this point, the server 20 according to the present embodiment is different from the server 20 according to the first embodiment. The display magnification of the document is further displayed in the shared screen display window 41 and the first individual screen display window 42.
[0144]
FIG. 17 is a block diagram illustrating a functional configuration of the server 20 according to the fourth embodiment. As a functional configuration, the first individual screen management unit 200 of the server 20 according to the third embodiment replaces the point-to-point distance calculation unit 226 of the first individual screen management unit 200 according to the first embodiment with a display magnification. The detection unit 232 is provided. The shared screen management unit 208 according to the fourth embodiment further includes a display magnification detection unit 256 in addition to the functional configuration of the shared screen management unit 208 according to the first embodiment.
[0145]
The display magnification detection unit 232 detects a display magnification from the first individual screen data. Similarly, the display magnification detection unit 256 of the shared screen management unit 208 detects the display magnification from the shared screen data.
[0146]
FIG. 18A shows a document display window 90 displayed on the first individual screen display window 42 in the present embodiment. The document display window 90 includes an area for displaying a display magnification. In the present embodiment, the area 70 indicating the display magnification is provided at the lower left of the document display window 90. As described above, the screen data employed in the present embodiment always displays the display magnification at a predetermined position of the window.
[0147]
Specifically, the display magnification detecting unit 232 identifies a number in the display area 70 from the bitmap data by an OCR (Optical Character Recognition) function. OCR is generally a technique of performing character recognition from character image data in paper image data read by a scanner and outputting characters as text data. This technique is applied to screen data.
[0148]
Since the bitmap data is in an RGB format for color display, the bitmap data is converted into luminance data (Y) using the following equation, and the luminance data is binarized.
Y = 0.31R + 0.59G + 0.11B
This equation converts R, G, and B into a luminance signal Y of NTSC (National Television System Committee). Then, the display magnification detection unit 232 performs character recognition on the binarized bitmap data, and sends the characters to the notification information creation unit 228 as text data. In the example shown in FIG. 18, "100%" is detected as the text data of the display magnification.
[0149]
The display position and display area of the display magnification in the window of the application displaying the document are stored in the hard disk in advance as a system file in association with each application. For example, in the case of Acrobat Reader, the coordinates of the two diagonal points of this rectangle are represented by relative coordinates from the coordinates of the lower left corner of the window. Then, the coordinate values of these two points are stored in the hard disk as a system file in association with the application name. In the example shown in FIG. 18B, points E and F indicate the display area of the display magnification, and point Q indicates the lower left corner of the Acrobat Reader window. In this case, the coordinate values of the points E and F expressed by relative coordinates from the point Q are stored in the hard disk as system files in association with the Acrobat Reader. Thus, the display position of the display magnification can be specified according to the application.
[0150]
The display position and display area of the display magnification may be designated by surrounding the screen data of the display magnification with a rectangle on the touch panel 34 of the large display device 2 functioning as the touch input device of the server 20.
[0151]
The first individual window control unit 226 displays a file name of screen data such as a document received from the application in a title bar added to a window of the application. Further, the first individual window control unit 226 specifies the application from the file name of the screen data. For example, if the extension of the file name (the part after “.”) Is “pdf”, this document is a PDF document and the document display application determines that it is Acrobat Reader.
[0152]
Next, the operation of the electronic conference system 1 according to the fourth embodiment when superimposing data is superimposed on screen data having different display magnifications will be described with reference to FIG.
[0153]
First, when the user touches the area of the superimposition data using the touch pen 11 (S400), the first individual screen management unit 200 selects the specified superimposition data (S403). Further, when the inter-screen copy button 300 is touched (S402), the first individual screen management unit 200 sets the inter-screen copy mode (S406). Next, the display magnification detection unit 232 detects the display magnification of the document displayed on the first individual screen (S408).
[0154]
Specifically, first, the coordinates of the point Q at the lower left corner of the document display window 90 shown in FIG. Then, the absolute coordinates of the points E and F are obtained based on the relative coordinate values (relative coordinates from the point Q) of the points E and F indicating the display area of the display magnification 70 associated with the screen data. Then, the display magnification is detected by character recognition with respect to the screen data of the rectangular area having the points E and F in the screen buffer as diagonals.
[0155]
Hereinafter, the processing steps in the shared screen management unit 208, the first individual screen management unit 200, and the first client 10 in S409 to S444 are the same as the processing steps in S111 to S120 described in FIG. I do. Note that the superimposition-related information created in the present embodiment includes information indicating the display magnification detected by the display magnification detection unit 232.
[0156]
When the inter-screen copy mode is set in the shared screen display window 41 in S444, the display magnification detection unit 256 detects the display magnification Mag_dst of the document displayed in the shared screen data 80 (S446). . Next, the display ratio calculation unit 248 calculates the display ratio (= Mag_dst / Mag_src) from the display magnification calculated by the display magnification detection unit 256 and the display magnification value Mag_src of the first individual screen data 60 included in the superimposition-related information. It is calculated (S448). Then, the superimposition unit 246 scales the superimposition data based on the display ratio calculated by the display ratio calculation unit 248 (S452). Further, when receiving the notification of the reference point from the server communication unit 102 (S462), the superposition position determination unit 250 determines the superposition position based on the reference point and the display ratio (S470). Next, the superimposing unit 246 superimposes and pastes the superimposition data on the transparent screen (S472). Next, the shared screen data transmission unit 242 transmits the updated shared screen data to each of the display screens 32 and 110 (S474).
[0157]
As described above, according to the fourth embodiment, the display ratio can be calculated by reading the display magnification of the document displayed in the shared screen display window 41 and the first individual screen display window 42. Therefore, the display ratio can be automatically calculated without depending on the input from the user.
[0158]
(Embodiment 5)
Next, an electronic conference system 1 according to the fifth embodiment will be described. In the electronic conference system 1 according to the first to fourth embodiments, the superimposition data is superimposed on the corresponding position on the different screen data by specifying the superimposition target portion with respect to the already displayed handwritten drawing line. In the fifth embodiment, when handwriting is performed by the user, superimposition data indicating the handwritten drawing line can be superimposed in real time.
[0159]
In the fifth embodiment, as shown in FIG. 20, when a handwritten drawing line 74 is input from the user to first individual screen display window 42, reference region 72 including handwritten drawn line 74 is set. . Then, the processing from S302 to S342 in FIG. 13 is performed on the superimposed data of the handwritten drawing line 74 and the reference area 72. By repeating this process at predetermined time intervals, superimposition data can be superimposed in real time.
[0160]
The predetermined time interval may be, for example, each time the input of the handwritten drawing line from the user reaches a predetermined amount. Further, for example, it may be every time a certain time elapses.
[0161]
Hereinafter, the configuration and processing steps common to the electronic conference system 1 according to each embodiment will be described.
[0162]
First, a case where data is superimposed between two first individual screen display windows 42 displayed on the display screen 110 will be described. The display screen 110 can display a plurality of individual windows.
[0163]
In the display screen 110 shown in FIG. 21A, the shared screen display window 41 is iconified, and first individual screen display windows 42A and 42B are displayed. Different applications are displayed in the first individual screen display windows 42A and 42B. For example, the first individual screen display window 42B may display Acrobat Reader manufactured by Adobe Systems, and the first individual screen display window 42B may display a Web browser Netscape manufactured by Netscape Communications.
[0164]
Hereinafter, the bitmap data of the superimposition data 92 in the first individual screen data 90 displayed in the first individual screen display window 42A is superimposed on the first individual screen data 96 displayed in the first individual screen display window 42B. A method of superimposing an arbitrary position on the transparent screen will be described.
[0165]
First, when the freeze button 310 provided on the display screen 110 shown in FIG. 21A is touched with the touch pen 11, the first individual screen window 226 sets the button to the reverse display and freezes the screen data of the freeze area 315. (To freeze. That is, the operation of the windows of Netscape and Acrobat Reader cannot be performed. The first individual screen display windows 42A and 42B are displayed in the freeze area 315.
[0166]
At this time, when the rectangular area designation icon 312 displayed on the display screen 110 is touched, a rectangular area setting mode is set. In this mode, the point at which the touch pen 11 touches the touch panel 112 (pen down) is the upper left corner of the rectangle, and the point released from the touch panel 112 (pen up) is the lower right corner of the rectangle. Here, when the user specifies an area (rectangular area) surrounding the superimposition data 92 in the first individual screen data 90 displayed in the first individual screen display window 42A, the superimposition data management unit 222 in the server 20 Is stored in the screen buffer 211.
[0167]
Then, when the freeze button 310 is touched again, the button is returned to the normal display, and the freeze of the screen data in the freeze area 315 is released. At this time, if the switch button 314 is further touched by the user, the superimposition mode is set. FIG. 21B illustrates the display screen 110 when the superimposition mode is set. In the display screen 110 shown in FIG. 21B, the first individual screen display window 42A is closed. On the display screen 110 shown in FIG. 21B, a superimposable drawing area 316 is provided at the same position as the freeze area 315 displayed before the switching button 314 is pressed. The superimposable area 316 is an area where a virtual transparent screen is superimposed.
[0168]
At this time, the display of the freeze button 310 and the rectangular area designation button 312 is turned off, and instead, the save button 318, the read button 320, the inter-screen copy button 300, and the handwriting button 304 are displayed.
[0169]
When the user touches an arbitrary position in the superimposable drawing area 316, the bitmap data of the superimposition data 92 previously copied to the shared memory 210 is superimposed on the touched position, and the position designated by the user is touched. , The same data 94 as the superimposed data 92 is displayed.
[0170]
Next, a method for drawing handwritten characters and the like in the first individual screen display window 42 will be described with reference to FIG. In FIG. 22, the shared screen display window 41 is iconified, and only the first individual screen display window 42 is displayed. One application is displayed in the first individual screen display window 42. This application process is, for example, Acrobat Reader manufactured by Adobe Systems. When the switching button 314 displayed on the screen is touched, the superimposition drawing mode is set for the first individual screen display window 42. At this time, a virtual transparent superimposed screen is superimposed on the superimposable drawable area 318 provided at the same position as the superimposable drawable area 316 shown in FIG.
[0171]
Further, when the handwriting button 304 is touched, the button is set to the reverse display, and a superimposed handwriting drawing mode is set. At this time, a line type button 326 for selecting a line type, a rectangular button 328 for drawing a rectangle, an eraser button 330 for deleting a drawing line, and a handwritten drawing area to be superimposed on another screen are designated. To display an area designation button 306 or the like.
[0172]
When the mode is set to the superimposed handwriting drawing mode, the first client receiving unit 214 determines whether each coordinate value received from the server communication unit 102 is in the superimposed drawing possible area 318, and determines two consecutive coordinate values. Is in this area and is in the pen down state (the period from pen down to pen up), a drawing command for connecting and displaying each coordinate value with a straight line is sent to the first individual window control unit 226.
[0173]
The first individual window control unit 226 performs drawing according to the drawing command, and a handwritten drawing line is displayed in the first individual screen display window 42 of the first client 10. The first client receiving unit 214 also stores the coordinate sequence from pen down to pen up received from the server communication unit 102 as stroke data in the main memory.
[0174]
Note that a commercially available notebook computer can be used as the client terminal in place of the portable display pad of the present embodiment. In this case, handwriting can be performed by pressing the left mouse button of the notebook computer. In this case, the first client receiving unit 214 detects the pen down by receiving the event of the left mouse button ON, and detects the pen up by receiving the event of the left mouse button OFF.
[0175]
The characteristic configuration and processing steps of the electronic conference system 1 according to the first to fifth embodiments have been described. Although the configuration and processing steps of the server 20, the large display device 2, and the first client 10 have been described above, the configuration of the other clients 12, 14 is the same as the configuration of the first client 10. In the above description, the case where the superimposed data on the first individual screen data is superimposed on the shared screen data has been described. The processing steps when superimposing on the screen data are the same as the processing steps when superimposing the first individual screen data on the shared screen data described in each embodiment.
[0176]
Further, in the electronic conference system 1 according to the first to fifth embodiments, a case has been described in which superimposed data on the first individual screen data 60 is superimposed on the shared screen data 80. However, as another example, Alternatively, the superimposition data on the shared screen data 80 may be superimposed on the first individual screen data 60.
[0177]
Note that the electronic conference system 1 described in Embodiments 1 to 5 can be realized by a VNC client server system. The VNC client server system will be described with reference to FIG.
[0178]
FIG. 23A shows the relationship between the VNC protocol (RFB protocol) and the X protocol. The server 20 functions as a VNC server process 310 (hereinafter, referred to as a VNC server) and an X client process 330. The large display device 2 and each of the clients 10, 12, and 14 are connected to a VNC client process 300 (hereinafter, a "VNC client"). Function). The VNC server 310 generates one screen buffer at the time of its activation, and the VNC client 300 displays the screen data in this screen buffer on its own display screen.
[0179]
Screen data transmitted from the VNC server 310 to the VNC client 300 and user input data transmitted from the VNC client 300 to the VNC server 310 are transferred using an RFB (Remote Frame Buffer) protocol.
[0180]
The RFB protocol has a function of dividing data of one screen into small areas (rectangles), and further compressing and transmitting the image data of the small areas. The smallest block of this small area is called a tile and is 16 × 16 pixels. As described above, since the VNC server 310 can divide and transmit data of one screen, it can select and transmit only the changed area in one screen.
[0181]
Note that the VNC server 310 existing in the server 20 and the VNC client 300 existing in each of the clients 10, 12, and 14 can communicate with each other by a socket.
[0182]
The VNC server 310 processes the user input data received from the VNC client 300 as a key event or a pointer event. Upon receiving these events, the VNC server 310 operates as the X server 320 and notifies the X client 330 of the X event. Therefore, the VNC client 300 can operate the X client 330 (application) running on the server 20.
[0183]
Next, referring to FIG. 23B, processing steps until the clients 10, 12, and 14 connect to the server 20, operate an application (X client) running on the server 20, and display a document. Will be described.
[0184]
First, the server 20 activates the VNC servers 311, 312, 313, and 314 by the required number of screen buffers. When this screen buffer is not shared by a plurality of clients, that is, when only one client is set to attach, only the screen number is specified in the VNC server start command. For example, when the screen number is 2, the start command of the VNC server is “vncserver: 2”.
[0185]
When the screen buffer of the server 20 is shared by a plurality of clients, an option for instructing sharing is specified in addition to the screen number in the VNC server start command. For example, the start command of the VNC server when the screen number 1 is shared is “vncserver-alwaysshared: 1”.
[0186]
In this way, the server 20 starts the VNC server so that the screen number 1 is shared and the screen numbers 2 to 4 are individually attached to the clients 10, 12, and 14, respectively.
[0187]
Then, each of the clients 10, 12, and 14 designates an IP (Internet protocol) address of the server 20 and a screen number to be attached, and activates each of the VNC clients 302, 303, and 304. The start command of the VNC client when the screen number to be attached is 3 is, for example, “vncviewer192.168.1.1: 3”. Here, 192.168.1.1 indicates an IP address.
[0188]
Each of the clients 10, 12, and 14 starts a VNC client for a shared screen (screen number 1) and a VNC client for one individual screen (screen numbers 2 to 4). Then, the shared screens 41, 43, 45 and the individual windows 42, 44, 46 are displayed on the display screens 110, 120, 130 of the clients 10, 12, 14, respectively.
[0189]
The server 20 also activates the VNC client 301 by designating its own IP address and screen number 1 in order to display the shared screen on the large display device 2.
[0190]
In this way, only the shared screen is displayed on the large display device 2, and the shared screen and the individual screen are displayed on the clients 10, 12, and 14, respectively. Next, when one of the clients 10, 12, and 14 displays an arbitrary document in the shared screen display window using an arbitrary application in the server 20, the same document is displayed on the large display device 2 and the client 10. , 12, and 14 are displayed in the shared screen display windows of the remaining clients.
[0191]
In the individual screen display window of each of the clients 10, 12, and 14, any document can be displayed by using any application in the server 20 for each client.
[0192]
Each application 331, 332, 333, 334, 335 shown in FIG. 23B is a different document display application process. It is also possible for a plurality of VNC servers to start the same document display application (an independent application process is generated for each start).
[0193]
In FIG. 23B, two document display applications are activated only on the screen of the second VNC server 312. Although not shown in FIG. 23B, the server 20 has a window manager process (hereinafter, referred to as a “window manager”) for controlling the desktop screen for each of the VNC servers 311 to 314. ing.
[0194]
When the drawing data of the transparent screen superimposed on the screen of the second VNC server 312 is superimposed on the transparent screen superimposed on the screen of the first VNC server 311, data necessary for processing is transferred from the second window manager to the first window manager. Also, it is necessary to pass each of the data from the second superimposed drawing process to the first superimposed drawing process, and these data are transmitted via the second VNC server 312 and the first VNC server 311. In addition, in the superimposition process, the rendering data to be superimposed is temporarily placed on the shared memory 210 from which data can be written and read from both the first superimposition rendering process and the second superimposition rendering process. The shared memory 210 is an area secured on the main memory.
[0195]
FIG. 24 is a diagram illustrating a hardware configuration of the client 10. The client 10 includes a CPU 21, a clock 22, a main memory 23, a ROM 24, an RTC 25, a wireless LAN controller 26, an antenna 27, an LCD display controller 28, an LCD 110, a touch panel controller 30, a touch panel 112, a USB controller 32, a USB I / F 33, and a system bus. 34, a battery 35, a DC-DC converter 36, a charging circuit 37, an AC adapter 38, and the like.
[0196]
The CPU 21 executes and processes a control processing program, an OS, and various application programs stored in a ROM (Read Only Memory) 24. The clock 22 includes a crystal oscillator and a frequency divider, and generates a clock for controlling the operation timing of the CPU 21 and the system bus 34.
[0197]
The main memory 23 includes a DRAM (Dynamic Random Access Memory), and is used as a work area of the CPU 21. A program for controlling the entire system is written in the ROM 24 in advance.
[0198]
An RTC (Real Time Clock) 25 is a date clock, and is backed up by a dedicated battery (not shown). The wireless LAN controller 26 executes and controls wireless communication conforming to the IEEE 802.11b standard.
[0199]
The LCD display controller 28 performs D / A (Digital / Analog) conversion of characters and graphic data and screen data received from the server 20 and performs control for displaying these data on the LCD 110. The touch panel controller 30 detects a portion of the touch panel 112 touched by the tip of the touch pen 11 and takes in the position information. The touch panel 112 is superimposed on and close to the LCD 110. A USB (Universal Serial Bus) controller 32 executes and controls data transfer conforming to the USB standard.
[0200]
The battery 35 is a chargeable lithium ion battery, for example. The DC-DC converter 36 converts the power supplied from the AC adapter 38 or the battery 35 into a predetermined voltage and supplies it to the inside of the client 10, and when there is no power supply from the AC adapter 38, the power supply from the battery 35 Switch to. The charging circuit 37 charges the battery 35 when power is supplied from the AC adapter 38. The AC adapter 38 is integrated with a detachable power supply cable, and converts an AC power supply into a DC of a predetermined voltage by a built-in AC-DC converter.
[0201]
The client 10 implements Linux (R) as the OS and X Window (R) as the window system.
[0202]
The relationship between touch input coordinates detected using touch panel 112 and display coordinates on LCD 110 will be described. When the touch pen 11 touches the touch panel 112, the touch panel controller 30 detects this touch and causes the CPU 21 to generate an interrupt. The CPU 21 obtains coordinate values from the touch panel controller 30 by this interrupt. The touch input coordinates are expressed with the upper left corner of the display area of the LCD 110 as the origin, the right direction as the positive direction of the X axis, and the downward direction as the positive direction of the Y axis.
[0203]
The positions of the display pixels of the LCD 110 are expressed by display coordinates with the pixel position at the upper left corner of the display area of the LCD 110 as the origin, the right direction being the positive direction of the X-axis, and the downward direction being the positive direction of the Y-axis. . That is,
Display coordinates = (number of pixels in the X-axis direction from the pixel at the origin position, number of pixels in the Y-axis direction from the pixel at the origin position)
It is.
[0204]
For simplicity, it is assumed that the interval between the touch input coordinates and the pixel interval on the LCD 110 are the same, and the touch input coordinates and the display coordinates on the LCD 110 match. Note that calibration is performed to match the origin of the touch input coordinates with the origin of the display coordinates on the LCD 110. The calibration is an operation for associating the display coordinates with the touch input coordinates, and is a technique that has been widely known in the related art.
[0205]
The hardware configuration and the like of the client 10 have been described above. However, the hardware configuration and the like of the other clients 12 and 14 are the same as the hardware configuration and the like of the client 10.
[0206]
The hardware configuration of the server 20 is almost the same as the hardware configuration of the client 10 described with reference to FIG.
[0207]
As described above, the present invention has been described using the embodiment. However, various changes or improvements can be added to the above embodiment.
[0208]
As an example of such a change, the electronic conference system 1 employing a client server system has been described in the present embodiment. However, as another embodiment, a screen data management device according to the present invention may be realized by a stand-alone computer. Good. In this case, the screen data management device includes the functional configuration of the shared screen management unit 208 and the first individual screen management unit 200 of the server 20 and the client 10 described with reference to FIG. In this case, since each optical property is provided in the same device, it is not necessary to connect the shared screen management unit 208 and the first individual screen management unit 200 to the client 10 by a wireless LAN or the like. Note that the functional configurations of the shared screen management unit 208, the first individual screen management unit 200, and the client 10 in the image data management device in this example are the same as those of the shared screen management unit 208 and the This is the same as the functional configuration of one individual screen management unit 200 and the client 10. As described above, even in the stand-alone computer, the display content on the display screen can be managed similarly to the electronic conference system 1 according to the first embodiment.
[0209]
【The invention's effect】
As described above, according to the first aspect of the present invention, the position where the superimposition data is superimposed based on the position where the superimposition data is superimposed on the first screen data and the predetermined reference position. Of the first screen data and the relative positional relationship between the first screen data and the superimposed data is equal to the relative positional relationship between the second screen data and the superimposed data. The superimposition data can be superimposed at such a position. Further, at this time, it is not necessary to use an application for screen data, and the effect that the convenience of the data management device can be improved can be achieved.
[0210]
According to the second aspect of the present invention, the reference position set for the first screen data and the position designated by the user as the reference position in the second screen data corresponding to the reference position , The positional relationship between the first screen data and the second screen data can be grasped, and the superposition position can be determined based on this positional relationship. That is, based on the reference position in the second screen data acquired by the acquiring means, the superimposition data can be superimposed on the second screen data with high positional accuracy without using an application. There is an effect that convenience can be improved.
[0211]
According to the third aspect of the present invention, based on the reference position in the first screen data acquired by the acquiring means, the superimposition data is superimposed on the second screen data with high positional accuracy without using an application. And the convenience of the screen data management device can be improved.
[0212]
According to the fourth aspect of the present invention, superimposition data can be superimposed on a desired position, so that position adjustment until the superimposition position is determined becomes unnecessary, and the convenience of the screen data management device can be improved. It has the effect of being able to do it.
[0213]
According to the fifth aspect of the present invention, even when the display magnifications of the first screen data and the second screen data are different, the superimposition data is superimposed with high positional accuracy without using an application. Can be. As described above, since the superimposition data can be superimposed on a desired position, there is no need to adjust the position until the superimposition position is determined, so that the convenience of the screen data management device can be improved.
[0214]
According to the invention of claim 6, even when the display magnifications of the first screen data and the second screen data are different, the superimposition data is superimposed with high positional accuracy without using an application. Can be. As described above, since the superimposition data can be superimposed on a desired position, there is no need to adjust the position until the superimposition position is determined, so that the convenience of the screen data management device can be improved.
[0215]
Further, according to the invention according to claim 7, it is possible to superimpose the superimposition data at an accurate position with an appropriate size. In addition, there is no need to adjust the superimposition position or the size, and thus it is possible to improve the convenience of the screen data management device.
[0216]
According to the eighth aspect of the present invention, when the superimposition data is a handwritten drawing line, the handwritten drawing line is placed at the superimposed position determined based on the positional relationship between the reference position and each point constituting the drawing line. Are superimposed. Therefore, it is possible to superimpose a handwritten drawing line as superimposition data with high positional accuracy without using an application. As described above, since the superimposition data indicating the handwritten drawing line can be superimposed at a desired position, the position adjustment until the superimposition position is determined becomes unnecessary, and the convenience of the screen data management device can be improved. To play.
[0219]
According to the ninth aspect of the present invention, since the superimposing means superimposes the superimposed data on the second screen data at predetermined time intervals, it is possible to superimpose the superimposed data in real time. Play.
[0218]
According to the tenth aspect of the present invention, based on the position where the superimposition data is superimposed on the first screen data and a predetermined reference position, the first position of the position where the superimposition data is superimposed is determined. Of the first screen data and the superimposed data, and a position where the relative positional relation between the second screen data and the superimposed data becomes equal. Can be superimposed with the superimposed data. Further, at this time, it is not necessary to use an application for screen data, and the effect that the convenience of the data management device can be improved can be achieved.
[0219]
According to the eleventh aspect, based on the position where the superimposition data is superimposed on the first screen data and the predetermined reference position, the first position of the superimposition data that is superimposed is determined. Of the first screen data and the superimposed data, and a position where the relative positional relation between the second screen data and the superimposed data becomes equal. Can be superimposed with the superimposed data. Further, at this time, it is not necessary to use an application for screen data, and the effect that the convenience of the data management device can be improved can be achieved.
[0220]
According to the twelfth aspect of the present invention, based on the position where the superimposition data is superimposed on the first screen data and the predetermined reference position, the first position of the superimposition data being superimposed is determined. Of the first screen data and the superimposed data, and a position where the relative positional relation between the second screen data and the superimposed data becomes equal. Can be superimposed with the superimposed data. Further, at this time, it is not necessary to use an application for screen data, and the effect that the convenience of the data management device can be improved can be achieved.
[Brief description of the drawings]
FIG. 1 is a view schematically showing an electronic conference system 1 according to a first embodiment.
FIG. 2 is a schematic block diagram schematically showing a functional configuration of a server 20.
FIG. 3 is a schematic block diagram illustrating a functional configuration of each window management unit.
FIG. 4 is a diagram schematically showing a relationship between screen data in a screen buffer and a virtual transparent screen superimposed on the screen data.
FIG. 5 is a schematic block diagram showing a functional configuration of a client 10.
FIG. 6 is a diagram showing a display screen 110 before and after superimposition data is superimposed by a server 20.
FIG. 7 is a flowchart illustrating processing of the electronic conference system 1 when superimposing data indicating an image is superimposed.
FIG. 8 is a diagram showing a display screen 110 before and after superimposition data indicating a handwritten drawing line is superimposed.
FIG. 9 is a flowchart illustrating a process of the electronic conference system 1 when superimposing data indicating a handwritten drawing line is superimposed.
FIG. 10 is a flowchart showing processing of the electronic conference system 1 when superimposing data is superimposed between screen data displayed at different display magnifications.
FIG. 11 is a diagram illustrating a display screen before and after superimposition when superimposing data is superimposed between screen data displayed at different display magnifications.
FIG. 12 is a schematic block diagram illustrating a functional configuration of a server 20 according to the second embodiment.
FIG. 13 is a flowchart illustrating a process performed by the electronic conference system 1 according to the second embodiment;
FIG. 14 is a diagram for explaining a reference area.
FIG. 15 is a diagram showing a reference area set for a handwritten drawing line.
FIG. 16 is a diagram showing the display screen 110 after a handwritten drawing line is superimposed on shared data.
FIG. 17 is a block diagram illustrating a functional configuration of a server 20 according to the fourth embodiment.
FIG. 18 is a diagram showing a display screen 110 displayed by a server 20 according to the fourth embodiment.
FIG. 19 is a flowchart illustrating processing of the electronic conference system 1 according to the fourth embodiment.
FIG. 20 is a diagram showing a display screen 110 for displaying a handwritten drawing line during drawing.
21 is a diagram showing the display screen 110 before and after superimposition between first individual screen display windows 42. FIG.
FIG. 22 is a diagram showing a screen displayed on the display screen 110 when a handwritten drawing line is drawn in the first individual screen display window 42.
FIG. 23 is a diagram showing a VNC client server system.
FIG. 24 is a diagram showing a hardware configuration of a client 10.
[Explanation of symbols]
1 Electronic conference system
2 Large display device
10,12,14 Client
11 Touch pen
20 servers
32,110,120,130 display screen
41 Shared screen display window
42 1st individual screen display window
54 transparent screen
60 1st individual screen data
74 drawing lines
80 Shared screen data
102 server communication unit
104 display screen control unit
106 Instruction reception unit
112 Touch Panel
200, 202, 204 Individual screen management unit
208 Shared Screen Management Unit
210 shared memory
211 screen buffer
212 First Individual Screen Data Transmission Unit
214 first client receiving unit
218 Communication unit between management units
220 Superposition unit
222 Superimposition data management unit
224 Vector calculation unit
226 First Individual Window Control Unit
228 Notification information creation unit
230 Reference area setting section
232 Display magnification detector
240 screen buffer
242 Shared screen data transmission unit
244 Communication unit between management units
246 Superposition unit
248 Display ratio calculation unit
250 Superposition position determination unit
252 client receiver
254 shared window control unit
256 Display magnification detector
258 Reference area detector

Claims (12)

In a screen data management device that manages screen data,
First superimposing means for virtually superimposing superimposed data to be superimposed on the first screen data and separately from the first screen data, on the first screen data;
Based on the positional relationship between the position where the superimposition data is superimposed on the first screen data and an arbitrary reference position on the first screen data, a part or all of the first screen data Superimposition position determining means for determining a superimposition position where the superimposition data is to be superimposed on the same second screen data;
A screen data management device, comprising: a second superimposing unit that virtually superimposes the superimposed data at a position determined by the superimposition position determining unit with respect to the second screen data. Acquisition means for acquiring designation of the reference position in the second screen data corresponding to the reference position in the first screen data,
The said superposition position determination means determines the said superposition position on the said 2nd screen data based on the said reference position and the said positional relationship which the said acquisition means acquired, The Claim 1 characterized by the above-mentioned. Screen data management device. An acquisition unit that acquires designation of the reference position in the first screen data,
The method according to claim 1, wherein the superimposition position determination unit determines the superimposition position on the second screen data based on the reference position and the positional relationship acquired by the acquisition unit. Screen data management device as described. A reference area detecting unit configured to detect, from the second screen data, an area identical to an arbitrary reference area in the first screen data;
The superimposition position determination unit is configured to determine a positional relationship between a position of the superimposition data superimposed on the first screen data and a position of the reference region, and the second screen data detected by the reference region detection unit. The screen data management device according to any one of claims 1 to 3, wherein the superimposition position on the second screen data is determined based on a position of the area in the area. Display ratio calculating means for calculating a ratio between a distance between any two points in the first screen data and a distance between the two points in the second screen data corresponding to the two points,
The said superposition position determination means determines the said superposition position on the said 2nd screen data based on the said positional relationship and the said ratio, The Claims any one of Claim 1 to 4 characterized by the above-mentioned. Screen data management device. When the display magnification of the first screen data is displayed in the first screen data and the display magnification of the second screen data is displayed in the second screen data, the first Display magnification detecting means for detecting a display magnification of the screen data of the second and the display magnification of the second screen data;
Display ratio calculating means for calculating a ratio between a display magnification of the first screen data and a display magnification of the second screen data,
The said superposition position determination means determines the said superposition position on the said 2nd screen data based on the said positional relationship and the said ratio, The Claims any one of Claim 1 to 4 characterized by the above-mentioned. Screen data management device. The second superimposing means edits superimposed data superimposed on the first screen data based on the ratio, and superimposes the edited superimposed data at the determined position. Item 7. The screen data management device according to item 5 or 6. In a case where the superimposition data superimposed on the first screen data is data representing a handwritten drawing line, the superposition position determining means determines each point constituting the drawing line on the first screen data. A position, based on each positional relationship with the reference position, determining the superimposed position on the second screen data;
The screen data management device according to claim 1, wherein the second superimposing unit draws the drawing line at the determined superimposition position. Further comprising an acquisition unit for acquiring the drawing line,
When the obtaining unit obtains the drawing line, the superimposition position determining unit determines, at predetermined time intervals, a superposition position where the superimposition data corresponding to the drawing line is to be superimposed,
The screen according to claim 7, wherein the second superimposing means superimposes the superimposed data on the second screen data every time the superimposed position determining means determines the superimposed position. Data management device. A plurality of clients that display screen data in a window, and a screen data management system including a screen data management device that manages the screen data to be displayed in the window,
First window control means in the client for displaying the first screen data in the first window;
First superimposing means for virtually superimposing superimposed data to be superimposed on the first screen data, separately from the first screen data, on the first screen data;
Based on the positional relationship between the position where the superimposition data is superimposed on the first screen data and an arbitrary reference position on the first screen data, a part or all of the first screen data Superimposition position determining means for determining a superimposition position where the superimposition data is to be superimposed on the same second screen data;
The superimposition data is superimposed by the second superimposition means and the second superimposition means for virtually superimposing the superimposition data at the position determined with respect to the second screen data by the superimposition position determination means. A second window control unit for displaying the second screen data in a second window. In a screen data management method for managing screen data,
A first superimposing step of superimposing superimposed data to be superimposed on the first screen data, separately from the first screen data, virtually on the first screen data;
Based on the positional relationship between the position where the superimposition data is superimposed on the first screen data and an arbitrary reference position in the first screen data, a part or all of the first screen data is A superimposition position determining step of determining a superimposition position where the superimposition data is to be superimposed on the same second screen data;
A second superimposing step of virtually superimposing the superimposed data at a position determined with respect to the second screen data in the superimposing position determining step. In a screen data management program that manages screen data,
A first superimposing step of superimposing superimposed data to be superimposed on the first screen data, separately from the first screen data, virtually on the first screen data;
Based on the positional relationship between the position where the superimposition data is superimposed on the first screen data and an arbitrary reference position in the first screen data, a part or all of the first screen data is A superimposition position determining step of determining a superimposition position where the superimposition data is to be superimposed on the same second screen data;
A screen data management program for causing a computer to execute a second superimposition step of virtually superimposing the superimposition data at a position determined with respect to the second screen data in the superimposition position determination step.

Images