JPS63228890A - Image synthesizing device - Google Patents
Image synthesizing deviceInfo
- Publication number
- JPS63228890A JPS63228890A JP6298887A JP6298887A JPS63228890A JP S63228890 A JPS63228890 A JP S63228890A JP 6298887 A JP6298887 A JP 6298887A JP 6298887 A JP6298887 A JP 6298887A JP S63228890 A JPS63228890 A JP S63228890A
- Authority
- JP
- Japan
- Prior art keywords
- image
- circuit
- caller
- image data
- display
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 230000002194 synthesizing effect Effects 0.000 title claims abstract 6
- 238000000605 extraction Methods 0.000 abstract description 10
- 230000003287 optical effect Effects 0.000 abstract description 8
- 230000005540 biological transmission Effects 0.000 abstract description 5
- 230000009466 transformation Effects 0.000 abstract 2
- 230000015572 biosynthetic process Effects 0.000 description 9
- 238000003786 synthesis reaction Methods 0.000 description 9
- 238000006243 chemical reaction Methods 0.000 description 6
- 239000000284 extract Substances 0.000 description 4
- 238000009434 installation Methods 0.000 description 4
- 238000010586 diagram Methods 0.000 description 3
- 230000000694 effects Effects 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 239000000203 mixture Substances 0.000 description 2
- 238000004891 communication Methods 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000000034 method Methods 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
Abstract
Description
【発明の詳細な説明】
〔産業上の利用分野〕
本発明は画像合成装置に係り、特に、双方向映像通信シ
ステムにおけるテレビ電話に用いるに好適な画像合成装
置に関する。DETAILED DESCRIPTION OF THE INVENTION [Field of Industrial Application] The present invention relates to an image composition device, and particularly to an image composition device suitable for use in a videophone in a two-way video communication system.
テレビ電話によって通話者が相手と話をするとき通常表
示装置の画面を見ながら行なうため１通話者の画像を相
手方に伝送するときには表示装置近傍にテレビカメラを
配置し、このテレビカメラで撮像された通話者の画像を
相手方に伝送することが行なわれている。この場合通話
者の視線は表示装置の光軸と一致するが、通話者の視線
はテレビカメラの光軸とはずれる。即ち、通話者はテレ
ビカメラに対して幾分下向きかげんで撮像されることに
なる。このためお互いに違和感が生じるという不具合が
あった。When a person on the other end of a videophone conversation talks with the other party, they usually do so while looking at the screen of a display device, so when an image of one person on the other end of the conversation is transmitted to the other party, a television camera is placed near the display device, and the image is captured by this television camera. An image of a caller is transmitted to the other party. In this case, the line of sight of the caller coincides with the optical axis of the display device, but the line of sight of the caller is off the optical axis of the television camera. In other words, the person on the phone will be imaged with a somewhat downward angle to the television camera. For this reason, there was a problem that a feeling of discomfort was caused between the two.
そこで、特開昭６１−６５６８３号公報に記載されてい
るように１表示装置の前面側に半透明鏡を設け。Therefore, as described in Japanese Unexamined Patent Publication No. 61-65683, a semi-transparent mirror is provided on the front side of one display device.
半透明鏡で反射した通話者の像をテレビカメラで撮像し
１通話者の視線とテレビカメラの光軸とを一致させるよ
うにするものが提案されている。°この方式によれば１
通話者の視線と表示装置の画面上に表示された通話相手
の視線が一致するため違和感が生じることはない。A system has been proposed in which the image of the caller reflected by a semi-transparent mirror is captured by a television camera, and the line of sight of the caller is aligned with the optical axis of the television camera. ° According to this method 1
Since the line of sight of the caller and the line of sight of the other party displayed on the screen of the display device match, no discomfort occurs.
上記従来技術は、テレビ電話の設置スペー、スの広さに
ついては何ら配慮がされておらず、表示装置の前面側に
半透明鏡を設置しなければならないので、テレビ電話の
設置スペースが広くなるという不具合があった。The above conventional technology does not give any consideration to the installation space and size of the videophone, and since a semi-transparent mirror must be installed on the front side of the display device, the installation space for the videophone becomes large. There was a problem.
本発明の目的は、表示装置の前面側に光学装置を設けな
くても表示装置の画面を見る者の視線と画像表示された
相手の視線とを一致させることができる画像合成装置を
提供することにある。An object of the present invention is to provide an image synthesis device that can match the line of sight of a person viewing the screen of a display device with the line of sight of a person whose image is displayed without providing an optical device on the front side of the display device. It is in.
前記目的を達成するために、本発明は、電話用表示装置
の画面を見つめる通話者の両横層を表示画面の両側から
撮像し、左右の横顔に対するＷＩ像信号を生成する画像
入力手段と、画像入力手段出力の各画像信号を受けて各
画像の特徴点を抽出し。In order to achieve the above object, the present invention provides image input means for capturing images of both horizontal layers of a caller staring at the screen of a telephone display device from both sides of the display screen and generating WI image signals for the left and right side faces; Receives each image signal output from the image input means and extracts feature points of each image.
各特徴点の位置情報を基に左右の画像を一画像に合成す
る画像合成手段と、を含む画像合成装置を構成したもの
である。This image compositing device includes an image compositing means for composing left and right images into one image based on position information of each feature point.
画像入力手段によって通話者の両横層に関する画像信号
を生成し、この画像信号を画像合成手段へ出力する。画
像合成手段は各画像信号を受けて各画像の特徴点を抽出
し、各特徴点の位置情報を基に左右の画像を位置画像に
合成する。The image input means generates image signals regarding both horizontal layers of the caller, and outputs the image signals to the image synthesis means. The image synthesis means receives each image signal, extracts the feature points of each image, and synthesizes the left and right images into a position image based on the position information of each feature point.
以下、本発明の実施例を第１図に基づいて詳細に説明す
る。Hereinafter, embodiments of the present invention will be described in detail based on FIG.
第１図において、テレビ電話システムとして、ディスプ
レイ１が設けられていると共にディスプレイ１の両側に
ビデオカメラ２．３が配置されている。そしてディスプ
レイ１には、アンテナ４から受信された信号が受信機５
．映像出力回路６を介して画像表示されるようになって
いる。ビデオカメラ２，３はディスプレイ１の画面を見
つめる通話者７の両横層をディスプレイ１の両側から撮
像し、左右の横顔に対する画像信号を生成する画像入力
手段として構成されている。そして各ビデオカメラ２，
３の出力信号は画像合成プロセッサ８、送信システム９
．アンテナ４を介して送信されるようになっている。In FIG. 1, a video telephone system is provided with a display 1 and video cameras 2.3 arranged on both sides of the display 1. The signal received from the antenna 4 is then displayed on the display 1 at the receiver 5.
．． The image is displayed via the video output circuit 6. The video cameras 2 and 3 are configured as image input means for capturing images of both sides of the caller 7 looking at the screen of the display 1 from both sides of the display 1, and generating image signals for the left and right sides of the person's face. And each video camera 2,
The output signal of 3 is sent to an image synthesis processor 8 and a transmission system 9.
．． The signal is transmitted via antenna 4.
画像合成手段としての画像合成プロセッサ８は。The image synthesis processor 8 is an image synthesis means.
第２図に示されるように、特徴点抽出回路８Ａ。As shown in FIG. 2, a feature point extraction circuit 8A.
特徴対応点抽出回路８Ｂ、距離計算回路８Ｃ，三次元座
標変換回路８Ｄ、二次元変換回路８Ｅから構成されてい
る。特徴点抽出回路８Ａはビデオカメラ２からの画像信
号、即ち通話者７の右側の横顔に対する画像信号を画像
データに変換すると共に画像データに含まれる各部の特
徴点１例えば輪郭、鼻などを抽出するようになっている
。又特徴対応点抽出回路８Ｂはビデオカメラ３からの画
像信号、即ち通話者７の左側の横顔に対する画像信号を
基に特徴点に対応した画像データを抽出するようになっ
ている。距離計算回路８Ｃは特徴点抽出回路８Ａ、特徴
対応点抽出回路８Ｂからの信号を基に、各特徴点及び特
徴対応点の距離を算出し、距離データを三次元座標変換
回路８Ｄへ出力するようになっている。三次元座標変換
回路８Ｄは特徴点抽出回路８Ａ、特徴対応点抽出回路８
Ｂからの画像データと距離計算回路８Ｃからの距離デー
タを基に左右の画像データを三次元の画像データに変換
し、変換したデータを二次元変換回路８Ｅへ出力するよ
うになっている。二次元変換回路８Ｅは三次元の画像デ
ータを基に左右の画像データを位置画像に変換する処理
を行ない、左右の画像データが位置画像の合成された画
像信号を送信システム９へ出力するようになっている。It is composed of a feature corresponding point extraction circuit 8B, a distance calculation circuit 8C, a three-dimensional coordinate conversion circuit 8D, and a two-dimensional conversion circuit 8E. The feature point extraction circuit 8A converts the image signal from the video camera 2, that is, the image signal of the right side profile of the caller 7, into image data, and extracts the feature points 1 of each part included in the image data, such as the contour, nose, etc. It looks like this. Further, the feature corresponding point extraction circuit 8B extracts image data corresponding to the feature points based on the image signal from the video camera 3, that is, the image signal for the left side profile of the caller 7. The distance calculation circuit 8C calculates the distance between each feature point and feature corresponding point based on the signals from the feature point extraction circuit 8A and the feature corresponding point extraction circuit 8B, and outputs the distance data to the three-dimensional coordinate conversion circuit 8D. It has become. The three-dimensional coordinate conversion circuit 8D includes a feature point extraction circuit 8A and a feature corresponding point extraction circuit 8.
The left and right image data are converted into three-dimensional image data based on the image data from B and the distance data from the distance calculation circuit 8C, and the converted data is output to the two-dimensional conversion circuit 8E. The two-dimensional conversion circuit 8E performs processing to convert left and right image data into position images based on three-dimensional image data, and outputs an image signal in which left and right image data are combined with position images to the transmission system 9. It has become.
この画像データが送信システム９によりアンテナ４を介
して通話相手に送信される。又相手からの画像をディス
プレイ１に表示するとき、相手側にも同じシステムが設
けられていれば、ディスプレイ１の画面には１通話者７
の視線と、ディスプレイ１の画面上に表示された相手側
の視線とが一致して表示され、お互いに違和感を生じる
ことなく通話を行なうことができる。さらにディスプレ
イ１の前面側に半透明鏡などを設置する必要がないので
、電話機の設置スペースを広く取る必要もない。This image data is transmitted by the transmission system 9 via the antenna 4 to the other party. Also, when displaying an image from the other party on display 1, if the other party has the same system, the screen of display 1 will show only one caller 7.
The line of sight of the person and the line of sight of the other party displayed on the screen of the display 1 are displayed in agreement, and the conversation can be carried out without causing any discomfort to either party. Furthermore, since there is no need to install a translucent mirror or the like on the front side of the display 1, there is no need to take up a large installation space for the telephone.
第３図には、本発明の他の実施例の構成が示されている
。FIG. 3 shows the configuration of another embodiment of the invention.
本実施例は、画像入力手段として一台のビデオカメラ１
２を配置し１通話者７の両横層からの反射光を光路変更
装置１１を介してビデオカメラ１２へ導くようにしたも
のであり、他の構成は第１図のものと同様であるので、
同一のものには同−符号を付してそれらの説明は省略す
る。In this embodiment, one video camera 1 is used as the image input means.
2 is arranged so that the reflected light from both lateral layers of one caller 7 is guided to the video camera 12 via the optical path changing device 11, and the other configuration is the same as that in FIG. ,
Identical parts are given the same reference numerals and their description will be omitted.
ディスプレイ１の両側にはシャッタ１３．１４が配置さ
れており、シャッタ１３．１４はシャッタコントローラ
１５からの指令によって交互に開閉し、通話者７の両横
顔から反射する反射光をミラー１０Ａ、ＩＯＢへ導くよ
うになっている。ミラー１０Ａに入射した光はミラー１
０Ｃ，ＩＯＥを介してビデオカメラ１２へ導かれ、ミラ
ー１０Ｂに入射した光はミラー１０Ｄ、ＩＯＦを介して
ビデオカメラ１２へ導かれるようになっている。即ち、
シャッタコントローラ１５がフィールド毎にシャッタ１
３．１４を交互に開閉すると、通話者７の両横顔から反
射した光がそれぞれ交互にビデオカメラ１２に入射する
。このため、一台のビデオカメラ１２によっても、通話
者７の各横顔に関する画像信号を画像合成プロセッサ８
へ出力することができる。又、シャッタ１３．１４とし
て、液晶シャッタを用いることも可能である。又さらに
光路変更装置１１として光ファイバを用いることも可能
である。Shutters 13.14 are arranged on both sides of the display 1, and the shutters 13.14 open and close alternately according to commands from the shutter controller 15, and direct the reflected light from both side faces of the caller 7 to the mirrors 10A and IOB. It is designed to guide you. The light incident on mirror 10A is reflected on mirror 1
The light is guided to the video camera 12 via 0C and IOE, and the light incident on the mirror 10B is guided to the video camera 12 via the mirror 10D and IOF. That is,
The shutter controller 15 releases one shutter for each field.
3.14 is alternately opened and closed, the light reflected from both side faces of the caller 7 alternately enters the video camera 12. Therefore, even if one video camera 12 is used, image signals related to each profile of the caller 7 are transmitted to the image synthesis processor 8.
It can be output to. It is also possible to use liquid crystal shutters as the shutters 13 and 14. Furthermore, it is also possible to use an optical fiber as the optical path changing device 11.
以上説明したように、本発明によれば、通話者の両横顔
を撮像し、各横顔に対する画像信号を一画像に合成する
ようにしたため９表示装置の前面側に半透明鏡など光学
手段を配置しなくても、通話者の視線と表示装置の画面
に表示された相手の視線とを一致させることができ、電
話機の設置スペースを狭少化することができる。As explained above, according to the present invention, since both side faces of the caller are captured and the image signals for each side face are combined into one image, an optical means such as a semi-transparent mirror is arranged on the front side of the display device. Even if the caller does not do so, the line of sight of the caller can be made to match the line of sight of the other party displayed on the screen of the display device, and the installation space for the telephone can be reduced.
第１図は本発明の一実施例を示す全体構成図、第２図は
第１＠に示す画像合成プロセッサ８の具体的構成図、第
３図は本発明の他の実施例を示す構成図である。
１・・・ディスプレイ、２，３．１２・・・ビデオカメ
ラ、４・・・アンテナ、５・・・受信機、６・・・映像
出力回路。
７・・・通話者、８・・・画像合成プロセッサ、９・・
・送信システム。FIG. 1 is an overall configuration diagram showing one embodiment of the present invention, FIG. 2 is a specific configuration diagram of the image synthesis processor 8 shown in FIG. 1@, and FIG. 3 is a configuration diagram showing another embodiment of the present invention. It is. 1... Display, 2, 3. 12... Video camera, 4... Antenna, 5... Receiver, 6... Video output circuit. 7... Caller, 8... Image synthesis processor, 9...
・Transmission system.
Claims (1)
表示画面の両側から撮像し、左右の横顔に対する画像信
号を生成する画像入力手段と、画像入力手段出力の各画
像信号を受けて各画像の特徴点を抽出し、各特徴点の位
置情報を基に左右の画像を一画像に合成する画像合成手
段と、を含むことを特徴とする画像合成装置。1. Image input means for capturing images of both sides of the caller's profile from both sides of the display screen and generating image signals for the left and right side profiles; An image synthesizing device comprising an image synthesizing means for extracting feature points of an image and synthesizing left and right images into one image based on position information of each feature point.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP6298887A JPH074011B2 (en) | 1987-03-18 | 1987-03-18 | Image synthesizer |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP6298887A JPH074011B2 (en) | 1987-03-18 | 1987-03-18 | Image synthesizer |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| JPS63228890A true JPS63228890A (en) | 1988-09-22 |
| JPH074011B2 JPH074011B2 (en) | 1995-01-18 |
Family
ID=13216255
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| JP6298887A Expired - Lifetime JPH074011B2 (en) | 1987-03-18 | 1987-03-18 | Image synthesizer |
Country Status (1)
| Country | Link |
|---|---|
| JP (1) | JPH074011B2 (en) |
Cited By (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5438357A (en) * | 1993-11-23 | 1995-08-01 | Mcnelley; Steve H. | Image manipulating teleconferencing system |
| US5499303A (en) * | 1991-01-31 | 1996-03-12 | Siemens Aktiengesellschaft | Correction of the gaze direction for a videophone |
| US5639151A (en) * | 1996-02-16 | 1997-06-17 | Mcnelley; Steve H. | Pass-through reflective projection display |
| US5777665A (en) * | 1995-09-20 | 1998-07-07 | Videotronic Systems | Image blocking teleconferencing eye contact terminal |
| JPH11355804A (en) * | 1998-06-04 | 1999-12-24 | Nec Corp | Network conference image processing unit |
| US6710797B1 (en) | 1995-09-20 | 2004-03-23 | Videotronic Systems | Adaptable teleconferencing eye contact terminal |
| EP1563680A1 (en) * | 2002-11-22 | 2005-08-17 | Hewlett-Packard Development Company, L.P. | Retractable camera apparatus |
| US7209160B2 (en) | 1995-09-20 | 2007-04-24 | Mcnelley Steve H | Versatile teleconferencing eye contact terminal |
| US8072481B1 (en) | 2006-03-18 | 2011-12-06 | Videotronic Systems | Telepresence communication system |
| US8199185B2 (en) | 1995-09-20 | 2012-06-12 | Videotronic Systems | Reflected camera image eye contact terminal |
| US8270075B2 (en) | 2008-05-08 | 2012-09-18 | Musion Ip Limited | Projection apparatuses and associated methods |
| US8915595B2 (en) | 2008-12-24 | 2014-12-23 | Musion Ip Limited | Method of manufacturing foil for producing a pepper's ghost illusion |
| US9563115B2 (en) | 2008-12-24 | 2017-02-07 | Musion Ip Limited | Method of manufacturing foil for producing a pepper's ghost illusion |
| US10288982B2 (en) | 2008-12-02 | 2019-05-14 | Musion Ip Limited | Mobile studio |
| US10447967B2 (en) | 2008-07-14 | 2019-10-15 | Musion Ip Ltd. | Live teleporting system and apparatus |
-
1987
- 1987-03-18 JP JP6298887A patent/JPH074011B2/en not_active Expired - Lifetime
Cited By (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5499303A (en) * | 1991-01-31 | 1996-03-12 | Siemens Aktiengesellschaft | Correction of the gaze direction for a videophone |
| US5438357A (en) * | 1993-11-23 | 1995-08-01 | Mcnelley; Steve H. | Image manipulating teleconferencing system |
| US8199185B2 (en) | 1995-09-20 | 2012-06-12 | Videotronic Systems | Reflected camera image eye contact terminal |
| US5777665A (en) * | 1995-09-20 | 1998-07-07 | Videotronic Systems | Image blocking teleconferencing eye contact terminal |
| US6710797B1 (en) | 1995-09-20 | 2004-03-23 | Videotronic Systems | Adaptable teleconferencing eye contact terminal |
| US7209160B2 (en) | 1995-09-20 | 2007-04-24 | Mcnelley Steve H | Versatile teleconferencing eye contact terminal |
| US5639151A (en) * | 1996-02-16 | 1997-06-17 | Mcnelley; Steve H. | Pass-through reflective projection display |
| JPH11355804A (en) * | 1998-06-04 | 1999-12-24 | Nec Corp | Network conference image processing unit |
| EP1563680A1 (en) * | 2002-11-22 | 2005-08-17 | Hewlett-Packard Development Company, L.P. | Retractable camera apparatus |
| US8072481B1 (en) | 2006-03-18 | 2011-12-06 | Videotronic Systems | Telepresence communication system |
| US8270075B2 (en) | 2008-05-08 | 2012-09-18 | Musion Ip Limited | Projection apparatuses and associated methods |
| US8514490B2 (en) | 2008-05-08 | 2013-08-20 | Musion Ip Limited | Projection apparatuses and associated methods |
| US10447967B2 (en) | 2008-07-14 | 2019-10-15 | Musion Ip Ltd. | Live teleporting system and apparatus |
| US10288982B2 (en) | 2008-12-02 | 2019-05-14 | Musion Ip Limited | Mobile studio |
| US8915595B2 (en) | 2008-12-24 | 2014-12-23 | Musion Ip Limited | Method of manufacturing foil for producing a pepper's ghost illusion |
| US9563115B2 (en) | 2008-12-24 | 2017-02-07 | Musion Ip Limited | Method of manufacturing foil for producing a pepper's ghost illusion |
Also Published As
| Publication number | Publication date |
|---|---|
| JPH074011B2 (en) | 1995-01-18 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JPS63228890A (en) | Image synthesizing device | |
| KR20110114620A (en) | Stereoscopic imaging apparatus and method | |
| CN103081462A (en) | Studio and system for life-size videoconferencing | |
| CN108093201B (en) | Video conference terminal and system | |
| JPH04280582A (en) | Display-image pickup device | |
| JP2005065051A (en) | Imaging apparatus | |
| CN104169795B (en) | Image display device, the camera and the method for displaying image that carry this image display device as viewfinder | |
| JP2008228170A (en) | Image display device and television telephone device | |
| JP2943940B2 (en) | Display / imaging device | |
| GB2273411A (en) | Video conferencing terminal | |
| JPH0497663A (en) | Visual line coincident type portrait image pickup device | |
| JP4089027B2 (en) | Bidirectional communication system, terminal device and control method | |
| JP2005229317A (en) | Image display system and imaging device | |
| JPH0481088A (en) | Coincident glance type figure picture display image pickup device | |
| JP2744394B2 (en) | Realism image display device and realism image input / output device | |
| JP3081377B2 (en) | 3D video phone | |
| EP3585053A1 (en) | Intercom door station, intercom system, control method, and program | |
| JP2859392B2 (en) | Eye-gaze type person image photographing device | |
| KR102201187B1 (en) | Stereo camera based twin camera module | |
| JPH0799644A (en) | Visual communication equipment | |
| CN214756700U (en) | 3D display device | |
| JPS63191120A (en) | Image pickup and projection device | |
| JPH07193796A (en) | Video communication system | |
| JP2010283550A (en) | Communication system, and communication device | |
| JPH01265685A (en) | Image pickup display device |