JPH04178685A - Display and image pickup device - Google Patents

Display and image pickup device

Info

Publication number
JPH04178685A
JPH04178685A JP2306267A JP30626790A JPH04178685A JP H04178685 A JPH04178685 A JP H04178685A JP 2306267 A JP2306267 A JP 2306267A JP 30626790 A JP30626790 A JP 30626790A JP H04178685 A JPH04178685 A JP H04178685A
Authority
JP
Japan
Prior art keywords
display
semi
transparent mirror
liquid crystal
pbs
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
JP2306267A
Other languages
Japanese (ja)
Other versions
JP3001251B2 (en
Inventor
Masato Kuriki
久力 真人
Hitoshi Arai
均 新井
Masato Nakamura
正人 中村
Hideki Nakajima
秀樹 中嶋
Shigenobu Sakai
酒井 重信
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nippon Telegraph and Telephone Corp
Original Assignee
Nippon Telegraph and Telephone Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nippon Telegraph and Telephone Corp filed Critical Nippon Telegraph and Telephone Corp
Priority to JP2306267A priority Critical patent/JP3001251B2/en
Publication of JPH04178685A publication Critical patent/JPH04178685A/en
Application granted granted Critical
Publication of JP3001251B2 publication Critical patent/JP3001251B2/en
Anticipated expiration legal-status Critical
Expired - Lifetime legal-status Critical Current

Links

Abstract

PURPOSE:To align the line of sight and to miniaturize a device by using a liquid crystal display composed of a liquid crystal panel and a polarizing plate installed on the rear of it and providing a half mirror having a function controlling the transmission and reflection of incident light according to the polarized state of the incident light. CONSTITUTION:In light from an object in the front of a polarizing beam splitter (PBS)2, only S-polarized light is reflected by the PBS 2. When this reflected light is imaged by this image pickup device 3, it is similar to that the imaging is carried out from the position of a display device. On the other hand, the PBS 2 has the function as a kind of polarizing plate because the PBS 2 transmits only P-polarized light, so that when the liquid crystal panel is used as the display device 1, the number of the polarizing plates 6 composing the liquid crystal display can be reduced. On the other hand, the PBS 2 has the function for serving both as the half mirror and the polarizing plate, so that reduction in a light transmitting quantity can be suppressed, and the reduction in the brightness of a display screen can be prevented.

Description

【発明の詳細な説明】 [産業上の利用分野] 本発明はTV電話やTV会議システム等に用いられる表
示装置と撮像装置との組合せからなる表示・撮像装置に
係り、特に、視線一致を実現し、かつ、装置の小型化を
図るとともに画質の向上を図ることのできる表示・撮像
装置に関する。
[Detailed Description of the Invention] [Industrial Application Field] The present invention relates to a display/imaging device that is a combination of a display device and an imaging device used in video telephones, video conference systems, etc. The present invention relates to a display/imaging device that is capable of reducing the size of the device and improving image quality.

[従来技術、発明が解決しようとする課題]近年、画像
符号化等通信技術の発展により遠隔地間を映像・音声通
信網で結んだTV電話やTV会議システム等の双方向映
像通信が急激に普及してきている。今後は、さらに、I
SDN網の充実と伝送網の高帯域化等によって、より臨
場感に溢れた映像サービスのできることが期待されてい
る。
[Prior Art and Problems to be Solved by the Invention] In recent years, with the development of communication technology such as image coding, two-way video communications such as video telephones and video conference systems that connect remote locations using video and audio communication networks have rapidly increased. It is becoming popular. In the future, I
It is expected that the enhancement of the SDN network and the increase in the bandwidth of the transmission network will make it possible to provide video services that are even more immersive.

第5図は現在双方向映像通信に用いられている表示・撮
像装置の概略構成を示した図で、撮像装置3がCRTデ
ィスプレイ等の表示装置1の上面または側面に設けられ
ており、使用者の撮像を行うことを示したものである。
FIG. 5 is a diagram showing a schematic configuration of a display/imaging device currently used for two-way video communication. This shows that images are taken.

しかし、このような装置を使用する場合、使用者は、通
常、表示装置を見ているため、撮像装置で撮像を行って
も撮像装置の方に視線を向けることがなく、折角臨場感
のある映像の送信が可能となっても、対話者同士の視線
が一致せず、自然な会話ができにくいという欠点があっ
た。
However, when using such a device, the user usually looks at the display device, so even if the image capture device captures an image, the user does not have to turn his/her line of sight toward the image capture device, which creates a sense of realism. Even if video transmission became possible, there was a drawback that the interlocutors could not see each other and it was difficult to have a natural conversation.

対話者同士の視線を一致させる方法として、半透鏡を用
いる方式がある。第6図は半透鏡を用い、表示装置とし
て液晶パネルを用いた表示・撮像装置の概略構成を示し
た図で、表示装置l、半透鏡2、撮像装置3、液晶パネ
ル5およびバックライト7からなることを示す。ここで
、表示装置1の、前方に半透鏡2が設置されており、被
写体からの像は半透鏡2で反射され、半透鏡2の上方に
ある撮像装置3によって撮像されることとなり、表示装
置1の位置から撮像したことと同等の効果が得られる。
One method of aligning the line of sight between interlocutors is to use a semi-transparent mirror. FIG. 6 is a diagram showing a schematic configuration of a display/imaging device using a semi-transparent mirror and a liquid crystal panel as a display device. show what will happen. Here, a semi-transparent mirror 2 is installed in front of the display device 1, and an image from the subject is reflected by the semi-transparent mirror 2 and is imaged by an imaging device 3 located above the semi-transparent mirror 2. The same effect as taking an image from position 1 can be obtained.

その結果、使用者の視線は表示装置1に向けられている
こととなるため、一方の通話者と表示画面に映しだされ
る他方の通話者との視線が一致することになる。
As a result, the user's line of sight is directed toward the display device 1, so that the lines of sight between one party and the other party displayed on the display screen match.

しかしなから、第6図のような構成の場合には、表示装
置1の画面サイズが大きくなるとともに半透鏡2のサイ
ズも大きくなり、そのため、奥行きdが大きくなる結果
となり、表示・撮像装置自体が大型のものになってしま
うという欠点があった。
However, in the case of the configuration shown in FIG. 6, as the screen size of the display device 1 increases, the size of the semi-transparent mirror 2 also increases, resulting in an increase in the depth d, and the display/imaging device itself becomes larger. The disadvantage was that it was too large.

本発明の目的は、上記従来技術の有していた課題を解決
して、視線一致を実現し、かつ、装置の小型化を図ると
ともに画質の向上を図ることのできる構成の表示・撮像
装置を提供することにある。
An object of the present invention is to provide a display/imaging device having a configuration that can solve the problems of the prior art described above, achieve line-of-sight alignment, reduce the size of the device, and improve image quality. It is about providing.

[課題を解決するための手段] 上記目的は、表示装置、撮像装置および半透鏡から構成
される装置 該半透鏡前方の被写体を該半透鏡からの反射像として該
半透鏡の周囲に設置した撮像装置により撮像を行う表示
・撮像装置において、上記表示装置として液晶パネルと
該液晶パネルの後方に設置した偏光板とからなる液晶デ
イスプレィを用い、上記半透鏡が入射光の偏光状態によ
り入射光の透過、反射を制御する機能を有する半透鏡(
偏光ビームスプリツタ:Polarizing Bea
m−Splitter,以下PBSと称する)である構
成の表示・撮像装置とすることによって達成することが
できる。
[Means for Solving the Problems] The above object is to provide an imaging device that is configured of a display device, an imaging device, and a semi-transparent mirror, and is installed around the semi-transparent mirror to capture an object in front of the semi-transparent mirror as a reflected image from the semi-transparent mirror. In a display/imaging device that captures an image, a liquid crystal display consisting of a liquid crystal panel and a polarizing plate installed behind the liquid crystal panel is used as the display device, and the semi-transparent mirror changes the transmission of incident light depending on the polarization state of the incident light. , a semi-transparent mirror with the function of controlling reflection (
Polarizing beam splitter: Polarizing Bea
This can be achieved by using a display/imaging device configured as an m-Splitter (hereinafter referred to as PBS).

また、上記PBSを微小PBSの複数個の組合せとする
ことによって、装置の小型化を図ることができるととも
に、液晶デイスプレィを構成する偏光板の枚数を減らす
ことができる。さらに、PBSの波長選択性を利用する
ことによって、カラーフィルターなしでカラー表示を行
うことができる。
Further, by using a combination of a plurality of micro PBSs as the PBS, it is possible to downsize the device and to reduce the number of polarizing plates constituting the liquid crystal display. Furthermore, by utilizing the wavelength selectivity of PBS, color display can be performed without a color filter.

[実施例] 以下、本発明の表示・撮像装置について実施例によって
具体的に説明する。
[Example] Hereinafter, the display/imaging device of the present invention will be specifically described using an example.

実施例 1 第1図は本発明表示・撮像装置の一実施例の概略構成を
示す図で、表示装置1、PBSからなる半透鏡2、撮像
装置3、液晶パネル5、液晶パネル5の後方に設けた偏
光板6およびバックライト7からなることを示す。なお
、図中θはPBS中の反射面の傾きの角度を示す。
Embodiment 1 FIG. 1 is a diagram showing a schematic configuration of an embodiment of the display/imaging device of the present invention, in which a display device 1, a semi-transparent mirror 2 consisting of a PBS, an imaging device 3, a liquid crystal panel 5, and a rear part of the liquid crystal panel 5 are shown. It is shown that it consists of a polarizing plate 6 and a backlight 7 provided. Note that θ in the figure indicates the angle of inclination of the reflective surface in the PBS.

ここで、PBS 2前方の被写体からの光はPBS 2
によりS偏光のみが反射されるされることになり、この
反射光を撮像装置3によって撮像すれば、表示装置の位
置から撮像したことと同等となる。また、PBS 2は
P偏光のみを透過するため一種の偏光板としての機能を
有しており、そのため、図に示すように表示装置lに液
晶パネルを用いると、液晶デイスプレィを構成する偏光
板6の数を減らすことができる。
Here, the light from the subject in front of PBS 2 is
Therefore, only the S-polarized light is reflected, and if this reflected light is imaged by the imaging device 3, it is equivalent to capturing the image from the position of the display device. In addition, since the PBS 2 transmits only P-polarized light, it has a function as a kind of polarizing plate. Therefore, when a liquid crystal panel is used for the display device l as shown in the figure, the polarizing plate 6 that constitutes the liquid crystal display can reduce the number of

従来構成の表示・撮像装置においては、光の透過量が偏
光板6によって約30%、半透鏡により約50%も減少
するため、表示画面の輝度が低下するが、本実施例構成
の装置においてはPBS 2が半透鏡と偏光板との機能
を兼ねることになるため、光の透過量の減少を抑えるこ
とが可能となり、表示画面の輝度低下を防ぐことができ
る。
In a display/imaging device with a conventional configuration, the amount of light transmitted is reduced by about 30% by the polarizing plate 6 and by about 50% by a semi-transparent mirror, resulting in a decrease in the brightness of the display screen, but in the device with the configuration of this embodiment, Since the PBS 2 functions as both a semi-transparent mirror and a polarizing plate, it is possible to suppress a decrease in the amount of transmitted light and prevent a decrease in the brightness of the display screen.

実施例 2 第2図は本発明の他の実施例、すなわち半透鏡として微
小、複数のPBSの組合せを用いた表示・撮像装置の半
透鏡の概略構成を示す断面図で、4は微小PBS、θは
微小PBS 4の反射面の傾きの角度を示す。
Embodiment 2 FIG. 2 is a sectional view showing a schematic configuration of a semi-transparent mirror of another embodiment of the present invention, that is, a display/imaging device using a combination of a plurality of micro PBSs as a semi-transparent mirror, and 4 is a micro PBS, θ indicates the angle of inclination of the reflective surface of the micro PBS 4.

このような構成の半透鏡とすることによって、図に示し
たように、入射光の内S偏光はある角度ψ方向に反射さ
れ、撮像装置はψ方向に設置されることになる。このよ
うな構成で、微小PBSの反射面の幅を小さくすること
が可能となり、半透鏡の厚さtを薄くすることができる
By using a semi-transparent mirror having such a configuration, as shown in the figure, the S-polarized light of the incident light is reflected at a certain angle in the ψ direction, and the imaging device is installed in the ψ direction. With such a configuration, it is possible to reduce the width of the reflective surface of the micro PBS, and the thickness t of the semi-transparent mirror can be reduced.

第3図は第2図の半透鏡を用いた場合の表示・撮像装置
の構成を示した図で、微小PBSで構成された半透鏡2
、撮像装置3、液晶パネル5、偏光板6およびバッグラ
イト7からなることを示す。
Figure 3 is a diagram showing the configuration of a display/imaging device when the semi-transparent mirror shown in Figure 2 is used.
, an imaging device 3, a liquid crystal panel 5, a polarizing plate 6, and a backlight 7.

第1図の場合と異なり、奥行きdを大幅に低減すること
ができるため、装置の小型化が実現できる。
Unlike the case shown in FIG. 1, since the depth d can be significantly reduced, the device can be made smaller.

実施例 3 第4図は本発明表示・撮像装置のさらに他の実施例の半
透鏡2と液晶パネル8の断面構成を示した図で、4は微
小PBS、8は第7図に示すカラーLCDの液晶パネル
からカラーフィルタを取り除いた白黒表示用液晶パネル
を示し、R,GおよびBは、それぞれ、赤色光、緑色光
および青色光のみを透過さぜる微小PBSを示している
Embodiment 3 FIG. 4 is a diagram showing a cross-sectional configuration of a semi-transparent mirror 2 and a liquid crystal panel 8 of still another embodiment of the display/imaging device of the present invention, where 4 is a micro PBS and 8 is a color LCD shown in FIG. The figure shows a monochrome display liquid crystal panel obtained by removing the color filter from the liquid crystal panel of 1995, and R, G, and B indicate minute PBSs that transmit only red light, green light, and blue light, respectively.

通常のカラー表示用液晶パネルではカラーフィルタを用
いて白色光を赤色、緑色および青色に対応する波長に分
解し、その光の透過率を制御することによってカラー表
示を行っているが、PBSでは、誘電多層膜のコーティ
ングが施しであるため、その多層膜でP偏光は透過、S
偏光は反射されることになる。しかし、多層膜の構成を
適切に決めることによって、偏光状態とともに波長の相
違により光の透過、反射をも制御することができる。
Normal liquid crystal panels for color display use color filters to separate white light into wavelengths corresponding to red, green, and blue, and display color by controlling the transmittance of the light. Since the dielectric multilayer film is coated, P polarized light is transmitted through the multilayer film, while S polarized light is transmitted through the multilayer film.
Polarized light will be reflected. However, by appropriately determining the structure of the multilayer film, it is possible to control the transmission and reflection of light based on the polarization state as well as the difference in wavelength.

そのため、本実施例の表示・撮像装置に用いた液晶デイ
スプレィにおいては、画素の一つ一つに、それぞれ、赤
色光のみ、緑色光のみおよび青色光のみを透過させる微
小PBSを配置することにより、微小PBSが偏光板の
みならずカラーフィルタをも兼ねるような構成にしであ
る。
Therefore, in the liquid crystal display used in the display/imaging device of this example, by arranging a micro PBS in each pixel that transmits only red light, only green light, and only blue light, The structure is such that the minute PBS serves not only as a polarizing plate but also as a color filter.

本実施例のような構成とすることによって、カラーフィ
ルタを用いることがないため、表示画面の輝度を大幅に
改善することができる。
With the configuration of this embodiment, since no color filter is used, the brightness of the display screen can be significantly improved.

[発明の効果] 以」二連べてきたように、TV電話やTV会議システム
等に用いられる表示・撮像装置を本発明構成の装置とす
ることによって、従来技術の有していた課題を解決して
、視線一致を実現し、かつ、装置の小型化を図るととも
に画質の向上を図ることのできる構成の表示・撮像装置
を提供することができた。
[Effects of the Invention] As mentioned above, the problems of the prior art can be solved by using a display/imaging device configured according to the present invention for use in video telephones, video conference systems, etc. As a result, it was possible to provide a display/imaging device configured to achieve line-of-sight alignment, miniaturize the device, and improve image quality.

すなわち、半透鏡にPBSを用いることによって、表示
装置に液晶デイスプレィを用いる場合には液晶デイスプ
レィを構成する偏光板の枚数を減らすことができ、その
結果液晶デイスプレィの実質的な輝度を上げることがで
き、さらに、微小PBSを複数組み合わせることによっ
て、装置の小型化を図ることができた。また、上記微小
PBSが波長選択性を有していることによって、カラー
フィルタなしでカラー表示を行うことができ、その結果
、通常のカラー液晶デイスプレィに比べ、輝度を大幅に
改善することができた。
That is, by using PBS for the semi-transparent mirror, when a liquid crystal display is used as a display device, the number of polarizing plates constituting the liquid crystal display can be reduced, and as a result, the substantial brightness of the liquid crystal display can be increased. Furthermore, by combining multiple micro PBSs, it was possible to downsize the device. In addition, because the micro PBS has wavelength selectivity, color display can be performed without a color filter, and as a result, brightness can be significantly improved compared to ordinary color liquid crystal displays. .

【図面の簡単な説明】[Brief explanation of drawings]

第1図は本発明表示・撮像装置の一実施例の概略構成を
示す図、第2図は本発明表示・撮像装置の他の実施例の
微小PBSからなる半透鏡の概略構成を示す断面図、第
3図は第2図の半透鏡を用いた場合の表示・撮像装置の
構成を示す図、第4図は本発明表示・撮像装置のさらに
他の実施例の半透鏡と液晶パネルの断面構成を示す図、
第5図は従来の表示・撮像装置の概略構成を示す図、第
6図は半透鏡を用い、表示装置として液晶パネルを用い
た表示・撮像装置の概略構成を示す図、第7図はカラー
LCDの液晶パネルの概略構成を示す図である。 1・・・表示装置、   2・・・半透鏡、3・・・撮
像装置、  4・・・微小PBS、5・・・液晶パネル
、  6・・・偏光板、7・・バックライト、8・・・
白黒表示用液晶パネル。 特許出願人 日本電信電話株式会社
FIG. 1 is a diagram showing a schematic configuration of one embodiment of the display/imaging device of the present invention, and FIG. 2 is a sectional view showing the schematic configuration of a semi-transparent mirror made of a micro PBS of another embodiment of the display/imaging device of the present invention. , FIG. 3 is a diagram showing the configuration of a display/imaging device using the semi-transparent mirror shown in FIG. 2, and FIG. 4 is a cross-section of the semi-transparent mirror and liquid crystal panel of still another embodiment of the display/imaging device of the present invention. A diagram showing the configuration,
Fig. 5 is a diagram showing a schematic configuration of a conventional display/imaging device, Fig. 6 is a diagram showing a schematic configuration of a display/imaging device using a semi-transparent mirror and a liquid crystal panel as a display device, and Fig. 7 is a color 1 is a diagram showing a schematic configuration of a liquid crystal panel of an LCD. DESCRIPTION OF SYMBOLS 1... Display device, 2... Semi-transparent mirror, 3... Imaging device, 4... Micro PBS, 5... Liquid crystal panel, 6... Polarizing plate, 7... Backlight, 8...・・・
LCD panel for black and white display. Patent applicant Nippon Telegraph and Telephone Corporation

Claims (1)

【特許請求の範囲】 1、表示装置、撮像装置および半透鏡から構成され、表
示装置の前面に半透鏡を設置し、該半透鏡前方の被写体
を該半透鏡からの反射像として該半透鏡の周囲に設置し
た撮像装置により撮像を行う表示・撮像装置において、
上記表示装置として液晶パネルと該液晶パネルの後方に
設置した偏光板とからなる液晶ディスプレイを用い、上
記半透鏡が入射光の偏光状態により入射光の透過、反射
を制御する機能を有する半透鏡であることを特徴とする
表示・撮像装置。 2、上記半透鏡が上記機能を有する半透鏡の複数個の組
合せからなる半透鏡であることを特徴とする特許請求の
範囲第1項記載の表示・撮像装置。 3、上記半透鏡が光の波長選択性を有する半透鏡である
ことを特徴とする特許請求の範囲第2項記載の表示・撮
像装置。
[Claims] 1. Consisting of a display device, an imaging device, and a semi-transparent mirror, the semi-transparent mirror is installed in front of the display device, and a subject in front of the semi-transparent mirror is used as a reflected image from the semi-transparent mirror. In display/imaging devices that capture images using imaging devices installed around them,
A liquid crystal display consisting of a liquid crystal panel and a polarizing plate installed behind the liquid crystal panel is used as the display device, and the semi-transparent mirror is a semi-transparent mirror that has a function of controlling transmission and reflection of incident light depending on the polarization state of the incident light. A display/imaging device characterized by the following. 2. The display/imaging device according to claim 1, wherein the semi-transparent mirror is a semi-transparent mirror made up of a combination of a plurality of semi-transparent mirrors having the above functions. 3. The display/imaging device according to claim 2, wherein the semi-transparent mirror is a semi-transparent mirror having wavelength selectivity of light.
JP2306267A 1990-11-14 1990-11-14 Display / imaging device Expired - Lifetime JP3001251B2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2306267A JP3001251B2 (en) 1990-11-14 1990-11-14 Display / imaging device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2306267A JP3001251B2 (en) 1990-11-14 1990-11-14 Display / imaging device

Publications (2)

Publication Number Publication Date
JPH04178685A true JPH04178685A (en) 1992-06-25
JP3001251B2 JP3001251B2 (en) 2000-01-24

Family

ID=17955027

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2306267A Expired - Lifetime JP3001251B2 (en) 1990-11-14 1990-11-14 Display / imaging device

Country Status (1)

Country Link
JP (1) JP3001251B2 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2010166292A (en) * 2009-01-15 2010-07-29 Nippon Telegr & Teleph Corp <Ntt> Method for displaying and capturing image, device for displaying and capturing image, and remote interactive device

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2010166292A (en) * 2009-01-15 2010-07-29 Nippon Telegr & Teleph Corp <Ntt> Method for displaying and capturing image, device for displaying and capturing image, and remote interactive device

Also Published As

Publication number Publication date
JP3001251B2 (en) 2000-01-24

Similar Documents

Publication Publication Date Title
US8593503B2 (en) Videoconferencing terminal and method of operation thereof to maintain eye contact
JP3892130B2 (en) LCD projector
GB2273411A (en) Video conferencing terminal
JPH04213287A (en) Display and image pickup device
JP3122531B2 (en) Display / imaging device
JP2859414B2 (en) Display / imaging device
JP3001251B2 (en) Display / imaging device
JP2526652B2 (en) Liquid crystal projection type stereoscopic display device
JP2645076B2 (en) Eye-gaze videophone
JP3062238B2 (en) Display / imaging device
JP3209790B2 (en) Display / imaging device
JPS6159989A (en) Video device
JPH06269002A (en) Display image pickup device
JP3058369B2 (en) Display / imaging device
JP3087915B2 (en) Display / imaging device
JPH04223688A (en) Display and image pickup device
JP3805156B2 (en) 3D image display device
JP2005094386A (en) Imaging display device
JPH08340520A (en) Video equipment
JPS63240283A (en) Video transmitter/receiver
JP3006726B2 (en) Display / imaging device
JP3122529B2 (en) Display / imaging device
JP3122543B2 (en) Display / imaging device
JP2859417B2 (en) Display / imaging device
JPH04154289A (en) Display/camera apparatus

Legal Events

Date Code Title Description
FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20071112

Year of fee payment: 8

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20081112

Year of fee payment: 9

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20091112

Year of fee payment: 10

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20101112

Year of fee payment: 11

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20101112

Year of fee payment: 11

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20111112

Year of fee payment: 12

EXPY Cancellation because of completion of term
FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20111112

Year of fee payment: 12