JPH09270792A - Multi-point video conference system - Google Patents

Multi-point video conference system

Info

Publication number
JPH09270792A
JPH09270792A JP8079221A JP7922196A JPH09270792A JP H09270792 A JPH09270792 A JP H09270792A JP 8079221 A JP8079221 A JP 8079221A JP 7922196 A JP7922196 A JP 7922196A JP H09270792 A JPH09270792 A JP H09270792A
Authority
JP
Japan
Prior art keywords
point
codec
video conference
sent
conference
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
JP8079221A
Other languages
Japanese (ja)
Other versions
JP3537583B2 (en
Inventor
Hiroo Jofu
浩男 上符
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Kyocera Corp
Original Assignee
Kyocera Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Kyocera Corp filed Critical Kyocera Corp
Priority to JP07922196A priority Critical patent/JP3537583B2/en
Publication of JPH09270792A publication Critical patent/JPH09270792A/en
Application granted granted Critical
Publication of JP3537583B2 publication Critical patent/JP3537583B2/en
Anticipated expiration legal-status Critical
Expired - Lifetime legal-status Critical Current

Links

Abstract

PROBLEM TO BE SOLVED: To easily provide a multi-point conference equipment by providing a 1st circuit connection means capable of communication of one to one terminal equipments at remote location, a 2nd circuit connection means for 1:N terminal equipment communication, and a transmission path revision means to the conference equipment. SOLUTION: A CODEC connecting to each point in terms of 1 to 1 relation through the use of an ISDN applies multiple address communication of information sent from a connection destination during utterance to other CODEC and sends the information received by multiple address communication to a connection destination so as to manage a multi-point conference. For example, let a point A be a chairman, and points B, C, D be participants, then a CODEC A1 is connected to the point B, a CODEC A2 is connected to the point C, and a CODEC A3 is connected to the point C respectively. When the point A makes utterance, the same video image is sent to the CODECs A1-3 and coded and sent to connection destination stations, the points B-D. Thus, each connecting point views the video image sent from the point A at the same time.

Description

【発明の詳細な説明】Detailed Description of the Invention

【0001】[0001]

【発明の属する技術分野】本発明は、ローカルエリアネ
ットワークに接続されている端末群とISDN回線に接
続されている端末群との送受信が制御される多地点テレ
ビ会議システムに関する。
BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a multipoint video conference system in which transmission / reception between a terminal group connected to a local area network and a terminal group connected to an ISDN line is controlled.

【0002】[0002]

【従来の技術】多地点テレビ会議は1対1の会議ではな
く複数の地点間を結びテレビ会議ができることから、有
用性が高く、複数のテレビ会議システムを回線を経由し
て接続し信号の伝送経路を切り替えることにより、同報
通信や多地点会議を実現する多地点会議制御装置( 以
下、MCU) が市場に投入されている。前記MCUは、
一般に2つの動作モードを有している。第1の動作モー
ドは、会議モードと呼ばれ、ある接続端末が発言する時
は、議長を担当する端末の制御もしくは発言音量の大小
により発言者となる端末をMCUが選択し、その発言者
の画像を他の参加接続端末に送り出す。他のモードは同
報モードと呼ばれ、予め決められた端末が主として発信
し、他の端末は特別に許可された場合を除き受信専用と
なる。従来技術によるMCUの構成では、複数の端末と
接続するための回線接続手段と、受信した信号を音声と
画像とデータに分離し、画像やデータは切替え装置によ
り選択し前記回線接続手段を介して接続された端末に送
信する。音声は通常合成手段により重ね合わせた後、前
記回線接続手段を介して接続された端末に送信する。接
続可能な最大端末数はその装置の構造に依存しており、
予め決められた装置数を越えて接続する場合はMCUを
一つの端末とみなしMCU同士を接続して、あたかも多
数の装置が接続されることになる。さらに、途中の回路
構成上、多くの切替え手段や、画像、音声、データの多
重分離合成回路を通るため、伝達の遅延時間が長くな
り、円滑な会議が進行できないという欠点があった。図
4に従列接続(カスケード接続)による接続地点数拡張
方法を、図5に階層接続による接続地点数拡張方法を示
す。また、多くの装置を単一装置内に接続しようとする
と、最大の接続数を処理する手段を有しておく必要があ
り、装置が大型化し、また、高価になるという欠点があ
った。
2. Description of the Related Art A multi-point video conference is highly useful because it enables a video conference by connecting a plurality of points rather than a one-to-one conference, and a plurality of video conference systems are connected via a line to transmit signals. A multipoint conference control unit (hereinafter referred to as MCU) that realizes a broadcast communication and a multipoint conference by switching the route has been put on the market. The MCU is
It generally has two modes of operation. The first operation mode is called a conference mode, and when a connected terminal speaks, the MCU selects the speaker's terminal by controlling the terminal in charge of the chair or the volume of the speaker, and the speaker Send images to other participating connected terminals. The other mode is called a broadcast mode, in which a predetermined terminal mainly makes a call, and the other terminal becomes a reception-only unless it is specifically permitted. In the structure of the MCU according to the prior art, a line connecting means for connecting to a plurality of terminals and a received signal are separated into voice, image and data, and the image and data are selected by a switching device and the line connecting means is used. Send to the connected terminal. The voice is usually superposed by the synthesizing means and then transmitted to the terminal connected through the line connecting means. The maximum number of terminals that can be connected depends on the structure of the device,
When connecting more than a predetermined number of devices, the MCUs are regarded as one terminal and the MCUs are connected to each other, and as if a large number of devices are connected. Further, due to the circuit configuration on the way, many switching means and image / voice / data demultiplexing / synthesizing circuits are involved, so that there is a drawback that the delay time of transmission becomes long and a smooth conference cannot proceed. FIG. 4 shows a method for expanding the number of connection points by cascade connection, and FIG. 5 shows a method for expanding the number of connection points by hierarchical connection. In addition, when many devices are to be connected in a single device, it is necessary to have a means for handling the maximum number of connections, which causes the device to be large and expensive.

【0003】[0003]

【発明が解決しようとする課題】上記従来技術は接続端
末数の増減に対し柔軟な構成を可能とする点について配
慮されておらず、その結果、複数のMCUを相互に接続
したり、想定される最大の接続端末数に見合った装置規
模を確保する必要があるため、情報の伝達や切替えに時
間がかかり、円滑な会議進行が妨げられたり、装置が大
型化したり、高価になるといった問題があった。
The above-mentioned prior art does not take into consideration the fact that a flexible configuration is possible with respect to an increase / decrease in the number of connected terminals, and as a result, a plurality of MCUs are connected to each other or are assumed. Since it is necessary to secure a device scale commensurate with the maximum number of connected terminals, it takes time to transfer and switch information, which hinders smooth conference proceedings, and makes the device large and expensive. there were.

【0004】[0004]

【課題を解決するための手段】本発明はこれらの課題を
解決するためのものであり、音声データおよび画像デー
タを送受信しうるテレビ会議用端末が複数地点に配置さ
れるとともに、ローカルエリアネットワークで接続され
ているテレビ会議用端末間で往来するデータの切換制御
を行なう多地点テレビ会議システムにおいて、一定の転
送レートを有する同期転送方式のディジタル回線に接続
され、1対1端末間の遠隔地間の通信を可能とする第1
の回線接続手段と、非同期転送方式のディジタル回線に
接続され、1対N(Nは1以上)端末間の通信を可能と
する第2の回線接続手段と、第1の回線接続手段と第2
の回線接続手段との伝達経路を変更可能とする伝達経路
変更手段とから構成されている多地点テレビ会議システ
ムを提供する。
SUMMARY OF THE INVENTION The present invention is to solve these problems, in which video conference terminals capable of transmitting and receiving voice data and image data are arranged at a plurality of points, and a local area network is used. In a multipoint video conference system that controls switching of data that flows between connected video conference terminals, a remote transfer between one-to-one terminals connected to a digital line of a synchronous transfer system having a constant transfer rate. First to enable communication
Second line connecting means, which is connected to the asynchronous transfer type digital line and enables communication between 1 to N (N is 1 or more) terminals, the first line connecting means, and the second line connecting means.
There is provided a multipoint video conference system including a transmission route changing unit capable of changing a transmission route to the line connecting unit.

【0005】[0005]

【発明の実施の形態】以下、本発明の実施例について図
面を用いて説明する。図1は本発明の多地点テレビ会議
システムのブロック図であり、図2は本発明の符号化復
号化装置のブロック図である。図1において、10は多
地点テレビ会議装置、11乃至13は符号化復号化装置
(コーデック)、20はテレビ会議システム、前記複数
のコーデック11乃至13はバス型のネットワーク14
を介して相互に接続されている。本実施例では業界標準
となっているイーサネットとしたが、このネットワーク
の種別はこれに限定されるものではない。図2におい
て、制御部30はコーデック11乃至13の動作状態を
制御する働きを持ち、画像入力部のビデオI/F31は
画像信号の入力・出力を受け持ち、音声入出力部のオー
ディオI/F32は音声信号の入力・出力を受け持ち、
画像符号化復号化部H.261の33は画像信号の圧縮
伸長を受け持ち、音声符号化復号化部34は音声信号の
圧縮伸長を受け持ち、パケット化部35は符号化情報を
バス型ネットワークに対し送信するためのパケット化
と、受信したパケットを元の符号化情報に戻す働きを
し、経路変更部36は、前記制御部30の指示により符
号化情報を転送する経路を切替える機能を持ち、多重化
部H221の37は符号化された画像情報、音声情報、
補助データを多重化したり、受信した多重化情報を画
像、音声、補助データ等に分離する働きを持ち、LAN
I/F38はパケット化された符号化情報を送受するイ
ンターフェースで、ISDNI/F39は公衆ディジタ
ル回線へのインターフェースである。前記複数のコーデ
ック11乃至13はオーディオ・ビデオセレクタ(以
下、AVS)15と接続され、映像音声情報を双方向に
伝送することが可能となっている。前記AVS15には
通常の人物や映像を映すTVカメラ1、書画を映すドキ
ュメントカメラ2等、複数の映像入力装置が接続されて
いて、複数のマイクロホン3接続が可能である。TVモ
ニタ4は複数台接続可能で、各コーデックに送る映像・
音声もしくは各コーデックから受け取った映像・音声を
選択して、あるいは合成して表示可能である。本装置の
運用に際しては、本装置に内蔵されたコーデックの台数
を越えない接続相手先と接続可能である。言い換える
と、本装置に内蔵されたコーデックのそれぞれが、接続
相手先と1対1でディジタル回線(ISDN)を介して
接続される。本来、多地点会議システムとは、複数の拠
点間を接続し会議を行う装置であり、発言者の映像を他
の拠点に送ることにより、会議を進行させる。本装置に
おいては、各拠点とISDNを用いて1対1で接続され
たコーデックが、発言中の接続先から送られてきた情報
を他のコーデックに同報通信し、その情報を同報で受け
取った情報を接続相手に送ることにより多地点会議を運
営する。具体的に述べると、拠点Aが議長役で、拠点
B、C、Dが参加者であるとし、本装置は議長役の拠点
に置かれているとする。また、本装置に内蔵されたコー
デックA1と拠点Bが、コーデックA2と拠点Cが、図
示していないコーデックA3と拠点Dがそれぞれ接続さ
れている。拠点Aが発言しているときは、コーデックA
1〜3には同じ映像が送られ、符号化されそれぞれの接
続相手局、拠点B〜Dに伝送される。そのため、各接続
拠点では拠点Aから送られた映像を同時に見ることが出
来る。拠点Bが発言する場合、拠点Bの映像はコーデッ
クBによって符号化され、1対1に接続された拠点Aの
コーデックA1に送られる。コーデックA1が受信した
符号化情報はバス型ネットワーク14を介して他の拠点
AのコーデックA2、A3に送られ、コーデックA2、
A3はそれぞれ1対1に接続された拠点C、Dのコーデ
ックに送られる。拠点Bにも送れば、自分自身の映像を
見ることが出来るが、議長役である拠点Aの映像を見る
ように符号化情報の流れを制御しても良い。情報の流れ
の制御方法を説明する。バス型のネットワークには、符
号化情報はパケットとして送られる。パケットの先頭に
は受取先と送り元を一意に示すアドレス情報が付加され
ており、先のアドレス情報としては、個別のアドレス情
報または複数のグループのアドレス情報、このネットワ
ークに接続された全ての装置を示すアドレス情報を記述
することが出来る。このネットワーク(LAN)は、広
域ネットワーク( WAN) 接続を実現するルーターを接
続し、遠隔地のネットワークと接続することも可能であ
る。各コーデックにおける信号の流れの制御情報は、マ
スターとなるコーデックから前記バス型のネットワーク
を経由して各スレーブとなるコーデックに伝達される。
図1においては、マスターはA1、スレーブはA2乃至
Anである。マスターとなるコーデックは、画像・音声
の入出力を制御するAVSと通信し、多地点会議装置の
全体の動作特性を決定する働きを有する。
Embodiments of the present invention will be described below with reference to the drawings. FIG. 1 is a block diagram of a multipoint video conference system of the present invention, and FIG. 2 is a block diagram of an encoding / decoding device of the present invention. In FIG. 1, 10 is a multipoint video conference device, 11 to 13 are encoding / decoding devices (codecs), 20 is a video conference system, and the plurality of codecs 11 to 13 are bus-type networks 14.
Connected to each other. In this embodiment, Ethernet which is the industry standard is used, but the type of this network is not limited to this. In FIG. 2, the control unit 30 has a function of controlling the operation states of the codecs 11 to 13, the video I / F 31 of the image input unit is responsible for input / output of the image signal, and the audio I / F 32 of the audio input / output unit is Responsible for input and output of audio signals,
Image encoding / decoding unit H.264 33 of 261 is responsible for compression / expansion of the image signal, the audio encoding / decoding unit 34 is responsible for compression / expansion of the audio signal, and the packetization unit 35 is for packetization for transmitting the encoded information to the bus network. The route changing unit 36 functions to return the received packet to the original encoded information, and the route changing unit 36 has a function of switching the route for transmitting the encoded information according to an instruction from the control unit 30, and 37 of the multiplexing unit H221 performs encoding. Image information, audio information,
It has the function of multiplexing auxiliary data and separating the received multiplexed information into images, audio, auxiliary data, etc.
The I / F 38 is an interface for transmitting and receiving packetized encoded information, and the ISDNI / F 39 is an interface for a public digital line. The plurality of codecs 11 to 13 are connected to an audio / video selector (hereinafter referred to as AVS) 15 and are capable of bidirectionally transmitting video / audio information. The AVS 15 is connected with a plurality of video input devices such as a TV camera 1 for displaying a normal person or video, a document camera 2 for displaying a document image, etc., and a plurality of microphones 3 can be connected. Multiple TV monitors 4 can be connected to send video to each codec.
It is possible to display by selecting or synthesizing audio or video / audio received from each codec. When operating this device, it is possible to connect to a connection destination that does not exceed the number of codecs built in this device. In other words, each of the codecs built in the device is connected to the connection destination one-to-one via the digital line (ISDN). Originally, a multipoint conference system is a device that connects a plurality of bases to hold a conference, and sends the video of the speaker to another base to advance the conference. In this device, a codec that is connected to each site on a one-to-one basis using ISDN broadcasts the information sent from the connection destination that is speaking to another codec and receives the information by the broadcast. Operates multipoint conferences by sending information to the other party. Specifically, it is assumed that the base A is the chairman and the bases B, C, and D are the participants, and that this device is located at the base of the chairman. Further, a codec A1 and a base B built in this apparatus, a codec A2 and a base C, and a codec A3 and a base D (not shown) are connected to each other. Code A when site A is speaking
The same video is sent to 1 to 3, encoded, and transmitted to each connection partner station and bases B to D. Therefore, at each connection site, the images sent from site A can be viewed at the same time. When the base B speaks, the video of the base B is encoded by the codec B and sent to the codec A1 of the base A connected one-to-one. The coded information received by the codec A1 is sent to the codecs A2 and A3 of the other site A via the bus network 14, and the codec A2,
A3 is sent to the codecs of the bases C and D, which are connected one-to-one. If you send it to the site B, you can see the video of yourself, but you may control the flow of the encoded information so that you can see the video of the site A that is the chairman. A method of controlling the flow of information will be described. The coded information is sent to the bus type network as packets. Address information that uniquely indicates the recipient and the sender is added to the beginning of the packet. As the destination address information, individual address information or address information of a plurality of groups, all devices connected to this network It is possible to describe address information indicating This network (LAN) can also be connected to a remote network by connecting a router that realizes a wide area network (WAN) connection. The control information of the signal flow in each codec is transmitted from the master codec to each slave codec via the bus type network.
In FIG. 1, the master is A1 and the slaves are A2 to An. The master codec has a function of communicating with an AVS that controls the input / output of images / voices and determining the overall operating characteristics of the multipoint conference apparatus.

【0006】[0006]

【発明の効果】以上のように、本発明は安価に作成でき
る通常のテレビ会議システムを局域ネットワーク(LA
N)を介して接続することにより簡単に多地点会議装置
を構成できる。また、各コーデックの制御や送信すべき
情報をLANを介して相互に送るため、それぞれのコー
デックは同一の場所にある必要は無く、広域ネットワー
ク(WAN)接続された遠隔地にあってもよい。そのた
め、従来困難であったISDN、LAN、WANが混在
するネットワーク上でも容易に多地点会議を実現でき、
利用者に対し多大な利益をもたらすという効果がある。
INDUSTRIAL APPLICABILITY As described above, according to the present invention, an ordinary video conference system that can be produced at a low cost is used as a local area network (LA
A multipoint conference device can be easily configured by connecting via N). Further, since the control of each codec and the information to be transmitted are mutually transmitted via the LAN, each codec does not need to be in the same place, and may be in a remote place connected to a wide area network (WAN). Therefore, it is possible to easily realize a multipoint conference even on a network where ISDN, LAN, and WAN are mixed, which was difficult in the past.
There is an effect that it brings great benefits to users.

【図面の簡単な説明】[Brief description of drawings]

【図1】 本発明による多地点テレビ会議システムの接
続状態を説明した図である。
FIG. 1 is a diagram illustrating a connection state of a multipoint video conference system according to the present invention.

【図2】 本発明による符号化復号化装置のブロック図
である。
FIG. 2 is a block diagram of an encoding / decoding device according to the present invention.

【図3】 従来の多地点テレビ会議システムの接続状態
を説明した図である。
FIG. 3 is a diagram illustrating a connection state of a conventional multipoint video conference system.

【図4】 従来の多地点テレビ会議接続装置のカスケー
ド接続を説明した図である。
FIG. 4 is a diagram illustrating a cascade connection of a conventional multipoint video conference connection device.

【図5】 従来の多地点テレビ会議システムの接続状態
を説明した図である。
FIG. 5 is a diagram illustrating a connection state of a conventional multipoint video conference system.

【符号の説明】[Explanation of symbols]

10 多地点テレビ会議装置 11、12、13 コーデック 14 ISDNネットワーク 31 ビデオI/F 32 オーディオI/F 33 H.261 10 multipoint video conference device 11, 12, 13 codec 14 ISDN network 31 video I / F 32 audio I / F 33 H.264 261

Claims (1)

【特許請求の範囲】[Claims] 【請求項1】音声データおよび画像データを送受信しう
るテレビ会議用端末が複数地点に配置されるとともに、
ローカルエリアネットワークで接続されているテレビ会
議用端末間との間で往来するデータの切換制御を行なう
多地点テレビ会議システムにおいて、一定の転送レート
を有する同期転送方式のディジタル回線に接続され、1
対1端末間の遠隔地間の通信を可能とする第1の回線接
続手段と、非同期転送方式のディジタル回線に接続さ
れ、1対N(Nは1以上)端末間の通信が行なわれる第
2の回線接続手段と、該第1の回線接続手段と該第2の
回線接続手段との伝達経路を変更可能とする伝達経路変
更手段とから構成されていることを特徴とする多地点テ
レビ会議システム。
1. A video conference terminal capable of transmitting and receiving voice data and image data is arranged at a plurality of points, and
In a multipoint video conference system that controls switching of data that flows between video conference terminals connected by a local area network, a multi-point video conference system is connected to a digital line of a synchronous transfer system having a constant transfer rate.
A first line connecting means for enabling communication between remote terminals between one-to-one terminals and a digital line of an asynchronous transfer system for communication between one-to-N terminals (where N is 1 or more). Multi-point video conferencing system, characterized in that the multi-point video conferencing system is comprised of a line connection means, and a transfer path changing means capable of changing a transfer path between the first line connecting means and the second line connecting means. .
JP07922196A 1996-04-01 1996-04-01 Multipoint video conference system Expired - Lifetime JP3537583B2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP07922196A JP3537583B2 (en) 1996-04-01 1996-04-01 Multipoint video conference system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP07922196A JP3537583B2 (en) 1996-04-01 1996-04-01 Multipoint video conference system

Publications (2)

Publication Number Publication Date
JPH09270792A true JPH09270792A (en) 1997-10-14
JP3537583B2 JP3537583B2 (en) 2004-06-14

Family

ID=13683871

Family Applications (1)

Application Number Title Priority Date Filing Date
JP07922196A Expired - Lifetime JP3537583B2 (en) 1996-04-01 1996-04-01 Multipoint video conference system

Country Status (1)

Country Link
JP (1) JP3537583B2 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2019532524A (en) * 2017-07-24 2019-11-07 ユープリズム カンパニー リミテッド Video conferencing server and method for providing multi-screen video conferencing using a plurality of video conferencing terminals

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2019532524A (en) * 2017-07-24 2019-11-07 ユープリズム カンパニー リミテッド Video conferencing server and method for providing multi-screen video conferencing using a plurality of video conferencing terminals

Also Published As

Publication number Publication date
JP3537583B2 (en) 2004-06-14

Similar Documents

Publication Publication Date Title
US5473363A (en) System, method and multipoint control unit for multipoint multimedia conferencing
US5936662A (en) Video conference control system using an integrated services digital network
EP0691779A2 (en) Multimedia conferencing system
JPH08279835A (en) Multimedia stream transfer method,voice control video conference device and data transfer equipment
US7453829B2 (en) Method for conducting a video conference
US6738356B1 (en) Object oriented video merging system
JP3207651B2 (en) Multipoint communication system and communication terminal
JPH0158899B2 (en)
JP2720857B2 (en) Multipoint video conference controller
EP0677962B1 (en) Peripheral unit for satellite multi-videoconferencing
JP3748952B2 (en) Multipoint connection network construction method and multipoint connection network system
WO1997011560A1 (en) Split bus architecture for multipoint control unit
JPH01241959A (en) Communication system between multi-point
JPH09270792A (en) Multi-point video conference system
JP2823571B2 (en) Distributed multipoint teleconferencing equipment
JPH09214923A (en) Multi-stop video conference system and additional video conference information display method
JPH0698030A (en) System and device for communication conference
JPH0965313A (en) Remote conference system
JPH09270791A (en) Multi-spot video conference system
JPH09149395A (en) Communication equipment
JPH1013804A (en) Multi-location video conference system
JPH07298229A (en) Communication method, communication system and terminal equipment
JPH03157044A (en) Multi-point conference system
KR100565185B1 (en) Video conferencing system
JPH10200871A (en) Video conference system

Legal Events

Date Code Title Description
A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20031216

A521 Written amendment

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20040216

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20040309

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20040317

R150 Certificate of patent or registration of utility model

Free format text: JAPANESE INTERMEDIATE CODE: R150

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20090326

Year of fee payment: 5

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20090326

Year of fee payment: 5

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20100326

Year of fee payment: 6

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20110326

Year of fee payment: 7

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20110326

Year of fee payment: 7

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20120326

Year of fee payment: 8

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20120326

Year of fee payment: 8

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20130326

Year of fee payment: 9