JPH01170280A - Solid-state image pickup device - Google Patents

Solid-state image pickup device

Info

Publication number
JPH01170280A
JPH01170280A JP62327420A JP32742087A JPH01170280A JP H01170280 A JPH01170280 A JP H01170280A JP 62327420 A JP62327420 A JP 62327420A JP 32742087 A JP32742087 A JP 32742087A JP H01170280 A JPH01170280 A JP H01170280A
Authority
JP
Japan
Prior art keywords
charge
signal
transfer means
vertical
period
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
JP62327420A
Other languages
Japanese (ja)
Inventor
Tadashi Nagai
正 永井
Tatsuki Ide
井手 達樹
Omichi Tanaka
田中 大通
Toshiya Fujii
俊哉 藤井
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Panasonic Holdings Corp
Original Assignee
Matsushita Electric Industrial Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Matsushita Electric Industrial Co Ltd filed Critical Matsushita Electric Industrial Co Ltd
Priority to JP62327420A priority Critical patent/JPH01170280A/en
Publication of JPH01170280A publication Critical patent/JPH01170280A/en
Pending legal-status Critical Current

Links

Landscapes

  • Solid State Image Pick-Up Elements (AREA)
  • Transforming Light Signals Into Electric Signals (AREA)

Abstract

PURPOSE:To obtain n-time zoom effect momentarily without using a zoom lens having a complicated mechanism by using an output of a solid-state image pickup element driven by the specific drive method. CONSTITUTION:The 1st charge transfer means is applied during the vertical blanking period to transfer a signal charge 2 from a picture element 1 to a vertical transfer section 2 and the 2nd charge transfer means eliminates the signal charge corresponding to the picture elements being 1/4 of the total picture elements in the vertical direction after the 1st charge transfer means near the end of the same vertical blanking period. Then, a signal charge corresponding to the picture element of 1/2 of the total picture elements in the vertical direction at the center of the pattern to be zoomed in the succeeding vertical scanning period is transferred sequentially by the 3rd charge transfer means to the horizontal transfer section 3 intermittently at each other horizontal blacking period, the signal charge corresponding to the remaining 1/4 of the total vertical picture element is eliminated by the 4th electrode transfer means from the vicinity of the start of the succeeding vertical blanking period to the succeeding 1st charge transfer means. Thus, the double zoom effect is obtained simply by having only to interpolate the signal during the horizontal scanning period without the signal charge.

Description

【発明の詳細な説明】 (産業上の利用分野) 本発明は、電子ズーム機能を有する固体撮像装置に関す
るものである。
DETAILED DESCRIPTION OF THE INVENTION (Field of Industrial Application) The present invention relates to a solid-state imaging device having an electronic zoom function.

(従来の技術) 従来の撮像装置のズーム機能は、光学的手法が用いられ
ており、ズーム効果を得るためには、複雑なカム機構を
用いたズームレンズを必要とする。
(Prior Art) The zoom function of conventional imaging devices uses an optical method, and in order to obtain a zoom effect, a zoom lens using a complicated cam mechanism is required.

(発明が解決しようとする問題点)  。(Problem that the invention seeks to solve).

しかしながら、上記ズームレンズを用いたズーム装置の
場合、レンズを移動させる時間が必要であるため、瞬間
的なズーム効果を得ることが困難であるとともに、近年
、ビデオカメラに望まれて′いる。小型軽量化、低価格
化に対して、大きな問題点となっている。
However, in the case of a zoom device using the above-mentioned zoom lens, it is difficult to obtain an instantaneous zoom effect because it requires time to move the lens, and in recent years, such a zoom device has been desired for video cameras. This has become a major problem in terms of miniaturization, weight reduction, and cost reduction.

(問題点を解決するための手段) 本発明は、上記問題点に鑑み、以ドに示す構成を設ける
ことによって、簡易な方法で、しかも瞬間的なズーム機
能を持たせた固体撮像装置を提供するものである。
(Means for Solving the Problems) In view of the above problems, the present invention provides a solid-state imaging device having an instantaneous zoom function in a simple manner by providing the configuration shown below. It is something to do.

n倍のズームを行なう際に、まず、光in変換素子(画
素)から垂直転送部へ信号電荷を垂直帰線期間内に読み
出し、その後不必要な画素に対応した信号電荷を、垂直
帰線期間内に高速転送して除去し、その後垂直方向にズ
ームすべき画素に対応した信号電荷をn水平期間内に1
回ずつ間歇的に垂直転送し、その後残りの信号電荷を垂
直帰線期間内に高速転送して除去することによって垂直
転送部の出力は通常の場合のl / n垂直走査期間内
の信号がn水平走査線ごとに1垂直走査期間にわたって
出力される。この垂直転送段の出力を水平転送段に人力
し、水平帰線期間中に不必要な画素に対応する信号電荷
を高速転送して除去し、その後水平方向にズームすべき
画素に対応する信号電荷を通常の水平転送速度の1 /
 nの速度で電荷検出部(以ド出力部と略す)に転送し
、その後、残りの信号電荷をn−1/n水平期間で転送
し除去する。
When zooming by n times, first, signal charges are read out from the optical in conversion elements (pixels) to the vertical transfer section during the vertical retrace period, and then signal charges corresponding to unnecessary pixels are read out during the vertical retrace period. After that, the signal charge corresponding to the pixel to be zoomed in the vertical direction is transferred by 1 within n horizontal periods.
By performing vertical transfer intermittently and then removing the remaining signal charges by transferring them at high speed during the vertical retrace period, the output of the vertical transfer section is reduced to the normal l/n signal within the vertical scanning period. Each horizontal scanning line is output for one vertical scanning period. The output of this vertical transfer stage is sent to the horizontal transfer stage, and during the horizontal retrace period, signal charges corresponding to unnecessary pixels are transferred and removed at high speed, and then signal charges corresponding to pixels to be zoomed in the horizontal direction are removed. 1 / of the normal horizontal transfer rate
The signal charges are transferred to the charge detection section (hereinafter referred to as the output section) at a speed of n, and then the remaining signal charges are transferred and removed in a horizontal period of n-1/n.

上記のように駆動した固体撮像索子の出力は1通常の場
合の1 / n垂直及び水平走査期間内の信号がn水平
走査線ごとに1垂直走査期間にわたって出力される形と
なる。その後遅延線を用いて、信号が出力されていない
水平走査線部分に信号を補間するだけで、垂直水平方向
ともにn倍にズームされた信号を得ることができる。
The output of the solid-state imaging probe driven as described above is such that a signal within 1/n vertical and horizontal scanning periods in the normal case is outputted over one vertical scanning period every n horizontal scanning lines. Thereafter, by simply using a delay line to interpolate a signal to a horizontal scanning line portion where no signal is output, a signal zoomed by n times in both the vertical and horizontal directions can be obtained.

(作 用) 本発明は、上述した駆動方法で駆動した固体撮像索子の
出力を用いることにより、容易に垂直・水平方向ともに
n倍に拡大された映像信号を得ることが出来るので、複
雑な機構を有するズームレンズを用いることなしに、し
かも瞬間的にn倍のズーム効果を得ることがnJ能とな
る。
(Function) The present invention makes it possible to easily obtain a video signal magnified by n times in both the vertical and horizontal directions by using the output of the solid-state imaging probe driven by the driving method described above. The nJ function is to instantaneously obtain an n-fold zoom effect without using a zoom lens with a mechanism.

(実施例) 以ドに、本発明を用いた画面中央部の2倍ズーム機能を
有する固体撮像装置について、実施例により図面を用い
て詳細に説明する。
(Example) Hereinafter, a solid-state imaging device according to the present invention having a double zoom function in the center of the screen will be described in detail by way of an example with reference to the drawings.

第1図は、本発明の一実施例に用いるインターライン型
CCL)固体撮像索子の構成図であり、1は光電変換素
子、2は垂直転送部、3は水平転送部、4は信号電荷検
出部である。
FIG. 1 is a configuration diagram of an interline type CCL) solid-state imaging probe used in an embodiment of the present invention, in which 1 is a photoelectric conversion element, 2 is a vertical transfer section, 3 is a horizontal transfer section, and 4 is a signal charge This is the detection part.

第2図は、第1図の固体撮像素子を駆動する本発明の一
実施例の駆動信号のタイミングチャートであり、第3図
は第2図のA−A’部のタイムスチールを拡大したタイ
ミングチャートであり、(、)は、複合帰線消去信号、
(b)は、1の光電変換素子(以ド画素と略す)から2
の垂直転送部へ信号電荷を読み出す読み出し信号(以ド
第1の電荷転送手段とする。)、(c)は2の垂直転送
部を駆動する第2.第3.第4の電荷転送手段からなる
垂直駆動信号、(d)は3の水平転送部を駆動する第5
゜第6.第7の電荷転送手段からなる水平駆動信号、(
e)は、4の信号電荷検出部より出力される出力(4号
である。
FIG. 2 is a timing chart of a drive signal according to an embodiment of the present invention that drives the solid-state image sensor shown in FIG. is a chart, where (,) is the composite blanking signal,
(b) is from 1 photoelectric conversion element (hereinafter abbreviated as pixel) to 2
A readout signal (hereinafter referred to as the first charge transfer means) reads the signal charge to the vertical transfer section of 2.(c) is a read signal for reading the signal charge to the vertical transfer section of 2. Third. The vertical drive signal consisting of the fourth charge transfer means, (d) is the fifth signal that drives the third horizontal transfer section.
゜6th. A horizontal drive signal consisting of the seventh charge transfer means, (
e) is the output (No. 4) output from the signal charge detection section No. 4.

第1の電荷転送手段5を垂直帰線期間内に印加すること
によって画素1から、垂直転送部2へと4g J+電荷
が転送される。そして第1の電荷転送手段5の後から同
一の垂直帰線期間の終端近傍までの間に不必要な垂直方
向総画素の1/4の画素に対応した信号電荷を高速転送
して除去するための第2の電荷転送手段6で垂直方向総
画素の174の画素に対応した信号電荷を除去する。そ
してその後続く垂直走査期間内は、ズームすべき画面中
央の垂直方向総画素の172の画素に対応した信号電荷
を1水平帰線期間おきに間歇的に水平転送部3の方向へ
第3の電荷転送手段7によって順次転送する。
By applying the first charge transfer means 5 during the vertical retrace period, 4g J+ charges are transferred from the pixel 1 to the vertical transfer section 2. Then, in order to transfer and remove unnecessary signal charges corresponding to 1/4 of the total pixels in the vertical direction from after the first charge transfer means 5 to near the end of the same vertical blanking period by high-speed transfer. The second charge transfer means 6 removes signal charges corresponding to 174 pixels of the total vertical pixels. Then, during the subsequent vertical scanning period, the signal charges corresponding to 172 pixels of the total vertical pixels at the center of the screen to be zoomed are intermittently transferred to the third charge in the direction of the horizontal transfer unit 3 every horizontal retrace period. The transfer means 7 sequentially transfers the data.

そして、垂直方向総画素の残りの1/4に対応した信号
電荷を、続く垂直帰線期間の始端近傍から次の第1の電
荷転送手段が印加されるまでの間で、第4の電荷転送手
段8によって除去する0以上のように垂直転送部2の駆
動を行うことにより。
Then, the signal charges corresponding to the remaining 1/4 of the total pixels in the vertical direction are transferred to the fourth charge transfer from the vicinity of the start of the subsequent vertical retrace period until the next first charge transfer means is applied. By driving the vertical transfer section 2 in such a way that zero or more are removed by the means 8.

垂直画面中央部1/2の画素に対する信号電荷が、1水
平帰線期間おきに1垂直走査期間にわたって水平転送部
3に転送される。
Signal charges for pixels in the center 1/2 of the vertical screen are transferred to the horizontal transfer unit 3 over one vertical scanning period every one horizontal retrace period.

そして、第3の電荷転送手段7が印加された後から、同
一の水平帰線期間の終端近傍までの間に、水平方向総画
素の1/4に対応した信号電荷を第5の電荷転送手段9
によって高速転送を行い除去する。その後、続く水平走
査期間内は水平方向総画素の172に対応した信号電荷
を、第6の電荷転送手段10で、通常の1/2の速度で
電荷検出部4に向けて水平転送部3内を転送し出力信号
として取りだす、その後、続く水平帰線期間の始端近傍
から次の第3の電荷転送手段7が印加されるまでの間に
残りの水平、方向総画鋼の1/4に対応した信号電荷を
、第7の電荷転送手段11で除去する。
Then, after the third charge transfer means 7 applies the signal until near the end of the same horizontal retrace period, the signal charges corresponding to 1/4 of the total pixels in the horizontal direction are transferred to the fifth charge transfer means. 9
Perform high-speed transfer and remove. Thereafter, during the subsequent horizontal scanning period, the signal charges corresponding to 172 of the total pixels in the horizontal direction are transferred into the horizontal transfer unit 3 by the sixth charge transfer means 10 toward the charge detection unit 4 at half the normal speed. Thereafter, from near the beginning of the subsequent horizontal retrace period until the next third charge transfer means 7 is applied, the charge corresponds to 1/4 of the total horizontal and directional image steel. The signal charge is removed by the seventh charge transfer means 11.

以上のように固体撮像素子の垂直転送部2及び水平転送
部3を駆動することによって、画面中央部1/2の画素
に対する信号電荷が1水平走査期間おきに1垂直走査期
間にわたって、固体撮像素子の出力として得られる。そ
して信号電荷のない水平走査期間に信号を補間するだけ
で簡単に2倍のズーム効果が得られる。
By driving the vertical transfer section 2 and the horizontal transfer section 3 of the solid-state image sensor as described above, the signal charges for the pixels in the center 1/2 of the screen are transferred to the solid-state image sensor over one vertical scanning period every other horizontal scanning period. is obtained as the output of A double zoom effect can be easily obtained by simply interpolating the signal during the horizontal scanning period when there is no signal charge.

以上、説明したように本実施例によれば、機械的、光学
的な手段を用いずに電子的な方法によって瞬間的に2倍
のズーム効果を得ることが容易にできる。またn倍のズ
ーム効果及び、画面上の任意の点のズーム効果を得たい
場合でも本実施例と同様の方法を用いて実現することが
可能である。
As described above, according to this embodiment, it is possible to easily obtain a double zoom effect instantaneously using an electronic method without using mechanical or optical means. Furthermore, even when it is desired to obtain an n-times zoom effect or a zoom effect for any point on the screen, it is possible to achieve this using the same method as in this embodiment.

また、本実施例では、インターライン型CCDを固体撮
像素子として用いたが、フレームインターライン型CC
U、フレーレ菩積型CCL)を固体撮像素子として用い
た場合でも同様の効果が得られる。
In addition, in this example, an interline type CCD was used as a solid-state image sensor, but a frame interline type CCD
Similar effects can be obtained even when a Freire type CCL) is used as a solid-state image sensor.

(発明の効果) 以上、詳細な説明から明らかなように本発明は。(Effect of the invention) As is clear from the above detailed description, the present invention is as follows.

従来の機械的、光学的なズーム機能に対して、電子的に
かつ簡易にn倍のズーム効果を得ることが容易になり、
その効果は大なるものがある。
Compared to conventional mechanical and optical zoom functions, it is now easy to obtain an n-fold zoom effect electronically and easily.
The effect is great.

【図面の簡単な説明】[Brief explanation of the drawing]

第1図は本発明の一実施例で用いる固体撮像索子の構成
図、第2図は第1図の固体撮像素子を駆動する本発明の
一実施例のタイミングチャート、第3図は第2図の部分
拡大のタイミングチャートである。 1 ・・・光電変換素子、2・・・垂直転送部、3・・
・水平転送部、4 ・・・信号電荷検出部。 特許出願人 松下電器産業株式会社 −へn寸
FIG. 1 is a configuration diagram of a solid-state imaging device used in an embodiment of the present invention, FIG. 2 is a timing chart of an embodiment of the present invention that drives the solid-state imaging device of FIG. It is a timing chart of a partial enlargement of the figure. 1...Photoelectric conversion element, 2...Vertical transfer section, 3...
-Horizontal transfer section, 4...Signal charge detection section. Patent applicant: Matsushita Electric Industrial Co., Ltd.

Claims (1)

【特許請求の範囲】[Claims]  複数個の光電変換素子が二次元に配列される光電変換
部と同光電変換部に蓄積される信号電荷を垂直方向に転
送する垂直転送部と、同垂直転送部から転送される信号
電荷を水平方向に転送する水平転送部と、同水平転送部
から転送された信号電荷を信号電圧または信号電流に変
換して出力する信号電荷検出部とを少なくとも有する固
体撮像装置であって、垂直帰線期間内の任意の場所にお
いて前記光電変換素子から前記垂直転送部に信号電荷を
読み出す第1の電荷転送手段と、前記第1の電荷転送手
段の転送発生時点から垂直帰線期間の終端近傍までの間
に前記光電変換素子に対応した前記信号電荷の一部を高
速転送して除去する第2の電荷転送手段と、垂直走査期
間においては残りの前記光電変換素子に対応した前記信
号電荷の一部をn水平帰線期間内に間歇的に転送する第
3の電荷転送手段と、垂直帰線期間の始端近傍から前記
信号読み出し信号の発生以前までの間に、残りの前記光
電変換素子に対応した前記信号電荷を高速転送して除去
する第4の電荷転送手段と、前記水平転送部へ前記垂直
転送部から水平帰線期間内に信号電荷が前記第3の電荷
転送手段によって転送された後から水平帰線期間終端近
傍までの間に前記信号電荷の一部を高速転送して除去す
る第5の電荷転送手段と、続く水平走査期間においては
前記信号電荷の残りの一部を通常の水平転送周期よりも
遅い周期で転送する第6の電荷転送手段と、続く水平帰
線期間の始端近傍より垂直転送部から水平転送部へ信号
電荷が前記第3の電荷転送手段によって再び転送される
時刻までの間の任意の期間内で前記信号電荷の残りを転
送して除去する第7の電荷転送手段とを有することを特
徴とする固体撮像装置。
A photoelectric conversion section in which multiple photoelectric conversion elements are arranged two-dimensionally; a vertical transfer section that vertically transfers the signal charges accumulated in the photoelectric conversion section; and a vertical transfer section that transfers the signal charges transferred from the vertical transfer section horizontally. A solid-state imaging device having at least a horizontal transfer section that transfers the signal charge in the horizontal transfer section and a signal charge detection section that converts the signal charge transferred from the horizontal transfer section into a signal voltage or signal current and outputs the signal charge, the solid-state imaging device a first charge transfer means for reading out a signal charge from the photoelectric conversion element to the vertical transfer section at any location within the area; and a period from the time of transfer occurrence of the first charge transfer means to near the end of the vertical retrace period; a second charge transfer means that transfers and removes a portion of the signal charge corresponding to the photoelectric conversion element at high speed; and a second charge transfer means that transfers a portion of the signal charge corresponding to the remaining photoelectric conversion element during the vertical scanning period. a third charge transfer means that transfers the charge intermittently during the n horizontal retrace period; fourth charge transfer means for transferring and removing signal charges at high speed; a fifth charge transfer means that transfers and removes a portion of the signal charge at high speed until near the end of the retrace period, and transfers the remaining portion of the signal charge during the normal horizontal transfer period during the subsequent horizontal scanning period; The sixth charge transfer means transfers the signal charge at a slower period than the above period, and the signal charge is transferred from the vicinity of the start of the subsequent horizontal blanking period to the time when the signal charge is transferred again by the third charge transfer means from the vertical transfer section to the horizontal transfer section. and seventh charge transfer means for transferring and removing the remainder of the signal charge within an arbitrary period between.
JP62327420A 1987-12-25 1987-12-25 Solid-state image pickup device Pending JPH01170280A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP62327420A JPH01170280A (en) 1987-12-25 1987-12-25 Solid-state image pickup device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP62327420A JPH01170280A (en) 1987-12-25 1987-12-25 Solid-state image pickup device

Publications (1)

Publication Number Publication Date
JPH01170280A true JPH01170280A (en) 1989-07-05

Family

ID=18198964

Family Applications (1)

Application Number Title Priority Date Filing Date
JP62327420A Pending JPH01170280A (en) 1987-12-25 1987-12-25 Solid-state image pickup device

Country Status (1)

Country Link
JP (1) JPH01170280A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0477884A2 (en) * 1990-09-26 1992-04-01 Matsushita Electric Industrial Co., Ltd. Horizontal line interpolation circuit and image pickup apparatus including it
US7508426B2 (en) 2004-05-17 2009-03-24 Sony Corporation Image pickup device, and driving controlling method for solid-state imaging device

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS63232765A (en) * 1987-03-20 1988-09-28 Canon Inc Image pickup device

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS63232765A (en) * 1987-03-20 1988-09-28 Canon Inc Image pickup device

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0477884A2 (en) * 1990-09-26 1992-04-01 Matsushita Electric Industrial Co., Ltd. Horizontal line interpolation circuit and image pickup apparatus including it
EP0477884A3 (en) * 1990-09-26 1994-06-08 Matsushita Electric Ind Co Ltd Horizontal line interpolation circuit and image pickup apparatus including it
US7508426B2 (en) 2004-05-17 2009-03-24 Sony Corporation Image pickup device, and driving controlling method for solid-state imaging device

Similar Documents

Publication Publication Date Title
JPH01280977A (en) Method and apparatus for displaying slave picture of television system
JPH08331461A (en) Driving method for solid-state image pickup device
US7336305B2 (en) Solid-state image capturing device, smear correcting method thereof and digital still camera using the same
JP3854662B2 (en) Imaging device
JP3459738B2 (en) Imaging device
JPH01300685A (en) Drive method for solid-state image pickup element
JPH01170280A (en) Solid-state image pickup device
JP3905308B2 (en) Digital camera and operation control method thereof
JP2988095B2 (en) Solid-state imaging device
JP2799003B2 (en) Driving method of solid-state image sensor
JPS6259473A (en) Solid-state image pickup device
JPH09233394A (en) Image pickup device
JP2568594B2 (en) Solid-state imaging device
JP2000115643A (en) Drive method for solid-state image pickup device, the solid-state image pickup device, solid-state image pickup element and image pickup camera
JPH10200819A (en) Solid-state image pickup device, and its driving method and camera
JP2663621B2 (en) Solid-state imaging device
JP2666398B2 (en) Solid-state imaging device and driving method thereof
JPH02124685A (en) Frame inter-line type solid-state image pickup element and its driving method
JP3483899B2 (en) Electronic imaging device
JPH01157678A (en) Solid-state image pickup device
JP2618962B2 (en) Solid-state imaging device camera
JP4427538B2 (en) Digital camera and operation control method thereof
JP2005260411A (en) High sensitivity imaging apparatus
JP2001069405A (en) Drive method for solid-state image pickup unit and camera adopting it
JPH10257380A (en) Solid-state image-pickup device and camera using the same

Legal Events

Date Code Title Description
A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20040127

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20040302

A521 Written amendment

Effective date: 20040413

Free format text: JAPANESE INTERMEDIATE CODE: A523

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20040720

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20040723

R150 Certificate of patent (=grant) or registration of utility model

Free format text: JAPANESE INTERMEDIATE CODE: R150

FPAY Renewal fee payment (prs date is renewal date of database)

Year of fee payment: 3

Free format text: PAYMENT UNTIL: 20070813

FPAY Renewal fee payment (prs date is renewal date of database)

Free format text: PAYMENT UNTIL: 20080813

Year of fee payment: 4

FPAY Renewal fee payment (prs date is renewal date of database)

Free format text: PAYMENT UNTIL: 20090813

Year of fee payment: 5

FPAY Renewal fee payment (prs date is renewal date of database)

Year of fee payment: 6

Free format text: PAYMENT UNTIL: 20100813

FPAY Renewal fee payment (prs date is renewal date of database)

Free format text: PAYMENT UNTIL: 20110813

Year of fee payment: 7

FPAY Renewal fee payment (prs date is renewal date of database)

Free format text: PAYMENT UNTIL: 20110813

Year of fee payment: 7

FPAY Renewal fee payment (prs date is renewal date of database)

Year of fee payment: 8

Free format text: PAYMENT UNTIL: 20120813

FPAY Renewal fee payment (prs date is renewal date of database)

Free format text: PAYMENT UNTIL: 20120813

Year of fee payment: 8

FPAY Renewal fee payment (prs date is renewal date of database)

Year of fee payment: 9

Free format text: PAYMENT UNTIL: 20130813

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250