JP2003298919A - Digital camera - Google Patents

Digital camera

Info

Publication number
JP2003298919A
JP2003298919A JP2002096976A JP2002096976A JP2003298919A JP 2003298919 A JP2003298919 A JP 2003298919A JP 2002096976 A JP2002096976 A JP 2002096976A JP 2002096976 A JP2002096976 A JP 2002096976A JP 2003298919 A JP2003298919 A JP 2003298919A
Authority
JP
Japan
Prior art keywords
lens
image
image pickup
ccd
zoom
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
JP2002096976A
Other languages
Japanese (ja)
Other versions
JP4068869B2 (en
Inventor
Michitaka Nakazawa
通隆 中沢
Mitsufumi Misawa
充史 三沢
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Fujifilm Holdings Corp
Original Assignee
Fuji Photo Film Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Fuji Photo Film Co Ltd filed Critical Fuji Photo Film Co Ltd
Priority to JP2002096976A priority Critical patent/JP4068869B2/en
Publication of JP2003298919A publication Critical patent/JP2003298919A/en
Application granted granted Critical
Publication of JP4068869B2 publication Critical patent/JP4068869B2/en
Anticipated expiration legal-status Critical
Expired - Fee Related legal-status Critical Current

Links

Landscapes

  • Cameras In General (AREA)
  • Structure And Mechanism Of Cameras (AREA)
  • Studio Devices (AREA)

Abstract

<P>PROBLEM TO BE SOLVED: To provide a digital camera provided with a plurality of photographing optical systems and imaging elements for realizing high magnification zooming without interruption and upsizing. <P>SOLUTION: The digital camera has two kinds of modes comprising: a telescope zoom mode for processing an image obtained by composing high quality image information with a small field angle and possible for optical zooming obtained by a combination of a first CCD 30 with a small size and high pixel density, a zoom lens 12, a second CCD 32 with a large size and low pixel density, and a lens 14, and low quality image information with a large field angle by an image interpolation means; and a wide angle zoom mode for processing an image obtained by composing high quality image information with a small field angle obtained by a combination of the first CCD 30 and the lens 14 and the zoom lens 12 and the second CCD 32 and low quality image information with a large field angle and possible for optical zooming by the image interpolation means 38. Each mode can be selected by selecting an optical path from each lens to each CCD to change the combination of the lenses and the CCDs. <P>COPYRIGHT: (C)2004,JPO

Description

【発明の詳細な説明】Detailed Description of the Invention

【0001】[0001]

【発明の属する技術分野】本発明はデジタルカメラに関
するものである。
TECHNICAL FIELD The present invention relates to a digital camera.

【0002】[0002]

【従来の技術】従来、撮影レンズを交換できない所謂レ
ンズ固定式カメラでは、撮影領域を拡大するためには高
倍率のズームレンズを搭載する必要があったが、レンズ
の構成枚数が多くなり、レンズの全長と重量が増加し、
開放F値が暗く、光学性能も劣化するといった問題があ
った。
2. Description of the Related Art Conventionally, in a so-called fixed lens type camera in which the photographing lens cannot be exchanged, it was necessary to mount a high-power zoom lens in order to enlarge the photographing area. The overall length and weight of the
There are problems that the open F value is dark and the optical performance is deteriorated.

【0003】そのため、一本のズームレンズではなくズ
ーム機能を持つ複数の光学系を備え、切替えを行ない撮
影領域を拡大するものが考案されている。
For this reason, there has been devised a system in which a plurality of optical systems having a zoom function are provided instead of a single zoom lens, and switching is performed to enlarge a photographing area.

【0004】また、単一の光学系とサイズの異なる複数
の撮像素子を備え、撮像素子を切替えて撮影領域を拡大
するものも考案されているしかし、いずれもレンズまた
は撮像素子を切替えて画角を変えるものであり、連続し
て切れ目なく撮影領域を変化させることはできない。
Further, there has been devised a device which has a single optical system and a plurality of image pickup devices of different sizes, and which switches the image pickup device to enlarge the photographing area. The shooting area cannot be changed continuously and continuously.

【0005】[0005]

【発明が解決しようとする課題】本発明は上記事実を考
慮して、複数の撮影光学系および撮像素子を備えたデジ
タルカメラにおいて装置の大型化を招かずに連続して切
れ目のない高倍率ズームを実現することを課題とする。
SUMMARY OF THE INVENTION In consideration of the above facts, the present invention is a digital camera equipped with a plurality of photographing optical systems and image pickup devices, and has a high-magnification zoom that is continuous and continuous without increasing the size of the apparatus. The challenge is to achieve.

【0006】[0006]

【課題を解決するための手段】請求項1に記載のデジタ
ルカメラは、第1の撮像素子と、前記第1の撮像素子よ
りサイズが大きく画素密度が低い第2の撮像素子と、ズ
ームレンズである第1の撮影レンズと、単焦点レンズで
ある第2の撮影レンズと、前記第1の撮影レンズを通っ
た光を前記第1の撮像素子または前記第2の撮像素子
へ、あるいは前記第2の撮影レンズを通った光を前記第
1の撮像素子または前記第2の撮像素子へ導く光路切替
手段と、前記光路切替手段を操作して前記第1の撮像素
子及び前記第2の撮像素子から得られる画像情報を要求
される画質によって使い分ける画像補完手段と、を備
え、前記第2の撮影レンズの焦点距離が前記第1のズー
ムレンズの焦点距離範囲内にあり、かつ前記第1のズー
ムレンズの短焦点側端および長焦点側端の焦点距離と前
記第2のレンズの焦点距離との比がともに前記第1の撮
像素子と第2の撮像素子の対角線長比より小さいことを
特徴とする上記構成の発明では、サイズが小さく画素密
度が高い第1撮像素子とズームレンズである第1撮影レ
ンズ、サイズが大きく画素密度が低い第2撮像素子と単
焦点レンズである第2撮影レンズの組合せによって得ら
れる、画角が小さく光学ズーム可能な高画質画像情報
と、画角が大きい低画質画像情報とを画像補完手段で合
成して得られる画像による望遠ズームモードを実現でき
る。また、サイズが小さく画素密度が高い第1撮像素子
と単焦点レンズである第2撮影レンズ、サイズが大きく
画素密度が低い第2撮像素子とズームレンズである第1
撮影レンズの組み合わせによって得られる、画角が小さ
い高画質画像情報と、画角が大きく光学ズーム可能な低
画質画像情報とを画像補完手段で合成して得られる画像
による広角ズームモードを実現できる。すなわち、上記
構成では望遠領域を光学ズームでカバーした望遠ズーム
モードと広角領域を光学ズームでカバーした広角ズーム
モードの2種類のモードが選択出来る。
According to a first aspect of the present invention, there is provided a digital camera including a first image pickup device, a second image pickup device which is larger in size than the first image pickup device and has a lower pixel density, and a zoom lens. A certain first photographing lens, a second photographing lens which is a single focus lens, and light passing through the first photographing lens to the first image pickup element or the second image pickup element, or the second image pickup element. Optical path switching means for guiding the light passing through the photographing lens to the first image sensor or the second image sensor, and the optical path switch means to operate the first image sensor and the second image sensor. Image complementing means for selectively using the obtained image information according to the required image quality, the focal length of the second photographing lens is within the focal length range of the first zoom lens, and the first zoom lens Short focus side edge of And the ratio of the focal length of the long focal length side end to the focal length of the second lens is smaller than the diagonal length ratio of the first image pickup device and the second image pickup device. An image obtained by combining a first image pickup element which is a zoom lens with a small size and a high pixel density and a second image pickup element which is a single focus lens with a second image pickup element which is a large size and has a low pixel density. It is possible to realize a telephoto zoom mode using an image obtained by synthesizing high-quality image information having a small angle and capable of optical zoom and low-quality image information having a large angle of view by the image complementing means. In addition, a first imaging element having a small size and a high pixel density and a second imaging lens which is a single focus lens, and a second imaging element having a large size and a low pixel density and a first zoom lens
A wide-angle zoom mode can be realized by an image obtained by synthesizing high-quality image information with a small angle of view obtained by a combination of photographing lenses and low-quality image information with a large angle of view that can be optically zoomed by the image complementing means. That is, in the above structure, two types of modes can be selected: a telephoto zoom mode in which the telescopic region is covered by the optical zoom and a wide-angle zoom mode in which the wide-angle region is covered by the optical zoom.

【0007】前記2種類のモードは各撮影レンズから各
撮像素子への光路を切替え、撮影レンズと撮像素子の組
合せを変えることによって選択することができる。
The two types of modes can be selected by switching the optical path from each photographing lens to each image pickup element and changing the combination of the photographing lens and the image pickup element.

【0008】また、両モードとも単焦点レンズで得られ
る画像の画角はズームレンズで得られる画像の画角範囲
に含まれないので、画像補完手段を使って効率的にズー
ムの領域を広げることが出来る。
Further, in both modes, the angle of view of the image obtained by the monofocal lens is not included in the range of the angle of view of the image obtained by the zoom lens, so the image complementing means can be used to efficiently expand the zoom region. Can be done.

【0009】請求項2に記載のデジタルカメラは、前記
第1の撮影レンズと前記第2の撮影レンズの両方がズー
ムレンズであり、前記第2の撮影レンズの焦点距離範囲
が前記第1の撮影レンズの焦点距離範囲内にあり、かつ
第1の撮影レンズの短焦点側端と第2の撮影レンズの長
焦点側端との焦点距離比が前記第1の撮像素子と前記第
2の撮像素子の対角線長比より小さいことを特徴とす
る。
According to a second aspect of the present invention, both the first and second photographing lenses are zoom lenses, and the focal length range of the second photographing lens is the first photographing. Within the focal length range of the lens, and the focal length ratio between the short focus side end of the first shooting lens and the long focus side end of the second shooting lens is the first image sensor and the second image sensor. Is smaller than the diagonal length ratio of.

【0010】上記構成の発明では、2本のズームレンズ
を2つの撮像素子と組合せて画像を得るので、画質劣化
の少ない光学ズームによる画角変化と画像補完手段を使
って高倍率のズームが可能となる。
In the invention of the above construction, since two zoom lenses are combined with two image pickup devices to obtain an image, a change in the angle of view by optical zoom with little image quality deterioration and a high magnification zoom can be performed by using the image complementing means. Becomes

【0011】また、2本のズームレンズによる画角変化
範囲は重複していないため効率的にズームの領域を広げ
ることができる。
Further, since the view angle change ranges of the two zoom lenses do not overlap, the zoom area can be efficiently expanded.

【0012】請求項3に記載のデジタルカメラは、前記
光路切替手段とズームの操作部を単一とし、前記第1の
撮像素子と前記第2の撮像素子により得られる撮影画像
を合成し、連続して切れ目なしに変化させることを特徴
とする。
According to a third aspect of the present invention, in the digital camera, the optical path switching means and the zoom operation section are united, the photographed images obtained by the first image pickup device and the second image pickup device are combined, and the continuous images are obtained. It is characterized by changing without breaks.

【0013】上記構成の発明では、単一の操作部材を操
作することでズーム操作と光路切替えを連続して行な
い、広角ズームモードでズームイン操作を続けることに
より自動的に望遠ズームモードに切り替わり、また望遠
ズームモードでズームアウト操作を続けることにより自
動的に広角ズームモードに切り替わる。このため、広角
ズームモードの広角側端から望遠ズームモードの望遠側
端まで連続して切れ目なくズームが行なえる。
In the invention having the above-mentioned structure, the zoom operation and the optical path switching are continuously performed by operating the single operating member, and the zooming operation is automatically switched to the telephoto zoom mode by continuing the zoom-in operation in the wide-angle zoom mode. Continued zoom-out operation in telephoto zoom mode automatically switches to wide-angle zoom mode. Therefore, continuous zooming can be performed from the wide-angle end of the wide-angle zoom mode to the telephoto end of the telephoto zoom mode.

【0014】[0014]

【発明の実施の形態】図1には、第1形態に係るデジタ
ルカメラが示されている。
DESCRIPTION OF THE PREFERRED EMBODIMENTS FIG. 1 shows a digital camera according to the first embodiment.

【0015】図1(A)に示すようにデジタルカメラ1
0は箱型をしており、レリーズボタン16、ズームボタ
ン18、ストロボ20等が設けられている。デジタルカ
メラ10前面には第1撮影レンズ12と第2撮影レンズ
14が設けられ、後述する第1CCD30および第2C
CD32上に画像を結ぶ。
As shown in FIG. 1A, the digital camera 1
Reference numeral 0 is a box shape, and is provided with a release button 16, a zoom button 18, a strobe 20, and the like. A first taking lens 12 and a second taking lens 14 are provided on the front surface of the digital camera 10, and a first CCD 30 and a second C which will be described later are provided.
Connect the images on the CD32.

【0016】図1(B)に示すようにデジタルカメラ1
0背面にはファインダ用としてLCDモニタ22が設け
られている。また、別途に光学ファインダ24を設けて
いる。電源スイッチ26、モード切替ボタン28等のス
イッチ類も設けられており、モード切替やズーム等の情
報はLCDモニタ20上に映し出される。
As shown in FIG. 1B, the digital camera 1
An LCD monitor 22 for the finder is provided on the back side of the LCD. Further, an optical finder 24 is separately provided. Switches such as a power switch 26 and a mode switching button 28 are also provided, and information such as mode switching and zooming is displayed on the LCD monitor 20.

【0017】図2には、第1形態にかかるデジタルカメ
ラ10の内部構造のブロック図が示されている。
FIG. 2 shows a block diagram of the internal structure of the digital camera 10 according to the first embodiment.

【0018】第1撮影レンズ12を通った光は第1CC
D30上に結像し、第2撮影レンズ14を通った光は第
2CCD32上に結像し、光学データは電気的な画像デ
ータに変換される。この画像データは画像処理部34、
35へ送られ画像処理される。画像処理部34、35で
処理された画像データはコントロール部36内の画像補
完部38へ送られ一つの画像に合成される。
The light passing through the first taking lens 12 is the first CC
The light imaged on D30 and passed through the second taking lens 14 is imaged on the second CCD 32, and the optical data is converted into electrical image data. This image data is stored in the image processing unit 34,
It is sent to 35 for image processing. The image data processed by the image processing units 34 and 35 is sent to the image complementing unit 38 in the control unit 36 and is combined into one image.

【0019】2本の撮影レンズと2個のCCDで得られ
る画像の画角における不連続部分は、不連続部分の両端
にあたる2つの画像をコントロール部36内の画像補完
部38にて合成し一つの画像として補完する。あるいは
画素数の関係で2つの画像を合成するよりも不連続部分
広角側端の画像をトリミングして使用した方が望ましい
場合は、不連続部分広角側端の画像を電子ズームでトリ
ミングして画角を調整し、不連続部分を補完する。
As for the discontinuous portion in the angle of view of the image obtained by the two taking lenses and the two CCDs, the two images at the both ends of the discontinuous portion are combined by the image complementing portion 38 in the control portion 36 to form one image. Complement as one image. Alternatively, if it is desirable to trim and use the image on the wide-angle side end of the discontinuous portion rather than combining the two images due to the number of pixels, trim the image on the wide-angle side end of the discontinuous portion using the electronic zoom to display the image. Adjust the corners and fill in the discontinuities.

【0020】図3には画像補完部38で行なわれる画像
合成の方法が示されている。
FIG. 3 shows an image synthesizing method performed by the image complementing unit 38.

【0021】図3(A)のように、画像の中央には画素
密度の高い第1CCD30の画像が表示され、周辺部は
画素密度の低い第2CCD32の画像を使用して補完す
る。第1CCD30の画像と第2CCD32の画像の境
目を目立たなくするため、図3(B)に示すように第1
CCD30の画像の周辺部で第2CCD32の画像と滑
らかに繋ぎ合わせる処理が行なわれる。例えば第1CC
D30の画像と第2CCD32の画像で輝度に差があっ
た場合、図3(B)では縦軸Yに輝度yをとり、第1C
CD30の画像外縁部a2から一定の距離を設けた内側
のa3まで輝度yをゆるやかに変化させて繋ぎ目を目立
たなくする。具体的には、a2における第2CCD32
のy数値(ya2)から、a3における第1CCD30
のy数値(ya3)まで、画像上の距離xに応じて図3
(B)上のy1:y2が常にx1:x2となるように数
値yを変化させて行けばよい。当然、輝度以外の数値に
ついても同様の処理を行なう。
As shown in FIG. 3A, the image of the first CCD 30 having a high pixel density is displayed in the center of the image, and the peripheral portion is complemented by using the image of the second CCD 32 having a low pixel density. In order to make the boundary between the image of the first CCD 30 and the image of the second CCD 32 inconspicuous, as shown in FIG.
A process for smoothly joining the image of the second CCD 32 is performed in the peripheral portion of the image of the CCD 30. For example, the first CC
When there is a difference in brightness between the image of D30 and the image of the second CCD 32, the vertical axis Y in FIG.
The brightness y is gradually changed from the image outer edge portion a2 of the CD 30 to the inner portion a3 provided at a certain distance to make the joints inconspicuous. Specifically, the second CCD 32 in a2
From the y value (ya2) of the first CCD30 in a3
Up to the y numerical value (ya3) of FIG.
(B) The numerical value y may be changed so that y1: y2 in the above is always x1: x2. Naturally, similar processing is performed for numerical values other than luminance.

【0022】図4には第1CCD30、第2CCD32
で得られる画像が撮影レンズとCCDの組合せ別に示さ
れている。
FIG. 4 shows a first CCD 30 and a second CCD 32.
The images obtained in 1) are shown for each combination of the taking lens and the CCD.

【0023】ここではサイズが小さく画素密度の高い第
1CCD30とサイズが大きく画素密度の低い第2CC
D32の対角線長比を1:3、第1撮影レンズ12のズ
ーム比をn〜4n(mm)、第2撮影レンズ14の焦点
距離を2n(mm)とする。
Here, the first CCD 30 having a small size and a high pixel density and the second CC 30 having a large size and a low pixel density are used.
The diagonal length ratio of D32 is 1: 3, the zoom ratio of the first taking lens 12 is n to 4n (mm), and the focal length of the second taking lens 14 is 2n (mm).

【0024】また、望遠ズームモードでは第1撮影レン
ズ12と第1CCD30の組合せで得られる画角は35
ミリカメラ換算で望遠96mm〜288mmレンズ相
当、第2撮影レンズ14と第2CCD32の組合せで得
られる画角は35ミリカメラ換算で標準48mmレンズ
相当とし、広角ズームモードでは第1撮影レンズ12と
第2CCD32の組合せで得られる画角は同じく24m
m〜72mmレンズ相当、第2撮影レンズ14と第1C
CD30の組合せで得られる画角は同じく望遠192m
m相当とする。
In the telephoto zoom mode, the angle of view obtained by the combination of the first taking lens 12 and the first CCD 30 is 35.
It corresponds to a telephoto 96 mm to 288 mm lens equivalent to a millimeter camera, and a field angle obtained by combining the second taking lens 14 and the second CCD 32 is equivalent to a standard 48 mm lens equivalent to a 35 mm camera. In the wide-angle zoom mode, the first taking lens 12 and the second CCD 32. The angle of view obtained by combining
m-72 mm lens equivalent, second taking lens 14 and first C
The angle of view obtained with the combination of CD30 is the same as telephoto 192m
m equivalent.

【0025】まず望遠ズームモードでは、第1撮影レン
ズ12とサイズが小さく画素密度の高い第1CCD3
0、第2撮影レンズ14とサイズが大きく画素密度の低
い第2CCD32の組合せで画像情報を得ている。得ら
れた画像情報は第1撮影レンズ12/第1CCD30で
96mm〜288mmレンズ相当、第2撮影レンズ14
/第2CCD32で48mmレンズ相当なので、画角の
不連続部分である96mmから48mmの間は図4
(A)に示すように画面中央に画質の高い第1CCD3
0の96mmレンズ相当画像を置き、周辺は第2CCD
32の48mmレンズ相当画像を使用して画像補完によ
り合成することで、標準48mmレンズ相当から望遠9
6mmレンズ相当の画面まで切れ目なく画像を得ること
ができる。
First, in the telephoto zoom mode, the first taking lens 12 and the first CCD 3 having a small size and a high pixel density are used.
The image information is obtained by a combination of 0, the second taking lens 14 and the second CCD 32 having a large size and a low pixel density. The obtained image information is equivalent to a 96 mm to 288 mm lens in the first taking lens 12 / first CCD 30, and the second taking lens 14
/ Since the second CCD 32 is equivalent to a 48 mm lens, the portion between 96 mm and 48 mm, which is the discontinuous portion of the angle of view, is shown in FIG.
As shown in (A), the first CCD 3 with high image quality is displayed in the center of the screen.
0mm 96mm lens equivalent image is placed and the periphery is the 2nd CCD
By combining images with 32 48 mm lens equivalent images by image complement, it is possible to change from the standard 48 mm lens equivalent to the telephoto 9
Images can be obtained seamlessly up to a screen equivalent to a 6 mm lens.

【0026】これにより、48mmから96mmまでは
画像補完で、96mmから288mmまでは光学ズーム
で連続して切れ目なくズームが可能となる。
As a result, it is possible to perform image complementation from 48 mm to 96 mm and continuous optical zoom from 96 mm to 288 mm without interruption.

【0027】次に広角ズームモードでは、第2撮影レン
ズ14とサイズが小さく画素密度の高い第1CCD3
0、第1撮影レンズ12とサイズが大きく画素密度の低
い第2CCD32の組合せで画像情報を得ている。得ら
れた画像情報は第2撮影レンズ14/第1CCD30で
192mmレンズ相当、第1撮影レンズ12/第2CC
D32で24mm〜72mmレンズ相当なので、画角の
不連続部分である72mmから192mmの間は図4
(B)に示すように画面中央に画質の高い第1CCD3
0の192mmレンズ相当画像を置き、周辺は第2CC
D32の24mmレンズ相当画像を使用して画像補完に
より合成することで、広角24mmレンズ相当から望遠
192mmレンズ相当の画面まで切れ目なく画像を得る
ことができる。
Next, in the wide-angle zoom mode, the second taking lens 14 and the first CCD 3 having a small size and a high pixel density are used.
Image information is obtained by a combination of 0, the first taking lens 12 and the second CCD 32 having a large size and a low pixel density. The obtained image information is equivalent to a 192 mm lens in the second taking lens 14 / first CCD 30, first taking lens 12 / second CC
Since D32 corresponds to a lens of 24 mm to 72 mm, the distance between 72 mm and 192 mm, which is a discontinuous portion of the angle of view, is as shown in FIG.
As shown in (B), the first CCD 3 with high image quality is displayed at the center of the screen.
Place an image equivalent to a 192 mm lens of 0, and the periphery is the second CC
By combining the images corresponding to the 24 mm lens of D32 by image complement, it is possible to obtain an image seamlessly from the screen corresponding to the wide-angle 24 mm lens to the screen corresponding to the telephoto 192 mm lens.

【0028】これにより、24mmから72mmまでは
光学ズームで、72mmから196mmまでは画像補完
で連続して切れ目なくズームが可能となる。
As a result, the optical zoom can be performed from 24 mm to 72 mm, and the image can be continuously zoomed from 72 mm to 196 mm without interruption by image complementation.

【0029】次にモード切替えについて具体的に説明す
る。
Next, the mode switching will be specifically described.

【0030】デジタルカメラ10が望遠ズームモードに
設定されている時は図5(A)のように第1撮影レンズ
12から入射した光が第1CCD30に導かれ、第2撮
影レンズ14から入射した光は第2CCD32に導かれ
る。これにより、ズームレンズである第1撮影レンズ1
2とサイズの小さい第1CCD30で得られる望遠領域
の画像を画面の中心に置き、単焦点レンズである第2撮
影レンズ14とサイズの大きい第2CCD32で得られ
る標準領域の画像を周囲に配置することで、標準から準
望遠までは画像補完で、準望遠から望遠までは光学ズー
ムでカバーし、連続して切れ目なくズームが可能とな
る。この場合、画質劣化のない光学ズームで望遠領域を
幅広くカバーできるので、スポーツ写真や報道写真に好
適である。
When the digital camera 10 is set to the telephoto zoom mode, the light incident from the first taking lens 12 is guided to the first CCD 30 as shown in FIG. Are guided to the second CCD 32. As a result, the first taking lens 1 which is a zoom lens
2. Place the image of the telephoto area obtained by the first CCD 30 having a small size in the center of the screen, and arrange the image of the standard area obtained by the second taking lens 14 which is a single focus lens and the second CCD 32 having a large size in the periphery. Then, the image is complemented from the standard to the quasi-telephoto, and the optical zoom is applied from the quasi-telephoto to the telephoto, and continuous zooming is possible. In this case, a wide range of the telephoto area can be covered by the optical zoom without deterioration of image quality, which is suitable for sports photographs and news photographs.

【0031】撮影者がモード切替ボタン28で広角ズー
ムモードに切替えると、図5(B)に示すように光路中
に4枚の可動ミラー42が挿入され、第1撮影レンズ1
2から入射した光は可動ミラー42と固定ミラー44で
反射され第2CCD32に導かれ、第2撮影レンズ14
から入射した光は可動ミラー42で反射され第1CCD
30に導かれる。これにより、単焦点レンズである第2
撮影レンズ14とサイズの小さい第1CCD30で得ら
れる望遠領域の画像を画面の中心に置き、ズームレンズ
である第1撮影レンズ12とサイズの大きい第2CCD
32で得られる広角領域の画像を周囲に配置すること
で、広角から標準までは光学ズームで、標準から望遠ま
では画像補完でカバーし、連続して切れ目なくズームが
可能となる。この場合、画質劣化のない光学ズームで広
角領域を幅広くカバーできるので、風景写真やスナップ
写真に好適である。
When the photographer switches to the wide-angle zoom mode with the mode switching button 28, four movable mirrors 42 are inserted in the optical path as shown in FIG.
The light incident from 2 is reflected by the movable mirror 42 and the fixed mirror 44 and guided to the second CCD 32, and the second taking lens 14
The light incident from the first CCD is reflected by the movable mirror 42.
Guided to 30. As a result, the second single-focus lens
The image of the telephoto area obtained by the taking lens 14 and the first CCD 30 having a small size is placed at the center of the screen, and the first taking lens 12 as a zoom lens and the second CCD having a large size are arranged.
By arranging the image in the wide-angle region obtained at 32 around, the wide-angle to standard can be covered by optical zoom, and the standard to telephoto can be covered by image complement, and continuous zooming can be performed. In this case, since the wide-angle region can be widely covered by the optical zoom without deterioration of image quality, it is suitable for landscape photography and snapshot photography.

【0032】図6には、第2形態に係るデジタルカメラ
の構造が示されている。図6(A)に示すようにデジタ
ルカメラ10は箱を二つ繋いだ形状をしており、二つの
箱は接合面の中央にある回転軸46で回動自在に連結さ
れている。
FIG. 6 shows the structure of a digital camera according to the second embodiment. As shown in FIG. 6A, the digital camera 10 has a shape in which two boxes are connected, and the two boxes are rotatably connected by a rotary shaft 46 located at the center of the joint surface.

【0033】撮影者から見て手前側の箱すなわちCCD
部48には電源スイッチ26、ズームボタン18、レリ
ーズボタン16が設けられ、接合面には第1CCD30
及び第2CCD32が設けられている。CCD部48に
回転軸46で軸支されているレンズ部50は回転軸46
を中心に360度自由に回動可能であり、内部には第1
撮影レンズ12及び第2撮影レンズ14が収められてい
る。この第1及び第2撮影レンズを通った光は夫々第1
窓52及び第2窓54を通り、CCD部48の第1CC
D30及び第2CCD32に像を結ぶ。CCD部48と
レンズ部50の情報の遣り取り、AF用の電源供給など
は電気接点56を通じて行なう。
A box on the front side of the photographer, that is, a CCD
A power switch 26, a zoom button 18, and a release button 16 are provided in the portion 48, and the first CCD 30 is provided on the joint surface.
And a second CCD 32 are provided. The lens unit 50, which is rotatably supported on the CCD unit 48 by the rotary shaft 46, has
It can be freely rotated 360 degrees around the
The taking lens 12 and the second taking lens 14 are housed. The light passing through the first and second photographing lenses is the first light, respectively.
The first CC of the CCD unit 48 passes through the window 52 and the second window 54.
An image is formed on D30 and the second CCD 32. Information is exchanged between the CCD unit 48 and the lens unit 50, power supply for AF, and the like are performed through the electric contacts 56.

【0034】撮影者がモードを切替える際は、CCD部
48とレンズ部50を持って回転軸46を中心に180
度回転させる。これによりレンズ部50の第1撮影レン
ズ12と第2撮影レンズ14、CCD部の第1CCD3
0と第2CCD32の組合せが逆になる。撮影レンズと
CCDの光軸は回転軸46を中心に対称の位置にあるの
でCCD部48とレンズ部50を180度回転させても
光軸が狂うことはない。電気接点56も回転軸に対して
対称の位置にあるので情報や電力の伝達に支障はない。
また撮影中、不用意に回転しないようにロック機構58
を設けておくことは言うまでもない。
When the photographer switches modes, the CCD unit 48 and the lens unit 50 are held 180 degrees about the rotary shaft 46.
Rotate it once. As a result, the first taking lens 12 and the second taking lens 14 of the lens unit 50, and the first CCD 3 of the CCD unit
The combination of 0 and the second CCD 32 is reversed. Since the optical axes of the taking lens and the CCD are symmetrical with respect to the rotation axis 46, the optical axes do not change even if the CCD section 48 and the lens section 50 are rotated 180 degrees. Since the electric contact 56 is also symmetrical with respect to the rotation axis, it does not hinder the transmission of information and electric power.
In addition, the lock mechanism 58 prevents the camera from rotating carelessly during shooting.
Needless to say, to provide.

【0035】さらに、現在のレンズ/CCDの組合せが
望遠ズーム/広角ズームのどちらか一目で判るようにレ
ンズ部をツートンカラーに塗り分けたり形状を非対称に
してもよい。
Further, the lens portion may be painted in two-tone colors or the shape may be asymmetric so that the current lens / CCD combination can be seen at a glance of either the telephoto zoom or the wide-angle zoom.

【0036】図7には第3形態に係るデジタルカメラの
外観が示されている。
FIG. 7 shows the external appearance of the digital camera according to the third embodiment.

【0037】図7に示すようにデジタルカメラ10は第
2形態と同様に箱を二つ繋いだ形状をしているが第3形
態には回転軸は存在せず、CCD部48側の接合面をU
字型の支持部60とし、レンズ部50側の接合面を形成
する係止部62を上から嵌め込んで固定する。
As shown in FIG. 7, the digital camera 10 has a shape in which two boxes are connected in the same manner as in the second embodiment, but in the third embodiment, there is no rotation axis, and the joint surface on the side of the CCD unit 48. U
The support portion 60 has a V shape, and the locking portion 62 that forms the joint surface on the lens portion 50 side is fitted and fixed from above.

【0038】モード切替えの際には一旦レンズ部50を
外し、レンズ光軸方向を中心として、180度回転させ
てからCCD部48に嵌め込む。これにより撮影レンズ
/CCDの組合せが変わり、撮影モードを変更できる。
At the time of mode switching, the lens unit 50 is once removed, rotated 180 degrees about the lens optical axis direction, and then fitted into the CCD unit 48. As a result, the combination of the photographing lens / CCD is changed, and the photographing mode can be changed.

【0039】このとき、不用意にCCD部48とレンズ
部50の結合が外れないようにロック機構64を設けて
おく必要がある。
At this time, it is necessary to provide the lock mechanism 64 to prevent the CCD unit 48 and the lens unit 50 from being unintentionally disconnected.

【0040】図8には第4形態に係る光学系の断面図が
示されている。
FIG. 8 shows a sectional view of the optical system according to the fourth embodiment.

【0041】図8(A)に示すように、一つの開口部か
ら入射した光をハーフプリズム66で2分割し、一方を
ミラー68で反射させ、それぞれ第1撮影レンズ12及
び第2撮影レンズ14へと導いた後、第1及び第2CC
D上に結像させる。この先は図8(B)に示すように第
1〜第3形態のいずれかに準拠した方法で撮影レンズと
CCDの組合せを切替える。
As shown in FIG. 8A, the light incident from one opening is split into two by the half prism 66, and one of them is reflected by the mirror 68, and the first taking lens 12 and the second taking lens 14 respectively. After leading to the 1st and 2nd CC
Image on D. After this, as shown in FIG. 8B, the combination of the taking lens and the CCD is switched by a method based on any of the first to third embodiments.

【0042】このとき、第1撮影レンズ12及び第2撮
影レンズ14は光学的に同軸配置されているので、被写
体までの距離が近くなっても、2つのCCDからの画像
間に2本のレンズの位置ずれに起因するパララックス
(視差)が発生しないという利点がある。
At this time, since the first taking lens 12 and the second taking lens 14 are optically coaxially arranged, even if the distance to the subject becomes short, two lenses are provided between the images from the two CCDs. There is an advantage that parallax (parallax) due to the position shift of does not occur.

【0043】また、ハーフプリズム66の代わりにハー
フミラーを用いても良いし、このハーフプリズム/ハー
フミラーの反射/透過の割合を調整することで2本の撮
影レンズの明るさの差を補正するようにしてもよい。
A half mirror may be used instead of the half prism 66, and the difference in brightness between the two taking lenses is corrected by adjusting the reflection / transmission ratio of the half prism / half mirror. You may do it.

【0044】図9には第5形態に係るデジタルカメラの
画角とCCDとの関係が示されている。
FIG. 9 shows the relationship between the angle of view and the CCD of the digital camera according to the fifth embodiment.

【0045】第1〜第4形態のデジタルカメラにおいて
第2撮影レンズ14がズームレンズであった場合、図9
に示すように、第1CCD30で得られる画像の望遠側
端T1と第2CCD32で得られる画像の広角側端W2
の間に画角の不連続部分が発生する場合がある。
When the second taking lens 14 is a zoom lens in the digital cameras of the first to fourth forms, FIG.
As shown in, the telephoto end T1 of the image obtained by the first CCD 30 and the wide-angle end W2 of the image obtained by the second CCD 32.
There may be a discontinuity of the angle of view between.

【0046】このときT1〜W2の不連続部分を画像補
完部38で補完し、W1からT2まで連続して切れ目な
くズームが可能となる。2本のレンズを共にズームレン
ズとすれば、比較的小さなズーム比のレンズ2本で幅広
い領域をカバーすることができるので、結果としてデジ
タルカメラ10本体サイズの小型化とズーム領域の拡大
を両立させることができる。
At this time, the discontinuous portion of T1 to W2 is complemented by the image complementing section 38, and continuous zooming from W1 to T2 is possible without interruption. If the two lenses are both zoom lenses, a wide area can be covered with two lenses having a relatively small zoom ratio, and as a result, the size reduction of the main body of the digital camera 10 and the expansion of the zoom area can both be achieved. be able to.

【0047】[0047]

【発明の効果】本発明は上記構成としたので、装置の大
型化を招かずに連続して切れ目のない高倍率ズームを実
現することができた。
Since the present invention has the above-described structure, it is possible to realize continuous high-power zoom without interruption without increasing the size of the apparatus.

【図面の簡単な説明】[Brief description of drawings]

【図1】本実施形態1に係るデジタルカメラの斜視図で
ある。
FIG. 1 is a perspective view of a digital camera according to a first embodiment.

【図2】本実施形態1に係るデジタルカメラのブロック
図である。
FIG. 2 is a block diagram of the digital camera according to the first embodiment.

【図3】本実施形態1に係るデジタルカメラの画面合成
の説明図である。
FIG. 3 is an explanatory diagram of screen composition of the digital camera according to the first embodiment.

【図4】本実施形態1に係るデジタルカメラの画面合成
の説明図である。
FIG. 4 is an explanatory diagram of screen composition of the digital camera according to the first embodiment.

【図5】本実施形態1に係るデジタルカメラの内部構造
図である。
FIG. 5 is an internal structure diagram of the digital camera according to the first embodiment.

【図6】本実施形態2に係るデジタルカメラの透視図で
ある。
FIG. 6 is a perspective view of the digital camera according to the second embodiment.

【図7】本実施形態3に係るデジタルカメラの斜視図で
ある。
FIG. 7 is a perspective view of a digital camera according to a third embodiment.

【図8】本実施形態4に係るデジタルカメラの内部構造
図である。
FIG. 8 is an internal structural diagram of a digital camera according to a fourth embodiment.

【図9】本実施形態5に係るデジタルカメラの画角とC
CDの関係図である。
FIG. 9 is a view angle and C of the digital camera according to the fifth embodiment.
It is a relationship diagram of CD.

【符号の説明】[Explanation of symbols]

10 デジタルカメラ 12 第1撮影レンズ 14 第2撮影レンズ 16 レリーズボタン 18 ズームボタン 26 電源スイッチ 30 第1CCD 32 第2CCD 42 可動ミラー 44 固定ミラー 46 回転軸 48 CCD部 50 レンズ部 52 第1窓 54 第2窓 56 電気接点 60 支持部 62 係止部 66 ハーフプリズム 10 digital camera 12 First photography lens 14 Second photography lens 16 Release button 18 Zoom button 26 Power switch 30 First CCD 32 Second CCD 42 Movable mirror 44 fixed mirror 46 rotation axis 48 CCD section 50 lens part 52 First window 54 second window 56 electrical contacts 60 Support 62 Locking part 66 half prism

───────────────────────────────────────────────────── フロントページの続き (51)Int.Cl.7 識別記号 FI テーマコート゛(参考) // H04N 101:00 H04N 101:00 Fターム(参考) 2H054 AA01 BB02 BB05 BB07 2H101 DD16 EE08 5C022 AA13 AB36 AB66 AC42 AC54 AC69 ─────────────────────────────────────────────────── ─── Continuation of front page (51) Int.Cl. 7 Identification code FI theme code (reference) // H04N 101: 00 H04N 101: 00 F term (reference) 2H054 AA01 BB02 BB05 BB07 2H101 DD16 EE08 5C022 AA13 AB36 AB66 AC42 AC54 AC69

Claims (3)

【特許請求の範囲】[Claims] 【請求項1】 第1の撮像素子と、前記第1の撮像素子
よりサイズが大きく画素密度が低い第2の撮像素子と、 ズームレンズである第1の撮影レンズと、単焦点レンズ
である第2の撮影レンズと、 前記第1の撮影レンズを通った光を前記第1の撮像素子
または前記第2の撮像素子へ、あるいは前記第2の撮影
レンズを通った光を前記第1の撮像素子または前記第2
の撮像素子へ導く光路切替手段と、 前記光路切替手段を操作して前記第1の撮像素子及び前
記第2の撮像素子から得られる画像情報を要求される画
質によって使い分ける画像補完手段と、 を備え、 前記第2の撮影レンズの焦点距離が前記第1のズームレ
ンズの焦点距離範囲内にあり、かつ前記第1のズームレ
ンズの短焦点側端および長焦点側端の焦点距離と前記第
2のレンズの焦点距離との比がともに前記第1の撮像素
子と第2の撮像素子の対角線長比より小さいことを特徴
とするデジタルカメラ。
1. A first image pickup device, a second image pickup device which is larger in size and has a lower pixel density than the first image pickup device, a first taking lens which is a zoom lens, and a single focus lens. No. 2 photographing lens and light passing through the first photographing lens to the first image pickup device or the second image pickup device, or light passing through the second photographing lens is the first image pickup device Or the second
Optical path switching means for guiding to the image pickup device, and image complementing means for operating the optical path switch means and selectively using image information obtained from the first image pickup element and the second image pickup element according to the required image quality. The focal length of the second taking lens is within the focal length range of the first zoom lens, and the focal lengths of the short focal length side end and the long focal length side end of the first zoom lens are equal to the second focal length. A digital camera characterized in that a ratio with a focal length of a lens is smaller than a diagonal length ratio of the first image sensor and the second image sensor.
【請求項2】 前記第1の撮影レンズと前記第2の撮影
レンズの両方がズームレンズであり、前記第2の撮影レ
ンズの焦点距離範囲が前記第1の撮影レンズの焦点距離
範囲内にあり、かつ第1の撮影レンズの短焦点側端と第
2の撮影レンズの長焦点側端との焦点距離比が前記第1
の撮像素子と前記第2の撮像素子の対角線長比より小さ
いことを特徴とする請求項1に記載のデジタルカメラ。
2. The first photographing lens and the second photographing lens are both zoom lenses, and the focal length range of the second photographing lens is within the focal length range of the first photographing lens. And the focal length ratio between the short focus side end of the first taking lens and the long focus side end of the second taking lens is the first
The digital camera according to claim 1, wherein the ratio of the diagonal lengths of the image pickup device and the second image pickup device is smaller than the diagonal length ratio.
【請求項3】 前記光路切替手段とズームの操作部を単
一とし、前記第1の撮像素子と前記第2の撮像素子によ
り得られる撮影画像を合成し、連続して切れ目なしに変
化させることを特徴とする請求項1または請求項2に記
載のデジタルカメラ。
3. An optical path switching unit and a zoom operation unit are integrated into one unit, and captured images obtained by the first image pickup device and the second image pickup device are combined and continuously changed seamlessly. The digital camera according to claim 1, wherein the digital camera is a digital camera.
JP2002096976A 2002-03-29 2002-03-29 Digital camera Expired - Fee Related JP4068869B2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2002096976A JP4068869B2 (en) 2002-03-29 2002-03-29 Digital camera

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2002096976A JP4068869B2 (en) 2002-03-29 2002-03-29 Digital camera

Publications (2)

Publication Number Publication Date
JP2003298919A true JP2003298919A (en) 2003-10-17
JP4068869B2 JP4068869B2 (en) 2008-03-26

Family

ID=29387562

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2002096976A Expired - Fee Related JP4068869B2 (en) 2002-03-29 2002-03-29 Digital camera

Country Status (1)

Country Link
JP (1) JP4068869B2 (en)

Cited By (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2004023794A1 (en) * 2002-09-09 2004-03-18 Rohm Co., Ltd. Image sensor module
JP2004297332A (en) * 2003-03-26 2004-10-21 Fuji Photo Film Co Ltd Imaging apparatus
EP1865712A1 (en) * 2005-03-22 2007-12-12 Sony Corporation Imaging device, information processing device, information processing method, program, and program recording medium
US7561788B2 (en) 2005-09-09 2009-07-14 Eastman Kodak Company Image-capturing device having multiple optical systems
US7593036B2 (en) 2005-12-27 2009-09-22 Eastman Kodak Company Digital camera and data management method
US7671907B2 (en) 2006-02-15 2010-03-02 Eastman Kodak Company Image-capturing apparatus
JP2010183281A (en) * 2009-02-04 2010-08-19 Sumitomo Electric Ind Ltd In-vehicle photographing device, and safety measure method for vehicle
US7852399B2 (en) 2007-03-29 2010-12-14 Fujifilm Corporation Multi-eye image pickup device
JP2014060471A (en) * 2012-09-14 2014-04-03 Sharp Corp Image pickup device
WO2017086021A1 (en) * 2015-11-20 2017-05-26 ソニー株式会社 Image processing device, image processing method, and computer program
JP2018507617A (en) * 2015-04-20 2018-03-15 エスゼット ディージェイアイ テクノロジー カンパニー リミテッドSz Dji Technology Co.,Ltd Imaging system, unmanned aerial vehicle, and method
CN108401104A (en) * 2018-02-08 2018-08-14 浙江大学 Bifocal camera digital zooming method based on frequency band reparation and super-resolution
CN113472989A (en) * 2012-11-28 2021-10-01 核心光电有限公司 Multi-aperture imaging system and method for acquiring images by multi-aperture imaging system

Cited By (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7453517B2 (en) 2002-09-09 2008-11-18 Rohm Co., Ltd. Image sensor module
WO2004023794A1 (en) * 2002-09-09 2004-03-18 Rohm Co., Ltd. Image sensor module
JP2004297332A (en) * 2003-03-26 2004-10-21 Fuji Photo Film Co Ltd Imaging apparatus
US8159572B2 (en) 2005-03-22 2012-04-17 Sony Corporation Image pickup apparatus, apparatus and method for processing information, program, and program recording medium
EP1865712A1 (en) * 2005-03-22 2007-12-12 Sony Corporation Imaging device, information processing device, information processing method, program, and program recording medium
EP1865712A4 (en) * 2005-03-22 2009-12-23 Sony Corp Imaging device, information processing device, information processing method, program, and program recording medium
US7561788B2 (en) 2005-09-09 2009-07-14 Eastman Kodak Company Image-capturing device having multiple optical systems
US7593036B2 (en) 2005-12-27 2009-09-22 Eastman Kodak Company Digital camera and data management method
US7671907B2 (en) 2006-02-15 2010-03-02 Eastman Kodak Company Image-capturing apparatus
US7852399B2 (en) 2007-03-29 2010-12-14 Fujifilm Corporation Multi-eye image pickup device
JP2010183281A (en) * 2009-02-04 2010-08-19 Sumitomo Electric Ind Ltd In-vehicle photographing device, and safety measure method for vehicle
JP2014060471A (en) * 2012-09-14 2014-04-03 Sharp Corp Image pickup device
CN113472989A (en) * 2012-11-28 2021-10-01 核心光电有限公司 Multi-aperture imaging system and method for acquiring images by multi-aperture imaging system
JP2018507617A (en) * 2015-04-20 2018-03-15 エスゼット ディージェイアイ テクノロジー カンパニー リミテッドSz Dji Technology Co.,Ltd Imaging system, unmanned aerial vehicle, and method
US10419690B2 (en) 2015-04-20 2019-09-17 SZ DJI Technology Co., Ltd. Imaging system
US10979651B2 (en) 2015-04-20 2021-04-13 SZ DJI Technology Co., Ltd. Imaging system
WO2017086021A1 (en) * 2015-11-20 2017-05-26 ソニー株式会社 Image processing device, image processing method, and computer program
CN108401104A (en) * 2018-02-08 2018-08-14 浙江大学 Bifocal camera digital zooming method based on frequency band reparation and super-resolution

Also Published As

Publication number Publication date
JP4068869B2 (en) 2008-03-26

Similar Documents

Publication Publication Date Title
JP2003298920A (en) Digital camera
US7852399B2 (en) Multi-eye image pickup device
JP4624245B2 (en) Imaging device
JP5705883B2 (en) Lens device
JP4068869B2 (en) Digital camera
JP3949388B2 (en) Digital camera
JP2009048125A (en) Photographing equipment and method of controlling same
JP2011048283A (en) Photographed image composing device
JP2001272593A (en) Digital still camera
JP2011048120A (en) Twin lens digital camera
JP2006081089A (en) Imaging device
JP2007206617A (en) Camera
US11330156B2 (en) Image capturing device
JP2018125628A (en) Imaging apparatus
JP2009017517A (en) Image-capturing device
JP3724701B2 (en) Solid-state imaging device and resolution conversion device
JP2002112097A (en) Camera
JP4549255B2 (en) Solid-state imaging device and resolution conversion device
JP2005101729A (en) Digital camera with zooming function
JP2006115091A (en) Imaging device
JP2001136429A (en) Electronic camera
JP2005026786A (en) Image photographing apparatus
JP2007249058A (en) Light source holding mechanism
JP2001211360A (en) Video camera
KR100209906B1 (en) Video camera with the still camera

Legal Events

Date Code Title Description
A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20040323

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20051115

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20060116

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20070220

A711 Notification of change in applicant

Free format text: JAPANESE INTERMEDIATE CODE: A712

Effective date: 20070227

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20070423

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20070710

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20070910

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20080108

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20080111

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20110118

Year of fee payment: 3

R150 Certificate of patent or registration of utility model

Free format text: JAPANESE INTERMEDIATE CODE: R150

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20110118

Year of fee payment: 3

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20120118

Year of fee payment: 4

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20120118

Year of fee payment: 4

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20130118

Year of fee payment: 5

LAPS Cancellation because of no payment of annual fees