WO2003075557A1 - Image pickup device and chromatic aberration correction method - Google Patents

Image pickup device and chromatic aberration correction method Download PDF

Info

Publication number
WO2003075557A1
WO2003075557A1 PCT/JP2003/002589 JP0302589W WO03075557A1 WO 2003075557 A1 WO2003075557 A1 WO 2003075557A1 JP 0302589 W JP0302589 W JP 0302589W WO 03075557 A1 WO03075557 A1 WO 03075557A1
Authority
WO
WIPO (PCT)
Prior art keywords
signal
image
recording
camera
chromatic aberration
Prior art date
Application number
PCT/JP2003/002589
Other languages
French (fr)
Japanese (ja)
Inventor
Miyuki Okada
Ken Nakajima
Original Assignee
Sony Corporation
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sony Corporation filed Critical Sony Corporation
Priority to US10/506,848 priority Critical patent/US7397499B2/en
Priority to EP03710248A priority patent/EP1489836A4/en
Priority to KR1020047013732A priority patent/KR100957261B1/en
Publication of WO2003075557A1 publication Critical patent/WO2003075557A1/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/76Television signal recording
    • H04N5/765Interface circuits between an apparatus for recording and another apparatus
    • H04N5/77Interface circuits between an apparatus for recording and another apparatus between a recording apparatus and a television camera
    • H04N5/772Interface circuits between an apparatus for recording and another apparatus between a recording apparatus and a television camera the recording apparatus and the television camera being placed in the same enclosure
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/10Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/68Control of cameras or camera modules for stable pick-up of the scene, e.g. compensating for camera body vibrations
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/68Control of cameras or camera modules for stable pick-up of the scene, e.g. compensating for camera body vibrations
    • H04N23/681Motion detection
    • H04N23/6811Motion detection based on the image signal
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/68Control of cameras or camera modules for stable pick-up of the scene, e.g. compensating for camera body vibrations
    • H04N23/681Motion detection
    • H04N23/6812Motion detection based on additional sensors, e.g. acceleration sensors
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/68Control of cameras or camera modules for stable pick-up of the scene, e.g. compensating for camera body vibrations
    • H04N23/682Vibration or motion blur correction
    • H04N23/683Vibration or motion blur correction performed by a processor, e.g. controlling the readout of an image memory
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/68Control of cameras or camera modules for stable pick-up of the scene, e.g. compensating for camera body vibrations
    • H04N23/682Vibration or motion blur correction
    • H04N23/685Vibration or motion blur correction performed by mechanical compensation
    • H04N23/687Vibration or motion blur correction performed by mechanical compensation by shifting the lens or sensor position
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/60Noise processing, e.g. detecting, correcting, reducing or removing noise
    • H04N25/61Noise processing, e.g. detecting, correcting, reducing or removing noise the noise originating only from the lens unit, e.g. flare, shading, vignetting or "cos4"
    • H04N25/611Correction of chromatic aberration
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/76Television signal recording
    • H04N5/765Interface circuits between an apparatus for recording and another apparatus
    • H04N5/775Interface circuits between an apparatus for recording and another apparatus between a recording apparatus and a television receiver
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/76Television signal recording
    • H04N5/78Television signal recording using magnetic recording
    • H04N5/781Television signal recording using magnetic recording on disks or drums
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/76Television signal recording
    • H04N5/907Television signal recording using static stores, e.g. storage tubes or semiconductor memories
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00Details of colour television systems
    • H04N9/79Processing of colour television signals in connection with recording
    • H04N9/80Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback
    • H04N9/82Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback the individual colour picture signal components being recorded simultaneously only
    • H04N9/8205Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback the individual colour picture signal components being recorded simultaneously only involving the multiplexing of an additional signal and the colour video signal

Definitions

  • the present invention relates to a two-image imaging apparatus and a chromatic aberration correction method capable of satisfactorily correcting chromatic aberration that occurs when, for example, imaging video light that has passed through a photographic lens.
  • the present invention relates to an image capturing apparatus and a chromatic aberration correction method suitable for use in a digital still camera. Background art
  • a photographic lens for converting image light passing through the photographic lens into an electric image signal
  • camera signal processing for processing the image signal Means
  • a so-called optical lens is used as the taking lens. Then, the image light from the subject passing through the photographing lens is separated into three primary colors of red (R), green (G), and blue (B) in a spectral filter, for example, such as a CCD or CMOS sensor. An image is formed on an image pickup surface of an image pickup means, and is converted into an electric image signal.
  • a spectral filter for example, such as a CCD or CMOS sensor.
  • video signals for each color of R, G, and B taken out from a CCD are temporarily converted into digital data and stored in individual field memories.
  • the entire field memory is individually vector-enlarged and scaled, and then each image is enlarged and reduced.
  • FIG. 5 shows a block diagram of a video camera or a digital still camera equipped with such an image stabilizer.
  • image light from a subject is imaged on an imaging surface of an imaging means 51 composed of a CCD, a CMOS sensor, or the like through an imaging lens 50, for example, a luminance (Y) signal. Is converted into an electrical image signal consisting of the two color difference (Cb, Cr) signals. This image signal is supplied to the camera signal processing circuit 52.
  • the zoom focal length of the photographing lens 50 operated by the user is detected from the photographing lens 50, for example.
  • the zoom focal length may be detected using, for example, an operation signal from a manual operation input unit 54 from a user.
  • the angular velocity signals detected by the gyro sensors 53P and 53Y are supplied to high-pass filters (HPF) 55P and 55Y to remove the direct current component.
  • HPF high-pass filters
  • the data is supplied to a table 56, from which the necessary operation coefficients are obtained, and the operation coefficients are supplied to multipliers 57P, 57Y, so that the data is calculated. Signals from the 55 P and 55 Y are multiplied.
  • the output signals of multipliers 57 P and 57 Y are output to integrators 58 P and 58, respectively.
  • angle information of the photographing lens 50 fluctuated by camera shake is extracted.
  • the camera shake angle information is supplied to, for example, the image pickup means 51 through the limiter circuits 59 P and 59 Y, and the position where the image signal from the image pickup means 51 is extracted is controlled. That is, for example, the imaging means 51 is provided with an imaging surface wider than the original image size, and an image necessary for canceling the fluctuation due to camera shake is taken out of the imaging surface.
  • camera shake correction in addition to the control of the extraction position of the image signal from the imaging means 51, the image signals captured by the imaging means 51 are temporarily stored in the memory 60. In addition, a method of controlling a reading position of an image signal from the memory 60 and a method of shifting and correcting a part of the lens of the photographing lens 50 are also implemented.
  • the angle information of the photographing lens 50 fluctuated by camera shake in addition to the means using the gyro sensors 53P and 53Y, for example, as shown in FIG. 5
  • the image signal from 1 is stored in the frame memory 61, and the image signal before and after this frame memory 61 is compared by the comparison circuit 62. Can also be calculated.
  • the calculated camera shake angle information can be used in all of the above-described camera shake correction means.
  • the present application has been made in view of such a point, and the problem to be solved is that, with conventional means, color blur and resolution degradation due to chromatic aberration of magnification due to downsizing of a taking lens and the like. It is difficult to sufficiently suppress such image quality degradation using only the taking lens.In particular, to correct such image quality degradation, enlarge or reduce the image for each color. However, if this is done, there was a problem that camera shake correction could not be performed at the same time. Disclosure of the invention
  • Claim 1 of the present invention provides a detection output using a means for enlarging or reducing an image for each color of a primary color signal and a means for detecting a driving state of a photographing lens and a camera shake correction amount. According to this, the conversion coefficient of the enlargement or reduction of the image and the coordinates of the optical axis center are controlled.
  • the resolution conversion means Signal conversion means for converting or inverting these output signals to an external output or image signal for recording, an external output means for outputting an image signal for external output, and recording an image signal for Z or recording
  • the corrected image signal can be recorded on a recording medium such as a flexible disk or a semiconductor memory card, or can be used for external video equipment etc. It can also be output.
  • the output signal from the camera signal processing means can be recorded on the recording medium by the recording / reproducing means, and the driving of the photographing lens detected by the detecting means at the time of the photographing is performed.
  • switching means for switching between an output signal from the camera signal processing means and an image signal from any external input means or recording / reproducing means, and The signal is supplied to the color signal conversion means, and the control means is provided with a user interface for making arbitrary settings for the conversion coefficient for enlargement or reduction and the center coordinate of the optical axis.
  • the correction process of the image signal recorded by the camera device can be performed well.
  • the recording medium reproduced by the recording / reproducing means includes, together with the image signal, the driving state of the photographing lens and the amount of camera shake detected by the detecting means at the time of photographing the image signal.
  • the recording medium is recorded using the same camera device. Recorded on Thus, the image signal can be satisfactorily corrected.
  • claim 6 of the present invention uses a means for enlarging or reducing an image for each color of a primary color signal, and a means for detecting a driving state of a photographing lens and a camera shake correction amount, According to the detection output, a conversion coefficient for enlarging or reducing the image and the center coordinate of the optical axis are controlled.
  • the output signal from the resolution conversion means is converted into an image signal for external output or recording, and an image signal for external output is output. And / or by recording the image signal for recording on a recording medium, the corrected image signal can be recorded on a recording medium such as a flexible disk or a semiconductor memory card, or can be recorded on an external video device or the like.
  • a recording medium such as a flexible disk or a semiconductor memory card
  • switching means for switching between an output signal from the camera signal processing means and an image signal from an arbitrary external input or a recording medium, and the signal from the switching means is reduced. At least three primary color signals are converted, and the image is enlarged or reduced for each color of the primary color signal, and the conversion coefficients for expansion or reduction and the optical axis By making arbitrary settings for the center coordinates, it is possible to satisfactorily correct the image signal recorded by another camera device.
  • the recording medium is recorded with the image signal and the information on the driving state of the photographing lens and the amount of camera shake correction detected at the time of photographing the image signal, and is reproduced.
  • the conversion coefficient for enlargement or reduction and the center coordinate of the optical axis in accordance with the information, the image signal recorded on the recording medium can be satisfactorily corrected using the same camera device. Things. BRIEF DESCRIPTION OF THE FIGURES
  • FIG. 1 is a block diagram showing a configuration of an embodiment of a video camera or a digital still camera to which the image photographing apparatus and the chromatic aberration correction method according to the present invention are applied.
  • FIG. 2 is a block diagram showing a configuration of an embodiment of the main part.
  • FIG. 3 is a diagram for explaining the operation.
  • FIG. 4 is a diagram for explaining chromatic aberration.
  • FIG. 5 is a block diagram for explaining conventional two-camera shake correction means.
  • FIG. 6 is a diagram for explaining the best mode for carrying out the invention.
  • the means for enlarging or reducing the image for each color of the primary color signal and the means for detecting the driving state of the imaging lens and the amount of camera shake correction are used to enlarge or reduce the image in accordance with the detection output.
  • the conversion coefficient and the optical axis center coordinate are controlled. Correction can be performed by processing the shadowed image signal, and good correction processing can be performed when camera shake correction is performed at the same time.
  • FIG. 1 shows the configuration of an embodiment of a video camera or a digital still camera to which an image capturing apparatus and a chromatic aberration correction method according to the present invention are applied. It is a block diagram '.
  • image light from a subject is focused through an imaging lens 1 onto an imaging surface of an imaging means 2 including a CCD, a CMOS sensor, or the like, and a luminance (Y) signal, for example, is obtained.
  • Y luminance
  • This image signal is supplied to the AZD conversion circuit 3, and the analog image signal is converted into digital image data.
  • the converted image data is supplied to a camera signal processing circuit 4, where signal processing such as so-called key correction is performed by digital processing, and a normal image signal used for general-purpose video equipment is used. Is formed. Further, an output signal from the force camera signal processing circuit 4 is selected by a switch 5 and supplied to a chromatic aberration corrector 6.
  • a chromatic aberration corrector 6 On the other hand, for example, using two sensors 7 P and 7 Y, pitch (P i t ch) and iodine (Y a w
  • Angular velocity due to camera shake in the direction is detected, and this detection signal is supplied to, for example, a camera shake correction vector calculator 9 of the control micro computer 8. Further, a driving state such as a zoom focal length and a focus position of the photographing lens 1 is detected and supplied to the conversion ratio calculating unit 10.
  • the driving state of the photographing lens 1 may be detected using, for example, an operation signal from a manual operation input unit 11 from a user.
  • the calculation in the camera shake correction vector calculation unit 9 of the control microcomputer 8 is shown in, for example, the above [FIG. 5].
  • an operation corresponding to the process shown by the dashed line is performed, whereby the angle information of the imaging lens 1 changed by the camera shake is extracted.
  • the camera shake correction vector calculated by the control microphone port computer 8 is supplied to, for example, the imaging means 2 to perform the camera shake correction.
  • a shift vector at the center of the optical axis of the photographing lens 1 is obtained from the camera shake correction vector and supplied to the chromatic aberration corrector 6. That is, the camera shake correction vector corresponds to the movement of the center of the optical axis of the photographing lens 1, and for example, the position at which an image signal is taken out from the imaging means 2 is controlled in accordance with the camera shake correction vector.
  • the shift vector at the center of the optical axis in the extracted image signal can be obtained.
  • the conversion ratio for each color calculated by the control microcomputer 8 is supplied to the chromatic aberration corrector 6. That is, for example, [FIG
  • Ratio of image change due to chromatic aberration K R, K B [Ratio of the size of the red (R) image when the size of the green (G) image is 1? :!? And the ratio (KB) of the size of the blue (B) image are determined according to the driving conditions such as the zoom focal length of the photographing lens 1, the force position, and the like.
  • the ratio KR, K B [Ratio of the size of the red (R) image when the size of the green (G) image is 1? :!?
  • KB the ratio of the size of the blue (B) image are determined according to the driving conditions such as the zoom focal length of the photographing lens 1, the force position, and the like.
  • the chromatic aberration corrector 6 performs processing such as that shown in FIG. That is, the signal from the switch 5 is supplied to the matrix operation circuit 21 and, for example, from the above-mentioned luminance (Y) signal and two color difference (Cb, Cr) signals, for example, the three primary colors (R , G, B) signal.
  • the converted three primary color (R, G, B) signals are written to the input side image memories 22 R, 22 G, 22 B, respectively, and the written image data is used to enlarge the image. Solution that performs Z reduction It is supplied to the image conversion circuit 23.
  • the resolution conversion circuit 23 is supplied with the above-mentioned conversion ratio data and shift vector data of the optical axis of the photographing lens.
  • the resolution conversion circuit 23 for each of the red (R), green (G), and blue (B) images, the light in the image is calculated according to the shift vector data of the optical axis of the photographing lens described above. The position of the axis center is determined, and resolution conversion for enlarging / reducing the image is performed centering on this position in accordance with the data of the conversion ratio described above.
  • the image data from the resolution conversion circuit 23 is written to the image memories 24 R, 24 G, 24 B on the output side.
  • the image memories 22R, 22G, 22B and 24R, 24G, 24B can be shared.
  • the image data written in the image memories 24 R, 24 G, and 24 B is read and supplied to the matrix operation circuit 25, for example, the three primary colors (R, The G, B) signal is converted into, for example, a luminance (Y) signal and two color difference (Cb, Cr) signals.
  • an image having chromatic aberration as shown at the left end of B of FIG. 3 is compared with an image formed by ideal imaging as shown at A of FIG. If supplied, this image is decomposed into the three primary colors (R, G, B), of which the red (R) image is reduced, for example, and the blue (B) image is enlarged, The size is made equal. Further, the images of these three primary colors (R, G, B) are recombined to form an image close to an ideal image formed by ideal imaging as shown at the right end of B of FIG.
  • the chromatic aberration corrector 6 re-creates an image close to an ideal image by the resolution conversion circuit 23 described above.
  • the image data is again converted into, for example, a luminance (Y) signal and two color difference (Cb, Cr) signals and is extracted.
  • the chromatic aberration corrector 6 The luminance (Y) signal and the two color difference (Cb, Cr) signals are selected as input signals to the chromatic aberration corrector 6 by the switching switches 12.
  • the signal selected by the switching switch 12 is supplied to the display processing circuit 13 and, for example, a luminance (Y) signal and two color difference (Cb, Cr) signals are converted into a predetermined display signal format.
  • the displayed image data is supplied to a display device 14 such as a liquid crystal display to perform display.
  • the signal selected by the switching switch 12 may be supplied to an external output means (not shown) and output to an external video device or the like.
  • the signal selected by the switch 12 is supplied to a data compression circuit 15, and the compressed image data is recorded through a data insertion circuit 16 into a flexible disk, a semiconductor memory, or the like. It is supplied to a medium recording / reproducing device 17. Further, a reproduced signal from the recording / reproducing device 17 is supplied to the data decompression circuit 18. Then, the expanded image data is supplied to the switching switch 5 so that it can be selected as the output signal from the above-mentioned force-measurement signal processing circuit 4.
  • the chromatic aberration is corrected by the chromatic aberration correction unit 6 and displayed on the display device 14, and the corrected image is displayed.
  • the image data is recorded on the recording medium by the recording / reproducing device 17.
  • the chromatic aberration corrector 6 corrects the chromatic aberration of the image data reproduced from the recording medium by the recording / reproducing device 17, and displays the image data on the display device 14. Is recorded on a recording medium by the recording / reproducing device 17.
  • the chromatic aberration of the image data is corrected and displayed on the display device 14, and the correction is performed.
  • Sa The image data recorded on the recording medium can be rewritten by the recording / reproducing device 17 using the obtained image data. That is, in continuous shooting, when there is no time to perform correction during shooting, only recording is performed, and correction is performed during reproduction, and the correction data can be re-recorded.
  • the data of the shift vector at the center of the optical axis at the time of shooting and the data of the conversion ratio are recorded together with the image data, so that the image data at the time of reproduction is recorded.
  • the chromatic aberration can be corrected smoothly.
  • the data of the shift vector around the optical axis from the camera shake correction vector calculation unit 9 and the conversion ratio data from the conversion ratio calculation unit 10 are data I / 0 circuits.
  • the data is converted into a predetermined data format, and the data is inserted into the image data from the data compression circuit 15 at a data insertion circuit 16 at a time. Further, at the time of reproduction, data included in a reproduction signal from the recording / reproducing device 17 is taken out by the data I / O circuit 19 and supplied to the chromatic aberration corrector 6.
  • an arbitrary user-to-interface input 20 is provided in the conversion ratio calculation unit 10.
  • the data of the conversion ratio is arbitrarily changed, and the correction ratio in the chromatic aberration correction unit 6 is changed.
  • the rate can be set arbitrarily.
  • this user interface input 20 It is possible to perform desired correction by using.
  • chromatic aberration compensation is performed by arbitrarily switching the selection of image data with the switching switch 12.
  • the image before the correction in the front part 6 and the image after the correction can be arbitrarily switched and displayed on the display device 14.
  • the image before correction and the image after correction can be easily compared, and the user's operation when performing desired correction can be smoothly performed.
  • the selection of the image data at the switching switch 12 is performed, for example, when the display device 14 is used as a view finder, or when the already corrected image data is passed through the chromatic aberration correction unit 6. It is also used when the image is projected on the display device 14 without being used. It is also used when performing only recording without performing correction during shooting such as continuous shooting described above. However, if the chromatic aberration corrector 6 is provided with a through mode that outputs the input as it is, it can be used instead of the switch 12.
  • means for enlarging or reducing an image for each color of the primary color signal, driving state of the photographing lens and camera shake By using a means for detecting the amount of correction and controlling a conversion coefficient for enlarging or reducing the image and the coordinates of the center of the optical axis in accordance with the detection output, image quality degradation caused by a miniaturized photographing lens is reduced. In addition to being able to make corrections by processing the captured image signal, good correction processing can be performed when camera shake correction is performed at the same time.
  • a photographing lens image pickup means for converting video light passing through the photographing lens into an electric image signal
  • camera signal processing means for processing the image signal
  • camera Color signal conversion means for converting or inversely converting the output signal from the signal processing means into at least three primary color signals
  • resolution conversion means for enlarging or reducing an image for each color of the primary color signal
  • driving state of camera lens and camera shake By providing detection means for detecting the amount of correction, and control means for controlling a conversion coefficient for enlargement or reduction by the resolution conversion means and an optical axis center coordinate in accordance with a detection output from the detection means, for example, It can very well compensate for image quality degradation caused by miniaturized photographic lenses.
  • a photographing lens an image pickup unit for converting video light passing through the photographing lens into an electric image signal
  • a force camera signal processing unit for processing the image signal.
  • Imaging equipment The chromatic aberration correction method according to the above, wherein the output signal from the camera signal processing means is converted into at least three primary color signals, and the image is enlarged or reduced for each color of the primary color signals.

Abstract

Quality deterioration caused by a small-sized pickup lens can be corrected by a processing of a picked up image signal and can perform preferable correction when performing camera shake correction. An output signal from a camera signal processing circuit (4) is selected by a selector switch (5) and supplied to a chromatic aberration correction unit (6). On the other hand, an angular speed by camera shake is detected by using sensors (7P, 7Y) and supplied to a camera shake correction vector calculation unit (9). Moreover, a drive state of a pickup lens (1) is supplied to a conversion ratio calculation unit (10). The shift vector at the center of the optical axis of the pickup lens (1) is calculated from the camera shake correction vector and supplied to the chromatic aberration correction unit (6). Moreover, the conversion ratio for each color is supplied to the chromatic aberration correction unit (6). Furthermore, the signal which has been corrected by the chromatic aberration correction unit (6) is compressed and supplied to a recording/reproduction device (17) to a recording medium. Moreover, the reproduction signal from the recording/reproduction device (17) is decompressed and supplied to the selector switch (5).

Description

明 細 書  Specification
画像撮影装置及び色収差補正方法 技術分野  Image capturing apparatus and chromatic aberration correction method
本発明は、 例えば撮影レンズを通った映像光を撮像する際に生 じる色収差の補正を良好に行う ことができるようにした 2画像撮 影装置及び色収差補正方法に係り、 特に、 例えばビデオカメ ラ、 あるいはデジタルスチルカメ ラに使用して好適な画像撮影装置及 び色収差補正方法に関する。 背景技術  The present invention relates to a two-image imaging apparatus and a chromatic aberration correction method capable of satisfactorily correcting chromatic aberration that occurs when, for example, imaging video light that has passed through a photographic lens. The present invention relates to an image capturing apparatus and a chromatic aberration correction method suitable for use in a digital still camera. Background art
例えばビデオカメ ラ、 あるいはデジタルスチルカメ ラにおいて は、 撮影レンズと、 この撮影レンズを通った映像光を電気的な画 像信号に変換する撮像手段と、 この画像信号を処理するカメ ラ信 号処理手段とが設け.られ、 このカメ ラ信号処理手段からの出力信 号が外部に出力されたり、 記録媒体に記録されたりするようにな されている。  For example, in the case of a video camera or a digital still camera, a photographic lens, imaging means for converting image light passing through the photographic lens into an electric image signal, and camera signal processing for processing the image signal Means is provided, and an output signal from the camera signal processing means is output to the outside or recorded on a recording medium.
ここで撮影レンズにはいわゆる光学レンズが用いられる。 そし てこの撮影レンズを通った被写体からの映像光が、 例えば分光フ ィ ル夕で赤 ( R ) 、 緑 ( G ) 、 青 ( B ) の光の 3原色に分離され 、 C C Dや C M O Sセンサ等からなる撮像手段の撮像面に結像さ れて電気的な画像信号への変換が行われる ものである。  Here, a so-called optical lens is used as the taking lens. Then, the image light from the subject passing through the photographing lens is separated into three primary colors of red (R), green (G), and blue (B) in a spectral filter, for example, such as a CCD or CMOS sensor. An image is formed on an image pickup surface of an image pickup means, and is converted into an electric image signal.
一方、 ビデオカメ ラあるいはデジタルスチルカメ ラにおいては 、 小型化が急速に進められ、 撮影レンズに対しても小型化が要求 されている。 このため撮影レンズの小型化については、 従来の多 枚数のレンズを組み合わせて用いる ものから、 1枚若し く は少枚 数の小型のものに置き換えることが多く なっている。 ところがこ のような小型化された撮影レンズでは、 いわゆる色収差などのレ ンズで生じる画質劣化を充分に抑えることが困難になつてく る。 すなわち光学レンズにおいては、 例えば分光フィ ル夕で分離さ れる赤 ( R ) 、 緑 ( G ) 、 青 ( B ) の各波長によってレンズでの 屈折率が異なるために、 例えば F I G . 4 に示すように、 緑 ( G ) の像に対して、 赤 (R ) の像は外側に、 青 ( B ) の像は内側に 結ぶ現象が起こる。 このため例えば白黒の被写体であってもその 像のエッ ジに色にじみ (色ずれ) を生じるという問題点があった そこでこのような倍率色収差 (横色収差とも呼ばれる) による 色にじみや解像度劣化などの画質劣化を抑えるために、 従来は多 枚数のレンズを組み合わせて、 撮影レンズ内で補正を行うように していたものである。 しかしながら上述のように小型化された撮 影レンズでは、 このような画質劣化を撮影レンズのみで充分に抑 える こ とが困難になっている。 On the other hand, video cameras and digital still cameras have been rapidly reduced in size, and there has been a demand for smaller photographic lenses. For this reason, the miniaturization of photographic lenses is increasingly replaced by one or a small number of small lenses instead of the conventional combination of many lenses. However, such miniaturized photographic lenses have so-called chromatic aberrations. It is difficult to sufficiently suppress the image quality deterioration caused by the lens. That is, in an optical lens, for example, since the refractive index of the lens differs depending on each wavelength of red (R), green (G), and blue (B) separated by a spectral filter, as shown in FIG. At the same time, for the green (G) image, the red (R) image is connected to the outside and the blue (B) image is connected to the inside. For this reason, for example, even a black-and-white subject has a problem that color blur (color shift) occurs at the edge of the image. Therefore, such color blur and resolution degradation due to chromatic aberration of magnification (also referred to as lateral chromatic aberration) are caused. In the past, in order to suppress image quality degradation, many lenses were combined to make corrections inside the taking lens. However, it is difficult for the miniaturized imaging lens as described above to sufficiently suppress such image quality deterioration only by the imaging lens.
これに対して、 上述のような倍率色収差による色にじみや解像 度劣化などの画質劣化を抑える手段と して、 例えば特開平 5 3 5 6 8号公報に開示された装置が先に提案されている。  On the other hand, as a means for suppressing image quality deterioration such as color blur and resolution deterioration due to the chromatic aberration of magnification as described above, for example, an apparatus disclosed in Japanese Patent Application Laid-Open No. 53568/1993 has been previously proposed. ing.
すなわちこの公報に開示された装置においては、 C C D (撮像 素子) から取り出される R、 G、 Bの各色別の映像信号を、 一旦 デジタルデ一夕に変換してそれぞれ個別のフィ 一ル ドメモリ に一 時記憶し、 さ らにズーム焦点距離、 フォーカス位置などの撮影レ ンズの駆動状態に基づいて、 各フィ —ル ドメモリ全体を個別にベ ク トル移動して各画像を拡大、 縮小し、 その後に再び R、 G、 B の合成を行う こ とにより、 ビデオカメ ラの撮影レンズで発生する 色ずれを捕正する ものである。  In other words, in the device disclosed in this publication, video signals for each color of R, G, and B taken out from a CCD (image pickup device) are temporarily converted into digital data and stored in individual field memories. Based on the driving status of the shooting lens, such as the zoom focal length and focus position, the entire field memory is individually vector-enlarged and scaled, and then each image is enlarged and reduced. By synthesizing R, G, and B again, color shift generated by the camera lens of the video camera is corrected.
と ころで小型のビデオカメ ラあるいはデジタルスチルカメ ラを 、 例えば手で持って撮影を行う場合には、 いわゆる手振れによる 画像の振動などの障害が発生する恐れがある。 そこでこのような 画像の振動などの障害を除去する目的で、 小型のビデオカメ ラあ るいはデジタルスチルカメ ラには、 いわゆる手振れ補正装置が搭 載されている。 F I G . 5 には、 そのような手振れ補正装置の搭 載されたビデオカメ ラ、 あるいはデジタルスチルカメ ラのブロ ッ ク図を示す。 In the case where a small video camera or digital still camera is used, for example, for photographing with a hand, there is a possibility that an obstacle such as vibration of an image due to a so-called camera shake may occur. So like this In order to remove obstacles such as image vibration, small video cameras or digital still cameras are equipped with a so-called image stabilization device. FIG. 5 shows a block diagram of a video camera or a digital still camera equipped with such an image stabilizer.
この F I G . 5 において、 被写体 (図示せず) からの映像光が 、 撮影レンズ 5 0 を通じて、 C C Dや C M O Sセンサ等からなる 撮像手段 5 1 の撮像面に結像されて、 例えば輝度 ( Y ) 信号と 2 つの色差 ( C b, C r ) 信号からなる電気的な画像信号への変換 が行われる。 この画像信号がカメ ラ信号処理回路 5 2 に供給され In this FIG. 5, image light from a subject (not shown) is imaged on an imaging surface of an imaging means 51 composed of a CCD, a CMOS sensor, or the like through an imaging lens 50, for example, a luminance (Y) signal. Is converted into an electrical image signal consisting of the two color difference (Cb, Cr) signals. This image signal is supplied to the camera signal processing circuit 52.
、 いわゆる ァ補正等の信号処理が行われて、 汎用の映像機器に使 用される通常の画像信号が形成される。 一方、 いわゆる手振れ を検出するために、 ここでは例えば 2個のジャイ ロセンサ 5 3 P 、 5 3 Yを用いてピッチ ( P i t c h ) 、 及びヨウ (Y a w ) 方 向の手振れによる角速度が検出される。 また、 撮影レンズ 5 0 か ら、 例えば使用者によって操作された撮影レンズ 5 0 のズーム焦 点距離が検出される。 なおズーム焦点距離の検出は、 例えば使用 者からの手動操作入力手段 5 4からの操作信号を用いてもよい。 Then, signal processing such as so-called correction is performed to form a normal image signal used in general-purpose video equipment. On the other hand, in order to detect so-called camera shake, here, for example, two gyro sensors 53P and 53Y are used to detect the pitch (Pitch) and the angular velocity due to the camera shake in the yaw (Yaw) direction. . Further, the zoom focal length of the photographing lens 50 operated by the user is detected from the photographing lens 50, for example. Note that the zoom focal length may be detected using, for example, an operation signal from a manual operation input unit 54 from a user.
そしてジャイ ロセンサ 5 3 P、 5 3 Yで検出された角速度の信 号がハイパスフィ ルタ ( H P F ) 5 5 P、 5 5 Yに供給されて直 流成分が除去され、 一方、 上述のズーム焦点距離のデータがテー ブル 5 6 に供給されて、 これらのデータから必要な演算係数が求 められ、 この演算係数が乗算器 5 7 P、 5 7 Yに供給されてハイ ノ、。スフイ ノレ夕 5 5 P、 5 5 Yからの信号に乗算される。 さ らに乗 算器 5 7 P、 5 7 Yの出力信号が、 それぞれ積分器 5 8 P、 5 8 The angular velocity signals detected by the gyro sensors 53P and 53Y are supplied to high-pass filters (HPF) 55P and 55Y to remove the direct current component. The data is supplied to a table 56, from which the necessary operation coefficients are obtained, and the operation coefficients are supplied to multipliers 57P, 57Y, so that the data is calculated. Signals from the 55 P and 55 Y are multiplied. In addition, the output signals of multipliers 57 P and 57 Y are output to integrators 58 P and 58, respectively.
Yに供給される。 Supplied to Y.
従ってこれらの積分器 5 8 P、 5 8 Yからは、 手振れによって 変動された撮影レンズ 5 0 の角度情報が取り出される。 そこでこ の手振れの角度情報がリ ミ ッタ回路 5 9 P、 5 9 Yを通じて例え ば撮像手段 5 1 に供給されて、 この撮像手段 5 1からの画像信号 の取り出される位置が制御される。 すなわち例えば撮像手段 5 1 には本来の画像の大きさより広い撮像面が設けられ、 この撮像面 の中から手振れによる変動を相殺するように必要な画像が取り出 される。 Therefore, from these integrators 58 P and 58 Y, angle information of the photographing lens 50 fluctuated by camera shake is extracted. There The camera shake angle information is supplied to, for example, the image pickup means 51 through the limiter circuits 59 P and 59 Y, and the position where the image signal from the image pickup means 51 is extracted is controlled. That is, for example, the imaging means 51 is provided with an imaging surface wider than the original image size, and an image necessary for canceling the fluctuation due to camera shake is taken out of the imaging surface.
このようにして小型のビデオカメラあるいはデジタルスチルカ メ ラ等においては、 いわゆる手振れ補正が行われている。 なお手 振れ補正を行う手段としては、 上述の撮像手段 5 1からの画像信 号の取り出し位置の制御の他に、 撮像手段 5 1で撮像された画像 信号を一旦全てメ モリ 6 0 に記憶させ、 このメ モリ 6 0からの画 像信号の読み出し位置を制御する方法や、 撮影レンズ 5 0 の一部 のレンズの位置をシフ ト して補正する方法も実施されている。  Thus, in a small video camera, a digital still camera, or the like, so-called camera shake correction is performed. As means for performing camera shake correction, in addition to the control of the extraction position of the image signal from the imaging means 51, the image signals captured by the imaging means 51 are temporarily stored in the memory 60. In addition, a method of controlling a reading position of an image signal from the memory 60 and a method of shifting and correcting a part of the lens of the photographing lens 50 are also implemented.
また、 手振れによって変動された撮影レンズ 5 0 の角度情報を 取り出す手段と しては、 上述のジャイロセンサ 5 3 P、 5 3 Yを 用いる手段の他に、 例えば F I G . 6に示すように撮像手段 5 1 からの画像信号をフ レームメ モリ 6 1 に記憶させ、 このフ レーム メ モ リ 6 1 の前後の画像信号を比較回路 6 2で比較して、 背景等 の画像の移動から手振れの角度情報を算出することもできる。 な おこの算出された手振れの角度情報は、 上述の全ての手振れ補正 手段で使用することができる。  As means for extracting the angle information of the photographing lens 50 fluctuated by camera shake, in addition to the means using the gyro sensors 53P and 53Y, for example, as shown in FIG. 5 The image signal from 1 is stored in the frame memory 61, and the image signal before and after this frame memory 61 is compared by the comparison circuit 62. Can also be calculated. The calculated camera shake angle information can be used in all of the above-described camera shake correction means.
ところがこのような手振れ補正を行っている場合に、 例えば上 述の公報に開示された装置を用いて、 倍率色収差による色にじみ や解像度劣化などの画質劣化の補正を行おう とすると、 充分な補 正を行う ことができないことが判明した。 すなわち上述の装置に おいて、 各フィ ール ドメ モリ全体を個別にべク トル移動する際に は、 その中心を撮影レンズの光軸に一致させて行う ものであるが 、 手振れ補正を行う と光軸の位置が移動されて中心を一致させる ことが困難になる。 However, in the case where such camera shake correction is performed, if an attempt is made to correct image quality deterioration such as color blur due to chromatic aberration of magnification or resolution deterioration using the apparatus disclosed in the above-mentioned publication, sufficient compensation is required. It proved impossible to do the right thing. That is, in the above-described apparatus, when the entire field memory is individually vector-moved, the center of the field memory is made coincident with the optical axis of the photographing lens. The position of the optical axis is moved to match the center It becomes difficult.
このため従来は、 色収差等の画質劣化の補正と手振れ補正を同 時には行う ことができないものであった。 ただし従来の画素数の 少ない機種にあっては、 特に手振れ補正を伴うような撮影では色 収差等の画質劣化が目立つことも少ないものであった。 しかしな がら近年、 撮影画素数の増加が求められた結果、 あらゆる状況に おいて色収差等の画質劣化の影響が顕著になつてきているもので る o  For this reason, conventionally, it has not been possible to simultaneously perform correction of image quality deterioration such as chromatic aberration and camera shake correction. However, in conventional models with a small number of pixels, image quality deterioration such as chromatic aberration was hardly noticeable especially in shooting involving camera shake correction. However, in recent years, as the number of photographed pixels has been required to increase, the effects of image quality deterioration such as chromatic aberration have become remarkable in all situations.o
この出願はこのような点に鑑みて成されたものであって、 解決 しょう とする問題点は、 従来の手段では、 撮影レンズの小型化な どによつて、 倍率色収差による色にじみや解像度劣化などの画質 劣化の問題が生じ、 このような画質劣化を撮影レンズのみでは充 分に抑えることが困難になっており、 特に、 このような画質劣化 の補正を各色別の画像を拡大、 縮小することにより行っている場 合には、 同時に手振れ補正を行う ことができないなど問題点があ つたという ものである。 発明の開示  The present application has been made in view of such a point, and the problem to be solved is that, with conventional means, color blur and resolution degradation due to chromatic aberration of magnification due to downsizing of a taking lens and the like. It is difficult to sufficiently suppress such image quality degradation using only the taking lens.In particular, to correct such image quality degradation, enlarge or reduce the image for each color. However, if this is done, there was a problem that camera shake correction could not be performed at the same time. Disclosure of the invention
本発明の請求の範囲第 1項は、 原色信号の各色ごとに画像の拡 大または縮小を行う手段と、 撮影レンズの駆動状態及び手振れ補 正量を検出する手段とを用いて、 検出出力に応じて画像の拡大ま たは縮小の変換係数及び光軸中心座標を制御するようにしたもの であ 。  Claim 1 of the present invention provides a detection output using a means for enlarging or reducing an image for each color of a primary color signal and a means for detecting a driving state of a photographing lens and a camera shake correction amount. According to this, the conversion coefficient of the enlargement or reduction of the image and the coordinates of the optical axis center are controlled.
これによつて、 小型化された撮影レンズで生じる画質劣化を、 撮影された画像信号に対する処理で補正することができると共に This makes it possible to correct image quality degradation caused by a miniaturized photographing lens by processing the photographed image signal, and
、 同時に手振れ補正を行う場合にも、 良好な補正処理を行う こと ができるものである。 However, even when the image stabilization is performed at the same time, it is possible to perform a good correction process.
また、 本発明の請求の範囲第 2項によれば、 解像度変換手段か らの出力信号を外部出力用若しく は記録用の画像信号に変換また は逆変換する信号変換手段と、 外部出力用の画像信号を出力する 外部出力手段及び Zまたは記録用の画像信号を記録媒体に記録ま たは再生する記録再生手段とを備えたことによって、 補正処理さ れた画像信号をフレキシブルディ スクや半導体メモリ力一 ド等の 記録媒体へ記録したり、 外部の映像機器等に出力することもでき る ものである。 According to claim 2 of the present invention, the resolution conversion means Signal conversion means for converting or inverting these output signals to an external output or image signal for recording, an external output means for outputting an image signal for external output, and recording an image signal for Z or recording By providing recording / reproducing means for recording / reproducing on a medium, the corrected image signal can be recorded on a recording medium such as a flexible disk or a semiconductor memory card, or can be used for external video equipment etc. It can also be output.
本発明の請求の範囲第 3項によれば、 カメラ信号処理手段から の出力信号を記録再生手段にて記録媒体に記録できるようにする と共に、 その撮影時に検出手段で検出された撮影レンズの駆動状 態及び手振れ補正量の情報をカメ ラ信号処理手段からの出力信号 と共に記録媒体に記録することによって、 連写などにおいて補正 処理を行う時間がない場合にも良好な画像信号の記録を行うこと ができる ものである。  According to claim 3 of the present invention, the output signal from the camera signal processing means can be recorded on the recording medium by the recording / reproducing means, and the driving of the photographing lens detected by the detecting means at the time of the photographing is performed. By recording information on the state and the amount of camera shake correction together with the output signal from the camera signal processing means on a recording medium, it is possible to record good image signals even when there is no time to perform correction processing in continuous shooting etc. Can be done.
本発明の請求の範囲第 4項によれば、 カメラ信号処理手段から の出力信号と任意の外部入力手段若しく は記録再生手段からの画 像信号とを切り替える切り替え手段を備え、 切り替え手段からの 信号を色信号変換手段に供給すると共に、 制御手段には拡大また は縮小の変換係数及び光軸中心座標に対して任意の設定を行うた めのユーザ一イ ンタ一フェースを設けることによって、 他のカメ ラ装置で記録された画像信号の補正処理も良好に行うことができ る ものである。  According to claim 4 of the present invention, there is provided switching means for switching between an output signal from the camera signal processing means and an image signal from any external input means or recording / reproducing means, and The signal is supplied to the color signal conversion means, and the control means is provided with a user interface for making arbitrary settings for the conversion coefficient for enlargement or reduction and the center coordinate of the optical axis. The correction process of the image signal recorded by the camera device can be performed well.
本発明の請求の範囲第 5項によれば、 記録再生手段で再生され る記録媒体には、 画像信号と共に、 その画像信号の撮影時に検出 手段で検出された撮影レンズの駆動状態及び手振れ補正量の情報 が記録され、 記録再生手段で再生される情報に応じて解像度変換 手段での拡大または縮小の変換係数及び光軸中心座標を制御する こ とによって、 同一のカメ ラ装置を用いて記録媒体に記録された 画像信号の補正処理を良好に行う ことができるものである。 According to claim 5 of the present invention, the recording medium reproduced by the recording / reproducing means includes, together with the image signal, the driving state of the photographing lens and the amount of camera shake detected by the detecting means at the time of photographing the image signal. By controlling the conversion coefficient for enlargement or reduction by the resolution conversion means and the coordinate of the optical axis center according to the information reproduced by the recording / reproduction means, the recording medium is recorded using the same camera device. Recorded on Thus, the image signal can be satisfactorily corrected.
さ らに本発明の請求の範囲第 6項は、 原色信号の各色ごとに画 像の拡大または縮小を行う手段と、 撮影レンズの駆動状態及び手 振れ補正量を検出する手段とを用いて、 検出出力に応じて画像の 拡大または縮小の変換係数及び光軸中心座標を制御するようにし たものである。  Further, claim 6 of the present invention uses a means for enlarging or reducing an image for each color of a primary color signal, and a means for detecting a driving state of a photographing lens and a camera shake correction amount, According to the detection output, a conversion coefficient for enlarging or reducing the image and the center coordinate of the optical axis are controlled.
これによつて、 小型化された撮影レンズで生じる画質劣化を、 撮影された画像信号に対する処理で補正することができると共に 、 同時に手振れ補正を行う場合にも、 良好な補正処理を行う こと ができる ものである。  As a result, it is possible to correct the image quality degradation caused by the miniaturized photographing lens by processing the photographed image signal, and to perform a good correction process even when performing camera shake correction at the same time. Things.
また、 本発明の請求の範囲第 7項によれば、 解像度変換手段か らの出力信号を外部出力用若し く は記録用の画像信号に変換し、 外部出力用の画像信号を出力するか、 及び/または記録用の画像 信号を記録媒体に記録することによって、 補正処理された画像信 号をフレキシブルディ スクや半導体メモリ 力一 ド等の記録媒体へ 記録したり、 外部の映像機器等に出力することもできるものであ 本発明の請求の範囲第 8項によれば、 カメラ信号処理手段から の出力信号を記録媒体に記録できるようにすると共に、 その撮影 時に検出された撮影レンズの駆動状態及び手振れ補正量の情報を 出力信号と共に記録媒体に記録することによって、 連写などにお いて補正処理を行う時間がない場合にも良好な画像信号の記録を 行う ことができる ものである。  According to claim 7 of the present invention, the output signal from the resolution conversion means is converted into an image signal for external output or recording, and an image signal for external output is output. And / or by recording the image signal for recording on a recording medium, the corrected image signal can be recorded on a recording medium such as a flexible disk or a semiconductor memory card, or can be recorded on an external video device or the like. According to claim 8 of the present invention, it is possible to record an output signal from the camera signal processing means on a recording medium and to drive a photographing lens detected at the time of photographing. By recording the information of the state and the amount of camera shake correction together with the output signal on a recording medium, it is possible to record a good image signal even when there is no time for performing the correction processing in continuous shooting or the like. It is.
本発明の請求の範囲第 9項によれば、 カメラ信号処理手段から の出力信号と任意の外部入力若しく は記録媒体からの画像信号と を切り替える切り替え手段を備え、 切り替え手段からの信号を少 なく とも 3原色信号に変換し、 原色信号の各色ごとに画像の拡大 または縮小を行う と共に、 拡大または縮小の変換係数及び光軸中 心座標に対して任意の設定が行われるようにすることによって、 他のカメ ラ装置で記録された画像信号の補正処理も良好に行う こ とができるものである。 According to claim 9 of the present invention, there is provided switching means for switching between an output signal from the camera signal processing means and an image signal from an arbitrary external input or a recording medium, and the signal from the switching means is reduced. At least three primary color signals are converted, and the image is enlarged or reduced for each color of the primary color signal, and the conversion coefficients for expansion or reduction and the optical axis By making arbitrary settings for the center coordinates, it is possible to satisfactorily correct the image signal recorded by another camera device.
本発明の請求の範囲第 1 0項によれば、 記録媒体には、 画像信 号と共に、 その画像信号の撮影時に検出された撮影レンズの駆動 状態及び手振れ補正量の情報が記録され、 再生される情報に応じ て拡大または縮小の変換係数及び光軸中心座標を制御することに よって、 同一のカメ ラ装置を用いて記録媒体に記録された画像信 号の補正処理を良好に行う ことができるものである。 図面の簡単な説明  According to claim 10 of the present invention, the recording medium is recorded with the image signal and the information on the driving state of the photographing lens and the amount of camera shake correction detected at the time of photographing the image signal, and is reproduced. By controlling the conversion coefficient for enlargement or reduction and the center coordinate of the optical axis in accordance with the information, the image signal recorded on the recording medium can be satisfactorily corrected using the same camera device. Things. BRIEF DESCRIPTION OF THE FIGURES
F I G . 1 は、 本発明による画像撮影装置及び色収差補正方法を 適用したビデオカメラ、 あるいはデジタルスチルカメ ラの一実施 形態の構成を示すブロ ック図である。  FIG. 1 is a block diagram showing a configuration of an embodiment of a video camera or a digital still camera to which the image photographing apparatus and the chromatic aberration correction method according to the present invention are applied.
F I G . 2 は、 その要部の一実施形態の構成を示すブロッ ク図で ある。  FIG. 2 is a block diagram showing a configuration of an embodiment of the main part.
F I G 3 は その動作の説明のための図である。  FIG. 3 is a diagram for explaining the operation.
F I G 4 は 色収差の説明のための図である。 FIG. 4 is a diagram for explaining chromatic aberration.
F I G 5 は 従来の 2手振れ補正手段の説明のためのプロック 図である。 FIG. 5 is a block diagram for explaining conventional two-camera shake correction means.
F I G . 6 は その説明のための図である 発明を実施するための最良の形態。 FIG. 6 is a diagram for explaining the best mode for carrying out the invention.
本発明においては、 原色信号の各色ごとに画像の拡大または縮 小を行う手段と、 撮影レンズの駆動状態及び手振れ補正量を検出 する手段とを用いて、 検出出力に応じて画像の拡大または縮小の 変換係数及び光軸中心座標を制御するようにしたものであって、 これによれば、 小型化された撮影レンズで生じる画質劣化を、 撮 影された画像信号に対する処理で補正するこ とができると共に、 同時に手振れ補正を行う場合にも、 良好な補正処理を行う ことが できる。 In the present invention, the means for enlarging or reducing the image for each color of the primary color signal and the means for detecting the driving state of the imaging lens and the amount of camera shake correction are used to enlarge or reduce the image in accordance with the detection output. In this case, the conversion coefficient and the optical axis center coordinate are controlled. Correction can be performed by processing the shadowed image signal, and good correction processing can be performed when camera shake correction is performed at the same time.
以下、 図面を参照して本発明を説明するに、 F I G. 1 は本発 明による画像撮影装置及び色収差補正方法を適用したビデオカメ ラ、 あるいはデジタルスチルカメ ラの一実施形態の構成を示すブ 口 ッ ク図である'。  Hereinafter, the present invention will be described with reference to the drawings. FIG. 1 shows the configuration of an embodiment of a video camera or a digital still camera to which an image capturing apparatus and a chromatic aberration correction method according to the present invention are applied. It is a block diagram '.
F I G. 1 において、 被写体 (図示せず) からの映像光が、 撮 影レンズ 1を通じて、 C C Dや C M O Sセンサ等からなる撮像手 段 2 の撮像面に結像されて、 例えば輝度 (Y) 信号と 2つの色差 ( C b, C r ) 信号からなる電気的な画像信号への変換が行われ る c In FIG. 1, image light from a subject (not shown) is focused through an imaging lens 1 onto an imaging surface of an imaging means 2 including a CCD, a CMOS sensor, or the like, and a luminance (Y) signal, for example, is obtained. Is converted to an electrical image signal consisting of two color difference (Cb, Cr ) signals.
この画像信号が AZD変換回路 3に供給されて、 アナログ形式 の画像信号がデジタル形式の画像データに変換される。 そ してこ の変換された画像データが、 カメ ラ信号処理回路 4に供給され、 いわゆる ァ補正等の信号処理がデジ夕ル処理で行われて、 汎用の 映像機器に使用される通常の画像信号が形成される。 さ らにこの 力メ ラ信号処理回路 4からの出力信号が切り替えスィ ッチ 5で選 択されて色収差補正部 6 に供給される。 一方、 例えば 2個のセ ンサ 7 P、 7 Yを用いてピッチ ( P i t c h ) 及びヨウ (Y a w This image signal is supplied to the AZD conversion circuit 3, and the analog image signal is converted into digital image data. The converted image data is supplied to a camera signal processing circuit 4, where signal processing such as so-called key correction is performed by digital processing, and a normal image signal used for general-purpose video equipment is used. Is formed. Further, an output signal from the force camera signal processing circuit 4 is selected by a switch 5 and supplied to a chromatic aberration corrector 6. On the other hand, for example, using two sensors 7 P and 7 Y, pitch (P i t ch) and iodine (Y a w
) 方向の手振れによる角速度が検出され、 この検出信号が例えば 制御用マイ ク ロコ ンピュータ 8の手振れ補正べク トル算出部 9 に 供給される。 また撮影レンズ 1のズーム焦点距離、 フォーカス位 置などの駆動状態が検出されて、 変換比率算出部 1 0に供給され る。 なお撮影レンズ 1 の駆動状態の検出には、 例えば使用者から の手動操作入力手段 1 1からの操作信号を用いてもよい。 ) Angular velocity due to camera shake in the direction is detected, and this detection signal is supplied to, for example, a camera shake correction vector calculator 9 of the control micro computer 8. Further, a driving state such as a zoom focal length and a focus position of the photographing lens 1 is detected and supplied to the conversion ratio calculating unit 10. The driving state of the photographing lens 1 may be detected using, for example, an operation signal from a manual operation input unit 11 from a user.
そして例えば制御用マイク ロコ ンピュータ 8の手振れ補正べク 卜ル算出部 9での演算は、 例えば上述の 〔 F I G. 5〕 に示した 回路構成の中で、 一点鎖線で囲って示した処理に相当する演算が 行われる ものであって、 これにより手振れによって変動された撮 影レンズ 1 の角度情報が取り出される。 さ らにこの制御用マイ ク 口 コ ンピュータ 8 で算出された手振れ補正べク トルが例えば撮像 手段 2 に供給されて手振れ補正が行われる。 For example, the calculation in the camera shake correction vector calculation unit 9 of the control microcomputer 8 is shown in, for example, the above [FIG. 5]. In the circuit configuration, an operation corresponding to the process shown by the dashed line is performed, whereby the angle information of the imaging lens 1 changed by the camera shake is extracted. Further, the camera shake correction vector calculated by the control microphone port computer 8 is supplied to, for example, the imaging means 2 to perform the camera shake correction.
それと共に、 この手振れ補正べク 卜ルから撮影レンズ 1 の光軸 中心のシフ トべク 卜ルが求められて色収差補正部 6 に供給される 。 すなわち手振れ補正べク トルは撮影レンズ 1 の光軸中心の移動 に相当する ものであり、 この手振れ補正べク トルに従って例えば 撮像手段 2 からの画像信号の取り出し位置が制御されている。 そ こでこの手振れ補正べク トルの符号の正負を反転することにより 、 取り出される画像信号中の光軸中心のシフ 卜べク トルが求めら れる ものである。  At the same time, a shift vector at the center of the optical axis of the photographing lens 1 is obtained from the camera shake correction vector and supplied to the chromatic aberration corrector 6. That is, the camera shake correction vector corresponds to the movement of the center of the optical axis of the photographing lens 1, and for example, the position at which an image signal is taken out from the imaging means 2 is controlled in accordance with the camera shake correction vector. Thus, by inverting the sign of the shake correction vector, the shift vector at the center of the optical axis in the extracted image signal can be obtained.
さ らに制御用マイ ク ロコ ン ピュータ 8で算出された各色別の変 換比率が色収差補正部 6 に供給される。 すなわち例えば 〔 F I G Further, the conversion ratio for each color calculated by the control microcomputer 8 is supplied to the chromatic aberration corrector 6. That is, for example, [FIG
. 4〕 に示した色収差による画像の変化の比率 K R 、 K B 〔緑 ( G ) の画像の大きさを 1 と したと きの赤 (R ) の画像の大きさの 比率?:!? と、 青 ( B ) の画像の大きさの比率 K B 〕 は、 撮影レン ズ 1 のズーム焦点距離、 フォー力ス位置などの駆動状態に応じて 定まる ものであり、 これらの駆動状態の検出信号から比率 K R 、.4] Ratio of image change due to chromatic aberration K R, K B [Ratio of the size of the red (R) image when the size of the green (G) image is 1? :!? And the ratio (KB) of the size of the blue (B) image are determined according to the driving conditions such as the zoom focal length of the photographing lens 1, the force position, and the like. The ratio KR,
K B を求める ことができる。 K B can be obtained.
そ して色収差補正部 6 では、 例えば F I G . に示すような処 理が行われる。 すなわちスィ ッチ 5からの信号がマ 卜 リ クス演算 回路 2 1 に供給されて、 例えば上述の輝度 ( Y ) 信号と 2つの色 差 ( C b, C r ) 信号から、 例えば 3原色 (R , G , B ) 信号へ の変換が行われる。 この変換された 3原色 (R, G , B ) 信号が 、 それぞれ入力側の画像メ モ リ 2 2 R, 2 2 G , 2 2 Bに書き込 まれ、 この書き込まれた画像データが画像の拡大 Z縮小を行う解 像度変換回路 2 3 に供給される。 Then, the chromatic aberration corrector 6 performs processing such as that shown in FIG. That is, the signal from the switch 5 is supplied to the matrix operation circuit 21 and, for example, from the above-mentioned luminance (Y) signal and two color difference (Cb, Cr) signals, for example, the three primary colors (R , G, B) signal. The converted three primary color (R, G, B) signals are written to the input side image memories 22 R, 22 G, 22 B, respectively, and the written image data is used to enlarge the image. Solution that performs Z reduction It is supplied to the image conversion circuit 23.
さ らにこの解像度変換回路 2 3 には、 上述の変換比率のデータ と撮影レンズの光軸のシフ 卜べク トルのデータとが供給される。 そしてこの解像度変換回路 2 3 では、 赤 ( R) 、 緑 (G) 、 青 ( B ) の各画像ごとに、 上述の撮影レンズの光軸のシフ トべク トル のデータに従って画像の中の光軸中心の位置が定められ、 この位 置を中心に上述の変換比率のデータに従って画像の拡大/縮小を 行う解像度変換が行われる。  Further, the resolution conversion circuit 23 is supplied with the above-mentioned conversion ratio data and shift vector data of the optical axis of the photographing lens. In the resolution conversion circuit 23, for each of the red (R), green (G), and blue (B) images, the light in the image is calculated according to the shift vector data of the optical axis of the photographing lens described above. The position of the axis center is determined, and resolution conversion for enlarging / reducing the image is performed centering on this position in accordance with the data of the conversion ratio described above.
またこの解像度変換回路 2 3 からの画像データが出力側の画像 メモリ 2 4 R, 2 4 G, 2 4 Bに書き込まれる。 なお、 画像メ モ リ 2 2 R, 2 2 G, 2 2 B と 2 4 R, 2 4 G , 2 4 B とは共通化 が可能である。 さ らに画像メ モ リ 2 4 R, 2 4 G, 2 4 Bに書き 込まれた画像データが読み出され、 マ ト リ クス演算回路 2 5 に供 給されて、 例えば 3原色 (R, G, B ) 信号から、 例えば輝度 ( Y) 信号と 2 つの色差 ( C b, C r ) 信号に変換される。  The image data from the resolution conversion circuit 23 is written to the image memories 24 R, 24 G, 24 B on the output side. The image memories 22R, 22G, 22B and 24R, 24G, 24B can be shared. Further, the image data written in the image memories 24 R, 24 G, and 24 B is read and supplied to the matrix operation circuit 25, for example, the three primary colors (R, The G, B) signal is converted into, for example, a luminance (Y) signal and two color difference (Cb, Cr) signals.
これによつて解像度変換回路 2 3では、 例えば F I G. 3 の A に示すような理想的な結像による画像に対して、 F I G. 3 の B の左端に示すような色収差のある画像が供給されている場合に、 この画像が 3原色 ( R, G, B ) に分解され、 その内の例えば赤 ( R) の画像が縮小され、 青 ( B ) の画像が拡大されて各画像の 大きさが等し く される。 さ らにこれらの 3原色 (R, G, B ) の 画像が再合成されて、 F I G. 3 の Bの右端に示すような理想的 な結像による画像に近い画像が形成される。  Accordingly, in the resolution conversion circuit 23, for example, an image having chromatic aberration as shown at the left end of B of FIG. 3 is compared with an image formed by ideal imaging as shown at A of FIG. If supplied, this image is decomposed into the three primary colors (R, G, B), of which the red (R) image is reduced, for example, and the blue (B) image is enlarged, The size is made equal. Further, the images of these three primary colors (R, G, B) are recombined to form an image close to an ideal image formed by ideal imaging as shown at the right end of B of FIG.
さ らにこの画像データがマ ト リ クス演算回路 2 5 に供給される ことによって、 色収差補正部 6 からは、 上述の解像度変換回路 2 3 で理想的な結像に近い画像に再形成された画像データが、 例え ば輝度 ( Y) 信号と 2つの色差 ( C b, C r ) 信号に再び変換さ れて取り出される。 そ してこの色収差補正部 6から取り出された 輝度 (Y ) 信号と 2 つの色差 ( C b , C r ) 信号が、 切り替えス イ ッチ 1 2 で色収差補正部 6への入力信号と選択される。 Further, by supplying this image data to the matrix operation circuit 25, the chromatic aberration corrector 6 re-creates an image close to an ideal image by the resolution conversion circuit 23 described above. The image data is again converted into, for example, a luminance (Y) signal and two color difference (Cb, Cr) signals and is extracted. The chromatic aberration corrector 6 The luminance (Y) signal and the two color difference (Cb, Cr) signals are selected as input signals to the chromatic aberration corrector 6 by the switching switches 12.
この切り替えスィ ッチ 1 2 で選択された信号が表示処理回路 1 3 に供給され、 例えば輝度 ( Y ) 信号と 2 つの色差 (C b, C r ) 信号が所定の表示信号の形式に変換された画像データが液晶デ イ スプレイ等の表示装置 1 4 に供給されて表示が行われる。 ある いはこの切り替えスィ ツチ 1 2 で選択された信号が外部出力手段 (図示せず) に供給されて、 外部の映像機器等に出力されるよう にする こ と もできる。  The signal selected by the switching switch 12 is supplied to the display processing circuit 13 and, for example, a luminance (Y) signal and two color difference (Cb, Cr) signals are converted into a predetermined display signal format. The displayed image data is supplied to a display device 14 such as a liquid crystal display to perform display. Alternatively, the signal selected by the switching switch 12 may be supplied to an external output means (not shown) and output to an external video device or the like.
また、 切り替えスィ ッチ 1 2 で選択された信号がデータ圧縮回 路 1 5 に供給され、 圧縮された画像データがデータ挿入回路 1 6 を通じてフ レキシブルディ スクゃ半導体メ モリ 力一 ド等の記録媒 体への記録再生装置 1 7 に供給される。 さ らに記録再生装置 1 7 からの再生信号がデータ伸張回路 1 8 に供給される。 そして伸張 された画像データが切り替えスィ ッチ 5 に供給されて、 上述の力 メ ラ信号処理回路 4 からの出力信号と選択することができるよう にされている。  The signal selected by the switch 12 is supplied to a data compression circuit 15, and the compressed image data is recorded through a data insertion circuit 16 into a flexible disk, a semiconductor memory, or the like. It is supplied to a medium recording / reproducing device 17. Further, a reproduced signal from the recording / reproducing device 17 is supplied to the data decompression circuit 18. Then, the expanded image data is supplied to the switching switch 5 so that it can be selected as the output signal from the above-mentioned force-measurement signal processing circuit 4.
従ってこの装置においては、 例えば撮像手段 2で撮像された画 像デ一夕に対しては、 色収差補正部 6 で色収差が補正されて表示 装置 1 4 での表示が行われると共に、 この補正された画像データ が記録再生装置 1 7 で記録媒体に記録される。 また記録再生装置 1 7 で記録媒体から再生された画像データに対しても、 色収差補 正部 6 で色収差が補正されて表示装置 1 4 での表示が行われると 共に、 この補正された画像データが記録再生装置 1 7で記録媒体 に記録される。  Therefore, in this apparatus, for example, with respect to the image data captured by the imaging means 2, the chromatic aberration is corrected by the chromatic aberration correction unit 6 and displayed on the display device 14, and the corrected image is displayed. The image data is recorded on the recording medium by the recording / reproducing device 17. The chromatic aberration corrector 6 corrects the chromatic aberration of the image data reproduced from the recording medium by the recording / reproducing device 17, and displays the image data on the display device 14. Is recorded on a recording medium by the recording / reproducing device 17.
これによつて、 例えば撮影時に色収差が補正されずに記録媒体 に記録された画像データに対しても、 この画像データの色収差が 補正されて表示装置 1 4 での表示が行われると共に、 この補正さ れた画像データを用いて記録再生装置 1 7 で記録媒体に記録され た画像データの書き換えることができる。 すなわち、 連写などに おいて撮影時に補正を行う時間がないときには記録のみを行い、 再生時に補正を行ってその補正データの再記録を行う こと もでき る ものである。 As a result, for example, even for image data recorded on a recording medium without correcting chromatic aberration at the time of shooting, the chromatic aberration of the image data is corrected and displayed on the display device 14, and the correction is performed. Sa The image data recorded on the recording medium can be rewritten by the recording / reproducing device 17 using the obtained image data. That is, in continuous shooting, when there is no time to perform correction during shooting, only recording is performed, and correction is performed during reproduction, and the correction data can be re-recorded.
そしてこの場合には、 例えば撮影時の光軸中心のシフ トべク 卜 ルのデータ と、 変換比率のデータ とを、 画像データと一緒に記録 しておく こ とによって、 再生時の画像データの色収差の補正処理 を円滑に行う こ とができるものである。  In this case, for example, the data of the shift vector at the center of the optical axis at the time of shooting and the data of the conversion ratio are recorded together with the image data, so that the image data at the time of reproduction is recorded. The chromatic aberration can be corrected smoothly.
すなわち上述の装置において、 例えば手振れ補正べク トル算出 部 9 からの光軸中心のシフ 卜べク トルのデ一夕 と、 変換比率算出 部 1 0 からの変換比率のデータがデータ I / 0回路 1 9 で所定の データ形式にされて、 デ一夕挿入回路 1 6 でデータ圧縮回路 1 5 からの画像データに挿入される。 さ らに再生時には、 記録再生装 置 1 7 からの再生信号に含まれるデータがデータ I ノ0回路 1 9 で取り出されて色収差補正部 6 に供給される。  That is, in the above-described apparatus, for example, the data of the shift vector around the optical axis from the camera shake correction vector calculation unit 9 and the conversion ratio data from the conversion ratio calculation unit 10 are data I / 0 circuits. At 19, the data is converted into a predetermined data format, and the data is inserted into the image data from the data compression circuit 15 at a data insertion circuit 16 at a time. Further, at the time of reproduction, data included in a reproduction signal from the recording / reproducing device 17 is taken out by the data I / O circuit 19 and supplied to the chromatic aberration corrector 6.
これによつて、 連写などにおいて撮影時に補正を行う時間がな い場合には、 例えば撮影時の光軸中心のシフ トべク トルのデータ と、 変換比率のデータ とが画像データと共に記録される。 そ して 再生時には、 この一緒に記録された光軸中心のシフ トベク トルの データと変換比率のデータを用いて画像データの色収差の補正処 理を円滑に行う こ とができる と共に、 その補正データの再記録を 行う こと もできる ものである。  As a result, if there is no time to perform correction at the time of shooting in continuous shooting or the like, for example, data of the shift vector around the optical axis at the time of shooting and data of the conversion ratio are recorded together with the image data. You. At the time of reproduction, the chromatic aberration correction processing of the image data can be smoothly performed by using the data of the shift vector at the center of the optical axis and the data of the conversion ratio recorded together, and the correction data can be obtained. Can be re-recorded.
ただしこのよ うな撮影時の光軸中心のシフ 卜べク トルのデータ と変換比率のデータ とを用いて補正を行う ことができるのは、 同 However, such correction can be performed using the data of the shift vector at the center of the optical axis and the data of the conversion ratio at the time of shooting.
—のカメ ラ装置で記録再生が行われる場合に限られる。 すなわち 撮影レンズの光軸中心は同じ機種であつても微妙に異なる もので あり、 他のカメ ラ装置で記録されたデータを補正するこ とはでき ない。 そこで同一のカメ ラ装置での記録再生であることを判別す る場合には、 例えば個体ごとの I Dコ一 ドをデータと共に記録す る こ とで可能とされる。 Only when recording / reproduction is performed with a camera device of —. In other words, the center of the optical axis of the taking lens is slightly different even for the same model, and data recorded by other camera devices cannot be corrected. Absent. Therefore, when it is determined that recording and reproduction are performed by the same camera device, for example, it is possible to record an ID code for each individual together with data.
また上述の装置においては、 例えば変換比率算出部 1 0 に任意 のユーザ一イ ンターフヱース入力 2 0 が設けられ、 例えば上述の 変換比率のデータを任意に変更し、 色収差補正部 6 での補正の比 率を任意に設定することができるようにされている。 これにより 、 例えば他のカメ ラ装置で記録された画像データの場合や、 変換 比率のデータが共に記録されていない画像データに対しても、 こ のユーザ一イ ンタ一フヱ一ス入力 2 0 を利用して所望の補正を行 う こ とが可能になる。  Further, in the above-described apparatus, for example, an arbitrary user-to-interface input 20 is provided in the conversion ratio calculation unit 10. For example, the data of the conversion ratio is arbitrarily changed, and the correction ratio in the chromatic aberration correction unit 6 is changed. The rate can be set arbitrarily. Thus, for example, even in the case of image data recorded by another camera device or image data in which conversion ratio data is not recorded together, this user interface input 20 It is possible to perform desired correction by using.
さ らに、 このようなユーザ一イ ンターフェース入力 2 0 を利用 して所望の補正を行う場合には、 例えば切り替えスィ ッチ 1 2 で の画像データの選択を任意に切り替えることによって、 色収差補 正部 6 での補正を行う前の画像と補正後の画像とを任意に切り替 えて表示装置 1 4 に映出する こ とができる。 これにより、 補正前 の画像と補正後の画像とを容易に比較することができ、 所望の補 正を行う際の使用者の操作を円滑に行わせることができる。  Furthermore, when desired correction is performed using such a user-interface input 20, for example, chromatic aberration compensation is performed by arbitrarily switching the selection of image data with the switching switch 12. The image before the correction in the front part 6 and the image after the correction can be arbitrarily switched and displayed on the display device 14. As a result, the image before correction and the image after correction can be easily compared, and the user's operation when performing desired correction can be smoothly performed.
なお切り替えスィ ッチ 1 2 での画像データの選択は、 例えば表 示装置 1 4 をビューフ ァイ ンダ一と して利用する場合や、 すでに 補正された画像デ一夕を色収差補正部 6 を通さずに表示装置 1 4 に映出する場合にも利用される。 また、 上述の連写などの撮影時 に補正を行わず記録のみを行う場合にも利用される。 ただし、 色 収差補正部 6 に入力をそのまま出力するスルーモ一 ドが設けられ ている場合には、 それを切り替えスィ ッチ 1 2 に替えて利用する こと もできる。  The selection of the image data at the switching switch 12 is performed, for example, when the display device 14 is used as a view finder, or when the already corrected image data is passed through the chromatic aberration correction unit 6. It is also used when the image is projected on the display device 14 without being used. It is also used when performing only recording without performing correction during shooting such as continuous shooting described above. However, if the chromatic aberration corrector 6 is provided with a through mode that outputs the input as it is, it can be used instead of the switch 12.
従つて上述の実施形態において、 原色信号の各色ごとに画像の 拡大または縮小を行う手段と、 撮影レンズの駆動状態及び手振れ 補正量を検出する手段とを用いて、 検出出力に応じて画像の拡大 または縮小の変換係数及び光軸中心座標を制御するようにしたこ とによって、 小型化された撮影レンズで生じる画質劣化を、 撮影 された画像信号に対する処理で補正することができると共に、 同 時に手振れ補正を行う場合にも、 良好な補正処理を行うことがで さる o Therefore, in the above-described embodiment, means for enlarging or reducing an image for each color of the primary color signal, driving state of the photographing lens and camera shake By using a means for detecting the amount of correction and controlling a conversion coefficient for enlarging or reducing the image and the coordinates of the center of the optical axis in accordance with the detection output, image quality degradation caused by a miniaturized photographing lens is reduced. In addition to being able to make corrections by processing the captured image signal, good correction processing can be performed when camera shake correction is performed at the same time.o
これによつて、 従来の手段では、 撮影レンズの小型化などによ つて、 倍率色収差による色にじみや解像度劣化などの画質劣化の 問題が生じ、 このような画質劣化を撮影レンズのみでは充分に抑 えることが困難になっており、 特に、 このような画質劣化の補正 を各色別の画像を拡大、 縮小することにより行っている場合には 、 同時に手振れ補正を行うことができないなど問題点があったも のを、 本発明によればこれらの問題点を容易に解消することがで きるものである。  As a result, in the conventional means, problems such as color blurring due to chromatic aberration of magnification and deterioration of image quality such as resolution degradation occur due to downsizing of the imaging lens, and such image quality deterioration is sufficiently suppressed only by the imaging lens. In particular, when such image quality deterioration correction is performed by enlarging or reducing the image of each color, there is a problem that camera shake correction cannot be performed at the same time. However, according to the present invention, these problems can be easily solved.
こう して上述の画像撮影装置によれば、 撮影レンズと、 撮影レ ンズを通った映像光を電気的な画像信号に変換する撮像手段と、 画像信号を処理するカメ ラ信号処理手段と、 カメラ信号処理手段 からの出力信号を少なく とも 3原色信号に変換または逆変換する 色信号変換手段と、 原色信号の各色ごとに画像の拡大または縮小 を行う解像度変換手段と、 撮影レンズの駆動状態及び手振れ補正 量を検出する検出手段と、 検出手段からの検出出力に応じて解像 度変換手段での拡大または縮小の変換係数及び光軸中心座標を制 御する制御手段とを備えるこ とにより、 例えば小型化された撮影 レンズで生じる画質劣化を極めて良好に補正することができるも のである。  Thus, according to the above-described image photographing apparatus, a photographing lens, image pickup means for converting video light passing through the photographing lens into an electric image signal, camera signal processing means for processing the image signal, and camera Color signal conversion means for converting or inversely converting the output signal from the signal processing means into at least three primary color signals, resolution conversion means for enlarging or reducing an image for each color of the primary color signal, driving state of camera lens and camera shake By providing detection means for detecting the amount of correction, and control means for controlling a conversion coefficient for enlargement or reduction by the resolution conversion means and an optical axis center coordinate in accordance with a detection output from the detection means, for example, It can very well compensate for image quality degradation caused by miniaturized photographic lenses.
また、 上述の色収差補正方法によれば、 撮影レンズと、 撮影レ ンズを通った映像光を電気的な画像信号に変換する撮像手段と、 画像信号を処理する力メ ラ信号処理手段とを有する画像撮影装置 における色収差補正方法であって、 カメ ラ信号処理手段からの出 力信号を少なく と も 3原色信号に変換し、 原色信号の各色ごとに 画像の拡大または縮小を行う と共に、 撮影レンズの駆動状態及び 手振れ補正量を検出してその検出出力に応じて拡大または縮小の 変換係数及び光軸中心座標を制御することにより、 例えば小型化 された撮影レンズで生じる画質劣化を極めて良好に補正するこ と ができる ものである。 Further, according to the chromatic aberration correction method described above, there are provided a photographing lens, an image pickup unit for converting video light passing through the photographing lens into an electric image signal, and a force camera signal processing unit for processing the image signal. Imaging equipment The chromatic aberration correction method according to the above, wherein the output signal from the camera signal processing means is converted into at least three primary color signals, and the image is enlarged or reduced for each color of the primary color signals. By detecting the camera shake correction amount and controlling the enlargement or reduction conversion coefficient and the optical axis center coordinate in accordance with the detected output, it is possible to extremely satisfactorily correct image quality degradation caused by, for example, a miniaturized photographing lens. You can do it.
なお本発明は、 上述の説明した実施の形態に限定される もので はな く 、 本発明の精神を逸脱する ことなく種々の変形が可能とさ れる ものである。  It should be noted that the present invention is not limited to the above-described embodiment, and various modifications can be made without departing from the spirit of the present invention.

Claims

請 求 の 範 囲 The scope of the claims
. 撮影レンズと、 . With the taking lens
前記撮影レンズを通った映像光を電気的な画像信号に変換す る撮像手段と、  Imaging means for converting video light passing through the taking lens into an electrical image signal;
前記画像信号を処理する力メ ラ信号処理手段と、  Force camera signal processing means for processing the image signal;
前記カメ ラ信号処理手段からの出力信号を少なく と も 3原色 信号に変換または逆変換する色信号変換手段と、  Color signal conversion means for converting or inversely converting an output signal from the camera signal processing means into at least three primary color signals;
前記原色信号の各色ごとに画像の拡大または縮小を行う解像 度変換手段と、  Resolution conversion means for enlarging or reducing an image for each color of the primary color signal;
前記撮影レンズの駆動状態及び手振れ補正量を検出する検出 手段と、  Detecting means for detecting a driving state of the photographing lens and a camera shake correction amount;
前記検出手段からの検出出力に応じて前記解像度変換手段で の拡大または縮小の変換係数及び光軸中心座標を制御する制御 手段と  Control means for controlling a conversion coefficient for enlargement or reduction and an optical axis center coordinate in the resolution conversion means according to a detection output from the detection means;
を備えたことを特徵とする画像撮影装置。  An image capturing apparatus characterized by comprising:
. 前記解像度変換手段からの出力信号を外部出力用若しく は記 録用の画像信号に変換または逆変換する信号変換手段と、 Signal conversion means for converting or inversely converting an output signal from the resolution conversion means into an image signal for external output or recording;
前記外部出力用の画像信号を出力する外部出力手段及び Zま たは前記記録用の画像信号を記録媒体に記録または再生する記 録再生手段と  External output means for outputting the image signal for external output, and recording / reproducing means for recording or reproducing the Z or the image signal for recording on a recording medium.
を備えたことを特徴どする請求の範囲 1記載の画像撮影装置 . 前記カメ ラ信号処理手段からの出力信号を前記記録再生手段 にて前記記録媒体に記録できるようにすると共に、  The image photographing apparatus according to claim 1, wherein an output signal from the camera signal processing means is recorded on the recording medium by the recording / reproducing means.
その撮影時に前記検出手段で検出された前記撮影レンズの駆 動状態及び手振れ補正量の情報を前記カメラ信号処理手段から の出力信号と共に前記記録媒体に記録する  Information on the driving state of the photographing lens and the amount of camera shake detected by the detecting means during the photographing is recorded on the recording medium together with the output signal from the camera signal processing means.
ことを特徵とする請求の範囲 2記載画像撮影装置。 3. The image photographing apparatus according to claim 2, wherein:
4 . 前記カメラ信号処理手段からの出力信号と任意の外部入力手 段若しく は記録再生手段からの画像信号とを切り替える切り替 え手段を備え、 4. A switching means for switching between an output signal from the camera signal processing means and an image signal from any external input means or recording / reproducing means,
前記切り替え手段からの信号を前記色信号変換手段に供給す る と共に、  Supplying a signal from the switching means to the color signal converting means;
前記制御手段には前記拡大または縮小の変換係数及び光軸中 心座標に対して任意の設定を行うためのユーザーィ ンタ一フエ —スを設ける  The control means is provided with a user interface for arbitrarily setting the conversion coefficient for enlargement or reduction and the center coordinate of the optical axis.
ことを特徴とする請求の範囲 1記載の画像撮影装置。  2. The image photographing apparatus according to claim 1, wherein:
5 . 前記記録再生手段で再生される記録媒体には、 前記画像信号 と共に、 その画像信号の撮影時に前記検出手段で検出された前 記撮影レンズの駆動状態及び手振れ補正量の情報が記録され、 前記記録再生手段で再生される前記情報に応じて前記解像度 変換手段での拡大または縮小の変換係数及び光軸中心座標を制 御する 5. In the recording medium reproduced by the recording / reproducing means, information of the driving state of the photographing lens and the amount of camera shake correction detected by the detecting means at the time of photographing the image signal is recorded together with the image signal, A conversion coefficient for enlargement or reduction by the resolution conversion means and an optical axis center coordinate are controlled in accordance with the information reproduced by the recording / reproduction means.
ことを特徴とする請求の範囲 4記載の画像撮影装置。  5. The image photographing device according to claim 4, wherein:
6 . 撮影レンズと、 前記撮影レンズを通った映像光を電気的な画 像信号に変換する撮像手段と、 前記画像信号を処理する力メラ 信号処理手段とを有する画像撮影装置における色収差補正方法 であって、 6. A method for correcting chromatic aberration in an image photographing apparatus, comprising: a photographing lens; an image pickup unit that converts video light passing through the photographing lens into an electric image signal; and a force signal processing unit that processes the image signal. So,
前記カメ ラ信号処理手段からの出力信号を少なく とも 3原色 信号に変換し、  Converting the output signal from the camera signal processing means into at least three primary color signals;
前記原色信号の各色ごとに画像の拡大または縮小を行うと共 に、  In addition to enlarging or reducing the image for each color of the primary color signal,
前記撮影レンズの駆動状態及び手振れ補正量を検出してその 検出出力に応じて前記拡大または縮小の変換係数及び光軸中心 座標を制御する  The driving state of the photographing lens and the amount of camera shake correction are detected, and the enlargement or reduction conversion coefficient and the coordinates of the optical axis center are controlled according to the detection output.
ことを特徴とする色収差補正方法。 A method for correcting chromatic aberration.
. 前記解像度変換手段からの出力信号を外部出力用若しく は記 録用の画像信号に変換し、 Converting an output signal from the resolution conversion means into an image signal for external output or recording;
前記外部出力用の画像信号を出力するか、 及び/または前記 記録用の画像信号を記録媒体に記録する  Outputting the image signal for external output, and / or recording the image signal for recording on a recording medium
ことを特徴とする請求の範囲 6記載の色収差補正方法。  7. The chromatic aberration correction method according to claim 6, wherein:
. 前記カメ ラ信号処理手段からの出力信号を前記記録媒体に記 録できるようにすると共に、 Output signals from the camera signal processing means can be recorded on the recording medium,
その撮影時に検出された前記撮影レンズの駆動状態及び手振 れ補正量の情報を前記出力信号と共に前記記録媒体に記録する ことを特徴とする請求の範囲 7記載の色収差補正方法。  8. The chromatic aberration correction method according to claim 7, wherein information on a driving state of the photographing lens and a camera shake correction amount detected at the time of photographing is recorded on the recording medium together with the output signal.
. 前記カメ ラ信号処理手段からの出力信号と任意の外部入力若 し く は記録媒体からの画像信号とを切り替える切り替え手段を 備え、 Switching means for switching between an output signal from the camera signal processing means and an image signal from an arbitrary external input or a recording medium,
前記切り替え手段からの信号を少なく とも 3原色信号に変換 し、  Converting the signal from the switching means into at least three primary color signals;
前記原色信号の各色ごとに画像の拡大または縮小を行う と共 に、  While enlarging or reducing the image for each color of the primary color signal,
前記拡大または縮小の変換係数及び光軸中心座標に対して任 意の設定が行われるようにする  Arbitrary settings are made for the conversion coefficient for the enlargement or reduction and the optical axis center coordinates.
ことを特徵とする請求の範囲 6記載の色収差補正方法。  7. The chromatic aberration correction method according to claim 6, wherein:
0 . 前記記録媒体には、 前記画像信号と共に、 その画像信号の 撮影時に検出された前記撮影レンズの駆動状態及び手振れ補正 量の情報が記録され、  0. In the recording medium, information of the driving state of the photographing lens and the amount of camera shake detected at the time of photographing the image signal are recorded together with the image signal,
再生される前記情報に応じて前記拡大または縮小の変換係数 及び光軸中心座標を制御する  Controlling the expansion or reduction conversion coefficient and the optical axis center coordinate according to the information to be reproduced
ことを特徴とする請求の範囲 9記載の色収差補正方法。  10. The chromatic aberration correction method according to claim 9, wherein:
PCT/JP2003/002589 2002-03-05 2003-03-05 Image pickup device and chromatic aberration correction method WO2003075557A1 (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
US10/506,848 US7397499B2 (en) 2002-03-05 2003-03-05 Image pickup device and chromatic aberration correction method
EP03710248A EP1489836A4 (en) 2002-03-05 2003-03-05 Image pickup device and chromatic aberration correction method
KR1020047013732A KR100957261B1 (en) 2002-03-05 2003-03-05 Image pickup device and chromatic aberration correction method

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2002059191A JP4000872B2 (en) 2002-03-05 2002-03-05 Image photographing apparatus and chromatic aberration correction method
JP2002-59191 2002-03-05

Publications (1)

Publication Number Publication Date
WO2003075557A1 true WO2003075557A1 (en) 2003-09-12

Family

ID=27784736

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2003/002589 WO2003075557A1 (en) 2002-03-05 2003-03-05 Image pickup device and chromatic aberration correction method

Country Status (7)

Country Link
US (1) US7397499B2 (en)
EP (1) EP1489836A4 (en)
JP (1) JP4000872B2 (en)
KR (1) KR100957261B1 (en)
CN (1) CN100384221C (en)
TW (1) TWI234394B (en)
WO (1) WO2003075557A1 (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1523172A2 (en) * 2003-10-07 2005-04-13 Sony Corporation Image pick-up apparatus, image processing apparatus and method of correcting chromatic aberration of lens
CN100442105C (en) * 2005-04-18 2008-12-10 索尼株式会社 Optical device, lens unit and image capture device
CN1725811B (en) * 2004-07-21 2011-06-15 奥林巴斯映像株式会社 Image pick-up apparatus and image restoration method

Families Citing this family (41)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4010254B2 (en) * 2003-02-06 2007-11-21 ソニー株式会社 Image recording / reproducing apparatus, image photographing apparatus, and chromatic aberration correction method
JP4706635B2 (en) * 2004-04-12 2011-06-22 株式会社ニコン Image processing apparatus having color misregistration correction function, image processing program, and electronic camera
JP4229053B2 (en) 2004-12-06 2009-02-25 ソニー株式会社 IMAGING DEVICE, IMAGING METHOD, AND PROGRAM FOR IMAGING PROCESS
JP4448039B2 (en) * 2005-01-26 2010-04-07 キヤノン株式会社 Imaging apparatus and control method thereof
JP4464292B2 (en) * 2005-02-25 2010-05-19 キヤノン株式会社 Information recording / reproducing device
JP4832013B2 (en) * 2005-07-05 2011-12-07 富士フイルム株式会社 Image blur correction device
JP5070690B2 (en) * 2005-09-07 2012-11-14 カシオ計算機株式会社 Chromatic aberration correction device
JP4424292B2 (en) * 2005-09-28 2010-03-03 ソニー株式会社 Imaging apparatus, exposure control method, and program
JP4487902B2 (en) 2005-11-09 2010-06-23 ソニー株式会社 Image processing apparatus and method, and program
JP4487903B2 (en) 2005-11-09 2010-06-23 ソニー株式会社 Image processing apparatus and method, and program
JP4804166B2 (en) * 2006-02-17 2011-11-02 キヤノン株式会社 Imaging apparatus and control method thereof
EP1898358A1 (en) * 2006-09-05 2008-03-12 Research In Motion Limited SVG script editor
JP4923987B2 (en) * 2006-11-30 2012-04-25 株式会社ニコン Image processing apparatus and image processing program for correcting image color
CN100583956C (en) * 2007-06-25 2010-01-20 鸿富锦精密工业(深圳)有限公司 Image forming apparatus and camera light strength attenuation and compensation method
CN101369089B (en) * 2007-08-15 2011-03-23 佛山普立华科技有限公司 Continuous image shooting system and method
JP4956401B2 (en) 2007-12-18 2012-06-20 キヤノン株式会社 Imaging apparatus, control method thereof, and program
JP5008578B2 (en) 2008-01-28 2012-08-22 株式会社リコー Image processing method, image processing apparatus, and image pickup apparatus
JP4966894B2 (en) * 2008-03-18 2012-07-04 株式会社リコー Imaging device
CN101546423B (en) * 2008-03-24 2011-05-04 鸿富锦精密工业(深圳)有限公司 Device and method for image interception
JP4969508B2 (en) * 2008-04-25 2012-07-04 オンセミコンダクター・トレーディング・リミテッド Vibration correction control circuit and imaging apparatus equipped with the same
TWI385474B (en) * 2008-05-02 2013-02-11 Hon Hai Prec Ind Co Ltd Imaging device and imaging method thereof
JP5173664B2 (en) * 2008-08-08 2013-04-03 キヤノン株式会社 Image processing apparatus and image processing method
CN102714737B (en) * 2009-12-17 2015-12-02 佳能株式会社 The image capture apparatus of image processing equipment and use image processing equipment
JP5577939B2 (en) * 2010-08-20 2014-08-27 ソニー株式会社 Imaging apparatus, aberration correction method, and program
WO2012050942A1 (en) 2010-09-29 2012-04-19 Applied Precision, Inc. Calibration targets for microscope imaging
CN102158730B (en) * 2011-05-26 2014-04-02 威盛电子股份有限公司 Image processing system and method
CN102158731B (en) * 2011-05-26 2014-03-12 威盛电子股份有限公司 Image processing system and method
JP5847471B2 (en) * 2011-07-20 2016-01-20 キヤノン株式会社 Image processing apparatus, imaging apparatus, image processing method, and image processing program
JP6303270B2 (en) 2012-05-18 2018-04-04 株式会社リコー Video conference terminal device, video conference system, video distortion correction method, and video distortion correction program
US20130321675A1 (en) 2012-05-31 2013-12-05 Apple Inc. Raw scaler with chromatic aberration correction
JP5968169B2 (en) * 2012-09-06 2016-08-10 キヤノン株式会社 Imaging device, control method thereof, and control program
JP6086829B2 (en) * 2013-06-26 2017-03-01 オリンパス株式会社 Image processing apparatus and image processing method
US10298898B2 (en) 2013-08-31 2019-05-21 Ml Netherlands C.V. User feedback for real-time checking and improving quality of scanned image
EP3072103B1 (en) 2013-12-03 2019-05-08 ML Netherlands C.V. User feedback for real-time checking and improving quality of scanned image
WO2015104235A1 (en) 2014-01-07 2015-07-16 Dacuda Ag Dynamic updating of composite images
US10708491B2 (en) * 2014-01-07 2020-07-07 Ml Netherlands C.V. Adaptive camera control for reducing motion blur during real-time image capture
EP3696774A1 (en) 2014-05-12 2020-08-19 ML Netherlands C.V. Method and apparatus for scanning a 3d object
US10148964B2 (en) * 2016-11-03 2018-12-04 Ujet, Inc. Image quality management
US11095800B2 (en) * 2017-12-05 2021-08-17 Fuji Corporation Imaging unit and component mounting machine
CN108600771B (en) * 2018-05-15 2019-10-25 东北农业大学 Recorded broadcast workstation system and operating method
CN108737734B (en) * 2018-06-15 2020-12-01 Oppo广东移动通信有限公司 Image compensation method and apparatus, computer-readable storage medium, and electronic device

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH04215378A (en) * 1990-12-13 1992-08-06 Matsushita Electric Ind Co Ltd Camcoder
JPH053568A (en) * 1991-06-25 1993-01-08 Canon Inc Video camera apparatus
JPH0522697A (en) * 1991-07-09 1993-01-29 Canon Inc Video recorder
JPH05328283A (en) * 1992-05-25 1993-12-10 Sony Corp Magnetic recording and/or reproducing device
JPH06237411A (en) * 1993-02-10 1994-08-23 Olympus Optical Co Ltd Video processor
JPH08149403A (en) * 1994-11-18 1996-06-07 Sharp Corp Video camera unified with monitor screen

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0313074A (en) 1989-06-09 1991-01-22 Canon Inc Picture processing system
JP2775878B2 (en) 1989-07-26 1998-07-16 キヤノン株式会社 Anti-vibration imaging device
KR920005598A (en) * 1990-08-29 1992-03-28 오가 노리오 Digital Electronic Still Camera
EP0611125B1 (en) * 1993-02-12 2000-11-22 Sony Corporation Electronic zoom control and image stabilization
EP0618739B1 (en) * 1993-03-19 1999-10-27 Canon Kabushiki Kaisha Digital video camera and recording apparatus
US7245319B1 (en) * 1998-06-11 2007-07-17 Fujifilm Corporation Digital image shooting device with lens characteristic correction unit
JP3804617B2 (en) * 2003-02-14 2006-08-02 コニカミノルタフォトイメージング株式会社 Image processing apparatus and method

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH04215378A (en) * 1990-12-13 1992-08-06 Matsushita Electric Ind Co Ltd Camcoder
JPH053568A (en) * 1991-06-25 1993-01-08 Canon Inc Video camera apparatus
JPH0522697A (en) * 1991-07-09 1993-01-29 Canon Inc Video recorder
JPH05328283A (en) * 1992-05-25 1993-12-10 Sony Corp Magnetic recording and/or reproducing device
JPH06237411A (en) * 1993-02-10 1994-08-23 Olympus Optical Co Ltd Video processor
JPH08149403A (en) * 1994-11-18 1996-06-07 Sharp Corp Video camera unified with monitor screen

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP1489836A4 *

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1523172A2 (en) * 2003-10-07 2005-04-13 Sony Corporation Image pick-up apparatus, image processing apparatus and method of correcting chromatic aberration of lens
CN100377600C (en) * 2003-10-07 2008-03-26 索尼株式会社 Image pick-up apparatus, image processing apparatus and method of correcting chromatic aberration of lens
CN1725811B (en) * 2004-07-21 2011-06-15 奥林巴斯映像株式会社 Image pick-up apparatus and image restoration method
CN100442105C (en) * 2005-04-18 2008-12-10 索尼株式会社 Optical device, lens unit and image capture device

Also Published As

Publication number Publication date
KR20040089699A (en) 2004-10-21
TWI234394B (en) 2005-06-11
JP2003255424A (en) 2003-09-10
JP4000872B2 (en) 2007-10-31
CN100384221C (en) 2008-04-23
US20050168614A1 (en) 2005-08-04
KR100957261B1 (en) 2010-05-12
US7397499B2 (en) 2008-07-08
EP1489836A4 (en) 2006-08-02
TW200304325A (en) 2003-09-16
CN1650614A (en) 2005-08-03
EP1489836A1 (en) 2004-12-22

Similar Documents

Publication Publication Date Title
WO2003075557A1 (en) Image pickup device and chromatic aberration correction method
JP4010254B2 (en) Image recording / reproducing apparatus, image photographing apparatus, and chromatic aberration correction method
JP4378994B2 (en) Image processing apparatus, image processing method, and imaging apparatus
JP4165361B2 (en) Image photographing apparatus, image processing apparatus, and lens chromatic aberration correction method
US8018517B2 (en) Image capture apparatus having display displaying correctly oriented images based on orientation of display, image display method of displaying correctly oriented images, and program
KR101109532B1 (en) Image capturing device, image capturing method, and a storage medium recording thereon a image capturing program
JP2000069343A (en) Digital image pickup device
JP2009159559A (en) Image capturing device and program thereof
JP2007124397A (en) Image processing device and image processing method
JP2005012423A (en) Image pickup device, and signal processing apparatus
JP2007202050A (en) Image generating apparatus and program
JP2007281654A (en) Image reproducing apparatus
JP2004013461A (en) Image processing system and digital imaging apparatus
JP2007295281A (en) Image pick-up device
JP2005303428A (en) Imaging apparatus, method and program
JP2007060292A (en) Digital camera and image quality correction method
JP2009284051A (en) Imaging apparatus
JP2007096677A (en) Image processing apparatus, imaging apparatus, and image processing program
JP2007094917A (en) Image processing device, image processing method, and program

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): CN KR US

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LU MC NL PT SE SI SK TR

121 Ep: the epo has been informed by wipo that ep was designated in this application
WWE Wipo information: entry into national phase

Ref document number: 10506848

Country of ref document: US

Ref document number: 1020047013732

Country of ref document: KR

WWE Wipo information: entry into national phase

Ref document number: 2003710248

Country of ref document: EP

WWP Wipo information: published in national office

Ref document number: 1020047013732

Country of ref document: KR

WWE Wipo information: entry into national phase

Ref document number: 20038095025

Country of ref document: CN

WWP Wipo information: published in national office

Ref document number: 2003710248

Country of ref document: EP