JPH11225270A - Image processing method and image processor - Google Patents

Abstract

PROBLEM TO BE SOLVED: To correct magnification color aberration, distortion aberration, ambient light quantity drop and aberration of being out of focus and to output a high quality image by using the characteristic of a lens that photographs an image and the positional information of the image. SOLUTION: A characteristic data supplying part 60 reads the characteristic information of a lens that corresponds to the acquired discrimination information of a camera from a memory and supplies it to an aberration correcting part 56. The part 56 uses a photographic lens characteristic of a supplied film and the positional information of image data, e.g. a coordinate position from the center of an image, corrects magnification color aberration and distortion aberration and also performs electronic variable power processing. When image data is supplied from an MTX. A coordinate transformation processing part 56A uses the lens characteristic supplied from the part 60, calculates deviation amounts Δr and Δb owing to the magnification color aberration to G image data ig in each pixel position ir and ib of R and B image data and further calculates a deviation amount D owing to the distortion aberration of the G input image data ig.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a digital photo printer or the like that photoelectrically reads an image photographed on a film and obtains a print (photograph) in which the image is reproduced. The present invention belongs to the technical field of an image processing method for correcting aberrations such as chromatic aberration of magnification and distortion occurring in an image captured by a digital camera or the like, and an image processing apparatus using the image processing method.

[0002]

2. Description of the Related Art At present, an image photographed on a photographic film (hereinafter referred to as a film) such as a negative film or a reversal film is printed on a photosensitive material (photographic paper) by projecting an image of the film onto the photosensitive material. Surface-exposing the photosensitive material,
This is performed by so-called direct exposure (analog exposure).

On the other hand, in recent years, a printing apparatus using digital exposure, that is, an image recorded on a film is photoelectrically read, the read image is converted into a digital signal, and then various image processing is performed. 2. Description of the Related Art Digital photo printers have been put to practical use, in which image data (latent images) are recorded by scanning and exposing a photosensitive material with recording light modulated in accordance with the image data, and the resulting images are printed.

In a digital photo printer, exposure conditions at the time of printing can be determined by image data processing using an image as digital image data, so that image skipping and blurring caused by backlight, strobe photography, and the like can be corrected, and sharpness can be reduced. Properly perform (sharpening) processing, correction of color feria and density feria, correction of underexposure and overexposure, correction of insufficient peripheral light quantity, etc. to obtain high-quality prints that could not be obtained by conventional direct exposure Can be. In addition, synthesis of a plurality of images, image division, and synthesis of characters can be performed by image data processing, and prints that have been freely edited / processed according to the intended use can be output.
In addition, according to the digital photo printer, a print can be created from an image (image data) photographed by a digital camera or the like, and the image can be printed (photograph).
The image data can be supplied to a computer or the like, or can be stored in a recording medium such as a floppy disk, so that the image data can be used for various purposes other than a photograph.

Such a digital photo printer basically includes a scanner (image reading device) that photoelectrically reads an image recorded on a film, image processing of the read image, and recording image data (exposure conditions). And a printer (image recording apparatus) that scans and exposes the photosensitive material in accordance with the image data, performs development processing, and prints.

In a scanner, reading light emitted from a light source is incident on a film to obtain projection light carrying an image photographed on the film, and the projection light is transmitted to an image sensor such as a CCD sensor by an imaging lens. The image is read by forming an image and performing photoelectric conversion, and after performing various types of image processing as necessary, the image is sent to the image processing apparatus as image data (image data signal) of the film. The image processing apparatus sets image processing conditions from image data read by a scanner, performs image processing according to the set conditions on the image data, and outputs the image data to a printer as output image data (exposure conditions) for image recording. send. In the printer, for example, if the device uses light beam scanning exposure, the light beam is modulated according to the image data sent from the image processing device,
The photosensitive material is two-dimensionally scanned and exposed (printed) to form a latent image, and then subjected to a predetermined developing process and the like, so that an image photographed on the film is reproduced (printed).

[0007]

The causes of image quality deterioration of an image reproduced in a print include magnification chromatic aberration, distortion, a decrease in peripheral light quantity, and image quality caused by the performance of a lens mounted on a camera that has captured the image. Lens aberrations such as out-of-focus can be mentioned. A color image is formed by three primary colors of red (R), green (G) and blue (B).
Since the refractive index (imaging magnification) of the lens slightly differs depending on the wavelength, the imaging magnification of the R, G, and B lights differs, that is, chromatic aberration of magnification occurs. As a result, when an image captured on a film is reproduced, a color shift occurs in the obtained image. Further, in order to obtain an appropriate captured image, a plane perpendicular to the optical axis in the scene needs to be formed on the same plane perpendicular to the optical axis. However, with a normal lens, the image plane shifts in the optical axis direction, that is, so-called distortion occurs, and the formed image is distorted (causes distortion). When an image captured on film is reproduced, the obtained image is distorted. It becomes what has. Furthermore, a decrease in the amount of peripheral light, in which an image becomes darker in the peripheral portion than in the central portion, which occurs depending on the performance of the lens, and image blur, i.e., focus blur, which is caused by a different focus position in the film surface direction. This causes image quality degradation.

For a camera such as a single-lens reflex camera that can afford a certain amount of cost, use a high-precision lens,
Further, by combining a plurality of lenses, it is possible to correct lateral chromatic aberration and distortion, and to photograph an appropriate image on a film. However, in the case of a film with a lens or an inexpensive compact camera, the cost of the lens cannot be increased, so that chromatic aberration of magnification and distortion occur in an image photographed on the film. As a result, an image reproduced as a print has color shift and distortion.

[0009] An object of the present invention is to provide an image processing apparatus, which is capable of correcting chromatic aberration of magnification, even if the image is taken by an inexpensive compact camera or digital camera.
An image processing method that corrects aberrations such as distortion, a decrease in peripheral light quantity, and out-of-focus, and enables to output a high-quality image free from color shift and distortion, and an image processing apparatus using the image processing method Is to provide.

[0010]

In order to achieve the above object, an image processing method according to the present invention obtains image data from an optically photographed image and reproduces the image data as a visible image. An image processing method for correcting at least one of chromatic aberration of magnification, distortion, peripheral light quantity, and image blur of the optically captured image, wherein a characteristic of a lens that captured the image and a position of the image From the information
An image processing method is provided, wherein at least one of the chromatic aberration of magnification, distortion, peripheral light amount, and image blur is corrected.

An image processing apparatus according to the present invention is an image processing apparatus which performs predetermined image processing on image data obtained from an optically captured image to obtain image data for output. Acquisition means for acquiring the identification information of the photographic lens that has captured the image, storage means for storing lens characteristics according to the type of photographic lens, and the corresponding photographic lens from the storage means according to the identification information acquired by the acquisition means. Provided is an image processing apparatus comprising: a correction unit that receives lens characteristics and corrects at least one of chromatic aberration of magnification, distortion, peripheral light amount, and image blur from an image based on position information and lens characteristics of the image. I do.

In the present invention, the position information of the image is preferably based on an optical axis of a lens at the time of photographing, and has a correction formula corresponding to a plurality of photographing lens types. It is preferable that the storage unit stores a correction coefficient of the correction formula as the lens characteristic, and that the correction unit determines whether a deviation of an image of another color from a reference color of the three primary colors due to chromatic aberration of magnification occurs. Calculates the image position where the chromatic aberration of magnification of each image is corrected from the amount, and corrects the chromatic aberration of magnification of the image, or calculates the image position where the distortion of each image is corrected based on the amount of displacement of the image due to distortion. To correct the distortion of the image, or the amount of deviation of the image of the other color from the reference color of the three primary colors caused by the chromatic aberration of magnification, and the amount of deviation of the image of the reference color caused by the distortion And from It is preferable to calculate the image position where the chromatic aberration of magnification and distortion of the image are corrected, and to correct the chromatic aberration of magnification and distortion, and that the correction unit corrects the chromatic aberration of magnification of each of the images, or Using the image position where the distortion of each image is corrected, or the image position where the magnification chromatic aberration and distortion of each image are corrected, electronic magni? Cation processing and electronic magni? Cation correction and electronic magni? Cation processing or distortion are performed. It is preferable to perform the aberration correction and the electronic magnification processing, or the interpolation arithmetic processing for the magnification chromatic aberration and the distortion and the electronic magnification processing at one time, and the acquisition unit is optically or magnetically recorded on the film. Information about the lens being used and / or information about the lens electrically recorded on the film cartridge as discrimination information. Is preferably Tokusuru, further being connected to the image data for output subjected to image processing to an apparatus for outputting the reproduced print as a visible image is preferred.

[0013]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, an image processing method and an image processing apparatus according to the present invention will be described in detail based on preferred embodiments shown in the accompanying drawings.

FIG. 1 is a block diagram showing an example of a digital photo printer using an image processing apparatus of the present invention for implementing the image processing method of the present invention. The digital photo printer (hereinafter, referred to as a photo printer 10) shown in FIG. 1 basically includes a scanner (image reading device) 12 that photoelectrically reads an image captured on a film F, and read image data ( Image processing apparatus 1 that performs image processing of image information), operation and control of the entire photo printer 10, and the like.
And a printer 16 that image-exposes a photosensitive material (photographic paper) with a light beam modulated in accordance with image data output from the image processing apparatus 14, develops it, and outputs it as a (finished) print. Be composed. The image processing apparatus 14 includes an operation system 18 having a keyboard 18a and a mouse 18b for inputting (setting) various conditions, selecting and instructing processing, and instructing color / density correction and the like.
A display 2 for displaying images read by the scanner 12, various operation instructions, setting / registration screens for various conditions, and the like.
0 is connected.

The scanner 12 is a device for photoelectrically reading an image photographed on a film F or the like one frame at a time.
And a variable aperture 24 and R, G and B for separating the image into three primary colors of R (red), G (green) and B (blue).
A color filter plate 26 having a plurality of color filters and rotating to apply an arbitrary color filter to an optical path; a diffusion box 28 for making reading light incident on the film F uniform in a surface direction of the film F; A lens unit 32 and a CCD sensor 3 serving as an area sensor for reading one frame image of the film;
4 and an amplifier (amplifier) 36.

In the illustrated example of the photo printer 10, a new photo system (Advanced Photo System) or 13
Depending on the type and size of the film such as a negative (or reversal) film of 5 sizes, the form of the film such as strips and slides, and the type of processing such as trimming,
A dedicated carrier that can be freely mounted on the main body of the scanner 12 is prepared. By changing the carrier, it is possible to cope with various films and processes. An image (frame) photographed on a film and provided for print production is conveyed and held at a predetermined reading position by this carrier. Also, as is well known, a magnetic recording medium is formed on the film of the new photographic system, and a cartridge ID, a film type, and the like are recorded. Various data such as the type of the camera and the developing machine can be recorded. The carrier corresponding to the film (cartridge) of the new photographic system is provided with a means for reading the magnetic information. The magnetic information is read when the film is transported to the reading position. Sent to

In such a scanner 12, the reading light emitted from the light source 22, adjusted in light quantity by the variable aperture 24, passed through the color filter plate 26, adjusted in color, and diffused in the diffusion box 28 is transmitted by the carrier. The light is incident on and transmitted through one frame of the film F held at a predetermined reading position, thereby obtaining projection light carrying an image of the frame photographed on the film F. The projection light of the film F is transmitted to the CCD sensor 3 by the imaging lens unit 32.
An image is formed on the light receiving surface of No. 4 and photoelectrically read by the CCD sensor 34, and its output signal is amplified by the amplifier 36 and sent to the image processing device 14. CCD sensor 34
Is, for example, an area CCD sensor having 1380 × 920 pixels.

In the scanner 12, such an image reading is performed three times by sequentially inserting the respective color filters of the color filter plate 26, so that one frame of image is read by R, G and B.
And read out. Here, in the photo printer 10, a pre-scan for reading an image at a low resolution is performed in order to determine image processing conditions and the like, before reading an image for printing a print (main scan). Therefore, a total of six image readings are performed in one frame.

Although the scanner 12 uses an area CCD sensor and separates projection light into three primary colors by a color filter plate 26 to read an image, the scanner used in the present invention reads each of the three primary colors. 3 corresponding to
An image may be read by slit scanning for reading an image while scanning and transporting the film F by a carrier using a type of line CCD sensor.

The illustrated photo printer 10 uses a scanner 12 that photoelectrically reads an image photographed on a film such as a negative or a reversal as an image data supply source of the image processing device 14. As an image data supply source for supplying the image data, other than the scanner 12, an image reading device that reads an image of a reflection original, an imaging device such as a digital camera or a digital video camera, an LA
Communication means such as N (Local Area Network) and computer communication network; various image reading means and imaging means such as a memory card and a medium (recording medium) such as MO (magneto-optical recording medium); storage means for image data; Can be used in various ways. That is, the present invention can be suitably used for images (image data) optically captured by an imaging device such as a digital camera.

As described above, the output signal (image data) from the scanner 12 is output to the image processing device 14.
FIG. 2 shows a block diagram of an image processing device (hereinafter, referred to as a processing device 14). The processing device 14 includes a data processing unit 38,
A pre-scan (frame) memory 40, a main scan (frame) memory 42, a pre-scan image processing unit 44, a main scan image processing unit 46, and a condition setting unit 48 are provided. FIG. 2 mainly shows parts related to image processing.
A CPU for controlling and managing the entire photo printer 10 including the processing device 14; a memory for storing information necessary for the operation of the photo printer 10;
A means for determining the aperture value of the CCD and the accumulation time of the CCD sensor 34 are arranged.
Are connected to each part via the CPU or the like (CPU bus).

The R, G and B output signals output from the scanner 12 are subjected to A / D (analog / digital) conversion, Log conversion, DC offset correction, dark time correction, shading correction, etc. The pre-scan (image) data is stored in the pre-scan memory 40 in the main scan (image).
The data is stored (stored) in the main scan memory 42, respectively. The pre-scan data and the main scan data are basically the same data except that the resolution (pixel density) and the signal level are different.

The pre-scan data stored in the pre-scan memory 40 is processed in the pre-scan image processing section 44, and the main scan data stored in the main scan memory 40 is processed in the main scan image processing section 46. The pre-scan image processing unit 44 includes the image processing unit 5
0 and an image data conversion unit 52. On the other hand, the main scan image processing unit 46 includes an image processing unit 54 and an image data conversion unit 58.

The image processing unit 50 of the pre-scan image processing unit 44 (hereinafter referred to as the processing unit 50) and the image processing unit 54 of the main scan image processing unit 46 (hereinafter referred to as the processing unit 54).
Are portions that perform predetermined image processing on an image (image data) read by the scanner 12 according to an image processing condition set by a condition setting unit 48 described later. Both have different pixel densities of the image data to be processed,
Basically, the same processing is performed except that the processing unit 50 of the prescan image processing unit 44 does not have an aberration correction unit. Image processing in the processing unit 50 and the processing unit 54 includes color balance adjustment, contrast correction (gradation processing), brightness correction, dodging processing (density dynamic range compression /
Extension), saturation correction, sharpness (sharpening) processing, and the like. These are performed by a well-known method that appropriately combines calculation, processing by an LUT (look-up table), matrix (MTX) calculation, processing by a filter, and the like. In the illustrated example, color balance adjustment,
Brightness correction and contrast correction are performed in the LUT,
Saturation correction is performed by MTX. Other sharpness processing, dodging processing, and the like are performed in blocks 50A and 54A in accordance with an instruction from an operator, image data, and the like.

Here, between the MTX of the processing section 54 for processing the main scan data and the block 54A, an aberration correction section 56 for correcting magnification chromatic aberration and distortion, and performing electronic variable power processing is arranged. . Also, the aberration correction unit 5
6, a lens characteristic data supply unit 60 is connected. In the processing device 14 according to the present invention, if necessary,
The aberration correction unit 56 corrects chromatic aberration of magnification and distortion of an image photographed on the film F by image processing using the lens characteristics and the position information of the image. It realizes stable output of prints in which high-quality images are reproduced.

In the present invention, an aberration correction unit may be provided in the processing unit 50 of the pre-scan processing unit 44 to correct chromatic aberration of magnification, distortion, and the like on the image displayed on the display 20. Of course.

A lens characteristic data supply unit 60 (hereinafter referred to as a characteristic data supply unit 60) acquires identification information for identifying the camera that has photographed the film F, and responds to the photographing camera corresponding to the acquired identification information. Aberration correction unit 5 for lens characteristics
6 is a part to be supplied.

There is no particular limitation on the discrimination information for discriminating the camera (that is, the photographing lens) and the obtaining means, and various methods can be used. For example, when the film F is a film with a lens of the above-described new photographic system, the magnetic information recorded on the film F is read by the carrier of the scanner 12, and the cartridge ID recorded magnetically is read.
The model of the lens-equipped film, that is, the camera, may be determined by using the film type or the film type. The extended DX code “SSU INDICA” optically recorded on the film may be used.
“TOR” may be optically read by a carrier and used. In addition, some cameras that support the new photographic system have a function of magnetically recording the model of the camera on the film F, so that the camera that has captured the film F may be determined by using this. At the time of reception, the model of the film with lens or the model of the photographing camera is heard from the customer, and recorded in a memo, package, patrone, cartridge, or the like. May be input, or the correspondence between a function key or the like and the camera may be determined in place of the camera model, and input may be made using this. Further, the camera model may be optically printed on the film at the time of photographing, and read to determine the camera model. If it is a film with a lens, the model of the film with a lens is optically baked like a DX code at the time of manufacture, or magnetically recorded,
The model may be determined using these. In the case of a film cartridge with an IC memory, the model of the camera or the like may be electrically recorded in the IC memory, and the model may be determined using this.

The characteristic data supply section 60 has a memory, which stores information on lens characteristics according to the type of various cameras, specifically information on characteristics of chromatic aberration of magnification and distortion of various lenses. Is stored. The characteristic data supply unit 60 reads the information of the lens characteristic corresponding to the acquired camera identification information from the memory, and supplies the information to the aberration correction unit 56. Note that the lens characteristics are not limited to being stored in the memory of the characteristic data supply unit 60. For example, the lens characteristics may be stored in a database connected to the printer 10, and may be accessed and read out there. Alternatively, when reading the film F, the information may be externally input as information on a lens corresponding to the film.

Although there is no particular limitation on the lens characteristics,
A correction function or a correction coefficient corresponding to each lens type for performing chromatic aberration of magnification or distortion may be used. Alternatively, a basic correction function (correction formula) for correcting magnification chromatic aberration and distortion corresponding to a plurality of lens types, preferably the main lens type processed by the printer 10, is stored.
A correction function and a correction coefficient according to the correction formula may be stored as lens characteristics corresponding to each lens. Further, in general, the characteristic of the chromatic aberration of magnification and the characteristic of the distortion are the parameters of the distance from the optical axis of the lens, that is, the center of the image captured on the film F (indicated by xy, for example). Since it can be approximated to some extent by a cubic function, a function indicating the characteristic of the chromatic aberration of magnification and a function indicating the characteristic of the distortion corresponding to various cameras requiring correction of the chromatic aberration of magnification and the distortion are provided. , May be stored as lens characteristics. By making this function a higher order such as fourth order, fifth order, etc., it is possible to perform more accurate correction in accordance therewith, but the load on the hardware increases and the processing time also increases. Since it increases, it may be determined according to the required correction accuracy, the processing capability required for the photo printer, and the like.

The aberration correction unit 56 includes a characteristic data supply unit 60
Information of the photographic lens characteristics of the film F and the position of the image data (pixels), for example, the coordinate position (the number of pixels from the center pixel) from the center of the image (the center of the optical axis of the photographic lens) Are used to correct lateral chromatic aberration and distortion, and to perform electronic scaling. In this case, if the center of the image cut out by the mask or the like is considered to be substantially the center of the optical axis of the lens at the time of shooting,
A variety of aberrations (distortion aberration, chromatic aberration of magnification, decrease in peripheral light amount, image blur) may be corrected using the pixel at the center of the clipped image as the center of the optical axis of the lens.

The coordinates in this case may be xy coordinates or polar coordinates. The information on the position of the image data is not limited to the center of the image, and various types of information can be used. For example, a corner (e.g., upper left corner) of an image or a certain pixel (e.g., pixel Pixel number 1), etc.
Further, the outside of the image, for example, the perforation of the film F or the like may be used as a reference. That is, in the present invention, various position information can be used as long as the position of the image (pixel) can be relatively detected.

Here, if the correction of the chromatic aberration of magnification and the distortion using the lens characteristics and the position information of the image (hereinafter referred to as pixel position) are separately performed, it takes a long time for the calculation, and a plurality of interpolation calculations are performed. Since it is necessary to perform the operation twice, there is a problem that the image quality is deteriorated. Therefore, in the present invention, preferably, the image magnification of R and B is converted into a G image by converting the image magnification of R and B with reference to the three primary colors of R, G and B, usually G. , The chromatic aberration of magnification is corrected, and then the distortion is corrected corresponding to the G image. This calculates the appropriate position of each pixel whose aberration has been corrected, and uses this to interpolate the image data of each pixel, thereby correcting the magnification chromatic aberration and distortion of the image photographed on the film. Can be obtained. Accordingly, since only the operation on the G image needs to be performed for the distortion, it is possible to perform more appropriate correction of the chromatic aberration of magnification and the distortion by reducing the amount of operation and the interpolation operation.

The image processing apparatus normally enlarges or reduces an image by image data processing, that is, performs electronic scaling of the image, and outputs the image (image data) in a size corresponding to the output image. This electronic scaling process is usually performed by performing an interpolation operation on image data. However, since the interpolation calculation is performed even in the correction of the chromatic aberration of magnification and the distortion, the result is that the interpolation is performed twice, which may deteriorate the image quality.

For this reason, in the present invention, it is more preferable to use the lens characteristics and the pixel position of the image data to determine the shift amount of the R and B pixel positions with respect to the reference color (G) caused by the chromatic aberration of magnification. An appropriate position for each pixel is calculated from the shift amount of the pixel position of the reference color due to the distortion, and image information is interpolated by using the calculated information on the appropriate position of each pixel to interpolate the image data. Perform double processing. In other words, by calculating the amount of displacement of the pixel position due to chromatic aberration of magnification and distortion, it is possible to know where each pixel should be originally located, and perform interpolation calculation of image data according to the appropriate position. To perform electronic scaling. Thus, correction of chromatic aberration of magnification and distortion and electronic scaling processing can be performed by one interpolation calculation.

The aberration corrector 56 in the illustrated example is a part that performs correction of chromatic aberration of magnification and distortion and electronic scaling processing by using the above-described method. As shown in the conceptual diagram of FIG. It is configured to include a conversion processing unit 56A and a scaling processing unit 56B. In FIG. 3, ir, ig
And ib are the pixel positions (addresses) of the image data (input image data) supplied from MTX, respectively;
r, Ig and Ib denote the pixel positions of the image data in which the chromatic aberration of magnification and the distortion have been corrected;
D represents the shift amount (that is, the correction amount) of the R and B pixel positions with respect to the G pixel position due to the chromatic aberration of magnification;
The shift amount of the G pixel position due to the distortion is shown below.

In the aberration correction unit 56, when image data is supplied from MTX, the coordinate conversion processing unit 56A uses the lens characteristics supplied from the characteristic data supply unit 60 to output each of the R and B image data. The shift amounts Δr and Δb due to chromatic aberration of magnification with respect to the G image data ig at the pixel positions ir and ib are calculated, and the shift amount D due to the distortion of the G input image data ig is calculated.

Next, as shown in FIG. 3, Δr and D are added to each pixel position ir of the R input image data,
The pixel position Ir of the R image data in which the chromatic aberration of magnification and the distortion have been corrected is calculated, and the above-mentioned Δb and D are added to each pixel position ib of the input image data of B, so that B in which the chromatic aberration of magnification and the distortion have been corrected. The pixel position Ib of the image data of B is calculated by adding D to each pixel position ig of the input image data of G, and the chromatic aberration of magnification and distortion are corrected. That is, in this calculation, the chromatic aberration of magnification of the R image and the B image is corrected on the basis of the G image, all the images are aligned with the G image, and the displacement D due to the distortion of the G image is used. Is corrected, and the pixel positions of the R, G, and B images in which the chromatic aberration of magnification and the distortion have been corrected are calculated.

Next, in the enlargement / reduction processing section 56B,
The pixel position I corrected for this chromatic aberration of magnification and distortion.
Using r, Ig, and Ib, the image is scaled by performing interpolation (N-fold interpolation) of the image data in accordance with the enlargement / reduction magnification, thereby correcting magnification chromatic aberration and distortion, and electronic scaling. The processed image data is output to the block 54A. There is no particular limitation on the method of the electronic scaling process, and various known methods can be used. Examples thereof include a method using bilinear interpolation and a method using spline interpolation.

When the characteristic data supply unit 60 does not acquire the camera identification information, and when there is no lens characteristic corresponding to the camera identification information acquired by the characteristic data supply unit 60, the chromatic aberration of magnification and When cancellation of distortion correction is instructed, the aberration corrector 56
Supplies the image data to the block 54A by performing only the electronic scaling process in the scaling unit 56B.

In the illustrated apparatus, as a preferred mode, both the distortion and the chromatic aberration of magnification are corrected by the aberration corrector 56. However, the present invention is not limited to this. Only one characteristic of the aberration may be stored, and only one of the aberrations may be corrected using this and the pixel position. In this case, for example, after calculating a proper position in which a shift amount caused by chromatic aberration of magnification or distortion is corrected, and using the calculated position to correct the corresponding aberration, an electronic scaling process may be performed by a known method. However, preferably, similarly to the above-described method, an electronic zoom process is performed by calculating an appropriate position in which a shift amount due to chromatic aberration of magnification or distortion is corrected, and interpolating image data using the information of the appropriate position. It is preferable to perform aberration correction and electronic zooming. Accordingly, similarly, the number of interpolation calculations can be reduced, and the deterioration of image quality due to interpolation can be reduced.

Further, according to the present invention, not only distortion and / or chromatic aberration of magnification but also lens characteristics for correcting aberrations such as out-of-focus (PSF: Point Spread Function) and a decrease in peripheral light amount caused by the lens are stored. In addition, in addition to or instead of the distortion and / or the chromatic aberration of magnification, the out-of-focus state and / or the decrease in the peripheral light amount may be corrected.

The image data processed by the processing units 50 and 54 are sent to image data conversion units 52 and 58.
Image data converter 52 of prescan image processor 44
Converts the image data processed by the processing unit 50 into 3D
The image data is converted using a (three-dimensional) -LUT or the like, and is converted into image data corresponding to the display on the display 20. On the other hand, the image data conversion unit 58 of the main scan image processing unit 46 similarly converts the image data processed by the processing unit 54 into a 3D image.
-A part which converts the data using the LUT and supplies the image data corresponding to the image recording by the printer 16 to the printer 16.

In the present invention, the image data subjected to the image processing can be output to a recording medium such as a floppy disk or MO, a computer, a communication network, or the like, in addition to the printer 16. As described above, the pre-scan image processing unit 44 may also be provided with an aberration correction unit, and the aberration-corrected image may be displayed on the display 20 as described above.
The image data that has been subjected to the aberration correction and processed in step 6 may be displayed on the display 20 or other display means by thinning it out as necessary.

Various processing conditions by the pre-scan image processing section 44 and the main scan image processing section 46 are set by a condition setting section 48. The condition setting unit 48 includes an image processing condition setting unit 72, a key correction unit 74, and a parameter integration unit 76.

The image processing condition setting section 72 (hereinafter, setting section 7)
2) selects image processing to be performed, sets image processing conditions in the processing units 50 and 60 using the prescan data, and supplies the image processing conditions to the parameter integration unit 76. Specifically, the setting unit 72 creates a density histogram from the pre-scan data, and calculates the average density, LATD
(Large-area transmission density), highlight (lowest density), shadow (highest density), and other image feature values are calculated, and in addition, in response to an instruction from the operator using the operation system 18 performed as necessary. The table (LU) of the above-described gray balance adjustment, brightness correction, and contrast correction
T), and image processing conditions such as creation of a matrix operation for performing saturation correction.

The key correction section 74 is provided for controlling image processing conditions according to keys set on the keyboard 18a for adjusting brightness, color, contrast, sharpness, saturation, etc., and various instructions input with the mouse 18b. Adjustment amount (for example, L
The correction amount of the UT is calculated and supplied to the parameter integration unit 76. The parameter integrating unit 76 includes a setting unit 7
2 receives the set image processing conditions, and sets the supplied image processing conditions in the processing unit 50 of the pre-scan image processing unit 44 and the processing unit 54 of the main scan image processing unit 46;
Further, according to the adjustment amount calculated by the key correction unit 74,
Correct (adjust) the image processing conditions set for each part, or reset the image processing conditions.

Hereinafter, the operation of the processing device 14 will be described. As described above, when the pre-scan data is stored in the pre-scan memory 40, the setting unit 72 reads out the pre-scan data, creates a density histogram, calculates an image feature amount, etc., and uses this to set an image processing condition. The setting (creation of LUT and MTX) is sent to the parameter integration unit 76. In parallel with this, the reading conditions of the main scan such as the determination of the aperture value of the variable aperture 24 are set, and the scanner 12 is adjusted. Then, the scanner 12 performs the main scan, and the main scan data is sequentially converted to the main scan. The data is transferred and stored in the memory 40.

The processing unit 14 has a keyboard 18
a and various kinds of instructions and information input by the mouse 18b, and magnetic information of the film F read by the scanner 12 (carrier) are transmitted. When the identification information of the camera is input as described above, This is sent to the characteristic data supply unit 60.

Upon receiving the image processing conditions, the parameter integration unit 76 converts the image processing conditions into the processing unit 50 of the pre-scan image processing unit 44 and the processing unit 54 of the main scan image processing unit 46.
Is set to a predetermined part (hardware). Next, pre-scan data is read from the pre-scan memory 40, processed under the image processing conditions set in the processing unit 50, converted by the image data conversion unit 52, and subjected to predetermined processing. Is displayed on the display 20. At this time, the chromatic aberration of magnification and the distortion may be corrected for the image displayed on the display 20 in the same manner as described above.

The operator confirms (verifies) the image, that is, the processing result, by looking at the display on the display 20 and, if necessary, uses the keys and the like set on the keyboard 18a for color / density and gradation. Adjust etc. The input of this adjustment is sent to the key correction unit 74, which calculates the correction amount of the image processing condition according to the adjustment input, and sends it to the parameter integration unit 76. The parameter integration unit 76
As described above, the LUT and the MTX of the processing unit 50 and the processing unit 54 are corrected according to the sent correction amount, and the image displayed on the display 20 changes according to the correction, that is, the adjustment input by the operator. .

When the operator determines that the image displayed on the display 20 is appropriate (OK), the operator instructs the start of printing using the keyboard 18a or the like. Thus, the image processing conditions are determined, the main scan data is read from the main scan memory 40, and sent to the processing unit 54 of the main scan image processing unit 46.

In the processing section 54, the image data is
After being processed by T and MTX, it is sent to the aberration correction unit 56. On the other hand, the characteristic data supply unit 60 reads out the corresponding lens characteristic from the acquired camera identification information and sends it to the aberration correction unit 56. The aberration corrector 56 determines the lens characteristic and the pixel position of the image data as described above,
The coordinate conversion processing unit 56A calculates pixel positions Ir, Ig, and Ib in which the chromatic aberration of magnification and distortion have been corrected, and sends them to the enlargement / reduction processing unit 56B. The enlargement / reduction processing unit 56B outputs these pixel positions Ir, Ig. Using Ib and Ib, the image data is electronically resized by performing N-fold interpolation on the image data according to the enlargement / reduction ratio, and the chromatic aberration and distortion are corrected, and the image data is subjected to the electronic resizing process. Output to block 54A. Note that the calculation of the pixel positions Ir, Ig, and Ib in the coordinate conversion processing unit 56A may be performed at the time when the information of the lens characteristics is received from the characteristic data supply unit 60 before the supply of the image data.

The image data is further subjected to necessary image processing such as sharpness processing and dodging processing in a block 54A, sent to an image data conversion unit 58, and is sent to the image data conversion unit 58 in accordance with image recording by the printer 16. The converted image data is sent to the printer 16. When the verification is not performed, the image processing conditions are determined at the time when the setting of the image processing conditions in the processing unit 54 of the main scan image processing unit 46 by the parameter integration unit 76 is completed, and the main scan data is automatically set. And sends it to the printer 16. It is preferable that these can be selected in a work mode or the like.

As described above, the image data processed by the processing device 14 is sent to the printer 16. Printer 16
Is to expose a photosensitive material (photographic paper) in accordance with image data to record a latent image, perform development processing in accordance with the photosensitive material, and output as a (finished) print. For example, after the photosensitive material is cut into a predetermined length corresponding to the print, recording of the back print, red (R) exposure, green (G) exposure, and blue (B) according to the spectral sensitivity characteristics of the photosensitive material (photographic paper). )
Recording of latent images by modulating the three types of light beams of exposure G according to image data (recorded image), deflecting them in the main scanning direction, and transporting the photosensitive material in a sub-scanning direction orthogonal to the main scanning direction. Perform a predetermined wet development process such as color development, bleach-fix, washing with water on the photosensitive material on which the latent image is recorded,
After drying to print, sort and accumulate.

Although the image processing method and the image processing apparatus of the present invention have been described in detail above, the present invention is not limited to the above-described embodiments, and various improvements and modifications can be made without departing from the gist of the present invention. Of course you can do it.

[0057]

As described above in detail, according to the present invention, even if the image is taken by a film with a lens, an inexpensive compact camera or a digital camera, etc., the chromatic aberration of magnification of the taken image is obtained by image processing. , Distortion, and the like can be corrected, so that a high-quality image free from color shift, distortion, and the like can be stably output.

[Brief description of the drawings]

FIG. 1 is a block diagram illustrating an example of a digital photo printer using an image processing apparatus according to the present invention.

FIG. 2 is a block diagram of an example of an image processing apparatus of the digital photo printer shown in FIG.

3 is a conceptual diagram of an aberration correction unit of the image processing device shown in FIG.

[Explanation of symbols]

 Reference Signs List 10 (Digital) photo printer 12 Scanner 14 (Image) processing device 16 Printer 18 Operation system 18a Keyboard 18b Mouse 20 Display 22 Light source 24 Variable aperture 26 Color filter plate 28 Diffusion box 32 Imaging lens unit 34 CCD sensor 36 Amplifier 38 Data processing Unit 40 Prescan (frame) memory 42 Main scan (frame) memory 44 Prescan image processing unit 46 Main scan image processing unit 48 Condition setting unit 50, 54 (Image) processing unit 52, 58 Image data conversion unit 56 Aberration correction unit 56A coordinate conversion processing unit 56B enlargement / reduction processing unit 60 (lens) characteristic data supply unit 72 (image processing condition) setting unit 74 key correction unit 76 parameter integration unit

Claims (9)

[Claims] 1. A method of obtaining image data from an optically captured image and reproducing the image data as a visible image, wherein the optically captured image has magnification chromatic aberration, distortion, peripheral light amount, An image processing method for correcting at least one of image blur, wherein at least one of the magnification chromatic aberration, distortion, peripheral light amount, and image blur is obtained from a characteristic of a lens that has captured the image and position information of the image. An image processing method, comprising: 2. The image processing method according to claim 1, wherein the position information of the image is based on an optical axis of a lens at the time of photographing. 3. An image processing apparatus which performs predetermined image processing on image data obtained from an optically captured image and outputs the processed image data as image data for output. Acquisition means for acquiring the lens characteristics of the corresponding photographic lens from the storage means in accordance with the discrimination information acquired by the acquisition means, and the position of the image. An image processing apparatus, comprising: a correction unit configured to correct at least one of chromatic aberration of magnification, distortion, peripheral light amount, and image blur from an information and a lens characteristic. 4. The image processing apparatus according to claim 3, wherein the position information of the image is based on an optical axis of a lens at the time of photographing. 5. The image processing apparatus according to claim 3, further comprising a correction formula corresponding to a plurality of photographing lens types, wherein said storage means stores a correction coefficient of said correction formula as said lens characteristic. 6. The correction means according to claim 3, wherein
Calculate the image position of each image with corrected lateral chromatic aberration from the amount of deviation of the image of the other color from the reference color of the primary color to correct the lateral chromatic aberration of the image, or the amount of deviation of the image due to distortion To calculate the image position in which the distortion of each image has been corrected to correct the distortion of the image, or the amount of shift of the image of another color from the reference color of the three primary colors caused by the chromatic aberration of magnification, and From the amount of shift of the reference color image due to aberrations, calculate the image position corrected for chromatic aberration of magnification and distortion of each image,
The image processing apparatus according to claim 3, wherein the chromatic aberration of magnification and the distortion are corrected. 7. The image position where the correcting means corrects the chromatic aberration of magnification of each image, the image position where the distortion of each image is corrected, or the image position where the chromatic aberration of magnification and the distortion of each image are corrected. , By performing electronic scaling processing, magnification chromatic aberration correction and electronic scaling processing,
7. The image processing apparatus according to claim 6, wherein an interpolation calculation process for correcting distortion and electronic scaling or a process for scaling chromatic aberration and distortion and electronic scaling is performed at a time. 8. The acquisition means acquires information on a lens optically or magnetically recorded on a film and / or information on a lens electrically recorded on a film cartridge as discrimination information. The image processing device according to claim 3. 9. The image processing apparatus according to claim 3, wherein the image processing apparatus is connected to an apparatus for outputting a print in which image data for output subjected to image processing is reproduced as a visible image.