JP2000156785A - Image processing method and image processor - Google Patents

Abstract

PROBLEM TO BE SOLVED: To obtain high quality print such that a high quality image is reproduced, even if it is from an image photographed by an inexpensive camera or an inexpensive digital camera, by discriminating lens type to obtain information about the lens by which the image is photographed and changing intensity of a sharpness emphasis processing of a corresponding image depending on the lens type. SOLUTION: Sharpness processing is performed more intensely than a normal sharpness emphasis processing, desirably a granular suppressing sharpness emphasis processing to the image photographed by the prescribed type of lens to be discriminated by a lens type discriminating part, and the sharpness processing is performed more intensely by setting a gain H multiplied by a second amplifier 104 which is larger than a normal set value, namely, by emphasizing high frequency components the more. Suitable gains M and H corresponding to film type and print size, etc., are set as default in a processing means 90.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention belongs to the technical field of a digital image processing method and a digital image processing apparatus. More specifically, the present invention relates to a digital image processing apparatus for reading a film image photoelectrically and obtaining a print (photograph) in which the image is reproduced. In a photo printer or the like, an image processing method and an image capable of obtaining a high-quality image even if the image is taken with a lens with low performance such as a film with a lens, an inexpensive compact camera, and a low-cost digital camera. It relates to a processing device.

[0002]

2. Description of the Related Art At present, an image photographed on a photographic film (hereinafter referred to as a film) such as a negative film or a reversal film is printed on a photosensitive material (photographic paper) by projecting an image of the film onto the photosensitive material. The so-called direct exposure (analog exposure) for exposing a photosensitive material is mainly used.

On the other hand, in recent years, a printing apparatus using digital exposure, that is, an image recorded on a film is photoelectrically read, the read image is converted into a digital signal, and then various image processing is performed. 2. Description of the Related Art Digital photo printers have been put into practical use as image data for recording, in which a photosensitive material is scanned and exposed with recording light modulated in accordance with the image data to record an image (latent image) and produce a finished print (photograph).

[0004] In a digital photo printer, exposure conditions at the time of printing can be determined by image processing using an image as digital image data, so that image skipping or blurring caused by backlight, strobe photography, or the like is corrected, and sharpness is enhanced. By suitably performing processing and the like, a high-quality print that cannot be obtained by conventional direct exposure can be obtained. In addition, images and characters can be combined by image processing, and prints that have been freely edited / processed according to the intended use can be output.

Further, according to the digital photo printer, in addition to the image photographed on the film, an image photographed by a digital camera or an image processed by a computer can be output as a print. Can be supplied to a computer or the like, or can be stored in a recording medium such as a floppy disk, so that the image data can be used for various purposes other than a photograph.

[0006] Such a digital photo printer basically includes a scanner (image reading device) that photoelectrically reads an image recorded on a film by inputting reading light to the film and reading the projected light. An image processing apparatus that performs predetermined image processing on image data read by a scanner or image data supplied from a digital camera or the like to obtain image data and exposure conditions for image recording, and an image output from the image processing apparatus. Depending on the image data,
For example, a printer (image recording device) that scans and exposes a photosensitive material by light beam scanning to record a latent image, and a processor (development) that develops the photosensitive material exposed by the printer to produce a print in which an image is reproduced Device).

[0007]

When a general user takes a normal photograph, it is rare to use an expensive and high-performance camera such as a single-lens reflex camera. In general, a so-called compact camera in which operations such as focusing are automated is used. In recent years, there are very many users who use a so-called lens-attached film because it is easy to use.

[0008] In a camera such as a single-lens reflex camera, which can incur a certain amount of cost, a high-precision lens is used, and by combining a plurality of lenses,
Very high quality images can be taken. On the other hand, a film with a lens or an inexpensive compact camera cannot increase the cost of the lens, and can use only one or two inexpensive lenses. Images that cannot be reproduced and printed cannot always be said to have high image quality.

SUMMARY OF THE INVENTION An object of the present invention is to solve the above-mentioned problems of the prior art, and it is possible to use an image taken by an inexpensive camera such as a film with a lens or a compact camera or an image taken by an inexpensive digital camera. Even
An object of the present invention is to provide an image processing method and an image processing apparatus capable of obtaining a high-quality print (photograph) in which a high-quality image is reproduced.

[0010]

As described above, in the case of a film with a lens or a compact camera, the cost of the lens cannot be increased. It is not possible to obtain reproduced high quality finished prints. Conventionally, in order to correct image quality deterioration due to such lens performance, particularly image blur, it is necessary to consider the phase of an image, that is, to perform inverse conversion of a focus blur (PSF: Point Spread Function). However, this method has a problem that the scale of the processing circuit becomes large and the processing is difficult.
As a result of the inventor's intensive studies on such problems, the intensity of the sharpness enhancement processing (sharpness processing) is changed even for an image photographed by a film with a lens or the like. It is found that by applying a stronger force, it is possible to obtain a print of sufficient image quality in which the out-of-focus is corrected without performing the difficult PSF correction, and if the apparatus has a sharpness enhancement processing function, By changing the intensity of the sharpness enhancement processing as described above, without increasing the cost of products etc.,
As a result of finding out that image quality degradation caused by lens performance can be covered, the present invention has been achieved.

That is, an image processing method according to the present invention is an image processing method for obtaining image data from an image photographed optically and performing at least sharpness enhancement processing to obtain image data for an output image. The method is characterized in that information of a lens that has captured an image is obtained, a lens type is determined, and the intensity of the sharpness enhancement processing of a corresponding image is changed according to the lens type.

Here, it is preferable that the image of the lens type for which the intensity of the sharpness enhancement processing is changed is also corrected for the image quality deterioration caused by the lens characteristics. Further, it is preferable that the correction of the image quality deterioration caused by the lens characteristic is at least one of distortion correction, magnification chromatic aberration correction, and peripheral light amount correction caused by the lens characteristic. Further, the intensity of the sharpness enhancement processing is changed uniformly over the entire image of one frame, or the image of one frame is divided into a plurality of images,
Preferably, it is changed for each of the divided image areas.
Further, it is preferable that the intensity of the sharpness enhancement processing is independently changed for each of the three primary colors or uniformly for each of the three primary colors. Further, it is preferable that the strength of the sharpness enhancement processing is further changed depending on the film type.

An image processing apparatus according to the present invention is an image processing apparatus which performs image processing on image data obtained from an optically captured image to obtain image data for an output image. A determination unit that obtains identification information of a photographed lens and determines a lens type thereof; and an image processing unit that performs at least image sharpness enhancement processing. The method is characterized in that the intensity of the sharpness enhancement processing of the corresponding image is changed according to the result of the type determination.

Here, the image processing means stores the lens characteristics corresponding to the lens type, receives the lens characteristics of the corresponding lens type from the storage means, and stores the image characteristics based on the position information of the image and the lens characteristics. Image quality deterioration correction means for correcting the image quality deterioration of the image, and it is preferable that the image quality deterioration correction means also perform image quality deterioration correction on the image for changing the intensity of the sharpness enhancement processing. Preferably, the means corrects at least one of distortion correction, lateral chromatic aberration correction, and peripheral light amount correction caused by the lens characteristic. Further, it is preferable to perform a sharpness enhancement process after the correction of the image quality deterioration. Further, the image quality deterioration correcting means corrects magnification chromatic aberration and distortion due to lens characteristics, or furthermore, peripheral light quantity, and shifts of image positions of other colors with respect to a reference color of three primary colors caused by magnification chromatic aberration. Using the amount of shift caused by the chromatic aberration of magnification and the amount of shift of the image position of the reference color caused by the distortion, the appropriate amount of each image in which the chromatic aberration of magnification is corrected in addition to the distortion is calculated. It is preferable to calculate a position and correct image quality deterioration from an appropriate position of each image, or to perform image quality correction and electronic scaling processing using an appropriate position of each image.

Preferably, the lens type for changing the intensity of the sharpness enhancement processing of the image is a lens of a film with a lens. Further, the image processing means uniformly changes the intensity of the sharpness enhancement processing over the entire image of one frame, or divides the image of one frame into a plurality of images,
It is preferable to change for each of the divided image areas. Further, it is preferable that the image processing means changes the intensity of the sharpness enhancement processing independently for each of the three primary colors or uniformly for each of the three primary colors. Further, it is preferable that the image processing means further changes the intensity of the sharpness enhancement processing depending on a film type.

[0016]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, an image processing method and an image processing apparatus according to the present invention will be described in detail based on preferred embodiments shown in the accompanying drawings.

FIG. 1 is a block diagram showing an embodiment of a digital photo printer using an image processing apparatus of the present invention for implementing the image processing method of the present invention. A digital photo printer (hereinafter, referred to as a photo printer) 10 shown in FIG. 1 basically includes a scanner (image reading device) 12 that photoelectrically reads an image captured on a film F, and read image data ( An image processing device 14 that performs image processing of image information and the entire operation and control of the photo printer 10, and images a photosensitive material (photographic paper) with a light beam modulated according to image data output from the image processing device 14. A printer 16 for exposing, developing and outputting as a print (photograph). The image processing apparatus 14 includes an operation system 18 having a keyboard 18a and a mouse 18b for inputting (setting) various conditions, selecting and instructing various processes, and inputting instructions such as color / density correction. ,
A display 20 that displays an image read by the scanner 12, various operation instructions, a condition setting / registration screen, and the like is connected.

The scanner 12 is a device that photoelectrically reads an image photographed on a film F or the like one frame at a time.
A variable aperture 24, a diffusion box 28 for making the reading light incident on the film F uniform in the surface direction of the film F, a scanner 30 for holding the film F at a predetermined position, an imaging lens unit 32, (Red), G (green) and B
An image sensor 34 having a line CCD sensor corresponding to each image reading of (blue), an amplifier 36,
An A / D (analog / digital) converter 38.

In the photo printer 10, the type and size of a film such as a new photo system (APS; Advanced Photo System) film or a 135 size negative (or reversal) film, the form of a film such as strips and slides, and the like. Accordingly, a dedicated carrier 30 that can be mounted on the main body of the scanner 12 is prepared, and by replacing the carrier 30, it is possible to cope with various films and processes. An image (frame) photographed on a film and provided for printing is conveyed by the carrier 30 to a predetermined reading position.

When the scanner 12 reads an image photographed on the film F, the image is emitted from the light source 22 and
The reading light, the light amount of which is adjusted by the variable aperture 24, is transmitted to the film F positioned at a predetermined reading position by the carrier 30.
, And is transmitted therethrough to obtain projection light carrying an image photographed on the film F.

As shown in FIG. 2A, the carrier 30 holds the film F at a predetermined reading position, and also has a sub-scanning direction orthogonal to the extending direction (main scanning direction) of the line CCD sensor of the image sensor 34. In the scanning direction, the longitudinal direction of the film F is conveyed, and the conveying position is set in the sub-scanning direction with the conveying roller pair 30a and 30b interposed therebetween, and the projection light of the film F is regulated in a predetermined slit shape. And a mask 40 having a slit 40a extending in the main scanning direction at a position corresponding to the reading position. Film F
Is read by the carrier 30 while being positioned at the reading position and conveyed in the sub-scanning direction. As a result, the film F is two-dimensionally slit-scanned by the slit 40a extending in the main scanning direction, and the image of each frame captured on the film F is read.

As is well known, a magnetic recording medium is formed on a film of the new photographic system, and a carrier 30 corresponding to the film (cartridge) of the new photographic system has information recorded on the magnetic recording medium. And a magnetic head 42 for reading necessary information and recording necessary information. The information recorded on the magnetic recording medium of the film F is read by the magnetic head 42 and sent from the main body of the scanner 12 to a necessary portion such as the image processing device 14 or various kinds of information are transmitted by the magnetic head 42 to the film F. Is recorded on a magnetic recording medium. Reference numeral 44 in the figure denotes a DX code optically recorded on the film, an extended DX code,
It is a sensor (bar code reader) for reading a bar code such as an NS code or various information optically recorded on a film, and the various information read by the sensor 44 is necessary for the image processing device 14 or the like. Sent to the site.

As described above, the reading light is transmitted through the film F held on the carrier 30 at a predetermined reading position, and becomes projection light for carrying an image. An image is formed on the light receiving surface of the image sensor 34. As shown in FIG. 2B, the image sensor 34 includes a line CCD sensor 34R for reading an R image and a line CCD sensor 34 for reading a G image.
Line CCD sensor 34B for reading G and B images
A three-line color CCD sensor with
Each line CCD sensor extends in the main scanning direction as described above. The projection light of the film F is separated into three primary colors of R, G and B by the image sensor 34 and read photoelectrically. The output signal of the image sensor 34 is amplified by the amplifier 36, converted into a digital signal by the A / D converter 38, and sent to the image processing device 14.

The scanner 12 reads an image photographed on the film F by two image readings: a pre-scan for reading at a low resolution and a main scan for obtaining image data of an output image. The pre-scan is performed under pre-scan reading conditions set in advance so that the image of all the films targeted by the scanner 12 can be read without saturation of the image sensor 34. On the other hand, the main scan is performed under the main scan reading conditions set for each frame from the pre-scan data so that the image sensor 34 saturates at a density slightly lower than the minimum density of the image (frame). The output signals of the prescan and the main scan are basically the same except that the resolution and the output level are different.

In the present invention, the scanner 12
The invention is not limited to such slit scanning, and the entire surface of one frame image can be formed at once using an area CCD sensor.
R, G, and B may be read in a face-sequential manner, and may use face reading. Also, the photo printer 10
In addition to the scanner 12 that photoelectrically reads an image photographed on a film such as a negative or a reversal, an image reading device that reads an image of a reflection original, an imaging device such as a digital camera or a digital video camera, communication means such as computer communication, Various image data supply sources such as FD (floppy disk), MO (magneto-optical recording medium), and image recording medium such as smart media can be used, and these can be used directly or via the driving device thereof. , The image data can be received from these image data supply sources, and a print can be created.
In particular, the present invention can be suitably used for an image (digital image data) in which an object is directly optically photographed by an imaging device such as a digital camera or a digital video camera. An image recording medium 2 on which digital image data obtained by directly photographing a subject with an imaging device such as a digital camera is recorded.
5 is connected to the image processing device 14. Of course, a digital camera or the like may be directly connected to the image processing device 14 so that the captured image data can be directly input to the image processing device 14.

As described above, output signals (image data) from the scanner 12, the recording medium driving device 26, and the like are output to the image processing device 14. In the following description, a case where one frame of image data is mainly supplied from the scanner 12 to the image processing apparatus 14 will be described as a representative example. FIG. 3 shows a block diagram of an image processing device (hereinafter, referred to as a processing device 14). The processing device 14 includes a data processing unit 50, a Log converter 52, a pre-scan memory 54, and a main scan memory 5.
6, pre-scan processing unit 58, main scan processing unit 60,
And a condition setting unit 62. FIG. 3 mainly shows parts related to image processing. The processing device 14 includes a CPU that controls and manages the entire photo printer 10 including the processing device 14, A memory or the like for storing information necessary for operation or the like is provided. Further, the operation system 18 and the display 20 are connected to each part via the CPU or the like (CPU bus).

The R, G, and B digital signals output from the scanner 12 are converted by a data processing unit 50 into D signals.
After performing predetermined data processing such as C offset correction, dark time correction, and shading correction, the data is converted by the Log converter 52 into digital image (density) data, and the prescan (image) data is stored in the prescan memory 54. The main scan (image) data is stored in the main scan memory 56. The pre-scan data and the main scan data are basically the same data except that the resolution (pixel density) and the signal level are different.

The pre-scan data stored in the pre-scan memory 54 is processed in the pre-scan processing section 58, and the main scan data stored in the main scan memory 56 is processed in the main scan processing section 60. The pre-scan processing section 58 has an image processing section 64 and a data conversion section 66, while the main scan processing section 60 has an image processing section 68, a data conversion section 70, and a lens type determination section 74.

The image processing section 64 of the prescan processing section 58
And the image processing unit 68 of the main scan processing unit 60
It is a part that performs predetermined image processing on an image (image data) read by the scanner 12 according to an image processing condition set by a condition setting unit 62 described later. Image processing unit 6
4 and 68 basically perform the same processing except that the pixel density of the image data to be processed is different and the image processing unit 64 does not have the aberration correction unit 72. The image processing unit 68 of the scan processing unit 60 is performed as a representative example. In the present invention, the image processing unit 64 of the pre-scan processing unit 58 is also provided with an aberration correction unit, and the pre-scan image has aberrations such as distortion and chromatic aberration of magnification and peripheral light reduction as described below, as necessary. For example, correction of image quality deterioration such as the above may be performed.

The LUT of the image processing section 68 (64) is LU
A portion for performing color balance adjustment, contrast adjustment (gradation processing), and brightness adjustment (density adjustment) of an image according to T (lookup table).
Is a part for adjusting the saturation of an image by a matrix operation.

The image processing section 68 of the main scan processing section 60 includes a correction between the MTX and the block 68A for correcting aberrations such as distortion and chromatic aberration of magnification and image quality deterioration such as a decrease in peripheral light amount (hereinafter, representatively, aberrations). Correction), and an aberration correction unit 72 that performs electronic scaling processing. The aberration correction unit 72 and the block 68 include a lens type determination unit 7.
4 are connected.

As will be described in detail later, the processing apparatus 1 according to the present invention
In step 4, the lens type of the lens on which the subject is photographed on the film F or the lens on which the subject is directly photographed by the imaging device is determined. The sharpness enhancement processing (sharpness processing) to be performed is strongly applied. In the present invention, this makes it possible to reproduce a high-quality image from a picture taken with a lens-equipped film or a low-cost lens such as a compact camera or a digital camera without applying difficult PSF correction or the like. It is possible to output simple prints. Here, in the processing device 14 of the illustrated example, as a preferable mode, in the case of an image which is photographed with a predetermined lens type and sharpness processing is strongly applied, aberration correction due to lens characteristics is also performed, and high intensity sharpness is obtained. , A higher quality image is obtained. In other words, in the present invention, sharpness processing is applied to an image taken with a low-performance lens that requires aberration correction to obtain a high-quality image, or further aberration correction is performed to obtain a high-quality image. The realization of obtaining images. In the high-intensity sharpness enhancement processing of the present invention, the same intensity may be applied uniformly to the entire screen of one frame, or similarly to the aberration correction, according to the lens characteristics, that is, according to the distance from the center of the image. The strength may be changed. By doing so, the out-of-focus caused by the lens can be finely corrected, and a high-quality image that has been subjected to appropriate sharpness processing can be reproduced.

The lens type discriminating section 74 acquires lens information for discriminating the lens type, discriminates the lens type that has captured the image on the film F, and determines the necessity of high-intensity sharpness processing and aberration correction based on the result. Judge unnecessary, and give an instruction based on the result to the aberration corrector 72 and the block 68A
Then, the lens characteristics of the determined lens type are supplied to the aberration corrector 72. In the present invention, there is no limitation on the type of lens that sharply applies sharpness processing to an image, but it is preferable to apply strong sharpness processing to at least an image captured with a film with a lens (hereinafter referred to as LF). .

There is no particular limitation on the lens information for determining the type of lens that has captured the image on the film F, and there is no particular limitation on the means for obtaining the lens information, and various methods can be used. Normally, the lens type can be determined if the model of the camera is known. For example, in the case of the LF of the new photographic system, the cartridge ID and / or the film type magnetically recorded on the film F in the scanner 12 (carrier 30) are reading,
This may be used to determine the camera model, that is, the lens type. By the way, the lens information used in the present invention may be the lens information itself, information indicating the lens information indirectly, for example, information such as a camera model, or encoding such lens information. For example, a code indicating the lens information directly or indirectly, for example, a lens type code or a camera model code may be used. Such a code may be a film cartridge ID or camera model from which the above-described lens information can be obtained. Here, the lens information may be information relating to the lens itself or information relating to the performance of the lens, or information relating to the LF and the model of the camera. It may be information on each amount of deterioration related to chromatic aberration, peripheral light amount reduction, and the like. Such lens information is recorded optically or magnetically or also electrically at the time of film production, at the time of film loading, or at the time of inserting an image recording medium into a digital camera, or at the time of shooting,
The scanner 12 (carrier 30) may read the lens information recorded on the film F and use this to determine the lens type.

That is, like a digital camera,
In the case where a subject is directly photographed by an image pickup device without using a film and the image data is directly recorded on the image recording medium, the lens information is inserted into the image recording medium or the image data of a series of frames is recorded at the time of photographing. Alternatively, the lens type may be determined by electrically recording the data in a header of image data of one frame or the like, and reading the data. In the case of the LF, before loading the film F into the camera (at the time of manufacture), lens information such as a lens type is magnetically stored in the film F (in the case of the new photographic system (APS) -LF) or optically. (In the case of 135-LF and APS-LF), and the lens type may be determined using this. For example, 135-L
With an LF such as F or APS-LF, lens information can be optically recorded in advance in a non-photographing area (outside the effective area) of the film separately from the DX code and the extended DX code at the time of film production. For example, in the case of APS-LF, it is also possible to optically record the rod code at the beginning and end of the APS film, which can be freely used by the film manufacturer, in advance. In the case of APS-LF, lens information can be magnetically recorded in advance on the magnetic layer of the APS film when the film is manufactured. Furthermore, 135-L using a film cartridge with IC
In the case of F and APS-LF, lens information can be electrically recorded in advance in the cartridge IC at the time of film production.

In the case of a camera of the New Photo System (APS) or an APS-LF, lens information such as the camera model and lens type is magnetically recorded on the film F when the film is loaded or photographed. This may be used.
Further, depending on the camera, for example, a camera using a normal 135 film, an APS camera, 135-LF, APS
-In the case of LF, lens information such as lens type (model of camera) may be optically recorded outside the effective area of the film using an LED or the like from the camera side when loading or photographing the film. it can. Alternatively, in various similar cameras, a notch provided at the opening edge of the exposure aperture frame of the camera is exposed and printed on the film at the time of photographing, and the notch as shown in FIGS. 6A and 6B as lens information. The mark 46 may be optically recorded outside the effective area of the film, or the film may be exposed to unevenness provided on an aperture that defines a photographing screen of the camera film at the time of photographing.
The irregularities 48 shown in (C) and (D) may be recorded outside the effective area of the film. FIG. 6 (A) and (B)
In the case of the notch mark 46 shown in FIG.
The code using the number, shape, spacing, etc. of
In the case of the irregularities 48 shown in (C) and (D), the lens information can be recorded by a code using the number, shape, interval, and the like, preferably a barcode readable by a barcode reader. In these cases, the scanner 1
A range larger than the image capturing area (effective area) of the image in the carrier 2 (carrier 30) may be read, and lens information may be read from the read notch mark 46 or the unevenness 48 to determine the lens type.

Although all frames of an APS film are usually photographed by a single camera, some APS cameras have a mid-way exchange (MRC) function.
If the APS camera uses the midway exchange function and one APS film is shot by a different camera, the change in sharpness intensity according to the lens type of the present invention is determined in consideration of the midway exchange function. Of course, this is performed using the lens type of this camera. Further, at the time of reception, the customer asks and records the model of the LF and the model of the camera used for photographing 135 film, etc., and when printing, the operator inputs this with the keyboard 18a or the like to determine the lens type. You may.

Further, if the lens type is not determined, and if the film is a specific film F, for example, a film F shot by LF, the detection of the LF film is used as the detection of the lens type. Under the above condition, sharpness processing may be applied strongly, or aberration correction may be further performed. The determination of the LF film F is made by the lens type information, the camera identification code recorded on the film, etc., and the SSU ( SnapShooting
Unit) indicator etc. can be used.

The lens type discriminator 74 stores information on lens characteristics according to various types of lenses, specifically, information on distortion and chromatic aberration of magnification and characteristics of reduction in peripheral light intensity, and the intensity of sharpness processing. When changing according to the distance from the camera, information on the blur characteristic (for example, focus blur characteristic, that is, PSF characteristic) of the image is stored. Alternatively, as described above, in the case of performing uniform correction in the case of LF, information on average lens characteristics of LF may be provided. If it is determined that the image is an image captured by a predetermined lens type, sharply processed, and the image needs to be corrected for aberration, the lens type determination unit 74 determines a lens corresponding to the determined lens type. The characteristic information is read from the memory and supplied to the aberration corrector 72.

Although there is no particular limitation on the lens characteristics,
In general, the characteristics of the lens such as distortion characteristics, magnification chromatic aberration, peripheral light reduction, and if necessary, blurring of the image depend on the optical axis of the lens, that is, the distance from the center of the image photographed on the film F (for example, (indicated by xy) can be approximated to some extent by a cubic function having parameters as parameters. Therefore, for lens types that need to be corrected for distortion, chromatic aberration of magnification, reduction in peripheral light quantity, blurring of an image, etc. A function indicating a characteristic of the distortion aberration, a function indicating the characteristic of the chromatic aberration of magnification, a function indicating a characteristic of a decrease in peripheral light amount, a function indicating a blur characteristic of an image, and the like may be stored as lens characteristics.

The aberration corrector 72 determines the lens characteristics of the film F supplied from the lens type determiner 74 and the position information of the image data (pixels) for the image determined to be necessary by the lens type determiner 74. Using the coordinate position from the center of (the number of pixels from the center pixel), distortion,
Correction of chromatic aberration of magnification, correction of decrease in peripheral light quantity, and electronic scaling processing are performed. This coordinate is, for example, x-
Various types of position information can be used as long as the position of the image (pixel) can be relatively detected.
Therefore, regarding the image for which the lens type determination unit 74 determines that it is not necessary to apply sharpness processing strongly, it is assumed that there is no image quality deterioration due to the photographing lens, and the aberration correction unit 7
In step 2, only the electronic scaling process is performed. Also, even if it is determined that sharpness processing needs to be applied strongly,
If the lens characteristics are not stored, only the electronic zoom processing is performed.

Here, if the correction of the chromatic aberration of magnification and the distortion using the lens characteristics and the position information of the image (hereinafter referred to as pixel position) are separately performed, it takes a long time to perform the calculation, and a plurality of interpolation calculations are performed. Since it is necessary to perform the operation twice, there is a problem that the image quality is deteriorated. Therefore, preferably, R,
The image magnifications of R and B are converted with reference to the three primary colors of G and B, usually G, and the chromatic aberration of magnification is corrected by adjusting the R and B images to the G image. The distortion of the G image is corrected, and the distortion and chromatic aberration of magnification of the image are corrected. Thus, by calculating an appropriate position of each pixel and using the calculated position to interpolate the image data of each pixel, it is possible to obtain image data in which the chromatic aberration and distortion of the image photographed on the film have been corrected. it can. Accordingly, since only the operation on the G image needs to be performed for the distortion, it is possible to perform more appropriate correction of the chromatic aberration of magnification and the distortion by reducing the amount of operation and the interpolation operation.

In an image processing apparatus, usually, an image is enlarged or reduced by image data processing, that is, electronic scaling is performed, and an image (image data) is output in a size corresponding to an output image. This electronic scaling process is usually performed by performing an interpolation operation on image data. However, since the interpolation calculation is necessary even in the correction of the chromatic aberration of magnification and the distortion, as a result, the interpolation is performed twice, and the image quality may be degraded.

For this reason, more preferably, using the lens characteristics and the pixel position of the image data, the amounts of displacement of the R and B pixel positions with respect to the reference color (G) caused by the chromatic aberration of magnification and the distortion caused by the distortion. From the shift amount of the pixel position of the reference color, an appropriate position for each pixel is calculated, and using the information on the calculated appropriate position of each pixel, the image data of each pixel is interpolated to electronically scale the image. I do. In other words, by calculating the amount of deviation of the pixel position due to chromatic aberration of magnification and distortion, it is possible to detect where each pixel should be originally located, and perform interpolation calculation of image data according to the appropriate position. To perform electronic scaling. Thereby, the correction of the distortion and the chromatic aberration of magnification and the electronic scaling process can be performed by one interpolation calculation.

The aberration corrector 72 in the illustrated example is a part for performing the above-described processing method, and has a coordinate conversion processor 72A and an enlargement / reduction processor 72B as shown in the conceptual diagram of FIG. In FIG. 4, ir, ig and ib
Are the pixel positions (addresses) of the image data (input image data) supplied from the MTX, respectively; Ir, Ig and Ib are the pixel positions of the image data in which the chromatic aberration of magnification and the distortion have been corrected; D represents the amount of displacement of the R and B pixel positions (that is, the correction amount) from the G pixel position due to chromatic aberration of magnification; and D represents the amount of displacement of the G pixel position due to distortion.

In the aberration correction section 72, when image data is supplied from MTX, the coordinate conversion processing section 72A uses the lens characteristics supplied from the lens type determination section 74 to output each of the R and B image data. The shift amounts Δr and Δb due to chromatic aberration of magnification with respect to the G image data ig at the pixel positions ir and ib are calculated, and the shift amount D due to the distortion of the G input image data ig is calculated.

Next, by adding Δr and D to each pixel position ir of the R input image data, the pixel position Ir of the R image data in which the chromatic aberration of magnification and distortion have been corrected is calculated. B in which the chromatic aberration of magnification and the distortion have been corrected by adding Δb and D to each pixel position ib of
The pixel position Ib of the B image data corrected for the chromatic aberration of magnification and the distortion is calculated by adding the D to each pixel position ig of the G input image data.
b is calculated. That is, in this calculation, the chromatic aberration of magnification of the R image and the B image is corrected based on the G image,
The entire image is aligned with the G image, and the entire distortion is corrected using the shift amount D due to the distortion of the G image,
The pixel positions of the R, G, and B images in which the chromatic aberration of magnification and the distortion have been corrected are calculated.

Next, in the enlargement / reduction processing section 72B,
The pixel position I corrected for this chromatic aberration of magnification and distortion.
Using r, Ig, and Ib, the image is scaled by performing interpolation (N-fold interpolation) of the image data in accordance with the enlargement / reduction magnification, thereby correcting magnification chromatic aberration and distortion, and electronic scaling. The processed image data is output to the block 68A. There is no particular limitation on the method of the electronic scaling process, and various known methods can be used. Examples thereof include a method using bilinear interpolation and a method using spline interpolation.

When the distortion is corrected, the image in the reproduction area may be lost, that is, so-called vignetting may occur. Therefore, when the distortion is corrected, the correction is performed by about 0.1% to 5% than usual. Electronic scaling processing (interpolation) with high scaling ratio
Is preferably performed. Further, the electronic magnification at that time may be variously set according to the lens type. In addition, since the amount of distortion may differ between the vertical and horizontal directions of the image, the magnification of the electronic magnification processing may be changed between the vertical and horizontal directions.

In the illustrated apparatus, both distortion and chromatic aberration of magnification are corrected as a preferred embodiment, but only one of them may be performed. Also in this case, instead of separately performing the aberration correction and the electronic scaling process, a proper position in which the amount of deviation caused by the aberration is corrected is calculated in the same manner as described above, and information on the proper position is used. It is preferable to perform electronic scaling by interpolating image data. Furthermore, not only distortion and chromatic aberration of magnification, but also a decrease in peripheral light amount and out-of-focus (PSF: Point S
The characteristics of the pread function may also be stored, and in addition to the aberration correction, focus blur correction and peripheral light amount correction may be performed.

The MTX of the image processing section 64 and the image data processed by the aberration correction section 72 are then sent to block 6
Processed at 4A and 68A.

Blocks 64A and 68A represent various types of image processing other than the various types of processing described above, such as dodging (compression of image dynamic range while maintaining intermediate gradation), synthesis of characters and images, in addition to sharpness processing. Is the part where The pre-scan processing section 58 may not include the block 64A, and the block 64A may not perform the sharpness processing. In the following description,
The sharpness processing is performed only in the block 68A. Here, in the processing device 14 according to the present invention, as described above, in accordance with the instruction from the lens type determination unit 74, the image captured by the specific lens type is added to the block 68A (or further, the block 64A). Apply sharpening processing more than usual.

FIG. 5 is a block diagram showing an example of processing means for performing the sharpness processing in the block 68A. As shown in the figure, (sharpness) processing means 90
Is a first low-pass filter (hereinafter referred to as LPF) 92
, A first subtractor 94, a luminance calculator 96, and a second LP
F98, a second subtractor 100, a first amplifier 102,
It has a second amplifier 104, a first adder 106, and a second adder 108.

In the processing means 90, image data (hereinafter, referred to as an original signal) S _F input after predetermined processing is completed.
(R, G, B) is processed by the first LPF 92 to obtain the original signal S
The low frequency components R _L , G _L , and B _L of _F (R, G, B) are extracted. The first LPF 92 is, for example, a 9 × 9 LPF. On the other hand, the first subtractor 94 subtracts the low frequency components R _L , G _L , and B _L from the original signal S _F to extract intermediate / high frequency components R _MH , G _MH , and B _MH . Here, the extracted low-frequency components R _L , G _L , and B _L do not include edges in optically captured color images, fine textures, and roughness due to film graininess. On the other hand, the intermediate frequency components R _M , G _M , and B _M include roughness due to film granularity, and the high frequency components R _H , G
_H and B _H include edges and fine texture in a color image.

Next, in the luminance calculating means 96, the first
The intermediate and high frequency components R _MH obtained by the subtractor 94,
A luminance component is extracted from G _MH and B _MH . The luminance component, the original signal S _F of the intermediate and high frequency components R _MH, G _MH, B _MH
Is a luminance (intermediate / high frequency) component Y _MH when Y is converted into the YIQ standard, and is calculated by the following equation, for example. Y _MH = 0.3R + 0.59G + 0.11B I _MH = Q _MH = 0 Here, the component I _MH and the component Q _MH that are color components have almost no component in the case of an image of a general subject. I know it. Thus, component I _MH and component Q
_By setting _MH to 0, assuming that the color is attributable to film graininess, it is possible to obtain a good reproduced image with reduced roughness.

[0056] Then, the luminance component Y _MH, the 2LP
It is subjected to filtering processing by the F98, to obtain an intermediate frequency component Y _M of the luminance component Y _MH. The second LPF 98 is
For example, a 5 × 5 LPF. Further, the second subtractor 1
In 00, get the high frequency components Y _H of the luminance components Y _MH by subtracting the intermediate frequency components Y _M of the luminance components Y _MH. Intermediate frequency component Y obtained by second LPF 98
To _M, the gain M is the sharpness gain for intermediate frequency components Y _M in the first amplifier 102 (gainM)
To the high frequency component Y _H obtained by subtraction,
The gain H (GainH) is the sharpness gain for the high frequency components Y _H in the second amplifier 104, and multiplied respectively, to obtain a processed component Y _'M, Y' _H. here,
In the processing means 90, when sharpness enhancement processing is performed, an intermediate image including graininess due to film graininess is used to suppress graininess so as to emphasize edges and fine textures in an image without conspicuous graininess due to film graininess. The gain M is set so that the frequency components R _M , G _M , and B _M (luminance component Y _M ) are not excessively emphasized, and the high frequency components R _H , G _H , B including edges and fine texture in the image are set. _It is preferable to set the gain H so as to emphasize _H (luminance component Y _H ). By doing so, the processing means 90 can perform the graininess suppression sharpness enhancement processing.

First amplifier 102 and second amplifier 104
Been processed resulting in component Y _'M and Y' _H are synthesized by the first adder 108, the processed luminance components Y _'MH is obtained. Further, in the second adder 108, the processed luminance component Y ′ _MH obtained in this way is converted to the above-described original signal S _F.
Are combined with the low frequency components R _L , G _L , and B _L to obtain image data R ′, G ′, and B ′ that have been subjected to sharpness processing. At this time, since the values of the components I _MH and Q _MH are set to 0, if the processed luminance component Y ′ _MH is inversely converted to correspond to the RGB data, all the three RGB data are converted to the component Y _MH. Since the value is the same as that of ', the processing can be simplified by combining the processed luminance components Y _MH ' without _performing inverse conversion.

Here, as described above, according to the present invention, an image photographed by a specific lens type determined by the lens type determining unit 74 is subjected to a normal sharpness enhancement process, preferably a granular suppression sharpness enhancement process. In the illustrated example, the sharpness processing is strongly applied by making the gain H multiplied by the second amplifier 104 larger than a normal set value, that is, by further emphasizing high frequency components. It is something to put on. In this example, since the strength of the sharpness enhancement process is increased by increasing the gain H of the high frequency component, the gain H of the high frequency component can be used as the intensity of the sharpness enhancement process.

In the processing means 90, suitable gain M and gain H according to the film type, print size, etc.
Is set as the default. For example, when a 2L size print is created from a film taken by a camera having a lens not specified as a specific lens type such as a single-lens reflex camera, a digital value of 10 (for example, , Gain 1.2
5), but the gain H is a digital value 28 (for example,
Gain is equivalent to 3.50).
The processing means 90 normally performs sharpness processing using these sharpness gains. On the other hand, for example, for an image photographed with a specific lens type, such as a film photographed with LF, in which the lens type discriminating unit 74 instructs to apply sharpness processing strongly, the processing unit 90
The gain H larger than the default, for example, in the above-described example, the gain H is set to a digital value of 32 (e.g., equivalent to a gain of 4.50) to perform high-intensity sharpness processing.

In the present invention, the method of applying the sharpness processing stronger than usual is not limited to the above method, and various methods can be used depending on the method of the sharpness processing to be used. The sharpness processing conditions such as the gain H and the gain M, which are the sharpness strengths when the sharpness processing is strongly applied, may be uniform regardless of the lens type, but are optimal for each according to the lens characteristics of the lens type. Conditions may be set.

In the above-described example, when performing the high-intensity sharpness processing, the intensity of the sharpness enhancement processing is
That is, although the gain H of the high frequency component is uniformly changed over the entire image of one frame, the present invention is not limited to this.
The image of the frame may be divided into a plurality of regions, and the image may be changed for each image in the divided region. The method of dividing one frame image into a plurality of regions is not particularly limited, and may be divided in any manner. The size and shape of the divided regions are not particularly limited, and any method may be used. The size and shape may be used. For example, an image of one frame may be divided into a plurality of rectangles, specifically, a 20 × 20 rectangular area per first quadrant, or a concentric circle centered on the center of the image and a plurality of flat plates. The image may be divided into rings (rings), may be divided into pixel units, or may be divided into one or more regions including the main subject in the image and some regions not including the main subject. Alternatively, the image may be divided into a main subject area and other areas. Of course, one of the remaining sharpness processing conditions is the gain M of the medium frequency component.
May be changed for each image in the divided area. In this case, since the strength (gain H) and the condition (gain M) of the sharpness enhancement processing in each of the divided areas are different, in order to make the connection at the boundary of each area smooth, It is preferable to set the sharpness intensity (gain H) and condition (gain M) so that the change is smooth.

At this time, the out-of-focus caused by the lens characteristics, and therefore the blur (PSF) of the photographed image, are the same as the image quality deterioration such as distortion and chromatic aberration of magnification and deterioration of the amount of peripheral light. It tends to increase with distance from the center. For this reason, the blur characteristic of this image is stored in the lens type determination unit 74 as information of the lens characteristics corresponding to various types of lenses, together with information on the characteristics of aberrations such as distortion and chromatic aberration of magnification and the characteristics of the peripheral light amount. When the processing means 90 performs the sharpness enhancement processing of the present invention,
Information on the blur characteristics of the image corresponding to the determined lens type is read from the memory, and the sharpness intensity (gain H) and condition (gain M) for each of the divided regions based on the position of each divided region and the size of the blur. May be determined. By doing so, even if the PSF correction is not performed in the aberration correction unit 72, the blurring of the image caused by the lens can be appropriately corrected according to the degree of blurring. It is possible to reproduce a few high-quality images. In this case, an image of one frame is divided into a plurality of rectangles, for example, a rectangular area of 20 × 20 per first quadrant, or a center circle and a plurality of plate-shaped toroids (concentric circles centered on the center of the image). Ring). When an image of one frame is divided into a plurality of rectangular areas, each unit rectangular area only in a quarter of the entire image of one frame, for example, 40 ×
When dividing into 40 unit rectangular areas, the first quadrant of 20
Sharpness strength (gain H) of × 20 unit rectangular area
And conditions (gain M) may be determined.

In the above-described example, when performing high-intensity sharpness processing, the sharpness intensity (gain H)
Is uniformly changed with image data of three primary colors, for example, RGB image data, but the present invention is not limited to this.
It may be changed independently for each image data. Of course, of course, the remaining sharpness processing conditions (gain M) are also R
It may be changed independently for each GB image data. When the sharpness intensity (gain H) and the condition (gain M) are independently changed for each of the RGB image data, for example, as shown in FIG.
The sharpness processing circuit 90 is provided for each of RGB, and the gain H is set as the gain HR, the gain HG and the gain HB, and the gain M is set as the gain MR, the gain MG and the gain MB, respectively. What is necessary is just to set independently for 1st and 2nd amplifier (corresponding to 102 and 104).

Then, the intermediate / high frequency component R_MH,
G_MH, B_MHFrom the luminance component Y_MHRather than asking for it
Each is subjected to the filtering process by the second LPF 98
Intermediate frequency component R_M, G_M, B_MAnd then the middle
・ High frequency component R_MH, G_MH, B_MHFrom each intermediate frequency
Number component R_M, G_M, B_MSubtract the high frequency component
R_H, G_H, B_HAsk for. After this, the obtained intermediate frequency
Number component R_M, G_M, B_MAnd gain MR and gain respectively
MG, the gain MB and the processed intermediate frequency component R
_M', G_M', B_M'And obtain the obtained high frequency component R
_H, G_H, B_HGain HR, gain HG, and gain
Multiplied by the high frequency component R_H’,
G_H’, B_H’. Processed intermediate thus obtained
Frequency component R_M', G_M', B_M'And processed high frequency components
Minute R_H’, G_H’, B_H’With
Luminance component Y '_MHInstead of mid- and high-frequency components
R_MH’, G_MH’, B_MH’For each low-frequency component
R_L, G_L, B_LAnd sharpened
Image data R ', G', B 'can be obtained.

As described above, when the sharpness intensity (gain H) and the condition (gain M) are changed independently for each of the RGB image data, they may be changed completely independently for each of the RGB image data. It is preferable to carry out the following two methods in consideration of the lens characteristics with respect to, the visibility characteristics of human eyes, and the like. The first method is a method in which G has a default intensity and R and B have an intensity larger than the default intensity (G <R = B). This is because R and B are usually out of focus and inferior in sharpness compared to G. On the other hand, the second method is G
And B with the default intensity and only R with an intensity greater than the default intensity (G = B
<R). This is because the visibility of human eyes is G> R
This is because B is less focused than G, and B is inconspicuous to human eyes among R and B which are inferior in sharpness. By using these methods, the overall processing amount can be reduced.

In the above-described example, when the intensity of the sharpness enhancement is changed, the gain of the high frequency component and the gain of the middle frequency component are changed uniformly to the RGB image data or independently of each other. Is not limited to this,
Any method may be used. For example, the respective gains may be changed without changing the frequency region (frequency band) to be decomposed into high, middle, and low frequency components. Further, the method of the sharpness enhancement processing itself may be changed, or the intensity may be changed. For example, in the case of sharpness emphasis processing using amp masking, the emphasis coefficient may be changed.

Further, in the above-described example, the intensity of the sharpness enhancement processing is changed according to the lens type. However, when the film taken by a camera equipped with the lens has high sensitivity, the intensity of the sharpness is increased. When is increased, the granularity of the film is also emphasized, and the reproduced image may become grainy. For this reason, the sharpness intensity may be changed not only according to the lens type but also according to the film type. For example, in the case of a high-sensitivity film, the rate at which the sharpness intensity (gain H) is increased is reduced, a limit is set, and the gain M of the medium frequency component including many grains is reduced from the default. It is preferable to increase the suppression of granularity. By doing so, even if an image is shot on a high-sensitivity film with a specific lens such as a compact camera or LF, a high-quality print in which a high-quality image with less graininess and blurring of the image is reproduced can be obtained. Obtainable. Here, when the lens type and the film type have a one-to-one correspondence like LF, the film type may be determined from the lens type. Further, the film type is generally obtained by reading information optically recorded on the film, for example, information such as a DX code or an extended DX code, and in the case of an APS film, magnetically recorded information. Can be determined, and these may be used.

Further, in the illustrated example, the sharpness processing is performed after the aberration correction is performed. However, the present invention is not limited to this, and the aberration correction may be performed after the sharpness processing is performed. However, in terms of image quality, it is more advantageous to perform the sharpness processing after performing the aberration correction as in the illustrated example. In the present invention, the aberration correction is not always necessary, and only the sharpness processing may be applied to an image captured by a specific lens type.

The image data processed by the image processing units 64 and 68 are sent to the data conversion units 66 and 70.
The data conversion unit 66 of the pre-scan processing unit 58 converts the image data processed by the image processing unit 64 by using a 3D (three-dimensional) -LUT or the like to obtain image data corresponding to the display on the display 20. . If necessary, the data conversion unit 66 may perform an electronic scaling process. On the other hand, the data conversion unit 7 of the main scan processing unit 60
0 similarly converts the image data processed by the image processing unit 68 using the 3D-LUT, and converts the converted image data into image data corresponding to image recording by the printer 16.
To supply.

Various image processing conditions by the prescan processing section 58 and the main scan processing section 60 are set in the condition setting section 6.
2 is set. The condition setting unit 62 includes a setup unit 72, a key correction unit 78, and a parameter integration unit 80.

The setup section 76 sets the reading conditions for the main scan using the pre-scan data,
The image processing to be performed is selected, image processing conditions in the image processing units 64 and 68 and the data conversion units 66 and 70 are set, and the image processing conditions are supplied to the parameter integration unit 80. In particular,
The setup unit 76 creates a density histogram from the pre-scan data, calculates image features such as average density, highlight (lowest density), shadow (highest density), and the like. In accordance with an instruction from the operator, the main scanning reading conditions are set, and the image processing conditions such as the creation of the LUT for performing the above-described gray balance adjustment and the creation of the matrix arithmetic expression for performing the saturation adjustment are determined.

The key correcting section 78 responds to a correction instruction for brightness, color, gradation, saturation, etc. from the keyboard 18a or the like.
The correction amount of the image is calculated and supplied to the parameter integration unit 80. The parameter integration unit 80 receives the image processing conditions set by the setup unit 76, and sets the supplied image processing conditions in the image processing unit 64 of the pre-scan processing unit 58 and the image processing unit 68 of the main scan processing unit 60, Further, in accordance with the correction amount calculated by the key correction unit 78, an LUT or the like for performing this correction is created and set in a predetermined region, and the image processing conditions set in each region are corrected.

The operation of the scanner 12 and the processing device 14 will be described below. After the operator loads the carrier 30 corresponding to the film F into the scanner 12, sets the film F (cartridge) at a predetermined position of the carrier 30, and inputs necessary instructions such as a print size to be created, and then instructs to start printing. I do.

According to the print start instruction, the aperture value of the variable aperture 24 of the scanner 12 and the accumulation time of the image sensor (line CCD sensor) 34 are set in accordance with the prescan reading conditions. Is transported in the sub-scanning direction at a speed corresponding to the pre-scan, and the pre-scan is started. At the predetermined reading position, the film F is slit-scanned and the projection light forms an image on the image sensor 34 as described above. The image photographed on the film F is decomposed into R, G and B and photoelectrically read.

When the film F is transported, information magnetically recorded on the film F is read by the magnetic head 42 of the carrier 30, and various information such as a DX code is read by the sensor 44. Information is sent to a predetermined site such as the processing device 14, for example.
The fourth lens type determination unit 74 obtains the determination information. Note that the determination information may be provided by various methods such as input by an operator, as described above.

In the present invention, the pre-scan and the main scan may be performed one frame at a time, or the pre-scan and the main scan may be performed continuously for all frames or for a predetermined plurality of frames. In the following example, one frame of image reading will be described as an example to simplify the description.

The output signal of the image sensor 34 by the pre-scan is amplified by the amplifier 36, and is output from the A / D converter 3
8, converted into a digital signal, transmitted to the processing device 14, subjected to data processing by the data processing unit 50, converted into digital image data by the Log converter 52, and stored in the prescan memory 54. Is done.

When the pre-scan data is stored in the pre-scan memory 54, the setup unit 76 of the condition setting unit 62 reads out the pre-scan data, creates a density histogram, and calculates image features such as highlights and shadows. The reading conditions for the main scan are set and supplied to the scanner 12, and various image processing conditions such as gradation adjustment are set and supplied to the parameter integration unit 80. The parameter integration unit 76
The supplied image processing conditions are converted into predetermined portions (hardware) of the pre-scan processing section 56 and the main scan processing section 58.
Set to.

When performing the test, the pre-scan data is read from the pre-scan memory 54 by the pre-scan processing unit 62, subjected to image processing under the image processing conditions set in the image processing unit 64, and further processed by the data conversion unit. 66
And is displayed on the display 20 as a simulation image. The operator looks at the display 20 to check (verify) the image, that is, the processing result, and corrects the color, density, gradation, etc., using the adjustment keys set on the keyboard 18a as necessary. . The input of this adjustment is sent to the key correction unit 78, which calculates a correction amount according to the correction input and sends it to the parameter integration unit 76. The parameter integrating unit 76 sets a correction condition for executing the correction according to the correction amount, and corrects the image processing condition set previously. Therefore, the image displayed on the display 20 also changes according to the correction, that is, the adjustment input by the operator.

When the operator determines that the image of this frame is proper (test OK), the operator instructs the start of printing using the keyboard 18a or the like. As a result, the image processing conditions are fixed, the aperture value of the variable aperture 24 is set in the scanner 12 in accordance with the reading conditions of the main scan, and the carrier 30 moves the film F at a speed corresponding to the main scan. Then, the main scan is started. When the verification is not performed, the image processing conditions are determined at the time when the setting of the image processing conditions in the image processing unit 68 of the main scan processing unit 60 by the parameter integration unit 80 is completed.
The main scan is started. It is preferable that the presence or absence of such a test can be selected as a mode.

The main scan is performed in the same manner as the pre-scan except that the read conditions for the main scan in which the read conditions such as the aperture value of the variable aperture 24 are set are set. The output signal from the image sensor 34 is amplified by the amplifier 36. The data is converted into a digital signal by the A / D converter 38, processed by the data processing unit 50 of the processing device 14, converted into the main scan data by the Log converter 52, and sent to the main scan memory 56. When the main scan data is sent to the main scan memory 54, the main scan data is read out by the main scan processing unit 60 and the image processing unit 68
Tone adjustment and saturation adjustment are performed by LUT and MTX,
Next, it is sent to the aberration correction unit 72.

On the other hand, the lens type discriminating section 74 discriminates the lens type from the obtained discrimination information, and the image obtained by photographing the image with a specific lens type is required to be sharply processed and subjected to aberration correction. It is determined whether it is necessary or not, and if it is determined that it is necessary, an instruction to that effect is sent to the block 68A and the aberration corrector 72, and the lens characteristics of the lens type are read out and sent to the aberration corrector 72.

The aberration correcting section 72 calculates the pixel positions Ir, Ig and Ib in which the chromatic aberration of magnification and distortion have been corrected in the coordinate conversion processing section 72A as described above from the lens characteristics and the pixel positions of the image data. Then, it comes to the enlargement / reduction processing unit 72B. The enlargement / reduction processing unit 72B uses the pixel positions Ir, Ig, and Ib to calculate the N
The image is electronically resized by performing the double interpolation, and the image data is subjected to aberration correction and electronic resizing processing.
Output to A. It should be noted that the image, for which the lens type determination unit 74 determines that it is not necessary to apply sharpness processing strongly, is not subjected to any processing in the coordinate conversion processing unit 72A, and only electronic scaling processing is performed in the enlargement / reduction processing unit 72B. .

The image data is further subjected to necessary image processing such as sharpness processing and dodging processing in block 68A, and sent to the data conversion unit 70. here,
The image instructed by the lens type discriminating section 74 to apply sharpness processing strongly is sent to the block 68 as described above.
In the processing device 90 that performs the sharpness processing at A, the gain H that is the sharpness gain by which the high frequency component is multiplied is set to a default (for example, a digital value of 28)
(For example, a digital value of 32), and the sharpness processing is strongly applied.

Next, the image data is converted by the image data converter 70 into image data corresponding to the image recording by the printer 16 and sent to the printer 16.

The printer 16 exposes a photosensitive material (printing paper) in accordance with image data to record a latent image, performs a development process in accordance with the photosensitive material, and outputs the print as a (finished) print. For example, after the photosensitive material is cut into a predetermined length corresponding to the print, recording of the back print, red (R) exposure, green (G) exposure, and blue (B) according to the spectral sensitivity characteristics of the photosensitive material (photographic paper). 3) The three types of light beams of exposure G are modulated according to image data (recorded image), deflected in the main scanning direction, and conveyed in a sub-scanning direction orthogonal to the main scanning direction to form a latent image. After performing recording and the like, the photosensitive material on which the latent image has been recorded is subjected to predetermined wet development processing such as color development, bleach-fixing, and washing with water, dried, printed, sorted, and accumulated.

Although the image processing method and the image processing apparatus of the present invention have been described in detail above, the present invention is not limited to the above-described embodiments, and various improvements and modifications can be made without departing from the gist of the present invention. Of course you can do it.

[0088]

As described above in detail, according to the present invention, a high-quality image can be reproduced even if it is an image taken by a film with a lens, an inexpensive compact camera, a digital camera, or the like. High quality prints can be output.

[Brief description of the drawings]

FIG. 1 is a block diagram illustrating an example of a digital photo printer using an image processing apparatus according to the present invention.

2A is a conceptual diagram of a carrier of the digital photo printer shown in FIG. 1, and FIG. 2B is a conceptual diagram of an image sensor of the digital photo printer shown in FIG.

FIG. 3 is a block diagram of an example of an image processing device of the digital photo printer shown in FIG.

4 is a conceptual diagram of an aberration correction unit of the image processing device shown in FIG.

FIG. 5 is a block diagram of processing means for performing sharpness in the image processing apparatus shown in FIG. 3;

FIGS. 6A, 6B, 6C, and 6D are plan views each showing an example of a film on which lens information used in the image processing apparatus of the present invention is recorded as a code.

[Explanation of symbols]

 DESCRIPTION OF SYMBOLS 10 (Digital) photo printer 12 Scanner 14 (Image) processing device 16 Printer 18 Operation system 18a Keyboard 18b Mouse 20 Display 22 Light source 24 Variable aperture 25 Image recording medium 26 Recording medium drive 28 Diffusion box 30 Carrier 32 Imaging lens unit 34 Image sensor 36 Amplifier 38 A / D converter 40 Mask 42 Magnetic head 44 Sensor 46 Notch mark 48 Unevenness 50 Data processing unit 52 Log converter 54 Prescan (frame) memory 56 Main scan (frame) memory 58 Prescan processing unit 60 Main scan processing unit 62 Condition setting unit 64, 68 Image processing unit 66, 70 Data conversion unit 72 Aberration correction unit 72A Coordinate conversion processing unit 72B Enlargement / reduction processing unit 74 Lens type determination unit 76 Setup Unit 78 key correction unit 80 parameter integration unit 90 processing means 92 first LPF 94 first subtractor 96 luminance calculation means 98 second LPF 100 second subtractor 102 first amplifier 104 second amplifier 106 first adder 108 second addition vessel

Claims (15)

[Claims] 1. An image processing method for obtaining image data from an optically captured image and performing at least a sharpness enhancement process to obtain image data for an output image, wherein information on a lens that has captured the image is used. An image processing method comprising: determining a lens type; and changing an intensity of the sharpness enhancement processing of a corresponding image according to the lens type. 2. The image processing method according to claim 1, wherein the image of the lens type for which the intensity of the sharpness enhancement processing is changed is also corrected for image quality deterioration due to lens characteristics. 3. The image processing method according to claim 2, wherein the correction of the image quality deterioration caused by the lens characteristic is at least one of a distortion aberration correction, a magnification chromatic aberration correction, and a peripheral light amount correction caused by the lens characteristic. 4. The intensity of the sharpness enhancement processing is changed uniformly for the entire image of one frame, or the intensity of the one frame image is divided into a plurality of images and changed for each of the divided image regions. The image processing method according to claim 1. 5. The image processing method according to claim 1, wherein the intensity of the sharpness enhancement processing is changed independently for each of the three primary colors or uniformly for each of the three primary colors. . 6. The image processing method according to claim 1, wherein the intensity of the sharpness enhancement processing is further changed depending on a film type. 7. An image processing apparatus for performing image processing on image data obtained from an optically captured image to obtain image data for an output image, wherein identification information of a lens that has captured the image is obtained. A determination unit for determining the lens type; and an image processing unit for performing at least a sharpness enhancement process on the image, wherein the image processing unit responds according to a determination result of the lens type by the determination unit. An image processing apparatus, wherein the intensity of the sharpness enhancement processing of an image is changed. 8. An image processing means for storing a lens characteristic corresponding to a lens type, a lens characteristic of a corresponding lens type from the storage means, and obtaining the image characteristic from the positional information of the image and the lens characteristic. 8. The image processing apparatus according to claim 7, further comprising image quality deterioration correction means for correcting image quality deterioration, wherein the image quality deterioration correction means also performs image quality deterioration correction on the image for which the intensity of the sharpness enhancement processing is changed. . 9. The image processing apparatus according to claim 8, wherein said image quality deterioration correction means corrects at least one of distortion aberration correction, lateral chromatic aberration correction, and peripheral light amount correction caused by the lens characteristics. 10. The image processing apparatus according to claim 8, wherein a sharpness enhancement process is performed after the correction of the image quality deterioration. 11. The image quality deterioration correction means corrects lateral chromatic aberration and distortion due to lens characteristics, or peripheral light amount, and corrects an image of another color with respect to a reference color of three primary colors caused by lateral chromatic aberration. Each image in which, in addition to the distortion, the lateral chromatic aberration is corrected in addition to the distortion, using the positional deviation due to the chromatic aberration of magnification and the deviation of the reference color image position due to the distortion. 9. Correcting the image quality deterioration from the proper position of each image, or correcting the image quality deterioration and electronic scaling processing using the proper position of each image.
The image processing apparatus according to any one of claims 10 to 10. 12. The image processing apparatus according to claim 7, wherein the lens type for changing the intensity of the sharpness enhancement processing of the image is a lens of a film with a lens. 13. The image processing means for uniformly changing the intensity of the sharpness enhancement processing over an entire image of one frame, or dividing the image of one frame into a plurality of images, and dividing the divided image area. The image processing apparatus according to claim 7, wherein the image processing apparatus is changed every time. 14. The image processing device according to claim 7, wherein the image processing means changes the intensity of the sharpness enhancement processing independently for each of the three primary colors or uniformly for each of the three primary colors. Image processing device. 15. An image processing apparatus according to claim 7, wherein said image processing means further changes the intensity of said sharpness enhancement processing depending on a film type.