JP2001075197A - Image processor, image processing method and recording medium - Google Patents

Abstract

PROBLEM TO BE SOLVED: To easily realize the appropriate correction of a defective part in accordance with the scale of the defective part on image data. SOLUTION: Images recorded on a photographic film are respectively read concerning R, G, B and IR wavelength regions. A threshold for determining the defective part, the size of a peripheral area used for the correction of the defective part and the size of the work area used for the correction of the defective part are decided on the basis of the pixel density of the respective data on the photographic film by using a map shown in (A) to (C) concerning the respective R, G, B and IR data obtained through electronic variable power (pixel density conversion) processing. Then, defective parts are detected and corrected in accordance with respective parameters.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image processing apparatus, method, and recording medium, and more particularly, to an image processing apparatus that detects a defective portion of an image represented by image information and corrects the defective portion, and is applicable to the image processing device. The present invention relates to an image processing method and a recording medium on which a program for causing a computer to function as the image processing apparatus is recorded.

[0002]

2. Description of the Related Art A photographic film may be damaged on the emulsion surface or the back surface (the back surface of the emulsion surface) depending on how to handle the film. However, the photographic film has been damaged at a portion corresponding to the image recording area of the photographic film. In this case, if an image recorded on the photographic film is output (recorded on an image recording material such as photographic paper or displayed on a display means such as a display), the image attached to the photographic film depends on the degree of scratches. The scratches are often clearly recognized on the output image as defective portions such as low-density streaks and white streaks. Also, when foreign matter such as dust adheres to the surface of the photographic film, the foreign matter is clearly recognized as a defective portion.

In a surface exposure type photographic printing apparatus which irradiates light on a photographic film and irradiates light transmitted through the photographic film onto a photographic paper to expose and record an image on the photographic paper, a light source is used as a measure against scratches on the photographic film. A diffusion plate is disposed between the photographic film and the photographic film, and the light scattered by the diffusion plate is irradiated on the photographic film. However, it is difficult to erase a defective portion in an output image (an image recorded on a photographic paper by exposure) with the above technique, and the defect is only slightly reduced (is less noticeable).

Further, an image recorded on a photographic film is represented by C
As a technique applicable to an image reading apparatus configured to read by a reading sensor such as a CD, JP-A-11-75039 includes three wavelengths in a visible region and one wavelength in a non-visible region (for example, an infrared region or an ultraviolet region). A technique is disclosed in which a photographic film is read in at least four or more wavelength ranges, and image information obtained by reading in a visible range is corrected based on information obtained by reading in a non-visible range.

The light in the visible region varies in the amount of transmitted light in accordance with the image density recorded on the photographic film, and is partially refracted by the scratches or foreign matter even in the places where the photographic film has scratches or foreign matter. The reflected light changes the amount of transmitted light. On the other hand, the light in the non-visible range varies in the amount of transmitted light in places where there is a scratch or foreign matter on the photographic film,
It is not affected by the image density recorded on the photographic film.

Therefore, according to the technique described in the above publication,
Detecting flaws and foreign matter on the photographic film from changes in the amount of transmitted light in the non-visible range, and correcting fluctuations in the amount of transmitted light in the visible range caused by the flaws and foreign matters on the photographic film; That is, it is possible to correct a defective portion of an image (an image represented by image information obtained by reading in the visible region) caused by a scratch or a foreign substance attached to the photographic film.

[0007]

The size of a scratch or foreign matter attached to a photographic film is indefinite, and the size of a defective portion caused by the scratch or foreign matter on image data obtained by reading an image. (The number of pixels belonging to the defective portion) changes according to the size of the flaw or foreign matter. In an aspect in which an image recorded on a photographic film is read and subjected to predetermined image processing and output, the image reading is performed in accordance with the size of the read image, the size of the output image, the required level of the image quality of the output image, and the like. At this time, the optical magnification and the reading resolution are changed, and the magnification in the electronic scaling process for the image data obtained by the reading is changed. In this case as well, the size of the defective portion on the image data changes. However, the above publication does not take into account any modification of a defective portion in consideration of a change in the size of a defective portion on image data.

[0008] As an example of defect correction in consideration of a change in the size of a defect on image data, it is assumed that a defect having the largest possible defect is corrected. The size of the area around the defective part used for the operation for correcting the defective part and the capacity of the storage means for storing data necessary for correcting the defective part) are fixedly determined according to the maximum scale of the defective part. Can be considered. However, in this aspect, when correcting a defective portion having a small size on the image data, the data of the surrounding area having a large area is used for the calculation compared with the size of the defective portion, so that the size of the defective portion is small. There are problems that the correction operation takes a long time and a large-capacity storage means is required.

As another example of the defect correction in consideration of the change in the size of the defective portion on the image data, the size of the defective portion on the image data is detected and a parameter related to the defect correction is detected. May be changed to an optimal value according to the size of the defective portion. However, in this embodiment, in order to detect the scale of the defective portion, it is necessary to perform a complicated process such as counting the number of pixels (defective pixels) belonging to the defective portion for each defective portion.

The present invention has been made in view of the above facts, and provides an image processing apparatus, an image processing method, and a recording medium which can easily realize appropriate defect correction in accordance with the scale of a defect on image data. Is the first purpose.

Further, the present invention provides an image processing apparatus and an image processing method capable of appropriately correcting a defective portion without changing parameters related to the defective portion regardless of the size of the defective portion on the image data. And a recording medium.

[0012]

The defective portion is caused by a scratch or foreign matter on the image recording material. The size of the scratch or foreign matter on the image recording material such as a photographic light-sensitive material is extremely large, though the size is not fixed. In most cases, it is within a certain range. The inventor of the present invention pays attention to the above and considers other parameters (optical magnification at the time of reading an image, reading resolution, magnification in electronic scaling processing for image information obtained by reading, which affect the size of a defective portion on the image information). If the “pixel density of the image represented by the image information on the image recording material” that changes due to the change is known, without performing complicated processing such as detecting the size of the defective portion on the image information, It has been conceived that the scale of a defective portion on image information can be estimated with a certain degree of accuracy.

[0013] Based on the above, in order to achieve the first object, an image processing apparatus according to the first aspect of the present invention provides an image processing apparatus for processing image information obtained by reading an image recorded on an image recording material. Detecting means for detecting a defective portion of the image represented by the image information; correcting means for correcting the defective portion detected by the detecting means with respect to the image information; and correcting the image represented by the image information on the image recording material. Changing means for changing a parameter related to the detection of the defective portion by the detection means or the correction of the defective portion by the correction means in accordance with the pixel density in the step (a).

According to the first aspect of the present invention, there is provided detecting means for detecting a defective portion of the image represented by the image information obtained by reading the image recorded on the image recording material. . The image information, for example, irradiating light to the image recording material, light transmitted or reflected by the image recording material,
It can be obtained by photoelectrically converting (reading) by a photoelectric conversion element provided with a large number of photoelectric conversion cells, and the detection of a defective portion can be performed, for example, by irradiating the image recording material with invisible light and transmitting or reflecting the image recording material. It can be performed using the result of photoelectrically converting the invisible light.

Further, the correcting means according to the first aspect of the present invention comprises:
A defective portion detected by the detecting means is corrected for the image information. The correction of the defective portion is performed by, for example, obtaining information on an area corresponding to the defective portion of the image from information on an area existing around the defective portion by interpolation, or correcting image information so that the luminance of the defective portion changes. The correction can be performed by reducing the high frequency component of the spatial frequency in the defective portion or in the vicinity thereof and correcting the image information so that the defective portion is blurred.

On the other hand, as described above, since the size of a flaw or foreign matter on an image recording material is mostly within a certain range, the size of a defective portion on image information is also reduced.
In most cases, the image represented by the image information falls within a range corresponding to the pixel density on the image recording material.

On the other hand, according to the first aspect of the present invention, the changing means detects the defective part by the detecting means or detects the defective part by the correcting means according to the pixel density of the image represented by the image information on the image recording material. Change parameters related to the modification.
The parameters relating to the detection of the defective portion or the correction of the defective portion include, for example, the size of the peripheral area of the defective portion used by the correcting device to correct the defective portion, and the correction device temporarily storing the data necessary for correcting the defective portion. The size of the storage area to be reserved for storage, the interval between pixels used by the repairing means for repairing the defective portion in the peripheral area of the defective portion, the reference for detecting the defective portion by the detecting means, and the like are given.

As described above, for example, when the size (for example, the number of pixels) of the peripheral area of a defective portion used for correcting the defective portion is changed in accordance with the pixel density of the image represented by the image information on the image recording material, Since the size of the region is set to a size corresponding to the approximate size of the defective portion on the image information, the peripheral region is too large compared to the size of the defective portion, so that it is unnecessary to correct the defective portion. It can be avoided that the correction accuracy of the defective portion is reduced due to the time taken or the peripheral region being too small compared to the scale of the defective portion.

Further, for example, when the size of a storage area reserved for temporarily storing data necessary for correcting a defective portion is changed according to the pixel density of an image represented by image information on an image recording material, Since the size of the region is set to a size corresponding to the approximate size of the defective portion on the image information, the storage region is uselessly occupied because the size of the storage region is too large compared to the size of the defective portion. In addition, it is possible to avoid that the correction of the defective portion is hindered due to the storage area size being too small as compared with the size of the defective portion.

Further, in the above-described embodiment in which the size of the peripheral region is changed in accordance with the pixel density, the size of the peripheral region increases as the size of the defective portion increases, so that the data used for correcting the defective portion is reduced. As the amount of data increases, the time required to correct a defective portion increases, and the size of a storage area required for storing the data also increases. On the other hand, for example, when the interval between pixels used for repairing a defective portion in the peripheral area of the defective portion is changed in accordance with the pixel density of the image represented by the image information on the image recording material, the pixel density becomes higher (the defect density becomes higher). By increasing the interval between pixels used for correcting a defective portion as the size of the defective portion increases, the amount of data used for correcting the defective portion increases extremely even when the size of the defective portion is large. Can be suppressed, and an increase in the time required for correcting the defective portion and an increase in the size of the storage area required for storing data can be suppressed.

Further, as the size of the defective portion increases, the time required for repairing the individual defective portion increases, but the defective portion becomes more conspicuous, so that the required level for repairing the defective portion may increase. For example, when the detection criterion for a defective portion (for example, a threshold value for determining whether or not to detect a defective portion) is changed according to the pixel density, the detection criterion for the defective portion is changed according to the approximate size of the defective portion on the image information. For example, if the detection criterion is changed so that the number of defective portions detected decreases as the pixel density increases (the approximate size of the defective portion increases), the correcting means can correct the defective portion. Increase in the time required for the operation can be suppressed. Also,
For example, if the detection criterion is changed so that the number of defective portions detected increases as the pixel density increases (the approximate size of the defective portion increases), even a finer defective portion can be corrected. Can be.

As described above, according to the first aspect of the present invention, without performing a complicated process such as detecting the size of a defective portion,
Since the parameters related to the detection of a defective part or the correction of a defective part are optimized according to the approximate size of the defective part, appropriate correction of the defective part according to the size of the defective part on the image information can be easily realized. can do. The pixel density is:
For example, it can be obtained by calculation or the like from parameters such as an optical magnification at the time of reading an image, a reading resolution, and a magnification in an electronic scaling process for image information obtained by reading (however, before correction of a defective portion).

When the changing means changes the size of the peripheral area, specifically, the size of the peripheral area increases as the pixel density increases, as described in claim 2. Can be. Further, when the changing unit changes the size of the storage area, specifically, as described in claim 2, the change can be made so that the size of the storage area increases as the pixel density increases.

When the changing means changes the interval between pixels used for correcting the defective portion in the peripheral area of the defective portion, specifically, the interval between the pixels is increased. Can be. Further, when the changing means changes the detection criterion of the defective portion, specifically, as described in claim 2, the detection criterion is changed so that the number of defective portions detected decreases as the pixel density increases. can do.

According to a third aspect of the present invention, there is provided an image processing apparatus, wherein the image information represents image information obtained by reading an image recorded on an image recording material. A first conversion unit that converts the pixel density of the image on the image recording material to a predetermined value; a detection unit that detects a defective portion of the image represented by the image information; and a conversion by the first conversion unit. Correcting means for correcting a defective portion detected by the detecting means with respect to the passed image information,
A second conversion unit that converts the image information that has been corrected by the correction unit so that the pixel density of the image represented by the image information on the image recording material returns to an original value; and And generating means for generating image information in which the defective portion is corrected by combining the image information converted by the two converting means.

According to the third aspect of the invention, image information obtained by reading an image recorded on an image recording material is
A first conversion unit that converts the image represented by the image information so that the pixel density on the image recording material becomes a predetermined value. As described above, since the size of the defective portion on the image information mostly falls within the range corresponding to the pixel density of the image represented by the image information, the pixel density is set to a predetermined value by the first conversion unit. In the image information converted to, the scale of the defective portion is substantially within a predetermined range.

According to a third aspect of the present invention, the correcting unit corrects the defective portion detected by the detecting unit similar to the first aspect of the present invention, with respect to the image information converted by the first converting unit. Appropriate values when the pixel density is a predetermined value are set in advance as parameters related to the correction (for example, the size of the peripheral region of the defective portion, the size of the storage region, the detection standard of the defective portion, etc.). By doing so, the defective portion can be properly corrected without changing the parameters, regardless of the size of the defective portion on the original image data.

The image information corrected by the correction means is converted by the second conversion means so that the pixel density of the image represented by the image information on the image recording material returns to the original value. By synthesizing the original image information and the image information that has been converted by the second conversion means, the image information in which the defective portion has been corrected is generated, so that regardless of the size of the defective portion on the image data, The defective portion can be properly corrected without changing parameters related to the portion correction.

According to a fourth aspect of the present invention, in the third aspect, the non-visible light obtained by irradiating the image recording material with invisible light and photoelectrically converting the invisible light transmitted or reflected by the image recording material. The image forming apparatus further includes an obtaining unit configured to obtain image information, wherein the first converting unit converts the invisible image information so that the pixel density of the image represented by the invisible image information on the image recording material also becomes the predetermined value, and detects the image. The means detects a defective portion using the invisible image information converted by the first converting means.

According to the fourth aspect of the present invention, the image recording material is irradiated with invisible light, and the invisible image information obtained by photoelectrically converting the invisible light transmitted or reflected by the image recording material is obtained by the obtaining means. The invisible image information is converted by the first conversion means so that the pixel density of the image represented by the invisible image information on the image recording material also becomes a predetermined value. Thereby, image information and invisible image information having the same (predetermined value) pixel density on the image recording material can be obtained.

According to the fourth aspect of the present invention, since the detecting means detects the defective part using the invisible image information converted by the first converting means, the correcting means detects the defective part by the detecting means (for example, The defective portion can be corrected with respect to the image information having a predetermined pixel density on the image recording material by directly using information indicating which pixel belongs to the defective portion. Therefore, according to the fourth aspect of the present invention, the defective portion can be corrected with higher accuracy.

According to a fifth aspect of the present invention, in the third aspect of the present invention, the generating means uses only the original image information for the non-defective area in the image, and uses the first image information for the defective area in the image. By using only the image information that has been converted by the second conversion means, or by using image information equivalent to a weighted average of the original image information and the image information that has been converted by the second conversion means, and combining these, the defective portion can be obtained. It is characterized in that corrected image information is generated.

When the image information is converted so that the pixel density of the image changes, image quality such as sharpness of the image represented by the image information is reduced by performing an interpolation operation or the like.
On the other hand, according to the invention of claim 5, the original image information is used for the non-defective area (the area excluding the defective area or the area excluding the defective area and its surrounding area) in the image. It is possible to prevent image quality deterioration such as deterioration in sharpness in the non-defect portion region that occupies the majority.

Further, a defective area in an image (only a defective area,
Alternatively, only the image information that has been converted by the second conversion means is used for the area including the defective portion and its surrounding area), or the weighted average of the original image information and the image information that has been converted by the second conversion means is used. Since the image information is generated by synthesizing the image information using the corresponding image information, a decrease in the image quality due to the conversion by the first conversion unit and the second conversion unit is suppressed, and the image in which the defective portion is appropriately corrected is obtained. Image information to be obtained.

In the image processing method according to the present invention, a defective portion of an image represented by the image information is detected for image information obtained by reading an image recorded on an image recording material, For the image information, while correcting the detected defective portion, according to the pixel density of the image represented by the image information on the image recording material, related to the detection of the defective portion or the correction of the defective portion Since the parameters are changed, it is possible to easily realize appropriate defect correction in accordance with the scale of the defect on the image data, similarly to the first aspect of the present invention.

According to a seventh aspect of the present invention, in the image processing method, the image information obtained by reading the image recorded on the image recording material is converted into an image represented by the image information on the image recording material. A first conversion for converting the pixel density to a predetermined value is performed, a defective portion of an image represented by the image information is detected, and the detected defective portion is determined with respect to the image information that has undergone the first conversion. A second step of converting the image information after the correction and the correction of the defective portion so that the pixel density of the image represented by the image information on the image recording material returns to the original value.
Is performed, and the original image information and the image information that has undergone the second conversion are combined to generate image information in which the defective portion has been corrected. Irrespective of the size of the defective portion described above, the defective portion can be properly corrected without changing parameters related to the defective portion correction.

According to the recording medium of the present invention, there is provided a first medium for detecting a defective portion of an image represented by image information obtained by reading an image recorded on an image recording material. Step, a second step of correcting the detected defective portion with respect to the image information, and before performing at least one of the first step and the second step, the image represented by the image information A program for causing a computer to execute a process including a third step of changing a parameter related to detection of the defective portion or correction of the defective portion according to a pixel density on the image recording material is recorded. I have.

The recording medium according to the invention of claim 8 includes:
A process including the first to third steps, that is, a program for causing a computer to function as the image processing apparatus according to claim 1 is recorded, so that the computer reads the program recorded on the recording medium. As a result, in the same manner as in the first aspect of the present invention, it is possible to easily realize appropriate correction of a defective portion in accordance with the size of the defective portion on the image data.

According to a ninth aspect of the present invention, there is provided the recording medium, wherein image information obtained by reading an image recorded on the image recording material is converted into a pixel of the image represented by the image information on the image recording material. First to convert the density to a predetermined value
A first step of detecting a defective portion of an image represented by the image information, a second step of correcting the detected defective portion with respect to the image information having undergone the first conversion, A third step of performing a second conversion of converting the image information that has undergone the modification of the section so that the pixel density of the image represented by the image information on the image recording material returns to the original value; and A program for causing a computer to execute a process including a fourth step of generating image information in which a defective portion has been corrected by synthesizing image information and image information that has undergone the second conversion is recorded. .

The recording medium according to the ninth aspect of the present invention includes:
Since the program including the first to fourth steps, that is, a program for causing a computer to function as the image processing apparatus according to claim 3 is recorded, the computer reads the program recorded on the recording medium. As a result, the defective portion can be appropriately corrected without changing the parameters related to the defective portion regardless of the size of the defective portion on the image data. .

[0041]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS An embodiment of the present invention will be described below in detail with reference to the drawings.

[First Embodiment] FIG. 1 shows an image processing system 10 according to the present embodiment. The image processing system 10 includes a film scanner 12, an image processing apparatus 1
4 and the printer 16 are connected in series. The film scanner 12 and the image processing device 14
Corresponds to the image processing apparatus according to the present invention.

The film scanner 12 visualizes an image recorded on a photographic material (hereinafter simply referred to as a photographic film) such as a photographic film (for example, a negative film or a reversal film) by taking an image of the subject and developing it. A negative light source or a positive light source image) is read, and image data obtained by the reading is output. As shown in FIG. Have.
The light emitted from the light source includes light having a wavelength in the visible light range and light having a wavelength in the infrared range.

On the light exit side of the light source 20, a photographic film 2
A stop 21, a filter unit 23, and a light diffusion box 22 for diffusing the light irradiated on the photographic film 26 are arranged in this order.
The filter unit 23 includes a filter 23C that transmits only light in a wavelength range corresponding to R (R light) of incident light, and a filter 23M that transmits only light in a wavelength range corresponding to G (G light) of incident light. A filter 23Y that transmits only light in a wavelength range corresponding to B (B light) of incident light and a filter 23IR that transmits only infrared light (IR light) of the incident light are shown in FIG. It is configured to be fitted into a turret 23A rotatable in the direction of arrow A.

On the opposite side of the photographic film 26 from the light source 20, an imaging lens (zoom lens) 28 for forming an image of light transmitted through the photographic film 26 and an area CCD 30 are arranged in order along the optical axis L. ing. Area CCD30
Means a number of CCs each having sensitivity in the visible and infrared regions.
It is a monochrome CCD in which D cells are arranged in a matrix, and is arranged such that the light receiving surface substantially coincides with the imaging point position of the imaging lens 28. A shutter (not shown) is provided between the area CCD 30 and the imaging lens 28.

The area CCD 30 is connected to a scanner controller 33 via a CCD driver 31. The scanner control unit 33 includes a CPU, a ROM (for example, a ROM whose storage content is rewritable), a RAM, and an input / output port, which are connected to each other via a bus or the like.
The scanner control unit 33 controls the operation of each unit of the film scanner 12. In addition, the CCD driver 31 has an area CC.
A drive signal for driving D30 is generated, and area CC is generated.
The driving of D30 is controlled.

The photographic film 26 is a film carrier 24
(See FIG. 1; not shown in FIG. 2), and is positioned at a position (reading position) where the screen center of the image coincides with the optical axis L. Further, the scanner control unit 33 rotates the turret 23A of the filter unit 23 so that all the filters 23 including the filter 23IR are sequentially positioned on the optical axis L in a state where the image is positioned at the reading position. Area CCD corresponding to predetermined reading conditions
The charge accumulation time of the CCD 30 is set in the CCD driver 31, the aperture 21 is moved to a position corresponding to the predetermined reading condition, and the optical magnification (zoom magnification) of the imaging lens 28 corresponds to the predetermined reading condition. Adjust to a predetermined magnification.

Thus, the image recording area on the photographic film 26 is irradiated with light in the wavelength range (R, G, B, or IR) corresponding to each filter 23 in order, and
The light transmitted through the upper image recording area enters the area CCD 30 via the imaging lens 28, is photoelectrically converted by the area CCD 30, and outputs a signal representing the transmitted light amount to the area CCD 30.
Output from CD30. The signal output from the area CCD 30 is converted into digital data representing the amount of transmitted light by the A / D converter 32 and input to the image processing device 14.

The amount of transmitted light in each of the R, G, and B wavelength ranges is based on the R, G, and B of the image recorded in the image recording area.
It changes according to the density (if the photographic film 26 has scratches or foreign matter, it also changes due to these.
The amount of transmitted light is not affected by the image density and changes only due to scratches or foreign matter. Therefore, photoelectrically converting the transmitted light in each of the R, G, and B wavelength ranges corresponds to reading an image. In the following, R, G, and B input to the image processing device 14 will be described.
R, excluding IR, of data of each wavelength range of G, B, IR
Each data of G and B is called image data. Note that R,
The G and B image data correspond to the image information according to the present invention, and the IR data corresponds to the invisible image information.

On the other hand, the scanner correction section 36 of the image processing device 14 sequentially performs various correction processes such as dark correction, density conversion, shading correction, and the like on the input image data (and IR data). The output terminal of the scanner correction unit 36 is I
The image data, which is connected to the input terminal of the I / O controller 38 and has been subjected to the above-described processing by the scanner correction unit 36, is
/ O controller 38. An input terminal of the I / O controller 38 is also connected to a data output terminal of the image processor 40, and receives image data subjected to image processing (details will be described later) from the image processor 40.

The input terminal of the I / O controller 38 is also connected to the control unit 42. The control unit 42 has an expansion slot (not shown). The expansion slot includes a PC card or an I / O card that can be loaded into the digital still camera.
A driver (not shown) for reading / writing data (or a program) from / to an information storage medium such as a C card (hereinafter collectively referred to as a digital camera card), a CD-ROM, an MO, and a CD-R; A communication control device for communicating with another information processing device is connected. Image data input from outside via the expansion slot is input to the I / O controller 38.

The output terminal of the I / O controller 38 is connected to the data input terminal of the image processor 40 and the control unit 42, and further connected to the printer 16 via the I / F circuit 54. The I / O controller 38
The input image data is selectively output to each of the devices connected to the output terminal.

In the present embodiment, each image recorded on the photographic film 26 is read twice by the film scanner 12 at different resolutions. In the first reading (pre-scan), even when the density of the image is very low, each image is read under the reading conditions determined so that the accumulated charge is not saturated in the area CCD 30. In this embodiment, IR reading is not performed at the time of prescan. Data (pre-scan image data) obtained by this pre-scan is input from the I / O controller 38 to the control unit 42.

The control unit 42 includes a CPU 46, a RAM 48,
ROM 50 (for example, a ROM whose storage content can be rewritten),
An input / output port 52 is provided, and these are connected to each other via a bus. The control unit 42 determines an image size (aspect ratio) based on the pre-scan image data input from the I / O controller 38, calculates an image feature amount such as an image density, and calculates an image feature amount for each image. The reading conditions when the film scanner 12 performs reading (fine scan) again are determined, and the determined reading conditions are output to the film scanner 12.

The reading conditions include an image reading magnification (optical magnification). The reading magnification is determined based on the aspect ratio of the image and the like. For example, among images recorded on a 135-size photographic film, an image having an aspect ratio equivalent to a high-definition size or a panorama size has a smaller frame size but has a smaller recording size of an image on photographic paper than a normal full-size image. Is also big. For this reason, a reading magnification (for example, a magnification at which the reading resolution (pixel density) is doubled) higher than the normal size is set in consideration of image quality deterioration when recording on photographic paper.

The control unit 42 calculates an image feature amount including extraction of a main image area (for example, an area corresponding to a person's face (face area)) in the image based on the pre-scanned image data. The scanner 12 automatically determines the processing conditions of various image processing for the image data (fine scan image data) obtained by performing the fine scan by calculation (setup calculation), and outputs the determined processing conditions to the image processor 40. I do.

For example, a pixel density conversion process (so-called electronic scaling process), which is one of various image processes, is performed by the control unit 4.
Reference numeral 2 denotes a reading resolution in image reading (determined from the optical magnification at the time of image reading and the number of cells of the area CCD 30) and the number of pixels of output image data (use of output image data (for example, display on recording / display means on photographic paper) / Storage in the information storage medium), the electronic scaling ratio (pixel density conversion rate = pixel density after conversion / pixel density before conversion), which is the processing condition of the pixel density conversion processing, is calculated. I have decided.

The control unit 42 is provided with the film scanner 1
A function for searching whether or not a defective portion caused by a foreign matter such as a scratch or dust attached to the photographic film 26 is present in an image represented by the image data, based on the IR data input from Step 2 Reference numeral 40 has a function of setting parameters for performing the defective portion correcting process. A display 43, a keyboard 44, and a mouse (not shown) are connected to the bus of the control unit 42.

The control unit 42 performs image processing equivalent to the image processing performed by the image processor 40 on the fine scan image data on the pre-scan image data based on the calculated processing conditions of the image processing. Generate data. Then, the generated simulation image data is converted into a signal for displaying an image on the display 43, and the simulation image is displayed on the display 43 based on the signal. In addition, when the operator checks the displayed simulation image for image quality and the like, and information indicating correction of processing conditions is input as a result of the inspection via the keyboard 44 or the mouse, the operator performs a test based on the input information. Recalculation of the processing conditions of the image processing is performed.

On the other hand, the image data (fine scan image data) input to the I / O controller 38 by performing the fine scan on the image by the film scanner 12 is input from the I / O controller 38 to the image processor 40. Is done. The fine scan is performed while adjusting the charge accumulation time of the area CCD 30, the position of the diaphragm 21, and the optical magnification by the imaging lens 28 according to the reading conditions calculated by the control unit 42 previously.

The image processor 40 performs color / density correction processing including gradation conversion and color conversion, pixel density conversion processing (so-called electronic scaling processing), and hypertone processing for compressing the gradation of an ultra-low frequency luminance component of an image. And image processing circuits for performing various image processing such as hyper-sharpness processing for enhancing sharpness while suppressing graininess. The control unit 42 determines input image data for each image and notifies the image data. Various image processing is performed according to the set processing conditions. Further, the image processor 40 has a function of performing a defective portion correcting process according to the parameters set by the control unit 42.

When the image data processed by the image processor 40 is used for recording an image on photographic paper, the image data processed by the image processor 40 is transmitted from the I / O controller 38 to the I / O controller 38. / F circuit 54
Is output to the printer 16 as image data for recording via the. When the image data after the image processing is output to the outside as an image file, the image data is output from the I / O controller 38 to the control unit 42. As a result, the control unit 42 outputs the image data input from the I / O controller 38 for output to the outside to the outside (the driver, the communication control device, or the like) as an image file via the expansion slot.

The printer 16 has image memories 58, R,
G and B laser light sources 60 and a laser driver 62 for controlling the operation of the laser light sources 60 are provided. The recording image data input from the image processing device 14 is stored in an image memory 58.
Is read out after being stored once, and is used for modulating the R, G, B laser light emitted from the laser light source 60.
The laser light emitted from the laser light source 60 is scanned on a printing paper 68 via a polygon mirror 64 and an fθ lens 66, and an image is exposed and recorded on the printing paper 68. The photographic paper 68 on which the image has been exposed and recorded is sent to the processor section 18 and subjected to color development, bleach-fixing, washing and drying.
Thus, the image recorded on the printing paper 68 by exposure is visualized.

Next, as an operation of the present embodiment, the scanner 1
2, fine scan image data is input to the image processing device 14, and the image processor 4
When processing such as pixel density conversion is performed at 0, the control unit 4
The defective part correction value determination processing executed in Step 2 will be described.

The defective part correction value determination processing is processing to which the image processing method according to claim 6 is applied, and is realized by the CPU 46 of the control unit 42 executing a defective part correction value determination program. . The defective part correction value determination program initially includes an information storage medium 72 (FIG. 1) together with a program for causing the CPU 46 to execute other processing.
Reference). Although the information storage medium 72 is shown as a floppy disk in FIG.
You may comprise with ROM, a memory card, etc.

When an information storage medium 72 is loaded into an information reading device (not shown) connected to the control unit 42 and transfer of a program (installation) from the information storage medium 72 to the image processing apparatus 14 is instructed, the information The reading device reads a defective part correction value determination program or the like from the information storage medium 72 and stores the stored content in the rewritable ROM 50. When the timing to execute the defective part correction value determination processing comes, the defective part correction value determination program is read from the ROM 50 and executed by the CPU 46. Thus, the image processing device 14 functions as the image processing device according to the first aspect. Thus, the information storage medium 72 storing the defective part correction value determination program and the like corresponds to the recording medium according to claim 8.

Hereinafter, the defective portion correction value determination processing will be described with reference to the flowchart of FIG. Step 10
At 0, the R, G, and B image data and IR data (data that have undergone processing such as pixel density conversion by the image processor 40) of a single image to be processed are loaded into the RAM 48 or the like. In the next step 102, the pixel density of the image represented by the image data on the photographic film 26 (hereinafter simply referred to as "pixel density of the image data") is calculated based on the reading resolution and the electronic magnification of the image to be processed. I do.

In step 104, the detection criteria for the defective portion (threshold value (IR light amount fluctuation value) for determining whether or not the image is a defective portion) and the correction of the defective portion in accordance with the pixel density of the image data calculated in step 102. The value of each parameter of the size of the area around the defective portion used for the above and the size of the work area for temporarily storing data when correcting the defective portion is determined. In the present embodiment, the values of the above-described parameters are determined by extracting values corresponding to the pixel densities of the image data obtained in advance, using maps such as those shown in FIGS. are doing. This step 104 corresponds to the changing means described in claim 1 (specifically, the changing means described in claim 2).

In the next step 106, based on the R, G, B image data and IR data fetched into the RAM 48 and the like, a defective portion of the image to be processed represented by the R, G, B image data is detected. Perform detection processing. Prior to the description of the defect detection processing, the principle of detection of a spot on a photographic film with a scratch or a foreign substance using IR light will be described.

As shown in FIG. 5 (A), the amount of transmitted light when light is applied to a portion on the surface of the photographic film where no scratch or foreign matter is attached is larger than the amount of light incident on the photographic film by the photographic film. Attenuates by the amount of attenuation according to light absorption. The wavelength range in which light is absorbed in the photographic film is approximately the visible light range, and IR light in the infrared range is hardly absorbed. The light quantity only slightly changes from the incident light quantity.

On the other hand, when light is applied to a spot on a photographic film having a flaw, a part of the irradiated light is refracted by the flaw. The amount of transmitted light (the amount of light transmitted linearly through the above-mentioned portion) is determined by the amount of light incident on the photographic film, the amount of attenuation caused by the absorption of light by the photographic film, and the amount of attenuation caused by refraction of light by scratches. Attenuates by the added amount of attenuation.
Note that FIG. 5A shows a case where the light incidence side has a flaw, but the same applies to a case where the light emission side has a flaw.

Since refraction of light due to a scratch is also caused by IR light, the amount of transmitted IR light when the above-mentioned scratched portion is irradiated with IR light is attenuated according to attenuation caused by refraction of light due to the scratch. Decay by an amount. As shown in FIG. 5B, the refraction of light due to the flaw becomes remarkable as the scale (depth or the like) of the flaw increases (visible light also has IR rays).
(The same applies to light.) Therefore, the amount of transmitted light when the above-mentioned scratched portion is irradiated with IR light decreases as the scale of the scratch increases. Therefore, the scale of the flaw on the photographic film can be detected based on the attenuation of the amount of transmitted IR light.

When light is applied to a portion of a photographic film on which foreign matter such as dust is attached, the irradiated light is reflected by the foreign matter, and therefore depends on the size and type (light transmittance) of the foreign matter. In addition, when light is applied to a portion where the foreign matter is attached, the amount of transmitted light is greatly attenuated by the foreign matter. Attenuation of the amount of transmitted light when light is applied to a portion where a foreign substance is attached is the same as when the IR light is applied to the portion.

As described above, the amount of transmitted light when IR light is transmitted through a photographic film changes only at a portion of the photographic film where a scratch or a foreign substance is attached, and even if an image is recorded on the photographic film. Since the image is not affected by the change in the transmission density of the image, the photographic film is irradiated with IR light to detect the amount of transmitted light, so that scratches and foreign substances on the photographic film can be detected.

Based on the above, in step 106, a defective portion detection process is performed as follows. IR on photographic film
As described above, the amount of transmitted light when irradiated with light is generally substantially constant irrespective of the position on the image, and is reduced only at a portion where the photographic film has a scratch or foreign matter (see FIG. 6). Since the IR data represents the amount of transmitted IR light at each position on the image to be processed, the amount of transmitted IR light (for example, transmitted (The maximum value of the amount of light) as a reference value. Then, the transmitted light amount of the IR light is compared with the reference value for each pixel, and the change amount (decrease amount) of the transmitted light amount with respect to the reference value is equal to or larger than the defect part determination threshold (defect part determination reference) determined in step 104. Are all detected as defective pixels belonging to the defective portion to be corrected.

In step 106, the detected defective pixels are classified into the defective pixels belonging to the same defective part based on the positional relationship between the defective pixels (for example, whether or not they are adjacent to each other), and each defective pixel is classified. (For example, information indicating defective pixels belonging to each defective portion or information such as a decrease in the amount of transmitted IR light at each defective pixel) is stored in the RAM 48 or the like. Step 106 corresponds to the detecting means of the present invention (specifically, the detecting means according to claim 4) together with the film scanner 12 for measuring the amount of transmitted IR light of the photographic film.

In the present embodiment, the defective portion is corrected for the defective portion detected by the above-described defective portion detection processing.
As shown by the solid line in (A), when the defect determination threshold is set using a map whose characteristics are determined such that the defect determination threshold increases as the pixel density of the image data increases, the pixel of the image data As the density increases (the approximate size of the defect on the image data increases), the IR
The defective portion determination threshold is set so that only a defective portion having a large fluctuation in the amount of light is detected.

When the size of a defective portion on the image data increases, the time required for correcting each individual defective portion often increases. However, the defect determining threshold set according to the map having the above characteristics is used. By performing the defective part detection process, the number of defective parts to be detected is reduced as the approximate size of the defective part on the image data increases, and the time required for correcting the defective part is increased. Can be suppressed.

The broken line shown in FIG. 4A represents a characteristic in which, as opposed to the characteristic shown by the solid line, the threshold value for determining a defective portion decreases as the pixel density of the image data increases. When a defect determination threshold is set using a map having the above-described characteristics, and the defect detection is performed using the defect determination threshold, the approximate size of the defect on the image data is determined. As grows,
Although the time required to correct a defective portion increases as the number of detected defective portions increases, it is possible to improve the image quality of an output image by detecting and correcting a minute defective portion in an image. it can.

In step 108, it is determined whether or not a defective portion has been detected by the defective portion detection processing in step 106. If the determination is negative, there is no defective part to be corrected, and the defective part correction value determination processing ends. If the determination in step 108 is affirmative, the process proceeds to step 110, in which a free area of the storage area of the RAM 48 where data is not stored is used as a work area for temporarily storing data when correcting a defective portion. The size of the work area determined in the previous step 104 is secured.

In the present embodiment, the defective area is corrected using the work area secured in the above step 110.
In the previous step 104, as shown in FIG. 4C as an example, the size of the work area increases as the pixel density of the image data increases (the approximate size of the defective portion on the image data increases). Since the size of the work area is set using the map whose characteristics are determined as described above, the work area of the set size is secured, and the defective portion is corrected using the work area, thereby obtaining the RAM.
It is possible to prevent the 48 storage areas from being unnecessarily occupied and the work area from being insufficient when correcting a defective portion.

In step 112, a single defective portion to be processed is selected from the defective portions detected by the defective portion detection processing in step 106. In the present embodiment, an interpolation method and a luminance adjustment method are prepared as correction methods for correcting a defective portion. In the next step 114, the defective portion to be processed selected in step 112 is replaced with the defective portion. A predetermined characteristic amount for determining an application range of the interpolation method and the luminance adjustment method in the correction is calculated. As the predetermined feature amount, for example, a feature amount representing a correlation between density changes of R, G, and B (changes in the amount of transmitted light) near the defect portion can be used.

As shown in FIG. 5 (B), the emulsion layer of the photographic film includes R, G, and B photosensitive layers, and the image is exposed, recorded, and subjected to processing such as development. In the film (negative film), a negative C image is formed on the R photosensitive layer, a negative M image is formed on the G photosensitive layer, and a negative Y image is formed on the B photosensitive layer. Of the visible light transmitted through the photographic film, R light is attenuated (absorbed) by an amount corresponding to the transmission density of the negative C image in the R photosensitive layer.
The G light is attenuated (absorbed) by an amount corresponding to the transmission density of the negative M image in the G photosensitive layer, and the B light is attenuated by an amount corresponding to the transmission density of the negative Y image in the B photosensitive layer. Attenuated (absorbed).

Here, as an example, as shown in FIG.
If there is a scratch on the back side opposite to the emulsion side,
Absorption of light in each of R, G, B photosensitive layers for transmitted light
The ratio is the same as when there is no scratch. Sand
In FIG. 5B, the amount of light incident on the photographic film is
I₀, Transmission of R light, G light, and B light when not scratched
Light intensity is I_0R, I_0G, I_0BAnd when it is scratched
The light passes straight through the damaged area and enters the emulsion layer.
I₁(I₁<I₀: I₀-I₁Attenuation of light due to scratches
Minute), transmitted light of R light, G light, B light when scratched
Each amount_1R, I_1G , I_1BThen, the following equation (1)
Holds (see also FIG. 6A). I_0R/ I₀≒ I_1R/ I₁ I_0G/ I₀≒ I_1G/ I₁ I_0B/ I₀≒ I_1B/ I₁ … (1)

Therefore, the defective portion corresponding to the portion having a scratch on the back surface changes only in luminance as compared with the case without the scratch, and the color information of the image recorded on the photographic film is preserved. Therefore, the defective portion of the image represented by the image data can be corrected by adjusting the luminance of the defective portion region by applying the luminance adjusting method.

On the other hand, as shown in FIG. 5C, for example, when the emulsion surface is scratched, if the scratch is shallow, a part of each photosensitive layer is cut off, so that the transmitted light is reduced. The ratio of light absorption in each of the R, G, and B photosensitive layers with respect to is different from that in the case where there is no flaw. In addition, if the photosensitive layer is very deeply scratched such that all the photosensitive layers are peeled off, the light does not absorb the transmitted light in each photosensitive layer. Therefore, in either case, the relationship of equation (1) does not hold (see also FIG. 6B).

As described above, the defective portion corresponding to the portion having a scratch on the emulsion surface has different luminance and color compared to the case without the scratch, regardless of the depth of the scratch. ,
Since the color information of the image recorded on the photographic film is also lost, it is difficult to accurately correct the defective portion even if the luminance is adjusted. For this reason, a correction method (interpolation method) for determining the luminance and density of a defective portion by interpolation from information on the area around the defective portion is suitable for correcting a defective portion corresponding to a portion where the emulsion surface is damaged. ing. In addition, since the brightness and the color of the defective portion caused by the presence of the foreign matter on the photographic film also change as compared with the case where the foreign matter is not attached, when the above-described defective portion is corrected, The interpolation method is also suitable.

As described above, in a defective portion caused by a scratch on the back surface of a photographic film, light in each wavelength range of R, G, and B is reduced at a substantially constant rate in each portion within the defective portion. Since the amount of change in density of R, G, and B at the defective portion on the image data is substantially constant, the ratio is uncertain at the defective portion caused by a scratch or foreign matter on the emulsion surface of the photographic film. , The amount of density change is also undefined. Therefore, if a feature value representing the correlation between the density changes of R, G, and B in the defective portion is used as the predetermined feature value, the defect to be processed is attached to the back surface based on the calculation result of the feature value. (Defects to be corrected by the brightness adjustment method) or defects due to scratches or foreign substances on the emulsion surface (defects to be corrected by the interpolation method).

It should be noted that, instead of the feature quantity representing the correlation between the density changes of R, G, and B in the defective part, the I
Changes in the amount of transmitted R light and R light and G near the defect
Light, a feature quantity representing a correlation with a change in the amount of transmitted light of B light, edge strength and texture strength in a region around a defective portion,
Whether the defective portion exists in the main portion region in the image (or the overlapping ratio of the defective portion and the main portion region), any one of the amount of transmitted IR light near the defective portion, or a combination thereof May be used.

Then, based on the calculation result of the predetermined characteristic amount,
The application range (application ratio) of the interpolation method and the luminance adjustment method in correcting the defective portion to be processed is determined. For example, as shown in FIG. 7A, the application range is determined by using a map representing the relationship between the value of a predetermined feature amount and the application ratio α of the interpolation method (or the application ratio of the luminance adjustment method). It can be carried out. In the map of FIG. 7A, in the range of α = 1, only the interpolation method is selected to correct the defective portion, and α
In the range of = 0, only the brightness adjustment method is selected to correct the defective portion, and in the range of 0 <α <1, the application ratio of the interpolation method =
α indicates that the application rate of the luminance adjustment method is equal to (1−α).

By determining the application ratio of the correction method in accordance with the value of the predetermined feature amount as described above, the optimum application ratio of each correction method is determined so that the defective portion to be processed is corrected with high accuracy. Will be determined. Note that a map as shown in FIG. 7B or 7C may be used instead of the map of FIG. 7A, and the value of the application ratio α becomes non-linear with respect to a change in the value of the feature amount. A changing map may be used.

In the next step 116, it is determined whether or not the interpolation method is applied to the correction of the defective portion to be processed. If the application ratio α = 0, the determination is negative and the process proceeds to step 120. However, if the application ratio α ≠ 0, the determination is affirmative and the process proceeds to step 118, where a correction value determination process by an interpolation method is performed. Hereinafter, the correction value determination processing by this interpolation method will be described.

The correction value determination processing by the interpolation method according to the present embodiment is performed by performing the following processing for all the defective pixels constituting the defective portion. That is, as shown by a plurality of arrows in FIG. 8 as an example, first, each pixel is scanned along a plurality of directions extending radially from the defective pixel to be processed to search for a normal pixel which does not belong to the defective portion. , The concentration gradient (gradient GR shown in FIG. 9A).
AD), the normal pixel distance (DIST), and the interpolation value (the density value of each of the R, G, and B colors of the defective pixel determined by interpolation,
9 (A) are calculated for each direction.

Here, as shown in “direction 6” shown in FIG.
If the scan direction substantially matches the direction in which the defective portion (white area in FIG. 8) extends, a normal pixel is not detected even if scanning is performed over a certain distance. Further, the size of the defective portion with respect to the pixel interval (that is, the size of the defective portion on the image data) relatively changes according to the pixel density of the image data.

For this reason, in the scan for each scan direction, when a normal pixel is detected, the data of the normal pixel is stored in the previously secured work area, and the scan is continued. , The scanning is stopped and the gradient (absolute value) of the density gradient GRAD (i),
Normal pixel distance DIST (i) and interpolation value VALUE _X
(I) (where i is a code for identifying the scanning direction, and X represents any of R, G, and B).
Also, when a predetermined number of normal pixels are not detected,
The scan distance (the number of scan pixels) is determined in step 10 above.
When the value reaches the value corresponding to the size of the defect peripheral area determined in step 4, the scan is stopped.

In this embodiment, as shown in FIG. 4B, in the previous step 104, as the pixel density of the image data increases (the approximate size of the defective portion on the image data increases), Since the size of the defective portion peripheral region is set using a map whose characteristics are determined so that the size of the defective portion peripheral region is increased, scanning in each scan direction is performed as described above. By performing each process only within the range corresponding to the size of the region around the portion, it takes longer than necessary to repair the defective portion (specifically, scanning in each scan direction), or conversely, the defective portion on the image data. Since the size of the peripheral area of the defective portion is too small as compared with the size of the normal pixel and a normal pixel cannot be detected, it is possible to avoid a decrease in the correction accuracy of the defective portion.

When the above scan is performed in all scan directions, the gradient GRAD (i) and the normal pixel distance DI calculated and stored for each scan direction are calculated.
Based on ST (i), a weight coefficient for each scanning direction is calculated. In the present embodiment, the weight coefficient M (i) for each scanning direction is calculated according to the following equation (2). M (i) = Mg (GRAD (i)) × Md (DIST (i)) (2)

In the equation (2), Mg and Md are weighting factors, and the weighting factor Mg is given as an example in FIG. 9 so that the weight increases when the gradient GRAD of the density gradient is small.
The gradient GR of the density gradient is calculated using a map as shown in FIG.
It can be determined according to AD. Also, the weight coefficient Md
9 can be determined according to the normal pixel distance DIST using a map as shown in FIG. 9C so that the weight increases when the normal pixel distance DIST is small.

As a result, the value of the weighting factor M increases in the scanning direction in which the gradient GRAD of the density gradient is small and the distance DIST between normal pixels is small, and one of the gradient GRAD of the density gradient and the normal pixel distance DIST becomes smaller. For a large scanning direction, the value of the weight coefficient M is reduced (or set to 0). In the scan direction in which the normal pixel cannot be detected and the scan is stopped, the value of the weight coefficient M is unconditionally set to 0.

Then, the interpolation value VAL for each scanning direction
Based on the UE _X (i) and the weighting factor M (i), calculates R, G, for each B a correction pixel value DI _X of the defective pixel to be processed according to the following equation (3). DI _X = Σ (M (i) × VALUE _X (i)) / Σ (M (i)) (3)

[0102] (3) In the formula, since seeking interpolated value VALUE _X (i) correction pixel value by weighting according to the weighting factor M (i) the DI _X in each scanning direction, each of the defect per Even if the proper scanning direction varies for each part within a single defective portion, a proper corrected pixel value can be obtained. Performs each of the above processes for all the defective pixels in the defect portion to be processed, when each operation the modified pixel value DI _X for all defective pixels, and terminates the correction value determination process by the interpolation method.

When the correction value determination processing by the interpolation method is completed, the flow shifts to step 120 in the flowchart of FIG. In step 120, it is determined whether or not the luminance adjustment method is applied to the correction of the defective portion to be processed. Application rate α = 1
If so, the determination is negative and the process proceeds to step 124. However, if the application ratio α ≠ 1, the determination is affirmative and the process proceeds to step 122, where a correction value determination process using the brightness adjustment method is performed. Hereinafter, the correction value determination processing by this luminance adjustment method will be described.

First, from the R, G, and B image data and IR data of the image to be processed, the defect area to be processed and the area around the area corresponding to the size of the area around the defect area determined in step 104 are determined. By extracting data of a predetermined region including a region and inputting the extracted data of the predetermined region to a high-pass filter, the high-frequency component data H-r of R, The high-frequency component data H-g of G, the high-frequency component data H-b of B, and the high-frequency component data H-IR of IR are respectively generated. Then, each data is temporarily stored in the work area secured in step 110.

Subsequent processing in the correction value determination processing by the luminance adjustment method is performed using only the data in the predetermined area. In the present embodiment, in the previous step 104, as shown in FIG. The area around the defective portion is determined using a map whose characteristics are determined so that the size of the area around the defective area increases as the pixel density of the image data increases (the approximate size of the defective area on the image data increases). Since the size of the region is set, correction of the defective portion is performed using only the data of the predetermined region including the defective portion and the peripheral region in the range corresponding to the size of the set defective portion peripheral region as described above. In this case, it takes more time than necessary to repair the defective part, and conversely, the size of the peripheral area is too small compared to the size of the defective part on the image data. Low It is possible to avoid that.

Next, an unprocessed defective pixel is selected as a defective pixel to be processed from among the defective pixels belonging to the defective portion to be processed, and the high frequency component data Hr, Hg, Hb, H
-From IR, high-frequency component data h- of the selected defective pixel
r, hg, hb, and h-IR are respectively extracted, and the ratio of high frequency components of R, G, B and IR of the defective pixel to be processed (gain Gain _X :
Where X represents any one of R, G and B) according to the following equation (4). Gain _X = hx / h-IR (4) In the above equation (4), high-frequency component data hr, hg, hb, and h-IR from which a DC component and a low-frequency component have been removed are used.
Since the ratio between the high-frequency component data hr, hg, hb and the high-frequency component data h-IR is obtained as the gain Gain _X , this gain
Gain _X represents the ratio of the amount of transmitted light of each of the R, G, and B wavelengths to the IR light due to the difference in the refractive index between the light of each of the R, G, and B wavelengths and the IR light in the photographic film. ing.

Subsequently, from the R, G, B, and IR data,
Data Dr of the defective pixel to be processed, Dg, Db, then extracted respectively ir, based on the gain Gain _X computed earlier, calculates the correction pixel value DG _X of the defective pixel to be processed according to the following equation (5) I do. DG _X = D _X −ir × Gain _X (5) The second term of the expression (5) is R, G, B in a photographic film.
R, which is caused by the difference in the refractive index between the light in each wavelength region and the IR light,
Since the data ir is corrected using the gain Gain _X representing the ratio of the amount of transmitted light between the G and B wavelength regions and the IR light,
This value accurately represents the amount of change in (the logarithmic value of) the amount of transmitted R, G, or B light at the position of a defective pixel to be processed due to a scratch or the like on the photographic film. Since equation (5) changes the pixel value of the defective pixel by (ir × Gain _X ), the corrected pixel value DG _X is R light, G light, or B light caused by a scratch or the like on the photographic film. It is possible to obtain a value in which a change in the amount of transmitted light is accurately corrected.

When the above processing is performed on all the defective pixels belonging to the defective part to be processed, the correction value determination processing by the luminance adjustment method is completed, and the process proceeds to step 118 in the flowchart of FIG. A correction value for the defective part is determined. The correction value for the defective part in the present embodiment is:
It consists of a corrected pixel value of each defective pixel belonging to the defective part,
When any one of the interpolation method and the brightness adjustment method is applied to the correction of the defective portion to be processed, the correction method determines the corrected pixel value of each defective pixel belonging to the defective portion to be processed by the interpolation method or the brightness adjustment method. By setting each of the correction pixel values, a correction value for the defective portion to be processed can be determined.

When the interpolation method and the brightness adjustment method are each applied to the correction of the defective portion to be processed, the correction value for the defective portion to be processed is the corrected pixel value determined by the interpolation method, DI _X , and the brightness adjustment. When the corrected pixel value determined by the method is DG _X and the application ratio of the interpolation method is α, the corrected pixel value D0 _X of each defective pixel belonging to the defective portion to be processed is calculated by the following equation (6). Can be determined. D0 _X = α × DI _X + (1−α) × DG _X (6) As described above, the correction value for the defective portion to be processed can be determined so that the defective portion to be processed is accurately corrected. .

In the next step 126, it is determined whether or not the processing of step 112 and subsequent steps has been performed on all the defective parts detected in the defective part detection processing (step 106). If the determination is negative, the process returns to step 112, and another unprocessed defective portion is determined as a defective portion to be processed in step 112.
The subsequent processing is repeated. As a result, for all defective portions detected by the defective portion detection processing, calculation of a predetermined feature amount, selection of a correction method to be applied or determination of an application range (application ratio) based on the calculation result, determination of a correction value Will be performed respectively.

When correction values are determined for all the detected defective portions, the determination in step 126 is affirmed, and the process proceeds to step 128. After the work area secured in step 110 is released, In the next step 130, the correction value for each defective part is replaced with information indicating the position of the defective part (for example, the address of a defective pixel constituting each defective part).
At the same time, it notifies the image processor 40 and terminates the defective part correction value determination processing.

In the image processor 40, after performing various image processing on the fine scan image data under the processing conditions determined by the setup calculation in the control unit 42, the control unit 42 performs a defective part correction value determination process. In this way, the defective portion is corrected in accordance with the correction value notified from the control unit 42 (specifically, the defective pixel correction process is performed in which the value of each defective pixel belonging to the defective portion is replaced with the notified corrected pixel value). Thus, the image processor 40
Corresponds to step 11 of the defect correction value determination processing described above.
Together with 0 to 128, they correspond to the correcting means of the present invention.

The image processor 40 converts the image data having undergone the defect correction processing and various image processing operations into I / O data.
Output to the printer 16 via the controller 38 and the I / F circuit 54. As a result, the defective portion selected as a correction target is erased from the image recorded by exposure on the photographic paper 68.

[Second Embodiment] Next, a second embodiment of the present invention will be described. Since the second embodiment has the same configuration as the first embodiment, the same reference numerals are given to the respective parts, and the description of the configuration will be omitted. Hereinafter, the second embodiment will be described as the operation of the second embodiment. The defective part correction value determination processing according to the embodiment will be described with reference to the flowchart of FIG. 10 and only the parts different from the defective part correction value determination processing described in the first embodiment.

The defective part correction value determination processing according to the second embodiment is processing to which the image processing method according to claim 7 is applied, and the defective part correction value determination processing is performed by the CPU 46 of the control unit 42. An information storage medium 72 storing a defective part correction value determination program to be realized by the present invention corresponds to the recording medium according to claim 9. When the CPU 46 executes the defective part correction value determination program, the image processing device 14 functions as the image processing device according to the third aspect.

In the defective part correction value determination processing according to the second embodiment, at step 100, the R, R
After the G and B image data and the IR data have been fetched (this step 100 corresponds to the acquisition means according to claim 4), in the next step 103, the reading resolution and the electronic magnification for the image to be processed are read. , And calculates an electronic scaling factor (1 / N) for setting the pixel density of the image data to a predetermined value. The above-mentioned predetermined value is fixedly determined in advance.

In the next step 105, the electronic scaling factor (1/1) obtained in step 103 is applied to the R, G, B image data and IR data captured in step 100.
N) times, an electronic scaling process (pixel density conversion process) is performed. As a result, R, which represents a visible image shown in FIG.
From the G and B image data, the image data representing the visible image (noted as “visible image (1 / N)” in FIG. 11) having a predetermined pixel density is obtained from the IR data representing the IR image shown in FIG. Obtains IR data representing an IR image having a pixel density of a predetermined value (in FIG. 11, denoted as “IR image (1 / N)”).

By performing the electronic scaling process on the image data and the IR data so that the pixel density becomes a predetermined value, the size of the defective portion is reduced on the image data and the IR data that have been subjected to the electronic scaling process. In conversion, it falls within a substantially predetermined range. As described above, steps 103 and 105 correspond to the first conversion unit described in claim 3 (specifically, the first conversion unit described in claim 4).

From the next step 106 onward, the same processing as in the first embodiment is performed using the image data and the IR data that have been subjected to the electronic scaling processing. However, in the first embodiment, the values of the parameters for the detection criterion of the defective portion, the size of the area around the defective portion, and the size of the work area are determined according to the pixel density of the image data. In the second embodiment, since the pixel densities of the image data and IR data to be processed are constant (predetermined values), the parameters are fixedly set to optimal values when the pixel density is the predetermined value. Detection of a defective portion in accordance with the values of the fixed parameters (step 106) and securing of a work area (step 1)
10), calculation of a correction value for the defective portion (step 11)
8, 122).

In the second embodiment, step 12
After determining the correction value for the defective portion to be processed in step 4,
Further, the defective portion to be processed is corrected using the determined correction value. As a result, as shown by way of example in FIG. 11 as “visual image with corrected defective portion (1 / N)”, image data having a predetermined pixel density representing an image in which the defective portion has been corrected is obtained. Step 106 corresponds to the detecting means described in claim 3 (specifically, claim 4).
Reference numerals 126 correspond to the correcting means according to the third aspect.

If all the defective portions are corrected and the determination in step 126 is affirmative, the process proceeds to step 132 after releasing the work area in step 128, and the image data in which the defective portion has been corrected (the pixel density is equal to the predetermined value). Image data) is subjected to electronic scaling processing (pixel density conversion processing) at an electronic scaling factor N times. As a result, as shown in FIG. 11 as an example of a “defect portion corrected visible image”, the defective portion is corrected and the pixel density is changed to the original image data (“visible image” shown in FIG. 11).
(Data of the defective portion). As described above, step 132 corresponds to the second conversion unit described in claim 3.

At step 132, the defect-corrected visible image data which has been subjected to the defect correction and the electronic magnification process of N times is transferred to the image processor 40. At the next step 136, the defect image is detected by the defect detection processing (step 106). The positions of all the defective parts (all the defective parts corrected in step 124) (specifically, the addresses of all the defective pixels belonging to the defective part) are notified to the image processor 40, and the defective part correction value determination processing ends. .

The defect-corrected visible image data transferred to the image processor 40 has undergone two electronic scaling processes, although the defect is corrected and the pixel density is the same as that of the original image data. The scaling process includes an interpolation process), and the image represented by the defective portion corrected visible image data has a lower image quality such as a lower sharpness than the image represented by the original image data. Therefore, the image processor 40 performs a process of combining the original image data and the defective portion corrected visible image data as the defective portion correction process.

More specifically, as shown in FIG. 11 as “selector”, while sequentially scanning each pixel of the image, each pixel is determined to be a pixel belonging to the defective part based on the notified position of the defective part. If the pixel belongs to the defective portion, the data of the corresponding pixel is extracted from the defective portion corrected visible image data, and if the pixel does not belong to the defective portion, the data of the corresponding pixel is extracted. The extraction from the original image data is repeated. As a result, the image quality is not degraded in regions other than the defective portion, and output image data in which the defective portion has been corrected can be obtained in the defective portion region. As described above, the image processor 4 according to the second embodiment
0 has a function as a generating means described in claim 3 (specifically, claim 5).

As described above, when the original image data is used for the pixels belonging to the defective portion, and the defective portion corrected visible image data is used for the pixels not belonging to the defective portion, the boundary between the defective portion and the non-defective portion is obtained. May have an unnatural finish. In consideration of this, for the pixel corresponding to the defective portion and the boundary between the defective portion and the non-defective portion, or the area around the defective portion, the weighted average of the original image data and the defective portion corrected visible image data is adopted. Is also good. The weighting factor for both data may be determined for each pixel based on, for example, the amount of transmitted IR light in each pixel (the amount of variation with respect to the reference value), or the amount of transmitted IR light in the defective portion (with respect to the reference value). It may be determined for each individual defective portion based on the maximum variation amount in the defective portion. Thereby, the unnaturalness of the boundary between the defective portion and the non-defective portion can be eliminated or reduced.
Also, the unnaturalness of the boundary can be eliminated by applying a low-pass filter to the vicinity of the boundary and blurring the vicinity of the boundary.

Further, in the above, the interpolation method and the brightness adjustment method have been described as an example of the defective portion repairing method. However, the present invention is not limited to these, and the so-called blurring method of blurring the defective portion by applying a low-pass filter or the like is described. May be added.

In the above description, R, G,
B is read, and R, G,
Although an example of reading B and IR has been described, the present invention is not limited to this. IR reading may be performed only at the time of pre-scanning, or may be performed at the time of pre-scanning and fine scanning. Further, the reading may be performed only once.

Further, in the above description, a configuration in which an image is read by an area sensor (area CCD 30) in which photoelectric conversion cells are arranged in a matrix has been described. However, the present invention is not limited to this, and the photoelectric conversion cells are arranged in a line. The image may be read by the line sensor provided. In the above description, the configuration in which an image is read by photoelectrically converting light transmitted through a photographic film has been described. However, the configuration is not limited to this, and the configuration in which an image is read by photoelectrically converting light reflected by a photographic film is described. May be adopted. The image recording material is not limited to a photographic film, and it goes without saying that a photographic photosensitive material other than a photographic film, plain paper, an OHP sheet, or the like may be used as the image recording material.

In the first embodiment, the values of the parameters for detecting the defect, the size of the area surrounding the defect, and the size of the work area are changed according to the pixel density of the image data. However, the invention of claim 1 is not limited to the above, and any one of the above parameters may be used.
It goes without saying that only one or two values may be changed.

The "parameters relating to the detection of a defective portion or the correction of a defective portion" described in claim 1 are not limited to the above, but may be used as parameters relating to the detection of a defective portion or the correction of a defective portion. For example, the interval between pixels used for correcting the defective portion in the peripheral area of the defective portion is adopted, and as the pixel density of the image data increases, the interval between pixels for sampling data (the degree of pixel thinning) is increased (for example, If the density is doubled, the sampling pixel interval is doubled, etc.), and the defective portion may be corrected using the sampled data.

[0130]

As described above, according to the first and sixth aspects of the present invention, it is possible to detect a defective portion or correct a defective portion in accordance with the pixel density of an image represented by image information on an image recording material. Since the related parameters are changed, there is an excellent effect that an appropriate defect correction according to the scale of the defect on the image data can be easily realized.

According to a third aspect of the present invention, the image information is converted so that the pixel density of the image represented by the image information on the image recording material becomes a predetermined value. Correcting the defective portion, and converting the image information after the correction of the defective portion so that the pixel density of the image represented by the image information on the image recording material returns to the original value. The image information obtained by correcting the defective portion is generated by synthesizing the image information having undergone the above-described processing, so that the parameters related to the defective portion correction are changed regardless of the size of the defective portion on the image data. This has an excellent effect that a defective portion can be properly corrected without any problem.

According to a fourth aspect of the present invention, in the third aspect of the present invention, the invisible image information obtained by irradiating the image recording material with invisible light is obtained, and the image recording of the image represented by the invisible image information is performed. The invisible image information is converted so that the pixel density on the material also becomes a predetermined value, and the defective portion is detected using the invisible image information that has undergone the conversion. This has the effect that it can be corrected well.

According to a fifth aspect of the present invention, in the third aspect of the present invention, only the original image information is used for the non-defective area, and only the image information which has been converted by the second converting means is used for the defective area. Or using image information corresponding to a weighted average of the original image information and the image information that has been converted by the second conversion means, and by combining these, generates image information with a defective portion corrected, In addition to the above effects, there is an effect that image information representing an image in which a decrease in image quality is suppressed and a defective portion is appropriately corrected can be obtained.

According to an eighth aspect of the present invention, there is provided a first step of detecting a defective portion of an image represented by image information, a second step of correcting the defective portion with respect to the image information, and a first step and a second step. Before performing at least one of the two steps,
A program for causing a computer to execute a process including a third step of changing a parameter related to detection of a defective portion or correction of a defective portion according to a pixel density of an image represented by image information on an image recording material is recorded. Since the information is recorded on the medium, there is an excellent effect that an appropriate defect correction according to the scale of the defect on the image data can be easily realized.

According to a ninth aspect of the present invention, the first aspect of the present invention converts a pixel density of an image represented by image information on an image recording material to a predetermined value and detects a defective portion of the image represented by the image information. A second step of correcting a defective portion with respect to the image information having undergone the conversion, a third step of converting the image information having undergone the correction of the defective portion so that the pixel density returns to the original value, and A program for causing a computer to execute a process including a fourth step of generating image information in which a defective portion is corrected by synthesizing the image information having undergone the conversion and the image information having undergone the conversion is recorded on a recording medium. ,
There is an excellent effect that the defective portion can be properly corrected without changing the parameter related to the defective portion regardless of the size of the defective portion on the image data.

[Brief description of the drawings]

FIG. 1 is a schematic configuration diagram of an image processing system according to an embodiment.

FIG. 2 is a perspective view illustrating a schematic configuration of a film scanner.

FIG. 3 is a flowchart showing the content of a defective portion correction value determination process according to the first embodiment.

FIGS. 4A to 4C show parameter values of a threshold value for determining whether or not a defective portion is determined, a size of a peripheral region used for correcting a defective portion, and a size of a work region for temporarily storing data; FIG. 4 is a diagram illustrating an example of a relationship between an image represented by image data and a pixel density on a photographic film.

FIG. 5A is a conceptual diagram showing light transmission in a portion of a photographic film without a scratch and foreign matter, a portion with a scratch, and a portion with a foreign material, and FIG. (C) is a conceptual diagram showing light transmission when the back surface is scratched and (C) shows the light transmission when the emulsion surface of the photographic film is scratched.

FIG. 6 (A) shows a case where the back surface is scratched.
(B) shows R light, G light, and B light when the emulsion surface is scratched.
FIG. 4 is a diagram illustrating an example of a change in transmitted light amount of light and IR light.

FIGS. 7A to 7C are diagrams illustrating an example of a map for selecting a correction method to be applied or determining an applicable range from a calculation result of a feature amount of a defective portion;

FIG. 8 is a conceptual diagram illustrating an example of a scanning direction.

9A is a diagram for explaining an interpolation calculation of a pixel value of a defective pixel from a pixel value of a normal pixel, FIG. 9B is a relationship between a gradient GRAD and a weight coefficient Mg, and FIG. It is a diagram which shows the relationship between the distance DIST and the weight coefficient Md, respectively.

FIG. 10 is a flowchart illustrating the content of a defective portion correction value determination process according to the second embodiment.

FIG. 11 is a conceptual diagram showing a process of correcting a defective portion according to the second embodiment.

[Explanation of symbols]

 12 Film Scanner 14 Image Processing Device 20 Light Source 23 Filter Unit 26 Photographic Film 30 Area CCD 40 Image Processor 42 Control Unit 72 Information Storage Medium

Claims (9)

[Claims] A detecting means for detecting a defective portion of an image represented by the image information obtained by reading an image recorded on an image recording material; Correcting means for correcting a defective part detected by the means, and detecting the defective part by the detecting means or detecting the defective part by the correcting means according to the pixel density of the image represented by the image information on the image recording material. An image processing apparatus, comprising: changing means for changing a parameter related to correction. 2. The image forming apparatus according to claim 1, wherein the changing unit is configured to correct the defective area by using the correcting unit to correct the defective portion as the pixel density of the image represented by the image information on the image recording material increases. To increase the size of a storage area secured by the correction means for temporarily storing data required for correction of a defective portion. At least one of: increasing a distance between pixels to be used, and changing a criterion of detecting a defective portion by the detecting unit so as to reduce the number of defective portions detected by the detecting unit. Item 2. The image processing device according to Item 1. 3. Converting image information obtained by reading an image recorded on an image recording material such that a pixel density of the image represented by the image information on the image recording material becomes a predetermined value. A first conversion unit; a detection unit that detects a defective portion of an image represented by the image information; and a correction unit that corrects the defective portion detected by the detection unit with respect to the image information that has been converted by the first conversion unit. And second image conversion means for converting the image information corrected by the correction means so that the pixel density of the image represented by the image information on the image recording material returns to the original value. An image processing apparatus comprising: a generating unit configured to generate image information in which a defective portion is corrected by combining image information that has been converted by the second converting unit. 4. Irradiating the image recording material with invisible light,
The image processing apparatus further includes an acquisition unit configured to acquire invisible image information obtained by photoelectrically converting invisible light transmitted or reflected by the image recording material. The invisible image information is converted so that the pixel density on the image recording material also becomes the predetermined value, and the detecting unit detects the defective portion by using the invisible image information that has been converted by the first converting unit. The image processing apparatus according to claim 3, wherein the detection is performed. 5. The image processing apparatus according to claim 1, wherein the generation unit uses only the original image information for the non-defective area in the image, and uses only the image information that has been converted by the second conversion unit for the defective area in the image. Or using image information equivalent to a weighted average of the original image information and the image information that has been converted by the second conversion means, and combining these to generate image information in which the defective portion has been corrected. The image processing apparatus according to claim 3, wherein: 6. An image information obtained by reading an image recorded on an image recording material, detecting a defective portion of an image represented by the image information, and detecting the defective portion based on the image information. And an image processing method for modifying parameters relating to the detection of the defective portion or the correction of the defective portion according to the pixel density of the image represented by the image information on the image recording material. 7. Converting image information obtained by reading an image recorded on an image recording material such that a pixel density of the image represented by the image information on the image recording material becomes a predetermined value. Performing the first conversion, detecting a defective portion of the image represented by the image information, correcting the detected defective portion with respect to the image information having undergone the first conversion, and performing an image after the correction of the defective portion. Performing a second conversion for converting the information represented by the image information so that the pixel density on the image recording material of the image represented by the image information returns to the original value. The original image information and the image information having undergone the second conversion An image processing method for generating image information in which a defective portion has been corrected by combining 8. A first step of detecting, for image information obtained by reading an image recorded on an image recording material, a defective portion of an image represented by the image information, A second step of correcting the detected defective portion; and, before performing at least one of the first step and the second step, a pixel density of the image represented by the image information on the image recording material. A recording medium on which is recorded a program for causing a computer to execute a process including a third step of changing a parameter related to detection of the defective portion or correction of the defective portion. 9. Converting image information obtained by reading an image recorded on an image recording material so that the pixel density of the image represented by the image information on the image recording material becomes a predetermined value. A first step of performing a first conversion and detecting a defective portion of an image represented by the image information; a second step of correcting the detected defective portion with respect to the image information having undergone the first conversion; A third step of performing a second conversion of converting the image information having undergone the correction of the defective portion so that the pixel density of the image represented by the image information on the image recording material returns to the original value; and A program for causing a computer to execute a process including a fourth step of generating image information in which a defective portion is corrected by combining original image information and image information that has undergone the second conversion is recorded. Recording media.