JPH11243493A - Image processor - Google Patents

Abstract

PROBLEM TO BE SOLVED: To produce a soft focus image which prevents the center of image such as contour from being out-of-focus and whose graininess is not noticeable by adding an image signal that performs the gain adjustment of at least the gain of either an intermediate frequency components or a high frequency component of an original image signal and an out-of-focus image signal. SOLUTION: For an original image signal whose color tone signal level has been converted by a color tone converting means 74, first a gain adjustment image signal is produced by a gain adjusting means 76 and inputted to an image signal compositing means 88. In the meantime, the original image signal is converted into a luminance signal Y by a luminance signal producing means 78, and an out-of-focus image signal is produced by a low-pass filter 80 and is inputted to the means 88. Also, the original image signal has an addition ratio αadjusted, in accordance with a density determined by an image density decision means 84 at an addition ratio adjusting means 86 and is inputted to the means 88. A soft focus image signal thus acquired can reproduce an effect that is close to actual flare.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

[0001] 1. Field of the Invention [0002] The present invention relates to an image processing apparatus, and more particularly, to an image processing apparatus which photoelectrically reads a color image and converts the original image signal obtained by converting the color image into a digital signal.
The present invention relates to an image processing apparatus capable of generating a soft focus image used in a color image reproduction system that reproduces a color image as a visible image.

[0002]

2. Description of the Related Art A color image recorded on a negative film, a reversal film, a color print, or the like is converted into a C image.
It is read photoelectrically by a photoelectric conversion element such as a CD, converted into a digital signal, stored as an original image signal in an image signal storage means such as a frame memory, and further converted into an image signal stored in an image data storage means. There has been proposed a color image reproducing system which performs processing and reproduces it on a recording material such as color paper or a display means such as a CRT. According to this color image reproduction system, even if a color image is photographed under inappropriate photographing conditions such as underexposure or overexposure and is recorded on a negative film, a reversal film or a color print, the obtained original image is obtained. By performing image processing on the signal,
It can be reproduced as a color image having a desired color and gradation. Further, a color image recorded on a negative film, a reversal film, a color print or the like can be reproduced as a color image having different colors and gradations, if desired.

On the other hand, in both photographing and photographic printing, a soft focus image is generated by multiple exposure, but multiple exposure is a time-consuming technique. By the way, based on a color image recorded on a negative film, a reversal film, a color print, or the like, a digital color image reproducing system as described above is used. It is strongly desired to generate a focus image. For this reason, the present applicant discloses an image processing apparatus capable of generating a soft focus image by digital image processing in the above-described color image reproduction system in Japanese Patent Application Laid-Open No. Hei 9-172600. The image processing apparatus disclosed herein performs color conversion on an image signal read from a color image and stored in a frame memory in the above-described color image reproduction system to obtain an original image signal. The blur signal processing is performed on the signal to obtain a blurred image signal, and the blurred image signal and the original image signal are combined at a predetermined ratio to generate an image signal for creating a soft focus image.

[0004]

SUMMARY OF THE INVENTION However, Japanese Patent Application Laid-Open No.
In the image processing apparatus disclosed in Japanese Patent No. 172600, the original image and the blurred image are added at an arbitrary ratio, so that an image having a soft focus effect can be created. However, in this technique, the addition ratio between the original image and the blurred image is constant in any part of one image. For this reason, if the addition ratio of the blurred image is increased in order to give a soft feeling, the core of the image is too blurred, that is, the limbs (edges) in the image most sensitive to human eyes are easily blurred. On the other hand, if the soft effect is suppressed to increase the center of the image and the addition ratio of the original image is increased, there is a problem that the granularity becomes conspicuous.

SUMMARY OF THE INVENTION An object of the present invention is to solve the above-mentioned problems of the prior art, and to create a soft focus image by image processing of a digital color image signal, such as a skin or highlight portion in one image. By applying the optimal software to the part where you want to give a soft feeling and the part where you want to leave the core of the image such as the limb, it is possible to create a soft focus image with no blurred core and no noticeable graininess An image processing device is provided. Another object of the present invention is to provide an image processing apparatus capable of providing an effect close to a flare seen in soft focus obtained by actual camera photographing or the like.

[0006]

In order to solve the above-mentioned object, the present invention provides a soft focus image signal for producing a soft focus image by performing image processing on a digital original image signal read from a color image. An image processing apparatus for generating, comprising: a gain adjusting unit that adjusts at least one of a gain of a medium frequency component and a high frequency component of the original image signal; a unit that generates a blurred image signal from the original image signal; The present invention provides an image processing apparatus comprising an adding unit for adding the image signal whose gain has been adjusted by the unit and the blurred image signal.

Here, the present invention is the above-mentioned image processing apparatus, further comprising an adding ratio adjusting means for adjusting an adding ratio of the gain adjusted image signal and the blurred image signal by the adding means. An object of the present invention is to provide an image processing apparatus having the feature. Further, the present invention is the image processing apparatus described above, further comprising: means for determining a density in the color image using the original image signal, wherein the adding ratio adjusting means determines the density by the determining means. An image processing apparatus that adjusts the addition ratio according to the determined density in the color image.

Further, the present invention is an image processing apparatus for generating a soft focus image signal for creating a soft focus image by performing image processing on a digital original image signal read from a color image, Means for generating a blurred image signal from the signal, means for determining the density in the color image using the original image signal, and adding means for adding the original image signal and the blurred image signal,
Means for adjusting the addition ratio of the original image signal and the blurred image signal by the adding means according to the density in the color image determined by the image density determining means. An apparatus is provided.

[0009]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS An image processing apparatus according to the present invention will be described in detail below based on preferred embodiments shown in the accompanying drawings.

FIG. 1 is a block diagram of an embodiment of a digital photo printer to which the image processing apparatus of the present invention is applied. A digital photo printer (hereinafter, referred to as a photo printer) 10 shown in FIG. 1 is a scanner (image reading device) 12 that photoelectrically reads an image photographed on a film F.
And an image processing device 14 for performing image processing such as soft focus processing of image data (image information) read by the scanner 12 and for operating and controlling the entire photo printer 10, and output from the image processing device 14. And an image recording device 16 for exposing a photosensitive material (printing paper) to an image with a light beam modulated in accordance with image data, developing (finishing) the image, and outputting a soft focus image as a print. The image processing apparatus 14 includes a keyboard 18a and a mouse 18 for inputting various conditions such as input, setting, selection and instruction of processing, and instructions such as color / density correction.
and an operation system 18 having an image b, a monitor 20 for displaying an image read by the scanner 12, various operation instructions, a setting / registration screen for various conditions, and the like.

The scanner 12 is a device that photoelectrically reads an image photographed on a film F or the like one frame at a time.
A variable aperture 24, a diffusion box 26 for making the reading light incident on the film F uniform in the surface direction of the film F, a carrier 28 of the film F, and an imaging lens unit 32
, An image sensor 32 having a three-line CCD sensor corresponding to reading of image densities of R (red), G (green), and B (blue), an amplifier (amplifier) 33, and an A / D (analog / digital). ) A converter 34.

In the photo printer 10, a dedicated carrier 28 which can be freely mounted on the main body of the scanner 12 is provided with a type and size of a film F such as a new photo system (Advanced Photo System) or a 135 size negative (or reversal) film. It is prepared according to the form of the film such as strips and slides, and can be adapted to various films and processes by replacing the carrier 28.
An image (frame) photographed on a film and provided for printing is conveyed by the carrier 28 to a predetermined reading position. Also, as is well known, a magnetic recording medium is formed on the film of the new photo system, and the cartridge ID
And various kinds of data such as the date and time of photographing and development, and the type of camera and developing machine at the time of photographing and developing. The magnetic information reading means is arranged on the carrier 28 corresponding to the film (cartridge) of the new photographic system. The magnetic information is read when the film is transported to the reading position, and the various kinds of information are subjected to image processing. It is sent to the device 14.

When reading an image photographed on the film F in such a scanner 12, uniform reading light emitted from the light source 22 and adjusted in light amount by the variable aperture 24 and the diffusion box 26 is transmitted by the carrier 28. Incident on the film F located at the predetermined reading position,
By transmitting the light, projection light carrying an image photographed on the film F is obtained.

In the illustrated example, the carrier 28 is a 24
It corresponds to a long film F (strips) such as a 35-size film or a cartridge of a new photo system. As schematically shown in FIG. 2A, the film F is located at a predetermined reading position. While the image sensor 32 is conveyed in the sub-scanning direction orthogonal to the extending direction (main scanning direction) of, for example, an RGB three-line CCD sensor, the longitudinal direction of the film F being conveyed. Conveying roller pairs 28a and 28 interposed in the sub-scanning direction
b, and a mask 28d having a slit 28c that extends in the main scanning direction and that corresponds to the reading position and regulates the projection light of the film F into a predetermined slit shape. The film F is positioned at the reading position by the carrier 28, and is conveyed in the sub-scanning direction, and receives the reading light.
As a result, the film F is two-dimensionally slit-scanned by the slit 28c extending in the main scanning direction, and the image of each frame captured on the film F is read.

The projection light of the film F is imaged on the light receiving surface of the image sensor 32 by the imaging lens unit 30. As shown in FIG. 2B, the image sensor 32
Is a line CCD sensor 32 for reading an R image
Line CCD sensor 32 for reading R and G images
This is a so-called three-line color CCD sensor having a line CCD sensor 32B for reading the G and B images. Each line CCD sensor extends in the main scanning direction as described above. The projection light of the film F is separated into three primary colors of R, G and B by the image sensor 32 and read photoelectrically. R, G, and B output signals output from the image sensor 32 are
, And is sent to the A / D converter 34. In the A / D converter 34, for example, 12-bit RGB
After being converted into digital image data, the image processing device 14
Is output to

In the scanner 12, when an image photographed on the film F is read, a prescan (first image reading) for reading at a low resolution and a fine scan (second image reading) for obtaining image data of an output image are performed. (2nd image reading). Here, the pre-scan is performed under pre-scan reading conditions set in advance so that the image sensor 32 can read all images of the film F to be scanned by the scanner 12 without saturation. On the other hand, the fine scan is performed such that the image sensor 32 is saturated at a density slightly lower than the minimum density of the image (frame) from the pre-scan data.
The scanning is performed under the fine scanning reading conditions set for each frame. The prescan and fine scan output image signals are basically the same image data except that the resolution and the output image signal level are different.

The scanner 12 used in the photo printer 10 is not limited to the one that performs the slit scanning reading, and may be the one that performs the surface reading that reads the entire surface of one frame of the film image at a time. Good. In this case, for example, an area sensor such as an area CCD sensor is used, and insertion means for each of R, G, and B color filters is provided between the light source 22 and the film F, and inserted into the optical path of light emitted from the light source. The reading light transmitted through the color filters is irradiated onto the entire surface of the film F, and the transmitted light is focused on the area CCD sensor to read the entire image of the film F by sequentially switching the R, G, and B color filters. Accordingly, the image photographed on the film F is separated into three primary colors and read.

As described above, the digital image data signal output from the scanner 12 is output to the image processing device 14 which is a feature of the present invention. FIG. 3 shows a block diagram of an image processing apparatus (hereinafter, referred to as a processing apparatus) 14 of the present invention. Here, the processing device 14 includes a scanner correction unit 36, L
OG converter 38, prescan (frame) memory 4
0, a fine scan (frame) memory 42, a pre-scan data processing unit 44, a fine scan data processing unit 46 for creating a soft focus image which is a feature of the present invention, and a condition setting unit 48. FIG. 3 mainly shows a part related to image processing, and the processing device 1
The CPU 4 further includes a CPU for controlling and managing the entire photo printer 10 including the processing device 14, a memory for storing information necessary for the operation of the photo printer 10, and the like. The monitor 18 and the monitor 20 are connected to each section via the CPU or the like (CPU bus).

The R, G, and B image signals input from the scanner 12 to the processing device 14, for example, 12-bit digital image data, are input to the scanner correction unit 36.
The scanner correction unit 36 performs DC offset correction to correct the sensitivity variation and dark current of each pixel of the RGB digital image data due to the three-line CCD sensors 32R, 32G, and 32B of the image sensor 32 of the scanner 12.
It performs data correction of the read image data such as darkness correction, defective pixel correction, and shading correction. The digital image signal that has been subjected to the correction process for the sensitivity variation and dark current for each pixel by the scanner correction unit 36 is output to the LOG converter. The LOG converter 38 converts the digital image data into gradation data by performing a logarithmic conversion process to convert the digital image data into digital image density data. For example, the LOG converter 38 corrects the digital image data using a lookup table (LUT) in the scanner correction unit 26. For example, by converting the 12-bit digital image data
For example, it is converted into digital image density data of 10 bits (0 to 1023).

The digital image density data converted by the LOG converter 38 is stored (stored) in the pre-scan memory 40 if it is pre-scan image data and in the fine scan memory 42 if it is fine scan image data. . The pre-scan memory 40 is obtained by pre-scanning the film F by the scanner 12,
This is a frame memory for storing or storing the low-resolution image density data of the entire frame of the film F subjected to various data corrections and logarithmic conversion processes for each of the RGB colors. The pre-scan memory 40 needs at least a capacity capable of storing image density data of one frame of the film F in three colors of RGB, but may have a capacity capable of storing image density data of a plurality of frames. It may have a large number of memories each having a capacity of one frame. The pre-scan image data stored in the pre-scan memory 40 is read by the pre-scan data processing unit 44.

On the other hand, the fine scan memory 42 stores the high-resolution image density data of the entire frame of the film F obtained by the fine scan of the film F by the scanner 12 and subjected to various data corrections and logarithmic conversion processes. It is a frame memory for storing or storing for each color. The fine scan memory 42 has a capacity to store at least image density data of three colors of RGB of two images of the film F, and while writing image density data of one frame, image density of another one frame is written. It is preferable that the data is read out and the fine scan data processing unit 46 simultaneously performs various processes for creating a soft focus image which is a feature of the present invention. However, the present invention is not limited to this. It may have a capacity to store the image density data of the frames and process the images one by one. Alternatively, a memory having a large capacity for one frame may be used, for example, a toggle memory. The fine scan image data stored in the fine scan memory 42 is read out by the fine scan data processing unit 46.

A prescan data processing unit 44 that performs various image processes required for displaying on the monitor 20 on the prescan image data stored in the prescan memory 40
Has an image processing unit 50 and an image data conversion unit 52. Here, the image processing unit 50 includes a condition setting unit 4 described below.
The image data read by the scanner 12 and stored in the pre-scan memory 42 in accordance with the image processing conditions set by
In order to reproduce a color image on the RT display screen, predetermined operations such as gradation correction, color conversion, and density conversion are performed by a lookup table (hereinafter, represented by LUT) or matrix (hereinafter, represented by MTX) calculation. This is for performing image processing. The image data conversion unit 52 thins out the image data processed by the image processing unit 50 as necessary in order to match the resolution of the monitor 20.
Using a 3D (three-dimensional) LUT or the like, the data is converted into image data corresponding to the display on the monitor 20 and displayed on the monitor 20. The processing conditions in the image processing unit 50 are set by a condition setting unit 48 described later.

On the other hand, the fine scan image data stored in the fine scan memory 42 is added to the image recording device 1.
The fine scan data processing unit 46 that performs various image processing necessary for outputting as a color print from the printer 6 and the soft focus image creation processing of the present invention includes an image processing unit 54 and an image data conversion unit 56. here,
The image processing unit 54 converts the image data read by the scanner 12 and stored in the fine scan memory 42 into a desired density, gradation, and color tone as a color print in accordance with image processing conditions set by a condition setting unit 48 described later. , Color balance adjustment, gradation adjustment, color adjustment using an LUT, MTX calculator, low-pass filter, adder / subtractor, etc. so that a color image or a color soft focus image intended by the present invention can be reproduced on a color paper. Adjustment, density adjustment, saturation adjustment, electronic scaling, sharpness enhancement (edge enhancement; sharpening), dodging (density dynamic range compression / expansion) or soft focus image creation, gain adjustment by frequency band, image density judgment, etc. This is for performing various types of image processing, details of which will be described later. The image data conversion unit 56 converts the dodging image data or the soft focus image data processed by the image processing unit 54 into image data corresponding to image recording by the image recording device 16 using, for example, a 3DLUT. And supplies it to the image recording device 16. The image recording device 16 is for outputting a dodged color image or a color soft focus image on a color print as a finished print based on the image data output from the fine scan data processing unit 46. is there.

The processing conditions in the image processing section 54 are set by a condition setting section 48 described later. Next, the condition setting unit 48 sets the reading conditions of the fine scan, and various processing conditions in the pre-scan data processing unit 44 and the fine scan data processing unit 46. The condition setting unit 48 includes a setup unit 58, a key correction unit 60, and a parameter integration unit 62. Setup part 5
8 sets the fine scan reading conditions using the prescan image data and supplies the same to the scanner 12, and creates the image processing conditions of the prescan data processing unit 44 and the fine scan data processing unit 46 (calculation). )
Then, the parameter is supplied to the parameter integration unit 62.

More specifically, the setup section 58 reads out the pre-scan image data from the pre-scan memory 40, creates a density histogram, average density, LATD (large area transmission density), and highlights from the pre-scan image data. Calculation of image feature amounts such as (lowest density) and shadow (highest density) is performed. Based on the calculated image feature amount, the image sensor 32 has a density slightly lower than the lowest density of the image.
In order to saturate the (line CCD sensors 32R, 32G, 32B), the reading conditions of the fine scan, for example, the light amount of the light source 22, the aperture value of the variable aperture 24, and the (each line CCD sensor 32R, 32G, 32B) of the image sensor 32
) Set the accumulation time. The fine scan reading condition may change all the elements corresponding to the output level of the image sensor with respect to the prescan reading condition, or change only one element such as the aperture value. Alternatively, only a plurality of factors such as the aperture value and the accumulation time may be changed. Furthermore, the setup unit 5
Reference numeral 8 sets image processing conditions such as the above-described color balance adjustment and gradation adjustment according to a density histogram, an image feature amount, and an instruction from an operator performed as necessary.

The key correction unit 60 is provided with a density (brightness), a color, a contrast, a sharpness, a saturation set by a key (not shown) provided on the keyboard 18a and the operation system 18, and a soft focus image of the present invention. The amount of adjustment of the image processing condition (for example, the amount of LUT correction) in accordance with the amount of adjustment of the medium-high frequency gain for creation, the addition ratio of the original image and the blurred image, and various instructions input with the mouse 18b Etc.), set parameters, and supply them to the parameter integration unit 62. The parameter integration unit 62
The image processing conditions set by the setup unit 58 are received, and the supplied image processing conditions are set in the image processing unit 50 of the pre-scan data processing unit 44 and the image processing unit 54 of the fine scan data processing unit 46. The image processing conditions set for each part are corrected (adjusted) or the image processing conditions are reset according to the adjustment amount calculated by the correction unit 60.

Next, the image processing unit 54 of the fine scan data processing unit 46 for creating a soft focus image, which is a feature of the present invention, will be described in detail.
FIG. 4 is a block diagram illustrating details of one embodiment of the image processing unit 54. As shown in FIG. 4, the image processing unit 54 includes a color density gradation conversion unit 64 that converts the density, color, and gradation of the image data, a saturation conversion unit 66 that converts the saturation of the image data, Digital magnification conversion (electronic scaling) means 68 for converting the number of pixels, frequency processing means 70 for performing frequency processing on image data, and soft focus for converting the density dynamic range of image data or applying soft focus to an image A processing means 72 is provided.

In the image processing section 54, a color density gradation conversion means 64 converts image data into density data, color data and gradation data according to an LUT or the like. Further, the saturation conversion means 66 includes a color density gradation conversion means 6.
4 is to convert the saturation data of the image data obtained in step 4 in accordance with MTX operation or the like. The electronic scaling unit 68 interpolates the image data subjected to the saturation conversion by the saturation conversion unit 66 according to the size of the color image output to the color paper in the image recording device 16 and according to the output pixel density. In this case, the number of pixel data of the image data is increased or decreased by thinning or thinning. Frequency processing means 7
0 denotes image data electronically scaled by the electronic scaling means 68 to image data of a predetermined output size and output pixel density,
The image data subjected to frequency processing such as edge enhancement is input to the soft focus processing unit 72.

In general, when a soft-focus image is generated using a camera, a subject is subjected to multiple exposure, that is, photographing is performed under normal exposure conditions, and photographing is performed again so as to obtain a blurred image. Thus, a soft focus image is generated. For this reason, in the present invention, basically, an image signal corresponding to an image blurred from an original image signal by using a soft focus processing unit to which a dodging processing unit disclosed in Japanese Patent Application Laid-Open No. 9-172600 is applied. Is generated, and the blurred image signal and the original image signal are combined to generate a soft focus image. FIG. 5 is a block diagram showing details of one embodiment of the soft focus processing means 72.

As shown in FIG. 5, the soft focus processing means 72 compresses the dynamic range of the density signal level of the image data, in particular, the wide density dynamic range of a document image such as a film image, and outputs it to an output medium such as a color paper. According to the narrower dynamic range of the density signal of the original image, without causing the jump of the low density (highlight) part and the collapse of the high density (shadow) part of the original image,
Either reproduce the color image or apply appropriate soft focus processing to the image data so that the part of the color image where you want to leave the image core, such as contours (edges), has no image core blur, There is no grainy part in the part where you want to give a soft feeling such as the light part, so that it can be reproduced as an optimal soft focus image,
It is configured to process image data, and includes a color tone conversion unit 74, a gain adjustment unit 76, a luminance signal conversion unit 78, a low-pass filter 80, a density dynamic range compression unit 82, an image density determination unit 84, , An addition ratio adjusting means 86 and an image signal synthesizing means 88.

In the soft focus processing means 72,
The color tone conversion means 74 is for converting the color tone signal level of the image data subjected to the frequency processing by the frequency processing means 70 into an original image signal. Gain adjustment means 7
6 is one of the features of the present invention, which is added to a blurred image to create a soft focus image;
The gain of at least one component of the medium frequency band and the high frequency band of the original image signal whose color tone has been converted by the color tone conversion means 74 is adjusted according to the magnitude of the soft focus effect. For example, the gain adjusting means 76 may be used to increase the soft focus effect of the reproduced image.
If it is desired to increase the gain of both the medium frequency band and the high frequency band components of the original image signal to be added to the blurred image and to reduce the soft focus effect of the reproduced image, the gain of the medium frequency band component of the original image signal is reduced. Note that the gain adjusting means 76 may be of any type as long as the gain of at least one component of the medium frequency band and the high frequency band of the original image signal can be adjusted by increasing or decreasing the gain. . For example, by changing the mask function when making a blur mask, that is, by changing the size of the blur mask, the gain of a component having a different frequency band of the original image signal may be adjusted, or a low-pass filter, a high-pass filter, a band-pass filter, or the like may be used. May be used to extract the medium frequency and high frequency components of the original image signal and amplify or attenuate these frequency components to adjust the gain.

The luminance signal conversion means 78 is provided by the color tone conversion means 7.
The R, G, and B color signals of the original image signal whose color tone has been converted by step 4 are converted into a luminance signal Y, and the R, G, and B color signals are weighted according to human vision. The luminance signal Y is converted. The low-pass filter 80 constitutes a unit for generating a blurred image (blur mask) signal of the present invention. In the illustrated example, the low-pass filter 80 filters a low-frequency component of the luminance signal obtained by the luminance signal conversion unit 78. This is for generating a blurred image signal. Therefore, as the blurred image signal, one type of blurred image signal is used for all of the three color signals of RGB. The density dynamic range compressing means 82 compresses the density dynamic range of the blurred image signal composed of the low frequency components generated by the low-pass filter 80 using an LUT, a multiplier (MUL), or the like. When the creation of the soft focus image, which is a feature of the present invention, is instructed, the density dynamic range compression unit 82 does not perform any processing on the blurred image signal, and
8 is output. Alternatively, when creating a soft focus image, the blurred image signal output from the low-pass filter 80 is directly input to the image signal synthesizing unit 88 by directly passing through the density dynamic range compression unit 82 or by bypassing it. You may.

Here, the soft focus processing means 72 in the illustrated example converts the original image signal to the luminance signal conversion means 7.
Although a blurred image signal is generated by the low-pass filter 80 from the luminance signal converted through the step 8, the present invention is not limited to this, and instead of the luminance signal, the blurred image signal is generated for each of the RGB original image color signals. May be generated,
The low-pass filter 80 that generates the blurred image signal is
An FIR filter or an IIR filter may be used.
The means for generating the blurred image signal includes a low-pass filter 80.
However, the present invention is not limited to this, and a smoothing filter such as a median filter may be used, or a combination thereof may be used. Further, since the low-pass filter 80 only processes a three-dimensional R, G, B color signal or a luminance signal converted into a one-dimensional signal, a one-dimensional low-pass filter can be used.

The image density judging means 84 is one of the features of the present invention, and is for judging the density of one frame image from the original image signal which has been color-converted by the color tone converting means 74 for each area. belongs to. Addition ratio adjusting means 86
Is one of the characteristic features of the present invention. The original image signal whose tone has been converted by the tone converter 74 or the image signal whose gain in the middle and high frequency band has been adjusted by the gain adjuster 76 and the low-pass filter 80 The addition ratio (α; the addition ratio of the blurred image signal) to the created blurred image signal is adjusted. Image signal combining means 88
In the dodging process, an LUT, a multiplier, and an adder are used to add an original image signal and a blurred image signal with a compressed dynamic range to synthesize an image, thereby eliminating highlight skipping and shadow loss. Create no color image or
Alternatively, the gain adjustment image signal and the blurred image signal are added at a predetermined addition ratio α (1−α: α), for example, 75% (1: 3), or the original image signal or the gain adjustment image signal and the blurred image signal are added at a predetermined ratio. This is for creating a soft focus image by adding images at the addition ratio α adjusted by the adjusting means 86 and synthesizing the images.

Here, the addition ratio α is input to the key correction unit 60 of the condition setting unit 48 by the operator using the keyboard 18a or the mouse 18b of the operation system 18, especially when the predetermined addition ratio α is set, and the condition setting unit 48 May be directly supplied to the image signal synthesizing means 88 via the parameter integration section 62 of the condition setting section 58. However, it is set by the setup section 58 and the key correction section 60 of the condition setting section 48 in accordance with the prescanned image data, The signal is input to the addition ratio adjustment unit 86 via the integration unit 62, and is added to the addition ratio adjustment unit 86.
The density of one frame image is determined for each area from the original image signal determined by the image density determining means 84, and the addition ratio adjusting means 86 is determined for each determined density area. May be used to adjust the addition ratio α. When the addition ratio α is adjusted by the addition ratio adjustment unit 86, the addition ratio α may be adjusted for each density region divided by a predetermined threshold by the image density determination unit 84, or the image density may be adjusted using an LUT. The addition ratio α may be set smoothly for each density region determined by the determination unit 84.

The soft focus processing means 72 can reproduce a color soft focus image without blur of the center of the image or graininess. On the other hand, the soft focus processing means 72 has high density collapse, low density jump, edge blur, and the like. It is configured to process image data so as to reproduce a color image that has been compressed so that there is no image data, that is, to perform either soft focus processing or dodging processing on the image data. Here, when creating a soft focus image, the soft focus processing means 72 first converts the input image data into a color tone conversion means 74.
After the color tone signal level is converted into the original image signal by the conversion, the signal is sent to the main path, and the gain adjusting means 76 adjusts the gain of at least one of the original image signal and the high-frequency band component, and Is generated and input to the image signal synthesizing means 88.

On the other hand, the original image signal output from the color tone conversion means 74 is sent to a bypass, and the luminance signal conversion means 78
Is input to The luminance signal conversion means 78 weights the R, G, and B color signals in the image signal according to human vision as follows, Convert to Y Y = aR + bC + cb where a + b + c = 1, a, b, c> 0. As an example, a = 0.3, b = 0.59, c =
0.11 can be mentioned. Next, the luminance signal Y
Is input to the low-pass filter 80, high-frequency components and middle-frequency components are cut off, and a blurred image signal including a luminance signal of only low-frequency components is generated. The blurred image signal thus obtained corresponds to a blurred image because the high frequency component and the middle frequency component have been cut off.

The blurred image signal output from the low-pass filter 80 passes through the dynamic range compression unit 82 and is input to the image signal synthesis unit 88 without any processing. The original image signal output from the color tone conversion unit 74 is input to the image density determination unit 84, and the image density is determined by a density region in one frame image, for example, by one density threshold or a plurality of density thresholds. And divided into a plurality of density regions. Next, in the addition ratio adjustment unit 86, the addition ratio α is adjusted according to the determination densities of the plurality of density regions, and the obtained addition ratio α is assigned to the plurality of density regions divided by the image density determination unit 84, The image signal is input to the image signal synthesizing unit 88.

Finally, in the image signal synthesizing means 88, the gain adjusted image signal from the gain adjusting means 76 input from the main path and the blurred image signal from the low pass filter 80 input from the bypass are added to the addition ratio adjusting means 86
Addition ratio α adjusted according to the image density input from
Are combined for each of a plurality of density regions, and a soft focus image signal is obtained. The soft focus image signal obtained in this way has an optimum soft focus effect, and there is no blur of the image core such as an outline (edge) at a portion where the image core is to be left, and a soft feeling such as a skin or a highlight portion is obtained. There is no graininess or the like in the portion where it is desired to produce, and it can be reproduced as a color soft focus image having an effect close to a flare seen in actual color soft focus by multiple exposure in a camera.

On the other hand, in the dodging process, in the soft focus processing means 72, the input image data is first converted into the original image signal by converting the tone signal level by the tone conversion means 74, and then the main image signal is processed. The signal is sent to the path and directly input to the image signal synthesizing means 88. On the other hand, the original image signal output from the color tone conversion unit 74 is sent to the bypass, input to the luminance signal conversion unit 78, converted into the luminance signal Y, and then input to the low-pass filter 80, where the blurred image signal is output. Generated. The blurred image signal thus obtained is input to the dynamic range compressing means 82, where the dynamic range is compressed, and is input to the image signal synthesizing means 88.

Finally, the image signal synthesizing means 88 synthesizes the original image signal input from the main path and the dynamic range compressed blur image signal from the dynamic range compressing means 82 input from the bypass at an addition ratio α.
A dodging color image signal is obtained. The dodging color image signal obtained in this way has an optimal dodging effect, the dynamic range of only the low frequency component is compressed, and the dynamic range of the high frequency component and the middle frequency component is not compressed. The color image can be reproduced as a color image without causing a jump in a low-density (highlight) portion or a collapse in a high-density (shadow) portion of an original image and without blurring an edge portion.

By the way, the luminance signal conversion means 78 outputs R,
The G and B color signals are converted into a one-dimensional luminance signal Y. Since the luminance signal Y corresponds to the gray component of the color image, the blur image signal processed by the bypass of the soft focus processing unit 72 is converted. The color soft focus image reproduced based on the soft focus image signal obtained by the synthesis has a problem that the gray component is mixed and the saturation decreases, so in the illustrated example,
In advance, the color tone of the image signal is
A soft focus image obtained by synthesizing an image signal by converting the main path and the blurred image signal processed by bypass so as to be equal to the color tone of the image signal obtained by synthesizing the image signal. It is preferable to prevent a decrease in the color saturation. The specific technique for preventing the saturation of the soft-focus image from decreasing is not particularly limited. However, the present applicant has disclosed a technique for preventing the saturation of the soft-focus image from decreasing, disclosed in Japanese Patent Application Laid-Open No. Hei 9-172600. For example, a known saturation prevention technique such as the above can be used.

In the image processing apparatus 14 of the present invention, various components for the above-described soft focus processing are
Various types of soft focus processing means 72 may be configured in combination according to the required soft focus effect, or the soft focus processing means 72 including all the components for the soft focus processing described above.
And the processing in the soft focus processing means 72 may be changed according to the required soft focus effect. For example, when it is desired to increase or decrease the effect of the soft focus, at least the gain adjusting unit 76, the blurred image signal generating unit such as the low-pass filter 80, the addition ratio adjusting unit 86, and the image signal combining unit 88 are provided. What is necessary is just to comprise the soft focus processing means 72. Here, when it is desired to increase the effect of the soft focus, as shown in FIG. 6, the gain adjusting means 76 is applied to the original image signal Org.
An image signal HG having a high gain in the middle frequency and high frequency bands, and a low-pass filter 8 as shown in FIG.
The blurred image signal LF generated at 0 is prepared, and the adding ratio α of the blurred image signal LF is increased by the adding ratio adjusting means 86, and is combined by the image signal combining means 88 as, for example, 75% (1: 3). As a result, a soft focus image SF1 having a frequency response characteristic as shown in FIG. 8 can be created.

By the way, in the middle frequency band and the high frequency band, there are many portions showing contours in an image, and a person is the most sensitive portion. Here, when the soft focus effect is strengthened, that is, when the addition ratio of the blurred image is increased, it is easy for a human eye to feel that the image has only a blurred outline (edge). Therefore, in the present invention, when the soft focus effect is strengthened, by using an image in which these medium-frequency and high-frequency components, that is, edge components are emphasized, instead of the original image, as shown in FIG. By leaving the image, an image with an enhanced overall soft focus effect can be created.
For comparison, the original image signal Or shown in FIG.
g and the blurred image signal LF shown in FIG.
Conventional soft focus image S synthesized by (1: 1)
In contrast to this, the soft focus image SF1 of the example of the present invention shown in FIG. 8 has a large decrease in response in the low frequency band and a high soft focus effect, but has a high soft focus effect. Since the decrease in the response is not so large, it can be seen that the image has the contour remaining and the overall soft focus effect is high.

On the other hand, when it is desired to reduce the effect of the soft focus, as shown in FIG. 9, the image signal LG whose gain in the middle frequency band has been reduced by the gain adjusting means 76 with respect to the original image signal Org, and FIG. Is prepared, and the addition ratio of the gain-adjusted image signal LG is increased by the addition ratio adjusting means 86, that is, the addition ratio α of the blurred image signal LF is reduced, for example, to 25%.
By synthesizing (3: 1) by the image signal synthesizing means 88, a soft focus image SF2 having a frequency response characteristic as shown in FIG. 10 can be created. By the way, when the soft focus effect is lowered, that is, when the addition ratio of the blurred image is lowered, the granularity of the human skin is more conspicuous. Therefore, in the present invention, when the soft focus effect is reduced, an image in which a signal of a medium frequency component including a portion close to the skin noise is used instead of the original image in place of the contour, as shown in FIG. As described above, it is possible to create an image with a small soft focus effect in which the outline is left and the granularity is suppressed. The soft focus image SF2 of the example of the present invention shown in FIG. 10 has a small response in a low frequency band and a small soft focus effect as compared with the soft focus image SF0 of the conventional example shown in FIG. Since the response in the frequency band is not high, it can be seen that the color image has a contour remaining and graininess suppressed.

Further, in the present invention, when it is desired to increase or reduce the effect, at least a blurred image signal generating means such as a low-pass filter 80, an image density determining means 84, an addition ratio adjusting means 86, and an image signal synthesizing means. The soft focus processing unit 72 may be configured by including a unit 88 and, if necessary, a gain adjusting unit 76. In this case, the image signal synthesizing unit 88 combines the original image signal or the image signal whose medium frequency gain has been increased or the image signal whose intermediate frequency gain has been reduced by the gain adjusting unit 76 and the blurred image signal by the low-pass filter 80. When the images are combined, the addition ratio α is adjusted in accordance with the image density determined by the image density determination unit 84, and, for example, a high-density portion (high-density region)
Then, the addition ratio α of the blurred image signal is increased, and the addition ratio α of the blurred image signal is reduced in a low density portion (low density region). By doing so, it is possible to create a soft-focus image close to the effect of flare that appears in a high-contrast portion as seen in actual soft focus by multiple exposure in a camera.

The image processing apparatus according to the present invention and the digital photo printer using the same are basically configured as described above. The operation of the image processing apparatus and digital photo printer of the present invention will be described below with reference to FIGS.

The operator sets the film F (frame to be read)
Is loaded into the scanner 12, the film F is set at a predetermined position of the carrier 28, necessary information such as finishing information and a print size to be created is input, and then the start of soft-focus image print creation is instructed. I do. Thereby, the aperture value of the variable aperture 24 of the scanner 12 and the image sensor (the line CCD sensors 32R, 32
G, 32B) The accumulation time of 32 is set according to the prescan reading conditions. Thereafter, the carrier 28 conveys the film F in the sub-scanning direction at a speed corresponding to the pre-scan, and the pre-scan is started, the film F is slit-scanned, the projection light forms an image on the image sensor 32, and the film F Is separated into R, G and B, and photoelectrically read at a low resolution. Here, the pre-scan and the fine scan may be performed one frame at a time, or the pre-scan and the fine scan may be performed continuously for all frames or for a predetermined plurality of frames. In the following example, one frame of image reading will be described as an example to simplify the description.

The output signal of the image sensor 32 due to the pre-scan is amplified by the amplifier 33 and is output from the A / D converter 3.
4 and converted into digital image data, which is then output to the image processing device 14 of the present invention. The digital image data input to the image processing device 14 of the present invention is subjected to a predetermined correction such as dark current of the image sensor 32 by the scanner correction unit 36, and then sent to the LOG converter 38, which corresponds to the pre-scan. In the density range, for example, the LUT is converted so as to allocate a density range of 4 in density D to 10-bit data, and is converted into prescan image data. The prescan image data is stored in the prescan memory 40. . When the pre-scan image data is stored in the pre-scan memory 40, the setup unit 58 of the condition setting unit 48 reads it out, creates a density histogram, calculates image features such as highlights and shadows, and performs fine scan. Are set and supplied to the scanner 12, and various image processing conditions such as gradation adjustment and gray balance adjustment are set and supplied to the parameter integration unit 62. Parameter integration unit 62 receiving the image processing conditions
Sets this in predetermined portions (hardware and software) of the pre-scan data processing unit 44 and the fine scan data processing unit 46.

When performing the test, the pre-scan image data is read from the pre-scan memory 40 by the pre-scan data processing unit 44, subjected to image processing under the image processing conditions set in the image processing unit 50, and then subjected to image processing. The data is converted by the data converter 52 and displayed on the monitor 20 as a simulation image. The operator looks at the display on the monitor 20, confirms (verifies) the image, that is, the processing result, and adjusts the color, density, gradation, and the like using the adjustment keys and the like set on the keyboard 18a as necessary. The input of this adjustment is sent to the key correction unit 60, which calculates the correction amount of the image processing condition according to the adjustment input, and sends it to the parameter integration unit 62. The parameter integration unit 62 determines whether the image processing unit 50
And 54 LUT and MTX are corrected. Therefore, the image displayed on the monitor 20 also changes according to the correction, that is, the adjustment input by the operator.

When the operator determines that the image of the frame is proper (OK), the operator instructs the start of printing using the keyboard 18a or the like. Thus, the image processing conditions are determined, the aperture value of the variable aperture 24 is set in the scanner 12 in accordance with the reading conditions of the fine scan, and the carrier 28 moves the film F at a speed corresponding to the fine scan. It is conveyed and fine scan is started. When the test is not performed, the fine scan data processing unit 4 by the parameter integration unit 62
When the setting of the image processing condition in the image processing unit 54 of Step 6 is completed, the image processing condition is determined, and the fine scan is started. The fine scan is performed in the same manner as the pre-scan except that the reading conditions such as the aperture value of the variable aperture 24 are different. The output signal from the image sensor 32 is amplified by the amplifier 33, and the A / D converter of the processing device 14 The digital density data is converted into digital density data at 34, subjected to predetermined processing by a scanner correction unit 36, and sent to a LOG converter 38. In the LOG converter 38, the fine scan digital image data is processed at a higher density resolution than the pre-scan. For example, the fine scan digital image data is converted by the LUT so as to allocate a density range of 2 in density D to 10-bit data. After that, it is sent to the fine scan memory 42.

In the image processing section 54, the density data, color data and gradation data of the fine scan image data are converted by the color density gradation conversion means 64 in accordance with the look-up table. The chroma data of the image signal is converted according to the matrix operation. Next, after the number of pixel data of the image data signal is increased or decreased by the electronic scaling unit 68 in accordance with the size of the color image output to the color paper, the image signal is input to the frequency processing unit 70. The image data signal input to the frequency processing means 70 undergoes frequency processing such as edge enhancement, and
2 is input. When the fine scan image data signal is input, the soft focus processing means 72 performs a process for generating a soft focus image on the image data signal.

That is, the operator operates the keyboard 18
When an instruction is given to generate a soft focus image using a, an instruction signal is input to the image processing apparatus 14 of the present invention,
Processing parameters required for the soft focus processing means 72 are set. When the processing parameters required for creating a soft focus image are set in the soft focus processing means 72,
The input image data is first converted into an original image signal by converting a color tone signal level by a color tone conversion unit 74, and then sent to a main path. At least one of the inside of the original image signal and the high frequency band component is output by a gain adjustment unit 76. Is adjusted, and a gain-adjusted image signal is generated. On the other hand, the original image signal output from the color tone conversion means 74 is sent to the bypass,
After being input to the luminance signal conversion means 78 and converted into a luminance signal Y, the signal is input to the low-pass filter 80, and after the blurred image signal is generated, it passes through the dynamic range compression means 82 without any processing. Image signal synthesizing means 8
8 is input. The original image signal output from the color tone conversion means 74 is input to the image density determination
The image density of the frame image is determined, and then the addition ratio adjusting means 86 adjusts the addition ratio α in accordance with the density determined by the image density determining means 84 and inputs the result to the image signal synthesizing means 88.

Finally, the image signal synthesizing means 88 synthesizes the gain-adjusted image signal and the blurred image signal with the addition ratio α adjusted according to the image density, and obtains a soft focus image signal. The soft-focus image signal obtained in this way has no blur in the image core such as a contour (edge) in a portion where the image core is desired to be left, and a soft focus image such as a skin or a highlight portion. The image can be reproduced as a color soft focus image having no graininess or the like and having an effect close to a flare seen in actual color soft focus by multiple exposure in a camera. The soft focus image signal generated in the image processing unit 54 of the fine scan processing unit 46 in this manner is input to the image data conversion unit 56 and converted into image output image data. Is output to the image recording device 16.

The image recording device 16 prints a latent image by exposing a photosensitive material (printing paper) in accordance with input image data, and performs predetermined processing on the exposed photosensitive material. And a processor (developing device) for outputting as a print. In a printer, for example, after cutting a photosensitive material into a predetermined length corresponding to a print, a back print is recorded, and then three types of light beams of R exposure, G exposure, and B exposure according to the spectral sensitivity characteristics of the photosensitive material. Is modulated in accordance with the image data output from the processing device 14 and is deflected in the main scanning direction, and the photosensitive material is conveyed in the sub-scanning direction orthogonal to the main scanning direction. A latent image is recorded by dimensional scanning exposure and supplied to a processor. The processor receiving the photosensitive material,
A predetermined wet developing process such as color development, bleach-fixing, and washing with water is performed, dried to form a print, sorted into a predetermined unit such as one film, and accumulated.

As described above, the image processing apparatus of the present invention has been described in detail. However, the present invention is not limited to the above embodiment, and various improvements and modifications may be made without departing from the gist of the present invention. Of course.

[0057]

As described in detail above, according to the present invention,
When creating a soft focus image by digital image processing, even if the soft focus effect is strengthened, there is no blurring of the outline or edge, and the core of the image such as the edge can be left, or to leave the core of the image Even when the soft focus effect is reduced, the granularity of the skin and highlights is not noticeable, making it ideal for areas where you want a soft focus such as skin or highlights, and areas where you want to leave the core of the image such as contours Soft focusing processing can be performed. Further, according to the present invention, it is possible to provide an effect close to a flare seen in actual soft focus obtained by multiple exposure by an actual camera.

[Brief description of the drawings]

FIG. 1 is a block diagram of an embodiment of a digital photo printer to which an embodiment of an image processing apparatus according to the present invention is applied.

2A is a schematic perspective view for explaining an embodiment of a carrier mounted on the digital photo printer shown in FIG. 1, and FIG. 2B is an image sensor of the digital photo printer shown in FIG. It is a key map of one Example.

FIG. 3 is a block diagram of an embodiment of the image processing apparatus of the digital photo printer shown in FIG.

4 is a block diagram of an embodiment of an image processing unit of the image processing device fine scan image data processing unit shown in FIG. 3;

FIG. 5 is a block diagram of an embodiment of a soft focus processing unit of the image processing unit shown in FIG.

FIG. 6 is a graph showing a frequency response characteristic of an example of soft focus processing by the soft focus processing means shown in FIG.

FIG. 7 is a graph showing another example of a frequency response characteristic of the soft focus processing by the soft focus processing means shown in FIG. 5;

8 is a graph showing another example of a frequency response characteristic of the soft focus processing by the soft focus processing means shown in FIG. 5;

9 is a graph showing a frequency response characteristic of another example of the soft focus processing by the soft focus processing means shown in FIG.

10 is a graph showing another example of the frequency response characteristic of the soft focus processing by the soft focus processing means shown in FIG. 5;

FIG. 11 is a graph showing another example of a frequency response characteristic of soft focus processing performed by a conventional image processing apparatus.

[Explanation of symbols]

 DESCRIPTION OF SYMBOLS 10 (Digital) photo printer 12 Scanner 14 (Image) processing device 16 Image recording device 18 Operation system 18a Keyboard 18b Mouse 20 Monitor 22 Light source 24 Variable aperture 26 Diffusion box 28 Carrier 30 Imaging lens unit 32 Image sensor 32R, 32G, 32B Line CCD sensor 34 A / D converter 36 Scanner correction unit 38 LOG converter 40 Prescan (frame) memory 42 Finescan (frame) memory 44 Prescan data processing unit 46 Fine scan data processing unit 48 Condition setting unit 50, 54 Image processing units 52, 56 Image data conversion unit 58 Setup unit 60 Key correction unit 62 Parameter integration unit 64 Color density gradation conversion means 66 Saturation conversion means 68 Electronic scaling (digital magnification conversion) means 0 frequency processing unit 72 the soft focus processing means 74 the color tone conversion means 76 gain adjusting means 78 the luminance signal conversion means 80 low-pass filter 82 the dynamic range compression unit 84 image density determining means 86 addition ratio adjustment means 88 the image signal combining means

Claims (4)

[Claims] An image processing apparatus for generating a soft focus image signal for creating a soft focus image by performing image processing on a digital original image signal read from a color image, comprising: Gain adjusting means for adjusting at least one of the component and high-frequency component gains; means for generating a blurred image signal from the original image signal; and adding the image signal gain-adjusted by the gain adjusting means and the blurred image signal. An image processing apparatus comprising: 2. The image processing apparatus according to claim 1, further comprising an addition ratio adjusting unit that adjusts an addition ratio between the gain adjustment image signal and the blurred image signal by the adding unit. Characteristic image processing device. 3. The image processing apparatus according to claim 2, further comprising: means for determining a density in the color image using the original image signal;
An image processing apparatus, wherein the addition ratio is adjusted according to the density in the color image determined by the determination unit. 4. An image processing apparatus for generating a soft focus image signal for creating a soft focus image by performing image processing on a digital original image signal read from a color image, comprising: Means for generating a signal, means for determining the density in the color image using the original image signal, addition means for adding the original image signal and the blurred image signal, and determination by the image density determination means An image processing apparatus comprising: means for adjusting the addition ratio of the original image signal and the blurred image signal by the adding means according to the determined density in the color image.