JP4046509B2 - Image generation method and apparatus, image processing method and apparatus, and program - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to an image generation method for generating image data for print output subjected to image processing suitable for print output and image data for external output subjected to image processing suitable for external output such as a monitor, and the like. The present invention relates to an apparatus, an image processing method and apparatus for performing image processing on image data, an image generation method, and a program for causing a computer to execute the image processing method.
[0002]
[Prior art]
A system for reproducing image data obtained by an imaging device such as a digital camera or image data obtained by reading an image recorded on a photographic film with a scanner on an image reproducing apparatus such as a printer or a monitor is known. ing. In such a system, various image processes are performed on the image data in order to improve the quality of the reproduced image.
[0003]
By the way, an image reproduced by the image reproducing apparatus has various characteristics depending on the image reproducing apparatus. For example, if the image reproduction apparatus is a monitor, the reproduced image has frequency characteristics and color reproduction characteristics peculiar to the monitor. If the image reproducing apparatus is a printer, the reproduced image has frequency characteristics and color reproduction characteristics peculiar to the printer. As described above, since the characteristics of an image to be reproduced (hereinafter referred to as output characteristics) differ depending on the type of the image reproducing apparatus, when image processing is performed on image data, the output characteristics of the image reproducing apparatus are It is necessary to consider.
[0004]
For this reason, when transmitting image data from a server to an external terminal via a network, a method for performing image processing on the image data so as to have characteristics according to the output characteristics of the image reproduction device of the external terminal has been proposed. (Japanese Patent Application No. 2001-257168). According to this method, the image data transmitted to the external terminal is subjected to image processing suitable for the image reproduction apparatus included in the external terminal. Therefore, the external terminal generates an image suitable for the output characteristics. Can be played. In particular, if both image data for print output subjected to image processing suitable for print output and image data for monitor output subjected to image processing suitable for monitor output are generated, the type of image reproducing apparatus can be changed. This is convenient because image data can be transmitted at any time.
[0005]
[Problems to be solved by the invention]
By the way, in order to print out the monitor output image data subjected to the image processing for the monitor in the printer, it is necessary to perform again the image processing suitable for printing out the monitor output image data. In this case, print output image data (hereinafter referred to as reprint output image data) obtained by re-image processing is the same as print output image data that has been subjected to image processing suitable for print output from the beginning. The image processing must be performed. However, image data once subjected to image processing suitable for monitor output lacks color information and high-frequency information compared to image data before image processing, and is therefore suitable for printing out from the beginning. It is difficult to determine the contents of image processing for obtaining again the same image data for reprint output as the image data for print output subjected to image processing.
[0006]
In this case, it is conceivable that the contents of the image processing for the second time are determined in advance and the image processing is performed on the monitor output image data. However, since the contents of image processing differ depending on the image processing system and the type of image, if the contents of the image processing for the second time are determined uniquely, image processing suitable for print output from the beginning is performed. It is difficult to obtain the same reprint output image data as the printed output image data.
[0007]
The present invention has been made in view of the above circumstances. When image processing suitable for print output is performed on monitor output image data that has been subjected to image processing suitable for monitor output, printing is performed from the beginning. It is an object to generate reprint output image data that is substantially the same as the print output image data that has been subjected to suitable image processing.
[0008]
[Means for Solving the Problems]
An image generation method according to the present invention includes image data for print output that has been subjected to image processing suitable for print output by a predetermined printer, and external output that has undergone image processing suitable for external output other than print output. In an image generation method for generating image data for use,
Partial image data representing a partial area of the print image represented by the print output image data is added to the external output image data.
[0009]
Examples of “external output other than print output” include monitor output, recording on media such as FD and CD-R, output to a network, output to an image server connected to the network, and the like.
[0010]
“Give” means recording in the file header of the monitor output image data, or a separate file from the monitor output image data, but by associating the file name with the monitor output image data, etc. Say.
[0011]
In the image generation method according to the present invention, it is preferable that the partial area corresponds to a main subject such as a human face included in the print image.
[0012]
An image processing method according to the present invention is an image processing method for performing image processing on image data.
Refer to the partial image data when generating image data for reprint output in which image processing suitable for the print output is performed on the image data for external output obtained by the image generation method of the present invention. Then, the image data for reprint output is generated.
[0013]
An image generation apparatus according to the present invention includes print output image data subjected to image processing suitable for print output in a predetermined printer, and external output subjected to image processing suitable for other external output other than print output. In an image generation apparatus for generating image data for use,
The image forming apparatus includes an adding unit that adds partial image data representing a partial area of the print image represented by the print output image data to the external output image data.
[0014]
In the image generation apparatus according to the present invention, the adding unit may be a unit that sets a region corresponding to a main subject included in the print image as the partial region.
[0015]
An image processing apparatus according to the present invention is an image processing apparatus that performs image processing on image data.
Refer to the partial image data when generating image data for reprint output in which image processing suitable for the print output is performed on the image data for external output obtained by the image generation method of the present invention. And image processing means for generating the reprint output image data.
[0016]
The image generation method and the image processing method according to the present invention may be provided as a program for causing a computer to execute.
[0017]
【The invention's effect】
According to the image generation method and apparatus of the present invention, when generating image data for print output and image data for external output, partial image data representing a partial area of the print image represented by the image data for print output is It is given to the image data for external output. For this reason, when the image data for external output is printed out by a predetermined printer, the image processing method and apparatus according to the present invention refers to the image processing suitable for printing out from the beginning by referring to the partial image data. It is easy to set the contents of image processing for obtaining reprint output image data so that substantially the same reprint output image data as the print output image data subjected to is obtained. Accordingly, the image represented by the image data for reprint output and the image represented by the image data for print output subjected to image processing suitable for printing from the beginning are easily made substantially the same. can do.
[0018]
In addition, by assuming that the partial image data represents an image of an area corresponding to the main subject included in the print image, the image data for print output subjected to image processing suitable for print output from the beginning for the main subject Reprint output image data having been subjected to substantially the same image processing can be obtained.
[0019]
DETAILED DESCRIPTION OF THE INVENTION
Embodiments of the present invention will be described below with reference to the drawings. FIG. 1 is a schematic block diagram showing a configuration of an image output apparatus to which an image generation apparatus according to an embodiment of the present invention is applied. As shown in FIG. 1, the image output apparatus to which the image generating apparatus according to the present embodiment is applied performs image processing on digital image data S0 acquired by an imaging means 10 such as a digital camera, a print scanner, and a film scanner. Image data processing means 1 for obtaining image data S1 for print output by performing image processing suitable for print output on the image data S0, and image data S0. The monitor output image processing means 2 that obtains monitor output image data S2 by performing image processing suitable for monitor output, and the print image represented by the print output image data S1 for the monitor output image data S2 Providing means 3 for providing partial image data Sp representing a partial area of the image to the monitor output image data S2, and Recording means 4 such as a media drive for recording the monitor output image data S2 to which the image data Sp is added to the medium M such as FD, CD-R, and the print output image data S1 are printed out to obtain the print 7. And a printer 5. The monitor output image data S2 recorded on the medium M is displayed on a monitor 6 such as a CRT or a liquid crystal.
[0020]
The print 7 obtained by the printer 5 and the image reproduced on the monitor 6 have different frequency characteristics and color space. For this reason, the print output image processing means 1 and the monitor output image processing means 2 perform image processing on the image data S0 so as to be images suitable for print output and monitor output, respectively.
[0021]
Here, the frequency characteristics will be described. Since the printer 5 and the monitor 6 have different resolutions of images to be reproduced, the size of one pixel is different. For example, in the printer 5 having a resolution of 600 dpi and the monitor 6 having a resolution of 200 dpi, the size of one pixel is three times larger in the monitor 6 than in the printer 5. For this reason, the physical size of the displayed image is different between the printer 5 and the monitor 6, and the visual characteristics for observing it are also different. Therefore, the printer 5 and the monitor 6 need to have different frequency characteristics in order to reproduce an optimal image.
[0022]
FIG. 2 is a diagram showing visual characteristics with respect to luminance and color difference when the observation distance is 30 cm, in which the horizontal axis represents frequency and the vertical axis represents contrast recognition, that is, visual sensitivity. The solid line indicates the luminance characteristic, and the broken line indicates the color difference characteristic. As shown by the solid line in FIG. 2, when the observation distance is 30 cm, the visual sensitivity has a peak near 1 cycle / mm, and the visual sensitivity decreases at a frequency higher than that. Therefore, when the printer 5 reproduces an image, it is preferable to emphasize a frequency band corresponding to 1 cycle / mm or more.
[0023]
However, when an image is reproduced on the monitor 6, if the pixel size of the monitor 6 is about three times that of the printer 5, information corresponding to 1 cycle / mm in the printer 5 corresponds to 0.33 cycle / mm in the monitor 6. To do. Therefore, when the print output image data S1 subjected to the same processing as when the image is reproduced in the printer 5 is reproduced on the monitor 6, the signal corresponding to 1 cycle / mm, which was originally clearly visible, is excessively emphasized. On the other hand, noise and the like become conspicuous. Therefore, in order to obtain the monitor output image data S2, it is necessary to perform image processing on the image data S0 so that the emphasized frequency band has a characteristic different from that in the case of obtaining the print output image data S1. is there.
[0024]
As for the color space, the printer 5 and the monitor 6 have different color reproduction ranges (dynamic range and chromaticity range). Therefore, even if the image data reproduced on the printer 5 or the monitor 6 includes information outside the color gamut, the information cannot be reproduced on the printer 5 or the monitor 6. Depending on the color gamut, it is necessary to compress information outside the color gamut in the image represented by the image data S0, or perform different color space mapping to express information outside the color gamut within the color gamut.
[0025]
For this reason, the image processing means 1 for print output performs image processing on the image data S0 in consideration of the frequency characteristics and color reproduction range of the image reproduced by the printer 5, and obtains image data S1 for print output. It is done. On the other hand, the monitor output image processing means 2 performs image processing on the image data S0 in consideration of the frequency characteristics and color reproduction range of the image reproduced on the monitor 6 to obtain monitor output image data S2. It is done.
[0026]
The assigning unit 3 cuts out a partial area corresponding to a main subject such as a human face from the print image represented by the print output image data S1, and cuts out the partial image data Sp corresponding to the cut out partial area. It is given to the monitor output image data S2 together with the position information P representing the position.
[0027]
Here, by recording the partial image data Sp and the position information P in the file header of the monitor output image data S2, the partial image data Sp can be added to the monitor output image data S2. Although the image data for monitor output S2 is a separate file, the partial image data Sp is obtained by associating the monitor output image data S2, the partial image data Sp and the position information P by, for example, sharing a file name. The position information P may be added to the monitor output image data S2.
[0028]
As a method of cutting out the main subject, the center point of an area of a predetermined size is moved to the position of the main subject based on the image movement, the inclination of the outline of the main subject and / or the color, and this center point Extract the main subject according to the size and / or shape of the main subject with reference to or create a potential field map of the entire image and extract the main subject based on the minimum potential point in the map (Japanese Patent Laid-Open No. 5-210739), a neural network learns a plurality of feature patterns for a plurality of feature parts such as eyes and mouth of a main subject such as a face, and main subject candidates and feature parts are It is determined whether or not it is included in a plurality of learned feature patterns, and the positional relationship of the main subject candidate's characteristic part is the positional relationship of the main subject's characteristic part. A method of determining whether or not a main subject candidate is a main subject by determining whether or not the subject matches, and extracting a main subject candidate determined to be a main subject (Japanese Patent Laid-Open No. 5-282457) Etc. can be used.
[0029]
If the main subject is a face, the image is divided into a plurality of areas, and after removing the non-person area, a shape pattern representing the outline of the person's head is detected, and the face candidate area is determined according to the detected pattern. In addition, a shape pattern that represents the contour of the person's face, a shape pattern that represents the internal structure of the face, and a shape pattern that represents the contour of the human torso are detected, and the consistency of the face candidate area is determined based on the detected pattern. A method of extracting a face area by determining an area corresponding to the face of a person having the highest degree of accuracy (Japanese Patent Laid-Open No. Hei 8-122944), dividing an image into a plurality of areas, and performing photometry Is converted into hue and saturation, and these two-dimensional histograms are created. The histogram is decomposed into single peaks, and each pixel of the image The pixel is divided into groups corresponding to the divided mountains, the image is divided for each group, face candidate areas are extracted, and obtained from the image size and main image size information of the extracted areas For example, a method of extracting the most matching area as a face area by comparing with the image size to be obtained (JP-A-5-100328) may be used.
[0030]
Further, not only the main subject but also a predetermined area in the central portion of the print image represented by the print output image data S1 may be cut out as the partial image data Sp.
[0031]
Here, the size of the area to be cut out may be an area having a size of about 1/8 each in the vertical and horizontal directions of the print image represented by the print output image data S1.
[0032]
Next, the operation of the image generation apparatus according to the present embodiment will be described. FIG. 3 is a flowchart showing the operation of the image generation apparatus according to the present embodiment. As shown in FIG. 3, first, print output image processing means 1 performs image processing for print output on image data S0 to obtain print output image data S1 (step S1). On the other hand, the monitor output image processing means 2 performs monitor output image processing on the image data S0 to obtain monitor output image data S2 (step S2). In addition, you may perform the process of step S1 and step S2 reversely. Moreover, it is preferable to perform the process of step S1 and step S2 in parallel for shortening calculation time.
[0033]
Then, in the assigning means 3, the partial image data Sp is cut out from the print output image data S1, and the cut out partial image data Sp is given to the monitor output image data S2 together with the position information P (step S3). The monitor output image data S2 to which the partial image data Sp and the position information P are assigned is recorded on the medium M by the recording means 4 (step S4). On the other hand, the print output image data S1 is printed out by the printer 5 (step S5), whereby a print 7 is obtained, and the process ends. The print output image data S1 may be output at any stage after the print output image data S1 is obtained.
[0034]
Next, an embodiment of an image processing apparatus that performs image processing suitable for print output on the monitor output image data S2 obtained as described above will be described. FIG. 4 is a schematic block diagram showing a configuration of an image output apparatus to which the image processing apparatus according to the embodiment of the present invention is applied. As shown in FIG. 4, the image output apparatus to which the image processing apparatus according to the present embodiment is applied has the monitor output image data S2 (partial image data Sp and position information P added) recorded on the medium M. On the other hand, image processing suitable for print output is performed to obtain reprint output image data S3. The reading means 11 reads the monitor output image data S2 from the medium M, and the partial image in the monitor output image data S2. By applying a plurality of types of image processing or image processing with changed parameters to image data in an area corresponding to the data Sp (hereinafter referred to as corresponding image data Sc0), n processed corresponding image data Sck (k = 1-n), the corresponding image processing means 12, and the comparing means 13 for comparing the corresponding image data Sck and the partial image data Sp. Based on the comparison result R in the comparison means 13, a re-image processing means 14 for performing image processing suitable for print output on the monitor output image data S 2 to obtain re-print output image data S 3; A printer 15 that prints out the image data S3 to obtain the print 8;
[0035]
In the corresponding image processing unit 12, a plurality of types of image processing or image processing with changed parameters is performed on the corresponding image data Sc0. Specifically, frequency enhancement processing in which the degree of enhancement is changed stepwise, nonlinear frequency enhancement processing in which the degree of enhancement is changed stepwise according to contrast, and the like are performed, and a plurality of processed corresponding image data Sck are obtained. .
[0036]
The comparison unit 13 compares the plurality of processed corresponding image data Sck with the partial image data Sp. Specifically, the difference value of the corresponding pixel between the processed corresponding image represented by each processed corresponding image data Sck and the partial image represented by the partial image data Sp is obtained, and the sum of the difference values in all the pixels is obtained. Is calculated. Then, the type of image processing or image processing parameter applied to the processed corresponding image data Sck representing the processed corresponding image having the smallest sum of difference values from the partial images is selected, and the selected type of image processing or image is selected. The processing parameter is output as the comparison result R.
[0037]
In the re-image processing unit 14, image processing is performed on the monitor output image data S 2 based on the comparison result R output from the comparison unit 13 to obtain re-print output image data S 3.
[0038]
Next, the operation of the image processing apparatus according to the present embodiment will be described. FIG. 5 is a flowchart showing the operation of the image processing apparatus according to the present embodiment. First, the readout means 11 reads out the monitor output image data S2 to which the partial image data Sp and the position information P are added from the medium M (step S11). Next, the corresponding image processing means 12 performs a plurality of types of image processing or image processing with parameters changed on the corresponding image data Sc0 to obtain n processed corresponding image data Sck (step S12). The n processed corresponding image data Sck is input to the comparison means 13, where it is compared with the partial image data Sp and a comparison result R is output (step S13). Then, the re-image processing means 14 performs image processing on the monitor output image data S2 based on the comparison result R to obtain re-print output image data S3 (step S14), and the processing is terminated. The reprint output image data S3 is printed out by the printer 15, and a print 8 is obtained.
[0039]
As described above, according to the present embodiment, when the print output image data S1 and the monitor output image data S2 are generated, a partial image representing a partial area of the print image represented by the print output image data S1. Data Sp is added to the monitor output image data S2. Therefore, when the monitor output image data S2 is printed out, the image processing apparatus according to the present embodiment performs image processing suitable for printing out from the beginning by referring to the partial image data Sp. It is easy to set the contents of the image processing for obtaining the reprint output image data S3 so that the reprint output image data S3 substantially the same as the print output image data S1 is obtained. Therefore, the image represented by the image data S3 for reprint output and the image represented by the image data S1 for print output subjected to image processing suitable for print output from the beginning are easily substantially the same. Can be.
[0040]
In the above-described embodiment, the print output image data S1 and the monitor output image data S2 are generated. Instead of the monitor output image data S2, output to a network or an image server connected to the network is performed. Image data that has been subjected to image processing suitable for output to an image may be generated.
[Brief description of the drawings]
FIG. 1 is a schematic block diagram showing a configuration of an image output apparatus to which an image generation apparatus according to an embodiment of the present invention is applied. FIG. 2 is a diagram showing visual characteristics with respect to luminance and color difference when an observation distance is 30 cm. FIG. 4 is a schematic block diagram showing a configuration of an image output apparatus to which an image processing apparatus according to an embodiment of the present invention is applied. FIG. 5 is a flowchart of an operation of the image generation apparatus according to the present embodiment. Flow chart showing operation 【Explanation of symbols】
DESCRIPTION OF SYMBOLS 1 Print output image processing means 2 Monitor output image processing means 3 Giving means 4 Recording means 5, 15 Printer 6 Monitor 10 Imaging means 11 Reading means 12 Corresponding image processing means 13 Comparison means 14 Re-image processing means

Claims (9)

It is represented by print output image data that has undergone image processing suitable for print output in a predetermined printer , and image data for print output that has undergone image processing suitable for external output other than print output. In an image generation method for generating image data for external output for the same image as a printed image ,
Location information representing a location of the portion of the partial image data representing the area, and the partial region of the print image represented by the print output image data, characterized by applying to the external output image data Image generation method.   The image generation method according to claim 1, wherein the partial area is an area corresponding to a main subject included in the print image. In an image processing method for performing image processing on image data,
The partial image data when generating image data for reprint output obtained by performing image processing suitable for the print output on the image data for external output obtained by the image generation method according to claim 1 And generating image data for reprint output with reference to FIG. It is represented by print output image data that has undergone image processing suitable for print output in a predetermined printer , and image data for print output that has undergone image processing suitable for external output other than print output. In an image generation apparatus for generating image data for external output for the same image as a printed image ,
The image processing apparatus includes an adding unit that adds partial image data representing a partial area of the print image represented by the print output image data and position information representing a position of the partial area to the external output image data. An image generation apparatus characterized by that.   The image generating apparatus according to claim 4, wherein the adding unit is a unit that sets a region corresponding to a main subject included in the print image as the partial region. In an image processing apparatus that performs image processing on image data,
The partial image data when generating image data for reprint output obtained by performing image processing suitable for the print output on the image data for external output obtained by the image generation method according to claim 1 An image processing apparatus comprising image processing means for generating the reprint output image data with reference to FIG. It is represented by print output image data that has undergone image processing suitable for print output in a predetermined printer , and image data for print output that has undergone image processing suitable for external output other than print output. In a program for causing a computer to execute an image generation method for generating image data for external output for the same image as a printed image ,
A program comprising a procedure of adding partial image data representing a partial area of a print image represented by the print output image data and position information representing a position of the partial area to the external output image data.   8. The program according to claim 7, wherein the assigning procedure is a procedure in which an area corresponding to a main subject included in the print image is the partial area. In a program for causing a computer to execute an image processing method for performing image processing on image data,
The partial image data when generating image data for reprint output obtained by performing image processing suitable for the print output on the image data for external output obtained by the image generation method according to claim 1 A program having a procedure for generating the reprint output image data with reference to FIG.

Images