JP2006157196A - Image forming method and image forming apparatus - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an image forming method and image forming apparatus capable of appealing a fact of execution of high quality image processing such as red-eye correction to a requester of print forming and allowing the requester to recognize the execution. <P>SOLUTION: The task above is solved by storing an image or more resulting from applying first image processing to one or more object images properly selected from one order item or the one unprocessed image or more to a prescribed storage means, and outputting the images read from the storage medium and to which the basic processing only is applied in addition to an image or more being products. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  In the technical field of image formation for outputting photographic prints and the like, the present invention outputs to a customer who ordered photographic prints or the like when performing high-quality image processing such as red-eye correction processing and outputting images. The present invention relates to an image forming method and an image forming apparatus that make it possible to recognize that an image has been subjected to high-quality image processing.

In recent years, an image recorded on a film is photoelectrically read, the read image is converted into a digital signal, and then subjected to various image processing to obtain image data for recording. By recording light modulated in accordance with the image data, Digital photo printers that expose photosensitive materials and output them as prints have been put into practical use.
In a digital photo printer, an image photographed on a film is photoelectrically read, and the image is processed as digital image data to perform image processing or exposure of a photosensitive material. Therefore, a print can be created not only from an image shot on a film but also from an image (image data) shot by a digital camera or the like.

As described above, since the digital photo printer handles images as digital image data, image processing (image correction and adjustment) can be performed by processing the image data.
Therefore, compared to conventional analog exposure printers (printers that expose photosensitive materials (printing paper) with the projection light of the film), the color / density correction, gradation correction, saturation correction, and sharpness are much more flexible. Image processing such as processing, dodging processing (adding a dodging effect by adjusting the image dynamic range while maintaining intermediate gradation), for example, overexposure, underexposure, backlight scene, high contrast scene, etc. Even if it exists, it is possible to stably reproduce high-quality images.

  Furthermore, for digital photo printers, red-eye correction (correction of red-eye phenomenon caused by flash photography), peripheral light reduction correction (correction of density unevenness due to peripheral light reduction of the taking lens), aberration correction (distortion due to aberration of the taking lens) ) And scratch removal processing (correction of defective pixels due to scratches on the film or taking lens, attached dust, etc.), printers with analog exposure require very advanced technology from the operator, or are extremely difficult or practical. Image processing that is impossible in particular can be performed by processing image data.

By performing the color / density correction, gradation correction, saturation correction, sharpness processing, and dodging processing, a sufficiently high quality image can be obtained in terms of photographic image quality. That is, a print as a product can be finished by performing only these image processes.
On the other hand, red-eye correction, peripheral light reduction correction, aberration correction, scratch-removal processing, and the like are processes for correcting image defects, which are different from so-called photographic image quality.
Here, each image processing such as color / density correction can set image processing conditions and the like by analyzing low-resolution image data such as so-called pre-scan data and thinned images, and the amount of calculation. Therefore, the processing can be performed in a relatively short time. On the other hand, red-eye correction and scratch removal processing require analysis with high-resolution image data corresponding to the output, and also require a complicated and large amount of computation. In addition, aberration correction and peripheral dimming correction also require information corresponding to the taking lens, and require a complicated and large amount of computation.

  In other words, red-eye correction and peripheral light reduction correction can be said to be high-quality image processing compared to normal image processing that corrects color, density, gradation, etc. to finish a proper image. By performing these processes, the advantages of digital exposure can be fully exerted, and high-quality prints corrected for so-called image-like defects can be output. It takes time and requires an advanced system.

However, customers (photographers who create photo prints) appreciate the finished prints, and even if high-quality image processing such as red-eye correction is performed, the customer usually performs these high-quality image processing. There is no knowledge of what has been done or its effect.
Therefore, even if processing time is taken and high-quality processing is performed using an advanced image processing system, and a higher quality image than a general lab system or processing system is finished, it is appealed to the customer. It is very difficult to get an evaluation.

  As a method for solving such a problem, Patent Document 1 discloses that an image is selected from one item ordered by a customer, and this image is digitally enhanced (qualitative improvement / enhancement). A printing method is disclosed that outputs a print that reproduces an image that has been reproduced and a print that reproduces an image that has not been enhanced.

JP 2003-205660 A

According to this method, it is possible to have a customer recognize and evaluate that a print in which a high-quality image is reproduced by image processing is output.
However, with this printing method, the effects of high-quality processing such as red-eye correction, flaw removal processing, peripheral light reduction correction, and aberration correction cannot be clearly and sufficiently shown.

  An object of the present invention is to solve the above-described problems of the prior art, and to high-quality images that are taken on a photographic film or taken with a digital camera or the like, such as red-eye correction, which requires time and effort. When image processing is performed and the image is output, the customer who ordered the image can be surely appealed and recognized that the image has been output by performing high-quality image processing, and efficiency It is an object of the present invention to provide an image forming method capable of outputting images well and an image forming apparatus for performing the image forming method.

  In order to achieve the above object, the image forming method of the present invention includes first image processing that is image processing for completing an image for one entire image including a plurality of optically photographed images. The second image processing, which is image processing for correcting image defects, is performed to output an image, and the one or more target images selected from the one case are An image forming method is also provided in which an image subjected to only the image processing is also output.

In the image forming method of the present invention, the first image processing is image enlargement or reduction, gradation correction, color / density correction, saturation correction, sharpness processing, and dodging processing. preferable. The second image processing is preferably image processing that analyzes information related to an image and corrects the image defect only when it is detected that the image image defect is detected as a result. In addition, the information related to the image is preferably at least one of an image and shooting information, and the second image processing includes red-eye correction, image defect correction, and aberration caused by the shooting lens. It is preferable that the correction is at least one of correction for peripheral light reduction caused by the photographing lens.
Further, the selection of the target image is performed according to an input instruction, or according to an analysis result of information about the image, or according to a selected one of the input instruction and the analysis result of information about the image. Is preferred.

In the image forming method of the present invention, at least a target image in the one image is subjected to the first image processing, and then the first image processing is performed separately from the second image processing. It is preferable that an image subjected only to image processing is stored in a predetermined storage unit, and the target image is read from the storage unit and output in accordance with the progress of the second image processing in the one case, or At least the target image in one image stores an unprocessed image in a predetermined storage unit separately from the execution of the first image processing and the second image processing, and the first image in the one image is stored. As the image processing and the second image processing proceed, it is preferable that the target image is read from the storage unit and output after being subjected to the first image processing.
Furthermore, when the selection of the target image is performed according to an input instruction, it is preferable to store only the target image in the storage unit, and the selection of the target image is an analysis result of information related to the image. When all the images other than the image that has been found not to be the target of the second image processing from the analysis result of the information related to the image in the one image are obtained. It is preferable to store in the storage means or to store all one image in the storage means.

  The image forming apparatus according to the present invention includes a first unit that acquires an image for each item including a plurality of optically photographed images, and image processing for completing the acquired image. Image processing and processing means for performing second image processing, which is image processing for correcting image defects, and selection means for selecting one or more images as target images from the one case, For the target image, the processing means generates an image subjected to both the first image processing and the second image processing and an image subjected to only the first image processing, and outputs both images. An image forming apparatus is provided.

In the image forming apparatus of the present invention, the first image processing is image enlargement or reduction, gradation correction, color / density correction, saturation correction, sharpness processing, and dodging processing, The image processing is preferably at least one of red-eye correction, image defect correction, aberration correction caused by the photographing lens, and peripheral light reduction correction caused by the photographing lens.
In addition, as the image selection unit, a first selection unit that selects the target image according to an input instruction from the outside, and a second selection unit that selects the target image by analyzing information about the image. In the case of having at least one and having the first selection means and the second selection means, the operation by the first selection means and the operation by the second selection means can be selected as modes. Preferably there is.

  In the image forming apparatus of the present invention, the image subjected to the first image processing by the processing unit is stored in a predetermined storage unit, and the target image subjected to the first image processing is read from the storage unit. It is preferable to output the image, or it is preferable to store an unprocessed image in a predetermined storage unit, read the target image from the storage unit, perform the first image processing by the processing unit, and output it.

  Further, in the image forming method and the image forming apparatus of the present invention, a hard copy obtained by reproducing the image subjected to the first image processing and the second image processing, and an image subjected to only the first image processing. It is preferable to reproduce and output an image on the same recording medium by the same image recording method, and in this case, the recording medium is preferably photographic paper.

By having the above-described configuration, the present invention is caused by red-eye correction, correction of image (pixel) defect due to dust and film or lens scratches attached to the film or lens, and aberration of the lens that captured the image. When image output is performed with high-quality image processing that takes time and effort, such as correction of image distortion and correction of decrease in peripheral density due to peripheral light reduction of the lens that took the image, print creation and image file The customer who has requested the creation can recognize that the image has been output by performing such high-quality image processing.
Therefore, by using the present invention, high quality processing and work such as red-eye correction are surely appealed to and recognized by the customer, and high added value and high quality processing of the image (product) are achieved. Differentiation from images that are not performed, differentiation from other stores in a lab store, maintenance of prices for other stores, acquisition and securing of customers, and the like can be achieved.

  Hereinafter, an image forming method and an image forming apparatus of the present invention will be described in detail based on preferred embodiments shown in the accompanying drawings.

FIG. 1 is a flowchart showing an example of an image forming method according to the present invention.
FIG. 1 shows an example of a processing flow when the image forming method of the present invention is carried out with the above-described digital photo printer.

  The digital photo printer includes an input device 10 that acquires an image (image data) and outputs the image (image data), and an output device 12 that outputs a print reproducing the output image. It is what is done. The input device 10 is an example of an image forming apparatus of the present invention.

As an example, the input device 10 photoelectrically reads an image photographed on a photographic film by a scanner to obtain an image (image data), and / or an imaging device such as a digital camera or a mobile phone with a photographing function, SmartMedia ^TM and PC card ^TM like storage medium that stores an image captured by the imaging device, various kinds of communication network or the like of a personal computer or a print order receiving terminal or the like is connected, an image captured by the imaging device ( Image data).
The input device 10 that has acquired the image displays the verification image (finished simulation image) on the display for verification, and after the verification is completed, it performs necessary image processing (basic processing and high-quality processing described later). The image is output to the output device 12 as an output image (image data). Note that the verification may not be performed, and the input device 10 does not necessarily have a verification function.

  That is, even if the input device 10 has a function corresponding only to image formation from photographic film, it corresponds only to image formation obtained by acquiring an image (that is, image data) taken by a digital camera or the like. Even if it has a function, it may have both functions. The digital photo printer may be configured by connecting a plurality of input devices 10 and one or more output devices 12.

The output device 12 that has received the output image from the input device 10, for example, pulls out the photographic paper (photosensitive material) wound in a roll shape, cuts it according to the print size, and then transports the photographic paper, The recording light (for example, laser light) modulated according to the image supplied from the input device 10 is two-dimensionally scanned and exposed to form a latent image, and the exposed photographic paper is subjected to a predetermined wet process. , Dried, output as (finished) photo prints, sorted by item.
Alternatively, the input device 10 changes the output image to the output device 12 or, in addition to outputting the image to the output device, collects the output images one by one and records them in a storage medium, And / or output to an external device via a communication network or the like.

  The present invention provides a promotion image (reference image) for prosecuting the effect of high-quality processing from among one image in the output of one image for performing image processing (basic processing and high-quality processing) as described above. One or a plurality of images (frames) to be promoted are selected as promotion target images, and the selected promotion target images are subjected to high-quality processing in addition to output images (product images) subjected to basic processing and high-quality processing. A promotion image which is not subjected to basic processing but only basic processing is formed, and an image including this is also output.

The basic processing (first image processing) is a basic processing performed to output an image having an appropriate color / density (tone reproduction, color reproduction), image structure (sharpness, graininess), and the like. Image processing. By performing this basic processing, the image is completed in terms of photographic image quality, and becomes a completed image corresponding to image output such as normal print output without high-quality processing. In the illustrated example, as an example, enlargement or reduction of the image (electronic scaling process), gradation correction, color / density correction, saturation correction, sharpness processing, and dodging processing (maintaining the intermediate gradation of the image) , Compression or expansion of the image density dynamic range).
On the other hand, high-quality processing (second image processing) is image processing for correcting only an image having a defect in order to correct an image defect. More preferably, it is image processing for correcting only an image detected to have a defect as a result of analyzing information on the image. Specifically, red-eye correction (red-eye correction) caused by flash photography, foreign matter adhering to photographic film or taking lens, and image (pixel) defect caused by photographic film or taking lens scratches (dust removal) Processing), correction of image distortion caused by aberration of the photographing lens (lens aberration correction), and correction of peripheral density decrease caused by peripheral light reduction of the photographing lens (peripheral light reduction correction).

In the present invention, information relating to an image refers to the image (image data) itself and imaging information of the image.
The shooting information specifically refers to the presence or absence of flash emission at the time of shooting, the information of the camera (lens) that shot the image, the information of the photographic film that shot the image, the information of the aperture at the time of shooting, the shutter speed, etc. Information etc. are illustrated. Shooting information may be acquired from magnetic information recorded on a film if the image is formed from an APS film, for example, and acquired from information recorded in an image file if the image is captured by a digital camera or the like. do it.

Hereinafter, an example of image formation according to the present invention shown in FIG. 1 will be described using a case where red-eye correction is performed as high-quality processing as an example.
Further, in the following description, for convenience, an image that has undergone both basic processing and high-quality processing (including a case in which only analysis of information about the image is performed and no correction is performed) An image that has been processed only is set as an unprocessed image, and a print obtained by reproducing a promotion image created from the unprocessed image is set as a promotion print.

The example shown in FIG. 1A is an example in which the operator selects a promotion target image to be a pro-junction image (manual selection of the promotion target image).
When the input device 10 acquires one image (image data) as described above (or during the acquisition of one image), the input device 10 displays the verification image on the display and causes the operator to execute the verification. . The test image is subjected to image processing according to basic processing. In addition, the image processing conditions of the basic process are set by analyzing the original image of the test image as an example, and when color / density adjustment is performed by the test, the image processing of the basic process is performed accordingly. Conditions are also changed.
In the illustrated example, the test screen also serves as a selection screen for the promotion target image, and uses a known means such as GUI (Graphical User Interface) (the same applies to other selections to be performed below). An image is indicated. In response to this, the input device 10 selects the instructed image as the promotion target image. The selection (input instruction) of the promotion target image may be one frame or a plurality of frames. Further, the operator may select the promotion target image using, for example, an automatic selection criterion described later.

  In the case where the promotion target image is not selected in one process, the formation of the promotion image (output of a promotion print described later) is not performed in this case. When the test is not performed, an image (preferably an image similar to the test image) is displayed for selection of the promotion target image.

In the illustrated example, the test image may be displayed in the same manner as a normal digital photo printer. In other words, when an image is acquired by reading a film with a scanner, it is performed with an image (pre-scan data) obtained by pre-scanning, which is performed prior to fine scanning, which is image reading for output, and with a digital camera or the like. In the case of a photographed image, the acquired image may be thinned (or reduced).
Further, when the film is read by the scanner, the fine scan may be performed after the completion of the test, or may be performed continuously following the pre-scan.

  When the promotion target image is selected, the input device 10 then displays a template selection screen for selecting a template to be a promotion print form (form) and prompts selection of the template. The template may be selected immediately after the promotion target image is determined or after one test is completed.

On the template selection screen, for example, the template type may be displayed as a figure and / or characters and selected using a GUI or the like. Further, the template selection result is supplied to a proportional process described later.
In the illustrated example, a template for reproducing only a promotion image on one print shown in FIG. 2A (referred to as type A), and a processed image and processing on one print shown in FIG. 2B. A template for reproducing a promotion image smaller than the finished image (type B), and a template for reproducing the processed image and the promotion image of the same size on one print shown in FIG. 2) and a template for reproducing a processed image and a promotional image smaller than the processed image (referred to as type D) shown in FIG. 2D are prepared and selectable. .

In the illustrated example, the above four types of templates are prepared. However, the present invention is not limited to this, and the number of templates may be five or more, or three or less. Furthermore, the arrangement and size of each image are also arbitrary.
In the illustrated example, as a preferred embodiment, a plurality of types of templates are available for selection. However, the present invention is not limited to this, and only one type of promotional print template may be used. . Further, a template dedicated to high-quality processing to be performed may be provided, such as a red-eye correction template.

After the promotion print template is selected, the basic processing is sequentially performed on the image of each frame. This image is an image corresponding to the output, and is a fine scan image (fine scan data) if a print is made from photographic film, and a captured image (photographed image data) if the image is from a digital camera or the like. is there.
In the illustrated example, as described above, enlargement or reduction of an image, gradation correction, color / density correction, saturation correction, sharpness processing, and dodging processing are performed as basic processing.
Any of these image processing may be performed by a known method.

Next, red-eye correction (high quality processing) is sequentially performed on the image subjected to the basic processing. In addition, the image selected as the promotion target image sends the unprocessed image (the image subjected to only the basic processing) to the storage means and stores it in parallel with the red-eye correction.
At this point, if the shooting information can be acquired and if it is found from the analysis result of the shooting information that the image is not a stroboscopic shot, the image does not have red eyes (hereinafter referred to as a non-red-eye image). At this point, the red-eye correction is finished, and the processed image is subjected to basic processing and red-eye correction (high-quality processing) without performing image correction.

There are no particular limitations on the red-eye correction method, and various known methods can be used. The following method is illustrated as a suitable example.
In this red-eye correction, first, a red-eye candidate (a region that may be red-eye) is detected from an image for which basic processing has been completed, and position information (center coordinate position information), region information, and number of red-eye candidates are detected. Get information and more.
Therefore, the image in which the red-eye candidate is not detected by the detection of the red-eye candidate is regarded as a non-red-eye image, and the red-eye correction is completed at this point, and the basic process and the red-eye correction are performed without correcting the image The finished image.

  As an example, if a person is photographed in a scene having three red lamps in the background as shown in FIG. 3 and an image (scene) in which a red-eye phenomenon occurs in this person, a, b, And c, and regions indicated by d and e corresponding to red eyes are detected as red eye candidates.

There are no particular limitations on the method for detecting a red-eye candidate, and various known methods can be used.
As an example, using a red-eye color information (red-eye is red) and shape information (red-eye is round), a circular region having a red hue and a predetermined number of pixels or more is extracted, and a large number of red-eye images are obtained in advance. Use the red eye degree (how much red-eye color) and circularity (how round it is) set from the sample, and the area where the red eye degree and circularity exceed the threshold values as red eye candidates that may be red eyes The method of detecting is illustrated.

Next, using the detection result of the red eye candidate (for example, the position information), face detection is performed in a peripheral region including the detected red eye candidate.
For example, in the example illustrated in FIG. 3, face detection is sequentially performed in a predetermined region including each red-eye candidate corresponding to each of the red-eye candidates a, b, c, d, and e. Therefore, for example, a region surrounded by a dotted line is detected as the face region, and information that the red-eye candidates d and e are red-eye candidates included in the face region, or information on the detected face region is obtained.

The face detection method is not particularly limited, and various known methods can be used.
As a preferred example, a method of performing face detection by template matching using an average face image so-called face template (hereinafter referred to as a face template) created in advance from a large number of face image samples is performed.
In this method, as an example, a face template (or target image) is displayed on the top and bottom as shown in FIG. 4A according to the orientation of the camera at the time of shooting such as vertical position (vertical shooting) / horizontal position (horizontal shooting). Then, the image is rotated in the horizontal direction (rotated as 0 ° → 90 ° → 180 ° → 270 ° on the image plane) to change the face direction, and according to the size (resolution) of the face in the image, FIG. ), The face size of the face template (same as above) is changed (enlargement / reduction = resolution conversion), a face template of a combination of various face orientations and face sizes, a face candidate area in the image, The face detection is performed by sequentially performing matching (confirmation of matching).
Instead of rotating and enlarging / reducing the face template, a rotated face template or an enlarged / reduced face template may be created in advance, and matching may be performed using the template. Further, the face candidate area may be detected by means such as skin color extraction or contour extraction.

Note that the method for detecting wrinkles is not limited to this template matching method.
For example, face detection using a learning method is also preferably exemplified. In this method, a large number of facial images and non-facial images are prepared, the respective feature amounts are extracted, and a face or non-face is separated from the result using an appropriately selected learning method. Perform prior learning to calculate functions and thresholds. When performing face detection, the feature amount is extracted from the target image in the same manner as in the pre-learning, and it is determined whether it is a face or a non-face using the function and threshold obtained in the pre-learning, It is also preferable to detect wrinkles by a learning method that performs face detection.
Furthermore, face detection by shape recognition by edge (contour) extraction and edge direction extraction disclosed in JP-A-8-184925 and JP-A-9-138471, face by color extraction such as skin color extraction or black extraction Various methods exemplified as face detection methods other than matching using face templates in Patent Documents 1 to 3 described above can also be used.

In this way, using the detection result of the red-eye candidate and the information of the red-eye candidate whose face has been detected, the red-eye candidate whose face can be detected around is identified as a red-eye.
Therefore, after performing eyelid detection, images for which eyelids cannot be detected around all red eye candidates are regarded as non-red eye images, and red eye correction is terminated at this point, and basic processing and red eye are not performed without image correction. It is assumed that the processed image has been corrected.

When the red eye is specified in this manner, the specified red eye region is subjected to image processing, red eye correction is performed, and a processed image having undergone basic processing and red eye correction is obtained.
There are no particular limitations on the red-eye correction method, and various known methods can be used. For example, processing to correct red-eye by controlling the saturation, brightness, hue, etc. of the red-eye area according to the image features such as red-eye and the surroundings of the red-eye (may include the periphery of the face), or simply the color of the red-eye area The correction process etc. which convert black into black are illustrated.

In this way, the red-eye candidate detection is performed first, then the face detection is performed only around the detected red-eye candidate, and the red-eye candidate whose face can be detected in the vicinity is identified as the red-eye, thereby reducing the time for red-eye detection. It can be greatly shortened.
That is, as described above, red-eye detection including face detection is a time-consuming process, but in conventional red-eye detection, after face detection, red-eye detection is performed within the detected face area. Therefore, face detection is performed even in a region where no red eye exists, and as a result, it takes a very long time to detect the face. On the other hand, after detecting a red eye candidate in this way, by performing face detection only in a predetermined region including the red eye candidate, there is no useless face detection in a region where no red eye exists, and in red eye detection, The time required for face detection can be greatly reduced.

The red-eye correction method (red-eye correction algorithm) is not limited to this method, and a normal red-eye correction method in which red-eye detection is performed after eyelid detection is performed can be used. All correction methods are available.
Further, the same red-eye correction method is performed in all the apparatuses, and the red-eye correction method may be executed in one or more apparatuses or in all apparatuses.

  As described above, in the image formation shown in FIG. 1A, the input device 10 sequentially performs red-eye correction on an image (frame) subjected to basic processing to obtain a processed image, and an image to be reproduced on a product print. As (the image data), it is output to the output machine 12 at a predetermined timing.

As described above, the image selected as the promotion target image stores an unprocessed image in the storage unit. This unprocessed image is read from the storage means at a predetermined timing, and is supplied to a promotion process for creating an image of a promotion print as an unprocessed image to be a promotion image. Further, information on the selected promotion print template is also supplied to the promotion process.
In the promotion process, a promotion print image obtained by reproducing the promotion image is formed according to the selected template, and is output to the output device 12 at a predetermined timing. Here, the promotion process is slightly different depending on the selected template.

When type A is selected as the template for the promotion print, an unprocessed image of the promotion target image is read from the storage means at an appropriate timing in accordance with the progress of red eye correction for each image in this one case. The unprocessed image is supplied to the promotion process.
Here, when creating a promotion print with a template of type A, an unprocessed image of the promotion target image is formed as a promotion image so that it is reproduced as it is, and the processed image of the product print is A print in which a promotion image (unprocessed image) is reproduced in the same manner may be used as the promotion print. However, preferably, the unprocessed image is reduced to provide a margin portion on the print as a promotion image, or the unprocessed image is used as it is as a promotion image, and the print size is made larger than the product print to leave the margin portion on the print. In addition to the promotion image, it is preferable to create a promotion print image so that a comment that allows the customer to recognize that red-eye correction has been made is added to the margin.

The content of the comment is not particularly limited. As an example, a comment that red-eye correction has been performed on this image, information on other frames (images) that have undergone red-eye correction, an appeal of the effect of red-eye correction (high-quality processing), and advertisements for stores such as lab stores Examples include digital photo printers and manufacturer advertisements, photography advice, discount tickets, camera advertisements, sightseeing / excursion information, and comments that combine these.
Further, it is preferable to set a plurality of comment contents in advance so that they can be selected, and it is also preferable to be able to set them arbitrarily. Furthermore, it is preferable that the comment entry position, font, character size, color, and the like can be arbitrarily selected and set.

On the other hand, when any of type B, type C, and type D is selected as the template for the promotion print, the processed image of the image selected as the promotion target image will be Apart from the output to the output machine 12, it is also supplied to the promotion process.
In addition, the unprocessed image of the promotion target image stored in the storage unit is also read from the storage unit at a predetermined timing (for example, when the red-eye correction of the corresponding image is completed) and becomes the promotion image. As supplied to the promotion process.
If any of type B to type D is selected as a template, the promotion process is performed when the processed and unprocessed images of the promotion target image are supplied to the promotion process, and an image of the promotion print is created. Is done.

In this case, first, the size of the promotion image and processed image to be inserted into the promotion print is determined according to the selected template, and the unprocessed image and processed image of the promotion target image are determined according to the determined size. Resize (size adjustment) to form a promotional image and a processed image that fit into the template. The resizing method is not particularly limited, and a known method such as thinning or electronic scaling may be used. Alternatively, instead of reducing, the image may be cut out according to the size of each image of the template with the red-eye corrected region as the center.
Next, the promotional image and the processed image obtained by resizing are inserted into a predetermined position of the selected template to form a promotional print image. Here, even when a promotion print is created using a template of type B to D, the image of the promotion print is formed so that the same comment as before is put in the blank portion other than the image area. preferable.

Further, in the promotion print, in addition to such a promotion image or further processed image and comment, as shown in FIG. 2 (E), only the uncorrected and / or corrected red-eye portion is cut out and enlarged. An image or the like may be recorded. Note that this enlarged view may be recorded in a blank portion, a part of the enlarged view may be recorded on the image, or all may be recorded on the image.
Further, the promotion print is preferable because the customer can surely recognize the presence of the promotion print by making the print size larger than the product print (or by reducing the print size conversely).

  In the above example, as a preferred mode, after red-eye correction (high-quality processing) is performed, images (processed images and promotion images) are images (resized) having a size corresponding to the template. However, the present invention is not limited to this, and in this aspect in which a promotion image is selected in advance, the image is resized for promotion printing, and then basic processing and red-eye correction are performed for promotion printing. Also good.

As described above, the processed image that has undergone red-eye correction (high quality processing) is supplied from the input device 10 to the output device 12 at a predetermined timing as an image (product image) to be reproduced on a product print. Further, a promotion print image is also supplied from the input device 10 to the output device 12 at a predetermined timing.
The output device 12 supplied with the processed image and the promotion print image from the input device 10 pulls out the photographic paper wound in a roll shape, for example, and cuts it according to the print size. , In a predetermined direction (sub-scanning direction), exposing the photographic paper with recording light modulated according to the image supplied from the input device 10 to form a latent image, then developing and drying, Product prints and promotional prints that reproduce only processed images are sorted and output one by one. Note that when the size of the promotion print is changed from the product print, the output machine changes the size of the photographic paper for reproducing the image (for example, changing the length cut out from the roll).

  In addition, the input device 10 changes the processed image and the promotion print image to the output device 12, or in addition to the output of the processed image and the promotion print image to the output device 12, the processed image In addition, the images of the promotion prints are collected for each case, recorded on a storage medium, and / or output to an external device via a communication network or the like.

There is no particular limitation on the output position of the promotion print in one print output (image output). For example, a method of outputting a promotion print at the beginning or end of one case is exemplified. However, in order to promote the red-eye correction (high-quality processing) to the customer and to recognize the red-eye correction effect more reliably, and to make the promotion print effect more suitable, It is preferable to output a promotion print immediately before or after.
Such setting of the output position of the product print and the promotion print may be performed by holding the image with the input device 10 and supplying the image of each print to the output device 14 in a predetermined order. Alternatively, the order of the images may be rearranged in the output device 14 and the prints may be output in a predetermined order.

As is clear from the above description, according to the present invention, in image formation in which high-quality processing such as red-eye correction, dust scratch extinction, lens aberration correction, and peripheral light reduction correction is performed, one image from a film or a recording medium is used. An image selected from one related image, such as an order order, and a processed image that has been subjected to high-quality processing, and a promotional image that has not been subjected to high-quality processing but has undergone basic processing and has been completed as an image Therefore, it is possible to surely appeal and recognize the implementation of high-quality processing, which takes time and effort, and the effects of the request to the customer who is requested to create the print. In addition, an image that has undergone only basic processing or an original image (to be described later) is stored in a predetermined storage means, and is read from here to form a promotion print image. It is possible to create a promotion print with good and simple processing.
Therefore, according to the present invention, high added value such as printing, differentiation from images not subjected to high quality processing, differentiation from other stores in lab stores, etc., price maintenance for other stores, acquisition and securing of customers Etc.

In the example shown in FIG. 1A, the promotion target image is selected by an input instruction by an operator or the like. However, the present invention is not limited to this, and the promotion target image is selected by an image (image data). Alternatively, the apparatus may automatically perform this by analyzing the shooting information (automatic selection of promotion target images).
Hereinafter, this image formation will be described with reference to FIG.

  In this example, the acquisition of one image is performed in the same manner as in the previous example, except that the operator does not select the promotion target image (manual selection of the promotion target image) at the time of verification. A template for display / certification and promotion print is selected, and further, basic processing is sequentially performed on each image (frame).

After selecting the template, the input device 10 sequentially performs basic processing on each image, and then performs red-eye correction (high quality processing) to obtain a processed image. In addition to the red-eye correction, unprocessed images that have undergone only basic processing are sequentially sent to and stored in the storage means.
It should be noted that, at this point in time, an image that is found not to be a flash photography from the photographing information may be a processed image without performing red-eye correction, as in the previous example. In addition, an unprocessed image that is not a flash image may not be stored in the storage unit. If the shooting information cannot be acquired, and if it is not possible to determine whether or not the flash shooting is based on the shooting information, red eye correction is performed on all the basic processed images, and the unprocessed image is stored in the storage unit. .
That is, in this example, all the unprocessed images of one case, or all of the unprocessed images that can be determined to be strobe shooting from the shooting information, are stored in the storage unit.

Red-eye correction is performed as before.
That is, first, an image that was found not to be a flash photography from the shooting information is a non-red-eye image. At this point, the red-eye correction is completed and the basic process and the red-eye correction are performed without performing the correction. The finished image. For the other images, first, the red eye candidate is detected, then the eyelid is detected around the redeye candidate, the redeye candidate in which the eyelid is detected in the vicinity is determined as the red eye, the correction is performed, the basic processing and The processed image is subjected to red-eye correction. In addition, images for which red-eye candidates could not be detected and images for which wrinkles could not be detected in the vicinity of red-eye candidates are not red-eye images. The processed image is processed and red-eye corrected.

When the red-eye correction is completed, an optimum image as a promotion image is determined for each image, and a promotion target image is selected.
The optimal image for the promotion image is determined using the above-described red-eye detection result. For example, the size of the red eye (the size of the eyelid), whether the red eye exists near the center of the image (the main part of the image), the red eye Reliability (color and saturation), whether or not a specific person with red eyes has been photographed in one image (whether or not a red-eye person is an important person), reliability of red-eye detection (red-eye candidate detection, 顏One or a plurality of factors are comprehensively determined from various factors such as the height of a determination value in detection and the like, and an image that is considered to have a great appeal effect of red-eye correction is determined and selected as a promotion target image. That is, the processed image and the unprocessed image are compared, and one image or a plurality of images that can clearly know that the red-eye correction has been performed are selected as the promotion target image.

In the illustrated example, at the time when the red-eye correction is completed, the suitability as a promotion image is evaluated according to a predetermined discrimination criterion using the detection result of the red-eye in the red-eye correction sequentially for each image. When the evaluation is completed, the image with the highest evaluation (one frame) is selected as the promotion-handling image. Or you may select the predetermined number of images with high evaluation as a promotion object image.
As an example, assuming that it has a red eye that is 2 mm or more on the promotion print, in an image that satisfies the essential condition, the suitability as a promotion image is determined by the distance from the center of the largest red eye image (center of the screen). evaluate. That is, an image having a red eye of 2 mm or more and the largest-sized red eye in the image is closest to the center of the image is determined as the optimum image and selected as the promotion target image.

When the promotion target image is selected in this way, the selection result is sent to the storage means.
The storage means receives this selection result, selects a corresponding image from the stored unprocessed images, and sends it to the promotion process as an unprocessed image of the promotion target image. Further, the storage unit erases the image of other candidate images as necessary.
In addition, when types B to D are selected as the template for the promotion print, the processed image of the image selected as the template promotion target image is also sent to the promotion process. Therefore, in this aspect, it is necessary to store the processed images of all images in the input device 10 until the promotion target image is determined. After determining the promotion target image, each processed image is The product image to be reproduced on the product print is supplied to the output device 12 at a predetermined timing.

The automatic selection method of the promotion target images is not limited to this, and a method of selecting a predetermined number of optimum images by comparing each image individually is also suitable.
That is, when the basic processing of the first frame image is completed, the unprocessed image is stored in the storage unit, the red-eye correction is performed on the image, and the red-eye detection result is similarly used as the promotion image. The evaluation result is sent to the storage means. When the basic processing of the second frame image is completed, similarly, the unprocessed image is stored in the storage means, red-eye correction is performed, evaluation is performed, and the result is sent to the storage means. The storage means compares the evaluations of the images in the first frame and the second frame, leaves only the unprocessed image with higher evaluation, and deletes the other. Further, the third frame image is similarly stored in the storage unit, red-eye corrected, and evaluated, and sent to the storage unit. The storage unit evaluates the stored image and the third frame image. In comparison, only the unprocessed image with high evaluation is left as a candidate image, and thereafter, the fourth frame, the fifth frame,... Are processed in the same manner, and all the one image is processed. The image of the unprocessed image remaining in the storage means is selected as the promotion target image.

Also in this example, the unprocessed image last remaining in the storage means is sent to the promotion process as an unprocessed image of the promotion handling image to be reproduced on the promotion print.
In addition, when the template of type BD is selected, the processed image of the image selected as a promotion object image is also sent to a promotion process. Therefore, at this time, in the input device 10, it is necessary to store the processed image corresponding to the unprocessed image remaining in the storage unit even after the determination of the optimum image.
The processed image that has been subjected to red-eye correction and optimum image discrimination is supplied to the output device 12 at a predetermined timing as a (product) image to be reproduced on a product print.

  Here, in the aspect of automatically selecting the promotion target image, for example, in the case of the above example, there is no essential requirement (minimum standard) in determining the optimal image of the promotion image, such as when there is no red-eye image of 2 mm or more on the promotion print. If there is no image satisfying (), the effect of the promotion print cannot be sufficiently obtained. Therefore, it is preferable not to create the promotion print.

In the present invention, the automatic selection of the promotion target image is not limited to a configuration in which an optimal image is determined and selected.
For example, a predetermined number of images (frames) in which red eyes are first detected may be selected as promotion target images. Or, similarly, for each image, evaluation as a promotion target image was performed at the time when red-eye correction was completed, and an image whose evaluation exceeded a threshold value set as appropriate was selected as a promotion target image, and a predetermined number could be selected. At some point, the selection may end.
Further, for selection of a promotion image, some discrimination criteria may be prepared and selectable, and / or discrimination criteria may be arbitrarily set.

  In this way, after the promotion target image is automatically selected and the unprocessed image of the promotion target image or further processed image is supplied to the promotion process, the input device 10 is the same as the example of the manual selection described below. Promotion processing is performed to create a promotion print image. At a predetermined timing, the processed image subjected to basic processing and red-eye correction and the promotion print image are sent to the output machine 12, and the output machine 12 is processed. Create product prints and promotional prints that reproduce the images, and sort them one by one. Or similarly to the above, the input device 10 collects images one by one and records the images on a storage medium, outputs them to the outside through a communication network, and the like.

In the above example, the promotion target image is selected by manual selection (input instruction from the operator) or automatic selection (selection based on analysis of images and photographing information).
The present invention is not limited to this. For example, in a digital photo printer or the like that implements the present invention, as an operation mode, a mode for selecting a promotion target image by manual selection (manual mode) and a promotion target image by automatic selection It is preferable that manual selection and automatic selection can be selected, for example, by setting a mode (automatic mode) for selecting and enabling selection.

Automatic selection saves operator trouble and improves productivity, and even when a technically inexperienced operator operates the device, it selects the appropriate promotion image and makes a suitable promotion print. Can be created stably.
On the other hand, in the manual selection, the effect of red-eye correction can be actually realized to the maximum, but an image that is not selected in the automatic selection can be selected as a promotion target image. For example, images of babies and infants with red eyes are images that customers find very unpleasant, and therefore promoting red-eye correction on these images can greatly enhance the effects of red-eye correction. Can appeal strongly. However, if there are many images that have a higher evaluation criterion than the image in which such a baby has red eyes, this image is not selected as a promotion target image. However, by performing manual selection, automatic selection is not performed, but it is possible to select an image with such a high appeal effect as a promotion target image, and it is possible to create a more effective promotional print.

  Accordingly, by making it possible to switch between manual selection and automatic selection of the promotion target image by, for example, a method of providing the automatic mode and the manual mode as described above, the operability and productivity can be improved and the processing / operation versatility can be improved. And ensuring higher quality processing, the promotion print creation effect as described above can be further improved.

In the above example, red-eye correction is performed as high-quality processing (second image processing). As described above, in the present invention, various images other than red-eye correction are used as high-quality processing. Image processing that corrects a general defect can be used. Preferably, various image processing that corrects only an image in which a defect is detected as a result of analysis of information on the image can be used. As described above, scratch removal processing, lens aberration correction, peripheral light reduction correction, and the like are preferably exemplified.
Similar to the red-eye correction, each of these high-quality processes may be performed by a known method.

As an example of the flaw-removal processing method, a line segment that satisfies the condition is detected by edge detection, which is disclosed in Japanese Patent Laid-Open No. 2000-74846, and a defective portion caused by dust or scratches is detected using this line segment. , And a method of correcting a defect part by continuity with surrounding pixels or complementation using image data of a surrounding area, or a smoothing image and an original image disclosed in Japanese Patent Laid-Open No. 2000-92319 Examples include a method of detecting a defect candidate area caused by dust or scratches from the size of the difference, detecting a defect part from the feature of the candidate area such as a change in shape or color, and correcting the defect part as before. Is done.
In addition, when forming an image from an image taken on a photographic film, in addition to normal image reading of R (red), G (green), and B (blue), IR light (infrared light) is used. Using the IR light reading result and detecting the position of dust and scratches on the film using the IR light reading and scattering, the defect portion is detected as before. A method of correcting the error can also be suitably used.

In the case of performing scratch removal as a high-quality process, when automatically selecting a promotion target image as shown in FIG. 1B, the dust or scratch length, thickness is detected using the dust or scratch detection result. And one or more such as whether or not dust or scratches are on main subjects such as wrinkles, whether or not the position of dust or scratches is close to the center of the image (main part of the image), etc. Therefore, it is only necessary to select one image or a plurality of images considered to have a great appeal effect of the scratch-removal process.
Further, when the position of dust or scratches using IR light is detected as a scratch extinguishing method, an image that does not have an IR light image is stored as an image that is not subject to high-quality processing. In addition, the image may be handled as an image subjected to high-quality processing.

  On the other hand, as a lens aberration correction method and a peripheral light attenuation correction method, for example, disclosed in Japanese Patent Application Laid-Open No. 11-225270, a camera type in which the lens characteristics of a camera are known and stored in advance and an image is taken ( A method of knowing the lens type) and performing lens aberration correction and / or peripheral dimming correction using corresponding lens characteristics is exemplified. If the lens type is image formation from an APS film, magnetic information is also read at the time of reading with a scanner, and this information is analyzed. On the other hand, image formation from an image taken with a digital camera or the like is possible. If there is, it may be detected by analyzing various information recorded in the image file.

When performing lens aberration correction and peripheral dimming correction as high-quality processing, when automatically selecting a promotion target image as shown in FIG. 1B, the magnitude of aberration and dimming, aberration and dimming One image or a plurality of images that are considered to have a great appeal effect of lens aberration correction and peripheral light reduction correction may be selected by comprehensively judging the degree of conspicuousness. The magnitude of the aberration, dimming, and the degree of conspicuousness may be determined, for example, by detecting the change in aberration or dimming in a concentric circle that gradually increases around the center of the screen.
Further, when performing lens aberration correction and peripheral light reduction correction as high-quality processing, for an image for which lens type discrimination and lens characteristics could not be acquired, the image is stored as an image that is not subject to high-quality processing. In addition, the image may be handled as an image subjected to high-quality processing.

In the present invention, the high-quality processing performed on the image is not limited to any one of red-eye correction, dust scratch cancellation processing, lens aberration correction, and peripheral light reduction correction, and two or more of these processings are performed. Of course, you may do this.
Furthermore, the high-quality processing to be performed may be appropriately selectable depending on a method for making a selection means, setting a work mode, or the like.

Further, depending on the combination of high-quality processing to be performed and a plurality of high-quality processing, it may be preferable to perform high-quality processing (or a part thereof) prior to basic processing.
In such a case, as schematically shown in FIG. 5 (shown in the example of automatically selecting a promotion target image), after selecting a promotion print template, basic processing and high quality for obtaining a processed image In addition to performing the processing on the image, in parallel, the unprocessed original image is stored in the storage unit without performing the basic processing, and the image selected as the promotion target image is read out from the storage unit for the corresponding original image. What is necessary is just to perform a basic process and to perform a promotion process after that and to make it a promotion image.

The present invention is not limited to image formation using a photographic print using photographic paper as shown in the illustrated example, but is a printer using a printing, thermal recording medium, a printer using a photosensitive thermal recording medium, and a printer using a photosensitive medium. Also, it may correspond to image formation (print (hard copy) creation) with an inkjet printer, an electrophotographic printer, or the like.
Here, the product print and the promotion print may be different in the recording medium and the image recording method (drawing method), but the effect of the high-quality processing by comparing the product print and the promotion print, the texture of the promotion print, etc. In this respect, it is preferable to create a promotion print using the same recording medium and image recording method as the product print. In particular, when creating a photographic print, outputting the promotional print as a photographic print in which a promotional image is recorded on photographic paper is preferable in terms of the promotional print texture, customer satisfaction, the appeal of high-quality processing, and the like.
Also, if possible depending on the image forming method, the image is not formed on only one side of the print (hard copy), but a product image (processed image) is provided on the surface as, for example, a promotion print or a product print. The print may be output and the promotion image reproduced on the back side.

In the present invention, when a promotion print is output, the promotion print image or the product print image is displayed on a display or the like, thereby confirming the appeal effect of the promotion print and the effect of high quality processing. This is more preferable.
It is also preferable that the same service can be provided by an unmanned photographing device installed at a store, a print creation device installed at a store, a photo print order receiving machine installed at a store.

  Although the image forming method and the image forming apparatus of the present invention have been described in detail above, the present invention is not limited to the above-described embodiments, and various improvements and modifications can be made without departing from the gist of the present invention. Of course it is good.

(A) And (B) is a flowchart which shows the concept of an example of the image forming method of this invention. (A)-(E) is a conceptual diagram which shows an example of the template of the image formed with the image forming method of this invention. It is a conceptual diagram for demonstrating an example of the red eye correction method in this invention. (A) And (B) is a conceptual diagram for demonstrating an example of the red-eye correction method in this invention. It is a flowchart which shows the concept of another example of the image forming method of this invention.

Explanation of symbols

10 Input machine 12 Output machine

Claims (11)

First image processing that is image processing for completing an image and second processing that is image processing for correcting a defect in the image, for one entire image including a plurality of optically photographed images. Image processing, output the image,
An image forming method characterized in that, for one or more target images selected from the one case, an image subjected to only the first image processing is also output.   The image forming method according to claim 1, wherein the first image processing is image enlargement or reduction, gradation correction, color / density correction, saturation correction, sharpness processing, and dodging processing.   The second image processing is image processing for analyzing information related to an image and correcting the image defect only when it is detected that the image image defect is detected as a result. The image forming method described in 1.   The image forming method according to claim 3, wherein the information related to the image is at least one of an image and shooting information.   The second image processing is at least one of red-eye correction, image defect correction, aberration correction caused by the photographing lens, and peripheral light reduction correction caused by the photographing lens. The image forming method described in 1.   The selection of the target image is performed according to an input instruction, is performed according to an analysis result of information about an image, or is performed according to a selected one of an input instruction and an analysis result of information about an image. The image forming method according to any one of?   A hard copy that reproduces an image that has undergone the first image processing and the second image process, and a hard copy that reproduces an image that has undergone only the first image processing are the same on the same type of recording medium. The image forming method according to claim 1, wherein an image is reproduced and output by an image recording method.   The image forming method according to claim 7, wherein the recording medium is photographic paper. Means for acquiring an image for each case consisting of a plurality of optically photographed images;
Processing means for subjecting the acquired image to first image processing that is image processing for completing the image and second image processing that is image processing for correcting a defect in the image;
Selecting means for selecting one or more images as target images from the one case,
For the target image, the processing means generates an image subjected to both the first image processing and the second image processing and an image subjected to only the first image processing, and outputs both images. An image forming apparatus.   The first image processing is image enlargement or reduction, gradation correction, color / density correction, saturation correction, sharpness processing, and dodging processing, and the second image processing is red-eye correction, image loss The image forming apparatus according to claim 9, wherein the image forming apparatus includes at least one of correction of a portion, aberration correction caused by a photographing lens, and peripheral light reduction correction caused by a photographing lens. As the image selection means, at least one of a first selection means for selecting the target image in response to an input instruction from the outside, and a second selection means for selecting the target image by analyzing information about the image Have
In addition, when the first selection unit and the second selection unit are provided, the operation by the first selection unit and the operation by the second selection unit can be selected as modes. The image forming apparatus described in 1.

Images