JP2006092153A - Image processing system and image processing method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To prevent the deterioration of processing capability or the deterioration of picture quality due to the reduplication of image processing in a system in which a plurality of devices having image processing functions are connected. <P>SOLUTION: Image processing in each of connected devices is set according to an image processing function installed in each device. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to an image processing system and an image processing method capable of speeding up image processing and optimizing image processing in an image processing system in which a plurality of devices having a function of performing image processing on image data are connected.

In recent years, an image recorded on a film is photoelectrically read, the read image is converted into a digital signal, and then subjected to various image processing to obtain image data for recording. By recording light modulated in accordance with the image data, Digital photo printers that expose photosensitive materials and output them as prints have been put into practical use.
In a digital photo printer, an image photographed on a film is photoelectrically read, and the image is processed as digital image data to perform image processing or exposure of a photosensitive material. Therefore, a print can be created not only from an image shot on a film but also from an image (image data) shot by a digital camera or the like.

In addition, with the spread of inexpensive color printers such as personal computers (PCs), digital cameras, and inkjet printers in recent years, some users capture images taken with digital cameras, perform image processing, and output them with printers. Many.
Furthermore, in recent years, (such as MO) magneto-optical recording medium that stores an image taken by a digital camera (such as a smart media ^TM and CompactFlash ^TM) small semiconductor storage medium (such as a flexible disk) a magnetic recording medium, an optical disk (CD Printers that read image data directly from a storage medium such as a CD-R, etc., perform predetermined image processing, and output a print (hard copy) have been put into practical use.

Thus, in recent years, image-related devices have been diversified, and instead of performing all the processing with one device, a system is formed by combining a plurality of devices.
For example, in the case of a digital photo printer, an input device (scanner / image processor) that reads an image on a film and performs predetermined image processing to obtain image data for recording, receives image data from the input device, and receives this image data. In addition to an output machine (printer / paper processor) that prints photographic paper (photosensitive material) with recording light modulated according to the data, and develops the exposed photosensitive material to produce (photo) prints. A reception device that reads with a digital camera or various recording media to create a print from an image (image data) taken with a camera or the like, and inputs an instruction such as the number of prints or print size, and image data from the reception device Digital image controller (hereinafter referred to as DI) A to) the printing system is constructed.

Here, in such a system, it is natural that the input device has a function of performing image processing on the image data in order to finish an image with high quality. The DIC may also have an image processing function.
In addition, in order to output a high-quality image, there is a printer that performs optimal image processing corresponding to itself on image data supplied for print output. Furthermore, a digital camera that captures an image (image data) to be supplied to the accepting machine also has a function of performing various image processing on the captured image data so that a high-quality image can be obtained during image display or print output. There are models that have
As described above, in a system in which a plurality of apparatuses having image processing functions are combined (connected), image processing is performed on a single image data by a plurality of apparatuses. In some cases, the overall processing capability may decrease.

For example, in an image including a person such as a portrait, the most important factor that affects the image quality is the finish of the person. Therefore, the red-eye phenomenon in which a person's eyes (pupil) become red due to the influence of strobe light emission at the time of photographing becomes a serious problem.
In a conventional photo printer that directly exposes from film, red-eye correction is very difficult. However, red (eye) correction can be performed by image analysis and image processing for (digital) image data.

  Red-eye correction by image processing usually detects faces in the image by analyzing the image data, and then detects red eyes in the image by detecting eyes, red circles, etc. from the detected faces. This is done by adjusting the hue and saturation of the detected red eye (that region).

  Various methods are known for wrinkle detection used for red-eye detection. For example, in Patent Document 1, a candidate area estimated to correspond to a person's face is detected from an image, the candidate area is divided into a predetermined number of small areas, and the frequency of change in density and luminance for each small area. And a feature amount related to the size is obtained, and the feature amount is collated with a pattern representing the relationship between the feature amounts of the small regions when the region corresponding to the face of the person created in advance is divided into the predetermined number. Thus, a method for improving the accuracy of face detection by evaluating the angle of the face candidate region is disclosed.

  Further, in Patent Document 2, a candidate area estimated to correspond to a human face is detected from an image, and when the density of the face candidate area is within a predetermined range, the body is estimated as a body based on the face candidate area. And based on the presence or absence of a region where the density difference between the set body region and the face candidate region is a predetermined value or less, or based on the density and saturation contrast of the face candidate region and the body candidate region, A method for improving the accuracy of face detection by evaluating the accuracy of detection results of face candidate regions is disclosed.

  Further, in Patent Document 3, a candidate area estimated to correspond to a human face is detected from an image, and among the detected candidate areas, a degree of overlap is determined for a candidate area that overlaps with another candidate area in the image. Thus, a method for improving the accuracy of face detection by evaluating that the region having a higher degree of overlap is more likely to be a face region is disclosed.

JP 2000-137788 A JP 2000-148980 A JP 2000-149018 A

Such face detection or further detection of red eye from the detected eyelid requires accuracy and requires various analyses. For this reason, these processes usually need to be performed with high-resolution image data used for print output or the like (so-called fine scan data for image data obtained by reading a film, or photographed image data for a digital camera). Yes, the amount of calculation is large and processing takes time. Further, as is apparent from the above patent documents, wrinkle detection is a complicated and time-consuming process.
That is, red-eye correction is a time-consuming process among various image processes.

As described above, red eyes are a serious problem for obtaining high-quality images in portraits and the like. Accordingly, when a device having a red-eye correction function is requested to have a high-quality image, the device performs a red-eye correction process on the supplied image.
Therefore, in the above-described printing system, for example, when the DIC and the input device have a red-eye correction function, when outputting a print of an image taken with a digital camera, processing is performed on one image. As a result, the red-eye correction which takes a long time is multiplied twice, and the processing capacity (throughput) of the system is greatly reduced.

  An object of the present invention is to solve the above-mentioned problems of the prior art, and is a system in which a plurality of devices having an image processing function are connected to prevent unnecessary double-folding of the same image processing. Accordingly, it is an object of the present invention to provide an image processing system and an image processing method capable of preventing a decrease in processing capability and obtaining an optimum image according to an output destination of an image (image data).

  In order to achieve the above object, an image processing system according to the present invention is an image processing system in which a plurality of devices having an image processing function are connected, and image processing in each device is performed according to the image processing function of the connected device. An image processing system characterized in that is set.

Also, the image processing method of the present invention sets and supplies image processing in each apparatus according to the image processing function of the connected apparatus in an image processing system in which a plurality of apparatuses having image processing functions are connected. An image processing method is provided in which each device performs image processing on an image according to the setting.

In such an image processing system and image processing method of the present invention, the apparatus has instruction means for instructing image processing to be performed by itself, and setting of the image processing is performed using the instruction means. Preferably, when the apparatus adds information on the image processing performed by itself to the image data and acquires the image data, the apparatus sets the image processing on itself using the image processing information. It is preferred to do so. The apparatus preferably determines the image processing performed by the upstream apparatus using the image processing information, and sets the image processing so that the image processing already performed by the upstream apparatus is not performed. Alternatively, the image processing information includes information on an image processing method, and the apparatus determines the image processing and the image processing method performed by an upstream apparatus using the image processing information. Even in the case of image processing that has already been performed in this apparatus, if the image processing method in itself is different, it is preferable to set the image processing so that the image processing is performed by this different image processing method.
Furthermore, it is preferable that the image processing is red-eye correction.

  In the image processing system in which a plurality of apparatuses having an image processing function are connected, the present invention can prevent unnecessary double application of the same image processing in red-eye correction or the like. When the system can perform higher-precision processing, and undesired image processing is performed on the upstream (upstream in the image data transfer direction) for the image (image data) output destination In addition, the image can be suitably modified to obtain an optimum image according to the output destination.

  Hereinafter, an image processing system and an image processing method according to the present invention will be described in detail based on preferred embodiments shown in the accompanying drawings.

FIG. 1 is a block diagram showing the concept of an example of an image processing system of the present invention that implements the image processing method of the present invention.
An image processing system 10 shown in FIG. 1 (hereinafter referred to as system 10) reproduces a visible image by performing image processing on an image photographed by a DSC (digital camera) or an image photographed on a (photo) film. It outputs prints (hard copy) and records image data on a recording medium.
The system 10 includes a receiving device 12, a digital image controller 14 (hereinafter referred to as DIC 14), an input device 16, a multi-printer controller 18 (hereinafter referred to as MPC 18), and a printer 20 (20a and 20b). Configured.

The accepting device 12 is a device that accepts an order such as print creation from (digital) image data, and stores an image capturing device such as a DSC or a mobile phone with an image capturing function, and image data captured by these image capturing devices. The image (image data) is read from the medium, and order information such as the number of prints of each image (each frame), print size, finish instruction information, various special processes, etc. is received, and these are associated with each other in the DIC 14. It is a device to supply.
The order information is input and received by a known method using a GUI (Graphical User Interface), a keyboard, a mouse, a touch panel, or the like.

In the illustrated example, the accepting machine 12 does not have an image processing function. However, in the present invention, the accepting machine 12 also has a function of performing various image processes as necessary. You may have. The image processing and the image processing method to be performed are the same as those of the DIC 14 and the input device 16 described later.
Further, when an imaging apparatus such as a DSC has an image processing function, this imaging apparatus is also an apparatus constituting the system 10 of the present invention.

The DIC 14 is a device having a function of performing various image processing on acquired image data in addition to an image reading from a recording medium and an order information input function similar to the receiving machine 12. The DIC 14 performs necessary image processing on the image data supplied from the receiving device 12 or the image data read from the recording medium, and supplies the processed image data to the input device 16 or the MPC 18.
Further, when creating a storage medium storing an image (image data) photographed on a film, the DIC 14 receives image data of the image photographed on the film from the input device 16, and an image necessary for this image data. Process and record on storage medium.
The image processing performed by the DIC 14 is not particularly limited. For example, negative / positive conversion, image enlargement / reduction (electronic scaling processing), gradation correction, color / density correction, saturation correction, sharpness processing, color space, and the like. Various image processing such as conversion processing, red-eye correction, photographic lens aberration correction, and peripheral dimming correction can be performed. Moreover, these image processes may be performed by a known method.

The input device 16 photoelectrically reads an image taken on a (photo) film, performs various image processing on the obtained image data to obtain an appropriate image, and further, an image suitable for image recording in the printer 20. It is a so-called scanner / image processor that sends data to the MPC 18.
The film reading method in the input device 16 is not particularly limited. For example, a known method such as a method in which reading light is incident on the film and the projection light of the film is read by an image sensor such as a CCD sensor may be used. . Similarly to the DIC 14, the image processing performed by the input device 16 is not particularly limited. For example, negative / positive conversion, image enlargement / reduction (electronic scaling processing), gradation correction, color / density correction , Saturation correction, sharpness processing, dodge processing (image (density) dynamic range compression / expansion), color space conversion processing, red-eye correction, dust / scratch-off processing, photographic lens aberration correction, peripheral light reduction correction, etc. Various image processes can be performed, and these image processes may be performed by a known method.

  Further, in the system 10, when recording image data of an image photographed on a film on a storage medium, the input device 16 supplies the DIC 14 with image data read from the film and subjected to necessary image processing.

The MPC 18 is connected to the system 10 as a preferable mode, and receives the image data from the DIC 14 and / or the input device 16 and is most convenient for outputting a print (in the illustrated example, the printer 20a or the printer 20b). ) To supply image data. Note that the DIC 14 and the input device 16 connected to the MPC 18 are not limited to one, and a plurality of DICs 14 and / or input devices 16 may be connected. That is, the MPC 18 is connected to the image data input side. And n: m connection with the print output side.
When image data is supplied simultaneously from both the DIC 14 and the input device 16, the image data is stored as necessary, the output order of each image data is determined, and the image data is supplied to an optimal printer. That is, the MPC 18 functions as a spool device in the system 10, and by having the MPC 18, the DIC 14, the input device 16, and the printer 20 can be operated asynchronously regardless of the state of each other. The processing efficiency as the system 10 can be improved.

  The MPC 18 also has an image processing function. The image processing and the image processing method to be performed are the same as those of the DIC 14 and the input device 16.

Both printers 20 (20a and 20b) are known digital photographic printers. That is, the printer 20 two-dimensionally exposes photographic paper (photosensitive material) with recording light modulated according to the supplied image data to form a latent image, and develops / fixes / applies to the exposed photographic paper. A predetermined wet development process of bleaching / washing is performed and dried to obtain a (finished photograph) print.
In the system 20, the printer 20 is not limited to such a photographic printer, and various printers such as an ink jet printer and an electrophotographic printer can be used. Different types of printers such as a photographic printer and an inkjet printer, a photographic printer, an inkjet printer, and an electrophotographic printer may be connected.

In the system 10, when creating a print from image data taken by a DSC or the like, basically, order information such as a print size is input to the accepting machine 12, and the accepting machine 12 reads the image data to be printed. The image data is sent to the DIC 14 in association with the order information. The DIC 14 performs image processing necessary for the image data and sends it to the MPC 18. The MPC 18 selects the printer 20 (20a or 20b) and sends it to the selected printer 20. 20 creates and outputs a print (hard copy) according to the order information. Alternatively, the image data and the order information may be supplied to the DIC 14 or may be supplied from the DIC 14 to the MPC 18 via the input device 16.
On the other hand, when printing an image taken on a film, order information is input to the receiving device 16, and the receiving device 16 photoelectrically reads an image printed on the film and is necessary for the obtained image data. Processing is performed and sent to the MPC 18 in association with the order information. The MPC 18 selects the printer 20 and sends it to the selected printer 20, and the printer 20 creates and outputs a print in accordance with the order information. In addition, when outputting image data of an image photographed on a film, the input device 16 similarly reads the image data subjected to necessary image processing and sends it to the DIC 14 in association with the order information. The image data is recorded in the storage medium designated by the order information.

Here, in the system 10, as an example, the DIC 14, the input device 16, and the MPC 18 have a function of performing image processing on image data.
The DIC 14, the input device 16, and the MPC 18 all serve as setting means for setting image processing according to the image processing function of each device (device having an image processing function) included in the system 10. Includes instruction means for selecting / instructing image processing to be performed.
Hereinafter, red eye correction will be described in detail as an example.

  In the illustrated system 10, the DIC 14 having an image processing function, the input device 16, and the MPC 18 all have a red-eye correction function. Hereinafter, an example of red-eye correction performed by each apparatus will be described with reference to the flowchart of FIG.

In each device, in red-eye correction, first, a red-eye candidate (a region that may be red-eye) is detected from an image (input image) on which red-eye correction is performed, and red-eye candidate position information (center coordinate position information) Obtain region information, number information, etc.
As an example, as shown in FIG. 3, if a person is photographed in a scene having three red lamps in the background and a red-eye phenomenon occurs in this person (a scene), a, b, And c, and regions indicated by d and e corresponding to red eyes are detected as red eye candidates.

There are no particular limitations on the method for detecting a red-eye candidate, and various known methods can be used.
As an example, using a red-eye color information (red-eye is red) and shape information (red-eye is round), a circular region having a red hue and a predetermined number of pixels or more is extracted, and a large number of red-eye images are obtained in advance. Use the red eye degree (how much red-eye color) and circularity (how round it is) set from the sample, and the area where the red eye degree and circularity exceed the threshold values as red eye candidates that may be red eyes The method of detecting is illustrated.

Next, using the detection result of the red eye candidate (for example, the position information), face detection is performed in a peripheral region including the detected red eye candidate.
For example, in the example illustrated in FIG. 3, face detection is sequentially performed in a predetermined region including each red-eye candidate corresponding to each of the red-eye candidates a, b, c, d, and e. Therefore, for example, a region surrounded by a dotted line is detected as the face region, and information that the red-eye candidates d and e are red-eye candidates included in the face region, or information on the detected face region is obtained.

The face detection method is not particularly limited, and various known methods can be used.
As an example, in this example, a method of performing face detection by template matching using an average face image so-called face template (hereinafter referred to as a face template) created in advance from a large number of face image samples is performed.
In this method, as an example, a face template (or target image) is displayed on the top and bottom as shown in FIG. 4A according to the orientation of the camera at the time of shooting such as vertical position (vertical shooting) / horizontal position (horizontal shooting). Then, the image is rotated in the horizontal direction (rotated as 0 ° → 90 ° → 180 ° → 270 ° on the image plane) to change the face direction, and according to the size (resolution) of the face in the image, FIG. ), The face size of the face template (same as above) is changed (enlargement / reduction = resolution conversion), a face template of a combination of various face orientations and face sizes, a face candidate area in the image, The face detection is performed by sequentially performing matching (confirmation of matching).
Instead of rotating and enlarging / reducing the face template, a rotated face template or an enlarged / reduced face template may be created in advance, and matching may be performed using the template. Further, the face candidate area may be detected by means such as skin color extraction or contour extraction.

Note that the method for detecting wrinkles is not limited to this template matching method.
For example, face detection using a learning method is also preferably exemplified.
In this method, a large number of facial images and non-facial images are prepared, the respective feature amounts are extracted, and a face or non-face is separated from the result using an appropriately selected learning method. Perform prior learning to calculate functions and thresholds. When performing face detection, the feature amount is extracted from the target image in the same manner as in the pre-learning, and it is determined whether it is a face or a non-face using the function and threshold obtained in the pre-learning, It is also preferable to detect wrinkles by a learning method that performs face detection.
Furthermore, face detection by shape recognition by edge (contour) extraction and edge direction extraction disclosed in JP-A-8-184925 and JP-A-9-138471, face by color extraction such as skin color extraction or black extraction Various methods exemplified as face detection methods other than matching using face templates in Patent Documents 1 to 3 described above can also be used.

In this way, using the detection result of the red-eye candidate and the information of the red-eye candidate whose face has been detected, the red-eye candidate whose face can be detected around is identified as red-eye (red-eye specification).
In this way, the red-eye candidate detection is performed first, then the face detection is performed only around the detected red-eye candidate, and the red-eye candidate whose face can be detected in the vicinity is identified as the red-eye, thereby reducing the time for red-eye detection. It can be greatly shortened.
That is, as described above, red-eye detection including face detection is a time-consuming process, but in conventional red-eye detection, after face detection, red-eye detection is performed within the detected face area. Therefore, face detection is performed even in a region where no red eye exists, and as a result, it takes a very long time to detect the face. On the other hand, after detecting a red eye candidate in this way, by performing face detection only in a predetermined region including the red eye candidate, there is no useless face detection in a region where no red eye exists, and in red eye detection, The time required for face detection can be greatly reduced.

When the red eye is specified in this way, the specified red eye region is subjected to image processing, the red eye of the input image is corrected, and a red eye corrected image is obtained.
There are no particular limitations on the red-eye correction method, and various known methods can be used. For example, processing to correct red-eye by controlling the saturation, brightness, hue, etc. of the red-eye area according to the image features such as red-eye and the surroundings of the red-eye (may include the periphery of the face), or simply the color of the red-eye area The correction process etc. which convert black into black are illustrated.

Note that the red-eye correction method (red-eye correction algorithm) is not limited to this method, and a normal red-eye correction method in which red-eye detection is performed after eyelid detection is performed can be used. All correction methods are available.
Further, the same red-eye correction method is performed in all the apparatuses, and the red-eye correction method may be executed in one or more apparatuses or in all apparatuses.

As described above, in the illustrated system 10, the DIC 14, the input device 16, and the MPC 18 have a red-eye correction function and instruction means for selecting / setting the image processing performed by itself.
In the system 10, according to the red-eye correction function (image processing function) included in the DIC 14, the input device 16, and the MPC 18, for example, the DIC 14 and the input device 16 do not perform red-eye correction, and only the MPC 18 is used. Set the image processing to perform red-eye correction. Thereby, the capability fall of the system 10 can be prevented.

Once the red-eye correction is performed and red-eye in the image is corrected, the red-eye is not detected even after the red-eye correction is performed, and the image quality cannot be further improved.
Therefore, if the system 10 performs the time-consuming red-eye correction on all the devices having the red-eye correction function (that is, if the red-eye correction is applied twice), the time-consuming red-eye correction (especially red-eye detection) is wasted. As a result, the processing capability of the system 10 is reduced. For example, in the case where image data is transferred as receiving machine 12 → DIC 14 → input machine 16 → MPC 18 → printer 20a, red-eye correction is performed at three locations of DIC 14, input machine 16 and MPC 18, and downstream of DIC 14. Red-eye correction at the input device 16 and MPC 18 is a waste of time.

On the other hand, in the system 10, when the DIC 14, the input device 16, and the MPC 18 have a red-eye correction function, the DIC 14 and the input device are corrected using only the MPC 18 through which all image data passes using the instruction unit. 16 is set not to perform image processing. Alternatively, if the system 10 is set to supply image data directly from the DIC 14 to the MPC 18, the red eye correction is performed only by the DIC 14 and the input device 16, and the red eye correction is not performed by the MPC 18. May be. As a result, unnecessary red-eye correction, i.e., double multiplication, can be prevented to prevent a reduction in system processing capability.
That is, according to the present invention, in a system in which a plurality of devices having an image processing function are connected (combined), for example, at the time of setting the system, each device is implemented according to the image processing function that each device has. By setting the image processing to be performed, it is possible to prevent the degradation of the processing capability of the system due to the double processing of the image processing and the like, and to maximize the capability of the image processing system.

In the system 10, the instruction means for setting the image processing to be performed is not particularly limited, and various known means can be used.
Examples include a method of providing a switch for setting execution / non-execution of individual image processing such as red-eye correction, and various methods performed by a computer using a GUI (Graphical User Interface). Is done.

  In addition, instead of such instruction means, when setting up a system by connecting devices, information about the image processing function that the device itself has, such as transmitting information from upstream to downstream, is transmitted. In addition, image processing having an implementation function in the upstream apparatus may not be performed in the downstream apparatus.

In the above example, an apparatus having an image processing function constituting the system 10 has an instruction unit for setting image processing to be performed, and sets image processing for each apparatus.
However, the present invention is not limited to this, and information (hereinafter referred to as image processing information) relating to the performed image processing (which image processing has been performed) is added to the image data. It is also possible to prevent the image processing from being performed twice by setting the image processing in each device so that the image processing performed in the upstream device is not performed. According to this aspect, image processing can be set for each image regardless of the device configuration.
Hereinafter, similarly, a case where the DIC 14, the input device 16, and the MPC 18 have a red-eye correction function will be described as an example.

When creating a print from image data photographed by a DSC or the like, the image data photographed by the DSC or the like is read by the accepting machine 12 and supplied to the DIC 14 as described above, and the DIC 14 corrects the red eye. Necessary image processing including
Here, the DIC 14 records the information indicating that the red-eye correction has been performed as image processing information, added to the image data. Note that the image processing information is an area that can be arbitrarily used by the user according to the image file format (image file format) of the image data (for example, if it is Exif, a tag that can be arbitrarily used by the user such as a user comment tag). ).

The DIC 14 supplies the processed image data to the MPC 18 as described above.
The MPC 18 reads image processing information added to the image data. As described above, image processing information indicating that the red-eye correction processing has been performed is added to the image data. Based on this image processing information, the MPC 18 knows that red-eye correction has already been performed in the upstream device for this image data, sets the non-execution of red-eye correction, and does not perform red-eye correction itself. Image data is output to the selected printer 20.
On the contrary, if it is found from the image processing information added to the image data that the red-eye correction is not performed in the upstream apparatus, the MPC 18 sets the execution of the red-eye correction as the image processing, performs the red-eye correction, Image data is output to the selected printer 20.

On the other hand, when creating a print from an image photographed on film, as described above, the input device 16 reads the film, performs necessary image processing including red-eye correction, and converts the red-eye corrected image data into image data. In addition, information indicating that red-eye correction has been performed is recorded as image processing information and supplied to the MPC 18.
The subsequent processing is the same as the previous example, and the MPC 18 knows from the image processing information added to the image data that the red-eye correction has already been performed on the image data by the upstream device. The non-execution of the correction is set, and the image data is output to the selected printer 20 without performing the red-eye correction. Conversely, if it is found from the image processing information that red-eye correction has not been performed in the upstream apparatus, execution of red-eye correction is set, red-eye correction is performed, and image data is output to the selected printer 20. .

In the above example, the information of the image processing performed is added as the image processing information to prevent the image processing from being doubled. This is caused by red eye correction processing, dust or scratches attached to the film, etc. In the case of correcting an image by detecting a defect in the image, such as correction of a defective portion (dust defect correction), it is preferable from the viewpoint of preventing a reduction in processing capacity of the system.
In addition, the present invention is not limited to the image processing for the defective portion of the image as described above, and sharpness processing, gradation correction, color / density correction, saturation correction, and image aberration caused by the aberration of the lens that captured the image. The present invention can also be used for various image processing such as distortion correction (aberration correction of the taking lens) and image density correction (peripheral dimming correction) due to peripheral dimming of the lens that has taken the image. Depending on the image processing (the type), if it is multiplied twice, the image processing effect may be overemphasized (or conversely, the image processing effect may be weakened), or the previously performed image processing may be adversely affected (or Conversely, if the image quality deteriorates and is severe, the image may fail. On the other hand, according to the above aspect of the present invention, it is possible to prevent the image quality from being deteriorated due to such double image processing.

In the above example, in an image processing system in which a plurality of devices having image processing functions are connected, image processing is prevented from being repeated twice. On the other hand, in the following example, in a similar image processing system, in an apparatus that has performed image processing, as image processing information to be added to image data, in addition to information on the performed image processing, image processing of the performed image processing is performed. The method information is also added, and the apparatus supplied with the image data learns the upstream image processing using the image processing information, and if the upstream image processing method is different from itself, the image processing must be performed. Set the image processing so that the image is corrected or the image processing is applied again if the upstream image processing or the upstream image processing is not optimal for the output. Can be output.
Hereinafter, similarly, a case where the DIC 14, the input device 16, and the MPC 18 have a red-eye correction function will be described as an example.

For example, in the system 10, it is assumed that the DIC 14, the input device 16, and the MPC 18 perform red-eye correction using different methods (red-eye correction algorithm).
As an example, the red-eye correction in each apparatus has the same method for detecting red-eye candidates, but the method for detecting wrinkles around the red-eye candidates after that is different. Specifically, the DIC 14 performs wrinkle detection (hereinafter referred to as wrinkle detection a) only with skin color detection, and the input device 16 further detects wrinkle detection (hereinafter referred to as “red eye candidate”) by detecting a color near the red eye candidate. Further, the MPC 18 performs wrinkle detection (hereinafter referred to as wrinkle detection c) by the above-described pattern matching (hull structure detection).
In addition, since the periphery of red eyes is usually not a skin color, after detecting the skin color, a color near the candidate for red eye is further detected, and if the periphery of the red eye is a skin color, it is not a red eye (possibility of earring etc. (High), it is possible to perform wrinkle detection, that is, red-eye correction with higher accuracy than wrinkle detection based only on skin color detection.

When creating a print from image data photographed by a DSC or the like, as described above, the accepting machine 12 reads the image data photographed by the DSC or the like and supplies the DIC 14 to the DIC 14. Necessary image processing including correction is performed.
Here, the DIC 14 adds, as image processing information, information indicating that red-eye correction has been performed by red-eye candidate detection and wrinkle detection a to the image data that has undergone red-eye correction. Note that the image processing information may be recorded as in the previous example.

The DIC 14 supplies the processed image data to the MPC 18 as described above.
The MPC 18 reads image processing information added to the image data. In this image data, information indicating that red-eye correction has been performed by the method using the wrinkle effect a is recorded as image processing information. Thereby, the MPC 18 knows the red-eye correction method applied to the image data. As described above, the MPC 18 is a device that implements the red-eye correction method based on the eyelid detection c, and the red-eye correction methods that are performed by the two are different. Correction is performed and image data is output to the selected printer 20.
On the contrary, if it is found from the added image processing information that the red-eye correction is performed on the image data in the same way as the red-eye correction method performed by the upstream apparatus itself, the MPC 18 Non-execution of red-eye correction is set, and image data is output to the selected printer 20 without performing red-eye correction.

On the other hand, when creating a print from an image photographed on film, the input device 16 reads the film, performs the necessary image processing including red-eye processing, and applies red-eye correction to the image data. Information indicating that red-eye correction has been performed by the method using eyelid detection b is added as image processing information and supplied to MPC 18.
The subsequent processing is the same as the previous example, and the MPC 18 performs red-eye correction on the image data in the upstream apparatus based on the added image processing information. This is the red-eye correction using the eyelid detection b. The method is found to be different from the red-eye correction method using wrinkle detection c performed by itself. In response to this, the MPC 18 sets execution of red-eye correction, performs red-eye correction by wrinkle detection c, and outputs image data to the selected printer 20.
On the contrary, if it is found from the added image processing information that the red-eye correction is performed on the image data in the same way as the red-eye correction method performed by the upstream apparatus itself, the MPC 18 Non-execution of red-eye correction is set, and image data is output to the selected printer 20 without performing red-eye correction.

  In the above example, even when the image processing information indicating that the red-eye correction is performed is not added to the image data, the MPC 18 sets the execution of the red-eye correction and performs the red-eye correction.

In a system in which a plurality of devices having image processing functions are connected, each device does not necessarily perform image processing by the same method, and may use different image processing methods (image processing algorithms). . Also, if the image processing method is different, the processing result may be different depending on the state of the image. For example, the accuracy of red-eye correction may not be 100%, and depending on the red-eye state and the red-eye detection method, red-eye that cannot be detected by a certain method may be detected by another method.
On the other hand, in a system in which a plurality of devices having an image processing function are connected, as in this aspect, image processing method information is added to image data in addition to image processing information, for example, red-eye correction. However, if the red-eye correction method (image processing method) is different, it can be reliably detected without overlooking the red-eye by forcing it twice and more accurate red-eye correction can be performed as a whole system. It becomes possible to do. That is, it is possible to complement the weaknesses of the image processing method implemented in each device and perform more accurate image processing as a system.
This aspect is particularly suitable for image processing in which an improper part is detected from an image and correction is performed, such as red-eye correction and dust scratch correction.

  As described above, the image processing performed in the present invention is not limited to red-eye correction, and various types of image processing can be used. In addition to the information on the image processing performed as image processing information, the image processing method includes: This mode of recording information can also be used for various types of image processing.

  As an example, in an apparatus that has performed image processing, in addition to image processing information, information about what image processing has been performed optimally is added to the image data as image processing information, and the apparatus supplied with the image data is: In accordance with this image processing information, the image processing performed by itself may be set.

For example, when the image data of the film read by the input device 16 is sent to the DIC 14 and recorded on a recording medium by the DIC 14, the input device 16 performs image processing (tone correction, Color / density correction, saturation correction, etc.). Here, the image data stored in the storage medium is often used for display display (output as a soft copy), and therefore suitable gradation, color / density, and saturation are different from the print.
In such a case, the input device 16 adds to the image data information indicating that the optimum image processing has been performed for print output together with information on the image processing performed, and supplies the image data to the DIC 14. In the DIC 14, using this image processing information, the image processing performed on the image data in the upstream apparatus is the image processing optimum for print output, that is, this image is the image optimum for print output. Knowing and setting the image processing to be performed by itself so as to obtain an optimal image for display display, the image processing is performed on the image data.
At this time, the DIC 14 may process the image data so as to be an image before correction by the input device 16 and then perform image processing so as to be optimal for display display, or perform image analysis or the like. Image processing may be performed so as to correct the image so as to be optimal for display display.

  Similarly, in a system in which a plurality of printers 20 are connected as in the illustrated example, image processing information is added to the printer that has performed the optimal image processing on the apparatus that has performed image processing, and image data is supplied. The apparatus may know upstream image processing from the image processing information and set image processing according to the output destination printer.

  In addition to the information on the image processing performed in each device, the image processing intensity, the type of information such as the LUT (lookup table), matrix, filter, etc. used for the image processing are added to the image data as image processing information. In addition, using these pieces of information, image processing to be performed in a downstream apparatus may be set.

  As an example, when the device performs sharpness processing (sharpness correction), in addition to information indicating that sharpness processing has been performed, information on the strength of sharpness processing is added as image processing information, and image data is supplied. In the above apparatus, a method of setting the sharpness processing performed by itself using this image processing information is exemplified.

The sharpness process is usually performed in response to print output, and the preferred strength varies depending on the printer model and the like.
Therefore, in the apparatus that has performed image processing, information indicating that sharpness processing has been performed and the strength of sharpness processing are added as image processing information, and the apparatus to which the image data is supplied is Knowing that the sharpness processing has been performed in the upstream apparatus and the strength thereof, and the strength of the sharpness processing is too low for the output destination printer 20 (or if sharpness processing has not been performed). The image processing is set so as to increase the sharpness again by performing the sharpness processing so as to be optimal for the output destination printer 20. Alternatively, if the apparatus supplied with image data similarly knows the strength of sharpness processing performed upstream, and the sharpness processing strength is too high for the output destination printer 20, the output destination printer The image processing is set so as to reduce the sharpness again by performing the sharpness processing so as to be optimal. Similarly, the apparatus supplied with the image data knows the strength of the sharpness processing performed upstream, and performs the sharpness processing when the strength of the sharpness processing is optimal for the output destination printer 20. Set the image processing so that there is no.

  Although the image processing system and the image processing method of the present invention have been described in detail above, the present invention is not limited to the above-described embodiments, and various improvements and modifications can be made without departing from the gist of the present invention. Of course it is good.

For example, in red-eye correction, if it is found from image processing information that red-eye correction (other image processing) that is less accurate than the method performed by the user is performed upstream, the user sets red-eye correction. On the other hand, if it is found upstream that red-eye correction is performed with higher accuracy than the method performed by itself, the user may set non-execution of red-eye correction.
If there is a device through which image data always passes (MPC 18 if the system 10 only performs print output, or all printers connected to the system), the other devices perform image processing. Instead, the image processing of each device may be set so that all image processing is performed by a device through which the image data always passes.

1 is a block diagram conceptually showing an example of an image processing system of the present invention. It is a block diagram for demonstrating an example of the red eye correction method in the image processing system shown in FIG. It is a conceptual diagram for demonstrating an example of the red eye correction method in the image processing system shown in FIG. (A) And (B) is a conceptual diagram for demonstrating an example of the red-eye correction method in the image processing system shown in FIG.

Explanation of symbols

10 (Image processing) system 12 Reception machine 14 DIC
16 Input machine 18 MPC
20 Printer

Claims (7)

In an image processing system in which a plurality of devices having an image processing function are connected,
An image processing system that sets image processing in each device in accordance with an image processing function of a connected device.   The image processing system according to claim 1, wherein the apparatus includes instruction means for instructing image processing to be performed by itself, and setting of the image processing is performed using the instruction means.   2. The apparatus according to claim 1, wherein when the image processing apparatus adds the information of the image processing performed by itself to the image data and acquires the image data, the image processing is set by itself using the information of the image processing. The image processing system described.   4. The apparatus according to claim 3, wherein the apparatus determines image processing performed by an upstream apparatus using the image processing information, and sets the image processing so that image processing already performed by the upstream apparatus is not performed. Image processing system.   The image processing information includes image processing method information, and the apparatus determines the image processing and the image processing method performed by the upstream apparatus using the image processing information. 4. The image processing system according to claim 3, wherein even if the image processing is already performed, if the image processing method in itself is different, the image processing is set so that the image processing is performed by the different image processing method. .   The image processing system according to claim 1, wherein the image processing is red-eye correction. In an image processing system in which a plurality of devices having an image processing function are connected,
An image processing method in which image processing in each device is set in accordance with an image processing function of a connected device, and each device performs image processing in accordance with the setting on the supplied image .

Images