JP2006301981A - Pupil correction processing apparatus and method thereof - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a pupil correction processing apparatus and a method thereof which are capable of surely and efficiently executing color correction processing of pupil areas in a digital image wherein a red-eye phenomenon that pupils of eyes are photographed in red or the like occurs. <P>SOLUTION: The pupil correction processing apparatus includes a pupil area detection means 40 for detecting pupil areas of a subject from the digital image and a pupil area color correction means for performing color correction processing for pupil areas of the digital image detected by the pupil area detection means 40. The pupil area detection means 40 includes a reduction processing part 41 for performing reduction processing to reduce the digital image to a reduction digital image, a reduction pupil detection part 42 for detecting reduction pupil areas being pupil areas in the reduction digital image, and a pupil detection part 43 for detecting pupil areas of the digital image on the basis of the reduction pupil areas. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to a pupil correction processing apparatus and method for correcting a pupil image in a digital image in which a red-eye phenomenon or the like in which a pupil portion of a person's eyes is photographed in red is a natural color.

  In a photographic image in which a person is photographed with a stroboscope, a red-eye phenomenon, etc., in which the pupil part of the eye is photographed in red often occurs. There has been proposed a photographic processing apparatus provided with color correction processing means for detecting a human pupil region from an input photographic image and correcting the saturation of the pupil portion to correct natural colors.

  In the above photographic processing apparatus, an image read from a developed photographic film with a film scanner or taken with a digital still camera and stored in a memory card is read with a media driver, and then displayed on a monitor on a pre-judge screen. If the operator determines that the color correction of the pupil area is necessary for the thumbnail image due to the occurrence of the red-eye phenomenon, and the color correction icon for the pupil area displayed on the pre-judge screen is operated, the color correction of the pupil area is performed. The color correction processing means for is configured to be activated.

  The color correction processing means includes a reduction processing means for reducing high-resolution image data read from a film scanner or a media driver by using a predetermined reduction algorithm, and a pupil image by an operator operation on the reduced image displayed on the monitor. Area specifying means for specifying a rough eye area including the area, pupil detection means for generating a histogram of the specified area and specifying the pixels of the pupil area from the value by operation by the operator or automatic detection; and And a pupil correction unit that adjusts the saturation and the like based on the operation of the operator with respect to the pupil region. The coordinate data of the region designated by the region designation unit when print data is generated and the pupil correction unit Based on color correction parameters, etc., the corresponding area for high-resolution image data is recognized by coordinate transformation, and Pixels pupil area from the histograms generated for the area to automatically detect and is configured to automatically corrected based on the pixel in the color correction parameters.

The reason why the reduction processing means is provided to perform the correction operation on the image data after the reduction processing is to reduce the calculation load when executing various correction processes on the pre-judge screen and to perform high-speed processing. In the reduction process, for example, as shown in FIG. 11, a specific pixel Ps (i) is applied to each pixel in the digital image so that the reduced digital image is not extremely deteriorated compared with a high-resolution digital image. , J), an average value of pixel data in a predetermined number of pixel groups Pg (i, j) corresponding to the target reduction size including the pixel corresponding to the target pixel Ps (i, j) is calculated. j) Smoothing processing such as replacement as new pixel data is performed, and pixel thinning processing is performed so as to obtain a target reduced size. The thinning processing still remains. A compression process is performed in which the coordinates of the pixel Ps ′ (i, j) that has become the new pixel data are replaced with the new coordinates Ps ′ (k, l) (i = 0, 1, 2, ..., m-1, j = 0, 1, 2, ..., n-1, k = 0, 1, 2, ..., (n-1) / p, l = 0, 1, 2,..., (M−1) / q, p is a reduction factor in the y-axis direction, and q is a reduction factor in the x-axis direction.
Japanese Patent Laid-Open No. 11-308474 Japanese Patent Laid-Open No. 2000-231539

  However, since the individual pixel data in the reduced digital image described above is obtained by averaging the pixels of the original digital image, the pupil detected based on the histogram for the reduced digital image generated by the pupil detection means. There is a problem that the pupil area detected based on the histogram for the area and the original digital image is different, that is, erroneously detected.

  Similarly, since individual pixel data in the reduced digital image and individual pixel data in the digital image have different values, even if the original digital image is subjected to color correction processing based on correction parameters for the reduced digital image. In some cases, the color was not corrected properly.

  In the above-described photographic processing apparatus, it is confirmed by an operator whether or not an appropriate correction has been made for detection and correction of the pupil region with respect to the reduced digital image on the pre-judge screen. Since the correction process is automatically executed and the print process is performed without detecting the pupil area in the image and confirming the color correction, the output photo print may not be properly color-corrected. In such a case, it is necessary to perform the color correction process again from the beginning, which causes a problem that the work efficiency is lowered.

  In view of the above-described conventional problems, the present invention is a pupil correction capable of reliably and efficiently performing pupil region color correction processing in a digital image in which a red-eye phenomenon or the like occurs such that the pupil of the eye is photographed in red. The object is to provide a processing apparatus and method.

  In order to achieve the above object, a first characteristic configuration of a pupil correction processing apparatus according to the present invention is a digital image input for reading an image recorded on a recording medium as described in claim 1 of the document of the claims. A pupil region detection unit that detects a pupil region of a subject from the digital image read by the digital image input unit; and a pupil that performs color correction processing on the pupil region of the digital image detected by the pupil region detection unit A pupil correction processing device including a region color correction unit, wherein the pupil region detection unit is a reduction processing unit that reduces the digital image to a reduced digital image, and a pupil region of the reduced digital image A reduction pupil detection unit that detects a reduction pupil region and a pupil detection unit that detects a pupil region of the digital image based on the reduction pupil region.

  According to the above configuration, since the pupil area of the digital image is detected based on the reduced pupil area that is the pupil area of the reduced digital image obtained by reducing the digital image, the reduced pupil area detected in the reduced digital image is detected. Since the corresponding region in the digital image is detected as a pupil region, the pupil region in the digital image can be reliably detected without causing erroneous detection of the pupil region in the digital image.

  In the second feature configuration, as described in claim 2, in addition to the first feature configuration described above, the reduced pupil detection unit may include a predetermined coordinate corresponding to the detected reduced pupil region or a predetermined coordinate. The size is detected, and the pupil detection unit is configured to detect a pupil region of the digital image based on the detected predetermined coordinates or a predetermined size.

  According to the above configuration, since the pupil detection unit detects a pupil region based on predetermined coordinates or a predetermined size corresponding to the reduced pupil region detected by the reduced pupil detection unit, the digital image is surely received. The pupil region at can be detected.

  The third feature configuration is the coordinate of the center when the predetermined coordinate approximates the reduced pupil region to a circular region in addition to the second feature configuration described above, as described in claim 3. The predetermined size is a radius when the reduced pupil region is approximated to a circular region.

  According to the above configuration, the pupil of the digital image is based on the coordinates of the center and the radius when the reduced pupil region is approximated to a circular region, corresponding to the shape of the pupil portion of the human eye, which is usually circular. In order to detect the region, the pupil region in the digital image can be reliably detected. In addition, the data transferred from the reduced pupil detection unit to the pupil detection unit can at least transfer the pupil region in the digital image by transferring the coordinates of the center and the radius when the reduced pupil region is approximated to a circular region. Since it becomes possible to specify, it is not necessary to transfer data such as all coordinates of the reduced pupil region, the time required for data transfer to specify the pupil region can be shortened, The memory capacity required for data transfer can be reduced.

  In the fourth feature configuration, as described in claim 4, in addition to the second feature configuration described above, the predetermined coordinates are coordinates of the center of gravity of the reduced pupil region, and the predetermined size is The point is a plurality of distances from the coordinates of the center of gravity to the outer edge of the reduced pupil region in a predetermined angular direction with respect to the coordinates of the center of gravity.

  According to the above-described configuration, the coordinates of the center of gravity of the reduced pupil region can be obtained even if the pupil portion of a normally circular human eye has a shape that cannot be said to be circular, for example, by being blocked by a half of the eyelid. And a plurality of distances from the coordinates of the center of gravity to the outer edge of the reduced pupil area in a predetermined angular direction with respect to the coordinates of the center of gravity. The pupil region can be detected. The data transferred from the reduced pupil detection unit to the pupil detection unit includes at most the coordinates of the center of gravity of the reduced pupil region and the reduced pupil in a predetermined angular direction from the coordinates of the center of gravity to the coordinates of the center of gravity. By transferring a plurality of distances to the outer edge of the region, it becomes possible to specify the pupil region in the digital image, so there is no need to transfer all coordinates and other data of the reduced pupil region, The time required for data transfer for specifying the pupil region can be shortened, and further, the memory capacity required for data transfer can be reduced.

  The fifth feature configuration is that, in addition to the second feature configuration described above, the predetermined coordinate is an outer edge coordinate of the reduced pupil region, as described in the fifth aspect.

  According to the above-described configuration, even if the pupil portion of the human eye, which is usually circular, has a shape that cannot be said to be circular due to, for example, half being blocked by the eyelid, the outer edge coordinates of the reduced pupil region are Based on this, the pupil region of the digital image can be reliably detected because the pupil region of the digital image is detected. Further, the data transferred from the reduced pupil detection unit to the pupil detection unit can specify the pupil region in the digital image by transferring the outer edge coordinates of the reduced pupil region at most. It is not necessary to transfer all data such as the coordinates of the pupil area, the time required to transfer the data for specifying the pupil area can be shortened, and further the memory capacity required for data transfer can be reduced. It can be done.

  In the sixth feature configuration, in addition to any one of the second to fifth feature configurations described above, the pupil region color correction unit is detected by the reduced pupil detection unit. A color correction value calculation unit that calculates a color correction value for the reduced pupil region, and a color correction unit that performs color correction processing on the pupil region of the digital image based on the color correction value calculated by the color correction value calculation unit The color correction processing can be performed on the pupil region.

  In the seventh feature configuration, as described in the seventh aspect, in addition to the sixth feature configuration described above, the pupil region color correction unit is configured to calculate from the color correction value calculated by the color correction value calculation unit. A color data generation unit configured to generate color data of the reduced pupil region, and the color correction unit performs color correction processing on the pupil region of the digital image based on the color data generated by the color data generation unit; In the point.

  According to the above-described configuration, the color correction unit performs color correction processing on the pupil region of the digital image based on color data that has been subjected to color correction processing on the reduced pupil region. Interpolation color data is generated from the color data subjected to color correction processing of the area so as to correspond to the number of pixels in the pupil area of the digital image, and the color data of the pupil area of the digital image and the interpolation color data are included. In order to perform color correction processing such as replacement processing for replacing the color data subjected to color correction processing of the reduced pupil region, the color after the color correction processing performed on the pupil region and the reduced pupil region are performed. Thus, the color after the color correction process can be surely matched.

  In the eighth feature configuration, as described in claim 8, in addition to the seventh feature configuration described above, the color correction unit may include the predetermined coordinates or the predetermined coordinates and the predetermined size. The color correction processing is performed on the pupil region of the digital image based on the color data at the obtained coordinates.

  According to the above configuration, the color correction processing is performed on the pupil region of the digital image based on color data at the predetermined coordinates or the coordinates obtained from the predetermined coordinates and the predetermined size. Data transferred from the data generation unit to the color correction unit can be obtained by transferring color data at the predetermined coordinates or coordinates obtained from the predetermined coordinates and the predetermined size at most. The color correction processing of the area can be performed. In other words, it is not necessary to transfer color data at all coordinates of the reduced pupil area, the time required for data transfer for performing color correction processing of the pupil area can be shortened, and further required for data transfer. It is possible to reduce the memory capacity.

  In order to achieve the above object, a first characteristic configuration of a pupil correction processing method according to the present invention is, as described in claim 9, a digital image input step of reading an image recorded on a recording medium, and the digital image A pupil region detection step for detecting a pupil region of a subject from the digital image read in the input step; and a pupil region color correction step for performing color correction processing on the pupil region of the digital image detected by the pupil region detection means. In the pupil correction processing method, the pupil region detecting step includes a reduction processing step for reducing the digital image to a reduced digital image, and a reduction for detecting a reduced pupil region that is a pupil region of the reduced digital image. A point comprising a pupil detection step and a pupil detection step of detecting a pupil region of the digital image based on the reduced pupil region A.

  In the second feature configuration, as described in claim 10, in addition to the first feature configuration described above, the reduced pupil detection step includes a predetermined coordinate corresponding to the detected reduced pupil region or a predetermined coordinate. The size is detected, and the pupil detection step is to detect a pupil region of the digital image based on the detected predetermined coordinates or a predetermined size.

  The third feature configuration is the coordinate of the center when the predetermined coordinate approximates the reduced pupil region to a circular region in addition to the second feature configuration described above, as described in claim 11. The predetermined size is a radius when the reduced pupil region is approximated to a circular region.

  In the fourth feature configuration, as described in claim 12, in addition to the second feature configuration described above, the predetermined coordinates are coordinates of the center of gravity of the reduced pupil region, and the predetermined size is The point is a plurality of distances from the coordinates of the center of gravity to the outer edge of the reduced pupil region in a predetermined angular direction with respect to the coordinates of the center of gravity.

  The fifth feature configuration is that, in addition to the second feature configuration described above, the predetermined coordinates are outer edge coordinates of the reduced pupil region, as described in claim 13.

  In the sixth feature configuration, in addition to any one of the second to fifth feature configurations described above, the pupil region color correction step is detected by the reduced pupil detection step. A color correction value calculation step for calculating a color correction value for the reduced pupil region, and a color correction step for performing color correction processing on the pupil region of the digital image based on the color correction value calculated by the color correction value calculation step It is in the point which consists of.

  In the seventh feature configuration, as described in claim 15, in addition to the sixth feature configuration described above, the pupil region color correction step may include a color correction value calculated by the color correction value calculation step. A color data generation step for generating color data of the reduced pupil region, wherein the color correction step performs color correction processing on the pupil region of the digital image based on the color data generated by the color data generation step; In the point.

  In the eighth feature configuration, in addition to the seventh feature configuration described above, the color correction step may include the predetermined coordinates or the predetermined coordinates and the predetermined size. The color correction processing is performed on the pupil region of the digital image based on the color data at the obtained coordinates.

  As described above, according to the present invention, a pupil correction processing apparatus that can reliably and efficiently perform color correction processing of a pupil region in a digital image in which a red-eye phenomenon or the like occurs such that the pupil of the eye is photographed in red. And the method can be provided.

  Hereinafter, an embodiment in which a pupil correction processing apparatus for digital images according to the present invention is applied to a photographic processing apparatus will be described. As shown in FIG. 2, the external structure of the photographic processing apparatus 1 includes a photographic printer 2 that performs an exposure process on the photographic paper P based on output image data and develops the exposed photographic paper, and a digital printer. An operation station 3 for setting and inputting print order information for an image and performing various image correction processes is provided, and print data edited on the digital image by the operation station 3 is output to the photo printer 2. And a desired photographic print is generated.

  As shown in FIGS. 2 and 3, the general structure of the photographic printer 2 is a two-line printing that contains a roll-like photographic paper P as a photosensitive material and supplies the photographic paper P as a photosensitive material supply unit. A paper magazine 21; a sheet cutter 22 for cutting the photographic paper P supplied from the photographic paper magazine 21 into a predetermined print size; and a back for printing print information such as an image number on the back of the photographic paper P after the cutting. A printing unit 23, an exposure processing unit 24 for exposing the photographic paper P based on the photographic print target data, and a plurality of processing solutions for developing, bleaching, and fixing the exposed photographic paper P. Processing tanks 25a, 25b, and 25c are arranged along the conveyance path of the photographic paper P, the horizontal feeding conveyor 26 that discharges the photographic paper P dried after the development processing, and the horizontal feeding A plurality of paper that is integrated in the conveyor 26 (photographic print) P is constituted by a sorter 27 as the print sorting unit for sorting the order unit of the photographic print. The exposure processing unit 24 includes an exposure head that exposes light beams of three primary colors of R (red), G (green), and B (blue) while feeding the photographic paper P based on print target data. In some cases, the photographic printing paper P is conveyed in the sub-scanning direction, and exposure is performed in a line along the main scanning direction in synchronization with the conveying speed. As the exposure head, a fluorescent beam method, a liquid crystal shutter method, a DMD method, a FOCRT method, or the like can be adopted depending on the exposure specification.

  That is, the photographic printer 2 conveys the roll-shaped photographic paper P stored in the two photographic paper magazines 21 and cuts it to the print size, and the exposure processing unit 24 applies the photographic paper P thus cut. Then, the exposure process is performed, and the photographic paper P after the exposure process is sent to the development processing unit 25 having a plurality of development processing tanks for development. Then, after the development process and the drying process, the photographic paper P sent to the sorter 27 from the lateral feed conveyor 26 at the top of the photographic printer 2, that is, the photographic prints P are sorted into a plurality of trays of the sorter 27 for each print order It is constituted so that it may accumulate in the state.

  As shown in FIG. 2, the operation station 3 has a film scanner 31 that reads an image from a developed photographic film F as a digital image, and a memory card that stores a digital image taken by a digital still camera or the like. And a media driver 32 for reading the digital image from the digital image storage medium M, and a general-purpose computer as the controller 33. The controller 33 is installed with an application program that operates under the control of a general-purpose operating system and executes various controls of the photographic processing apparatus 1, and has a monitor 34, a keyboard 35, and a mouse 36 as operation interfaces with the operator. Etc. are connected.

  As shown in FIG. 1, the functional block configuration relating to the color correction processing in the pupil region of the digital image, which is executed by the cooperation of the hardware and software of the controller 33, includes the film scanner 31 and the media as digital image input means. A memory 37 for storing a digital image read by the driver 32 and a graphic operation screen including image information and input information based on the read digital image are generated, and the graphic operation screen is displayed on the monitor 34. A graphic user interface (GUI) unit 38 for generating various control commands based on an input operation from the keyboard 35 or mouse 36 to the graphic operation screen; and a digital image stored in the memory 37 The pupil area to detect the pupil area based on the serial control command is constituted by a pupil correction processing unit 39 to the color correction process.

  The film scanner 31 is configured to operate in two modes: a pre-scan mode that reads an image recorded on the film F at a high speed although it has a low resolution, and a main scan mode that reads a high resolution at a low speed, Normally, the low-resolution frame image read in the pre-scan mode is displayed on the pre-judge screen, and the operator inputs print order information and various image correction processes. Based on the various correction parameters at this time, the main scan mode is displayed. The final correction is performed on the high-resolution image data read in (1) to generate print data.

  Similarly, if there is no thumbnail image read by the media driver 32 or a thumbnail image, a thumbnail image reduced from a high resolution image is displayed on the pre-judge screen, and after various correction processes are performed, the correction is performed. A high-resolution digital image is corrected based on the parameters.

  When high-definition correction processing is required for the thumbnail image displayed on the pre-judge screen, each time a transition is made to a one-frame enlargement mode in which a high-resolution digital image is read and the reduced image is displayed. Detailed correction processing is executed.

  For example, when a thumbnail image recognized as needing color correction of the pupil area by the operator on the pre-judge screen is double-clicked with the mouse 36, the mode shifts to the single frame enlargement mode and is read in the main scan mode. The high-resolution digital image read or the high-resolution digital image read from the media driver 32 is stored in the memory 37, and the pupil correction described below is based on the high-resolution digital image stored in the memory 37. The processing unit 39 is activated.

  The pupil correction processing unit 39 detects the pupil area of the digital image stored in the memory 37, and performs color correction on the pupil area of the digital image detected by the pupil area detection means 40. It comprises pupil region color correction means 46 for processing.

  The pupil region detection means 40 is a reduction processing unit 41 that performs reduction processing to a reduced digital image obtained by reducing the digital image stored in the memory 37, and a pupil region of the reduced digital image reduced by the reduction processing unit 41. A reduced pupil detector 42 for detecting a reduced pupil region; a pupil detector 43 for detecting a pupil region of a digital image stored in the memory 37 based on the reduced pupil region detected by the reduced pupil detector 42; It is configured with.

  The reduction processing unit 41 calculates, for each pixel in the digital image stored in the memory 37, an average value of pixel data in a predetermined number of pixel groups according to a target reduction size including a pixel as a specific pixel. Then, smoothing processing is performed to replace the calculated average value with new pixel data of the specific pixel, and if necessary, pixel thinning processing is performed so as to obtain a target reduced size, and the thinning processing is performed. It is configured to generate a reduced digital image by executing a compression process that replaces the coordinates of each pixel that has become the new pixel data still remaining by the process with the new coordinates. Note that the reduction rate at which the digital image is reduced to the reduced digital image has a predetermined reduction rate corresponding to the size of the digital image.

  For example, as shown in FIG. 4, the reduced pupil detection unit 42 applies the mouse to the reduced digital image reduced by the reduction processing unit 41 displayed on the monitor 34 via the GUI 38. A histogram is generated in a rectangular area E with two points P1 (x1, y1) and P2 (x2, y2) designated by operation via the keyboard 36 or the keyboard 35, and the saturation is continuously within a predetermined threshold range. The pixel area is detected as a reduced pupil area.

  The detection of the reduced pupil area may be automatically performed after the rectangular area E is designated by the operator by setting a predetermined threshold range of the saturation in advance. The predetermined threshold range of the saturation may be set via the mouse 36 or the keyboard 35. The operator can finely adjust the reduced pupil region, and can detect not only the red eye phenomenon but also the pupils of various colors.

  Further, the detection of the reduced pupil region is configured to detect, as the reduced pupil region, a continuous pixel region in which a value based on lightness, chromaticity, or a combination thereof is within a predetermined threshold range in addition to saturation. May be.

  Further, the reduced pupil detection unit 42 is configured to approximate the detected reduced pupil region as a circular region, and calculate the center coordinates of the circular region and the radius of the circular region. For example, in the reduced pupil region, the number of continuous pixels in the pixel row where the number of continuous pixels in the pixel column direction (x-axis direction) is maximum and the number of continuous pixels in the pixel row direction (y-axis direction). The half value of the average number of pixels with respect to the number of continuous pixels in the pixel column having the maximum is detected as the radius of the circular area, and the number of continuous pixels in the pixel column direction (x-axis direction) is maximum. The y coordinate in the pixel row is the y coordinate of the center position of the circle region, and the x coordinate in the pixel column in which the number of continuous pixels in the row direction (y-axis direction) of the pixel is the maximum The position is detected as the x coordinate.

  That is, the operation of the reduced pupil detection unit 42 will be described with reference to the flowchart of FIG. 5. Two points P1 and P2 that are designated by the operator to operate the reduced digital image via the mouse 36 or the keyboard 35 are displayed. When a diagonal rectangular area E is designated (SA1), the reduced pupil detection unit 42 extracts the rectangular area E (SA2), and for each pixel in the rectangular area E (SA3, SA4, SA5, SA6, SA7, SA8), the lightness M in the pixel data is within the range of the predetermined first lightness threshold Mth1 and the predetermined second lightness threshold Mth2 (SA9), and the saturation S is the predetermined first saturation. Pixels within the range between the threshold Sth1 and the predetermined second saturation threshold Sth2 are detected (SA10, SA11). When the detection of each pixel in the rectangular area E is completed, a continuous pixel area in which the detected pixels are a predetermined number of continuous pixels is detected as a reduced pupil area (SA12).

  The reduced pupil detection unit 42 measures the number of consecutive pixels in the row direction for each column of pixels in the detected reduced pupil region (SA13), and detects the x coordinate in the column where the number of consecutive pixels is maximum (SA14). ). Further, the number of continuous pixels in the column direction for each row of pixels in the detected reduced pupil region is measured (SA15), and the y coordinate in the row where the number of continuous pixels is maximum is detected (SA16). Further, an average half value of the maximum number of continuous pixels in the row direction of the measured pixels and the maximum number of continuous pixels in the pixel column direction is detected (SA17). In other words, the reduced pupil detection unit 42 approximates the detected reduced pupil region as a circular region, and detects the center coordinates and the radius thereof.

  The reduced pupil detection unit 42 superimposes reference circles of various sizes on the detected reduced pupil area, detects a reference circle having a size having the highest degree of coincidence with the reduced pupil area, and A configuration may be adopted in which the position of the reference circle when the degree of coincidence is the highest with respect to the reduced pupil region is detected, and the radius and center coordinates of the reference circle at this time are detected.

  The pupil detection unit 43 detects the pupil region of the digital image stored in the memory 37 based on the center coordinates and radius detected by the reduced pupil detection unit 42, and is stored in the memory 37. The center coordinate and the radius are converted based on the enlargement rate corresponding to the reduction rate of the digital image being reduced to the reduced digital image by the reduction processing unit 41, and obtained by the converted center coordinate and radius. A circular area in the digital image is specified, and the specified circular area is detected as a pupil area. Note that the enlargement ratio has a predetermined enlargement ratio corresponding to the reduction ratio. For example, when the reduction ratio is 1 / N times, the enlargement ratio can be set to N times. At this time, the central coordinates of the reduced pupil region in the reduced digital image are (xa, ya If the radius is r, the converted center coordinates can be calculated as (N · xa, N · ya), and the converted radius can be calculated as N · r.

  The operation of the pupil detection unit 43 will be described with reference to the flowchart of FIG. 6. When the reduced pupil detection unit 42 detects the center coordinates and the radius in the reduced pupil region, the pupil detection unit 43 (SB1). The reduction rate of the digital image stored in the memory 37 is reduced to the reduced digital image by the reduction processing unit 41 (SB2), and the enlargement rate corresponding to the reduction rate of the reduced digital image is obtained. (SB3).

  The pupil detection unit 43 converts the center coordinates and radius in the reduced pupil region based on the enlargement ratio (SB4), and a circle in the digital image obtained by the converted center coordinates and radius. An area is specified (SB5), and the circular area is detected as a pupil area in the digital image (SB6).

  The pupil area color correction unit 46 performs a color correction process on the reduced pupil area detected by the reduced pupil detection unit 42, and calculates a color correction value applied to the color correction process. 44, and a color correction unit 45 that performs color correction processing on the pupil region detected by the pupil detection unit 43 based on the color correction value calculated by the color correction value calculation unit 44. Yes.

  The color correction value calculation unit 44 performs color correction values sequentially tried by the operator via the mouse 36 or the keyboard 35 on the reduced pupil area of the reduced digital image displayed on the monitor 34 via the GUI 38. For example, a reduced pupil region in which color correction processing is sequentially performed based on input operation instructions such as a correction rate set for each of saturation, chromaticity, lightness, and the like, and the color correction processing is performed via the GUI 38 The color correction processing image is displayed on the monitor 34, and the color correction value applied to the color correction processing image of the reduced pupil region finally selected by the operator is calculated.

  The color correction unit 45 performs color correction processing on the pixels in the pupil region in the digital image detected by the pupil detection unit 43 based on the color correction value calculated by the color correction value calculation unit 44. It is configured as follows.

  That is, the color correction unit 45 detects the digital image detected by the pupil detection unit 43 with a correction rate such as saturation, chromaticity, and brightness as the color correction value calculated by the color correction value calculation unit 44. The color correction processing is performed by calculating a new pixel value by reflecting the pixel value in the pupil region in the image by integration processing or the like.

  Hereinafter, the operation of the color correction process in the pupil region of the digital image will be described based on the flowchart of FIG. A high-resolution image read in the main scan mode by double-clicking with the mouse 36 on the thumbnail image that the operator recognized on the pre-judge screen as a result of red-eye phenomenon, etc. When the high-resolution digital image read from the media driver 32 is stored in the memory 37 (SC1), the reduction processing unit 41 reduces the digital image data according to the digital image size. By performing the processing, a reduced digital image is generated (SC2).

  When the reduced digital image is generated by the reduction processing unit 41, the reduced digital image is displayed on the monitor 34 via the GUI (SC3). When the rectangular area E is designated by the operator via the mouse 36 or the keyboard 35 for the reduced digital image on the monitor 34 (SC4), the reduced pupil detection unit 42, as described above, The reduced pupil region is automatically detected in the rectangular region E (SC5), the reduced pupil region is approximated as a circular region, and its center coordinates and its radius are detected (SC6).

  On the other hand, the color correction value calculation unit 44 performs color correction sequentially tried by the operator via the mouse 36 or the keyboard 35 on the pupil region of the reduced digital image displayed on the monitor 34 via the GUI 38. The color correction processing is sequentially performed based on the value operation instruction (SC7, SC8), and the color correction processing image of the pupil region subjected to the color correction processing via the GUI 38 is displayed on the monitor 34 (SC9). A color correction value applied to the color correction processing image of the pupil region finally selected by the operator is calculated (SC10, SC11).

  As described above, the pupil detection unit 43 detects the pupil region of the digital image stored in the memory 37 based on the center coordinates and the radius detected by the reduced pupil detection unit 42 (SC12).

  The color correction unit 45 performs color correction processing on the pixels in the pupil region in the digital image detected by the pupil detection unit 43 based on the color correction value calculated by the color correction value calculation unit 44. (SC13).

  The digital image that has been subjected to the color correction processing of the pupil region is converted into print data by the print data generation unit 45 and then output as a photographic print by the photographic printer 2.

  Hereinafter, another embodiment will be described. In the above description, the reduced pupil detection unit 42 approximates the detected reduced pupil region as a circular region to calculate the center coordinates of the circular region and the radius of the circular region, and the pupil detection unit 43 Although the case where the pupil region of the digital image is detected based on the center coordinates of the circular region and the radius of the circular region has been described, the reduced pupil detection unit 42, the coordinates of the center of gravity of the detected reduced pupil region, Calculating a plurality of distances from the coordinates of the center of gravity to the outer edge of the reduced pupil region in a predetermined angular direction with respect to the coordinates of the center of gravity, and the pupil detection unit 43 includes the coordinates of the center of gravity of the reduced pupil region; The pupil region of the digital image may be detected based on a plurality of distances from the coordinates of the center of gravity to the outer edge of the reduced pupil region at a predetermined angle with respect to the coordinates of the center of gravity. For convenience of explanation, the reduced pupil detection unit 42 will be described as a reduced pupil detection unit 50, and the pupil detection unit 43 will be described as a pupil detection unit 51 with different reference numerals.

  The reduced pupil detection unit 50 detects the reduced pupil area in the same manner as described above, and then the coordinates of the center of gravity of the detected reduced pupil area and the coordinates in the predetermined angular direction from the coordinates of the center of gravity to the coordinates of the center of gravity. A plurality of distances to the outer edge of the reduced pupil region are calculated.

  The coordinates of the center of gravity of the reduced pupil region can be, for example, the average value of the x coordinate values and the average value of the y coordinate values in the reduced pupil region. That is, the average value of the calculated x-coordinate values is set as the x-coordinate value in the coordinates of the center of gravity of the reduced pupil region, and the average value of the calculated y-coordinate values is set as the reduced pupil region. The value of the y coordinate in the coordinates of the center of gravity of

  A plurality of distances from the coordinates of the center of gravity to the outer edge of the reduced pupil region in a predetermined angle direction with respect to the coordinates of the center of gravity are, for example, the coordinates of the center of gravity and the coordinates of the center of gravity as shown in FIG. On the other hand, the amount of deviation from each coordinate of the outer edge of the reduced pupil region in a predetermined angular direction can be a value calculated individually in the x-axis direction and the y-axis direction. If the plurality of distances are the distances between the coordinates of the outer edge of the reduced pupil region located in different directions at equal angular intervals from the coordinates of the center of gravity, and the coordinates of the center of gravity, the pupil detection described later is performed. It is preferable that the detection of the pupil region by the unit 51 can be performed with relatively high accuracy.

  In other words, the operation of the reduced pupil detection unit 50 will be described with reference to the flowchart of FIG. 9. After the reduced pupil detection unit 50 detects the reduced pupil region as described above (SD1), An average value of x-coordinate values and an average value of y-coordinate values are calculated (SD2, SD3). The average value of the calculated x-coordinate values and the average value of the y-coordinate values are used as the coordinates of the center of gravity of the reduced pupil region, and the outer edge of the reduced pupil region in a predetermined angle direction with respect to the coordinates of the center of gravity. The coordinates of the part are detected (SD4). For example, each coordinate of the outer edge portion of the reduced pupil region in the direction of 360 / R at intervals of R ° with respect to the coordinates of the center of gravity is detected.

  The reduced pupil detection unit 50 detects the distance between each coordinate of the detected outer edge portion of the reduced pupil region and the coordinates of the center of gravity of the reduced pupil region. That is, the difference between the x-coordinate value at each coordinate of the detected outer edge of the reduced pupil region and the x-coordinate value at the center of gravity coordinate, the y-coordinate value at each outer edge coordinate, and the coordinates of the center of gravity And the difference between the values of the y-coordinates at (SD5, SD6).

  The pupil detection unit 51 uses the reduction pupil detection unit 50 based on an enlargement rate corresponding to a reduction rate obtained by reducing the digital image stored in the memory 37 into a reduced digital image by the reduction processing unit 41. The coordinates of the center of gravity of the detected reduced pupil region and the plurality of distances are converted, and each coordinate corresponding to a position separated from the converted center of gravity coordinates by the converted distance is calculated. Further, an area in the digital image surrounded by the calculated coordinates is specified, and the specified area is detected as a pupil area. Note that the enlargement ratio is determined in advance according to the reduction ratio, as described above. For example, when the reduction ratio is 1 / N times, the enlargement ratio can be set to N times. At this time, the coordinates of the center of gravity of the reduced pupil region in the reduced digital image are (xa, ya) and the distance is (xb, yb), the converted center coordinates are (N · xa, N · ya), and the converted distance is (N · xb, N · yb).

  Further, if the plurality of distances are the distances between the coordinates of the outer edge of the reduced pupil region and the coordinates of the center of gravity located in different directions at equal angular intervals from the coordinates of the center of gravity, these are converted. The coordinates obtained in this manner are arranged at relatively equal intervals, so even if the amount of information such as the coordinates is relatively small, the area surrounded by these coordinates, that is, the pupil area, is relatively accurately detected. This can be detected.

  That is, the operation of the pupil detection unit 51 will be described with reference to the flowchart of FIG. 10. The pupil detection unit 51 uses the reduced pupil detection unit 50 to determine the coordinates of the center of gravity in the reduced pupil region and the plurality of distances. When detected (SE1), the reduction ratio of the digital image stored in the memory 37 is reduced to the reduced digital image by the reduction processing unit 41 (SE2), and the reduction ratio of the reduced digital image is confirmed. The enlargement ratio corresponding to is obtained (SE3).

Further, the coordinates of the center of gravity of the reduced pupil region and the plurality of distances are converted based on the magnification (SE4), and the converted center of gravity is calculated from the converted coordinates of the center of gravity and the plurality of distances. Each coordinate corresponding to a position away from the coordinate by the converted distance is calculated (SE5). Further, an area in the digital image surrounded by the calculated coordinates is specified, and the specified area is detected as a pupil area (SE6).
In the above description, the reduced pupil detection unit 50 includes a plurality of coordinates of the detected center of gravity of the reduced pupil region, and a plurality of coordinates from the center of gravity to the outer edge of the reduced pupil region in a predetermined angle direction with respect to the coordinates of the center of gravity. The pupil detection unit 51 calculates a plurality of coordinates from the center of gravity of the reduced pupil region to the outer edge of the reduced pupil region at a predetermined angle with respect to the coordinates of the center of gravity. In the above description, the reduced pupil detection unit 50 detects a predetermined number of coordinates in the outer edge of the detected reduced pupil region, and detects the pupil. The unit 51 may be configured to detect the pupil region of the digital image based on a predetermined number of coordinates at the outer edge of the reduced pupil region. The coordinates of the outer edge of the reduced pupil area can be converted based on the magnification ratio, and the digital image area surrounded by the converted coordinates can be detected as a pupil area.

  The pupil region color correction unit 46 includes a color data generation unit that generates color data of the reduced pupil region from the color correction value calculated by the color correction value calculation unit 44, and the color correction unit 45 includes: A color correction process may be performed on the pupil region of the digital image based on the color data generated by the color data generation unit. For example, the color correction unit 45 corresponds to the number of pixels in the pupil region of the digital image from color data obtained by performing color correction processing on the reduced pupil region, that is, color data generated by the color data generation unit. In this way, interpolation color data is generated, and replacement processing is performed to replace the color data of the pupil region of the digital image and the color data subjected to color correction processing of the reduced pupil region including the interpolation color data. The interpolated color data can be generated by using, for example, nearest neighbor interpolation, bilinear interpolation, or cubic convolution (bicubic).

  Further, the color correction unit 45 may be configured to perform color correction processing on the pupil region of the digital image based on color data at predetermined coordinates or coordinates obtained from the predetermined coordinates and a predetermined size. For example, the predetermined coordinates are set as center coordinates approximating a reduced pupil area detected by the reduced pupil area detection unit to a circular area, the predetermined size is set as a radius of the circular area, and the predetermined coordinates and a predetermined The coordinates obtained from the size can be coordinates corresponding to the circumferential portion of the circular region. Alternatively, the predetermined coordinates are set as the coordinates of the center of gravity of the reduced pupil area detected by the reduced pupil area detection unit, and the predetermined size is set in a predetermined angle direction from the coordinates of the center of gravity to the coordinates of the center of gravity. A plurality of distances to the outer edge of the reduced pupil region, and a coordinate obtained from the predetermined coordinate and a predetermined size is a coordinate of the outer edge of the reduced pupil region located in a predetermined angular direction with respect to the coordinate of the center of gravity. It can be a coordinate. Furthermore, the predetermined coordinates may be used as the coordinates of the outer edge portion of the reduced pupil region detected by the reduced pupil region detection unit. In any case, a replacement process that appropriately generates interpolated color data and replaces the color data of the pupil area of the digital image with the color data that has been subjected to the color correction process of the reduced pupil area including the interpolated color data. Just do it.

  Note that the above-described embodiment is merely an example of the present invention, and it is needless to say that the specific configuration and the like of each block can be changed and designed as appropriate within the scope of the effects of the present invention.

Explanatory drawing of a functional block configuration concerning color correction processing in the pupil region of a digital image Explanatory drawing of the external structure of the photo processing device Illustration of the photo printer's general structure Illustration of how to specify a rectangular area for a reduced digital image Flow chart for explaining the operation of the reduced pupil detector Flow chart for explaining the operation of the pupil detection unit Flow chart for explaining the operation of color correction processing in the pupil region of a digital image Explanatory diagram of the coordinates of the center of gravity and a plurality of distances from the coordinates of the center of gravity to the outer edge of the reduced pupil region in a predetermined angular direction with respect to the coordinates of the center of gravity The flowchart for demonstrating operation | movement of the reduction pupil detection part in another embodiment. The flowchart for demonstrating operation | movement of the pupil detection part in another embodiment. Explanatory drawing of the reduction process for converting a digital image into a reduced digital image

Explanation of symbols

1: Photo processing device 2: Photo printer 3: Operation station 31: Film scanner 32: Media driver 33: Controller 34: Monitor 35: Keyboard 36: Monitor 37: Memory 38: GUI
39: Pupil correction processing unit 40: Pupil region detection means 41: Reduction processing unit 42, 50: Reduction pupil detection unit 43, 51: Pupil detection unit 44: Color correction value calculation unit 45: Color correction unit 46: Pupil region color correction means

Claims (16)

Digital image input means for reading an image recorded on a recording medium, pupil area detection means for detecting a pupil area of a subject from the digital image read by the digital image input means, and digital detected by the pupil area detection means A pupil correction processing device including a pupil region color correction unit that performs color correction processing on a pupil region of an image,
The pupil region detecting means includes a reduction processing unit that reduces the digital image to a reduced digital image, a reduced pupil detection unit that detects a reduced pupil region that is a pupil region of the reduced digital image, and the reduced pupil region And a pupil detection unit that detects a pupil region of the digital image based on the above.   The reduced pupil detection unit detects a predetermined coordinate or a predetermined size corresponding to the detected reduced pupil region, and the pupil detection unit detects the predetermined coordinate or the predetermined size based on the detected predetermined coordinate or a predetermined size. The pupil correction processing device according to claim 1, wherein the pupil region of the digital image is detected.   3. The predetermined coordinate is a center coordinate when the reduced pupil region is approximated to a circular region, and the predetermined size is a radius when the reduced pupil region is approximated to a circular region. Digital image pupil correction processing device.   The predetermined coordinates are coordinates of the center of gravity of the reduced pupil area, and the predetermined size is a plurality of coordinates from the coordinates of the center of gravity to the outer edge of the reduced pupil area in a predetermined angle direction with respect to the coordinates of the center of gravity. The pupil correction processing apparatus according to claim 2, which is a distance.   The pupil correction processing apparatus according to claim 2, wherein the predetermined coordinates are outer edge coordinates of the reduced pupil region.   The pupil region color correction means is based on a color correction value calculation unit that calculates a color correction value for the reduced pupil region detected by the reduced pupil detection unit, and a color correction value calculated by the color correction value calculation unit. The pupil correction processing apparatus according to claim 2, further comprising a color correction unit that performs color correction processing on a pupil region of the digital image.   The pupil region color correction unit includes a color data generation unit that generates color data of the reduced pupil region from the color correction value calculated by the color correction value calculation unit, and the color correction unit includes the color data generation unit. The pupil correction processing apparatus according to claim 6, wherein color correction processing is performed on a pupil region of the digital image based on the color data generated by the step.   The color correction unit according to claim 7, wherein the color correction unit performs color correction processing on the pupil region of the digital image based on color data at the predetermined coordinates or coordinates obtained from the predetermined coordinates and the predetermined size. Pupil correction processing device. A digital image input step for reading an image recorded on a recording medium, a pupil region detection step for detecting a pupil region of a subject from the digital image read by the digital image input step, and the digital detected by the pupil region detection means A pupil correction processing method comprising a pupil region color correction step for performing color correction on a pupil region of an image,
The pupil region detecting step includes a reduction processing step for reducing the digital image to a reduced digital image, a reduced pupil detection step for detecting a reduced pupil region that is a pupil region of the reduced digital image, and the reduced pupil region A pupil correction processing method comprising: a pupil detection step of detecting a pupil region of the digital image based on   The reduced pupil detecting step detects a predetermined coordinate or a predetermined size corresponding to the detected reduced pupil region, and the pupil detecting step is based on the detected predetermined coordinate or a predetermined size. The pupil correction processing method according to claim 9, wherein a pupil region of the digital image is detected.   11. The predetermined coordinate is a center coordinate when the reduced pupil region is approximated to a circular region, and the predetermined size is a radius when the reduced pupil region is approximated to a circular region. Pupil correction processing method.   The predetermined coordinates are coordinates of the center of gravity of the reduced pupil area, and the predetermined size is a plurality of coordinates from the coordinates of the center of gravity to the outer edge of the reduced pupil area in a predetermined angle direction with respect to the coordinates of the center of gravity. The pupil correction processing method according to claim 10, which is a distance.   The pupil correction processing method according to claim 10, wherein the predetermined coordinates are outer edge coordinates of the reduced pupil region.   The pupil region color correction step is based on the color correction value calculation step for calculating a color correction value for the reduced pupil region detected by the reduction pupil detection step, and the color correction value calculated by the color correction value calculation step. The pupil correction processing method according to claim 10, further comprising a color correction step of performing color correction processing on the pupil region of the digital image.   The pupil region color correction step includes a color data generation step of generating color data of the reduced pupil region from the color correction value calculated in the color correction value calculation step, and the color correction step includes the color data generation step. The pupil correction processing method according to claim 14, wherein a color correction process is performed on a pupil region of the digital image based on the color data generated by the step.   16. The color correction process according to claim 15, wherein the color correction step performs color correction processing on the pupil region of the digital image based on color data at the predetermined coordinates or coordinates obtained from the predetermined coordinates and the predetermined size. Pupil correction processing method.

Images