US20050174448A1 - Red eye image correction device, electronic camera and red eye image correction program product - Google Patents

Red eye image correction device, electronic camera and red eye image correction program product Download PDF

Info

Publication number
US20050174448A1
US20050174448A1 US11/049,731 US4973105A US2005174448A1 US 20050174448 A1 US20050174448 A1 US 20050174448A1 US 4973105 A US4973105 A US 4973105A US 2005174448 A1 US2005174448 A1 US 2005174448A1
Authority
US
United States
Prior art keywords
image
red eye
data
processing
unit
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US11/049,731
Other languages
English (en)
Inventor
Motoyuki Kuboi
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nikon Corp
Original Assignee
Nikon Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nikon Corp filed Critical Nikon Corp
Assigned to NIKON CORPORATION reassignment NIKON CORPORATION ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: KUBOI, MOTOYUKI
Publication of US20050174448A1 publication Critical patent/US20050174448A1/en
Priority to US12/149,433 priority Critical patent/US7812864B2/en
Abandoned legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/76—Television signal recording
    • H04N5/765—Interface circuits between an apparatus for recording and another apparatus
    • H04N5/77—Interface circuits between an apparatus for recording and another apparatus between a recording apparatus and a television camera
    • H04N5/772—Interface circuits between an apparatus for recording and another apparatus between a recording apparatus and a television camera the recording apparatus and the television camera being placed in the same enclosure
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/90—Determination of colour characteristics
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18—Eye characteristics, e.g. of the iris
    • G06V40/193—Preprocessing; Feature extraction
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/02—Editing, e.g. varying the order of information signals recorded on, or reproduced from, record carriers
    • G11B27/031—Electronic editing of digitised analogue information signals, e.g. audio or video signals
    • G11B27/034—Electronic editing of digitised analogue information signals, e.g. audio or video signals on discs
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/46—Colour picture communication systems
    • H04N1/56—Processing of colour picture signals
    • H04N1/60—Colour correction or control
    • H04N1/62—Retouching, i.e. modification of isolated colours only or in isolated picture areas only
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/46—Colour picture communication systems
    • H04N1/56—Processing of colour picture signals
    • H04N1/60—Colour correction or control
    • H04N1/62—Retouching, i.e. modification of isolated colours only or in isolated picture areas only
    • H04N1/624—Red-eye correction
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70—Circuitry for compensating brightness variation in the scene
    • H04N23/74—Circuitry for compensating brightness variation in the scene by influencing the scene brightness using illuminating means
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30216—Redeye defect
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/76—Television signal recording
    • H04N5/907—Television signal recording using static stores, e.g. storage tubes or semiconductor memories
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00—Details of colour television systems
    • H04N9/79—Processing of colour television signals in connection with recording
    • H04N9/80—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback
    • H04N9/804—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback involving pulse code modulation of the colour picture signal components
    • H04N9/8042—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback involving pulse code modulation of the colour picture signal components involving data reduction
    • H04N9/8047—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback involving pulse code modulation of the colour picture signal components involving data reduction using transform coding
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00—Details of colour television systems
    • H04N9/79—Processing of colour television signals in connection with recording
    • H04N9/80—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback
    • H04N9/82—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback the individual colour picture signal components being recorded simultaneously only
    • H04N9/8205—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback the individual colour picture signal components being recorded simultaneously only involving the multiplexing of an additional signal and the colour video signal

Definitions

  • the present invention relates to a device that corrects a red eye image contained in an image photographed by using an electronic flash unit.
  • Japanese Laid Open Patent Publication No. H 6-350914 discloses a technology whereby the red eye data portion is extracted from the digital image data read from the raw data and the extracted red eye data portion is corrected to a normal pupil color.
  • Japanese Laid Open Patent Publication No. 2000-299812 discloses an electronic camera that executes photographing operations by using an electronic flash unit and without using the electronic flash unit, extracts the red eye data portion in the image by calculating the correlation between the images obtained through the individual photographing operations and executes red eye correction processing on the extracted red eye data portion.
  • Japanese Laid Open Patent Publication No. 2000-299812 requires two photographed images to enable the red eye correction processing for a single photographed image.
  • a red eye image correction device comprises: a data size conversion unit that executes reduction processing on an image so as to retain color component information contained in the image and generates a sub image with a smaller data size than the image; a red eye detection unit that detects data corresponding to red eye portions in data constituting the sub image; a position information calculation unit that obtains through calculation second position information indicating positions of data corresponding to the red eye portions in data constituting the image by using first position information indicating positions of the detected data in the sub image data; and a red eye correction unit that executes red eye correction processing on the data of the image indicated by the second position information.
  • the data size conversion unit in the red eye image correction device according to the 1st aspect it is preferred that the data size conversion unit generates the sub image if the data size of the image is equal to or greater than a predetermined value.
  • the red eye image correction device in the red eye image correction device according to the 1st or 2nd aspect, it is preferred that there is further provided a process regulating unit that interrupts detection processing by the red eye detection unit, calculation processing by the position information calculation unit or the red eye correction processing by the red eye correction unit if the processing has been executed over a length of time exceeding a predetermined time length and proceeds to execute processing other than the detection processing, the calculation processing and the red eye correction processing.
  • the red eye image correction device in the red eye image correction device according to the 3rd aspect, it is preferred that there is further provided a data recording unit that records data indicating incomplete red eye correction in correlation with the data of the image if the processing is interrupted by the process regulating unit.
  • the data size conversion unit generates the sub image in correspondence to an image correlated with the data indicating incomplete red eye correction.
  • an electronic camera comprises: a red eye image correction device according to any of the 1st through 5th aspect; an image-capturing unit that captures a subject image and generates image data that include a color component; a light emission instruction unit that outputs a light emission instruction signal to an electronic flash unit which illuminates a subject during a photographing operation; and a recording unit that records the data constituting the image into a recording medium.
  • an electronic camera comprises: an image-capturing unit that captures a subject image and generates image data; a sub image generation unit that executes reduction processing on the image data to generate a sub image data with a smaller data size than the image data; a red eye detection unit that executes detection processing to detect red eye portions in the sub image data; a position information calculation unit that executes calculation processing to obtain second position information indicating positions of red eye portions in the image data by using first position information indicating positions of the detected red eye portions in the sub image data; a red eye correction unit that executes red eye correction processing on the image data based upon the second position information; and a recording unit that records the image data having undergone the red eye correction processing into a recording medium.
  • the red eye correction unit in the electronic camera according to the 7th aspect, it is preferred that: if at least one of the detection processing by the red eye detection unit, the calculation processing by the position information calculation unit and the red eye correction processing by the red eye correction unit has been executed over a length of time exceeding a predetermined time length, the red eye correction unit does not execute the red eye correction processing on the image data; and the recording unit records the image data having not undergone the red eye correction processing with information indicating that the red eye correction processing has not undergone, into the recording medium.
  • an image obtaining unit that obtains the image data recorded in the recording medium; and a control unit that controls the reduction processing by the sub image generation unit, the detection processing by the red eye detection unit, the calculation processing by the position information calculation unit and the red eye correction processing by the red eye correction unit to be executed on the obtained image, when the obtained image data includes the information indicating that the red eye correction processing has not undergone.
  • the recording unit records the obtained image data having undergone the red eye correction processing into the recording medium.
  • a computer-readable computer program product contains a red eye image correction program.
  • the red eye image correction program comprises: an instruction code for executing reduction processing on an image so as to retain color component information contained in the image and generating a sub image with a smaller data size than the image; an instruction code for detecting data corresponding to red eye portions in data constituting the sub image; an instruction code for obtaining through calculation second position information indicating positions of data corresponding to the red eye portions in data constituting the image by using first position information indicating positions of the detected data in the sub image data; and an instruction code for executing red eye correction on the data of the image indicated by the second position information.
  • FIG. 1 is a block diagram showing the essential structure adopted in the electronic camera achieved in an embodiment of the present invention
  • FIG. 2 presents a flowchart of the processing executed by the CPU during the red eye correction processing in the photographing mode
  • FIG. 3 presents a flowchart of the processing executed by the CPU during the red eye correction processing in the reproduction mode
  • FIG. 4 shows how the program may be provided to a personal computer.
  • FIG. 1 is a block diagram of the essential structure adopted in an electronic camera 10 achieved in an embodiment of the present invention.
  • a CPU 101 in FIG. 1 is constituted with a microcomputer and the like.
  • the CPU 101 executes specific arithmetic operations by using signals input thereto from various blocks to be detailed later and outputs control signals generated based upon the arithmetic operation results to the individual blocks.
  • An image-capturing element 121 is constituted with a CCD image sensor or the like.
  • the image-capturing element 121 captures an image formed with a subject light flux having passed through a photographic lens 20 and outputs image-capturing signals to an A/D conversion circuit 122 .
  • the A/D conversion circuit 122 converts the analog image-capturing signals to digital signals.
  • a buffer memory 123 image data resulting from the digital conversion are temporarily stored.
  • the CPU 101 executes compression processing for compressing the image data having undergone the image processing in a specific format, decompression processing for decompressing compressed image data and the like.
  • the buffer memory 123 is utilized to temporarily store data to undergo the image processing, data currently undergoing the image processing and data having undergone the image processing.
  • a recording medium 124 is constituted with a memory card or the like that can be detachably loaded in an electronic camera main unit 10 . Image data to be saved are recorded into the recording medium 124 .
  • a memory 102 is utilized by the CPU 101 as its work area.
  • An image reproduction circuit 103 which includes a frame memory, generates display data to be displayed at a display device 104 .
  • the display device 104 may be, for instance, a liquid crystal display monitor.
  • images constituted of display data stored in the frame memory and text information such as menus are reproduced and displayed by the image reproduction circuit 103 .
  • a range finding device 110 detects the adjustment state of the focal point position achieved through the photographic lens 20 and outputs a detection signal to the CPU 101 .
  • a lens drive device 111 drives a focus lens (not shown) included in the photographic lens 20 forward/backward along the optical axis in response to a command from the CPU 101 so as to adjust the focal point position of the photographic lens 20 .
  • the detection signal indicating the focal point adjustment state is used as distance information indicating the distance to the main subject.
  • An operating member 105 which includes a mode selector switch and a flash unit on/off switch (not shown), outputs an operation signal corresponding to a specific setting operation to the CPU 101 . Based upon the operation signal input from the operating member 105 , the CPU 101 executes setting change processing.
  • the mode selector switch outputs an operation signal in response to which the electronic camera is switched to, for instance, a photographing mode, a reproduction mode or a setup mode.
  • the photographing mode is an operation mode in which an image is photographed as the shutter release button (not shown) is pressed down
  • the reproduction mode is an operation mode in which an image constituted of image data recorded in the recording medium 124 is reproduced and displayed at the display device 104
  • the setup mode is an operation mode selected to perform menu operations or the like.
  • the electronic flash unit on/off switch outputs an operation signal indicating that light emission from the electronic flash unit 112 is to be allowed/disallowed.
  • the electronic flash unit 112 Upon receiving a light emission instruction from the CPU 101 in a light emission allowed state, the electronic flash unit 112 emits supplementary photographing light and illuminates the main subject. More specifically, in response to the light emission instruction issued by the CPU 101 , it releases an electrical charge stored in the main capacitor thereof (not shown) into a discharge tube 112 a constituted with a xenon tube or the like, thereby inducing a flash light emission at the xenon tube 112 a.
  • the present invention relates to a specific correction of the “red eye phenomenon” manifesting in an image photographed with the electronic camera described above.
  • the electronic camera achieved in the embodiment executes the red eye phenomenon correction on a photographed image under the following two sets of circumstances
  • the red eye correction processing executed in the photographing mode in case (1) above is now explained in reference to the flowchart ( FIG. 2 ) of the processing executed by the CPU 101 of the electronic camera.
  • the program in conformance to which the processing in FIG. 2 is executed is started up as the electronic camera set to execute the red eye correction processing photographs an image by emitting flash light with the electronic flash unit 112 and the digital image data are stored into the buffer memory 123 .
  • the setting for the red eye correction processing is preselected through a menu operation performed in the setup mode described above in the electronic camera.
  • step S 11 in FIG. 2 the CPU 101 reads out the image data having been stored in the buffer memory 123 and writes the image data thus read out in the work memory 102 , before the operation proceeds to step S 12 .
  • the image written in the memory 102 at this time has a data size (e.g., 2592 dots ⁇ 1944 dots) having been set in the electronic camera for the photographing operation, and such an image is referred to as a main image in this document.
  • step S 12 the CPU 101 generates a reduced image having a smaller data size (e.g., 1024 dots ⁇ 768 dots) compared to the main image and stores the reduced image into the memory 102 , before proceeding to step S 13 .
  • the reduced image thus stored into the memory is referred to as a sub image in this document.
  • the sub image is generated through sub-sampling processing or cull processing combined with interpolation processing, instead of the so-called simple sub-sampling processing, so as to ensure that the color component information indicating the “red eye” portions in the main image does not become culled through the reduction processing. It is to be noted that if the data size of the main image is smaller than 1024 dots ⁇ 768 dots, the main image should be utilized directly as the sub image.
  • step S 13 the CPU 101 starts a search for correction positions (positions at which the “red eye” portions are present in the sub image) by using the sub image (sub-sampled image), and then the operation proceeds to step S 14 .
  • the search for the correction positions is achieved by extracting the “red eye” portions contained in the sub image, for which the technology disclosed in Japanese Laid Open Patent Publication No. H 6-350914, for instance, may be adopted.
  • step S 14 the CPU 101 makes a decision as to whether or not the search has ended.
  • the CPU 101 proceeds to step S 16 upon making an affirmative decision in step S 14 if the “red eye” position search has been completed, whereas it makes a negative decision in step S 14 if the “red eye” position search has not been completed yet, to proceed to step S 15 .
  • step S 15 the CPU 101 makes a decision as to whether or not a timeout has occurred.
  • the CPU 101 makes an affirmative decision in step S 15 if a predetermined length of time (e.g., 3 sec) has elapsed since the search start and, in this case, the CPU 101 interrupts the search processing and proceeds to step S 22 . If, on the other hand, 3 seconds have not elapsed since the search start, the CPU 101 makes a negative decision in step S 15 and returns to step S 13 . In such a case, the “red eye” position search processing is continuously executed.
  • a predetermined length of time e.g. 3 sec
  • step S 16 the CPU 101 converts position information (correction position information) indicating the “red eye” portions in the sub image extracted through the “red eye” position search processing to position information on the main image, before proceeding to step S 17 . More specifically, it obtains through calculation coordinate information indicating the coordinates corresponding to the “red eyes” in the main image by using the coordinate information indicating the coordinates corresponding to the “red eyes” in the sub image. In other words, it obtains address information indicating the addresses at which the data corresponding to the “red eyes” are stored in the address space in the memory 102 in which the main image is written.
  • the CPU 101 After starting the red eye correction processing on the main image in step S 17 , the CPU 101 proceeds to step S 18 .
  • the red eye correction processing is executed on the data corresponding to the addresses ascertained as explained above in the main image written in the memory 102 .
  • the color of the “red eyes” having been extracted is converted to the normal pupil color by, for instance, adopting the technology disclosed in Japanese Laid Open Patent Publication No. H 6-350914.
  • step S 18 the CPU 101 makes a decision as to whether or not the correction has ended.
  • the CPU 101 makes an affirmative decision in step S 18 if the red eye correction has been completed to proceed to step S 20 , whereas it makes a negative decision in step S 18 if the red eye correction has not been completed to proceed to step S 19 .
  • step S 19 the CPU 101 makes a decision as to whether or not a timeout has occurred.
  • the CPU 101 makes an affirmative decision in step S 19 if a predetermined length of time (e.g., 3 sec) has elapsed since the correction start and, in this case, the CPU 101 interrupts the red eye correction processing and proceeds to step S 22 . If, on the other hand, 3 seconds have not elapsed since the correction start, the CPU 101 makes a negative decision in step S 19 and returns to step S 13 . In such a case, the “red eye” correction processing is continuously executed.
  • a predetermined length of time e.g. 3 sec
  • step S 22 the CPU 101 sets up a red eye correction incomplete flag before proceeding to step S 20 .
  • the red eye correction incomplete flag indicates that the search processing executed to locate the “red eye” positions or the red eye correction processing has not been completed yet.
  • step S 20 the CPU 101 executes processing for compressing the main image data to data in the JPEG format, and then the operation proceeds to step S 21 .
  • step S 21 the CPU 101 generates a data file containing the main image data having undergone the compression processing, records the data file thus generated into the recording medium 124 and then ends the processing in FIG. 2 .
  • the CPU 101 includes information needed to restore the main image having undergone the red eye correction processing to the pre-red-eye-correction main image (e.g., correction position information indicating the correction positions in the main image and the details of the correction achieved through the red eye correction processing) in the data file recorded into the recording medium 124 .
  • the red eye correction incomplete flag is set, the CPU 101 includes information indicating that the red eye correction incomplete flag is set in the data file recorded into the recording medium 124 .
  • the red eye correction processing executed in the reproduction mode in case (2) above is now explained in reference to the flowchart ( FIG. 3 ) of the processing executed by the CPU 101 of the electronic camera.
  • the program in conformance to which the processing in FIG. 3 is executed is started up as the electronic camera set to execute the red eye correction processing is switched to the reproduction mode. It is to be noted that the setting for the red eye correction processing is preselected through a menu operation performed in the setup mode described above in the electronic camera.
  • step S 51 in FIG. 3 the CPU 101 reads out one of the data files recorded in the recording medium 124 and then the operation proceeds to step S 52 .
  • Files are read out sequentially in, for instance, chronological order, with the data file having the oldest generation date/time read out first.
  • step S 52 the CPU 101 checks the data file in order to ascertain whether or not the red eye correction incomplete flag is set, and then the operation proceeds to step S 53 .
  • step S 53 the CPU 101 makes a decision as to whether or not the red eye correction processing is incomplete.
  • the CPU 101 makes an affirmative decision in step S 53 if the red eye correction incomplete flag is set, before proceeding to step S 54 .
  • the operation proceeds to step S 54 if the red eye correction processing needs to be executed. If, on the other hand, the presence of the red eye correction incomplete flag has been recognized, the CPU 101 makes a negative decision in step S 53 and proceeds to step S 61 .
  • the operation proceeds to step S 61 to read out the next data file.
  • step S 54 the CPU 101 reads out the image data recorded in the data file, writes the image data in the work memory 102 and then proceeds to step S 55 .
  • the image data first undergo decompression processing if they have been compressed and are then written, whereas uncompressed image data are directly written.
  • the image written in the memory 102 has the image data size (e.g., 2592 dots ⁇ 1944 dots) having been set in the electronic camera when the image was photographed, and this image is referred to as the main image.
  • step S 55 the CPU 101 generates a reduced image having a smaller data size (e.g., 1024 dots ⁇ 768 dots) compared to the main image and stores the reduced image into the memory 102 , before proceeding to step S 56 .
  • the reduced image thus stored into the memory is referred to as a sub image in this document.
  • the sub image is generated through sub-sampling processing or cull processing combined with interpolation processing, as in the photographing mode. If the data size of the main image is smaller than 1024 dots ⁇ 768 dots, the main image should be utilized directly as the sub image, as in the photographing mode.
  • step S 56 the CPU 101 starts a search for correction positions (positions at which the “red eye” portions are present in the sub image) by using the sub image (sub-sampled image), and then the operation proceeds to step S 57 . It is to be noted that timeout processing is not executed in the reproduction mode.
  • step S 57 the CPU 101 converts position information (correction position information) indicating the “red eye” portions in the sub image extracted through the “red eye” position search processing to position information on the main image, before proceeding to step S 58 .
  • the processing in step S 57 is executed in order to utilize the coordinate information indicating the coordinates corresponding to the “red eyes” detected in the sub image in conjunction with the main image.
  • step S 58 the CPU 101 executes the red eye correction processing on the main image and then the operation proceeds to step S 59 . It is to be noted that timeout processing is not executed in the reproduction mode.
  • step S 59 the CPU 101 executes processing for compressing the main image data having undergone the red eye correction processing to data in the JPEG format before proceeding to step S 60 . It is to be noted that if the pre-red-eye-correction main image data had not been compressed, the compression processing is skipped.
  • step S 60 the CPU 101 generates a data file containing the main image data and records the data file into the recording medium 124 through an overwrite before proceeding to step S 61 .
  • the CPU 101 includes information needed to restore the main image having undergone the red eye correction processing to the pre-red eye correction main image (e.g., correction position information indicating the correction positions in the main image and details of the correction achieved through the red eye correction processing) in the data file and deletes the information indicating that the red eye correction incomplete flag is set before recording the data file into the recording medium 124 .
  • information needed to restore the main image having undergone the red eye correction processing to the pre-red eye correction main image e.g., correction position information indicating the correction positions in the main image and details of the correction achieved through the red eye correction processing
  • step S 61 the CPU 101 makes a decision as to whether or not the last image file has been processed. If no more image data files are recorded in the recording medium 124 , the CPU 101 makes an affirmative decision in step S 61 and ends the processing in FIG. 3 . If another image data file is recorded in the recording medium 124 , the CPU 101 makes a negative decision in step S 61 and returns to step S 51 . Then, similar processing is executed on the other image data file.
  • the electronic camera set for the red eye correction processing executes the red eye correction processing before the data file containing the image is recorded into the recording medium 124 . Since it is not necessary to record two files, i.e., the pre-red-eye-correction processing data file and the post-red-eye-correction processing data file, into the recording medium 124 , a greater number of images can be recorded in the recording medium 124 compared to the number of images that can be recorded when both files need to be recorded. In addition, the length of time required to record the images into the recording medium 124 can be reduced.
  • the electronic flash unit 112 since the red eye correction is executed on the photographed image, the electronic flash unit 112 does not need to execute the preliminary light emission during the photographing operation in order to reduce the extent of the red eye phenomenon.
  • the photographing operation can be executed faster compared to a photographing operation during which the preliminary light emission needs to be executed, and since no preliminary light emission needs to be executed, the power consumption can be kept down.
  • the “red eye” portions are searched (S 13 ) by using the sub image with a smaller data size than the main image, position information indicating the positions corresponding to the “red eyes” in the main image is obtained through calculation based upon the position information obtained through the search (step S 16 ), and the correction processing is executed on the portion of the main image data corresponding to the calculated position information (S 17 ).
  • the length of time required to execute the search can be greatly reduced compared to the length of time required to search for the “red eye” portions by using the main image data.
  • the data size of the main image is 2592 dots ⁇ 1944 dots and the data size of the sub image is 1024 dots ⁇ 768 dots, far fewer dots need to be searched and thus, the length of search time can be reduced to approximately 1 ⁇ 6.
  • Patent Reference Literature 2 it is not necessary to photograph two images and consequently, the capacity of the memory used by the CPU to execute the arithmetic operations does not need to be large and the length of time required for the photographing operation, too, can be reduced.
  • step S 15 A decision is made as to whether or not a timeout has occurred (step S 15 , step S 19 ), and if the red eye correction processing (including the red eye portion search) needs to be executed longer than the predetermined length of time, the processing is interrupted. As a result, since protracted red eye correction processing does not delay the photographing operation for the next frame, a good photo opportunity is not missed.
  • the electronic camera set for the red eye correction processing sequentially executes red eye correction processing on data files having recorded therein the information indicating that the red eye correction processing is incomplete.
  • the user does not need to indicate to the electronic camera whether or not each data file needs to undergo the red eye correction processing. Since the electronic camera automatically executes the red eye correction processing on images that need to undergo the red eye correction among the data files recorded in the recording medium 124 , the operability of the electronic camera is improved.
  • a common memory may be used to constitute the buffer memory 123 and the work memory 102 .
  • the sub image used to detect the “red eye” portions may be generated by using the main image before undergoing white balance adjustment processing or the main image having undergone white balance adjustment processing.
  • information indicating that the red eye correction processing is currently in progress be displayed at the display device 104 during the red eye correction processing (including the red eye portion search), i.e., after the processing in step S 11 starts until the processing in step S 20 starts.
  • the information indicating that the red eye correction processing is currently in progress may be, for instance, an icon of an “eye” displayed over the freeze image.
  • While the processing in FIG. 3 starts as the electronic camera set for the red eye correction processing is switched to the reproduction mode, it may also start when the main switch of the electronic camera set in the reproduction mode is turned on and when the recording medium 124 is loaded into the electronic camera set in the reproduction mode.
  • the data size of the sub image does not need to be 1024 dots ⁇ 768 dots, and an optimal size setting may be selected in correspondence to the processing speed of the CPU 101 and the data size of the main image.
  • the data size of the sub image may be adjusted in correspondence to the photographing conditions, as well. For instance, the data size of the sub image may be adjusted in correspondence to the distance to the main subject.
  • the data size should be set to a larger value when the subject distance is significant since the face (particularly the eyes) of the main subject photographed in the image tends to range over a small area, whereas the data size should be set to a smaller value when the subject distance is small since the face of the main subject photographed in the image tends to range over a large area.
  • the detection signal provided by the range finding device 112 is used as the distance information indicating the distance to the main subject.
  • the data size of the sub image may be adjusted in correspondence to the focal length of the photographic lens.
  • the data size should be set to a larger value when the focal length is small since the face (particularly the eyes) of the main subject photographed in the image tends to range over a small area, whereas the data size should be set to a smaller value when the focal length is great since the face of the main subject photographed in the image tends to range over a large area.
  • the lens position detection signal provided by the lens drive device 111 or the like is used as the focal length information.
  • the data size of the sub image may be adjusted in correspondence to the specific photographing mode (e.g., a scene assist mode) set for the camera.
  • the data size of the sub image should be reduced for a portrait photographing operation since the face of a single subject photographed in the image ranges over a large area.
  • the data size of the sub image should be increased for a group picture in which the face of each subject photographed in the image ranges over a small area.
  • timeout processing is individually executed after starting the red eye portion search processing (step S 13 ) and after starting the red eye correction processing (step S 17 ), it may be executed after starting the position information conversion processing (step S 16 ), as well.
  • the timeout processing individually after starting the various types of processing, it is possible to interrupt the processing if execution of the red eye portion search, the sub image-to-main image position information conversion or the red eye correction processing goes on longer than the predetermined length of time. It is to be noted that a value other than 3 sec may be selected as appropriate for the predetermined length of time used in the timeout decision-making.
  • a red eye correction processing program in conformance to which the processing in FIG. 3 is executed may be prepared and the program may be taken into a personal computer or the like which is then enabled to function as a red eye image correction device.
  • the program should be loaded into a data storage device of the personal computer and the personal computer executing the loaded program functions as the red eye image correction device.
  • the program may be loaded by loading a recording medium having stored therein the program in the personal computer or via a network.
  • FIG. 4 shows how the program may be provided to a personal computer.
  • a personal computer 200 obtains the program via a CD-ROM 204 .
  • the personal computer 200 can also be connected with a communication line 201 .
  • a computer 202 is a server computer that provides the program stored in a recording medium such as a hard disk 203 .
  • the communication line 201 may be a communication line for Internet communication, personal computer communication or the like, or it may be a dedicated communication line.
  • the computer 202 reads out the program stored in the hard disk 203 and transmits the program thus read out to the personal computer 200 via the communication line 201 .
  • the program embodied as a data signal on a carrier wave is transmitted via the communication line 201 .
  • the program can be distributed as a computer-readable computer program product adopting any of various modes such as a recording medium and a carrier wave.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Ophthalmology & Optometry (AREA)
  • Human Computer Interaction (AREA)
  • Image Processing (AREA)
  • Studio Devices (AREA)
  • Image Analysis (AREA)
US11/049,731 2004-02-09 2005-02-04 Red eye image correction device, electronic camera and red eye image correction program product Abandoned US20050174448A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US12/149,433 US7812864B2 (en) 2004-02-09 2008-05-01 Red eye image correction device, electronic camera and red eye image correction program product

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2004-032452 2004-02-09
JP2004032452A JP4306482B2 (ja) 2004-02-09 2004-02-09 赤目画像補正装置、電子カメラおよび赤目画像補正プログラム

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US12/149,433 Continuation US7812864B2 (en) 2004-02-09 2008-05-01 Red eye image correction device, electronic camera and red eye image correction program product

Publications (1)

Publication Number Publication Date
US20050174448A1 true US20050174448A1 (en) 2005-08-11

Family

ID=34824208

Family Applications (2)

Application Number Title Priority Date Filing Date
US11/049,731 Abandoned US20050174448A1 (en) 2004-02-09 2005-02-04 Red eye image correction device, electronic camera and red eye image correction program product
US12/149,433 Expired - Fee Related US7812864B2 (en) 2004-02-09 2008-05-01 Red eye image correction device, electronic camera and red eye image correction program product

Family Applications After (1)

Application Number Title Priority Date Filing Date
US12/149,433 Expired - Fee Related US7812864B2 (en) 2004-02-09 2008-05-01 Red eye image correction device, electronic camera and red eye image correction program product

Country Status (3)

Country Link
US (2) US20050174448A1 (zh)
JP (1) JP4306482B2 (zh)
CN (1) CN100492154C (zh)

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060184520A1 (en) * 2005-02-17 2006-08-17 Canon Kabushiki Kaisha Image processing apparatus, control method thereof, program, and storage medium
US20060269128A1 (en) * 2005-05-24 2006-11-30 Samsung Electronics Co., Ltd. Image correction method and apparatus
US20070086652A1 (en) * 2005-10-14 2007-04-19 Samsung Electronics Co., Ltd. Apparatus, medium, and method with facial-image-compensation
US20070201742A1 (en) * 2006-02-16 2007-08-30 Nikon Corporation Camera with red-eye correction function
US20080181490A1 (en) * 2007-01-25 2008-07-31 Samsung Electronics Co., Ltd. Apparatus and method for generating image using multi-channel filter
US20080309785A1 (en) * 2007-06-14 2008-12-18 Masahiko Sugimoto Photographing apparatus
US20090128834A1 (en) * 2007-11-16 2009-05-21 Seiko Epson Corporation Image Processing Apparatus and Control Method Thereof
US8594454B2 (en) 2009-10-06 2013-11-26 Panasonic Corporation Image production device, reproduction device, reproduction system, image production method, and reproduction method
US20160048735A1 (en) * 2013-04-12 2016-02-18 Denso Corporation Eye open state determination device and eye open state determination method

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7450756B2 (en) * 2005-04-28 2008-11-11 Hewlett-Packard Development Company, L.P. Method and apparatus for incorporating iris color in red-eye correction
JP4773924B2 (ja) * 2006-10-24 2011-09-14 キヤノン株式会社 撮像装置及びその制御方法及びプログラム及び記憶媒体
JP4909009B2 (ja) * 2006-10-25 2012-04-04 キヤノン株式会社 撮像装置及び画像処理方法及びプログラム及び記憶媒体
JP2008311922A (ja) * 2007-06-14 2008-12-25 Fujifilm Corp 撮像装置
JP2008311921A (ja) * 2007-06-14 2008-12-25 Fujifilm Corp 撮像装置
JP5406958B2 (ja) * 2012-04-24 2014-02-05 富士フイルム株式会社 画像処理装置、方法及びプログラム
EP3398515B1 (de) * 2017-05-03 2020-06-24 Siemens Healthcare GmbH Adaptives verfahren zum erzeugen von artefaktreduzierten ct-bilddaten, sowie bilddatenrekonstruktionseinheit und entsprechendes computerprogrammprodukt.

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040196503A1 (en) * 2003-04-07 2004-10-07 Eastman Kodak Company Index print having a correction indicator thereon and a method of making the index print
US20040233301A1 (en) * 2003-05-23 2004-11-25 Fuji Photo Film Co., Ltd. Digital camera
US20040257456A1 (en) * 2003-06-17 2004-12-23 Goris Andrew C. Digital camera having nonvolatile memory for storing intermediate data associated with image processing
US20050047656A1 (en) * 2003-08-29 2005-03-03 Huitao Luo Systems and methods of detecting and correcting redeye in an image suitable for embedded applications
US20050062856A1 (en) * 2003-09-19 2005-03-24 Fuji Photo Film Co., Ltd. Camera equipped with red-eye correction feature

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH06350914A (ja) 1993-06-04 1994-12-22 Olympus Optical Co Ltd 赤目修正システム
JP2000299812A (ja) 1999-04-13 2000-10-24 Olympus Optical Co Ltd 電子撮像装置
JP2000305141A (ja) 1999-04-21 2000-11-02 Olympus Optical Co Ltd 電子カメラ
JP2001148780A (ja) 1999-09-07 2001-05-29 Fuji Photo Film Co Ltd 赤目修正対象領域の設定方法および赤目修正方法
EP1293933A1 (de) 2001-09-03 2003-03-19 Agfa-Gevaert AG Verfahren zum automatischen Erkennen von rote-Augen-Defekten in fotografischen Bilddaten
JP2003179807A (ja) 2001-12-13 2003-06-27 Fuji Photo Film Co Ltd 撮像装置
US7289664B2 (en) 2002-01-17 2007-10-30 Fujifilm Corporation Method of detecting and correcting the red eye
JP2005167697A (ja) 2003-12-03 2005-06-23 Canon Inc 赤目補正機能を有する電子カメラ

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040196503A1 (en) * 2003-04-07 2004-10-07 Eastman Kodak Company Index print having a correction indicator thereon and a method of making the index print
US20040233301A1 (en) * 2003-05-23 2004-11-25 Fuji Photo Film Co., Ltd. Digital camera
US20040257456A1 (en) * 2003-06-17 2004-12-23 Goris Andrew C. Digital camera having nonvolatile memory for storing intermediate data associated with image processing
US20050047656A1 (en) * 2003-08-29 2005-03-03 Huitao Luo Systems and methods of detecting and correcting redeye in an image suitable for embedded applications
US20050062856A1 (en) * 2003-09-19 2005-03-24 Fuji Photo Film Co., Ltd. Camera equipped with red-eye correction feature

Cited By (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7612808B2 (en) * 2005-02-17 2009-11-03 Canon Kabushiki Kaisha Image processing apparatus, control method thereof, program, and storage medium
US20060184520A1 (en) * 2005-02-17 2006-08-17 Canon Kabushiki Kaisha Image processing apparatus, control method thereof, program, and storage medium
US7855734B2 (en) 2005-02-17 2010-12-21 Canon Kabushiki Kaisha Image processing apparatus, control method thereof, program, and storage medium
US20100010972A1 (en) * 2005-02-17 2010-01-14 Canon Kabushiki Kaisha Image processing apparatus, control method thereof, program, and storage medium
US20060269128A1 (en) * 2005-05-24 2006-11-30 Samsung Electronics Co., Ltd. Image correction method and apparatus
US20070086652A1 (en) * 2005-10-14 2007-04-19 Samsung Electronics Co., Ltd. Apparatus, medium, and method with facial-image-compensation
US20070201742A1 (en) * 2006-02-16 2007-08-30 Nikon Corporation Camera with red-eye correction function
US20080181490A1 (en) * 2007-01-25 2008-07-31 Samsung Electronics Co., Ltd. Apparatus and method for generating image using multi-channel filter
US7986857B2 (en) 2007-01-25 2011-07-26 Samsung Electronics Co., Ltd. Apparatus and method for generating image using multi-channel filter
US20080309785A1 (en) * 2007-06-14 2008-12-18 Masahiko Sugimoto Photographing apparatus
US20110234851A1 (en) * 2007-06-14 2011-09-29 Masahiko Sugimoto Photographing apparatus
US9065998B2 (en) 2007-06-14 2015-06-23 Fujifilm Corporation Photographing apparatus provided with an object detection function
US9131138B2 (en) 2007-06-14 2015-09-08 Fujifilm Corporation Photographing apparatus
US20090128834A1 (en) * 2007-11-16 2009-05-21 Seiko Epson Corporation Image Processing Apparatus and Control Method Thereof
US8125680B2 (en) * 2007-11-16 2012-02-28 Seiko Epson Corporation Image processing apparatus and control method thereof
US8594454B2 (en) 2009-10-06 2013-11-26 Panasonic Corporation Image production device, reproduction device, reproduction system, image production method, and reproduction method
US20160048735A1 (en) * 2013-04-12 2016-02-18 Denso Corporation Eye open state determination device and eye open state determination method
US10095936B2 (en) * 2013-04-12 2018-10-09 Denso Corporation Eye open state determination device and eye open state determination method

Also Published As

Publication number Publication date
JP4306482B2 (ja) 2009-08-05
CN1655045A (zh) 2005-08-17
US20080211938A1 (en) 2008-09-04
US7812864B2 (en) 2010-10-12
CN100492154C (zh) 2009-05-27
JP2005223858A (ja) 2005-08-18

Similar Documents

Publication Publication Date Title
US7812864B2 (en) Red eye image correction device, electronic camera and red eye image correction program product
US6542192B2 (en) Image display method and digital still camera providing rapid image display by displaying low resolution image followed by high resolution image
US8587658B2 (en) Imaging device, image display device, and program with intruding object detection
US20030164890A1 (en) Image-capturing apparatus
JP4174404B2 (ja) 撮像装置、画像表示方法、プログラムおよび記憶媒体
US20050225650A1 (en) Image-capturing device
JP2010063085A (ja) 撮像装置及び撮影方法、プログラム
JP2000350087A (ja) ディジタル・スチル・カメラおよびその制御方法
US20020057294A1 (en) Information processing apparatus
JP3915285B2 (ja) 電子スチルカメラ及びその画像処理方法
JP2009038749A (ja) 画像処理装置、画像処理装置の制御方法、および、これを実行させるためのプログラム
JP2007282279A (ja) 情報処理装置および記録媒体
JP4518582B2 (ja) 画像撮像装置及び方法
JP2001094919A (ja) 画像記録装置、方法、及びコンピュータ読み取り可能な記憶媒体
JP4750634B2 (ja) 画像処理システム、画像処理装置、情報処理装置並びにプログラム
JPH10313438A (ja) 情報処理装置および記録媒体
JP2000299800A (ja) 撮像方法及び装置並びに記憶媒体
JP2005176272A (ja) 撮像方法及びその装置
JP4305473B2 (ja) 電子スチルカメラ、画像情報の消去方法及び画像情報の状態設定方法
JP2006253761A (ja) 撮像装置およびプログラム
JP2010028451A (ja) デジタルカメラおよびデジタルカメラを制御するプログラム
JP4520816B2 (ja) カメラ及び電子装置
JP2006191234A (ja) 撮像装置、動作状態提示方法、および動作状態提示プログラム
JP4571111B2 (ja) 情報処理装置および記録媒体
JP3633264B2 (ja) 撮像装置及び被写体データ記録方法

Legal Events

Date Code Title Description
AS Assignment

Owner name: NIKON CORPORATION, JAPAN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:KUBOI, MOTOYUKI;REEL/FRAME:016243/0054

Effective date: 20050201

STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION