CN1663287A - Method and system for white balancing images using facial color as a reference signal - Google Patents

Method and system for white balancing images using facial color as a reference signal Download PDF

Info

Publication number
CN1663287A
CN1663287A CN038146711A CN03814671A CN1663287A CN 1663287 A CN1663287 A CN 1663287A CN 038146711 A CN038146711 A CN 038146711A CN 03814671 A CN03814671 A CN 03814671A CN 1663287 A CN1663287 A CN 1663287A
Authority
CN
China
Prior art keywords
skin
face
colour
signal
digital picture
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN038146711A
Other languages
Chinese (zh)
Inventor
Y·-T·林
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Koninklijke Philips NV
Original Assignee
Koninklijke Philips Electronics NV
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Koninklijke Philips Electronics NV filed Critical Koninklijke Philips Electronics NV
Publication of CN1663287A publication Critical patent/CN1663287A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/80Camera processing pipelines; Components thereof
    • H04N23/84Camera processing pipelines; Components thereof for processing colour signals
    • H04N23/88Camera processing pipelines; Components thereof for processing colour signals for colour balance, e.g. white-balance circuits or colour temperature control
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00Details of colour television systems
    • H04N9/64Circuits for processing colour signals
    • H04N9/73Colour balance circuits, e.g. white balance circuits or colour temperature control
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30196Human being; Person
    • G06T2207/30201Face

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Processing Of Color Television Signals (AREA)
  • Color Television Image Signal Generators (AREA)
  • Image Processing (AREA)
  • Facsimile Image Signal Circuits (AREA)
  • Color Image Communication Systems (AREA)

Abstract

A system for white balancing images using facial color as a reference signal is provided. The system includes a face detector that is operable to receive a digital image and to detect a human face within the digital image. A skin tone extractor is operable to extract a skin tone from the digital image. The extracted skin tone is associated with a human face detected by the face detector. A skin tone comparator is operable to access reference skin tones and to compare the extracted skin tone to the reference skin tones in order to identify a reference skin tone corresponding to the extracted skin tone. A balance parameter generator is operable to generate a balance parameter based on the extracted skin tone and the corresponding reference skin tone. The balance parameter is operable to be applied to the digital image to white balance the digital image.

Description

Use face color to come the method and system of white balance image as the reference signal
The present invention relates generally to processing system for video, and in more detail, relate to a kind of method and system that uses face color to come the white balance image as the reference signal.
From the color in digital camera or portable video camera or the image that on the monitor of video screen or personal computer, shows because a variety of causes presents difference through being everlasting between each image.In order between each image, to keep constant coloured appearance, often use the technology that is called white balance.Use this technology, with the white in the imaging scene as a reference, make whole scene carry out the color adjustment according to this white.
The white balance of traditional digital picture provides by manual and automated manner.For manual white balance, imaging device is typically aimed at supposition reference surface for white under white illumination.For Automatic white balance, usually there is the bright spot in white object and the general white object correspondence image in supposition in the imaging scene.Use the white object of supposition to carry out white balance then as reference.But, when white object in fact not in the imaging scene or bright spot when not belonging to the white surface of reference, this technology can be adjusted image with leading to errors.
According to the present invention, provide a kind of face color of using to come the method and system of white balance image as the reference signal, eliminate basically or reduced shortcoming and the problem relevant with legacy system and method.Especially, can replace white object end user face to provide Automatic white balance as color reference, the scene that makes white object wherein not have to occur can be by color adjustment correctly.
According to one embodiment of the present of invention, provide a kind of face color of using to come the system of white balance image as the reference signal, this system comprises face detector, skin tone extractor, a plurality of reference skin tones, skin tone comparator and balance parameter generator.Face detector is used to receive digital picture and detects the interior people's face of digital picture.Skin tone extractor is used to extract all constant face color model to each race.Skin tone extractor connects face detector.Skin tone extractor is used for extracting the colour of skin from digital picture.The colour of skin of extracting is related with people's face that face detector detects.Skin tone comparator connects skin tone extractor.Skin tone comparator is used to visit the colour of skin and the reference skin tones of reference skin tones and relatively extraction, so that identification is corresponding to the reference skin tones of extracting the colour of skin.The balance parameters generator connects skin tone comparator.The balance parameters generator is used for producing balance parameters according to the colour of skin of extracting and the corresponding reference colour of skin.Balance parameters is applied to digital picture and comes the white balance digital picture.
According to another embodiment of the present invention, provide a kind of method of using face color to come the white balance image as the reference signal.This method comprises the white balance input signal of reception from digital picture.Carry out the relevant judgement that whether in input signal, detects people's face.When in input signal, detecting face, extract the colour of skin of the face of detecting.The colour of skin and a plurality of reference skin tones extracted are relatively discerned the corresponding reference colour of skin.Produce balance parameters according to the colour of skin of extracting and the corresponding reference colour of skin.
The technological merit of one or more embodiment of the present invention comprises the method that improved Automatic white balance image is provided.In certain embodiments, with respect to white object, people's face is used as color reference in the imaging scene.As a result, wherein the white object scene that do not have to occur can be according to people's face by color adjustment correctly.
Other technological merit will easily be found out by those skilled in the art from the following drawings, explanation and claim.
Before being elaborated, the definition that proposes some word and expression use in whole this patent document is favourable: term " comprises " and " comprising " and derivative thereof mean and comprise rather than limit; Term " or " included, mean and/or; Phrase " association " and " related with it " and derivative thereof can mean and comprise, be comprised, connect, comprise, involved, be connected to or link to each other, be coupled or be coupled, communicate by letter, cooperate, insert and put, approaching, adjacent or adjacent to, have, have, have characteristic or the like; And term " controller " means any device, system or its part of controlling at least one operation, and such device can be at hardware, firmware or software or at least wherein realized in certain combination of two.Should illustrate that the function related with any specific controller can be centralized or distributed, no matter be this locality or remote control.Especially, controller can comprise one or more data processors and related input/output device and memory, carries out one or more application programs and/or operating system program.To providing in whole this patent document of being defined in of certain words and phrase, it should be understood by one skilled in the art that this defines priority application in many (if not most examples), and use also like this future of the word and expression of definition like this.
For the more fully understanding of the present invention and advantage thereof, with reference now to the explanation below in conjunction with respective drawings, wherein identical reference number is represented identical part, wherein:
Fig. 1 is that explanation is used for using face color that the block diagram of video camera of the white balance of image is provided as the reference signal according to one embodiment of the present of invention;
Fig. 2 A is that explanation is used for using face color that the block diagram of computer generated image system of the white balance of image is provided as the reference signal according to one embodiment of the present of invention;
To be explanation by the computer generated image system of Fig. 2 A make Fig. 2 B is used for providing as the reference signal with face color according to one embodiment of the present of invention the block diagram of white balance application of the white balance of image; With
Fig. 3 is that explanation is used the flow chart of face color as the white balance method of the image of reference signal according to one embodiment of the present of invention in the computer generated image system of the video camera of Fig. 1 or Fig. 2.
Fig. 1 that discusses below-3 and being used for illustrates each embodiment only explanation and the scope that should not be construed as limiting the invention by any way as an example of the principle of the invention of this patent document.In with the lower part, the present invention will illustrate in three embodiment: digital camera, digital television and computer generated image system.But this only is used for should not be construed as by any way for example limiting the scope of the invention.It will be appreciated by those skilled in the art that principle of the present invention can implement in the image processing system of any suitable configuration.
Fig. 1 is that explanation is used for using face color that the block diagram of video camera 100 of the white balance of image is provided as the reference signal according to one embodiment of the present of invention.Video camera 100 can comprise that digital camera, digital portable video camera or any other are used for the video camera of the suitable type of processing digital images.
Video camera 100 comprises imageing sensor 102, analog to digital converter 104, image processor 106 and white balance module 110.Imageing sensor 102 is used to receive the incident image 120 based on the light of the scene reflectivity that writes down from video camera 100 location.Imageing sensor 102 also is used for producing analog signal 122 and analog signal 122 being offered analog to digital converter 104 from incident image 120.
Analog to digital converter 104 is used to receive analog signal 122 and is used for image processor 106 from analog signal 122 generation digital signals 124.Image processor 106 is used for receiving digital signals 124 and digital signal 124 is carried out additional treatments producing displayable image 126.Displayable image 126 can record in video camera 100 in the storage device 128, for example compact flash cards, intelligent multimedia card, memory stick etc., and/or can offer external system and come record.
Analog to digital converter 104 also is used for producing digital incoming frame 130 from analog signal 122 and is used for white balance module 110, and image processor 106 is used for from white balance module 110 receiving balance parameters 132, and balance parameters 132 is applied to displayable image 126, so that white balance displayable image 126.
White balance module 110 comprises face detector 140, skin tone extractor 142, skin tone comparator 144, balance parameters generator 146 and reference skin tones 148.According to an embodiment, white balance module 110 may be incorporated in the automatic gain parts (not shown in figure 1) of full luminance that is used for adjusting the image of being caught by video camera 100 of video camera 100.
Face detector 140 is used to receive at least one incoming frame 130 from analog to digital converter 104, and judges in the incoming frame 130 people's face whether occurs.Face detector 140 can be carried out this judgement according to face detection algorithms or any suitable process that other is used to detect the people's face in the digital picture based on brightness.
If face detector 140 detects people's face in incoming frame 130, then face detector 140 also is used to skin tone extractor 142 to produce the face signal 150 that detects.The face signal 150 that detects can comprise from incoming frame 130 data corresponding with the face of detecting, be used to discern coordinate or other finger URL or any other appropriate signals of the position of the faces of detections in the incoming frame 130.
Skin tone extractor 142 is used to extract all constant face color model to each race.Skin tone extractor 142 is used to receive the face signal 150 of detection, and extracts the colour of skin that detects face according to the face signal 150 that detects.Skin tone extractor 142 also is used to skin tone comparator 144 to produce the skin tone signal of extracting 152.The skin tone signal of extracting 152 can comprise that identification detects the data of the extraction colour of skin of face.
Skin tone comparator 144 is used to receive the skin tone signal 152 of extraction, and relatively by the extraction colour of skin of skin tone signal 152 identifications of extracting with as a plurality of colours of skin with reference to the colour of skin 148 storages.Skin tone comparator 144 also is used for according to extracting the colour of skin and the corresponding reference colour of skin 148 thereof, for balance parameters generator 146 produces comparison signal 154.
The corresponding reference colour of skin 148 comprises such reference skin tones 148, it comprises the true colour of skin that presents as it in normal illumination, and extract the colour of skin comprise as it be shown as 102 that catch by the imageing sensor of video camera 100, because the colour of skin that actual illumination presents when not having the displayable image 126 of white balance.Comparison signal 154 can comprise that data or any other of the difference between data, the identification extraction colour of skin and the corresponding reference colour of skin 148 of the identification extraction colour of skin and the corresponding reference colour of skin 148 are used to make balance parameters generator 146 can produce the proper data of balance parameters 132.
Balance parameters generator 146 is used to receive comparison signal 154, and is that image processor 106 produces balance parameters 132 according to comparison signal 154.According to an embodiment, by reference signal is replaced with reference skin tones from reference white color, balance parameters generator 146 can be used for according to U.S. Patent No. 6,069, and disclosed principle produces balance parameters 132 in 972.Balance parameters 132 can should be used for the displayable image 126 that white balance produces by image processor 106 by image processor 106.
Though face detector 140, skin tone extractor 142, skin tone comparator 144, balance parameters generator 146 and reference skin tones 148 illustrate and are described as resolution element, but be appreciated that any or all these elements 140,142,144,146 and/or 148 can not depart from the scope of the present invention and are implemented in together.In addition, reference skin tones 148 can provide outside white balance module 110.For example, can be stored in can be from the medium that video camera 100 is removed for reference skin tones 148.
In addition, any or all face detector 140, skin tone extractor 142, skin tone comparator 144 and balance parameter generator 146 can comprise the logic that is coded in the medium.This logic comprises the function command of program tasks.This medium comprises computer disks or other computer-readable medium, application-specific integrated circuit (ASIC), field programmable gate array, digital signal processor, other suitable special use or general processor, transmission medium or codified and utilize other suitable medium of logic therein.
Fig. 2 A is that explanation is used for using face color that the block diagram of computer generated image system 300 of the white balance of image is provided as the reference signal according to one embodiment of the present of invention.According to an embodiment, computer generated image system 300 comprises personal computer 302, display 304, optional loud speaker 306 and at least one input unit, for example keyboard 308 and/or pointing device 310.
Personal computer 302 can comprise CD (CD) read-only memory (ROM) driving 320, hard drive (HDD) 322, CPU (CPU) 324, random-access memory (ram) 326, I/O (I/O) interface (IF) circuit 328 and video/audio interface (IF) circuit 330.CD-ROM drives 320 and is used for reception and reads removable CD-ROM dish 332.
Display 304 comprises the computer monitor of personal computer 302.Display 304 can comprise that cathode-ray tube shiels, LCDs, panel display screen, plasma panel, projection display screen or any other are suitable for the device of display image.Display 304 comprises the screen 340 that is used to show the video image that may comprise people's face.
Hard drive 322 is used to provide to operating system program, application program and is used for the visit of the data of information storage and retrieval.Keyboard 308 is connected personal computer 302 with pointing device 310 through I/O IF circuit 328.Pointing device 310 can comprise mouse or other be used to make the user can with the interactive suitable equipment in the specific region of screen 340.
Display 304 is connected personal computer 302 with loud speaker 306 through video/audio IF circuit 330.The inner member of personal computer 302 comprises CD-ROM driving 320, hard drive 322, CPU 324, RAM 326, I/O IF circuit 328 and video/audio IF circuit 330, interconnects and intercommunication mutually through communication bus 344.
Be described in more detail as following, CPU 324 is used to call white balance module so that correctly adjust the color of the object that occurs on the screen 340.White balance module is in conjunction with the work that should be used for of any generation vision signal that other is carried out in personal computer 302, and for example the RF TV signal of fluidisation Video Applications, MPEG or AVI player, reception and demodulation input is with video card of producing baseband video signal or the like.According to one embodiment of the present of invention, the white balance module of being carried out by CPU 324 can be stored among 332,3.5 inches moveable magnetic disc (not shown in figure 1)s of CD-ROM, the RAM 326 or any other suitable position.Therefore, for an embodiment, RAM 326 can be used for storage operating system program, fluidisation video application, MPEG/AVI player application and white balance module.
To be explanation by computer generated image system 300 make Fig. 2 B is used for using face color that the block diagram of white balance module 350 of the white balance of image is provided as the reference signal according to one embodiment of the present of invention.White balance module 350 is used to receive the incoming frame 352 from being presented at the vision signal on the display 304 by computer 302, and produces balance parameters 354 according to incoming frame 352.White balance module 350 comprises face detector 360, skin tone extractor 362, skin tone comparator 364, balance parameters generator 366 and reference skin tones 368.
Face detector 360 is used to receive at least one incoming frame 352 from being presented at the vision signal on the display 304 by computer 302, and judges in the incoming frame 352 people's face whether occurs.Face detector 360 can be carried out this judgement according to face detection algorithms or any suitable process that other is used to detect the people's face in the digital picture based on brightness.
If face detector 360 detects people's face in incoming frame 352, then face detector 360 also is used to skin tone extractor 362 to produce the face signal 370 that detects.The face signal 370 that detects can comprise with from the corresponding data of incoming frame 352 and the face of detecting, be used to discern coordinate or other finger URL or any other appropriate signals of the face positions of incoming frame 352 interior detections.
Skin tone extractor 362 is used to extract all constant face color model to each race.Skin tone extractor 362 is used to receive the face signal 370 of detection, and extracts the colour of skin that detects face according to the face signal 370 that detects.Skin tone extractor 362 also is used to skin tone comparator 364 to produce the skin tone signal of extracting 372.The skin tone signal of extracting 372 can comprise that identification detects the data of the extraction colour of skin of face.
Skin tone comparator 364 is used to receive the skin tone signal 372 of extraction, and relatively by the extraction colour of skin of skin tone signal 372 identifications of extracting with as a plurality of colours of skin with reference to the colour of skin 368 storages.Skin tone comparator 364 also is used for producing comparison signal 374 according to extracting the colour of skin and the corresponding reference colour of skin 368 thereof for balance parameters generator 366.
The corresponding reference colour of skin 368 comprises such reference skin tones 368, and it comprises the true colour of skin that presents as it in normal illumination, comprises the colour of skin that presents as it and extract the colour of skin when not having white balance to show by display 304.Comparison signal 374 can comprise that data or any other of the difference between data, the identification extraction colour of skin and the corresponding reference colour of skin 368 of the identification extraction colour of skin and the corresponding reference colour of skin 368 are used to make balance parameters generator 366 can produce the proper data of balance parameters 364.
Balance parameters generator 366 is used to receive comparison signal 374, and produces balance parameters 354 according to comparison signal 374.According to an embodiment, by reference signal is replaced with reference skin tones from reference white color, balance parameters generator 366 can be used for according to U.S. Patent No. 6,069, and disclosed principle produces balance parameters 354 in 972.Balance parameters 354 can be used to the image that white balance shows on display 304.
Though face detector 360, skin tone extractor 362, skin tone comparator 364, balance parameters generator 366 and reference skin tones 368 illustrate and are described as resolution element, but be appreciated that any or all these elements 360,362,364,366 and/or 368 can not depart from the scope of the present invention and are implemented in together.In addition, reference skin tones 368 can provide outside white balance module 35 0.For example, reference skin tones 368 can be stored in can be from the medium that computer 302 is removed, in RAM 326 or other the suitable position, and the remainder of white balance module 350 provides elsewhere.
In addition, any or all face detector 360, skin tone extractor 362, skin tone comparator 364 and balance parameter generator 366 can comprise the logic that is coded in the medium.This logic comprises the function command of program tasks.This medium comprises computer disks and other computer-readable medium, application-specific integrated circuit (ASIC), field programmable gate array, digital signal processor, other suitable special use or general processor, transmission medium or codified and utilize other suitable medium of logic therein.
Fig. 3 is that explanation is used the flow chart of face color as the white balance method of the image of reference signal according to one embodiment of the present of invention in video camera 100, computer generated image system 3 00 or any other suitable imaging system.This method wherein receives white balance input signal 130,352 from digital picture in step 400 beginning.In step 402, attempt detecting the people's face in the input signal 130,352.
In decision steps 404, carry out the relevant judgement that whether in input signal 130,352, detects face.If in input signal 130,352, do not detect face, method along branch not from decision steps 404 to step 406.In step 406, can selectively carry out any suitable alternative white balance process, afterwards, this method finishes.
Get back to decision steps 404, if in input signal 130,352, detect face, method along be branch from decision steps 404 to step 408.In step 408, extract the colour of skin of the face of detecting.In step 410, the colour of skin of extraction and reference skin tones 148,368 compare with the identification corresponding reference colour of skin 148,368.
In step 414, produce balance parameters 132,354 according to the colour of skin of extracting and the corresponding reference colour of skin 148,368.In step 416, balance parameters 132,354 is applied to digital picture, so that the white balance digital picture.In step 418, can show digital picture through white balance, this method finishes afterwards.
Like this, when the balance parameters 132,354 according to the colour of skin of extracting and 148,368 generations of the corresponding reference colour of skin is applied to whole digital picture, for the color that digital picture shows can all be proofreaied and correct.By this way, can come the whole digital picture of white balance according to the colour of skin of the people's face in the digital picture of using corresponding reference skin tones 148,368 to proofread and correct.
Though the present invention has been described, can have made those skilled in the art expect variations and modifications with several embodiment.Promptly the present invention includes this interior variation and the modification of scope that falls into claims.

Claims (20)

1. one kind is used face color to come the system of white balance image as the reference signal, comprising:
Face detector (140) is used to receive digital picture and detects the interior people's face of digital picture;
Be connected to the skin tone extractor (142) of face detector (140), this skin tone extractor (142) is used for extracting the colour of skin from digital picture, and the colour of skin of extraction is related with the people's face that is detected by face detector (140);
A plurality of reference skin tones (148);
Be connected to the skin tone comparator (144) of skin tone extractor (142), this skin tone comparator (144) is used to visit the colour of skin and the reference skin tones (148) of reference skin tones (148) and relatively extraction, so that identification is corresponding to the reference skin tones (148) of extracting the colour of skin; With
Be connected to the balance parameters generator (146) of skin tone comparator (144), this balance parameters generator (146) is used for producing balance parameters (132) according to the colour of skin of extracting and the corresponding reference colour of skin (148), and balance parameters (132) is applied to digital picture and comes the white balance digital picture.
2. system as claimed in claim 1, described face detector (140) are used for according to the people's face that detects based on the face detection algorithms of brightness in the digital picture.
3. system as claimed in claim 1, described face detector (140) are that skin tone extractor (142) produces the face signal (150) that detects when being used for detecting face in digital picture.
4. system as claimed in claim 3, the face signal of described detection (150) comprise from the data corresponding to the digital picture of the face of detecting.
5. system as claimed in claim 3, the face signal of described detection (150) comprise the finger URL of the position of the face that is used for the detection in the discriminating digit image.
6. it is that skin tone comparator (144) produces the skin tone signal of extracting (152) that system as claimed in claim 1, described skin tone extractor (142) are used for according to the colour of skin of extracting, and the skin tone signal of extraction (152) comprises the data of the colour of skin of identification extraction.
7. system as claimed in claim 1, described skin tone comparator (144) are used to balance parameters generator (146) to produce comparison signal (154), and comparison signal (154) comprises the colour of skin of identification extraction and the data of the corresponding reference colour of skin (148).
8. system as claimed in claim 1, described skin tone comparator (144) are used to balance parameters generator (146) to produce comparison signal (154), and comparison signal (154) comprises the colour of skin of identification extraction and the data of the difference between the corresponding reference colour of skin (148).
9. one kind is used face color as the method that the reference signal comes the white balance image, comprising:
Reception is from the white balance input signal (130) of digital picture;
Judge and whether in input signal (130), detect people's face;
When in input signal (130), detecting face, extract the colour of skin of the face of detecting;
Relatively the colour of skin of Ti Quing and a plurality of reference skin tones (148) are with the identification corresponding reference colour of skin (148); With
Produce balance parameters (132) according to the colour of skin of extracting and the corresponding reference colour of skin (148).
10. method as claimed in claim 9 further comprises balance parameters (132) is applied to digital picture so that the white balance digital picture.
11. method as claimed in claim 9 further comprises the digital picture of demonstration through white balance.
12. method as claimed in claim 9 further comprises and carry out the white balance process that substitutes when not detecting face in input signal (130).
13. method as claimed in claim 9 further comprises producing the face signal that detects when detecting face in digital picture (130).
14. method as claimed in claim 9 judges that whether detecting people's face in input signal (130) is included in the last face detection algorithms of carrying out based on brightness of input signal (130).
15. one kind is used face color to come the system of white balance image as the reference signal, comprising:
The accessible medium of computer; With
Be stored in the logic on the accessible medium of computer, this logic is used to receive the white balance input signal (130) from digital picture, judge and whether in input signal (130), detect people's face, when in input signal (130), detecting face, extract the colour of skin of the face of detecting, relatively the colour of skin of Ti Quing and a plurality of reference skin tones (148) produce balance parameters (132) with the identification corresponding reference colour of skin (148) with according to the colour of skin of extracting and the corresponding reference colour of skin (148).
16. as the system of claim 15, described logic is further used for balance parameters (132) is applied to digital picture so that the white balance digital picture.
17. as the system of claim 15, described logic is further used for showing the digital picture through white balance.
18. as the system of claim 15, described logic is further used for carrying out the white balance process that substitutes when not detecting face in input signal (130).
19. as the system of claim 15, described logic is further used for producing the face signal that detects when detecting face in input signal (130).
20. as the system of claim 15, described logic is used for by going up to carry out to judge whether detect people's face at input signal (130) based on the face detection algorithms of brightness at input signal (130).
CN038146711A 2002-06-25 2003-06-16 Method and system for white balancing images using facial color as a reference signal Pending CN1663287A (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US10/179,360 US6975759B2 (en) 2002-06-25 2002-06-25 Method and system for white balancing images using facial color as a reference signal
US10/179360 2002-06-25

Publications (1)

Publication Number Publication Date
CN1663287A true CN1663287A (en) 2005-08-31

Family

ID=29734890

Family Applications (1)

Application Number Title Priority Date Filing Date
CN038146711A Pending CN1663287A (en) 2002-06-25 2003-06-16 Method and system for white balancing images using facial color as a reference signal

Country Status (7)

Country Link
US (1) US6975759B2 (en)
EP (1) EP1518417A1 (en)
JP (1) JP4219893B2 (en)
KR (1) KR100981697B1 (en)
CN (1) CN1663287A (en)
AU (1) AU2003237013A1 (en)
WO (1) WO2004002166A1 (en)

Cited By (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101166286B (en) * 2006-10-20 2010-06-02 索尼株式会社 Image pickup device and method, image processing device and method
CN101179746B (en) * 2006-11-06 2010-12-22 索尼株式会社 Image processing device and image processing method
CN1992820B (en) * 2005-12-27 2010-12-22 三星数码影像株式会社 Digital still cameras with face detection to aid in exposure compensation
CN101527860B (en) * 2008-03-04 2011-06-15 佳能株式会社 White balance control apparatus, control method therefor, and image sensing apparatus
US8005298B2 (en) 2006-12-22 2011-08-23 Canon Kabushiki Kaisha Image processing apparatus and method thereof
CN101389039B (en) * 2007-09-11 2012-04-04 佳能株式会社 Image processing apparatus and image processing method and imaging apparatus
CN102077245B (en) * 2008-06-26 2014-11-12 惠普开发有限公司 Face detection processing method, image processing device, and manufactured product
CN104735362A (en) * 2015-03-11 2015-06-24 广东欧珀移动通信有限公司 Picture taking method and device
WO2015109693A1 (en) * 2014-01-22 2015-07-30 中兴通讯股份有限公司 Method and system for image color calibration
CN105409211A (en) * 2013-08-26 2016-03-16 英特尔公司 Auto white balance with skin tone correction for image processing
CN106097261A (en) * 2016-06-01 2016-11-09 广东欧珀移动通信有限公司 Image processing method and device
CN106973278A (en) * 2014-11-11 2017-07-21 怀效宁 A kind of AWB device and method with reference to face color character
CN107277479A (en) * 2017-07-10 2017-10-20 广东欧珀移动通信有限公司 White balance processing method and device
CN107465903A (en) * 2017-09-08 2017-12-12 广东欧珀移动通信有限公司 Image white balance method, device and computer-readable storage medium
CN107635124A (en) * 2017-10-31 2018-01-26 广东欧珀移动通信有限公司 White balance processing method, device and equipment for face shooting
CN108024107A (en) * 2017-12-06 2018-05-11 广东欧珀移动通信有限公司 Image processing method, device, electronic equipment and computer-readable recording medium
CN109495731A (en) * 2017-09-13 2019-03-19 三星电子株式会社 Auto white balance method is used for by what image-signal processor executed
CN110570476A (en) * 2018-06-06 2019-12-13 英属开曼群岛商玩美股份有限公司 System, method and storage medium for execution on computing device
CN111626959A (en) * 2020-05-28 2020-09-04 深圳康佳电子科技有限公司 Image processing method, terminal and storage medium
CN113177886A (en) * 2021-04-14 2021-07-27 RealMe重庆移动通信有限公司 Image processing method, image processing device, computer equipment and readable storage medium

Families Citing this family (42)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4045929B2 (en) * 2002-11-18 2008-02-13 セイコーエプソン株式会社 Automatic image quality adjustment according to subject size
US20040179228A1 (en) * 2003-03-10 2004-09-16 Mccluskey Mark Indication of image content modification
US20040208363A1 (en) * 2003-04-21 2004-10-21 Berge Thomas G. White balancing an image
CN1781319A (en) * 2003-05-01 2006-05-31 精工爱普生株式会社 Color balance adjustment after weighing the color reproduction of a specific color
DE60314851D1 (en) * 2003-05-19 2007-08-23 St Microelectronics Sa Image processing method for numerical images with exposure correction by detection of skin areas of the object
US7844076B2 (en) * 2003-06-26 2010-11-30 Fotonation Vision Limited Digital image processing using face detection and skin tone information
JP4424216B2 (en) * 2004-03-30 2010-03-03 セイコーエプソン株式会社 Image processing apparatus, image processing method, and image processing program
JP4154400B2 (en) * 2004-04-01 2008-09-24 キヤノン株式会社 Imaging apparatus, control method thereof, and program
JP4284448B2 (en) 2005-01-28 2009-06-24 富士フイルム株式会社 Image processing apparatus and method
JP4371069B2 (en) * 2005-03-16 2009-11-25 セイコーエプソン株式会社 Color balance correction according to the color cast tendency
US7869630B2 (en) * 2005-03-29 2011-01-11 Seiko Epson Corporation Apparatus and method for processing image
JP4217698B2 (en) * 2005-06-20 2009-02-04 キヤノン株式会社 Imaging apparatus and image processing method
JP5119921B2 (en) * 2005-07-19 2013-01-16 コニカミノルタホールディングス株式会社 Image processing apparatus, image processing system, and image processing program
JP2007036462A (en) * 2005-07-25 2007-02-08 Fujifilm Holdings Corp Image processing apparatus
KR100735549B1 (en) * 2005-08-08 2007-07-04 삼성전자주식회사 An image processing method and apparatus for converting skin color of an image
JP4750520B2 (en) * 2005-09-21 2011-08-17 富士フイルム株式会社 Human image correction apparatus and method
US8103094B2 (en) * 2005-09-22 2012-01-24 Adobe Systems Incorporated Color correction based on skin color
JP4718952B2 (en) * 2005-09-27 2011-07-06 富士フイルム株式会社 Image correction method and image correction system
JP4542013B2 (en) * 2005-09-29 2010-09-08 富士フイルム株式会社 Print order system, program, program storage medium, and print order server
JP2007110576A (en) * 2005-10-17 2007-04-26 Fujifilm Corp Subject image data color correction apparatus and control method thereof
US20080231726A1 (en) * 2007-03-23 2008-09-25 Motorola, Inc. Apparatus and method for image color correction in a portable device
US7800783B2 (en) * 2007-05-25 2010-09-21 Hong Kong Applied Science And Technology Research Institute Co. Ltd. Auto white balancing by modified grey world and geometric distortion measurement
JP4702635B2 (en) * 2007-07-17 2011-06-15 富士フイルム株式会社 AUTO WHITE BALANCE CORRECTION VALUE CALCULATION DEVICE, METHOD, PROGRAM, AND IMAGING DEVICE
JP5113514B2 (en) * 2007-12-27 2013-01-09 キヤノン株式会社 White balance control device and white balance control method
JP4384240B2 (en) * 2008-05-28 2009-12-16 株式会社東芝 Image processing apparatus, image processing method, and image processing program
JP2010003118A (en) * 2008-06-20 2010-01-07 Seiko Epson Corp Image processing apparatus, image processing method and image processing program
KR20100056270A (en) * 2008-11-19 2010-05-27 삼성전자주식회사 Digital image signal processing method for color correction and digital image signal processing apparatus for applying the method
JP4748271B2 (en) * 2009-01-28 2011-08-17 株式会社ニコン Electronic camera and image processing program
US20100245617A1 (en) * 2009-03-31 2010-09-30 Gary Stephen Shuster Automated white balancing in digital photography
JP2011090569A (en) * 2009-10-23 2011-05-06 Sony Corp Image processing apparatus and image processing method
JP5214749B2 (en) * 2011-01-26 2013-06-19 富士フイルム株式会社 AUTO WHITE BALANCE CORRECTION VALUE CALCULATION DEVICE, METHOD, PROGRAM, AND IMAGING DEVICE
KR101896386B1 (en) * 2011-11-22 2018-09-11 삼성전자주식회사 Device and method for adjusting white balance
US9118876B2 (en) * 2012-03-30 2015-08-25 Verizon Patent And Licensing Inc. Automatic skin tone calibration for camera images
JP5970937B2 (en) * 2012-04-25 2016-08-17 ソニー株式会社 Display control apparatus and display control method
US8885936B2 (en) 2012-06-10 2014-11-11 Apple Inc. Automated color balance tools for editing images
US8983186B2 (en) 2012-06-10 2015-03-17 Apple Inc. Method and system for auto-enhancing photographs with shadow lift adjustments
KR102082365B1 (en) * 2013-02-26 2020-02-27 삼성전자주식회사 Method for image processing and an electronic device thereof
JP6288816B2 (en) * 2013-09-20 2018-03-07 カシオ計算機株式会社 Image processing apparatus, image processing method, and program
GB201702008D0 (en) 2017-02-07 2017-03-22 Anthropics Tech Ltd A method of matching colours
KR102359276B1 (en) 2017-03-24 2022-02-07 삼성전자주식회사 Method and apparatus for controlling white balance function of electronic device
WO2024048082A1 (en) * 2022-09-02 2024-03-07 ソニーグループ株式会社 Imaging control device and imaging device
DE102024106135A1 (en) * 2024-03-04 2025-09-04 Bundesdruckerei Gmbh Method, apparatus and system for checking a preset white balance of at least one facial image, and a corresponding computer program product

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH02298194A (en) * 1988-10-03 1990-12-10 Hitachi Ltd Color video printer device
US5296945A (en) * 1991-03-13 1994-03-22 Olympus Optical Co., Ltd. Video ID photo printing apparatus and complexion converting apparatus
JP3298072B2 (en) * 1992-07-10 2002-07-02 ソニー株式会社 Video camera system
US5420630A (en) * 1992-09-11 1995-05-30 Canon Kabushiki Kaisha Image pickup apparatus performing white balance control based on data from regions of a frame
BE1007006A3 (en) * 1993-04-16 1995-02-14 Koninkl Philips Electronics Nv TONE DETECTION CIRCUIT.
US6069972A (en) * 1998-06-02 2000-05-30 Intel Corporation Global white point detection and white balance for color images
JP2001136546A (en) 1999-11-09 2001-05-18 Nikon Corp Electronic camera
JP3959909B2 (en) 1999-11-19 2007-08-15 日本ビクター株式会社 White balance adjustment method and adjustment device
JP4826028B2 (en) * 2001-05-24 2011-11-30 株式会社ニコン Electronic camera
US7259784B2 (en) * 2002-06-21 2007-08-21 Microsoft Corporation System and method for camera color calibration and image stitching

Cited By (27)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1992820B (en) * 2005-12-27 2010-12-22 三星数码影像株式会社 Digital still cameras with face detection to aid in exposure compensation
CN101166286B (en) * 2006-10-20 2010-06-02 索尼株式会社 Image pickup device and method, image processing device and method
CN101179746B (en) * 2006-11-06 2010-12-22 索尼株式会社 Image processing device and image processing method
US8005298B2 (en) 2006-12-22 2011-08-23 Canon Kabushiki Kaisha Image processing apparatus and method thereof
CN101206761B (en) * 2006-12-22 2012-05-23 佳能株式会社 Image processing apparatus and method thereof
CN101389039B (en) * 2007-09-11 2012-04-04 佳能株式会社 Image processing apparatus and image processing method and imaging apparatus
CN101527860B (en) * 2008-03-04 2011-06-15 佳能株式会社 White balance control apparatus, control method therefor, and image sensing apparatus
CN102077245B (en) * 2008-06-26 2014-11-12 惠普开发有限公司 Face detection processing method, image processing device, and manufactured product
CN105409211A (en) * 2013-08-26 2016-03-16 英特尔公司 Auto white balance with skin tone correction for image processing
CN105409211B (en) * 2013-08-26 2018-07-10 英特尔公司 For the automatic white balance positive with skin-color adjustment of image procossing
CN104796683B (en) * 2014-01-22 2018-08-14 南京中兴软件有限责任公司 A kind of method and system of calibration image color
WO2015109693A1 (en) * 2014-01-22 2015-07-30 中兴通讯股份有限公司 Method and system for image color calibration
CN106973278A (en) * 2014-11-11 2017-07-21 怀效宁 A kind of AWB device and method with reference to face color character
CN104735362A (en) * 2015-03-11 2015-06-24 广东欧珀移动通信有限公司 Picture taking method and device
CN106097261A (en) * 2016-06-01 2016-11-09 广东欧珀移动通信有限公司 Image processing method and device
US11082677B2 (en) 2017-07-10 2021-08-03 Guangdong Oppo Mobile Telecommunications Corp., Ltd. White balance processing method and apparatus
CN107277479A (en) * 2017-07-10 2017-10-20 广东欧珀移动通信有限公司 White balance processing method and device
CN107465903A (en) * 2017-09-08 2017-12-12 广东欧珀移动通信有限公司 Image white balance method, device and computer-readable storage medium
CN107465903B (en) * 2017-09-08 2019-04-26 Oppo广东移动通信有限公司 Image white balance method, apparatus and computer readable storage medium
US11503262B2 (en) 2017-09-13 2022-11-15 Samsung Electronics Co., Ltd. Image processing method and device for auto white balance
CN109495731A (en) * 2017-09-13 2019-03-19 三星电子株式会社 Auto white balance method is used for by what image-signal processor executed
CN109495731B (en) * 2017-09-13 2022-06-17 三星电子株式会社 Method for automatic white balance executed by image signal processor
CN107635124A (en) * 2017-10-31 2018-01-26 广东欧珀移动通信有限公司 White balance processing method, device and equipment for face shooting
CN108024107A (en) * 2017-12-06 2018-05-11 广东欧珀移动通信有限公司 Image processing method, device, electronic equipment and computer-readable recording medium
CN110570476A (en) * 2018-06-06 2019-12-13 英属开曼群岛商玩美股份有限公司 System, method and storage medium for execution on computing device
CN111626959A (en) * 2020-05-28 2020-09-04 深圳康佳电子科技有限公司 Image processing method, terminal and storage medium
CN113177886A (en) * 2021-04-14 2021-07-27 RealMe重庆移动通信有限公司 Image processing method, image processing device, computer equipment and readable storage medium

Also Published As

Publication number Publication date
KR20050016880A (en) 2005-02-21
JP2005531189A (en) 2005-10-13
AU2003237013A1 (en) 2004-01-06
US6975759B2 (en) 2005-12-13
KR100981697B1 (en) 2010-09-13
JP4219893B2 (en) 2009-02-04
WO2004002166A1 (en) 2003-12-31
US20030235333A1 (en) 2003-12-25
EP1518417A1 (en) 2005-03-30

Similar Documents

Publication Publication Date Title
CN1663287A (en) Method and system for white balancing images using facial color as a reference signal
EP1652000B1 (en) Method and system in digital imaging for adjusting exposure and a corresponding device
US8374440B2 (en) Image processing method and apparatus
US8180115B2 (en) Two stage detection for photographic eye artifacts
US20200294214A1 (en) Image processing apparatus, method for controlling image processing apparatus, and non-transitory computer-readable storage medium
US8964038B2 (en) Image processing apparatus, method, and computer program storage device
JP4118688B2 (en) System and method for enhancement based on segmentation of video images
US20080247640A1 (en) Image Processing Device, Image Processing Method, and Recording Medium on Which the Program is Recorded
US20010007473A1 (en) Imaging method and apparatus for generating an output image with a wide dynamic range
CN111083385B (en) Binocular or multi-view camera exposure method, system and storage medium
JP4244063B2 (en) Image processing apparatus, image processing method, and program
US20110129149A1 (en) Method and apparatus for processing digital image signal, recording medium having recorded thereon the method, and apparatus for processing digital image signal
JP2007264860A (en) Face area extraction device
WO2020090176A1 (en) Image processing device and image processing method
US20100054604A1 (en) Image processing apparatus and program recording medium
JP2008234619A (en) Face authentication apparatus and face authentication method
CN112052726B (en) Image processing method and device
US8558910B2 (en) Method and apparatus for detecting red eyes
US20110149069A1 (en) Image processing apparatus and control method thereof
JP3294089B2 (en) Imaging device
KR100457302B1 (en) Auto tracking and auto zooming method of multi channel by digital image processing
US8649656B2 (en) Image processing apparatus and method, and program
KR102783573B1 (en) Method of restoration original topography color by outlined section in dark environment with AI and system thereof
JP4267746B2 (en) Video compression device
JP2021048441A (en) Imaging control unit and imaging control method

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C12 Rejection of a patent application after its publication
RJ01 Rejection of invention patent application after publication

Open date: 20050831