CN1663287A - Method and system for white balancing images using facial color as a reference signal - Google Patents

Method and system for white balancing images using facial color as a reference signal Download PDF

Info

Publication number
CN1663287A
CN1663287A CN038146711A CN03814671A CN1663287A CN 1663287 A CN1663287 A CN 1663287A CN 038146711 A CN038146711 A CN 038146711A CN 03814671 A CN03814671 A CN 03814671A CN 1663287 A CN1663287 A CN 1663287A
Authority
CN
China
Prior art keywords
skin
face
colour
signal
digital picture
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN038146711A
Other languages
Chinese (zh)
Inventor
Y·-T·林
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Koninklijke Philips NV
Original Assignee
Koninklijke Philips Electronics NV
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Koninklijke Philips Electronics NV filed Critical Koninklijke Philips Electronics NV
Publication of CN1663287A publication Critical patent/CN1663287A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/80—Camera processing pipelines; Components thereof
    • H04N23/84—Camera processing pipelines; Components thereof for processing colour signals
    • H04N23/88—Camera processing pipelines; Components thereof for processing colour signals for colour balance, e.g. white-balance circuits or colour temperature control
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00—Details of colour television systems
    • H04N9/64—Circuits for processing colour signals
    • H04N9/73—Colour balance circuits, e.g. white balance circuits or colour temperature control
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30196—Human being; Person
    • G06T2207/30201—Face

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Processing Of Color Television Signals (AREA)
  • Color Television Image Signal Generators (AREA)
  • Image Processing (AREA)
  • Facsimile Image Signal Circuits (AREA)
  • Color Image Communication Systems (AREA)

Abstract

A system for white balancing images using facial color as a reference signal is provided. The system includes a face detector that is operable to receive a digital image and to detect a human face within the digital image. A skin tone extractor is operable to extract a skin tone from the digital image. The extracted skin tone is associated with a human face detected by the face detector. A skin tone comparator is operable to access reference skin tones and to compare the extracted skin tone to the reference skin tones in order to identify a reference skin tone corresponding to the extracted skin tone. A balance parameter generator is operable to generate a balance parameter based on the extracted skin tone and the corresponding reference skin tone. The balance parameter is operable to be applied to the digital image to white balance the digital image.

Description

使用脸部颜色作为参考信号来白平衡图像的方法和系统Method and system for white balancing an image using face color as a reference signal

本发明一般涉及视频处理系统，并且更详细地，涉及一种使用脸部颜色作为参考信号来白平衡图像的方法和系统。The present invention relates generally to video processing systems and, more particularly, to a method and system for white balancing an image using the color of a face as a reference signal.

来自数字摄像机或便携摄录机或者在电视屏幕或个人计算机的监视器上显示的图像中的颜色由于各种原因经常在每个图像之间呈现差异。为了在每个图像之间保持恒定的彩色外观，经常使用称为白平衡的技术。使用该技术，用成像场景中的白色作为参考，使整个场景能够根据该白色进行颜色调整。Colors in images from a digital video camera or camcorder, or displayed on a television screen or personal computer monitor often appear to vary from image to image for various reasons. To maintain a constant color appearance between each image, a technique called white balancing is often used. Using this technique, the white in the imaged scene is used as a reference, enabling the entire scene to be color adjusted to that white.

传统的数字图像的白平衡通过手动和自动方式提供。对于手动白平衡，成像装置典型地对准假定在白照明下为白色的参考表面。对于自动白平衡，通常假定在成像场景内存在白色物体并且大概白色物体对应图像中的最亮点。然后使用假定的白色物体作为参考执行白平衡。但是，当白色物体实际上不在成像场景内或最亮点不属于参考的白色表面时，该技术会导致错误地调整图像。Traditional digital image white balance is provided by manual and automatic means. For manual white balance, the imaging device is typically aimed at a reference surface that is assumed to be white under white lighting. For automatic white balance, it is generally assumed that there is a white object within the imaged scene and that the white object roughly corresponds to the brightest point in the image. White balance is then performed using an assumed white object as a reference. However, this technique can lead to incorrectly adjusted images when white objects are not actually within the imaged scene or when the brightest point does not belong to the white surface of reference.

按照本发明，提供了一种使用脸部颜色作为参考信号来白平衡图像的方法和系统，基本上消除或减少了与传统系统和方法有关的缺点和问题。尤其是，可以代替白色物体使用人脸作为颜色参考来提供自动白平衡，使其中白色物体没有出现的场景能够被正确地颜色调整。In accordance with the present invention, there is provided a method and system for white balancing an image using the color of a face as a reference signal that substantially eliminates or reduces the disadvantages and problems associated with conventional systems and methods. In particular, an automatic white balance can be provided using a human face as a color reference instead of a white object, enabling scenes in which white objects do not appear to be correctly color adjusted.

按照本发明的一个实施例，提供一种使用脸部颜色作为参考信号来白平衡图像的系统，该系统包括脸部检测器、肤色提取器、多个参考肤色、肤色比较器和平衡参数产生器。脸部检测器用于接收数字图像并检测数字图像内的人脸。肤色提取器用于提取对各种族都不变的脸部颜色模型。肤色提取器连接脸部检测器。肤色提取器用于从数字图像提取肤色。提取的肤色与脸部检测器检测的人脸关联。肤色比较器连接肤色提取器。肤色比较器用于访问参考肤色并比较提取的肤色和参考肤色，以便识别对应于提取肤色的参考肤色。平衡参数产生器连接肤色比较器。平衡参数产生器用于根据提取的肤色和对应的参考肤色产生平衡参数。平衡参数被应用于数字图像来白平衡数字图像。According to one embodiment of the present invention, there is provided a system for using face color as a reference signal to white balance an image, the system includes a face detector, a skin color extractor, multiple reference skin colors, a skin color comparator and a balance parameter generator . A face detector is used to receive a digital image and detect human faces within the digital image. A skin tone extractor is used to extract a face color model that is invariant to various races. The skin tone extractor is connected to the face detector. The Skin Tone Extractor is used to extract skin tones from digital images. The extracted skin color is associated with the faces detected by the face detector. The skin color comparator connects to the skin color extractor. The skin tone comparator is used to access the reference skin tone and compare the extracted skin tone with the reference skin tone in order to identify the reference skin tone corresponding to the extracted skin tone. The balance parameter generator is connected to the skin color comparator. The balance parameter generator is used to generate balance parameters according to the extracted skin color and the corresponding reference skin color. A balance parameter is applied to the digital image to white balance the digital image.

按照本发明的另一实施例，提供一种使用脸部颜色作为参考信号来白平衡图像的方法。该方法包括接收来自数字图像的白平衡输入信号。进行有关是否在输入信号中检测到人脸的判定。当在输入信号中检测到脸部时提取检测的脸部的肤色。提取的肤色与多个参考肤色比较来识别对应的参考肤色。根据提取的肤色和对应的参考肤色产生平衡参数。According to another embodiment of the present invention, a method of white balancing an image using the color of a face as a reference signal is provided. The method includes receiving a white balance input signal from a digital image. A determination is made as to whether a human face is detected in the input signal. When a face is detected in an input signal, the skin color of the detected face is extracted. The extracted skin color is compared with a plurality of reference skin colors to identify a corresponding reference skin color. A balance parameter is generated according to the extracted skin color and the corresponding reference skin color.

本发明的一个或多个实施例的技术优点包括提供改进的自动白平衡图像的方法。在特定的实施例中，相对于白色物体，人脸在成像场景中用作颜色参考。结果，其中白色物体没有出现的场景可以根据人脸被正确地颜色调整。Technical advantages of one or more embodiments of the present invention include providing improved methods of automatically white balancing images. In a particular embodiment, a human face is used as a color reference in an imaged scene relative to a white object. As a result, a scene in which a white object does not appear can be correctly color-adjusted according to a human face.

其它技术优点将从以下附图、说明和权利要求被本领域技术人员容易地看出。Other technical advantages will be readily apparent to those skilled in the art from the following figures, descriptions and claims.

在进行详细说明之前，提出在整个该专利文件中使用的某些单词和短语的定义是有利的：术语“包括”和“包含”及其派生词意味着包括而不是限制；术语“或”是包括在内的，意味着和/或；短语“关联”和“与其关联”及其派生词可以意味着包括、被包括、互连接、包含、被包含、连接到或相连、耦合或相耦合、通信、合作、插入、并置、接近、相邻或相邻于、具有、拥有、具有特性等等；而术语“控制器”意味着控制至少一个操作的任何装置、系统或其部分，这样的装置可以在硬件、固件或软件或至少其中两个的某种组合中实现。应当说明，与任何特定控制器关联的功能可以是集中式的或分布式的，不管是本地还是遥控。特别地，控制器可以包括一个或多个数据处理器、以及关联的输入/输出装置和存储器，执行一个或多个应用程序和/或操作系统程序。对特定单词和短语的定义在整个该专利文件中提供，本领域普通技术人员应当理解，在许多(如果不是多数实例)中，该定义优先应用，并且这样定义的单词和短语的将来使用也如此。Before going into detail, it is advantageous to set forth definitions of certain words and phrases used throughout this patent document: the terms "include" and "comprising" and their derivatives mean inclusion rather than limitation; the term "or" is Included means and/or; the phrases "associated with" and "associated with" and their derivatives may mean to include, to be included, to be interconnected, to include, to be included, to be connected to or linked to, to be coupled or to be coupled with, communicates, cooperates, intervenes, juxtaposes, proximates, adjoins or adjoins, has, possesses, has characteristics, etc.; and the term "controller" means any device, system or part thereof that controls at least one operation, such The means may be implemented in hardware, firmware or software or some combination of at least two of them. It should be noted that the functionality associated with any particular controller may be centralized or distributed, whether locally or remotely. In particular, a controller may include one or more data processors, and associated input/output devices and memory, executing one or more application programs and/or operating system programs. Definitions for certain words and phrases are provided throughout this patent document, those of ordinary skill in the art should understand that in many, if not most instances, such definitions take precedence, and so do future uses of such defined words and phrases .

为了本发明及其优点的更全面的理解，现在参考以下结合相应附图的说明，其中相同的参考数字表示相同的部分，其中：For a more complete understanding of the present invention and its advantages, reference is now made to the following description taken in conjunction with the accompanying drawings, in which like reference numerals designate like parts, wherein:

图1是说明用于按照本发明的一个实施例使用脸部颜色作为参考信号提供图像的白平衡的摄像机的框图；1 is a block diagram illustrating a video camera for providing white balance of an image using the color of a face as a reference signal according to one embodiment of the present invention;

图2A是说明用于按照本发明的一个实施例使用脸部颜色作为参考信号提供图像的白平衡的计算机成像系统的框图；2A is a block diagram illustrating a computerized imaging system for providing white balance of an image using the color of the face as a reference signal according to one embodiment of the present invention;

图2B是说明由图2A的计算机成像系统使用来按照本发明的一个实施例用脸部颜色作为参考信号提供图像的白平衡的白平衡应用的框图；和2B is a block diagram illustrating a white balance application used by the computer imaging system of FIG. 2A to provide white balance for an image using the color of the face as a reference signal according to one embodiment of the present invention; and

图3是说明按照本发明的一个实施例在图1的摄像机或图2的计算机成像系统中使用脸部颜色作为参考信号的图像的白平衡方法的流程图。3 is a flow chart illustrating a method of white balancing an image using face color as a reference signal in the video camera of FIG. 1 or the computer imaging system of FIG. 2 according to an embodiment of the present invention.

下面讨论的图1-3和用于说明该专利文件中的本发明原理的各实施例仅作为举例说明而不应以任何方式解释为限制本发明的范围。在以下部分中，本发明将在三个实施例中说明：数字摄像机、数字电视机和计算机成像系统。但是，这仅用于举例而不应解释为以任何方式限制本发明的范围。本领域技术人员将理解本发明的原理可以在任何适当配置的图像处理系统中实施。1-3, discussed below, and the various embodiments used to illustrate the principles of the invention in this patent document are by way of illustration only and should not be construed in any way to limit the scope of the invention. In the following sections, the invention will be described in three embodiments: a digital video camera, a digital television and a computer imaging system. However, this is for example only and should not be construed as limiting the scope of the invention in any way. Those skilled in the art will understand that the principles of the invention may be implemented in any suitably arranged image processing system.

图1是说明用于按照本发明的一个实施例使用脸部颜色作为参考信号提供图像的白平衡的摄像机100的框图。摄像机100可以包括数字摄像机、数字便携摄录机或任何其它用于处理数字图像的适当类型的摄像机。FIG. 1 is a block diagram illustrating a video camera 100 for providing white balance of an image using the color of a face as a reference signal according to one embodiment of the present invention. Video camera 100 may comprise a digital video camera, a digital camcorder, or any other suitable type of video camera for processing digital images.

摄像机100包括图像传感器102、模数转换器104、图像处理器106和白平衡模块110。图像传感器102用于接收基于从摄像机100定位进行记录的场景反射的光的入射图像120。图像传感器102还用于从入射图像120产生模拟信号122并将模拟信号122提供给模数转换器104。Camera 100 includes image sensor 102 , analog-to-digital converter 104 , image processor 106 and white balance module 110 . The image sensor 102 is adapted to receive an incident image 120 based on light reflected from a scene where the camera 100 is positioned for recording. Image sensor 102 is also used to generate an analog signal 122 from incident image 120 and to provide analog signal 122 to analog-to-digital converter 104 .

模数转换器104用于接收模拟信号122并从模拟信号122产生数字信号124用于图像处理器106。图像处理器106用于接收数字信号124并对数字信号124执行附加处理来产生可显示图像126。可显示图像126可在摄像机100内记录到存储装置128中，例如小型闪存卡、智能多媒体卡、存储棒等，和/或可以提供给外部系统来记录。The analog-to-digital converter 104 is configured to receive an analog signal 122 and generate a digital signal 124 from the analog signal 122 for the image processor 106 . Image processor 106 is configured to receive digital signal 124 and perform additional processing on digital signal 124 to generate displayable image 126 . Displayable image 126 may be recorded within camera 100 to storage device 128, such as a compact flash card, smart media card, memory stick, etc., and/or may be provided to an external system for recording.

模数转换器104还用于从模拟信号122产生数字输入帧130用于白平衡模块110，并且图像处理器106用于从白平衡模块110接收平衡参数132，并将平衡参数132应用于可显示图像126，以便白平衡可显示图像126。The analog-to-digital converter 104 is also used to generate a digital input frame 130 from the analog signal 122 for the white balance module 110, and the image processor 106 is used to receive the balance parameters 132 from the white balance module 110 and apply the balance parameters 132 to the displayable Image 126 so that the white balance can display image 126.

白平衡模块110包括脸部检测器140、肤色提取器142、肤色比较器144、平衡参数产生器146和参考肤色148。按照一个实施例，白平衡模块110可以合并在摄像机100的用于调整由摄像机100捕获的图像的整个亮度的自动增益部件(图1中未示出)中。The white balance module 110 includes a face detector 140 , a skin color extractor 142 , a skin color comparator 144 , a balance parameter generator 146 and a reference skin color 148 . According to one embodiment, the white balance module 110 may be incorporated in an automatic gain component (not shown in FIG. 1 ) of the camera 100 for adjusting the overall brightness of the image captured by the camera 100 .

脸部检测器140用于接收来自模数转换器104的至少一个输入帧130，并判定输入帧130中是否出现人脸。脸部检测器140可以根据基于亮度的脸部检测算法或任何其它用于检测数字图像内的人脸的适当过程来进行该判定。The face detector 140 is configured to receive at least one input frame 130 from the analog-to-digital converter 104 and determine whether a human face appears in the input frame 130 . Face detector 140 may make this determination according to a brightness-based face detection algorithm or any other suitable process for detecting human faces within digital images.

如果脸部检测器140在输入帧130内检测到人脸，则脸部检测器140还用于为肤色提取器142产生检测的脸部信号150。检测的脸部信号150可以包括来自输入帧130与检测的脸部对应的数据、用于识别输入帧130内检测的脸部的位置的坐标或其它定位符、或者任何其它适当的信号。If the face detector 140 detects a human face within the input frame 130 , the face detector 140 is also used to generate a detected face signal 150 for the skin color extractor 142 . Detected face signal 150 may include data from input frame 130 corresponding to the detected face, coordinates or other locators identifying the location of the detected face within input frame 130 , or any other suitable signal.

肤色提取器142用于提取对各种族都不变的脸部颜色模型。肤色提取器142用于接收检测的脸部信号150，并根据检测的脸部信号150提取检测脸部的肤色。肤色提取器142还用于为肤色比较器144产生提取的肤色信号152。提取的肤色信号152可以包括识别检测脸部的提取肤色的数据。The skin color extractor 142 is used to extract a face color model that is invariant to each race. The skin color extractor 142 is used for receiving the detected face signal 150 and extracting the skin color of the detected face according to the detected face signal 150 . The skin color extractor 142 is also used to generate an extracted skin color signal 152 for the skin color comparator 144 . The extracted skin tone signal 152 may include data identifying the extracted skin tone of the detected face.

肤色比较器144用于接收提取的肤色信号152，并比较由提取的肤色信号152识别的提取肤色和作为参考肤色148存储的多个肤色。肤色比较器144还用于根据提取肤色及其对应的参考肤色148，为平衡参数产生器146产生比较信号154。The skin color comparator 144 is configured to receive the extracted skin color signal 152 and compare the extracted skin color identified by the extracted skin color signal 152 with a plurality of skin colors stored as the reference skin color 148 . The skin color comparator 144 is also used to generate a comparison signal 154 for the balance parameter generator 146 according to the extracted skin color and its corresponding reference skin color 148 .

对应的参考肤色148包括这样的参考肤色148，其包括如它在正常照明中呈现的真实肤色，而提取肤色包括如它在显示为由摄像机100的图像传感器102捕获的、由于实际照明没有白平衡的可显示图像126时呈现的肤色。比较信号154可以包括识别提取肤色和对应的参考肤色148的数据、识别提取肤色和对应的参考肤色148之间的差别的数据、或任何其它用于使平衡参数产生器146能够产生平衡参数132的适当数据。The corresponding reference skin tone 148 includes a reference skin tone 148 that includes a true skin tone as it would appear in normal lighting, and an extracted skin tone that includes a color that is not white balanced due to actual lighting as it is shown captured by the image sensor 102 of the camera 100. The image 126 may be displayed when presenting skin tones. The comparison signal 154 may include data identifying the extracted skin tone and the corresponding reference skin tone 148, data identifying the difference between the extracted skin tone and the corresponding reference skin tone 148, or any other data used to enable the balance parameter generator 146 to generate the balance parameter 132. appropriate data.

平衡参数产生器146用于接收比较信号154，并根据比较信号154为图像处理器106产生平衡参数132。按照一个实施例，通过将参考信号从参考白色替换为参考肤色，平衡参数产生器146可以用于按照美国专利No.6,069,972中公开的原理来产生平衡参数132。平衡参数132可以被图像处理器106应用来白平衡由图像处理器106产生的可显示图像126。The balance parameter generator 146 is configured to receive the comparison signal 154 and generate the balance parameter 132 for the image processor 106 according to the comparison signal 154 . According to one embodiment, the balance parameter generator 146 may be used to generate the balance parameter 132 in accordance with the principles disclosed in US Patent No. 6,069,972 by substituting the reference signal from a reference white color to a reference skin color. Balance parameters 132 may be applied by image processor 106 to white balance displayable image 126 generated by image processor 106 .

虽然脸部检测器140、肤色提取器142、肤色比较器144、平衡参数产生器146和参考肤色148说明和描述为分离元件，但是可以理解，任何或所有这些元件140、142、144、146和/或148可以不脱离本发明的范围而实施在一起。此外，参考肤色148可以在白平衡模块110之外提供。例如，参考肤色148可存储在可从摄像机100移去的介质中。While face detector 140, skin tone extractor 142, skin tone comparator 144, balance parameter generator 146, and reference skin tone 148 are illustrated and described as separate elements, it will be appreciated that any or all of these elements 140, 142, 144, 146 and and/or 148 may be implemented together without departing from the scope of the present invention. Additionally, reference skin tone 148 may be provided external to white balance module 110 . For example, reference skin tone 148 may be stored on a medium that is removable from camera 100 .

另外，任何或所有脸部检测器140、肤色提取器142、肤色比较器144和平衡参数产生器146都可以包括编码在介质中的逻辑。该逻辑包括执行程序任务的功能指令。该介质包括计算机盘或其它计算机可读介质、专用集成电路、现场可编程门阵列、数字信号处理器、其它适当的专用或通用处理器、传输介质或在其中可编码和利用逻辑的其它适当的介质。Additionally, any or all of face detector 140, skin tone extractor 142, skin tone comparator 144, and balance parameter generator 146 may include logic encoded in the medium. The logic includes functional instructions to perform program tasks. Such media include computer disks or other computer-readable media, application-specific integrated circuits, field-programmable gate arrays, digital signal processors, other suitable special-purpose or general-purpose processors, transmission media, or other suitable devices in which logic may be encoded and utilized. medium.

图2A是说明用于按照本发明的一个实施例使用脸部颜色作为参考信号提供图像的白平衡的计算机成像系统300的框图。按照一个实施例，计算机成像系统300包括个人计算机302、显示器304、可选扬声器306和至少一个输入装置，例如键盘308和/或点击设备310。FIG. 2A is a block diagram illustrating a computerized imaging system 300 for providing white balance of an image using the color of a face as a reference signal according to one embodiment of the present invention. According to one embodiment, computer imaging system 300 includes a personal computer 302 , a display 304 , optional speakers 306 and at least one input device, such as a keyboard 308 and/or pointing device 310 .

个人计算机302可以包括光盘(CD)只读存储器(ROM)驱动320、硬盘驱动(HDD)322、中央处理单元(CPU)324、随机存取存储器(RAM)326、输入/输出(I/O)接口(IF)电路328和视频/音频接口(IF)电路330。CD-ROM驱动320用于接收和读取可移动CD-ROM盘332。Personal computer 302 may include compact disc (CD) read only memory (ROM) drive 320, hard disk drive (HDD) 322, central processing unit (CPU) 324, random access memory (RAM) 326, input/output (I/O) interface (IF) circuit 328 and video/audio interface (IF) circuit 330 . CD-ROM drive 320 is used to receive and read removable CD-ROM disc 332 .

显示器304包括个人计算机302的计算机监视器。显示器304可以包括阴极射线管屏、液晶显示屏、平板显示屏、等离子显示屏、投影显示屏或任何其它适于显示图像的装置。显示器304包括用于显示可能包括人脸的视频图像的屏幕340。Display 304 includes a computer monitor of personal computer 302 . Display 304 may include a cathode ray tube screen, liquid crystal display, flat panel display, plasma display, projection display, or any other suitable device for displaying images. Display 304 includes a screen 340 for displaying video images, which may include a human face.

硬盘驱动322用于提供对操作系统程序、应用程序和用于信息存储和检索的数据的访问。键盘308和点击设备310经I/O IF电路328连接个人计算机302。点击设备310可以包括鼠标或其它用于使用户能够与屏幕340的特定区域交互作用的适当的设备。Hard disk drive 322 is used to provide access to operating system programs, application programs and data for information storage and retrieval. Keyboard 308 and pointing device 310 are connected to personal computer 302 via I/O IF circuit 328. Pointing device 310 may include a mouse or other suitable device for enabling a user to interact with a particular area of screen 340 .

显示器304和扬声器306经视频/音频IF电路330连接个人计算机302。个人计算机302的内部元件，包括CD-ROM驱动320、硬盘驱动322、CPU 324、RAM 326、I/O IF电路328和视频/音频IF电路330，经通信总线344相互连接和相互通信。Display 304 and speaker 306 are connected to personal computer 302 via video/audio IF circuit 330 . The internal components of the personal computer 302, including a CD-ROM drive 320, a hard disk drive 322, a CPU 324, a RAM 326, an I/O IF circuit 328 and a video/audio IF circuit 330, are interconnected and communicate with each other via a communication bus 344.

如下面更详细说明的，CPU 324用于调用白平衡模块以便正确地调整屏幕340上出现的物体的颜色。白平衡模块结合任何其它在个人计算机302中执行的产生视频信号的应用来工作，例如流化视频应用、MPEG或AVI播放器、接收和解调输入的RF电视信号以产生基带视频信号的视频卡等等。按照本发明的一个实施例，由CPU 324执行的白平衡模块可以存储在CD-ROM 332、3.5英寸可移动磁盘(图1中未示出)、RAM 326中或任何其它适当的位置。因此，对于一个实施例，RAM 326可以用于存储操作系统程序、流化视频应用程序、MPEG/AVI播放器应用程序和白平衡模块。As explained in more detail below, the CPU 324 is used to invoke the white balance module to correctly adjust the color of objects appearing on the screen 340. The white balance module works in conjunction with any other video-generating application executing in the personal computer 302, such as a streaming video application, MPEG or AVI player, video card that receives and demodulates an incoming RF television signal to produce a baseband video signal etc. According to one embodiment of the present invention, the white balance module executed by CPU 324 may be stored on CD-ROM 332, a 3.5-inch removable disk (not shown in FIG. 1), RAM 326, or any other suitable location. Thus, for one embodiment, RAM 326 may be used to store operating system programs, streaming video applications, MPEG/AVI player applications, and white balance modules.

图2B是说明由计算机成像系统300使用来按照本发明的一个实施例使用脸部颜色作为参考信号提供图像的白平衡的白平衡模块350的框图。白平衡模块350用于接收来自要被计算机302显示在显示器304上的视频信号的输入帧352，并根据输入帧352产生平衡参数354。白平衡模块350包括脸部检测器360、肤色提取器362、肤色比较器364、平衡参数产生器366和参考肤色368。2B is a block diagram illustrating the white balance module 350 used by the computer imaging system 300 to provide white balance for an image using the color of the face as a reference signal according to one embodiment of the invention. The white balance module 350 is configured to receive an input frame 352 from a video signal to be displayed by the computer 302 on the display 304 , and generate a balance parameter 354 according to the input frame 352 . The white balance module 350 includes a face detector 360 , a skin color extractor 362 , a skin color comparator 364 , a balance parameter generator 366 and a reference skin color 368 .

脸部检测器360用于接收来自要被计算机302显示在显示器304上的视频信号的至少一个输入帧352，并判定输入帧352中是否出现人脸。脸部检测器360可以根据基于亮度的脸部检测算法或任何其它用于检测数字图像内的人脸的适当过程来进行该判定。The face detector 360 is used to receive at least one input frame 352 from a video signal to be displayed by the computer 302 on the display 304 and determine whether a human face appears in the input frame 352 . Face detector 360 may make this determination according to a brightness-based face detection algorithm or any other suitable process for detecting human faces within digital images.

如果脸部检测器360在输入帧352内检测到人脸，则脸部检测器360还用于为肤色提取器362产生检测的脸部信号370。检测的脸部信号370可以包括与来自输入帧352与检测的脸部对应的数据、用于识别输入帧352内检测的脸位置的坐标或其它定位符、或者任何其它适当的信号。If face detector 360 detects a human face within input frame 352 , face detector 360 is also used to generate detected face signal 370 for skin color extractor 362 . Detected face signal 370 may include data corresponding to the detected face from input frame 352, coordinates or other locators for identifying the location of the detected face within input frame 352, or any other suitable signal.

肤色提取器362用于提取对各种族都不变的脸部颜色模型。肤色提取器362用于接收检测的脸部信号370，并根据检测的脸部信号370提取检测脸部的肤色。肤色提取器362还用于为肤色比较器364产生提取的肤色信号372。提取的肤色信号372可以包括识别检测脸部的提取肤色的数据。The skin color extractor 362 is used to extract a face color model that is invariant to each race. The skin color extractor 362 is used for receiving the detected face signal 370 and extracting the skin color of the detected face according to the detected face signal 370 . The skin color extractor 362 is also used to generate an extracted skin color signal 372 for the skin color comparator 364 . Extracted skin tone signal 372 may include data identifying the extracted skin tone of a detected face.

肤色比较器364用于接收提取的肤色信号372，并比较由提取的肤色信号372识别的提取肤色和作为参考肤色368存储的多个肤色。肤色比较器364还用于根据提取肤色及其对应的参考肤色368为平衡参数产生器366产生比较信号374。The skin color comparator 364 is configured to receive the extracted skin color signal 372 and compare the extracted skin color identified by the extracted skin color signal 372 with a plurality of skin colors stored as the reference skin color 368 . The skin color comparator 364 is also used to generate a comparison signal 374 for the balance parameter generator 366 according to the extracted skin color and its corresponding reference skin color 368 .

对应的参考肤色368包括这样的参考肤色368，其包括如它在正常照明中呈现的真实肤色，而提取肤色包括如它在通过显示器304没有白平衡显示时呈现的肤色。比较信号374可以包括识别提取肤色和对应的参考肤色368的数据、识别提取肤色和对应的参考肤色368之间的差别的数据、或任何其它用于使平衡参数产生器366能够产生平衡参数364的适当数据。The corresponding reference skin tone 368 includes the reference skin tone 368 including the true skin tone as it appears in normal lighting, and the extracted skin tone includes the skin tone as it appears through the display 304 without white balance. The comparison signal 374 may include data identifying the extracted skin tone and the corresponding reference skin tone 368, data identifying the difference between the extracted skin tone and the corresponding reference skin tone 368, or any other data used to enable the balance parameter generator 366 to generate the balance parameter 364. appropriate data.

平衡参数产生器366用于接收比较信号374，并根据比较信号374产生平衡参数354。按照一个实施例，通过将参考信号从参考白色替换为参考肤色，平衡参数产生器366可以用于按照美国专利No.6,069,972中公开的原理来产生平衡参数354。平衡参数354可以被应用来白平衡在显示器304上显示的图像。The balance parameter generator 366 is used for receiving the comparison signal 374 and generating the balance parameter 354 according to the comparison signal 374 . According to one embodiment, the balance parameter generator 366 may be used to generate the balance parameter 354 in accordance with the principles disclosed in US Patent No. 6,069,972 by substituting the reference signal from a reference white to a reference skin tone. Balance parameters 354 may be applied to white balance the image displayed on display 304 .

虽然脸部检测器360、肤色提取器362、肤色比较器364、平衡参数产生器366和参考肤色368说明和描述为分离元件，但是可以理解，任何或所有这些元件360、362、364、366和/或368可以不脱离本发明的范围而实施在一起。此外，参考肤色368可以在白平衡模块35 0之外提供。例如，参考肤色368可存储在可从计算机302移去的介质中、RAM 326或其它适当的位置中，而白平衡模块350的剩余部分在别处提供。While face detector 360, skin tone extractor 362, skin tone comparator 364, balance parameter generator 366, and reference skin tone 368 are illustrated and described as separate elements, it will be appreciated that any or all of these elements 360, 362, 364, 366 and and/or 368 may be implemented together without departing from the scope of the present invention. Additionally, reference skin tone 368 may be provided in addition to white balance module 350. For example, reference skin tone 368 may be stored on a medium removable from computer 302, in RAM 326, or other suitable location, while the remainder of white balance module 350 is provided elsewhere.

另外，任何或所有脸部检测器360、肤色提取器362、肤色比较器364和平衡参数产生器366都可以包括编码在介质中的逻辑。该逻辑包括执行程序任务的功能指令。该介质包括计算机盘和其它计算机可读介质、专用集成电路、现场可编程门阵列、数字信号处理器、其它适当的专用或通用处理器、传输介质或在其中可编码和利用逻辑的其它适当的介质。Additionally, any or all of face detector 360, skin tone extractor 362, skin tone comparator 364, and balance parameter generator 366 may include logic encoded in the medium. The logic includes functional instructions to perform program tasks. Such media include computer disks and other computer-readable media, application-specific integrated circuits, field-programmable gate arrays, digital signal processors, other suitable special-purpose or general-purpose processors, transmission media, or other suitable devices in which logic may be encoded and utilized. medium.

图3是说明按照本发明的一个实施例在摄像机100、计算机成像系统3 00或任何其它适当的成像系统中使用脸部颜色作为参考信号的图像的白平衡方法的流程图。该方法在步骤400开始，其中从数字图像接收白平衡输入信号130、352。在步骤402，尝试检测输入信号130、352中的人脸。FIG. 3 is a flowchart illustrating a method of white balancing an image using face color as a reference signal in camera 100, computerized imaging system 300, or any other suitable imaging system according to an embodiment of the present invention. The method starts at step 400, where a white balance input signal 130, 352 is received from a digital image. At step 402, an attempt is made to detect a human face in the input signal 130,352.

在判决步骤404，进行有关是否在输入信号130、352中检测到脸部的判定。如果在输入信号130、352中没有检测到脸部，方法沿否分支从判决步骤404至步骤406。在步骤406，可以选择地执行任何适当的替代白平衡过程，之后，该方法结束。At decision step 404, a determination is made as to whether a face is detected in the input signal 130,352. If no face is detected in the input signal 130 , 352 , the method branches along NO from decision step 404 to step 406 . At step 406, any suitable alternative white balance process may optionally be performed, after which the method ends.

回到判决步骤404，如果在输入信号130、352中检测到脸部，方法沿是分支从判决步骤404至步骤408。在步骤408，提取检测的脸部的肤色。在步骤410，提取的肤色和参考肤色148、368进行比较以识别对应的参考肤色148、368。Returning to decision step 404 , if a face is detected in the input signal 130 , 352 , the method branches along yes from decision step 404 to step 408 . In step 408, the skin color of the detected face is extracted. At step 410, the extracted skin color is compared to the reference skin color 148,368 to identify a corresponding reference skin color 148,368.

在步骤414，根据提取的肤色和对应的参考肤色148、368产生平衡参数132、354。在步骤416，平衡参数132、354应用于数字图像，以便白平衡数字图像。在步骤418，可以显示经白平衡的数字图像，之后该方法结束。At step 414 , balance parameters 132 , 354 are generated from the extracted skin color and the corresponding reference skin color 148 , 368 . At step 416, the balance parameters 132, 354 are applied to the digital image to white balance the digital image. At step 418, the white balanced digital image may be displayed, after which the method ends.

这样，当根据提取的肤色和对应的参考肤色148、368产生的平衡参数132、354应用于整个数字图像时，为数字图像显示的颜色可以被全部校正。以这种方式，可以根据使用对应参考肤色148、368校正的数字图像内的人脸的肤色来白平衡整个数字图像。In this way, when the balance parameters 132, 354 generated from the extracted skin tones and corresponding reference skin tones 148, 368 are applied to the entire digital image, the displayed color for the digital image may be fully corrected. In this way, the entire digital image can be white balanced according to the skin tone of the faces within the digital image corrected using the corresponding reference skin tone 148 , 368 .

虽然已经用几个实施例说明了本发明，但是可以使本领域技术人员想到各种变化和修改。即本发明包括这种落入所附权利要求的范围内的变化和修改。While the invention has been described with several embodiments, various changes and modifications will occur to those skilled in the art. That is, the present invention includes such changes and modifications that come within the scope of the appended claims.

Claims (20)

1. one kind is used face color to come the system of white balance image as the reference signal, comprising:
Face detector (140) is used to receive digital picture and detects the interior people's face of digital picture;
Be connected to the skin tone extractor (142) of face detector (140), this skin tone extractor (142) is used for extracting the colour of skin from digital picture, and the colour of skin of extraction is related with the people's face that is detected by face detector (140);
A plurality of reference skin tones (148);
Be connected to the skin tone comparator (144) of skin tone extractor (142), this skin tone comparator (144) is used to visit the colour of skin and the reference skin tones (148) of reference skin tones (148) and relatively extraction, so that identification is corresponding to the reference skin tones (148) of extracting the colour of skin; With
Be connected to the balance parameters generator (146) of skin tone comparator (144), this balance parameters generator (146) is used for producing balance parameters (132) according to the colour of skin of extracting and the corresponding reference colour of skin (148), and balance parameters (132) is applied to digital picture and comes the white balance digital picture.
2. system as claimed in claim 1, described face detector (140) are used for according to the people's face that detects based on the face detection algorithms of brightness in the digital picture.
3. system as claimed in claim 1, described face detector (140) are that skin tone extractor (142) produces the face signal (150) that detects when being used for detecting face in digital picture.
4. system as claimed in claim 3, the face signal of described detection (150) comprise from the data corresponding to the digital picture of the face of detecting.
5. system as claimed in claim 3, the face signal of described detection (150) comprise the finger URL of the position of the face that is used for the detection in the discriminating digit image.
6. it is that skin tone comparator (144) produces the skin tone signal of extracting (152) that system as claimed in claim 1, described skin tone extractor (142) are used for according to the colour of skin of extracting, and the skin tone signal of extraction (152) comprises the data of the colour of skin of identification extraction.
7. system as claimed in claim 1, described skin tone comparator (144) are used to balance parameters generator (146) to produce comparison signal (154), and comparison signal (154) comprises the colour of skin of identification extraction and the data of the corresponding reference colour of skin (148).
8. system as claimed in claim 1, described skin tone comparator (144) are used to balance parameters generator (146) to produce comparison signal (154), and comparison signal (154) comprises the colour of skin of identification extraction and the data of the difference between the corresponding reference colour of skin (148).
9. one kind is used face color as the method that the reference signal comes the white balance image, comprising:
Reception is from the white balance input signal (130) of digital picture;
Judge and whether in input signal (130), detect people's face;
When in input signal (130), detecting face, extract the colour of skin of the face of detecting;
Relatively the colour of skin of Ti Quing and a plurality of reference skin tones (148) are with the identification corresponding reference colour of skin (148); With
Produce balance parameters (132) according to the colour of skin of extracting and the corresponding reference colour of skin (148).
10. method as claimed in claim 9 further comprises balance parameters (132) is applied to digital picture so that the white balance digital picture.
11. method as claimed in claim 9 further comprises the digital picture of demonstration through white balance.
12. method as claimed in claim 9 further comprises and carry out the white balance process that substitutes when not detecting face in input signal (130).
13. method as claimed in claim 9 further comprises producing the face signal that detects when detecting face in digital picture (130).
14. method as claimed in claim 9 judges that whether detecting people's face in input signal (130) is included in the last face detection algorithms of carrying out based on brightness of input signal (130).
15. one kind is used face color to come the system of white balance image as the reference signal, comprising:
The accessible medium of computer; With
Be stored in the logic on the accessible medium of computer, this logic is used to receive the white balance input signal (130) from digital picture, judge and whether in input signal (130), detect people's face, when in input signal (130), detecting face, extract the colour of skin of the face of detecting, relatively the colour of skin of Ti Quing and a plurality of reference skin tones (148) produce balance parameters (132) with the identification corresponding reference colour of skin (148) with according to the colour of skin of extracting and the corresponding reference colour of skin (148).
16. as the system of claim 15, described logic is further used for balance parameters (132) is applied to digital picture so that the white balance digital picture.
17. as the system of claim 15, described logic is further used for showing the digital picture through white balance.
18. as the system of claim 15, described logic is further used for carrying out the white balance process that substitutes when not detecting face in input signal (130).
19. as the system of claim 15, described logic is further used for producing the face signal that detects when detecting face in input signal (130).
20. as the system of claim 15, described logic is used for by going up to carry out to judge whether detect people's face at input signal (130) based on the face detection algorithms of brightness at input signal (130).
CN038146711A 2002-06-25 2003-06-16 Method and system for white balancing images using facial color as a reference signal Pending CN1663287A (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US10/179,360 US6975759B2 (en) 2002-06-25 2002-06-25 Method and system for white balancing images using facial color as a reference signal
US10/179360 2002-06-25

Publications (1)

Publication Number Publication Date
CN1663287A true CN1663287A (en) 2005-08-31

Family

ID=29734890

Family Applications (1)

Application Number Title Priority Date Filing Date
CN038146711A Pending CN1663287A (en) 2002-06-25 2003-06-16 Method and system for white balancing images using facial color as a reference signal

Country Status (7)

Country Link
US (1) US6975759B2 (en)
EP (1) EP1518417A1 (en)
JP (1) JP4219893B2 (en)
KR (1) KR100981697B1 (en)
CN (1) CN1663287A (en)
AU (1) AU2003237013A1 (en)
WO (1) WO2004002166A1 (en)

Cited By (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101166286B (en) * 2006-10-20 2010-06-02 索尼株式会社 Image pickup device and method, image processing device and method
CN1992820B (en) * 2005-12-27 2010-12-22 三星数码影像株式会社 Digital still cameras with face detection to aid in exposure compensation
CN101179746B (en) * 2006-11-06 2010-12-22 索尼株式会社 Image processing device and image processing method
CN101527860B (en) * 2008-03-04 2011-06-15 佳能株式会社 White balance control apparatus, control method therefor, and image sensing apparatus
US8005298B2 (en) 2006-12-22 2011-08-23 Canon Kabushiki Kaisha Image processing apparatus and method thereof
CN101389039B (en) * 2007-09-11 2012-04-04 佳能株式会社 Image processing apparatus and image processing method and imaging apparatus
CN102077245B (en) * 2008-06-26 2014-11-12 惠普开发有限公司 Face detection processing method, image processing device, and manufactured product
CN104735362A (en) * 2015-03-11 2015-06-24 广东欧珀移动通信有限公司 Picture taking method and device
WO2015109693A1 (en) * 2014-01-22 2015-07-30 中兴通讯股份有限公司 Method and system for image color calibration
CN105409211A (en) * 2013-08-26 2016-03-16 英特尔公司 Automatic white balancing with skin tone correction for image processing
CN106097261A (en) * 2016-06-01 2016-11-09 广东欧珀移动通信有限公司 Image processing method and device
CN106973278A (en) * 2014-11-11 2017-07-21 怀效宁 A kind of AWB device and method with reference to face color character
CN107277479A (en) * 2017-07-10 2017-10-20 广东欧珀移动通信有限公司 White balance processing method and device
CN107465903A (en) * 2017-09-08 2017-12-12 广东欧珀移动通信有限公司 Image white balance method, device and computer-readable storage medium
CN107635124A (en) * 2017-10-31 2018-01-26 广东欧珀移动通信有限公司 White balance processing method, device and equipment for face shooting
CN108024107A (en) * 2017-12-06 2018-05-11 广东欧珀移动通信有限公司 Image processing method, device, electronic equipment and computer-readable recording medium
CN109495731A (en) * 2017-09-13 2019-03-19 三星电子株式会社 Auto white balance method is used for by what image-signal processor executed
CN110570476A (en) * 2018-06-06 2019-12-13 英属开曼群岛商玩美股份有限公司 System, method and storage medium for execution on computing device
CN111626959A (en) * 2020-05-28 2020-09-04 深圳康佳电子科技有限公司 Image processing method, terminal and storage medium
CN113177886A (en) * 2021-04-14 2021-07-27 RealMe重庆移动通信有限公司 Image processing method, image processing device, computer equipment and readable storage medium

Families Citing this family (42)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4045929B2 (en) * 2002-11-18 2008-02-13 セイコーエプソン株式会社 Automatic image quality adjustment according to subject size
US20040179228A1 (en) * 2003-03-10 2004-09-16 Mccluskey Mark Indication of image content modification
US20040208363A1 (en) * 2003-04-21 2004-10-21 Berge Thomas G. White balancing an image
WO2004098202A1 (en) * 2003-05-01 2004-11-11 Seiko Epson Corporation Color balance adjustment conducted considering color reproducibility of specific color
EP1482724B1 (en) * 2003-05-19 2007-07-11 STMicroelectronics S.A. Image processing method for digital images with exposure correction by recognition of skin areas of the subject.
US7844076B2 (en) * 2003-06-26 2010-11-30 Fotonation Vision Limited Digital image processing using face detection and skin tone information
JP4424216B2 (en) * 2004-03-30 2010-03-03 セイコーエプソン株式会社 Image processing apparatus, image processing method, and image processing program
JP4154400B2 (en) * 2004-04-01 2008-09-24 キヤノン株式会社 Imaging apparatus, control method thereof, and program
JP4284448B2 (en) 2005-01-28 2009-06-24 富士フイルム株式会社 Image processing apparatus and method
JP4371069B2 (en) * 2005-03-16 2009-11-25 セイコーエプソン株式会社 Color balance correction according to the color cast tendency
US7869630B2 (en) * 2005-03-29 2011-01-11 Seiko Epson Corporation Apparatus and method for processing image
JP4217698B2 (en) * 2005-06-20 2009-02-04 キヤノン株式会社 Imaging apparatus and image processing method
JP5119921B2 (en) * 2005-07-19 2013-01-16 コニカミノルタホールディングス株式会社 Image processing apparatus, image processing system, and image processing program
JP2007036462A (en) * 2005-07-25 2007-02-08 Fujifilm Holdings Corp Image processing apparatus
KR100735549B1 (en) * 2005-08-08 2007-07-04 삼성전자주식회사 An image processing method and apparatus for converting skin color of an image
JP4750520B2 (en) * 2005-09-21 2011-08-17 富士フイルム株式会社 Human image correction apparatus and method
US8103094B2 (en) * 2005-09-22 2012-01-24 Adobe Systems Incorporated Color correction based on skin color
JP4718952B2 (en) * 2005-09-27 2011-07-06 富士フイルム株式会社 Image correction method and image correction system
JP4542013B2 (en) * 2005-09-29 2010-09-08 富士フイルム株式会社 Print order system, program, program storage medium, and print order server
JP2007110576A (en) * 2005-10-17 2007-04-26 Fujifilm Corp Subject image data color correction apparatus and control method thereof
US20080231726A1 (en) * 2007-03-23 2008-09-25 Motorola, Inc. Apparatus and method for image color correction in a portable device
US7800783B2 (en) * 2007-05-25 2010-09-21 Hong Kong Applied Science And Technology Research Institute Co. Ltd. Auto white balancing by modified grey world and geometric distortion measurement
JP4702635B2 (en) * 2007-07-17 2011-06-15 富士フイルム株式会社 AUTO WHITE BALANCE CORRECTION VALUE CALCULATION DEVICE, METHOD, PROGRAM, AND IMAGING DEVICE
JP5113514B2 (en) * 2007-12-27 2013-01-09 キヤノン株式会社 White balance control device and white balance control method
JP4384240B2 (en) * 2008-05-28 2009-12-16 株式会社東芝 Image processing apparatus, image processing method, and image processing program
JP2010003118A (en) * 2008-06-20 2010-01-07 Seiko Epson Corp Image processing apparatus, image processing method and image processing program
KR20100056270A (en) * 2008-11-19 2010-05-27 삼성전자주식회사 Digital image signal processing method for color correction and digital image signal processing apparatus for applying the method
JP4748271B2 (en) * 2009-01-28 2011-08-17 株式会社ニコン Electronic camera and image processing program
US20100245617A1 (en) * 2009-03-31 2010-09-30 Gary Stephen Shuster Automated white balancing in digital photography
JP2011090569A (en) * 2009-10-23 2011-05-06 Sony Corp Image processing apparatus and image processing method
JP5214749B2 (en) * 2011-01-26 2013-06-19 富士フイルム株式会社 AUTO WHITE BALANCE CORRECTION VALUE CALCULATION DEVICE, METHOD, PROGRAM, AND IMAGING DEVICE
KR101896386B1 (en) * 2011-11-22 2018-09-11 삼성전자주식회사 Device and method for adjusting white balance
US9118876B2 (en) * 2012-03-30 2015-08-25 Verizon Patent And Licensing Inc. Automatic skin tone calibration for camera images
JP5970937B2 (en) * 2012-04-25 2016-08-17 ソニー株式会社 Display control apparatus and display control method
US8885936B2 (en) 2012-06-10 2014-11-11 Apple Inc. Automated color balance tools for editing images
US9070195B2 (en) 2012-06-10 2015-06-30 Apple Inc. Method and system for auto-enhancing photographs with saturation adjustments
KR102082365B1 (en) * 2013-02-26 2020-02-27 삼성전자주식회사 Method for image processing and an electronic device thereof
JP6288816B2 (en) * 2013-09-20 2018-03-07 カシオ計算機株式会社 Image processing apparatus, image processing method, and program
GB201702008D0 (en) 2017-02-07 2017-03-22 Anthropics Tech Ltd A method of matching colours
KR102359276B1 (en) 2017-03-24 2022-02-07 삼성전자주식회사 Method and apparatus for controlling white balance function of electronic device
WO2024048082A1 (en) * 2022-09-02 2024-03-07 ソニーグループ株式会社 Imaging control device and imaging device
DE102024106135A1 (en) * 2024-03-04 2025-09-04 Bundesdruckerei Gmbh Method, apparatus and system for checking a preset white balance of at least one facial image, and a corresponding computer program product

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH02298194A (en) * 1988-10-03 1990-12-10 Hitachi Ltd Color video printer device
US5296945A (en) * 1991-03-13 1994-03-22 Olympus Optical Co., Ltd. Video ID photo printing apparatus and complexion converting apparatus
JP3298072B2 (en) * 1992-07-10 2002-07-02 ソニー株式会社 Video camera system
US5420630A (en) * 1992-09-11 1995-05-30 Canon Kabushiki Kaisha Image pickup apparatus performing white balance control based on data from regions of a frame
BE1007006A3 (en) 1993-04-16 1995-02-14 Koninkl Philips Electronics Nv TONE DETECTION CIRCUIT.
US6069972A (en) 1998-06-02 2000-05-30 Intel Corporation Global white point detection and white balance for color images
JP2001136546A (en) 1999-11-09 2001-05-18 Nikon Corp Electronic camera
JP3959909B2 (en) 1999-11-19 2007-08-15 日本ビクター株式会社 White balance adjustment method and adjustment device
JP4826028B2 (en) * 2001-05-24 2011-11-30 株式会社ニコン Electronic camera
US7259784B2 (en) * 2002-06-21 2007-08-21 Microsoft Corporation System and method for camera color calibration and image stitching

Cited By (27)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1992820B (en) * 2005-12-27 2010-12-22 三星数码影像株式会社 Digital still cameras with face detection to aid in exposure compensation
CN101166286B (en) * 2006-10-20 2010-06-02 索尼株式会社 Image pickup device and method, image processing device and method
CN101179746B (en) * 2006-11-06 2010-12-22 索尼株式会社 Image processing device and image processing method
US8005298B2 (en) 2006-12-22 2011-08-23 Canon Kabushiki Kaisha Image processing apparatus and method thereof
CN101206761B (en) * 2006-12-22 2012-05-23 佳能株式会社 Image processing apparatus and method thereof
CN101389039B (en) * 2007-09-11 2012-04-04 佳能株式会社 Image processing apparatus and image processing method and imaging apparatus
CN101527860B (en) * 2008-03-04 2011-06-15 佳能株式会社 White balance control apparatus, control method therefor, and image sensing apparatus
CN102077245B (en) * 2008-06-26 2014-11-12 惠普开发有限公司 Face detection processing method, image processing device, and manufactured product
CN105409211A (en) * 2013-08-26 2016-03-16 英特尔公司 Automatic white balancing with skin tone correction for image processing
CN105409211B (en) * 2013-08-26 2018-07-10 英特尔公司 For the automatic white balance positive with skin-color adjustment of image procossing
CN104796683B (en) * 2014-01-22 2018-08-14 南京中兴软件有限责任公司 A kind of method and system of calibration image color
WO2015109693A1 (en) * 2014-01-22 2015-07-30 中兴通讯股份有限公司 Method and system for image color calibration
CN106973278A (en) * 2014-11-11 2017-07-21 怀效宁 A kind of AWB device and method with reference to face color character
CN104735362A (en) * 2015-03-11 2015-06-24 广东欧珀移动通信有限公司 Picture taking method and device
CN106097261A (en) * 2016-06-01 2016-11-09 广东欧珀移动通信有限公司 Image processing method and device
US11082677B2 (en) 2017-07-10 2021-08-03 Guangdong Oppo Mobile Telecommunications Corp., Ltd. White balance processing method and apparatus
CN107277479A (en) * 2017-07-10 2017-10-20 广东欧珀移动通信有限公司 White balance processing method and device
CN107465903A (en) * 2017-09-08 2017-12-12 广东欧珀移动通信有限公司 Image white balance method, device and computer-readable storage medium
CN107465903B (en) * 2017-09-08 2019-04-26 Oppo广东移动通信有限公司 Image white balance method, apparatus and computer readable storage medium
US11503262B2 (en) 2017-09-13 2022-11-15 Samsung Electronics Co., Ltd. Image processing method and device for auto white balance
CN109495731A (en) * 2017-09-13 2019-03-19 三星电子株式会社 Auto white balance method is used for by what image-signal processor executed
CN109495731B (en) * 2017-09-13 2022-06-17 三星电子株式会社 Method for automatic white balance executed by image signal processor
CN107635124A (en) * 2017-10-31 2018-01-26 广东欧珀移动通信有限公司 White balance processing method, device and equipment for face shooting
CN108024107A (en) * 2017-12-06 2018-05-11 广东欧珀移动通信有限公司 Image processing method, device, electronic equipment and computer-readable recording medium
CN110570476A (en) * 2018-06-06 2019-12-13 英属开曼群岛商玩美股份有限公司 System, method and storage medium for execution on computing device
CN111626959A (en) * 2020-05-28 2020-09-04 深圳康佳电子科技有限公司 Image processing method, terminal and storage medium
CN113177886A (en) * 2021-04-14 2021-07-27 RealMe重庆移动通信有限公司 Image processing method, image processing device, computer equipment and readable storage medium

Also Published As

Publication number Publication date
JP2005531189A (en) 2005-10-13
KR20050016880A (en) 2005-02-21
AU2003237013A1 (en) 2004-01-06
US6975759B2 (en) 2005-12-13
EP1518417A1 (en) 2005-03-30
WO2004002166A1 (en) 2003-12-31
JP4219893B2 (en) 2009-02-04
US20030235333A1 (en) 2003-12-25
KR100981697B1 (en) 2010-09-13

Similar Documents

Publication Publication Date Title
CN1663287A (en) Method and system for white balancing images using facial color as a reference signal
US8417054B2 (en) System and method for optimizing camera settings
CN100546367C (en) Signal processing apparatus, signal processing method
US9628837B2 (en) Systems and methods for providing synchronized content
US11070891B1 (en) Optimization of subtitles for video content
US20110305384A1 (en) Information processing apparatus, information processing method, and program
CN102326393B (en) Image processing apparatus, image pickup apparatus, and image processing method
EP2109313A1 (en) Television receiver and method
US20080260255A1 (en) Image processing apparatus, imaging apparatus, image processing method, and computer program
US8681239B2 (en) Image capturing device, image capturing method, program, and integrated circuit
CN108234883A (en) Video frequency abstract including particular person
CN103620682A (en) Video summary including a feature of interest
US20010007473A1 (en) Imaging method and apparatus for generating an output image with a wide dynamic range
JP4244063B2 (en) Image processing apparatus, image processing method, and program
CN101213828B (en) Method and apparatus for incorporating iris color into red-eye correction
CN102346858A (en) Image processing apparatus and method, and program
CN103578102B (en) Object detection device and subject detection method
US20040252977A1 (en) Still image extraction from video streams
JP2010245945A (en) Image processing apparatus, and imaging apparatus
CN116051477A (en) Image noise detection method and device for ultra-high definition video file
JP7408358B2 (en) Information processing device, program, storage medium, and information processing method
JP4636024B2 (en) Imaging device
JP2004179708A (en) Digital camera and control method therefor
JP4139145B2 (en) Video image search device
CN101835021A (en) Method and device for continuously reproducing moving image files

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C12 Rejection of a patent application after its publication
RJ01 Rejection of invention patent application after publication

Open date: 20050831