WO2019090591A1 - Procédé de photographie et un système de photographie basés sur un terminal intelligent - Google Patents

Procédé de photographie et un système de photographie basés sur un terminal intelligent Download PDF

Info

Publication number
WO2019090591A1
WO2019090591A1 PCT/CN2017/110170 CN2017110170W WO2019090591A1 WO 2019090591 A1 WO2019090591 A1 WO 2019090591A1 CN 2017110170 W CN2017110170 W CN 2017110170W WO 2019090591 A1 WO2019090591 A1 WO 2019090591A1
Authority
WO
WIPO (PCT)
Prior art keywords
color temperature
temperature value
face
module
light
Prior art date
Application number
PCT/CN2017/110170
Other languages
English (en)
Chinese (zh)
Inventor
詹昌松
Original Assignee
深圳传音通讯有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳传音通讯有限公司 filed Critical 深圳传音通讯有限公司
Priority to CN201780096712.XA priority Critical patent/CN111345030A/zh
Priority to PCT/CN2017/110170 priority patent/WO2019090591A1/fr
Publication of WO2019090591A1 publication Critical patent/WO2019090591A1/fr

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70—Circuitry for compensating brightness variation in the scene

Definitions

  • the present invention relates to the technical field of intelligent terminals, and in particular, to a photographing method and a photographing system based on a smart terminal.
  • Smart terminals have become an increasingly indispensable part of today's life. With the rapid development of smart terminals, its built-in functions are becoming more diverse. Listening to music, business, games, and taking pictures has become a must-have feature for smart terminals. At present, in order to further improve the functions and user experience of smart terminals, technicians have continuously innovated and optimized existing functions.
  • the white balance option is often adjusted manually.
  • the so-called white balance is to let the smart terminal shoot white in different ambient color temperatures to represent real white, where white is a standard, because if the white is accurate, then The other colors are also accurate, so it is called white balance.
  • Those white balance modes such as cloudy, flash, fluorescent lights, etc., are all set by the smart terminal in response to different color temperatures, just to make the color of the photo closer to the real scene color.
  • this adjustment often requires manual operation by the user, and an additional representation of the color is required by additionally filling the light with the tool or replacing the shooting scene.
  • the invention is based on a smart terminal photographing method and a photographing system.
  • the compensating light of different intensities can be automatically generated according to the color temperature value of the face to ensure that the photo can be presented more.
  • Real colors provide users with a more optimized shooting and shooting experience.
  • the invention provides a photographing method for a smart terminal, and the photographing method comprises the following steps:
  • the step of extracting the color temperature value of the face of the face further comprises:
  • the average eye color temperature value of the eye position is detected as a facial color temperature value.
  • the compensation light is emitted by a soft light and/or a flash of the smart terminal.
  • the intensity of the compensated light is adjusted by the flash according to a difference between the facial color temperature value and the preset color temperature value.
  • the present invention further provides a camera system for an intelligent terminal, the camera system comprising: an acquisition module, an extraction module, a determination module, and a compensation module;
  • the collecting module collects a preview image of a face including a shooting object
  • the extraction module is communicatively coupled to the acquisition module and the determined module to extract a facial color temperature value of the face;
  • the compensation module When the color temperature value of the face is lower than a preset color temperature value, the compensation module emits a compensation light.
  • the extraction module further comprises:
  • An identification unit that performs face recognition on the face to determine an eye position in the face
  • the detecting unit detects an average eye color temperature value of the eye position as a facial color temperature value.
  • the intensity of the compensated light is adjusted by the flash according to a difference between the facial color temperature value and the preset color temperature value.
  • the photographing system further includes a prompting module, and the prompting module is communicatively connected to the determining module;
  • the extraction module is further connected to the compensation module, and extracts a compensated color temperature value after the face receives the compensation light;
  • the determining module determines whether the compensated color temperature value is lower than a preset color temperature value
  • the prompting module issues a prompt for reminding the photo.
  • the compensation light of different intensity can be automatically generated according to the color temperature value of the face
  • FIG. 1 is a schematic flowchart of a method for photographing based on an intelligent terminal according to an embodiment of the present invention
  • FIG. 2 is a schematic flowchart of a method for photographing based on an intelligent terminal according to an embodiment of the present invention
  • FIG. 3 is a schematic flowchart of a method for photographing based on an intelligent terminal according to an embodiment of the present invention
  • FIG. 4 is a schematic structural diagram of a camera system based on an intelligent terminal according to an embodiment of the present invention.
  • FIG. 5 is a schematic structural diagram of a camera system based on an intelligent terminal according to an embodiment of the present invention.
  • FIG. 6 is a schematic structural diagram of a camera system based on an intelligent terminal according to an embodiment of the present invention.
  • the smart terminal can be implemented in various forms.
  • the terminal described in the present invention may include a mobile terminal such as a mobile phone, a smart phone, a notebook computer, a PDA (Personal Digital Assistant), a PAD (Tablet), a PMP (Portable Multimedia Player), a navigation device, and the like, and such as Fixed terminal for digital TV, desktop computer, etc.
  • a mobile terminal such as a mobile phone, a smart phone, a notebook computer, a PDA (Personal Digital Assistant), a PAD (Tablet), a PMP (Portable Multimedia Player), a navigation device, and the like
  • the terminal is a smart terminal.
  • those skilled in the art will appreciate that configurations in accordance with embodiments of the present invention can be applied to fixed type terminals in addition to components that are specifically for mobile purposes.
  • the photographing method includes the following steps:
  • the camera of the smart terminal (including the front camera and the rear camera) needs to be first turned on, and after opening, a preview image is collected through the camera.
  • the preview image includes at least one or more face images of the subject.
  • the smart terminal After acquiring the facial image including one or more photographic subjects, the smart terminal further detects the face in the preview image through the built-in color temperature sensor for the subsequent smart terminal to accurately adjust the facial color temperature value according to the current shooting state.
  • the color temperature value is the color temperature of the face.
  • Color temperature is a feature of visible light that has important applications in photography, video, and publishing.
  • Color temperature is a sign that indicates the color of light, not the temperature of light.
  • the color temperature value is expressed by K. Different light sources exhibit different colors because the spectral components are different, and white light contains equal amounts of red, green, and blue light, that is, the same amount of red, green, and blue light are mixed in white light.
  • the color temperature of this white light is about 5400K.
  • a light source contains more red light components, its color temperature is lower than 5400K, for example, the tungsten light color temperature is about 2800K; if a light source contains more blue light components, its color temperature is higher than 5400K, such as sunny days.
  • the color temperature can reach about 20000K. Therefore, the simple understanding is that the more red light, the lower the color temperature value; the more blue the light, the higher the color temperature value.
  • the smart terminal After collecting the color temperature value of the face in the current shooting state, the smart terminal compares the color temperature value of the face with a preset color temperature value to determine whether the current color temperature value of the face reaches the preset standard, that is, determines the current shooting state. Is it possible to realistically present the color of the picture? Based on this, the smart terminal will calculate whether the current facial color temperature value is lower than the preset color temperature value by calling a function for judgment.
  • a compensated light is emitted when the facial color temperature value is below a predetermined color temperature value.
  • the compensation light is emitted by a soft light and/or a flash of the smart terminal.
  • the intensity of the compensated light is adjusted by the flash according to a difference between the facial color temperature value and the preset color temperature value.
  • the smart terminal determines that the photo collected under the current light state cannot present the true color, and the light condition is not good, which affects the photo quality.
  • the current shooting weather is cloudy, rainy, or at night.
  • the setting of the preset color temperature value can refer to the sensitivity of the color temperature of the human eye according to each region.
  • the method of filling light includes: automatically turning on the soft light and/or the flash to increase the current shooting brightness, and adjusting and adjusting the color temperature value of the face of the subject.
  • the smart terminal can adjust the manner of emitting the compensated light and compensate the intensity of the light according to the difference between the color temperature of the face and the preset color temperature value.
  • the difference is small, the light compensation can be performed only by the soft light; if the difference is large, the light compensation should be combined with the soft light and the flash, and further Steps increase the light intensity of the flash, so that the compensated face color temperature value reaches the standard of the preset color temperature value.
  • the step of extracting the color temperature value of the face of the face further includes:
  • the step of extracting the face color temperature value of the subject further includes face recognition of the subject.
  • face recognition includes the extraction of the feature information of the specific part of the face and the overall feature information, and the representation methods can be roughly divided into three categories:
  • the first one is a point to represent facial features, that is, some feature points defined according to our understanding of facial features.
  • facial features are defined by points, which we call boundaries. point. This is divided into three kinds of boundaries: extreme points. Generally, such boundaries have only one definition in a local range, such as the pupil of the eye, the tip of the nose and the nostrils.
  • Boundary point which can be considered as a boundary point on a local boundary, but considering the position and distance between adjacent boundary points, it is generally extracted uniformly over the entire edge, such as a face contour point. , eyebrow contour points, lip contour points, etc.
  • Interpolation points which have no obvious texture features locally, are calculated by interpolation of other boundary points, such as the center point of the mouth, the eyebrow, and those that are occluded or invisible.
  • the second is to define facial features with lines or borders.
  • the outline of the face is defined as a parabola
  • the boundary of the eyeball is defined as a circle, and so on.
  • the third type is to define facial features by region. For example, in some methods of segmentation by color or gray value, the region of the pixel with lip color is segmented as a mouth by statistically counting the lip color; eyes, eyebrows, etc. The difference is made by the difference between the corresponding color and brightness and other areas of the face, and then the area composed of the eligible pixels is taken as the corresponding target area.
  • the eye position of the photographed person can be obtained by identifying the points, lines, and faces in the face image collected by the smart terminal.
  • the smart terminal After the face recognition is used to lock the eye position in the face of the subject, the smart terminal detects and extracts the eye color temperature value for the eye position through its built-in color temperature sensor, and then averages the extracted N times eye color temperature value. Calculate, and finally get the color temperature of the face.
  • FIG. 3 it is a schematic flowchart of a method for photographing based on an intelligent terminal according to an embodiment of the present invention.
  • the photographing method further comprises:
  • the photographing method provided by the present invention further includes the compensated color temperature after being compensated. The value is further extracted.
  • the smart terminal After the smart terminal extracts the compensated color temperature value after the light compensation, the smart terminal compares the compensated color temperature value with a preset color temperature value to determine whether the compensated color temperature value of the current face reaches the preset standard, that is, the judgment Whether the color of the picture can be realistically displayed under the current shooting state. Based on this, the smart terminal will calculate whether the compensated color temperature value of the current face is lower than the preset color temperature value by calling a function.
  • the smart terminal can detect the current photographing state and can take a photo showing the real color. At this time, the smart terminal will send a prompt to the screen to remind The user can take a photo by taking a photo instruction to capture a preview image to generate a photo corresponding to the preview image.
  • the photographing system includes: an acquisition module, an extraction module, a determination module, and a compensation module;
  • the acquisition module acquiring a preview image of a face including a photographic subject
  • the camera system When the user needs to capture an image including a human face through the smart terminal, the camera system provided by the present invention needs to first open the camera (including the front camera and the rear camera) in the acquisition module, and after opening, through the acquisition module The camera captures a preview image that includes at least one or more facial images of the subject.
  • the extraction module is communicatively coupled to the acquisition module and the determined module to extract a facial color temperature value of the face;
  • the extraction module further detects the color temperature sensor according to the current shooting state, and the extraction module further detects the preview image through its built-in color temperature sensor.
  • the color temperature value of the face is the color temperature of the face.
  • Color temperature is a feature of visible light that has important applications in photography, video, and publishing.
  • Color temperature is a sign that indicates the color of light, not the temperature of light.
  • the color temperature value is expressed by K. Different light sources exhibit different colors because the spectral components are different, and white light contains equal amounts of red, green, and blue light, that is, the same amount of red, green, and blue light are mixed in white light.
  • the color temperature of this white light is about 5400K.
  • a light source contains more red light components, its color temperature is lower than 5400K, for example, the tungsten light color temperature is about 2800K; if a light source contains more blue light components, its color temperature is higher than 5400K, such as sunny days.
  • the color temperature can reach about 20000K. Therefore, the simple understanding is that the more red light, the lower the color temperature value; the more blue the light, the higher the color temperature value.
  • the determining module compares the color temperature value of the face with a preset color temperature value to determine whether the current color temperature value of the face reaches a preset standard, that is, determines the current Whether the color of the picture can be realistically displayed in the shooting state. Based on this, the judging module will calculate whether the current facial color temperature value is lower than the preset color temperature value by calling the function for judgment.
  • the compensation module emits a compensation light when the facial color temperature value is lower than a preset color temperature value.
  • the compensation module emits the compensation light by a soft light and/or a flash.
  • the intensity of the compensated light is adjusted by the flash according to a difference between the facial color temperature value and the preset color temperature value.
  • the judging module judges that the color temperature value of the face obtained by the judging module is lower than a preset color temperature value, the judging module judges that the photo taken under the current light state cannot present the true color, the light condition is not good, and the photo quality is affected.
  • the current shooting weather is cloudy, rainy, or at night.
  • the setting of the preset color temperature value can refer to the sensitivity of the color temperature of the human eye according to each region.
  • the method of filling light includes: automatically turning on the soft light and/or the flash to increase the current shooting brightness, and adjusting and adjusting the color temperature value of the face of the subject.
  • the compensation module can adjust the manner of emitting the compensated light and compensate the intensity of the light according to the difference between the color temperature of the face and the preset color temperature value.
  • the difference is small, the light compensation can be performed only by the soft light in the compensation module; if the difference is large, the soft light and the flash in the compensation module should be combined to compensate the light, and the light intensity change of the flash is further increased. , so that the compensated face color temperature value reaches the standard of the preset color temperature value.
  • the extraction module further includes: an identification unit that performs face recognition on the face to determine an eye position in the face;
  • the extraction module further includes an identification unit and a detection unit.
  • the identification unit is used for face recognition of the photographic subject.
  • the face recognition includes the extraction of the feature information of the specific part of the face and the overall feature information, and the representation methods can be roughly divided into three categories:
  • the first one is a point to represent facial features, that is, some feature points defined according to our understanding of facial features.
  • facial features are defined by points, which we call boundaries. point. This is divided into three kinds of boundaries: extreme points. Generally, such boundaries have only one definition in a local range, such as eyes. Pupils, nose tips and nostrils.
  • Boundary point which can be considered as a boundary point on a local boundary, but considering the position and distance between adjacent boundary points, it is generally extracted uniformly over the entire edge, such as a face contour point. , eyebrow contour points, lip contour points, etc.
  • Interpolation points which have no obvious texture features locally, are calculated by interpolation of other boundary points, such as the center point of the mouth, the eyebrow, and those that are occluded or invisible.
  • the second is to define facial features with lines or borders.
  • the outline of the face is defined as a parabola
  • the boundary of the eyeball is defined as a circle, and so on.
  • the third type is to define facial features by region. For example, in some methods of segmentation by color or gray value, the region of the pixel with lip color is segmented as a mouth by statistically counting the lip color; eyes, eyebrows, etc. The difference is made by the difference between the corresponding color and brightness and other areas of the face, and then the area composed of the eligible pixels is taken as the corresponding target area.
  • the recognition unit of the extraction module can obtain the eye position of the photographed person by the recognition of the points, lines and faces in the facial image collected by the acquisition module.
  • a detecting unit that detects an average eye color temperature value of the eye position as a facial color temperature value.
  • the detecting unit After recognizing the face of the subject by the recognition unit and locking the position of the eye in the face of the subject, the detecting unit can detect and extract the color temperature value of the eye for the eye position through the built-in color temperature sensor thereof, and then extract the obtained eye color value.
  • the N-eye color temperature value is averaged, and finally the face color temperature value is obtained.
  • FIG. 6 is a schematic structural diagram of a camera system based on an intelligent terminal according to an embodiment of the present invention.
  • the photographing system further includes a prompting module, the prompt a module, which is in communication with the determining module;
  • the extraction module is further connected in communication with the compensation module, and extracts a compensated color temperature value after the face receives the compensation light;
  • the extraction module in the photographing system provided by the present invention further The compensation module communication connection is further used for further extracting the compensated compensation color temperature value.
  • the determining module determining whether the compensated color temperature value is lower than a preset color temperature value
  • the determining module further compares the compensated color temperature value with a preset color temperature value to determine whether the compensated color temperature value of the current face reaches a preset standard, that is, Determine whether the color of the picture can be realistically displayed under the current shooting state. Based on this, the judgment module will calculate whether the compensated color temperature value of the current face is lower than the preset color temperature value by calling the function for judgment.
  • the prompting module issues a reminder to remind the photo.
  • the judging module judges that the photograph of the real color can be captured under the current photographing state, and at this time, the prompting module of the photographing system will issue a photo to the screen.
  • the prompt reminds the user that the photo can be taken by taking a photo instruction, and the preview image is captured to generate a photo corresponding to the preview image.
  • the invention adopts a smart terminal-based photographing method and a photographing system provided by the invention, and the user does not need to manually adjust the white balance option when taking photos, without using the fill light tool, and is not restricted by the shooting location, and the face of the photographed object is adopted.
  • Face color temperature value extraction can automatically emit different intensity compensation light according to the color temperature value of the face to ensure that the photo is shot under a certain standard brightness, providing users with a more optimized shooting effect and shooting experience.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Studio Devices (AREA)

Abstract

Selon la présente invention, un procédé de photographie basé sur un terminal intelligent, comprenant les étapes suivantes consistant : à collecter une image de prévisualisation comprenant un visage d'un sujet de photographie ; à extraire une valeur de température de couleur faciale ; à déterminer si la valeur de température de couleur faciale est inférieure à une valeur de température de couleur prédéfinie ; et, lorsque la valeur de température de couleur faciale est inférieure à la valeur de température de couleur prédéfinie, à émettre un rayon lumineux de compensation. Le système de photographie basé sur un terminal intelligent comprend : un module de collecte, un module d'extraction, un module de détermination et un module de compensation.
PCT/CN2017/110170 2017-11-09 2017-11-09 Procédé de photographie et un système de photographie basés sur un terminal intelligent WO2019090591A1 (fr)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201780096712.XA CN111345030A (zh) 2017-11-09 2017-11-09 一种基于智能终端的拍照方法及拍照系统
PCT/CN2017/110170 WO2019090591A1 (fr) 2017-11-09 2017-11-09 Procédé de photographie et un système de photographie basés sur un terminal intelligent

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2017/110170 WO2019090591A1 (fr) 2017-11-09 2017-11-09 Procédé de photographie et un système de photographie basés sur un terminal intelligent

Publications (1)

Publication Number Publication Date
WO2019090591A1 true WO2019090591A1 (fr) 2019-05-16

Family

ID=66437525

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/110170 WO2019090591A1 (fr) 2017-11-09 2017-11-09 Procédé de photographie et un système de photographie basés sur un terminal intelligent

Country Status (2)

Country Link
CN (1) CN111345030A (fr)
WO (1) WO2019090591A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI819219B (zh) * 2020-04-30 2023-10-21 鴻海精密工業股份有限公司 動態場景補償的拍照方法及攝像裝置

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102104785A (zh) * 2009-12-21 2011-06-22 佳能株式会社 摄像设备及其控制方法
CN104581099A (zh) * 2014-12-04 2015-04-29 广东欧珀移动通信有限公司 一种拍摄方法及终端
CN106954027A (zh) * 2017-02-14 2017-07-14 维沃移动通信有限公司 一种图像拍摄的方法及移动终端

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105637783B (zh) * 2013-12-27 2018-10-02 松下电器（美国）知识产权公司 信息处理方法、接收方法和信息处理装置
JP6695021B2 (ja) * 2015-11-27 2020-05-20 パナソニックＩｐマネジメント株式会社 照明装置
CN105744174B (zh) * 2016-02-15 2019-03-08 Oppo广东移动通信有限公司 一种自拍方法、装置及移动终端

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102104785A (zh) * 2009-12-21 2011-06-22 佳能株式会社 摄像设备及其控制方法
CN104581099A (zh) * 2014-12-04 2015-04-29 广东欧珀移动通信有限公司 一种拍摄方法及终端
CN106954027A (zh) * 2017-02-14 2017-07-14 维沃移动通信有限公司 一种图像拍摄的方法及移动终端

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI819219B (zh) * 2020-04-30 2023-10-21 鴻海精密工業股份有限公司 動態場景補償的拍照方法及攝像裝置

Also Published As

Publication number Publication date
CN111345030A (zh) 2020-06-26

Similar Documents

Publication Publication Date Title
US20210329208A1 (en) Illuminant estimation referencing facial color features
USRE47960E1 (en) Methods and devices of illuminant estimation referencing facial color features for automatic white balance
EP3520390B1 (fr) Recolorisation de flux d'images infrarouges
CN110163810B (zh) 一种图像处理方法、装置以及终端
US7912285B2 (en) Foreground/background segmentation in digital images with differential exposure calculations
US7680342B2 (en) Indoor/outdoor classification in digital images
US20220180485A1 (en) Image Processing Method and Electronic Device
CN104735362B (zh) 拍照方法和装置
US8175382B2 (en) Learning image enhancement
US20120229694A1 (en) Digital Image Processing Using Face Detection Information
JP3018914B2 (ja) 階調補正装置
US20150131902A1 (en) Digital Image Analysis
CN112887582A (zh) 一种图像色彩处理方法、装置及相关设备
US10965924B2 (en) Correlating illuminant estimation by a plurality of cameras
CN109089041A (zh) 拍摄场景的识别方法、装置、电子设备和存储介质
CN108234770B (zh) 一种辅助化妆系统、辅助化妆方法、辅助化妆装置
WO2019218879A1 (fr) Procédé et appareil d'interaction de photographie, support de stockage et dispositif terminal
CN108810397B (zh) 一种图像色偏校正方法及终端设备
WO2019090591A1 (fr) Procédé de photographie et un système de photographie basés sur un terminal intelligent
CN110335257A (zh) 一种图像色彩检测方法及移动终端
KR102334030B1 (ko) 컴퓨터 장치를 이용한 헤어 염색 방법
US20210314541A1 (en) Face recognition based on illuminant estimation
CN114565506B (zh) 图像颜色迁移方法、装置、设备及存储介质
RU2794062C2 (ru) Устройство и способ обработки изображения и оборудование
CN117793541A (zh) 环境光线调节方法、装置、电子设备及可读存储介质

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17931783

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17931783

Country of ref document: EP

Kind code of ref document: A1