CN110473156A - Processing method, device, storage medium and the electronic equipment of image information - Google Patents

Processing method, device, storage medium and the electronic equipment of image information Download PDF

Info

Publication number
CN110473156A
CN110473156A CN201910741627.5A CN201910741627A CN110473156A CN 110473156 A CN110473156 A CN 110473156A CN 201910741627 A CN201910741627 A CN 201910741627A CN 110473156 A CN110473156 A CN 110473156A
Authority
CN
China
Prior art keywords
subject area
image
tone mapping
hue adjustment
information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201910741627.5A
Other languages
Chinese (zh)
Other versions
CN110473156B (en
Inventor
贾玉虎
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangdong Oppo Mobile Telecommunications Corp Ltd
Original Assignee
Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangdong Oppo Mobile Telecommunications Corp Ltd filed Critical Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority to CN201910741627.5A priority Critical patent/CN110473156B/en
Publication of CN110473156A publication Critical patent/CN110473156A/en
Application granted granted Critical
Publication of CN110473156B publication Critical patent/CN110473156B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00Image enhancement or restoration
    • G06T5/90Dynamic range modification of images or parts thereof
    • G06T5/94Dynamic range modification of images or parts thereof based on local image properties, e.g. for local contrast enhancement
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/40Extraction of image or video features
    • G06V10/46Descriptors for shape, contour or point-related descriptors, e.g. scale invariant feature transform [SIFT] or bags of words [BoW]; Salient regional features
    • G06V10/462Salient features, e.g. scale invariant feature transforms [SIFT]
    • G06V10/464Salient features, e.g. scale invariant feature transforms [SIFT] using a plurality of salient features, e.g. bag-of-words [BoW] representations
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/168Feature extraction; Face representation
    • G06V40/171Local features and components; Facial parts ; Occluding parts, e.g. glasses; Geometrical relationships
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/172Classification, e.g. identification
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70Circuitry for compensating brightness variation in the scene
    • H04N23/741Circuitry for compensating brightness variation in the scene by increasing the dynamic range of the image compared to the dynamic range of the electronic image sensors
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/80Camera processing pipelines; Components thereof
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10024Color image
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20172Image enhancement details
    • G06T2207/20208High dynamic range [HDR] image processing
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30196Human being; Person
    • G06T2207/30201Face

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • General Health & Medical Sciences (AREA)
  • Signal Processing (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Human Computer Interaction (AREA)
  • Image Processing (AREA)

Abstract

The embodiment of the present application discloses a kind of processing method of image information, comprising: obtains image to be processed and carries out Object identifying, obtains associated first subject area and the second subject area;Corresponding first hue adjustment information is determined based on the first subject area and the second subject area;Tone mapping processing is carried out to the first subject area, generates tone mapping treated first object subject area;The second hue adjustment information of first object subject area and the first subject area is calculated, and determines the tone mapping processing strategie of the second subject area according to the first hue adjustment information and the second hue adjustment information.The tone mapping processing strategie for determining suitable second subject area is combined according to the second hue adjustment information of the first hue adjustment information and the first subject area before and after tone mapping of associated first subject area and the second subject area before tone mapping processing with this, so that associated region treatment effect is true, it is greatly improved the treatment effeciency of image information.

Description

Processing method, device, storage medium and the electronic equipment of image information
Technical field
This application involves technical field of image processing more particularly to a kind of processing method of image information, device, storage Jie Matter and electronic equipment.
Background technique
With the continuous development of electronic technology, the camera pixel of electronic equipment such as mobile phone and image processing function be increasingly Powerful, requirement of the people for the treatment effect of image is also higher and higher, especially for high dynamic range (High Dynamic Range Imaging, HDR) image treatment effect concern.
Currently, generally handling, making for high dynamic range images by tone mapping (Tone Mapping) mode Image whole visual effect it is more preferable, still, unified mapping processing is carried out to high dynamic range images, will lead to that treated The treatment effect of different zones is inconsistent in image, influences treatment effeciency.
Summary of the invention
The embodiment of the present application provides processing method, device, storage medium and the electronic equipment of a kind of image information, Ke Yiti Rise the treatment effeciency of image information.
In a first aspect, the embodiment of the present application provides a kind of processing method of image information, comprising:
Image to be processed is obtained, and Object identifying is carried out to the image to be processed, obtains associated first subject area With the second subject area;
Corresponding first hue adjustment information is determined based on first subject area and the second subject area;
Tone mapping processing is carried out to first subject area, generates tone mapping treated first object target area Domain;
The second hue adjustment information of the first object subject area Yu the first subject area is calculated, and according to described One hue adjustment information and the second hue adjustment information determine the tone mapping processing strategie of second subject area.
Second aspect, a kind of processing unit for the image information that the embodiment of the present application provides, comprising:
Recognition unit carries out Object identifying for obtaining image to be processed, and to the image to be processed, obtains associated First subject area and the second subject area;
Determination unit, for determining corresponding first tone tune based on first subject area and the second subject area Whole information;
Processing unit, for carrying out tone mapping processing to first subject area, generating tone mapping, treated First object subject area;
Computing unit, the second hue adjustment for calculating the first object subject area and the first subject area are believed It ceases, and determines the tone mapping of second subject area according to the first hue adjustment information and the second hue adjustment information Processing strategie.
The third aspect, storage medium provided by the embodiments of the present application, is stored thereon with computer program, when the computer When program is run on computers, so that the computer executes the processing of the image information provided such as the application any embodiment Method.
Fourth aspect, electronic equipment provided by the embodiments of the present application, including processor and memory, the memory have meter Calculation machine program, the processor is by calling the computer program, for executing the figure provided such as the application any embodiment As the processing method of information.
The embodiment of the present application obtains image to be processed and carries out Object identifying, obtains associated first subject area and second pair As region;Corresponding first hue adjustment information is determined based on the first subject area and the second subject area;To the first object Region carries out tone mapping processing, generates tone mapping treated first object subject area;Calculate first object target area The second hue adjustment information in domain and the first subject area, and it is true according to the first hue adjustment information and the second hue adjustment information The tone mapping processing strategie of fixed second subject area.With this according to associated first subject area and the second subject area in color The the second hue adjustment letter of the first hue adjustment information and the first subject area before and after tone mapping before adjusting mapping processing Breath combines the tone mapping processing strategie for determining suitable second subject area, so that associated region treatment effect is true, greatly Improve the treatment effeciency of image information.
Detailed description of the invention
With reference to the accompanying drawing, it is described in detail by the specific embodiment to the application, the technical solution of the application will be made And other beneficial effects are apparent.
Fig. 1 is the flow diagram of the processing method of image information provided by the embodiments of the present application.
Fig. 2 is another flow diagram of the processing method of image information provided by the embodiments of the present application.
Fig. 3 is the schematic diagram of a scenario of the processing method of image information provided by the embodiments of the present application.
Fig. 4 is the module diagram of the processing unit of image information provided by the embodiments of the present application.
Fig. 5 is another module diagram of the processing unit of image information provided by the embodiments of the present application.
Fig. 6 is the structural schematic diagram of electronic equipment provided by the embodiments of the present application.
Fig. 7 is another structural schematic diagram of electronic equipment provided by the embodiments of the present application.
Specific embodiment
Schema is please referred to, wherein identical component symbol represents identical component, the principle of the application is to implement one It is illustrated in computing environment appropriate.The following description be based on illustrated by the application specific embodiment, should not be by It is considered as limitation the application other specific embodiments not detailed herein.
Term as used herein " module " can regard the software object to execute in the arithmetic system as.It is somebody's turn to do herein not Same component, module, engine and service can be regarded as the objective for implementation in the arithmetic system.And the device and method being somebody's turn to do herein is excellent Being implemented in the form of software for choosing, can also be implemented on hardware, certainly within the application protection scope.
The embodiment of the present application provides a kind of processing method of image information, the executing subject of the processing method of the image information It can be the processing unit of image information provided by the embodiments of the present application, or be integrated with the electricity of the processing unit of the image information Sub- equipment, wherein the processing unit of the image information can be realized by the way of hardware or software.Wherein, electronic equipment can To be smart phone, tablet computer, palm PC (PDA, Personal Digital Assistant) etc..
Concrete analysis explanation is carried out below.
The embodiment of the present application provides a kind of processing method of image information, and as shown in FIG. 1, FIG. 1 is the embodiment of the present application to mention The processing method of the flow diagram of the processing method of the image information of confession, the image information may comprise steps of:
In step s101, image to be processed is obtained, and Object identifying is carried out to image to be processed, obtains associated first Subject area and the second subject area.
Wherein, the format of the image to be processed can be bitmap (BitMaP, BMP) and joint photo expert group (Joint Photographic Expert Group, JPEG) etc., which can be high dynamic range images, the high dynamic Range image can provide more dynamic ranges and image detail compared to common image, but due to high dynamic range figure The intensity profile value of picture is very uneven, and partial pixel point is excessively bright, and partial pixel point is excessively dark, so needing to by tone mapping side Formula carries out mapping transformation to color of image, the color value of image is mapped to low-dynamic range from high dynamic range, makes its color It is evenly distributed, it appears that more comfortable, whole presentation effect is more preferable, and presses brighter pixel during this operation It is secretly the most common operation.
But in the tone mapping processing mode of image, by that can be protected to default subject area, such as face pair As the protection mechanism in region, avoids face subject area dark excessive by pressure in tone mapping processing, face is caused to present not certainly So, however only carrying out protection to face subject area will lead to object around face subject area still according to original color Mapping mode processing is adjusted, such as the hair of people, when hair is black, press to hair not will lead to and face object secretly Region it is excessively uncoordinated, but nowadays with the diversification of life, more and more people like having hair dyed, and are no lack of among these head Hair dye non-black light tone or the born non-black of occidentals hair, in the case, if to face subject area into Row protection, and associated hair subject area is handled still according to original tone mapping mode, it will lead to and protected Treated that hair subject area difference is excessive for the face subject area and normal tone mapping mode for protecting processing, so that tone Treated, and entire portrait is unnatural.
Optionally, image recognition algorithm, such as convolutional neural networks (Convolutional Neural can be passed through Networks, CNN) for algorithm to image to be processed progress image recognition, identification obtains the different objects in image to be processed, from Be mutually related the first subject area and the second subject area are determined in different objects, such as face subject area and hair pair As region is strong correlation or trunk subject area and leaf objects region is strong correlation, associated first target area Domain and the second subject area need rationally to be handled in tone mapping processing, avoid the occurrence of the false feelings of image procossing Shape.
In step s 102, corresponding first hue adjustment letter is determined based on the first subject area and the second subject area Breath.
Wherein it is possible to calculate corresponding first hue adjustment letter based on first subject area and the second subject area Breath, the first hue adjustment information are the table of the first subject area and the second subject area before not carrying out tone mapping processing Disparity range is now spent, such as the first subject area and the second subject area are determined in the difference of brightness and contrast according to the difference Corresponding difference range out, the difference range are the first hue adjustment information, which embodies original The image appearance degree difference of first subject area and the second subject area in image, even if subsequent progress tone mapping processing, Need to retain the image appearance degree difference, to retain the true angle value of image.
In step s 103, tone mapping processing is carried out to the first subject area, generating tone mapping, treated first Targeted object region.
Wherein, conventional tone mapping method is to be adjusted according to the brightness and contrast of pixel itself, is easy to cause The brightness and contrast of different zones area object cannot reach requirement simultaneously in whole image after adjustment, such as in the figure for having portrait As in, background is brighter sky, and the picture tone if it is desired to be mapped to low dynamic image by this when, it is necessary to pixel It is worth high pixel to be compressed, although the dynamic range of sky can be reduced in this way, also results in portrait simultaneously The higher point of pixel value can also be compressed simultaneously, so that portrait is untrue, the contrast between part can be poor, at this point, generally Face subject area can be protected, face subject area is avoided secretly excessively face to be caused to show by pressure in tone mapping procedure Show abnormal.
Optionally, the region for carrying out tone mapping protection mechanism is needed to be determined as first similar face subject area etc. Subject area carries out tone mapping processing according to the tone mapping processing under protection mechanism, the first mesh after generating tone mapping Mark subject area.
In step S104, the second hue adjustment information of first object subject area and the first subject area is calculated, and The tone mapping processing strategie of the second subject area is determined according to the first hue adjustment information and the second hue adjustment information.
Wherein, based on according to treated the first object subject area of the tone mapping under protection mechanism and not according to protecting The expressivity disparity range of first subject area of the tone mapping processing under mechanism, such as first object subject area and first pair As region is in the difference of brightness and contrast, corresponding difference range is determined according to the difference, which is second Adjustment information, the second hue adjustment information embody the first subject area and according to the tone under protection mechanism in original image The image appearance degree difference of mapping treated first object subject area, subsequent second subject area carry out at tone mapping Reason needs to follow the processing degree difference of the tone mapping processing of first subject area.
Further, the second subject area phase is determined in conjunction with the first hue adjustment information and the second hue adjustment information The tone mapping processing strategie answered, so that second subject area is based on the tone mapping processing strategie and carries out tone mapping processing Afterwards, the expressivity of the tone mapping obtained treated the second targeted object region had both met the first object in former image to be processed The expressivity difference in region and the second subject area also complies with the processing amplitude of the tone mapping processing of the first subject area, makes The expressivity of tone mapping treated first object subject area and the second targeted object region meets wanting for real scene It asks.
It can be seen from the above, a kind of processing method of image information provided in this embodiment, by obtain image to be processed into Row Object identifying obtains associated first subject area and the second subject area;Based on the first subject area and the second target area Determine corresponding first hue adjustment information in domain;Tone mapping processing is carried out to the first subject area, is generated at tone mapping First object subject area after reason;The second hue adjustment information of first object subject area and the first subject area is calculated, And the tone mapping processing strategie of the second subject area is determined according to the first hue adjustment information and the second hue adjustment information.With This according to the first hue adjustment information before tone mapping processing of associated first subject area and the second subject area and Second hue adjustment information of first subject area before and after tone mapping, which combines, determines that the tone of suitable second subject area reflects Processing strategie is penetrated, so that associated region treatment effect is true, is greatly improved the treatment effeciency of image information.
Citing, is described in further detail by the method according to described in above-described embodiment below.
Referring to Fig. 2, Fig. 2 is another flow diagram of the processing method of image information provided by the embodiments of the present application.
Specifically, this method comprises:
In step s 201, image to be processed is obtained, the key feature points information in image to be processed is extracted.
It should be noted that electronic equipment is illustrated with mobile phone below in order to better illustrate the application.
Wherein, mobile phone obtains high dynamic range images, as shown in figure 3, processing image 1 is high dynamic range images, it should It may include sky and personage in processing image 1, due to light refraction problem, the brightness for handling the sky in image 1 of shooting The brightness and contrast of personage certainly will be higher than with contrast.
Optionally, can by convolutional neural networks according to sequence from top to bottom to the pixel of image to be processed carry out by The identification of one feature, extracts the key feature points information in image to be processed.
In step S202, associated face subject area and hair subject area are determined according to key feature points information.
Wherein it is possible to face subject area be determined according to key feature points information, due to including in face subject area Feature very abundant and especially, such as eyes, mouth, eyebrow, nose and hair key feature points, according to the key feature points Determine face subject area and associated hair subject area.
Due to current conventional tone mapping method be brightness for subject areas different in entire image to be processed and Contrast is handled simultaneously, as shown in figure 3, conventional tone mapping method is to hair subject area A, face subject area B and sky subject area C carries out tone mapping processing together, and background is brighter sky, at this time if it is desired to processing is schemed As 1 tone mapping to low dynamic image, it is necessary to the high pixel of pixel value be compressed, although in this way can be sky Dynamic range reduces, but also results in the pixel value in portrait simultaneously and be overly compressed as sky degree for the treatment of, so that Portrait is untrue, and the contrast between part is poor, so generally requiring to carry out face protection to image, for face object Region carries out individual tone mapping processing, other subject areas such as hair subject area is still according to such as sky degree for the treatment of It is handled, will lead to tone mapping in the case where face subject area and hair subject area strong correlation with this and handle it Differ larger between face subject area and the brightness and contrast of hair subject area afterwards, so that portrait presentation is untrue.
In step S203, the first brightness value and the first contrast value of face subject area are obtained, obtains hair object Second brightness value and the second contrast value in region.
Wherein, first brightness value and first contrast of the face subject area before not carrying out tone mapping processing are obtained Value obtains second brightness value and second contrast value of the hair subject area before not carrying out tone mapping processing, this first Brightness value and the first contrast value and the second brightness value and the second contrast value represent in original image face subject area and The expressivity disparity range of hair subject area is the more true portrait form of expression.
In step S204, calculate the first brightness value and the second brightness value the first luminance difference and the first contrast value and First luminance difference and the first poor contrast are determined as the first hue adjustment information by the first poor contrast of the second contrast value.
Wherein, the first luminance difference and the first contrast value and second for calculating the first brightness value and the second brightness value compare First poor contrast of degree, first luminance difference and the first poor contrast are positive number, such as the first luminance difference and the first poor contrast For negative, then needing accordingly to carry out absolute value processing.
Optionally, the first luminance difference range can will be determined according to the first luminance difference and will be determined according to the first poor contrast First poor contrast range out, the size of the range are that fluctuation up and down is carried out according to practical situation, and such as upper and lower amplitude of variation is 5 Etc., corresponding first hue adjustment information is determined based on the first luminance difference range and the first poor contrast range, this One hue adjustment information embodies the image degree of a representation difference model of face subject area and hair subject area in original image It encloses.
In step S205, tone mapping processing is carried out to face subject area, generating tone mapping, treated first Target face subject area.
Wherein, it handles, generates as shown in figure 3, carrying out the tone mapping with face protection mechanism to face subject area B Tone mapping treated first object face subject area.
In step S206, the third brightness value and third contrast value of first object face subject area are obtained.
Wherein, it obtains and is carrying out the tone mapping with face protection mechanism treated first object face subject area Third brightness value and third contrast value.
In step S207, calculate third brightness value and the first brightness value the second luminance difference and third contrast value and Second luminance difference and the second poor contrast are determined as the second hue adjustment information by the second poor contrast of the first contrast value.
Wherein, no matter how tone mapping processing is carried out to high-dynamics image, last presentation effect should will all meet Therefore the presentation rule of former dynamic image calculates tone mapping treated the target face object with face protection mechanism Second luminance difference of the first brightness value of the face subject area of the third brightness value and original image in region and have face The tone mapping of protection mechanism treated the third contrast value of target face subject area and the face object of original image Second poor contrast of first contrast value in region, second luminance difference and the second poor contrast are positive number, such as the second brightness Difference and the second poor contrast are negative, then needing accordingly to carry out absolute value processing.
Optionally, the second luminance difference range can will be determined according to the second luminance difference and will be determined according to the second poor contrast Second poor contrast range out, the size of the range are that fluctuation up and down is carried out according to practical situation, and such as upper and lower amplitude of variation is 5 Etc., corresponding second hue adjustment information is determined based on the second luminance difference range and the second poor contrast range, this Two hue adjustment information, the second hue adjustment information embody face subject area in original image and protect machine according to face The image appearance degree difference of the tone mapping of system treated target face subject area is with range.
In step S208, image contrast range is determined according to the first luminance difference and the first poor contrast, according to Second luminance difference and the second poor contrast determine face tone adjustable range, bond area shade contrast's range and face tone Adjustable range determines the corresponding tone mapping processing strategie of hair subject area.
Wherein, according to the corresponding first luminance difference range of the first luminance difference and corresponding first poor contrast of the first contrast Range determines the image contrast range between face subject area and hair subject area in original image to be processed, The image contrast range be original image to be processed face subject area and hair subject area contrast range, it is subsequent Tone mapping processing after target face subject area and target hair subject area need to meet the contrast range so that Face and hair keep original presentation mode, keep authenticity.
Further, according to corresponding second comparison of the corresponding second luminance difference range of the second luminance difference and the second contrast It spends poor range and determines the tone mapping with face protection mechanism treated target face subject area and original to be processed Face tone adjustable range between face subject area in image, the face adjustable range are to carry out face protection mechanism Tone mapping treated target face subject area and original image to be processed face object adjustable range, it is subsequent The target hair head subject area after hair subject area and tone mapping processing in original image to be processed needs to meet The adjustable range, so that the tone mapping treatment effect of hair subject area is handled with the tone mapping with face protection mechanism Treatment effect it is close.
Therefore, the tone of hair subject area is determined in conjunction with the image contrast range and face tone adjustable range Processing strategie is mapped, so that obtaining after the hair subject area carries out tone mapping processing according to the tone mapping processing strategie Target hair subject area meet the original presentation diversity factor of face subject area and hair subject area in image to be processed And the tone mapping of face protection mechanism treated adjust treatment effect so that the target face target area after tone mapping The expressivity of domain and target hair subject area meets authenticity, avoids in face subject area in the color for carrying out face protection Adjust mapping processing under, and associated hair subject area tone mapping processing under present effect gap it is larger so that portrait False situation is presented.
It can be seen from the above, a kind of processing method of image information provided in this embodiment, by obtain image to be processed into Row Object identifying obtains associated first subject area and the second subject area;Based on the first subject area and the second target area Determine corresponding first hue adjustment information in domain;Tone mapping processing is carried out to the first subject area, is generated at tone mapping First object subject area after reason;The second hue adjustment information of first object subject area and the first subject area is calculated, And the tone mapping processing strategie of the second subject area is determined according to the first hue adjustment information and the second hue adjustment information.With This according to the first hue adjustment information before tone mapping processing of associated first subject area and the second subject area and Second hue adjustment information of first subject area before and after tone mapping, which combines, determines that the tone of suitable second subject area reflects Processing strategie is penetrated, so that associated region treatment effect is true, is greatly improved the treatment effeciency of image information.
For the processing method convenient for better implementation image information provided by the embodiments of the present application, the embodiment of the present application is also mentioned For a kind of device of processing method based on above-mentioned image information.The wherein processing method of the meaning of noun and above-mentioned image information In it is identical, specific implementation details can be with reference to the explanation in embodiment of the method.
Referring to Fig. 4, Fig. 4 is the module diagram of the processing unit of image information provided by the embodiments of the present application.Specifically For, the processing unit 300 of the image information, comprising: recognition unit 31, determination unit 32, processing unit 33 and calculating are single Member 34.
Recognition unit 31 carries out Object identifying for obtaining image to be processed, and to the image to be processed, is associated with The first subject area and the second subject area.
Wherein, recognition unit 31 can be by image recognition algorithm, such as convolutional neural networks algorithm is to image to be processed Image recognition is carried out, identification obtains the different objects in image to be processed, determines to be mutually related from different objects First subject area and the second subject area, as face subject area and hair subject area are strong correlation or trunk pair As region and leaf objects region are strong correlation, associated first subject area and the second subject area are at tone mapping It needs rationally to be handled in reason, avoids the occurrence of the false situation of image procossing.
In some embodiments, as shown in figure 5, the recognition unit 31, comprising:
Subelement 311 is extracted, for obtaining image to be processed, extracts the key feature points letter in the image to be processed Breath;
Subelement 312 is determined, for determining associated face subject area and hair according to the key feature points information Subject area.
Determination unit 32, for determining corresponding first tone based on first subject area and the second subject area Adjustment information.
Wherein it is determined that unit 32 can calculate corresponding first color based on first subject area and the second subject area Adjustment information is adjusted, which is that the first subject area and the second subject area are not carrying out tone mapping processing Expressivity disparity range before, such as the first subject area and the second subject area brightness and contrast difference, according to this Difference determines corresponding difference range, which is the first hue adjustment information, which is The image appearance degree difference for embodying the first subject area and the second subject area in original image, even if subsequent progress tone mapping Processing, it is also desirable to retain the image appearance degree difference, to retain the true angle value of image.
In some embodiments, the determination unit 32, specifically for obtain face subject area the first brightness value and First contrast value;Obtain the second brightness value and the second contrast value of hair subject area;Calculate first brightness value and First poor contrast of the first luminance difference of the second brightness value and the first contrast value and the second contrast value;By described first Luminance difference and first poor contrast are determined as the first hue adjustment information.
Processing unit 33, for carrying out tone mapping processing to first subject area, after generating tone mapping processing First object subject area.
Wherein, the region that similar face subject area etc. is needed to carry out tone mapping protection mechanism by processing unit 33 is true It is set to the first subject area, tone mapping processing is carried out according to the tone mapping processing under protection mechanism, after generating tone mapping First object subject area.
In some embodiments, the processing unit 33, is specifically used for: carrying out tone mapping to the face subject area Processing generates tone mapping treated first object face subject area.
Computing unit 34, the second hue adjustment for calculating the first object subject area and the first subject area are believed It ceases, and determines the tone mapping of second subject area according to the first hue adjustment information and the second hue adjustment information Processing strategie.
Wherein, computing unit 34 based on according to treated the first object subject area of the tone mapping under protection mechanism and The not expressivity disparity range according to the first subject area of the tone mapping processing under protection mechanism, such as first object target area Domain and the first subject area determine corresponding difference range according to the difference, the difference model in the difference of brightness and contrast Enclose as second adjustment information, the second hue adjustment information i.e. embody original image in the first subject area and according to protection machine The image appearance degree difference of the lower tone mapping of system treated first object subject area, subsequent second subject area progress color Mapping processing is adjusted, needs to follow the processing degree difference of the tone mapping processing of first subject area.
Further, computing unit 34 combines the first hue adjustment information and the second hue adjustment information to determine second The corresponding tone mapping processing strategie of subject area, so that second subject area is based on the tone mapping processing strategie and carries out color After adjusting mapping processing, the expressivity of obtained tone mapping treated the second targeted object region had both met former image to be processed In the first subject area and the second subject area expressivity difference, also comply with the first subject area tone mapping processing place Reason amplitude, so that tone mapping treated first object subject area and the expressivity of the second targeted object region meet really The requirement of scene.
In some embodiments, the computing unit 34, is specifically used for: obtaining the third of first object face subject area Brightness value and third contrast value;Calculate the second luminance difference and third contrast of the third brightness value and the first brightness value Second poor contrast of value and the first contrast value;Second luminance difference and second poor contrast are determined as the second color Adjust adjustment information;Image contrast range is determined according to first luminance difference and the first poor contrast;According to described Two luminance differences and the second poor contrast determine face tone adjustable range;In conjunction with the image contrast range and the people Face tune adjusting range determines the corresponding tone mapping processing strategie of hair subject area.
It can be seen from the above, a kind of processing unit of image information provided in this embodiment, by recognition unit 31 obtain to It handles image and carries out Object identifying, obtain associated first subject area and the second subject area;Determination unit 32 is based on first Subject area and the second subject area determine corresponding first hue adjustment information;Processing unit 33 to the first subject area into The processing of row tone mapping, generates tone mapping treated first object subject area;Computing unit 34 calculates first object pair Believe as the second hue adjustment information in region and the first subject area, and according to the first hue adjustment information and the second hue adjustment Cease the tone mapping processing strategie for determining the second subject area.With this according to associated first subject area and the second subject area The the second tone tune of the first hue adjustment information and the first subject area before and after tone mapping before tone mapping processing Whole information combines the tone mapping processing strategie for determining suitable second subject area, so that associated region treatment effect is true, pole Big improves the treatment effeciency of image information.
The embodiment of the present application also provides a kind of electronic equipment.Referring to Fig. 6, electronic equipment 500 include processor 501 and Memory 502.Wherein, processor 501 and memory 502 are electrically connected.
The processor 500 is the control centre of electronic equipment 500, utilizes various interfaces and the entire electronic equipment of connection Various pieces, the computer program in memory 502 by operation or load store, and call and be stored in memory Data in 502 execute the various functions of electronic equipment 500 and handle data, to carry out whole prison to electronic equipment 500 Control.
The memory 502 can be used for storing software program and module, and processor 501 is stored in memory by operation 502 computer program and module, thereby executing the processing of various function application and image information.Memory 502 can be led It to include storing program area and storage data area, wherein storing program area can be needed for storage program area, at least one function Computer program (such as sound-playing function, image player function etc.) etc.;Storage data area can be stored according to electronic equipment Use created data etc..In addition, memory 502 may include high-speed random access memory, it can also include non-volatile Property memory, a for example, at least disk memory, flush memory device or other volatile solid-state parts.Correspondingly, it deposits Reservoir 502 can also include Memory Controller, to provide access of the processor 501 to memory 502.
In the embodiment of the present application, the processor 501 in electronic equipment 500 can be according to following step, by one or one The corresponding instruction of the process of a above computer program is loaded into memory 502, and is stored in by the operation of processor 501 Computer program in reservoir 502, thus realize various functions, it is as follows:
Image to be processed is obtained, and Object identifying is carried out to the image to be processed, obtains associated first subject area With the second subject area;
Corresponding first hue adjustment information is determined based on first subject area and the second subject area;
Tone mapping processing is carried out to first subject area, generates tone mapping treated first object target area Domain;
The second hue adjustment information of the first object subject area Yu the first subject area is calculated, and according to described One hue adjustment information and the second hue adjustment information determine the tone mapping processing strategie of second subject area.
In some embodiments, first subject area is face subject area, and second subject area is head Subject area is sent out, Object identifying is being carried out to the image to be processed, is obtaining associated first subject area and the second target area When domain, processor 501 can specifically execute following steps:
Extract the key feature points information in the image to be processed;
Associated face subject area and hair subject area are determined according to the key feature points information.
In some embodiments, corresponding first is being determined based on first subject area and the second subject area When hue adjustment information, processor 501 can specifically execute following steps:
Obtain the first brightness value and the first contrast value of face subject area;
Obtain the second brightness value and the second contrast value of hair subject area;
The first luminance difference and the first contrast value and second for calculating first brightness value and the second brightness value compare First poor contrast of angle value;
First luminance difference and first poor contrast are determined as the first hue adjustment information.
In some embodiments, in the second tone tune for calculating the first object subject area and the first subject area When whole information, processor 501 can specifically execute following steps:
Obtain the third brightness value and third contrast value of first object face subject area;
The second luminance difference and third contrast value and first for calculating the third brightness value and the first brightness value compare Second poor contrast of angle value;
Second luminance difference and second poor contrast are determined as the second hue adjustment information.
In some embodiments, according to the first hue adjustment information and the determination of the second hue adjustment information When the tone mapping processing strategie of the second subject area, processor 501 can specifically execute following steps:
Image contrast range is determined according to first luminance difference and the first poor contrast;
Face tone adjustable range is determined according to second luminance difference and the second poor contrast;
Determine that hair subject area is corresponding in conjunction with the image contrast range and the face tone adjustable range Tone mapping processing strategie.
In some embodiments, tone mapping processing is being carried out to first subject area, generated at tone mapping When first object subject area after reason, processor 501 can specifically execute following steps:
Tone mapping processing is carried out to the face subject area, generates tone mapping treated first object face pair As region.
It can be seen from the above, the electronic equipment of the embodiment of the present application, carries out Object identifying by obtaining image to be processed, obtains Associated first subject area and the second subject area;Corresponding is determined based on the first subject area and the second subject area One hue adjustment information;Tone mapping processing is carried out to the first subject area, generates tone mapping treated first object pair As region;The second hue adjustment information of first object subject area and the first subject area is calculated, and according to the first tone tune Whole information and the second hue adjustment information determine the tone mapping processing strategie of the second subject area.With this according to associated first The the first hue adjustment information and the first subject area of subject area and the second subject area before tone mapping processing are in color The second hue adjustment information of mapping front and back is adjusted to combine the tone mapping processing strategie for determining suitable second subject area, so that closing It is true to join regional processing effect, is greatly improved the treatment effeciency of image information.
Referring to Figure 7 together, in some embodiments, electronic equipment 500 can also include: display 503, radio frequency electrical Road 504, voicefrequency circuit 505 and power supply 506.Wherein, wherein display 503, radio circuit 504, voicefrequency circuit 505 and Power supply 506 is electrically connected with processor 501 respectively.
The display 503 be displayed for information input by user or be supplied to user information and various figures User interface, these graphical user interface can be made of figure, text, icon, video and any combination thereof.Display 503 may include display panel, in some embodiments, can use liquid crystal display (Liquid Crystal Display, LCD) or the forms such as Organic Light Emitting Diode (Organic Light-Emitting Diode, OLED) match Set display panel.
The radio circuit 504 can be used for transceiving radio frequency signal, with by wireless communication with the network equipment or other terminals Wireless telecommunications are established, the receiving and transmitting signal between the network equipment or other terminals.
The voicefrequency circuit 505 can be used for providing the audio between user and electronic equipment by loudspeaker, microphone and connecing Mouthful.
The power supply 506 is used to all parts power supply of electronic equipment 500.In some embodiments, power supply 506 can With logically contiguous by power-supply management system and processor 501, thus charged, discharged by power-supply management system realization management, And the functions such as power managed.
The embodiment of the present application also provides a kind of storage medium, which is stored with computer program, when the computer When program is run on computers, so that the computer executes the processing method of the image information in any of the above-described embodiment, than Such as: obtaining image to be processed, and Object identifying is carried out to the image to be processed, obtain associated first subject area and second Subject area;Corresponding first hue adjustment information is determined based on first subject area and the second subject area;To institute It states the first subject area and carries out tone mapping processing, generate tone mapping treated first object subject area;Described in calculating Second hue adjustment information of first object subject area and the first subject area, and according to the first hue adjustment information and Second hue adjustment information determines the tone mapping processing strategie of second subject area.
In the embodiment of the present application, storage medium can be magnetic disk, CD, read-only memory (Read Only Memory, ROM) or random access memory (Random Access Memory, RAM) etc..
In the above-described embodiments, it all emphasizes particularly on different fields to the description of each embodiment, there is no the portion being described in detail in some embodiment Point, reference can be made to the related descriptions of other embodiments.
It should be noted that for the processing method of the image information of the embodiment of the present application, this field common test people Member is understood that realize all or part of the process of the processing method of the image information of the embodiment of the present application, is that can pass through calculating Machine program is completed to control relevant hardware, which can be stored in a computer-readable storage medium, such as It is stored in the memory of electronic equipment, and is executed by least one processor in the electronic equipment, in the process of implementation may be used The process of the embodiment of processing method including such as image information.Wherein, the storage medium being somebody's turn to do can for magnetic disk, CD, read-only deposit Reservoir, random access memory etc..
For the processing unit of the image information of the embodiment of the present application, each functional module can integrate to be handled at one In chip, it is also possible to modules and physically exists alone, can also be integrated in two or more modules in a module. Above-mentioned integrated module both can take the form of hardware realization, can also be realized in the form of software function module.The collection If at module realized in the form of software function module and when sold or used as an independent product, also can store In one computer-readable storage medium, which is for example read-only memory, disk or CD etc..
Above to a kind of processing method of image information, device, storage medium and electronics provided by the embodiment of the present application Equipment is described in detail, and specific examples are used herein to illustrate the principle and implementation manner of the present application, with The explanation of upper embodiment is merely used to help understand the present processes and its core concept;Meanwhile for the technology of this field Personnel, according to the thought of the application, there will be changes in the specific implementation manner and application range, in conclusion this theory Bright book content should not be construed as the limitation to the application.

Claims (10)

1. a kind of processing method of image information characterized by comprising
It obtains image to be processed, and Object identifying is carried out to the image to be processed, obtain associated first subject area and the Two subject areas;
Corresponding first hue adjustment information is determined based on first subject area and the second subject area;
Tone mapping processing is carried out to first subject area, generates tone mapping treated first object subject area;
The second hue adjustment information of the first object subject area Yu the first subject area is calculated, and according to first color Adjustment information and the second hue adjustment information is adjusted to determine the tone mapping processing strategie of second subject area.
2. the processing method of image information as described in claim 1, which is characterized in that first subject area is face pair As region, second subject area is hair subject area, described to carry out Object identifying to the image to be processed, is closed The step of the first subject area and the second subject area of connection, comprising:
Extract the key feature points information in the image to be processed;
Associated face subject area and hair subject area are determined according to the key feature points information.
3. the processing method of image information as claimed in claim 2, which is characterized in that described to be based on first subject area The step of determining corresponding first hue adjustment information with the second subject area, comprising:
Obtain the first brightness value and the first contrast value of face subject area;
Obtain the second brightness value and the second contrast value of hair subject area;
Calculate the first luminance difference and the first contrast value and the second contrast value of first brightness value and the second brightness value The first poor contrast;
First luminance difference and first poor contrast are determined as the first hue adjustment information.
4. the processing method of image information as claimed in claim 3, which is characterized in that described to calculate the first object object The step of second hue adjustment information of region and the first subject area, comprising:
Obtain the third brightness value and third contrast value of first object face subject area;
Calculate the second luminance difference and third contrast value and the first contrast value of the third brightness value and the first brightness value The second poor contrast;
Second luminance difference and second poor contrast are determined as the second hue adjustment information.
5. the processing method of image information as claimed in claim 4, which is characterized in that described according to first hue adjustment The step of information and the second hue adjustment information determine the tone mapping processing strategie of second subject area, comprising:
Image contrast range is determined according to first luminance difference and the first poor contrast;
Face tone adjustable range is determined according to second luminance difference and the second poor contrast;
The corresponding tone of hair subject area is determined in conjunction with the image contrast range and the face tone adjustable range Map processing strategie.
6. such as the processing method of the described in any item image informations of claim 2 to 5, which is characterized in that described to described first The step of subject area carries out tone mapping processing, generates tone mapping treated first object subject area, comprising:
Tone mapping processing is carried out to the face subject area, generates tone mapping treated first object face target area Domain.
7. a kind of processing unit of image information characterized by comprising
Recognition unit carries out Object identifying for obtaining image to be processed, and to the image to be processed, obtains associated first Subject area and the second subject area;
Determination unit, for determining corresponding first hue adjustment letter based on first subject area and the second subject area Breath;
Processing unit, for carrying out tone mapping processing to first subject area, generating tone mapping, treated first Targeted object region;
Computing unit, for calculating the second hue adjustment information of the first object subject area Yu the first subject area, and The tone mapping processing of second subject area is determined according to the first hue adjustment information and the second hue adjustment information Strategy.
8. the processing unit of image information as claimed in claim 7, which is characterized in that first subject area is face pair As region, second subject area is hair subject area, the recognition unit, comprising:
Subelement is extracted, for obtaining image to be processed, extracts the key feature points information in the image to be processed;
Subelement is determined, for determining associated face subject area and hair target area according to the key feature points information Domain.
9. a kind of storage medium, is stored thereon with computer program, which is characterized in that when the computer program on computers When operation, so that the computer executes the processing method such as image information as claimed in any one of claims 1 to 6.
10. a kind of electronic equipment, including processor and memory, the memory have computer program, which is characterized in that described Processor is by calling the computer program, for executing the processing such as image information as claimed in any one of claims 1 to 6 Method.
CN201910741627.5A 2019-08-12 2019-08-12 Image information processing method and device, storage medium and electronic equipment Active CN110473156B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910741627.5A CN110473156B (en) 2019-08-12 2019-08-12 Image information processing method and device, storage medium and electronic equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910741627.5A CN110473156B (en) 2019-08-12 2019-08-12 Image information processing method and device, storage medium and electronic equipment

Publications (2)

Publication Number Publication Date
CN110473156A true CN110473156A (en) 2019-11-19
CN110473156B CN110473156B (en) 2022-08-02

Family

ID=68510191

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910741627.5A Active CN110473156B (en) 2019-08-12 2019-08-12 Image information processing method and device, storage medium and electronic equipment

Country Status (1)

Country Link
CN (1) CN110473156B (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112351195A (en) * 2020-09-22 2021-02-09 北京迈格威科技有限公司 Image processing method, device and electronic system
CN114463191A (en) * 2021-08-26 2022-05-10 荣耀终端有限公司 Image processing method and electronic equipment
CN114676360A (en) * 2022-03-23 2022-06-28 腾讯科技(深圳)有限公司 Image processing method, image processing device, electronic equipment and storage medium

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101389039A (en) * 2007-09-11 2009-03-18 佳能株式会社 Image processing apparatus and image processing method and imaging apparatus
CN101621702A (en) * 2009-07-30 2010-01-06 北京海尔集成电路设计有限公司 Method and device for automatically adjusting chroma and saturation
CN103400342A (en) * 2013-07-04 2013-11-20 西安电子科技大学 Mixed color gradation mapping and compression coefficient-based high dynamic range image reconstruction method
CN105913373A (en) * 2016-04-05 2016-08-31 广东欧珀移动通信有限公司 Image processing method and device
CN107862657A (en) * 2017-10-31 2018-03-30 广东欧珀移动通信有限公司 Image processing method, device, computer equipment and computer-readable recording medium
WO2019028700A1 (en) * 2017-08-09 2019-02-14 深圳市大疆创新科技有限公司 Image processing method, device and computer readable storage medium

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101389039A (en) * 2007-09-11 2009-03-18 佳能株式会社 Image processing apparatus and image processing method and imaging apparatus
CN101621702A (en) * 2009-07-30 2010-01-06 北京海尔集成电路设计有限公司 Method and device for automatically adjusting chroma and saturation
CN103400342A (en) * 2013-07-04 2013-11-20 西安电子科技大学 Mixed color gradation mapping and compression coefficient-based high dynamic range image reconstruction method
CN105913373A (en) * 2016-04-05 2016-08-31 广东欧珀移动通信有限公司 Image processing method and device
WO2019028700A1 (en) * 2017-08-09 2019-02-14 深圳市大疆创新科技有限公司 Image processing method, device and computer readable storage medium
CN107862657A (en) * 2017-10-31 2018-03-30 广东欧珀移动通信有限公司 Image processing method, device, computer equipment and computer-readable recording medium

Non-Patent Citations (4)

* Cited by examiner, † Cited by third party
Title
GIAN DL ET AL: "《Dynamic range enhancement for Medical Image Processing》", 《2017 7TH IEEE INTERNATIONAL WORKSHOP ON ADVANCES IN SENSORS AND INTERFACES》 *
李美怡: "《不完整的模糊人脸图像修复方法的研究》", 《中国优秀博硕士学位论文全文数据库 (硕士) 信息科技辑》 *
许少杰: "《基于边缘保持平滑滤波与编辑传播的快速人脸美化方法及系统实现》", 《中国优秀硕士学位论文全文数据库 信息科技辑》 *
阳策等: "《基于标准肤色的人脸图像纹理合成与三维重建应用》", 《计算机系统应用》 *

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112351195A (en) * 2020-09-22 2021-02-09 北京迈格威科技有限公司 Image processing method, device and electronic system
CN112351195B (en) * 2020-09-22 2022-09-30 北京迈格威科技有限公司 Image processing method, device and electronic system
CN114463191A (en) * 2021-08-26 2022-05-10 荣耀终端有限公司 Image processing method and electronic equipment
CN114463191B (en) * 2021-08-26 2023-01-31 荣耀终端有限公司 Image processing method and electronic equipment
CN114676360A (en) * 2022-03-23 2022-06-28 腾讯科技(深圳)有限公司 Image processing method, image processing device, electronic equipment and storage medium

Also Published As

Publication number Publication date
CN110473156B (en) 2022-08-02

Similar Documents

Publication Publication Date Title
WO2021027649A1 (en) Dark-mode display interface processing method, electronic device, and storage medium
CN111327814A (en) Image processing method and electronic equipment
CN105516585B (en) A kind of device and method of the adjust automatically colour of skin
CN110136183A (en) A kind of method and relevant device of image procossing
CN112712470B (en) Image enhancement method and device
CN110473156A (en) Processing method, device, storage medium and the electronic equipment of image information
CN112950499B (en) Image processing method, device, electronic equipment and storage medium
CN112449120A (en) High dynamic range video generation method and device
CN113452969B (en) Image processing method and device
CN108921941A (en) Image processing method, device, storage medium and electronic equipment
CN110570370B (en) Image information processing method and device, storage medium and electronic equipment
CN110163816B (en) Image information processing method and device, storage medium and electronic equipment
CN113132696A (en) Image tone mapping method, device, electronic equipment and storage medium
CN114463191B (en) Image processing method and electronic equipment
CN117201930B (en) Photographing method and electronic equipment
CN112184581B (en) Image processing method, device, computer equipment and medium
CN116668656B (en) Image processing method and electronic equipment
CN116668838B (en) Image processing method and electronic equipment
CN116055699A (en) Image processing method and related electronic equipment
US8498332B2 (en) Chroma supression features
CN107563957A (en) Eyes image processing method and processing device
CN117119316B (en) Image processing method, electronic device, and readable storage medium
CN113518172A (en) Image processing method and device
CN114519891A (en) Backlight adjusting method and device and storage medium
WO2016164098A1 (en) System and method to refine image data

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant