CN107464253A - eyebrow location method and device - Google Patents
eyebrow location method and device Download PDFInfo
- Publication number
- CN107464253A CN107464253A CN201710557776.7A CN201710557776A CN107464253A CN 107464253 A CN107464253 A CN 107464253A CN 201710557776 A CN201710557776 A CN 201710557776A CN 107464253 A CN107464253 A CN 107464253A
- Authority
- CN
- China
- Prior art keywords
- eyebrow
- probability
- pixel
- region
- obtains
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 210000004709 eyebrow Anatomy 0.000 title claims abstract description 261
- 238000000034 method Methods 0.000 title claims abstract description 55
- 230000011218 segmentation Effects 0.000 claims description 51
- 238000004364 calculation method Methods 0.000 claims description 4
- 210000004209 hair Anatomy 0.000 claims description 2
- 230000000694 effects Effects 0.000 abstract description 5
- 230000001419 dependent effect Effects 0.000 abstract description 3
- 238000010586 diagram Methods 0.000 description 15
- 238000012545 processing Methods 0.000 description 13
- 238000004891 communication Methods 0.000 description 9
- 230000006870 function Effects 0.000 description 7
- 238000013527 convolutional neural network Methods 0.000 description 6
- 238000005516 engineering process Methods 0.000 description 5
- 230000001815 facial effect Effects 0.000 description 4
- 230000003287 optical effect Effects 0.000 description 4
- 230000005236 sound signal Effects 0.000 description 4
- 230000000712 assembly Effects 0.000 description 3
- 238000000429 assembly Methods 0.000 description 3
- 238000007726 management method Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 238000012986 modification Methods 0.000 description 3
- 210000000056 organ Anatomy 0.000 description 3
- 230000001133 acceleration Effects 0.000 description 2
- 230000006978 adaptation Effects 0.000 description 2
- 230000008859 change Effects 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 230000002093 peripheral effect Effects 0.000 description 2
- KLDZYURQCUYZBL-UHFFFAOYSA-N 2-[3-[(2-hydroxyphenyl)methylideneamino]propyliminomethyl]phenol Chemical compound OC1=CC=CC=C1C=NCCCN=CC1=CC=CC=C1O KLDZYURQCUYZBL-UHFFFAOYSA-N 0.000 description 1
- 241000209140 Triticum Species 0.000 description 1
- 235000021307 Triticum Nutrition 0.000 description 1
- 238000004458 analytical method Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 239000011469 building brick Substances 0.000 description 1
- 238000007796 conventional method Methods 0.000 description 1
- 230000008878 coupling Effects 0.000 description 1
- 238000010168 coupling process Methods 0.000 description 1
- 238000005859 coupling reaction Methods 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 201000001098 delayed sleep phase syndrome Diseases 0.000 description 1
- 208000033921 delayed sleep phase type circadian rhythm sleep disease Diseases 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000011478 gradient descent method Methods 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/10—Segmentation; Edge detection
- G06T7/194—Segmentation; Edge detection involving foreground-background segmentation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformations in the plane of the image
- G06T3/04—Context-preserving transformations, e.g. by using an importance map
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/70—Determining position or orientation of objects or cameras
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/168—Feature extraction; Face representation
- G06V40/171—Local features and components; Facial parts ; Occluding parts, e.g. glasses; Geometrical relationships
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Health & Medical Sciences (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Computer Vision & Pattern Recognition (AREA)
- General Health & Medical Sciences (AREA)
- Human Computer Interaction (AREA)
- Multimedia (AREA)
- Image Analysis (AREA)
Abstract
The disclosure is directed to eyebrow location method and device.This method includes：Eyebrow in picture is positioned based on face key point location algorithm, obtains profile point corresponding to eyebrow；Human face region where mixed Gauss model, and eyebrow according to corresponding to profile point determines eyebrow；Probability Estimation is carried out to each pixel in human face region according to mixed Gauss model, obtains the probability that each pixel is belonging respectively to eyebrow；The probability of eyebrow is belonging respectively to according to each pixel, determines the band of position of eyebrow.The disclosure can solve the problem that in correlation technique to be carried out positioning the problem of existing positioning precision is relatively low based on face key point location algorithm to eyebrow, improve the accuracy of eyebrow location, ensure the U.S. face effect dependent on the pinpoint adjust automatically camber function of eyebrow, improve Consumer's Experience.
Description
Technical field
This disclosure relates to image processing field, more particularly to eyebrow location method and device.
Background technology
Generally, many people think that by carrying out the U.S. face functions such as thin face to face in image, can have face preferable
Aesthetic feeling.The function of adjust automatically camber in U.S. face software, mainly by being accurately positioned to eyebrow, come automatically more
Change the color and shape of eyebrow, or directly carry out eyebrow replacement.Eyebrow location is exactly the position for calculating eyebrow in picture,
Namely position the profile point of eyebrow.
In correlation technique, the positioning to eyebrow in facial image is realized using the method for face key point location；Face closes
The method of key point location, such as active shape model (ASM, Active shape model), the gradient descent method for having supervision
(SDM, Supervised descent method) or convolutional neural networks (CNN, Convolutional neural
Network) etc., the method for above-mentioned face key point location can position simultaneously to each organ of face.
The content of the invention
To overcome problem present in correlation technique, the embodiment of the present disclosure provides a kind of eyebrow location method and device.Institute
It is as follows to state technical scheme：
According to the first aspect of the embodiment of the present disclosure, there is provided a kind of eyebrow location method, including：
Eyebrow in picture is positioned based on face key point location algorithm, obtains profile point corresponding to the eyebrow；
Face area where the mixed Gauss model according to corresponding to the profile point determines the eyebrow, and the eyebrow
Domain；
Probability Estimation is carried out to each pixel in the human face region according to the mixed Gauss model, obtains each pixel point
Do not belong to the probability of eyebrow；
The probability of eyebrow is belonging respectively to according to each pixel, determines the band of position of the eyebrow.
In one embodiment, the mixed Gauss model according to corresponding to the profile point determines the eyebrow, and
Human face region where the eyebrow, including：
The profile point is carried out curve fitting, obtains contour line corresponding to the eyebrow；
Gaussian modeling is carried out to the pixel value in contour line institute enclosing region, determines to mix corresponding to the eyebrow
Close Gauss model；
Contour line institute enclosing region is expanded according to preset ratio, obtains the face area where the eyebrow
Domain.
In one embodiment, the probability that eyebrow is belonging respectively to according to each pixel, the position area of the eyebrow is determined
Domain, including：
The probability of eyebrow is belonging respectively to according to each pixel, calculates prospect probability graph；
Binarization segmentation is carried out to the prospect probability graph, obtains binarization segmentation figure；
By region corresponding with the prospect of the binarization segmentation figure in the picture, it is defined as the position area of the eyebrow
Domain.
In one embodiment, it is described by region corresponding with the prospect of the binarization segmentation figure in the picture, really
It is set to the band of position of the eyebrow, including：
Closing operation of mathematical morphology is carried out to the binarization segmentation figure, obtains revised binarization segmentation figure；
By region corresponding with the prospect of the revised binarization segmentation figure in the picture, it is defined as the eyebrow
The band of position.
In one embodiment, the curve type of the contour line includes cubic fit curve.
According to the second aspect of the embodiment of the present disclosure, there is provided a kind of eyebrow location device, including：
Locating module, for being positioned based on face key point location algorithm to eyebrow in picture, obtain the eyebrow
Corresponding profile point；
First determining module, for mixed Gauss model corresponding to determining the eyebrow according to the profile point, Yi Jisuo
State the human face region where eyebrow；
Probability Estimation module, for carrying out probability to each pixel in the human face region according to the mixed Gauss model
Estimation, obtains the probability that each pixel is belonging respectively to eyebrow；
Second determining module, for being belonging respectively to the probability of eyebrow according to each pixel, determine the band of position of the eyebrow.
In one embodiment, first determining module, including：
Curve matching submodule, for the profile point to be carried out curve fitting, obtain contour line corresponding to the eyebrow；
Submodule is modeled, for carrying out Gaussian modeling to the pixel value in contour line institute enclosing region, it is determined that
Mixed Gauss model corresponding to the eyebrow；
Submodule is expanded, for contour line institute enclosing region to be expanded according to preset ratio, obtains the eyebrow
Human face region where hair.
In one embodiment, second determining module, including：
Probability calculation submodule, for being belonging respectively to the probability of eyebrow according to each pixel, calculate prospect probability graph；
Binarization segmentation submodule, for carrying out binarization segmentation to the prospect probability graph, obtain binarization segmentation figure；
Determination sub-module, for by region corresponding with the prospect of the binarization segmentation figure in the picture, being defined as
The band of position of the eyebrow.
In one embodiment, the determination sub-module：Closing operation of mathematical morphology is carried out to the binarization segmentation figure to obtain
Revised binarization segmentation figure, by region corresponding with the prospect of the revised binarization segmentation figure in the picture,
It is defined as the band of position of the eyebrow.
According to the third aspect of the embodiment of the present disclosure, there is provided a kind of eyebrow location device, including：
Processor；
For storing the memory of processor-executable instruction；
Wherein, the processor is configured as：
Eyebrow in picture is positioned based on face key point location algorithm, obtains profile point corresponding to the eyebrow；
Face area where the mixed Gauss model according to corresponding to the profile point determines the eyebrow, and the eyebrow
Domain；
Probability Estimation is carried out to each pixel in the human face region according to the mixed Gauss model, obtains each pixel point
Do not belong to the probability of eyebrow；
The probability of eyebrow is belonging respectively to according to each pixel, determines the band of position of the eyebrow.
According to the fourth aspect of the embodiment of the present disclosure, there is provided a kind of computer-readable recording medium, be stored thereon with calculating
The step of machine instructs, and above-mentioned first aspect methods described is realized in the instruction when being executed by processor.
The technical scheme provided by this disclosed embodiment can include the following benefits：The technical scheme is closed based on face
Key point location algorithm determines profile point corresponding to eyebrow, on this basis, the mixed Gaussian according to corresponding to profile point determines eyebrow
Human face region where model and eyebrow；Probability Estimation is carried out according to mixed Gauss model to each pixel in human face region to obtain
The probability of eyebrow is belonging respectively to each pixel, and then determines the band of position of eyebrow, solves in correlation technique and is closed based on face
Key point location algorithm carries out positioning the problem of existing positioning precision is relatively low to eyebrow, improves the accuracy of eyebrow location, protects
U.S. face effect of the card dependent on the pinpoint adjust automatically camber function of eyebrow, improves Consumer's Experience.
It should be appreciated that the general description and following detailed description of the above are only exemplary and explanatory, not
The disclosure can be limited.
Brief description of the drawings
Accompanying drawing herein is merged in specification and forms the part of this specification, shows the implementation for meeting the disclosure
Example, and be used to together with specification to explain the principle of the disclosure.
Fig. 1 is the application scenario diagram of the eyebrow location method according to an exemplary embodiment.
Fig. 2 is the flow chart of the eyebrow location method according to an exemplary embodiment.
Fig. 3 is the application scenario diagram of the eyebrow location method according to an exemplary embodiment.
Fig. 4 is the application scenario diagram of the eyebrow location method according to an exemplary embodiment.
Fig. 5 is the application scenario diagram of the eyebrow location method according to an exemplary embodiment.
Fig. 6 is the application scenario diagram of the eyebrow location method according to an exemplary embodiment.
Fig. 7 is the block diagram of the eyebrow location device according to an exemplary embodiment.
Fig. 8 is the block diagram of the eyebrow location device according to an exemplary embodiment.
Fig. 9 is the block diagram of the eyebrow location device according to an exemplary embodiment.
Figure 10 is the block diagram of the eyebrow location device according to an exemplary embodiment.
Figure 11 is the block diagram of the eyebrow location device according to an exemplary embodiment.
Figure 12 is the block diagram of the eyebrow location device according to an exemplary embodiment.
Embodiment
Here exemplary embodiment will be illustrated in detail, its example is illustrated in the accompanying drawings.Following description is related to
During accompanying drawing, unless otherwise indicated, the same numbers in different accompanying drawings represent same or analogous key element.Following exemplary embodiment
Described in embodiment do not represent all embodiments consistent with the disclosure.On the contrary, they be only with it is such as appended
The example of the consistent apparatus and method of some aspects be described in detail in claims, the disclosure.
The function of adjust automatically camber in U.S. face software, mainly by being accurately positioned to eyebrow, come automatic
The color and shape of eyebrow is changed, or directly carries out eyebrow replacement.Eyebrow location is exactly the position for calculating eyebrow in picture
Put, that is, the profile point of positioning eyebrow.
In correlation technique, the method for generally use face key point location realizes the positioning to eyebrow in facial image；People
For the method for face key point location including ASM, SDM or CNN etc., the method for above-mentioned face key point location can be to each of face
Organ is positioned simultaneously；However, the problem of method generally existing positioning precision of above-mentioned face key point location is relatively low, especially
It is the situation that local organs position inaccurate often occurs when facial pose or expression compare exaggeration.Refer to figure
1, the brow region that correlation technique is positioned using the method for above-mentioned face key point location, compared to eyebrow actual in image
Offseting occurs in region, and this locating bias, can have a strong impact on dependent on the pinpoint adjust automatically camber function of eyebrow
U.S. face effect, reduce the product competitiveness of U.S. face software, influence Consumer's Experience.
In order to solve the above problems, the embodiment of the present disclosure provides a kind of eyebrow location method, and this method includes：Based on people
Face key point location algorithm positions to eyebrow in picture, obtains profile point corresponding to eyebrow；Eyebrow is determined according to profile point
Corresponding mixed Gauss model, and the human face region where eyebrow；According to mixed Gauss model to each picture in human face region
Element carries out probability Estimation, obtains the probability that each pixel is belonging respectively to eyebrow；The probability of eyebrow is belonging respectively to according to each pixel, it is determined that
The band of position of eyebrow.
The eyebrow location method that the embodiment of the present disclosure provides, wheel corresponding to eyebrow is determined based on face key point location algorithm
It is wide, on this basis, mixed Gauss model and the human face region where eyebrow according to corresponding to profile point determines eyebrow；Root
The probability that probability Estimation obtains each pixel and is belonging respectively to eyebrow is carried out to each pixel in human face region according to mixed Gauss model, is entered
And the band of position of eyebrow is determined, solve to position eyebrow based on face key point location algorithm in correlation technique and deposited
Positioning precision it is relatively low the problem of, improve the accuracy of eyebrow location, guarantee depends on the pinpoint adjust automatically of eyebrow
The U.S. face effect of camber function, improve Consumer's Experience.
Based on above-mentioned analysis, following specific embodiment is proposed.
Fig. 2 is a kind of flow chart of eyebrow location method according to an exemplary embodiment, the execution master of this method
Body can be terminal or server, and terminal is, for example, smart mobile phone, tablet personal computer, desktop computer, notebook computer etc.；Such as Fig. 2
Shown, this method comprises the following steps 201-204：
In step 201, eyebrow in picture is positioned based on face key point location algorithm, obtained corresponding to eyebrow
Profile point；
Example, in needing to position the scene of eyebrow from any one frame picture in single picture or video, first,
Face datection is carried out to picture, the region of face in picture is detected, obtains facial image；For example, the method for Face datection can
With including self-adaptive enhancement algorithm (Adaboost) or faster region CNN (faster rcnn) the methods of.Then, based on people
Face key point location algorithm positions to eyebrow in picture, obtains profile point corresponding to eyebrow；For example, face key point location
Algorithm can be including ASM, SDM or CNN etc.；Referring to the eyebrow for positioning to obtain based on face key point location algorithm shown in Fig. 1
Profile point, as seen from Figure 1, profile point compared to brow region actual in image occur skew.
In step 202, the face area where mixed Gauss model, and eyebrow according to corresponding to profile point determines eyebrow
Domain；
Example, the profile point is carried out curve fitting, obtains contour line corresponding to the eyebrow；Area in contour line
Domain is prime area corresponding to eyebrow；Gaussian modeling is carried out to the pixel value in contour line institute enclosing region, really
Mixed Gauss model corresponding to the fixed eyebrow；Contour line institute's enclosing region is expanded according to preset ratio to surrounding
, the region after will be enlarged by is as the human face region where the eyebrow.For example, curve matching can use cubic curve；Intend
The curve type of contour line after conjunction includes cubic fit curve；Contour line can include one or more, such as including following two
Bar contour line：The coboundary of eyebrow and the lower boundary of eyebrow；Referring to Fig. 3, by the way that the profile point of eyebrow is carried out curve fitting, obtain
To two borders of eyebrow, the i.e. lower boundary of the coboundary of eyebrow and eyebrow；It is eyebrow institute referring to the enlarged area shown in Fig. 4
Human face region.
In step 203, probability Estimation is carried out to each pixel in human face region according to mixed Gauss model, obtains each picture
Element is belonging respectively to the probability of eyebrow；
Example, according to mixed Gauss model to each in the human face region where eyebrow determined by step 202
Pixel carries out probability Estimation, obtains the probability that each pixel belongs to eyebrow.
In step 204, the probability of eyebrow is belonging respectively to according to each pixel, determines the band of position of eyebrow.
Example, the probability of eyebrow is belonging respectively to according to each pixel, calculates prospect probability graph；The prospect probability graph is entered
Row binarization segmentation, binarization segmentation figure is obtained, referring to the binarization segmentation figure shown in Fig. 5；By in the picture with described two
Region corresponding to the prospect of value segmentation figure, it is defined as the band of position of the eyebrow.For example, by the picture with described two
The implementation that region corresponding to the prospect of value segmentation figure is defined as the band of position of the eyebrow can include：To described two
Value segmentation figure carries out closing operation of mathematical morphology, obtains revised binarization segmentation figure；By in the picture with after the amendment
Binarization segmentation figure prospect corresponding to region, be defined as the band of position of the eyebrow, participate in revised shown in Fig. 6
Binarization segmentation figure.
The technical scheme provided by this disclosed embodiment, profile corresponding to eyebrow is determined based on face key point location algorithm
Point, on this basis, mixed Gauss model and the human face region where eyebrow according to corresponding to profile point determines eyebrow；According to
Mixed Gauss model carries out the probability that probability Estimation obtains each pixel and is belonging respectively to eyebrow to each pixel in human face region, and then
The band of position of eyebrow is determined, is solved in correlation technique present in being positioned to eyebrow based on face key point location algorithm
Positioning precision it is relatively low the problem of, improve the accuracy of eyebrow location, guarantee depends on the pinpoint adjust automatically eyebrow of eyebrow
The U.S. face effect of shape function, the competitiveness of U.S. face software is improved, so, it is possible to improve Consumer's Experience.
Following is embodiment of the present disclosure, can be used for performing embodiments of the present disclosure.
Fig. 7 is a kind of block diagram of eyebrow location device according to an exemplary embodiment, and the device can use each
Kind of mode is implemented, for example, in terminal or server implementation all components, or, in terminal or server side with coupling
Component in the mode implementation of conjunction；The device can be implemented in combination with the above-mentioned disclosure by software, hardware or both
The method being related to, as shown in fig. 7, the eyebrow location device includes：Locating module 701, the first determining module 702, probability Estimation
The determining module 704 of module 703 and second, wherein：
Locating module 701 is configured as positioning eyebrow in picture based on face key point location algorithm, obtains institute
State profile point corresponding to eyebrow；
First determining module 702 is configured as the mixed Gauss model according to corresponding to the profile point determines the eyebrow,
And the human face region where the eyebrow；
Probability Estimation module 703 is configured as entering each pixel in the human face region according to the mixed Gauss model
Row probability Estimation, obtain the probability that each pixel is belonging respectively to eyebrow；
Second determining module 704 is configured as being belonging respectively to the probability of eyebrow according to each pixel, determines the position of the eyebrow
Put region.
The device that the embodiment of the present disclosure provides can be used in performing the technical scheme of embodiment illustrated in fig. 2, its executive mode
Similar with beneficial effect, here is omitted.
In a kind of possible embodiment, as shown in figure 8, eyebrow location device shown in Fig. 7 can also be included the
One determining module 702 is configured to include：Curve matching submodule 801, modeling submodule 802 and expansion submodule 803, wherein：
Curve matching submodule 801 is configured as carrying out curve fitting the profile point, obtains corresponding to the eyebrow
Contour line；
Modeling submodule 802 is configured as building the pixel value progress mixed Gaussian in contour line institute enclosing region
Mould, determine mixed Gauss model corresponding to the eyebrow；
Expansion submodule 803 is configured as being expanded contour line institute enclosing region according to preset ratio, obtains
Human face region where the eyebrow.
In a kind of possible embodiment, as shown in figure 9, eyebrow location device shown in Fig. 7 can also be included the
Two determining modules 704 are configured to include：Probability calculation submodule 901, binarization segmentation submodule 902 and determination sub-module 903,
Wherein：
Probability calculation submodule 901 is configured as being belonging respectively to the probability of eyebrow according to each pixel, calculates prospect probability graph；
Binarization segmentation submodule 902 is configured as carrying out binarization segmentation to the prospect probability graph, obtains binaryzation
Segmentation figure；
Determination sub-module 903 is configured as region corresponding with the prospect of the binarization segmentation figure in the picture,
It is defined as the band of position of the eyebrow.
In a kind of possible embodiment, the determination sub-module 903：Morphology is carried out to the binarization segmentation figure
Closed operation obtains revised binarization segmentation figure, by the prospect pair in the picture with the revised binarization segmentation figure
The region answered, it is defined as the band of position of the eyebrow.
Figure 10 is a kind of block diagram of eyebrow location device 1000 according to an exemplary embodiment, eyebrow location device
1000 are applied to terminal or server, and eyebrow location device 1000 includes：
Processor 1001；
For storing the memory 1002 of processor-executable instruction；
Wherein, processor 1001 is configured as：
Eyebrow in picture is positioned based on face key point location algorithm, obtains profile point corresponding to the eyebrow；
Face area where the mixed Gauss model according to corresponding to the profile point determines the eyebrow, and the eyebrow
Domain；
Probability Estimation is carried out to each pixel in the human face region according to the mixed Gauss model, obtains each pixel point
Do not belong to the probability of eyebrow；
The probability of eyebrow is belonging respectively to according to each pixel, determines the band of position of the eyebrow.
Example, the curve type of the contour line includes cubic fit curve.
In one embodiment, above-mentioned processor 1001 is also configured to：
The profile point is carried out curve fitting, obtains contour line corresponding to the eyebrow；
Gaussian modeling is carried out to the pixel value in contour line institute enclosing region, determines to mix corresponding to the eyebrow
Close Gauss model；
Contour line institute enclosing region is expanded according to preset ratio, obtains the face area where the eyebrow
Domain.
In one embodiment, above-mentioned processor 1001 is also configured to：
The probability of eyebrow is belonging respectively to according to each pixel, calculates prospect probability graph；
Binarization segmentation is carried out to the prospect probability graph, obtains binarization segmentation figure；
By region corresponding with the prospect of the binarization segmentation figure in the picture, it is defined as the position area of the eyebrow
Domain.
In one embodiment, above-mentioned processor 1001 is also configured to：
Closing operation of mathematical morphology is carried out to the binarization segmentation figure, obtains revised binarization segmentation figure；
By region corresponding with the prospect of the revised binarization segmentation figure in the picture, it is defined as the eyebrow
The band of position.
On the device in above-described embodiment, wherein modules perform the concrete mode of operation in relevant this method
Embodiment in be described in detail, explanation will be not set forth in detail herein.
Figure 11 is a kind of block diagram of eyebrow location device according to an exemplary embodiment；Eyebrow location device 1100
Suitable for terminal；Eyebrow location device 1100 can include following one or more assemblies：Processing component 1102, memory
1104, power supply module 1106, multimedia groupware 1108, audio-frequency assembly 1110, the interface 1112 of input/output (I/O), sensor
Component 1114, and communication component 1116.
Processing component 1102 generally controls the integrated operation of eyebrow location device 1100, such as with display, call, counts
According to communication, camera operation and record operate associated operation.Processing component 1102 can include one or more processors
1120 carry out execute instruction, to complete all or part of step of above-mentioned method.In addition, processing component 1102 can include one
Or multiple modules, the interaction being easy between processing component 1102 and other assemblies.For example, processing component 1102 can include more matchmakers
Module, to facilitate the interaction between multimedia groupware 1108 and processing component 1102.
Memory 1104 is configured as storing various types of data to support the operation in eyebrow location device 1100.This
The example of a little data includes the instruction of any application program or method for being operated on eyebrow location device 1100, contact person
Data, telephone book data, message, picture, video etc..Memory 1104 by any kind of volatibility or non-volatile can be deposited
Store up equipment or combinations thereof is realized, such as static RAM (SRAM), Electrically Erasable Read Only Memory
(EEPROM), Erasable Programmable Read Only Memory EPROM (EPROM), programmable read only memory (PROM), read-only storage
(ROM), magnetic memory, flash memory, disk or CD.
Power supply module 1106 provides electric power for the various assemblies of eyebrow location device 1100.Power supply module 1106 can include
Power-supply management system, one or more power supplys, and other generate to for eyebrow location device 1100, manage and to distribute electric power related
The component of connection.
Multimedia groupware 1108 is included in the screen of one output interface of offer between eyebrow location device 1100 and user
Curtain.In certain embodiments, screen can include liquid crystal display (LCD) and touch panel (TP).If screen includes touching
Panel, screen may be implemented as touch-screen, to receive the input signal from user.Touch panel includes one or more touch
Sensor is touched with the gesture on sensing touch, slip and touch panel.Touch sensor can not only sensing touch or slip be dynamic
The border of work, but also detect the duration and pressure to touching or slide is related.In certain embodiments, multimedia
Component 1108 includes a front camera and/or rear camera.When eyebrow location device 1100 is in operator scheme, such as clap
When taking the photograph pattern or video mode, front camera and/or rear camera can receive outside multi-medium data.It is each preposition
Camera and rear camera can be a fixed optical lens system or have focusing and optical zoom capabilities.
Audio-frequency assembly 1110 is configured as output and/or input audio signal.For example, audio-frequency assembly 1110 includes a wheat
Gram wind (MIC), when eyebrow location device 1100 is in operator scheme, during such as call model, logging mode and speech recognition mode,
Microphone is configured as receiving external audio signal.The audio signal received can be further stored in memory 1104 or
Sent via communication component 1116.In certain embodiments, audio-frequency assembly 1110 also includes a loudspeaker, for exporting audio
Signal.
I/O interfaces 1112 provide interface, above-mentioned peripheral interface module between processing component 1102 and peripheral interface module
Can be keyboard, click wheel, button etc..These buttons may include but be not limited to：Home button, volume button, start button and
Locking press button.
Sensor cluster 1114 includes one or more sensors, for providing various aspects for eyebrow location device 1100
State estimation.For example, sensor cluster 1114 can detect opening/closed mode of eyebrow location device 1100, component
Relative positioning, such as the display and keypad that component is eyebrow location device 1100, sensor cluster 1114 can also examine
The position for surveying eyebrow location device 1100 or 1,100 1 components of eyebrow location device changes, user and eyebrow location device 1100
The existence or non-existence of contact, the orientation of eyebrow location device 1100 or acceleration/deceleration and the temperature of eyebrow location device 1100 become
Change.Sensor cluster 1114 can include proximity transducer, be configured in no any physical contact near detection
The presence of object.Sensor cluster 1114 can also include optical sensor, such as CMOS or ccd image sensor, for being imaged
Used in.In certain embodiments, the sensor cluster 1114 can also include acceleration transducer, gyro sensors
Device, Magnetic Sensor, pressure sensor or temperature sensor.
Communication component 1116 is configured to facilitate wired or wireless way between eyebrow location device 1100 and other equipment
Communication.Eyebrow location device 1100 can access the wireless network based on communication standard, such as WiFi, 2G or 3G, or they
Combination.In one exemplary embodiment, communication component 1116 is received from external broadcasting management system via broadcast channel
Broadcast singal or broadcast related information.In one exemplary embodiment, communication component 1116 also includes near-field communication (NFC) mould
Block, to promote junction service.For example, radio frequency identification (RFID) technology, Infrared Data Association (IrDA) skill can be based in NFC module
Art, ultra wide band (UWB) technology, bluetooth (BT) technology and other technologies are realized.
In the exemplary embodiment, eyebrow location device 1100 can be by one or more application specific integrated circuits
(ASIC), digital signal processor (DSP), digital signal processing appts (DSPD), PLD (PLD), scene can
Program gate array (FPGA), controller, microcontroller, microprocessor or other electronic building bricks to realize, for performing the above method.
In the exemplary embodiment, a kind of non-transitorycomputer readable storage medium including instructing, example are additionally provided
Such as include the memory 1104 of instruction, above-mentioned instruction can be performed above-mentioned to complete by the processor 1120 of eyebrow location device 1100
Method.For example, non-transitorycomputer readable storage medium can be ROM, random access memory (RAM), CD-ROM, magnetic
Band, floppy disk and optical data storage devices etc..
A kind of non-transitorycomputer readable storage medium, when the instruction in storage medium is by eyebrow location device 1100
During computing device so that eyebrow location device 1100 is able to carry out following eyebrow location method, and method includes：
Eyebrow in picture is positioned based on face key point location algorithm, obtains profile point corresponding to the eyebrow；
Face area where the mixed Gauss model according to corresponding to the profile point determines the eyebrow, and the eyebrow
Domain；
Probability Estimation is carried out to each pixel in the human face region according to the mixed Gauss model, obtains each pixel point
Do not belong to the probability of eyebrow；
The probability of eyebrow is belonging respectively to according to each pixel, determines the band of position of the eyebrow.
Figure 12 is a kind of block diagram of eyebrow location device according to an exemplary embodiment.For example, eyebrow location fills
Put 1200 and may be provided in a server.Eyebrow location device 1200 includes processing component 1202, and it further comprises one
Or multiple processors, and as the memory resource representated by memory 1203, can holding by processing component 1202 for storing
Capable instruction, such as application program.The application program stored in memory 1203 can include one or more each
The individual module for corresponding to one group of instruction.In addition, processing component 1202 is configured as execute instruction, to perform the above method.
Eyebrow location device 1200 can also be configured as performing eyebrow location device including a power supply module 1206
1200 power management, a wired or wireless network interface 1205 are configured as eyebrow location device 1200 being connected to net
Network, and input and output (I/O) interface 1208.Eyebrow location device 1200 can be operated based on being stored in memory 1203
Operating system, such as Windows ServerTM, Mac OS XTM, UnixTM, LinuxTM, FreeBSDTM or similar.
Those skilled in the art will readily occur to the disclosure its after considering specification and putting into practice disclosure disclosed herein
Its embodiment.The application is intended to any modification, purposes or the adaptations of the disclosure, these modifications, purposes or
Person's adaptations follow the general principle of the disclosure and including the undocumented common knowledges in the art of the disclosure
Or conventional techniques.Description and embodiments are considered only as exemplary, and the true scope of the disclosure and spirit are by following
Claim is pointed out.
It should be appreciated that the precision architecture that the disclosure is not limited to be described above and is shown in the drawings, and
And various modifications and changes can be being carried out without departing from the scope.The scope of the present disclosure is only limited by appended claim.
Claims (11)
- A kind of 1. eyebrow location method, it is characterised in that including：Eyebrow in picture is positioned based on face key point location algorithm, obtains profile point corresponding to the eyebrow；Human face region where the mixed Gauss model according to corresponding to the profile point determines the eyebrow, and the eyebrow；Probability Estimation is carried out to each pixel in the human face region according to the mixed Gauss model, each pixel is obtained and belongs to respectively In the probability of eyebrow；The probability of eyebrow is belonging respectively to according to each pixel, determines the band of position of the eyebrow.
- 2. according to the method for claim 1, it is characterised in that described according to corresponding to the profile point determines the eyebrow Human face region where mixed Gauss model, and the eyebrow, including：The profile point is carried out curve fitting, obtains contour line corresponding to the eyebrow；Gaussian modeling is carried out to the pixel value in contour line institute enclosing region, determines that mixing is high corresponding to the eyebrow This model；Contour line institute enclosing region is expanded according to preset ratio, obtains the human face region where the eyebrow.
- 3. according to the method for claim 1, it is characterised in that the probability that eyebrow is belonging respectively to according to each pixel, really The band of position of the fixed eyebrow, including：The probability of eyebrow is belonging respectively to according to each pixel, calculates prospect probability graph；Binarization segmentation is carried out to the prospect probability graph, obtains binarization segmentation figure；By region corresponding with the prospect of the binarization segmentation figure in the picture, it is defined as the band of position of the eyebrow.
- 4. according to the method for claim 3, it is characterised in that it is described by the picture with the binarization segmentation figure Region corresponding to prospect, it is defined as the band of position of the eyebrow, including：Closing operation of mathematical morphology is carried out to the binarization segmentation figure, obtains revised binarization segmentation figure；By region corresponding with the prospect of the revised binarization segmentation figure in the picture, it is defined as the position of the eyebrow Put region.
- 5. according to the method for claim 2, it is characterised in that it is bent that the curve type of the contour line includes cubic fit Line.
- A kind of 6. eyebrow location device, it is characterised in that including：Locating module, for being positioned based on face key point location algorithm to eyebrow in picture, it is corresponding to obtain the eyebrow Profile point；First determining module, for mixed Gauss model corresponding to determining the eyebrow according to the profile point, and the eyebrow Human face region where hair；Probability Estimation module, estimate for carrying out probability to each pixel in the human face region according to the mixed Gauss model Meter, obtains the probability that each pixel is belonging respectively to eyebrow；Second determining module, for being belonging respectively to the probability of eyebrow according to each pixel, determine the band of position of the eyebrow.
- 7. device according to claim 6, it is characterised in that first determining module, including：Curve matching submodule, for the profile point to be carried out curve fitting, obtain contour line corresponding to the eyebrow；Submodule is modeled, for carrying out Gaussian modeling to the pixel value in contour line institute enclosing region, it is determined that described Mixed Gauss model corresponding to eyebrow；Submodule is expanded, for contour line institute enclosing region to be expanded according to preset ratio, obtains the eyebrow institute Human face region.
- 8. device according to claim 6, it is characterised in that second determining module, including：Probability calculation submodule, for being belonging respectively to the probability of eyebrow according to each pixel, calculate prospect probability graph；Binarization segmentation submodule, for carrying out binarization segmentation to the prospect probability graph, obtain binarization segmentation figure；Determination sub-module, it is described for by region corresponding with the prospect of the binarization segmentation figure in the picture, being defined as The band of position of eyebrow.
- 9. device according to claim 8, it is characterised in that the determination sub-module：The binarization segmentation figure is entered Row closing operation of mathematical morphology obtains revised binarization segmentation figure, by the picture with the revised binarization segmentation figure Prospect corresponding to region, be defined as the band of position of the eyebrow.
- A kind of 10. eyebrow location device, it is characterised in that including：Processor；For storing the memory of processor-executable instruction；Wherein, the processor is configured as：Eyebrow in picture is positioned based on face key point location algorithm, obtains profile point corresponding to the eyebrow；Human face region where the mixed Gauss model according to corresponding to the profile point determines the eyebrow, and the eyebrow；Probability Estimation is carried out to each pixel in the human face region according to the mixed Gauss model, each pixel is obtained and belongs to respectively In the probability of eyebrow；The probability of eyebrow is belonging respectively to according to each pixel, determines the band of position of the eyebrow.
- 11. a kind of computer-readable recording medium, is stored thereon with computer instruction, it is characterised in that the instruction is by processor The step of method any one of claim 1-5 is realized during execution.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710557776.7A CN107464253B (en) | 2017-07-10 | 2017-07-10 | Eyebrow positioning method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710557776.7A CN107464253B (en) | 2017-07-10 | 2017-07-10 | Eyebrow positioning method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107464253A true CN107464253A (en) | 2017-12-12 |
| CN107464253B CN107464253B (en) | 2020-11-20 |
Family
ID=60546540
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710557776.7A Active CN107464253B (en) | 2017-07-10 | 2017-07-10 | Eyebrow positioning method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107464253B (en) |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108806146A (en) * | 2018-06-06 | 2018-11-13 | 合肥嘉仕诚能源科技有限公司 | A kind of safety monitoring dynamic object track lock method and system |
| CN110084154A (en) * | 2019-04-12 | 2019-08-02 | 北京字节跳动网络技术有限公司 | Render method, apparatus, electronic equipment and the computer readable storage medium of image |
| US10528796B2 (en) * | 2017-09-28 | 2020-01-07 | Cal-Comp Big Data, Inc. | Body information analysis apparatus with augmented reality and eyebrow shape preview method thereof |
| WO2020056901A1 (en) * | 2018-09-20 | 2020-03-26 | 北京字节跳动网络技术有限公司 | Method and device for processing image |
| JP2021069602A (en) * | 2019-10-30 | 2021-05-06 | 有限会社 ティ・アール・コーポレーション | Design method, eyebrow design server and design support program |
| CN113409185A (en) * | 2021-05-14 | 2021-09-17 | 北京达佳互联信息技术有限公司 | Image processing method, image processing device, electronic equipment and storage medium |
| WO2021218040A1 (en) * | 2020-04-29 | 2021-11-04 | 百度在线网络技术（北京）有限公司 | Image processing method and apparatus |
| CN113689325A (en) * | 2021-07-12 | 2021-11-23 | 深圳数联天下智能科技有限公司 | Method for digitizing beautiful eyebrows, electronic device and storage medium |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2004272326A (en) * | 2003-03-05 | 2004-09-30 | Matsushita Electric Ind Co Ltd | Probabilistic facial component fusion method for face description and recognition using subspace component feature |
| CN1822024A (en) * | 2006-04-13 | 2006-08-23 | 北京中星微电子有限公司 | Positioning method for human face characteristic point |
| CN102254327A (en) * | 2011-07-29 | 2011-11-23 | 西南交通大学 | Method for automatically segmenting face in digital photo |
| CN102982320A (en) * | 2012-12-05 | 2013-03-20 | 山东神思电子技术股份有限公司 | Method for extracting eyebrow outline |
| CN104091155A (en) * | 2014-07-04 | 2014-10-08 | 武汉工程大学 | Rapid iris positioning method with illumination robustness |
| US20160125229A1 (en) * | 2014-11-03 | 2016-05-05 | Anastasia Soare | Facial structural shaping |
| CN106203329A (en) * | 2016-07-08 | 2016-12-07 | 安徽工业大学 | A kind of set up identity template and the method carrying out identification based on eyebrow |
| CN106407911A (en) * | 2016-08-31 | 2017-02-15 | 乐视控股（北京）有限公司 | Image-based eyeglass recognition method and device |
| CN106446781A (en) * | 2016-08-29 | 2017-02-22 | 厦门美图之家科技有限公司 | Face image processing method and face image processing device |
| CN106611413A (en) * | 2016-11-30 | 2017-05-03 | 上海联影医疗科技有限公司 | Image segmentation method and system |
-
2017
- 2017-07-10 CN CN201710557776.7A patent/CN107464253B/en active Active
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2004272326A (en) * | 2003-03-05 | 2004-09-30 | Matsushita Electric Ind Co Ltd | Probabilistic facial component fusion method for face description and recognition using subspace component feature |
| CN1822024A (en) * | 2006-04-13 | 2006-08-23 | 北京中星微电子有限公司 | Positioning method for human face characteristic point |
| CN102254327A (en) * | 2011-07-29 | 2011-11-23 | 西南交通大学 | Method for automatically segmenting face in digital photo |
| CN102982320A (en) * | 2012-12-05 | 2013-03-20 | 山东神思电子技术股份有限公司 | Method for extracting eyebrow outline |
| CN104091155A (en) * | 2014-07-04 | 2014-10-08 | 武汉工程大学 | Rapid iris positioning method with illumination robustness |
| US20160125229A1 (en) * | 2014-11-03 | 2016-05-05 | Anastasia Soare | Facial structural shaping |
| CN106203329A (en) * | 2016-07-08 | 2016-12-07 | 安徽工业大学 | A kind of set up identity template and the method carrying out identification based on eyebrow |
| CN106446781A (en) * | 2016-08-29 | 2017-02-22 | 厦门美图之家科技有限公司 | Face image processing method and face image processing device |
| CN106407911A (en) * | 2016-08-31 | 2017-02-15 | 乐视控股（北京）有限公司 | Image-based eyeglass recognition method and device |
| CN106611413A (en) * | 2016-11-30 | 2017-05-03 | 上海联影医疗科技有限公司 | Image segmentation method and system |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10528796B2 (en) * | 2017-09-28 | 2020-01-07 | Cal-Comp Big Data, Inc. | Body information analysis apparatus with augmented reality and eyebrow shape preview method thereof |
| CN108806146A (en) * | 2018-06-06 | 2018-11-13 | 合肥嘉仕诚能源科技有限公司 | A kind of safety monitoring dynamic object track lock method and system |
| WO2020056901A1 (en) * | 2018-09-20 | 2020-03-26 | 北京字节跳动网络技术有限公司 | Method and device for processing image |
| CN110084154A (en) * | 2019-04-12 | 2019-08-02 | 北京字节跳动网络技术有限公司 | Render method, apparatus, electronic equipment and the computer readable storage medium of image |
| JP2021069602A (en) * | 2019-10-30 | 2021-05-06 | 有限会社 ティ・アール・コーポレーション | Design method, eyebrow design server and design support program |
| JP7175476B2 (en) | 2019-10-30 | 2022-11-21 | 有限会社 ティ・アール・コーポレーション | Design method, eyebrow design server and design support program |
| WO2021218040A1 (en) * | 2020-04-29 | 2021-11-04 | 百度在线网络技术（北京）有限公司 | Image processing method and apparatus |
| CN113409185A (en) * | 2021-05-14 | 2021-09-17 | 北京达佳互联信息技术有限公司 | Image processing method, image processing device, electronic equipment and storage medium |
| CN113409185B (en) * | 2021-05-14 | 2024-03-05 | 北京达佳互联信息技术有限公司 | Image processing method, device, electronic equipment and storage medium |
| CN113689325A (en) * | 2021-07-12 | 2021-11-23 | 深圳数联天下智能科技有限公司 | Method for digitizing beautiful eyebrows, electronic device and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107464253B (en) | 2020-11-20 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107464253A (en) | eyebrow location method and device | |
| CN104156947B (en) | Image partition method, device and equipment | |
| EP2977959B1 (en) | Method and device for adjusting skin color | |
| CN107680033A (en) | Image processing method and device | |
| CN107368810A (en) | Method for detecting human face and device | |
| CN104850852B (en) | Feature vector computational methods and device | |
| CN105426867A (en) | Face identification verification method and apparatus | |
| CN104036240B (en) | The localization method and device of human face characteristic point | |
| CN107122679A (en) | Image processing method and device | |
| CN104484858B (en) | Character image processing method and processing device | |
| CN107403144A (en) | Face localization method and device | |
| CN107818543A (en) | Image processing method and device | |
| CN107330868A (en) | image processing method and device | |
| CN107657590B (en) | Picture processing method and device and storage medium | |
| CN105512605A (en) | Face image processing method and device | |
| US10248855B2 (en) | Method and apparatus for identifying gesture | |
| CN104063865B (en) | Disaggregated model creation method, image partition method and relevant apparatus | |
| CN104077563B (en) | Face identification method and device | |
| CN106557755B (en) | Fingerprint template acquisition method and device | |
| CN107480665A (en) | Character detecting method, device and computer-readable recording medium | |
| CN107977934A (en) | Image processing method and device | |
| CN107704190B (en) | Gesture recognition method and device, terminal and storage medium | |
| CN107341777A (en) | image processing method and device | |
| CN107213642A (en) | Virtual portrait outward appearance change method and device | |
| CN107944367A (en) | Face critical point detection method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |