CN109190529B - Face detection method and system based on lip positioning - Google Patents
Face detection method and system based on lip positioning Download PDFInfo
- Publication number
- CN109190529B CN109190529B CN201810954300.1A CN201810954300A CN109190529B CN 109190529 B CN109190529 B CN 109190529B CN 201810954300 A CN201810954300 A CN 201810954300A CN 109190529 B CN109190529 B CN 109190529B
- Authority
- CN
- China
- Prior art keywords
- thres
- face
- block
- current
- positioning
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/168—Feature extraction; Face representation
- G06V40/171—Local features and components; Facial parts ; Occluding parts, e.g. glasses; Geometrical relationships
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/172—Classification, e.g. identification
Landscapes
- Engineering & Computer Science (AREA)
- Health & Medical Sciences (AREA)
- Oral & Maxillofacial Surgery (AREA)
- General Health & Medical Sciences (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Theoretical Computer Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Image Analysis (AREA)
- Image Processing (AREA)
Abstract
The invention provides a face detection method and system based on lip positioning. Firstly, finding a lip area of a current face, and determining face inclination and face side degree; then, determining a search area of the face according to the inclination and the side degree of the face, and then performing accurate judgment and reasonable inclination angle analysis according to the skin color characteristic of the face, so that on one hand, an accurate face search direction can be provided for a face detection system; and on the other hand, the calculation amount of full search for skin color detection of the whole image video can be reduced.
Description
Technical Field
The invention relates to the technical field of image processing, in particular to a face detection method and system based on lip positioning.
Background
Face recognition and video beauty are two emerging video applications. In practical application, the human face is not always in the front and does not skew. Due to personal habits and needs for beautification, there are often situations such as sideways, leaning, etc. If the face is not distinguished according to the normal mode, the accuracy of face detection and recognition can be affected. The human face detection is inaccurate, and the good portrait beautifying effect cannot be achieved naturally.
Disclosure of Invention
The embodiment of the invention aims to provide a face detection method based on lip positioning, and aims to solve the problem of low recognition accuracy of face detection in the prior art.
The embodiment of the invention is realized in such a way that a face detection method based on lip positioning comprises the following steps:
step 1: performing lip positioning on the current face;
step 2: finding a block column with the minimum column number in the face lip block set judged to be the current face lip block set, and positioning a middle block of the block column and marking as gmb (i1, j 1); finding the block column with the largest column number, locating the middle block of the block column, denoted gmb (i2, j 2);
step 3: finding a block row with the minimum row number in the face lip block set judged to be current, and positioning a middle block of the block row, and marking as gmb (i3, j 3); finding the block row with the largest row number, locating the middle block of the block row, and recording as gmb (i4, j 4);
step 4: calculating the side proportion gamma of the current face;
step 5: calculating the current face inclination angle theta;
step 6: determining a current human face to-be-detected area according to the human face inclination angle and the human face side proportion;
step 7: and accurately judging the skin color of the block in the current human face region to be detected to finish the human face detection.
Another objective of an embodiment of the present invention is to provide a face detection system based on lip positioning, where the face detection system includes:
the lip positioning device is used for carrying out lip positioning on the current face;
the first middle block searching and positioning module is used for finding a block column with the minimum column number in the face lip block set judged to be current, and positioning a middle block of the block column, and marking as gmb (i1, j 1); finding the block column with the largest column number, locating the middle block of the block column, denoted gmb (i2, j 2);
a second middle block searching and positioning module, configured to find a block row with a minimum row number in the face lip block set determined as the current face lip block set, and position a middle block of the block row, which is denoted as gmb (i3, j 3); finding the block row with the largest row number, locating the middle block of the block row, and recording as gmb (i4, j 4);
the face side proportion calculation module is used for calculating the current face side proportion gamma;
the face inclination angle calculation module is used for calculating the current face inclination angle theta;
the face to-be-detected region determining module is used for determining a current face to-be-detected region according to the face inclination angle and the face side proportion;
and the skin color accurate judgment module is used for accurately judging the skin color of the block in the current human face region to be detected so as to finish the human face detection.
The invention has the advantages of
The invention provides a face detection method and system based on lip positioning. Firstly, finding a lip area of a current face, and determining face inclination and face side degree; then, a search area of the face is determined according to the inclination and the side degree of the face, and then accurate judgment is carried out according to the skin color characteristic of the face. By reasonable inclination angle analysis, on one hand, an accurate face searching direction can be provided for a face detection system; and on the other hand, the calculation amount of full search for skin color detection of the whole image video can be reduced.
Drawings
FIG. 1 is a flow chart of a face detection method based on lip positioning according to a preferred embodiment of the present invention;
fig. 2 is a block diagram of a face detection system based on lip location according to a preferred embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention is further described in detail below with reference to the accompanying drawings and examples, and for convenience of description, only parts related to the examples of the present invention are shown. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
The invention provides a face detection method and system based on lip positioning. Firstly, finding a lip area of a current face, and determining face inclination and face side degree; then, a search area of the face is determined according to the inclination and the side degree of the face, and then accurate judgment is carried out according to the skin color characteristic of the face. By reasonable inclination angle analysis, on one hand, an accurate face searching direction can be provided for a face detection system; and on the other hand, the calculation amount of full search for skin color detection of the whole image video can be reduced.
Example one
FIG. 1 is a flow chart of a face detection method based on lip positioning according to a preferred embodiment of the present invention; the method comprises the following steps:
step 1: and carrying out lip positioning on the current face.
The lip positioning of the current face adopts an industry-disclosed method;
step 2: finding a block column with the minimum column number in the face lip block set judged to be the current face lip block set, and positioning a middle block of the block column and marking as gmb (i1, j 1); the block column with the largest column number is found, and the middle block of the block column is located, denoted gmb (i2, j 2).
Step 3: finding a block row with the minimum row number in the face lip block set judged to be current, and positioning a middle block of the block row, and marking as gmb (i3, j 3); the block row with the largest row number is found, and the middle block of this block row is located, denoted gmb (i4, j 4).
Step 4: calculating the side proportion gamma of the current face,
step 5: calculating the inclination angle theta of the current face,
step 6: and determining the current human face region to be detected according to the human face inclination angle and the human face side ratio.
The method comprises the following specific steps:
if theta is equal to 0, the area to be detected of the human face is defined as
{gmb(i,j)|i3-ThresiU≤i≤i4+ThresiDAnd j1-ThresjL≤j≤j2+ThresjR}，
Wherein Thres < ThresiD＜ThresiU/3＜2*Thres，Thres＝max(i4-i3,j2-j1)，
2*Thres＜ThresjR＜6*Thres、
Thres、ThresiU、ThresiD、ThresjL、ThresjRRespectively called threshold, uplink threshold, downlink threshold, left column threshold and right column threshold; solving the maximum value by a max table; gmb (i, j) denotes a block located at ith row and jth column of the current picture.
If θ ≠ 0, then first define a rectangular region
{i3-ThresiU≤i≤i4+ThresiDAnd j1-ThresjL≤j≤j2+ThresjR}; then finding a positioning point ((i3+ i4)/2, (j3+ j4)/2), and then rotating the rectangular area by theta by taking the positioning point as a rotation positioning point; and finally, selecting the blocks falling into the rotating rectangular region as the region to be detected of the human face.
Step 7: and accurately judging the skin color of the block in the current human face region to be detected to finish the human face detection.
The accurate determination of the skin color of the block in the current human face region to be detected adopts an industry public method.
Example two
Fig. 2 is a block diagram of a face detection system based on lip location according to a preferred embodiment of the present invention. The system comprises:
and the lip positioning device is used for carrying out lip positioning on the current face.
The lip positioning of the current face adopts an industry-disclosed method;
the first middle block searching and positioning module is used for finding a block column with the minimum column number in the face lip block set judged to be current, and positioning a middle block of the block column, and marking as gmb (i1, j 1); the block column with the largest column number is found, and the middle block of the block column is located, denoted gmb (i2, j 2).
A second middle block searching and positioning module, configured to find a block row with a minimum row number in the face lip block set determined as the current face lip block set, and position a middle block of the block row, which is denoted as gmb (i3, j 3); the block row with the largest row number is found, and the middle block of this block row is located, denoted gmb (i4, j 4).
A face side proportion calculating module for calculating the current face side proportion gamma,
a face inclination angle calculation module for calculating the current face inclination angle theta,
and the face to-be-detected region determining module is used for determining the current face to-be-detected region according to the face inclination angle and the face side proportion.
The method comprises the following specific steps:
if theta is equal to 0, the area to be detected of the human face is defined as
{gmb(i,j)|i3-ThresiU≤i≤i4+ThresiDAnd j1-ThresjL≤j≤j2+ThresjR}，
Wherein Thres < ThresiD＜ThresiU/3＜2*Thres，Thres＝max(i4-i3,j2-j1)，2*Thres＜ThresjR＜6*Thres、
Thres、ThresiU、ThresiD、ThresjL、ThresjRRespectively called threshold, uplink threshold, downlink threshold, left column threshold and right column threshold; solving the maximum value by a max table; gmb (i, j) denotes a block located at ith row and jth column of the current picture.
If θ ≠ 0, then first define a rectangular region
{i3-ThresiU≤i≤i4+ThresiDAnd j1-ThresjL≤j≤j2+ThresjR}; then finding a positioning point ((i3+ i4)/2, (j3+ j4)/2), and then rotating the rectangular area by theta by taking the positioning point as a rotation positioning point; and finally, selecting the blocks falling into the rotating rectangular region as the region to be detected of the human face.
And the skin color accurate judgment module is used for accurately judging the skin color of the block in the current human face region to be detected so as to finish the human face detection.
The accurate determination of the skin color of the block in the current human face region to be detected adopts an industry public method.
It will be understood by those skilled in the art that all or part of the steps in the method according to the above embodiments may be implemented by hardware related to program instructions, and the program may be stored in a computer readable storage medium, such as ROM, RAM, magnetic disk, optical disk, etc.
The above description is only for the purpose of illustrating the preferred embodiments of the present invention and is not to be construed as limiting the invention, and any modifications, equivalents and improvements made within the spirit and principle of the present invention are intended to be included within the scope of the present invention.
Claims (4)
1. A face detection method based on lip positioning is characterized by comprising the following steps:
step 1: performing lip positioning on the current face;
step 2: finding a block column with the minimum column number in the face lip block set judged to be the current face lip block set, and positioning a middle block of the block column and marking as gmb (i1, j 1); finding the block column with the largest column number, locating the middle block of the block column, denoted gmb (i2, j 2);
step 3: finding a block row with the minimum row number in the face lip block set judged to be current, and positioning a middle block of the block row, and marking as gmb (i3, j 3); finding the block row with the largest row number, locating the middle block of the block row, and recording as gmb (i4, j 4);
step 4: calculating the side proportion gamma of the current face:
step 5: calculating the current face inclination angle theta:
step 6: determining a current human face to-be-detected area according to the human face inclination angle and the human face side proportion:
if theta is equal to 0, the area to be detected of the human face is defined as
{gmb(i,j)|i3-ThresiU≤i≤i4+ThresiDAnd j1-ThresjL≤j≤j2+ThresjR}，
Wherein Thres < ThresiD＜ThresiU/3＜2*Thres，Thres＝max(i4-i3,j2-j1)，2*Thres＜ThresjR＜6*Thres、
Thres、ThresiU、ThresiD、ThresjL、ThresjRRespectively called threshold, uplink threshold, downlink threshold, left column threshold and right column threshold; solving the maximum value by a max table; gmb (i, j) represents a block located at ith row and jth column of the current picture;
step 7: and accurately judging the skin color of the block in the current human face region to be detected to finish the human face detection.
2. The lip-positioning-based face detection method according to claim 1, wherein the current face region to be detected is determined according to the face inclination angle and the face side ratio:
if θ ≠ 0, then first define the rectangular region { i3-ThresiU≤i≤i4+ThresiDAnd j1-ThresjL≤j≤j2+ThresjR}; then finding a positioning point ((i3+ i4)/2, (j3+ j4)/2), and then rotating the rectangular area by theta by taking the positioning point as a rotation positioning point; and finally, selecting the blocks falling into the rotating rectangular region as the region to be detected of the human face.
3. A lip-positioning based face detection system, the system comprising:
the lip positioning device is used for carrying out lip positioning on the current face;
the first middle block searching and positioning module is used for finding a block column with the minimum column number in the face lip block set judged to be current, and positioning a middle block of the block column, and marking as gmb (i1, j 1); finding the block column with the largest column number, locating the middle block of the block column, denoted gmb (i2, j 2);
a second middle block searching and positioning module, configured to find a block row with a minimum row number in the face lip block set determined as the current face lip block set, and position a middle block of the block row, which is denoted as gmb (i3, j 3); finding the block row with the largest row number, locating the middle block of the block row, and recording as gmb (i4, j 4);
the face side proportion calculation module is used for calculating the current face side proportion gamma:
the face inclination angle calculation module is used for calculating the current face inclination angle theta:
the face detection region determining module is used for determining a current face detection region according to the face inclination angle and the face side ratio:
if theta is equal to 0, the area to be detected of the human face is defined as
{gmb(i,j)|i3-ThresiU≤i≤i4+ThresiDAnd j1-ThresjL≤j≤j2+ThresjR}，
Wherein Thres < ThresiD＜ThresiU/3＜2*Thres，Thres＝max(i4-i3,j2-j1)，2*Thres＜ThresjR＜6*Thres、
Thres、ThresiU、ThresiD、ThresjL、ThresjRRespectively called threshold, uplink threshold, downlink threshold, left column threshold and right column threshold; solving the maximum value by a max table; gmb (i, j) represents a block located at ith row and jth column of the current picture;
and the skin color accurate judgment module is used for accurately judging the skin color of the block in the current human face region to be detected so as to finish the human face detection.
4. The lip-positioning-based face detection system of claim 3,
the face detection region determining module is used for determining the current face detection region according to the face inclination angle and the face side ratio:
if θ ≠ 0, then first define the rectangular region { i3-ThresiU≤i≤i4+ThresiDAnd j1-ThresjL≤j≤j2+ThresjR}; then finding a positioning point ((i3+ i4)/2, (j3+ j4)/2), and then rotating the rectangular area by theta by taking the positioning point as a rotation positioning point; and finally, selecting the blocks falling into the rotating rectangular region as the region to be detected of the human face.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810954300.1A CN109190529B (en) | 2018-08-21 | 2018-08-21 | Face detection method and system based on lip positioning |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810954300.1A CN109190529B (en) | 2018-08-21 | 2018-08-21 | Face detection method and system based on lip positioning |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109190529A CN109190529A (en) | 2019-01-11 |
| CN109190529B true CN109190529B (en) | 2022-02-18 |
Family
ID=64919199
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810954300.1A Active CN109190529B (en) | 2018-08-21 | 2018-08-21 | Face detection method and system based on lip positioning |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109190529B (en) |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110807402B (en) * | 2019-10-29 | 2023-08-08 | 深圳市梦网视讯有限公司 | Facial feature positioning method, system and terminal equipment based on skin color detection |
| CN111626143B (en) * | 2020-05-06 | 2023-12-08 | 深圳市梦网视讯有限公司 | Reverse face detection method, system and equipment based on eye positioning |
| CN111815651B (en) * | 2020-07-08 | 2024-01-30 | 深圳市梦网视讯有限公司 | Method, system and equipment for segmenting human face and body skin color region |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102024156A (en) * | 2010-11-16 | 2011-04-20 | 中国人民解放军国防科学技术大学 | Method for positioning lip region in color face image |
| CN102324025A (en) * | 2011-09-06 | 2012-01-18 | 北京航空航天大学 | Human face detection and tracking method based on Gaussian skin color model and feature analysis |
| CN103632132A (en) * | 2012-12-11 | 2014-03-12 | 广西工学院 | Face detection and recognition method based on skin color segmentation and template matching |
| CN107506691A (en) * | 2017-10-19 | 2017-12-22 | 深圳市梦网百科信息技术有限公司 | A kind of lip localization method and system based on Face Detection |
-
2018
- 2018-08-21 CN CN201810954300.1A patent/CN109190529B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102024156A (en) * | 2010-11-16 | 2011-04-20 | 中国人民解放军国防科学技术大学 | Method for positioning lip region in color face image |
| CN102324025A (en) * | 2011-09-06 | 2012-01-18 | 北京航空航天大学 | Human face detection and tracking method based on Gaussian skin color model and feature analysis |
| CN103632132A (en) * | 2012-12-11 | 2014-03-12 | 广西工学院 | Face detection and recognition method based on skin color segmentation and template matching |
| CN107506691A (en) * | 2017-10-19 | 2017-12-22 | 深圳市梦网百科信息技术有限公司 | A kind of lip localization method and system based on Face Detection |
Non-Patent Citations (2)
| Title |
|---|
| "一种快速而精确的多人脸检测与定位算法";李武军 等;《小型微型计算机系统》;20050930;第26卷(第9期);第1520-1524页 * |
| "基于颜色与模板匹配的人脸检测方法";马艳;《中国优秀硕士学位论文全文数据库 信息科技辑》;20070215(第02期);摘要、第1-4章 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109190529A (en) | 2019-01-11 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109190529B (en) | Face detection method and system based on lip positioning | |
| WO2022027912A1 (en) | Face pose recognition method and apparatus, terminal device, and storage medium. | |
| US8792728B2 (en) | Near-duplicate image detection | |
| CN109241878B (en) | Lip positioning-based facial feature positioning method and system | |
| US9092697B2 (en) | Image recognition system and method for identifying similarities in different images | |
| US9373054B2 (en) | Method for selecting frames from video sequences based on incremental improvement | |
| CN101520852B (en) | Vanishing point detecting device and detecting method | |
| US20070195996A1 (en) | Characteristic point detection method, apparatus, and program | |
| US11093792B2 (en) | Image processing methods and devices | |
| CN110807402B (en) | Facial feature positioning method, system and terminal equipment based on skin color detection | |
| WO2019015344A1 (en) | Image saliency object detection method based on center-dark channel priori information | |
| CN109840524A (en) | Kind identification method, device, equipment and the storage medium of text | |
| US9075476B2 (en) | Touch sensing methods comprising comparison of a detected profile form of a sensing curve with predetermined profile forms and devices thereof | |
| US20110007974A1 (en) | Object detection apparatus and method | |
| CN116168041B (en) | Real-time detection method and system applied to laminating device | |
| CN109255307B (en) | Face analysis method and system based on lip positioning | |
| CN112712569B (en) | Skin color detection method and device, mobile terminal and storage medium | |
| KR20190080388A (en) | Photo Horizon Correction Method based on convolutional neural network and residual network structure | |
| CN112312001A (en) | Image detection method, device, equipment and computer storage medium | |
| EP3376468B1 (en) | Object detection device and object detection method | |
| CN111738194B (en) | Method and device for evaluating similarity of face images | |
| JP6003367B2 (en) | Image recognition apparatus, image recognition method, and image recognition program | |
| CN107452003A (en) | A kind of method and device of the image segmentation containing depth information | |
| CN109271922B (en) | Nasal part positioning method and system based on contrast | |
| CN111126101B (en) | Method and device for determining key point position, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information | ||
| CB02 | Change of applicant information |
Address after: 518000 Guangdong city of Shenzhen province Nanshan District Guangdong streets high in the four Longtaili Technology Building Room 325 No. 30 Applicant after: Shenzhen mengwang video Co., Ltd Address before: 518000 Guangdong city of Shenzhen province Nanshan District Guangdong streets high in the four Longtaili Technology Building Room 325 No. 30 Applicant before: SHENZHEN MONTNETS ENCYCLOPEDIA INFORMATION TECHNOLOGY Co.,Ltd. |
|
| GR01 | Patent grant | ||
| GR01 | Patent grant |