CN105046202B - Adaptive recognition of face lighting process method - Google Patents

Adaptive recognition of face lighting process method Download PDF

Info

Publication number
CN105046202B
CN105046202B CN201510349830.XA CN201510349830A CN105046202B CN 105046202 B CN105046202 B CN 105046202B CN 201510349830 A CN201510349830 A CN 201510349830A CN 105046202 B CN105046202 B CN 105046202B
Authority
CN
China
Prior art keywords
face
illumination
image
classifier
lighting process
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201510349830.XA
Other languages
Chinese (zh)
Other versions
CN105046202A (en
Inventor
李千目
陈晗婧
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nust Science And Technology Park Co ltd
Original Assignee
Nanjing University of Science and Technology
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nanjing University of Science and Technology filed Critical Nanjing University of Science and Technology
Priority to CN201510349830.XA priority Critical patent/CN105046202B/en
Publication of CN105046202A publication Critical patent/CN105046202A/en
Application granted granted Critical
Publication of CN105046202B publication Critical patent/CN105046202B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/168Feature extraction; Face representation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/172Classification, e.g. identification

Landscapes

  • Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • General Health & Medical Sciences (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Image Processing (AREA)
  • Image Analysis (AREA)

Abstract

The invention discloses a kind of adaptive recognition of face lighting process methods.This method passes through Adaboost method first and carries out Face detection, obtains the face part in picture;Illumination complicated dynamic behaviour is carried out to face after carrying out Face detection;Different lighting process methods is selected to carry out lighting process to face by setting complexity threshold.The present invention is handled input picture using above three step, finally obtains the facial image of removal illumination effect.The present invention can not only effectively inhibit light to change the influence generated to later period recognition of face, it avoids and is lacked under varying environment using robustness caused by the algorithm of same lighting process simultaneously, and can rapidly and accurately obtain normalized facial image after lighting process.

Description

Adaptive recognition of face lighting process method
Technical field
The invention belongs to recognition of face preconditioning technique, specifically a kind of adaptive recognition of face lighting process method.
Background technique
The research of recent years, the identification of controllable environment human face make great progress, but under natural situation, at The variation of various uncontrollable factors always causes same face to generate very big variation as during.The wherein influence nothing of illumination It doubts and has been known as one of bottleneck of face identification system.
Difference of the same facial image under different illumination conditions may be greater than different faces image and shine in same light Under difference.Therefore, the solution of researcher's growing interest lighting issues is constantly combined existing method and improves, mentions Go out that many discriminations are higher, the stronger method of universality.These methods or using digital image processing techniques to illumination into Row pretreatment, or image is converted using mathematical theory combination image technique, to obtain the good image of illumination, again Or modeling processing is carried out to facial image, it is intended to restore the information such as shape, the posture of face;On this basis again to face into Row identification, mostly obtains preferable recognition performance.
Three kinds of recognition of face lighting process methods of mainstream have at present: histogram equalization, gradient face and illumination pretreatment chain. Histogram equalization method is intensity profile a kind of for statistical analysis in the overall situation, in adjustment histogram, then regenerates The method of histogram.This method primarily to selectively inhibit certain information (the less gray scale of pixel proportion), And enhance the certain information (the more gray scale of pixel proportion) for additionally needing performance, that is, achieve the purpose that equalization, in light In the case where all right, to the recognition effect robust that the later period carries out, and very simple it is quick (1.Stephen M.Pizer, E.Philip Amburn,John D.Austin,Robert Cromartie,Ari Geselowitz.Adaptive histogram equalization and its variations,Computer Vision,Graphics,and Image Processing,1987,vol.39,pp.355-368.).Illumination pretreatment chain (TT) is by filtering gamma transformation, difference of Gaussian The technologies such as wave combine one illumination pretreatment chain of composition, can eliminate light change bring adverse effect well, achieve non- Normal high discrimination, the face image processing more serious suitable for illumination effect, but process is complex.Gradient face (GRF) treatment process are as follows: the gradient component for seeking image X and Y-direction first does convolution by Gauss first derivative and image It can be in the hope of;It is a kind of illumination secondly, obtaining the gradient component of image in X and the respective gradient component of Y-direction according to image The method of robust, face identification rate in the extremely complex situation of illumination condition it is higher (2.Stephen M.Pizer, E.Philip Amburn,John D.Austin,Robert Cromartie,Ari Geselowitz.Face Recognition Under Varying Illumination Using Gradientfaces,Image Processing, IEEE Transactions on,2009,vol.18,pp.2599-2606).Three kinds of methods have their own specific aim, Each light conditions cannot all be carried out with the processing of robust.
Summary of the invention
The purpose of the present invention is to provide one kind to provide the judgement of different faces complexity, so that different algorithms be selected to take Match, reaches the method that can realize the lighting process effect of robust under any light environment.
The technical solution for realizing the aim of the invention is as follows: a kind of adaptive recognition of face lighting process method, step It is as follows:
The first step, locating human face carry out the positioning of face by Adaboost to input picture.A sample is organized first This collection finds out the Haar feature (face and non-face) of sample set, trains classifier with feature: according in each layer of classifier Whether sample classification correctly modifies the weight of sample, and is sent into next layer of classifier training, then by each layer of Multiple Classifier Fusion It rises as final Adaboost Decision Classfication device.Then facial image is detected with classifier, realizes Face detection.
Second step establishes illumination subspace, for three kinds of possible light conditions, organizes respectively multiple by Gaussian Blur The sample set of processing is trained strong classifier made of obtaining the cascade of several Weak Classifiers to sample set.It will pass through The facial image of first step processing is put into classifier, and the illumination complexity of face is obtained.
Third step, it is serious if illumination effect according to the judgement that second step is classified, then select gradient face to carry out at illumination Reason selects illumination pretreatment chain if moderate, and histogram equalization well can be then directly selected if Irradiance and carries out light According to processing.
Compared with prior art, the present invention its remarkable advantage: (1) at the human face light for having merged a variety of existing excellents Reason method can normalize the lighting process that robust is carried out containing facial image.(2) by sentencing to different light conditions Disconnected, the different targetedly lighting process methods of selection carry out unitary of illumination processing to containing facial image.So that lighting process has There are very strong robustness and anti-noise ability.(3) concept for introducing human face light complexity has merged Face datection cascade point The thought of class device can select lighting process algorithm according to different faces light conditions.
Detailed description of the invention
Fig. 1 is the flow chart of the adaptive recognition of face lighting process method of the present invention.
Fig. 2 is common Haar feature appearance schematic diagram.
Fig. 3 is Gaussian Blur smoothed image schematic diagram.
Fig. 4 is cascade illumination complexity classifier schematic diagram.
Fig. 5 is gradient face lighting process method schematic diagram.
Fig. 6 is illumination pretreatment chain method schematic diagram.
Fig. 7 is histogram equalization schematic diagram.
Specific embodiment
Present invention is further described in detail with reference to the accompanying drawing.
In conjunction with Fig. 1, the adaptive recognition of face lighting process method of the present invention, steps are as follows:
The first step carries out Face detection processing to input picture: one sample set of tissue extracts the Haar feature of picture, Suitable Haar feature is then picked out by Adaboost algorithm to form detector, people is carried out containing facial image to input Face detection, obtains facial image.
(1) Haar feature appearance as shown in Figure 2 is common Haar feature extraction, these feature are in face and non- The position upper value of face characterizes different.By the pixel in white area and subtracts the pixel in black region and obtain a mould The value of version.The integrated value ii (x, y) of certain point A (x, y) is defined as in imageDefining s (x, y) is The sum of upward all pixels of A (x, y) and its direction y, in this way, each pixel calculates ii (x, y) and s in the image of m*n size Entire integrogram matrix can be obtained in (x, y), m*n*2 calculating.
(2) Weak Classifier is chosen.
Wherein f is characterized, and θ is threshold value, and p is the direction of the sign of inequality, and x is a detection child window.
Wherein wt,iFor the weight of t-th of classifier ith feature, qt,iIt is the weight after normalization.
The weighting fault rate ε of all features is calculated for each feature f, one Weak Classifier h of trainingf,
εf=∑iqi|h(xi,f,p,θ)-yi|
Choosing has minimal error rate εfWeak Classifier hi, and adjust the weight of sample
Wherein ei=0 indicates xiCorrectly classified, it is on the contrary then for mistake classification,
(3) it is cascaded into strong classifier
Wherein
Image is detected, adjusts position and the ratio of detection window, constantly to look for face and be cut.
Second step, human face light complicated dynamic behaviour.By the foundation of illumination subspace, to facial image illumination complexity into Row measurement classification, selects according to the recognition of face lighting process that different illumination complexities enters third step.Detailed process is such as Under:
(1) sample set is established, which includes the facial image under multiple various illumination, and the light conditions of image are carried out Classification: 1. almost without illumination effect, face in uniform light;2. a small amount of illumination effect, such as a small amount of polarisation, facial contour and edge can See;3. illumination effect is serious, if face shadow occlusion range is big, overexposure etc..
(2) Gaussian Blur is carried out to sample set picture:
Wherein x, y respectively represent the position of coordinate points, and σ indicates smooth degree, this method selected parameter σ=10.0.It is flat Sliding facial image, hides its apparent feature, obtains the face matrix of significant face's comparison of light and shade.Smooth effect is as shown in Figure 3.
(3) Haar feature classifiers thought used in first step Face datection is used for reference, to the sample set of a large amount of Gaussian Blurs It is trained, obtains many Weak Classifiers, multiple Weak Classifiers are connected, obtain a strong classifier and come to light conditions Classify.
1. choosing Weak Classifier.
Wherein f is characterized, and θ is threshold value, and p is the direction of the sign of inequality, and x is a detection child window.
Wherein wt,iFor the weight of t-th of classifier ith feature, qt,iIt is the weight after normalization.
2. calculating the weighting fault of all images for each feature f, one Weak Classifier h of training in every one kind Rate εf,
εf=∑iqi|h(xi,f,p,θ)-yi|
Choosing has minimal error rate εfWeak Classifier hi, and adjust the weight of sample
Wherein ei=0 indicates xiCorrectly classified, it is on the contrary then for mistake classification,
3. being cascaded into three groups of strong classifiers
Wherein
(4) cutting facial image to be sorted is put into the strong classifier of third step composition, if first layer classifier obtains The result arrived is 0, then enters next layer of judgement, if obtained result is 1, obtains the classification of the image, enters next Step.
Third step, recognition of face lighting process:
(1) if image classification is that illumination effect is serious, Systematic selection gradient face.Detailed process is as follows:
1. seeking the gradient component of image X and Y-direction first, gradient transform definition is
WhereinWherein σ is standard deviation, x direction gradient and y direction gradient meter It is
WhereinIt is expressed as x, the derivative in the direction y.
2. the calculating of eigenface are as follows:
(2) if image classification is by a small amount of illumination effect, Systematic selection illumination pretreatment chain handles illumination effect, it It is by integrating the light irradiation preprocess methods such as Gamma correction, contrast equalization, to have obtained an illumination pretreatment Chain.Detailed process is as follows:
1. using Iγ(γ > 0) or log (I) (γ=0) replace image grayscale I, and as γ ∈ [0,1] and γ is a use Family custom parameter.One index is that the power law of γ and γ ∈ [0,0.5] range is a good compromise.Present invention selection γ=0.2 is used as default setting.
2. in order to reach illumination robustness, this method readjusts image ash using contrast equalization after Gamma correction It spends within the scope of an expectation, while can guarantee overall contrast of the image in the overall situation again.Process is as follows:
Wherein, a is a strength cake compressibility, and can be reduced individual larger gray value brings influences;τ is a threshold value, It is used to intercept larger gray value in equalization;Mean () is the averaging operation operator to whole image.The present invention is here Take α=0.1 and τ=10 as default value.
3. finally, this method completes the inhibition to gray value of image maximum using a kind of strategy of Nonlinear Mapping, That is I (x, y) ← τ tanh (I (x, y)/τ), wherein tanh () is hyperbolic tangent function, the value range of I be limited in (- τ, τ)。
(3) if almost without illumination effect, this system selection histogram equalization method is handled.Steps are as follows:
1. calculating the probability density function of image, i.e., tonal range is become 0~1 from 0~255, normalized.Use Pr (r) probability density function of original image, P are indicateds(S) it indicates to equalize later probability density function, r, s are respectively represented directly The gray value of side figure equalization front and back, and belong to [0,1].It is available by the knowledge of probability theoryWherein T-1(s) inverse transform function for being T (r).And have
2. calculating Cumulative Distribution Function.The probability occurred for some gray-level pixels are as follows:
Pr(rk)=nk/N
Wherein Pr(rk) it is the probability that the k-th gray-level pixels of original image occur, rkIt is k-th of gray level, i.e. current color Rank, range are [0,1], and N is total number of image pixels, nkFor rkPixel quantity.
3. gray-level histogram equalization formula are as follows:
Wherein, T (rk) indicates the transfer function of k-th of gray level of original image.∑ Pr (rk) indicates the ash of 0~k Spend grade probability of occurrence cumulative addition.Because s is normalized numerical value (s ∈ [0,1]), 0~255 color value is converted to, is needed It will be multiplied by 255, i.e.,
S=∑ Pr (rk) * 255.
In conclusion human face light processing method of the present invention by a variety of existing excellents of fusion, it can be to containing people Face image carries out adaptive lighting process normalization.And can be by judging different light conditions, selection is different Targetedly lighting process method carries out unitary of illumination processing to containing facial image, so that lighting process has very strong robust Property and anti-noise ability.

Claims (3)

1. a kind of adaptive recognition of face lighting process method, it is characterised in that steps are as follows:
The first step, training Haar feature classifiers handle the image containing face, realize Face detection, face part is cut out Come;
Second step establishes illumination subspace, for three kinds of possible light conditions, sample set of the tissue by Gaussian Blur processing It closes, strong classifier made of obtaining the cascade of several Weak Classifiers is trained to sample set;
Third step will be put into classifier by the facial image of first step processing, obtain the illumination complexity of face;
4th step, it is serious if illumination effect according to the illumination complexity for the face that third step obtains, then select gradient face into Row lighting process then selects illumination pretreatment chain to carry out lighting process, if almost no light shadow if a small amount of illumination effect It rings, then histogram equalization is selected to carry out lighting process;
It establishes illumination subspace and carries out the judgement of illumination complexity specific step is as follows:
2.1 establish sample set, which includes the facial image under multiple various illumination, according to criterion by sample image Light conditions are classified: 1. almost without illumination effect, i.e. face in uniform light;2. a small amount of illumination effect, i.e., a small amount of polarisation, people Face profile and edge are visible;3. serious illumination effect, i.e. face shadow occlusion range are big, overexposure;
2.2 pairs of sample set pictures carry out Gaussian Blur:
Wherein, x, y respectively represent the position of coordinate points, and σ indicates smooth degree, hidden using the smooth facial image of Gaussian Blur Its facial five features is hidden, the image of face's comparison of light and shade is only obtained;
2.3 are trained using the Adaboost method based on Haar feature to by the sample set of Gaussian Blur, are obtained many Weak Classifier connects multiple Weak Classifiers, obtains a strong classifier;The specific method is as follows:
2.3.1 initializing weight:
Wherein f is light image feature, and θ is threshold value, and p is the direction of the sign of inequality, and x is a detection child window;
Wherein, wt,iFor the weight of t-th of classifier ith feature, qt,iIt is the weight after normalization;
2.3.2 is calculated for the light image feature f of every multiple angles of one kind, one Weak Classifier h of training adding for all images Weigh error rate εf,
εf=∑iqi|h(xi,f,p,θ)-yi|
Choosing has minimal error rate εfWeak Classifier hi, and adjust the weight of sample
Wherein ei=0 indicates xiCorrectly classified, it is on the contrary then for mistake classification;
Wherein εtFor the weighting fault rate of t-th of classifier,For Dynamic gene;
2.3.3 Weak Classifier obtained in 2.3.2 is cascaded into three groups of strong classifiers
Wherein
2. adaptive recognition of face lighting process method according to claim 1, it is characterised in that: third step will pass through The facial image of processing is put into the strong classifier of second step composition, if the result that first layer classifier obtains is 1, image category It is serious in illumination effect;If the result that first layer classifier obtains is 0, next layer of judgement is entered, if classifier obtains at this time The result arrived is 1, then it is moderate to belong to illumination effect for image;Otherwise judge it for almost without illumination effect.
3. adaptive recognition of face lighting process method according to claim 1, it is characterised in that the 4th step The specific method is as follows:
(1) when being classified as normal illumination, i.e., the image array dark pixel after Gaussian Blur accounts for 5%~30%, then selects histogram Equalization handles picture;
(2) when being classified as slightly illumination effect, i.e., the image array dark pixel after Gaussian Blur accounts for 30%~70%, then selects light Picture is handled according to pretreatment chain;
(3) when being classified as serious illumination effect, i.e., the image array dark pixel after Gaussian Blur accounts for 70%~100%, then selects Gradient face handles picture.
CN201510349830.XA 2015-06-23 2015-06-23 Adaptive recognition of face lighting process method Active CN105046202B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201510349830.XA CN105046202B (en) 2015-06-23 2015-06-23 Adaptive recognition of face lighting process method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510349830.XA CN105046202B (en) 2015-06-23 2015-06-23 Adaptive recognition of face lighting process method

Publications (2)

Publication Number Publication Date
CN105046202A CN105046202A (en) 2015-11-11
CN105046202B true CN105046202B (en) 2019-04-16

Family

ID=54452731

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510349830.XA Active CN105046202B (en) 2015-06-23 2015-06-23 Adaptive recognition of face lighting process method

Country Status (1)

Country Link
CN (1) CN105046202B (en)

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106022225B (en) * 2016-05-10 2019-03-05 中科天网(广东)科技有限公司 A kind of Face datection classifier building method based on AdaBoost
CN106407966B (en) * 2016-11-28 2019-10-18 南京理工大学 A kind of face identification method applied to attendance
CN107545251A (en) * 2017-08-31 2018-01-05 北京图铭视界科技有限公司 Face quality discrimination and the method and device of picture enhancing
CN108985222B (en) * 2018-07-12 2024-02-20 天津艾思科尔科技有限公司 Deep learning network model and system for recognition of incoming calls
CN109431045B (en) * 2018-12-08 2022-04-22 余姚市恒正金属制品有限公司 Leg self-adaptive telescopic system
CN110910320B (en) * 2019-11-04 2022-09-06 南京邮电大学 Face image illumination restoration method based on singular value decomposition

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102214292A (en) * 2010-04-09 2011-10-12 汉王科技股份有限公司 Illumination processing method for human face images
CN103208012A (en) * 2013-05-08 2013-07-17 重庆邮电大学 Light face recognition method

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7747079B2 (en) * 2006-09-27 2010-06-29 Tandent Vision Science, Inc. Method and system for learning spatio-spectral features in an image

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102214292A (en) * 2010-04-09 2011-10-12 汉王科技股份有限公司 Illumination processing method for human face images
CN103208012A (en) * 2013-05-08 2013-07-17 重庆邮电大学 Light face recognition method

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
Facial-Lighting归一化方法研究;周枫 等;《软件》;20150615;第36卷(第6期);第58-65页
基于光照分类的可变光照下人脸识别方法;崔瑞 等;《计算机工程与应用》;20101231;第46卷(第28期);第185~188页

Also Published As

Publication number Publication date
CN105046202A (en) 2015-11-11

Similar Documents

Publication Publication Date Title
CN105046202B (en) Adaptive recognition of face lighting process method
Anila et al. Preprocessing technique for face recognition applications under varying illumination conditions
CN108734138B (en) Melanoma skin disease image classification method based on ensemble learning
CN109684922B (en) Multi-model finished dish identification method based on convolutional neural network
CN108268859A (en) A kind of facial expression recognizing method based on deep learning
CN102306384B (en) Color constancy processing method based on single image
CN109766898A (en) Image character recognition method, device, computer equipment and storage medium
CN109859181A (en) A kind of PCB welding point defect detection method
CN104318262A (en) Method and system for replacing skin through human face photos
CN1975759A (en) Human face identifying method based on structural principal element analysis
CN105488456A (en) Adaptive rejection threshold adjustment subspace learning based human face detection method
CN110458792B (en) Method and device for evaluating quality of face image
CN105678245A (en) Target position identification method based on Haar features
Smith et al. Effect of pre-processing on binarization
CN108664839A (en) A kind of image processing method and equipment
CN107516083A (en) A kind of remote facial image Enhancement Method towards identification
CN109522865A (en) A kind of characteristic weighing fusion face identification method based on deep neural network
CN114463269A (en) Chip defect detection method based on deep learning method
CN104966271B (en) Image de-noising method based on biological vision receptive field mechanism
Karamizadeh et al. Race classification using gaussian-based weight K-nn algorithm for face recognition
US8311358B2 (en) Method and system for image extraction and identification
CN110490053B (en) Human face attribute identification method based on trinocular camera depth estimation
Pathak et al. Entropy based CNN for segmentation of noisy color eye images using color, texture and brightness contour features
CN111339856A (en) Deep learning-based face recognition method and recognition system under complex illumination condition
Giap et al. Adaptive multiple layer retinex-enabled color face enhancement for deep learning-based recognition

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
TR01 Transfer of patent right
TR01 Transfer of patent right

Effective date of registration: 20210107

Address after: 210014 Guanghua Road 129-3, Qinhuai District, Nanjing City, Jiangsu Province

Patentee after: NUST SCIENCE AND TECHNOLOGY PARK Co.,Ltd.

Address before: 210094 No. 200, Xiaolingwei, Jiangsu, Nanjing

Patentee before: NANJING University OF SCIENCE AND TECHNOLOGY