CN101609500A - Quality estimation method of exit-entry digital portrait photos - Google Patents

Quality estimation method of exit-entry digital portrait photos Download PDF

Info

Publication number
CN101609500A
CN101609500A CNA2008102279269A CN200810227926A CN101609500A CN 101609500 A CN101609500 A CN 101609500A CN A2008102279269 A CNA2008102279269 A CN A2008102279269A CN 200810227926 A CN200810227926 A CN 200810227926A CN 101609500 A CN101609500 A CN 101609500A
Authority
CN
China
Prior art keywords
image
face
exit
entry
digital portrait
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CNA2008102279269A
Other languages
Chinese (zh)
Other versions
CN101609500B (en
Inventor
宛根训
田青
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Vimicro Corp
First Research Institute of Ministry of Public Security
Original Assignee
Vimicro Corp
First Research Institute of Ministry of Public Security
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Vimicro Corp, First Research Institute of Ministry of Public Security filed Critical Vimicro Corp
Priority to CN2008102279269A priority Critical patent/CN101609500B/en
Publication of CN101609500A publication Critical patent/CN101609500A/en
Application granted granted Critical
Publication of CN101609500B publication Critical patent/CN101609500B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Abstract

The invention provides a kind of quality estimation method of exit-entry digital portrait photos, this method comprises the exposure tests of digital portrait photograph form size and file size detection, the detection of people's face and eye location, the detection of portrait horizontal center, overall luminance deviation and local luminance deviation; The sharpness that comprises contrast evaluation and blur level evaluation detects, whether qualified color detection and background detects as the color of face area to be used for detecting colour of skin naturalness and process decision chart at the Lab color space.The advantage of appraisal procedure of the present invention is: the quality that is different from digital portrait photograph has in the past been set up the assessment models of digital portrait phase tablet quality and concrete quality testing item, testing process, evaluation index and appraisal procedure by subjective assessment.Judge the quality of every width of cloth digital portrait photograph, do not need to rely on " standard picture " that result of determination meets people's the subjective feeling and the requirement of face authentication system, can satisfy the requirement of exit-entry digital portrait management service well.

Description

Quality estimation method of exit-entry digital portrait photos
Technical field
The present invention relates to the computer software application field, particularly a kind of quality estimation method of exit-entry digital portrait photos.
Background technology
Along with informationization, multimedia and development of Communication Technique, increasing digital portrait photograph begins to appear at a plurality of scopes of business of entry-exit management, people's face biometric identity authenticates becomes one of important channel of identity validation, becomes a requisite link of entry and exit photograph management at the quality assessment of entry and exit Applied Digital Studio Portraits.In the accreditation link, the sector-meeting of low-quality digital portrait phase influences the attractive in appearance of certificate making, causes the true appearance difference of identity photographs and holder bigger on the one hand, increases difficulty for the verification of certificate; On the other hand, non-compliant image may cause the thrashing of people's face biological characteristic authentication, reduces the reliability of face authentication system.
Usually image quality evaluation can be divided into subjective assessment and objective evaluation.Subjective assessment mainly comes the quality of checking image by the people, in traditional entry-exit management business, the quality assessment of digital portrait photograph mainly realizes by subjective assessment, usually by the harmony of foreground admissibility staff or the logical ratio from the head of experienced photographic quality authentication personnel, whether people's face placed in the middle, whether image clear, whether photo has levels sense, photo color and expression whether naturally etc. the aspect judge whether photo can put in storage.Because that subjective assessment lacks is objective, science, unified judgment basis, causes putting in storage photographic quality on the one hand and differs greatly, and on the other hand along with the extensive granting of the various certificates of entry and exit, is difficult to adapt to the needs of business development on efficient.Objective evaluation is the quality by relatively coming checking image with benchmark image usually, square error method (MSE) commonly used and Y-PSNR analogy method for objectively evaluating such as (PSNR), be used for " fidelity " of evaluate image the new images after promptly restoring and the degree of approximation of original image.And aspect the quality assessment of entry-exit management digital portrait photograph, since at be the photo that a width of cloth width of cloth is submitted to, can be for reference without any " standard picture ", and quality evaluation result and entry-exit management business are closely connected, should make the result of quality assessment meet most people's subjective sensation, make the result of quality assessment meet the operation requirement of certificate making again, guarantee that the certificate of making is attractive in appearance, satisfy the requirement of face authentication system.
Face recognition technology is the focus of studying in recent years, face recognition technology is to utilize to analyze to compare the computer technology that people's face visual signature information is carried out the identity discriminating, promptly seek the people's face position in the input picture automatically and extract the identity characteristic that contains in everyone face by computing machine, thereby then by comparing the identity of determining everyone face with known people's face.Detection of people's face and location are important technologies in the face recognition technology.In face identification system, at first determine the position of people's face in the image by human face detection tech, be positioned at the position of locating facial characteristics such as eyes, nose (nostril) (eyebrow) (mouth) (lip) ear etc. in definite people's face by people's face then.Patent CN03147472.1 " based on the human eye localization method of GaborEye model " and patent 200510089006 " a kind of Combination of Multiple Classifiers face identification method based on the feature grouping " provide correlation technique.
Aspect the background detection technique, use traditional method at first to use the Sobel operator to obtain gradient map to former figure, on gradient map, carry out binaryzation preserving edge information, use seed fill algorithm to obtain the background area then, use the background area from former figure, to propose background image at last as blindage.Relevant document has:
" Sobel operator " (Ruan Qiuqi. Digital Image Processing. Beijing: electronics industry is published, and 2003)
" binaryzation " (Ostu N.A threshold selection method from gray2level histogram[J] .IEEETrans SMC, 1979,9:62266)
" seed filling " (Sun Jiaguang, Yang Changgui. computer graphics (the 3rd edition) [M]. Beijing: publishing house of Tsing-Hua University, 1999)
Existing digital picture quality method for objectively evaluating need provide the original image reference, and aspect the quality assessment of entry-exit management digital portrait photograph, since at be the photo that a width of cloth width of cloth is submitted to, can be for reference without any " standard picture ", and require evaluation result and entry-exit management business to be closely connected, one side requires the result of image quality evaluation to meet most people's subjective sensation, the result of requirement evaluation meets the operation requirement of certificate making on the other hand, guarantee that the certificate of making is attractive in appearance, satisfy the requirement of face authentication system.Therefore, can satisfy the quality estimation method of exit-entry digital portrait photos appearance as yet at present of exit-entry digital portrait management service requirement well.
Summary of the invention
The objective of the invention is to overcome and judge otherness and the poor efficiency that the phase tablet quality exists according to the personal experience, a kind of do not need to rely on " standard picture " is provided, can realize the quantification of digital photo quality judging, result of determination had both met people's subjective feeling, meet the face authentication system requirements again, can satisfy the quality estimation method of exit-entry digital portrait photos of exit-entry digital portrait management service requirement well.
Quality estimation method of exit-entry digital portrait photos provided by the invention, this method is provided with computing machine exit-entry digital Studio Portraits quality evaluation model the digital portrait in the system of being input to is carried out the judgement of the whether satisfied traffic criteria of entering and leaving the border, and comprises the steps:
The step that digital portrait photograph form size and file size detect;
The step of detection of people's face and eye location;
The step that the portrait horizontal center detects; With
The step that background detects;
This method also is included in and carries out following steps between portrait horizontal center detection step and the background detection step:
1) step of exposure tests is used to detect the reliability of face image overall exposing;
2) step that detects of sharpness is used to detect the diffusion around each pixel and the fog-level of detected image;
3) whether the step of color detection, it is qualified as the color of face area to be used in Lab color space detection colour of skin naturalness and process decision chart.
Method of the present invention, wherein said step 1) is carried out following steps:
(1) step of overall luminance deviation detection, it is excessive or not enough to be used to detect face's overall exposing
A) oriented face area is carried out color conversion from the RGB color space conversion to the Lab color space;
B) the brightness average P of calculating face area in the L space;
C) if brightness average P is less than normal, promptly P<L1 determines that the figure kine bias is dark, under-exposure; If P is bigger than normal for the brightness average, i.e. P>L2, then image is too bright, and is over-exposed;
(2) step of local luminance deviation detection, it is excessive to be used to detect partial exposure
Human face region is divided into 8 * 8 sub-pieces, adds up the brightness average P of each sub-piece respectively Ij, and calculate symmetrical luminance deviation respectively
▿ P i , j = | P i , j - P i , 9 - j | I=1...8 wherein, j=1...4
Add up maximum symmetric deviations, symmetric deviations average and variance respectively
Maximum deviation δ 2 = 1 - max ▿ P i , j 255
Average m = Σ i = 1 8 Σ j = 1 4 ▿ P i , j 32
Variance s = ( Σ i = 1 8 Σ j = 1 4 ( ▿ P i , j - m ) 2 32 ) 1 2 ,
Utilize the face area symmetry, detect the homogeneity of exposure respectively by maximum symmetric deviations, average and variance, wherein maximum deviation δ 2The reflection partial exposure excessively causes image detail to be lost.
Method of the present invention, wherein said step 2) the execution following steps:
(1) contrast evaluation is used to detect each pixel diffusion on every side:
A) oriented face area is scaled the identical standard face of area;
B) the standard face is transformed to gray level image from coloured image;
C) define the contrast of each pixel:
c(i,j)=|f(i,j)-f(i-1,j)|+|f(i,j)-f(i+1,j)|+|f(i,j)-f(i-1,j-1)|+|f(i,j)-f(i-1,j)|+|f(i,j)-f(i-1,j+1)|+|f(i,j)-f(i+1,j-1)|+|f(i,j)-f(i+1,j)|+|f(i,j)-f(i+1,j+1)|
C) lower limit and the upper limit of setting contrast threshold are used for getting rid of respectively non-marginal information and interference of noise, preserving edge information:
c ′ ( i , j ) = 0 c ( i , j ) ≤ c 1 c ( i , j ) c 1 ≤ c ( i , j ) ≤ c 2 0 c ( i , j ) ≥ c 2
The average contrast of edge calculation information and variance;
D) process decision chart similarly is not clear: if the contrast average is bigger, variance is bigger, then is picture rich in detail; If contrast is less, and variance is less, then is blurred picture;
(2) blur level evaluation, determine the blur level of image with the Robert gradient under the different dynamic thresholds:
Method of the present invention, wherein said step 3) is carried out following steps:
In the Lab color space, to red progressively transition a value representation, to Huang transition b value representation progressively, calculate a average and the b average of each image face area respectively by green, and draw the areal map of a, b at two-dimensional space by indigo plant, judge then: if
( a - 7.5 ) 2 7.5 2 + ( b - 5 ) 2 10 2 > 1
It then is the defective image of color.
Method of the present invention, wherein said digital portrait photograph form size and file size detect carries out following steps: computing machine reads the Digital Image Data and the attribute of input, the size that comprises the width of form, image of image and height, file, judge that the form that the whether satisfied professional standard of entering and leaving the border is an image is JPG, picture traverse is 354 pixels, highly be 472 pixels, the file size scope is 18-25KB.
Method of the present invention, wherein said people's face detects and eye location is carried out following steps: at first adopt the recognition of face field in detection of people's face and feature location technology, find the position of human face region and glasses from digital photo, human face region comprises the zone between forehead, chin and the left and right sides auricle; The human eye location comprises the position of locating pupil center; Do not comprise people's face in the image and maybe can't navigate to eyes if detect, determine that then image does not comprise people's face or picture quality is relatively poor.
Method of the present invention, wherein said portrait horizontal center detect carries out following steps:
1) position of eyes in the definition image, the width of establishing image is W, highly is H, left eye is (X apart from position, the image upper left corner L, Y L), right eye is (X apart from the image upper left corner R, Y R):
d1=|X L+X R-W|×0.5
d2=|Y L+Y R|×0.5
d3=|X R-X L|
angle=atan(|Y L-Y R|/d3)
Wherein, d1 represents the distance of portrait off-set from horizontal centerline, and d2 represents the distance of eye areas apart from image top, and d3 represents two oculocentric distances, the anglec of rotation of Angle presentation video;
2) judge:
When d1 surpassed 0.03 times of picture traverse, image was not placed in the middle;
In certificate photo, the distance that d2 is suitable is between the 0.3H to 0.5H;
The scope of d3 is W/4 to W/3;
Deflection angle is no more than 3 degree.
Method of the present invention, wherein said background detects carries out following steps: at first use the Sobel operator to obtain gradient map to original image, on gradient map, carry out binaryzation preserving edge information, use seed fill algorithm to obtain the background area then, use the background area from former figure, to propose background image at last as blindage.
The advantage of quality estimation method of exit-entry digital portrait photos of the present invention is: based on the harmony of two oculocentric physical locations and range estimation people face position and ratio, exposure tests, sharpness detection process decision chart based on face area similarly are to deny the clear sense that has levels, judge based on face's Face Detection whether the photo color is natural, realized the quantification of digital photo quality judging, it is different from the past that the evaluation of the quality of digital portrait photograph mainly realizes by subjective assessment, has set up entry-exit management with the unified objective criterion of digital portrait phase tablet quality.Exposure provided by the invention, sharpness and color appraisal procedure can be judged the quality of every width of cloth digital portrait photograph, do not need to rely on " standard picture ", result of determination meets most people's subjective feeling, meet the requirement of face authentication system, can satisfy the requirement of exit-entry digital portrait management service well.The present invention has set up the assessment models of entry-exit management with digital portrait phase tablet quality first, has set up concrete quality testing item, testing process, evaluation index and appraisal procedure.
Description of drawings
Below in conjunction with accompanying drawing the present invention is further described.
Fig. 1 is the process flow diagram of quality estimation method of exit-entry digital portrait photos of the present invention;
Fig. 2 is the test item table of quality estimation method of exit-entry digital portrait photos of the present invention;
Fig. 3 is that people's face detects and human eye location synoptic diagram in the quality estimation method of exit-entry digital portrait photos of the present invention;
Fig. 4 is a) to Fig. 4 c) be exposure check result figure in the quality estimation method of exit-entry digital portrait photos of the present invention;
Fig. 5 is a) to Fig. 5 b) be contrast check result figure in the quality estimation method of exit-entry digital portrait photos of the present invention;
Fig. 6 is a whole figure contrast mean variance distribution plan in the quality estimation method of exit-entry digital portrait photos of the present invention;
Fig. 7 is a quality estimation method of exit-entry digital portrait photos contrast mean variance distribution plan of the present invention;
Fig. 8 is the normalization histogram of gradients of different images in the quality estimation method of exit-entry digital portrait photos of the present invention;
Fig. 9 A to Fig. 9 D is the digital portrait photograph of different fog-levels;
Figure 10 is that the different quality coloured image is at the ab of Lab color space color space distribution plan.
Embodiment
The present invention passes through exit-entry digital Studio Portraits quality evaluation model according to entry-exit management own service demand, require necessary clear, the levels are rich of portrait of digital portrait photograph of warehouse-in, the expression nature, portrait is horizontal center in photograph, runs counter in this standard each and will will not put in storage as image off quality.
The appraisal procedure that the present invention adopts according to the attribute of exit-entry digital portrait standard and digital portrait photograph self, has been formulated exit-entry digital Studio Portraits quality check project and concrete inspection flow process.The present invention is different with general digital photo assessment, and we are the position of location human face region and eyes from digital photo at first, the quality of emphasis assessment face area and eye areas.Inspection item as shown in Figure 2.Testing process as shown in Figure 1.
Referring to Fig. 1 and Fig. 2, quality estimation method of exit-entry digital portrait photos of the present invention, setting up the automatic assessment models of exit-entry digital Studio Portraits quality utilizes computing machine that the digital picture in the system of being input to is assessed automatically, whether the digital picture of judging input satisfies the professional relevant standard of entry and exit, comprises the steps:
The step that digital portrait photograph form size and file size detect:
With reference to Fig. 2, stipulate that in the entry and exit business form of image is JPG, picture traverse is 354 pixels, highly is 472 pixels, the file size scope is 18-25KB.Computing machine at first reads the Digital Image Data and the attribute of input, comprises the size of the width of form, image of image and height, file etc., judges whether satisfy the professional standard of entry and exit.
The step of detection of people's face and eye location:
The present invention introduces the correlation technique of recognition of face, utilize the recognition of face field in people's face detect and the feature location technology, from digital photo, accurately find the position of human face region and eyes, about the specific implementation of detection of people's face and location can be with reference to recognition of face field pertinent literature.With reference to Fig. 3, human face region comprises the zone between forehead, chin and the left and right sides auricle, and the position of pupil center can accurately be located in the human eye location.Do not comprise people's face in the image and maybe can't navigate to eyes if detect, show that image does not comprise people's face or picture quality is relatively poor.The emphasis of assessment is a face area at portrait, guarantee the portrait exposure evenly, face feature is clear is rich in level.
The step that the portrait horizontal center detects:
Whether during horizontal center, portrait area commonly used judges that from the distance of image boundary still, hair style etc. are disturbed bigger to testing result in detected image, and fluffy hair can cause human face region shared zone in image too little.Among the present invention, the horizontal center line of image is divided two oculocentric lines equally; The ratio of two oculocentric distance reflection heads in entire image, two eye distances are from too small, and head image is less than normal, and two eye distances are from excessive, and head image is bigger than normal; Two eye distances are from the coordination degree of the distance reflection portrait of image bottom; In addition, the rotation degree of the position of eyes reflection image.
If the width of image is W, highly be H, left eye is (X apart from position, the image upper left corner L, Y L), right eye is (X apart from the image upper left corner R, Y R), it is as follows to define three distances:
d1=|X L+X R-W|×0.5
d2=|Y L+Y R|×0.5
d3=|X R-X L|
angle=atan(|Y L-Y R|/d3)
Wherein d1 represents the distance of portrait off-set from horizontal centerline, and when d1 surpassed 0.03 times of picture traverse, human eye can feel that obviously image is not placed in the middle; D2 represents the distance of eye areas apart from image top, and in certificate photo, human eye is positioned at the top of image, draws from a large amount of statistics, and the suitable distance of d2 is between 0.3H to 0.5H; D3 represents two oculocentric distances, and the scope of d3 is W/4 to W/3; The anglec of rotation of Angle presentation video, after deflection angle surpassed 3 degree usually, human eye can be discovered.
The step of exposure tests:
Exposure tests adopts overall luminance deviation and local luminance deviation to be respectively applied for the reliability that detects the face image overall exposing, wherein:
(1) overall luminance deviation
A) oriented face area is carried out color conversion from the RGB color space conversion to the Lab color space;
B) the brightness average P of calculating face area in the L space;
C) if brightness average P is less than normal, promptly P<L1 determines that the figure kine bias is dark, under-exposure; If P is bigger than normal for the brightness average, i.e. P>L2, then image is too bright, and is over-exposed.
In an embodiment of the present invention, with reference to Fig. 4 a) to Fig. 4 c), be depicted as the result that exposure is checked.With reference to Fig. 4 .a), brightness average P=167.35, it is suitable to expose, with reference to Fig. 4 b), brightness average P=212.52, brightness is bigger than normal, and is over-exposed, with reference to Fig. 4 .c), brightness average P=75.90, dark partially, under-exposure.
(2) local luminance deviation
Human face region is divided into 8 * 8 sub-pieces, adds up the brightness average P of each sub-piece respectively Ij, and calculate symmetrical luminance deviation respectively
▿ P i , j = | P i , j - P i , 9 - j | I=1...8 wherein, j=1...4
Add up maximum symmetric deviations, symmetric deviations average and variance respectively
Maximum deviation δ 2 = 1 - max ▿ P i , j 255
Average m = Σ i = 1 8 Σ j = 1 4 ▿ P i , j 32
Variance s = ( Σ i = 1 8 Σ j = 1 4 ( ▿ P i , j - m ) 2 32 ) 1 2 ,
Utilize the face area symmetry, detect the homogeneity of exposure respectively by maximum symmetric deviations, average and variance, wherein maximum deviation δ 2The reflection partial exposure excessively causes image detail to be lost, and is defective image.
Sharpness detects:
2) sharpness detects, and sharpness detects and comprises contrast evaluation and blur level evaluation, wherein:
(1) contrast evaluation:
A), oriented face area is scaled the identical standard face of area with reference to Fig. 3;
B) the standard face is transformed to gray level image from coloured image;
C) define the contrast of each pixel:
c(i,j)=|f(i,j)-f(i-1,j)|+|f(i,j)-f(i+1,j)|+|f(i,j)-f(i-1,j-1)|+|f(i,j)-f(i-1,j)|+|f(i,j)-f(i-1,j+1)|+|f(i,j)-f(i+1,j-1)|+|f(i,j)-f(i+1,j)|+|f(i,j)-f(i+1,j+1)|
D) lower limit and the upper limit of setting contrast threshold are used for getting rid of respectively non-marginal information and interference of noise, preserving edge information:
c ′ ( i , j ) = 0 c ( i , j ) ≤ c 1 c ( i , j ) c 1 ≤ c ( i , j ) ≤ c 2 0 c ( i , j ) ≥ c 2
The average contrast of edge calculation information and variance;
E) process decision chart similarly is not clear: if contrast average and variance are bigger, then be picture rich in detail, with reference to Fig. 5 a), as contrast P=25.64, variance S=30.34; If contrast is less, and variance is less, then is blurred picture, with reference to Fig. 5 b), as contrast average P=16.79, variance S=21.65.
In an embodiment of the present invention, in advance reality test photograph is divided into two groups, one group of blurred picture, one group of picture rich in detail.To every width of cloth photograph, at first calculate the contrast average and the variance of view picture photograph, use the present invention's defined method statistic contrast average and variance then, with reference to Fig. 6 and Fig. 7, the contrast mean variance distribution situation of difference drawing image.
With reference to Fig. 6 and Fig. 7, wherein transverse axis is the contrast average, and the longitudinal axis is the contrast variance, "+" expression blurred picture that color is more shallow, ". " expression picture rich in detail that color is darker.The contrast mean variance distribution situation that Fig. 7 obtains for this paper evaluation method, as can be seen from the figure, the contrast average of picture rich in detail is bigger, variance is bigger, and blurred picture, because contrast concentrates on less contrast part, the contrast average is less, and variance is less, has only a spot of overlapping between two groups of images.Therefore, use the contrast evaluation method of the present invention's definition to make a distinction blurred picture and picture rich in detail preferably.Fig. 6 is traditional contrast mean variance distribution situation of taking entire image, and as can be seen from the figure, the distribution of two groups of images is overlapped, is difficult to distinguish.
(2) blur level evaluation:
A), oriented face area is scaled the identical standard face of area with reference to Fig. 3;
B) the standard face is transformed to gray level image from coloured image;
C) define the Robert gradient of each pixel:
g ( x , y ) = [ ( f ( x , y ) - f ( x + 1 , y + 1 ) ) 2 + ( f ( x + 1 , y ) - f ( x , y + 1 ) ) 2 ] 1 2 ;
D) definition dynamic threshold c keeps initial value when Grad surpasses threshold value c, represent that this point is the edge, otherwise be changed to 0, marginal information account for that the standard face amasss 0.05:
g ( x , y ) = 0 g ( x , y ) < c g ( x , y ) g ( x , y ) &GreaterEqual; c
D) statistics edge gradient histogram, and carry out normalization:
hist(i)=count(g(x,y)=i)
p ( i ) = hist ( i ) &Sigma; i = 1 255 hist ( i )
The i value is 1 in the formula ... 255, (x y) represents all marginal points to g;
E) blur level of calculating and definite image:
blur = &Sigma; i = 1 T p ( i )
Wherein T is an empirical value, and the values of ambiguity of image is at 0 to 1, and values of ambiguity is big more, and image is fuzzy more.
In an embodiment of the present invention, with reference to Fig. 5, draw the normalization histogram of gradients of picture rich in detail and blurred picture respectively, blurred picture histogram distribution major part concentrates on less gradient part, and blur level is bigger; Picture rich in detail histogram distribution broad, small part appear at less gradient part, and blur level is bigger.
In an embodiment of the present invention, with reference to Fig. 9 A-Fig. 9 D, be depicted as the blur level of different fog-level digital portrait photographs.With reference to Fig. 9 A, blur level A=0.495156, the blur level minimum, image is the most clear; With reference to Fig. 9 B to Fig. 9 D, blur level B=0.822690, blur level C=0.907083, blur level D=0.951220, the strain of blur level phase is big, image is also more and more fuzzyyer.As can be seen from the results, blur level can correctly reflect the fog-level of image.
Color detection:
Whether color detection is used in Lab color space detection colour of skin naturalness and process decision chart qualified as the color of face area.In the Lab color space, to red progressively transition a value representation, to Huang transition b value representation progressively, calculate a average and the b average of each image face area respectively by green, and draw the areal map of a, b at two-dimensional space by indigo plant, judge then: if
( a - 7.5 ) 2 7.5 2 + ( b - 5 ) 2 10 2 > 1
It then is the defective image of color.
In an embodiment of the present invention, in order to determine the distribution of the colour of skin on the Lab color space, at first to the set of number portrait photo, according to the effect of certificate making color nature degree is divided into 5 grades and gives a mark respectively: serious colour cast, colour cast, badly determine, the colour of skin normally, very natural.In 5 ranks, it is defective that serious colour cast and colour cast belong to color, bad determine to be defined as can declare and can not declare, the normal and qualified image of genus color very naturally of the colour of skin.Then,, calculate a average and the b average of people's face area in every width of cloth image respectively, project to respectively by class in the ab space of Lab color space with reference to Figure 10.As can be seen, be distributed in X-Y scheme left-half for serious colour cast and colour cast image, belong to the defective image of color; Its excess-three class is distributed in the elliptic region of right half part, between have tangible discrimination, can distinguish the defective image of color.
The step that background detects:
We realize the background test section by traditional method, at first the digital photo to input carries out rim detection, promptly use the Sobel operator to obtain gradient map to former figure, on gradient map, carry out binaryzation preserving edge information, use seed fill algorithm on outline map, to fill then, obtain the background area, from former figure, propose background image then, check the homogeneity of background image at last, use the background area from former figure, to propose background image as blindage.Use this method,, also can more accurately from Studio Portraits, extract the background area even the change color scope of background is very big.
The present invention is directed to the requirement of exit-entry digital portrait management service, and the certificate quality standard that proposes recently in conjunction with International Civil Aviation Organization, set up the quality evaluating method of entry-exit management digital portrait photograph, by estimating qualified portrait photo, satisfy the professional requirement of entry and exit well, evaluation result meets most people's subjective sensation on the one hand, meets the operation requirement of certificate making on the other hand, guarantee that the certificate of making is attractive in appearance, satisfy the requirement of follow-up face authentication system simultaneously.
Above-described embodiment; only be that preferred implementation of the present invention is described; be not that scope of the present invention is limited; design under the prerequisite of spirit not breaking away from the present invention; various distortion and improvement that the common engineering technical personnel in this area make technical scheme of the present invention all should fall in the definite protection domain of claims of the present invention.

Claims (8)

1. quality estimation method of exit-entry digital portrait photos, this method are provided with computing machine exit-entry digital Studio Portraits quality evaluation model the digital portrait in the system of being input to are carried out whether satisfying the judgement of entry and exit traffic criteria, comprise the steps:
The step that digital portrait photograph form size and file size detect;
The step of detection of people's face and eye location;
The step that the portrait horizontal center detects; With
The step that background detects;
It is characterized in that this method also is included in and carries out following steps between portrait horizontal center detection step and the background detection step:
1) step of exposure tests is used to detect the reliability of face image overall exposing;
2) step that detects of sharpness is used to detect the diffusion around each pixel and the fog-level of detected image;
3) whether the step of color detection, it is qualified as the color of face area to be used in Lab color space detection colour of skin naturalness and process decision chart.
2. quality estimation method of exit-entry digital portrait photos according to claim 1 is characterized in that, wherein said step 1) is carried out following steps:
(1) step of overall luminance deviation detection, it is excessive or not enough to be used to detect face's overall exposing
C) oriented face area is carried out color conversion from the RGB color space conversion to the Lab color space;
D) the brightness average P of calculating face area in the L space;
C) if brightness average P is less than normal, promptly P<L1 determines that the figure kine bias is dark, under-exposure; If P is bigger than normal for the brightness average, i.e. P>L2, then image is too bright, and is over-exposed;
(2) step of local luminance deviation detection, it is excessive to be used to detect partial exposure
Human face region is divided into 8 * 8 sub-pieces, adds up the brightness average P of each sub-piece respectively Ij, and calculate symmetrical luminance deviation respectively
&dtri; p i , j = | P i , j - P i , 9 - j | I=1...8 wherein, j=1...4
Add up maximum symmetric deviations, symmetric deviations average and variance respectively
Maximum deviation &delta; 2 = 1 - max &dtri; P i , j 255
Average m = &Sigma; i = 1 8 &Sigma; j = 1 4 &dtri; P i , j 32
Variance s = ( &Sigma; i = 1 8 &Sigma; j = 1 4 ( &dtri; P i , j - m ) 2 32 ) 1 2 ,
Utilize the face area symmetry, detect the homogeneity of exposure respectively by maximum symmetric deviations, average and variance, wherein maximum deviation δ 2The reflection partial exposure excessively causes image detail to be lost.
3. quality estimation method of exit-entry digital portrait photos according to claim 1 and 2 is characterized in that, wherein said step 2) the execution following steps:
(1) contrast evaluation is used to detect each pixel diffusion on every side:
A) oriented face area is scaled the identical standard face of area;
B) the standard face is transformed to gray level image from coloured image;
C) define the contrast of each pixel:
c(i,j)=|f(i,j)-f(i-1,j)|+|f(i,j)-f(i+1,j)|+|f(i,j)-f(i-1,j-1)|+|f(i,j)-f(i-1,j)|+
|f(i,j)-f(i-1,j+1)|+|f(i,j)-f(i+1,j-1)|+|f(i,j)-f(i+1,j)|+|f(i,j)-f(i+1,j+1)|
C) lower limit and the upper limit of setting contrast threshold are used for getting rid of respectively non-marginal information and interference of noise, preserving edge information:
c &prime; ( i , j ) = 0 c ( i , j ) &le; c 1 c ( i , j ) c 1 &le; c ( i , j ) &le; c 2 0 c ( i , j ) &GreaterEqual; c 2
The average contrast of edge calculation information and variance;
D) process decision chart similarly is not clear: if the contrast average is bigger, variance is bigger, then is picture rich in detail; If contrast is less, and variance is less, then is blurred picture;
(2) blur level evaluation, determine the blur level of image with the Robert gradient under the different dynamic thresholds:
A) with the standard face long-pending be that the coloured image of the human face region of 28960 pixels is transformed to gray level image;
B) define the Robert gradient of each pixel:
g ( x , y ) = [ ( f ( x , y ) - f ( x + 1 , y + 1 ) ) 2 + ( f ( x + 1 , y ) - f ( x , y + 1 ) ) 2 ] 1 2 ;
C) definition dynamic threshold c keeps initial value when Grad surpasses threshold value c, represent that this point is the edge, otherwise be changed to 0:
g ( x , y ) = 0 g ( x , y ) < c g ( x , y ) g ( x , y ) &GreaterEqual; c
D) statistics edge gradient histogram, and carry out normalization:
hist(i)=count(g(x,y)=i)
p ( i ) = hist ( i ) &Sigma; i = 1 255 hist ( i )
The i value is 1 in the formula ... 255, (x y) represents all marginal points to g;
E) blur level of calculating and definite image:
blur = &Sigma; i = 1 T p ( i )
Wherein T is an empirical value, and the values of ambiguity of image is at 0 to 1, and values of ambiguity is big more, and image is fuzzy more.
4. quality estimation method of exit-entry digital portrait photos according to claim 3 is characterized in that, wherein said step 3) is carried out following steps:
In the Lab color space, to red progressively transition a value representation, to Huang transition b value representation progressively, calculate a average and the b average of each image face area respectively by green, and draw the areal map of a, b at two-dimensional space by indigo plant, judge then: if
( a - 7.5 ) 2 7.5 2 + ( b - 5 ) 2 10 2 > 1
It then is the defective image of color.
5. quality estimation method of exit-entry digital portrait photos according to claim 4, it is characterized in that, wherein said digital portrait photograph form size and file size detect carries out following steps: computing machine reads the Digital Image Data and the attribute of input, the size that comprises the width of form, image of image and height, file, judge that the form that the whether satisfied professional standard of entering and leaving the border is an image is JPG, picture traverse is 354 pixels, highly be 472 pixels, the file size scope is 18-25KB.
6. quality estimation method of exit-entry digital portrait photos according to claim 5, it is characterized in that, wherein said people's face detects and eye location is carried out following steps: at first adopt the recognition of face field in detection of people's face and feature location technology, find the position of human face region and glasses from digital photo, human face region comprises the zone between forehead, chin and the left and right sides auricle; The human eye location comprises the position of locating pupil center; Do not comprise people's face in the image and maybe can't navigate to eyes if detect, determine that then image does not comprise people's face or picture quality is relatively poor.
7. quality estimation method of exit-entry digital portrait photos according to claim 6 is characterized in that, wherein said portrait horizontal center detects carries out following steps:
1) position of eyes in the definition image, the width of establishing image is W, highly is H, left eye is (X apart from position, the image upper left corner L, Y L), right eye is (X apart from the image upper left corner R, Y R):
d1=|X L+X R-W|×0.5
d2=|Y L+Y R|×0.5
d3=|X R-X L|
angle=atan(|Y L-Y R|/d3)
Wherein, d1 represents the distance of portrait off-set from horizontal centerline, and d2 represents the position distance of eye areas apart from image top, and d3 represents two oculocentric distances, the anglec of rotation of Angle presentation video;
2) judge:
When d1 surpassed 0.03 times of picture traverse, image was not placed in the middle;
In certificate photo, the distance that d2 is suitable is between the 0.3H to 0.5H;
The scope of d3 is W/4 to W/3;
Deflection angle is no more than 3 degree.
8. quality estimation method of exit-entry digital portrait photos according to claim 7, it is characterized in that, wherein said background detects carries out following steps: at first use the Sobel operator to obtain gradient map to original image, on gradient map, carry out binaryzation preserving edge information, use seed fill algorithm to obtain the background area then, use the background area from former figure, to propose background image at last as blindage.
CN2008102279269A 2008-12-01 2008-12-01 Quality estimation method of exit-entry digital portrait photos Expired - Fee Related CN101609500B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN2008102279269A CN101609500B (en) 2008-12-01 2008-12-01 Quality estimation method of exit-entry digital portrait photos

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN2008102279269A CN101609500B (en) 2008-12-01 2008-12-01 Quality estimation method of exit-entry digital portrait photos

Publications (2)

Publication Number Publication Date
CN101609500A true CN101609500A (en) 2009-12-23
CN101609500B CN101609500B (en) 2012-07-25

Family

ID=41483252

Family Applications (1)

Application Number Title Priority Date Filing Date
CN2008102279269A Expired - Fee Related CN101609500B (en) 2008-12-01 2008-12-01 Quality estimation method of exit-entry digital portrait photos

Country Status (1)

Country Link
CN (1) CN101609500B (en)

Cited By (27)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102063659A (en) * 2010-12-28 2011-05-18 广州商景网络科技有限公司 Method, server and system for collecting and making electronic photo
CN102063660A (en) * 2010-12-28 2011-05-18 广州商景网络科技有限公司 Acquisition method for electronic photograph, client, server and system
CN102137271A (en) * 2010-11-04 2011-07-27 华为软件技术有限公司 Method and device for evaluating image quality
CN102622741A (en) * 2011-01-30 2012-08-01 联想(北京)有限公司 Method for detecting image file and apparatus thereof
CN102867179A (en) * 2012-08-29 2013-01-09 广东铂亚信息技术股份有限公司 Method for detecting acquisition quality of digital certificate photo
CN103415869A (en) * 2010-12-13 2013-11-27 巴黎狄德罗大学(巴黎七大) Method of detecting and quantifying blur in a digital image
CN103455994A (en) * 2012-05-28 2013-12-18 佳能株式会社 Method and equipment for determining image blurriness
CN103927753A (en) * 2014-04-21 2014-07-16 中国人民解放军国防科学技术大学 Image absolute ambiguity estimation method based on multi-scale reorganized DCT coefficients
CN103988207A (en) * 2011-12-14 2014-08-13 英特尔公司 Techniques for skin tone activation
CN105120167A (en) * 2015-08-31 2015-12-02 广州市幸福网络技术有限公司 Certificate picture camera and certificate picture photographing method
CN105139404A (en) * 2015-08-31 2015-12-09 广州市幸福网络技术有限公司 Identification camera capable of detecting photographing quality and photographing quality detecting method
CN105654451A (en) * 2014-11-10 2016-06-08 中兴通讯股份有限公司 Image processing method and device
CN105915791A (en) * 2016-05-03 2016-08-31 广东欧珀移动通信有限公司 Electronic device control method and device, and electronic device
CN106446851A (en) * 2016-09-30 2017-02-22 厦门大图智能科技有限公司 Visible light based human face optimal selection method and system
CN106874306A (en) * 2015-12-14 2017-06-20 公安部户政管理研究中心 People information portrait Compare System Key Performance Indicator evaluating method
CN107169507A (en) * 2017-01-06 2017-09-15 华南理工大学 A kind of certificate photo exposure directions detection algorithm extracted based on grid search-engine
WO2018036276A1 (en) * 2016-08-22 2018-03-01 平安科技(深圳)有限公司 Image quality detection method, device, server and storage medium
CN107977648A (en) * 2017-12-20 2018-05-01 武汉大学 A kind of method of discrimination and system of the identity card clarity based on recognition of face
CN109146839A (en) * 2017-06-28 2019-01-04 东京威尔斯股份有限公司 Image processing method and defect detecting method
CN109215010A (en) * 2017-06-29 2019-01-15 沈阳新松机器人自动化股份有限公司 A kind of method and robot face identification system of picture quality judgement
CN109584198A (en) * 2017-09-26 2019-04-05 浙江宇视科技有限公司 A kind of quality of human face image evaluation method, device and computer readable storage medium
CN110363180A (en) * 2019-07-24 2019-10-22 厦门云上未来人工智能研究院有限公司 A kind of method and apparatus and equipment that statistics stranger's face repeats
CN110363753A (en) * 2019-07-11 2019-10-22 北京字节跳动网络技术有限公司 Image quality measure method, apparatus and electronic equipment
CN110603566A (en) * 2017-05-01 2019-12-20 兴和株式会社 Image analysis and evaluation method, computer program, and image analysis and evaluation device
CN110738656A (en) * 2019-10-28 2020-01-31 公安部交通管理科学研究所 Method for evaluating definition of certificate photos, storage medium and processor
CN111199527A (en) * 2020-01-04 2020-05-26 圣点世纪科技股份有限公司 Finger vein image noise detection method based on multi-direction self-adaptive threshold
WO2022199545A1 (en) * 2021-03-23 2022-09-29 腾讯科技(深圳)有限公司 Image processing method and apparatus, computer device, and storage medium

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104458597B (en) * 2014-12-03 2017-09-22 东莞市神州视觉科技有限公司 A kind of product colour detection method, device and system based on camera
CN105187721B (en) * 2015-08-31 2018-09-21 广州市幸福网络技术有限公司 A kind of the license camera and method of rapid extraction portrait feature

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1333370C (en) * 2003-06-18 2007-08-22 佳能株式会社 Image processing method and device
CN100375977C (en) * 2005-04-01 2008-03-19 上海银晨智能识别科技有限公司 Three-dimensional portrait imaging device and distinguishing method for three-dimensional human face

Cited By (43)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102137271A (en) * 2010-11-04 2011-07-27 华为软件技术有限公司 Method and device for evaluating image quality
CN103415869B (en) * 2010-12-13 2016-10-19 巴黎狄德罗大学(巴黎七大) Detection and the fuzzy method quantified in digital picture
CN103415869A (en) * 2010-12-13 2013-11-27 巴黎狄德罗大学(巴黎七大) Method of detecting and quantifying blur in a digital image
CN102063660A (en) * 2010-12-28 2011-05-18 广州商景网络科技有限公司 Acquisition method for electronic photograph, client, server and system
CN102063660B (en) * 2010-12-28 2012-09-05 广州商景网络科技有限公司 Acquisition method for electronic photograph, client, server and system
CN102063659B (en) * 2010-12-28 2012-09-05 广州商景网络科技有限公司 Method, server and system for collecting and making electronic photo
CN102063659A (en) * 2010-12-28 2011-05-18 广州商景网络科技有限公司 Method, server and system for collecting and making electronic photo
CN102622741B (en) * 2011-01-30 2015-04-29 联想(北京)有限公司 Method for detecting image file and apparatus thereof
CN102622741A (en) * 2011-01-30 2012-08-01 联想(北京)有限公司 Method for detecting image file and apparatus thereof
CN103988207A (en) * 2011-12-14 2014-08-13 英特尔公司 Techniques for skin tone activation
CN103455994A (en) * 2012-05-28 2013-12-18 佳能株式会社 Method and equipment for determining image blurriness
CN102867179A (en) * 2012-08-29 2013-01-09 广东铂亚信息技术股份有限公司 Method for detecting acquisition quality of digital certificate photo
CN103927753A (en) * 2014-04-21 2014-07-16 中国人民解放军国防科学技术大学 Image absolute ambiguity estimation method based on multi-scale reorganized DCT coefficients
CN103927753B (en) * 2014-04-21 2016-03-02 中国人民解放军国防科学技术大学 The absolute blur level method of estimation of a kind of image based on multiple dimensioned restructuring DCT coefficient
CN105654451A (en) * 2014-11-10 2016-06-08 中兴通讯股份有限公司 Image processing method and device
CN105120167A (en) * 2015-08-31 2015-12-02 广州市幸福网络技术有限公司 Certificate picture camera and certificate picture photographing method
CN105139404A (en) * 2015-08-31 2015-12-09 广州市幸福网络技术有限公司 Identification camera capable of detecting photographing quality and photographing quality detecting method
CN105120167B (en) * 2015-08-31 2018-11-06 广州市幸福网络技术有限公司 A kind of license camera and license image pickup method
CN105139404B (en) * 2015-08-31 2018-12-21 广州市幸福网络技术有限公司 A kind of the license camera and shooting quality detection method of detectable shooting quality
CN106874306A (en) * 2015-12-14 2017-06-20 公安部户政管理研究中心 People information portrait Compare System Key Performance Indicator evaluating method
CN106874306B (en) * 2015-12-14 2020-10-09 公安部户政管理研究中心 Method for evaluating key performance index of population information portrait comparison system
CN105915791A (en) * 2016-05-03 2016-08-31 广东欧珀移动通信有限公司 Electronic device control method and device, and electronic device
CN105915791B (en) * 2016-05-03 2019-02-05 Oppo广东移动通信有限公司 Electronic apparatus control method and device, electronic device
WO2018036276A1 (en) * 2016-08-22 2018-03-01 平安科技(深圳)有限公司 Image quality detection method, device, server and storage medium
CN106446851A (en) * 2016-09-30 2017-02-22 厦门大图智能科技有限公司 Visible light based human face optimal selection method and system
CN107169507A (en) * 2017-01-06 2017-09-15 华南理工大学 A kind of certificate photo exposure directions detection algorithm extracted based on grid search-engine
CN110603566B (en) * 2017-05-01 2023-10-20 兴和株式会社 Image analysis evaluation method, computer program, and image analysis evaluation device
CN110603566A (en) * 2017-05-01 2019-12-20 兴和株式会社 Image analysis and evaluation method, computer program, and image analysis and evaluation device
CN109146839A (en) * 2017-06-28 2019-01-04 东京威尔斯股份有限公司 Image processing method and defect detecting method
CN109146839B (en) * 2017-06-28 2022-03-08 东京威尔斯股份有限公司 Defect inspection method
CN109215010A (en) * 2017-06-29 2019-01-15 沈阳新松机器人自动化股份有限公司 A kind of method and robot face identification system of picture quality judgement
CN109215010B (en) * 2017-06-29 2021-08-31 沈阳新松机器人自动化股份有限公司 Image quality judgment method and robot face recognition system
CN109584198A (en) * 2017-09-26 2019-04-05 浙江宇视科技有限公司 A kind of quality of human face image evaluation method, device and computer readable storage medium
CN107977648A (en) * 2017-12-20 2018-05-01 武汉大学 A kind of method of discrimination and system of the identity card clarity based on recognition of face
CN107977648B (en) * 2017-12-20 2020-05-12 武汉大学 Identification card definition distinguishing method and system based on face recognition
CN110363753A (en) * 2019-07-11 2019-10-22 北京字节跳动网络技术有限公司 Image quality measure method, apparatus and electronic equipment
CN110363753B (en) * 2019-07-11 2021-06-22 北京字节跳动网络技术有限公司 Image quality evaluation method and device and electronic equipment
CN110363180A (en) * 2019-07-24 2019-10-22 厦门云上未来人工智能研究院有限公司 A kind of method and apparatus and equipment that statistics stranger's face repeats
CN110738656A (en) * 2019-10-28 2020-01-31 公安部交通管理科学研究所 Method for evaluating definition of certificate photos, storage medium and processor
CN110738656B (en) * 2019-10-28 2022-05-31 公安部交通管理科学研究所 Definition evaluation method of certificate photo, storage medium and processor
CN111199527B (en) * 2020-01-04 2021-02-02 圣点世纪科技股份有限公司 Finger vein image noise detection method based on multi-direction self-adaptive threshold
CN111199527A (en) * 2020-01-04 2020-05-26 圣点世纪科技股份有限公司 Finger vein image noise detection method based on multi-direction self-adaptive threshold
WO2022199545A1 (en) * 2021-03-23 2022-09-29 腾讯科技(深圳)有限公司 Image processing method and apparatus, computer device, and storage medium

Also Published As

Publication number Publication date
CN101609500B (en) 2012-07-25

Similar Documents

Publication Publication Date Title
CN101609500B (en) Quality estimation method of exit-entry digital portrait photos
CN108038456B (en) Anti-deception method in face recognition system
CN104834898B (en) A kind of quality classification method of personage&#39;s photographs
CN105046246B (en) It can carry out the license camera and portrait pose detection method of the shooting prompt of portrait posture
US10255484B2 (en) Method and system for assessing facial skin health from a mobile selfie image
US7715596B2 (en) Method for controlling photographs of people
CN109952594B (en) Image processing method, device, terminal and storage medium
CN105139404B (en) A kind of the license camera and shooting quality detection method of detectable shooting quality
CN107862299A (en) A kind of living body faces detection method based on near-infrared Yu visible ray binocular camera
CN101390128B (en) Detecting method and detecting system for positions of face parts
CN104036278B (en) The extracting method of face algorithm standard rules face image
CN106778518A (en) A kind of human face in-vivo detection method and device
US20050117802A1 (en) Image processing method, apparatus, and program
US20100172578A1 (en) Detecting skin tone in images
CN109740572A (en) A kind of human face in-vivo detection method based on partial color textural characteristics
CN110210448B (en) Intelligent face skin aging degree identification and evaluation method
CN112528939A (en) Quality evaluation method and device for face image
CN111222433A (en) Automatic face auditing method, system, equipment and readable storage medium
KR20150001940A (en) An ATM capable of controlling the display interface using face recognition and the control method thereof
KR20080044611A (en) Face region detection device and correction method for photo printing
CN109741285A (en) A kind of construction method and system of underwater picture data set
JP4619762B2 (en) Image processing method, apparatus, and program
CN105809085B (en) Human-eye positioning method and device
WO2015125552A1 (en) Moisture sense evaluation device, moisture sense evaluation method, and moisture sense evaluation program
CN108416304A (en) A kind of three classification method for detecting human face using contextual information

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
C17 Cessation of patent right
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20120725

Termination date: 20121201