CN104091176A - Technology for applying figure and head portrait comparison to videos - Google Patents

Technology for applying figure and head portrait comparison to videos Download PDF

Info

Publication number
CN104091176A
CN104091176A CN201410343153.6A CN201410343153A CN104091176A CN 104091176 A CN104091176 A CN 104091176A CN 201410343153 A CN201410343153 A CN 201410343153A CN 104091176 A CN104091176 A CN 104091176A
Authority
CN
China
Prior art keywords
head portrait
target person
photo
face
sub
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201410343153.6A
Other languages
Chinese (zh)
Other versions
CN104091176B (en
Inventor
吴建忠
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangdong Dreamhunt Technology Co ltd
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Priority to CN201410343153.6A priority Critical patent/CN104091176B/en
Publication of CN104091176A publication Critical patent/CN104091176A/en
Application granted granted Critical
Publication of CN104091176B publication Critical patent/CN104091176B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Landscapes

  • Studio Devices (AREA)

Abstract

The invention discloses a technology for applying figure and head portrait comparison to videos. The technology is achieved through the following steps of firstly, obtaining the real-time video and extracting the photo of a target figure head portrait, obtaining all figure videos in a preset region in real time through a camera and extracting the real-time head portrait photo at the same time, and judging the real-time head portrait photo to be the photo of the target figure head portrait when the distance between the center points of the pupils of the two eyes of the figure in the real-time head portrait photo ranges from 10 pixels to 100 pixels and the vertical shooting angle between the camera and the head of the figure in the real-time head portrait photo ranges from 0 degree to 90 degrees; secondly, conducting figure and head portrait comparison. The technology for applying figure and head portrait comparison to videos is easy to operate, rapid in distinguishment and high in accuracy.

Description

Portrait is compared the application technology in video
Technical field
The present invention relates to portrait Determination field, particularly portrait and compare the application technology in video.
Background technology
Recognition of face is a popular computer technology research field, and it belongs to biometrics identification technology, is the biological characteristic of biosome (generally refering in particular to people) itself is distinguished to biosome individuality.The biological characteristic that biometrics identification technology is studied comprises face, fingerprint, palm line, iris, retina, sound (voice), the bodily form etc.This wherein, only having face characteristic is the most intuitively, the most reliably, the most accurately, utilizing face characteristic to carry out authentication is the most natural, the most direct means.Compare the identification of other human body biological characteristics, the just identity of verification object easily and effectively of the cooperation that face characteristic identification does not need object behavior, is difficult for being discovered, thus have good false proof, anti-swindle, directly, friendly, the feature such as conveniently.Through the research of decades, face recognition technology is applied in the fields such as security protection, gate inhibition, work attendance widely.
Recognition of face mainly comprises that the extraction, eigenwert of the eigenwert of the unique point of identification, the face of the unique point of location, picture pre-service, the face of face are than equity, wherein, it is a lot of that face is located the method that can realize, such as the method based on knowledge (Knowledge-based), feature invariant metering method (Feature invariant), wherein comparatively classical is the method (Template matching) etc. of adaboost method, template matches.Picture pre-service comprises the angular setting of face, proofread and correct and conventionally undertaken by following several theories for the angle of inclination perpendicular to photographic plane region: 1) (the document 1:Y.Li and X.Y.Lin of the method based on Garbor wavelet transformation, " Face hallucination with pose variation " in Pro.6th IEEE Int.Conf.Automatic Face and Gesture Recognition, 2004, pp.723 – 728); 2) (the document 2:K.Jia and S.G.Gong of the method based on tensor resolution, " Multi-modal tensor face for simultaneoussuper-resolution and recognition; " in Proc.IEEE Int.Conf.ComputerVision, 2005, pp.1683-1690; Document 3:K.Jia and S.G.Gong, " Generalizedfacesuper-resolution, " IEEETrans.ImageProcessing, vol.17, no.6, pp.873886, Ju is n.2008); 3) synthetic method (document 4: Chen Jia great, Lai Jianhuang, the Feng Guocan of the positive face of principles of construction of the corresponding algorithm of improved point and linear object class, " a kind of face posture is differentiated the new method synthetic with positive face ", Journal of Computer Research and Development, 2006), can reach the adjustment at comparison film angle of inclination by above-mentioned any method; The identification of human face characteristic point and extraction, as in Chinese patent application CN201310746593.1, have proposed the algorithm that a kind of new face characteristic value is extracted.Chinese patent application CN2008100003131.1 discloses a kind of method that face detects and follows the trail of, and above-mentioned technical development makes face recognition technology development rapidly, and application prospect is extensive.
According to incompletely statistics, China is just entering the epoch of flowing.2011, national floating population reached 2.3 hundred million people, accounted for 17% of total population, and in every 6 Chinese, just having 1 people is floating population.Following 20 years, also will there be 300,000,000 people in the countryside to enter cities and towns.Along with floating population rolls up, be faced with floating population's complex structure, personal information is opaque, floating population's quantity is huge,
The situations such as mobile personnel's difficult management, especially in mobile personnel, be mingled with punishment and disliking personnel, flee to escape, wait for an opportunity crime, more have after some of the staff's crime " bleaching identity " to slip into strange land and live on, how can effectively suppress and to find to obscure the emphasis personnel in huge floating population, become the important topic facing at present, bring challenges to social synthesis's management, make the main force of the departments such as public security organ as social public security safety management, responsibilities and obligations are with it heavier.
Along with the quickening of rapid development of economy and Development of China's Urbanization, urban population is increasingly intensive, and urban population quantity and mobility also increase greatly, strengthen significant to aspects such as social security, key area strick precaution, stability maintenances to the management of city personal information.In addition, social crime rate is the situation raising year by year in recent years, and high-tech crime and forged identity Information Crimes emerge in an endless stream, and the sudden, uncertain of criminal offence strengthens, and brings great difficulty to strick precaution and detection work.Recently, terrorist implements blast, the chopper terrorist activity such as hurt sb.'s feelings and takes place frequently.Anti-terrorism department is studying the countermeasure always, based on not having at present enough police strength to monitor; Even monitor in real time by people, still cannot be timely and effectively by event recognition out.Carry out the research of anti-terrorism picture control intelligent analysis system, will effectively prevent the generation of terrorist incident.The anti-terrorism picture control intelligent analysis system that conducts a research is extremely urgent.
Along with the increase of mobility of people, it is very crucial in video, analyzing timely and obtain people information, particularly along with the development of cloud computing and data communication technology, the storage of data and calculating are not limited only in local computer, large-scale computing machine constantly puts into operation, therefore develop a kind of calculated amount little, the portrait correlation technique that what accuracy rate was high realize by monitor video is to have very much market outlook.
Summary of the invention
The object of this invention is to provide portrait simple to operate, that resolution is rapid, accuracy rate is high and compare the application technology in video.
Technical scheme provided by the invention is:
Portrait is compared the application technology in video, comprises the following steps: step 1: obtain real-time video and extract target person head portrait photograph; All personage's videos by camera Real-time Obtaining predeterminable area also extract instant head portrait photo simultaneously, in the time that the distance of pupil center's point of two of personages in the instant head portrait photo shooting vertical angle that is personage's head in 10~100 pixels and described camera and this instant head portrait photo is 0~90 °, this instant head portrait photo is judged as YES to target person head portrait photograph; When the shooting vertical angle that wherein in instant head portrait photo, the distance of pupil center's point of two of personages is preferably personage's head in 60~90 pixels and described camera and this instant head portrait photo is preferably 30~70 °, this instant head portrait photo is judged as YES to target person head portrait photograph; Step 2: portrait comparison, send to server by extracting target person head portrait photograph in step 1, and by described server, this target person head portrait photograph and existing head portrait photo are carried out to similarity and compare, in the time that existence in existing head portrait photo meets the existing head portrait photo of default first threshold, judge that the personage in this target person head portrait photograph is same people with existing head portrait photo and exports corresponding people information, otherwise output is without corresponding personage's information.
Compare in the application technology in video at above-mentioned portrait, described step 1 specifically comprises following sub-step: sub-step 11: by camera testing environment light intensity, and in the time that described ambient light intensity is less than default Second Threshold, light filling; Sub-step 12: by all personage's videos of camera Real-time Obtaining predeterminable area, judge the personage's of containing in described video number; If the number of target person is single,, for single target person extraction target person head portrait photo, if the number of target person is multiple, extract respectively target person head portrait photo for each target person.
Compare in the application technology in video at above-mentioned portrait, the angle determination methods of taking vertical angle in described step 1 is: personage in instant head portrait photo is carried out to eyes location, and taking the center line of eyes of location as datum line, eyes are shone upon to eyes and judge the shooting vertical angle of personage's head in described camera and this instant head portrait photo in the upper and lower benchmark angle in face left and right.
Compare in the application technology in video at above-mentioned portrait, between described step 1 and step 2, also include shooting level angle determining step:
Shooting level angle determining step: whether the shooting level angle that judges personage's head in described camera and this instant head portrait photo is 0~90 °, if so, carry out step 2, if not, preserves the instant head portrait photo of this frame.
Compare in the application technology in video at above-mentioned portrait, after first cutting out step, the target person head portrait photograph that can enter step 2 to judgement in horizontal shooting angle determining step enters again step 2, wherein, described cut out step for: obtained target person head portrait photograph is cut out, make the face of described target person at least account for the target person head portrait photograph after described cutting out area 3/4.
Compare in the application technology in video at above-mentioned portrait, in step 2, described server by target person head portrait photograph be stored in existing head portrait photo in server and compare and specifically comprise following sub-step: sub-step 201: face location, from the background of target person head portrait photograph, isolate human face region; Sub-step 202: eyes location, the position of definite pupil of both eyes in the human face region obtaining from sub-step 201; Sub-step 203: adjustment of image, proofread and correct the angle of inclination of human face region, and according to the distance at the pupil of both eyes center described in the location positioning of determined pupil of both eyes in sub-step 202, and according to the ratio of the distance at the distance at pupil of both eyes center and default pupil of both eyes center, adjust the pixel of human face region; Sub-step 204: image pre-service, corrected human face region in sub-step 203 is carried out to pre-service, the exposure of color, face, face's light that specifically comprises face evenly, the processing of face's average color, the Gao Guang of face, blur level, brightness average, gray scale dynamic range, unevenness, overexposure ratio, under-exposure ratio, image sharpness, image blur; Sub-step 205: extract face characteristic cluster, the human face region obtaining is extracted to the face characteristic value that is no less than through sub-step 204, the set of the face characteristic value of described head portrait photo is the face characteristic cluster of head portrait photo; Sub-step 206: the face characteristic cluster of the existing head portrait photo of storing in the face characteristic cluster of described personage's head portrait photograph and server is compared, calculating meet the 3rd default threshold value the quantity of face characteristic value, and according to meet the 3rd default threshold value the quantity of face characteristic value obtain similarity; Sub-step 207: whether the described similarity of judgement meets first threshold, if so, extracts and export corresponding target person information.
Compare in the application technology in video at above-mentioned portrait, if the existing head portrait photo that meets first threshold obtaining in sub-step 207 is multiple, according to similarity corresponding to multiple existing head portrait photos, select the existing head portrait photo of similarity maximum and judge personage in this existing head portrait photo with the same people of personage in target person head portrait photograph and export corresponding people information.
Compare in the application technology in video at above-mentioned portrait, in described sub-step 207, if while exporting corresponding target person information, network condition variation cannot be transmitted, described corresponding target person information is stored in server, when after network conditions turn good, export corresponding target person information.
Compare in the application technology in video at above-mentioned portrait, in step 2, export corresponding people information to face sharing service platform.
Compare in the application technology in video at above-mentioned portrait, described corresponding people information comprises existing head portrait photo and the corresponding identity information of target person head portrait photograph, correspondence.
The present invention is by setting specific interpupillary distance, shooting angle and taking light, obtain satisfactory instant head portrait photo, and obtain fast result by portrait comparison technology, can effectively reduce data processing amount by above-mentioned processing, improve comparison accuracy, reduce the used time of comparison.
Cannot compare if server is busy, the target person head portrait photograph of extraction is sent to face sharing service platform, continue identification by face sharing service platform, improve recognition efficiency.
Brief description of the drawings
Fig. 1 is the flow diagram of the specific embodiment of the invention 1;
Fig. 2 is the flow diagram of the sub-step of the specific embodiment of the invention 1;
Fig. 3 is the flow diagram of the sub-step of the specific embodiment of the invention 1;
Fig. 4 is the flow diagram of the specific embodiment of the invention 1.
Embodiment
Below in conjunction with embodiment, technical scheme of the present invention is described in further detail, but does not form any limitation of the invention.
One of core idea of the present invention is, by setting specific interpupillary distance, shooting angle and taking light, obtain satisfactory instant head portrait photo, and obtain fast result by portrait comparison technology, can effectively reduce data processing amount by above-mentioned processing, improve comparison accuracy, reduce the used time of comparison.
Specific embodiment 1:
As shown in Figure 1, a kind of portrait is compared the application technology in video, comprises the following steps:
Step 1: obtain real-time video and extract target person head portrait photograph; All personage's videos by camera Real-time Obtaining predeterminable area also extract instant head portrait photo simultaneously, in the time that the distance of pupil center's point of two of personages in the instant head portrait photo shooting vertical angle that is personage's head in 10~100 pixels and described camera and this instant head portrait photo is 0~90 °, this instant head portrait photo is judged as YES to target person head portrait photograph; It should be noted that, in the present embodiment real-time video is not carried out to the operations such as image extraction, carry out the shooting of real-time video and capture target person head portrait photograph by camera, obtaining of target person head portrait photograph can be obtained also and can be undertaken by automatic capture machine by camera, is preferably and adopts same camera to carry out.Described camera sensing device parameter is: 1/2.5 inch of CMOS valid pixel: 3,000,000 lens interfaces: C/CS ultimate resolution: 1920 × 1200 minimal illuminations: 0.3Lux F1.4 frame per second: 1920 × 108029fps1600 × 120031fps, has improved the quantity of information of image greatly.It should be noted that, the target person described in the present embodiment is defined as all people that camera can photograph.Northeast, the Northwest (Xinjiang, Inner Mongol, the Heilungkiang) winter temperature of China can reach-40 degrees Celsius, outdoor maintenance is inconvenience very, stability requirement to system is high, camera adopts embedded design, all devices are selected technical grade device, the extreme weather conditions such as low temperature, high temperature can be successfully managed, the stable of system can be effectively ensured.Hardware circuits such as built-in " house dogs ", be equivalent to have people front end carry out 24 hours uninterruptedly on duty, the system that effectively ensured is long-term, stable, operation continuously.
As shown in Figure 2, described step 1 specifically comprises following sub-step:
Sub-step 11: by camera testing environment light intensity, in the time that described ambient light intensity is less than default Second Threshold, light filling; In the present embodiment, Second Threshold is brightness 500-1000lux; Lower than this threshold value, light filling, is that the industry is general certainly, and the mode of light filling is not restricted to by LED lamp light filling, can also, by increasing the light filling measures such as soft box, improve photoenvironment quality, with the video quality that ensures to gather.
Sub-step 12: by all personage's videos of camera Real-time Obtaining predeterminable area, judge the personage's of containing in described video number; If the number of target person is single, for single target personage extract real-time target person head portrait photo, if the number of target person is multiple, for each target person extract real-time target person head portrait photo respectively.
In actual applications, scheme about face tracking in video is very ripe, the present embodiment is according to Detection for Moving Target, human body and human face region are determined in the variation of the edge image by this frame and previous frame, determining after human face region, according to eyes on pre-set face apart from the universal rule of proportion, estimate the distance of pupil center's point of eyes, such as, default rule be the distance of pupil of both eyes central point account for face width 50%~65%, if the face width recording is now 100 pixels, the distance of the central point of the pupil of eyes is 50~65 pixels, can improve significantly by this method computing velocity.Certainly the present embodiment is not restricted to above-mentioned method, can also adopt in the art by the variation of previous frame and next frame picture, detect eigenwert the comparison of face in adjacent two frame pictures, be defined as determining eyes position and calculating eyes distance after same people.
In the time that the distance of pupil center's point of two of target persons is not 10~100 pixel, instant this frame head portrait photo is kept in server.Can certainly be kept in the SD card of camera.
When shooting level angle or take vertical angle while being not 0~90 °, instant this frame head portrait photo is kept in server.Can certainly be kept in the SD card of camera.
Judgement the present embodiment of taking vertical angle provides two kinds of concrete implementation methods:
Method 1: in sub-step 12, determine the center position of human face region according to definite human face region;
Determine the central point of camera
Determine shooting level angle and the shooting vertical angle of camera and people's head according to the center position of the central point of camera, zoom multiple, human face region.The zoom multiple in each moment is stored in camera, and server can extract the zoom multiple in any moment.
Method 2: personage in instant head portrait photo is carried out to eyes location, and taking the center line of eyes of location as datum line, eyes are shone upon to eyes and judge the shooting vertical angle of personage's head in described camera and this instant head portrait photo in the upper and lower benchmark angle in face left and right.
After sub-step 12, also comprise sub-step 13: shooting level angle determining step: whether the shooting level angle that judges personage's head in described camera and this instant head portrait photo is 0~90 °, if, carry out sub-step 14, if not, preserve the instant head portrait photo of this frame.
It is specially with the line of pupil of both eyes and horizontal angle and judges.
Sub-step 14: obtained target person head portrait photograph is cut out, make the face of described target person at least account for the target person head portrait photograph after described cutting out area 3/4.
Step 2: portrait comparison, send to server by extracting target person head portrait photograph in step 1, and by described server, this target person head portrait photograph and existing head portrait photo are carried out to similarity and compare, in the time that existence in existing head portrait photo meets the existing head portrait photo of default first threshold, judge that the personage in this target person head portrait photograph is same people with existing head portrait photo and exports corresponding people information, otherwise output is without corresponding personage's information.The existing head portrait photo of storing in book server can independently arrange according to user's needs, such as, if banking system, in server, storage has the people's of current right photo, photo size is 3Kb, when detecting not for having the people of current right, reports to the police, such as, if public security department stores wanted criminal's photo in server, such as, if education department stores the photo that in examination hall, examinee pre-deposits in server.In order to ensure to carry out timely recognition of face, reduce the data processing amount of server, the existing head portrait photo of storing in book server is preferable over and is less than 10,000.For the face photograph of different service types, support classification to build storehouse, support to build storehouse by rule classifications such as sex, region (as the place where his residence is registered, native place), age bracket, nationality, nationality, photographic qualities.
Build and in the process of storehouse, should be noted that following item:
(1) individual human face photo template size <3KB;
(2) storage rate >=99% of Certification of Second Generation or the similar photo of quality;
Under (3) 100 ten thousand storage capacity (the similar photo of Certification of Second Generation or quality) conditions, modeling time <3 days;
Under (4) 100 ten thousand storage capacity (the similar photo of Certification of Second Generation or quality) conditions, the full storehouse comparison of 1:N speed <1.5 second;
Under (5) 100 ten thousand storage capacity (the similar photo of Certification of Second Generation or quality) conditions, 1:N compares the first hit rate >90% in full storehouse; Front 100 select hit rate >96%;
Wherein, building storehouse importing has three kinds of modes to add, and is respectively that front-end camera, existing photo and I.D. shine.The human face photo that what at present discrimination was the highest is gathers by front-end camera, as blacklist, is secondly existing photo (picture that the photo of other video cameras or digital camera take etc.), is finally the China second-generation identity card photo in public security storehouse.
Annotation:
Comparison speed=comparison T.T./comparison total degree;
Front N selects hit rate=return in top n image and test pattern is number of times/comparison total degree * 100% of same person.
As shown in Figure 3, in described step 2, described server by target person head portrait photograph be stored in existing head portrait photo in server and compare and specifically comprise following sub-step:
Sub-step 201: face location, from the background of target person head portrait photograph, isolate human face region;
Sub-step 202: eyes location, the position of definite pupil of both eyes in the human face region obtaining from sub-step 201; Adopt the method for adaboost based on face characteristic can effectively determine the position of pupil of both eyes, in the prior art, several method has been developed in the location of human face characteristic point, does not describe in detail one by one at this, and above-mentioned concrete method is not restricted to the method for adaboost based on face characteristic.
In actual applications, because the computing power of existing mobile terminal is limited by the restriction of volume, chip development degree, there is a certain distance in its computing velocity and fixed computing machine, in order further to improve the arithmetic speed of this technology in mobile terminal, above-mentioned face location and eyes location adopt following method:
1) utilize and set threshold values automatically by human eye and face other parts and background separation or utilize human eye gray-scale value to carry out eyes location;
2) by gray level image being carried out after vertical and horizontal Gray Projection, tentatively fixed to face;
3), with the square frame search face of pupil size, when falling into black picture element number in frame and reaching maximum, the position of frame is eye position.
Sub-step 203: adjustment of image, proofread and correct the angle of inclination of human face region, and according to the distance at the pupil of both eyes center described in the location positioning of determined pupil of both eyes in sub-step 202, and according to the ratio of the distance at the distance at pupil of both eyes center and default pupil of both eyes center, adjust the pixel of human face region, in concrete application, the correction at the angle of inclination of human face region comprises two aspects, be photographic plane region angle of inclination correction and perpendicular to the correction at the angle of inclination in photographic plane region, angle of inclination correction for photographic plane region both can have been known the angle that needs correction by the calculating at the line angle of inclination at two through hole centers, the pixel of human face region is mainly adjusted according to the ratio of the distance at the distance at pupil of both eyes center and default pupil of both eyes center, the distance of the pupil of both eyes obtaining when taking pictures is 63 pixels, and the distance at default pupil of both eyes center is 65 pixels, the picture processing module of mobile terminal suitably increases according to the ratio of above-mentioned pixel.The adjustment of above-mentioned angle and pixel is all fine setting, both can obtain the desired result of this sub-step 33 by less calculated amount.
Sub-step 204: image pre-service, corrected human face region in sub-step 203 is carried out to pre-service, the exposure of color, face, face's light that specifically comprises face evenly, face's average color, the Gao Guang of face, blur level, brightness average, gray scale dynamic range, unevenness, overexposure ratio, under-exposure ratio, image sharpness, image blur, wear glasses, the processing of the face left and right sides, upper and lower deflection angle;
Sub-step 205: extract face characteristic cluster, the human face region obtaining is extracted to the face characteristic value that is no less than through sub-step 204, the set of the face characteristic value of described head portrait photo is the face characteristic cluster of head portrait photo.
Sub-step 206: the face characteristic cluster of the existing head portrait photo of storing in the face characteristic cluster of described personage's head portrait photograph and server is compared, calculating meet the 3rd default threshold value the quantity of face characteristic value, and according to meet the 3rd default threshold value the quantity of face characteristic value obtain similarity;
Sub-step 207: whether the described similarity of judgement meets first threshold, if so, extracts and export corresponding target person information to face sharing service platform sends a warning message to the object of setting simultaneously, such as supervisor, and police etc.; Face sharing service platform is the database server that each Department of Public Security of Shanxi Province sets up.It should be noted that, the target person information described in the present embodiment comprises target person head portrait photograph, corresponding existing head portrait photo and corresponding identity information.
If the existing head portrait photo that meets first threshold obtaining in sub-step 207 is multiple,, according to similarity corresponding to multiple existing head portrait photos, select the existing head portrait photo of similarity maximum and judge the same people of personage in personage and the target person head portrait photograph in this existing head portrait photo.
In sub-step 207, if while exporting corresponding target person information, network condition variation, is stored in described corresponding target person information in server, when after network conditions turn good, exports corresponding target person information.
In the present embodiment, operating personnel can also carry out consistency operation on face sharing service platform, carry out manual operation or intervention, are mainly artificial modelings, control to camera, gather the operations such as target person photograph by hand.
In the present embodiment, in the target person head portrait photograph of capturing when recording numbering, the shooting time of camera simultaneously and have multiple personage in shooting picture between each personage server also to different personages' numbering, if as long as want that follow-up staff the video of transferring this target person has target person head portrait photo can transfer smoothly video recording.Video recording is stored in the storage of camera, and regularly passes to server or face sharing service platform, regularly deletes cleaning data.
As shown in Figure 4, in the present embodiment, described step 1 cannot carry out step 2 if server is busy after finishing, and carries out:
Step 3: described target person head portrait photograph is sent to face sharing service platform by server, described face sharing service platform stores multiple existing head portrait photos, carry out face alignment by described face sharing service platform, find out and meet the existing head portrait photo of first threshold and judge the same people of personage in personage and the target person head portrait photograph in this existing head portrait photo.
Server must produce alarm message reminding user to the face photograph that can not complete recognition of face, and user's manual intervention entrance is provided, and can carry out manual face location modeling in client; Possess synchronous intervention and asynchronous intervention and select, can be by systematic parameter control; Can show and inquiry by the condition stub such as time point, type of service, again carry out manual modeling; Provide evaluation to not carrying out successfully modeling image, and improvement prompting is provided.
In step 2, face alignment has following points for attention specifically: (1) supports the functions such as the convergent-divergent, montage, compression of photo.Face photo files form is supported the main flow forms such as JPEG, BMP.
(2) face photographic quality measuring ability before comparison, before comparison must through the face number, two eye distances that comprising compressing file form to human face photo, size, size (pixel), blur level, color figure place, human face photo from, wear glasses, a detection such as light uniformity coefficient, the face left and right sides, upper and lower deflection angle.To ensure that photo to be compared all must meet recognition of face requirement.
(3) provide human face photo preprocessing function before the comparison of OCX or other control forms, as Fuzzy Quality optimization, correction etc.
(4) support single-sheet photo comparison and photograph comparison in batches.
(5) support many condition stubs, point storehouse comparison, the single or multiple conditions of inputting the face identity characteristic of photograph can realize comparison faster in classification.
(6) support according to priority to set up comparison personage, how tactful the support of personage's dispatching method is, and can carry out dynamic-configuration according to business need by user.
(7) after comparison photograph modeling comparison, template is saved in feature database automatically.
(8) comparison result comprises the information of photograph ID, similarity (mark) or other requirements etc., can be determined by parameter, according to sequence output; Comparison returns results size and is determined by parameter.
(9) mode such as comparison result supporting document and database mode is exported.Support comprises forms such as deriving WORD, EXCEL, TXT.
By setting specific interpupillary distance, shooting angle and taking light, obtain satisfactory instant head portrait photo, and obtain fast result by portrait comparison technology, can effectively reduce data processing amount by above-mentioned processing, improve comparison accuracy, reduce the used time of comparison.
By the present embodiment, while deploying to ensure effective monitoring and control of illegal activities list based on <=5 ten thousand, correct discrimination power >=75%; When deploy to ensure effective monitoring and control of illegal activities list based on <=10 ten thousand, correct discrimination power >=70%; When deploy to ensure effective monitoring and control of illegal activities list based on <=20 ten thousand, correct discrimination power >=65%; When deploy to ensure effective monitoring and control of illegal activities list based on >20 ten thousand, correct discrimination power >=60%; (do not comprise lean to one side, bow, face by partial occlusion);
When deploy to ensure effective monitoring and control of illegal activities list based on <=5 ten thousand, misidentification rate <=5 ‰; When deploy to ensure effective monitoring and control of illegal activities list based on <=10 ten thousand, misidentification rate <=1%; When deploy to ensure effective monitoring and control of illegal activities list based on <=20 ten thousand, misidentification rate <=3%; When deploy to ensure effective monitoring and control of illegal activities list based on >20 ten thousand, misidentification rate <=5%; (do not comprise lean to one side, bow, face by partial occlusion), alarm time <=3 second (relevant with network transfer speeds).
Above-described is only preferred embodiment of the present invention, all any amendments of doing within the scope of the spirit and principles in the present invention, is equal to and replaces and improvement etc., within all should being included in protection scope of the present invention.

Claims (10)

1. portrait is compared the application technology in video, it is characterized in that, comprises the following steps:
Step 1: obtain real-time video and extract target person head portrait photograph; All personage's videos by camera Real-time Obtaining predeterminable area also extract instant head portrait photo simultaneously, in the time that the distance of pupil center's point of two of personages in the instant head portrait photo shooting vertical angle that is personage's head in 10~100 pixels and described camera and this instant head portrait photo is 0~90 °, this instant head portrait photo is judged as YES to target person head portrait photograph;
Step 2: portrait comparison; Send to server by extracting target person head portrait photograph in step 1, and by described server, this target person head portrait photograph and existing head portrait photo are carried out to similarity and compare, in the time that existence in existing head portrait photo meets the existing head portrait photo of default first threshold, judge that the personage in this target person head portrait photograph is same people with existing head portrait photo and exports corresponding people information, otherwise output is without corresponding personage's information.
2. portrait according to claim 1 is compared the application technology in video, it is characterized in that, described step 1 specifically comprises following sub-step:
Sub-step 11: by camera testing environment light intensity, in the time that described ambient light intensity is less than default Second Threshold, light filling;
Sub-step 12: by all personage's videos of camera Real-time Obtaining predeterminable area, judge the personage's of containing in described video number; If the number of target person is single, for single target personage extract real-time target person head portrait photo, if the number of target person is multiple, for each target person extract real-time target person head portrait photo respectively.
3. portrait according to claim 1 is compared the application technology in video, it is characterized in that, the angle determination methods of taking vertical angle in described step 1 is: personage in instant head portrait photo is carried out to eyes location, and taking the center line of eyes of location as datum line, eyes are shone upon to eyes and be judged as the shooting vertical angle of personage's head in described camera and this instant head portrait photo in the upper and lower benchmark angle in face left and right.
4. portrait according to claim 1 is compared the application technology in video, it is characterized in that, also includes shooting level angle determining step between described step 1 and step 2:
Shooting level angle determining step: whether the shooting level angle that judges personage's head in described camera and this instant head portrait photo is 0~90 °, if so, carry out step 2, if not, preserves the instant head portrait photo of this frame.
5. portrait according to claim 4 is compared the application technology in video, it is characterized in that, after first cutting out step, the target person head portrait photograph that can enter step 2 to judgement in horizontal shooting angle determining step enters again step 2, wherein, described cut out step for: obtained target person head portrait photograph is cut out, make the face of described target person at least account for the target person head portrait photograph after described cutting out area 3/4.
6. portrait according to claim 5 is compared the application technology in video, it is characterized in that, in step 2, described server by target person head portrait photograph be stored in existing head portrait photo in server and compare and specifically comprise following sub-step:
Sub-step 201: face location, from the background of target person head portrait photograph, isolate human face region;
Sub-step 202: eyes location, the position of definite pupil of both eyes in the human face region obtaining from sub-step 201;
Sub-step 203: adjustment of image, proofread and correct the angle of inclination of human face region, and according to the distance at the pupil of both eyes center described in the location positioning of determined pupil of both eyes in sub-step 202, and according to the ratio of the distance at the distance at pupil of both eyes center and default pupil of both eyes center, adjust the pixel of human face region;
Sub-step 204: image pre-service, corrected human face region in sub-step 203 is carried out to pre-service, the exposure of color, face, face's light that specifically comprises face evenly, the processing of face's average color, the Gao Guang of face, blur level, brightness average, gray scale dynamic range, unevenness, overexposure ratio, under-exposure ratio, image sharpness, image blur;
Sub-step 205: extract face characteristic cluster, the human face region obtaining is extracted to the face characteristic value that is no less than through sub-step 204, the set of the face characteristic value of described head portrait photo is the face characteristic cluster of head portrait photo;
Sub-step 206: the face characteristic cluster of the existing head portrait photo of storing in the face characteristic cluster of described personage's head portrait photograph and server is compared, calculating meet the 3rd default threshold value the quantity of face characteristic value, and according to meet the 3rd default threshold value the quantity of face characteristic value obtain similarity;
Sub-step 207: whether the described similarity of judgement meets first threshold, if so, extracts and export corresponding target person information.
7. portrait according to claim 6 is compared the application technology in video, it is characterized in that, if the existing head portrait photo that meets first threshold obtaining in sub-step 207 is multiple,, according to similarity corresponding to multiple existing head portrait photos, select the existing head portrait photo of similarity maximum and judge that the personage in this existing head portrait photo is same people with the personage in target person head portrait photograph and exports corresponding people information.
8. portrait according to claim 7 is compared the application technology in video, it is characterized in that, in described sub-step 207, if while exporting corresponding target person information, network condition variation cannot be transmitted, described corresponding target person information is stored in server, when after network conditions turn good, exports corresponding target person information.
9. compare the application technology in video according to the arbitrary described portrait of claim 1~8, it is characterized in that, in step 2, export corresponding people information to face sharing service platform.
10. compare the application technology in video according to the arbitrary described portrait of claim 1~8, it is characterized in that, described corresponding people information comprises existing head portrait photo and the corresponding identity information of target person head portrait photograph, correspondence.
CN201410343153.6A 2014-07-18 2014-07-18 Portrait comparison application technology in video Expired - Fee Related CN104091176B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201410343153.6A CN104091176B (en) 2014-07-18 2014-07-18 Portrait comparison application technology in video

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201410343153.6A CN104091176B (en) 2014-07-18 2014-07-18 Portrait comparison application technology in video

Publications (2)

Publication Number Publication Date
CN104091176A true CN104091176A (en) 2014-10-08
CN104091176B CN104091176B (en) 2015-10-14

Family

ID=51638891

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201410343153.6A Expired - Fee Related CN104091176B (en) 2014-07-18 2014-07-18 Portrait comparison application technology in video

Country Status (1)

Country Link
CN (1) CN104091176B (en)

Cited By (23)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104574876A (en) * 2015-01-16 2015-04-29 移康智能科技(上海)有限公司 Monitoring management method and system based on monitoring system
CN104794458A (en) * 2015-05-07 2015-07-22 北京丰华联合科技有限公司 Fuzzy video person identifying method
CN104951773A (en) * 2015-07-12 2015-09-30 上海微桥电子科技有限公司 Real-time face recognizing and monitoring system
CN105022999A (en) * 2015-07-12 2015-11-04 上海微桥电子科技有限公司 Man code company real-time acquisition system
CN105046219A (en) * 2015-07-12 2015-11-11 上海微桥电子科技有限公司 Face identification system
CN105138954A (en) * 2015-07-12 2015-12-09 上海微桥电子科技有限公司 Image automatic screening, query and identification system
CN105187721A (en) * 2015-08-31 2015-12-23 广州市幸福网络技术有限公司 An identification camera and method for rapidly extracting portrait features
CN105357473A (en) * 2015-10-23 2016-02-24 苏州佳风网络科技有限公司 Video monitoring method
CN105809415A (en) * 2016-03-04 2016-07-27 腾讯科技(深圳)有限公司 Human face recognition based check-in system, method and device
CN106127106A (en) * 2016-06-13 2016-11-16 东软集团股份有限公司 Target person lookup method and device in video
CN106203393A (en) * 2016-07-22 2016-12-07 广东金杭科技股份有限公司 A kind of face collection and recognition method and the system realizing the method
CN106203234A (en) * 2015-04-30 2016-12-07 蔡汉宝 Object identifying and searching system and method
CN106803941A (en) * 2017-03-06 2017-06-06 深圳市博信诺达经贸咨询有限公司 The big data sort recommendations method and system of monitoring system
CN107134031A (en) * 2017-05-09 2017-09-05 厦门善基通信科技有限公司 The first card second method for early warning of lessee gate inhibition's IC-card
CN107704851A (en) * 2017-10-30 2018-02-16 歌尔股份有限公司 Character recognition method, Public Media exhibiting device, server and system
CN107944424A (en) * 2017-12-08 2018-04-20 广东金杭科技有限公司 Front end human image collecting and Multi-angle human are distributed as comparison method
CN108269333A (en) * 2018-01-08 2018-07-10 平安科技(深圳)有限公司 Face identification method, application server and computer readable storage medium
CN108399665A (en) * 2018-01-03 2018-08-14 平安科技(深圳)有限公司 Method for safety monitoring, device based on recognition of face and storage medium
CN109729280A (en) * 2018-12-28 2019-05-07 维沃移动通信有限公司 A kind of image processing method and mobile terminal
CN111489097A (en) * 2020-04-17 2020-08-04 云南电网有限责任公司电力科学研究院 Park people flow management and control system based on edge calculation
CN111985348A (en) * 2020-07-29 2020-11-24 深思考人工智能科技(上海)有限公司 Face recognition method and system
TWI783199B (en) * 2019-12-25 2022-11-11 亞旭電腦股份有限公司 Processing method of face recognition and electronic device
CN115512276A (en) * 2022-10-25 2022-12-23 湖南三湘银行股份有限公司 Video anti-counterfeiting identification method and system based on artificial intelligence

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108171219A (en) * 2018-01-30 2018-06-15 广州市君望机器人自动化有限公司 Face method is tracked by a kind of robot

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101751551A (en) * 2008-12-05 2010-06-23 比亚迪股份有限公司 Method, device, system and device for identifying face based on image
CN102201061A (en) * 2011-06-24 2011-09-28 常州锐驰电子科技有限公司 Intelligent safety monitoring system and method based on multilevel filtering face recognition
CN102298702A (en) * 2010-06-28 2011-12-28 北京中星微电子有限公司 Method and device for detecting body postures

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101751551A (en) * 2008-12-05 2010-06-23 比亚迪股份有限公司 Method, device, system and device for identifying face based on image
CN102298702A (en) * 2010-06-28 2011-12-28 北京中星微电子有限公司 Method and device for detecting body postures
CN102201061A (en) * 2011-06-24 2011-09-28 常州锐驰电子科技有限公司 Intelligent safety monitoring system and method based on multilevel filtering face recognition

Cited By (34)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104574876A (en) * 2015-01-16 2015-04-29 移康智能科技(上海)有限公司 Monitoring management method and system based on monitoring system
CN104574876B (en) * 2015-01-16 2017-06-16 移康智能科技(上海)股份有限公司 A kind of method for managing and monitoring and system based in monitoring system
CN106203234A (en) * 2015-04-30 2016-12-07 蔡汉宝 Object identifying and searching system and method
CN104794458A (en) * 2015-05-07 2015-07-22 北京丰华联合科技有限公司 Fuzzy video person identifying method
CN105022999B (en) * 2015-07-12 2019-06-04 上海微桥电子科技有限公司 A kind of adjoint real-time acquisition system of people's code
CN105138954A (en) * 2015-07-12 2015-12-09 上海微桥电子科技有限公司 Image automatic screening, query and identification system
CN105046219A (en) * 2015-07-12 2015-11-11 上海微桥电子科技有限公司 Face identification system
CN105138954B (en) * 2015-07-12 2019-06-04 上海微桥电子科技有限公司 A kind of image automatic screening inquiry identifying system
CN105022999A (en) * 2015-07-12 2015-11-04 上海微桥电子科技有限公司 Man code company real-time acquisition system
CN105046219B (en) * 2015-07-12 2018-12-18 上海微桥电子科技有限公司 A kind of face identification system
CN104951773A (en) * 2015-07-12 2015-09-30 上海微桥电子科技有限公司 Real-time face recognizing and monitoring system
CN104951773B (en) * 2015-07-12 2018-10-02 上海微桥电子科技有限公司 A kind of real-time face recognition monitoring system
CN105187721A (en) * 2015-08-31 2015-12-23 广州市幸福网络技术有限公司 An identification camera and method for rapidly extracting portrait features
CN105187721B (en) * 2015-08-31 2018-09-21 广州市幸福网络技术有限公司 A kind of the license camera and method of rapid extraction portrait feature
CN105357473A (en) * 2015-10-23 2016-02-24 苏州佳风网络科技有限公司 Video monitoring method
CN105809415A (en) * 2016-03-04 2016-07-27 腾讯科技(深圳)有限公司 Human face recognition based check-in system, method and device
US10664580B2 (en) 2016-03-04 2020-05-26 Tencent Technology (Shenzhen) Company Limited Sign-in system, method, apparatus and server based on facial recognition
CN105809415B (en) * 2016-03-04 2020-04-21 腾讯科技(深圳)有限公司 Check-in system, method and device based on face recognition
CN106127106A (en) * 2016-06-13 2016-11-16 东软集团股份有限公司 Target person lookup method and device in video
CN106203393A (en) * 2016-07-22 2016-12-07 广东金杭科技股份有限公司 A kind of face collection and recognition method and the system realizing the method
CN106803941A (en) * 2017-03-06 2017-06-06 深圳市博信诺达经贸咨询有限公司 The big data sort recommendations method and system of monitoring system
CN107134031A (en) * 2017-05-09 2017-09-05 厦门善基通信科技有限公司 The first card second method for early warning of lessee gate inhibition's IC-card
CN107704851A (en) * 2017-10-30 2018-02-16 歌尔股份有限公司 Character recognition method, Public Media exhibiting device, server and system
CN107704851B (en) * 2017-10-30 2021-01-15 歌尔股份有限公司 Character identification method, public media display device, server and system
CN107944424A (en) * 2017-12-08 2018-04-20 广东金杭科技有限公司 Front end human image collecting and Multi-angle human are distributed as comparison method
CN108399665A (en) * 2018-01-03 2018-08-14 平安科技(深圳)有限公司 Method for safety monitoring, device based on recognition of face and storage medium
CN108269333A (en) * 2018-01-08 2018-07-10 平安科技(深圳)有限公司 Face identification method, application server and computer readable storage medium
CN109729280A (en) * 2018-12-28 2019-05-07 维沃移动通信有限公司 A kind of image processing method and mobile terminal
TWI783199B (en) * 2019-12-25 2022-11-11 亞旭電腦股份有限公司 Processing method of face recognition and electronic device
CN111489097A (en) * 2020-04-17 2020-08-04 云南电网有限责任公司电力科学研究院 Park people flow management and control system based on edge calculation
CN111985348A (en) * 2020-07-29 2020-11-24 深思考人工智能科技(上海)有限公司 Face recognition method and system
CN111985348B (en) * 2020-07-29 2024-05-10 深思考人工智能科技(上海)有限公司 Face recognition method and system
CN115512276A (en) * 2022-10-25 2022-12-23 湖南三湘银行股份有限公司 Video anti-counterfeiting identification method and system based on artificial intelligence
CN115512276B (en) * 2022-10-25 2023-07-25 湖南三湘银行股份有限公司 Video anti-counterfeiting identification method and system based on artificial intelligence

Also Published As

Publication number Publication date
CN104091176B (en) 2015-10-14

Similar Documents

Publication Publication Date Title
CN104091176B (en) Portrait comparison application technology in video
CN109583342B (en) Human face living body detection method based on transfer learning
CN109711370B (en) Data fusion method based on WIFI detection and face clustering
CN104504408A (en) Human face identification comparing method and system for realizing the method
CN105138954B (en) A kind of image automatic screening inquiry identifying system
CN106203393A (en) A kind of face collection and recognition method and the system realizing the method
CN108009482A (en) One kind improves recognition of face efficiency method
CN109086739A (en) A kind of face identification method and system of no human face data training
CN107967458A (en) A kind of face identification method
CN105868689A (en) Cascaded convolutional neural network based human face occlusion detection method
CN104504362A (en) Face detection method based on convolutional neural network
CN105809178A (en) Population analyzing method based on human face attribute and device
CN109190475A (en) A kind of recognition of face network and pedestrian identify network cooperating training method again
CN105574509B (en) A kind of face identification system replay attack detection method and application based on illumination
CN104143086A (en) Application technology of portrait comparison to mobile terminal operating system
CN108932783A (en) A kind of access control system towards big flow scene based on two-dimension human face identification
CN107230267A (en) Intelligence In Baogang Kindergarten based on face recognition algorithms is registered method
CN105022999A (en) Man code company real-time acquisition system
WO2021217764A1 (en) Human face liveness detection method based on polarization imaging
CN104463232A (en) Density crowd counting method based on HOG characteristic and color histogram characteristic
CN107516076A (en) Portrait identification method and device
CN102880864A (en) Method for snap-shooting human face from streaming media file
US20230206688A1 (en) Information processing device, information processing method, and program
CN109637123A (en) A kind of complexity traffic environment downlink people living things feature recognition and traffic control system
CN110164007B (en) Access control system based on identity evidence and face image incidence relation

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
C41 Transfer of patent application or patent right or utility model
TR01 Transfer of patent right

Effective date of registration: 20160411

Address after: 510000 Guangdong city of Guangzhou province Panyu District Dashi street, Village Stone Road No. 13 403

Patentee after: Guangzhou Jia Qi Electronics Co.,Ltd.

Address before: 353000 Nanping city of Fujian Province Huang Dun Yanping District Jiangbin Road No. 51 Room 204

Patentee before: Wu Jianzhong

C41 Transfer of patent application or patent right or utility model
TR01 Transfer of patent right

Effective date of registration: 20160720

Address after: 510000 Guangdong city of Guangzhou province Panyu District Dashi street, Village Stone Road No. 13 Room 401

Patentee after: GUANGDONG DREAMHUNT TECHNOLOGY CO.,LTD.

Address before: 510000 Guangdong city of Guangzhou province Panyu District Dashi street, Village Stone Road No. 13 403

Patentee before: Guangzhou Jia Qi Electronics Co.,Ltd.

CF01 Termination of patent right due to non-payment of annual fee
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20151014