Summary of the invention
In view of this; The embodiment of the invention has proposed a kind of multi-angle face identification method and system, obtains image information through a plurality of angles, then image information is detected and gathers people's face picture wherein; And through recipient's face picture and it is carried out attitude differentiate; Select the front face picture, finally the front face picture in the collection period is extracted eigenwert, carry out people's face clustering processing and output; The people face collection of realization to being need not to cooperate by the acquisition target unaware, through the multi-angle collection to improve front face acquisition rate under the bigger situation of human face posture randomness.
For solving the problems of the technologies described above, the purpose of the embodiment of the invention realizes through following technical scheme:
A kind of multi-angle face identification method comprises:
Step 1, obtain image information through a plurality of angles;
Step 2, image information is detected and gathers people's face picture wherein;
Step 3, recipient's face picture also carry out attitude to it and differentiate, and select the front face picture;
Step 4, the front face picture in the collection period is extracted eigenwert, carry out people's face clustering processing and output.
Preferably, in the above-mentioned steps one, be the image information of obtaining a plurality of angles through many digital collection video cameras.
Preferably, the selection of above-mentioned digital collection video camera seat in the plane needs according to current face recognition algorithms characteristics, and promptly people from system face can be discerned the attitude scope: left rotation and right rotation [20 ° ,+20 °]; Last lower angle [15 ° ,+15 °], setting height(from bottom) is controlled in the 2700mm; Vertical angle is controlled in the luffing angle [15 ° ,+15 °], axis is installed along personnel's direct of travel; Horizontal sextant angle is no more than 20 degree, is controlled within human face posture left rotation and right rotation [20 °, the 20 °] scope.
Preferably, can gather left rotation and right rotation [60 ° ,+60 °] through 3 video cameras, rotate people's face within [25 ° ,+25 °] scope up and down, the collecting efficiency of every digital camera was 25 frame/seconds.
Preferably, in the above-mentioned steps two, be the video flowing that obtains pictorial information; And video flowing is carried out the frame picture reduce; Restore every video camera per second 25 frame pictures, in the frame picture, carry out people's face subsequently and detect, detect the people of point range intercepting according to pixels face picture and name behind people's face.
Preferably; In the above-mentioned steps two; Be video flowing to be carried out frame picture reduction detect, be pixel coverage intercepting people face picture to people's face of reaching the 100*120 pixel by the 150*250 of people's face center position, and name by the frame picture sequence numbers of image acquisition unit sequence number, collection period time, each collection period reduction acquisition with people's face; Picture size is about 50k, and per second can be gathered people's face picture of the about 3750k of output altogether.
Preferably, in the above-mentioned steps three, be that the people's face picture that receives is differentiated carrying out attitude from each image acquisition unit people's face picture of moment order at same frame together by the image file naming order, select the front face picture.
Preferably, in the above-mentioned steps four, be to extract the face characteristic value, and be that unit compares the face characteristic value in twos that comparison efficiency is about per second 100,000 times by collection period through algorithm.
Preferably, be that lineup's face picture that ratio reaches a predetermined threshold value is judged to be same people through similarity comparison, and choose in immediate two the people's face pictures of similarity ratio one and export as people's face cluster for the face characteristic value.
Preferably, the span of said predetermined threshold value is 60% to 100%.
A kind of multi-angle face identification system; Comprise image acquisition unit, people's face collecting unit, attitude judgement unit and people's face cluster and output unit, obtain image information, then image information is detected and gathers people's face picture wherein through a plurality of angles; And through recipient's face picture and it is carried out attitude differentiate; Select the front face picture, finally the front face picture in the collection period is extracted eigenwert, carry out people's face clustering processing and output.
Preferably, above-mentioned image acquisition unit is used for obtaining image information through a plurality of angles.
Preferably, above-mentioned people's face collecting unit is used for image information is detected and gather people's face picture wherein.
Preferably, above-mentioned attitude judgement unit is used for recipient's face picture and it is carried out attitude differentiate, and selects the front face picture.
Preferably, above-mentioned people's face cluster and output unit are used for the front face picture in the collection period is extracted eigenwert, carry out people's face clustering processing and output.
In sum; The invention provides a kind of multi-angle face identification method and system, obtain image information, then image information is detected and gathers people's face picture wherein through a plurality of angles; And through recipient's face picture and it is carried out attitude differentiate; Select the front face picture, finally the front face picture in the collection period is extracted eigenwert, carry out people's face clustering processing and output; The people face collection of realization to being need not to cooperate by the acquisition target unaware, through the multi-angle collection to improve front face acquisition rate under the bigger situation of human face posture randomness.
Embodiment
A kind of multi-angle face identification method and system that the embodiment of the invention provides; Obtain image information through a plurality of angles; Then image information is detected and gathers people's face picture wherein, and carry out the attitude differentiation, select the front face picture through recipient's face picture and to it; Finally the front face picture in the collection period is extracted eigenwert; Carry out people's face clustering processing and output, realize people's face collection being need not to cooperate by the acquisition target unaware, through the multi-angle collection to improve front face acquisition rate under the bigger situation of human face posture randomness.
For making the object of the invention, technical scheme and advantage clearer, the embodiment that develops simultaneously with reference to the accompanying drawings is to further explain of the present invention.
The embodiment of the invention provides a kind of multi-angle face identification method, and as shown in Figure 1, concrete steps comprise:
Step 1, obtain image information through a plurality of angles;
Particularly, in embodiments of the present invention, comprising a plurality of image acquisition units so that obtain image information from a plurality of angles, is the image information of obtaining a plurality of angles through many digital collection video cameras.In this programme, comprise image acquisition unit one, image acquisition unit two, image acquisition unit three and be the digital collection video camera, be used for multi-angle to obtain image its scheme of installation such as Fig. 2, shown in Figure 3.The selection of every video camera seat in the plane needs according to current face recognition algorithms characteristics, and promptly people from system face can be discerned the attitude scope: left rotation and right rotation [20 ° ,+20 °], last lower angle [15 ° ,+15 °].Setting height(from bottom) is controlled in the 2700mm, and vertical angle is controlled in the luffing angle [15 ° ,+15 °], axis is installed along personnel's direct of travel, and horizontal sextant angle is no more than 20 degree, is controlled within human face posture left rotation and right rotation [20 °, the 20 °] scope.Can gather left rotation and right rotation [60 ° ,+60 °] through 3 video cameras, up and down people's face within rotation [25 ° ,+25 °] scope.The collecting efficiency of every digital camera was 25 frame/seconds.
Further, in this programme, image acquisition unit one is a digital camera, and for people's face collecting unit provides image, its setting height(from bottom) is as shown in Figure 3, and collecting efficiency was 25 frame/seconds.Image acquisition unit two is a digital camera, and for people's face collecting unit provides image, its setting height(from bottom) is as shown in Figure 3, and collecting efficiency was 25 frame/seconds.Image acquisition unit three is a digital camera, and for people's face collecting unit provides image, its setting height(from bottom) is as shown in Figure 3, and collecting efficiency was 25 frame/seconds.Image acquisition unit is installed vertical view such as Fig. 2.
Step 2, image information is detected and gathers people's face picture wherein;
Particularly, in embodiments of the present invention, will detect and gather people's face picture wherein to the image information of obtaining through a plurality of angles.In this programme; At first will obtain the video flowing of each image acquisition unit output; Secondly video flowing is carried out the reduction of frame picture, restore every video camera per second 25 frame pictures, in the frame picture, carry out people's face subsequently and detect; The people of point range intercepting according to pixels face picture is also named after detecting people's face, and its method is following:
Collection period of define system is 1 second, gathers first to be T0, and next collection period is T1, by that analogy.
Definition image acquisition unit N people's face picture to be detected and intercepting in Tn moment P two field picture is R
NnP, the people's face picture that then is detected constantly at T0 is following:
For image acquisition unit one: R
101R
102R
103... R
1025
For image acquisition unit two: R
201R
202R
203... R
2025
For image acquisition unit three: R
301R
302R
303... R
3025
Further; In this programme, the people's face collecting unit that comprises at first obtains the video flowing of each image acquisition unit output, secondly video flowing is carried out the reduction of frame picture; Restore every video camera per second 25 frame pictures; In the frame picture, carry out people's face subsequently and detect, detect the people of point range intercepting according to pixels face picture and name behind people's face, and export to the attitude judgement unit.People's face collecting unit is a DSP microchip processor; Can obtain the video flowing of image acquisition unit in real time; Video flowing is carried out reduction of frame picture and the detection of people's face; Is pixel coverage intercepting people face picture to people's face of reaching the 100*120 pixel by the 150*250 of people's face center position, and names by the frame picture sequence numbers that image acquisition unit sequence number, collection period time, each collection period reduction obtain, and picture size is about 50k.Per second can be gathered people's face picture of the about 3750k of output altogether.
Step 3, recipient's face picture also carry out attitude to it and differentiate, and select the front face picture;
Particularly, in embodiments of the present invention, because people's face can only have one to be that unit carries out algorithm and differentiates towards, the people's face picture that therefore a certain moment is obtained by each image acquisition unit frame picture in a certain particular moment, and at R
101, R
201, R
301In determine a front face, by that analogy.
Further; It is DSP microchip processor that this programme comprises an attitude judgement unit; With people's face picture output of recipient's face collecting unit, differentiate carrying out attitude by the image file naming order from each image acquisition unit people's face picture of moment order at same frame together, select the front face picture.Attitude differentiation algorithm operational efficiency is about per second and differentiates 10,000 people's face pictures.Front face through identification and classification goes out is exported to people's face cluster cell.
Step 4, the front face picture in the collection period is extracted eigenwert, carry out people's face clustering processing and output.
Particularly, in embodiments of the present invention, will extract eigenwert to one group of front face of a certain collection period human face posture judgement unit output, and carry out the similarity comparison, the cluster that similarity ratio reaches a predetermined threshold value is people's face.In this programme; The front face that comprises a pair of T0 collection period of people's face cluster cell carries out cluster; The front face of two pairs of T1 collection period of people's face cluster cell carries out cluster; People's face cluster cell carries out cluster to the front face of T2 collection period again and again, and people's face cluster cell two carries out cluster to the front face of T3 collection period again, by that analogy.Because the time that people's face occurs before acquisition camera in the reality was greater than 1 second collection period; And, through being people's face of many different people after the cluster, therefore; The front face that people's face cluster cell one cluster is accomplished also need carry out the secondary cluster with the front face that next collection period cluster is accomplished; Promptly give people's face cluster cell two cluster once more, reciprocal successively, the same front face of each collection period can be come to light; And to front face output of the final formation of different objects, the span of said predetermined threshold value is 60% to 100%.。
Further, in this programme, the people's face cluster cell that comprises is an application server, extracts the face characteristic value through algorithm, and is that unit compares the face characteristic value in twos by collection period, and comparison efficiency is about per second 100,000 times.Through similarity comparison, lineup's face picture that ratio reaches a predetermined threshold value is judged to be same people, and choose in immediate two the people's face pictures of similarity ratio one and export as people's face cluster for the face characteristic value.The output of people's face cluster cell one is as an importation of people's face cluster cell two; Participate in people's face cluster of next collection period; People's face cluster cell one and back and forth exchange input and output of people's face cluster cell two; No longer close with other people face eigenwert until this face characteristic value, promptly ratio is exported this people's face picture and eigenwert less than 0.6.Can concentrate cluster to M collection period according to actual conditions setup parameter M during practical application, running efficiency of system is provided.In this programme, the front face output form of output unit is picture and this picture characteristic of correspondence value coding.
In addition, the embodiment of the invention also provides a kind of multi-angle face identification system.A kind of multi-angle face identification system synoptic diagram as shown in Figure 4, as to provide for the embodiment of the invention.
A kind of multi-angle face identification system comprises image acquisition unit 11, people's face collecting unit 22, attitude judgement unit 33 and people's face cluster and output unit 44.
Image acquisition unit 11 is used for obtaining image information through a plurality of angles;
Particularly, in embodiments of the present invention, comprise a plurality of image acquisition units so that obtain image information from a plurality of angles.In this programme, comprise image acquisition unit one, image acquisition unit two, image acquisition unit three and be the digital collection video camera, be used for multi-angle to obtain image its scheme of installation such as Fig. 2, shown in Figure 3.The selection of every video camera seat in the plane needs according to current face recognition algorithms characteristics, and promptly people from system face can be discerned the attitude scope: left rotation and right rotation [20 ° ,+20 °], last lower angle [15 ° ,+15 °].Setting height(from bottom) is controlled in the 2700mm, and vertical angle is controlled in the luffing angle [15 ° ,+15 °], axis is installed along personnel's direct of travel, and horizontal sextant angle is no more than 20 degree, is controlled within human face posture left rotation and right rotation [20 °, the 20 °] scope.Can gather left rotation and right rotation [60 ° ,+60 °] through 3 video cameras, up and down people's face within rotation [25 ° ,+25 °] scope.The collecting efficiency of every digital camera was 25 frame/seconds.
Further, in this programme, image acquisition unit one is a digital camera, and for people's face collecting unit provides image, its setting height(from bottom) is as shown in Figure 3, and collecting efficiency was 25 frame/seconds.Image acquisition unit two is a digital camera, and for people's face collecting unit provides image, its setting height(from bottom) is as shown in Figure 3, and collecting efficiency was 25 frame/seconds.Image acquisition unit three is a digital camera, and for people's face collecting unit provides image, its setting height(from bottom) is as shown in Figure 3, and collecting efficiency was 25 frame/seconds.Image acquisition unit is installed vertical view such as Fig. 2.
People's face collecting unit 22 is used for image information is detected and gather people's face picture wherein;
Particularly, in embodiments of the present invention, will detect and gather people's face picture wherein to the image information of obtaining through a plurality of angles.In this programme; At first will obtain the video flowing of each image acquisition unit output; Secondly video flowing is carried out the reduction of frame picture, restore every video camera per second 25 frame pictures, in the frame picture, carry out people's face subsequently and detect; The people of point range intercepting according to pixels face picture is also named after detecting people's face, and its method is following:
Collection period of define system is 1 second, gathers first to be T0, and next collection period is T1, by that analogy.
Definition image acquisition unit N people's face picture to be detected and intercepting in Tn moment P two field picture is R
NnP, the people's face picture that then is detected constantly at T0 is following:
For image acquisition unit one: R
101R
102R
103... R
1025
For image acquisition unit two: R
201R
202R
203... R
2025
For image acquisition unit three: R
301R
302R
303... R
3025
Further; In this programme, the people's face collecting unit that comprises at first obtains the video flowing of each image acquisition unit output, secondly video flowing is carried out the reduction of frame picture; Restore every video camera per second 25 frame pictures; In the frame picture, carry out people's face subsequently and detect, detect the people of point range intercepting according to pixels face picture and name behind people's face, and export to the attitude judgement unit.People's face collecting unit is a DSP microchip processor; Can obtain the video flowing of image acquisition unit in real time; Video flowing is carried out reduction of frame picture and the detection of people's face; Is pixel coverage intercepting people face picture to people's face of reaching the 100*120 pixel by the 150*250 of people's face center position, and names by the frame picture sequence numbers that image acquisition unit sequence number, collection period time, each collection period reduction obtain, and picture size is about 50k.Per second can be gathered people's face picture of the about 3750k of output altogether.
Attitude judgement unit 33 is used for recipient's face picture and it is carried out the attitude differentiation, selects the front face picture;
Particularly, in embodiments of the present invention, because people's face can only have one to be that unit carries out algorithm and differentiates towards, the people's face picture that therefore a certain moment is obtained by each image acquisition unit frame picture in a certain particular moment, and at R
101, R
201, R
301In determine a front face, by that analogy.
Further; It is DSP microchip processor that this programme comprises an attitude judgement unit; With people's face picture output of recipient's face collecting unit, differentiate carrying out attitude by the image file naming order from each image acquisition unit people's face picture of moment order at same frame together, select the front face picture.Attitude differentiation algorithm operational efficiency is about per second and differentiates 10,000 people's face pictures.Front face through identification and classification goes out is exported to people's face cluster cell.
People's face cluster and output unit 44 are used for the front face picture in the collection period is extracted eigenwert, carry out people's face clustering processing and output.
Particularly, in embodiments of the present invention, will extract eigenwert to one group of front face of a certain collection period human face posture judgement unit output, and carry out the similarity comparison, the cluster that similarity ratio reaches a predetermined threshold value is people's face.In this programme; The front face that comprises a pair of T0 collection period of people's face cluster cell carries out cluster; The front face of two pairs of T1 collection period of people's face cluster cell carries out cluster; People's face cluster cell carries out cluster to the front face of T2 collection period again and again, and people's face cluster cell two carries out cluster to the front face of T3 collection period again, by that analogy.Because the time that people's face occurs before acquisition camera in the reality was greater than 1 second collection period; And, through being people's face of many different people after the cluster, therefore; The front face that people's face cluster cell one cluster is accomplished also need carry out the secondary cluster with the front face that next collection period cluster is accomplished; Promptly give people's face cluster cell two cluster once more, reciprocal successively, the same front face of each collection period can be come to light; And to front face output of the final formation of different objects, the span of said predetermined threshold value is 60% to 100%.。
Further, in this programme, the people's face cluster cell that comprises is an application server, extracts the face characteristic value through algorithm, and is that unit compares the face characteristic value in twos by collection period, and comparison efficiency is about per second 100,000 times.Through similarity comparison, lineup's face picture that ratio reaches a predetermined threshold value is judged to be same people, and choose in immediate two the people's face pictures of similarity ratio one and export as people's face cluster for the face characteristic value.The output of people's face cluster cell one is as an importation of people's face cluster cell two; Participate in people's face cluster of next collection period; People's face cluster cell one and back and forth exchange input and output of people's face cluster cell two; No longer close with other people face eigenwert until this face characteristic value, promptly ratio is exported this people's face picture and eigenwert less than 0.6.Can concentrate cluster to M collection period according to actual conditions setup parameter M during practical application, running efficiency of system is provided.In this programme, the front face output form of output unit is picture and this picture characteristic of correspondence value coding.
Through the multi-angle face identification method and the system of this programme, can realize people's face collection to bigger human face posture scope, remedy the deficiency of current face recognition algorithms in practical application; Make people's face can gather the attitude scope and extend to [60 ° ,+60 °] by left rotation and right rotation [20 ° ,+20 °]; Rotating range is by [15 ° up and down; + 15 °] extend to [25 ° ,+25 °], improve the front face collecting efficiency.On the other hand, realized being need not collection of people's face and cluster under the mated condition by the acquisition target unaware.
One of ordinary skill in the art will appreciate that and realize that all or part of step that the foregoing description method is carried is to instruct relevant hardware to accomplish through program; Described program can be stored in a kind of computer-readable recording medium; This program comprises one of step or its combination of method embodiment when carrying out.
In addition, each functional unit in each embodiment of the present invention can be integrated in the processing module, also can be that the independent physics in each unit exists, and also can be integrated in the module two or more unit.Above-mentioned integrated module both can adopt the form of hardware to realize, also can adopt the form of software function module to realize.If said integrated module realizes with the form of software function module and during as independently production marketing or use, also can be stored in the computer read/write memory medium.
In sum; This paper provides a kind of multi-angle face identification method and system, obtains image information through a plurality of angles, then image information is detected and gathers people's face picture wherein; And through recipient's face picture and it is carried out attitude differentiate; Select the front face picture, finally the front face picture in the collection period is extracted eigenwert, carry out people's face clustering processing and output; The people face collection of realization to being need not to cooperate by the acquisition target unaware, through the multi-angle collection to improve front face acquisition rate under the bigger situation of human face posture randomness.
More than a kind of multi-angle face identification method provided by the present invention and system have been carried out detailed introduction; Used concrete example among this paper principle of the present invention and embodiment are set forth, the explanation of above embodiment just is used for helping to understand scheme of the present invention; Simultaneously, for one of ordinary skill in the art, according to thought of the present invention, the part that on embodiment and range of application, all can change, in sum, this description should not be construed as limitation of the present invention.