Summary of the invention
The technical matters that (one) will solve
The objective of the invention is to design a kind of remote iris image acquisition device, method and recognition system of automatic focusing, to increase the field depth of distant range iris image acquisition, improve the ease for use of iris recognition.
(2) technical scheme
For achieving the above object, the invention provides a kind of remote iris image acquisition device of automatic focusing.This device comprises following structure: iris camera, long focal length lens, focusing gear unit, lens converter, focusing electric rotating machine, electric-motor drive unit, calculation processing unit, wherein: iris camera, long focal length lens and lens converter are positioned on same axis, the focusing gear unit with focus that electric rotating machine is coaxial to be connected; The iris camera connects by lens converter with long focal length lens; The focusing ring that the focusing gear unit is connected with long focal length lens connects; Focusing electric rotating machine and electric-motor drive unit electrical connection; Calculation processing unit is connected with the electric-motor drive unit signal, controls the rotation of focusing electric rotating machine by electric-motor drive unit; Calculation processing unit is connected with the iris camera, processes the image from the iris camera.
For achieving the above object, the invention provides a kind of distant range iris image acquiring method of automatic focusing, comprise the steps:
Step P1: initialization apparatus, the rotation focusing ring makes the focusing ring focusing position to zero point, i.e. limit switch 11 places;
Step P2: the iris camera constantly gathers image, forms image sequence;
Step P3: the changing value of the sharpness of every two field picture and sharpness in the calculation processing unit sequence of computed images, difference execution in step P4 and step P5 in two threads;
Step P4: according to sharpness and the sharpness changing value of image, direction and the speed of the rotation of conversion focusing ring are returned to step P2; Described conversion is according to sharpness and sharpness changing value, and the automatic current system state of the remote iris image acquisition device of focusing, is decided by the system state switch condition of the remote iris image acquisition device of automatic focusing;
Step P5: change image over to and select thread, the sharpness of image and sharpness changing value in sequence of computed images, and judge whether to pick out by sharpness and the sharpness changing value of image the image that sharpness meets the demands, if the clear picture of selecting, execution in step P6, if that selects is not fogging clear, get back to step P2;
Step P6: carry out human eye detection and extract eye image from the picture rich in detail of picking out;
Step P7: eye image is carried out the quality judgement, judge whether to be used for iris recognition, if the judgement eye image can be used in iris recognition, iris recognition finishes, if the judgement eye image can not be used for iris recognition, continue to gather image, continue execution in step P5.
For achieving the above object, the invention provides a kind of full automatic distant range iris recognition system based on above apparatus and method, comprise following structure: far distance automatic focusing mechanism, remote infrared light supply, driving governor, light source controller, image pick-up card, computing machine, panel and rack, wherein: the focusing electric rotating machine of far distance automatic focusing mechanism is electrically connected on computing machine by driving governor; Iris camera on far distance automatic focusing mechanism is connected on computing machine by image pick-up card; The high-definition picture of iris camera collection is by on passing to; By computing machine calculate camera collection to the sharpness of realtime graphic, and according to the far distance automatic focusing mechanism of variation automatic rotating of sharpness, the focal position of search and tracking object; Remote infrared light supply is connected on computing machine by controller; Above equipment all is installed in rack, and far distance automatic focusing mechanism and remote infrared light supply are all installed towards the front, rack front plate placement.
(3) beneficial effect
The present invention combines the technology such as image processing, Electromechanical Control, computer vision and pattern-recognition, is applied to the iris recognition direction in living things feature recognition field.The present invention is carrying out iris image acquiring at a distance by the method for automatic focusing, improves iris image acquiring scope and picking rate, has improved the ease for use of iris recognition.
The scheme that the present invention adopts, the first, the redesign focusing mechanism makes it take iris image by focusing in larger scope, farther distance.The second, design is the focusing strategy better, can satisfy large-scale focus search, can satisfy high-precision focusing again, and follows the tracks of fast can work as focal variation the time.
Focusing mechanism has adopted exquisite mechanical hook-up, goes for multiple long focal length lens; Drive focusing ring with stepper motor, focusing range is large, slow-roll stabilization and fast; Adopt the strategy of the focusing of state-based conversion, can control focusing mechanism fast search and tracking focus position; Adopted the sharpness of image processing techniques judgement image and detected human eye, having obtained iris image.
Embodiment
Describe each related detailed problem in technical solution of the present invention in detail below in conjunction with accompanying drawing.Be to be noted that described embodiment only is intended to be convenient to the understanding of the present invention, and it is not played any restriction effect.
The remote iris image acquisition device of (one) automatically focusing
Structural design of the present invention such as Fig. 1 are comprised of following and part: iris camera 1, long focal length lens 2, focusing gear unit 3, lens converter 4, focusing electric rotating machine 5, electric-motor drive unit 6, calculation processing unit 7.
Iris camera 1 is connected with camera lens by lens converter 4 connections; Focusing gear unit 3 connects with focusing ring 21 and focusing electric rotating machine 5 on camera lens is connected; Focusing electric rotating machine 5 and electric-motor drive unit 6 electrical connections; Calculation processing unit 7 is connected signal and is connected with electric-motor drive unit, can control by electric-motor drive unit 6 rotation of focusing electric rotating machines 5; Calculation processing unit 7 is connected connection with the iris camera, process the image from camera 1.
The focal length value of long focal length lens 2 is that 100mm is to the arbitrary value between 500mm.Long focal length lens 2 can be connected connection by lens converter 4 with the iris camera.
Wherein, focusing gear unit 3 structural drawing such as Fig. 2.One cavity ring 31 and a jig 32 are arranged on described focusing gear unit 3, have the elasticity three-jaw jig 32, one jigs 32 are installed on a cavity ring 31 and between focusing ring 21, be used for blocking in a described cavity ring 31 and camera lens 2 and the focusing rings 21 of different sizes; Described focusing gear unit 3 also has a belt 33 and a limit switch 34, the be locked rotating shaft of cavity ring 31 and the focusing electric rotating machine 5 that is locked of a described belt 33, like this when 5 rotation of focusing electric rotating machine, also can drive cavity ring 31 rotations, focus thereby drive 21 pairs of camera lenses 2 of focusing ring; A described limit switch 34 will be run into when focusing ring 21 rotates to a position, and limit switch 34 sends a signal can make stepper motor 5 stop operating, and so just makes focusing gear unit 3 that an initial position has been arranged.
The distant range iris image acquiring method of (two) automatically focusing
Based on the remote iris image acquisition device of above automatic focusing, Atomatic focusing method process flow diagram such as Fig. 3 that we adopt: method has two threads, and the first thread is used for focusing, and the second thread is used for image and selects journey.The focusing of the first thread is made of following step:
Step P1: initialization apparatus, the rotation focusing ring makes focusing ring 21 focusing positions to zero point, i.e. limit switch 11 places;
Step P2: iris camera 1 constantly gathers image, forms image sequence;
Step P3: calculation processing unit 7 calculates the sharpness of every two field picture in the image sequence that collects by iris camera 1 and the changing value of sharpness, respectively execution in step P4 and step P5;
Step P4: according to sharpness and the sharpness changing value of image, direction and the speed of the rotation of conversion focusing ring are returned to step P2; Described conversion is according to sharpness and sharpness changing value, and whose current state, is decided by defined state transition condition.Automatically the state of the remote iris image acquisition device of focusing is divided into four kinds, stationary state, extensive search state, search condition and focus condition among a small circle.
Step P5: change image over to and select thread, image with sharpness and sharpness changing value is selected, constantly judge whether to pick out the image that sharpness meets the demands from image sequence, if the clear picture of selecting, execution in step P6, if that selects is not fogging clear, get back to step P2;
Step P6: carry out human eye detection and extract eye image from the picture rich in detail of picking out;
Step P7: eye image is carried out the quality judgement, judge whether to be used for iris recognition, if the judgement eye image can be used in iris recognition, iris recognition finishes, if the judgement eye image can not be used for iris recognition, continue to gather image, continue execution in step P5.
(1) computed image sharpness
In the said method flow process, the method for computed image sharpness is as follows:
Step P31: the image fritter of randomly drawing 100 20*20 on the image that gathers;
Step P32: to the edge energy of each image fritter computed image, the edge calculation energy approach is: asks at image fritter X, and the quadratic sum of the Grad of Y both direction, and the edge energy addition of having a few of image fritter, obtain edge energy;
Step P33: the edge energy value addition of 100 image fritters, and normalize to a numerical value between 0~1, described numerical value is the changing value of image definition.
Fig. 5 is that sharpness is along with the schematic diagram of the variable in distance of focusing.Fixedly the time, the point of sharpness maximum is at the focus place when object, and along with the distance of leaving the focal position, sharpness descends gradually, and the sharpness peak value is very sharp-pointed, can be used for judge whether sequence has the focus existence.Wherein, X-axis is distance, and Y-axis is sharpness, and Q is change curve, and P is the focal position, and D is for can identify field depth.
Fig. 6 is object when changing (in the situation that the people moves), the variation schematic diagram of the focal position of the long focal length lens 2 of iris camera 1.When the people moved to B from position A, the definition values of iris camera 1 different focus distance also was changed to curve QB from curve QA, and the focal position becomes PB from PA.So this device can realize when the people moves, device can trace into new focal position PB from original focal position PA fast.
(2) the focusing strategy of state-based conversion
In the said method flow process, according to sharpness and the sharpness changing value of image, the current system state of the remote iris image acquisition device of the direction of conversion focusing ring 21 rotations, speed and automatic focusing is decided by defined system state switch condition.System state is defined as stationary state S1, extensive search state S2, search condition S3 and focus condition S4 among a small circle.Switch condition between them is: C11, C12, C23, C34, C44, C43, C32, C21.System state and state transition condition are as shown in the focusing strategy schematic diagram of Fig. 4, wherein:
Stationary state S1: focusing ring 21 is in leads a position, transfixion.If satisfy state transition condition C11 (being that sharpness is lower than a threshold value T1), thinking does not have object to enter the visual field of iris camera, does not rotate focusing ring 21, and this moment, focusing ring 21 still remained static; If satisfy state transition condition C12 (being that sharpness is higher than threshold value T1), thinking has object to come into view, and system enters the extensive search state.
Extensive search state S2 is: rotation focusing ring 21 from 0 in the hunting zone of maximum step number quick rotation: the certain step number of every rotation gathers a two field picture, and calculates the value of sharpness, and records current location.If satisfy state transition condition C23 (namely when definition values greater than a threshold value T2, or definition values is when obvious peak value occurring), think to enter and to search among a small circle S3 near the focal position; If satisfy state transition condition C21 (if namely not finding the focal position), get back to null position S1.
Search condition S3 is among a small circle: near the focal position, rotate so that small step is long near the scope of focusing ring 21 focus: often rotate to an angle, gather a two field picture, and calculate the value of sharpness, and record current step-length position.If satisfy state transition condition C34 (namely when definition values greater than a threshold value T3, or definition values is when obvious peak value occurring), think to arrive the focal position, record this peak value, enter focus mode; If satisfy state transition condition C32 (if namely not finding the focal position), proceed extensive search S2.
Focus mode S4: focusing ring 21 stops at the focal position, calculates at set intervals sharpness changing value successively.If satisfy state transition condition C43 (namely work as sharpness and alter a great deal, or sharpness is less than a half of initial focus peak value), think that variation has occured focus, the new focus of search S3 among a small circle; Otherwise, if satisfy state transition condition C44 (being that sharpness changes a half that is not less than initial focus peak value), suspend a period of time, continue to calculate the sharpness changing value, state is constant.
Described threshold value T1, T2 and T3 obtain by experiment.When experiment, with the some pairs of camera collection (more than 500 width) image; Manual image is divided into four classes: there is no object, object is arranged but image blurring, image is more clear, image is very clear; Then calculate the value of each width image definition; The definition values of four class images is respectively normal distribution, utilizes bayes method to determine cut off value T1, T2 and T3 between three classes to be each above-mentioned threshold value.
(3) image selection method
In above-mentioned method flow, select clearly that image is used for carrying out iris recognition in focusing, wherein the concrete grammar of step P5 is:
Step P51: every collection 10 two field pictures, choose 1 two field picture of sharpness maximum from 10 two field pictures;
Step P52: if the sharpness of image is not processed less than a threshold value T3;
Step P53: if the sharpness of image more than or equal to threshold value T3, continues to process to this image.
Wherein, the concrete grammar of step P6 eye detection is:
At first, utilize by machine learning algorithm (Adaboostting) training generation based on Ha Er small echo (Haar) feature cascade sorter.In system's operational process of the remote iris image acquisition device of automatically focusing, the down-sampled high-definition picture that collects, and utilize feature cascade sorter to carry out eye detection on different scale.If eyes do not detected, do not process; If eyes detected, go out the image of the eyes part under original resolution at the high-definition picture up-sampling that collects, proceed to process.
(4) iris image quality judgement
Above-mentioned image clearly not necessarily can carry out iris recognition, so the present invention need to carry out the picture quality judgement again to eye image, the method for step P7 is as described in Figure 7:
Step P71: the high band component E1 that calculates original eye image; High fdrequency component E1 obtains by the following method: generate the operator of a 8*8,4*4 the point value at operator center is-3, and other value is+1; Operator with this 8*8 carries out filtering on image; Then that filtered all picture point additions are obtained and be defined as E1;
Step P72: down-sampled eye image is that eye image is dwindled one times;
Step P73: calculate the high band component E2 of down-sampled eye image, obtain the computing method of E2 with step P71;
Step P74: ask for the ENERGY E 1 of high band and than the ratio R of the ENERGY E 2 of low-frequency range;
Step P75: in conjunction with high band ENERGY E 1, the definition values C that obtains iris image quality is: C=α E1+ β R, and α, β are weighted operators, are drawn by experience;
If the definition values C that obtains does not process iris image less than a threshold value T4; Otherwise iris image is carried out pre-service, Iris Location, feature extraction and aspect ratio pair.
Application Example: full automatic distant range iris recognition system
According to above-mentioned focusing mechanism and focusing method, form a cover iris capturing instance system, as shown in Figure 8, wherein, described full automatic distant range iris recognition system is comprised of following part: far distance automatic focusing mechanism D1, remote infrared light supply D2, driving governor D3, light source controller D4, image pick-up card D5, computing machine D6, panel D7 and rack D8, and its connected mode is: the stepper motor of far distance automatic focusing mechanism D1 is electrically connected on computing machine D6 by driving governor D3; Iris camera 1 on far distance automatic focusing mechanism D1 is connected on computing machine D6 by image pick-up card D5, is connected on computing machine D6 by the USB line apart from the wide visual angle camera 7 of automatic focusing mechanism D1; Remote infrared light supply D2 is connected on computing machine D6 by controller D4; Above equipment all is installed to D8 in rack, and far distance automatic focusing mechanism D1 and remote infrared light supply D2 install towards the front.For attractive in appearance, rack D8 front plate placement D7, panel D7 can be the acrylic board with the cavity, also can be the glass of transmitted infrared light, reflect visible light.
Be the example that full automatic distant range iris recognition system shown in Figure 8 is shown as Fig. 9, this recognition system operation has following steps:
Step F 1: make the face area of iris camera 1 aligning people in far distance automatic focusing mechanism D1, and start iris camera 1 collection high-definition picture;
Step F 2: calculated the sharpness of the realtime graphic that collects by camera 1 by computing machine, and focusing mechanism D1 far distance automatic according to the variation automatic rotating of sharpness, the focal position of search and tracking object;
Step F 3: iris camera 1 is selected the most clearly image in image sequence, detects eye image, extracts the image of people's eye portion;
Step F 4: the judgement of eye image quality, select image the most clearly in the eye image sequence, be used for iris recognition.
In this example, because full automatic distant range iris recognition system of the present invention has adopted apart from automatic focusing mechanism, effective identification range of described full automatic distant range iris recognition system improves greatly.The people goes to the scope of 2.5~3.2 meters of rack precontracts, freezes, and this recognition system can be adjusted camera D1 position according to people's height automatically, carries out simultaneously the iris that the people is taken in focusing automatically.
The user can feel comfortable nature when using this full automatic distant range iris recognition system of the present invention, and do not worry the position not to and can not complete identification.On the other hand, for the user of the full automatic distant range iris recognition system of first use, can not complete because it there is no experience yet.
The above; only be the embodiment in the present invention; but protection scope of the present invention is not limited to this; anyly be familiar with the people of this technology in the disclosed technical scope of the present invention; can understand conversion or the replacement expected; all should be encompassed in of the present invention comprise scope within, therefore, protection scope of the present invention should be as the criterion with the protection domain of claims.