CN109426762B - Biological recognition system, method and biological recognition terminal - Google Patents
Biological recognition system, method and biological recognition terminal Download PDFInfo
- Publication number
- CN109426762B CN109426762B CN201710725269.XA CN201710725269A CN109426762B CN 109426762 B CN109426762 B CN 109426762B CN 201710725269 A CN201710725269 A CN 201710725269A CN 109426762 B CN109426762 B CN 109426762B
- Authority
- CN
- China
- Prior art keywords
- image information
- biometric
- camera
- information
- component image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/161—Detection; Localisation; Normalisation
- G06V40/166—Detection; Localisation; Normalisation using acquisition arrangements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/168—Feature extraction; Face representation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/18—Eye characteristics, e.g. of the iris
- G06V40/19—Sensors therefor
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/18—Eye characteristics, e.g. of the iris
- G06V40/193—Preprocessing; Feature extraction
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/70—Circuitry for compensating brightness variation in the scene
- H04N23/74—Circuitry for compensating brightness variation in the scene by influencing the scene brightness using illuminating means
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/80—Camera processing pipelines; Components thereof
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Signal Processing (AREA)
- Ophthalmology & Optometry (AREA)
- Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
Abstract
The invention provides a biological identification system, a biological identification method and a biological identification terminal, wherein the method comprises the following steps: s1, performing light supplement processing according to the external illumination environment to obtain first image information and second image information carrying biological characteristic information; s2, acquiring first component image information for first biological recognition and second component image information for image synthesis and depth of field calculation based on the first image information; acquiring third component image information used for second biological identification and fourth component image information used for image synthesis and depth of field calculation based on the second image information; and S3, combining the first component image information and the third component image information to obtain a biological identification result, and obtaining two-dimensional image information or/and three-dimensional image information of the biological on the basis of the second component image information and the fourth component image information. The method can realize biological identification and perform two-dimensional/three-dimensional reconstruction display on the biological characteristic image.
Description
Technical Field
The present invention relates to the field of biometric identification and image processing technologies, and in particular, to a biometric identification system, a biometric identification method, and a biometric identification terminal.
Background
With the rapid development of economy, social networks are more complex, and the mobility of personnel is more frequent, so the requirement for identity security authentication of personnel is more urgent, and the authentication conditions are more severe. Among the numerous identification methods, the advantages of using the self biological characteristics of the human body to carry out identification are incomparable with other peripheral devices, and the safety and reliability of the method are widely accepted. In view of the characteristics of uniqueness and constancy of the iris in the life individual, one of the highly appreciated technologies in the biometric identification technology is provided. And due to the very low error recognition rate, the technology is more suitable for the field with high safety guarantee requirements. Based on the characteristics of human biological features, the biological feature recognition technology based on the aspects of human faces, palm prints, fingerprints, irises, veins, hand shapes, handwriting and the like is provided.
In one or more exemplary embodiments of the inventive concepts related to biometric devices, face recognition, retina recognition, eye print recognition, iris recognition, etc. have been applied, requiring a user to capture an image of a biometric feature of the user within an appropriate distance for biometric recognition, processing the image, and comparing the image with a pre-stored registered image. In a camera configured to capture a biological image of a user, only a single camera is usually used for capturing a biological image, and more biological features cannot be captured according to distance, so that information acquisition of the image is not easy to be used for evaluating the effectiveness of the biological features, and image information acquired by the single camera is either color or black and white, thereby affecting the user experience.
With the rise of smart phones, binocular cameras or multi-view cameras have gradually entered the lives of people, but they are generally only used for shooting life scenes, and are either low-illumination enhanced, or focused after shooting, or optically zoomed, and the like, so that the functions are not applied to image acquisition of biological features, and thus the requirements of biological recognition cannot be met.
With the continuous emergence of various intelligent terminals, images are taken as an important entrance, the use of the images is not limited to simple photographing storage and the like, but the use of the images is interactive with the vision of a user and interactive experience of nature, and a single camera is adopted to carry out the use experience with a single application scene, so that the visual effect cannot be really reflected, the experience requirements of the user cannot be met, and the interaction and the use cannot be expanded greatly.
Disclosure of Invention
The invention provides a biological recognition system, a biological recognition method and a biological recognition terminal, which overcome the problems or at least partially solve the problems, and solve the problems that in the prior art, the application scene is single, the visual effect cannot really respond, and the user experience requirements cannot be met.
According to an aspect of the present invention, there is provided a biometric method including:
s1, performing light supplement processing according to the external illumination environment to obtain first image information and second image information carrying biological characteristic information;
s2, acquiring first component image information for first biological recognition and second component image information for image synthesis and depth of field calculation based on the first image information; acquiring third component image information used for second biological identification and fourth component image information used for image synthesis and depth of field calculation based on the second image information;
and S3, combining the first component image information and the third component image information to obtain a biological identification result, and obtaining two-dimensional image information or/and three-dimensional image information of the biological on the basis of the second component image information and the fourth component image information.
Preferably, in step S1, the performing light supplement processing according to the external lighting environment specifically includes: and sensing the external illumination environment and selecting different image acquisition modes according to the illumination environment, wherein the different image acquisition modes comprise automatic exposure, automatic white balance and automatic light supplement.
Preferably, in step S1, the first image information is biometric image information acquired by infrared light, and the second image information is biometric image information acquired by visible light.
Preferably, in step S1, the first image information and the second image information are collected with the same, different or partially the same biometric characteristic.
Preferably, in step S1, the biometric features are one or more of retina, iris, eyeball, eye pattern, eye shape, mouth/tooth shape, face shape and vein features.
Preferably, in step S2, the first component image information is RGB component image information of the first image signal, the second component image information is luminance component image information of the first image signal, the third component image information is gray component image information of the second image signal, and the fourth component image information is luminance component image information of the second image signal.
Preferably, in step S3, the obtaining of the biometric result by combining the first component image information and the third component image information specifically includes:
acquiring first biological identification code information based on the first component image information, and acquiring second biological identification code information based on the third component image information;
and matching the first biological identification code information and the second biological identification code information with pre-stored biological characteristic data, and outputting a corresponding identification result according to the setting condition of biological identification.
Preferably, the recognition result is a recognition result of the first component image information or/and a recognition result of the third component image information.
Preferably, in step S3, the obtaining of the two-dimensional image information or/and the three-dimensional image information of the living being based on the second component image information and the fourth component image information specifically includes:
re-splicing and outputting a two-dimensional biological characteristic image based on the second component image information and the fourth component image information;
acquiring depth information of the biological features according to the second component image information and the fourth component image information;
a three-dimensional model of the living being is generated based on the two-dimensional biometric image and the depth information.
A biometric identification system comprises a camera unit and a camera processing unit;
the camera unit is used for performing light supplement processing according to an external illumination environment to obtain first image information and second image information carrying biological characteristic information;
the camera processing unit is used for acquiring first component image information used for first biological recognition and second component image information used for image synthesis and depth of field calculation based on the first image information; acquiring third component image information used for second biological identification and fourth component image information used for image synthesis and depth of field calculation based on the second image information; and combining the first component image information and the third component image information to obtain a biological recognition result, and obtaining two-dimensional image information or/and three-dimensional image information of the living being based on the second component image information and the fourth component image information.
Preferably, the first image information and the second image information are collected with the same, different or partially the same biometric characteristic.
Preferably, the biometric features include one or more of retinal, iris, eyeball, eye print, eye shape, mouth/tooth shape, facial shape and vein features.
Preferably, the camera processing unit comprises a first image processing module and a second image processing module, and the first image processing module is used for receiving the external illumination environment information and adopting corresponding automatic white balance processing; and the second image processing module is used for receiving the external illumination environment information and adopting corresponding automatic white balance processing.
Preferably, the camera processing unit further comprises a first identification module and a second identification module, wherein the first identification module performs biometric feature extraction based on the first component image information and outputs first biometric code information; and the second identification module extracts biological characteristics based on the third component image information and outputs second biological identification code information.
Preferably, the camera processing unit further includes a determining module, where the determining module is configured to match the biometric encoding information with pre-stored biometric data, and output a corresponding recognition result according to a setting condition of biometric recognition, where the recognition result is a recognition result of the first biometric feature or/and a recognition result of the second biometric feature.
Preferably, the camera processing unit further includes an image synthesis module, and the image synthesis module is configured to perform re-stitching based on the second component image information and the fourth component image information and output a two-dimensional biometric image.
Preferably, the camera processing unit further includes a depth-of-field calculation module, and the depth-of-field calculation module is configured to perform re-stitching based on the second component image information and the fourth component image information and output depth-of-field information.
Preferably, the camera processing unit further comprises a three-dimensional image acquisition module, and the three-dimensional image acquisition module is used for generating a three-dimensional model of the living being based on the two-dimensional biological feature image and the depth information.
A biological identification terminal comprises a camera unit and a camera processing unit;
the camera unit comprises a first camera, a second camera, a first light-emitting device, a second light-emitting device and a light intensity sensor; the first camera and the second camera are respectively used for acquiring first image information and second image information carrying biological characteristic information; the light intensity sensor is used for sensing an external illumination environment, the first light-emitting device is used for supplementing light to the first camera according to the external illumination environment, and the second light-emitting device is used for supplementing light to the second camera according to the external illumination environment;
the camera processing unit is used for acquiring first component image information used for first biological recognition and second component image information used for image synthesis and depth of field calculation based on the first image information; acquiring third component image information used for second biological identification and fourth component image information used for image synthesis and depth of field calculation based on the second image information; and combining the first component image information and the third component image information to obtain a biological recognition result, and obtaining two-dimensional image information or/and three-dimensional image information of the living being based on the second component image information and the fourth component image information.
Preferably, the first camera is used for collecting the biological characteristic image of infrared rays, and the second camera is used for collecting the biological characteristic image of visible rays.
Preferably, the first camera is a narrow-angle lens or a wide-angle lens; the second camera is a narrow-angle lens or a wide-angle lens.
Preferably, the first camera comprises a first image sensor, a first optical filter and a first lens; the second camera comprises a second image sensor, a second optical filter and a second lens; the first image sensor and the second image sensor are mounted on a circuit board.
Preferably, the first camera is a fixed focus type or an automatic focus type camera; the second camera is a fixed focus type or an automatic focus type camera.
Preferably, the first light emitting device is configured to emit infrared light, and the second light emitting device is configured to emit visible light.
Preferably, the first light emitting device emits near infrared light of 700nm to 1000nm, and the second light emitting device emits visible light of 380nm to 780 nm.
Preferably, the first image information and the second image information are collected with the same, different or partially the same biometric characteristic.
Preferably, the biometric features include one or more of retinal, iris, eyeball, eye print, eye shape, mouth/tooth shape, facial shape and vein features.
Preferably, the camera processing unit comprises a first image processing module and a second image processing module, and the first image processing module is used for receiving the external illumination environment information and adopting corresponding automatic white balance processing; and the second image processing module is used for receiving the external illumination environment information and adopting corresponding automatic white balance processing.
Preferably, the camera processing unit further comprises a first identification module and a second identification module, wherein the first identification module performs biometric feature extraction based on the first component image information and outputs first biometric code information; and the second identification module extracts biological characteristics based on the third component image information and outputs second biological identification code information.
Preferably, the camera processing unit further includes a determining module, where the determining module is configured to match the biometric encoding information with pre-stored biometric data, and output a corresponding recognition result according to a setting condition of biometric recognition, where the recognition result is a recognition result of the first biometric feature or/and a recognition result of the second biometric feature.
Preferably, the camera processing unit further includes an image synthesis module, and the image synthesis module is configured to perform re-stitching based on the second component image information and the fourth component image information and output a two-dimensional biometric image.
Preferably, the camera processing unit further includes a depth-of-field calculation module, and the depth-of-field calculation module is configured to perform re-stitching based on the second component image information and the fourth component image information and output depth-of-field information.
Preferably, the camera processing unit further comprises a three-dimensional image acquisition module, and the three-dimensional image acquisition module is used for generating a three-dimensional model of the living being based on the two-dimensional biological feature image and the depth information.
The application provides a biological recognition system, a biological recognition method and a biological recognition terminal, wherein the illumination intensity of the external environment is detected in real time in the acquisition process, the camera is supplemented with light in the acquisition process, the infrared light and the visible light are acquired simultaneously for recognition processing, the corresponding components of the two image information are extracted for feature recognition and image reconstruction respectively, and the biological recognition can be realized, and meanwhile, the biological feature image is subjected to two-dimensional/three-dimensional reconstruction display.
Drawings
FIG. 1 is a flowchart of a biometric authentication method according to embodiment 1 of the present invention;
fig. 2 is a block diagram showing the construction of a biometric authentication system according to embodiment 2 of the present invention;
FIG. 3 is a biometric feature distribution map according to an embodiment of the present invention;
fig. 4 is a block diagram showing the construction of a biometric terminal according to embodiment 3 of the present invention;
fig. 5 is a block diagram of a camera unit according to embodiment 3 of the present invention;
fig. 6 is a schematic view of a basic structure of a camera unit according to embodiment 3 of the present invention;
FIG. 7 is a schematic diagram of a specific implementation structure of the camera unit according to FIG. 6;
FIG. 8 is a schematic diagram of another embodiment of the camera unit according to FIG. 6;
FIG. 9 is a schematic diagram of another embodiment of the camera unit according to FIG. 6;
fig. 10 is a block diagram of a control unit according to embodiment 3 of the present invention;
fig. 11 is a flowchart of the operation of a camera processing unit according to embodiment 3 of the present invention;
fig. 12 is a block diagram showing an external configuration of a biometrics identification terminal according to embodiment 3 of the invention;
fig. 13 is a schematic structural diagram of a camera unit according to embodiment 3 of the present invention.
Detailed Description
The following detailed description of embodiments of the present invention is provided in connection with the accompanying drawings and examples. The following examples are intended to illustrate the invention but are not intended to limit the scope of the invention.
Example 1
As shown in fig. 1, there is shown a biometric identification method comprising:
s1, performing light supplement processing according to the external illumination environment to obtain first image information and second image information carrying biological characteristic information;
s2, acquiring first component image information for first biological recognition and second component image information for image synthesis and depth of field calculation based on the first image information; acquiring third component image information used for second biological identification and fourth component image information used for image synthesis and depth of field calculation based on the second image information;
and S3, combining the first component image information and the third component image information to obtain a biological identification result, and obtaining two-dimensional image information or/and three-dimensional image information of the biological on the basis of the second component image information and the fourth component image information.
In this embodiment, in the step S1, the performing light supplement processing according to the external lighting environment specifically includes: and sensing the external illumination environment and selecting different image acquisition modes according to the illumination environment, wherein the different image acquisition modes comprise automatic exposure, automatic white balance and automatic light supplement.
In this embodiment, in step S1, the first image information is biometric image information acquired by infrared light, and the second image information is biometric image information acquired by visible light.
In this embodiment, in step S1, the biometric features of the first image information and the second image information are the same, different or partially the same.
In this embodiment, in step S1, as shown in fig. 3, the biometric features are one or more of retina, iris, eyeball, eye pattern, eye shape, mouth/tooth shape, face shape and vein features, and the corresponding features can be respectively selected to perform a: face recognition and B: and (4) eye identification. .
In this embodiment, in step S2, the first component image information is RGB component image information of the first image signal, the second component image information is luminance component image information of the first image signal, the third component image information is gray component image information of the second image signal, and the fourth component image information is luminance component image information of the second image signal.
In this embodiment, in step S3, the obtaining of the biometric result by combining the first component image information and the third component image information specifically includes:
acquiring first biological identification code information based on the first component image information, and acquiring second biological identification code information based on the third component image information;
and matching the first biological identification code information and the second biological identification code information with pre-stored biological characteristic data, and outputting a corresponding identification result according to the setting condition of biological identification.
In this embodiment, the recognition result is a recognition result of the first component image information or/and a recognition result of the third component image information.
In this embodiment, in step S3, obtaining two-dimensional image information or/and three-dimensional image information of the living being based on the second component image information and the fourth component image information specifically includes:
re-splicing and outputting a two-dimensional biological characteristic image based on the second component image information and the fourth component image information;
acquiring depth information of the biological features according to the second component image information and the fourth component image information;
a three-dimensional model of the living being is generated based on the two-dimensional biometric image and the depth information.
Example 2
Fig. 2 shows a biometric identification system comprising a camera unit and a camera processing unit;
the camera unit is used for performing light supplement processing according to an external illumination environment to obtain first image information and second image information carrying biological characteristic information;
the camera processing unit is used for acquiring first component image information used for first biological recognition and second component image information used for image synthesis and depth of field calculation based on the first image information; acquiring third component image information used for second biological identification and fourth component image information used for image synthesis and depth of field calculation based on the second image information; and combining the first component image information and the third component image information to obtain a biological recognition result, and obtaining two-dimensional image information or/and three-dimensional image information of the living being based on the second component image information and the fourth component image information.
In this embodiment, the first image information and the second image information are collected with the same, different or partially the same biometric characteristic.
In this embodiment, as shown in fig. 3, the biometric features include one or more of retina, iris, eyeball, eye pattern, eye shape, mouth/tooth shape, face shape and vein features, and the respective features may be selected as a: face recognition and B: and (4) eye identification.
In this embodiment, the camera processing unit includes a first image processing module and a second image processing module, where the first image processing module is configured to receive external illumination environment information and perform corresponding automatic white balance processing; and the second image processing module is used for receiving the external illumination environment information and adopting corresponding automatic white balance processing.
In this embodiment, the camera processing unit further includes a first recognition module and a second recognition module, where the first recognition module performs biometric feature extraction based on the first component image information and outputs first biometric encoding information; and the second identification module extracts biological characteristics based on the third component image information and outputs second biological identification code information.
In this embodiment, the camera processing unit further includes a determining module, where the determining module is configured to match the biometric encoding information with the pre-stored biometric data, and output a corresponding recognition result according to a setting condition of biometric recognition, where the recognition result may be a recognition result of the first biometric feature or/and a recognition result of the second biometric feature.
In this embodiment, the camera processing unit further includes an image synthesis module, and the image synthesis module is configured to perform re-stitching based on the second component image information and the fourth component image information and output a two-dimensional biometric image.
In this embodiment, the camera processing unit further includes a depth-of-field calculation module, where the depth-of-field calculation module is configured to perform re-stitching based on the second component image information and the fourth component image information and output depth-of-field information.
In this embodiment, the camera processing unit further includes a three-dimensional image obtaining module, and the three-dimensional image obtaining module is configured to generate a three-dimensional model of the living being based on the two-dimensional biometric image and the depth information.
Example 3
Fig. 4 shows a biometric terminal including a camera unit and a camera processing unit (i.e., a processor in the figure); and the display is used for storing data and displaying images.
As shown in fig. 5, the camera unit includes a first camera, a second camera, a first light emitting device and a second light emitting device, and a light intensity sensor; the first camera and the second camera are respectively used for acquiring first image information and second image information carrying biological characteristic information; the light intensity sensor is used for sensing an external illumination environment, the first light-emitting device is used for supplementing light to the first camera according to the external illumination environment, and the second light-emitting device is used for supplementing light to the second camera according to the external illumination environment; the light intensity sensor senses the external illumination intensity and provides a detected external illumination intensity value so as to be used for controlling the light supplement effect of the light-emitting device; the first light-emitting device and the first light-emitting device can adjust the illumination intensity according to the control condition of the illumination environment.
The camera processing unit is used for acquiring first component image information used for first biological recognition and second component image information used for image synthesis and depth of field calculation based on the first image information; acquiring third component image information used for second biological identification and fourth component image information used for image synthesis and depth of field calculation based on the second image information; and combining the first component image information and the third component image information to obtain a biological recognition result, and obtaining two-dimensional image information or/and three-dimensional image information of the living being based on the second component image information and the fourth component image information.
In this embodiment, the first camera is used for capturing a biometric image of infrared light, and the second camera is used for capturing a biometric image of visible light.
In this embodiment, the first camera is a narrow-angle lens or a wide-angle lens; the second camera is a narrow-angle lens or a wide-angle lens.
In this embodiment, the first camera is a fixed focus type or an automatic focus type camera; the second camera is a fixed focus type or an automatic focus type camera.
In this embodiment, as shown in fig. 6, the first camera includes a first image sensor, a first optical filter, and a first lens; the second camera comprises a second image sensor, a second optical filter and a second lens; the first image sensor and the second image sensor are mounted on a circuit board and connected through a bus.
When the first camera and the second camera are of a fixed focusing type, the light intensity sensor senses the external illumination intensity and transmits the infrared light to the first light-emitting device and the second light-emitting device through the bus, the first light-emitting device emits infrared light according to the external illumination intensity condition and projects the infrared light onto the biological characteristics, the first lens captures all light on the biological characteristics and transmits the light to the first optical filter, the first optical filter selects the infrared light to pass through and transmits the infrared light to the first image sensor, and the first image sensor photoelectrically converts the infrared light into an electric signal and transmits the electric signal to the bus; the second light emitting device emits visible light according to the external illumination intensity condition and projects the visible light onto the biological feature, the second lens captures all light on the biological feature and transmits the light to the second optical filter, the second optical filter selects the visible light to pass through and transmits the visible light to the second image sensor, and the second image sensor converts the visible light into an electric signal through photoelectricity and transmits the electric signal to the bus.
Further, as shown in fig. 7 and 8, when the first camera or/and the second camera is of an auto-focusing type of a voice coil motor, the light intensity sensor senses the external illumination intensity and transmits the external illumination intensity to the first light emitting device and the second light emitting device through a bus, the first light emitting device emits infrared light according to the external illumination intensity and projects the infrared light onto the biological feature, the first lens captures all light on the biological feature and transmits the light to the first optical filter, the first optical filter selects the infrared light to pass through and transmits the infrared light to the first image sensor, and the first image sensor photoelectrically converts the infrared light into an electrical signal and transmits the electrical signal to the bus; the second light-emitting device emits visible light rays according to the external illumination intensity condition and projects the visible light rays onto the biological characteristics, the second lens captures all light rays on the biological characteristics and transmits the light rays to the second optical filter, the second optical filter selects the visible light rays to pass through and transmits the visible light rays to the second image sensor, and the second image sensor photoelectrically converts the visible light rays into electric signals and transmits the electric signals to the bus; and when the first driving unit or/and the second driving unit receive the focusing control signal from the bus, the first actuator or/and the second actuator is controlled to carry out position driving, and finally, the image is clear.
Further, as shown in fig. 9, when the first camera or/and the second camera is of an auto-focusing type with an adjustable liquid crystal lens, the first camera is provided with a first liquid control lens, the second camera is provided with a second liquid control lens, the light intensity sensor senses the external illumination intensity and transmits the external illumination intensity to the first light emitting device and the second light emitting device through a bus, the first light emitting device emits infrared light according to the external illumination intensity and projects the infrared light onto the biological feature, the first liquid control lens receives all light on the biological feature and transmits the received light to the first lens, the first lens transmits all light on the biological feature to the first optical filter, the first optical filter selects the infrared light to transmit the infrared light to the first image sensor, and the first image sensor photoelectrically converts the infrared light into an electrical signal and transmits the electrical signal to the bus; the second light-emitting device emits visible light rays according to the external illumination intensity condition and projects the visible light rays onto the biological characteristics, the second liquid control lens receives all the light rays on the biological characteristics and transmits the light rays to the second lens, the second lens transmits all the light rays on the biological characteristics to the second optical filter, the second optical filter selects the visible light rays to pass through and transmits the visible light rays to the second image sensor, and the second image sensor photoelectrically converts the visible light rays into electric signals to transmit the electric signals to the bus; when the first driving unit or/and the second driving unit receive the focusing control signal from the bus, the first liquid control lens or/and the first liquid control lens change the focal length of the liquid crystal lens and finally enable the image to be clear.
In this embodiment, the first light emitting device is configured to emit infrared light, and the second light emitting device is configured to emit visible light.
In this embodiment, the first light emitting device emits a near infrared light of 700nm to 1000nm, preferably 800 nm to 950 nm; the second light emitting device emits visible light of 380nm to 780nm, preferably 450 nm to 650 nm.
In this embodiment, the first image information and the second image information are collected with the same, different or partially the same biometric characteristic. That is, the image capture of the first camera and the image capture of the second camera are completely the same, or partially the same, or completely different.
In this embodiment, as shown in fig. 3, the biometric features include one or more of retina, iris, eyeball, eye pattern, eye shape, mouth/tooth shape, face shape and vein features, and the respective features may be selected as a: face recognition and B: and (4) eye identification.
In this embodiment, as shown in fig. 10, the device further includes a control unit, where the control unit includes a camera control module, a light source control module, a focusing control module, and a light intensity control module, a first auto-focusing module is disposed in the first camera, a second auto-focusing module is disposed in the second camera, the first auto-focusing module and the second auto-focusing module are controlled by the focusing control module, the light intensity control module controls the light supplement intensity of the light intensity sensor, and the light source control module is used to control the emission wavelengths of the first light emitting device and the second light emitting device; the camera control module controls the first camera and the second camera to acquire images.
In this embodiment, as shown in fig. 11, the camera processing unit includes a first image processing module and a second image processing module, where the first image processing module is configured to receive external illumination environment information and perform corresponding automatic white balance processing; and the second image processing module is used for receiving the external illumination environment information and adopting corresponding automatic white balance processing.
As shown in fig. 11, the first image processing module obtains first component image information IM1A for first biometric identification and second component image information IM1B for image synthesis and depth calculation based on the first image information IM 1; the second image processing module obtains third component image information IM2A for second biometric identification and fourth component image information IM2B for image synthesis and depth calculation based on the second image information IM 2.
The image synthesis module carries out synthesis processing based on the second component image information IM1B and the fourth component image information IM2B and outputs two-dimensional image information of biological characteristics.
In this embodiment, the camera processing unit further includes a determining module, where the determining module is configured to match the biometric encoding information with the pre-stored biometric data, and output a corresponding recognition result according to a setting condition of biometric recognition, where the recognition result may be a recognition result of the first biometric feature or/and a recognition result of the second biometric feature.
The first camera is used for collecting and outputting first biological characteristic image information (and first image information), the first image processing module is used for carrying out first biological characteristic extraction and coding and outputting first biological characteristic coded information (namely first component image information IM1A) based on the first biological characteristic image information, the identification and judgment module is used for matching the first biological characteristic coded information with pre-stored biological characteristic data based on the first biological characteristic coded information, the second camera is used for collecting and outputting second biological characteristic image information (namely second image information), and the second image processing module is used for carrying out second biological characteristic extraction and coding and outputting second biological characteristic coded information (namely third component image information IM1A) based on the second biological characteristic image information.
In this embodiment, the camera processing unit further includes a first identification module and a second identification module, the first identification module performs biometric feature extraction based on the first component image information IM1A and outputs first biometric code information PN 1; the second identification module performs biological feature extraction based on the third component image information IM2A and outputs second biological identification code information PN 2.
The identification decision module (i.e. decision module) matches with the pre-stored biometric data based on the first biometric code information PN1 and the second biometric code information PN2, and outputs the result of biometric identification if the match is satisfied.
In this embodiment, the camera processing unit further includes an image synthesis module, and the image synthesis module is configured to perform re-stitching based on the second component image information and the fourth component image information and output a two-dimensional biometric image IM3 and image information IM4 required for depth calculation.
In this embodiment, the camera processing unit further includes a depth-of-field calculation module, where the depth-of-field calculation module is configured to perform re-stitching based on the second component image information and the fourth component image information and output depth-of-field information and image information DM required for obtaining a three-dimensional image.
In this embodiment, the camera processing unit further includes a three-dimensional image obtaining module, and the three-dimensional image obtaining module is configured to generate a three-dimensional model DMX of the living being based on the two-dimensional biometric image and the depth information.
In this embodiment, a specific structure diagram of a camera unit is also provided, as shown in fig. 12 and 13, the biometric terminal 1 includes a camera unit 20 and a display 10, and a camera processing unit is provided therein, where (a), (b), (c), and (d) in the drawings correspond to the camera unit structures of fig. 6 to 9, respectively, (c) the camera unit 20 includes a first camera 21, a first light emitting device 23, a second camera 22, a second light emitting device 24, and a light intensity sensor 25, the first camera 21 includes a first image sensor 21c, a first filter 21b, a first lens 21a, a first actuator 21d, and a first driving unit 21 e; the second camera 22 includes a second image sensor 22c, a second filter 22b, a second lens 22a, a second actuator 22d, and a second driving unit 22 e. The first image sensor 21c, the second image sensor 22c, the first light emitting device 23, the second light emitting device 24, the first driving unit 21e, and the second driving unit 22e are connected to a bus 43.
In summary, the present application provides a biometric identification system, a biometric identification method, and a biometric identification terminal, which are capable of performing light supplement on a camera in an acquisition process by detecting the illumination intensity of an external environment in real time in the acquisition process, acquiring two kinds of image information, namely infrared light and visible light, simultaneously performing identification processing, extracting corresponding components of the two kinds of image information, and performing feature identification and image reconstruction respectively, so as to achieve biometric identification and perform two-dimensional/three-dimensional reconstruction display on a biometric image.
Finally, the method of the present application is only a preferred embodiment and is not intended to limit the scope of the present invention. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.
Claims (23)
1. A biometric identification method, comprising:
s1, performing light supplement processing according to the external illumination environment to obtain first image information and second image information carrying biological characteristic information; the first image information is biological characteristic image information acquired through infrared light, the second image information is biological characteristic image information acquired through visible light, and two kinds of image information, namely infrared light and visible light, are acquired simultaneously to be identified;
s2, acquiring first component image information for first biological recognition and second component image information for image synthesis and depth of field calculation based on the first image information; acquiring third component image information used for second biological identification and fourth component image information used for image synthesis and depth of field calculation based on the second image information;
s3, combining the first component image information and the third component image information to obtain a biological identification result, and obtaining two-dimensional image information or/and three-dimensional image information of the biological based on the second component image information and the fourth component image information;
in step S3, obtaining two-dimensional image information or/and three-dimensional image information of the living being based on the second component image information and the fourth component image information specifically includes:
re-splicing and outputting a two-dimensional biological characteristic image based on the second component image information and the fourth component image information;
acquiring depth information of the biological features according to the second component image information and the fourth component image information;
a three-dimensional model of the living being is generated based on the two-dimensional biometric image and the depth information.
2. The biometric authentication method according to claim 1, wherein the step S1 of performing supplementary lighting according to the ambient lighting environment specifically comprises: and sensing the external illumination environment and selecting different image acquisition modes according to the illumination environment, wherein the different image acquisition modes comprise automatic exposure, automatic white balance and automatic light supplement.
3. The biometric authentication method according to claim 1, wherein in step S1, the biometric characteristics of the first image information and the second image information are the same, different or partially the same.
4. The biometric authentication method according to claim 1, wherein in step S1, the biometric features are one or more of retina, iris, eyeball, eye pattern, eye shape, face shape, and vein features.
5. The biometric authentication method according to claim 1, wherein the step S3 of combining the first component image information and the third component image information to obtain the biometric authentication result specifically comprises:
acquiring first biological identification code information based on the first component image information, and acquiring second biological identification code information based on the third component image information;
and matching the first biological identification code information and the second biological identification code information with pre-stored biological characteristic data, and outputting a corresponding identification result according to the setting condition of biological identification.
6. The biometric authentication method according to claim 5, wherein the authentication result is an authentication result of the first component image information or/and an authentication result of the third component image information.
7. A biometric identification system is characterized by comprising a camera unit and a camera processing unit;
the camera unit is used for performing light supplement processing according to an external illumination environment to obtain first image information and second image information carrying biological characteristic information; the first image information is biological characteristic image information acquired through infrared light, the second image information is biological characteristic image information acquired through visible light, and two kinds of image information, namely infrared light and visible light, are acquired simultaneously to be identified;
the camera processing unit is used for acquiring first component image information used for first biological recognition and second component image information used for image synthesis and depth of field calculation based on the first image information; acquiring third component image information used for second biological identification and fourth component image information used for image synthesis and depth of field calculation based on the second image information; combining the first component image information and the third component image information to obtain a biological identification result, and obtaining two-dimensional image information or/and three-dimensional image information of the organism based on the second component image information and the fourth component image information;
the camera processing unit further comprises an image synthesis module, wherein the image synthesis module is used for carrying out re-splicing based on the second component image information and the fourth component image information and outputting a two-dimensional biological characteristic image;
the camera processing unit further comprises a depth-of-field calculation module, wherein the depth-of-field calculation module is used for re-splicing based on the second component image information and the fourth component image information and outputting depth-of-field information;
the camera processing unit further comprises a three-dimensional image acquisition module, and the three-dimensional image acquisition module is used for generating a three-dimensional model of the living being based on the two-dimensional biological characteristic image and the depth information.
8. The biometric identification system of claim 7, wherein the biometric characteristics of the first and second image information acquisitions are the same, different, or partially the same.
9. The biometric identification system of claim 7, wherein the biometric features include one or more of retinal, iris, eyeball, eye print, eye shape, facial shape, and vein features.
10. The biometric identification system according to claim 7, wherein the camera processing unit comprises a first image processing module and a second image processing module, the first image processing module is configured to receive the ambient lighting environment information and perform corresponding automatic white balance processing; and the second image processing module is used for receiving the external illumination environment information and adopting corresponding automatic white balance processing.
11. The biometric system according to claim 7, wherein the camera processing unit further comprises a first recognition module and a second recognition module, the first recognition module performing biometric extraction based on the first component image information and outputting first biometric code information; and the second identification module extracts biological characteristics based on the third component image information and outputs second biological identification code information.
12. The biometric identification system according to claim 7, wherein the camera processing unit further comprises a determination module, and the determination module is configured to match the biometric encoding information with the pre-stored biometric data, and output a corresponding identification result according to the setting condition of the biometric identification, wherein the identification result is an identification result of the first biometric characteristic or/and an identification result of the second biometric characteristic.
13. A biological identification terminal is characterized by comprising a camera unit and a camera processing unit;
the camera unit comprises a first camera, a second camera, a first light-emitting device, a second light-emitting device and a light intensity sensor; the first camera and the second camera are respectively used for acquiring first image information and second image information carrying biological characteristic information; the light intensity sensor is used for sensing an external illumination environment, the first light-emitting device is used for supplementing light to the first camera according to the external illumination environment, and the second light-emitting device is used for supplementing light to the second camera according to the external illumination environment; the first camera is used for collecting a biological characteristic image of infrared rays, the second camera is used for collecting a biological characteristic image of visible rays, and simultaneously collects two image information of infrared light and visible light for identification processing;
the camera processing unit is used for acquiring first component image information used for first biological recognition and second component image information used for image synthesis and depth of field calculation based on the first image information; acquiring third component image information used for second biological identification and fourth component image information used for image synthesis and depth of field calculation based on the second image information; combining the first component image information and the third component image information to obtain a biological identification result, and obtaining two-dimensional image information or/and three-dimensional image information of the organism based on the second component image information and the fourth component image information;
the camera processing unit further comprises an image synthesis module, wherein the image synthesis module is used for carrying out re-splicing based on the second component image information and the fourth component image information and outputting a two-dimensional biological characteristic image;
the camera processing unit further comprises a depth-of-field calculation module, wherein the depth-of-field calculation module is used for re-splicing based on the second component image information and the fourth component image information and outputting depth-of-field information;
the camera processing unit further comprises a three-dimensional image acquisition module, and the three-dimensional image acquisition module is used for generating a three-dimensional model of the living being based on the two-dimensional biological characteristic image and the depth information.
14. The biometric terminal of claim 13, wherein the first camera is a narrow angle lens or a wide angle lens; the second camera is a narrow-angle lens or a wide-angle lens.
15. The biometric terminal of claim 13, wherein the first camera comprises a first image sensor, a first filter, and a first lens; the second camera comprises a second image sensor, a second optical filter and a second lens; the first image sensor and the second image sensor are mounted on a circuit board.
16. The biometric terminal of claim 13, wherein the first camera is a fixed focus or auto focus camera; the second camera is a fixed focus type or an automatic focus type camera.
17. The biometric terminal of claim 13, wherein the first light emitting device is configured to emit infrared light and the second light emitting device is configured to emit visible light.
18. The biometric terminal of claim 17, wherein the first light emitting device emits a near infrared light of 700nm to 1000nm and the second light emitting device emits a visible light of 380nm to 780 nm.
19. The biometric terminal of claim 13, wherein the biometric characteristics of the first and second image information acquisitions are the same, different, or partially the same.
20. The biometric terminal of claim 13, wherein the biometric features include one or more of retinal, iris, eyeball, eye pattern, eye shape, facial shape, and vein features.
21. The biometric terminal according to claim 13, wherein the camera processing unit comprises a first image processing module and a second image processing module, the first image processing module is configured to receive the ambient light environment information and perform corresponding auto white balance processing; and the second image processing module is used for receiving the external illumination environment information and adopting corresponding automatic white balance processing.
22. The biometric terminal according to claim 13, wherein the camera processing unit further comprises a first recognition module and a second recognition module, the first recognition module performs biometric extraction based on the first component image information and outputs first biometric code information; and the second identification module extracts biological characteristics based on the third component image information and outputs second biological identification code information.
23. The biometric terminal according to claim 13, wherein the camera processing unit further comprises a determination module, and the determination module is configured to match the biometric encoding information with the pre-stored biometric data, and output a corresponding recognition result according to the setting condition of the biometric, wherein the recognition result is a recognition result of the first biometric characteristic or/and a recognition result of the second biometric characteristic.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710725269.XA CN109426762B (en) | 2017-08-22 | 2017-08-22 | Biological recognition system, method and biological recognition terminal |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710725269.XA CN109426762B (en) | 2017-08-22 | 2017-08-22 | Biological recognition system, method and biological recognition terminal |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109426762A CN109426762A (en) | 2019-03-05 |
| CN109426762B true CN109426762B (en) | 2021-03-23 |
Family
ID=65498656
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710725269.XA Active CN109426762B (en) | 2017-08-22 | 2017-08-22 | Biological recognition system, method and biological recognition terminal |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109426762B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117373103B (en) * | 2023-10-18 | 2024-05-07 | 北京极溯光学科技有限公司 | Image feature extraction method, device, equipment and storage medium |
Family Cites Families (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20020113687A1 (en) * | 2000-11-03 | 2002-08-22 | Center Julian L. | Method of extending image-based face recognition systems to utilize multi-view image sequences and audio information |
| DE10227167A1 (en) * | 2002-06-18 | 2004-01-15 | Siemens Ag | Method and device for personal identification |
| CN101639891B (en) * | 2008-07-28 | 2012-05-02 | 汉王科技股份有限公司 | Double-camera face identification device and method |
| CN101814130A (en) * | 2009-02-19 | 2010-08-25 | 中国科学院自动化研究所 | Iris identification device by using camera array and multimodal biometrics identification method |
| CN103150553A (en) * | 2013-02-06 | 2013-06-12 | 北京中科虹霸科技有限公司 | Mobile terminal and method for realizing multi-mode identity characteristic recognition |
| CN104933344B (en) * | 2015-07-06 | 2019-01-04 | 北京中科虹霸科技有限公司 | Mobile terminal user identity authentication device and method based on multi-biological characteristic mode |
| CN206370880U (en) * | 2017-01-25 | 2017-08-01 | 徐鹤菲 | A kind of dual camera imaging system and mobile terminal |
| CN106874871B (en) * | 2017-02-15 | 2020-06-05 | 广东光阵光电科技有限公司 | Living body face double-camera identification method and identification device |
-
2017
- 2017-08-22 CN CN201710725269.XA patent/CN109426762B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN109426762A (en) | 2019-03-05 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR101286454B1 (en) | Fake face identification apparatus and method using characteristic of eye image | |
| US8754934B2 (en) | Dual-camera face recognition device and method | |
| CN102855471B (en) | Remote iris intelligent imaging device and method | |
| CN109255282B (en) | Biological identification method, device and system | |
| CN112165573A (en) | Shooting processing method and device, equipment and storage medium | |
| KR101014325B1 (en) | Face recognition system and method using the infrared rays | |
| CN111339831B (en) | Lighting lamp control method and system | |
| US20140055567A1 (en) | Video Infrared Retinal Image Scanner | |
| CN207491128U (en) | A kind of RGB+IR image capture devices | |
| CN109661668B (en) | Image processing method and system for iris recognition | |
| KR20180134280A (en) | Apparatus and method of face recognition verifying liveness based on 3d depth information and ir information | |
| KR101919090B1 (en) | Apparatus and method of face recognition verifying liveness based on 3d depth information and ir information | |
| CN109451233A (en) | A kind of device acquiring fine definition face-image | |
| US20210256244A1 (en) | Method for authentication or identification of an individual | |
| CN109409249A (en) | Information processing method and electronic equipment | |
| CN108769504A (en) | A kind of infrared camera that function is activated with In vivo detection applied to ATM | |
| CN109426762B (en) | Biological recognition system, method and biological recognition terminal | |
| CN106934349A (en) | Dual camera is imaged and iris capturing identification integration apparatus | |
| CN112926367B (en) | Living body detection equipment and method | |
| WO2018150554A1 (en) | Pulse wave measuring device, mobile terminal device, and pulse wave measuring method | |
| CN111144219A (en) | Iris recognition device and method based on 3D structured light | |
| CN109840514A (en) | A kind of method and apparatus of In vivo detection | |
| US11341224B2 (en) | Handheld multi-sensor biometric imaging device and processing pipeline | |
| US20210192205A1 (en) | Binding of selfie face image to iris images for biometric identity enrollment | |
| CN1752990A (en) | Portable iris image acquiring device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20191225 Address after: 518109 first floor, building 1b, yunantong Industrial Park, langrong Road, Dalang community, Dalang street, Longhua District, Shenzhen City, Guangdong Province Applicant after: Shenzhen Jinghong Technology Co., Ltd Address before: 201203 Shanghai City, Pudong New Area free trade zone fanchun Road No. 400 Building 1 layer 3 Applicant before: Shanghai Jinghong Electronic Technology Co., Ltd. |
|
| TA01 | Transfer of patent application right | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |