CN109255282B

CN109255282B - Biological identification method, device and system

Info

Publication number: CN109255282B
Application number: CN201710573675.9A
Authority: CN
Inventors: 黄欢; 赵刚
Original assignee: Shenzhen Jinghong Technology Co ltd
Current assignee: Shenzhen Jinghong Technology Co., Ltd
Priority date: 2017-07-14
Filing date: 2017-07-14
Publication date: 2021-01-05
Anticipated expiration: 2037-07-14
Also published as: CN109255282A

Abstract

The invention provides a biological identification method, a system and a device, wherein the method comprises the following steps: s1, acquiring a first image signal carrying the biological characteristic information of the head of the user and a second image signal carrying the biological characteristic information of the eyes of the user; s2, synthesizing and calculating the depth information of the user according to the first image signal and the second image signal, and judging whether the user is in the range of the biological identification area; and S3, carrying out biological recognition on the user in the biological recognition area range. Performing user identification authentication through dual biological characteristics; the system can not only shoot images of at least one biological characteristic, but also collect and process images of at least one biological characteristic, realize identity registration and authentication of organisms, complete identity identification of the organisms, provide convenience for obtaining and using information safety, and achieve the highest identity identification safety level at present, thereby promoting greater progress of social services and life and work of people.

Description

Biological identification method, device and system

Technical Field

The invention relates to the technical field of human-computer interaction, in particular to a biological identification method, a biological identification system and a biological identification device.

Background

With the rapid development of economy, social networks are more complex, and the mobility of personnel is more frequent, so the requirement for identity security authentication of personnel is more urgent, and the authentication conditions are more severe. Among the numerous identification methods, the advantages of using the self biological characteristics of the human body to carry out identification are incomparable with other peripheral devices, and the safety and reliability of the method are widely accepted. In view of the characteristics of uniqueness and constancy of the iris in the life individual, one of the highly appreciated technologies in the biometric identification technology is provided. And due to the very low error recognition rate, the technology is more suitable for the field with high safety guarantee requirements. Based on the characteristics of human biological features, the biological feature recognition technology based on the aspects of human faces, palm prints, fingerprints, irises, veins, hand shapes, handwriting and the like is provided.

In one or more exemplary embodiments of the inventive concepts related to biometric devices, face recognition, retina recognition, eye print recognition, iris recognition, etc. have been applied, requiring a user to capture an image of a biometric feature of the user within an appropriate distance for biometric recognition, processing the image, and comparing the image with a pre-stored registered image. In a camera configured to capture a biological image of a user, only a single camera is usually used for capturing a biological image, and more biological features cannot be captured according to distance, so that information acquisition of the image is not easy to be used for evaluating the effectiveness of the biological features, and image information acquired by the single camera is either color or black and white, thereby affecting the user experience.

With the rise of smart phones, binocular cameras or multi-view cameras have gradually entered the lives of people, but they are generally only used for shooting life scenes, and are either low-illumination enhanced, or focused after shooting, or optically zoomed, and the like, so that the functions are not applied to image acquisition of biological features, and thus the requirements of biological recognition cannot be met.

As such, the biometric recognition system displays the result of measuring the user's distance using the distance measuring sensor to locate the user's operation range and defines the image capturing that is used for biometric recognition only when within the operation range, and is otherwise used only for general scene photographing. Since biometric recognition needs to be used normally both day and night, especially in dark environment, if there is no infrared light supplement, the image capturing effect will be affected, so it is necessary to provide infrared light supplement on the biometric recognition system, and the lower capturing effect will be increased.

Disclosure of Invention

The present invention provides a biometric method, system and device that overcomes or at least partially solves the above-mentioned problems, and solves the problem in the prior art that only a single camera is used for capturing biometric images, and more biometric features cannot be captured according to distance, so that the information acquisition of the images is not easily used to evaluate the validity of the biometric features.

According to an aspect of the present invention, there is provided a biometric method including:

s1, acquiring a first image signal carrying the biological characteristic information of the head of the user and a second image signal carrying the biological characteristic information of the eyes of the user;

s2, synthesizing and calculating the depth information of the user according to the first image signal and the second image signal, and judging whether the user is in the range of the biological identification area;

and S3, carrying out biological recognition on the user in the biological recognition area range.

Preferably, the first image signal is an image signal for shooting the head of the user to capture corresponding visible light; the second image signal is an image signal of an eye portion used for shooting to capture corresponding infrared light.

Preferably, the head biometric information includes face contour and vein distribution information; the eye biological characteristic information comprises iris, retina and eye pattern information.

Preferably, in step S1, the first image signal is an RGB image signal, and the second image signal is a BW image signal.

Preferably, the step S2 specifically includes:

extracting a luminance component image and an RGB component image of the first image signal, and extracting a gray component image of the second image signal;

synthesizing the brightness classification image of the first image signal and the gray component image of the second image signal to obtain user position information containing a head position and an eye position and obtain depth information of a user;

and judging whether the user is in the range of the biological identification area or not according to the user depth information.

Preferably, the depth information of the user is obtained by extracting the feature point features of the first image signal and the second image signal and performing feature point matching through a binocular vision technology, screening a certain point appearing in the two images at the same time, and restoring the three-dimensional coordinates of the matching point.

Preferably, the step S3 specifically includes:

s31, calculating the biological characteristics of the user in the biological identification area according to the RGB component image of the first image signal to obtain the face contour and/or vein distribution information of the user;

s32, matching the obtained face contour and/or vein distribution information with the registration data, and if the matching is unsuccessful, the authentication fails, and the authentication is ended; if the matching is successful, the step S33 is entered;

s33, calculating the biological characteristics of the user according to the second image signal to obtain the eye iris and/or retina and/or eye pattern information of the user, matching the eye iris and/or retina and/or eye pattern information with the registration data, and if the matching is unsuccessful, failing to authenticate, and ending the authentication; if the matching is successful, the authentication is passed, and the authentication is finished.

Preferably, the step S3 further includes processing and combining the first image signal and the second image signal, and outputting and displaying the processed and combined image when it is detected that the user is not in the biometric area or the authentication fails.

Preferably, in steps S2 and S3, after the matching is completed, an authentication result signal is output, and the authentication result signal includes an image signal and a sound signal.

A biometric identification system includes an image acquisition module and a system processor;

the image acquisition module is used for acquiring a first image signal carrying biological characteristic information of the head of a user and a second image signal carrying biological characteristic information of the eyes of the user;

the system processor is used for synthesizing and calculating the depth information of the user according to the first image signal and the second image signal, and performing identity recognition based on the depth information, the biological feature information of the head of the user and the biological feature information of the eyes of the user.

Preferably, the image capturing module captures a visible light optical signal of a head of a user and outputs a first image signal, captures an infrared light optical signal of eyes of the user and outputs a second image signal, the first image signal is an RGB image signal, and the second image signal is a BW image signal.

Preferably, the system processor comprises a color image processor, a black and white image processor, a synthesis unit, an identification unit and a judgment unit;

the color image processor is used for extracting a brightness component image and an RGB component image of the first image signal;

the black-and-white image processor is used for extracting a gray component image of the second image signal;

the synthesis unit is used for synthesizing the brightness classification image of the first image signal and the gray component image of the second image signal to obtain user position information containing a head position and an eye position and obtain depth information of a user;

the judging unit is used for judging whether the user is in the range of the biological identification area according to the user depth information;

the identification unit is used for carrying out biological identification on the user in the biological identification area range.

Preferably, the mobile terminal further comprises a prompting unit, wherein the prompting unit is used for outputting an authentication result signal after the matching is finished, and the authentication result signal comprises an image signal and a sound signal.

Preferably, the identification unit includes a first identification unit and a second identification unit;

the first identification unit is used for calculating the biological characteristics of the user according to the RGB component image of the first image signal, obtaining the face contour and/or vein distribution information of the user, and matching and identifying the obtained face contour and/or vein distribution information with the registration data;

the second identification unit is used for calculating the biological characteristics of the user according to the second image signal, obtaining the eye iris and/or retina and/or eye pattern information of the user, and performing matching identification with the registration data.

Preferably, the synthesis unit includes a depth acquisition sub-block and an image synthesis sub-block;

the depth acquisition sub-block is used for extracting the characteristic point characteristics of the first image signal and the second image signal and matching the characteristic points through a binocular vision technology, screening out a certain point appearing in the two images at the same time, and restoring the three-dimensional coordinates of the matched point to obtain depth information;

the image synthesis sub-block is used for processing and synthesizing the first image signal and the second image signal, and outputting and displaying the processed and synthesized image.

Preferably, the authentication server further comprises a display unit for displaying the user image information and the authentication result information.

A biological recognition device comprises a binocular camera and a system processor chip;

the binocular camera comprises a first camera and a second camera, and the first camera is used for acquiring a first image signal carrying biological characteristic information of the head of a user; the second camera is used for acquiring a second image signal carrying eye biological characteristic information of the user;

the system processing chip is used for synthesizing and calculating the depth information of the user according to the first image signal and the second image signal, and performing identity recognition based on the depth information, the biological feature information of the head of the user and the biological feature information of the eyes of the user.

Preferably, the exposure time of the first camera and the exposure time of the second camera are the same or different.

Preferably, the first camera is a visible light shooting device, and the second camera is an infrared light shooting device.

Preferably, the first camera comprises a first lens, a first optical filter and a first image sensor chip; the second camera comprises a second lens, a second optical filter and a second image sensor chip; the first camera.

Preferably, the first optical filter is an optical filter for cutting off infrared light waves and filtering infrared light rays outside the visible light rays, and the second optical filter is an optical filter for filtering visible light rays outside the visible light rays.

Preferably, the first image sensor is an RGB image sensor for capturing a color image; the second image sensor is a BW image sensor and is used for shooting black and white images.

Preferably, the first lens is a wide-angle lens for capturing an image of a head of a user, and the second lens is a narrow-angle lens for capturing an image of an eye of the user.

Preferably, the binocular camera and the system processor chip are mounted on a circuit board assembly.

Preferably, the first camera further includes a first base with a through hole, the second camera further includes a second base with a through hole, the first optical filter and the first lens are mounted on the circuit board assembly through the first base, and the second optical filter and the second lens are mounted on the circuit board assembly through the second base.

Preferably, the binocular camera further comprises an active focusing device, and the active focusing device is used for adjusting the relative positions of the first lens and the first image sensor chip, the relative positions of the second lens and the second image sensor chip, and the optical axis positions of the first camera and the second camera.

Preferably, the first image sensor chip further comprises a first control unit for controlling exposure times of the first pixel, the reader and the first pixel of the first image sensor chip; the second image sensor chip further comprises a second control unit for controlling exposure times of second pixels, the reader and the second pixels of the second image sensor chip.

Preferably, the first camera is a fixed exchange camera module, an automatic focusing camera module or an optical zooming camera module.

Preferably, the system processor chip comprises an image processor, a judgment unit and an identification unit;

the image processor is used for synthesizing the brightness classification image of the first image signal and the gray component image of the second image signal to obtain user position information containing a head position and an eye position and obtain depth information of a user;

Preferably, the image processor includes a color image processor, a black-and-white image processor, and a synthesizing unit;

the synthesis unit is used for synthesizing the brightness classification image of the first image signal and the gray component image of the second image signal to obtain user position information containing the head position and the eye position and obtain depth information of the user.

The application provides a biological identification method, a biological identification system and a biological identification device, wherein a first image signal carrying biological characteristic information of a head of a user and a second image signal carrying biological characteristic information of eyes of the user are respectively used, and the first image signal is an image signal for shooting the head of the user and capturing corresponding visible light; the second image signal is an image signal of corresponding infrared light captured by shooting eyes, and user identification and authentication are performed through dual biological features; the system can not only shoot images of at least one biological characteristic, but also collect and process images of at least one biological characteristic, realize identity registration and authentication of organisms, complete identity identification of the organisms, provide convenience for obtaining and using information safety, and achieve the highest identity identification safety level at present, thereby promoting greater progress of social services and life and work of people.

Drawings

Fig. 1 is a block flow diagram of a biometric method according to embodiment 1 of the present invention;

FIG. 2 is a schematic flow chart of a biometric identification method according to embodiment 1 of the present invention;

fig. 3 is a self-timer view of a biometric identification system method according to embodiment 1 of the present invention;

FIG. 4 is a schematic diagram of head biometrics of a biometrics system method according to embodiment 1 of the invention;

fig. 5 is a schematic view of ocular biometric identification according to the biometric identification method in embodiment 1 of the present invention;

FIG. 6 is a schematic diagram showing the application of the biometric authentication method according to embodiment 2 of the present invention;

fig. 7 is a block diagram showing the construction of a biometrics identification system according to embodiment 3 of the invention;

FIG. 8 is a schematic diagram of a system identification process according to embodiment 3 of the present invention;

fig. 9 is a schematic view of the application of the biometric authentication system according to embodiment 4 of the present invention;

FIG. 10 is a schematic view of a biometric apparatus according to embodiment 5 of the present invention;

fig. 11 is a structural view of a biometrics authentication system according to embodiment 5 of the invention;

fig. 12 is a frame diagram of a binocular camera chip according to embodiment 5 of the present invention.

Detailed Description

The following detailed description of embodiments of the present invention is provided in connection with the accompanying drawings and examples. The following examples are intended to illustrate the invention but are not intended to limit the scope of the invention.

Example 1

As shown in fig. 1 and 2, there is shown a biometric identification method comprising:

In this embodiment, the first image signal is an image signal obtained by capturing a corresponding visible light ray on the head of a user; the second image signal is an image signal of an eye portion used for shooting to capture corresponding infrared light.

Preferably, the step S2 specifically includes:

The binocular vision technology belongs to a branch of computer vision technology, and the idea is that three-dimensional information of an object is obtained by processing two or more two-dimensional images, and then a three-dimensional live-action image of a corresponding scene is restored to fulfill the aim of reconstructing a real world model, and the depth information of the object is obtained through parallax by utilizing different imaging positions, namely parallax, of the same object on imaging planes at a certain distance. The research result of the binocular vision technology can be applied to various fields of spaceflight, aviation, military, education, entertainment and the like. In the embodiment, when a first image signal and a second image signal are collected, the first image signal and the second image signal can be respectively collected through a binocular vision system, two lenses of a binocular camera simultaneously acquire two digital images of a target object and a scene around the target object from different positions, or two digital images of the scene around the target object are acquired from different positions at different moments by a single camera, three-dimensional space information of the target object is recovered on the basis of the known position relation between the two cameras based on a parallax principle, the target object is further reconstructed, the shot object can be restored in a world coordinate system, and depth information is further acquired through a binocular vision technology.

Preferably, the step S3 specifically includes:

In the present embodiment, specifically, as shown in fig. 3 to fig. 6, when the user 2 picks up the mobile phone (image processing system) and the user 2 faces the binocular camera 21 of the mobile phone (image processing system), the binocular camera 21 will take images of the scene inside the user 2 together and display the picture of the user 2' on the display; if the user 2 is detected to be in the biological identification area, a picture of the head 2 'of the user or the surface of the eyes 2' of the user is displayed on the display. The image 1 signal with the luminance component image 1a and the grayscale component image 2' is image-synthesized, and distance information between the binocular camera 21 and the user is calculated based on this synthesis result. Whether the user is in the range of the biological recognition area is judged after matching with the stored parameters of the range of the biological recognition area based on the depth information. The biometric information is calculated based on the second component image 1b of the image 1 signal from the RBG firmware and the face contour and/or vein distribution of the user 2 is recorded. And matching the face contour and/or vein distribution of the user 2 in the biological recognition area based on the depth information and the biological characteristic information, and outputting a grab picture command signal if the face contour and/or vein distribution of the user 2 in the biological recognition area passes the matching. Shooting an image 2 signal from BW firmware according to the capture command signal to calculate the biological characteristic information of the iris and/or retina and/or eye print of the eye of the user 2 in the biological identification area for matching registration data, and if the image 2 signal is equal to the registration data, successfully authenticating the user and outputting an 'authentication success' signal; if the image 2 signal is not identical to the registration data, the user authentication fails and an "authentication failure" signal is output.

When the fact that the image data is not in the biological feature recognition area and/or the fact that the biological feature recognition fails in authentication is received is detected, the image 1 signal and the image 2 signal are processed respectively, the processed first image data and the processed second image data are processed into a new composite image, and finally the composite image of the first image data and the second image data is processed again and displayed on a display.

Example 2

As shown in fig. 6, in the present embodiment, the image processing system 1 may be any equipment with a biometric identification system 20, including but not limited to mobile devices, fixed devices, and the like, such as door lock, door access, attendance, gun locker, and the like. When the image processing system 1 'is a door lock, which is another embodiment of the image processing system 1, the biometric recognition system 20 of the image processing system 1' may capture the eye image 2 ″ of the user 2 when the user 2 is within the biometric identification area, thereby implementing biometric recognition.

Example 3

As shown in fig. 7 and 8, a biometric identification system is shown comprising an image acquisition module and a system processor;

Fig. 8 is a flowchart of biometric identification performed by the system according to the embodiment, and the image may include a color image processor (image processor 1 in the image), a black-and-white image processor (image processor 2 in the image), a synthesizing unit, a judging unit, a first identifying unit, and a second identifying unit. The image processor may process the image 1 signal from the binocular camera, the image 1 signal being an RGB signal, thereby extracting one luminance component image 1a and a second RBG component image 1b of the image 1 signal of the RGB firmware. The image processor can process the image 2 signal from the binocular camera, the image 2 signal being a BW signal, thus extracting the grayscale component image 2' of the image 2 signal of the BW firmware. The synthesizing unit image-synthesizes the image 1 signal with the luminance component image 1a and the gradation component image 2' and calculates distance information between the binocular camera and the user based on the synthesis result. Meanwhile, the synthesizing unit may calculate distance information between the binocular camera and the user by synthesizing the head position of the user and the eye position of the user. The first recognition unit calculates a biometric feature based on the second component image 1b of the image 1 signal from the BW firmware, this biometric feature information being the spatial information of the user's face contour picture and/or the spatial information of the user's face vein distribution which is captured by the binocular camera and which is to be displayed by the display unit. The judging unit judges whether the user is within the range of the biometric area based on the depth information, and the biometric system can be operated only when the user is determined to be within the range of the biometric area according to a preset value; meanwhile, the judging unit can detect the face contour and/or vein distribution image of the head of the user and the images of the two eyes by centering in the optical view field area of the binocular camera. When the judging unit detects that the user is not in the biological identification area, a No signal can be output, and after the prompting unit receives the No signal, an image and sound can be output to prompt that the biological identification fails or prompt information that the biological identification fails is displayed. When the judging unit detects the face contour and/or vein distribution image of the head of the user, the judging unit can output a shooting command signal to the first identifying unit, the first identifying unit detects the face contour and/or vein distribution image 1b signal of the head of the user captured by the binocular camera according to the shooting command signal, and the judging unit judges whether the first image data is matched with the registration data or not by combining the image signal of the face contour and/or vein distribution image of the head of the user, if the signal is output, the judging unit can continuously output a shooting command to capture the position image of the iris and/or retina and/or eye pattern of the eyes of the user, the second identifying unit detects the image 2 signal of the iris and/or retina and/or eye pattern of the eyes of the user captured by the binocular camera according to the shooting command information, the combination judging unit judges whether the second image data is matched with the registered data or not through the image signals of the iris and/or retina and/or eye pattern of the eyes of the user, and if yes signals are output, the matching is successful. If no, a voice message is output to prompt that the biological recognition fails or a reminding message is displayed to prompt that the biological recognition fails.

Example 4

As shown in fig. 9, which is a schematic diagram of a specific application of the system in embodiment 2, the image processing system 1 may be an intelligent mobile terminal, including but not limited to a smart phone, a tablet computer, a digital camera, an internet of things device or an internet device. The image processing system 1 includes a display screen 10, a biometric system 20, a lighting device 30, a memory 40 and an application processor 50. The application processor 50 of the image processing system 1 can control the display of image data through the display screen 10; it may control the biometric recognition system 20 to capture image information of the biometric features of the head and eyes of the user, the biometric recognition system 20 capturing depth information and biometric feature information of the user through a binocular structure; it can control the light emitting device 30 to provide infrared light toward the eyes; the memory 40 may store a program for controlling the image processing system 1. The application processor 50 may execute programs stored in the memory 40. When the biometric recognition system 20 detects that the biometric feature is within the biometric identification area, the application processor 50 may control the biometric recognition system 20 to output data corrected to an infrared light image and/or data corrected to a visible light image; when the biometric recognition system 20 detects that the biometric feature is outside the biometric identification area, the application processor 50 may control the biometric recognition system 20 to output only the data of the visible light image.

Example 5

The embodiment shows a biological recognition device, which comprises a binocular camera and a system processor chip;

the depth acquisition sub-block is used for extracting the characteristic point characteristics of the first image signal and the second image signal and matching the characteristic points through a binocular vision technology, screening out a certain point appearing in the two images at the same time, and restoring the three-dimensional coordinates of the matched point to obtain depth information; the binocular vision technology belongs to a branch of computer vision technology, and the idea is that three-dimensional information of an object is obtained by processing two or more two-dimensional images, and then a three-dimensional live-action image of a corresponding scene is restored to fulfill the aim of reconstructing a real world model, and the depth information of the object is obtained through parallax by utilizing different imaging positions, namely parallax, of the same object on imaging planes at a certain distance. The research result of the binocular vision technology can be applied to various fields of spaceflight, aviation, military, education, entertainment and the like. In the embodiment, when a first image signal and a second image signal are collected, the first image signal and the second image signal can be respectively collected through a binocular vision system, two lenses of a binocular camera simultaneously acquire two digital images of a target object and a scene around the target object from different positions, or two digital images of the scene around the target object are acquired from different positions at different moments by a single camera, three-dimensional space information of the target object is recovered on the basis of the known position relation between the two cameras based on a parallax principle, the target object is further reconstructed, the shot object can be restored in a world coordinate system, and depth information is further acquired through a binocular vision technology.

When visual recognition (namely face recognition, retina recognition and iris recognition) is carried out, a plurality of biological recognition images are firstly shot by a camera, the most appropriate image is selected as the selected biological image, the quality of the image (if the image meets the biological recognition standard) is evaluated, the image is compared with the previously registered biological image to see whether the biological characteristics are consistent, if yes, the screen is unlocked, and if not, the recognition is prompted to try again.

The data shows that the false recognition rate of fingerprint identification is about 0.8%, and the face identification is about 2%. The iris recognition as the ultimate BOSS has the advantages of individual uniqueness, consistency, anti-counterfeiting property and the like, and the error recognition rate can be as low as one millionth, so the iris recognition method is gradually applied to scenes with high requirements on security levels, such as the fields of medical treatment, social security, credit, finance and the like. Such schemes determine whether a user is a legitimate user and unlock the lock by identifying the user's biometric features.

In this embodiment, an iris recognition method is adopted, and the human eye structure is composed of a sclera, an iris, a pupil lens, a retina and the like. The iris is an annular segment between the black pupil and the white sclera containing many details characteristic of interlaced spots, filaments, coronaries, stripes, crypts, etc. And the iris will remain unchanged throughout life span after it is formed during the fetal development stage. These features determine the uniqueness of the iris features and also the uniqueness of the identification. Therefore, the iris feature of the eye can be used as an identification target for each person. Compared with other biological characteristics such as human faces, physiological research of irises shows that the irises not only have abundant textural characteristics, but also have the characteristics of uniqueness, stability, non-invasion, natural anti-counterfeiting property, high biological activity and the like, and are the safest biological identification and authentication technology which can be put into use at present. Therefore, the iris-based identity recognition technology is a research hotspot at present, and plays an important role in fields with high security authentication requirements, such as entrance guard attendance, gun vault, identity card passports, social security systems, financial information and the like. However, due to the delicate nature and the biological nature of iris hiding, there are still some difficulties in large-scale industrialization and commercialization of iris recognition technology, such as acquisition equipment of high-quality iris images, reduction in user's fitness, evaluation of iris image quality, whether the iris origin is living, iris adaptive processing, efficient feature matching, etc.

As shown in fig. 10 to 12, the image processing system 1 may be an intelligent mobile terminal, including but not limited to a smart phone, a tablet computer, a digital camera, an internet of things device or an internet device. The image processing system 1 includes a display screen 10, a biometric system 20, a lighting device 30, a memory 40 and an application processor 50. The application processor 50 of the image processing system 1 can control the display of image data through the display screen 10; it may control the biometric recognition system 20 to capture image information of the biometric features of the head and eyes of the user, the biometric recognition system 20 capturing depth information and biometric feature information of the user through a binocular structure; it can control the light emitting device 30 to provide infrared light toward the eyes; the memory 40 may store a program for controlling the image processing system 1. The application processor 50 may execute programs stored in the memory 40. When the biometric recognition system 20 detects that the biometric feature is within the biometric identification area, the application processor 50 may control the biometric recognition system 20 to output data corrected to an infrared light image and/or data corrected to a visible light image; when the biometric recognition system 20 detects that the biometric feature is outside the biometric identification area, the application processor 50 may control the biometric recognition system 20 to output only the data of the visible light image.

The biometric system 20 includes a dual-purpose camera 21 and a biometric system processor chip 22. These processors and other processes may be executed by biometric device 20 as executable machine-executable instructions similar to those in memory 40. The binocular camera 21 and the biometric system processor chip 22 are executed as hardware dedicated to the assignment process, and the processing tasks can be appropriately assigned or shared. The binocular camera 21 is used to capture head and eye image information of a user and output an image 1 signal and an image 2 signal based on a photographed picture. The binocular camera 21 includes a first camera 21a and a second camera 21b, the first camera 21a and the second camera 21b being mounted on the circuit board assembly 110, the first camera 21a including a first image sensor chip 120, a first filter 130, a first lens 140, and a first chassis 150; the second camera 21b includes a first image sensor chip 160, a second filter 170, a second lens 180 and a second base 190. The wiring board assembly 110 is for mounting various devices, including the first camera 21a, the second camera 21b, and the biometric system processor chip 22. The first and

second lenses

140 and 180 may include lenses having different field angles according to focal lengths; the first lens 140 has a wide-angle lens with a large field angle to capture the head of the user, and is a short-focus lens; the second lens 160 has a small field angle to capture the narrow angle lens of the user's eyes and may be a fixed focus lens or an auto-focus lens. The first filter 130 may allow the wavelength of the visible light to pass therethrough and block the wavelength of the infrared light from passing therethrough, and is an infrared cut filter; the second filter 170 may allow the filtered length of the infrared light to pass through and block the filtered length of the visible light from passing through, and is an infrared pass filter. The first image sensor chip 120 is a color CMOS chip for collecting optical signals that have been cut off by infrared rays and converting the optical signals into output image 1 signals; the second image sensor chip 160 is a black and white CMOS chip for collecting the optical signals passing through the infrared and converting the output image 2 signals. The first base 150 is a cover with a through hole, the through hole is used for placing the first lens 140 and the first optical filter 130, and the first base 150 shields and protects the first image sensor chip 120; the second base 190 is also a cover with through holes for placing the second lens 180 and the second optical filter 170, and the second base 190 shields and protects the second image sensor chip 160.

Referring to fig. 12, the binocular camera 21 has two independent image sensors including a first image sensor chip 120 and a second image sensor chip 160. The first control unit 122 of the first image sensor chip 120 may control the first pixel 121 and the reader 123 according to the control signal 1 from the application processor 50. The second control unit 162 of the second image sensor chip 160 may control the second pixels 161 and the reader 163 according to the control signal 2 from the application processor 50. The first control unit 122 may control the exposure time of the first pixels 121, and the second control unit 162 may control the exposure time of the second pixels 161, which are different in exposure time.

The exposure time may be controlled differently in consideration of the environmental conditions of the light emitting device 30 according to variations, the sensitivity of the second image sensor 160 may have a selected wavelength, and the like. When the biometric recognition is in a dark environment, the first control unit 122 may control the pixel exposure time of the picture corresponding to the visible light to collect the pixel exposure time of the picture corresponding to the infrared light; the second control unit 162 may control the pixel exposure time of the picture corresponding to the infrared ray to collect the pixel exposure time of the picture corresponding to the visible ray; the difference between these two exposure times may be dependent on changes in environmental conditions. In order to improve the efficiency of the pixel sizes of the respective images, any pixel may include or combine different size comparisons that may be performed on the pixels, the larger pixel size is a synthesized pixel size that includes an infrared image corresponding to the output of the second pixel 161 and a visible light image corresponding to the output of the first pixel 121, the brighter synthesized pixel size is a synthesized pixel size that performs brightness compensation on the infrared image corresponding to the output of the second pixel 161 and the visible light image corresponding to the output of the first pixel 121, and the clearer synthesized pixel size is a synthesized pixel size that performs detail compensation on the visible light image corresponding to the output of the second pixel 161 and the infrared image corresponding to the output of the second pixel 161 by the output of the first pixel 121.

In order to meet the requirement of image synthesis, the first camera 21a and the second camera 21b may optimize the position accuracy through active focusing control, the position accuracy assembly between the first camera 21a and the second camera 21b is to be actively focused, then the first image sensor chip 120 and the first lens 140 may optimize the optical axis position accuracy of the first camera 21a through active focusing control, the second image sensor chip 160 and the second lens 180 may optimize the position accuracy of the second camera 21b through active focusing control, and finally the first camera 21a and the second camera 21b may optimize the position accuracy of the binocular camera 21 through active focusing control. The "active focusing control" herein generally refers to an assembly process of a single camera module and an assembly process of a whole binocular camera, wherein the assembly of the single camera module is completed in one process by adjusting factors affecting optical characteristics, such as a height, a rotation angle, and an inclination angle, of the first lens 140 with respect to the first image sensor chip 120, and the assembly of the single camera module is completed in one process by adjusting factors affecting optical characteristics, such as a height, a rotation angle, and an inclination angle, of the second lens 180 with respect to the second image sensor chip 160; finally, the assembly of the binocular camera 21 is completed by adjusting the optical axis control between the first camera 21a and the second camera 21b in the geometric relationship. The first reader 123 of the binocular camera 21 generates and outputs an image 1 signal, which is an image corresponding to visible light for capturing the head of the user, by the first reader 123 under the control of the first control unit 122 upon receiving the signal of the first pixel 121; the second reader 163 generates and outputs an image 2 signal, which is an image corresponding to infrared light for capturing eyes of the user, under the control of the second control unit 162, upon receiving the signal of the second pixel 161 from the second reader 163.

Finally, the method of the present application is only a preferred embodiment and is not intended to limit the scope of the present invention. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims

1. A biometric identification method, comprising:

s3, carrying out biological recognition on the user in the biological recognition area range;

the first image signal is an image signal for shooting the head of a user to capture corresponding visible light; the second image signal is an image signal of an eye portion used for shooting to capture corresponding infrared light.

2. The biometric method according to claim 1, wherein the head biometric information includes face contour, vein distribution information; the eye biological characteristic information comprises iris, retina and eye pattern information.

3. The biometrics authentication method according to claim 1, characterized in that in step S1, the first image signal is an RGB image signal, and the second image signal is a BW image signal.

4. The biometric authentication method according to claim 3, wherein the step S2 specifically comprises:

5. The biometric identification method according to claim 4, wherein the depth information of the user is obtained by performing feature point matching by using a binocular vision technique based on feature point features extracted from the first image signal and the second image signal, screening a certain point appearing in both images, and restoring three-dimensional coordinates of the matched point.

6. The biometric authentication method according to claim 4, wherein the step S3 specifically comprises:

7. The biometric authentication method according to claim 6, wherein the step S3 further comprises processing and combining the first image signal and the second image signal, and outputting and displaying the processed and combined image when it is detected that the user is not in the biometric authentication area or the authentication fails.

8. The biometric authentication method according to claim 5, wherein in the steps S2 and S3, after the matching is completed, an authentication result signal is outputted, and the authentication result signal includes an image signal and a sound signal.

9. A biometric identification system comprising an image acquisition module and a system processor;

the system processor is used for synthesizing and calculating the depth information of the user according to the first image signal and the second image signal, and performing identity recognition based on the depth information, the biological characteristic information of the head of the user and the biological characteristic information of the eyes of the user;

the image acquisition module captures visible light optical signals of the head of a user and outputs first image signals, and captures infrared light optical signals of the eyes of the user and outputs second image signals, wherein the first image signals are RGB image signals, and the second image signals are BW image signals.

10. The biometric method according to claim 9, wherein the head biometric information includes face contour, vein distribution information; the eye biological characteristic information comprises iris, retina and eye pattern information.

11. The biometric authentication method according to claim 9, wherein the system processor comprises a color image processor, a black and white image processor, a synthesizing unit, an authentication unit, and a judging unit;

12. The biometric identification system according to claim 11, further comprising a prompting unit configured to output an authentication result signal after the matching is completed, wherein the authentication result signal includes an image signal and a sound signal.

13. The biometric identification system according to claim 11, wherein the identification unit includes a first identification unit and a second identification unit;

14. The biometric identification system according to claim 11, wherein the synthesis unit includes a depth acquisition sub-block and an image synthesis sub-block;

15. The biometric authentication system according to claim 11, further comprising a display unit for displaying user image information and authentication result information.

16. A biological recognition device is characterized by comprising a binocular camera and a system processor chip;

the system processing chip is used for synthesizing and calculating the depth information of the user according to the first image signal and the second image signal and carrying out identity recognition based on the depth information, the biological feature information of the head of the user and the biological feature information of the eyes of the user; the first camera is a visible light shooting device, and the second camera is an infrared light shooting device.

17. The biometric recognition device of claim 16, wherein the exposure times of the first camera and the second camera are the same or different.

18. The biometric identification device of claim 17, wherein the first camera comprises a first lens, a first filter, and a first image sensor chip; the second camera comprises a second lens, a second optical filter and a second image sensor chip; the first camera.

19. The biometric apparatus of claim 18, wherein the first filter is an infrared cut filter for filtering infrared light other than the captured visible light, and the second filter is an infrared filter for filtering visible light other than the captured infrared light.

20. The biometric apparatus according to claim 18, wherein the first image sensor is an RGB image sensor for capturing a color image; the second image sensor is a BW image sensor and is used for shooting black and white images.

21. The biometric recognition device of claim 18, wherein the first lens is a wide angle lens for capturing an image of a user's head and the second lens is a narrow angle lens for capturing an image of a user's eyes.

22. The biometric identification device of claim 18, further comprising a circuit board assembly on which the binocular camera and the system processor chip are mounted.

23. The biometric identification device of claim 22, wherein the first camera further comprises a first base having a through hole, the second camera further comprises a second base having a through hole, the first filter and the first lens are mounted on the circuit board assembly via the first base, and the second filter and the second lens are mounted on the circuit board assembly via the second base.

24. The biometric identification device of claim 18, wherein the binocular camera further comprises an active focusing device for adjusting the relative position of the first lens and the first image sensor chip, the relative position of the second lens and the second image sensor chip, and the optical axis position of the first camera and the second camera.

25. The biometric identification device of claim 18, wherein the first image sensor chip further comprises a first control unit for controlling exposure times of the first pixels, the reader, and the first pixels of the first image sensor chip; the second image sensor chip further comprises a second control unit for controlling exposure times of second pixels, the reader and the second pixels of the second image sensor chip.

26. The biometric recognition device of claim 16, wherein the head biometric information includes facial contours, vein distribution information; the eye biological characteristic information comprises iris, retina and eye pattern information.

27. The biometric recognition device of claim 16, wherein the first camera is a fixed exchange camera module or an auto focus camera module or an optical zoom camera module.

28. The biometric identification device according to claim 16, wherein the system processor chip comprises an image processor, a judgment unit, and an identification unit;

29. The biometric identification device of claim 28, wherein the image processor comprises a color image processor, a black and white image processor, and a synthesis unit;

30. The biometrics authentication device as recited in claim 29, wherein the synthesis unit comprises a depth acquisition sub-block and an image synthesis sub-block;

31. The biometrics authentication device according to claim 16, characterized by further comprising a display unit for displaying user image information and authentication result information.

32. The biometric apparatus according to claim 16, further comprising a presentation unit configured to output an authentication result signal after the end of the matching, wherein the authentication result signal includes an image signal and a sound signal.

33. The biometric identification system of claim 28, wherein the identification unit comprises a first identification unit and a second identification unit;