WO2020191595A1

WO2020191595A1 - Biological feature recognition device and method, and electronic device

Info

Publication number: WO2020191595A1
Application number: PCT/CN2019/079586
Authority: WO
Inventors: 蒋鹏
Original assignee: 深圳市汇顶科技股份有限公司
Priority date: 2019-03-25
Filing date: 2019-03-25
Publication date: 2020-10-01
Also published as: CN110741382A

Abstract

The embodiments of the present application provide a biological feature recognition device and method, and an electronic device. The biological feature recognition device comprises: a first light emitter, a second light emitter, and an image sensor; the first light emitter is used for generating a first light signal, and the first light signal passes through a glass cover plate above the image sensor and is reflected to the lower portion of the glass cover plate by means of a finger on the glass cover plate; the second light emitter is used for generating a second light signal, and the second light signal is emitted obliquely to the finger and is scattered to the lower portion of the glass cover plate by means of subcutaneous tissues inside the finger; and the image sensor is used for performing fingerprint recognition according to the first light signal reflected by the finger, and performing vein recognition according to the second light signal scattered by the subcutaneous tissues inside the finger. The biological feature recognition device and method, and the electronic device in the embodiments of the present application are beneficial to improving the security and convenience of the biological feature recognition device.

Description

Biometric identification device, method and electronic equipment

Technical field

The embodiments of the present application relate to the field of biometric identification technology, and more specifically, to a biometric identification device, method, and electronic equipment.

Background technique

With the rapid development of the mobile phone industry, biometric identification devices can be fingerprint identification devices that use optical fingerprint identification technology, ultrasonic fingerprint identification technology, and capacitive fingerprint identification technology. These technologies only have a single identification function and are relatively low in security. The biometric identification device can also be a finger vein identification device, which is usually large in size, which is not conducive to application miniaturization and integration. Therefore, the disclosed biometric identification device has been unable to meet people's requirements for safety and convenience.

Summary of the invention

In view of this, the embodiments of the present application provide a biometric identification device, method, and electronic equipment, which are beneficial to improving the safety and convenience of the biometric identification device.

In a first aspect, a biometric identification device is provided, including: a first light emitter, a second light emitter, and an image sensor, wherein the first light emitter is used to generate a first light signal, and the first light emitter The light signal is used to pass through the glass cover plate above the image sensor, and is reflected by the finger on the glass cover plate to the bottom of the glass cover plate; the second light emitter is used to generate a second light signal, The second light signal is used for obliquely hitting the finger, and is scattered under the glass cover through the subcutaneous tissue inside the finger; the image sensor is used for according to the first light reflected by the finger Optical signal, fingerprint recognition, and vein recognition based on the second light signal scattered through the subcutaneous tissue inside the finger.

Optionally, the first optical signal is an infrared optical signal, and the second optical signal is an infrared optical signal. It is possible to combine the optical fingerprint recognition technology and the vein recognition technology through the light method of different space, based on the principle of frustrated total reflection optical fingerprint recognition and the imaging of the scattered light of the veins inside the finger, and a high degree of biometric security can be achieved.

In a possible implementation manner, the first light signal generated by the first light emitter is used to be reflected under the glass cover through the pad of the finger; the second light emitter The generated second light signal is used to scatter under the glass cover through the subcutaneous tissue in the knuckle of the finger.

In a possible implementation manner, the first light emitter is arranged below the glass cover or the side of the glass cover, and the second light emitter is arranged above the glass cover .

In a possible implementation manner, the glass cover plate has a square shape, and the first light emitter and/or the second light emitter are arranged on four sides of the glass cover plate.

In a possible implementation, the first light emitter is arranged at two opposite sides of the glass cover, and the second light emitter is arranged at the other two pairs of the glass cover. The position of the edge.

In a possible implementation manner, the glass cover is circular, and the first light emitter and/or the second light emitter are arranged in a circular ring around the glass cover. position.

In a possible implementation, the outer edge of the circular ring formed by the lighting area of the first light emitter overlaps the inner edge of the circular ring formed by the lighting area of the second light emitter.

In a possible implementation manner, the biometric identification device further includes: an optical waveguide for guiding the first optical signal into the glass cover plate.

In a possible implementation manner, the biometric identification device further includes: an optical component, which is arranged between the glass cover and the image sensor, and is used to transmit the first light reflected by the finger The signal and the second light signal scattered through the subcutaneous tissue inside the finger are transmitted to the image sensor.

In a possible implementation manner, the optical component includes a periodic small hole array, a micro-telecentric lens array group, a macro lens, or a periodic fiber waveguide.

In a possible implementation, the micro-telecentric lens array group includes an object-side telecentric lens array, or the micro-telecentric lens array group includes a bi-telecentric lens array and an object-side telecentric lens array. The bi-telecentric lens array is arranged above the object-side telecentric lens array.

In a possible implementation, the biometric identification device further includes: a filter, which is arranged between the glass cover and the image sensor, and is configured to correct the first light reflected by the finger The signal and the second light signal scattered through the subcutaneous tissue inside the finger are filtered.

In a possible implementation manner, the first light emitter and the second light emitter alternate lighting.

In a possible implementation manner, the first light emitter and the second light emitter are illuminated at the same time, the image sensor includes: a first image sensor unit, and the first light signal passes through the finger After reflection from the finger pad, the first image sensor unit is used to perform fingerprint recognition on the first light signal reflected by the finger pad; the second image sensor unit, After the second light signal is scattered by the subcutaneous tissue in the knuckle of the finger, it is transmitted to the second image sensor unit, and the second image sensor unit is used to scatter the subcutaneous tissue in the knuckle. The second light signal for vein recognition.

In a possible implementation manner, the lighting method of the first light emitter and/or the second light emitter during lighting is direct current lighting or periodic lighting.

In a possible implementation manner, the infrared light band of the second optical signal is 840 nm or 940 nm.

In a possible implementation manner, the biometric identification device further includes the glass cover plate.

In a second aspect, a biometric identification method is provided, which is applied to a biometric identification device, the biometric identification device includes: a first light emitter, a second light emitter, and an image sensor, the biometric identification method The method includes: the first light emitter generates a first light signal, the first light signal is used to pass through a glass cover plate above the image sensor, and is reflected to the glass by a finger on the glass cover plate Below the cover; the second light emitter generates a second light signal, the second light signal is used to obliquely hit the finger, and scatter through the subcutaneous tissue inside the finger to the bottom of the glass cover The image sensor performs fingerprint recognition based on the first light signal reflected by the finger, and performs vein recognition based on the second light signal scattered through the subcutaneous tissue inside the finger.

In a possible implementation manner, the first light signal is used to be reflected under the glass cover through the pad of the finger, and the second light signal is used to be reflected in the knuckles of the finger. The subcutaneous tissue scatters under the glass cover plate.

In a possible implementation manner, the glass cover plate is circular, and the first light emitter and/or the second light emitter are arranged around the glass cover plate in an annular manner s position.

In a possible implementation manner, the outer edge of the ring formed by the lighting area of the first light emitter overlaps the inner edge of the ring formed by the lighting area of the second light emitter.

In a possible implementation manner, the image sensor performs fingerprint recognition based on the first light signal reflected by the finger, and performs venous identification based on the second light signal scattered by the subcutaneous tissue inside the finger. The recognition includes: the image sensor alternately performs fingerprint recognition based on the first light signal reflected by the finger, and performs vein recognition based on the second light signal scattered through the subcutaneous tissue inside the finger.

In a possible implementation, the image sensor includes a first image sensor unit and a second image unit, and the image sensor performs fingerprint recognition according to the first light signal reflected by the finger, and according to the The second light signal scattered by the subcutaneous tissue inside the finger to perform vein recognition includes: the first image sensor unit performs fingerprint recognition according to the first light signal reflected by the finger pad, and the second The second image sensor unit performs vein recognition based on the second light signal scattered by the subcutaneous tissue in the knuckle.

In a possible implementation manner, the first optical signal is an infrared optical signal, and the second optical signal is an infrared optical signal.

In a third aspect, an electronic device is provided, including the biometric identification device described in the first aspect or any possible implementation of the first aspect.

In a possible implementation, the electronic device includes: a control circuit for controlling the first optical transmitter to generate the first optical signal and the second optical transmitter to generate the second optical signal .

In practical applications, the control circuit can be set in the biometric identification device, or can also be set in the electronic equipment installed in the biometric identification device, that is, the function of the control circuit can be implemented in the electronic device, or also It can be implemented partly in the biometric identification device and partly in electronic equipment.

In a possible implementation, the biometric identification device is arranged on the back or side of the electronic device.

These and other aspects of the application will be more concise and understandable in the description of the following embodiments.

Description of the drawings

Fig. 1 is a schematic diagram of a biometric identification device provided by an embodiment of the present application.

Fig. 2 is a schematic diagram of an implementation manner of the biometric identification device provided by an embodiment of the present application.

Fig. 3 is a schematic diagram of another implementation manner of the biometric identification device provided by an embodiment of the present application.

FIG. 4 is a schematic diagram of a layout of the first light emitter and the second light emitter according to an embodiment of the present application.

FIG. 5 is a schematic diagram of another layout of the first light emitter and the second light emitter according to an embodiment of the present application.

Figure 6 shows the imaging principle diagram of the object-side telecentric lens.

Figure 7 shows the imaging principle diagram of the image-side telecentric lens.

Figure 8 shows the imaging principle diagram of the bi-telecentric lens.

FIG. 9 is a schematic diagram of another implementation manner of the biometric identification device provided by the embodiment of the present application.

Fig. 10 is a schematic diagram of a biometric identification method provided by an embodiment of the present application.

FIG. 11 is a schematic diagram of the installation of the biometric identification device provided in an embodiment of the present application in an electronic device.

detailed description

In order to enable those skilled in the art to better understand the technical solutions in the embodiments of the present application, the technical solutions in the embodiments of the present application will be described clearly and completely in conjunction with the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in this application, all other embodiments obtained by those of ordinary skill in the art should fall within the protection scope of the embodiments of this application.

The biometric identification device involved in the embodiments of the present application can be applied to smart phones, tablet computers, notebook computers, desktops, and other mobile terminals or other terminal devices with biometric identification devices. The biometric information includes, but is not limited to: any one or more of fingerprints, iris, retina, genes, voices, human faces, palm geometry, veins, gait, and handwriting.

Fingerprint identification devices that have been disclosed and applied to terminal equipment can use off-screen optical fingerprint identification technology, ultrasonic fingerprint identification technology, capacitive fingerprint identification technology, etc. These technologies only have a single identification function, and their security is relatively low.

Finger veins are the internal information of the living body, which is unique and non-replicable, and finger vein authentication adopts living body authentication technology, so the security is higher. The current finger vein recognition devices are usually large in size, which is not conducive to miniaturization and integration of applications, and is not conducive to being directly used in mobile phones and other occasions.

Therefore, the embodiment of the present application provides a biometric identification device, which may be a device that integrates fingerprint identification and vein identification. The biometric identification device provided by the embodiment of the present application can solve the problem of single identification of the existing biometric identification device, so as to be safe; in addition, the biometric identification device of the embodiment of the present application facilitates the miniaturization and integration of applications, which can directly Used in terminal equipment such as mobile phones.

It should be understood that the biometric recognition device of the embodiment of the present application may also be a device that integrates palm print recognition and palm vein recognition. Or, it may also be the above-mentioned devices combined with other biometric technologies, which is not limited in the embodiment of the present application.

Fig. 1 shows a schematic diagram of a biometric identification device 100 provided by an embodiment of the present application. As shown in FIG. 1, the biometric identification device 100 may include: a first light emitter 110, a second light emitter 120, and an image sensor 130, wherein,

The first light emitter 110 is used to generate a first light signal, and the first light signal is used to pass through the glass cover plate above the image sensor 130, and is reflected by the finger on the glass cover plate. Below the glass cover;

The second light emitter 120 is used to generate a second light signal, the second light signal is used to obliquely hit the finger, and scatter through the subcutaneous tissue inside the finger to below the glass cover;

The image sensor 130 is configured to perform fingerprint recognition based on the first light signal reflected by the finger, and perform vein recognition based on the second light signal scattered through the subcutaneous tissue inside the finger.

It should be noted that the optical signals emitted by the first light emitter and the second light emitter in the embodiments of the present application can be infrared light or other light. For example, the light signal used for fingerprint recognition can be green light. Wait for visible light. Preferably, the first optical signal generated by the first optical transmitter is an infrared optical signal, and the second optical signal generated by the second optical generator is also an infrared optical signal. Optionally, the optical wavelength band of the infrared light signal used for fingerprint identification may be 840 nm or 940 nm.

To facilitate understanding, first take infrared light as an example to introduce the principle of fingerprint recognition and finger vein recognition in the embodiments of the present application.

1. Optical fingerprint recognition based on the principle of frustrated total reflection. When the near-infrared light propagates in the thin glass cover, the light in the glass cover is almost in a state of total reflection, and the upper and lower parts of the glass cover are almost opaque. When a finger presses on the glass cover, the ridge of the fingerprint will contact the upper surface of the glass cover, destroying the total reflection state of the local area, and then reflect light to the bottom of the glass cover. An image sensor and its supporting electronic system are placed under the glass cover to perform imaging recognition of fingerprints.

2. Principle of finger vein recognition. Vein recognition technology is a biometric technology that uses light propagation technology to compare and recognize finger veins. Each person’s fingers or palms are distributed with specific arrangements of veins. The blood in the vein has low oxygen content, and its absorption rate of infrared light is large, while the light absorption rate of the biological tissue around the vein is small. Because of the uniqueness and stability of the shape of finger veins, each person's finger vein images are different, and the vein images of different fingers of the same person are also different. Based on this, the vein distribution image of the finger can be used for user identification. Specifically, the light can be illuminated from the side of the finger toward the knuckles. The light propagates and scatters inside the vein and the subcutaneous tissue of the finger, and a part of the light is incident on the image sensor from the vertical direction. After the image sensor receives the image, the vein can be accurately displayed and further identified through operations such as image preprocessing and feature enhancement.

It should be understood that finger vein recognition may be based on any subcutaneous tissue inside the finger, for example, it may be a vein inside the finger, specifically, it may be a vein in a finger belly, a vein in a finger joint, and the like.

Optionally, in the embodiment of the present application, the first light signal generated by the first light emitter is used to reflect under the glass cover through the pad of the finger; the second light The second light signal generated by the transmitter is used to be scattered under the glass cover through the subcutaneous tissue in the knuckle of the finger. Any spatial layout that can meet the above-mentioned optical path can be the technical solution to be protected by this application. For example, the first light emitter is arranged below the glass cover or the side surface of the glass cover, and the second light emitter is arranged above the glass cover. Figure 2 shows that the first light emitter is arranged on the side of the glass cover, and the second light emitter is arranged above the glass cover. 3 shows that the first light emitter is arranged under the glass cover, and the second light emitter is arranged above the glass cover. As shown in Figure 2, the second light emitter is arranged on the upper edge of the glass cover, and the first light emitter is arranged on the side of the glass cover. As shown in Fig. 3, the second light emitter is arranged on the upper edge of the glass cover, and the first light emitter is arranged on the lower edge of the glass cover. It should be understood that FIG. 2 and FIG. 3 are only for illustration and not for limitation. For example, if the size of the glass cover matches the size of the image sensor, the second light emitter may be arranged on the upper edge of the glass cover. For another example, if the size of the glass cover is much larger than the image sensor (such as the size of the back cover of a mobile phone), the second light emitter is not located on the upper edge of the glass cover, but slightly above the glass cover and close to the center of the glass cover s position.

Optionally, the first light emitter and the second light emitter arranged around the glass cover plate may be a circular layout or a square layout. In a possible embodiment, the glass cover has a square shape, and the first light emitter and/or the second light emitter are arranged on four sides of the glass cover. For example, the first light emitter is arranged around the side of the glass cover or around the edge of the glass cover under the glass cover. The second light emitter is arranged above the glass cover and along the periphery of the glass cover. Wherein, the lighting area of the first light emitter and the lighting area of the second light emitter may completely overlap, or may partially overlap or not overlap. For another example, as shown in FIG. 4, the first light emitter is arranged at two opposite sides of the glass cover plate, and the second light emitter is arranged at the other two pairs of the glass cover plate. The position of the edge. In another possible embodiment, the glass cover is circular, the glass cover is circular, and the first light emitter and/or the second light emitter are arranged in a circular ring The location around the glass cover. For example, the first light emitter is arranged around the edge of the glass cover under the glass cover, and the second light emitter is arranged around the edge of the glass cover above the glass cover. Wherein, the lighting area of the first light emitter and the lighting area of the second light emitter may completely overlap, or may partially overlap or not overlap. For another example, as shown in FIG. 5, the outer edge of the circular ring formed by the lighting area of the first light emitter overlaps the inner edge of the circular ring formed by the light emitting area of the second light emitter.

Optionally, in some embodiments, the first light emitter and the second light emitter may be light emitting diodes (LED), laser diodes (LD), or photodiodes capable of generating infrared light. In some other embodiments, the first light emitter and the second light emitter may be vertical cavity surface emitting lasers (VCSELs) or other semiconductor lasers, which are not limited in the embodiments of the present application.

Optionally, in this embodiment of the present application, the biometric identification device may further include an optical waveguide. The optical waveguide is a dielectric device that guides the propagation of optical signals, and is also called a dielectric optical waveguide. For example, the optical waveguide can guide the first optical signal into the glass dry plate, and its setting position is shown in FIG. 2. The optical waveguide can also illuminate the second optical signal toward the area above the glass. Specifically, in the embodiment of the present application, the first optical signal can be guided into the glass cover through the optical waveguide. When the fingerprint or knuckle is pressed on the biometric area, based on the principle of frustrated total reflection, the ridge line of the fingerprint will reflect Part of the optical signal, while reflecting this part of the optical signal to the image sensor under the glass cover; or through the optical waveguide, the second optical signal can be directly illuminated to the area above the glass cover, and these optical signals are irradiated on both sides of the finger , Illuminate the vein area inside the knuckles. These light signals will be scattered inside the finger, and there is a difference in the light absorption rate between the veins inside the knuckles and the biological tissues around the veins. This difference will be imaged on the image sensor in the form of light signal transmission.

Optionally, in the embodiment of the present application, the biometric identification device further includes: an optical component, which is disposed between the glass cover and the image sensor, and is configured to reflect the second image reflected by the finger. A light signal and the second light signal scattered through the subcutaneous tissue inside the finger are transmitted to the image sensor.

Wherein, the light guide layer or light path guide structure of the optical component has multiple implementation solutions, such as periodic pinhole arrays, micro-telecentric lens array groups, macro lenses, or periodic fiber waveguides. Among them, the periodic small hole array can receive almost vertical light for imaging. The short focal length object telecentric lens array can also be used for ultra-thin optical imaging, and the thickness of these two solutions can be ultra-thin. You can also use a macro lens, which is similar to a mobile phone lens but has a shorter focal length and can be used for imaging, but it is thicker. Compared with imaging devices in the form of a periodic small hole solution or a short focal length object-side telecentric lens array, the macro lens has a thicker module.

Specifically, in an embodiment, the light guide layer may specifically be a collimator (Collimator) layer fabricated on a semiconductor silicon wafer, which has a plurality of collimator units or microhole arrays, and the collimator The unit may specifically be a small hole. The light signal reflected from the finger or the light signal scattered back through the subcutaneous tissue inside the finger, the light that is perpendicularly incident on the collimating unit can pass through and be received by the image sensor below it.

In another embodiment, the light guide layer or the light path guide structure may also be an optical lens (Lens) layer, which has one or more lens units, such as a lens group composed of one or more aspheric lenses, which It is used to converge the light signal reflected from the finger or the light signal scattered back through the subcutaneous tissue inside the finger to the image sensor below it, so that the image sensor can perform imaging based on the received light signal, thereby obtaining the finger Fingerprint image and vein image.

In another alternative embodiment, the light guide layer or the light path guide structure may also specifically adopt a micro-lens (Micro-Lens) layer, and the micro-lens layer has a micro-lens array formed by a plurality of micro-lens, It can be formed above the image sensor through a semiconductor growth process or other processes. The light signal reflected from the finger or the light signal scattered back through the subcutaneous tissue inside the finger is condensed by the microlens array and transmitted to the image below it. sensor. It should be understood that several implementation solutions of the above-mentioned optical path guiding structure can be used alone or in combination. For example, a microlens layer can be further provided under the collimator layer or the optical lens layer. Of course, when the collimator layer or the optical lens layer is used in combination with the micro lens layer, its specific laminated structure or optical path may need to be adjusted according to actual needs.

In other embodiments, the light guide layer or light path guide structure may also be a macro lens or a periodic optical fiber waveguide.

Optionally, in the embodiment of the present application, the light guide layer or the light path guide structure may also be a micro telecentric lens array group as shown in FIG. 2 or FIG. 3.

The so-called telecentric lens is essentially a combination of ordinary lens and small aperture imaging principle. It can be within a certain object distance range, so that the obtained image magnification does not change, does not change with the depth of field, and has no parallax. Applying it to biometric recognition technology can improve the accuracy of biometric recognition.

Generally, telecentric lenses can be divided into object-side telecentric lenses, image-side telecentric lenses and bi-telecentric lenses. Hereinafter, the principles of various telecentric lenses will be explained in conjunction with FIGS. 6 to 8.

Figure 6 shows the imaging principle of an object-side telecentric lens. As shown in Figure 6, an aperture diaphragm is placed at the image focal plane of the ordinary lens. The function of this aperture diaphragm is to allow only parallel incident object light (such as light 1 and light 2) to reach the image plane for imaging. From the geometric relationship, it can be seen that there is no relationship between near and far. In other words, it is equivalent to the object at infinity.

Figure 7 shows the imaging principle of an image-side telecentric lens. As shown in Figure 7, an aperture stop is placed at the object focal plane of the ordinary lens to make the principal rays of the image side (such as ray 1 and ray 2) parallel to the optical axis, and the magnification and image distance of the image side telecentric lens Irrelevant.

Figure 8 shows the imaging principle of a bi-telecentric lens. As shown in Figure 8, the dual telecentric lens has the advantages of both the object-side telecentric lens and the image-side telecentric lens. It consists of two sets of lenses (such as lens 1 and lens 2). The confocal surface of the two sets of lenses is equipped with an aperture stop, so that the principal rays (such as ray 1 and ray 2) are aligned with the optical axis on the object and image sides. parallel.

Since a single telecentric lens is used for imaging, a relatively large imaging surface is usually required, so the entire lens group is relatively thick. However, after the telecentric lens is arrayed and miniaturized, it can image objects at a certain distance, which can be used in biometrics. Therefore, the light guide layer or the light path guide structure in the optical assembly may be a micro telecentric lens array group.

The micro-telecentric lens array group, as the name suggests, can be a combination of various arrayed and miniaturized telecentric lens units. For example, the micro-telecentric lens array group only includes the object-side telecentric lens array, as shown in Figures 2 and 3, a micro-aperture diaphragm is placed at the focal point behind the lens to allow the light signal from the object side to enter the lens at a parallel angle , The aperture diaphragm is the focal point of the lens, so that the light from the object can be concentrated at the focal point to improve the receiving efficiency of the image sensor. For another example, as shown in FIG. 9, the micro-telecentric lens array group may include a bi-telecentric lens array and an object-side telecentric lens array, and the object-side telecentric lens array may be arranged below the bi-telecentric lens array, wherein The bi-telecentric lens array mainly receives the light signal reflected by the human finger or the light signal scattered by the subcutaneous tissue inside the finger, and it receives the light signal at a small angle in the vertical direction; and the object-side telecentric lens array It is used to collimate and focus the light signal transmitted from the bi-telecentric lens array, and the sensing array of the image sensor can receive the light signal transmitted from the object-side telecentric lens array and perform imaging based on the light signal.

Optionally, in this embodiment of the present application, the biometric identification device further includes:

The filter is arranged between the glass cover and the image sensor, and is used for detecting the first light signal reflected by the finger and the second light signal scattered by the subcutaneous tissue inside the finger To filter. Optionally, the filter can be arranged between the image sensor and the optical component. It should be understood that, in specific implementation, the position of the filter is not limited to below the optical component, it can also be included inside the optical component, or it can also include two layers of filters, which are respectively arranged above the optical component And below. It can even be omitted, which is not limited in this application.

It should be understood that the filter can be used to reduce undesired background light to improve the optical sensitivity of the image sensor to the received light. For example, the filter may be an infrared narrowband filter.

Optionally, the first light emitter and the second light emitter may alternate lighting. For example, independent circuits can be used to control the on and off of the lights of the first light emitter and the second light emitter. At this time, the image sensor used for fingerprint recognition and the image sensor used for vein recognition can be the same image sensor. The lighting area of the first light emitter and the lighting area of the second light emitter may or may not overlap. In this case, the sequence of fingerprint recognition and vein recognition is not limited.

Optionally, the first light emitter and the second light emitter can be illuminated at the same time. At this time, the image sensor used for fingerprint recognition and the image sensor used for vein recognition may not be the same image sensor. For example, the image sensor includes: a first image sensor unit, the first light signal is transmitted to the first image sensor unit after being reflected by the fingertips of the finger, and the first image sensor unit is used to The first light signal reflected by the finger pad is used for fingerprint identification; the second image sensor unit, the second light signal is scattered by the subcutaneous tissue in the knuckle of the finger, and then transmitted to the second An image sensor unit, where the second image sensor unit is configured to perform vein recognition on the second light signal scattered through the subcutaneous tissue in the knuckle joint. Wherein, the first image sensor unit and the second image sensor unit may each be a complete image sensor, or may respectively include part of the sensing unit in an image sensor. In other words, while the first image sensor unit performs fingerprint recognition, the second image sensor unit can perform vein recognition.

Optionally, the image sensor may be a complementary metal oxide semiconductor (Complementary Metal Oxide Semiconductor, CMOS) image sensor. The CMOS image sensor has a more mature technology, and the range of the center sensitive wavelength is easier to achieve through process doping, and the cost is relatively higher than that of charge coupled devices. (Charge-coupled Device, CCD) is low, and the drive circuit is simpler than CCD. The image sensor may also use other types of image sensors, which are not limited in the embodiment of the present application.

Optionally, the glass cover in the embodiment of the present application may be a glass cover of an electronic device, or it may be packaged with the biometric identification device. That is, the biometric identification device in the embodiment of the present application may include the glass cover plate.

Multi-frame short exposure can be used to quickly obtain multi-frame images to obtain more images, and then do more accurate recognition.

Optionally, the biometric identification device provided in the embodiment of the present application can also be used to detect other biometric data, for example, the heartbeat or heart rate of the user can also be detected during fingerprint scanning. Therefore, the biometric identification device in the disclosed technology can be a multifunctional biometric identification device that can provide secure access to electronic equipment, and can also provide other biometric data analysis, such as heartbeat or heart rate and other information representative of the living body. For example, by continuously acquiring multiple frames of images, the heart rate and other information representing the living body can be further extracted from the image data.

A specific embodiment provided by this application will be described below. A glass cover is placed above the image sensor, the lower surface of the glass cover is vapor-deposited with an infrared narrowband filter function film, and the CMOS image sensor is placed under the glass cover. There is a certain air layer between the glass cover and the CMOS image sensor. Optical waveguides are arranged around or on both sides or one side of the glass cover and the CMOS image sensor. The light guide guides the red LED light into the glass cover. An object-side telecentric microlens array is grown on the unit surface of each pixel on the surface of the image sensor. A micro-infrared LED array or an infrared LED light source is placed above the glass cover near the edge as a light source for the vein infrared lighting. The infrared LED can control the light on and off through an independent circuit. An independent circuit transmits the optical signal collected by the image sensor to a micro control unit (MCU) or other platform capable of processing information. The lighting method of the infrared LED can be DC lighting or periodic lighting. Among them, the periodic lighting method can weaken the interference of external light to a certain extent. By individually lighting the LED under the glass cover, the infrared light is guided into the glass for total reflection. When the finger presses the upper surface of the glass, the ridge part of the finger will reflect the light inside the glass into the image sensor under the glass, and the image will collect fingerprint data Do processing identification. By individually lighting the infrared LED above the glass cover, the light penetrates the finger or knuckle, the veins in the knuckle will be imaged on the image sensor, and the image can be collected for processing for vein recognition. High-security recognition can be achieved by fusing the results of fingerprint recognition and vein recognition. Through the method of acquiring images of multiple frames of veins, the heart rate signals of the living body can be extracted from the vein images, and then higher-level biosafety identification can be done.

Therefore, the biometric identification device provided by the embodiment of the present application can combine the ultra-thin optical fingerprint identification technology and the vein identification technology based on the principle of frustrated total reflection and the scattered light imaging of the internal veins of the finger through the lighting method in different space and time. In one, biological information can be extracted through multi-frame photographic image processing, which can further enhance the security of biometric identification. Combining multiple biometric technologies can achieve a high degree of biometric security.

Above, the biometric identification device of the embodiment of the present application has been described in detail with reference to FIGS. 1 to 9. Hereinafter, a biometric identification method 200 according to an embodiment of the present application will be introduced and explained with reference to FIG.

It should be understood that FIG. 10 shows the detailed steps or operations of the biometric identification method of the embodiment of the present application, but these steps or operations are only examples, and the embodiment of the present application may also perform other operations or various operations of FIG. 10 Deformed. In addition, each step in FIG. 10 may be performed in a different order from that shown in FIG. 10, and it may not be necessary to perform all the operations in FIG. 10.

The biometric identification method according to the embodiment of the present application can be applied to a biometric identification device. The biometric identification device is the above-mentioned biometric identification device 100. The biometric identification method can perform fingerprint identification and vein identification. The following will describe the biometric identification method of the embodiment of the present application with reference to FIG. 10. Of course, the biometric identification method of the embodiment of the present application may not be limited to fingerprint identification and vein identification, or the sequence of fingerprint identification and vein identification For adjustments, etc., the embodiment of the present application does not limit this.

As shown in FIG. 10, the method 200 includes some or all of the following contents:

S210. The first light emitter generates a first light signal, and the first light signal is used to pass through a glass cover plate above the image sensor and be reflected to the glass by a finger on the glass cover plate. Under the cover;

S220, the second light emitter generates a second light signal, the second light signal is used to obliquely hit the finger, and scatter under the glass cover through the subcutaneous tissue inside the finger;

S230. The image sensor performs fingerprint recognition based on the first light signal reflected by the finger, and performs vein recognition based on the second light signal scattered through the subcutaneous tissue inside the finger.

Wherein, the first light emitter, the second light emitter and the image sensor may be the first light emitter, the second light emitter and the image sensor in the biometric identification device 100 described above. For the specific working process, please refer to the relevant description above, which will not be repeated here.

Optionally, in the embodiment of the present application, the first optical signal is used to be reflected under the glass cover through the pad of the finger, and the second optical signal is used to be reflected through the finger of the finger. The subcutaneous tissue in the joint is scattered under the glass cover plate.

Optionally, in the embodiment of the present application, the first light emitter is arranged under the glass cover plate or the side of the glass cover plate, and the second light emitter is arranged on the glass cover plate Above.

Optionally, in the embodiment of the present application, the glass cover plate has a square shape, and the first light emitter and/or the second light emitter are arranged at four sides of the glass cover plate.

Optionally, in the embodiment of the present application, the first light emitter is arranged at two opposite sides of the glass cover plate, and the second light emitter is arranged at the other two sides of the glass cover plate. The position of the opposite side of the bar.

Optionally, in the embodiment of the present application, the glass cover plate has a circular shape, and the first light emitter and/or the second light emitter are arranged on the glass cover plate in an annular manner. Around the location.

Optionally, in the embodiment of the present application, the outer edge of the ring formed by the lighting area of the first light emitter and the inner edge of the ring formed by the lighting area of the second light emitter overlapping.

Optionally, in the embodiment of the present application, the image sensor performs fingerprint recognition based on the first light signal reflected by the finger, and based on the second light signal scattered through the subcutaneous tissue inside the finger, Performing vein recognition includes: the image sensor performs fingerprint recognition alternately based on the first light signal reflected by the finger, and performs vein recognition based on the second light signal scattered through the subcutaneous tissue inside the finger. Recognition.

Optionally, in the embodiment of the present application, the image sensor includes a first image sensor unit and a second image unit, and the image sensor performs fingerprint recognition according to the first light signal reflected by the finger, and according to the The second light signal scattered by the subcutaneous tissue inside the finger to perform vein recognition includes: the first image sensor unit performs fingerprint recognition according to the first light signal reflected by the finger pad, The second image sensor unit performs vein recognition based on the second light signal scattered by the subcutaneous tissue in the knuckle.

Optionally, in the embodiment of the present application, the lighting method of the first light emitter and/or the second light emitter during lighting is direct current lighting or periodic lighting.

Optionally, in the embodiment of the present application, the first optical signal is an infrared optical signal, and the second optical signal is an infrared optical signal.

Optionally, in this embodiment of the present application, the infrared light band of the second optical signal is 840 nm or 940 nm.

An embodiment of the present application also provides an electronic device, which includes the biometric identification device described in the foregoing various embodiments.

Optionally, the electronic device may further include a control circuit for controlling the first optical transmitter in the biometric identification device to generate the first optical signal and the second optical transmitter in the biometric identification device The second optical signal is generated. For example, the first light emitter and the second light emitter can be controlled to light alternately. For another example, it is possible to control whether the lighting mode of the first light emitter and/or the second light emitter is a periodic lighting mode or a DC lighting mode.

It should be understood that in practical applications, the control circuit can be provided in the biometric identification device, or can also be provided in the electronic equipment installed in the biometric identification device, that is, the function of the control circuit can be implemented in the electronic equipment , Or it may be implemented partly in the biometric identification device and partly in the electronic device, which is not limited in the embodiment of the present application.

Optionally, the biometric identification device can be installed on the back or side of the electronic device. Specifically, as shown in FIG. 11, the biometric identification device can be installed on the side or back of the electronic device where no buttons are provided. The electronic device also includes a display screen. For example, the electronic device may include a smart phone, a tablet computer, a notebook computer or a wearable device, etc., which is not limited in the embodiment of the present application.

Optionally, the electronic device may also include the above-mentioned glass cover.

It should be understood that the specific working process of the biometric identification device can be referred to the relevant description above, which will not be repeated here.

It should be understood that “one embodiment” or “an embodiment” mentioned throughout the specification means that a specific feature, structure, or characteristic related to the embodiment is included in at least one embodiment of the present application. Therefore, the appearance of "in one embodiment" or "in an embodiment" in various places throughout the specification does not necessarily refer to the same embodiment. In addition, these specific features, structures, or characteristics can be combined in one or more embodiments in any suitable manner.

A person of ordinary skill in the art may be aware that the units and circuits of the examples described in conjunction with the embodiments disclosed herein can be implemented by electronic hardware or a combination of computer software and electronic hardware. Whether these functions are executed by hardware or software depends on the specific application and design constraint conditions of the technical solution. Professionals and technicians can use different methods for each specific application to implement the described functions, but such implementation should not be considered beyond the scope of this application.

In the several embodiments provided in this application, it should be understood that the disclosed circuits, branches, and units may be implemented in other ways. For example, the branches described above are illustrative, for example, the division of the unit is only a logical function division, and there may be other divisions in actual implementation, for example, multiple units or components can be combined or integrated into A branch or some features can be ignored or not implemented.

If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer readable storage medium. Based on this understanding, the technical solution of this application essentially or the part that contributes to the existing technology or the part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including Several instructions are used to make a computer device (which may be a personal computer, a server, or a network device, etc.) execute all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage media include: U disk, mobile hard disk, read-only memory (Read-Only Memory, ROM), random access memory (Random Access Memory, RAM), magnetic disk or optical disk and other media that can store program code .

The above are only specific implementations of this application, but the protection scope of this application is not limited to this. Any person skilled in the art can easily think of changes or substitutions within the technical scope disclosed in this application. Should be covered within the scope of protection of this application. Therefore, the protection scope of this application shall be subject to the protection scope of the claims.

Claims

A biometric identification device, characterized in that the biometric identification device comprises: a first light emitter, a second light emitter and an image sensor, wherein,

The first light emitter is used to generate a first light signal, the first light signal is used to pass through the glass cover above the image sensor, and is reflected to the glass cover by a finger on the glass cover Under the board

The second light emitter is used to generate a second light signal, the second light signal is used to obliquely hit the finger, and scatter through the subcutaneous tissue inside the finger to below the glass cover;

The image sensor is used to perform fingerprint recognition based on the first light signal reflected by the finger, and perform vein recognition based on the second light signal scattered through the subcutaneous tissue inside the finger.
The biometric identification device according to claim 1, wherein the first light signal generated by the first light emitter is used to be reflected by the pad of the finger to below the glass cover; The second light signal generated by the second light emitter is used to scatter under the glass cover through the subcutaneous tissue in the knuckle of the finger.
The biometric identification device according to claim 1 or 2, wherein the first light emitter is arranged below the glass cover or the side of the glass cover, and the second light emitter It is arranged above the glass cover plate.
The biometric identification device according to claim 3, wherein the glass cover is square, and the first light emitter and/or the second light emitter are arranged on four sides of the glass cover s position.
The biometric identification device according to claim 4, wherein the first light emitter is arranged on two opposite sides of the glass cover, and the second light emitter is arranged on the glass. The position of the other two opposite sides of the cover.
The biometric identification device according to claim 3, wherein the glass cover is circular, and the first light emitter and/or the second light emitter are arranged in a circular ring. The location around the glass cover.
The biometric identification device according to claim 6, wherein the outer edge of the ring formed by the lighting area of the first light emitter and the ring formed by the lighting area of the second light emitter The inner edges of the shapes overlap.
The biometric identification device according to any one of claims 1 to 7, wherein the biometric identification device further comprises:

The optical waveguide is used to guide the first optical signal into the glass cover plate.
The biometric identification device according to any one of claims 1 to 8, wherein the biometric identification device further comprises:

The optical component is arranged between the glass cover and the image sensor, and is used to combine the first light signal reflected by the finger and the second light signal scattered by the subcutaneous tissue inside the finger To the image sensor.
The biometric identification device according to claim 9, wherein the optical component comprises a periodic small hole array, a micro-telecentric lens array group, a macro lens or a periodic fiber waveguide.
The biometric identification device according to claim 10, wherein:

The micro-telecentric lens array group includes an object-side telecentric lens array, or

The micro-telecentric lens array group includes a double-telecentric lens array and an object-side telecentric lens array, and the double-telecentric lens array is arranged above the object-side telecentric lens array.
The biometric identification device according to any one of claims 1 to 11, wherein the biometric identification device further comprises:

The filter is arranged between the glass cover and the image sensor, and is used for detecting the first light signal reflected by the finger and the second light signal scattered by the subcutaneous tissue inside the finger To filter.
The biometric identification device according to any one of claims 1 to 12, wherein the first light emitter and the second light emitter alternate lighting.
The biometric identification device according to any one of claims 1 to 12, wherein the first light emitter and the second light emitter are illuminated at the same time, and the image sensor comprises:

The first image sensor unit, the first light signal is transmitted to the first image sensor unit after being reflected by the finger pads of the finger, and the first image sensor unit is used to The first optical signal is used for fingerprint identification;

The second image sensor unit, the second light signal is transmitted to the second image sensor unit after being scattered by the subcutaneous tissue in the knuckle of the finger, and the second image sensor unit is used to The second light signal scattered by the subcutaneous tissue in the joint performs vein recognition.
The biometric identification device according to any one of claims 1 to 14, wherein the lighting method of the first light emitter and/or the second light emitter is direct current lighting. Light or periodic lighting.
The biometric identification device according to any one of claims 1 to 15, wherein the first optical signal is an infrared optical signal, and the second optical signal is an infrared optical signal.
The biometric identification device according to claim 16, wherein the infrared light waveband of the second optical signal is 840 nm or 940 nm.
The biometric identification device according to any one of claims 1 to 17, wherein the biometric identification device further comprises the glass cover.
A biometric identification method, characterized in that it is applied to a biometric identification device, the biometric identification device includes: a first light emitter, a second light emitter, and an image sensor, and the biometric identification method includes:

The first light emitter generates a first light signal, and the first light signal is used to pass through the glass cover plate above the image sensor, and is reflected to the glass cover plate by a finger on the glass cover plate Below

The second light emitter generates a second light signal, and the second light signal is used to obliquely hit the finger, and scatter under the glass cover through the subcutaneous tissue inside the finger;

The image sensor performs fingerprint recognition based on the first light signal reflected by the finger, and performs vein recognition based on the second light signal scattered through the subcutaneous tissue inside the finger.
The biometric identification method according to claim 19, wherein the first light signal is used to reflect under the glass cover through the pad of the finger, and the second light signal is used to pass through The subcutaneous tissue in the knuckle of the finger scatters to the bottom of the glass cover plate.
The biometric identification method according to claim 19 or 20, wherein the first light emitter is arranged below the glass cover or the side of the glass cover, and the second light emitter It is arranged above the glass cover plate.
The biometric identification method according to claim 21, wherein the glass cover is square, and the first light emitter and/or the second light emitter are arranged on four sides of the glass cover s position.
The biometric identification method according to claim 22, wherein the first light emitter is arranged at two opposite sides of the glass cover, and the second light emitter is arranged on the glass. The position of the other two opposite sides of the cover.
The biometric identification method according to claim 21, wherein the glass cover is circular, and the first light emitter and/or the second light emitter are arranged in a circular ring The location around the glass cover.
The biometric identification method according to claim 24, wherein the outer edge of the ring formed by the lighting area of the first light emitter and the circle formed by the lighting area of the second light emitter The inner edges of the loop overlap.
The biometric identification method according to any one of claims 19 to 25, wherein the image sensor performs fingerprint identification based on the first light signal reflected by the finger, and based on the The second light signal scattered by the subcutaneous tissue for vein recognition includes:

The image sensor alternately performs fingerprint recognition based on the first light signal reflected by the finger and performs vein recognition based on the second light signal scattered through the subcutaneous tissue inside the finger.
The biometric identification method according to any one of claims 19 to 25, wherein the image sensor comprises a first image sensor unit and a second image unit, and the image sensor is based on the first image reflected by the finger. A light signal to perform fingerprint recognition, and to perform vein recognition based on the second light signal scattered through the subcutaneous tissue inside the finger, including:

While the first image sensor unit performs fingerprint recognition based on the first light signal reflected by the finger pad, the second image sensor unit is based on the second light scattered by the subcutaneous tissue in the knuckle joint. Signal, perform vein recognition.
The biometric identification method according to any one of claims 19 to 27, wherein the lighting method of the first light emitter and/or the second light emitter is direct current lighting. Light or periodic lighting.
The biometric identification method according to any one of claims 19 to 28, wherein the first optical signal is an infrared optical signal, and the second optical signal is an infrared optical signal.
The biometric identification method according to claim 29, wherein the infrared light waveband of the second optical signal is 840 nm or 940 nm.
An electronic device, characterized in that the electronic device comprises the biometric identification device according to any one of claims 1 to 18.
The electronic device according to claim 31, wherein the electronic device comprises:

A control circuit is used to control the first optical transmitter to generate the first optical signal and the second optical transmitter to generate the second optical signal.
The electronic device according to claim 31 or 32, wherein the biometric identification device is provided on the back or side of the electronic device.