CN218974941U - Identification module and terminal equipment - Google Patents

Abstract

The application provides an identification module and terminal equipment, the identification module includes light source, multispectral image sensor, temperature sensor and control and treater. The light source is used for emitting light beams with various wavelengths to the palm, and the light beams are reflected by the palm to form reflected light beams; the multispectral image sensor is used for receiving the reflected light beam and generating a multispectral image of the palm; the temperature sensor is used for detecting the temperature of the palm; the control and processor is used for identifying palmprint and/or palmvein of the palm according to the multispectral image, and carrying out living detection and/or monitoring the temperature of the palm by combining the temperature. The recognition module provided by the application has higher palm print and palm vein recognition precision and can monitor palm temperature.

Description

Identification module and terminal equipment

Technical Field

The application belongs to the technical field of biological feature recognition, and particularly relates to a recognition module and terminal equipment.

Background

The existing palm print recognition module is characterized in that a visible light image sensor and an infrared light image sensor are respectively used for shooting a palm, the two image sensors are combined to further lead to complex hardware structure, only one infrared light image sensor is used for saving cost, but infrared information precision of a wave band is limited, and living body recognition precision is reduced. The other scheme is that the palm images under different lights are respectively collected for combination by polishing towards the palm for multiple times, the scheme has more complicated hardware, and because the time required for light switching is required, the picture collection speed is slower, the problem of mismatching of the images possibly exists in the images under different lights, and the algorithm is more complicated to realize.

Disclosure of Invention

In order to achieve the above purpose, the technical scheme adopted in the application is to provide an identification module and terminal equipment.

The application provides an identification module including light source, multispectral image sensor and control and treater. The light source is used for emitting light beams with various wavelengths to the palm, and the light beams are reflected by the palm to form reflected light beams; the multispectral image sensor is used for receiving the reflected light beam and generating a multispectral image of the palm; the temperature sensor is used for detecting the temperature of the palm; the control and processor is used for identifying palmprint and/or palmvein of the palm according to the multispectral image, and carrying out living detection and/or monitoring the temperature of the palm by combining the temperature.

In some embodiments, the light source emits light having a wavelength between 400nm and 1000 nm. In some of these embodiments, the light source comprises a plurality of sub-light sources, at least some of which emit light beams of different wavelengths. In other embodiments, the light source is a broad spectrum light source.

In some embodiments, the multispectral image sensor includes a filter array for filtering a portion of the reflected light beams and a pixel array, the filter array including a visible light filter and an infrared filter; the pixel array is used for receiving the light beams filtered by the filter array and generating electric signals.

In some embodiments, the visible light filter includes a red filter, a green filter, and a blue filter, the infrared filters are plural, and the center wavelengths of at least three infrared filters are different. In some of these embodiments, the red, green, and blue filters are disposed adjacent, and the plurality of infrared filters are disposed adjacent. In some of these embodiments, the center wavelengths of the three infrared filters are 750nm 20nm, 850nm 20nm, and 960nm 20nm, respectively.

In some embodiments, the control and processor is configured to send an early warning signal when the temperature measured by the temperature sensor is abnormal. In some embodiments, the temperature sensor is a non-contact temperature sensor, and the control and processor is further configured to calculate a distance between the palm and the recognition module based on the multispectral image to correct the temperature by the distance.

The terminal equipment comprises the identification module.

The identification module and the terminal equipment provided by the application have the beneficial effects that: the light source can emit light beams with various different wavelengths, the light beams are reflected by the palm to form reflected light beams after being irradiated on the palm, the multispectral image sensor can collect the reflected light beams with various different wavelengths and generate multispectral images, the control and processor can identify palmprint and/or palmvein according to the multispectral images, and the palmprint and/or palmvein identification result is more accurate; the temperature sensor can detect the temperature of the palm, and the control and the processor are combined with the temperature detected by the temperature sensor to assist in living body detection, so that the living body detection precision is improved; because the images of a plurality of channels in the acquired multispectral image are consistent, the algorithm required by palm print and/or palm vein identification is relatively simple; the palm temperature can be monitored through a temperature sensor; in addition, the structure of the identification module is simpler than that of the existing identification module.

Drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are required for the embodiments or the description of the prior art will be briefly described below, it being obvious that the drawings in the following description are only some embodiments of the present application, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.

Fig. 1 is a schematic structural diagram of an identification module provided in an embodiment of the present application;

fig. 2 is a schematic structural diagram of a linear arrangement of a light source, a multispectral image sensor and a temperature sensor in an identification module provided in an embodiment of the present application;

FIG. 3 is a schematic diagram of a portion of a filter array of a multispectral image sensor according to an embodiment of the disclosure;

fig. 4 is a schematic diagram of a portion of a filter array of a multispectral image sensor according to an embodiment of the disclosure;

fig. 5 is a schematic structural diagram of a terminal device according to an embodiment of the present application.

Wherein, each reference sign in the figure:

1-an identification module; 11-a light source; 12-multispectral image sensor; 13-a temperature sensor; 14-control and processor.

Detailed Description

In order to make the technical problems, technical schemes and beneficial effects to be solved by the present application more clear, the present application is further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the present application.

It will be understood that when an element is referred to as being "mounted" or "disposed" on another element, it can be directly on the other element or be indirectly on the other element. When an element is referred to as being "connected to" another element, it can be directly connected to the other element or be indirectly connected to the other element. Also, it is to be understood that in the description of the present application, the meaning of "a plurality" is two or more, unless explicitly defined otherwise.

Referring to fig. 1, an identification module 1 provided in an embodiment of the present application will now be described. The identification module 1 comprises a light source 11, a multispectral image sensor 12, a temperature sensor 13 and a control and processor 14 connected to the light source 11, the multispectral image sensor 12 and the temperature sensor 13, respectively.

The light source 11 may be configured to emit light beams with various wavelengths toward the palm, and the light beams may be reflected by the palm to form reflected light beams. The multispectral image sensor 12 is operable to receive the reflected light beam and generate a multispectral image of the palm, and it is understood that the multispectral image has a spectral image of a plurality of channels, wherein the channels are defined by the light beam emitted by the light source 11 and the reflected light beam receivable by the multispectral image sensor 12, and the plurality of channels are operable to simultaneously receive light in a plurality of different wavelength bands. The temperature sensor 13 may be used to detect the temperature of the palm. The control and processor 14 can be used to identify palmprint and/or palmprint of the palm from the multispectral image, and to perform in vivo detection in combination with the temperature and palmprint identification, and to monitor the temperature of the palm. The palmprint is a ridge on the palm, and the palmvein is a palmar vein.

In the recognition module 1 provided by the application, the light source 11 can emit light beams with various different wavelengths, the light beams are reflected by the palm to form reflected light beams after being irradiated on the palm, the multispectral image sensor 12 can collect the reflected light beams with various different wavelengths and generate multispectral images, the control and processor 14 recognizes palmprint and/or palmvein according to the multispectral images, and the recognition result of the palmprint and/or palmvein is more accurate; the temperature sensor 13 can detect the temperature of the palm, and the control and the processor 14 are combined with the temperature detected by the temperature sensor 13 to assist in living body detection, so that living body detection precision is improved; because the images of a plurality of channels in the acquired multispectral image are consistent, the algorithm required by palm print and/or palm vein identification is relatively simple; and the palm temperature can be monitored by the temperature sensor 13; in addition, the structure of the identification module 1 is simpler than that of the existing identification module.

The following describes the structure of each part of the identification module 1.

In some embodiments of the present application, the identification module 1 may further include a circuit board, where the light source 11, the multispectral image sensor 12, the temperature sensor 13, and the control and processor 14 are detachably connected or fixedly connected, and the circuit board may provide current for the light source 11, the multispectral image sensor 12, the temperature sensor 13, and the control and processor 14. The control and processor 14 is respectively connected with the light source 11, the multispectral image sensor 12 and the temperature sensor 13, and can send trigger signals to the light source 11, the multispectral image sensor 12 and the temperature sensor 13 so as to synchronously control the light source 11 to emit light beams and the multispectral image sensor 12 to collect reflected light beams and control the temperature sensor 13 to synchronously collect palm temperature, and in addition, the control and processor 14 can also process data collected by the multispectral image sensor 12 and the temperature sensor 13.

In some embodiments of the present application, the light source 11, the multispectral image sensor 12, and the temperature sensor 13 may be arranged linearly, for example, the light source 11, the multispectral image sensor 12, and the temperature sensor 13 may be arranged linearly on a base or a backplane.

Referring to fig. 2, fig. 2 shows a schematic diagram of a linear arrangement, in which the light source 11, the multispectral image sensor 12 and the temperature sensor 13 are respectively illustrated by three circles, and the light source 11, the multispectral image sensor 12 and the temperature sensor 13 are linearly arranged. That is, the light source 11 is arranged between the temperature sensor 13 and the multispectral image sensor 12. Of course, the structural distribution of the identification module 1 is not limited to this structural distribution, and may be any distribution. Preferably, the light source 11 and the multispectral image sensor 12 are disposed close to each other, and the multispectral image sensor 12 may be disposed between the temperature sensor 13 and the light source 11 in addition to the arrangement shown in fig. 2. By arranging the light source 11 and the multispectral image sensor 12 close to each other, the distance between the multispectral image sensor 12 and the light source 11 can be reduced, so that the multispectral image sensor 12 can acquire multispectral images conveniently.

In some embodiments of the present application, the light source 11 may emit a light beam having a wavelength of 400nm to 1000 nm. In some of these embodiments, the light source 11 is a broad spectrum light source that can emit light beams of multiple wavelengths simultaneously. The light beam emitted by the light source 11 may include a visible light beam and an infrared light beam, for example, the light source 11 may be a halogen lamp, and the wavelength of the light beam emitted by the halogen lamp is between 400nm and 1000 nm. In other embodiments of the present application, the light source 11 may be composed of a plurality of sub-light sources, each of which may be a light emitting element, each of which may emit a light beam of a specific wavelength band, and the wavelengths of the light beams emitted by some or all of the sub-light sources are different, so that the light source 11 can emit a broad spectrum light beam composed of a plurality of light beams of specific wavelength bands toward the palm.

The light source 11 emits a light beam toward the palm, the light beam irradiates on the palm and is reflected by the palm to form a reflected light beam, the reflected light beam is incident into the multispectral image sensor 12 and is then received by the multispectral image sensor 12, and the multispectral image sensor 12 generates a multispectral image of the palm according to the received reflected light beam.

In particular, the multispectral image sensor 12 may include a filter array, a pixel array, and processing circuitry. The filter array may include a plurality of filters, each filter operable to filter a reflected light beam, and to filter out a portion of the reflected light beam such that only reflected light beams of a corresponding wavelength may pass through the filter. The filter array can comprise a visible light filter and an infrared filter, and is used for enabling the pixel array to simultaneously receive visible light and infrared light, so that information contained in the multispectral image is more abundant, the sensitivity of visible light wavelength to palmprint is higher, and the acquired image is favorable for identifying palmprint; the sensitivity of the infrared light on the palmar veins is higher, and the acquired image is favorable for identifying the palmar veins; therefore, the recognition module has higher palm print and palm vein recognition precision and higher living body detection precision.

In some embodiments, the visible light filters may include a red filter (R), a green filter (G), a blue filter (B), each of the visible light filters being disposed adjacent to one another; the number of the infrared filters is greater than or equal to three, the central wavelengths of at least three infrared filters are different, and a plurality of infrared filters are adjacently arranged. It can be appreciated that the adjacent arrangement of each visible light filter and the adjacent arrangement of each infrared light filter facilitate subsequent processing of the received light signals, facilitate extraction of color images and infrared images from the multispectral image, and further facilitate identification of palmprint and/or palmprint. Wherein the number of the infrared filters may be three, four, five, six or more, and the center wavelengths of at least three of the infrared filters are different.

Referring to fig. 3, fig. 3 is a schematic view of a portion of a structure of an optical filter array provided in the present application. The filters in the filter array are distributed in a mosaic mode, wherein R, G, B three filters are arranged in a similar mode, and IR1, IR2 and IR3 are respectively three infrared filters with different wavelengths and are arranged in a similar mode.

Of course, fig. 3 is only an exemplary illustration, and in practical applications, the visible light filter may further include other filters besides the R, G, B filter, such as a cyan filter and a yellow filter. In addition, the number of the partial visible light filters may be plural, and the number of the partial wavelength infrared filters may be two or more. For example, as shown in fig. 4, considering that the human eye is more sensitive to green, two green filters are used, i.e., the number of green filters is greater than the number of blue and red filters, and the number of IR1 filters in fig. 4 is two.

Preferably, at least three infrared filters have a center wavelength between 700nm and 800nm, between 800nm and 900nm, and between 900nm and 1000nm, respectively. For example, in one embodiment, the filter array has three infrared filters with different central wavelengths, the central wavelengths of the three infrared filters are respectively 750nm±20nm, 850nm±20nm and 960nm±20nm, in one example, the central wavelengths of the three infrared filters are respectively 750nm, 850nm and 960nm, and the sensitivity of infrared light with the three wavelengths of 750nm±20nm, 850nm±20nm and 960nm to palmar veins is higher, so that the acquired image is favorable for recognizing palmar veins; in addition, the information of visible wavelength and infrared wavelength can be used for palm print and/or palm vein recognition, and the information of substance components can be detected. The substance component information may specifically be information of components such as cells, fibers, fat, veins, capillaries, and hairs, and the like, and the responses of different substance components to different wavelengths may be different. Therefore, the control and processor 14 can determine the substance components according to the multispectral image, and can also perform living body detection according to the substance components, so that fusion evaluation can be performed on the multiple dimensional characteristics, and the living body detection precision is improved. It will be appreciated that prosthetic palms made of materials such as silicone typically have different responses to infrared light at these three wavelengths than do real palms, and that prosthetic palms typically do not have the characteristics of palmar veins, capillaries, and the like. That is, the control and processor 14 may be configured to identify the biological material component in the palm of the hand based on the spectral image corresponding to each infrared light channel to determine whether the palm is a living body.

Wherein 750 nm.+ -.20 nm may be a value of 730nm, 740nm, 750nm, 760nm, 770nm or more, 850 nm.+ -.20 nm may be a value of 830nm, 835nm, 840nm, 845nm, 850nm, 860nm, 870nm or more, and 960 nm.+ -.20 nm may be a value of 940nm, 945nm, 950nm, 960nm, 970nm, 980nm or more, which are not listed herein.

The pixel array may include a plurality of photosensitive units, and the photosensitive units are configured to receive the light beams filtered by the filter array and convert the light beams into corresponding electrical signals. The processing circuit is connected with the pixel array and can be used for generating a multispectral image of the palm according to the electric signals. Accordingly, control and processor 14 may be used to extract spectral images corresponding to each channel in the multispectral image and identify the palmprint and/or palmprint of the palm in the spectral image corresponding to each channel.

In addition, the multispectral image sensor 12 may also include a lens, which is comprised of one or more lenses, operable to converge an incident light beam incident on the multispectral image sensor 12 onto the filter array. In some embodiments, one or more optical elements may be included between the lens and the filter array and/or between the filter array and the pixel array, which may be used to alter the optical path. For example, one or more lenses may be included between the lens and the filter array, and one or more lenses may be included between the filter array and the pixel array.

In some embodiments of the present application, the temperature sensor 13 is a non-contact temperature sensor for non-contact measurement of the temperature of the palm, for example, the temperature sensor 13 is an infrared temperature sensor, and the non-contact temperature measurement can avoid direct contact with the measured object, avoid cross infection, and ensure safety and health of the user during use. In addition, the control and processor 14 may be used to send out an early warning signal when there is an abnormality in the temperature measured by the temperature sensor 13, and to monitor the temperature change of the user in time, so that the user can pay attention to the health of himself or herself or the family.

For example, the recognition module 1 may be further configured with an alarm, and when there is an abnormality in temperature, the control and processor 14 may generate an early warning signal to send to the alarm, and the alarm outputs sound or text. In some embodiments, the control and processor 14 may send out an early warning signal when the temperature of a specific user is abnormal according to the palm print and palm pulse recognition result and the temperature measured by the temperature sensor 13, for example, confirm that the user is an old person or a child based on the palm print and palm pulse recognition result, and send out an early warning signal when the temperature of the old person or the child is abnormal. Or, the identification module 1 can also be in communication connection with the user terminal, and when the abnormal temperature of a specific user is monitored, an early warning signal is timely sent to the user terminal so as to remind the user.

In practical application, the non-contact temperature sensor 13 is prone to inaccurate temperature measurement, and the temperature acquired by the temperature sensor 13 needs to be corrected according to the distance between the palm and the recognition module 1 so as to obtain accurate temperature information. Specifically, the control and processor 14 may be further configured to extract a spectral image corresponding to each channel in the multispectral image, obtain reflectivity information of the palm through the spectral image corresponding to each channel, and determine a distance between the palm and the identification module 1 by using the reflectivity information, so as to correct the temperature according to the distance.

Further, the difference of the reflectances of the palms of different users on the light rays with different wavelengths in the light source is considered, and the difference of the reflectances of the palms in the channels can be considered in calculating the distance to correct the temperature acquired by the temperature sensor 13, so as to obtain accurate temperature information. The recognition module 1 provided by the application can be combined with the distance, palm print information and/or palm vein recognition results and the corresponding relation between the reflectivities of the palm in each channel to correct the temperature information so as to obtain more accurate temperature data.

For example, the palmprint and/or palmprint of different users may have different reflectivities for light beams of different wavebands at the same distance, so that palmprint information and/or palmprint recognition results of different users may be classified in advance through experiments, and reflectivity information at each distance is collected under each user type, so as to establish a mapping relationship among the user type, the reflectivity information and the distance. The control and processor 14 can identify and obtain palm print and/or palm vein identification results based on the spectrum images corresponding to the channels in the multispectral images, and confirm the identity information of the user through the palm print and/or palm vein identification results so as to obtain the user type to which the user belongs, and further determine the reflectivity information corresponding to the user type. Because the reflectivities at different distances are different, the distance can be determined through the mapping relation between the reflectivities and the distances, and the mapping relation between the distances and the temperature offset exists, therefore, the temperature offset can be determined after the distance is determined, and then the measured temperature is corrected by using the temperature offset, so that the actually obtained temperature is more accurate. With a more accurate temperature, it is also possible to more accurately confirm whether or not the palm to which the palmprint and/or palmar vein belongs is a living body.

Since the humidity of the palm may affect the light propagation, the reflectivity of the same palm at the same distance varies at different humidities. Thus, in other embodiments of the present application, the identification module 1 may also be configured with a humidity sensor, which is connected to the processor 14 for acquiring palm humidity. The control and processor 14 can determine the reflectivity of the user type corresponding to the palm under the current palm humidity based on the mapping relationship of the user type, the palm humidity and the reflectivity obtained through experiments in advance, and then determine the distance and the correction temperature by utilizing the reflectivity.

It should be noted that, the identification module of the present application may further include other components, such as a housing, a heat dissipating device, a bracket, etc., which are not listed herein nor described in detail.

In the embodiment of the application, the multispectral image sensor 12 formed by the optical filter arrays distributed in the mosaic manner can extract images under a plurality of wave bands (channels) from a single image, the multispectral image can be obtained by adopting the light source 11 capable of emitting light with a plurality of wavelengths without polishing for many times, the hardware design is simpler, the images of the plurality of channels in the obtained multispectral image are consistent, the temperature sensor 13 is combined, the temperature of a palm can be monitored simultaneously, the living body recognition can be assisted by the temperature sensor 13, the palm print and/or palm pulse recognition result obtained by the processor 14 recognition is controlled to assist in temperature correction, and further a more accurate palm print recognition result is given.

Referring to fig. 5, the present application further provides a terminal device, which includes the foregoing identification module 1, that is, the terminal device may include a light source 11, a multispectral image sensor 12, a temperature sensor 13, and a control and processor 14 connected to the light source 11, the multispectral image sensor 12, and the temperature sensor 13, respectively. Wherein the light source 11 can be used for emitting light beams with various wavelengths to the palm, and the light beams are reflected by the palm to form reflected light beams; the multispectral image sensor 12 is operable to receive the reflected light beam and generate a multispectral image of the palm based on the reflected light beam; the temperature sensor 13 may be used to detect the temperature of the palm; the control and processor 14 may be used to perform in vivo detection and/or monitor the temperature of the palm based on the palm print and/or veins of the palm of the multispectral image, and based on temperature.

In some embodiments, the terminal device may further include a processor, where the processor is connected to the recognition module 1, and may obtain a palm print and/or a palm pulse recognition result generated by the recognition module 1, and perform data analysis processing by using the palm print and/or the palm pulse recognition result. For example, the terminal device is an intelligent door lock, and the intelligent door lock can identify the user identity by using palm print and/or palm pulse identification results and control the door lock to be opened and closed when the user identity is correct. For another example, the terminal device is a payment device, and the payment device may identify the user identity using the palm print and/or palm vein recognition result, and perform the payment operation when the user identity is correct.

In the identification module 1 included in the terminal device of the present application, the light source 11 may emit light beams with a plurality of different wavelengths, and after being irradiated on the palm, the light beams are reflected by the palm to form reflected light beams, the multispectral image sensor 12 may collect the reflected light beams with a plurality of different wavelengths and generate multispectral images, and the control and processor 14 identifies palmprint and/or palmprint according to the multispectral images, so that the palmprint and/or palmprint identification result is more accurate; the temperature sensor 13 can detect the temperature of the palm, and the control and the processor 14 are combined with the temperature detected by the temperature sensor 13 to assist in living body detection, so that living body detection precision is improved; because the images of a plurality of channels in the acquired multispectral image are consistent, the algorithm required by palm print and/or palm vein identification is relatively simple; and the palm temperature can be monitored by the temperature sensor 13; in addition, the structure of the identification module 1 is simpler than that of the existing identification module.

The foregoing description of the preferred embodiments of the present application is not intended to be limiting, but is intended to cover any and all modifications, equivalents, and alternatives falling within the spirit and principles of the present application.

Claims (10)

1. An identification module, comprising:

a light source for emitting light beams of a plurality of wavelengths toward a palm, the light beams being reflected by the palm to form reflected light beams;

a multispectral image sensor for receiving the reflected light beam and generating a multispectral image of the palm;

a temperature sensor for detecting the temperature of the palm;

and the control and processor is used for identifying palmprint and/or palmar veins of the palm according to the multispectral image, and carrying out living detection and/or monitoring on the temperature of the palm in combination with the temperature.

2. The identification module of claim 1, wherein the light source emits a light beam having a wavelength between 400nm and 1000 nm.

3. The identification module of claim 1, wherein the light source comprises a plurality of sub-light sources, at least some of the sub-light sources emitting light of different wavelengths; or, the light source is a broad spectrum light source.

4. The identification module of claim 1, wherein the multispectral image sensor comprises a filter array and a pixel array, the filter array is used for filtering part of the light beams in the reflected light beams, and the filter array comprises a visible light filter and an infrared filter; the pixel array is used for receiving the light beams filtered by the filter array and converting the light beams into electric signals.

5. The identification module of claim 4, wherein the visible light filter comprises a red filter, a green filter and a blue filter, the number of the infrared filters is greater than or equal to three, and the central wavelengths of at least three of the infrared filters are different.

6. The identification module of claim 5, wherein the red filter, the green filter, and the blue filter are disposed adjacent to each other, and a plurality of the infrared filters are disposed adjacent to each other.

7. The identification module of claim 5, wherein the three infrared filters have center wavelengths of 750nm 20nm, 850nm 20nm and 960nm 20nm, respectively.

8. The identification module of any one of claims 1 to 7, wherein the control and processor is configured to send an early warning signal when the temperature measured by the temperature sensor is abnormal.

9. The identification module of any one of claims 1 to 7 wherein the temperature sensor is a non-contact temperature sensor, the control and processor further configured to calculate a distance between the palm and the identification module based on the multispectral image to correct the temperature by the distance.

10. A terminal device comprising an identification module as claimed in any one of claims 1 to 9.

Images