CN211628257U

CN211628257U - Fingerprint identification device and electronic equipment

Info

Publication number: CN211628257U
Application number: CN202020212430.0U
Authority: CN
Inventors: 程祥; 张玮; 李顺展
Original assignee: Shenzhen Goodix Technology Co Ltd
Current assignee: Shenzhen Goodix Technology Co Ltd
Priority date: 2020-02-25
Filing date: 2020-02-25
Publication date: 2020-10-02
Anticipated expiration: 2030-02-25

Abstract

Provided are a fingerprint identification device and an electronic device. The fingerprint identification device includes: an array of microlens elements; at least one light-blocking layer; an array of pixel cells; a filter unit group array disposed between the microlens unit array and the pixel unit array, wherein each filter unit group includes a plurality of filter units, the plurality of filter units are filter units of a plurality of colors, and each filter unit of the plurality of filter units is configured to transmit a light signal of one color of a light signal in a first direction of the plurality of directions; the pixel unit array comprises a pixel unit group corresponding to the filter unit group, a plurality of pixel units in the pixel unit group respectively receive the light signals of the multiple colors through the multiple filter units, and the light signals of the multiple colors are used for detecting whether the finger is a real finger or not. This fingerprint identification device can improve fingerprint identification's security on the basis that does not influence fingerprint identification effect.

Description

Fingerprint identification device and electronic equipment

Technical Field

The present application relates to the field of optical fingerprint technology, and more particularly, to a fingerprint identification device and an electronic apparatus.

Background

The application of the optical fingerprint recognition device brings safe and convenient user experience to users, but counterfeit fingerprints such as fingerprint molds, printed fingerprint images and the like manufactured by artificial materials (e.g., silica gel, white gel and the like) are a potential safety hazard in fingerprint application. Therefore, how to identify the authenticity of the fingerprint to improve the security of fingerprint identification is an urgent problem to be solved.

SUMMERY OF THE UTILITY MODEL

The embodiment of the application provides a fingerprint identification device and electronic equipment, which can identify the authenticity of a fingerprint, thereby improving the safety of fingerprint identification.

In a first aspect, a fingerprint identification device is provided, which includes:

a microlens cell array arranged below the display screen and including a plurality of microlens cell groups, each microlens cell group including a plurality of microlens cells, each microlens cell including at least one microlens, each microlens cell group for transmitting light signals of a plurality of directions to the pixel cell array;

at least one light-blocking layer arranged below the microlens unit array, wherein each light-blocking layer in the at least one light-blocking layer is provided with a small hole array;

the pixel unit array is arranged below the small hole array of the bottom light blocking layer in the at least one light blocking layer, so that optical signals returned from fingers above the display screen are transmitted to the pixel unit array through the small hole array arranged in the at least one light blocking layer after being converged by the micro lens unit array;

a filter unit group array disposed between the microlens unit array and the pixel unit array, each filter unit group in the filter unit group array corresponding to one microlens unit group, each filter unit group including a plurality of filter units, the plurality of filter units being filter units of a plurality of colors, each filter unit in the plurality of filter units being configured to transmit a light signal of one color of a light signal in a first direction among the plurality of directions;

the pixel unit array comprises a pixel unit group corresponding to the filter unit group, a plurality of pixel units in the pixel unit group respectively receive the light signals of the multiple colors through the multiple filter units, and the light signals of the multiple colors are used for detecting whether the finger is a real finger or not.

Through setting up the light signal that the multiple colour in the filtering unit group sees through the single direction, like this, a plurality of pixel units that filtering unit group corresponds can gather the colored fingerprint image of multiple colour in this single direction, and whether can further confirm the finger that is located the display screen top based on this colored fingerprint image is real finger.

In one possible implementation, the microlens unit group includes four microlens units, each of the four microlenses is used for transmitting light signals in four directions to a corresponding pixel unit, and a corresponding filtering unit of each microlens unit is located on an optical path in the first direction.

The light filtering unit is designed to be located on the light path in the first direction of the four directions, so that the structural complexity of the fingerprint identification device can be simplified, for example, the complexity of the light path design of at least one light blocking layer can be simplified, and the laying complexity of the light filtering unit can be simplified, so that the laying of the light filtering unit on the at least one light blocking layer presents a certain rule.

In a possible implementation manner, the microlens unit group is an array composed of 2 × 2 microlens units, each microlens unit includes one microlens, each filter unit group includes four filter units, and each filter unit corresponds to one microlens and one pixel unit.

In one possible implementation, the microlens unit group is an array of 2 × 2 microlens units, each microlens unit includes 2 × 2 microlenses, each filter unit group includes sixteen filter units, and each filter unit corresponds to one microlens and one pixel unit.

Each filtering unit corresponds to one pixel unit in the pixel unit group, so that the resolution of fingerprint images with different colors can be improved, and a plurality of pixel units corresponding to the filtering units can be uniformly distributed in the pixel unit group.

In a possible implementation manner, the microlens unit group is an array composed of 3 × 3 microlens units, each microlens unit includes one microlens, the pixel unit group is a 4 × 4 pixel unit array, and one microlens is arranged right above each adjacent 4 pixel units in the 4 × 4 pixel unit array.

In a possible implementation manner, the central microlens in the array composed of 3 × 3 microlens units is used to transmit optical signals in four directions to the corresponding pixel unit, each microlens in the microlenses at four corners is used to transmit an optical signal in one direction to the pixel unit at the four corners of the corresponding 4 × 4 pixel unit array, the other four microlenses in the array composed of 3 × 3 microlens units are used to transmit optical signals in two directions to the two pixel units below the same microlens and outside the 4 × 4 pixel unit array, each filtering unit group includes four filtering units, each filtering unit corresponds to one microlens and one pixel unit, and the filtering unit corresponding to each microlens unit is located on the optical path of the optical signal transmitted along the first direction.

In a possible implementation manner, the microlens unit group is an array composed of 2 × 2 microlens units, each microlens unit includes an array composed of 3 × 3 microlenses, each microlens unit corresponds to a 4 × 4 pixel unit array, and one microlens is disposed right above each adjacent 4 pixel units in the 4 × 4 pixel unit array.

In a possible implementation manner, the central microlens of the array composed of 3 × 3 microlenses is used to transmit optical signals in four directions to corresponding pixel units, each microlens of the microlenses at four corners is used to transmit an optical signal in one direction to a pixel unit at a corner of a corresponding 4 × 4 pixel unit array, the other four microlenses in the array composed of 3 × 3 microlenses are used to transmit optical signals in two directions to two pixel units below the same microlens and outside the 4 × 4 pixel unit array, each filtering unit group includes sixteen filtering units, each filtering unit corresponds to one microlens and one pixel unit, and the filtering unit corresponding to each microlens unit is located on the optical path in the first direction.

In one possible implementation, the inside of each microlens unit corresponds to a filter unit of the same color.

In one possible implementation manner, the filter units corresponding to the microlens units in the microlens unit group include a red filter unit, a blue filter unit, and a green filter unit.

In one possible implementation manner, the color of the filter units corresponding to two microlens units on the diagonal in the microlens unit group is the same, and the filter unit with the same color is a red filter unit, a blue filter unit or a green filter unit.

In one possible implementation manner, the light filtering units corresponding to the microlens units in the microlens unit group are a red light filtering unit, a blue light filtering unit, a green light filtering unit, and a white light filtering unit, respectively.

In a possible implementation manner, the at least one light-blocking layer is a plurality of light-blocking layers, and a bottom light-blocking layer in the plurality of light-blocking layers is provided with a plurality of small holes corresponding to the plurality of pixel units, respectively, so that the at least one microlens transmits the optical signals in the plurality of directions to the corresponding pixel units through the plurality of small holes, respectively.

In a possible implementation manner, the apertures of the light blocking layers corresponding to the same pixel unit are sequentially reduced from top to bottom.

In a possible implementation manner, a top light-blocking layer of the plurality of light-blocking layers is provided with at least one small hole corresponding to the plurality of pixel units.

In a possible implementation manner, the at least one light blocking layer is a light blocking layer, and the light blocking layer is provided with a plurality of small holes corresponding to the plurality of pixel units, respectively, so that the at least one microlens transmits the optical signals in the plurality of directions to the corresponding plurality of pixel units through the plurality of small holes, respectively.

In one possible implementation, the wavelength range of each of the plurality of filtering units includes only a portion of the wavelength range of the optical signal used for fingerprint recognition.

In a possible implementation manner, the fingerprint identification apparatus further includes:

and the processing unit is used for processing the fingerprint images of the object to be identified, which are acquired by the plurality of filtering units, through a deep learning network and determining whether the object to be identified is a real finger.

In one possible implementation, the processing unit is further configured to:

extracting sampling values of pixel units corresponding to the light filtering units in each fingerprint image from the fingerprint images of a plurality of real fingers and false fingerprints collected by the plurality of pixel units, and recombining to obtain a color fingerprint image;

and inputting the color fingerprint image into a deep learning network for training to obtain a model and parameters of the deep learning network.

In one possible implementation, the processing unit is further configured to:

and fingerprint identification is carried out according to fingerprint images collected by other pixel units except the plurality of light filtering units in the plurality of pixel units.

In one possible implementation, the processing unit is further configured to:

calibrating three color values acquired by the pixel unit group corresponding to the filtering unit group to 0-255 respectively to form RGB three-channel color values, wherein the filtering unit group comprises filtering units of three colors of RGB, and each microlens unit in the microlens unit group corresponds to one filtering unit;

and combining the color values of the RGB three channels into 12-bit color values, and outputting the 12-bit color values at one time.

In one possible implementation, the processing unit is further configured to: and combining the color values collected by the pixel units corresponding to the filtering units of the same color in the filtering unit group to obtain a color value, and outputting the color value at a time, wherein the filtering unit group comprises a plurality of filtering units of the same color.

In a second aspect, an electronic device is provided, comprising:

a display screen; and

the fingerprint recognition device according to the first aspect, wherein the device is disposed below the display screen to realize optical fingerprint recognition under the screen.

Drawings

Fig. 1 is a schematic structural diagram of a terminal device to which the embodiment of the present application is applied.

Fig. 2 is a graph showing the difference between color fingerprint images corresponding to true and false fingerprints.

Fig. 3 is a schematic block diagram of a fingerprint identification device according to an embodiment of the present application.

FIG. 4 is a cross-sectional view of a fingerprint recognition device according to one embodiment of the present application.

Fig. 5 is a layout diagram of the filter cell group and the microlens cell group of the embodiment shown in fig. 4.

Fig. 6 is a color layout diagram of the filter unit of the embodiment shown in fig. 4.

Fig. 7 is a layout diagram of a group of filter cells and a group of microlens cells according to another embodiment of the present application.

Fig. 8 is a cross-sectional view of a fingerprint identification device according to yet another embodiment of the present application.

Fig. 9 is a layout diagram of the filter cell group and the microlens cell group of the embodiment shown in fig. 8.

FIG. 10 is a schematic diagram of an array of apertures in the light blocking layer of the embodiment shown in FIG. 8.

Fig. 11 is a layout diagram of a group of filter cells and a group of microlens cells according to still another embodiment of the present application.

Fig. 12-13 are schematic diagrams of two ways of processing color values according to embodiments of the present application.

Fig. 14 is a structural diagram of a convolutional neural network according to an embodiment of the present application.

FIG. 15 is a schematic block diagram of an electronic device according to an embodiment of the present application.

Detailed Description

The technical solutions in the embodiments of the present application will be described below with reference to the accompanying drawings.

It should be understood that the embodiments of the present application can be applied to optical fingerprint systems, including but not limited to optical fingerprint identification systems and medical diagnostic products based on optical fingerprint imaging, and the embodiments of the present application are only described by way of example, but should not be construed as limiting the embodiments of the present application, and the embodiments of the present application are also applicable to other systems using optical imaging technology, etc.

As a common application scenario, the optical fingerprint system provided by the embodiment of the application can be applied to smart phones, tablet computers and other mobile terminals or other terminal devices with display screens; more specifically, in the terminal device described above, the fingerprint recognition device may be embodied as an optical fingerprint device, which may be disposed in a partial area or an entire area below the display screen, thereby forming an Under-screen (Under-display) optical fingerprint system. Or, the fingerprint identification device may also be partially or completely integrated inside a display screen of the terminal device, so as to form an In-display (In-display) optical fingerprint system.

As shown in fig. 1, which is a schematic structural diagram of a terminal device to which the embodiment of the present application is applicable, the terminal device 10 includes a display screen 120 and an optical fingerprint device 130, where the optical fingerprint device 130 is disposed in a local area below the display screen 120. The optical fingerprint device 130 comprises an optical fingerprint sensor, the optical fingerprint sensor comprises a sensing array 133 with a plurality of optical sensing units 131, and the area where the sensing array 133 is located or the sensing area thereof is the fingerprint detection area 103 of the optical fingerprint device 130. As shown in fig. 1, the fingerprint detection area 103 is located in a display area of the display screen 120. In an alternative embodiment, the optical fingerprint device 130 may be disposed at other positions, such as the side of the display screen 120 or the edge opaque area of the terminal device 10, and the optical signal of at least a part of the display area of the display screen 120 is guided to the optical fingerprint device 130 through the optical path design, so that the fingerprint detection area 103 is actually located in the display area of the display screen 120.

It should be appreciated that the area of the fingerprint sensing area 103 may be different from the area of the sensing array of the optical fingerprint device 130, for example, by the design of optical path such as lens imaging, reflective folded optical path design or other optical path design such as light converging or reflecting, the area of the fingerprint sensing area 103 of the optical fingerprint device 130 may be larger than the area of the sensing array of the optical fingerprint device 130. In other alternative implementations, the fingerprint sensing area 103 of the optical fingerprint device 130 may be designed to substantially coincide with the area of the sensing array of the optical fingerprint device 130 if optical path guidance is performed, for example, by light collimation.

Therefore, when the user needs to unlock the terminal device or perform other fingerprint verification, the user only needs to press a finger on the fingerprint detection area 103 of the display screen 120, so as to realize fingerprint input. Since fingerprint detection can be implemented in the screen, the terminal device 10 with the above structure does not need to reserve a special space on the front surface thereof to set a fingerprint key (such as a Home key), so that a full-screen scheme can be adopted, that is, the display area of the display screen 120 can be basically extended to the front surface of the whole terminal device 10.

As an alternative implementation, as shown in fig. 1, the optical fingerprint device 130 includes a light detection portion 134 and an optical component 132, where the light detection portion 134 includes the sensing array and a reading circuit and other auxiliary circuits electrically connected to the sensing array, which can be fabricated on a chip (Die) through a semiconductor process, such as an optical imaging chip or an optical fingerprint sensor, the sensing array is specifically a Photo detector (Photo detector) array, which includes a plurality of Photo detectors distributed in an array, and the Photo detectors can be used as the optical sensing units as described above; the optical assembly 132 may be disposed above the sensing array of the light detecting portion 134, and may specifically include a Filter layer (Filter) for filtering out ambient light penetrating through the finger, a light guiding layer or a light path guiding structure for guiding reflected light reflected from the surface of the finger to the sensing array for optical detection, and other optical elements.

In particular implementations, the optical assembly 132 may be packaged with the same optical fingerprint component as the light detection portion 134. For example, the optical component 132 may be packaged in the same optical fingerprint chip as the optical detection portion 134, or the optical component 132 may be disposed outside the chip where the optical detection portion 134 is located, for example, the optical component 132 is attached to the chip, or some components of the optical component 132 are integrated into the chip.

For example, the light guide layer may specifically be a Collimator (collimater) layer manufactured on a semiconductor silicon wafer, and the collimater unit may specifically be a small hole, and in reflected light reflected from a finger, light perpendicularly incident to the collimater unit may pass through and be received by an optical sensing unit below the collimater unit, and light with an excessively large incident angle is attenuated by multiple reflections inside the collimater unit, so that each optical sensing unit can basically only receive reflected light reflected from a fingerprint pattern directly above the optical sensing unit, and the sensing array can detect a fingerprint image of the finger.

In another embodiment, the light guiding layer or the light path guiding structure may also be an optical Lens (Lens) layer, which has one or more Lens units, such as a Lens group composed of one or more aspheric lenses, and is used to focus the reflected light reflected from the finger to the sensing array of the light detecting portion 134 therebelow, so that the sensing array can perform imaging based on the reflected light, thereby obtaining the fingerprint image of the finger. Optionally, the optical lens layer may further form a pinhole in the optical path of the lens unit, and the pinhole may cooperate with the optical lens layer to enlarge the field of view of the optical fingerprint device, so as to improve the fingerprint imaging effect of the optical fingerprint device 130.

In other embodiments, the light guide layer or the light path guiding structure may also specifically adopt a Micro-Lens (Micro-Lens) layer, the Micro-Lens layer has a Micro-Lens array formed by a plurality of Micro-lenses, which may be formed above the sensing array of the light detecting portion 134 through a semiconductor growth process or other processes, and each Micro-Lens may respectively correspond to one of the sensing units of the sensing array. And another optical film layer, such as a dielectric layer or a passivation layer, may be further formed between the microlens layer and the sensing unit, and more specifically, a light blocking layer having micro holes may be further included between the microlens layer and the sensing unit, where the micro holes are formed between the corresponding microlenses and the sensing unit, and the light blocking layer may block optical interference between adjacent microlenses and the sensing unit, and enable light corresponding to the sensing unit to be converged inside the micro holes through the microlenses and transmitted to the sensing unit through the micro holes for optical fingerprint imaging. It should be understood that several implementations of the above-mentioned optical path guiding structure may be used alone or in combination, for example, a microlens layer may be further disposed below the collimator layer or the optical lens layer. Of course, when the collimator layer or the optical lens layer is used in combination with the microlens layer, the specific lamination structure or optical path thereof may need to be adjusted according to actual needs.

As an alternative embodiment, the display screen 120 may adopt a display screen having a self-Light Emitting display unit, such as an Organic Light-Emitting Diode (OLED) display screen or a Micro-LED (Micro-LED) display screen. Taking an OLED display screen as an example, the optical fingerprint device 130 may use the display unit (i.e., OLED light source) of the OLED display screen 120 located in the fingerprint detection area 103 as an excitation light source for optical fingerprint detection. When the finger 140 is pressed against the fingerprint detection area 103, the display 120 emits a beam of light 111 toward the target finger 140 above the fingerprint detection area 103, and the light 111 is reflected on the surface of the finger 140 to form reflected light or scattered light by the inside of the finger 140 to form scattered light. Because ridges (ridges) and valleys (valley) of the fingerprint have different light reflection capacities, reflected light 151 from the ridges and the valleys 152 from the fingerprint have different light intensities, and the reflected light is received by the sensing array 134 in the optical fingerprint device 130 and converted into corresponding electric signals, i.e., fingerprint detection signals, after passing through the optical assembly 132; fingerprint image data can be obtained based on the fingerprint detection signal, and fingerprint matching verification can be further performed, so that an optical fingerprint identification function is realized in the terminal device 10.

In other embodiments, the optical fingerprint device 130 may also use an internal light source or an external light source to provide an optical signal for fingerprint detection. In this case, the optical fingerprint device 130 may be adapted for use with a non-self-emissive display such as a liquid crystal display or other passively emissive display. Taking an application to a liquid crystal display having a backlight module and a liquid crystal panel as an example, to support the underscreen fingerprint detection of the liquid crystal display, the optical fingerprint system of the terminal device 10 may further include an excitation light source for optical fingerprint detection, where the excitation light source may specifically be an infrared light source or a light source of non-visible light with a specific wavelength, and may be disposed below the backlight module of the liquid crystal display or in an edge area below a protective cover of the terminal device 10, and the optical fingerprint device 130 may be disposed below the edge area of the liquid crystal panel or the protective cover and guided through a light path so that the fingerprint detection light may reach the optical fingerprint device 130; alternatively, the optical fingerprint device 130 may be disposed below the backlight module, and the backlight module may be perforated or otherwise optically designed to allow the fingerprint detection light to pass through the liquid crystal panel and the backlight module and reach the optical fingerprint device 130. When the optical fingerprint device 130 is used to provide an optical signal for fingerprint detection by using an internal light source or an external light source, the detection principle is consistent with the above description.

It should be understood that in a specific implementation, the terminal device 10 further includes a transparent protective cover plate, which may be a glass cover plate or a sapphire cover plate, positioned above the display screen 120 and covering the front surface of the terminal device 10. Because, in the present embodiment, the pressing of the finger on the display screen 120 actually means pressing on the cover plate above the display screen 120 or the surface of the protective layer covering the cover plate.

On the other hand, in some embodiments, the optical fingerprint device 130 may include only one optical fingerprint sensor, where the area of the fingerprint detection area 103 of the optical fingerprint device 130 is small and the location is fixed, so that the user needs to press a finger to a specific location of the fingerprint detection area 103 when performing a fingerprint input, otherwise the optical fingerprint device 130 may not acquire a fingerprint image and the user experience is poor. In other alternative embodiments, the optical fingerprint device 130 may specifically include a plurality of optical fingerprint sensors; the plurality of optical fingerprint sensors may be disposed side by side below the display screen 120 in a splicing manner, and sensing areas of the plurality of optical fingerprint sensors jointly form the fingerprint detection area 103 of the optical fingerprint device 130. That is to say, the fingerprint detection area 103 of the optical fingerprint device 130 may include a plurality of sub-areas, each sub-area corresponding to the sensing area of one of the optical fingerprint sensors, respectively, so as to extend the fingerprint collection area 103 of the optical fingerprint module 130 to the main area of the lower half portion of the display screen, that is, to the area that the finger presses conventionally, thereby realizing the blind-touch type fingerprint input operation. Alternatively, when the number of optical fingerprint sensors is sufficient, the fingerprint detection area 130 may also be extended to half or even the entire display area, thereby enabling half-screen or full-screen fingerprint detection.

It should also be understood that in the embodiments of the present application, the sensing array in the optical fingerprint device may also be referred to as a pixel array, and the optical sensing unit or the sensing unit in the sensing array may also be referred to as a pixel unit.

It should be noted that, optical fingerprint device in this application embodiment also can be called optical fingerprint identification module, fingerprint identification device, fingerprint identification module, fingerprint collection device etc. but above-mentioned term mutual replacement.

Generally, the reflection performance of human skin tissue for light of a specific wavelength, such as red light, is significantly different from that of artificial materials such as silica gel, paper, and tape, due to factors such as the thickness of the cortex, hemoglobin concentration, and melanin content of the human skin tissue.

Based on this, the present application provides a fingerprint identification scheme, wherein a plurality of color filter units are disposed between a microlens unit array and a pixel unit array in a fingerprint identification device, and are used for transmitting a plurality of color optical signals in a first direction of a plurality of directions, each filter unit corresponds to one pixel unit, the pixel unit corresponding to the filter unit is identified as a characteristic pixel unit, and the filter unit can be considered to be disposed above the corresponding characteristic pixel unit in position. Thus, the fingerprint image acquired by the characteristic pixel unit is a low-resolution color fingerprint image, and for different materials (for example, human fingers, artificial materials such as silica gel and the like), the low-resolution color fingerprint image has obviously different characteristics, as shown in fig. 2, so that the authenticity of the fingerprint image can be determined according to the difference of the low-resolution color fingerprint images acquired by the characteristic pixel unit.

Hereinafter, a fingerprint identification device according to an embodiment of the present application will be described in detail with reference to the accompanying drawings.

It should be noted that, for the sake of understanding, the same structures are denoted by the same reference numerals in the embodiments shown below, and detailed descriptions of the same structures are omitted for the sake of brevity.

It should be understood that the number, arrangement, and the like of the pixel unit, the filter unit, the microlens unit, the filter unit group, and the microlens unit group in the embodiments of the present application shown below are merely exemplary illustrations, and should not constitute any limitation to the present application.

Fig. 3 is a schematic block diagram of a fingerprint identification device 300 according to an embodiment of the present application, where the fingerprint identification device 300 includes: a microlens cell array 310, at least one light blocking layer 320, a pixel cell array 330, and a filter cell group array 340.

The microlens unit array 310 is disposed under the display screen 120. The microlens cell array 310 includes a plurality of microlens cell groups each including a plurality of microlens cells each including at least one microlens, each microlens cell group for transmitting light signals of a plurality of directions to the pixel cell array 330.

The at least one light blocking layer 320 is disposed under the microlens cell array. Each of the at least one light-blocking layer is provided with an array of apertures corresponding to pixel cells in the pixel cell array 330.

The pixel cell array 330 is disposed below the aperture array of the bottom light-blocking layer in the at least one light-blocking layer, so that the optical signal returning from the finger above the display screen 120 is transmitted to the pixel cell array 330 through the aperture array disposed in the at least one light-blocking layer 320 after being converged by the microlens cell array 310.

The filter unit group array 340 is disposed between the microlens unit array 310 and the pixel unit array 330, each filter unit group in the filter unit group array 340 corresponds to one microlens unit group, each filter unit group includes a plurality of filter units, the plurality of filter units are filter units of a plurality of colors, and each filter unit in the plurality of filter units is used for transmitting a light signal of one color of a light signal of a first direction in the plurality of directions.

The pixel unit array 330 includes a pixel unit group corresponding to the filter unit group, a plurality of pixel units in the pixel unit group respectively receive the light signals of the plurality of colors through the plurality of filter units, and the light signals of the plurality of colors are used to detect whether the finger is a real finger.

For convenience of distinction and explanation, in the embodiments of the present application, a plurality of pixel units corresponding to the filter unit in the pixel unit array are referred to as feature pixel units; the other pixel units except the plurality of pixel units are called as common pixel units or background pixel units, namely, the light signals collected by the characteristic pixel units are used for living body identification, and the light signals collected by the background pixel units are used for fingerprint identification.

It should be noted that, in practical applications, a filtering unit may also be disposed above the background pixel unit for filtering out an optical signal affecting fingerprint identification, and it should be noted that, unless otherwise specified, the filtering unit in the embodiments of the present application refers to a filtering unit for transmitting an optical signal of a specific color in a single direction.

Therefore, in the embodiment of the present application, the filtering units in the filtering unit group are configured to transmit the light signals with multiple colors in a single direction, so that the multiple pixel units corresponding to the filtering unit group can acquire the color fingerprint images with multiple colors in the single direction, and further determine whether the finger located above the display screen is a real finger based on the color fingerprint images.

It should be understood that the filter unit group may include filter units of two colors, or may also include filter units of three colors, or may also include filter units of more colors, and the color layout of the filter units in each filter unit group is described below by taking the example that the filter unit group includes filter units of three colors, but the embodiment of the present application is not limited thereto.

In the embodiment of the present application, the microlens units in the microlens unit groups correspond to filter units of the same color, and the number of microlenses included in each microlens unit in the embodiment of the present application is not particularly limited, and may be, for example, 1, or more, and correspondingly, the number of filter units of the same color in each filter unit group may be 1 or more.

It should be noted that, in the embodiment of the present application, the number of the microlens units included in the microlens unit group is not limited, for example, 2, 4, and the like, and may be specifically determined according to the color layout of the filter units in the filter unit group, which is described in detail herein.

It should also be understood that each microlens unit group in the microlens unit array is used to guide light signals in multiple directions to a corresponding pixel unit group, and the number of the light signals in the multiple directions is not particularly limited in the embodiments of the present application, and for example, may be two, three or more, and hereinafter, the multiple directions are taken as 4 directions as an example for explanation, but the embodiments of the present application are not limited thereto.

It should be noted that, in the embodiment of the present application, the filtering unit group is used to transmit the light signals of the multiple colors in the first direction of the multiple directions, and is denoted as a first type filtering unit group, and in other embodiments, the fingerprint identification apparatus may further include more types of filtering unit groups, for example, a second type filtering unit group, which is used to transmit the light signals of the multiple colors in the second direction of the multiple directions. In the following, the color layout and the position layout of the filtering unit groups for transmitting the light signals of the multiple colors of the light signals in the first direction among the multiple directions are taken as an example, and the design manners of other filtering unit groups are similar, which is not described in detail in this embodiment of the present application.

As an alternative embodiment, a plurality of filtering unit groups in the filtering unit group array may be discretely distributed in the photosensitive region of the pixel unit array, and accordingly, it may be considered that the characteristic pixel unit groups corresponding to the filtering unit groups are discretely distributed in the pixel unit array, so that it is possible to avoid that the fingerprint identification performance is affected by too many pixel units continuously covered by the filtering unit. Alternatively, the characteristic pixel unit groups corresponding to the filtering unit groups can be uniformly distributed in the photosensitive area of the pixel unit array.

In this embodiment, the filtering units in the filtering unit group may be disposed between the corresponding pixel unit group and the corresponding microlens unit group, and are located in the optical path of the optical signal transmitted along the first direction, so as to transmit the optical signals of multiple colors in the optical signal transmitted along the first direction, that is, the fingerprint identification device of this embodiment may arrange the filtering units in a part of the optical path to realize living body identification, and may perform fingerprint identification by using the optical signals of other optical paths, thereby being capable of considering both living body identification and fingerprint identification.

The following describes a specific implementation of the fingerprint identification device according to the embodiment of the present application with reference to fig. 4 to 11.

Example 1:

in this embodiment 1, as shown in fig. 4 and 5, the fingerprint identification device may include a microlens cell array 310, at least one light blocking layer 320, a pixel cell array 330, and a filter cell group array 340.

Each microlens unit group in the microlens unit array 310 includes 4 microlens units, each microlens unit includes one microlens 311, each microlens in the four microlens units is used for transmitting light signals in four directions to a corresponding pixel unit, and a filter unit corresponding to each microlens unit is located on a light path in the first direction, that is, the filter unit corresponding to each microlens unit is used for transmitting light signals in a specific wavelength band in the light signals in the first direction, and the specific wavelength band is a wavelength band which can be transmitted by the filter unit.

As an example, each microlens is disposed directly above a2 × 2 pixel cell array, the microlens for transmitting light signals in four directions to the 2 × 2 pixel cell array.

The at least one light-blocking layer 320 includes a bottom light-blocking layer 321 and a top light-blocking layer 322, wherein a set of small holes corresponding to each of the plurality of microlenses 311 is respectively disposed in the bottom light-blocking layer 321 and the top light-blocking layer 322.

The pixel cells in the pixel cell array 330 disposed below the microlens 311 are used to receive the oblique optical signals converged by the microlens and transmitted through the small holes in the bottom light-blocking layer and the top light-blocking layer.

As an example, the bottom light-blocking layer 321 is provided with 4 apertures corresponding to the microlenses 311, for example, a first aperture 3211 and a second aperture 3212, and other apertures are not shown. The top light blocking layer 322 is provided with a third aperture 3221 corresponding to the microlens 311, wherein a connection line direction between the second aperture 3212 and the third aperture 3221 is used to form a first direction of the four directions, and a connection line direction between the first aperture 3211 and the third aperture 3221 is used to form a second direction of the four directions. It should be understood that the number of the apertures corresponding to each microlens in the top light-blocking layer may be one, or may also be one for each pixel unit in the pixel unit group.

The filter unit 341 may be disposed at any position in the optical path of the optical signal in the first direction from the microlens cell array to the corresponding pixel cell array, and as an implementation, the filter unit 341 is disposed above the second small hole 3212 in the bottom light-blocking layer, or may also be disposed on the upper surface of the corresponding pixel cell 332.

In a specific optical path, the pixel unit 331 may receive the light signal of the second direction converged by the microlens 311 and transmitted through the third aperture 3221 and the first aperture 3211, and the pixel unit 332 may receive the light signal of the first direction converged by the microlens 311 and transmitted through the third aperture 3221 and the second aperture 3212. It is understood that the pixel cells 332 are spaced apart within a group of pixel cells by the pixel cells 331.

In other embodiments, the at least one light-blocking layer may also be a light-blocking layer, that is, the small holes corresponding to the 4 pixel units are disposed below the microlens 311.

The layout of colors in the filter unit group in this embodiment 1 is explained with reference to fig. 5 and 6.

In one implementation, the filter units corresponding to the four microlens units in the microlens unit group include filter units of three colors, namely a red filter unit, a blue filter unit, and a green filter unit.

Optionally, the color of the filter unit corresponding to two microlens units on the diagonal in the microlens unit group is the same, and the color of the filter unit corresponding to the other two filter units is the other two colors.

In one implementation, as shown in a1 in fig. 6, that is, the filter cells of the same color in one filter cell group are green filter cells, adjacent filter cells are separated by a background pixel cell, and if the interval between adjacent filter cell groups in the filter cell array above the pixel cell array is neglected, that is, the adjacent filter cell groups are spliced together, the color layout of the filter cell group array is as shown in a2 in fig. 6.

In another implementation, the filter cells of the same color in one filter cell group may also be red filter cells, the color layout of the filter cell group is shown as b1 in fig. 6, and the color layout of the entire filter cell group array is shown as b2 in fig. 6.

In yet another implementation, if the filter cells of the same color in one filter cell group are blue filter cells, the filter cell group is shown as c1 in fig. 6, and the filter cell group array is shown as c2 in fig. 6.

In other alternative implementations, the light filtering units corresponding to the microlens units in the microlens unit group are a red light filtering unit, a blue light filtering unit, a green light filtering unit, and a white light filtering unit, respectively. In this case, the color layout of the filter cell group is as shown by d1 in fig. 6, and the color layout of the filter cell group array is as shown by d2 in fig. 6.

It should be noted that, in the embodiment of the present application, the setting manners of the colors and the positions of the filter units in each of the plurality of filter unit groups may be the same, or the colors and/or the positions of one or more filter units in one or some of the filter unit groups may also be changed, that is, the colors and/or the positions of the filter units in the filter unit groups may be locally adjusted, as long as the fingerprint identification performance is not affected, which is not limited in the embodiment of the present application.

To sum up, in this embodiment 1, by setting the filtering units in each filtering unit group to transmit the light signals of three colors in the first direction, correspondingly, the four pixel units corresponding to the filtering unit group can acquire the color fingerprint images of three colors in the first direction, and further can determine whether the finger located above the display screen is a real finger based on the color fingerprint images.

It should be understood that the fingerprint recognition device may further include a transparent dielectric layer 350.

Wherein the transparent dielectric layer 350 may be disposed at least one of: between the microlens cell array 310 and the at least one light blocking layer 320; between the at least one light blocking layer 320; and between the at least one light blocking layer 320 and the pixel cell array 330.

For example, the transparent medium layer 350 may include a first medium layer 351 between the microlens cell array 310 and the at least one light blocking layer 320 (i.e., the bottom light blocking layer 321) and a second medium layer 352 between the bottom light blocking layer 321 and the top light blocking layer 322.

The material of the transparent dielectric layer 350 is any transparent material transparent to light, such as glass, and may also be air or vacuum transition, which is not specifically limited in this application.

Example 2:

alternatively, as shown in fig. 7, the microlens unit group is an array of 2 × 2 microlens units, each microlens unit includes 2 × 2 microlenses, each filter unit group includes sixteen filter units, and each filter unit corresponds to one microlens and one pixel unit. That is, four microlenses in each microlens unit correspond to 4 filter units of the same color, for example, 2 × 2 microlenses at the top left corner in fig. 7 are one microlens unit, and the corresponding filter unit is 4 filter units of the same color, for example, a red filter unit; for another example, 2 × 2 microlenses at the bottom right corner in fig. 7 are a microlens unit, and the corresponding filtering units are 4 filtering units of the same color, for example, blue filtering units.

It should be noted that the difference between this embodiment 2 and embodiment 1 is that one microlens unit corresponds to the number of filter units of the same color, where one microlens unit corresponds to one filter unit in embodiment 1, and since one microlens unit includes 4 microlenses in this embodiment 2, it corresponds to 4 filter units of the same color.

It should be understood that the design of the light-blocking layer in embodiment 2 can refer to the description related to embodiment 1, and the description is omitted here.

In practical applications, signals collected by four pixel units below four filter units corresponding to one microlens unit may be combined, for example, averaged, to reduce the dimension of the color fingerprint image.

Example 3:

as shown in fig. 8, the fingerprint recognition device may include a microlens cell array 310, at least one light blocking layer 320, a pixel cell array 330, and a filter cell group array 340.

The at least one light-blocking layer 320 includes a bottom light-blocking layer 321 and a top light-blocking layer 322, wherein a set of small holes corresponding to each of the plurality of microlenses are respectively disposed in the bottom light-blocking layer 321 and the top light-blocking layer 322.

The pixel units in the pixel unit array 330 disposed below the microlenses are configured to receive the four-directional optical signals converged by the microlenses and transmitted through the small holes in the bottom light-blocking layer and the top light-blocking layer.

Specifically, the microlens cell array 310 includes an array composed of 3 × 3 microlens cells, each microlens cell includes one microlens, the pixel cell group is a 4 × 4 pixel cell array, one microlens is disposed right above each adjacent 4 pixel cells in the 4 × 4 pixel cell array, and as a specific implementation, one microlens may be disposed right above the center of the 4 pixel cells.

As shown in fig. 9, the central microlens 3111 in the array of 3 × 3 microlens units is used to transmit light signals in four directions to the corresponding pixel unit, each of the

microlenses

3112 and 3115 at the four corners is used to transmit light signals in one direction to the pixel unit at the four corners of the array of 4 × 4 pixel units, the other four

microlenses

3116 and 3119 in the array of 3 × 3 microlens units are used to transmit light signals in two directions to the two pixel units below the same microlens at the outer side of the array of 4 × 4 pixel units, each filter unit group includes four filter units, each filter unit corresponds to one microlens and one pixel unit, and the filter unit corresponding to each microlens unit is located on the optical path of the light signals transmitted along the first direction. Namely, the microlens unit group includes three types of microlenses, where a first type of microlens (i.e., microlenses located at four corners of the microlens unit group) is used to transmit an optical signal in one direction to a corresponding pixel unit, a second type of microlens (i.e., microlens located at a central position of the microlens unit group) is used to transmit an optical signal in four directions to a corresponding pixel unit, and a third type of microlens (i.e., other microlenses located in the microlens unit group) is used to transmit an optical signal in two directions to a corresponding pixel unit, and specifically, the microlens can transmit an optical signal in a specific direction to a corresponding pixel unit through an aperture array in a corresponding light blocking layer.

Taking the design of the apertures in the light-blocking layer corresponding to the microlenses in the first row of one microlens unit group in fig. 9 as an example, the microlenses in the first row are respectively designated as

microlenses

3112, 3117 and 3113. The micro lens 3112 corresponds to the second and

third apertures

3212 and 3221, the micro lens 3117 corresponds to the first, second and

third apertures

3211, 3212 and 3221, and the micro lens 3113 corresponds to the first and

third apertures

3211 and 3221, with the other apertures not shown. The connecting line of the second aperture 3212 and the third aperture 3221 is configured to form a first direction of the four directions, and the connecting line of the first aperture 3211 and the third aperture 3221 is configured to form a second direction of the four directions. It should be understood that the number of the holes corresponding to each microlens in the top light-blocking layer may be one, or may also be one hole corresponding to each pixel unit in the pixel unit group, as shown in fig. 10, the microlens 3118 corresponds to two holes 3222 in the top light-blocking layer, wherein the two holes 3222 respectively form two directions with the two holes 3211 in the bottom light-blocking layer.

It should be understood that in the example of fig. 9, in order to understand how to control the transmission direction of light through the aperture, the transmission direction of light and the aperture are related, that is, the aperture using the same reference number can be used for light signals passing through the same direction, but this does not mean that the aperture is the same aperture, and it is understood that in order to pass light signals of a specific direction, the light blocking layer above each microlens needs to be provided with a suitable aperture to form the specific direction.

In a specific optical path, the pixel unit 331 may receive the light signal of the second direction converged by the microlens 311 and transmitted through the third aperture 3221 and the first aperture 3211, and the pixel unit 332 may receive the light signal of the first direction converged by the microlens 311 and transmitted through the third aperture 3221 and the second aperture 3212. It is to be understood that in this embodiment 3, the pixel cells 332 (i.e., the characteristic pixel cells) within one pixel cell group are adjacent.

Similarly, in this embodiment 3, the at least one light-blocking layer may also be one light-blocking layer, that is, the small holes corresponding to the 4 pixel units are disposed below the one microlens.

It should be understood that the fingerprint recognition device may further include a transparent dielectric layer 350. The specific description refers to the description related to embodiment 1 and is not further set forth.

The layout of colors in the filter cell group in this embodiment 3 is explained with reference to fig. 9.

Similar to embodiment 1, the filter units corresponding to 9 microlens units in each microlens unit group include filter units of three colors, for example, a red filter unit, a blue filter unit, and a green filter unit. In other alternative implementations, the light filtering units corresponding to the microlens units in the microlens unit group are a red light filtering unit, a blue light filtering unit, a green light filtering unit, and a white light filtering unit, respectively. The specific color layout is described in relation to embodiment 1, and is not described herein again.

Example 4:

optionally, as shown in fig. 11, the microlens unit group is an array composed of 2 × 2 microlens units, each microlens unit includes an array composed of 3 × 3 microlenses, each microlens unit corresponds to an array of 4 × 4 pixel units, one microlens is disposed right above each adjacent 4 pixel units in the array of 4 × 4 pixel units, and as a specific implementation, one microlens may be disposed right above the center of the 4 pixel units.

Specifically, the central microlens of the array composed of 3 × 3 microlenses is used to transmit optical signals in four directions to the corresponding pixel unit, each microlens of the microlenses at four corners is used to transmit optical signals in one direction to the pixel unit at the corner of the corresponding 4 × 4 pixel unit array, and the other four microlenses of the array composed of 3 × 3 microlenses are used to transmit optical signals in two directions to the two pixel units below the same microlens and outside the 4 × 4 pixel unit array. It should be understood that one microlens unit group corresponds to one filter unit group, and as shown in fig. 11, one filter unit group includes sixteen filter units, one microlens unit corresponds to four filter units, and the four filter units are adjacent in position. For example, 3 × 3 microlenses in the upper left corner of fig. 11 are a microlens unit, and the corresponding filter units are 4 filter units of the same color, for example, red filter units, and the 4 filter units of the same color are adjacent and distributed in a2 × 2 array; for another example, 3 × 3 microlenses in the bottom right corner of fig. 11 are a microlens unit, and the corresponding filter units are 4 filter units of the same color, for example, blue filter units, and the 4 filter units of the same color are adjacent and distributed in a2 × 2 array. Each filtering unit corresponds to one micro lens and one pixel unit, and the filtering unit corresponding to each micro lens unit is located on the light path in the first direction.

It should be noted that the difference between this embodiment 4 and embodiment 3 is that one microlens unit corresponds to the number of filter units of the same color, where one microlens unit corresponds to one filter unit in embodiment 3, and in this embodiment 4, since one microlens unit includes 9 microlenses, and 4 microlenses out of the 9 microlenses are used for receiving the optical signal in the first direction, it corresponds to the filter units of 4 same colors.

It should be understood that the design of the light-blocking layer in embodiment 4 can refer to the description related to embodiment 3, and the description thereof is omitted here.

Optionally, in this embodiment of the present application, the fingerprint identification device 300 may further include:

and the processor is used for determining whether the fingerprint image is from a real finger or not according to the fingerprint images acquired by the pixel units.

Specifically, the multiple pixel units of the optical fingerprint sensor can image fingerprint detection signals reflected from the surface of an object to be identified, further, the processor can extract and recombine fingerprint images collected by characteristic pixel units in the multiple pixel units to obtain a low-resolution color fingerprint image, then the processor can input the low-resolution color fingerprint image into a successfully trained deep learning network, and the color fingerprint image is processed through the deep learning network to determine whether the color fingerprint image is from a real finger.

As an embodiment, the processor may further determine whether the object to be recognized is a real finger in a case that the fingerprint image acquired by the background pixel unit matches with the registered fingerprint template of the object to be recognized, and determine that the fingerprint authentication is successful in a case that the object to be recognized is a real finger, so as to perform an operation of triggering the fingerprint recognition, for example, performing an operation of unlocking a terminal or paying, and the like.

As another embodiment, the processor may further determine whether the fingerprint image acquired by the background pixel unit matches with the registered fingerprint template of the object to be recognized, determine that the fingerprint authentication is successful if the fingerprint image acquired by the background pixel unit matches with the registered fingerprint template of the object to be recognized, and further perform an operation that triggers the fingerprint recognition, for example, perform an operation such as unlocking a terminal or paying.

Optionally, in this embodiment of the application, the processor may be a processor in the fingerprint module, for example, a Microcontroller (MCU), or may also be a processor in an electronic device, for example, a master Control (Host) module, which is not limited in this embodiment of the application.

Further, in some embodiments of the present application, the processor may be further configured to process the color values collected by the pixel unit group and output the color values at a time, so as to save a large amount of collection time.

In one implementation mode, three color values acquired by pixel unit groups corresponding to the filtering unit groups are respectively calibrated to 0-255 to form RGB three-channel color values; and combining the color values of the RGB three channels into 12-bit color values, and outputting the 12-bit color values at one time, wherein the light filtering unit group comprises light filtering units of RGB three colors, and each micro lens unit in the micro lens unit group corresponds to one light filtering unit.

Taking the layout of the filtering unit shown in fig. 5 and 9 as an example, as shown in fig. 12, the pixel unit corresponding to the filtering unit can collect the light signals of three colors, and further calibrate the sampling values of the light signals of three colors to 0-255, respectively, to form a color value of RGB three channels. And combining the RGB three-channel color values into 12-bit color values, for example, 0-3, 4-7, 8-11 bit color values in the RGB three-channel 12-bit color values respectively represent a color value of an R channel, a color value of a G channel and a color value of a B channel.

In another implementation manner, the color values collected by the pixel units corresponding to the filtering units of the same color in the filtering unit group are combined to obtain a color value, and the color value is output once, wherein the filtering unit group comprises a plurality of filtering units of the same color.

Taking the layout of the filtering units shown in fig. 7 and fig. 11 as an example, in practical applications, if the color values collected by the pixel units corresponding to each filtering unit are output one by one, a lot of time is required. Therefore, in this embodiment of the application, as shown in fig. 13, the color values collected by the pixel units corresponding to the filter units of the same color in the filter unit group may be combined by the processor, for example, averaged, and the color values after the combination processing are output once, so that only one color value needs to be output.

Optionally, after the color values collected by the pixel units corresponding to the same color filter unit are combined, the collected color values can be calibrated in the former implementation mode, and further combined into 12-bit color values, and the 12-bit color values are output once, so that the collecting time can be further saved.

In sum, the color values collected by the pixel units are calibrated or combined through the processor, so that the output time of the color values can be reduced, and a large amount of collecting time is saved. In an alternative implementation, no other structure may be disposed above the background pixel unit, or no material may be coated, that is, the upper side of the background pixel unit is transparent and has no treatment, in other words, there is an air gap between the background pixel unit and the optical component above the background pixel unit.

In another alternative implementation, a light-transmissive material may be disposed above the background pixel cells, in which case the fingerprint detection signal entering the background pixel cells is also unaffected or less affected.

In other optional implementation manners, a filter layer, for example, a green filter layer, may also be disposed above the background pixel unit, optionally, a green filter material may be coated above the background pixel unit, or a green filter may be disposed above the background pixel unit, so that after the fingerprint detection signal passes through the green filter layer, the fingerprint image acquired by the background pixel unit is a green fingerprint image, that is, the fingerprint detection signal in the red band and the fingerprint detection signal in the blue band are filtered, which is beneficial to reducing the influence of ambient light signals such as red light, and thus the fingerprint identification performance can be improved.

Optionally, in this embodiment of the application, the number of consecutive filter units may be set to be less than or equal to a specific threshold, for example, 6, and correspondingly, the number of consecutive feature pixel units is also not greater than the specific threshold, so that the fingerprint identification performance can be prevented from being affected.

Alternatively, in the embodiment of the present application, the filtering unit generally only allows light signals in a specific wavelength band to pass through, and for a single filtering unit, the wavelength band range of the emitted light of the light source for fingerprint detection needs to include the wavelength band of the filtering unit, and at least some other wavelength bands than this wavelength band, that is, the wavelength band of the single filtering unit only includes some of the wavelength bands of the emitted light. Therefore, the emitted light enters the filtering unit after being reflected on the surface of the object to be identified, a part of light signals are filtered after passing through the filtering unit, meanwhile, a part of light signals are allowed to pass through, further, imaging is carried out on the characteristic pixel unit, and then the low-resolution color fingerprint image can be obtained.

Optionally, in this embodiment of the present application, the wavelength range of the blue filtering unit may be that the central wavelength band is 440nm to 475nm, the upper cut-off wavelength band is about 550nm, and the transmittance of the blue light is higher than that of the green light and the red light; the wave band range of the green light filtering unit can be that the central wave band is 520 nm-550 nm, the upper and lower cut-off wave bands are about 620nm and 460nm, and the transmissivity of the green light is higher than that of the blue light and the red light; the red filter unit may have a lower cut-off band of about 550nm and a red light transmittance higher than that of green and blue light.

Optionally, the deep learning network in the embodiment of the present application may be a convolutional neural network, or another deep learning network, which is not limited in the embodiment of the present application. Hereinafter, a convolutional neural network is taken as an example to describe a specific training process.

First, a convolutional neural network structure is constructed, for example, a two-layer convolutional neural network shown in fig. 14 may be adopted, or a three-layer network structure or more-layer network structures may also be adopted, and the structure of each layer of convolutional network structure may also be adjusted according to fingerprint information to be extracted, which is not limited in this embodiment of the present application.

Second, the initial training parameters and convergence conditions of the convolutional neural network are set.

Optionally, in this embodiment of the present application, the initial training parameter may be randomly generated, or obtained according to an empirical value, or may also be a parameter of a convolutional neural network model pre-trained according to a large amount of true and false fingerprint data, which is not limited in this embodiment of the present application.

Optionally, in this embodiment of the present application, the convergence condition may include at least one of the following:

1. the probability of determining the color fingerprint image of the real finger as the fingerprint image of the real finger is greater than the first probability, for example, 98%;

2. the probability of judging the color fingerprint image of the fake finger as the fingerprint image of the fake finger is greater than the second probability, for example, 95%;

3. the probability of determining the color fingerprint image of the real finger as the fingerprint image of the fake finger is less than a third probability, for example, 2%;

4. the probability of judging the color fingerprint image of the fake finger as the fingerprint image of the real finger is less than the fourth probability, for example, 3%.

Then, inputting a large number of color fingerprint images of real fingers and false fingers into the convolutional neural network, which can process the color fingerprint images based on the initial training parameters to determine the judgment result for each color fingerprint image, and further, according to the judgment result, adjusting the structure of the convolutional neural network and/or the training parameters of each layer until the judgment result meets the convergence condition.

Then, other color fingerprint images collected by the characteristic pixel unit can be input into the convolutional neural network, so that the convolutional neural network can process the color fingerprint images by using the trained parameters to determine whether the color fingerprint images are from real fingers.

As shown in fig. 15, an electronic device 400 is further provided in the embodiment of the present application, where the electronic device 400 may include a fingerprint identification device 410, and the fingerprint identification device 410 may be the fingerprint identification device 300 in the foregoing device embodiments.

It should be understood that the electronic device may include a display screen, and the display screen may refer to the related implementation manner in fig. 1 regarding the display screen 120, such as an OLED display screen or other display screens, and therefore, for brevity, the description is omitted here.

In a specific embodiment, the display screen is an OLED display screen, and the optical fingerprint device utilizes a part of the display unit of the OLED display screen as an excitation light source for optical fingerprint detection.

It should be understood that the specific examples in the embodiments of the present application are for the purpose of promoting a better understanding of the embodiments of the present application and are not intended to limit the scope of the embodiments of the present application.

It is to be understood that the terminology used in the embodiments of the present application and the appended claims is for the purpose of describing particular embodiments only and is not intended to be limiting of the embodiments of the present application. For example, as used in the examples of this application and the appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise.

Those of ordinary skill in the art will appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.

It is clear to those skilled in the art that, for convenience and brevity of description, the specific working processes of the above-described systems, apparatuses and units may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.

In the several embodiments provided in the present application, it should be understood that the disclosed system, apparatus and method may be implemented in other ways. For example, the above-described apparatus embodiments are merely illustrative, and for example, the division of the units is only one logical division, and other divisions may be realized in practice, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.

The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit.

The functions, if implemented in the form of software functional units and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solutions of the present application may be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the methods described in the embodiments of the present application. And the aforementioned storage medium includes: various media capable of storing program codes, such as a usb disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk.

The above description is only for the specific embodiments of the present application, but the scope of the present application is not limited thereto, and any person skilled in the art can easily conceive of the changes or substitutions within the technical scope of the present application, and shall be covered by the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims

1. The utility model provides a fingerprint identification device which characterized in that, fingerprint identification device is applicable to the below of display screen to realize optical fingerprint identification under the screen, fingerprint identification device includes:

2. The fingerprint recognition device according to claim 1, wherein the microlens unit set comprises four microlens units, each microlens of the four microlens units is used for transmitting light signals in four directions to a corresponding pixel unit, and the filter unit corresponding to each microlens unit is located on the optical path in the first direction.

3. The fingerprint recognition device of claim 2, wherein the microlens element sets are an array of 2 x 2 microlens elements, each microlens element includes one microlens, each filter element set includes four filter elements, and each filter element corresponds to one microlens and one pixel element.

4. The fingerprint recognition device of claim 2, wherein the microlens element sets are an array of 2 x 2 microlens elements, each microlens element includes 2 x 2 microlenses, each filter element set includes sixteen filter elements, and each filter element corresponds to one microlens and one pixel element.

5. The fingerprint recognition device according to claim 1, wherein the microlens unit set is an array of 3 × 3 microlens units, each microlens unit includes one microlens, the pixel unit set is an array of 4 × 4 pixel units, and one microlens is disposed directly above each adjacent 4 pixel units in the array of 4 × 4 pixel units.

6. The fingerprint recognition device according to claim 5, wherein the central micro lens of the array of 3 x 3 micro lens units is used for transmitting light signals in four directions to the corresponding pixel unit, each of the micro lenses at four corners is used for transmitting light signals in one direction to the pixel unit at four corners of the corresponding array of 4 x 4 pixel units, the other four microlenses in the array formed by the 3 x 3 microlens units are used for respectively transmitting optical signals in two directions to two pixel units which are arranged at the outer side of the 4 x 4 pixel unit array and below the same microlens, each filtering unit group comprises four filtering units, each filtering unit corresponds to one microlens and one pixel unit, the filter unit corresponding to each microlens unit is located on the optical path of the optical signal transmitted along the first direction.

7. The fingerprint recognition device according to claim 1, wherein the microlens unit sets are an array of 2 x 2 microlens units, each microlens unit includes an array of 3 x 3 microlenses, each microlens unit corresponds to an array of 4 x 4 pixel units, and one microlens is disposed directly above each adjacent 4 pixel units in the array of 4 x 4 pixel units.

8. The fingerprint recognition device according to claim 7, wherein the central microlens of the 3 x 3 microlens array is configured to transmit light signals in four directions to the corresponding pixel unit, each of the microlenses at four corners is configured to transmit light signals in one direction to the pixel unit at the corner of the corresponding 4 x 4 pixel unit array, and the other four microlenses of the 3 x 3 microlens array are configured to transmit light signals in two directions to the two pixel units below the same microlens and outside the 4 x 4 pixel unit array, and each filter unit group includes sixteen filter units, each filter unit corresponds to one microlens and one pixel unit, and the filter unit corresponding to each microlens unit is located on the optical path in the first direction.

9. The fingerprint recognition device according to any one of claims 2-8, wherein each microlens unit comprises a microlens with a corresponding filter unit having the same color.

10. The fingerprint recognition device of claim 9, wherein the filter units corresponding to the microlens units in the microlens unit set comprise a red filter unit, a blue filter unit, and a green filter unit.

11. The fingerprint recognition device according to claim 10, wherein the color of the filter units corresponding to two microlens units located on the diagonal line in the microlens unit group is the same, and the filter unit with the same color is a red filter unit, a blue filter unit or a green filter unit.

12. The fingerprint identification device of claim 9, wherein the filter units corresponding to the micro lens units in the micro lens unit group are a red filter unit, a blue filter unit, a green filter unit and a white filter unit, respectively.

13. The fingerprint identification device according to claim 12, wherein the at least one light-blocking layer is a plurality of light-blocking layers, and a bottom light-blocking layer of the plurality of light-blocking layers is provided with a plurality of small holes corresponding to the plurality of pixel units, so that the at least one microlens transmits the light signals in the plurality of directions to the corresponding pixel units through the plurality of small holes.

14. The fingerprint identification device of claim 13, wherein the apertures of the light blocking layers corresponding to the same pixel unit decrease in aperture from top to bottom.

15. The fingerprint recognition device according to claim 14, wherein a top light-blocking layer of the plurality of light-blocking layers is provided with at least one small hole corresponding to the plurality of pixel units.

16. The fingerprint identification device according to claim 12, wherein the at least one light-blocking layer is a light-blocking layer, and the light-blocking layer is provided with a plurality of small holes corresponding to the plurality of pixel units, respectively, so that the at least one microlens transmits the light signals in the plurality of directions to the corresponding plurality of pixel units through the plurality of small holes, respectively.

17. The fingerprint recognition device of claim 16, wherein the wavelength band range of each of the plurality of filtering units includes only a portion of the wavelength band range of the optical signal used for fingerprint recognition.

18. The fingerprint recognition device of claim 17, further comprising:

and the processing unit is used for determining whether the object to be recognized is a real finger.

19. An electronic device, comprising:

a display screen; and

the fingerprint recognition device of any one of claims 1-18, said device being disposed below said display screen to enable off-screen optical fingerprint recognition.