CN110785768B

CN110785768B - Photosensitive detection device, display device, fingerprint detection method, and method of operating display device

Info

Publication number: CN110785768B
Application number: CN201980001712.6A
Authority: CN
Inventors: 海晓泉; 王海生
Original assignee: BOE Technology Group Co Ltd
Current assignee: BOE Technology Group Co Ltd
Priority date: 2019-09-17
Filing date: 2019-09-17
Publication date: 2023-04-28
Anticipated expiration: 2039-09-17
Also published as: WO2021051276A1; CN110785768A; EP4032008A1; EP4032008A4

Abstract

A photosensitive detection device is provided. The photosensitive detection device includes a counter substrate, an array substrate facing the counter substrate, and a fingerprint sensing driver. The array substrate includes a plurality of light sources configured to emit light toward the counter substrate, at least a portion of the light being totally reflected by a surface of the counter substrate remote from the array substrate; and a light sensor configured to detect the at least a portion of light totally reflected by a surface of the opposite substrate away from the array substrate. The photosensitive detection device is configured to operate in a time division mode including a plurality of time-sequential photosensitive modes. The fingerprint sensing driver is configured to detect fingerprint information by integrating signals detected in a plurality of time-sequential photosensitive modes.

Description

Photosensitive detection device, display device, fingerprint detection method, and method of operating display device

Cross Reference to Related Applications

The present application is a continuation-in-part application of international application No. pct/CN2019/098374 filed on 7, 30, 2019, which claims priority from chinese patent application No.201811535591.7 filed on 12, 14, 2018. Each of the above applications is incorporated by reference herein in its entirety for all purposes.

Technical Field

The present invention relates to display technology, and more particularly, to a photosensitive detection device, a display device, a fingerprint detection method, and a method of operating the display device.

Background

In recent years, various methods have been proposed in fingerprint and palm print recognition. Examples of the optical method for recognizing fingerprints and palmprints include a total reflection method, an optical path separation method, and a scanning method. In the total reflection method, light from a light source such as ambient light enters a pixel and is totally reflected on the surface of a package substrate. When a finger or palm touches the display panel, the total reflection condition of the surface changes locally upon touching, resulting in the total reflection being destroyed locally. The disruption of total reflection results in reduced reflection. Based on this principle, the ridges of the finger can be distinguished from the valleys. Alternatively, the fingerprint and palm print may be identified by detecting a change in capacitance when a finger or palm touches the display panel.

Disclosure of Invention

In one aspect, the present invention provides a photosensitive detection device comprising a counter substrate, an array substrate facing the counter substrate, and a fingerprint sensing driver; wherein, the array substrate includes: a plurality of light sources configured to emit light toward the counter substrate, at least a portion of the light being totally reflected by a surface of the counter substrate remote from the array substrate; and a light sensor configured to detect the at least a portion of the light totally reflected by a surface of the counter substrate remote from the array substrate; wherein the photosensitive detection device is configured to operate in a time division mode comprising a plurality of time-sequential photosensitive modes; and the fingerprint sensing driver is configured to detect fingerprint information by integrating signals detected in the plurality of time sequential photosensitive modes.

Optionally, in a respective one of the plurality of time-sequential photosensitive modes, the plurality of spaced apart light-emitting blocks are configured to emit light that is reflected by a plurality of touch sub-areas in a surface of the counter substrate remote from the array substrate, respectively; wherein the plurality of touch sub-regions are spaced apart from one another.

Optionally, in a corresponding one of the plurality of time-sequential photosensitive modes, light respectively reflected by the plurality of touch sub-regions in a surface of the counter substrate remote from the array substrate is respectively detected by a plurality of sensing sub-regions in the light sensor; and the plurality of sensing sub-regions in the light sensor do not substantially overlap.

Optionally, adjacent ones of the plurality of sensing subregions are adjacent to each other.

Optionally, the plurality of time-sequential photosensitive modes includes a first mode and a second mode; the plurality of spaced apart first light emitting blocks are configured to emit light in the first mode, the light being reflected by the plurality of first touch sub-areas in a surface of the counter substrate remote from the array substrate, respectively; the plurality of spaced apart second light emitting blocks are configured to emit light in the second mode, the light being reflected by a plurality of second touch sub-areas in a surface of the counter substrate remote from the array substrate, respectively; the plurality of first touch sub-regions are spaced apart from one another; and the plurality of second touch sub-areas are spaced apart from one another.

Optionally, light respectively reflected by the plurality of first touch sub-areas in the surface of the counter substrate remote from the array substrate is respectively detected by a plurality of first sensing sub-areas in the first sensing area of the light sensor; light respectively reflected by the plurality of second touch sub-areas in the surface of the counter substrate away from the array substrate is respectively detected by a plurality of second sensing sub-areas in a second sensing area of the light sensor; the first sensing region and the second sensing region partially overlap; the plurality of first sensing sub-regions are substantially non-overlapping; and the plurality of second sensing sub-regions do not substantially overlap.

Optionally, the total number of the plurality of first light-emitting blocks and the total number of the plurality of second light-emitting blocks are substantially the same.

Optionally, the positions of the plurality of first light emitting blocks and the positions of the plurality of second light emitting blocks are related by translational displacement.

Optionally, in a respective one of the plurality of time-sequential photosensitive modes, the plurality of light-emitting blocks are configured to emit light; and the plurality of light emitting blocks have substantially the same size.

Optionally, the substantially identical dimensions are dimensions optimized for achieving a maximum value of the contrast value; wherein the comparison value is composed of

Definition; where Sr represents a signal corresponding to a ridge of a fingerprint; and Sv denotes a signal corresponding to a valley of the fingerprint.

Optionally, a respective one of the plurality of light-emitting blocks comprises a block of (9 sub-pixels×9 sub-pixels).

Optionally, the photosensitive detection device further includes: a touch sensing drive circuit configured to control touch detection in a touch area of the photosensitive detection device; wherein, in a respective one of the plurality of time-sequential photosensitive modes, the plurality of spaced apart light-emitting blocks are configured to emit light; and the plurality of light emitting blocks are defined in an area corresponding to the touch area.

In another aspect, the present invention provides a display device comprising or manufactured by the photosensitive detection device described herein; wherein the display device operates in a time division mode including a display mode and a fingerprint sensing mode; the display device is configured to display an image in the display mode; and the photosensitive detection device is configured to detect a fingerprint in the fingerprint sensing mode.

Optionally, the plurality of light sources are a plurality of light emitting elements in the display device configured to emit light for image display in the display mode.

Optionally, the display device is substantially free of any vacuum space at least in a display area of the display device and between the array substrate and the counter substrate.

Optionally, an optically transparent resin layer substantially penetrating the display region and the peripheral region of the display device is included between the array substrate and the opposite substrate.

Optionally, the optically transparent resin layer includes OCA facestock.

Optionally, an optically transparent resin layer disposed in a peripheral region of the display device and a dielectric layer substantially penetrating a display region of the display device are included between the array substrate and the counter substrate.

Optionally, the dielectric layer comprises silicone oil.

In another aspect, the present invention provides a fingerprint detection method, including: operating the photosensitive detection device in a time division mode including a plurality of time-sequential photosensitive modes; and integrating the signals detected in the plurality of time-sequential photosensitive modes to detect fingerprint information; wherein the photosensitive detection device includes a counter substrate, an array substrate facing the counter substrate, and a fingerprint sensing driver; wherein, in a respective one of the plurality of time-sequential photosensitive modes, the method comprises: illuminating the counter substrate with a plurality of light sources, at least a portion of the light being totally reflected by a surface of the counter substrate remote from the array substrate; and detecting the at least a portion of the light totally reflected by the surface of the counter substrate remote from the array substrate using a light sensor.

Optionally, in a respective one of the plurality of time-sequential photosensitive modes, the method comprises: driving the spaced apart light emitting blocks to emit light, respectively, which is reflected by the plurality of touch sub-areas in the surface of the opposite substrate away from the array substrate; wherein the plurality of touch sub-regions are spaced apart from one another.

Optionally, in a corresponding one of the plurality of time-sequential photosensitive modes, further comprising: detecting light emitted from the plurality of light-emitting blocks and reflected by the plurality of touch sub-areas in a surface of the counter substrate remote from the array substrate, respectively, in a plurality of sensing sub-areas in a light sensor; wherein the plurality of sensing sub-regions of the light sensor do not substantially overlap.

Optionally, the plurality of time-sequential photosensitive modes includes a first mode and a second mode; wherein the method comprises the following steps: driving the spaced apart first light emitting blocks to emit light in the first mode, the light being reflected by the first touch sub-regions in the surface of the opposite substrate away from the array substrate, respectively; and driving the spaced apart second light emitting blocks to emit light in the second mode, the light being reflected by the second touch sub-regions in the surface of the opposite substrate away from the array substrate, respectively; wherein the plurality of first touch sub-regions are spaced apart from one another; and the plurality of second touch sub-areas are spaced apart from one another.

Optionally, the method further comprises: in a plurality of first sensing sub-areas in the light sensor, the following lights are detected, respectively: the light is emitted from the plurality of first light-emitting blocks and reflected by the plurality of first touch sub-areas in the surface of the counter substrate remote from the array substrate, respectively; in a plurality of second sensing sub-areas in the light sensor, the following lights are detected, respectively: the light is emitted from a plurality of second light-emitting blocks and reflected by the plurality of second touch sub-areas in a surface of the counter substrate remote from the array substrate, respectively; the first sensing region and the second sensing region partially overlap; the plurality of first sensing sub-regions are substantially non-overlapping; and the plurality of second sensing sub-regions do not substantially overlap.

Optionally, in a respective one of the plurality of time-sequential photosensitive modes, the method comprises: driving the spaced apart light emitting blocks to emit light, respectively, which is reflected by a surface of the opposite substrate remote from the array base; and determining a size of each of the plurality of light emitting blocks.

Optionally, the plurality of light emitting blocks have substantially the same size; and determining the size of each of the plurality of light emitting blocks comprises: determining a size of each of the plurality of light emitting blocks as a size optimized for achieving a maximum value of the contrast value; wherein the comparison value is composed of

Optionally, the method further comprises: detecting a touch area of the photosensitive detection device when touched; and driving the spaced apart light emitting blocks to emit light, respectively, in a corresponding one of the plurality of time-series photosensitive modes, the light being reflected by a surface of the opposite substrate remote from the array substrate; wherein the plurality of light emitting blocks are defined in an area corresponding to the touch area.

In another aspect, the present invention provides a method of operating a display device, comprising: operating the display device in a time division mode including a display mode and a fingerprint sensing mode; wherein, in the display mode, the method comprises: displaying an image using the display device; and in the fingerprint sensing mode, the method comprising detecting a fingerprint according to the method of any one of claims 16 to 22; and the fingerprint sensing mode comprises a plurality of time sequential photosensitive modes.

Optionally, the time division mode further includes a touch sensing mode; wherein, in the touch sensing mode, the method further comprises: detecting a touch area in the photosensitive detection device when touched; wherein, in the fingerprint sensing mode, the method further comprises: driving a plurality of spaced apart light emitting blocks to emit light in a corresponding one of the plurality of time-sequential photosensitive modes, respectively, the light being reflected by a surface of the opposite substrate remote from the array substrate; wherein the plurality of light emitting blocks are defined in an area corresponding to the touch area.

Drawings

The following drawings are merely examples for illustrative purposes in accordance with various disclosed embodiments and are not intended to limit the scope of the invention.

Fig. 1 is a schematic diagram illustrating a structure of a photosensitive detection device in some embodiments according to the present disclosure.

Fig. 2 illustrates a photosensitive detection mechanism in some embodiments according to the present disclosure.

Fig. 3 illustrates a relationship between a respective one of a plurality of touch sub-areas (objects) and a respective one of a plurality of sense sub-areas (images) in a light sensor in accordance with some embodiments of the present disclosure.

Fig. 4 illustrates a respective one of a plurality of sensing sub-areas (images) in a light sensor in accordance with some embodiments of the present disclosure.

FIG. 5 illustrates a plurality of sensing sub-regions adjacent to one another in some embodiments according to the present disclosure.

FIG. 6 illustrates a plurality of touch sub-areas corresponding to the plurality of sense sub-areas of FIG. 5.

Fig. 7A-7F illustrate methods of detecting full fingerprint information in a plurality of time-sequential photosensitive modes in accordance with some embodiments of the present disclosure.

Fig. 8A-8D illustrate translational displacement of a light emitting block in a plurality of time-sequential photosensitive modes in accordance with some embodiments of the present disclosure.

Fig. 9 illustrates a correlation between a size of a corresponding one of a plurality of light-emitting blocks and a comparison value (comparison value) in accordance with some embodiments of the present disclosure.

Fig. 10 illustrates a time division operation mode of a display device in some embodiments according to the present disclosure.

Fig. 11 is a schematic diagram illustrating a structure of a display device in some embodiments according to the present disclosure.

Fig. 12 is a schematic diagram illustrating a structure of a display device in some embodiments according to the present disclosure.

Fig. 13 is a schematic view illustrating a structure of a display device in some embodiments according to the present disclosure.

Fig. 14 schematically shows a structural view of a fingerprint recognition device according to an embodiment of the present invention.

Fig. 15a schematically shows a block diagram of a finger touch fingerprint recognition device according to an embodiment of the present invention.

Fig. 15b schematically shows a diagram of a total reflection area and a light transmission area according to an embodiment of the invention.

Fig. 15c schematically shows diagrams of an effective image area, an ineffective image area, and a residual image area according to an embodiment of the present invention.

Fig. 16 schematically shows a diagram of magnification according to an embodiment of the present invention.

Fig. 17 schematically shows a simulated view of a fingerprint image obtained when the fingerprint touches the total reflection area.

Fig. 18 schematically shows a diagram of a distribution structure of an image sensor on a support substrate.

Fig. 19 is a flowchart 1 of a driving method according to an embodiment of the present invention.

Fig. 20a schematically shows a block diagram 1 of a point light source according to an embodiment of the present invention.

Fig. 20b schematically shows a block diagram 2 of a point light source according to an embodiment of the present invention.

Fig. 20c schematically shows a block diagram 3 of a point light source according to an embodiment of the present invention.

Fig. 21a schematically shows fig. 1 of an imaging area according to an embodiment of the invention.

Fig. 21b schematically shows fig. 2 of an imaging area according to an embodiment of the invention.

Fig. 22 schematically illustrates fig. 3 of an imaging region according to an embodiment of the invention.

Fig. 23 schematically illustrates fig. 4 of an imaging region according to an embodiment of the invention.

Fig. 24 schematically illustrates a block diagram 4 of a point light source according to an embodiment of the present invention.

Fig. 25 schematically illustrates a block diagram 5 of a point light source according to an embodiment of the present invention.

Fig. 26 schematically shows a block diagram 6 of a point light source according to an embodiment of the present invention.

Fig. 27 schematically illustrates fig. 5 of an imaging region according to an embodiment of the invention.

Fig. 28a schematically shows a block diagram 7 of a point light source according to an embodiment of the present invention.

Fig. 28b schematically shows a block diagram 8 of a point light source according to an embodiment of the present invention.

Fig. 29 schematically illustrates fig. 6 of an imaging region according to an embodiment of the invention.

Fig. 30 schematically illustrates fig. 7 of an imaging region according to an embodiment of the invention.

Fig. 31 schematically illustrates fig. 8 of an imaging region according to an embodiment of the invention.

Fig. 32 schematically illustrates fig. 9 of an imaging region according to an embodiment of the invention.

Fig. 33 schematically illustrates fig. 10 of an imaging region according to an embodiment of the invention.

Fig. 34 is a flowchart 2 of a driving method according to an embodiment of the present invention.

Fig. 35 schematically shows fig. 11 of an imaging region according to an embodiment of the invention.

Detailed Description

The present disclosure will now be described more specifically with reference to the following examples. It should be noted that the following description of some embodiments is presented herein for purposes of illustration and description only. It is not intended to be exhaustive or to be limited to the precise form disclosed.

The present disclosure is directed, inter alia, to a photosensitive detection device, a display device, a fingerprint detection method, and a method of operating a display device that substantially obviate one or more problems due to limitations and disadvantages of the related art. In one aspect, the present disclosure provides a photosensitive detection device. In some embodiments, the photosensitive detection device includes a counter substrate; an array substrate facing the opposite substrate; and a fingerprint sensing driver. In some embodiments, the array substrate includes a plurality of light sources configured to emit light toward the counter substrate, at least a portion of the light being reflected by a surface of the counter substrate remote from the array substrate; and a light sensor configured to detect the at least a portion of light totally reflected by a surface of the counter substrate away from the array substrate. Optionally, the photosensitive detection device is configured to operate in a time division mode comprising a plurality of time-sequential photosensitive modes. Optionally, the fingerprint sensing driver is configured to detect fingerprint information by integrating/integrating (integrating) signals detected in a plurality of time sequential photosensitive modes.

As used herein, the term "fingerprint" refers to an imprint of a human body part. The term fingerprint includes an imprint of a finger such as a thumb. The term fingerprint also includes the imprint of the palm or foot.

Fig. 1 is a schematic diagram illustrating a structure of a photosensitive detection device in some embodiments according to the present disclosure. Referring to fig. 1, in some embodiments, the photosensitive detection device includes an array substrate 1, an opposite substrate 2 facing the array substrate 1, and a fingerprint sensing driver 3 connected to the array substrate 1. In some embodiments, the array substrate 1 comprises a plurality of light sources 10, the plurality of light sources 10 being configured to emit light towards the counter substrate 2, at least a portion of the light being totally reflected by the surface Sc of the counter substrate 2 remote from the array substrate 1. The array substrate 1 further comprises a light sensor 20, the light sensor 20 being configured to detect the at least a portion of the light totally reflected by the surface Sc of the counter substrate 2 remote from the array substrate 1, thereby detecting fingerprint FP information. The array substrate 1 further includes thin film transistors 30 driven by a plurality of light sensors, which are respectively connected to the plurality of light sources 10 for controlling light emission of the plurality of light sources 10. The plurality of light sources 10 may emit monochromatic light. Optionally, the plurality of light sources 10 are each configured to emit different light of different colors. In one example, the plurality of light sources 10 includes a plurality of red light sources that emit red light, a plurality of green light sources that emit green light, and a plurality of blue light sources that emit blue light.

In some embodiments, the plurality of light sources 10 are a plurality of light emitting elements in a photosensitive detection device. Various suitable light emitting elements can be used in the present display substrate. Examples of suitable light emitting elements include organic light emitting diodes, quantum dot light emitting diodes, and micro light emitting diodes.

The plurality of light sources 10 are arranged to emit light toward the counter substrate 2. As shown in fig. 1, at least a part of light emitted from the plurality of light sources 10 is reflected (e.g., totally reflected) by the surface Sc of the counter substrate 2 remote from the array substrate 1, thereby forming totally reflected light. The surface Sc is, for example, a touch surface on which a fingerprint touch occurs. When a finger (or palm) is placed on the side of the counter substrate 2 away from the array substrate 1, a fingerprint FP (or palm print) can be detected. As shown in fig. 1, the fingerprint FP has a plurality of ridge lines RL and a plurality of valley lines VL. The light emitted from the plurality of light sources 10 irradiates a plurality of valleys VL and a plurality of ridges RL of the fingerprint FP (or palm print). Due to the difference in the intensity and reflection angle of the reflected light between the plurality of valleys VL and the plurality of ridges RL, the light projected onto the light sensor 20 may generate different currents, so that the plurality of valleys VL and the plurality of ridges RL of the fingerprint FP (or palm print) may be identified.

In one example, light is shone on one of the plurality of valleys VL. In the areas corresponding to the plurality of valleys VL, the fingers (or palm) are not in contact with the screen surface (the side of the opposite substrate 2 away from the array substrate 1), and the total reflection condition in these areas remains unchanged (for example, the medium on the side of the opposite substrate 2 away from the array substrate 1 is air). In the regions corresponding to the plurality of valleys VL, light is irradiated onto the surface Sc of the counter substrate 2 remote from the array substrate 1, and (at least a part of) the light is totally reflected by the surface Sc of the counter substrate 2 remote from the array substrate 1. In the regions corresponding to the plurality of valleys VL, light totally reflected by the surface Sc of the counter substrate 2 remote from the array substrate 1 is detected.

In another example, light is irradiated on one of the plurality of ridge lines RL. In the areas corresponding to the plurality of ridge lines RL, the fingers (or palms) are in contact with the screen surface (the side of the opposite substrate 2 away from the array substrate 1), and the total reflection condition in these areas is broken (for example, the medium on the side of the opposite substrate 2 away from the array substrate 1 is not air but fingers). In the regions corresponding to the plurality of ridge lines RL, light is irradiated on the surface Sc of the counter substrate 2 remote from the array substrate 1, and diffuse reflection occurs at the interface, thereby generating diffuse reflected light transmitted in the respective directions. The light sensor 20 near one of the plurality of ridge lines RL detects less reflected light than a region corresponding to one of the plurality of valley lines VL. Thus, the plurality of ridge lines RL and the plurality of valley lines VL can be distinguished and identified.

Fig. 2 illustrates a photosensitive detection mechanism in some embodiments according to the present disclosure. Referring to fig. 2, in some embodiments, a respective one of the plurality of light-emitting blocks LB is configured to emit light toward the counter substrate 2, at least a portion of the light being reflected by a surface Sc of the counter substrate 2 remote from the array substrate 1. A respective one of the plurality of light-emitting blocks LB illuminates a respective one of the plurality of touch sub-areas TSR ("objects"), e.g., a respective one of the plurality of touch sub-areas TSR represents a sub-area of the touch interface that receives light emitted from the respective one of the plurality of light-emitting blocks LB. The photosensors are configured to detect reflected light in a respective one of a plurality of sensing sub-regions SSR ("images") in the photosensors.

A respective one of the plurality of light emitting blocks LB may include one or more of the plurality of light sources 10 in fig. 1. Alternatively, a corresponding one of the plurality of light emitting blocks LB includes a plurality of the plurality of light sources 10 in fig. 1. The respective one of the plurality of light emitting blocks LB may have any suitable shape and size. Alternatively, a corresponding one of the plurality of light emitting blocks LB includes m n sub-pixels, m.gtoreq.1 and n.gtoreq.1. Alternatively, m=9, and n=9. Alternatively, a corresponding one of the plurality of light emitting blocks LB has a circular shape.

Fig. 3 illustrates a relationship between a respective one of a plurality of touch sub-areas (objects) and a respective one of a plurality of sense sub-areas (images) in a light sensor in accordance with some embodiments of the present disclosure. As shown in fig. 3, in some embodiments, a respective one of the plurality of sense sub-regions SSR ("images") is greater than a respective one of the plurality of touch sub-regions TSR ("objects"). Fig. 4 illustrates a respective one of a plurality of sensing sub-areas (images) in a light sensor in accordance with some embodiments of the present disclosure. Referring to fig. 4, a corresponding one of the plurality of sensing sub-regions SSR includes an inactive bright region at the center, an inactive dark region surrounding the inactive bright region, and an active sensing region surrounding the inactive dark region.

In the present disclosure, it is found that when the distance between the finger and the light sensor is relatively large, diffuse light reflected by the finger (e.g., multiple ridges of the finger) may affect fingerprint identification, resulting in blurring of the fingerprint image and subsequently resulting in inaccurate fingerprint detection. It is further found in this disclosure that although light collimators can be used to enrich the fingerprint information and filter out diffuse light, the device will inevitably become thicker due to the presence of the light collimators.

Accordingly, to overcome these problems, the present disclosure provides a novel photosensitive detection device configured to operate in a time division mode. The time division pattern includes a plurality of time-sequential photosensitive patterns. The fingerprint sensing driver is configured to detect fingerprint information by integrating signals detected in a plurality of time-sequential photosensitive modes. In some embodiments, in a respective one of a plurality of time-sequential photosensitive modes, the spaced apart plurality of light-emitting blocks are configured to emit light that is reflected by a plurality of touch sub-areas on a surface of the counter substrate remote from the array substrate, respectively, and is detected by a plurality of sensing sub-areas in the light sensor, respectively. Optionally, the plurality of touch sub-areas are spaced apart from one another. Optionally, light reflected by the plurality of touch sub-areas in the surface of the counter substrate remote from the array substrate, respectively, is detected by the plurality of sensor sub-areas in the light sensor. Optionally, the plurality of sensing sub-regions in the light sensor do not substantially overlap. As used herein, the term "substantially non-overlapping" means that the two sub-regions do not overlap by at least 50% (e.g., at least 60%, at least 70%, at least 80%, at least 90%, at least 95%, at least 99%, and 100%). Optionally, adjacent ones of the plurality of sensing subregions are adjacent to each other. As used herein, the term "adjacent" means "meeting" and "adjacent". "adjacent" means "close together", "nearby" or "adjacent". Thus, adjacent means touching or abutting, with the cutting edges touching or approaching.

In each of the plurality of time-series photosensitive modes, a plurality of light-emitting blocks are used to detect fingerprint information. The plurality of light emitting blocks are sufficiently spaced apart from one another such that the plurality of sensing sub-regions in the light sensor do not substantially overlap. By such a design, it is possible to prevent the diffused light from the adjacent light emitting blocks from being detected by the respective ones of the plurality of sensing sub-regions corresponding to the respective one of the plurality of light emitting blocks. The signal-to-noise ratio of the signal detected by a respective one of the plurality of sensing sub-areas may be significantly enhanced.

FIG. 5 illustrates a plurality of sensing sub-regions adjacent to one another in some embodiments according to the present disclosure. FIG. 6 illustrates a plurality of touch sub-areas corresponding to the plurality of sense sub-areas of FIG. 5. Referring to fig. 5, a plurality of sensing sub-regions SSR ("images") in the photosensor are adjacent to each other but do not overlap. However, as shown in fig. 6, the plurality of touch sub-regions TSR corresponding to the plurality of sensing sub-regions SSR in fig. 5 are spaced apart from each other. Thus, in each of the plurality of time-series photosensitive modes, only a part of fingerprint information may be detected, for example, in a single one of the plurality of time-series photosensitive modes, a fingerprint in a space between adjacent ones of the plurality of touch sub-areas TSR in fig. 6 is not detected.

Thus, to detect complete fingerprint information, the present photosensitive detection device is configured to operate in a time division mode comprising a plurality of time-sequential photosensitive modes. The fingerprint sensing driver is configured to detect fingerprint information by integrating signals detected in a plurality of time-sequential photosensitive modes. Specifically, in some embodiments, the plurality of time-sequential photosensitive modes includes a first mode and a second mode. The plurality of spaced apart first light emitting blocks are configured to emit light in a first mode, the light being reflected by a plurality of first touch sub-areas in a surface of the counter substrate remote from the array substrate, respectively, and being detected by a plurality of first sense sub-areas in a first sense area in the light sensor, respectively. The plurality of spaced apart second light emitting blocks are configured to emit light in a second mode, the light being reflected by a plurality of second touch sub-areas in a surface of the opposite substrate away from the array substrate, respectively, and being detected by a plurality of second sensing sub-areas in a second sensing area in the light sensor, respectively. The plurality of first touch sub-areas are spaced apart from one another. The plurality of second touch sub-areas are spaced apart from one another.

Optionally, light respectively reflected by the plurality of first touch sub-areas in the surface of the counter substrate remote from the array substrate is respectively detected by the plurality of first sensing sub-areas in the first sensing area in the light sensor. Optionally, light respectively reflected by the plurality of second touch sub-areas in the surface of the counter substrate remote from the array substrate is respectively detected by the plurality of second sensing sub-areas in the second sensing area of the light sensor. Optionally, the first sensing region and the second sensing region partially overlap. The plurality of first sensing sub-regions do not substantially overlap. Optionally, the plurality of second sensing subregions do not substantially overlap.

Fig. 7A-7F illustrate methods of detecting full fingerprint information in a plurality of time-sequential photosensitive modes in some embodiments according to the present disclosure. In fig. 7A to 7E, four modes are used to demonstrate detection of complete fingerprint information in the touch region TR. Four modes among the plurality of time-series photosensitive modes include a first mode M1, a second mode M2, a third mode M3, and a fourth mode M4.

In the first mode M1, the spaced apart plurality of first light emitting blocks are configured to emit light, which is reflected by the plurality of first touch sub-regions TSR1 in the surface of the opposite substrate away from the array substrate, respectively. The plurality of first touch sub-regions TSR1 are spaced apart from each other, each of the plurality of first touch sub-regions TSR1 corresponding to a partial fingerprint. Light respectively reflected by the plurality of first touch sub-regions TSR1 in the surface of the counter substrate remote from the array substrate is respectively detected by the plurality of first sensing sub-regions in the first sensing region in the photo sensor. The plurality of first sensing sub-regions respectively detect signals originating from the plurality of first touch sub-regions TSR1 in the first touch region TR1, as shown in fig. 7A. Fingerprint information of central regions (e.g., invalid bright regions and invalid dark regions in fig. 4) between adjacent ones of the plurality of first touch sub-regions TSR1 and in each of the plurality of first touch sub-regions corresponding to the invalid sensing regions is not detected in the first pattern M1.

In the second mode M2, the spaced apart plurality of second light emitting blocks are configured to emit light, which is reflected by the plurality of second touch sub-regions TSR2 in the surface of the opposite substrate away from the array substrate, respectively. The plurality of second touch sub-regions TSR2 are spaced apart from each other, each of the plurality of second touch sub-regions TSR2 corresponding to a partial fingerprint. Light respectively reflected by the plurality of second touch sub-regions TSR2 in the surface of the counter substrate remote from the array substrate is respectively detected by the plurality of second sensing sub-regions in the second sensing region in the photo sensor. The plurality of second sensing sub-regions respectively detect signals originating from the plurality of second touch sub-regions TSR2 in the second touch region TR2, as shown in fig. 7B. Fingerprint information of a central area corresponding to the invalid sensing area between adjacent ones of the plurality of second touch sub-areas TSR2 and of each of the plurality of second touch sub-areas TSR2 is not detected in the second mode M2.

In the third mode M3, the spaced apart plurality of third light emitting blocks are configured to emit light, which is reflected by the plurality of third touch sub-regions TSR3 in the surface of the opposite substrate away from the array substrate, respectively. The plurality of third touch sub-regions TSR3 are spaced apart from each other, each of the plurality of third touch sub-regions TSR3 corresponding to a partial fingerprint. Light reflected by the plurality of third touch sub-regions TSR3 in the surface of the counter substrate away from the array substrate is detected by the plurality of third sensing sub-regions in the third sensing region in the photo sensor, respectively. The plurality of third sensing sub-regions respectively detect signals originating from the plurality of third touch sub-regions TSR3 in the third touch region TR3, as shown in fig. 7C. Fingerprint information of a central area between adjacent ones of the plurality of third touch sub-areas TSR3 of the third touch area TR3 and corresponding to the invalid sensing area of each of the plurality of third touch sub-areas TSR3 is not detected in the third mode M3.

In the fourth mode M4, the spaced apart plurality of fourth light emitting blocks are configured to emit light, which is reflected by the plurality of fourth touch sub-regions TSR4 in the surface of the opposite substrate away from the array substrate, respectively. The plurality of fourth touch sub-regions TSR4 are spaced apart from each other, each of the plurality of fourth touch sub-regions TSR4 corresponding to a partial fingerprint. Light respectively reflected by the plurality of fourth touch sub-regions TSR4 in the surface of the opposite substrate away from the array substrate is respectively detected by the plurality of fourth sensing sub-regions in the fourth sensing region in the photo sensor. The plurality of fourth sensing sub-regions respectively detect signals originating from the plurality of fourth touch sub-regions TSR4 in the fourth touch region TR4, as shown in fig. 7D. Fingerprint information of a central area between adjacent ones of the plurality of fourth touch sub-areas TSR4 of the fourth touch area TR4 and corresponding to the invalid sensing area of each of the plurality of fourth touch sub-areas TSR4 is not detected in the fourth mode M4.

In order to detect the complete fingerprint information, the present photosensitive detection device integrates the signals detected in the first mode M1, the second mode M2, the third mode M3 and the fourth mode M4. As shown in fig. 7E, the integration of signals from the plurality of time-series photosensitive patterns enables the detection of the complete fingerprint information in the first, second, third, and fourth touch regions TR1, TR2, TR3, and TR 4. The missing fingerprint information in one mode may be supplemented by fingerprint information detected in the other mode. As shown in fig. 7E, when the photosensitive detection device operates in the time division mode as described herein, not only missing fingerprint information between adjacent touch sub-areas but also missing fingerprint information in a central area of each touch sub-area corresponding to an invalid sensing area can be effectively complemented. Fig. 7F shows an exemplary fingerprint detected by the present photosensitive detection device.

The plurality of time-sequential photosensitive modes may include any suitable number of modes, for example, N modes. Optionally, N is not less than 3. Optionally, N is greater than or equal to 4. Optionally, N is greater than or equal to 5. Alternatively, n=6.

In some embodiments, the total number of the plurality of light emitting blocks in each mode is substantially the same. For example, the total number of the plurality of first light emitting blocks and the total number of the plurality of second light emitting blocks are substantially the same. For example, when n=4, the total number of the plurality of first light emitting blocks, the total number of the plurality of second light emitting blocks, the total number of the plurality of third light emitting blocks, and the total number of the plurality of fourth light emitting blocks are substantially the same. As used herein, the term "substantially the same" means that the difference between two values is no more than 10% of the base value (e.g., one of the two values), e.g., no more than 8%, no more than 6%, no more than 4%, no more than 2%, no more than 1%, no more than 0.5%, no more than 0.1%, no more than 0.05%, no more than 0.01% of the base value.

It follows that the total number of touch sub-areas in each mode is substantially the same and the total number of sense sub-areas in each mode is substantially the same. For example, when n=4, the total number of the plurality of first touch sub-regions, the total number of the plurality of second touch sub-regions, the total number of the plurality of third touch sub-regions, the total number of the plurality of fourth touch sub-regions, the total number of the plurality of first sensing sub-regions, the total number of the plurality of second sensing sub-regions, the total number of the plurality of third sensing sub-regions, and the total number of the plurality of fourth sensing sub-regions are substantially the same.

As shown in fig. 7A-7E, in some embodiments, the positions of the plurality of touch sub-regions in two different modes are related by translational displacement. As used herein, the term "translational displacement" means that a first region can substantially (e.g., completely) overlap a second region by translational movement, and that the two regions are substantially identical in extent (co-existence) after translational movement. For example, the positions of the plurality of first touch sub-regions TSR1 are correlated with the positions of the plurality of second touch sub-regions TSR2 by translating to the right in the horizontal direction, e.g., the plurality of first touch sub-regions TSR1 overlap the plurality of second touch sub-regions TSR2 after translating to the right and are the same range as the plurality of second touch sub-regions TSR 2. In another example, the positions of the plurality of second touch sub-regions TSR2 are correlated with the positions of the plurality of third touch sub-regions TSR3 by translating rightward in a horizontal direction and then translating downward in a vertical direction, e.g., the plurality of second touch sub-regions TSR2 overlap the plurality of third touch sub-regions TSR3 and are identical in range to the plurality of third touch sub-regions TSR3 after translating rightward and downward.

It follows that the positions of the plurality of sensing sub-areas in the two different modes are related by translational displacement. For example, the positions of the plurality of first sensing sub-regions are related to the positions of the plurality of second sensing sub-regions by translating to the right in the horizontal direction, e.g., the plurality of first sensing sub-regions overlap the plurality of second sensing sub-regions after translating to the right and are the same range as the plurality of second sensing sub-regions. In another example, the position of the plurality of second sensing sub-regions is related to the position of the plurality of third sensing sub-regions by translating right in a horizontal direction and then translating down in a vertical direction, e.g., the plurality of second sensing sub-regions overlaps and is the same range as the plurality of third sensing sub-regions after translating right and translating down.

In some embodiments, the positions of the plurality of light emitting blocks in two different modes are related by translational displacement. Optionally, the positions of the plurality of first light emitting blocks and the positions of the plurality of second light emitting blocks are related by translational displacement. For example, the positions of the plurality of first light emitting blocks are related to the positions of the plurality of second light emitting blocks by shifting rightward in the horizontal direction, e.g., the plurality of first light emitting blocks overlap the plurality of second light emitting blocks after shifting rightward, and are the same as the plurality of second light emitting blocks in range. In another example, the positions of the plurality of second light emitting blocks are related to the positions of the plurality of third light emitting blocks by being shifted right in a horizontal direction and then shifted down in a vertical direction, for example, the plurality of second light emitting blocks overlap the plurality of third light emitting blocks after being shifted right and shifted down and are the same range as the plurality of third light emitting blocks. Fig. 8A-8D illustrate translational displacement of a light emitting block in a plurality of time-sequential photosensitive modes in accordance with some embodiments of the present disclosure. Referring to fig. 8A to 8D, the plurality of first light emitting blocks LB1, the plurality of second light emitting blocks LB2, the plurality of third light emitting blocks LB3, and the plurality of fourth light emitting blocks are related by translational displacement.

In any one of the plurality of time-series photosensitive patterns, only the plurality of light-emitting blocks designated for a specific individual pattern are configured to emit light, and the light sources other than the plurality of light-emitting blocks designated for the specific individual pattern are turned off to reduce interference with fingerprint detection in the sensing region corresponding to the plurality of light-emitting blocks designated for the specific individual pattern. For example, in some embodiments, at least the light sources surrounding the plurality of light emitting blocks designated for the specific individual mode are turned off. In one example, any light sources inside X sub-pixels surrounding the plurality of light emitting blocks designated for the specific individual mode are turned off, where X is equal to or greater than 20 sub-pixels.

Referring to fig. 7A-7E, in some embodiments, the plurality of touch sub-regions have substantially the same size at least in the same one of the plurality of time-sequential photosensitive modes (e.g., first mode, second mode, third mode, or fourth mode). Thus, at least in the same one of the plurality of time-sequential photosensitive modes, the plurality of sensing sub-regions have substantially the same size. In some embodiments, referring to fig. 8A to 8D, the plurality of light emitting blocks have substantially the same size at least in the same one of the plurality of time-series photosensitive modes. Optionally, in any and all of the plurality of time-sequential photosensitive modes, the plurality of touch sub-regions have substantially the same size, the plurality of sense sub-regions have substantially the same size, and the plurality of light-emitting blocks have substantially the same size.

In some embodiments, a size of a respective one of the plurality of light emitting blocks may be determined as a size optimized for achieving a maximum value of the contrast value. As used herein, the term contrast value is defined by

Definition; wherein Sr represents a signal corresponding to a ridge of the fingerprint; sv represents a signal corresponding to a valley of the fingerprint. Fig. 9 illustrates a correlation between a contrast value and a size of a corresponding one of a plurality of light emitting blocks in accordance with some embodiments of the present disclosure. As shown in fig. 9, in some embodiments, the size optimized to achieve the maximum contrast value is a block of (9 sub-pixels x 9 sub-pixels).

In some embodiments, the photosensitive detection device further includes a touch sensing drive circuit configured to control touch detection of a touch area in the photosensitive detection device. The touch sensing driving circuit may be integrated with the fingerprint sensing driver 3 of fig. 1 as a whole circuit (unit circuit). Alternatively, the touch sensing drive circuit is a separate circuit or independent circuit configured specifically for controlling touch detection of a touch area in the photosensitive detection device. In some embodiments, the photosensitive detection device operates in a time division mode that includes a touch sensing mode followed by a plurality of time-sequential photosensitive modes. Various suitable methods may be used to detect the touch area. For example, in some embodiments, the photosensitive detection device further includes a touch substrate (mutual capacitance or self capacitance) having a plurality of touch electrodes.

In some embodiments, as shown in fig. 7A to 7D, a plurality of touch sub-areas corresponding to a respective one of the plurality of light emitting blocks are defined in the touch area TR. By first determining the touch area where the finger is in contact with the surface of the counter substrate, fingerprint detection can be performed more efficiently and more quickly. In some embodiments, a plurality of light emitting blocks in each of the plurality of time-series photosensitive modes are defined in an area corresponding to the touch area TR.

In another aspect, the present disclosure provides a display device comprising a photosensitive detection device as described herein. In some embodiments, the display device operates in a time division mode including a display mode and a fingerprint sensing mode. The display device is configured to display an image in a display mode. The photosensitive detection device is configured to detect a fingerprint during a fingerprint sensing mode. In some embodiments, the photosensitive detection device is integrated into the display device as an integral unit. For example, in some embodiments, the plurality of light sources are a plurality of light emitting elements in a display device configured to emit light for image display in a display mode. In another example, the light sensor is integrated into the display device, e.g., integrated in the inter-subpixel area of the display device.

Examples of suitable display devices include, but are not limited to, electronic paper, mobile phones, tablets, televisions, monitors, notebook computers, digital photo albums, GPS, and the like.

Fig. 10 illustrates a time division operation mode of a display device in some embodiments according to the present disclosure. Referring to fig. 10, in some embodiments, the display device operates in a time division mode including a display mode, a touch sensing mode, and a fingerprint detection mode. Alternatively, referring to fig. 10, the touch sensing mode and the fingerprint detection mode are two different modes that occur in two different non-overlapping time frames. Optionally, the touch sensing mode and the fingerprint detection mode occur in two partially overlapping time frames. Optionally, the touch sensing mode and the fingerprint detection mode occur substantially simultaneously, e.g. simultaneously. In this case, the touch sensing mode and the fingerprint detection mode become integrated touch sensing and fingerprint detection modes.

In some embodiments, in the touch sensing mode, the display device is configured to detect a touch region where a finger is in contact with a surface of the counter substrate. In the display mode, the display device is configured to display an image. In the fingerprint detection mode, the display device is configured to detect fingerprint information. In some embodiments, the fingerprint detection mode includes a plurality of time-sequential photosensitive modes as described herein.

Fig. 11 is a schematic diagram illustrating a structure of a display device in some embodiments according to the present disclosure. Referring to fig. 11, in some embodiments, the display device includes an array substrate 1 and a counter substrate 2 facing the array substrate 1. The array substrate 1 and the counter substrate 2 are adhered together using an optically transparent resin layer 40 provided in the peripheral area PA of the display device. In the display area DA, a vacuum space exists between the array substrate 1 and the counter substrate 2. As shown in fig. 11, when the incident angle of light emitted from the array substrate 1 with respect to the interface between the vacuum space and the top layer of the array substrate 1 is equal to or greater than a threshold value, a portion of the light (depicted as a bold line) undergoes total reflection at the interface between the vacuum space and the top layer of the array substrate 1. Due to the vacuum space, this part of the light does not reach the interface between the finger and the surface Sc of the counter substrate 2 remote from the array substrate 1. As a result, a portion of fingerprint information corresponding to a portion of light totally reflected at the interface between the vacuum space and the top layer of the array substrate 1 cannot be detected. In addition, the portion of light reflected by the interface between the vacuum space and the top layer of the array substrate 1 increases noise of the signal detected by the light sensor 20.

In order to overcome this problem, the present disclosure provides a display device in which a vacuum space is substantially not present between the array substrate 1 and the counter substrate 2. Alternatively, the display device does not have any vacuum space between the array substrate 1 and the opposite substrate 2 at least in the display area DA. Fig. 12 is a schematic diagram illustrating a structure of a display device in some embodiments according to the present disclosure. Referring to fig. 12, the array substrate 1 and the opposite substrate 2 are adhered together using an optically transparent resin layer 40 substantially penetrating the display area DA of the display device, thereby eliminating any vacuum space between the array substrate 1 and the opposite substrate 2 at least at the display area DA. As shown in fig. 12, since the optically transparent resin layer 40 is present between the array substrate 1 and the counter substrate 2 at least in the display area DA, a portion of light depicted as a thick line having an incident angle α (or more) is not totally reflected at the interface between the optically transparent resin layer 40 and the top layer of the array substrate 1. Instead, this portion of the light continues to travel to the interface between the finger and the surface Sc of the counter substrate 2 remote from the array substrate 1. As a result, more complete fingerprint information can be detected and noise levels reduced. Optionally, the optically clear resin layer is OCA (Optically Clear Adhesive) facestock.

As used herein, the term "peripheral region" refers to a region in a display substrate (e.g., a counter substrate or an array substrate) in a display panel where various circuits and wires are provided to transmit signals to the display substrate. To increase the transparency of the display device, opaque or opaque components of the display device (e.g., battery, printed circuit board, metal frame) may be disposed in the peripheral area instead of the display area.

As used herein, the term "display area" refers to an area in a display substrate (e.g., a counter substrate or an array substrate) in a display panel where an image is actually displayed. Alternatively, the display region may include a sub-pixel region and an inter-sub-pixel region. The sub-pixel region refers to a light emitting region of a sub-pixel, for example, a region corresponding to a pixel electrode in a liquid crystal display or a region corresponding to a light emitting layer in an organic light emitting diode display panel. The inter-subpixel region refers to a region between adjacent subpixel regions, for example, a region corresponding to a black matrix in a liquid crystal display or a region corresponding to a pixel defining layer in an organic light emitting diode display panel. Alternatively, the inter-subpixel area is an area between adjacent subpixel areas in the same pixel. Alternatively, the inter-subpixel area is an area between two adjacent subpixel areas from two adjacent pixels.

Fig. 13 is a schematic view illustrating a structure of a display device in some embodiments according to the present disclosure. Referring to fig. 13, in some embodiments, the array substrate 1 and the counter substrate 2 are adhered together using an optically transparent resin layer 40 provided in the peripheral region PA of the display device. Between the array substrate 1 and the counter substrate 2 in the display area DA, the display device further comprises a dielectric layer 50 for eliminating any vacuum space between the array substrate 1 and the counter substrate 2 and at least in the display area DA. As shown in fig. 13, since the dielectric layer 50 is present at least in the display area DA and between the array substrate 1 and the counter substrate 2, a portion of light depicted as a thick line having an incident angle α (or more) is not totally reflected at the interface between the dielectric layer 50 and the top layer of the array substrate 1. Instead, the portion of the light continues to travel to the interface between the finger and the surface Sc of the counter substrate 2 remote from the array substrate 1. As a result, more complete fingerprint information can be detected and noise levels are reduced.

Optionally, dielectric layer 50 comprises a material having a refractive index in the range of 1.3 to 1.7, such as a refractive index of 1.4 to 1.6, 1.45 to 1.55, 1.48 to 1.52, or about 1.5. Optionally, the dielectric layer 50 comprises a liquid material. Optionally, dielectric layer 50 comprises silicone oil.

In another aspect, the present disclosure provides a fingerprint detection method. In some embodiments, the method includes operating the photosensitive detection device in a time division mode including a plurality of time-sequential photosensitive modes; and integrating the signals detected in the plurality of time-sequence photosensitive modes to detect fingerprint information. In some embodiments, the photosensitive detection device includes a counter substrate; an array substrate facing the opposite substrate; and a fingerprint sensing driver. In some embodiments, in a respective one of a plurality of time-sequential photosensitive modes, the method includes: using a plurality of light sources to emit light toward the opposite substrate, at least a portion of the light being reflected by a surface of the opposite substrate remote from the array substrate; the at least a portion of the light totally reflected by the surface of the counter substrate remote from the array substrate is detected using a light sensor.

In some embodiments, in a respective one of a plurality of time-sequential photosensitive modes, the method includes: the plurality of spaced apart light emitting blocks are respectively driven to emit light, which is respectively reflected by the plurality of touch sub-areas in the surface of the opposite substrate remote from the array substrate. Optionally, the plurality of touch sub-areas are spaced apart from one another. Optionally, in a respective one of the plurality of time-sequential photosensitive modes, the method further comprises: in a plurality of sensing regions in the light sensor, the following lights are detected respectively: the light is emitted from the plurality of light emitting blocks and reflected by the plurality of touch sub-areas in the surface of the counter substrate remote from the array substrate, respectively. Optionally, the plurality of sensing sub-regions in the light sensor do not substantially overlap. Optionally, adjacent ones of the plurality of sensing subregions are adjacent to each other.

In some embodiments, the plurality of time-sequential photosensitive modes includes a first mode and a second mode. In some embodiments, the method comprises: driving the spaced apart first light emitting blocks to emit light in a first mode, the light being reflected by the first touch sub-regions in a surface of the opposite substrate remote from the array substrate, respectively; and driving the spaced apart plurality of second light emitting blocks to emit light in a second mode, the light being reflected by the plurality of second touch sub-areas in the surface of the opposite substrate remote from the array substrate, respectively. Optionally, the plurality of first touch sub-areas are spaced apart from each other. Optionally, the plurality of second touch sub-areas are spaced apart from each other.

In some embodiments, the method further comprises: the following lights are detected in a plurality of first sensing regions in the light sensor, respectively: the light is emitted from the plurality of first light-emitting blocks and reflected by the plurality of first touch subareas in the surface of the opposite substrate away from the array substrate respectively; and in a plurality of second sensing sub-areas of the light sensor, detecting the following light respectively: the light is emitted from the plurality of second light emitting blocks and is reflected by the plurality of second touch sub-areas in the surface of the opposite substrate away from the array substrate, respectively. Optionally, the first sensing region and the second sensing region partially overlap. Optionally, the plurality of first sensing sub-regions do not substantially overlap. Optionally, the plurality of second sensing subregions do not substantially overlap.

Optionally, a total number of the plurality of first light emitting blocks is substantially the same as a total number of the plurality of second light emitting blocks.

Optionally, in a respective one of the plurality of time-sequential photosensitive modes, the plurality of light-emitting blocks are configured to emit light; the plurality of light emitting blocks have substantially the same size.

In some embodiments, in a respective one of a plurality of time-sequential photosensitive modes, the method includes: respectively driving the plurality of spaced light emitting blocks to emit light, the light being respectively reflected by the plurality of touch sub-areas in the surface of the opposite substrate away from the array substrate; the size of each of the plurality of light emitting blocks is determined. Optionally, determining the size of each of the plurality of light emitting blocks includes: a size of each of the plurality of light emitting blocks optimized to achieve a maximum value of the contrast value is determined. Alternatively, the contrast value is defined by

Definition; wherein Sr represents a signal corresponding to a ridge of the fingerprint; sv represents a signal corresponding to a valley of the fingerprint.

In some embodiments, the method further comprises detecting a touch area in the photosensitive detection device upon touch; the plurality of spaced apart light emitting blocks are respectively driven to emit light in a corresponding one of the plurality of time-sequential photosensitive modes, the light being respectively reflected by the plurality of touch sub-areas in the surface of the counter substrate remote from the array substrate. Alternatively, a plurality of light emitting blocks are defined in an area corresponding to the touch area.

In another aspect, the present disclosure provides a method of operating a display device. In some embodiments, a method of operating a display device includes: the display device is operated in a time division mode including a display mode and a fingerprint sensing mode. Optionally, in the display mode, the method comprises displaying the image using a display device. Optionally, in the fingerprint sensing mode, the method comprises detecting a fingerprint according to the methods described herein. Optionally, the fingerprint sensing mode comprises a plurality of time sequential photosensitive modes.

In some embodiments, the time division mode further includes a touch sensing mode. In some embodiments, in the touch sensing mode, the method further comprises: a touch area in the photosensitive detection device is detected at the time of touch. In some embodiments, in the fingerprint sensing mode, the method further comprises: the plurality of spaced apart light emitting blocks are respectively driven to emit light in a corresponding one of a plurality of time-sequential photosensitive modes, the light being respectively reflected by a plurality of touch sub-areas in a surface of the opposite substrate remote from the array substrate. Alternatively, a plurality of light emitting blocks are defined in an area corresponding to the touch area.

Referring to fig. 14, a fingerprint recognition device according to an embodiment of the present invention may include: the image sensor includes a substrate 100, a plurality of pixel units 110 located at one side of the substrate 100, and a plurality of image sensors 120 located at the other side of the substrate facing the plurality of pixel units 110. Here, the image sensor 120 is used to receive light reflected by the interface. Each pixel unit 110 includes a plurality of sub-pixels 111. In one embodiment, the pixel unit 110 may include three sub-pixels 111, for example, a red sub-pixel, a green sub-pixel, and a blue sub-pixel. In another embodiment, the pixel unit 110 may further include four sub-pixels 111, such as a red sub-pixel, a green sub-pixel, a blue sub-pixel, and a white sub-pixel. In yet another embodiment, the subpixels 111 in the pixel unit 110 may all be white subpixels. The number of sub-pixels and the color of the sub-pixels are not limited.

In one embodiment, electroluminescent diodes such as Organic Light Emitting Diodes (OLEDs), quantum dot light emitting diodes (QLEDs), etc., may have self-luminescence, low power consumption, etc. In one embodiment, as shown in fig. 14, each subpixel 111 may include an electroluminescent diode 112 and a pixel circuit 113 for driving the electroluminescent diode 112 to emit light. Here, the electroluminescent diode 112 may be an OLED or a QLED. In general, a pixel circuit may include a plurality of transistors such as a driving transistor, a switching transistor, and the like, and a storage capacitor. The structure can be the same as the prior art. There is no limitation here. In addition, in order to protect the thin film layer in the fingerprint recognition device, as shown in fig. 14, the fingerprint recognition device may further include a protective glass 200 on the side of the sub-pixel 111 opposite to the substrate 100. The cover glass 200 is generally transparent, such as a glass substrate. It should be noted that fig. 14 is only described by taking a driving transistor in the pixel circuit 113 as an example.

In one embodiment, at least one subpixel is a point light source. As shown in fig. 15a to 15c, when the point light source emits light and fingerprint acquisition is performed, the electroluminescent diode 112 emits light to irradiate the cover glass 200. Due to the effect of total reflection, total reflection occurs if the incident angle of light emitted from the electroluminescent diode 112 is greater than or equal to the critical angle θ of total reflection. As a result, the light rays L2-L4 cannot pass through the glass 200, and an annular total reflection region QB may be formed. The incident angle of the light ray L1 is smaller than the critical angle θ of total reflection, and the light ray L1 may be emitted to form a light transmission region TG surrounded by the total reflection region QB. When the finger touches the cover glass 200, there may be a total reflection area QB and a light transmission area TG at the interface S2 of the finger touch. The light in the region where the light L1 is located or the light transmission region TG may be reflected by the cover glass 200, and in addition, the light in the region may also be reflected by the interface S2 touched by the finger, and both reflected lights may be incident on the image sensor. However, the difference between the two reflected lights is small. As a result, the valleys and ridges cannot be distinguished. In addition, the angle between the light ray L1 and the normal angle is relatively small, and thus the light intensity is relatively large. Therefore, when light in the area where the light ray L1 is located is reflected and then incident on the image sensor, the photosensitive detection range of the image sensor 120 may be exceeded, so that the valley and the ridge cannot be distinguished. In this way, the ineffective image area WX is formed on the plane S1 in which the image sensor 120 is located. That is, in the ineffective image area WX, although the image sensor 120 also receives light, the difference between different light signals is small. As a result, the difference between the different photo-induced electrical signals generated by the image sensors in the ineffective image area WX is small. As a result, the valleys and ridges cannot be distinguished.

Since the light intensity of the light received by the image sensor is relatively large in the ineffective image area WX, there may be a residual image for a period of time after the image sensor receives the light. If the residual image does not fade, then when the image sensor subsequently receives light, the electrical signal generated by the image sensor is inaccurate due to the effects of the residual image. Thus, the acquired fingerprint is inaccurate. In addition, since the light intensity is strongest at the center of the light transmission region TG, the intensity of light received by the image sensor is strongest at the center region of the ineffective image region (i.e., the residual image region CY). Therefore, the residual image of the image sensor in the residual image area CY has the greatest influence on the accuracy of the acquired fingerprint. Thus, fingerprint acquisition may be performed by light of the total reflection area QB. In one embodiment, the total reflection condition is destroyed when the ridge of the fingerprint FG contacts the total reflection area QB. When the valley regions contact the total reflection region QB, the total reflection conditions in these regions are not destroyed. Thus, due to the influence of the valleys and ridges, the light in the total reflection area QB is irradiated on the image sensor, and a fingerprint image with alternating brightness and darkness can be formed. In this way, when the point light source emits light, the light emitted by the point light source forms an annular effective image area TX on the plane S1 where the image sensor 120 is located after being reflected by the interface touched by the finger in the total reflection area QB. In addition, the effective image area TX surrounds the ineffective image area WX. The ineffective image area WX has a residual image area CY. Here, the central area of the ineffective image area WX may be the residual image area CY. Of course, the residual image area CY may be determined by design according to the actual application environment. There is no limitation here.

Referring to fig. 15a to 16, S1 represents a plane in which the image sensor 120 is located. S1' represents the mirror surface of S1. S2 represents the plane of the interface touched by the finger FG. S3 represents the plane in which the electroluminescent diode 112 in the point light source is located. d1 represents the distance between the plane S2 of the interface touched by the finger and the plane S3 of the subpixel of the light-emitting point light source. d2 represents the distance between the plane S2 in which the interface touched by the finger lies and the plane S1 in which the image sensor lies. Because of d2>d1, it can be seen that the fingerprint image formed on the image sensor is an enlarged image compared to the original fingerprint. In addition, the magnification a may satisfy the following formula:

the area of the ineffective image area SWX and the area of the light transmission area STG satisfy the formula: swx=a2×stg.

In addition, fig. 17 shows a simulation result of a fingerprint image acquired when a finger touches the total reflection area QB. As can be seen from fig. 17, the effective image area of the formed fingerprint image is annular. The center has a missing portion. The missing portion is located in the invalid image region, and the missing fingerprint corresponds to the fingerprint in the light transmission region. To capture a fingerprint of the missing portion at the center, the electroluminescent diode adjacent to the electroluminescent diode 112 in fig. 15 is controlled to emit light at a subsequent time so that the missing portion in fig. 17 can be covered or captured at a subsequent time. However, due to the characteristics of the image sensor, a residual image may exist for a while after the image sensor receives light. If the residual image does not fade, then the electrical signal generated by the image sensor is inaccurate due to the effect of the residual image when the image sensor receives light at a later time. Thus, the collected fingerprint is inaccurate, and the fingerprint recognition effect may be poor.

Based on the above, an embodiment provides a driving method of a fingerprint identification device, which is used for improving the accuracy of collected fingerprints and improving the fingerprint identification effect.

The driving method of the fingerprint recognition device according to an embodiment may include a fingerprint input stage:

in the fingerprint input stage, for the same image sensor, the interval between the time at which light in the residual image area is received and the time at which light in the effective image area is received is at least a preset residual image decay period.

In the fingerprint input stage, the driving method of the fingerprint recognition device according to the embodiment controls the following intervals: the interval between the time light is received in the residual image area and the time light is received in the effective image area by the same image sensor is at least a preset residual image decay period. Accordingly, by a preset residual image fading period, a residual image generated after the image sensor receives light in the residual image region may fade out to an acceptable error range. Therefore, when the image sensor receives light in the effective image area, it can be considered that the residual image has been eliminated. Accordingly, the accuracy of the electrical signal generated by the image sensor is improved. In addition, the accuracy of collecting fingerprints is improved, and the fingerprint identification effect is improved.

In one embodiment, referring to fig. 18, the image sensor 120 may include: a photodiode 121, and a switching transistor 122 electrically connected to the photodiode 121. Further, the gate of the switching transistor 122 is electrically connected to the fingerprint acquisition line 123. The source of the switching transistor 122 is electrically connected to the photodiode 121. The drain of the switching transistor 122 is electrically connected to a detection output line 124. Thus, when the fingerprint acquisition line 123 transmits a gate-on signal, the switching transistor 122 is turned on, and the driving circuit may be turned on with the photodiode 121 through the detection output line 124, so that the driving circuit may acquire an electrical signal generated by the photodiode. When the fingerprint acquisition line 123 sends a gate off signal, the switching transistor 122 is turned off. Thus, the driving circuit can determine the fingerprint image based on the acquired electrical signals.

In an embodiment of the present invention, a preset residual image fading period may be predetermined. The method for determining the preset residual image fading period may use the following manner. As shown in fig. 18, the light source is controlled to emit light having a preset light intensity. During time T1, the electrical signal Lt1 generated by each photodiode 121 is detected. Then, the light source is turned off. The electrical signal Lt2_b generated by each photodiode 121 is detected at different times T2_b (1.ltoreq.b.ltoreq.B; B is a positive integer, B is a positive integer). For the electric signal lt2_b detected in each time t2_b, based on the electric signals Lt1 and lt2_b generated by each photodiode 121, the residual image ratio lag_b corresponding to each photodiode 121 in the time t2_b may be determined as:

Based on the residual image ratio lagb corresponding to each photodiode 121, a residual map corresponding to time t2_b is determinedAverage of image ratios. When the average value of the residual image ratios corresponding to the time t2_b satisfies the residual image removal rate, the time t2_b may be used as a preset residual image fading period. Here, the residual image removal rate may be a value in the range of 20% -100%. For example, the residual elimination rate may be 20%, 50%, 70%, 80%, or 100%. Of course, if the performances of the photodiodes are different, the length of time for eliminating the residual image is also different. Therefore, the value of the residual image removal rate can be determined by design according to the actual application environment. It is not limited by the examples given herein.

In an embodiment of the present invention, each point light source may be a sub-pixel. Alternatively, each point light source may include all sub-pixels in a pixel unit. Alternatively, each point light source may also include all sub-pixels in more than one pixel unit. Of course, different application environments have different requirements for the number of sub-pixels in the point light source. Therefore, the number of sub-pixels in the point light source can be determined by design according to the actual application environment. It is not limited by the examples given herein.

In one embodiment, the interval between the time light in the residual image area is received and the time light in the effective image area is received by the same image sensor may be a preset residual image decay period. Of course, the interval between the time of receiving light in the residual image area and the time of receiving light in the effective image area by the same image sensor may be determined by design according to the actual application environment. Without being limited to the examples given herein.

It should be noted that: the examples are intended to better illustrate the invention, but not to limit the disclosure.

In one embodiment, the fingerprint input stage may have multiple fingerprint acquisition cycles. Here, the number of fingerprint acquisition cycles may be determined by design according to the actual application environment. There is no limitation here.

In one embodiment, the interval between the time light is received from the residual image area and the time the same image sensor receives light from the active image area is at least a preset residual image decay period.

For example, each point light source may be turned on during a time slot of a light emission sequence. Controlling point light sources having the same light emission sequence to emit light at intervals of at least a preset residual image decay period in two adjacent fingerprint acquisition cycles so as to satisfy the following condition: the interval between the time light is received in the residual image area and the time light is received in the active image area by the same image sensor within two adjacent fingerprint acquisition cycles is at least a preset residual image decay period.

The driving method according to the embodiment controls the point light sources having the same light emission sequence in two adjacent fingerprint acquisition cycles to emit light at intervals of at least a preset residual image fading period, so that the residual image generated by the point light sources in the previous fingerprint acquisition cycle can fade to an acceptable error range in the subsequent fingerprint acquisition cycle after the preset residual image fading period. Thus, in a subsequent fingerprint acquisition cycle, the residual image may be considered to have been eliminated from the image sensor. Thus, in a subsequent fingerprint acquisition cycle, the accuracy of the electrical signal of the image sensor in the effective image area corresponding to the point light sources having the same light emission sequence is improved. In addition, the accuracy of the acquired fingerprint is improved. The effect of fingerprint recognition can be improved.

The following description gives one example: in two adjacent fingerprint acquisition cycles, point light sources of the same lighting sequence are controlled to emit light at intervals of a preset residual image fading period.

In one embodiment of the invention, each fingerprint acquisition cycle may include N consecutive fingerprint acquisition frames. In each fingerprint acquisition frame, a plurality of point light sources in the finger touch area may be controlled to emit light simultaneously, and an electric signal generated by each image sensor in the finger touch area may be acquired. N may be an integer greater than 1. For example, N may be set to 2, 3, 4, 5, 6, etc., which needs to be determined by design according to the actual application environment. Without being limited to the examples given herein.

In one embodiment, referring to fig. 19, point sources of the same lighting sequence in two adjacent fingerprint acquisition cycles are controlled to light at intervals of at least a preset residual image decay period. This satisfies the condition: in two adjacent fingerprint acquisition cycles, the interval between the time light in the residual image area is received and the time light in the active image area is received by the same image sensor is at least a preset residual image decay period. The controlling may include the steps of:

s601: in the current fingerprint acquisition cycle, the point light sources in fingerprint acquisition frames 1 to N are sequentially driven to emit light, so that an effective image area formed by the point light sources emitting light in the fingerprint acquisition frames and a residual image area formed by the point light sources emitting light in adjacent fingerprint acquisition frames meet the following conditions: they do not overlap each other. In one embodiment, the electrical signals generated by all of the image sensors in the fingerprint recognition device may be acquired. In another embodiment, only the electric signal generated by the image sensor in the finger touch area may be acquired, so that the acquisition time of the electric signal may be shortened. To determine the finger touch area, in one embodiment, at the beginning of the first fingerprint acquisition cycle, the following steps may be performed: a finger touch area, such as an area touched by a finger, is acquired in the fingerprint recognition device.

S602, entering a subsequent fingerprint acquisition cycle when the time length of the current fingerprint acquisition cycle meets a preset residual image fading period. In one embodiment, the point sources of light are different during the current and subsequent fingerprint acquisition cycles. It should be noted that the point light sources that are turned on at any time to emit light simultaneously may be a subset of the point light sources of the fingerprint recognition device or a subset of the point light sources of the touch area of the fingerprint recognition device. Further, the respective subsets of point light sources may generate respective subsets of valid image areas, respective subsets of invalid image areas, and respective subsets of residual image areas, respectively. In one embodiment, a subset of point sources that are open at one time slot of a fingerprint acquisition cycle do not overlap with another subset of point sources that are open in another time slot of the same fingerprint acquisition cycle, or do not overlap with another subset of point sources that are open in another time slot of a different fingerprint acquisition cycle. This applies to all embodiments described herein.

The driving method according to the embodiment may control the plurality of point light sources to emit light and collect the electric signal generated by the image sensor in the first fingerprint collection frame of the current fingerprint collection cycle. Then, in the second fingerprint acquisition frame, a plurality of point light sources may be controlled to emit light, and an electric signal generated by the image sensor may be acquired. The remaining steps are then similarly performed. Redundant description is not given here. Because the current fingerprint acquisition cycle may include N fingerprint acquisition frames, the current fingerprint acquisition cycle has a duration length. Thus, in a first fingerprint acquisition frame in a current fingerprint acquisition cycle when the duration of the current fingerprint acquisition cycle satisfies a preset residual image decay period, the residual image on the image sensor in the residual image area may be considered to have faded away, so that the current fingerprint acquisition cycle may end and a subsequent fingerprint acquisition cycle may begin. The plurality of point light sources are controlled to emit light in a first fingerprint acquisition frame in a subsequent fingerprint acquisition cycle, and an electrical signal generated by the image sensor is acquired. Then, the point light source is controlled to emit light in the second fingerprint acquisition frame, and an electric signal generated by the image sensor is acquired. The rest of the operations are then similarly performed until all fingerprint acquisition cycles are completed, thereby acquiring electrical signals corresponding to the finger fingerprint. Redundant description is not given here. Therefore, the accuracy of the electric signal of the image sensor can be improved, and the effect of fingerprint recognition can be improved. Additionally, in one embodiment, the remainder of the fingerprint is captured during the waiting time for the residual image to fade, thereby reducing fingerprint input time. Further improving the fingerprint identification effect.

It should be noted that, in each fingerprint acquisition cycle, the point light sources that emit light in the nth fingerprint acquisition frame are point light sources that have the same light emission time slot in the lighting order, where N is an integer of 1 or more and N or less. In one embodiment of the invention, the pattern of light sources that illuminate in each fingerprint acquisition frame is the same. In this way, the multiple point sources in each fingerprint acquisition frame can be moved in its entirety. For example, taking the first and second fingerprint acquisition cycles and each fingerprint acquisition cycle including four fingerprint acquisition frames (i.e., first to fourth fingerprint acquisition frames) as an example, y1_1 represents a point light source that emits light simultaneously in the first fingerprint acquisition frame in the first fingerprint acquisition cycle as shown in fig. 20 a. Y2_1 represents a point light source that emits light simultaneously in a second fingerprint acquisition frame in a first fingerprint acquisition cycle. Y3_1 represents a point light source that emits light simultaneously in a third fingerprint acquisition frame in a first fingerprint acquisition cycle. Y4_1 represents a point light source that emits light simultaneously in the fourth fingerprint acquisition frame in the first fingerprint acquisition cycle. Y1_2 represents a point light source that emits light simultaneously in the first fingerprint acquisition frame in the second fingerprint acquisition cycle. Y2—2 represents a point light source that emits light simultaneously in the second fingerprint acquisition frame in the second fingerprint acquisition cycle. Y3_2 represents a point light source that emits light simultaneously in the third fingerprint acquisition frame in the second fingerprint acquisition cycle. Y4_2 represents a point light source that emits light simultaneously in the fourth fingerprint acquisition frame in the second fingerprint acquisition cycle. Here, the patterns formed by y1_1, y2_1, y3_1, y4_1, y1_2, y2_2, y3_2, and y4_2 are the same. Alternatively, taking as an example that each fingerprint acquisition cycle includes two fingerprint acquisition frames (i.e., a first fingerprint acquisition frame to a second fingerprint acquisition frame), as shown in fig. 20b and 20 c. Y1_1 represents a point light source that emits light simultaneously in a first fingerprint acquisition frame in a first fingerprint acquisition cycle. Y2_1 represents a point light source that emits light simultaneously in a second fingerprint acquisition frame in a first fingerprint acquisition cycle. Y1_2 represents a point light source that emits light simultaneously in the first fingerprint acquisition frame in the second fingerprint acquisition cycle. Y2—2 represents a point light source that emits light simultaneously in the second fingerprint acquisition frame in the second fingerprint acquisition cycle. Here, the patterns formed by y1_1, y2_1, y1_2, and y2_2 are the same.

Furthermore, in an embodiment of the present invention, the overall moving direction of the point light sources that emit light in consecutive N fingerprint acquisition frames may be the row direction of the sub-pixels in the same fingerprint acquisition cycle. For example, as shown in fig. 20a, in the first fingerprint acquisition cycle, the point light sources y1_1 and y2_1 move in the row direction F1 of the sub-pixels, and the point light sources y3_1 and y4_1 move in the row direction F1 of the sub-pixels. In the second fingerprint acquisition cycle, the point light sources y1_2 and y2_2 move in the row direction F1 of the sub-pixels, and the point light sources y3_2 and y4_2 move in the row direction F1 of the sub-pixels.

In one embodiment of the present invention, the overall moving direction of each point light source that emits light in consecutive N fingerprint acquisition frames may have an angle γ with respect to the row direction of the sub-pixels in the same fingerprint acquisition cycle; here, the angle γ is equal to 90 degrees. That is, the overall moving direction of each point light source in the consecutive N fingerprint acquisition frames is the column direction F2 of the sub-pixels. For example, as shown in fig. 20b, in the first fingerprint acquisition cycle, the point light sources y1_1 and y2_1 move along the column direction F2 of the sub-pixels. In the second fingerprint acquisition cycle, the point light sources y1_2 and y2_2 move along the column direction F2 of the sub-pixels.

In one embodiment of the present invention, in the same fingerprint acquisition cycle, the overall moving direction of each point light source in the continuous N fingerprint acquisition frames may have an angle γ with respect to the direction F3 of the sub-pixel; here, the angle γ is greater than 0 ° and less than 90 °. For example, as shown in fig. 20c, in the first fingerprint acquisition cycle, the point light sources y1_1 and y2_1 move in the direction F3. In the second fingerprint acquisition cycle, the point light sources y1_2 and y2_2 move in the direction F3.

Of course, in embodiments of the present invention, the above-described movement directions may also be combined. Design determination is required according to the practical application environment. Without being limited to the examples given herein.

In one embodiment of the invention, in the same fingerprint acquisition cycle, the effective image area corresponding to the point light source that emits light in the subsequent fingerprint acquisition frame and the effective image area corresponding to the point light source that emits light in the previous fingerprint acquisition frame do not overlap. For example, an effective image area corresponding to a point light source that emits light in a subsequent fingerprint acquisition frame and an effective image area corresponding to a point light source that emits light in a previous fingerprint acquisition frame may satisfy the following conditions: the distance therebetween is a preset distance such that an effective image area corresponding to the point light source that emits light in the subsequent fingerprint acquisition frame is separated from an effective image area corresponding to the point light source that emits light in the previous fingerprint acquisition frame. Here, the preset distance may be the size of at least one sub-pixel, or may be other distances. Design determination is required according to the practical application environment. There is no limitation here. For example: a first fingerprint acquisition cycle and a second fingerprint acquisition cycle, each fingerprint acquisition cycle comprising two fingerprint acquisition frames (i.e., a first fingerprint acquisition frame and a second fingerprint acquisition frame), as shown in fig. 21 a. Tx1_1 represents the effective image area corresponding to the point source of light in the first fingerprint acquisition cycle that emits light in the first fingerprint acquisition frame. Tx2_1 represents the effective image area corresponding to the point source that emits light in the second fingerprint acquisition frame in the first fingerprint acquisition cycle. Tx1_2 represents the effective image area corresponding to the point source that emits light in the first fingerprint acquisition frame in the second fingerprint acquisition cycle. Tx2_2 represents the effective image area corresponding to the point light source that emits light in the second fingerprint acquisition frame in the second fingerprint acquisition cycle. Here, in the first fingerprint acquisition cycle, the effective image area TX2_1 corresponding to the point light source that emits light in the subsequent fingerprint acquisition frame (i.e., the second fingerprint acquisition frame) and the effective image area TX1_1 corresponding to the point light source that emits light in the previous fingerprint acquisition frame (i.e., the first fingerprint acquisition frame) are separated by a certain distance. In the second fingerprint acquisition cycle, the effective image area TX2_2 corresponding to the point light source that emits light in the subsequent fingerprint acquisition frame (i.e., the second fingerprint acquisition frame) and the effective image area TX1_2 corresponding to the light source that emits light in the previous fingerprint acquisition frame (i.e., the first fingerprint acquisition frame) are separated by a certain distance.

In another embodiment, the effective image area corresponding to the point light sources illuminated in the subsequent fingerprint acquisition frame may be tangential to the effective image area corresponding to the point light sources illuminated in the previous fingerprint acquisition frame. For example: the fingerprint acquisition cycle includes two fingerprint acquisition frames (i.e., a first fingerprint acquisition frame and a second fingerprint acquisition frame), as shown in fig. 21 b. Tx1_1 represents the effective image area corresponding to the point source of light in the first fingerprint acquisition cycle that emits light in the first fingerprint acquisition frame. Tx2_1 represents the effective image area corresponding to the point source that emits light in the second fingerprint acquisition frame in the first fingerprint acquisition cycle. It can be seen that the effective image area TX1_1 corresponding to the point light source that emits light in the subsequent fingerprint acquisition frame (i.e., the second fingerprint acquisition frame) is tangential to the effective image area TX2_1 corresponding to the point light source that emits light in the previous fingerprint acquisition frame (i.e., the first fingerprint acquisition frame).

In one embodiment, N may be set to an integer greater than or equal to 3 such that the fingerprint acquisition cycle includes at least three fingerprint acquisition frames. In one embodiment of the invention, for two fingerprint acquisition frames separated from each other by at least one fingerprint acquisition frame, an invalid image region corresponding to a point light source that emits light in a subsequent fingerprint acquisition frame covers a residual image region corresponding to a point light source that emits light in a previous fingerprint acquisition frame in the same fingerprint acquisition cycle. Specifically, for two fingerprint acquisition frames separated from each other by one fingerprint acquisition frame, an invalid image area corresponding to a point light source that emits light in a subsequent fingerprint acquisition frame covers a residual image area corresponding to a point light source that emits light in a previous fingerprint acquisition frame. For example, taking a fingerprint acquisition frame comprising four fingerprint acquisition frames (i.e., a first fingerprint acquisition frame through a fourth fingerprint acquisition frame) as shown in fig. 20a and 22. Tx1_1 represents the effective image area corresponding to each point light source Y1_1 that emits light in the first fingerprint acquisition frame in the first fingerprint acquisition cycle. Tx2_1 represents the effective image area corresponding to each point light source Y2_1 that emits light in the second fingerprint acquisition frame in the first fingerprint acquisition cycle. Tx3_1 represents the effective image area corresponding to each point light source Y3_1 that emits light in the third fingerprint acquisition frame in the first fingerprint acquisition cycle. The TX4_1 represents an effective image area corresponding to each point light source y4_1 that emits light in the fourth fingerprint acquisition frame in the first fingerprint acquisition cycle. Cy1_1 represents a residual image area corresponding to each point light source y1_1 that emits light in the first fingerprint acquisition frame in the first fingerprint acquisition cycle. Cy2_1 represents a residual image area corresponding to each point light source y2_1 that emits light in the second fingerprint acquisition frame in the first fingerprint acquisition cycle. Wx3_1 represents an invalid image region corresponding to each point light source y3_1 that emits light in the third fingerprint acquisition frame in the first fingerprint acquisition cycle. Wx4_1 represents an invalid image region corresponding to each point light source y4_1 that emits light in the fourth fingerprint acquisition frame in the first fingerprint acquisition cycle. Tx1_2 represents the effective image area corresponding to each point light source Y1_2 that emits light in the first fingerprint acquisition frame in the second fingerprint acquisition cycle. Tx2_2 represents the effective image area corresponding to each point light source Y2_2 that emits light in the second fingerprint acquisition frame in the second fingerprint acquisition cycle. Tx3_2 represents the effective image area corresponding to each point light source Y3_2 that emits light in the third fingerprint acquisition frame in the second fingerprint acquisition cycle. Tx4_2 represents the effective image area corresponding to each point light source Y4_2 that emits light in the fourth fingerprint acquisition frame in the second fingerprint acquisition cycle. Cy1_2 represents a residual image area corresponding to each point light source y1_2 that emits light in the first fingerprint acquisition frame in the second fingerprint acquisition cycle. Cy2_2 represents a residual image area corresponding to each point light source y2_2 that emits light in the second fingerprint acquisition frame in the second fingerprint acquisition cycle. Wx3_2 represents an invalid image region corresponding to each point light source y3_2 that emits light in the third fingerprint acquisition frame in the second fingerprint acquisition cycle. Wx4_2 represents an invalid image region corresponding to each point light source y4_2 that emits light in the fourth fingerprint acquisition frame in the second fingerprint acquisition cycle. Here, the effective image areas TX1_1 to TX4_1, TX1_2 to TX4_2, which correspond to each point light source that emits light in the first to fourth fingerprint acquisition frames in the first and second fingerprint acquisition cycles, do not overlap each other. In the first fingerprint acquisition cycle, WX3_1 covers CY1_1 and WX4_1 covers CY2_1. In the second fingerprint acquisition cycle, WX3_2 covers CY1_2 and WX4_2 covers CY2_2.

In one embodiment of the present invention, in two adjacent fingerprint acquisition cycles, the effective image area corresponding to each point light source that emits light in the nth fingerprint acquisition frame in the subsequent fingerprint acquisition cycle may overlap with the ineffective image area corresponding to each point light source that emits light in at least one of the first fingerprint acquisition frame to the nth fingerprint acquisition frame in the previous fingerprint acquisition cycle. Herein, the effective image area corresponding to each point light source that emits light in the nth fingerprint acquisition frame in the subsequent fingerprint acquisition cycle may overlap with the ineffective image area corresponding to each point light source that emits light in the nth fingerprint acquisition frame in the previous fingerprint acquisition cycle. In this way, it is possible to acquire an electrical signal corresponding to a fingerprint in an invalid image region corresponding to each point light source that emits light in the n-th fingerprint acquisition frame in the previous fingerprint acquisition cycle. As shown in fig. 22, TX1_2 overlaps with the invalid image region corresponding to each point light source that emits light in the first fingerprint acquisition frame in the first fingerprint acquisition cycle. Tx2_2 overlaps with the inactive image area corresponding to each point source that emits light in the second fingerprint acquisition frame in the first fingerprint acquisition cycle. Tx3_2 overlaps Wx3_1. Tx4_2 overlaps Wx4_1. Of course, the setting may be accomplished in other ways. There is no limitation here.

Further, in one embodiment, the effective image area corresponding to each point light source that emits light in the nth fingerprint acquisition frame in the subsequent fingerprint acquisition cycle at least partially covers the ineffective image area corresponding to each point light source that emits light in the nth fingerprint acquisition frame in the previous fingerprint acquisition cycle. In this way, it is possible to acquire an electrical signal corresponding to a fingerprint in an invalid image region corresponding to each point light source that emits light in the n-th fingerprint acquisition frame in the previous fingerprint acquisition cycle. For example, as shown in fig. 21a, wx1_1 represents an invalid image region corresponding to each point light source that emits light in the first fingerprint acquisition frame in the first fingerprint acquisition cycle. Wx2_1 represents an invalid image region corresponding to each point light source that emits light in the second fingerprint acquisition frame in the first fingerprint acquisition cycle. Here, the TX1_2 part covers wx1_1. The TX2_2 part covers WX2_1. Of course, the effective image area corresponding to each point light source that emits light in the nth fingerprint acquisition frame in the subsequent fingerprint acquisition cycle may completely cover the ineffective image area corresponding to each point light source that emits light in the nth fingerprint acquisition frame in the previous fingerprint acquisition cycle.

In one embodiment, the effective image area corresponding to each point light source that emits light in the nth fingerprint acquisition frame in a subsequent fingerprint acquisition cycle may at least partially cover the residual image area corresponding to each point light source that emits light in the nth fingerprint acquisition frame in a previous fingerprint acquisition cycle. As shown in fig. 21a, cy1—1 represents a residual image area corresponding to each point light source that emits light in the first fingerprint acquisition frame in the first fingerprint acquisition cycle. Cy2—1 represents a residual image area corresponding to each point light source that emits light in the second fingerprint acquisition frame in the first fingerprint acquisition cycle. Here, TX1_2 completely covers cy1_1. The Tx2_2 completely covers the CY2_1. Of course, the effective image area corresponding to each point light source in the n-th fingerprint acquisition frame in the subsequent fingerprint acquisition cycle may also partially cover the residual image area corresponding to each point light source in the n-th fingerprint acquisition frame in the previous fingerprint acquisition cycle. There is no limitation here. In this way, the effective image area corresponding to the point light sources that were illuminated in the first fingerprint acquisition frame in the subsequent fingerprint acquisition cycle may partially or completely cover the residual image area corresponding to the point light sources that were illuminated in the first fingerprint acquisition frame in the previous fingerprint acquisition cycle. In this way, electrical signals in areas of the residual image not acquired in the first fingerprint acquisition frame in a previous fingerprint acquisition cycle may be acquired. Then, in the second fingerprint acquisition frame, the effective image area corresponding to the point light source that emits light in the second fingerprint acquisition frame may partially or completely cover the residual image area corresponding to the point light source that emits light in the second fingerprint acquisition frame in the previous fingerprint acquisition cycle. In this way, electrical signals in areas of the residual image not acquired in the second fingerprint acquisition frame in the previous fingerprint acquisition cycle may be acquired. The rest of the operations are then similarly performed until all fingerprint acquisition cycles are completed and an electrical signal corresponding to the fingerprint of the finger is acquired. Redundant description is not given here. In addition, for the nth fingerprint in each fingerprint acquisition cycle, since the duration length of the current fingerprint acquisition cycle satisfies the preset residual image decay period, the residual image of the image sensor receiving light of the residual image area in the previous fingerprint acquisition cycle may be considered to have been eliminated, and the subsequent fingerprint acquisition cycle starts. Accordingly, the influence of the residual image of the image sensor in the nth fingerprint acquisition frame on the electric signal can be avoided, thereby improving the accuracy of the electric signal generated by the image sensor. In addition, the accuracy of the collected fingerprints is improved, and the fingerprint identification effect is improved.

In an embodiment of the present invention, the effective image area corresponding to each point light source that emits light in the n-th fingerprint acquisition frame in the subsequent fingerprint acquisition cycle may satisfy the following condition: which does not overlap with the residual image area corresponding to each point light source that emits light in the (n+1) th fingerprint acquisition frame to the nth fingerprint acquisition frame in the previous fingerprint acquisition cycle. Here, the effective image area corresponding to each point light source that emits light in the n-th fingerprint acquisition frame in the subsequent fingerprint acquisition cycle completely covers or partially covers the ineffective image area corresponding to each point light source that emits light in the n-th fingerprint acquisition frame in the previous fingerprint acquisition cycle. There is no limitation here. Taking the example that the fingerprint acquisition cycle includes four fingerprint acquisition frames (i.e., the first fingerprint acquisition frame to the fourth fingerprint acquisition frame), as shown in fig. 22. Tx1_2 partially covers the invalid image region corresponding to the point light source that emits light in the first fingerprint acquisition frame in the first fingerprint acquisition cycle. In addition, the residual image areas of the TX1_2 corresponding to the point light sources that emit light in the second to fourth fingerprint acquisition frames in the first fingerprint acquisition cycle do not overlap. The rest also performs similarly. Redundant description is not given here.

In one embodiment, the fingerprint input stage is used to input a new fingerprint to the fingerprint recognition device for fingerprint recognition. In addition, the working of the fingerprint input stage may be performed each time a new fingerprint is input. In one embodiment of the present invention, after all fingerprint acquisition cycles are completed during the fingerprint input phase, the following steps may be further included:

determining a complete image of the fingerprint of the finger from each electrical signal acquired within each fingerprint acquisition cycle;

image features corresponding to a plurality of fingerprint feature points are extracted from the complete image and stored in a fingerprint database. In this way, the fingerprint determined during the fingerprint input stage may be stored in a fingerprint database for fingerprint identification.

Furthermore, in order to implement the fingerprint recognition function, in one embodiment, the driving method may further include: the fingerprinting stage, which may include at least one fingerprinting cycle.

In the current fingerprint recognition cycle, a plurality of point light sources in a finger touch area are controlled to emit light. In addition, when the point light source emits light, an electric signal generated by each image sensor at least in the finger touch area is collected. In one embodiment, the electrical signals generated by all of the image sensors in the fingerprint recognition device may be acquired. In another embodiment, only the electric signal generated by each image sensor in the finger touch area may be acquired, so that the time to acquire the electric signal may be shortened. To determine the finger touch area, in one embodiment, at the beginning of the first fingerprint recognition cycle, the steps of: a finger touch area touched by a finger in the fingerprint recognition device is acquired.

Fingerprint recognition is performed based on the electrical signals collected during the fingerprint recognition stage and a fingerprint database.

Further, in one embodiment of the present invention, the fingerprint identification stage may include:

determining image features corresponding to fingerprint feature points of the current fingerprint based on the electric signals collected in the current fingerprint identification cycle;

determining whether the similarity between the image features corresponding to the fingerprint feature points of the current fingerprint and the image features corresponding to the fingerprint feature points in the fingerprint database meets a preset similarity threshold;

if so, determining that the current fingerprint matches the stored fingerprint, and a subsequent fingerprint identification phase may begin; here, when determining whether the current fingerprint matches the stored fingerprint, a corresponding operation, such as turning on the device, may be performed.

If not, it is determined that the current fingerprint does not match the stored fingerprint and a subsequent fingerprint identification cycle may begin.

When fingerprint identification is performed, fingerprint identification performance can be evaluated by a False Rejection Rate (FRR) and a False Acceptance Rate (FAR). In one embodiment, the preset similarity threshold may include: FRR <1/50000 and FAR <2%. Of course, different application environments have different requirements for the similarity threshold. Therefore, in practical application, the preset similarity threshold value can be determined according to the practical application environment. There is no limitation here. In this way, when the similarity between the image feature corresponding to the fingerprint feature point of the current fingerprint and the image feature corresponding to the fingerprint feature point in the fingerprint database does not meet the preset similarity threshold, it may indicate that the current fingerprint is not matched with the stored fingerprint, and the fingerprint identification apparatus cannot be opened now. In this way, a subsequent fingerprint identification cycle may be started, continuing the fingerprint identification process. When it is determined that the similarity between the image feature corresponding to the fingerprint feature point of the current fingerprint and the image feature corresponding to the fingerprint feature point in the fingerprint database satisfies a preset similarity threshold, the current fingerprint may be indicated to match the stored fingerprint, and then the fingerprint identification apparatus may be turned on, so that no more fingerprint acquisition process is performed. The time for fingerprint recognition can be shortened. The user experience of fingerprint recognition may be improved.

In an embodiment of the invention, the fingerprint identification loop may be divided into successive fingerprint identification frames comprising at least one fingerprint identification frame. In various embodiments, the fingerprint identification cycle may be divided into one, two, three, four, or six consecutive fingerprint identification frames. Of course, different application environments have different requirements on the number of fingerprint identification frames. Therefore, the number of fingerprint identification frames can be determined by design according to the actual application environment. Without being limited to the examples given herein.

In embodiments of the present invention, most point sources in the finger touch area may be controlled to emit light during the current fingerprint recognition cycle. The process may include: in each of the fingerprint recognition frames in the current fingerprint recognition cycle, a plurality of point light sources in the finger touch area are controlled to emit light, respectively, and an electric signal generated by each of the image sensors in the finger touch area is collected in each of the fingerprint recognition frames. That is, in the same fingerprint recognition cycle, point light sources controlled to emit light in different fingerprint recognition frames are different. Furthermore, point light sources that are controlled to emit light in different fingerprint recognition cycles are different. That is, the point light sources controlled to emit light in each fingerprint identification frame are different. In this way, acquisition of different fingerprint electrical signals can be achieved.

In one embodiment, the fingerprint identification cycle may be divided into at least two consecutive fingerprint identification frames. In one embodiment of the present invention, in the same fingerprint recognition cycle, the effective image area corresponding to the point light source that emits light in the previous fingerprint recognition frame satisfies the following condition: the effective image area is not overlapped with the effective image area corresponding to the point light source which emits light in the subsequent fingerprint identification frame. In one embodiment, in the same fingerprint recognition cycle, the effective image area corresponding to the point light source that emits light in the previous fingerprint recognition frame and the effective image area corresponding to the point light source that emits light in the subsequent fingerprint recognition frame are separated by a certain distance. For example, the fingerprint recognition cycle is divided into two consecutive fingerprint recognition frames (i.e., a first fingerprint recognition frame and a second fingerprint recognition frame), as shown in fig. 23. tx_1 represents an effective image area corresponding to each point light source that emits light in the first fingerprint identification frame. tx_2 represents an effective image area corresponding to each point light source that emits light in the second fingerprint identification frame. Here, tx_1 and tx_2 are separated by a certain distance. In another embodiment, in the same fingerprint recognition cycle, the effective image area corresponding to the point light source that emits light in the previous fingerprint recognition frame satisfies the following condition: the effective image area is tangent to an effective image area corresponding to a point light source which emits light in a subsequent fingerprint identification frame. Without being limited to the examples given herein.

In one embodiment, a plurality of capacitive touch electrodes on the substrate are further disposed in the fingerprint recognition device. In one embodiment of the present invention, the finger touch area touched by the finger in the fingerprint recognition device may include:

collecting the change of capacitance value corresponding to each capacitive touch electrode in the fingerprint identification device; and

the finger touch area is determined based on the change in capacitance value.

Furthermore, in one embodiment, the fingerprint recognition device may also be used as a display device to display an image. In one embodiment of the invention, the driving method may further include a display stage. In the display stage, the fingerprint identification device can be driven to display images. Further, the fingerprint-touch area may be an area touched by a finger in a display area of the fingerprint recognition device. In the fingerprint input stage and the fingerprint recognition stage, the sub-pixels in the finger touch area may be used as point light sources for emitting light, thereby performing fingerprint acquisition. Pixel cells in the display area other than the finger touch area may be used for image display.

Further, in the embodiment of the present invention, as shown in fig. 20a to 20c, for the multi-point light sources that emit light simultaneously, any two point light sources may be separated by at least one sub-pixel. In one embodiment, any two point light sources may be separated by one sub-pixel. Alternatively, any two point light sources may be separated by all sub-pixels in a pixel unit. Alternatively, any two point light sources may be separated by all sub-pixels in the plurality of pixel units.

Since the fingerprint image formed on the image sensor is an enlarged image, when a plurality of point light sources are relatively close, the same image sensor can receive light emitted from the plurality of point light sources and reflected by the interface, so that the accuracy of fingerprint acquisition is affected. In one embodiment, for a plurality of point light sources that emit light simultaneously, the number of sub-pixels for separating any two adjacent point light sources that emit light simultaneously may satisfy the following condition: the effective image areas corresponding to the two point light sources do not overlap each other. Here, the number of sub-pixels for separating any two adjacent point light sources that emit light simultaneously satisfies the following condition: the effective image areas corresponding to the two point light sources are tangent to each other. Alternatively, the number of sub-pixels for separating any two point light sources satisfies the following condition: the effective image areas corresponding to the two point light sources are separated by a certain distance. In one embodiment, as shown in fig. 23 and 24, y_1 represents each point light source that emits light in the first fingerprint recognition frame. y_2 denotes each point light source that emits light in the second fingerprint identification frame. tx_1 represents an effective image area corresponding to each point light source y_1 that emits light in the first fingerprint identification frame. tx_2 denotes an effective image area corresponding to each point light source y_2 that emits light in the second fingerprint identification frame. Here, by setting the number of sub-pixels of any two adjacent point light sources for split light emission, the following condition is satisfied: the effective image areas corresponding to the two point light sources are separated by a certain distance. Of course, in practical application, the above-described number of sub-pixels for separating any two adjacent point light sources that emit light simultaneously may be determined by design according to the practical application environment. Without being limited to the examples given herein.

In one embodiment, as shown in fig. 24, a plurality of point light sources that emit light simultaneously may be arranged in an array. For example, all the point light sources y_1 are arranged in an array, and all the point light sources y_2 are arranged in an array.

In another embodiment, as shown in fig. 25, at least two point light sources may form a point light source group. The plurality of point light sources that emit light at the same time may be divided into a plurality of point light source groups. In a point light source group, the centers of the areas where the point light sources are located are sequentially connected to form a bar shape. For example, all the point light sources y_1 form a bar shape, and all the point light sources y_2 form a bar shape.

Alternatively, as shown in fig. 26, at least three point light sources may form a point light source group. The plurality of point light sources that emit light at the same time are divided into a plurality of point light source groups. In a point light source group, the centers of the areas where the point light sources are located are sequentially connected to form a closed pattern. Further, the closed figure may be provided in a regular polygon or a circle. Here, the regular polygon may be a regular quadrangle, a regular pentagon, a regular hexagon, a regular heptagon, a regular octagon, or the like. There is no limitation here. For example, as shown in fig. 26, four point light sources y_1 form a square, and four point light sources y_2 form a square. Further, as shown in fig. 26 and 27, y_1 represents each point light source that emits light in the first fingerprint identification frame. y_2 denotes each point light source that emits light in the second fingerprint identification frame. tx_1 represents an effective image area corresponding to each point light source y_1 that emits light in the first fingerprint identification frame. tx_2 denotes an effective image area corresponding to each point light source y_2 that emits light in the second fingerprint identification frame. In a group of point light sources, the effective image areas corresponding to two adjacent point light sources may satisfy the condition that they are tangential to each other.

In one embodiment, as shown in fig. 28a, a plurality of point light sources y_1 simultaneously emitting light may form a grid pattern. Here, the grid pattern (i.e., the hatched area in fig. 28 a) may include a plurality of point light sources forming a line shape. Of course, in various embodiments, the grid pattern may be determined by design according to the actual application environment. There is no limitation here. In addition, the mesh pattern may further include a polygon or a circle. Here, the polygon may be a regular quadrangle, a regular pentagon, a regular hexagon, a regular heptagon, a regular octagon, or the like. There is no limitation here. Alternatively, as shown in fig. 28b, a plurality of point light sources y_1 emitting light simultaneously may form a stripe pattern. Of course, a plurality of point light sources emitting light simultaneously may form a grid pattern and a stripe pattern. There is no limitation here.

It should be noted that the above-described arrangement mode of the point light sources is suitable for fingerprint acquisition in at least one of the fingerprint input stage and the fingerprint recognition stage. Furthermore, different application environments have different requirements for the effective image area, the ineffective image area, and the residual image area. Accordingly, an embodiment of the point light source can be designed according to the above conditions and practical application environments. There is no limitation here.

A driving method according to an embodiment is described with reference to fig. 20a, 22, 26, and 27. The driving method according to an embodiment may include the steps of:

(1) In a first fingerprint acquisition frame F1_1 in a first fingerprint acquisition cycle of a fingerprint input stage, acquiring change information of capacitance values corresponding to each capacitive touch electrode in a fingerprint identification device; according to the information of the change in the capacitance value, after the finger touch area is determined, each point light source y1_1 is controlled to emit light simultaneously, and an electric signal generated by each image sensor in the finger touch area is acquired.

(2) In the second fingerprint acquisition frame f2_1 of the first fingerprint acquisition cycle, each point light source y2_1 is controlled to emit light simultaneously, and an electric signal generated by each image sensor in the finger touch area is acquired.

(3) In the third fingerprint acquisition frame f3_1 of the first fingerprint acquisition cycle, each point light source y3_1 is controlled to emit light simultaneously, and an electric signal generated by each image sensor in the finger touch area is acquired.

(4) In the fourth fingerprint acquisition frame f4_1 of the first fingerprint acquisition cycle, each point light source y4_1 is controlled to emit light simultaneously, and an electric signal generated by each image sensor in the finger touch area is acquired. The remainder is then performed in a similar manner to steps (1) - (4) until the duration of the current fingerprint acquisition cycle meets the preset residual image decay period. It can be considered that the residual image on the image sensor operating in the first fingerprint acquisition frame f1_1 has been eliminated. Thereafter, a subsequent fingerprint acquisition cycle, i.e., a second fingerprint acquisition cycle, may begin.

(5) In the first fingerprint acquisition frame f1_2 of the second fingerprint acquisition cycle, each point light source y1_2 is controlled to emit light simultaneously, and an electric signal generated by each image sensor in the finger touch area is acquired. In this way, the electric signal of the image sensor corresponding to the residual image area in the first fingerprint acquisition frame f1_1 can be acquired. Thus, based on the acquired electrical signals, a missing portion of the fingerprint image in the first fingerprint acquisition frame f1_1 is constructed.

(6) In the second fingerprint acquisition frame f2_2 of the second fingerprint acquisition cycle, each point light source y2_2 is controlled to emit light simultaneously, and an electric signal generated by each image sensor in the finger touch area is acquired. In this way, the missing part in the fingerprint image acquired in the second fingerprint acquisition frame f2_1 can be partially constructed.

(7) In the third fingerprint acquisition frame f3_2 in the second fingerprint acquisition cycle, each point light source y3_2 is controlled to emit light simultaneously, and an electric signal generated by each image sensor in the finger touch area is acquired. In this way, a missing part in the fingerprint image acquired in the third fingerprint acquisition frame f3_1 can be constructed.

(8) In the fourth fingerprint acquisition frame f4_2 of the second fingerprint acquisition cycle, each point light source y4_2 is controlled to emit light simultaneously, and an electric signal generated by each image sensor in the finger touch area is acquired. In this way, a missing part in the fingerprint image acquired in the fourth fingerprint acquisition frame f4_1 can be constructed.

The remainder is then performed in a similar manner to steps (1) - (8) until all fingerprint acquisition cycles are completed, thereby acquiring an electrical signal corresponding to the fingerprint of the finger.

(9) Based on the electrical signals acquired during the fingerprint acquisition cycle, a complete image of the fingerprint of the finger is determined. For example, a complete image of the fingerprint of a finger may be determined by using a stitching method.

(10) Image features corresponding to a plurality of fingerprint feature points are extracted from the complete image and stored in a fingerprint database.

(11) In the fingerprint identification stage, in a fingerprint identification frame SZ_1 of a first fingerprint identification cycle, acquiring change information of a capacitance value corresponding to each capacitive touch electrode in the fingerprint identification device; based on the change information of the capacitance value, after determining the finger touch area, each point light source y_1 is controlled to emit light simultaneously, and an electric signal generated by each image sensor in the finger touch area is acquired.

(12) Then, the fingerprint identification frame sz_2 is entered. In the fingerprint recognition frame sz_2, each point light source y_2 is controlled to emit light simultaneously, and an electric signal generated by each image sensor in the finger touch area is acquired.

(13) Based on the electric signals acquired in the fingerprint identification frames sz_1 and sz_2, an image feature corresponding to a fingerprint feature point of the current fingerprint is determined.

(14) It is determined whether a similarity between an image feature corresponding to a fingerprint feature point in the first fingerprint identification cycle and an image feature corresponding to a fingerprint feature point stored in the fingerprint database satisfies a preset similarity threshold. If yes, executing step (15); if not, step (16) is performed.

(15) It is determined that the current fingerprint matches the stored fingerprint, then the fingerprint recognition device may be turned on and a subsequent fingerprint recognition phase may be started.

(16) It is determined that the current fingerprint does not match the stored fingerprint. Then, the fingerprint recognition device cannot be turned on. The fingerprint acquisition is performed again after entering a subsequent fingerprint identification cycle until it is determined that the current fingerprint matches a stored fingerprint, or until the fingerprint identification phase is over.

Fig. 20a and 29 show structural diagrams of a display panel corresponding to another embodiment, showing a variation from the fingerprint acquisition cycle in the previous embodiment. Only the differences between this embodiment and the previous embodiment are described below. The same portions are not repeated here.

In one embodiment of the present invention, the invalid image region corresponding to each point light source in the n-th fingerprint acquisition frame in the subsequent fingerprint acquisition cycle may cover the residual image region corresponding to each point light source in the n-th fingerprint acquisition frame in the previous fingerprint acquisition cycle. Thus, the influence of the residual image area on the accuracy of the acquired fingerprint can be further avoided.

Taking the example that the fingerprint acquisition cycle includes four fingerprint acquisition frames (i.e., first fingerprint acquisition frame to fourth fingerprint acquisition frame), as shown in fig. 20a and 29. Here, TX1_1 represents an effective image area corresponding to each point light source y1_1 that emits light in the first fingerprint acquisition frame in the first fingerprint acquisition cycle. Tx3_1 represents the effective image area corresponding to each point light source Y3_1 that emits light in the third fingerprint acquisition frame in the first fingerprint acquisition cycle. Cy1_1 represents a residual image area corresponding to each point light source y1_1 that emits light in the first fingerprint acquisition frame in the first fingerprint acquisition cycle. Wx3_1 represents an invalid image region corresponding to each point light source y3_1 that emits light in the third fingerprint acquisition frame in the first fingerprint acquisition cycle. Cy3_1 represents a residual image area corresponding to each point light source y3_1 that emits light in the third fingerprint acquisition frame in the first fingerprint acquisition cycle. Tx1_2 represents the effective image area corresponding to each point light source Y1_2 that emits light in the first fingerprint acquisition frame in the second fingerprint acquisition cycle. Tx3_2 represents the effective image area corresponding to each point light source Y3_2 that emits light in the third fingerprint acquisition frame in the second fingerprint acquisition cycle. Wx1_2 represents an invalid image region corresponding to each point light source y1_2 that emits light in the first fingerprint acquisition frame in the second fingerprint acquisition cycle. Cy1_2 represents a residual image area corresponding to each point light source y1_2 that emits light in the first fingerprint acquisition frame in the second fingerprint acquisition cycle. Wx3_2 represents an invalid image region corresponding to each point light source y3_2 that emits light in the third fingerprint acquisition frame in the second fingerprint acquisition cycle. Here, wx1_2 covers cy1_1.WX3_2 covers CY3_1. In addition, WX3_1 covers CY1_1.WX3_2 covers CY1_2.

Fig. 30 shows a structural diagram of a display panel corresponding to another embodiment, showing a variation from the implementation of the pattern recognition loop in the previous embodiment. Only the differences between this embodiment and the previous embodiment are described below. The same portions are not repeated here.

In an embodiment of the invention, the fingerprint identification cycle may be divided into at least two consecutive fingerprint identification frames. Here, two adjacent fingerprint identification frames may form an identification frame group. At least two consecutive fingerprint identification frames may be divided into X consecutive identification frame groups; here, in the same identification frame group, the invalid image region corresponding to the point light source emitted in the subsequent fingerprint identification frame covers the residual image region corresponding to the point light source emitted in the previous fingerprint identification frame. X is an integer greater than or equal to 1.

Further, in one embodiment of the present invention, in one fingerprint recognition cycle, the effective image area corresponding to each point light source that emits light in the subsequent recognition frame group satisfies the following condition: which does not overlap with the effective image area corresponding to each point light source that emits light in the previously identified frame group.

For example, the fingerprint identification loop may be divided into four consecutive fingerprint identification frames, i.e. a first fingerprint identification frame to a fourth fingerprint identification frame. Thus, the first fingerprint identification frame and the second fingerprint identification frame are one identification frame group. The third and fourth fingerprint identification frames are another set of identification frames. As shown in fig. 30, tx_1 represents an effective image area corresponding to each point light source that emits light in the first fingerprint identification frame. tx_2 represents an effective image area corresponding to each point light source that emits light in the second fingerprint identification frame. tx_3 represents an effective image area corresponding to each point light source that emits light in the third fingerprint identification frame. tx_4 represents an effective image area corresponding to each point light source that emits light in the fourth fingerprint identification frame. cy_1 denotes a residual image area corresponding to each point light source that emits light in the first fingerprint identification frame. wx_2 represents an invalid image region corresponding to each point light source that emits light in the second fingerprint identification frame. cy_3 denotes a residual image area corresponding to each point light source that emits light in the third fingerprint identification frame. wx_4 represents an invalid image region corresponding to each point light source in the fourth fingerprint identification frame. Here, wx_2 covers cy_1.wx_4 covers cy_3. Neither tx_1 nor tx_2 overlaps either tx_3 or tx_4.

A block diagram of a display panel corresponding to another embodiment is shown in fig. 31, showing a variation of the implementation of the pattern recognition loop in the previous embodiment. Only the differences between this embodiment and the previous embodiment are described below. The same portions are not repeated here.

In one embodiment, the fingerprint identification cycle is divided into at least three consecutive fingerprint identification frames. In one embodiment of the invention, for two fingerprint frames separated by at least one fingerprint frame, the effective image area corresponding to the point light source illuminated in the subsequent fingerprint frame at least partially covers the ineffective image area corresponding to the point light source illuminated in the previous fingerprint frame in the same fingerprint cycle. Here, the fingerprint recognition cycle may be divided into four consecutive fingerprint recognition frames, i.e., first to fourth fingerprint recognition frames. As shown in fig. 31, tx_1 represents an effective image area corresponding to each point light source that emits light in the first fingerprint identification frame. tx_2 represents an effective image area corresponding to each point light source that emits light in the second fingerprint identification frame. tx_3 represents an effective image area corresponding to each point light source that emits light in the third fingerprint identification frame. tx_4 represents an effective image area corresponding to each point light source that emits light in the fourth fingerprint identification frame. wx_1 represents an invalid image region corresponding to each point light source that emits light in the first fingerprint identification frame. wx_2 represents an invalid image region corresponding to each point light source that emits light in the second fingerprint identification frame. Here, the first fingerprint frame and the third fingerprint frame are separated by one fingerprint frame. The second fingerprint identification frame and the fourth fingerprint identification frame are separated by one fingerprint identification frame. tx_3 partially covers wx_1.tx_4 partially covers wx_2. Of course, the effective image area corresponding to the point light source emitted in the subsequent fingerprint identification frame may cover the ineffective image area corresponding to the point light source emitted in the previous fingerprint identification frame. There is no limitation here.

A block diagram of a display panel corresponding to another embodiment is shown in fig. 32, illustrating a variation of the implementation of the finger print acquisition cycle in the previous embodiment. Only the differences between the embodiments and the previous embodiments are described below. The same portions are not repeated here.

In one embodiment, each fingerprint acquisition cycle includes: n consecutive fingerprint acquisition frames. In one embodiment of the invention, two adjacent fingerprint acquisition frames are taken as an acquisition frame set. The N fingerprint acquisition frames are divided into M continuous acquisition frame groups; here, in at least one acquisition frame group, an invalid image region corresponding to a point light source emitted in a subsequent fingerprint acquisition frame covers a residual image region corresponding to a point light source emitted in a previous fingerprint acquisition frame; in addition, the effective image area corresponding to each point light source that emits light in the (m+1) th acquisition frame group satisfies the following condition: which does not overlap with an effective image area corresponding to each point light source that emits light in the mth acquisition frame group; wherein M is an integer greater than 1. M is an integer of 1 or more and M-1 or less. Here, in each acquisition frame group, an invalid image region corresponding to a point light source emitted in a subsequent fingerprint acquisition frame may cover a residual image region corresponding to a point light source emitted in a previous fingerprint acquisition frame. There is no limitation here.

Taking as an example that each fingerprint acquisition cycle comprises four consecutive fingerprint acquisition frames, i.e. a first fingerprint acquisition frame to a fourth fingerprint acquisition frame. The first fingerprint acquisition frame and the second fingerprint acquisition frame are a first acquisition frame group. The third acquisition frame and the fourth acquisition frame are a second acquisition frame group. As shown in fig. 32, TX1_1 represents an effective image area corresponding to a point light source that emits light in a first fingerprint acquisition frame in a first fingerprint acquisition cycle. Tx2_1 represents the effective image area corresponding to the point source that emits light in the second fingerprint acquisition frame in the first fingerprint acquisition cycle. Tx3_1 represents the effective image area corresponding to the point light source that emits light in the third fingerprint acquisition frame in the first fingerprint acquisition cycle. Tx4_1 represents the effective image area corresponding to the point light source that emits light in the fourth fingerprint acquisition frame in the first fingerprint acquisition cycle. Tx1_2 represents the effective image area corresponding to the point source of light emitted in the first fingerprint acquisition frame in the second fingerprint acquisition cycle. Tx2_2 represents the effective image area corresponding to the point light source that emits light in the second fingerprint acquisition frame in the second fingerprint acquisition cycle. Tx3_2 represents the effective image area corresponding to the point light source that emits light in the third fingerprint acquisition frame in the second fingerprint acquisition cycle. Tx4_2 represents the effective image area corresponding to the point source that emits light in the fourth fingerprint acquisition frame in the second fingerprint acquisition cycle. Cy1—1 represents a residual image area corresponding to a point light source that emits light in a first fingerprint acquisition frame in a first fingerprint acquisition cycle. Cy3—1 represents a residual image area corresponding to a point light source that emits light in the third fingerprint acquisition frame in the first fingerprint acquisition cycle. Wx2_1 represents an invalid image region corresponding to a point light source that emits light in a second fingerprint acquisition frame in a first fingerprint acquisition cycle. Wx4_1 represents an invalid image region corresponding to a point light source that emits light in the fourth fingerprint acquisition frame in the first fingerprint acquisition cycle. Here, wx2_1 covers cy1_1.WX4_1 covers CY3_1. Neither TX1_1 nor TX2_1 overlaps TX3_1 and TX 4_1. Neither TX1_2 nor TX2_2 overlaps TX3_2 and TX 4_2.

Further, in one embodiment of the present invention, for a previous fingerprint acquisition frame in an mth acquisition frame group of a subsequent fingerprint acquisition cycle and a subsequent fingerprint acquisition frame in the mth acquisition frame group of the previous fingerprint acquisition cycle, an effective image area corresponding to a point light source that emits light in the previous fingerprint acquisition frame at least partially covers an ineffective image area corresponding to a point light source that emits light in the subsequent fingerprint acquisition frame. Referring to fig. 32, when m=1, the previous fingerprint acquisition frame in the first acquisition frame group of the subsequent fingerprint acquisition cycle is the first fingerprint acquisition frame of the second fingerprint acquisition cycle. The effective image area corresponding to the point light source that emits light in the fingerprint acquisition frame is TX1_2. The subsequent fingerprint acquisition frame in the first acquisition frame set of the previous fingerprint acquisition cycle is the second fingerprint acquisition frame of the first fingerprint acquisition cycle. The invalid image area corresponding to the point light source that emits light in the fingerprint acquisition frame is wx2_1. Here, the TX1_2 part covers wx2_1. For the same reason, when m=2, the TX3_2 partially covers wx4_1.

Fig. 33 and 34 show schematic structural views of a display panel corresponding to another embodiment, showing variations of the implementation of the finger print acquisition cycle in the previous embodiment. Only the differences between the present embodiment and the previous embodiment are described below. The same portions are not repeated here.

In an embodiment of the present invention, for two fingerprint acquisition cycles separated by at least one fingerprint acquisition cycle, an effective image area corresponding to a point light source that emits light in an nth fingerprint acquisition frame in a subsequent fingerprint acquisition cycle and an ineffective image area corresponding to a point light source that emits light in at least one fingerprint acquisition frame from a first fingerprint acquisition frame to an nth fingerprint acquisition frame of a previous fingerprint acquisition cycle overlap. Here, the effective image area corresponding to the point light source that emits light in the n-th fingerprint acquisition frame in the subsequent fingerprint acquisition cycle overlaps with the ineffective image area corresponding to the point light source that emits light in the n-th fingerprint acquisition frame in the previous fingerprint acquisition cycle. Taking the first fingerprint acquisition cycle to the third fingerprint acquisition cycle as an example, an effective image area corresponding to the point light source that emits light in the nth fingerprint acquisition frame in the third fingerprint acquisition cycle may overlap with an ineffective image area of the point light source that emits light in the nth fingerprint acquisition frame in the first fingerprint acquisition cycle. As shown in fig. 33, TX1_1 represents an effective image area corresponding to a point light source that emits light in a first fingerprint acquisition frame in a first fingerprint acquisition cycle. Tx2_1 represents the effective image area corresponding to the point source that emits light in the second fingerprint acquisition frame in the first fingerprint acquisition cycle. Tx1_3 represents the effective image area corresponding to the point light source that emits light in the first fingerprint acquisition frame in the third fingerprint acquisition cycle. Tx2_3 represents the effective image area corresponding to the point source that emits light in the second fingerprint acquisition frame in the third fingerprint acquisition cycle. Wx1_1 represents an invalid image region corresponding to a point light source that emits light in a first fingerprint acquisition frame in a first fingerprint acquisition cycle. Wx2_1 represents an invalid image region corresponding to a point light source that emits light in a second fingerprint acquisition frame in a first fingerprint acquisition cycle. Here, TX1_3 partially covers wx1_1.Tx2_3 partially covers Wx2_1. Of course, other means may be used for setting. There is no limitation here.

In one embodiment, the effective image area corresponding to the point light sources illuminated in the nth fingerprint acquisition frame of the subsequent fingerprint acquisition cycle may at least partially cover the residual image corresponding to the point light sources illuminated in the nth fingerprint acquisition frame of the previous fingerprint acquisition cycle. As shown in fig. 33, cy1_1 represents a residual image area corresponding to a point light source that emits light in a first fingerprint acquisition frame in a first fingerprint acquisition cycle. Cy2—1 represents a residual image area corresponding to a point light source that emits light in the second fingerprint acquisition frame in the first fingerprint acquisition cycle. Here, TX1_3 completely covers cy1_1. The Tx2_3 completely covers the CY2_1. Of course, the effective image area corresponding to the point light source that emits light in the n-th fingerprint acquisition frame of the subsequent fingerprint acquisition cycle may also partially cover the residual image area corresponding to the point light source that emits light in the n-th fingerprint acquisition frame of the previous fingerprint acquisition cycle. There is no limitation here.

Fig. 34 and 35 show structural diagrams of a display panel corresponding to another embodiment. Variations of the implementation of the finger print acquisition loop in the previous embodiment are shown. Only the differences between the embodiments and the previous embodiments are described below. The same portions are not repeated here.

In one embodiment of the present invention, as shown in fig. 34, point light sources having the same light emission sequence in two adjacent fingerprint acquisition cycles are controlled to emit light separated at least at a time interval of a preset residual image fading period, so that a time difference between a time when light in an effective pattern area is received and a time when light in a residual pattern area is received by the same image sensor in the two adjacent fingerprint acquisition cycles is at least a preset residual image fading period. In one embodiment, the process may include the steps of:

s2101: in the current fingerprint acquisition cycle, a plurality of point light sources in a finger touch area are controlled to emit light simultaneously, and at least an electric signal generated by each image sensor in the finger touch area is acquired. In one embodiment, the electrical signals generated by all of the image sensors in the fingerprint recognition device may be acquired. Alternatively, only the electric signal generated by each image sensor in the finger touch area may be acquired, so that the acquisition time of the electric signal may be shortened. To determine the finger touch area, in one embodiment, at the beginning of the first fingerprint acquisition cycle may include: a finger touch area touched by a finger in the fingerprint recognition device is acquired. Here, in one embodiment, the image sensor may be driven according to the region so as to better acquire the electric signal of the image sensor in the finger touch region.

S2102: when the current fingerprint acquisition cycle is completed, entering a subsequent fingerprint acquisition cycle at least after a preset residual image fading period; here, the point light sources that emit light in the current fingerprint acquisition cycle and the subsequent fingerprint acquisition cycles are different.

In one embodiment, multiple point sources in the finger touch area are controlled to illuminate simultaneously during the current fingerprint acquisition cycle. Light is reflected by the action of the interface touched by the finger and is incident on the image sensor. The electrical signals generated by each image sensor in the finger touch area may be acquired by acquisition. By waiting for a preset residual image decay period when the current fingerprint acquisition cycle is completed, the residual image on the image sensor receiving light can be considered to have been eliminated when the point light source emits light in the current fingerprint acquisition cycle, so that a subsequent fingerprint acquisition cycle can begin. Therefore, the influence of the residual image of the image sensor on the electric signal can be avoided. Thus, the accuracy of the electrical signal generated by the image sensor is improved. In addition, the accuracy of the collected fingerprints is improved, and the fingerprint identification effect is improved.

In one embodiment, the pattern of point sources that illuminate in each fingerprint acquisition frame is the same. In one embodiment of the present invention, as shown in fig. 35, the effective image area corresponding to each point light source that emits light in a subsequent fingerprint acquisition cycle at least partially covers the ineffective image area corresponding to each point light source that emits light in a previous fingerprint acquisition cycle. Here, as shown in fig. 35, tx_1 represents an effective image area corresponding to each point light source that emits light in the first fingerprint acquisition cycle (i.e., the previous fingerprint acquisition cycle). Wx_1 represents an invalid image region corresponding to each point light source that emits light in the first fingerprint acquisition cycle (i.e., the previous fingerprint acquisition cycle). Tx_2 represents the effective image area corresponding to each point source that emits light in the second fingerprint acquisition cycle (i.e., the subsequent fingerprint acquisition cycle). Here, tx_2 partially covers wx_1. Of course, the effective image area corresponding to each point light source that emits light in a subsequent fingerprint acquisition cycle may completely cover the ineffective image area corresponding to each point light source that emits light in a previous fingerprint acquisition cycle. There is no limitation here.

Of course, in this embodiment, the effective image areas corresponding to the point light sources that emit light in two adjacent fingerprint acquisition cycles may also satisfy the condition that they do not overlap each other. There is no limitation here.

A driving method according to an embodiment of the present invention is described with reference to fig. 35, 26, and 27. The driving method according to an embodiment of the present invention may include the steps of:

(1) In a first fingerprint acquisition cycle Z_1 of the fingerprint input stage, the change information of the capacitance value corresponding to each capacitive touch electrode in the fingerprint identification device is acquired. And according to the change information of the capacitance value, after the finger touch area is determined, controlling each point light source to emit light simultaneously, and acquiring an electric signal generated by each image sensor in the finger touch area. Here, the effective image area corresponding to the point light source that emits light in the fingerprint acquisition cycle z_1 is tx_1.

(2) When the fingerprint acquisition cycle z_1 is completed, a subsequent fingerprint acquisition cycle z_2 is entered after a preset residual image decay period. In the subsequent fingerprint acquisition cycle z_2, each point light source is controlled to emit light simultaneously, and an electrical signal generated by each image sensor in the finger touch zone is acquired. Here, the effective image area corresponding to the point light source that emits light in the fingerprint acquisition cycle z_2 is tx_2. Thus, a missing portion in the fingerprint image acquired in the fingerprint acquisition cycle z_1 can be constructed.

Then, the rest is performed in a similar manner to steps (1) - (2). The point source can be moved in the row direction F1 until all fingerprint acquisition cycles are completed, thereby acquiring all electrical signals corresponding to the finger fingerprint.

(4) Based on the electrical signals acquired in each fingerprint acquisition cycle, a complete image of the fingerprint of the finger is determined. In one embodiment, a complete image of the fingerprint of the finger is determined by using a stitching method.

(5) Image features corresponding to the plurality of fingerprint feature points are extracted from the complete image and stored in a fingerprint database.

(6) In the fingerprint identification stage, in a first fingerprint identification frame SZ_1 of a first fingerprint identification cycle, the change information of the capacitance value corresponding to each capacitive touch electrode in the fingerprint identification device is obtained. According to the change information of the capacitance value, after the finger touch area is determined, each point light source y_1 is controlled to emit light simultaneously, and an electric signal generated by each image sensor in the finger touch area is acquired.

(7) Then, the fingerprint identification frame sz_2 is input. In the fingerprint recognition frame sz_2, each point light source y_2 is controlled to emit light simultaneously, and an electric signal generated by each image sensor in the finger touch area is acquired.

(8) Based on the electrical signals acquired in the fingerprint frames sz_1-sz_2 of the first fingerprint identification cycle, an image feature corresponding to a fingerprint feature point of the current fingerprint is determined.

(9) Determining whether a similarity between the image feature corresponding to the fingerprint feature point of the first fingerprint identification cycle and the image feature corresponding to the fingerprint feature point stored in the fingerprint database in steps (1) - (5) satisfies a preset similarity threshold. If yes, executing step (10); if not, step (11) is performed.

(10) A determination is made that the current fingerprint matches the stored fingerprint. Then, the fingerprint identification device is opened, and the subsequent fingerprint identification stage is entered.

(11) It is determined that the current fingerprint does not match any stored fingerprints. The fingerprint recognition device is then unable to open and enters a subsequent fingerprint recognition cycle to again perform fingerprint collection until it is determined that the current fingerprint matches the stored fingerprint, or until the fingerprint recognition phase is over.

The embodiment of the invention also provides fingerprint identification equipment which comprises a fingerprint identification device and a driving circuit. Here, as shown in fig. 14, the fingerprint recognition device may include a substrate 100, a plurality of pixel units 110 positioned at one side of the substrate 100, and a plurality of image sensors 120 positioned at a side of the substrate 100 facing the pixel units 110; here, the image sensor 120 is used to receive light reflected by the interface. Each pixel unit 110 includes a plurality of sub-pixels 111.

In addition, in the fingerprint input stage, the driving circuit is configured to control the point light sources having the same light emission sequence in two adjacent fingerprint acquisition cycles to emit light at intervals of a preset residual image fading period, so that an effective image area corresponding to the point light sources having the same light emission sequence in a subsequent fingerprint acquisition cycle overlaps with a corresponding residual image area in a previous fingerprint acquisition cycle; here, each point light source includes at least one sub-pixel. When the point light source emits light, the plane in which the interface touched by the finger is located has a light transmission region and a total reflection region surrounding the light transmission region. After being reflected by the interface, the light in the total reflection area forms an annular image area on the plane in which the image sensor is located. The effective image area surrounds the ineffective image area. The invalid image region has a residual image region.

According to the fingerprint recognition device of one embodiment, the point light sources having the same light emission sequence in two adjacent fingerprint collection cycles are controlled to emit light at intervals of a preset residual image fading period by the driving circuit, so that the residual image generated after the image sensor receives light in the residual image region corresponding to the point light sources having the same light emission sequence in the previous fingerprint collection cycle can fade to within an acceptable error range after the preset residual image fading period, so that the residual image can be considered to have faded in the subsequent fingerprint collection cycle for the image sensor. In this way, the effective image area corresponding to the point light sources having the same light emission sequence in the subsequent fingerprint acquisition cycle can overlap with the residual image area corresponding to the point light sources having the same light emission sequence in the previous fingerprint acquisition cycle, and thus, the missing portion in the previous fingerprint acquisition cycle is obtained, so that the accuracy of the electric signal of the image sensor in the effective image area corresponding to the point light sources having the same light emission sequence in each fingerprint acquisition cycle is improved. In addition, the accuracy of the collected fingerprints is improved, and the fingerprint identification effect is improved.

In one embodiment, as shown in fig. 14 and 18, the image sensor 120 may be located on the opposite side of the substrate 100 from the subpixel electroluminescent diode 112. Furthermore, in one embodiment, the fingerprint recognition device may further include: a support substrate 300 attached to the opposite side of the substrate from the sub-pixels 111. Here, the image sensor 120 is disposed on a surface of the support substrate 300 facing the substrate 100. In one embodiment, an adhesive is disposed between the support substrate 300 and the substrate 100 such that the substrate 300 and the substrate 100 may be tightly fitted by the adhesive. Here, the support substrate 300 may be a glass substrate, and thus, the photodiodes may be disposed in a large area with respect to the silicon substrate.

In one embodiment, the photodiode may include: a photodiode made of an organic photosensitive material, or a PIN diode. Here, the intrinsic layer in the PIN diode may use a-Si, and the characteristic layer may use a-Si doped with P or B. In addition, in order to prevent external light from affecting the photodiode through the support substrate 300, a light shielding layer may be provided between the photodiode and the support substrate. In addition, the orthographic projection of the light shielding layer on the supporting substrate covers the orthographic projection of the photodiode on the supporting substrate.

In one embodiment, the thin film encapsulation layer, the touch capacitance electrode layer, the polarizer, and the cover glass are sequentially disposed on the side of the electroluminescent diode opposite to the substrate 100.

In one embodiment, the fingerprint recognition device may be provided as a display device. In this way, the fingerprint recognition device may also have a display function. Further, in the display phase, the driving circuit may be configured to drive the fingerprint recognition device to display an image. In one embodiment, the display device may be any product or component having a display function, such as: mobile phones, tablet computers, televisions, displays, notebook computers, digital photo frames, navigator, and the like. Other components of the display device that are not necessary as will be appreciated by those of ordinary skill in the art are not redundantly described here nor should they be considered limiting of the invention.

In one embodiment, the driving circuit may also implement the steps of any of the above-described driving methods according to embodiments of the present invention. Redundant description is not given here.

Based on the same inventive concept, embodiments of the present invention also provide a computer-readable storage medium having a computer program stored thereon. The steps of any one of the driving methods described above according to the embodiments of the present invention are implemented when the program is executed by a processor. In one embodiment, the present invention may take the form of a computer program product embodied on one or more computer-readable storage media storing computer-usable program code. A computer-readable storage medium may be implemented as any type or combination of volatile memory devices and non-volatile memory devices, such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk, or optical disk. The processor may be a Central Processing Unit (CPU) or a field programmable logic array (FPGA) or a Microcontroller (MCU) or a Digital Signal Processor (DSP) or a Programmable Logic Device (PLD) or an Application Specific Integrated Circuit (ASIC) with data processing and/or program execution capabilities. When the processor executes the program, the steps of any one of the above-described driving methods according to the embodiments of the present invention are implemented.

Based on the same inventive concept, embodiments of the present invention also provide a computer apparatus comprising a memory, a processor and a computer program stored in the memory and executable on the processor.

According to the driving method of the fingerprint recognition apparatus, the fingerprint recognition device, the computer-readable storage medium, and the computer apparatus of the embodiments of the present invention, the interval between the time when light in the residual image area is received and the time when light in the effective image area is received by the same image sensor is controlled to be at least a preset residual image fading period through the fingerprint input stage. In this way, the residual image generated after the image sensor receives the light of the residual image region can be eliminated to an acceptable range of error after a preset residual image fading period. Therefore, when the image sensor receives light in the effective image area, it can be considered that the residual image has been eliminated, thereby improving the accuracy of the electric signal generated by the image sensor. In addition, the accuracy of the collected fingerprints is improved, and the fingerprint identification effect is improved.

In some embodiments, the method includes driving a first subset of a plurality of light sources located on the device on; capturing a first fingerprint acquisition frame using a plurality of image sensors on the device, wherein light reflected from the finger touch interface forms an active image area and an inactive image area as each of the plurality of light sources is turned on, the first fingerprint acquisition frame comprising a first set of active image areas and a first set of inactive image areas resulting from a first subset of the plurality of light sources being turned on; driving a second subset of the plurality of light sources on, wherein the second subset of the plurality of light sources does not overlap with the first subset of the plurality of light sources; capturing a second fingerprint acquisition frame using the plurality of image sensors, wherein the second fingerprint acquisition frame includes a second set of valid image areas and a second set of invalid image areas resulting from a second subset of the plurality of light sources being turned on, the second set of valid image areas at least partially covering a different area of the finger touch interface than the first set of valid image areas.

Optionally, each inactive image region further comprises a residual image region comprising a residual image after the fingerprint acquisition frame has been captured, at least one of the plurality of image sensors is located in the residual image region of the first fingerprint acquisition frame and in the active image region of the second fingerprint acquisition frame, and the second fingerprint acquisition frame is captured at least at a preset residual image decay period after the first fingerprint acquisition frame is captured.

Optionally, capturing a first fingerprint acquisition frame during a first fingerprint acquisition cycle and capturing a second fingerprint acquisition frame in a second fingerprint acquisition cycle subsequent to the first fingerprint acquisition cycle; the first subset and the second subset of the plurality of light sources are turned on at the same time slot during their respective fingerprint acquisition cycles.

Optionally, the first and second fingerprint acquisition cycles are part of a plurality of fingerprint acquisition cycles, each of the plurality of fingerprint acquisition cycles comprising acquiring N fingerprint acquisition frames, wherein N is an integer greater than 1, each of the N fingerprint acquisition frames comprising: different subsets of the plurality of light sources are driven to be on simultaneously within the finger touch area and electrical signals are acquired from at least some of the plurality of image sensors located in the finger touch area, an active image area in any one of the N fingerprint acquisition frames does not overlap with a residual image area in any other one of the N fingerprint acquisition frames, and a subsequent fingerprint acquisition cycle begins after a previous fingerprint acquisition cycle has continued for a preset residual image decay period.

Optionally, the second fingerprint acquisition frame is an nth fingerprint acquisition frame during the second fingerprint acquisition cycle, the first fingerprint acquisition frame is one of the first fingerprint acquisition frame to the nth fingerprint acquisition frame during the first fingerprint acquisition cycle, and N is a positive integer less than or equal to N.

Optionally, the second fingerprint acquisition frame has at least one valid image area that at least partially overlaps with one residual image area of the nth fingerprint acquisition frame during the previous fingerprint acquisition cycle.

Optionally, the second fingerprint acquisition frame has at least one inactive image area that at least partially overlaps with one residual image area of the nth fingerprint acquisition frame during the previous fingerprint acquisition cycle.

Optionally, the device is a display panel, the plurality of light sources are subpixels of the display panel, and the finger touch interface is a cover glass of the display panel.

Optionally, the method further comprises: sequentially driving different subsets of the plurality of light sources on, capturing different fingerprint acquisition frames using the plurality of image sensors; combining all captured fingerprint acquisition frames to obtain a fingerprint image; extracting a first set of fingerprint features from the fingerprint image; and storing the first set of fingerprint features extracted from the fingerprint image in a fingerprint database.

Optionally, the method further comprises: capturing one or more fingerprint acquisition frames; acquiring a second set of fingerprint features from one or more fingerprint acquisition frames; the second set of fingerprint features is compared to the first set of fingerprint features stored in the fingerprint database to determine if a fingerprint match exists.

Optionally, at least one of the one or more fingerprint acquisition frames has an active image area that overlaps with an inactive image area in another of the one or more fingerprint acquisition frames.

Optionally, the method further comprises: acquiring a set of fingerprint features from the first fingerprint acquisition frame and the second fingerprint acquisition frame; and compares the set of fingerprint features with the fingerprint features stored in the fingerprint database.

Optionally, the method further comprises: a finger touch area on a device is determined, wherein the device includes a plurality of capacitive touch electrodes configured to change their respective capacitance values in response to pressure on a finger touch interface, a plurality of light sources being located within the finger touch area.

In some embodiments, a computer program product includes a non-transitory computer-readable medium having instructions recorded thereon, the instructions being executed by a processor implementing the methods described herein.

In some embodiments, the device comprises a cover glass; a plurality of light sources configured to irradiate light onto the cover glass when turned on; a plurality of image sensors configured to capture light reflected from the cover glass; a control circuit configured to drive a first subset of the plurality of light sources on; capturing a first fingerprint acquisition frame using at least a subset of the plurality of image sensors, wherein light reflected from the cover glass forms an active image area and an inactive image area as each light source is turned on, and the first fingerprint acquisition frame includes a first set of active image areas and a first set of inactive image areas resulting from the turning on of a first subset of the plurality of light sources; and performs fingerprint recognition using the first fingerprint acquisition frame.

Optionally, the device further comprises a substrate and a support substrate, the plurality of light sources are a plurality of sub-pixels located on the substrate, and the plurality of image sensors are located on the support substrate, and the support substrate is bonded to the substrate.

Optionally, the control circuit is further configured to drive a second subset of the plurality of light sources on, the second subset of the plurality of light sources not overlapping the first subset of the plurality of light sources; a second fingerprint acquisition frame is captured using at least a subset of the plurality of image sensors, wherein the second fingerprint acquisition frame includes a second set of active image areas and a second set of inactive image areas resulting from a second subset of the plurality of light sources being turned on, and the second set of active image areas at least partially covers a different area than the first set of active image areas of the cover glass.

Optionally, the apparatus further comprises combining the first fingerprint acquisition frame and the second fingerprint acquisition frame for fingerprint identification.

Optionally, each of the plurality of light sources is a point light source, and the first subset of light sources forms a repeating pattern of rectangles, polygons with more than four sides, or circles.

Optionally, each effective image area is formed of light reflected from a total reflection area of one of the plurality of light sources on the cover glass.

The foregoing description of the embodiments of the invention has been presented for the purposes of illustration and description. It is not intended to be exhaustive or to limit the invention to the precise form or exemplary embodiments disclosed. The preceding description is, therefore, to be taken in an illustrative, rather than a limiting sense. Obviously, many modifications and variations will be apparent to practitioners skilled in the art. The embodiments were chosen and described in order to explain the principles of the invention and its best mode practical application to thereby enable others skilled in the art to understand the invention for various embodiments and with various modifications as are suited to the particular use or implementation contemplated. It is intended that the scope of the invention be defined by the following claims and their equivalents, in which all terms are indicated in their broadest reasonable sense unless otherwise indicated. Therefore, the terms "invention," "invention," and the like do not necessarily limit the scope of the claims to a particular embodiment, and references to exemplary embodiments of the invention are not intended to limit the invention, and no such limitation is inferred. The invention is limited only by the spirit and scope of the appended claims. Furthermore, the claims may refer to the use of the terms "first," "second," etc. together as a noun or element. These terms are to be construed as names and should not be construed as limiting the number of elements modified by such names unless a specific number is given. Any of the advantages and benefits described may not apply to all embodiments of the present invention. It will be appreciated that variations may be made in the described embodiments by a person skilled in the art without departing from the scope of the invention as defined by the accompanying claims. Furthermore, no element or component in the present disclosure is intended to be dedicated to the public regardless of whether the element or component is explicitly recited in the following claims.

Claims

1. A photosensitive detection device includes a counter substrate, an array substrate facing the counter substrate, and a fingerprint sensing driver;

wherein, the array substrate includes:

a plurality of light sources configured to emit light toward the counter substrate, at least a portion of the light being totally reflected by a surface of the counter substrate remote from the array substrate; and

a light sensor configured to detect the at least a portion of the light totally reflected by a surface of the counter substrate remote from the array substrate;

wherein the photosensitive detection device is configured to operate in a time division mode comprising a plurality of time-sequential photosensitive modes; and is also provided with

The fingerprint sensing driver is configured to detect fingerprint information by integrating signals detected in the plurality of time-sequential photosensitive modes;

in a corresponding one of the plurality of time-sequential photosensitive modes, the plurality of light-emitting blocks are configured to emit light; and the plurality of light emitting blocks have substantially the same size;

the substantially identical dimensions are dimensions optimized for achieving a maximum value of the contrast value; wherein the comparison value is composed of

2. The photosensitive detection device of claim 1, wherein in a respective one of the plurality of time-sequential photosensitive modes, the spaced apart plurality of light-emitting blocks are configured to emit light that is reflected by a plurality of touch sub-areas in a surface of the counter substrate remote from the array substrate, respectively;

wherein the plurality of touch sub-regions are spaced apart from one another.

3. The photosensitive detection device according to claim 2, wherein light respectively reflected by the plurality of touch sub-areas in the surface of the counter substrate away from the array substrate is respectively detected by a plurality of sensor sub-areas in the light sensor in a corresponding one of the plurality of time-sequential photosensitive modes; and is also provided with

The plurality of sensing sub-regions in the light sensor do not substantially overlap.

4. The photosensitive detection device of claim 3, wherein adjacent ones of the plurality of sensing subregions are adjacent to one another.

5. The photosensitive detection apparatus according to any one of claims 1 to 4, wherein the plurality of time-series photosensitive modes includes a first mode and a second mode;

the plurality of spaced apart first light emitting blocks are configured to emit light in the first mode, the light being reflected by the plurality of first touch sub-areas in a surface of the counter substrate remote from the array substrate, respectively;

The plurality of spaced apart second light emitting blocks are configured to emit light in the second mode, the light being reflected by a plurality of second touch sub-areas in a surface of the counter substrate remote from the array substrate, respectively;

the plurality of first touch sub-regions are spaced apart from one another; and is also provided with

The plurality of second touch sub-areas are spaced apart from one another.

6. The photosensitive detection device according to claim 5, wherein light respectively reflected by the plurality of first touch sub-areas in the surface of the counter substrate away from the array substrate is respectively detected by a plurality of first sensor sub-areas in a first sensing area of the photosensor;

light respectively reflected by the plurality of second touch sub-areas in the surface of the counter substrate away from the array substrate is respectively detected by a plurality of second sensing sub-areas in a second sensing area of the light sensor;

the first sensing region and the second sensing region partially overlap;

the plurality of first sensing sub-regions are substantially non-overlapping; and is also provided with

The plurality of second sensing sub-regions are substantially non-overlapping.

7. The photosensitive detection device of claim 5, wherein a total number of the plurality of first light-emitting blocks and a total number of the plurality of second light-emitting blocks are substantially the same.

8. The photosensitive detection device of claim 5, wherein the positions of the plurality of first light emitting blocks and the positions of the plurality of second light emitting blocks are related by translational displacement.

9. The photosensitive detection device of claim 1, wherein a respective one of the plurality of light-emitting blocks comprises a block of 9 sub-pixels by 9 sub-pixels.

10. The photosensitive detection device according to claim 1, further comprising: a touch sensing drive circuit configured to control touch detection in a touch area of the photosensitive detection device;

wherein, in a respective one of the plurality of time-sequential photosensitive modes, the plurality of spaced apart light-emitting blocks are configured to emit light; and

the plurality of light emitting blocks are defined in an area corresponding to the touch area.

11. A display device comprising the photosensitive detection device according to any one of claims 1 to 10;

wherein the display device operates in a time division mode including a display mode and a fingerprint sensing mode;

the display device is configured to display an image in the display mode; and is also provided with

The photosensitive detection device is configured to detect a fingerprint in the fingerprint sensing mode.

12. The display device according to claim 11, wherein the plurality of light sources are a plurality of light emitting elements in the display device configured to emit light for image display in the display mode.

13. A display device according to claim 11 or 12, wherein the display device is substantially free of any vacuum space at least in a display area of the display device and between the array substrate and the counter substrate.

14. The display device according to claim 13, wherein an optically transparent resin layer substantially penetrating a display region and a peripheral region of the display device is included between the array substrate and the counter substrate.

15. The display device according to claim 14, wherein the optically transparent resin layer comprises OCA topcoat.

16. The display device according to claim 13, wherein the array substrate and the counter substrate include an optically transparent resin layer disposed at a peripheral region of the display device and a dielectric layer substantially penetrating the display region of the display device therebetween.

17. The display device of claim 16, wherein the dielectric layer comprises silicone oil.

18. A fingerprint detection method, comprising:

operating the photosensitive detection apparatus according to any one of claims 1 to 10 in a time division mode including a plurality of time-sequential photosensitive modes; and

integrating the signals detected in the plurality of time-sequence photosensitive modes to detect fingerprint information;

wherein the photosensitive detection device includes a counter substrate, an array substrate facing the counter substrate, and a fingerprint sensing driver;

wherein, in a respective one of the plurality of time-sequential photosensitive modes, the method comprises:

illuminating the counter substrate with a plurality of light sources, at least a portion of the light being totally reflected by a surface of the counter substrate remote from the array substrate; and

detecting, using a light sensor, the at least a portion of the light totally reflected by the surface of the counter substrate remote from the array substrate;

in a respective one of the plurality of time-sequential photosensitive modes, the method comprises: driving the spaced apart light emitting blocks to emit light, respectively, which is reflected by a surface of the opposite substrate away from the array substrate; and

determining a size of each of the plurality of light emitting blocks;

The plurality of light emitting blocks have substantially the same size; and determining the size of each of the plurality of light emitting blocks comprises: determining a size of each of the plurality of light emitting blocks as a size optimized for achieving a maximum value of the contrast value; wherein the comparison value is composed of

19. The method of claim 18, in a respective one of the plurality of time-sequential photosensitive modes, the method comprising: driving the spaced apart light emitting blocks to emit light, respectively, which is reflected by the plurality of touch sub-areas in the surface of the opposite substrate away from the array substrate;

wherein the plurality of touch sub-regions are spaced apart from one another.

20. The method of claim 19, further comprising, in a respective one of the plurality of time-sequential photosensitive modes: detecting light emitted from the plurality of light-emitting blocks and reflected by the plurality of touch sub-areas in a surface of the counter substrate remote from the array substrate, respectively, in a plurality of sensing sub-areas in a light sensor;

Wherein the plurality of sensing sub-regions of the light sensor do not substantially overlap.

21. The method of claim 18, wherein the plurality of time-sequential photosensitive modes includes a first mode and a second mode;

wherein the method comprises the following steps:

driving the spaced apart first light emitting blocks to emit light in the first mode, the light being reflected by the first touch sub-regions in the surface of the opposite substrate away from the array substrate, respectively; and

driving the spaced apart second light emitting blocks to emit light in the second mode, the light being reflected by the second touch sub-areas in the surface of the opposite substrate away from the array substrate, respectively;

wherein the plurality of first touch sub-regions are spaced apart from one another; and is also provided with

The plurality of second touch sub-areas are spaced apart from one another.

22. The method of claim 21, further comprising:

in a plurality of first sensing sub-areas in the light sensor, the following lights are detected, respectively: the light is emitted from the plurality of first light-emitting blocks and reflected by the plurality of first touch sub-areas in the surface of the counter substrate remote from the array substrate, respectively; light respectively reflected by the plurality of first touch sub-areas in the surface of the counter substrate away from the array substrate is respectively detected by a plurality of first sensing sub-areas in a first sensing area of the light sensor;

In a plurality of second sensing sub-areas in the light sensor, the following lights are detected, respectively: the light is emitted from a plurality of second light-emitting blocks and reflected by the plurality of second touch sub-areas in a surface of the counter substrate remote from the array substrate, respectively; light respectively reflected by the plurality of second touch sub-areas in the surface of the counter substrate away from the array substrate is respectively detected by a plurality of second sensing sub-areas in a second sensing area of the light sensor; the first sensing region and the second sensing region partially overlap;

The plurality of second sensing sub-regions are substantially non-overlapping.

23. The method of any of claims 18 to 22, further comprising: detecting a touch area of the photosensitive detection device when touched; and

in a corresponding one of the plurality of time-series photosensitive modes, driving the plurality of spaced light-emitting blocks to emit light, respectively, the light being reflected by a surface of the opposite substrate remote from the array substrate;

wherein the plurality of light emitting blocks are defined in an area corresponding to the touch area.

24. A method of operating a display device, comprising: operating the display device in a time division mode including a display mode and a fingerprint sensing mode;

wherein, in the display mode, the method comprises: displaying an image using the display device; and

in the fingerprint sensing mode, the method comprises detecting a fingerprint according to the method of any one of claims 18 to 23; and is also provided with

The fingerprint sensing mode includes a plurality of time sequential photosensitive modes.

25. The method of claim 24, wherein the time division mode further comprises a touch sensing mode;

wherein, in the touch sensing mode, the method further comprises: detecting a touch area in the photosensitive detection device when touched;

wherein, in the fingerprint sensing mode, the method further comprises: driving a plurality of spaced apart light emitting blocks to emit light in a corresponding one of the plurality of time-sequential photosensitive modes, respectively, the light being reflected by a surface of the opposite substrate remote from the array substrate;