TWI758801B - Fingerprint identification method for in-display fingerprint display device and fingerprint identification and display driver integrated circuit and mobile device using the same - Google Patents

Abstract

A fingerprint identification method for in-display fingerprint display device, a fingerprint identification and display driver integrated circuit and a mobile device using the same are provided in the present invention. The method is adapted for an in-display fingerprint display device. The method includes: in a frame period, performing fingerprint identification, and requesting a driving voltage polarity status from a driver circuit; performing a fingerprint image capture; and correcting the captured fingerprint image according to the driving voltage polarity status.

Description

Fingerprint sensing method and integrated circuit of embedded fingerprint display panel and mobile device using the same

The present invention relates to a fingerprint recognition technology, and further, the present invention relates to a fingerprint sensing method and integrated circuit of an embedded fingerprint display panel and a mobile device using the same.

Fingerprint identification technology is a biometric identification technology, and the fingerprint identification system is a pattern identification system including modules for fingerprint image acquisition, processing, feature extraction and comparison. It is often used in places that require personnel identification, such as access control systems, attendance systems, notebook computers, mobile devices, bank internal processing, bank payment, etc. Optical fingerprint recognition currently used in mobile devices can be divided into button-type and under-screen types. The button-type fingerprint identification device is generally configured on the power-on button or the HOME button of the mobile device, and the under-screen fingerprint identification device is generally It is arranged in a specific position under the organic light emitting diode panel.

The liquid crystal display panel is still a mainstream display device used in mobile devices. However, due to the structural problems of the liquid crystal display panel, it is difficult to configure the optical fingerprint identification on the liquid crystal display panel.

An object of the present invention is to provide a fingerprint sensing method and integrated circuit of an in-cell fingerprint display panel and a mobile device using the same, so that the fingerprint can be correctly identified when a finger is placed on the in-cell fingerprint display panel.

In view of this, the present invention provides a fingerprint sensing method for an in-cell fingerprint display panel, which is suitable for an in-cell fingerprint display panel, wherein the in-cell fingerprint display panel includes an optical reading array, and the in-cell fingerprint display panel includes an optical reading array. A fingerprint sensing method of a fingerprint display panel includes: providing a driving polarity state of the embedded fingerprint display panel to a fingerprint reading circuit within a frame time; capturing a fingerprint image; and according to the embedded fingerprint The driving polarity state of the display panel is used to correct the captured fingerprint image data.

The present invention further provides an integrated display driver fingerprint identification circuit suitable for an in-cell fingerprint display panel, wherein the in-cell fingerprint display panel includes an optical reading array, and the integrated display driver fingerprint identification circuit includes a display driver circuit and a fingerprint reading circuit. The display driving circuit is coupled to the embedded fingerprint display panel, and displays the embedded fingerprint according to a display data. display panel to drive. The fingerprint reading circuit is coupled to the optical reading array of the embedded fingerprint display panel and the display driving circuit. Within a frame time, the display driving circuit provides a driving polarity state of the in-cell fingerprint display panel to the fingerprint reading circuit. The fingerprint reading circuit captures the fingerprint image through the optical reading array, and then the fingerprint reading circuit corrects the captured fingerprint image data according to the driving polarity state of the embedded fingerprint display panel.

The present invention further provides a mobile device, which includes an embedded fingerprint display panel and an integrated display-driven fingerprint identification circuit. The in-cell fingerprint display panel includes an optical reading array. The integrated display driving fingerprint identification circuit includes a display driving circuit and a fingerprint reading circuit. The display driving circuit is coupled to the embedded fingerprint display panel, and drives the embedded fingerprint display panel according to a display data. The fingerprint reading circuit is coupled to the optical reading array of the embedded fingerprint display panel and the display driving circuit. Within a frame time, the display driving circuit provides a driving polarity state of the in-cell fingerprint display panel to the fingerprint reading circuit. The fingerprint reading circuit captures the fingerprint image through the optical reading array, and then the fingerprint reading circuit corrects the captured fingerprint image data according to the driving polarity state of the embedded fingerprint display panel.

According to the fingerprint sensing method of the in-cell fingerprint display panel and the integrated circuit and the mobile device using the same according to the preferred embodiment of the present invention, the driving method of the pixels of the in-cell fingerprint display panel includes positive driving and negative driving drive to avoid or eliminate image sticking on the panel sticking).

According to the fingerprint sensing method and integrated circuit of the in-cell fingerprint display panel according to the preferred embodiment of the present invention, and the mobile device using the same, the integrated display driver fingerprint identification circuit further includes a touch sensing circuit for The touch position is detected, wherein, when fingerprint identification is performed, the position where the finger is placed is detected, so as to drive the optical reading array to read the fingerprint of the finger at the position. In a preferred embodiment, before fingerprint identification is performed, the in-cell fingerprint display driving circuit reduces the frame refresh rate of the in-cell fingerprint display panel. In a preferred embodiment, the image data of the fingerprint is adjusted according to multiple fingerprint captures and their corresponding driving polarity states.

When the in-cell fingerprint display panel is driven by positive and negative polarities, the amount of light transmittance will cause differences, resulting in noise in the fingerprint image. The spirit of the present invention is that before capturing the fingerprint image, the fingerprint reading circuit first obtains the current driving information of each pixel. Polarity state, whereby after the fingerprint is captured, the back-end image processing can be performed for the interference caused by the polarity, so that the fingerprint recognition rate can be greatly improved.

In order to make the above-mentioned and other objects, features and advantages of the present invention more clearly understood, preferred embodiments are hereinafter described in detail in conjunction with the accompanying drawings.

CF: color filter substrate

TFT: Thin Film Transistor Array (TFT array)

300: LCD panel

301: Integrated display driver fingerprint identification circuit

401: LCD driver circuit

402: Fingerprint reading circuit

403: Touch Sensing Circuit

S501~S506: Steps of the fingerprint sensing method of the liquid crystal display panel according to a preferred embodiment of the present invention

FP: During fingerprint identification

TP: During touch sensing

FIG. 1 is a schematic diagram of a module integrating an optical fingerprint and a liquid crystal display panel according to a preferred embodiment of the present invention.

FIG. 2 is a schematic diagram of a liquid crystal driving method.

FIG. 3 is a schematic diagram of a mobile device according to a preferred embodiment of the present invention.

FIG. 4A is a circuit block diagram of an integrated display driver fingerprint identification circuit 301 according to a preferred embodiment of the present invention.

FIG. 4B is a circuit block diagram of the integrated display driver fingerprint identification circuit 301 according to a preferred embodiment of the present invention.

FIG. 4C is a circuit block diagram of the integrated display driver fingerprint identification circuit 301 according to a preferred embodiment of the present invention.

FIG. 5 is a flow chart of a fingerprint sensing method of a liquid crystal display panel according to a preferred embodiment of the present invention.

FIG. 6 is an operation timing chart of the fingerprint sensing method of the liquid crystal display panel according to a preferred embodiment of the present invention.

FIG. 1 is a schematic diagram of a module integrating an optical fingerprint and a liquid crystal display panel according to a preferred embodiment of the present invention. In this embodiment, the panel in which the optical fingerprint and the liquid crystal display panel are integrated can also be an in-cell fingerprint display panel. Please refer to Figure 1, the liquid crystal display panel is composed of two transparent substrates (glass substrates) up and down. The upper substrate is a color filter substrate CF, which includes red, green, and blue (RGB) color resists, a black matrix, and the like. Down The substrate is mainly a thin film transistor array (TFT array), which includes a metal layer, an indium tin oxide transparent electrode (ITO), a semiconductor layer (silicon) and an insulating layer (SiOx, OC...) and the like. In the embodiment of FIG. 1, the upper substrate is marked as CF, the lower substrate is marked as TFT, and the middle of the upper and lower substrates is, for example, a liquid crystal layer LC. In this embodiment, the fingerprint image sensor FP sensor can be, for example, using thin film transistor materials and processes to fabricate optical sensing elements (eg p-i-n diode, p-n diode, TFT, MIM...), so as to capture fingerprints The image sensor FP sensor and the liquid crystal layer LC can be fabricated on the thin film transistor array substrate at the same time. In addition, if it is an optical sensing element of TFT, it can be fabricated together with the pixel switching TFT. In another preferred embodiment, the fingerprint image sensor FP sensor can also be fabricated on the color filter substrate, but more process steps need to be added. However, the present invention does not limit the position of the image sensor FP sensor . In this embodiment, when the finger touches the surface of the panel to perform fingerprint identification, for example, the light reflected by the back light module is used to illuminate the finger to capture the light reflected by the fingerprint of the finger.

FIG. 2 is a schematic diagram of a liquid crystal driving method. Please refer to FIG. 2, the “+” symbol in the figure represents that the voltage of the pixel electrode is higher than the voltage of the common electrode (Vcom electrode), and the “-” symbol represents that the voltage of the pixel electrode is lower than the voltage of the common electrode. In Figure 2, there are four inversion methods, namely Frame inversion, Line inversion, Column inversion and Pixel inversion. Way. This kind of driving method is mainly because the liquid crystal display panel will have so-called so-called charges due to the accumulation of electric charges after working for a long time. the condition of image sticking. Regardless of the inversion method, the polarity of the pixel electrode of each pixel relative to the common electrode will be switched in adjacent frames. However, the positive/negative polarity switching of the pixel electrodes not only changes the arrangement of the liquid crystal, but also directly changes the amount of light transmittance for fingerprint recognition, which further causes the signal read by the fingerprint image sensor to be inconsistent. Stable, affecting fingerprint discrimination.

In order to solve the above problems, in the following embodiments of the present invention, a mobile device with an on-panel fingerprint identification function is provided. FIG. 3 is a schematic diagram of a mobile device according to a preferred embodiment of the present invention. Please refer to FIG. 3 , the mobile device includes a liquid crystal display panel 300 and an integrated display driver fingerprint identification circuit 301 . The liquid crystal display panel 300 includes an optical reading array, which can be used to read fingerprints as described in the above embodiments.

FIG. 4A is a circuit block diagram of an integrated display driver fingerprint identification circuit 301 according to a preferred embodiment of the present invention. Please refer to FIG. 4A , the integrated display driving fingerprint identification circuit 301 includes a liquid crystal display driving circuit 401 , a fingerprint reading circuit 402 and a touch sensing circuit 403 . The liquid crystal display driving circuit 401 is coupled to the fingerprint reading circuit 402 and the liquid crystal display panel 300, and drives the liquid crystal display panel according to a display data. The fingerprint reading circuit 402 is coupled to the optical reading array of the liquid crystal display panel 300 and the liquid crystal display driving circuit 401 . The touch sensing circuit 403 is coupled to the liquid crystal display driving circuit 401 and the touch electrodes of the liquid crystal display panel 300 , and is used for detecting the touch position of a sensible object such as a finger or a stylus. In one embodiment, the integrated display driver The mobile fingerprint identification circuit 301 may also include a liquid crystal display driving circuit 401 and a fingerprint reading circuit 402 .

In another embodiment, the fingerprint reading circuit 402 can also be coupled to the touch sensing circuit 403 , as shown in FIG. 4B , so that the touch sensing circuit 403 and the fingerprint reading circuit 402 can communicate directly. For example, when the touch sensing circuit 403 detects the touch position of the finger, it can notify the fingerprint reading circuit 402 to perform fingerprint identification.

Furthermore, in another embodiment, the display driving circuit 401 may give the driving method to the touch sensing circuit 403 first, and then the touch sensing circuit 403 notifies the fingerprint reading circuit 402 of the display state. As shown in Figure 4C. When fingerprint identification is to be performed, the display driving circuit 401 notifies the touch sensing circuit 403 of the driving polarity state, and the touch sensing circuit 403 sends the driving polarity state and finger position information to the fingerprint reading circuit 402 together. The reading circuit 402 can directly perform fingerprint identification and correct the fingerprint reading result.

FIG. 5 is a flow chart of a fingerprint sensing method of a liquid crystal display panel according to a preferred embodiment of the present invention. Please refer to Figure 4 and Figure 5, the fingerprint sensing method of the LCD panel includes the following steps:

Step S501: Start.

Step S502: Determine whether to read fingerprint data. A mobile device, such as a mobile phone, generally needs to be unlocked with a fingerprint when it is turned on, and the host in the mobile phone will notify the integrated display driver fingerprint identification circuit 301 to read the fingerprint data.

Step S503 : The touch sensing circuit 403 of the integrated display driver fingerprint identification circuit 301 detects the position touched by the finger, and defines or determines the image capture range of the fingerprint identification accordingly. In this embodiment, it is assumed that the optical reading array included in the liquid crystal display panel 300 is distributed over the entire panel, that is, fingerprint recognition can be performed anywhere on the entire screen. However, in another embodiment of the present invention, if only a part of the liquid crystal display panel 300 has an optical reading array, this step S503 is unnecessary, and the designer can choose whether to omit this step.

Step S504 : the integrated display driver fingerprint identification circuit 301 reduces the display data update frequency. Please refer to FIG. 6 . FIG. 6 is an operation timing chart of a fingerprint sensing method of a liquid crystal display panel according to a preferred embodiment of the present invention. As shown in FIG. 6, FP is fingerprint recognition and TP is touch sensing. In this embodiment, when entering the fingerprint identification, the original 60Hz frame refresh rate is changed to 30Hz frame refresh rate, and the touch sensing is turned off to avoid signal interference. However, in another embodiment of the present invention, the touch sensing does not necessarily need to be turned off, so turning off the touch sensing is an unnecessary action, and the present invention is not limited thereto.

Step S505 : Capture multiple fingerprint images, and make corrections according to the driving polarity. As shown in FIG. 6 , the integrated display driver fingerprint identification circuit 301 uses, for example, a time-sharing method to update display data and perform fingerprint scanning. During the period of fingerprint recognition FP, the liquid crystal display driving circuit 401 notifies the fingerprint reading circuit 402 of the driving polarity state of the frame. Fingerprint reading circuit 402 Adjust and correct the fingerprint image data according to the driving polarity state. In practical applications, due to the different polarities of the pixel driving voltages, the light transmittances are also different, resulting in changes in the noise of fingerprint identification. Taking the column inversion method in Figure 2 above as an example, in the captured fingerprint image, there will be uneven brightness and darkness of straight lines, resulting in straight line noise, or background values that the fingerprint does not touch. different situations. In the embodiment of the present invention, since the liquid crystal display driving circuit 401 provides the driving polarity mode of the fingerprint reading circuit 402 at this time when the fingerprint is captured and recognized, the fingerprint reading circuit 402 can read the fingerprint image after reading the fingerprint image. It can be modified according to different driving polarities.

The driving polarity states provided by the liquid crystal display driving circuit 401 are, for example, the positive and negative polarities indicated in FIG. 2 , that is, the positive and negative polarities of each pixel are informed. In another preferred embodiment of the present invention, the driving polarity state provided by the liquid crystal display driving circuit 401 can also only inform the current frame inversion mode of liquid crystal driving, or directly provide the voltage data of each pixel, or It is to provide the frame as an odd-numbered frame or an even-numbered frame, etc. Therefore, the present invention does not limit the data content of the driving polarity state, as long as the data of the current liquid crystal driving polarity can be known to the fingerprint reading circuit 402, it belongs to the scope of the present invention.

In addition, in step S505, for example, multiple fingerprint image captures are performed, for example, after comparing the fingerprint identification data captured multiple times, one is selected for compensation and correction of the fingerprint image. Or, perform image processing on all or part of the fingerprint identification data captured multiple times, and use the driving polarity state to Compensation and correction of fingerprint images. Therefore, the present invention does not limit the number of times of capturing the fingerprint image and the method of image processing. As long as the image data is adjusted by driving the data of the polarity state, it should belong to the scope of the present invention.

Step S506: Report the adjusted fingerprint image data to the host. After the fingerprint image correction is completed, the integrated display driver fingerprint identification circuit 301 returns the adjusted fingerprint image data to the host to complete the fingerprint sensing. The host determines whether to unlock the mobile device by using the adjusted fingerprint image data.

In the above-mentioned step S503, the present embodiment, for example, determines the image capture range of the fingerprint recognition according to the sensed touch position. In another preferred embodiment of the present invention, the image capture range of fingerprint recognition can also be determined by other methods such as operating system default or program default, etc. Therefore, those skilled in the art can infer that , the integrated display driver fingerprint identification circuit 301 can also determine the fingerprint image capture range according to the application timing of the fingerprint identification.

In the above embodiment, the liquid crystal display driving circuit 401 notifies the fingerprint reading circuit 402 of the driving polarity state of the frame, for example, during the period of fingerprint recognition FP. However, in another preferred embodiment of the present invention, the fingerprint reading circuit 402 may provide a request to the liquid crystal display driving circuit 401 in advance, so as to inform the liquid crystal display driving circuit 401 that the current driving polarity state data is required. Then, the data of the driving polarity state of the frame is provided to the fingerprint reading circuit 402 to the fingerprint reading circuit 402 . Therefore, the present invention is not limited to provide the driving polarity state time. In addition, although the display element in the embodiment of the present invention is described with a liquid crystal display panel, it can be understood that the display element in the in-cell fingerprint display panel of the present invention is not limited to the structure of the liquid crystal display panel. Other display elements, such as organic light emitting diodes (OLEDs), are also possible.

To sum up, the spirit of the present invention is that, before capturing the fingerprint image, the fingerprint reading circuit first obtains the current polarity state of each pixel being driven, so that after the fingerprint is captured, the interference caused by the polarity can be detected. The back-end image processing greatly improves the fingerprint recognition rate.

The specific embodiments proposed in the detailed description of the preferred embodiments are only used to facilitate the description of the technical content of the present invention, rather than restricting the present invention to the above-mentioned embodiments in a narrow sense, without exceeding the spirit of the present invention and applying for patents below The situation of the scope, the various changes and implementations made, all belong to the scope of the present invention. Therefore, the protection scope of the present invention should be determined by the scope of the appended patent application.

S501~S506: Steps of the fingerprint sensing method of the liquid crystal display panel according to a preferred embodiment of the present invention

Claims (18)

A fingerprint sensing method of an embedded fingerprint display panel, suitable for an embedded fingerprint display panel, wherein the embedded fingerprint display panel includes an optical reading array, and the fingerprint sensing of the embedded fingerprint display panel Methods include: providing a driving polarity state of the in-cell fingerprint display panel to a fingerprint reading circuit within a frame time; perform fingerprint image capture; and According to the driving polarity state of the embedded fingerprint display panel, the captured fingerprint image data is corrected. The fingerprint sensing method for an in-cell fingerprint display panel according to claim 1, wherein the driving methods of the pixels of the in-cell fingerprint display panel include positive polarity driving and negative polarity driving, so as to eliminate the image of the panel residue. According to the fingerprint sensing method of the embedded fingerprint display panel described in the first item of the claim, before the fingerprint image capture is performed, it further includes: According to a touch position, the position for capturing the fingerprint image is determined. The fingerprint sensing method of the embedded fingerprint display panel as described in item 1 of the claim law, including: Before performing fingerprint identification, reduce the screen refresh rate of the in-cell fingerprint display panel. The fingerprint sensing method of the embedded fingerprint display panel as described in item 1 of the claim, further comprising: Before performing fingerprint identification, a display driving circuit is required to provide the driving polarity state of the in-cell fingerprint display panel. The fingerprint sensing method of the embedded fingerprint display panel as described in item 1 of the claim, further comprising: The image data of the fingerprint is adjusted according to the multiple fingerprint captures and the corresponding driving polarity states. An integrated display-driven fingerprint identification circuit is suitable for an embedded fingerprint display panel, wherein the embedded fingerprint display panel includes an optical reading array, and the integrated display-driven fingerprint identification circuit includes: a display driving circuit, coupled to the embedded fingerprint display panel, and driving the embedded fingerprint display panel according to a display data; a fingerprint reading circuit, coupled to the optical reading array of the in-cell fingerprint display panel and the display driving circuit, wherein, Within a frame time, the display driving circuit provides a driving polarity state of the in-cell fingerprint display panel to the fingerprint reading circuit; Wherein, the fingerprint reading circuit captures the fingerprint image through the optical reading array, and then the fingerprint reading circuit corrects the captured fingerprint image data according to the driving polarity state of the embedded fingerprint display panel. The integrated display-driven fingerprint identification circuit according to claim 7, wherein the driving modes of the pixels of the in-cell fingerprint display panel include positive-polarity driving and negative-polarity driving, by alternating positive-polarity driving and negative-polarity driving drive to eliminate image sticking from the panel. The integrated display driver fingerprint identification circuit as described in claim 7, further comprising: a touch sensing circuit for detecting a touch position, Wherein, when fingerprint recognition is performed, the fingerprint reading circuit determines the location where the fingerprint image is captured according to the touch position. The integrated display driver fingerprint identification circuit according to claim 7, wherein the in-cell fingerprint display driver circuit reduces the screen refresh rate of the in-cell fingerprint display panel before performing fingerprint identification. The integrated display-driven fingerprint identification circuit according to claim 7, wherein, before fingerprint identification is performed, the display-driven circuit is required to provide the drive polarity state of the in-cell fingerprint display panel. The integrated display-driven fingerprint identification circuit as described in claim 7, wherein the image data of the fingerprint is adjusted according to multiple fingerprint captures and their corresponding driving polarity states. A mobile device, comprising: an in-cell fingerprint display panel including an optical reading array; and An integrated display driver fingerprint identification circuit, including: a display driving circuit, coupled to the embedded fingerprint display panel, and driving the embedded fingerprint display panel according to a display data; a fingerprint reading circuit, coupled to the optical reading array of the in-cell fingerprint display panel and the display driving circuit, wherein, providing a driving polarity state of the in-cell fingerprint display panel to the fingerprint reading circuit within a frame time; Wherein, the fingerprint reading circuit captures the fingerprint image through the optical reading array, and then the fingerprint reading circuit corrects the captured fingerprint image data according to the driving polarity state of the embedded fingerprint display panel. The mobile device according to claim 13, wherein the driving mode of the pixels of the in-cell fingerprint display panel includes positive polarity driving and negative polarity driving, and by alternating positive polarity driving and negative polarity driving to eliminate Image retention of the panel. The mobile device as described in item 13 of the claim, further comprising: a touch sensing circuit for detecting a touch position, Wherein, when fingerprint recognition is performed, the fingerprint reading circuit determines the location where the fingerprint image is captured according to the touch position. The mobile device according to claim 13, wherein, before performing fingerprint identification, the display driving circuit reduces the screen refresh rate of the in-cell fingerprint display panel. The mobile device according to claim 13, wherein before performing fingerprint identification, the display driving circuit is required to provide the driving polarity state of the in-cell fingerprint display panel. The mobile device according to claim 13, wherein the image data of the fingerprint is adjusted according to multiple fingerprint captures and their corresponding driving polarity states.

Images