CN107958185B

CN107958185B - Biological characteristic information sensing method of display module

Info

Publication number: CN107958185B
Application number: CN201710707679.1A
Authority: CN
Inventors: 李问杰
Original assignee: Shenzhen Sunwave Technology Co Ltd
Current assignee: Liuzhou Zibo Technology Co.,Ltd.
Priority date: 2017-08-17
Filing date: 2017-08-17
Publication date: 2020-05-19
Anticipated expiration: 2037-08-17
Also published as: CN107958185A

Abstract

The invention discloses a biological characteristic information sensing method of a display module, which comprises the following steps: s1, when a target object contacts or approaches the display module and triggers the sensing of the biological characteristic information, controlling the display pixels of the display panel to be lighted in a time-sharing manner, wherein the controlling the display pixels of the display panel to be lighted in a time-sharing manner comprises: controlling display pixels corresponding to a photosensitive device which executes light sensing not to be lightened, and controlling the rest display pixels to be lightened in a time-sharing manner so that light signals sent by the display pixels reach a target object; s2, providing scanning driving signals to the photosensitive units to drive the photosensitive units to receive optical signals reflected by the target object and convert the received optical signals into corresponding electric signals; and S3, acquiring the preset biological characteristic information of the target object according to the electric signals output by the plurality of photosensitive units.

Description

Biological characteristic information sensing method of display module

Technical Field

The invention relates to a biological characteristic information sensing method of a display module.

Background

At present, a biological information sensor, especially a fingerprint sensor, has gradually become a standard component of electronic products such as mobile terminals. Because optical fingerprint identification sensor has stronger penetrability than capacitanc fingerprint identification sensor, consequently someone proposes an optical fingerprint identification module who is applied to mobile terminal. As shown in fig. 1, the optical fingerprint recognition module includes an optical fingerprint sensor 400 and a light source 402. The optical fingerprint sensor 400 is disposed under a protective cover 401 of the mobile terminal. The light source 402 is disposed adjacent to one side of the optical fingerprint recognition sensor 400. When the finger F of the user touches the protective cover 401, the light signal emitted from the light source 402 passes through the protective cover 401 and reaches the finger F, is reflected by the valleys and ridges of the finger F, and is received by the optical fingerprint recognition sensor 400, and forms a fingerprint image of the finger F.

However, the optical fingerprint identification module can only be limited to be disposed in a predetermined area of the mobile terminal, for example, a non-display area of the mobile terminal, and the fingerprint identification module can be used only by contacting the predetermined area, which is still limited in use. Therefore, it is necessary to provide a structure that can be disposed in the display area and can realize fingerprint identification of any area in the display area.

Disclosure of Invention

The embodiment of the invention aims to solve at least one technical problem in the prior art. Therefore, the present invention is directed to a method for sensing biometric information of a display module.

The embodiment of the invention provides a biological characteristic information sensing method of a display module, wherein the display module comprises a display panel and a photosensitive panel which is stacked with the display panel; the display panel comprises a plurality of display pixels, the photosensitive panel comprises a plurality of photosensitive units, each photosensitive unit comprises at least one photosensitive device, and the photosensitive devices are arranged corresponding to the display pixels; the biometric information sensing method includes the steps of:

s1, when a target object contacts or approaches the electronic device and triggers the sensing of the biometric information, controlling the display pixels of the display panel to illuminate in a time-sharing manner, wherein the controlling the display pixels of the display panel to illuminate in a time-sharing manner includes: controlling display pixels corresponding to a photosensitive device which executes light sensing not to be lightened, and controlling the rest display pixels to be lightened in a time-sharing manner so that light signals sent by the display pixels reach a target object;

s2, providing scanning driving signals to the photosensitive units to drive the photosensitive units to receive optical signals reflected by the target object and convert the received optical signals into corresponding electric signals;

and S3, acquiring the preset biological characteristic information of the target object according to the electric signals output by the plurality of photosensitive units.

According to the sensing method provided by the embodiment of the invention, the display pixels are controlled to be lighted in a time-sharing mode when the biological characteristic information sensing is carried out on the photosensitive panel, so that aliasing of optical signals sensed by the photosensitive panel is avoided, and the sensing precision of the photosensitive device is improved.

In some embodiments, the controlling the time-sharing lighting of the display pixels in step S1 includes: and controlling the display pixels to light one by one or controlling at least two display pixels at a preset interval to light.

In some embodiments, the photosensitive units are distributed in a matrix, and each row of photosensitive units is connected with a scanning line; the step S2 includes: the scan driving signal is supplied to the plurality of scan lines line by line or in an interlaced manner to activate the light sensing units.

By providing scanning driving signals to the scanning lines line by line or in an interlaced manner, the photosensitive units of one line can be activated at a time to perform light sensing, thereby accelerating the sensing speed.

In some embodiments, each row of the light-sensing units is connected with a data line; the step S3 includes: and reading the electric signals on the data line in a time-sharing manner, and acquiring the preset biological characteristic information of the target object according to the read electric signals.

The number of signal channels in the signal processing circuit is relatively reduced by time-sharing reading of the electric signals on the data lines, so that the cost of the signal processing circuit is reduced.

In some embodiments, when the remaining display pixels are controlled to be turned on in a time-sharing manner, the display pixels adjacent to the non-turned-on display pixels are controlled to be turned on in a time-sharing manner.

In certain embodiments, the step S1 further includes: when the target object is in contact with or close to the electronic device, determining a touch area of the target object on the electronic device so that the electronic device performs biometric information sensing in the touch area.

Through confirming the touch area to supply the display module assembly to carry out the sensing of biological characteristic information in the touch area, thereby avoided carrying out the sensing of biological characteristic information in the whole display area of electronic equipment, thereby accelerated the sensing of biological characteristic information of display module assembly, still reduced the operation consumption of display module assembly simultaneously.

In certain embodiments, the step S1 further comprises: and controlling the display pixels corresponding to the touch area to be lighted in a time sharing mode.

In certain embodiments, the step S2 further includes: and providing the scanning driving signal to the photosensitive unit corresponding to the touch area.

In some embodiments, a filter is disposed on the photosensitive unit, and the filter is configured to filter light signals outside a preset wavelength band; the step S1 further includes: and when the target object contacts or approaches the electronic equipment and triggers the sensing of the biological characteristic information, controlling the display pixels of the display panel to send out optical signals of preset wave bands.

Additional aspects and advantages of embodiments of the invention will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of embodiments of the invention.

Drawings

The above and/or additional aspects and advantages of embodiments of the present invention will become apparent and readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings of which:

FIG. 1 is a schematic diagram of an optical biometric information sensing structure applied to an electronic device in the prior art;

FIG. 2 is a schematic view of a partial structure of a display module according to an embodiment of the invention;

FIG. 3 is a block diagram of a photosensitive device according to an embodiment of the present invention;

FIG. 4 is a schematic structural diagram of a photosensitive unit according to an embodiment of the invention;

FIG. 5 is a schematic structural diagram of a photosensitive unit according to another embodiment of the present invention;

FIG. 6 is a schematic diagram illustrating the display panel and the light-sensing panel shown in FIG. 2;

FIG. 7 is a schematic view of a partial structure of a photosensitive device according to another embodiment of the present invention;

FIG. 8 is a schematic diagram of the corresponding positions of a display panel and a photosensitive panel according to another embodiment of the present invention;

FIG. 9 is a schematic view of a partial structure of a display module according to another embodiment of the present invention;

FIG. 10 is a schematic diagram of a partial structure of a display panel according to an embodiment of the present invention;

FIG. 11 is a schematic diagram illustrating a display pixel in a display panel and a corresponding location of a photosensitive device in a photosensitive panel according to an embodiment of the invention;

FIG. 12 is a schematic diagram illustrating the corresponding positions of display pixels in a display panel and photosensitive devices in a photosensitive panel according to another embodiment of the invention;

FIG. 13 is a schematic view illustrating a process of sensing biometric information of a display module according to an embodiment of the present invention;

FIG. 14 is a schematic view illustrating a process of sensing biometric information of a display module according to another embodiment of the present invention;

FIG. 15 is a schematic view of the display panel and the light-sensing panel shown in FIG. 9;

fig. 16 is a schematic front view illustrating a display module according to an embodiment of the invention applied to an electronic device;

fig. 17 is a schematic cross-sectional structure view of the electronic device in fig. 16 taken along line I-I, in which only a partial structure of the electronic device is shown;

fig. 18 is a schematic diagram illustrating a correspondence relationship between a display area of a display panel and a sensing area of a light-sensing panel according to an embodiment of the invention.

Detailed Description

Reference will now be made in detail to embodiments of the present invention, examples of which are illustrated in the accompanying drawings, wherein like reference numerals refer to the same or similar elements or elements having the same or similar function throughout. The embodiments described below with reference to the accompanying drawings are illustrative only for the purpose of explaining the present invention, and are not to be construed as limiting the present invention.

In the description of the present invention, it is to be understood that the terms "first", "second" and the like are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implying any number of technical features indicated. Thus, features defined as "first", "second", may explicitly or implicitly include one or more of the described features. In the description of the present invention, "a plurality" means two or more unless specifically defined otherwise. "contact" or "touch" includes direct contact or indirect contact. For example, a light-sensing panel disclosed below, which is disposed inside the electronic device, such as under a protective cover, the user's finger indirectly contacts the light-sensing panel through the protective cover.

In the description of the present invention, it should be noted that, unless otherwise explicitly specified or limited, the terms "mounted," "connected," and "connected" are to be construed broadly, e.g., as meaning either a fixed connection, a removable connection, or an integral connection; may be mechanically connected, may be electrically connected or may be in communication with each other; either directly or indirectly through intervening media, either internally or in any other relationship. The specific meanings of the above terms in the present invention can be understood by those skilled in the art according to specific situations.

The following disclosure provides many different embodiments or examples for implementing different features of the invention. To simplify the disclosure of the present invention, the components and settings of a specific example are described below. Of course, they are merely examples and are not intended to limit the present invention. Furthermore, the present invention may repeat reference numerals and/or reference letters in the various examples, which have been repeated for purposes of simplicity and clarity and do not in themselves dictate a relationship between the various embodiments and/or configurations discussed. In addition, the present invention provides examples of various specific processes and materials, but one of ordinary skill in the art may recognize applications of other processes and/or uses of other materials.

Further, the described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments. In the following description, numerous specific details are provided to provide a thorough understanding of embodiments of the invention. One skilled in the relevant art will recognize, however, that the invention can be practiced without one or more of the specific details, or with other structures, components, and so forth. In other instances, well-known structures or operations are not shown or described in detail to avoid obscuring the invention.

The embodiment of the invention provides a display module for sensing biological characteristic information, which not only can realize image display, but also can realize acquisition of biological characteristic information of a target object contacting or approaching the display module.

In some embodiments, referring to fig. 2, fig. 2 shows a structure of a display module according to an embodiment of the invention. The display module 1 includes a display device (not shown) and a photosensitive device 20 (see fig. 3). The display device further includes a display panel 100 for performing image display. The photosensitive device 20 includes a photosensitive panel 200, and the photosensitive panel 200 and the display panel 100 are stacked for sensing optical signals to obtain predetermined biometric information of a target object touching or approaching the display module 1.

Specifically, the display panel 100 includes a plurality of display pixels 12, and adjacent display pixels 12 have a space H therebetween. Further, the display panel 100 further includes a driving circuit (not shown) for driving each display pixel 12 to emit light, and the corresponding driving circuit may be disposed between the display pixels 12, or may be disposed below the display pixels 12. The display device further comprises a display driving circuit (not shown) for driving the plurality of display pixels 12 to emit light to serve as a light source for the light sensing by the light sensing device 20. Further, the display driving circuit drives the display pixels 12 to be turned on in a time division manner when the light sensing device 20 senses light. In some embodiments, the display driving circuit may be disposed on the display panel 100, or may be connected to the display pixels 12 through a connector (e.g., a flexible circuit board).

With reference to fig. 2, the light-sensing panel 200 includes a substrate 26 and a plurality of light-sensing devices 220 formed on the substrate 26, wherein the light-sensing devices 220 are configured to receive light signals and convert the received light signals into corresponding electrical signals. The substrate 26 may include both transparent substrates such as, but not limited to, glass substrates, plastic substrates, crystal and the like insulating substrates, and non-transparent substrates such as, but not limited to, silicon substrates, printed circuit boards, metal substrates and the like. In addition, the substrate 26 may be a rigid material or a flexible material, such as a flexible film. If the substrate 26 is made of a flexible material, the light-sensing panel 200 not only has a thin thickness, but also can be applied to an electronic device having a curved display screen.

When the display module 1 is in operation, the display pixels 12 emit light signals to perform image display. When a target object, such as a finger, is placed above the display module 1, due to the shielding of the target object, the light signal irradiated to the target object is reflected, the reflected light signal is received by the light sensing device 220, the light sensing device 220 converts the received light signal into a corresponding electrical signal, and the biological characteristic information of the target object can be obtained according to the electrical signal.

Because the reflection of the light signals by different parts of the target object is different, the light signals sensed between the adjacent light sensing devices 220 are aliased, so that the obtained biological characteristic information is fuzzy, therefore, when the light sensing panel 200 senses the biological characteristic information, the display pixels 12 are driven to be turned on in a time-sharing manner through the display driving circuit, that is, the light signals emitted by the adjacent display pixels 12 are controlled not to interfere with each other, and the reflected light signals are also aliased, so that the light sensing device 20 obtains accurate biological characteristic information, and the sensing precision of the light sensing device 20 is improved.

Specifically, the plurality of display pixels 12 in the display panel 100 can be controlled independently, and when a single display pixel 12 is controlled to be turned on, point light source illumination can be realized. When the light sensing device 220 performs light sensing, only one display pixel 12 emits a light signal, so that the interference of the light signal reflected by the target object is less, and the sensing accuracy of the light sensing device 20 is improved.

In some embodiments, when driving the display pixels 12 to illuminate in a time-sharing manner, a single display pixel 12 is driven to illuminate in sequence, or several display pixels 12 spaced far enough apart are driven to illuminate at the same time, so that the light reflected by the target object has a sufficiently small mutual influence.

Referring to fig. 3, fig. 3 shows a structure of a photosensitive device according to an embodiment of the invention. The photosensitive panel 200 further includes a plurality of photosensitive cells 22, and a scan line group and a data line group electrically connected to the plurality of photosensitive cells 22, wherein the scan line group includes a plurality of scan lines 201, and the data line group includes a plurality of data lines 202. The plurality of photosensitive units 22 are distributed in an array, such as a matrix. Of course, other regular or irregular distributions are also possible. The plurality of scan lines 201 and the plurality of data lines 202 electrically connected to the light sensing units 22 are disposed to cross each other and disposed between the adjacent light sensing units 22. For example, a plurality of scan lines G1, G2 … Gm are arranged at intervals in the Y direction, and a plurality of data lines S1, S2 … Sn are arranged at intervals in the X direction. However, the plurality of scan lines 201 and the plurality of data lines 202 may be arranged at a certain angle, for example, 30 ° or 60 °, instead of being arranged perpendicularly as shown in fig. 5. In addition, since the scan lines 201 and the data lines 202 have conductivity, the scan lines 201 and the data lines 202 at the crossing positions are isolated from each other by an insulating material.

It should be noted that the arrangement of the distribution and number of the scanning lines 201 and the data lines 202 is not limited to the above-mentioned exemplary embodiment, and corresponding scanning line groups and data line groups may be correspondingly arranged according to the structure of the photosensitive unit 22.

Furthermore, the plurality of scanning lines 201 are connected to a photosensitive driving circuit 23, and the plurality of data lines 202 are connected to a signal processing circuit 25. The photosensitive driving circuit 23 is configured to provide a corresponding scanning driving signal, and transmit the scanning driving signal to the corresponding photosensitive unit 22 through the corresponding scanning line 201, so as to activate the photosensitive unit 22 to perform the light sensing. The photosensitive driving circuit 23 is formed on the substrate 26, and may be electrically connected to the photosensitive unit 22 through a connecting component (e.g., a flexible circuit board), i.e., connected to the plurality of scanning lines 201. The signal processing circuit 25 receives an electric signal generated by the corresponding light sensing unit 22 performing light sensing through the data line 202, and acquires biometric information of the target object based on the electric signal.

In some embodiments, the photosensitive device 20 including the photosensitive panel 200 further includes a controller 27, in addition to the signal processing circuit 25 and the photosensitive driving circuit 23, the controller 27 is configured to control the timing of outputting the corresponding scanning driving signal by the driving circuit 23, such as but not limited to activating the photosensitive units 22 row by row to perform the photosensitive sensing. The controller 27 is further configured to control the signal processing circuit 25 to receive the electrical signals output by the light sensing units 22, and generate the biometric information of the target object according to the electrical signals after receiving the electrical signals output by all the light sensing units 22 performing the light sensing.

Further, the signal processing circuit 25 and the controller 27 may be selectively formed on the substrate 26 or electrically connected to the photosensitive unit 22, for example, by a connector (e.g., a flexible circuit board) according to the type of the substrate 26. For example, when the substrate 26 is a silicon substrate, the signal processing circuit 25 and the controller 27 may be selectively formed on the substrate 26, or may be selectively electrically connected to the light sensing unit 22 through a flexible circuit board, for example; when the substrate 26 is an insulating substrate, the signal processing circuit 25 and the controller 27 need to be electrically connected to the light sensing unit 22, for example, through a flexible circuit board.

In some embodiments, referring to fig. 4, fig. 4 illustrates a connection structure of the light sensing unit 22, the scan line 201 and the data line 202 according to an embodiment. The light sensing unit 22 includes a light sensing device 220 and a switching device 222. The switch device 220 has a control terminal C and two signal terminals, such as a first signal terminal Sn1 and a second signal terminal Sn 2. The control terminal C of the switching device 220 is connected to the scan line 201, the first signal terminal Sn1 of the switching device 222 is connected to a reference signal L via the light sensing device 220, and the second signal terminal Sn2 of the switching device 222 is connected to the data line 202.

Specifically, the photosensitive device 220 may be, for example, but not limited to, any one or more of a photodiode, a phototransistor, a photodiode, a photoresistor, and a thin film transistor. Taking a photodiode as an example, negative voltages are applied to two ends of the photodiode, at this time, when the photodiode receives an optical signal, a photocurrent proportional to the optical signal is generated, and the larger the intensity of the received optical signal is, the higher the generated photocurrent is, the higher the speed of voltage drop on the cathode of the photodiode is, so that by collecting voltage signals on the cathode of the photodiode, the intensities of optical signals reflected by different parts of a target object are obtained, and further, biological characteristic information of the target object is obtained. It is understood that a plurality of the light sensing devices 220 may be provided in order to increase the light sensing effect of the light sensing devices 220.

Further, the switching device 222 is, for example, but not limited to, any one or more of a triode, a MOS transistor, and a thin film transistor. Of course, the switching device 222 may also include other types of devices, and the number may also be 2, 3, etc.

Taking the structure of the light sensing unit 22 shown in fig. 4 as an example, the gate of the thin film transistor TFT is used as the control terminal C of the switching device 222, and the source and the drain of the thin film transistor TFT correspond to the first signal terminal Sn1 and the second signal terminal Sn2 used as the switching device 222. The gate of the thin film transistor TFT is connected to the scanning line 201, the source of the thin film transistor TFT is connected to the cathode of the photodiode D1, and the drain of the thin film transistor TFT is connected to the data line 202. The anode of the photodiode D1 is connected to a reference signal L, which is, for example, a ground signal or a negative voltage signal.

When the photosensitive unit 22 performs the photosensitive process, a driving signal is applied to the gate of the thin film transistor TFT through the scanning line 201 to drive the thin film transistor TFT to be turned on. At this time, the data line 202 is connected to a positive voltage signal, when the TFT is turned on, the positive voltage signal on the data line 202 is applied to the cathode of the photodiode D1 through the TFT, and since the anode of the photodiode D1 is grounded, a reverse voltage is applied across the photodiode D1, so that the photodiode D1 is in a reverse bias state, i.e., in an operating state. At this time, when an optical signal is irradiated to the photodiode D1, the reverse current of the photodiode D1 rapidly increases, thereby causing a current change on the photodiode D1, which can be obtained from the data line 202. Since the larger the intensity of the optical signal is, the larger the generated reverse current is, the intensity of the optical signal can be obtained according to the current signal acquired on the data line 202, and thus the biometric information of the target object can be obtained.

In some embodiments, the reference signal L may be a positive voltage signal, a negative voltage signal, a ground signal, or the like. It is within the scope of the present invention that the electrical signal provided on the data line 202 and the reference signal L apply a reverse voltage across the photodiode D1 to perform the optical sensing.

It is to be understood that the connection method of the thin film transistor TFT and the photodiode D1 in the light sensing unit 22 is not limited to the connection method shown in fig. 4, and other connection methods may be used. For example, as shown in fig. 5, fig. 5 shows a connection structure of the photosensitive unit 22, the scanning line 201, and the data line 202 according to another embodiment. The gate G of the thin film transistor TFT is connected to the scanning line 201, the drain D of the thin film transistor TFT is connected to the positive electrode of the photodiode D1, and the source S of the thin film transistor TFT is connected to the data line 202. The cathode of the photodiode D1 is connected to a positive voltage signal.

In some embodiments, please refer to fig. 2-4 and fig. 6 in combination, and fig. 6 shows a partial structure of a display module according to another embodiment of the present invention. Since the photosensitive panel 200 is located above the display panel 100, the photosensitive panel 200 has a first light-transmitting region P1 through which the light signal of the display panel 100 passes, and the first light-transmitting region P1 is disposed corresponding to the display pixels 12 so as not to affect the normal display of the display device.

Further, adjacent display pixels 12 have a spacing H therebetween. Since the photosensitive panel 200 is disposed above the display panel 100, in order not to affect the display of the display panel 100, the photosensitive panel 200 is provided with a first light transmission region P1, and the first light transmission region P1 is disposed corresponding to the display pixels 12 for the light signals emitted by the display panel 100 to pass through. In some embodiments, in order to improve the display effect of the display panel 100, the area of the first light transmission region P1 is slightly larger than the area of the display pixel 12.

In addition, since the scanning lines 201, the data lines 202, and the light sensing devices 220 on the substrate 26 have opaque characteristics and the switching devices 222 are prevented from being affected by light signals applied to the switching devices 222, the regions of the substrate 26 where the scanning lines 201, the data lines 202, the light sensing devices 220, and the switching devices 222 are formed become the opaque regions P2 of the light sensing panel 200. The non-light-transmitting region P2 is located above the gap H of the display panel 100. Accordingly, the switching device 222 and the light sensing device 220 are located in the non-light transmission region P2. It is understood that the non-light-transmitting region P2 can also be changed to the first light-transmitting region P1 if the components provided on the light-sensing panel 200 can transmit light or omit some components having non-light-transmitting structures. For example, in some embodiments, the scan lines 201 and the data lines 202 may also be made of a transparent conductive material and located in the first light-transmitting region P1. Therefore, in the embodiment of the present invention, the positions and sizes of the first light-transmitting region P1 and the non-light-transmitting region P2 are not strictly limited, and can be flexibly adjusted according to actual conditions.

In some embodiments, the switching device 222 may be disposed below the light sensing device 220, or the switching device 222 may be disposed partially overlapping the light sensing device 220. The scan line 201 and the data line 202 may also be disposed under the switching device 222. This makes the arrangement of the light sensing units 22, the scan lines 201 and the data lines 202 more compact, and increases the light sensing area of the light sensing device 220 in the case of limited arrangement area, thereby enhancing the sensing effect of the light sensing panel 200.

In particular, in some embodiments, the semiconductor layer and the upper electrode of the photosensitive device 220 may also extend above the switching device 222 to increase the sensing area. Taking the photosensitive device 220 as a photodiode as an example, the anode and the semiconductor layer of the photodiode extend above the switching device 222 to cover the switching device 222, and a light shielding layer is further disposed above the region of the anode corresponding to the switching device 222 to prevent light from irradiating the switching device 222. The cathode of the photodiode is connected to the switching device 222. The cathode is a lower electrode, and is made of a non-light-transmitting conductive material, such as a metal material.

In some embodiments, taking an object as an organism such as a finger as an example, when the finger contacts or approaches the display module 1, if the finger is illuminated by ambient light, and the finger has many tissue structures such as epidermis, bone, flesh, blood vessels, etc., part of the light signals in the ambient light will penetrate through the finger, and part of the light signals will be absorbed by the finger. The light signal penetrating through the finger reaches the light sensing unit 22, and at this time, the light sensing unit 22 not only senses the light signal reflected by the target object, but also senses the light signal of the environment light penetrating through the finger, so that accurate sensing cannot be performed. Therefore, in order to avoid the influence of the ambient light on the sensing of the target object by the photosensitive unit 22, please refer to fig. 7, in which fig. 7 shows a partial structure of a photosensitive device according to another embodiment of the present invention. The photosensitive device 20 further includes a filter 29, and the filter 29 is disposed on the photosensitive panel 200 and corresponds to the photosensitive unit 22. The filter 29 is used for filtering light signals outside a predetermined wavelength band. In the embodiment of the present invention, the optical filter 29 filters the optical signals outside the preset wavelength band from the reflected optical signals, thereby improving the sensing accuracy of the photosensitive device 20.

In some embodiments, the predetermined wavelength band is a wavelength band corresponding to the blue light signal, i.e., the filter 29 filters out light signals other than the blue light signal.

In some embodiments, the predetermined wavelength band is a wavelength band corresponding to green light signals, i.e., the filter 29 filters light signals other than the green light signals.

Among the red, blue, and green light signals of the ambient light, a target object such as a finger absorbs the red light signal weakest, and absorbs the blue light signal strongest next to the green light signal. I.e. ambient light is shining on the finger, a large amount of the blue light signal is absorbed by the finger, and only a small amount, even no blue light signal penetrates the finger. Therefore, the light signals in the wavelength bands other than the blue light signal or the green light signal are selected for filtering, so that the interference of the ambient light can be greatly eliminated, and the sensing accuracy of the light sensing device 20 can be improved.

Further, the embodiment of the present invention may select the photo sensor device 220 having high sensitivity to blue or green light signals. By selecting the photosensitive device 220 with high sensitivity to blue light signals or green light signals to perform light sensing, the photosensitive device 220 is more sensitive to the blue light signals or the green light signals, so that interference caused by red light signals in ambient light is avoided to a certain extent, and the sensing accuracy of the photosensitive device 20 is improved.

In some embodiments, referring to fig. 8, fig. 8 shows a structure of a display module according to another embodiment of the present invention. The light sensing device 220 is a light-transmitting structure and is correspondingly disposed above the display pixel 12. The display pixels 12 are, for example, but not limited to, three types of red display pixels, green display pixels, and blue display pixels. Moreover, in order not to affect the brightness uniformity of the display panel 100, the photo-sensing device 220 correspondingly covers all the display pixels 12, i.e., the red display pixels, the green display pixels and the blue display pixels. Since the photosensitive device 220 has light transmittance, the photosensitive device 220 is not limited to be disposed in the non-light-transmitting region P2, but may extend into the light-transmitting region P1, i.e., the photosensitive device 220 extends from the non-light-transmitting region P2 to the light-transmitting region P1 and occupies the entire light-transmitting region. Therefore, the photosensitive area of the photosensitive device 220 is increased, and the photosensitive effect of the photosensitive device 220 is further enhanced. Alternatively, the light sensing device 220 may be disposed in the light transmissive region P1, so as to provide more layout space for the switching device 222, the scan line 201, and the data line 202 in the non-light transmissive region P2.

Further, since the photo sensor device 220 is located above the display pixel 12, in order to solve the influence of the interference signal, the embodiment of the present invention selects the photo sensor device 220 having high sensitivity to blue or green light signals. By selecting the photosensitive device 220 with high sensitivity to blue light signals or green light signals to perform light sensing, the photosensitive device 220 is more sensitive to the blue light signals or the green light signals, so that interference caused by red light signals in ambient light is avoided to a certain extent, and the sensing accuracy of the photosensitive device 20 is improved.

In some embodiments, referring to fig. 9, fig. 9 shows a structure of a display module according to still another embodiment of the present invention. The display module 1 includes a display device (not shown) and a photosensitive device 20 (see fig. 3). The display device further includes a display panel 100 for displaying an image, and a second light-transmitting region (not shown) is disposed in the display region of the display panel 100. The photosensitive device 20 includes a photosensitive panel 200, and the photosensitive panel 200 is disposed below the display panel 100 for sensing the optical signal passing through the second light-transmitting area to obtain the predetermined biometric information of the target object contacting or approaching the display module 1.

Since the photosensitive panel 200 is located below the display panel 100, the display panel 100 has a second light-transmitting area through which the light signal reflected by the target object passes, so that the photosensitive panel 200 can receive the light signal passing through the display panel 100, convert the received light signal into an electrical signal, and obtain the predetermined biometric information of the target object contacting or approaching the display module 1 according to the converted electrical signal.

In some embodiments, in order to ensure that the light signal passing through the display panel 100 is received by the light-sensing panel 200, the light-sensing device 220 (refer to fig. 4) in the light-sensing panel 200 is disposed below the second light-transmitting region. Further, the light sensing device 220 is disposed opposite to the second light transmission region, so that the light signal passing through the display panel 100 is fully received, and the sensing accuracy of the light sensing device 20 is improved.

In some embodiments, the display panel 100 is not limited to an OLED display device, but any display device that can achieve a display effect and has a light-transmitting region through which a light signal passes is within the scope of the present invention.

Referring to fig. 10, fig. 10 shows a partial structure of an OLED panel of an embodiment of a display panel. Taking the display panel 100 as an OLED display panel as an example, the display panel 100 further includes a transparent substrate 101. The display pixel 12 includes an anode 102 formed on a transparent substrate 101, a light-emitting layer 103 formed on the anode 102, and a cathode 104 formed on the light-emitting layer 103. When a voltage signal is applied to the anode 102 and the cathode 104, a large number of carriers accumulated on the anode 102 and the cathode 104 will move to the light-emitting layer 103 and enter the light-emitting layer 103, so as to excite the light-emitting layer 103 to emit a corresponding light signal.

In certain embodiments, the anode 102 and cathode 104 are made of an electrically conductive material. For example, the anode 102 is made of a suitable conductive material such as Indium Tin Oxide (ITO), and the cathode 104 is made of a suitable conductive material such as metal or ITO. The display panel 100 is not limited to the OLED display panel, and may be other suitable types of display panels. The display panel 100 may be a rigid panel made of a rigid material, or may be a flexible panel made of a flexible material. Also, the OLED display panel of the embodiments of the present invention may be a bottom emission type device, a top emission type device, or other suitable structural type display device.

Further, referring to fig. 11, fig. 11 shows a partial structure of a display module according to an embodiment of the invention. The display pixel 12 includes three display pixels, i.e., a red pixel R, a green pixel G and a blue pixel B, wherein the light signal emitted from the red pixel R is a red light signal, the light signal emitted from the green pixel G is a green light signal, and the light signal emitted from the blue pixel B is a blue light signal. The light-emitting layer in the red pixel R uses a light-emitting material that emits a red light signal, the light-emitting layer in the green pixel G uses a light-emitting material that emits a green light signal, and the light-emitting layer in the blue pixel B uses a light-emitting material that emits a blue light signal. Of course, the display pixels 12 may also include black pixels, white pixels; or a red pixel, a green pixel, a blue pixel, a white pixel, etc. In addition, the display panel 100 may also adopt other display technologies to realize display, for example, a color conversion technology, in which light emitted from a blue OLED is absorbed by a fluorescent dye and then converted into red, green, and blue light signals. The display pixels 12 in the display panel 100 are not limited to the arrangement shown in fig. 11, and may have another arrangement, for example, a pentiel arrangement.

Referring to fig. 11, a gap H is formed between adjacent display pixels 12, and the gap H has a second transparent region. The photo sensing devices 220 in the photo sensing unit 22 are correspondingly disposed below the interval H between the adjacent display pixels. Such as but not limited to directly below, may be any location where sufficient optical signals are received. It is understood that the more the light signal passes through the interval H, the higher the sensing accuracy of the light sensing device 20. In addition, the light sensing device 220 may be selectively disposed according to actual situations, for example, the light sensing device 220 is disposed below the maximum interval between the red display pixel R and the green and blue display pixels G and B.

Referring to fig. 12, fig. 12 shows a relative position relationship between a sensing device and a display pixel in a sensing unit according to an embodiment, the display pixel 12 has a transparent display pixel structure, and the display pixel 12 includes, but is not limited to, three display pixels, i.e., a red pixel R, a green pixel G, and a blue pixel B. The light sensing device 220 of the light sensing unit 22 is correspondingly disposed below the display pixel 12. It should be noted that the corresponding arrangement is used for the position relationship between the photosensitive device 220 and the display pixels 12, and does not mean that a photosensitive device 220 must be arranged below each display pixel 12.

The embodiment of the invention utilizes the light transmittance of the display pixels 12 to receive the light signals reflected by the target object and passing through the display pixels, and performs the biological characteristic information sensing on the target object. In addition, since the photosensitive device 220 is disposed below the display pixel 12, the photosensitive surface of the photosensitive device 220 may be equal to the area of the display pixel 12, which can be implemented by using the existing display panel structure, thereby reducing the manufacturing cost of the display module 1, ensuring that enough optical signals in the optical signals passing through the display pixel 12 are received by the photosensitive device 220, and improving the sensing accuracy of the photosensitive device 20.

In some embodiments, the size and shape of the light sensing panel 200 is adapted to the display panel, thus enabling sensing of predetermined biometric information of a target object in contact with or near any location of the display area of the display panel 100. However, alternatively, in some embodiments, the light-sensing panel 200 may be smaller than the display panel. For another example, the sensing area of the photosensitive panel 200 may be smaller than, larger than, or equal to the display area of the display panel.

Further, the display device is further configured to perform touch sensing, and the display driving circuit drives the display pixels corresponding to the touch area to emit light after the display device detects a touch or proximity of a target object.

Further, in some embodiments, to address the effect of interference signals when performing sensing of biometric information, a filter 29 is disposed on the light-sensing panel 200. It should be noted that, since the photosensitive panel 200 is disposed below the display panel 100, the filter 29 can be disposed on the photosensitive panel 200 by, for example, adhering after being disposed independently, so that the process for preparing the filter 29 is simpler.

Correspondingly, in some embodiments, referring to fig. 13, the method for sensing biometric information of the display module includes the following steps:

s11, when a target object contacts or approaches the display module and triggers the sensing of the biological characteristic information, controlling the display pixels of the display panel to be lighted in a time-sharing manner so as to enable the light signals emitted by the display pixels to reach the target object;

s12, providing scanning driving signals to the multiple photosensitive units to drive the photosensitive units to receive optical signals reflected by the target object and convert the received optical signals into corresponding electric signals;

and S13, acquiring the preset biological characteristic information of the target object according to the electric signals generated by the plurality of photosensitive units.

Specifically, the plurality of display pixels 12 in the display panel 100 can be independently controlled, and point light source illumination can be realized by controlling the lighting of a single display pixel 12. When the light sensing unit 22 performs light sensing, only one display pixel 12 emits a light signal, so that the interference of the light signal reflected by the target object is less, and the sensing accuracy of the light sensing device 20 is improved.

In some embodiments, when the display pixels 12 are controlled to be lit in a time-sharing manner, a single display pixel 12 is controlled to be lit, or at least two display pixels 12 spaced far enough apart are controlled to be lit simultaneously, so that the light rays reflected by the target object have a sufficiently small mutual influence.

In some embodiments, in conjunction with the photosensitive device structure shown in FIG. 3, in step S11, a driving signal is provided to the plurality of scan lines line by line or in alternate lines to activate the photosensitive cells 22. As shown in fig. 3, for example, a scan driving signal is supplied to the first scan line G1, and the remaining scan lines are not supplied with the scan driving signal; after a predetermined time, the scan driving signal is provided to the second scan line G2, the rest scan lines are not provided with the scan driving signal, and so on until all the scan lines 201 are scanned. Of course, the scan driving signal is not limited to the progressive supply, and may be supplied in an interlaced manner. For example, a scan driving signal is supplied to the first scan line G1, and the remaining scan lines are not supplied with the scan driving signal; after a predetermined time, the scan driving signal is supplied to the third scan line G3, the rest scan lines are not supplied with the scan driving signal, and so on until all the scan lines 201 are scanned. Note that interlace here is not limited to every 1 line, and may be every 2 lines, 3 lines, and the like.

In some embodiments, since the light sensing device 20 includes the filter 29, assuming that the light signal emitted by the display panel 100 is a white light signal, the light signal becomes weaker after the reflected light signal is filtered by the filter 29, and the light sensing unit 22 hardly senses the light signal, so that the intensity of the light signal can be increased, that is, the light emitting intensity of the display panel 100 can be increased when sensing the biometric information.

Alternatively, in some embodiments, when the display pixels are driven to be turned on in a time-sharing manner in step S11, the display pixels may be driven to emit light signals in a predetermined wavelength band. Specifically, for example, if the filter 29 is used to filter light signals other than the blue light signal, the blue display pixel B of the display panel 100 is driven to emit a light signal; if the filter 29 is used to filter light signals other than the green light signals, the green display pixels G of the display panel 100 are driven to emit signals.

By controlling the display panel 100 to emit the optical signal with the predetermined wavelength band, the optical signal emitted by the display panel 100 is reflected by the target object and then filtered by the filter 29 without loss, that is, the optical signal reaching the light sensing unit 22 is not lost. In other words, if the intensity of the light signal emitted by the display panel 100 increases by a certain amount, the intensity of the light signal sensed by the light sensing unit 22 also increases by a certain amount. Thus, not only the accurate sensing of the optical signal is realized, but also the waste of the optical signal emitted by the display panel 100 is avoided, thereby achieving the purpose of energy saving.

Further, in some embodiments, please refer to fig. 14, and fig. 14 shows a sensing method according to another embodiment of the present invention. Before step S11, the method further includes:

in step S10, when the target object contacts or approaches the display module 1, the touch area of the target object on the display module 1 is determined.

The step S11 further includes: when sensing of the biometric information of the target object is performed, the display pixels 12 of the display panel 100 corresponding to the touch area are controlled to be turned on in a time-sharing manner. The step S12 further includes: the scanning driving signal is supplied to the light sensing unit 22 corresponding to the touch area. For example, the scanning driving signals are provided to the plurality of scanning lines 201 where the touch areas are located to drive the light sensing units 22 corresponding to the touch areas to perform light sensing.

In this embodiment, when sensing the biological characteristic information of the target object is performed, a touch area of the target object on the photosensitive panel 200 is determined first, and the display pixels 12 corresponding to the touch area in the display panel 100 are controlled to emit optical signals according to the touch area, so that all the display pixels 12 are prevented from emitting optical signals, and the purpose of saving energy is achieved; and driving the light sensing panel 200 to perform light sensing with the light sensing unit 22 corresponding to the touch area according to the touch area, thereby preventing the light sensing unit 22 of the entire light sensing panel 200 from performing light sensing and increasing the sensing speed.

In some embodiments, referring to fig. 8 and 12 in combination, since the photo sensor 220 is disposed corresponding to the display pixel 12, if the display pixel 12 is turned on, the photo sensor 220 corresponding to the display pixel 12 senses not only the optical signal reflected by the target object but also the optical signal emitted by the display pixel 12, so that the optical signal emitted by the display panel 100 interferes with sensing of the biometric information of the target object. Therefore, when sensing the biometric information is performed, if the light sensing device 220 is driven to perform light sensing, the display pixel 12 corresponding to the light sensing device 220 is not lighted.

Referring to fig. 15, fig. 15 shows the operation states of the display panel and the photosensitive panel in the sensing method according to another embodiment of the invention, and it should be noted that the distribution of the display pixels in the display panel and the distribution of the photosensitive devices in the photosensitive panel are not limited thereto, and other distribution structures may be adopted. By supplying a scanning driving signal to one scanning line 201a, the photosensitive device 220 connected to the scanning line 201a is driven to operate, and light sensing is performed. At this time, the display pixels 12b above the photo-sensing device 220 are not illuminated for the light signal reflected back through the target object to pass through. To achieve light sensing, a row of display pixels 12, such as display pixel 12a, in the vicinity of display pixel 12b is illuminated.

In some embodiments, when the display pixels 12a adjacent to the display pixel 12b are controlled to be turned on, the display pixels 12a are controlled to be turned on in a time division manner. By controlling the display pixels 12 to be turned on in a time-sharing manner, the interference of the optical signal reflected by the target object is reduced, that is, the mutual interference of the optical signals received between the adjacent light sensing devices 220 is avoided, so that the sensing accuracy of the light sensing apparatus 20 is improved.

Further, referring to fig. 16 and 17, fig. 16 shows a structure of an electronic apparatus according to an embodiment of the present invention, fig. 17 shows a cross-sectional structure of the electronic apparatus shown in fig. 16 along the line I-I, and fig. 17 shows only a partial structure of the electronic apparatus. The electronic device is provided with the display module with any one of the implementation structures, and is used for displaying images of the electronic device and sensing biological characteristic information of a target object contacting or approaching the electronic device.

Examples of the electronic devices include, but are not limited to, consumer electronics, home electronics, vehicle-mounted electronics, financial terminal products, and other suitable types of electronic products. The consumer electronic products include mobile phones, tablet computers, notebook computers, desktop displays, all-in-one computers, and the like. The household electronic products are intelligent door locks, televisions, refrigerators, wearable equipment and the like. The vehicle-mounted electronic products are vehicle-mounted navigators, vehicle-mounted DVDs and the like. The financial terminal products are ATM machines, terminals for self-service business handling and the like. The electronic device shown in fig. 16 is a mobile terminal such as a mobile phone, but the display module can be applied to other suitable electronic products, and is not limited to the mobile terminal such as a mobile phone.

Specifically, the front surface of the mobile terminal 3 is provided with a display panel 100, and a protective cover 300 is disposed above the display panel 100. Optionally, the screen ratio of the display panel 100 is high, for example, more than 80%. The screen occupation ratio refers to a ratio of a display area of the display panel 100 to a front area of the mobile terminal 3. The photosensitive panel 200 is correspondingly disposed above the display panel 100 and below the protective cover 300. The size and shape of the light-sensing panel 200 are adapted to the size and shape of the display panel 100. The light-sensing panel 200 is used to sense predetermined biometric information of a target object contacting or approaching an arbitrary position of the display area of the display panel 100. Alternatively, the photosensitive panel 200 may be disposed below the display panel 100.

In some embodiments, the light sensing panel 200 is used to perform biometric information sensing of a target object anywhere within the display area of the display panel 100. Specifically, for example, referring to fig. 2 and fig. 18 in combination, the display panel 100 has a display area 105 and a non-display area 106, the display area 105 is defined by light emitting areas of all the display pixels 12 of the display panel 100, an area outside the display area 105 is the non-display area 106, and the non-display area 106 is used for setting circuits such as a display driving circuit for driving the display pixels 12 or a circuit bonding area for connecting a flexible circuit board. The photosensitive panel 200 has a sensing region 203 and a non-sensing region 204, the sensing region 203 is defined by the sensing regions of all the photosensitive units 22 of the photosensitive panel 200, the region outside the sensing region 203 is the non-sensing region 204, and the non-sensing region 204 is used for setting circuits such as the photosensitive driving circuit 23 for driving the photosensitive units 22 to perform the photosensitive process or a circuit bonding region for connecting a flexible circuit board. The shape of the sensing region 203 is consistent with the shape of the display region 105, and the size of the sensing region 203 is larger than or equal to the size of the display region 105, so that the photo-sensing panel 200 can sense the predetermined biometric information of the target object contacting or approaching any position of the display region 105 of the display panel 100. Further, the area of the photosensitive panel 200 is smaller than or equal to the area of the display panel 100, and the shape of the photosensitive panel 100 is consistent with the shape of the display panel 100, so that the assembly of the photosensitive panel 200 and the display panel 100 is facilitated. However, alternatively, in some embodiments, the area of the photosensitive panel 200 may be larger than that of the display panel 100.

When the mobile terminal 3 is in a bright screen state and in the biometric information sensing mode, the display panel 100 emits a light signal. When an object touches or approaches the display area, the light sensing panel 200 receives the light signal reflected by the object, converts the received light signal into a corresponding electrical signal, and obtains predetermined biometric information of the object, for example, fingerprint image information, according to the electrical signal. Thus, the photo-sensing panel 200 can sense a target object contacting or approaching an arbitrary position of the display region 105.

In some embodiments, the sensing region 203 of the light sensing panel 200 may also be smaller than the display region 105 of the display panel 100, so as to realize sensing of the predetermined biometric information of the target object in a local region of the display region 105 of the display panel 100.

The electronic device of the embodiment of the invention has the following advantages:

first, the light sensing panel in the display module utilizes the optical signal that display panel sent to realize the biological characteristic information sensing of target object, need not additionally set up the light source to not only save electronic equipment's cost, but also can acquire the biological characteristic information of the target object of contact or near the display area optional position.

Secondly, the photosensitive device can be assembled with the display device after being independently manufactured, so that the preparation of the electronic equipment is accelerated.

Further, the electronic device further comprises a touch sensor (not shown in the figure), and the touch sensor is used for determining a touch area of a target object when the target object contacts the protective cover plate, so that the electronic device can perform biometric information sensing in the touch area.

In some embodiments, the touch sensor is integrated with either the protective cover 300, the display panel 100, or the photo panel 200. Through the integrated touch sensor, not only is the touch detection of the target object realized, but also the thickness of the electronic equipment is reduced, and the development of the electronic equipment towards the direction of lightness and thinness is facilitated.

In the description herein, references to the description of the terms "one embodiment," "certain embodiments," "an illustrative embodiment," "an example," "a specific example," or "some examples," etc., mean that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the invention. In this specification, schematic representations of the above terms do not necessarily refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.

Furthermore, the terms "first", "second" and "first" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one such feature. In the description of the present invention, "a plurality" means at least two, e.g., two, three, etc., unless specifically limited otherwise.

Although embodiments of the present invention have been shown and described above, it is understood that the above embodiments are exemplary and not to be construed as limiting the present invention, and those skilled in the art can make changes, modifications, substitutions and alterations to the above embodiments within the scope of the present invention.

Claims

1. A biological characteristic information sensing method of a display module is characterized in that: the display module comprises a display panel and a photosensitive panel which is arranged in a stacking mode with the display panel; the display panel comprises a plurality of display pixels, the photosensitive panel comprises a plurality of photosensitive units, each photosensitive unit comprises at least one photosensitive device, and the photosensitive devices are arranged corresponding to the display pixels; the biometric information sensing method includes the steps of:

s1, when a target object contacts or approaches the display module device and triggers the sensing of the biological characteristic information, controlling the display pixels of the display panel to be lighted in a time-sharing manner, wherein the controlling the display pixels of the display panel to be lighted in a time-sharing manner comprises: controlling display pixels corresponding to a photosensitive device which executes light sensing not to be lightened, and controlling the rest display pixels to be lightened in a time-sharing manner so that light signals sent by the display pixels reach a target object;

2. The method for sensing biometric information of a display module of claim 1, wherein: the controlling the time-sharing lighting of the display pixels in step S1 includes: and controlling the display pixels to light one by one or controlling at least two display pixels at a preset interval to light.

3. The method for sensing biometric information of a display module of claim 1, wherein: the photosensitive units are distributed in a matrix, and each row of photosensitive units is connected with a scanning line; the step S2 includes: the scan driving signal is supplied to the plurality of scan lines line by line or in an interlaced manner to activate the light sensing units.

4. The method for sensing biometric information of a display module of claim 3, wherein: each row of photosensitive units is connected with a data line; the step S3 includes: and reading the electric signals on the data line in a time-sharing manner, and acquiring the preset biological characteristic information of the target object according to the read electric signals.

5. The method for sensing biometric information of a display module of claim 1, wherein: and when the rest of the display pixels are controlled to be turned on in a time-sharing manner, the display pixels adjacent to the unlit display pixels are controlled to be turned on in a time-sharing manner.

6. The method for sensing biometric information of a display module according to any one of claims 1 to 5, wherein: the step S1 further includes: when the target object contacts or approaches the display module, determining a touch area of the target object on the display module so that the display module performs biometric information sensing in the touch area.

7. The method for sensing biometric information of a display module of claim 6, wherein: the step S1 further includes: and controlling the display pixels corresponding to the touch area to be lighted in a time sharing mode.

8. The method for sensing biometric information of a display module of claim 7, wherein: the step S2 further includes: and providing the scanning driving signal to the photosensitive unit corresponding to the touch area.

9. The method for sensing biometric information of a display module of claim 1, wherein: the light-sensitive unit is provided with a light-filtering film, and the light-filtering film is used for filtering light signals outside a preset waveband; the step S1 further includes: when the target object contacts or approaches the display module and triggers the sensing of the biological characteristic information, the display pixels of the display panel are controlled to send out optical signals of preset wave bands.