WO2021051753A1 - Electronic device with under-screen infrared biosensor - Google Patents

Abstract

Provided is an electronic device (100) with an under-screen infrared biosensor. The electronic device includes a backlight module (10), a display panel (20), a light-transmitting protection plate (30), an optical sensor (40) and an infrared light source (50), wherein the backlight module (10) provides visible light (VL) to travel upwards, and has a reflective layer (11) to block the visible light (VL) from traveling downwards; the display panel (20) is arranged above the backlight module (10) and displays information according to the visible light (VL); the light-transmitting protection plate (30) is arranged above the display panel (20) and allows the information to pass through same; the optical sensor (40) is arranged under the backlight module (10); the infrared light source (50) provides infrared light (IR1) to a living body (F) located on or above the light-transmitting protection plate (30); the living body (F) reflects the infrared light (IR1) to produce reflected infrared light (IR2); and the reflected infrared light (IR2) is received by the optical sensor (40) through the light-transmitting protection plate (30), the display panel (20) and the backlight module (10), such that the optical sensor (40) obtains an image signal representing an image of the living body (F), and thereby realizing an under-screen image sensing function.

Description

Electronic equipment with under-screen infrared biosensor

cross reference

This application was filed on September 16, 2019 in accordance with the requirements of 35 USC §119, with the title of "IR LED LIGHTING INTEGRATED WITH LGP IN LCD FOD SOLUTION" in the U.S. Provisional Application 62/900,812; submitted on November 26, 2019, The priority of the US provisional application 62/940,445 with the title of the invention "LGP FINGERPRINT APPLICATION RULER", and the above application is taken as a reference.

Technical field

The present invention relates to an electronic device with an under-screen infrared biosensor, and in particular to an electronic device that can be applied to liquid crystal displays (Liquid Crystal Display, LCD) and OLEDs with under-screen infrared biosensors The electronic equipment of the display panel, and the backlight module applied to the display panel.

Background technique

Today's mobile electronic devices (such as mobile phones, tablet computers, laptops, etc.) are usually equipped with user biometric systems, including different technologies such as fingerprints, face shapes, irises, etc., to protect personal data security, such as mobile phones Or smart watches and other portable devices, which also have the function of mobile payment. For users, biometric identification has become a standard function. The development of portable devices such as mobile phones is even more towards full screen (or ultra-narrow). The trend of frame) has made traditional capacitive fingerprint buttons (such as the buttons of iphone 5 to iphone 8) no longer available, and then evolved new miniaturized optical imaging devices (very similar to traditional camera modules, with complementary metal Oxide semiconductor (Complementary Metal-Oxide Semiconductor (CMOS) Image Sensor (referred to as CIS), sensing components and optical lens modules). The miniaturized optical imaging device is placed at the bottom of the screen (can be called under the screen), through the screen part of the light (especially organic light emitting diode (Organic Light Emitting Diode, OLED) screen), can capture the object pressed on the top of the screen Images, especially fingerprint images, can be referred to as fingerprint on display (FOD).

Existing optical biosensors (such as fingerprint sensors) include at least one optical module. The optical module contains a CMOS image sensor (CIS) chip or module, and a lens array module (Lens array module), these components or modules are mainly placed under the OLED display. Because the OLED display itself transmits light, there is no problem in implementation.

However, in addition to OLED screens (or screens), many products also use LCD screens, and OLED screens are also evolving. For example, the development of low-penetration screens (transmittance from 3% to 1%) requires new screens. Under the optical fingerprint scheme. The solution to this case is how to design an infrared optical sensing module underneath a liquid crystal display (Liquid Crystal Display, LCD), or a low-penetration OLED, or a different screen in the future. This needs to face many challenges. For example, an LCD has components such as a backlight module, a brightness enhancement film, and a light guide plate. RGB visible light enters from the side, and then diffuses out from the light guide plate and the brightness enhancement film to homogenize or obscure the light. There are many zigzag structures on the light guide plate and the brightness enhancement film, which scatter light in various directions. If the CIS module is placed under the brightness enhancement film and light guide plate of the backlight module, there is an anti-reflection coating (ARC) inside the backlight module to allow visible light to be totally reflected, so the visible light reflected from the finger Can not penetrate and reach the CIS module, causing image sensing problems.

Another problem to be solved in this case is that, for example, the resolution of OLED displays is getting higher and higher, and the visible light FOD is limited by the lower and lower visible light transmittance of the display (the resolution is getting higher and higher), which makes the sensor’s visible light signal The Signal-to-Noise Ratio (SNR) is getting lower and lower, so the FOD solution of IR can also solve this problem. Of course, other display technologies, such as Micro Light Emitting Diode (uLED) displays, etc., also apply this solution.

Summary of the invention

Therefore, an object of the embodiments of the present invention is to provide an electronic device with an under-screen infrared biosensor and a backlight module applied to a display panel. The electronic device has functions of information display and biosensing.

To achieve the above objective, an embodiment of the present invention provides an electronic device, which at least includes a backlight module, a display panel, a light-transmitting protection plate, an optical sensor, and an infrared light source. The backlight module provides visible light traveling upward, and has a reflective layer to block visible light traveling downward. The display panel is arranged above the backlight module and displays information according to visible light. The light-transmitting protection board is arranged above the display panel and allows information to pass through. The optical sensor is arranged under the backlight module. The infrared light source provides infrared light to life objects located on or above the light-transmitting protective plate. The biological body reflects infrared light and generates reflected infrared light. The reflected infrared light is received by the optical sensor through the light-transmitting protective plate, the display panel and the backlight module, so that the optical sensor obtains an image representing the biological body An image signal to realize the under-screen image sensing function.

In addition, the present invention also provides an electronic device, which at least includes: a display panel that provides visible light traveling upward and displays information according to the visible light; a light-transmitting protective plate arranged above the display panel to allow information to pass through; and an optical The sensor is arranged under the display panel; and an infrared light source, which provides infrared light to the living objects on or above the light-transmitting protective plate. The biological body reflects the infrared light to generate reflected infrared light, and the reflected infrared light passes through the transparent protective plate. The light protection plate and the display panel are received by the optical sensor, so that the optical sensor obtains an image signal representing an image of the biological body.

The present invention further provides a backlight module applied to a display panel, which at least includes a light guide plate and a visible light source. The light guide plate cooperates with an infrared light source to generate an infrared light. The visible light source is arranged on one side of the light guide plate and emits light into the light guide plate to travel to generate a visible light. In this way, the required light for information display and biological sensing can be provided.

Through the above embodiments, the use of infrared light can allow the optical sensing module disposed under the LCD to obtain a good biometric image without affecting the display function of the LCD, and the reflective layer of the LCD has different characteristics for infrared light and visible light. , The reflective layer that makes visible light impenetrable can allow infrared light to penetrate, and the reflected infrared light from the finger can easily penetrate the reflective layer to reach the optical sensor disposed under the reflective layer, achieving biometric sensing Function to provide an optical biosensing solution for electronic devices equipped with LCD displays. In addition to being suitable for LCD displays, it is also suitable for optical biosensing applications such as OLED displays and other displays.

In order to make the above-mentioned content of the present invention more obvious and understandable, the following is a detailed description of preferred embodiments in conjunction with the accompanying drawings.

Description of the drawings

In order to explain the technical solutions in the embodiments of the present invention more clearly, the following will briefly introduce the drawings needed in the description of the embodiments. Obviously, the drawings in the following description are only some embodiments of the present invention. For those of ordinary skill in the art, other drawings can be obtained from these drawings without creative work. In the attached picture:

FIG. 1 shows a schematic diagram of an electronic device with an under-screen infrared biosensor according to a preferred embodiment of the present invention.

FIG. 1A shows a schematic diagram of a modification of the electronic device of FIG. 1.

Fig. 2 shows a partial schematic diagram of the electronic device of Fig. 1.

FIG. 2A shows a schematic diagram of a modification of the electronic device of FIG. 2.

FIG. 3 shows a schematic diagram of an example of the combined structure of the backlight module, the display panel, and the light-transmitting protective plate of FIG. 1.

Fig. 4 shows a partial schematic diagram of an actual configuration example of Fig. 1.

Fig. 5 and Fig. 6 show partial schematic diagrams of two modified configuration examples of Fig. 4.

Figures 7 to 9 show schematic diagrams of three configurations of the infrared light source relative to the light-transmitting protective plate.

Fig. 10 to Fig. 12 show schematic diagrams of three variation examples of Fig. 1.

FIG. 13 shows a three-dimensional schematic diagram of the backlight module corresponding to FIG. 10.

FIG. 14 shows a front view of the backlight module corresponding to FIG. 13.

15 and 16 show front views of two modification examples of the backlight module corresponding to FIG. 14.

FIG. 17 shows a three-dimensional schematic diagram of a variation of the backlight module corresponding to FIG. 10.

FIG. 18 shows a partial schematic diagram of the backlight module corresponding to FIG. 10.

FIG. 19 shows a partial schematic diagram of the light guide plate corresponding to FIG. 18.

FIG. 20 shows a partial schematic diagram of another example of the light guide plate corresponding to FIG. 19.

Figure 21 shows a schematic diagram of the dimensions of the various components of the light guide plate.

Figures 22A to 22F show fingerprint images obtained by using six different sizes of light guide plates.

FIG. 23 shows a schematic diagram of an electronic device with an under-screen infrared biosensor according to another embodiment of the invention.

Fig. 24 shows a modified example of the electronic device of Fig. 23.

FIG. 25 shows a front view of a modification example of the optical sensor and infrared light source of FIG. 23. FIG.

FIG. 26 shows a top view of the optical sensor of FIG. 25. FIG.

F: organism

FR: Peak

FT: free end

FV: Tanibe

H: height

IR0: Initial infrared light

IR1: infrared light

IR2: reflected infrared light

P: Pitch

R: radius

VL: Visible light

10: Backlight module

11: reflective layer

12: Light guide plate

12A: Base

12B: Arc convex

12C: V-shaped cut

12D: bottom surface

12E: Top surface

13: Visible light source

14: Visible light emitting diode

15: Diffusion brightening layer

16: Diffusion layer

17: Brightening film

18: Drive

20: Display panel

21: Rear polarizer

22: Rear alignment layer

23: Liquid crystal layer

24: Front electrode

25: Color filter layer

26: Front polarizer

30: Light-transmitting protection board

31: Anti-reflection layer

32: Optical transparent glue

40: Optical sensor

41: Lens module

42: Sensing unit

50: infrared light source

51: Light-emitting unit

52: Lens with specific curvature

53: Optical film

55: Circuit board

56: Light guide plate

90: Battery

100: electronic equipment

detailed description

The creator of this case discovered that infrared (IR) can penetrate the above-mentioned ARC. In this way, the IR is put on the finger, and the finger reflects the IR downward through the cover glass, the display panel and the backlight module and is received by the CIS module. , To achieve fingerprint sensing. However, if you want to hit the IR up to the finger from the bottom of the backlight module, the IR goes upward through the backlight module, and the IR goes downward through the backlight module. In this way, the outgoing IR is blurred, and the reflected IR is also blurred, making the image of the sensed fingerprint blurred. If you want to transmit IR from the front to your finger, there will be many interference problems that need to be solved.

This case proposes four design architectures to achieve IR emission to the finger. The first is related to lateral lighting. IR is emitted from one side of the protective glass (cover glass), where an ARC can be set under the protective glass to keep the IR intensity of the incident protective glass at a high intensity. In this lighting method, Total Internal Reflection (TIR) can be used. The second is about changing the design of the backlight module, putting some IR LEDs in the visible light (red, green and blue GB) LED array on the side of the backlight module. The third is about the use of a linear array of RGB LEDs and another linear array of IR LEDs arranged in parallel. The fourth is to modify the design of the light guide module. In this way, IR lighting can be set in all possible positions, including side lighting and down lighting.

FIG. 1 shows a schematic diagram of an electronic device 100 with an under-screen infrared biosensor according to a preferred embodiment of the present invention. FIG. 2 shows a partial schematic diagram of the electronic device 100 of FIG. 1. The electronic device 100 is, for example, a mobile phone, a tablet computer, a wearable device, an electronic device with a biometric sensing function, and the like. As shown in FIGS. 1 and 2, the electronic device 100 at least includes a backlight module 10, a display panel 20, a light-transmitting protection plate 30, an optical sensor 40 and an infrared light source 50. The electronic device 100 has a function of displaying information to interact with the user, and may also have a touch function to allow the user to input instructions or data. For example, when the user uses the optical sensor 40 to sense biometrics, he can perform actions such as login and biometric comparison. If the biometric comparison passes, the central processing unit (not shown) of the electronic device 100 can be unlocked. , In order to allow users to perform advanced operations, or conduct transactions, etc.

The backlight module 10 provides visible light VL to travel upward, and the backlight module 10 has a reflective layer 11 to block the visible light VL from traveling downward (a direction away from the display panel 20). The display panel 20 is disposed above the backlight module 10 for displaying information according to visible light VL. The application on mobile devices such as mobile phones may be a display cell or a display unit with touch function. The light-transmitting protective plate 30 is arranged above the display panel 20 to allow information to pass through. The application on mobile devices such as mobile phones may be Cover Glass (CG). The optical sensor 40 is disposed under the backlight module 10. In one example, the optical sensor 40 is a lens-type optical sensor, which utilizes one lens or a combination of multiple lenses to achieve the image sensing function, and the optical sensor 40 in another example is an ultra-thin optical sensor. It has a micro lens collimator design.

The infrared light source 50 provides infrared light IR1 to a living object F located on or above the light-transmitting protective plate 30. In this embodiment, the infrared light source 50 is disposed above the reflective layer 11. For example, the biological body F of a finger reflects infrared light IR1 to generate reflected infrared light IR2, and the reflected infrared light IR2 is received by the optical sensor 40 through the light-transmitting protection plate 30, the display panel 20, and the backlight module 10, so that The optical sensor 40 obtains an image signal representing an image of the biological body F. Images include fingerprint images, blood vessel images, blood oxygen concentration images, and other biological organ information on the skin surface or under the skin. The above configuration structure can achieve the effect of the present invention, and achieve the function of under-screen infrared biosensing. It is worth noting that the above-mentioned "reflection" may be the reflection of infrared light by the surface of the biological body F, or the phenomenon that infrared light enters the biological body F and is emitted from the biological body F.

In this embodiment, the infrared light source 50 is arranged under the light-transmitting protective plate 30 and arranged on one side of the display panel 20. That is, the area of the light-transmitting protection plate 30 is larger than the area of the display panel 20, and the infrared light source 50 is disposed in the redundant space formed by the light-transmitting protection plate 30 and the display panel 20. The optical sensor 40 is arranged under the backlight module 10 and beside the battery 90 of the electronic device 100. In another embodiment, the optical sensor 40 (for example, with an ultra-thin microlens collimator design) may be disposed between the battery 90 and the backlight module 10, as shown in FIG. 1A.

As shown in FIG. 2, the infrared light IR1 passes through an anti-reflection layer 31 of the light-transmitting protection plate 30, and the anti-reflection layer 31 prevents the infrared light IR1 from being reflected by the light-transmitting protection plate 30 and cannot reach the biological body F. As shown in FIG. 2A, the infrared light source 50 is located under the backlight module 10, and provides a downward lighting method, which is also applicable to the above-mentioned embodiment.

FIG. 3 shows a schematic diagram of an example of the combined structure of the backlight module 10, the display panel 20 and the light-transmitting protective plate 30 of FIG. 1. As shown in FIG. 3, the backlight module 10 and the display panel 20 constitute a liquid crystal display (LCD). In a non-limiting example, the backlight module 10 at least includes a reflective layer 11, a light guide plate (LGP) 12, a visible light source 13, and a diffusing brightness enhancement layer 15. The diffusion brightness enhancement layer 15 includes a diffusion layer (Diffuser, DIFF) 16 and a brightness enhancement film (Brightness Enhanced Film, BEF) 17. The reflective layer 11 is, for example, an enhanced specular reflector (ESR) produced by 3M Company. The display panel 20 includes a rear polarizer 21, a rear alignment layer 22, a liquid crystal layer 23, a front electrode 24, a color filter layer 25, and a front polarizer 26 stacked sequentially from bottom to top. However, the present invention is not limited to this. In addition, the display panel 20 is adhered to the light-transmitting protective plate 30 through an optical clear adhesive (OCA) 32. It is worth noting that FIG. 3 only shows one example, and does not specifically limit the present invention to this. For visible light, the diffusion layer 16 and the brightness enhancement film 17 will blur the image, the light guide plate 12 will reduce the image quality, and the reflective layer 11 will reflect the visible light upward. However, the creator of this case discovered that for infrared light, infrared light can penetrate the reflective layer 11 without being greatly affected by the diffusion layer 16, the brightness enhancement film 17, and the light guide plate 12. Therefore, the configuration of the embodiment of the present invention is suitable for the application of LCD, but is not particularly limited thereto. Any display provided with a reflective layer that reflects visible light belongs to the application of the embodiment of the present invention.

Fig. 4 shows a partial schematic diagram of an actual configuration example of Fig. 1. As shown in FIG. 4, a driver 18 of the electronic device 100 controls the operation of the backlight module 10 and the display panel 20, so that the electronic device 100 can display information to the user. As shown in FIG. 4, the infrared light IR1 penetrates the light-transmitting protective plate 30 and irradiates a peak FR of the biological body F directly in contact with the light-transmitting protective plate 30 to generate reflected infrared light IR2, and the reflected infrared light IR2 is coupled Into the light-transmitting protective plate 30, a part of the image corresponding to the peak FR is in a bright state. On the other hand, a valley FV of the living body F cannot reflect the infrared light IR1 penetrating through the light-transmitting protective plate 30, so that a part of the image corresponding to the valley FV appears dark. In an example, a distance between the infrared light source 50 and the biological body F is between 10 mm and 30 mm or between 15 mm and 20 mm, or the distance between the sensing area of the biological body F and the infrared light source 50 is between 10 mm and 30 mm. Between 30mm or between 15mm and 20mm. In the example shown in FIG. 4, a fairly uniform light field can be obtained, which enhances the image sensing result.

Fig. 5 and Fig. 6 show partial schematic diagrams of two modified configuration examples of Fig. 4. As shown in Figure 5, the infrared light IR1 penetrates the light-transmitting protective plate 30 and irradiates a free end FT of the biological body F. The free end FT is coupled into the biological body F to generate reflected infrared light IR2, or infrared The light IR1 is scattered in the biological body F to generate reflected infrared light IR2. In this case, the peak FR of the biological body F directly contacting the light-transmitting protection plate 30 couples the reflected infrared light IR2 into the light-transmitting protection plate 30, so that a part of the image corresponding to the peak FR appears bright, and the valley The part FV cannot couple the reflected infrared light IR2 into the biological body F. In this example, the illuminating light received by the organism F is relatively consistent. Compared with the method of FIG. 6 described later, the change is relatively small, and there is relatively no problem that the residue on the light-transmitting protective plate 30 affects the image sensing. The distance between the infrared light source 50 and the biological body F is between 15 mm and 20 mm, or the distance between the sensing area of the biological body F and the infrared light source 50 is between 15 mm and 20 mm. As shown in FIG. 6, the infrared light IR1 is totally reflected in the light-transmitting protective plate 30, and the peak FR of the biological body F that directly contacts the light-transmitting protective plate 30 couples the infrared light IR1 into the biological body F to make the peak FR A part of the corresponding image presents a dark state, and the valley FV cannot couple the infrared light IR1 into the biological body F, so that the corresponding part sensed by the optical sensor 40 presents a bright state. The advantage of using total reflection is that the distance between the infrared light source 50 and the biological body F can be relatively long, and the light field will be relatively uniform, because the attenuation degree of infrared light is not high if the total reflection efficiency is to reach a certain level.

Figures 7 to 9 show schematic diagrams of three configurations of the infrared light source relative to the light-transmitting protective plate. These three configurations can each be applied to the structures of FIGS. 4 to 6. As shown in FIG. 7, the light field can be changed by rotating the configuration angle of the light-emitting unit of the infrared light source 50, so that the circuit board 55 on which the light-emitting unit is installed presents a tilted non-horizontal state, which can provide a better light field for living beings. In general, the frame of the current mobile device is about 1 mm to allow the rotation of the infrared light source 50, but the frame can also be enlarged to provide a suitable space for rotation. As shown in FIG. 8, the infrared light source 50 includes: a light-emitting unit 51 that emits infrared light IR1; and a lens 52 with a specific curvature covering the light-emitting unit 51 to change the light divergence angle and light field of the infrared light IR1. The light-emitting unit 51 includes a light-emitting diode (LED) or a laser diode (LD), and the laser diode includes a vertical-cavity surface-emitting laser (Vertical-Cavity Surface-Emitting Laser). In one example, the wavelength of the light emitted by the LD is 940 nanometers (nm). In FIG. 8, the packaging of LEDs or LDs can be changed, and special zone rate lenses or structures can be used to change the light divergence angle and light field. With current technology, 0402 LED packaging can be used.

As shown in FIG. 9, the infrared light source 50 includes: a light-emitting unit 51 that emits infrared light IR1; and an optical film 53 disposed on the light-emitting unit 51, and the optical film 53 is attached to the light-transmitting protective plate 30 and covers the light-emitting unit 51. To change the light divergence angle and light field of the infrared light IR1, the light-emitting unit 51 includes a light-emitting diode or a laser diode, and the optical film 53 includes a grating, a Fresnel lens or element, or a diffractive element. When designing, by selecting the diffraction item or level of the grating, the light output angle can be controlled. The diffractive element is, for example, a diffractive optical element (DOE). In the optical film, it is better to use nearly parallel light output, so it can be matched with LED or LD, and use collimator or collimating structure on the package to make a simple collimation effect, and then use these elements to make the light angle and light Field changes and control can make design easier. Alternatively, the optical film may integrate the functions of at least two of collimation, grating, Fresnel lens, and diffractive element to generate the required light field.

Therefore, in FIG. 9, the optical film can be attached to the side or bottom surface of the light-transmitting protective plate 30, and then the LED or LD can be attached to the optical film to change the light divergence angle and light field. The mechanism is easy to assemble and also There is no need to expand the frame, just add a little thickness, and the increased thickness does not affect the entire LCD, so the cost can be reduced, for example, the optical film can be manufactured by nano-imprinting. In addition, because the LED and the optical film are in a bonded state, the design needs to consider near-field optics. With the above settings, the light field can be changed to meet the function of biometric sensing.

Fig. 10 to Fig. 12 show schematic diagrams of three variation examples of Fig. 1. FIG. 13 shows a three-dimensional schematic diagram of the backlight module corresponding to FIG. 10. FIG. 14 shows a front view of the backlight module corresponding to FIG. 13. As shown in FIGS. 10, 13 and 14, the infrared light source 50 and the visible light source 13 of the backlight module 10 are arranged on the same side of the backlight module 10. In detail, the multiple light emitting units 51 of the infrared light source 50 and the multiple visible light emitting diodes 14 of the visible light source 13 of the backlight module 10 are arranged on the same side of the light guide plate 12 of the backlight module 10. From another perspective, the light emitting units 51 and the visible light emitting diodes 14 are alternately arranged on the same side of the light guide plate 12 and arranged in a straight line. It is worth noting that although FIG. 14 uses two infrared light emitting diodes as an example for illustration, in another example, four infrared light emitting diodes are interspersed between the visible light emitting diodes 14 to obtain The light field of image sensing.

15 and 16 show front views of two modification examples of the backlight module corresponding to FIG. 14. As shown in FIGS. 11 and 15, the light-emitting units 51 and the visible light-emitting diodes 14 are arranged on the same side of the light guide plate 12 and arranged in two straight lines. As shown in Figures 11 and 16, these light emitting units 51 and these visible light emitting diodes 14 are arranged on the same side of the light guide plate 12 and arranged in two straight lines, and the distribution area of these light emitting units 51 is smaller than that of these visible light emitting diodes. 14 distribution area.

As shown in FIG. 12, the multiple light emitting units 51 of the infrared light source 50 and the multiple visible light emitting diodes 14 of the visible light source 13 of the backlight module 10 are arranged on the opposite side of the light guide plate 12 of the backlight module 10.

FIG. 17 shows a three-dimensional schematic diagram of a variation of the backlight module corresponding to FIG. 10. As shown in FIG. 17, the multiple light emitting units 51 of the infrared light source 50 and the multiple visible light emitting diodes 14 of the visible light source 13 of the backlight module 10 are arranged on the adjacent side of the light guide plate 12 of the backlight module 10.

FIG. 18 shows a partial schematic diagram of the backlight module corresponding to FIG. 10. FIG. 19 shows a partial schematic diagram of the light guide plate corresponding to FIG. 18. As shown in FIGS. 18 and 19, the backlight module 10 is applied to the display panel 20 or used in conjunction with the display panel 20, thereby providing light required for information display and biological sensing. The light guide plate 12 of the backlight module 10 cooperates with the infrared light source 50 to generate infrared light IR1 (the light source 50 is not a necessary component here, because it can also be arranged on the side as shown in Figure 4 to Figure 6, that is, the infrared light is reflected from the fingerprint and penetrates. After the backlight module is detected by the optical sensor 40), the visible light source 13 is arranged on one side of the light guide plate 12, and emits light into the light guide plate 12 to travel to generate visible light VL. The light guide plate 12 at least includes a base 12A, a plurality of arc-shaped protrusions (Dot) 12B, and a plurality of V-cuts (V-cut) 12C. The arc-shaped convex portion 12B is disposed on a bottom surface 12D of the substrate 12A, and is used to destroy the total reflection of light in the substrate 12A to generate visible light VL. The V-shaped cut portion 12C is disposed on a top surface 12E of the substrate 12A, and is used to destroy the total reflection of light in the substrate 12A to generate visible light VL. That is, without the arc-shaped protrusion 12B and the V-shaped cut portion 12C, the light from the visible light source 13 can only be totally reflected in the substrate 12A, and the arc-shaped protrusion 12B and/or the V-shaped cut portion 12C can be used to The light is guided out to generate visible light VL. The arc-shaped convex portion 12B and the V-shaped cut portion 12C will also affect the travel of infrared light. Therefore, without affecting the visible light VL, it is necessary to design a better arc-shaped convex portion 12B and the V-shaped cut portion 12C to obtain acceptable Fingerprint image.

FIG. 20 shows a partial schematic diagram of another example of the light guide plate corresponding to FIG. 19. As shown in FIG. 20, it is not necessary to provide the V-shaped cut portion 12C.

Figure 21 shows a schematic diagram of the dimensions of the various components of the light guide plate. As shown in FIG. 21, the arc-shaped convex portion 12B has a radius R and a height H. The pitch of the distribution of these arc-shaped convex portions 12B is equal to the pitch P. Figures 22A to 22F show fingerprint images obtained by using six different sizes of light guide plates. In this disclosure, six different design parameters (as listed in Table 1) are used to obtain six fingerprint images (Figure 22A to Figure 22F), and the modulation transfer function (Modulation Transfer Function) value MTF (representing blurred image) Degree) is also listed in Table 1.

Table 1

example	R(μm)	H(μm)	P(μm)	P/H	MTF(%)
1	31.64	0.52	60.08	115.5	70.30
2	31.31	1.39	59.8	43.02	43.7
3	37.87	2.6	119.96	46.13	68.5
4	40.34	2	80.33	40.16	53.8
5	79.85	1.17	35.58	30.4	6.7
6	100.75	0.5	19.92	39.94	56.1

In the above six examples, the effect of the light guide plate 12 on the display function of all examples is not much different, so by comparing the MTF values of the fingerprint images, you can obtain which parameters are better. From Table 1 and Figures 22A to 22F, it can be seen that the MTF value is correlated with P/H. From the first and second examples, the radius R is the same, but the larger the P/H value, the higher the MTF value. . Judging from the second case, the fourth case and the sixth case, the P/H is similar, but the larger the R value, the higher the MTF value. Although the P/H value of the sixth case is slightly lower than the second and fourth cases, However, the contribution of the R value can make the MTF value of the sixth case higher. However, there is no absolute linear relationship. When P/H is lower than a certain value, the MTF value will drop sharply, as can be seen from the fifth example. From Figure 22C corresponding to the third example, although the MTF value is higher, it will cause moiré patterns on the image. According to other experimental results, P is preferably not more than 100 microns, and more preferably not. More than 80 microns.

Therefore, based on the above and other experimental results, the integrated design specifications for fingerprint applications are as follows. The pitch P of the distribution of these arc-shaped protrusions 12B is less than or equal to 150, 100, or 80 microns to avoid moiré fringes. The radius of each arc-shaped protrusion 12B is between 10 and 300 microns (between 10 and 150 microns, or between 30 and 120 microns, more preferably between 20 and 110 microns), and The ratio of the distance P to the height H of each arc-shaped convex portion 12B is between 30 and 300 (between 20 and 150, between 30 and 120, or more preferably between 35 and 45). The design example is that P/H is equal to 40. When P/H increases, improved fingerprint image quality can be obtained. Therefore, the above design specifications can suppress moiré and increase the MTF value without affecting the display function. Of course, the content of the disclosure is not only applicable to side lighting and light guide plate lighting, but also applicable to down lighting.

Through the above embodiments, the use of infrared light can allow the optical sensing module disposed under the LCD to obtain a good biometric image without affecting the display function of the LCD, and the reflective layer of the LCD has different characteristics for infrared light and visible light. , The reflective layer that makes visible light impenetrable can allow infrared light to penetrate, and the reflected infrared light from the finger can easily penetrate the reflective layer to reach the optical sensor disposed under the reflective layer, achieving biometric sensing Function to provide an optical biosensing solution for electronic devices equipped with LCD displays.

The above-mentioned design method is not only suitable for LCD displays, but can also be appropriately changed to suit other displays, such as OLED displays or displays that may be developed in the future, such as uLEDs. FIG. 23 shows a schematic diagram of an electronic device with an under-screen infrared biosensor according to another embodiment of the invention. As shown in FIG. 23, this embodiment provides an electronic device 100 that at least includes a display panel 20, a light-transmitting protective plate 30, an optical sensor 40 and an infrared light source 50. The display panel 20 provides visible light VL traveling upward, and displays information according to the visible light VL. The display panel 20 includes, but is not limited to, an Organic Light Emitting Diode (OLED) display panel. The light-transmitting protection plate 30 is arranged above the display panel 20 to allow information to pass through. The optical sensor 40 is disposed under the display panel 20. The infrared light source 50 provides infrared light IR1 to a living object F located on or above the light-transmitting protective plate 30. The infrared light IR1 is, for example, Near Infrared (NIR) light, and the wavelength is about 0.75 to 1.4 microns. The biological body F reflects infrared light IR1 and generates reflected infrared light IR2. The reflected infrared light IR2 is received by the optical sensor 40 through the transparent protective plate 30 and the display panel 20, so that the optical sensor 40 obtains an image signal representing an image of the biological body F. In this example, the infrared light source 50 is located on one side of the display panel 20. With the above configuration, the function of under-screen infrared biosensing can also be achieved.

Fig. 24 shows a modified example of the electronic device of Fig. 23. As shown in FIG. 24, the difference from FIG. 23 is that the infrared light source 50 is located under the display panel 20. The infrared light source 50 has one or more light-emitting units 51, such as light-emitting diodes. The light-emitting units 51 can be arranged beside or around the optical sensor 40, and provide infrared light IR1 to penetrate the display panel 20 and the light-transmitting protective plate 30 to reach The biological body F can also achieve the function of under-screen infrared biological sensing.

FIG. 25 shows a front view of a modification example of the optical sensor and infrared light source of FIG. 23. FIG. FIG. 26 shows a top view of the optical sensor of FIG. 25. FIG. As shown in FIGS. 25 and 26, the infrared light source 50 includes one or more light-emitting units 51 and a light guide plate 56. The light-emitting unit 51 provides initial infrared light IR0. The light guide plate 56 is located around the optical sensor 40 and guides the initial infrared light IR0 to generate infrared light IR1. In this example, the optical sensor 40 includes a sensing unit 42 and a lens module 41. The optical sensor can also be an ultra-thin optical sensor with a microlens collimator design. The reflected infrared light IR2 passes through the lens module 41 and is focused on the sensing unit 42 to obtain a sensed image. The lens module 41 may be a single lens, or may be a stack of multiple lenses, or may be composed of multiple lenses arranged in a two-dimensional array. The light guide plate 56 may have a ring structure (for example, a circular ring or a polygonal ring structure), and is disposed around the lens module 41. In this way, the light guide plate 56 can be used to process the light of the light emitting unit 51 into a uniform and upward direction. Infrared light IR1, can provide uniform infrared light to improve sensing quality. The light emitting unit 51 may be arranged on the side or the lower side of the light guide plate 56.

Therefore, the embodiments of the present invention can provide an optical biosensing solution for an electronic device equipped with an LCD or OLED display, including an electronic device with an under-screen infrared biosensor and a backlight module applied to a display panel.

The specific embodiments proposed in the detailed description of the preferred embodiments are only used to facilitate the description of the technical content of the present invention, instead of restricting the present invention to the above-mentioned embodiments in a narrow sense, and do not exceed the spirit of the present invention and the protection of the claims. The scope of the situation, various changes and implementations made, all belong to the scope of the present invention.

Claims (39)

1. An electronic device (100) with an under-screen infrared biosensor, characterized in that it includes at least:

   A backlight module (10) that provides visible light (VL) traveling upward, and the backlight module (10) has a reflective layer (11) that blocks the visible light (VL) traveling downward;

   A display panel (20) arranged above the backlight module (10) for displaying information according to the visible light (VL);

   A light-transmitting protection board (30) is arranged above the display panel (20) to allow the information to pass through;

   An optical sensor (40) arranged under the backlight module (10); and

   An infrared light source (50) provides infrared light (IR1) to a living object (F) located on or above the light-transmitting protective plate (30), and the biological body (F) reflects the infrared light (IR1) to produce a reflection Infrared light (IR2), the reflected infrared light (IR2) passes through the transparent protective plate (30), the display panel (20) and the backlight module (10) and is received by the optical sensor (40) , Enabling the optical sensor (40) to obtain an image signal representing an image of the biological body (F).
2. The electronic device (100) according to claim 1, wherein the infrared light source (50) is arranged under the light-transmitting protective plate (30) and arranged on one side of the display panel (20).
3. The electronic device (100) according to claim 2, wherein the infrared light (IR1) passes through an anti-reflection layer (31) of the light-transmitting protective plate (30), and the anti-reflection layer (31) prevents The infrared light (IR1) is reflected and cannot reach the living body (F).
4. The electronic device (100) according to claim 2, wherein the infrared light (IR1) is totally reflected in the transparent protective plate (30).
5. The electronic device (100) according to claim 2, wherein the infrared light (IR1) penetrates the transparent protective plate (30) and irradiates a free end (FT) of the biological body (F) , The free end (FT) is coupled into the organism (F) to generate the reflected infrared light (IR2).
6. The electronic device (100) according to claim 5, wherein a peak (FR) of the biological body (F) directly in contact with the light-transmitting protective plate (30) couples the reflected infrared light (IR2) Into the light-transmitting protective plate (30), a part of the image corresponding to the peak (FR) is rendered bright.
7. The electronic device (100) according to claim 5, wherein a distance between the infrared light source (50) and the biological body (F) is between 10 mm and 30 mm.
8. The electronic device (100) according to claim 2, wherein the infrared light (IR1) penetrates the transparent protective plate (30) and irradiates the biological body that directly contacts the transparent protective plate (30) The reflected infrared light (IR2) is generated on a peak (FR) of (F).
9. The electronic device (100) according to claim 8, wherein the reflected infrared light (IR2) is coupled into the transparent protective plate (30), so that the peak (FR) corresponds to a part of the image Presents a bright state.
10. The electronic device (100) according to claim 9, wherein a distance between the infrared light source (50) and the biological body (F) is between 10 mm and 30 mm.
11. The electronic device (100) according to claim 2, wherein the infrared light source (50) at least comprises: a light-emitting unit (51) that emits the infrared light (IR1); and a lens (52) with a specific curvature, Cover the light-emitting unit (51) to change the light divergence angle and light field of the infrared light (IR1), the light-emitting unit (51) includes a light-emitting diode or a laser diode, and the laser diode includes a vertical resonant cavity surface-emitting laser .
12. The electronic device (100) according to claim 2, wherein the infrared light source (50) at least comprises: a light-emitting unit (51) that emits the infrared light (IR1); and an optical film (53) that is arranged On the light-emitting unit (51), the optical film (53) is attached to the light-transmitting protective plate (30) and covers the light-emitting unit (51) to change the light divergence angle of the infrared light (IR1) and the light Field, the light-emitting unit (51) includes a light-emitting diode or a laser diode, and the laser diode includes a vertical cavity surface-emitting laser.
13. The electronic device (100) according to claim 12, wherein the optical film (53) comprises a grating, a Fresnel lens or element, or a diffraction element.
14. The electronic device (100) according to claim 1, wherein the infrared light source (50) and a visible light source (13) of the backlight module (10) are arranged on the same side of the backlight module (10) .
15. The electronic device (100) according to claim 1, wherein a plurality of light-emitting units (51) of the infrared light source (50) and a plurality of visible lights of a visible light source (13) of the backlight module (10) The light emitting diodes (14) are arranged on the same side of a light guide plate (12) of the backlight module (10).
16. The electronic device (100) according to claim 15, wherein the plurality of light-emitting units (51) and the plurality of visible light-emitting diodes (14) are alternately arranged on the same side of the light guide plate (12). Side, and arranged in a straight line.
17. The electronic device (100) according to claim 15, wherein the plurality of light emitting units (51) and the plurality of visible light emitting diodes (14) are arranged on the same side of the light guide plate (12) , And arranged in two straight lines.
18. The electronic device (100) according to claim 15, wherein the plurality of light emitting units (51) and the plurality of visible light emitting diodes (14) are arranged on the same side of the light guide plate (12) , And arranged in two straight lines, and the distribution area of the plurality of light emitting units (51) is smaller than the distribution area of the plurality of visible light emitting diodes (14).
19. The electronic device (100) according to claim 1, wherein a plurality of light-emitting units (51) of the infrared light source (50) and a plurality of visible lights of a visible light source (13) of the backlight module (10) The light emitting diode (14) is arranged on the adjacent side of a light guide plate (12) of the backlight module (10).
20. The electronic device (100) according to claim 1, wherein a plurality of light-emitting units (51) of the infrared light source (50) and a plurality of visible lights of a visible light source (13) of the backlight module (10) The light emitting diode (14) is arranged on the opposite side of a light guide plate (12) of the backlight module (10).
21. The electronic device (100) according to claim 1, wherein a peak (FR) of the biological body (F) that directly contacts the light-transmitting protective plate (30) couples the infrared light (IR1) into the In the living body (F), a part of the image corresponding to the peak (FR) is rendered dark.
22. The electronic device (100) according to claim 1, wherein the backlight module (10) further comprises:

    A light guide plate (12) that cooperates with the infrared light source (50) to generate the infrared light (IR1); and

    A visible light source (13) is arranged on one side of the light guide plate (12), and emits light into the light guide plate (12) to travel to generate the visible light (VL).
23. The electronic device (100) according to claim 22, wherein the light guide plate (12) at least further comprises:

    A base (12A); and

    A plurality of V-shaped cut portions (12C) are arranged on a top surface (12E) of the substrate (12A), and are used to destroy the total reflection of the light in the substrate (12A) to generate the visible light (VL).
24. The electronic device (100) according to claim 22, wherein the light guide plate (12) at least comprises:

    A base (12A); and

    A plurality of arc-shaped protrusions (12B) are arranged on a bottom surface (12D) of the substrate (12A), and are used to destroy the total reflection of the light in the substrate (12A) to generate the visible light (VL).
25. The electronic device (100) according to claim 24, wherein the light guide plate (12) at least further comprises:

    A plurality of V-shaped cut portions (12C) are arranged on a top surface (12E) of the substrate (12A), and are used to destroy the total reflection of the light in the substrate (12A) to generate the visible light (VL).
26. The electronic device (100) according to claim 24, wherein the pitch (P) of the distribution of the plurality of arc-shaped protrusions (12B) is less than or equal to 150 microns.
27. The electronic device (100) according to claim 24, wherein the radius of each arc-shaped protrusion (12B) is between 10 and 150 microns.
28. The electronic device (100) according to claim 24, wherein the ratio of the pitch (P) of each arc-shaped protrusion (12B) to the height (H) of each arc-shaped protrusion (12B) is 20 To 150.
29. The electronic device (100) according to claim 24, wherein the pitch (P) of the distribution of the plurality of arc-shaped protrusions (12B) is less than or equal to 150 microns, and each arc-shaped protrusion (12B) has a The radius is between 10 and 150 microns, and the ratio of the pitch (P) to the height (H) of each arc-shaped protrusion (12B) is between 20 and 150.
30. The electronic device (100) according to claim 24, wherein the pitch (P) of the distribution of the plurality of arc-shaped protrusions (12B) is less than or equal to 80 microns.
31. The electronic device (100) according to claim 24, wherein the radius of each arc-shaped protrusion (12B) is between 20 and 110 microns.
32. The electronic device (100) according to claim 24, wherein the ratio of the pitch (P) of the distribution of each arc-shaped protrusion (12B) to the height (H) of each arc-shaped protrusion (12B) is between Between 30 and 120.
33. The electronic device (100) according to claim 24, wherein the pitch (P) of the distribution of the plurality of arc-shaped protrusions (12B) is less than or equal to 80 microns, and the arc-shaped protrusions (12B) are The radius is between 20 and 110 microns, and the ratio of the pitch (P) to the height (H) of each arc-shaped protrusion (12B) is between 30 and 120.
34. An electronic device (100) with an under-screen infrared biosensor, characterized in that it includes at least:

    A display panel (20) that provides visible light (VL) to travel upward, and displays information according to the visible light (VL);

    A light-transmitting protection board (30) is arranged above the display panel (20) to allow the information to pass through;

    An optical sensor (40) arranged under the display panel (20); and

    An infrared light source (50) provides infrared light (IR1) to a living object (F) located on or above the light-transmitting protective plate (30), and the biological body (F) reflects the infrared light (IR1) to produce a reflective Infrared light (IR2), the reflected infrared light (IR2) is received by the optical sensor (40) through the transparent protective plate (30) and the display panel (20), so that the optical sensor ( 40) Obtain an image signal representing an image of the biological body (F).
35. The electronic device (100) according to claim 34, wherein the infrared light source (50) is located on one side of the display panel (20).
36. The electronic device (100) according to claim 34, wherein the infrared light source (50) is located below the display panel (20).
37. The electronic device (100) according to claim 36, wherein the infrared light source (50) comprises one or more light-emitting units (51), located beside the optical sensor (40), and provides the infrared light (IR1).
38. The electronic device (100) according to claim 36, wherein the infrared light source (50) comprises:

    One or more light-emitting units (51) to provide initial infrared light (IR0); and

    A light guide plate (56), located around the optical sensor (40), guides the initial infrared light (IR0) to generate the infrared light (IR1).
39. The electronic device (100) according to claim 34, wherein the display panel (20) is an organic light emitting diode display panel.

Images