TWI757955B - Driving display device with under-display image capturing - Google Patents

Abstract

This invention also provides a display device with under-display image capturing, which comprising a reflective type liquid crystal display unit comprising a opposite substrate, a reflective liquid crystal layer, a black matrix layer with at least one through hole, a pixel array substrate comprising at least one pixel, and at least one image capturing module; wherein the image capturing module receives rays corresponding to at least one object and passing through the reflective type liquid crystal layer by the through hole to capture at least one image.

Description

Under-display image capture display device

The present invention relates to an image capture and display device under a display screen, in particular to an image capture and display device under a display screen with a reflective liquid crystal display unit.

Since Complementary Metal-Oxide-Semiconductor (CMOS) elements were found to have photosensitive properties, the photosensitive elements of camera lenses have gradually replaced the higher-priced Charge Coupled Device (CCD) with CMOS elements. Benefiting from the increasing precision of the semiconductor industry, the external dimensions of CMOS components are also rapidly shrinking, so that a miniature CMOS camera lens has come out. Capture the camera market.

When the camera phone was launched, due to the limited opening of the miniature camera lens and the small number of CMOS units installed in the small space, the resolution was not high, and it could only provide VGA images (about 300,000 pixels in 640 X 480). The photosensitivity is not as good as that of CCD, and the cross talk problem caused by dense settings, the camera function is not good. Then, due to the continuous refinement of the semiconductor industry, the number of CMOS units set in a unit area of CMOS components has increased rapidly. Today, micro lenses with tens of millions of pixels are very common, and with the continuous improvement of algorithms to correct crosstalk The problem is that the functions of mobile phone lenses are becoming more and more complete, making camera phones popular.

The traditional camera function mobile phone is equipped with a camera lens on the back of the mobile phone. The camera function is to display an operation screen on the display screen on the front of the mobile phone for users to focus on the person or object to be shot, take photos and even video videos. Consumers gradually After getting used to taking pictures with a mobile phone, there is a need for personal self-photography. However, the camera lens of the traditional camera phone is set on the back of the phone. When the user needs to take a self-photograph, he will not be able to operate the focus by himself and has to ask someone else to do it for him. When there is no one else around, he can only shoot blindly and cannot obtain a satisfactory image.

In view of the fact that the traditional camera phone with a single rear lens can no longer meet the above-mentioned self-photography needs, various mobile phone manufacturers have launched a dual-lens camera phone with a camera lens on the front of the display screen to meet consumers' self-photography needs. need. In addition, more and more social applications and communication programs have begun to incorporate image or animation communication functions, further driving consumers’ growing demand for self-camera phones. Various mobile phone manufacturers have even added features such as multi-lens focusing or laser focusing. Advanced features to stimulate more consumers to buy new mobile phones with constantly updated styles and higher prices.

The above-mentioned dual-lens self-camera phone generally controls the two lenses with the camera operation screen. Consumers can choose to use the main camera lens on the back of the phone to focus and framing through the operation screen to take a photo or a video of the object or object that they want to take. Or switch to the second camera lens set on the front of the screen to focus and framing to take the photos or videos you need. The second camera lens on the front of the screen of the self-camera mobile phone is generally disposed in the non-display area of the display screen to avoid occupying the display area of the display panel. However, consumers' requirements for mobile phones are light, thin, small size and large screen. The original dial pad has long been replaced by touch screens. Now the trend of narrow bezels is popular, and display panel manufacturers are also asked by mobile phone manufacturers to minimize non-display area to increase the screen-to-body ratio.

In addition to reducing the size of various driving components and circuit traces in the non-display area, display panel manufacturers also need to cooperate with mobile phone manufacturers to provide space for the above-mentioned second camera lens. Therefore, various display panel special-shaped cutting technologies have come into being. is generated, it will display the display of the panel The display area has a through hole or even a gap for setting the second camera lens. Although this special-shaped cutting technology can solve the problem of setting the second camera lens, it causes huge difficulties in the design and manufacture of the display panel. Uniformity problem, the processing process has to undergo heavy acid etching and grinding, so the cost will rise, and the environmental pollution problem will also arise. In addition, the backlight module also needs to be correspondingly opened to expose the second camera lens. Although this design can achieve a narrow frame However, it not only has the visual disadvantage of backlight leakage, but also increases the probability of dark spots on the screen caused by the dust entry of the backlight module, which reduces the quality and yield of the product, but the most significant disadvantage is that part of the display area must be sacrificed for Setting up a second camera lens and thus reducing the screen ratio is very unfavorable for market expansion.

In addition, there are other technologies that strive for the coexistence of the above-mentioned second camera lens and the display screen, such as a pop-up periscope second camera lens. However, this design must reserve 2 times the required amount of the second camera lens at the bottom of the screen. In addition, this kind of movable second camera lens has a lifespan problem, and it is prone to failure after a period of use. In addition, after the second camera lens is ejected, the protruding parts are easily damaged by impact, so this type of design is very fast. exit the market.

Based on the above-mentioned problems of the prior art, it can be seen that an image capture and display device with high screen ratio, high yield, high durability, low cost and low pollution is urgently needed in the market to meet the needs of dual-lens self-camera mobile phones. In view of this, the present invention provides an image capture and display device under the display screen, by driving the reflective liquid crystal layer of the display device to a light-transmitting state, and then driving the image capture module to capture at least one image of an object, Under-display image capture display devices with high screen-to-body ratio, high yield, high durability, low cost and low pollution can be realized.

An object of the present invention is to provide a driving method of an image capture display device under a display screen, which first drives a reflective liquid crystal layer to a light-transmitting state, and then drives at least one image capture module to pass through a black matrix At least one perforation of the layer, receiving corresponding at least one object and penetrating the reflective The light reflected and emitted by the liquid crystal layer is used to capture at least one image corresponding to at least one object, without reducing the area of the display area or increasing the area of the non-display area, so as to achieve a high screen ratio.

Another object of the present invention is to provide an image capture and display device under the display screen, which utilizes the characteristic that a reflective liquid crystal display device does not need a backlight module, an image capture module is arranged on the back of the reflective liquid crystal display device, and the image capture module is correspondingly driven. The reflective liquid crystal above the module is in a light-transmitting state, so that the image capture module can receive the light reflected and emitted by the at least one object, so as to realize the function of image capture, thus avoiding the special-shaped cutting of the display panel and The backlight module is opened to achieve high yield, high durability, low cost and low pollution at the same time.

In order to achieve the above-mentioned objects and effects, an embodiment of the present invention provides a driving method of an image capture display device under a display screen, the steps of which include: driving a reflective liquid crystal layer to a light-transmitting state; driving At least one image capturing module receives light corresponding to at least one object and penetrates the reflective liquid crystal layer; and outputs at least one image corresponding to the light.

In one embodiment of the present invention, the step of receiving the light passing through the reflective liquid crystal layer is: receiving the light to generate a plurality of light-sensing signals, and extracting the light-sensing signals to generate the image of the corresponding light.

In one embodiment of the present invention, it discloses an image capture display device under the display screen, which includes: a reflective liquid crystal display unit, including: and a pair of facing substrates; a reflective liquid crystal layer disposed on the pair of and a pixel array substrate disposed below the reflective liquid crystal layer and comprising a plurality of pixels; at least one image capturing module disposed below one of the reflective liquid crystal display units , the image capturing module captures the at least one image of the at least one object in a light-transmitting state of the reflective liquid crystal layer.

In one embodiment of the present invention, the image capture display device under the display screen further includes a black matrix layer disposed between the reflective liquid crystal layer and the pixel array substrate and located on the pixel array substrate facing the pixel array substrate. On one side of the reflective liquid crystal layer, the black matrix layer has at least one through hole.

In an embodiment of the present invention, the black matrix layer is a black resin layer.

In an embodiment of the present invention, the pixel array substrate includes at least one pixel and is provided with the through hole.

In an embodiment of the present invention, the at least one image capturing module is disposed corresponding to the at least one through hole to cover the through hole completely, and the size of the image capturing module is greater than or equal to the size of the through hole.

In one embodiment of the present invention, the reflective liquid crystal layer is a cholesteric liquid crystal layer or a nematic liquid crystal layer doped with an optical rotator.

In one embodiment of the present invention, the at least one image capturing module includes: a light absorbing body; a light receiving element disposed on the light absorbing body; and a reading element disposed on the light absorbing body In the main body, the light receiving element is electrically connected; wherein the light receiving element receives the light reflected and emitted by the photographing object to generate a plurality of light-sensing signals, and the reading element reads the light-sensing signals and outputs the at least one image.

In an embodiment of the present invention, the light receiving element is a complementary metal oxide semiconductor element, a charge coupled element or an infrared light receiving element.

1: Image capture display device under the display screen

10: Reflective liquid crystal display unit

11: Opposite substrate

13: Reflective liquid crystal layer

15: Black matrix layer

151: Through hole

17: Pixel array substrate

171: Pixels

20: Image capture module

21: light absorption body

22: Light receiving element

23: read element

IMG: Visible Light Imaging

L: External light

LI: Sensing light

LIR: infrared light

LR: Reflected light

LT: penetrating light

SL: photosensitive signal

Figure 1: It is a flow chart of an embodiment of the present invention; Figure 2: It is a schematic front view of an embodiment of the present invention; Figure 3: It is another front view of an embodiment of the present invention Schematic diagram; Figure 4: It is another schematic front view of an embodiment of the present invention; Figure 5: It is another schematic front view of an embodiment of the present invention; Figure 6: It is an embodiment of the present invention Another schematic front view; Figure 7: It is another schematic front view of an embodiment of the present invention; and Figure 8: It is a schematic diagram of a display image of an embodiment of the present invention.

In order to make your examiners have a further understanding and understanding of the features of the present invention and the effects achieved, I would like to add examples and explanations, and the explanations are as follows:

Hereinafter, the present invention will be described in detail by illustrating various embodiments of the present invention by means of the drawings. The concepts of the invention may, however, be embodied in many different forms and should not be construed as limited to the exemplary embodiments set forth herein.

Certain terms are used in the description and claims to refer to specific elements. However, those with ordinary knowledge in the technical field of the present invention should understand that manufacturers may use different terms to refer to the same element. The claim does not take the difference in name as a way of distinguishing elements, but takes the difference in the overall technology of the elements as a criterion for distinguishing. The "comprising" mentioned throughout the specification and claims is an open-ended term, so it should be interpreted as "including but not limited to".

In view of the purpose of high screen-to-body ratio and narrow frame of conventional selfie phones, special-shaped cutting technology is used to cut through holes or even gaps in the display area of the display panel for the installation of the above-mentioned second camera lens, which causes huge design and manufacturing challenges for the display panel. Difficulties and various derived problems. If it can be placed under the display panel, the narrow border effect can be achieved without affecting the display quality and yield. Accordingly, the present invention proposes an image capture display device under the display panel, which utilizes The reflective liquid crystal can be driven into a light-transmitting state, driving the pixels corresponding to the opening range of the light absorbing layer of the reflective liquid crystal display device, so that the image capturing module receives the light passing through the outer surface of the reflective liquid crystal display device, At least one image of the at least one object is captured, and when the image capture module is disabled, the pixel of the reflective liquid crystal display unit corresponding to the position of the through hole can be driven according to the needs of the display screen, so as to participate in normal display and obtain a full screen Display effect to solve the problems of high cost, heavy pollution, low yield, and low screen ratio caused by conventional technologies.

First, please refer to the flowchart in Figure 1. As shown in the figure, the driving method of the image capture display device under the display screen of the present invention includes the following steps: Step S1: driving the reflective liquid crystal layer to a light-transmitting state; Step S2: driving the image capture module to receive light corresponding to at least one object and penetrating the reflective liquid crystal layer; and Step S3: outputting an image corresponding to the light .

Next, an under-display image capture and display device according to the driving method of the under-display image capture and display device of the present embodiment will be described. Please refer to the second figure, which is an under-display image capture display according to an embodiment of the present invention. Front view of the device. As shown in the second figure, the image capture and display device 1 under the display screen of the present invention includes a reflective liquid crystal display unit 10 and an image capture module 20 . The reflective liquid crystal display unit 10 includes a counter substrate 11 , a reflective liquid crystal layer 13 , a black matrix layer 15 and a pixel array substrate 17 , the black matrix layer 15 has through holes 151 , and the pixel array substrate 17 has a plurality of pixels 171 ; The group 20 includes a light absorbing body 21 , a light receiving element 22 , and a reading element 23 .

The reflective liquid crystal layer 13 is disposed below the opposite substrate 11 , the pixel array substrate 17 is disposed below the reflective liquid crystal layer 13 , on the surface of the pixel array substrate 17 adjacent to the black matrix layer 15 and the reflective liquid crystal layer 13 , and is also provided with a plurality of pixels 171 arranged in an array. The black matrix layer 15 is arranged between the reflective liquid crystal layer 13 and the pixel array substrate 17 and is located on the side of the pixel array substrate 17 facing the reflective liquid crystal layer 13. The through hole 151 exposes part of the pixels 171 and part of the image capture module 20 ; the image capture module 20 is disposed below the reflective liquid crystal display unit 10 , and the size of the image capture module 20 is greater than or equal to the through hole 151 , Corresponding to the position of the through hole 151 , it is disposed under the black matrix layer 15 to fully cover the through hole 151 .

In this embodiment, the under-display image capture display device 1 is, for example, a selfie phone with a reflective liquid crystal screen; The transition between the transmissive state and the light-reflecting state, that is, the reflective liquid crystal layer 13 can have vertically aligned liquid crystal 131 or horizontally aligned liquid crystal 132 or a combination thereof; the black matrix layer 15 is, for example, a black resin layer, which can shield the reflective liquid crystal display unit from The light L below 10 absorbs the transmitted light LT of the reflective liquid crystal layer 13 without any light reflection, so that the reflective liquid crystal display unit 10 displays a black image in a dark state; the light absorption of the image capturing module 20 The main body 21 is, for example, a black casing, which can also shield the light L from below the reflective liquid crystal display unit 10 and absorb the transmitted light LT from the reflective liquid crystal layer 12 . The component 22 and the reading element 23 are arranged in the light absorbing body 21, and the light absorbing body 21 is wrapped around and below the light receiving element 22 and the reading element 23, and the light absorbing body 21 is only wrapped around the light receiving element 22 The frame part of the upper surface is used to fix the light-receiving element 22, so that the light-receiving element 22 is equivalent to protruding on the light-absorbing body 21. The image capturing module 20 absorbs light through the light-absorbing body 21, and the light-receiving element 22 For example, a complementary metal-oxide-semiconductor photosensitive element can generate a photocurrent when irradiated by light corresponding to at least one object and penetrate the reflective liquid crystal layer 13 to emit a photosensitive signal, and the reading element 23 is, for example, a reading circuit, It is electrically connected to the light receiving element 22 to capture the photosensitive signal SL generated by the light receiving element 22 (as shown in the seventh figure); and the at least one object corresponding to the light received by the image capturing module 20 is, for example, a The operator's face.

In this embodiment, as shown in the third figure, when the reflective liquid crystal display unit 10 is disabled to display a white image, the black matrix layer 15 and the reflective liquid crystal layer 13 corresponding to the through holes 151 are not driven and are The vertically aligned liquid crystal 131 is in a reflective state, and all the incident light rays L are reflected by the vertically aligned liquid crystal 131 to become reflected light LR and leave the reflective liquid crystal display unit 10 .

As shown in FIG. 4 , the reflective liquid crystal layer 13 not only has vertically aligned liquid crystals 131 or horizontally aligned liquid crystals 132 or a combination thereof, but may also be inclinedly aligned liquid crystals 133 . When the reflective liquid crystal display unit 10 is enabled, a grayscale image can be displayed. Or when a color picture is used, the reflective liquid crystal layer 13 corresponding to the black matrix layer 15 and the through hole 151 is driven to form an obliquely aligned liquid crystal 133, which partially penetrates and partially reflects, so that a part of the incident light L is partially reflected by the reflective liquid crystal layer. 13 is reflected as reflected light LR and leaves the reflective liquid crystal display unit 10 , and the rest of the incident light L penetrates the reflective liquid crystal layer 13 to become transmitted light LT, and is absorbed by the black matrix layer 15 and the image capture module 20 , thereby providing a good contrasting picture.

As shown in FIG. 5, after the reflective liquid crystal layer 13 is driven, it only has horizontally aligned liquid crystals 132. Therefore, when the reflective liquid crystal display unit 10 is enabled to display a black screen, the black matrix layer 15 and the through holes 151 correspond to The reflective liquid crystal layer 13 is driven to the horizontally aligned liquid crystal 132 in the light-transmitting state. The image capture module 20 absorbs, thereby providing a picture with good contrast.

Therefore, when the image capture module 20 is disabled, all the pixels 171 of the reflective liquid crystal display unit 10 are used for pure display, and the above-mentioned reflective liquid crystal display unit 10 displays grayscale images. In the case of a flat or color screen and a black screen, the corresponding pixels 171 within the range of the through holes 151 drive the reflective liquid crystal layer 13 to a partially penetrating, partially reflective or state light-transmitting state according to the needs of the display screen, because the image capturing module 20 The light absorbing body 21 is made of black material that can absorb visible light and infrared light. Therefore, the image capturing module 20 can absorb the transmitted light LT within the range of the through hole 151, so that the corresponding pixels 171 within the range of the through hole 151 are also Good contrast can be provided without affecting the overall picture of the reflective liquid crystal display unit 10 , and a full-screen display effect can be obtained. And because the image capture module 20 is still in the disabled state, even if the light receiving element 22 receives the transmitted light LT, no photosensitive signal is generated, so the operation of the image capture display device 1 under the display screen is not affected.

Next, the operation of each step of the driving method of the image capture display device under the display screen of the present embodiment will be described. Please refer to the sixth to seventh figures together:

As shown in step S1, a reflective liquid crystal layer is driven to a light-transmitting state, please refer to FIG. 6, where the reflective liquid crystal display unit 10 displays a white screen as an example, the driving through hole 151 can be selected within the range of the For the corresponding pixel 171 , the reflective liquid crystal layer 13 corresponding to the through hole 151 is driven to a light-transmitting state, and the reflective liquid crystal layer 13 corresponding to the black matrix layer 15 is not driven and is in a reflective state.

Next, as shown in step S2, an image capture module is driven to receive light passing through the reflective liquid crystal layer; please refer to FIG. 7, an operator faces the reflective liquid crystal display unit 10 of his mobile phone to himself The face is self-photographed, because at this time, the pixel 171 corresponding to the through hole 151 will drive the reflective liquid crystal layer 13 corresponding to the through hole 151 to the light-transmitting state. When the image capturing module 20 When enabled, the light receiving element 22 receives the sensing light LI passing through the reflective liquid crystal layer 13 through the through hole 151 to generate a plurality of light sensing signals SL, wherein the sensing light LI includes the external light reflected by the operator's face L and the self-emitted infrared light LIR from the operator's face, because the sensing light LI is diffused light and does not have a single direction, so part of the sensing light LI that is not transmitted to the light receiving element 22 is absorbed by the light absorbing body 21 to Avoid noise caused by multiple reflections.

Finally, as shown in step S3, at least one image corresponding to the light is output; then, as shown in the eighth figure, the reading element 23 captures the light-sensing signals SL in accordance with the full high image quality (FHD, Full High Definition) format editing to form at least one visible light image IMG corresponding to the sensing light LI received by the light receiving element 22, and output the at least one visible light image IMG to the reflective liquid crystal display unit 10, so that the reflective liquid crystal The display unit 10 displays the at least one visible light image IMG.

In this embodiment, in order to match the light reflection of the reflective liquid crystal without setting the backlight module, a through hole is provided in the black matrix layer and an image capture module is arranged under the reflective liquid crystal display unit at the position of the through hole. When the image capture module is disabled, the pixels corresponding to the through holes of the reflective liquid crystal display unit can be driven according to the needs of the display screen to participate in normal display, or the pixels corresponding to the through holes can be driven to be light through holes according to the needs of the display screen. When the black screen is displayed in the transparent state, the image capture module can also enable image capture. In the above two cases, the number of effective pixels in the display area will not be reduced, so the full-screen display effect can be obtained without the need to widen the non-display area. The area is used to accommodate the image capture module, and there is no need to cut the display panel in a special shape to expose the image capture module.

Moreover, the image capturing module of the present invention is well protected under the reflective liquid crystal display unit, rather than protruding from the outside of the image capturing and display device under the display screen, and is not easily damaged by external impact. The present invention can achieve the objectives of low manufacturing cost, low pollution, high yield, high durability, and high screen ratio at the same time, and the reflective liquid crystal display unit adopts externally incident visible light as the light source, which does not require a backlight module Therefore, the cost can be further reduced, and it has the advantage of low cost.

The various element structures and driving steps disclosed in the above embodiments are only for illustrating the implementation of the present invention, and are not intended to limit the implementation scope of the present invention. For example, the present embodiment is taken as an example when the reflective liquid crystal display unit 10 displays a white image. However, the reflective liquid crystal display unit 10 can also be driven to display a grayscale image, a color image, and a black image, which does not affect the present invention. The reflective liquid crystal layer 13 corresponding to the through hole 151 and the driving of the image capturing module 20; and the reflective liquid crystal layer 13 is a nematic liquid crystal doped with a light rotator, which not only has a lower cost than cholesteric liquid crystal, but also can be used for driving. By adjusting the content of the optical active agent, the optoelectronic characteristics suitable for different products can be adjusted; in addition, the light-receiving element 23 can also be a charge-coupled element, or an infrared light-receiving element to receive the infrared light emitted by the photographed object, all of which also have good performance. Light receiving characteristics, the rest of the same will not be repeated.

To sum up, the present invention provides an image capture and display device under the display screen, which utilizes the characteristic that the reflective liquid crystal display unit does not need to be provided with a backlight module, and is correspondingly disposed under the through hole of the black matrix layer of the reflective liquid crystal display unit The image capture module can solve the problems of high cost, heavy pollution, low yield, and low screen ratio of the conventional technology, and achieve low manufacturing cost, low pollution, high yield, high durability, and high screen ratio. The image capture display device under the display screen.

Therefore, the present invention is indeed novel, progressive and available for industrial use, and it should meet the requirements for patent application in my country's patent law.

However, the above is only an embodiment of the present invention, and is not intended to limit the scope of the present invention. Therefore, all the equivalent changes and modifications made in accordance with the shape, structure, feature and spirit described in the scope of the patent application of the present invention, All should be included in the scope of the patent application of the present invention.

S1~S3: Step flow

Claims (7)

An image capture display device under a display screen, comprising: a reflective liquid crystal display unit, including: and a pair of facing substrates; a reflective liquid crystal layer disposed under one of the facing substrates; and a pixel array a substrate, which is arranged under the reflective liquid crystal layer, and includes a plurality of pixels; at least one image capturing module is arranged under one of the reflective liquid crystal display units, and the image capturing module is in the reflection The reflective liquid crystal layer captures at least one image of at least one object in a light-transmitting state; wherein, it further includes a black matrix layer, which is disposed between the reflective liquid crystal layer and the pixel array substrate and located in the pixel array On one side of the substrate facing the reflective liquid crystal layer, the black matrix layer has at least one through hole. The image capture display device under the display screen of claim 1, wherein the black matrix layer is a black resin layer. The image capture display device under the display screen as claimed in claim 1, wherein the pixel array substrate comprises at least one pixel and the through hole is provided. The image capture and display device under the display screen as claimed in claim 1, wherein the at least one image capture module is disposed corresponding to the at least one through hole so as to fully cover the through hole, and the size of the image capture module is greater than or equal to The size of the through hole. The image capture and display device under the display screen as claimed in claim 1, wherein the reflective liquid crystal layer is a cholesteric liquid crystal layer or a nematic liquid crystal layer doped with an optical rotator. The image capture and display device under the display screen according to claim 1, wherein the at least one image capture module comprises: a light-absorbing body; a light-receiving element disposed on the light-absorbing body; and a reading element disposed in the light-absorbing body and electrically connected to the light-receiving element; wherein the light-receiving element receives the corresponding At least one object penetrates the light of the reflective liquid crystal layer to generate a plurality of photosensitive signals, and the reading element reads the photosensitive signals and outputs the at least one image. The image capture and display device under the display screen according to claim 6, wherein the light receiving element is a complementary metal oxide semiconductor element, a charge coupled element or an infrared light receiving element.

Images