WO2020186375A1

WO2020186375A1 - Display device, terminal and photographing method

Info

Publication number: WO2020186375A1
Application number: PCT/CN2019/078229
Authority: WO
Inventors: 谭桂财; 金志河
Original assignee: 深圳柔宇显示技术有限公司
Priority date: 2019-03-15
Filing date: 2019-03-15
Publication date: 2020-09-24
Also published as: CN113170031A

Abstract

Disclosed is a display device, comprising: a display panel having at least two light-transmitting parts, the light-transmitting parts comprising a light-transmitting region and a non-light-transmitting region; and a photographing unit, wherein the photographing unit captures images by means of the light-transmitting regions of the at least two light-transmitting parts and performs complementary synthesis. By means of the above method, when a camera is arranged under a display panel screen, light can be transmitted without opening holes, thereby effectively improving the screen utilization rate.

Description

Display device, terminal and shooting method

Technical field

The embodiments of the present application relate to the technical field of display devices, and in particular to a display device, a terminal, and a shooting method.

Background technique

With the development of technology, people have higher and higher requirements for the performance of mobile phones, and the requirements for the screen ratio of mobile phones are also getting higher and higher. In order to meet the needs of the market and meet the space requirements of the front camera, there are now many special-shaped full screens with holes on the front panel to place the camera, such as notch screens, water drop screens, and so on.

In the process of implementing the embodiments of the present application, the inventor found that the current full-screen mobile phone cannot display the aperture area where the front camera is placed, and the screen usage rate is not high.

Summary of the invention

The embodiments of the present application provide a display device, a terminal, and a shooting method, which can effectively improve screen utilization.

The embodiments of this application provide the following technical solutions to solve their technical problems:

A display device includes:

A display panel having at least two light-transmitting parts, the light-transmitting part including a light-transmitting area and a non-light-transmitting area;

A camera unit, which takes images through the light-transmitting areas of the at least two light-transmitting parts and performs complementary synthesis.

The embodiments of this application also provide the following technical solutions to solve their technical problems:

A terminal includes a casing and the above-mentioned display device, the display device being embedded in the casing.

A photographing method applied to the above-mentioned display device, the method including:

Receive camera instructions;

According to the imaging instruction, the light transmitted through the light-transmitting areas of the at least two light-transmitting parts is received by the imaging unit to generate the corresponding original image;

The original image is subjected to complementary synthesis processing to obtain a photographed image.

Compared with the prior art, the display device provided by the embodiment of the present application provides at least two light-transmitting parts on the display panel. The light-transmitting part includes a light-transmitting area and a non-light-transmitting area. The camera unit passes through at least two light-transmitting parts. The light-transmitting area of the camera captures images and performs complementary synthesis, so that when a camera is set under the display panel, light can be transmitted without opening holes, thereby effectively improving screen utilization.

Description of the drawings

In order to explain the technical solutions of the embodiments of the present application more clearly, the following will briefly introduce the drawings that need to be used in the embodiments of the present application. Obviously, the drawings described below are only some embodiments of the present application. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative work.

FIG. 1 is a schematic structural diagram of one of the display devices provided by an embodiment of the application;

FIG. 2 is a schematic structural diagram of the display device in FIG. 1 from another angle;

3 is a schematic diagram of the structure of a thin film transistor layer of the display device in FIG. 1;

FIG. 4 is a schematic diagram of captured images in an embodiment of the application;

5a to 5e are schematic diagrams of the arrangement of the light-transmitting area and the non-light-transmitting area in the light-transmitting part of the display panel in the embodiment of the application;

6a to 6b are schematic diagrams of image information synthesis processing in an embodiment of this application;

FIG. 7 is a schematic structural diagram of a terminal provided by an embodiment of the application;

FIG. 8 is a schematic flowchart of a shooting method according to an embodiment of the application.

detailed description

In order to facilitate the understanding of the application, the application will be described in more detail below in conjunction with the drawings and specific embodiments. It should be noted that when an element is expressed as being "fixed to" another element, it can be directly on the other element, or there can be one or more elements in between. When an element is said to be "connected" to another element, it can be directly connected to the other element, or there may be one or more intervening elements in between. The terms "vertical", "horizontal", "left", "right", "inner", "outer" and similar expressions used in this specification are only for explanatory purposes and only express substantial positional relationships. For example, for "vertical", if a certain positional relationship is not strictly vertical because it achieves a certain purpose, but is essentially vertical, or uses vertical characteristics, it belongs to the "vertical" category described in this specification.

Unless otherwise defined, all technical and scientific terms used in this specification have the same meaning as commonly understood by those skilled in the technical field of this application. The terminology used in the description of this application is only for the purpose of describing specific embodiments, and is not used to limit the application. The term "and/or" as used in this specification includes any and all combinations of one or more related listed items.

It can be understood that, for one or more interlayer substances involved in the embodiments of the present application as shown herein, the positional relationship between the layers uses terms such as "laminated" or "formed" or "applied" or "arranged". In the expression, those skilled in the art can understand that: any term such as "laminated" or "formed" or "applied" can cover all the ways, types and techniques of "laminated". For example, sputtering, electroplating, molding, chemical vapor deposition (Chemical Vapor Deposition, CVD), physical vapor deposition (Physical Vapor Deposition, PVD), evaporation, hybrid physical-chemical vapor deposition (Hybrid Physical-Chemical Vapor Deposition, HPCVD) , Plasma Enhanced Chemical Vapor Deposition (PECVD), Low Pressure Chemical Vapor Deposition (LPCVD), etc.

In addition, the technical features involved in the different embodiments of the application described below can be combined with each other as long as they do not conflict with each other.

Please refer to FIG. 1, a display device 100 provided by an embodiment of the present application includes: a display panel 10 and a camera unit 20, and the camera unit 20 is provided on the backlight side of the display panel 10.

The display panel 10 has at least two light-transmitting parts 11, and each light-transmitting part 11 includes a light-transmitting area 1101 and a non-light-transmitting area 1102. The imaging unit 20 captures images through the light-transmitting areas 1101 of at least two light-transmitting parts 11 and performs complementary synthesis. Through the above method, when the camera is installed under the display panel screen, light can be transmitted without opening holes, thereby effectively improving screen utilization.

The display panel 10 is used to display images. The display panel 10 may be an LCD display panel, or an organic light emitting diode (organic light emitting diode, OLED) display panel, etc., where the OLED display panel has self-luminescence, low driving voltage, high luminous efficiency, short response time, and sharpness. The advantages of high contrast ratio, nearly 180° viewing angle and wide operating temperature range can achieve many advantages such as flexible display and large-area full-color display.

Specifically, referring to FIG. 2 together, the display panel 10 is composed of a stacked pixel layer 101 and a thin film transistor device layer 102, and the imaging unit 20 is provided on a side of the thin film transistor device layer 102 away from the pixel layer 101.

Wherein, the pixel layer 101 is made of a transparent material. The pixel layer 101 may include a cathode 1011, an organic light emitting layer 1012, an anode 1013, and a substrate 1014 that are sequentially stacked and arranged. The organic light emitting layer 1012 includes an organic light emitting material. In some embodiments, the organic light-emitting material may include a material that emits red, green, or blue light, and a fluorescent material or a phosphorescent material. In some embodiments, the organic light emitting layer 1012 may include two or more light emitting materials. The organic light-emitting layer is used for light emission, and electroluminescence is controlled by the thin film transistor device layer 102 for display. Among them, the light-emitting color can be white light or a color composed of any color ratio. The organic light emitting layer 1012 also includes an electron transport layer and a hole transport layer (not shown). The substrate 1014 is a flexible transparent substrate, such as a flexible material including a thin glass or plastic substrate. For example, the plastic substrate has a flexible structure including coating on both sides of a base film, and the base film includes materials such as polyimide (PI ), polycarbonate (PC), polyethylene glycol terephthalate (PET), polyethersulfone (PES), polyethylene film (PEN), fiber reinforced plastic (FRP) and other resins. It can be understood that, in some other embodiments, in order to reduce the thickness of the display panel 10, the substrate 1014 may be omitted.

Among them, the thin film transistor device layer 102 includes a number of thin film transistors (Thin Film Transistor, TFT), for example, it may include low temperature poly-Si Thin Film Transistor (LTP-Si TFT), amorphous silicon TFT, polysilicon TFT, Oxide semiconductor TFT, or organic TFT, etc. The thin film transistor device layer 102 is used to drive the pixel units on the pixel layer 101. Specifically, the thin film transistor device layer 102 is used to implement display control and control the electroluminescence of the organic light emitting layer 1012. The thin film transistor device layer 102 is provided on the side of the substrate 1014 away from the anode 1013, or the thin film transistor device layer 102 is provided in the substrate 1014, which can be selected according to actual usage.

It can be understood that, in some other embodiments, the display panel 10 may also be provided with structures such as a polarizing layer and a protective layer as required.

1 to 3 together, the display panel 10 includes a plurality of first pixel units 110 and second pixel units 120 arranged in an array. The first pixel units 110 constitute the light transmitting portion 11, and the second pixel units 120 constitute The display part 12 of the display panel.

Wherein, each light-transmitting portion 11 and display portion 12 is composed of a pixel layer 101 and a thin-film transistor device layer 102, but the structure of the thin-film transistor device layer 102 corresponding to the light-transmitting portion 11 is the same as that of the thin-film transistor device layer 102 of the display portion 12. The structure is different.

The light transmitting part 11 is used to transmit light so that the light can enter the imaging unit 20; when the imaging unit 200 is in a non-working state, the light transmitting part 11 is also used to display images. Specifically, each first pixel unit 110 in the light-transmitting portion 11 includes a sub-light-transmitting area 11011 and a line area 11021. Wherein, the sub-transmissive area 11011 and the circuit area 11021 refer to the area in the thin film transistor device layer 102 corresponding to a first pixel unit 110. The sub-transparent area 11011 is made of light-transmitting material, and the sub-transparent area 11011 is not Thin film transistor devices or metal wires are provided so that the sub-transmissive area 11011 can transmit light; the wiring area 11021 is provided with thin film transistor devices and/or metal wires for displaying the first pixel unit 110, so as to display images, and, The circuit area 11021 cannot transmit light. A plurality of array-distributed sub light-transmitting regions 11011 constitute the light-transmitting region 1101 of the light-transmitting portion 11, and a plurality of array-distributed line regions 11021 constitute the non-light-transmitting region 1102 of the light-transmitting portion 11.

Wherein, in the first pixel unit 110, the proportion of the sub-transmissive area 11011 may be greater than or equal to the proportion of the line area 11021. When the proportion of the sub-transparent area 11011 is greater than the proportion of the line area 11021, the captured image can be made finer.

Among them, the sub-transmissive area 11011 or the circuit area 11021 may have a regular shape or an irregular shape, such as a rectangular shape.

Wherein, the first pixel units 110 may be arrayed separately in the same order, so that the light-transmitting area 1101 and the non-light-transmitting area 1102 are adjacent, so that the light-transmitting area 1101 and the non-light-transmitting area 1102 are alternately arranged.

It is understandable that, as long as the display panel 10 has a light-transmitting area 1101, organic light-emitting diode (OLED) technology or micro light-emitting diode (MICRO LED) can be selected according to actual needs. ) Technology, or active-matrix organic light emitting diode (AMOLED), etc., to configure the display panel 10.

Please refer to FIG. 1 and FIG. 2 again, the camera unit 20 is used to receive light incident from the light-transmitting area 1101 for imaging. The number of camera units 20 can be one or more. When there are multiple camera units 20, the number of camera units 20 can be the same as the number of light-transmitting parts 11, and each camera unit 20 is provided corresponding to the light-transmitting part 11. For example: the display device 100 includes two camera units 20 and two light-transmitting parts 11, and each camera unit 20 corresponds to a light-transmitting part 11, so that the light transmitted by each light-transmitting part 11 can enter the light-receiving unit 20 Components; when the imaging unit 20 is one, the imaging unit 20 may include a plurality of photosensitive elements, the number of photosensitive elements may be the same as the number of the light-transmitting portion 11, and each photosensitive element is arranged corresponding to the light-transmitting portion 11, for example: a display device 100 includes a camera unit 20 and two light-transmitting parts 11, the camera unit 20 includes two photosensitive elements, each photosensitive element corresponds to a light-transmitting part 11, so that the light transmitted by each light-transmitting part 11 can enter the imaging unit 20 Of the photosensitive elements.

Wherein, the central axis of each photosensitive element may be on the same horizontal plane or not on the same horizontal plane.

It should be noted that, in this embodiment, the photosensitive element of the imaging unit 20 refers to a device used to receive light in the imaging unit 20, for example, a lens, and when the lens receives light, the light enters the image sensor of the imaging unit 20. Imaging is performed, and the central axis of the photosensitive element is the central optical axis of the lens.

In this embodiment, the photosensitive elements of the imaging unit 20 are arranged at different positions on the backlight side of the display panel 10, and each photosensitive element corresponds to the light-transmitting portion 11, so that the photosensitive element partially or fully covers the light-transmitting portion 11. In addition, the imaging unit 20 complements and synthesizes complete image information through partial image information transmitted by at least two light-transmitting regions 1101. For example, as shown in FIG. 4, assuming that the object to be photographed includes four parts a, b, c, and d, the display panel 10 includes two light-transmitting parts 11, and the imaging unit 20 takes only partial image information captured by one of the light-transmitting parts 11 Contains parts a and c. The part of the image information captured by the camera unit 20 through the other light-transmitting part 11 only contains parts b and d. The combination of the two parts of image information can be complementarily combined into four parts a, b, c, and d, thus Get complete image information.

Of course, there are many ways to arrange the light-transmitting area 1101 and the non-light-transmitting area 1102 in the light-transmitting portion 11. In some other embodiments, as long as there are at least two light-transmitting areas 1101 after the partial image information is combined Complementary synthesis is sufficient. For example, as shown in FIG. 4, assuming that the object to be photographed includes four parts a, b, c, and d, the display panel 10 includes two light-transmitting parts 11, and the imaging unit 20 takes only partial image information captured by one of the light-transmitting parts 11 Containing parts a and c, the part of the image information captured by the camera unit 20 through the other light-transmitting part 11 only contains part b, and the two parts of image information are combined to complementarily synthesize a, b, and c to obtain a part of the complete image.

In this embodiment, the display device 100 is provided with at least two light-transmitting parts 11 on the display panel 10. The light-transmitting part 11 includes a light-transmitting area 1101 and a non-light-transmitting area 1102, and the imaging unit 20 passes through at least two light-transmitting parts 11. The light-transmitting area 1101 captures images and performs complementary synthesis, so that when a camera is set under the display panel, light can be transmitted without opening holes, thereby effectively improving screen utilization.

In some embodiments, as shown in FIGS. 5 a to 5 e, the light transmitting portion 11 includes a first light transmitting portion 111 and a second light transmitting portion 112, and the imaging unit 20 includes a first photosensitive element 21 and a second photosensitive element 22.

Among them, the first light-transmitting portion 111 and the second light-transmitting portion 112 may be arranged adjacently, or may be arranged with the display portion 12 spaced apart (in FIGS. 5a to 5e, the interval between the first light-transmitting portion and the second light-transmitting portion is shown Set as an example for description). The arrangement of the light-transmitting regions 1101 and the non-light-transmitting regions 1102 in the first light-transmitting portion 111 and the second light-transmitting portion 112 may be the same or different.

Among them, the first photosensitive element 21 corresponds to the first light transmitting portion 111, and the second photosensitive element 22 corresponds to the second light transmitting portion 112, so that the first photosensitive element 21 can receive the light transmitted in the first light transmitting portion 111 The light transmitted by the area 1101, the second photosensitive element 22 can receive the light transmitted by the light-transmitting area 1101 in the second light-transmitting portion 112, so that the imaging unit 20 is transmitted through the light-transmitting areas of the two light-transmitting portions Part of the image information is complementary to synthesize complete image information.

Specifically, as shown in FIGS. 5a and 5b, the central axis of the first photosensitive element 21 and the central axis of the second photosensitive element 22 are on the same horizontal plane, so that the first photosensitive element 21 and the second photosensitive element 22 are on the same horizontal line. Sensitization is performed on. The first light-transmitting portion 111 and the second light-transmitting portion 112 may be composed of the sub-transmitting regions 11011 and the circuit regions 11021 in different arrangements. In the first light-transmitting portion 111, the non-light-transmitting areas 1102 and the light-transmitting areas 1101 alternate in order; in the second light-transmitting portion 112, the light-transmitting areas 1101 and the non-light-transmitting areas 1102 alternate in order.

Wherein, in this embodiment, the vertical downward direction is set as the preset reference direction X, then in the light-in area of the first photosensitive element 21, the non-transmissive area 1102 and the light-transmitting area 1101 follow the preset reference direction X alternates in sequence. In the light-in area of the second photosensitive element 22, the light-transmitting area 1101 and the non-light-transmitting area 1102 alternate in sequence according to the preset reference direction X. Among them, the light entering area of the photosensitive element is the entire area where light can enter the mirror surface of the photosensitive element.

Wherein, in the actual manufacturing process of the display device 100 as shown in FIG. 5a and FIG. 5b, the first light-transmitting portion 111 and the second light-transmitting portion 112 can be pre-arranged by the sub-transmitting area 11011 and the circuit area. 11021, and make the shape of the first light-transmitting part 111 and the second light-transmitting part 112 the same, the cross section of the first photosensitive element 21 and the second photosensitive element 22 are the same, and the center of the first photosensitive element 21 is the same as the first The center of the light-transmitting portion 111 is opposite, and the center of the second photosensitive element 22 is opposite to the center of the second light-transmitting portion 112.

The area of the transparent region 1101 may be greater than or equal to the area of the non-transparent region 1102. For example, in FIG. 5a, the area of the light-transmitting area 1101 is equal to the area of the non-transmitting area 1102; for another example, in FIG. 5b, the area of the light-transmitting area 1101 is larger than the area of the non-transmitting area 1102.

Optionally, in some other embodiments, as shown in FIG. 5c, the central axis of the first photosensitive element 21 and the central axis of the second photosensitive element 22 are not on the same horizontal plane, so that the first photosensitive element 21 and the second photosensitive element 22 The element 22 does not receive light on the same horizontal line. The first light-transmitting portion 111 and the second light-transmitting portion 112 may be composed of the sub-transmitting regions 11011 and the circuit regions 11021 in the same arrangement. In the first light-transmitting portion 111 and the second light-transmitting portion 112, the non-light-transmitting regions 1102 and the light-transmitting regions 1101 alternate in sequence. Of course, in some other embodiments, the light-transmitting area 1101 and the non-light-transmitting area 1102 alternate in order, which can be set according to actual needs.

Wherein, in the present embodiment, the vertical downward direction is set as the preset reference direction X, then in the light-in areas of the first photosensitive element 21 and the second photosensitive element 22, the non-transmissive area 1102 and the transmissive area 1101 alternate in sequence according to the preset reference direction X. Wherein, each adjacent light-transmitting area 1101 and non-light-transmitting area 1102 is a pair of combined areas, and the plane between the horizontal plane of the first photosensitive element 21 and the horizontal plane of the second photosensitive element 22 The distance is the length of a non-transparent zone 1102. For example, as shown in Fig. 5c, the plane distance between the horizontal plane of the central axis of the first photosensitive element 21 and the horizontal plane of the central axis of the second photosensitive element 22 is the length M of a non-transmissive area 1102.

Wherein, in the actual manufacturing process of the display device 100 as shown in FIG. 5c, the first light-transmitting portion 111 and the second light-transmitting portion 112 may be pre-arranged to be composed of a circuit area 11021 and a sub-transmitting area 11011 in the same arrangement. The first light-transmitting part 111 and the second light-transmitting part 112 have the same shape. The cross-sections of the first photosensitive element 21 and the second photosensitive element 22 are the same, so that the center of the first photosensitive element 21 is the same as the first light-transmitting part. A point A on the part 111 corresponds to the point A'corresponding to the first light-transmitting part 111 in the second block 112, and the point A'is moved in the preset reference direction by the length of the non-light-transmitting area. Point A" makes the center of the second photosensitive element 22 correspond to point A".

It should be noted that, in this embodiment, the area where light enters the photosensitive element through the transparent area is the light area, and the area where light does not pass through the non-transmissive area but does not enter the photosensitive element is the non-light area. The area of the light area of the photosensitive element 21 may be greater than or equal to the area of the non-light area of the first photosensitive element 21; or, the area of the light area of the second photosensitive element 22 may be greater than or equal to the area of the non-light area of the second photosensitive element 22 area. For example, as shown in FIG. 5a, the area of the light area of the first photosensitive element 21 is equal to the area of the non-light area of the first photosensitive element 21, and the area of the light area of the second photosensitive element 22 is equal to the area of the non-light area of the second photosensitive element 22. For example, as shown in FIG. 5b, the area of the light region of the first photosensitive element 21 is greater than the area of the non-light region of the first photosensitive element 21, and the area of the light region of the second photosensitive element 22 is greater than that of the second photosensitive element. The area of the non-light region of the element 22, for example, as shown in FIG. 5c, the area of the light region of the first photosensitive element 21 is smaller than the area of the non-light region of the first photosensitive element 21, and the light region of the second photosensitive element 22 The area is larger than the area of the non-light region of the second photosensitive element 22.

Among them, the combined light area of all photosensitive elements is equivalent to the light entering area of one photosensitive element. For example, as shown in Figures 5a and 6a, combining the light area of the first photosensitive element 21 and the light area of the second photosensitive element 22 can be equivalent to the light entering area of the first photosensitive element 21 or the light entering area of the second photosensitive element 22 For the light area, part of the image information captured by the first photosensitive element 21 and the second photosensitive element 22 is just complementary to synthesize complete image information.

Wherein, the light area of all the photosensitive elements combined can also be larger than the light entrance area of one photosensitive element. When the light area of the first photosensitive element 21 is combined with the light area of the second photosensitive element 22, the light area of the first photosensitive element 21 and the light area of the second photosensitive element 22 may have overlapping light areas. The "overlapping light area" refers to the light area that can pass through the first light-receiving element 21 at the same time if there is a horizontal straight line when the centers of the first light-receiving element 21 and the second light-receiving element 22 are located on the same horizontal line Compared with the light area of the second photosensitive element 22, the light area of the first photosensitive element 21 and the light area of the second photosensitive element 22 have overlapping light areas. For example, as shown in FIGS. 5b and 6b, the centers of the first photosensitive element 21 and the second photosensitive element 22 are located on the same horizontal line, and there are horizontal straight lines that can pass through the light area of the first photosensitive element 21 and the second photosensitive element head 22 at the same time. Therefore, there is an overlapping light area between the light area of the first photosensitive element 21 and the light area of the second photosensitive element 22. The combined light area of the first photosensitive element 21 and the light area of the second photosensitive element 22 are larger than The light entering area of the first photosensitive element 21 or the light entering area of the second photosensitive element 22, the part of the image information captured by the first photosensitive element 21 and the second photosensitive element 22 has overlapping parts, which can make the captured image more fine.

It needs to be further explained that Figures 6a and 6b are only a schematic diagram of image information synthesis processing. In the actual imaging process, effective imaging points or invalid imaging points will be formed according to the resolution of the camera and whether the corresponding points transmit light. The effective imaging points of the camera are combined to compensate for the loss of resolution of the camera.

Optionally, in some embodiments, as shown in FIGS. 5d and 5e, the light-transmitting portion 11 may further include a third light-transmitting portion 113, and the imaging unit 20 may further include a third photosensitive element 23.

Among them, the third light-transmitting portion 113 and the first light-transmitting portion 111 and the second light-transmitting portion 112 may be arranged adjacent to each other, or may be arranged with the display portion 12 spaced apart (in FIG. 5d and FIG. The interval display part between the light-transmitting parts is set as an example for description).

Among them, the third photosensitive element 23 corresponds to the third light-transmitting portion 113, and the light area combining the first photosensitive element 21, the second photosensitive element 22, and the third photosensitive element 23 is at least equivalent to the light entering area of one photosensitive element to The images captured by the first photosensitive element 21, the second photosensitive element 22, and the third photosensitive element 23 can at least complementarily synthesize a complete image.

Optionally, the first light-transmitting portion 111, the second light-transmitting portion 112, and the third light-transmitting portion 113 may all be composed of the sub-transmitting regions 11011 and the circuit regions 11021 in different arrangements. For example, in the first light-transmitting portion 111, the non-transmitting regions and the light-transmitting regions formed alternate in order; in the second light-transmitting portion 112, the light-transmitting regions and the non-transmitting regions formed alternate in sequence; In the three light-transmitting parts 113, the non-light-transmitting regions, the light-transmitting regions, and the non-light-transmitting regions are formed alternately, so that each first pixel unit 110 in the third light-transmitting part 113 is composed of two circuit regions 11021 and one Sub-transparent area 11011 is composed.

Specifically, as shown in FIG. 5d, the central axis of the first photosensitive element 21 and the central axis of the second photosensitive element 22 are located on the same horizontal plane, and in the first light-transmitting portion 111 and the second light-transmitting portion 112, light is transmitted The area of the area 1101 is equal to the area of the non-transmissive area 1102, so that the light area of the first photosensitive element 21 and the second photosensitive element 22 can be equivalent to the light entrance area of a photosensitive element, and the light area of the third photosensitive element 23 There are light areas overlapping with the light areas of the first photosensitive element 21 and the second photosensitive element 22 respectively, which can make the synthesized photos taken by the first photosensitive element 21, the second photosensitive element 22 and the third photosensitive element 23 more precise.

As shown in FIG. 5e, the central axis of the first photosensitive element 21 and the central axis of the second photosensitive element 22 are on the same horizontal plane, and the area of the light-transmitting area 1101 in the first light-transmitting portion 111 and the second light-transmitting portion 112 is smaller than The area of the non-transmissive region 1102, and at the same time, the area of the transmissive region 1101 in the third transmissive portion 113 is greater than or equal to the area of the non-transmissive region 1102, so that the first transmissive portion 111 and the second transmissive portion 112 And the total area of all the light-transmitting regions 1101 in the third light-transmitting portion 113 is greater than or equal to the area of one of the light-transmitting portions (the first light-transmitting portion 111, the second light-transmitting portion 112 or the third light-transmitting portion 113), So that the light area of the first photosensitive element 21, the second photosensitive element 22, and the third photosensitive element 23 can be equivalent to the light entering area of a photosensitive element, so that the first photosensitive element 21, the second photosensitive element 22 and the third photosensitive element The image taken by the element 23 can at least complementarily synthesize a complete image.

Of course, in some other embodiments, the imaging unit 20 may also include N (N is a positive integer, and N≥3) photosensitive elements, and the number of the light-transmitting parts 11 may also be N. A light-transmitting part corresponds to combining the respective light areas of the N photosensitive elements to be equivalent to a light-inlet area of one photosensitive element, so that the imaging unit 20 can synthesize a complete image. Further, the light regions of any M (M is a positive integer and 2≤M≤N) of the N photosensitive elements have overlapping light regions, so that the imaging unit 20 can synthesize a complete image and the image More refined.

It should be noted that FIGS. 5a to 5e are only an illustration of the arrangement of the light-transmitting area 1101 and the non-light-transmitting area 1102 in the light-transmitting portion 11 of the display panel 10, and do not limit the light-transmitting area and the non-transmitting area. The specific setting method and its size and shape can be selected according to actual needs to adopt ordinary RGB arrangement, RGBB arrangement, or PenTile arrangement.

In this embodiment, the display device 100 is provided with a first light-transmitting portion 111 and a second light-transmitting portion 112 on the display panel 10. Both the first light-transmitting portion 111 and the second light-transmitting portion 112 include a light-transmitting area 1101 and a non-transmitting area. Light-transmitting area 1102, and make the first photosensitive element 21 correspond to the first light-transmitting portion 111, and the second photosensitive element 22 corresponds to the second light-transmitting portion 112, so that the first light-transmitting portion 111 and the second light-transmitting portion 112 Part of the image information transmitted by the light-transmitting area 1101 can complement and synthesize complete image information, so that when a camera is set under the display panel, light can be transmitted without opening holes, thereby effectively improving screen utilization.

Referring to FIG. 7, a terminal 200 provided by an embodiment of the present application includes: a display device 100 and a housing 210.

Wherein, the display device 100 may be any display device 100 in the above-mentioned embodiments. In FIG. 7, the display device shown in FIG. 5a is taken as an example for description.

Wherein, the display device 100 is embedded in the casing 210 so that the display device 100 and the casing 210 form a closed space, and the side of the display device 100 where the camera unit 20 is provided is accommodated in the closed space. Preferably, the display effect of the light-transmitting part of the display device 100 may be different from that of the display part. Therefore, the light-transmitting part is arranged at the corners of the housing 210 so that the light-transmitting part does not occupy the center of the user's observation, thereby improving user experience. .

Wherein, the housing 210 may be the housing of a terminal device, where the terminal device exists in various forms, including but not limited to: smart phones, functional phones, tablet computers, audio, video players, handheld game consoles, e-books and many more. Optionally, the housing 210 has a certain degree of curvature, so that when the display device 100 is installed in the housing 210, the display screen can be enlarged.

Optionally, the terminal 200 may further include a processor and a memory (not shown). The processor may include an Application-Specific Integrated Circuit (ASIC) with control processing functions, a Field Programmable Gate Array (FPGA), a single-chip microcomputer, and the like. The memory is connected to the processor, and the processor executes various functions of the terminal 200 by running software programs and modules stored in the memory. The memory may include volatile memory (English: volatile memory), such as random access memory (English: random-access memory, abbreviation: RAM), such as static random access memory (English: static random-access memory, abbreviation: SRAM) ), Double Data Rate Synchronous Dynamic Random Access Memory (English: Double Data Rate Synchronous Access Memory, abbreviation: DDR SDRAM), etc.; memory can also include non-volatile memory (English: non-volatile memory), for example Flash memory (English: flash memory), hard disk (English: hard disk drive, abbreviation: HDD) or solid state drive (English: solid-state drive, abbreviation: SSD), electrically erasable programmable read-only memory (Electrically Erasable Programmable) read only memory, EEPROM); the memory may also include a combination of the above types of memories. Among them, the memory can be an independent memory, a memory inside a chip (such as a processor chip) or a module with a storage function. Among them, the memory may store computer programs (such as control programs for positioning modules, vehicle diagnostic programs, functional modules, etc.), computer instructions, operating systems, data, databases, etc. The memory can be partitioned for storage.

It can be understood that the terminal 200 may also include more other modules, such as a touch module, a WIFI module, a sensor, etc., and this embodiment does not constitute a limitation.

In this embodiment, the terminal 200 is provided with the display device 100 so that when a camera is set under the display panel, light can be transmitted without opening holes, thereby effectively improving screen utilization.

Referring to FIG. 8, the shooting method provided by the embodiment of the present application can be applied to the above-mentioned display device 100 or terminal 200, and the method includes:

S310. Receive a camera instruction.

In this embodiment, the camera instruction is a control instruction triggered when the user needs to take a photo. Among them, the user triggering a camera instruction can be to trigger a corresponding menu item, or call a corresponding shortcut, or long press an icon, and so on. When the user triggers the camera instruction, the camera instruction can be directly received through the display device, and the display device directly executes the next step, or the camera instruction can be received through the controller connected to the display device, and the controller controls the display device to instruct the next step.

S320: According to the imaging instruction, the imaging unit receives light that passes through the light-transmitting areas of the at least two light-transmitting parts to generate a corresponding original image.

In this embodiment, after receiving the imaging instruction, the display device (or the controller connected to the display device) controls the imaging unit to take pictures, and the imaging unit receives the light of the external object through the light-transmitting area of its corresponding light-transmitting part, To generate its corresponding original image.

Among them, because the camera unit corresponds to the non-transmissive area at the same time, the non-transmissive area cannot receive the optics of the external object, so the original image generated by each lens has a certain blocking area (as shown in FIG. 6a or FIG. 6b).

Among them, during shooting, the display block can be displayed normally, and the light-transmitting part corresponding to the camera unit can be displayed or not displayed.

S330: Perform complementary synthesis processing on the original image to obtain a photographed image.

In this embodiment, since the light area of the photosensitive element combining all the imaging areas is at least equivalent to the light entering area of a lens, the original images captured by the imaging unit are at least complementary. Through the image processing algorithm, all the original images By complementing the occluded areas of, a complete photographed image can be obtained. Among them, a complete captured image refers to an image obtained when a single camera with the same parameters and without occlusion is used to shoot at the same position. For example, as shown in FIG. 6a, two original images are obtained by shooting, and the two original images are exactly complementary, then a complete shot image can be obtained by combining the two original images. For another example, as shown in FIG. 6b, two original images are obtained by shooting, and the two original images are complementary and partially overlapped, and then a complete and higher-quality shot image can be obtained after synthesis.

In some other embodiments, since the positions of the photosensitive elements of the imaging unit are different, the shooting angles thereof are also different, and the content of the original image captured may be different. When the contents of the original images obtained by shooting are not the same, the parts with the same contents are cut out to perform complementary synthesis to obtain the shot images.

Wherein, the display device can be used to display images, and the method further includes:

S341. Receive a display instruction, where the display instruction includes a target image;

S342. According to the display instruction, control the display panel of the display device to display the target image.

Among them, in S341, the display command is a control command sent when the display needs to be performed. The display instruction can be triggered by the user or the system, and receiving the display instruction can be the display device directly receiving the display instruction, or the display instruction sent by the controller connected to the display device. Among them, the target image refers to the image that needs to be displayed; the display instruction includes the target image, which may include address information, display information, and so on of the target image.

Wherein, in S342, controlling the display panel of the display device to display the target image is specifically: controlling the light-transmitting part and the display part of the display panel to display the target image at the same time, so that the screen utilization can be effectively improved when the camera is installed under the screen.

Wherein, when the display device displays an image, since the display panel has a light-transmitting area, a non-light-transmitting area, and a low-light area, the imaging effects of different areas are different. Therefore, the method further includes:

S351: Obtain preset calibration parameters;

S352: Compensate the brightness of the display panel according to the preset correction parameter.

Among them, the preset calibration parameter is a preset calibration parameter, which can be a fixed value for calibration and compensation measured before leaving the factory. When the image is displayed, the preset correction parameters are acquired at the same time, and the brightness of the display panel can be compensated according to the preset correction parameters, so that different areas of the display panel have uniform brightness, thereby obtaining a better display effect.

The display panel has at least two light-transmitting parts. Before S351, the method further includes:

S353: Obtain the brightness of the light-transmitting part and other display areas of the display panel respectively;

S354: Determine a preset correction parameter according to the brightness of the light-transmitting portion and the brightness of the remaining display area of the display panel.

Among them, in this embodiment, the specific implementation may be: separately obtain the brightness of the light-transmitting part and the display part of the display panel through methods such as image sensor shooting, calculate the difference between the brightness of the light-transmitting part and the display part, and calculate the difference in brightness according to the brightness The difference value of, generates preset correction parameters.

In this embodiment, the photographing method receives the light that passes through at least the light-transmitting area of the light-transmitting part through the photographing unit after receiving the photographing instruction to generate the corresponding original image, and perform complementary synthesis of each original image to obtain Complete image information, so that when a camera is set under the display panel, light can pass through without opening holes, thereby effectively improving screen utilization.

Those skilled in the art can understand that the processes and materials described in the embodiments in this specification are only exemplary, and the embodiments of the present application may use any process or material suitable for the present application developed in the future.

Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, but not to limit them; under the idea of this application, the above embodiments or the technical features in different embodiments can also be combined. The steps can be implemented in any order, and there are many other variations in different aspects of the application as described above. For the sake of brevity, they are not provided in the details; although the application has been described in detail with reference to the foregoing embodiments, it is common in the art The technical personnel should understand that: they can still modify the technical solutions described in the foregoing embodiments, or equivalently replace some of the technical features; and these modifications or substitutions do not make the essence of the corresponding technical solutions deviate from the implementations of this application Examples of the scope of technical solutions.

Claims

A display device, characterized by comprising:

A display panel having at least two light-transmitting parts, the light-transmitting part including a light-transmitting area and a non-light-transmitting area;

A camera unit, which takes images through the light-transmitting areas of the at least two light-transmitting parts and performs complementary synthesis.
The display device according to claim 1, wherein the number of the imaging units is the same as the number of the light-transmitting parts, and each of the imaging units is provided corresponding to the light-transmitting part.
The display device according to claim 2, wherein the photosensitive element of the imaging unit covers the light-transmitting part, and the partial image information transmitted by the at least two light-transmitting regions is complementary to synthesize complete image information .
The display device according to claim 1, wherein the number of photosensitive elements of the imaging unit is two, and the central axes of the two photosensitive elements are located on the same horizontal plane.
The display device according to any one of claims 1 to 4, wherein the display panel comprises a plurality of first pixel units and second pixel units distributed in an array, and the first pixel units constitute the transparent Section, the second pixel unit constitutes a display section of the display panel.
The display device according to claim 5, wherein when the camera unit is in a non-working state, the light-transmitting part is used to display an image.
The display device according to claim 6, wherein each of the first pixel units includes a sub-transmissive area and a circuit area, and a plurality of the sub-transmissive areas arranged in an array form the transmissive portion of the light-transmitting portion. In the light area, a plurality of the line areas distributed in an array form the non-light-transmitting area of the light-transmitting part.
7. The display device according to claim 7, wherein in the first pixel unit, the proportion of the sub-transmissive area is greater than or equal to the proportion of the line area.
8. The display device of claim 7, wherein the light-transmitting area is adjacent to the non-light-transmitting area.
The display device according to any one of claims 1-9, wherein the camera unit is arranged on the backlight side of the display panel.
A terminal, characterized by comprising: a housing and the display device of any one of claims 1-10, the display device being embedded in the housing.
A photographing method, characterized by being applied to the display device of any one of claims 1-10, the method comprising:

Receive camera instructions;

According to the imaging instruction, the light transmitted through the light-transmitting areas of the at least two light-transmitting parts is received by the imaging unit to generate a corresponding original image;

The original image is subjected to complementary synthesis processing to obtain a photographed image.
The method of claim 12, wherein the method further comprises:

Receiving a display instruction, where the display instruction includes a target image;

According to the display instruction, the display panel of the display device is controlled to display the target image.
The method of claim 13, wherein the method further comprises:

Obtain preset calibration parameters;

According to the preset correction parameters, the brightness of the display panel is compensated.
The method of claim 14, wherein the display panel has at least two light-transmitting parts,

The method also includes:

Acquiring the brightness of the light-transmitting portion and other display areas of the display panel respectively;

The preset correction parameter is determined according to the brightness of the light-transmitting portion and the brightness of the remaining display area of the display panel.