CN115428063A - Display panel, display terminal and display device - Google Patents

Display panel, display terminal and display device Download PDF

Info

Publication number
CN115428063A
CN115428063A CN202080099986.6A CN202080099986A CN115428063A CN 115428063 A CN115428063 A CN 115428063A CN 202080099986 A CN202080099986 A CN 202080099986A CN 115428063 A CN115428063 A CN 115428063A
Authority
CN
China
Prior art keywords
photoelectric conversion
conversion unit
display
image
lens
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202080099986.6A
Other languages
Chinese (zh)
Inventor
王铠尧
刘永俊
杨晖
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huawei Technologies Co Ltd
Original Assignee
Huawei Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co Ltd filed Critical Huawei Technologies Co Ltd
Publication of CN115428063A publication Critical patent/CN115428063A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G3/00Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
    • G09G3/20Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
    • G09G3/34Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters by control of light from an independent source
    • G09G3/36Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters by control of light from an independent source using liquid crystals

Abstract

A display panel (11) for improving a screen ratio and capable of performing image display and image acquisition in a time-sharing manner, the display panel (11) includes a plurality of pixel units (P) arranged in a matrix, and each pixel unit (P) includes at least one first photoelectric conversion unit (101) for emitting light to display an image. An image acquisition module (13) is arranged among the pixel units (P) in at least part of the display area. The image acquisition module (13) comprises a lens layer (131) for acquiring ambient light and a second photoelectric conversion unit (102) for converting the ambient light into an electric signal, wherein the electric signal is used for reconstructing an image corresponding to the ambient light. The emergent light of the first photoelectric conversion unit (101) and the output electric signal of the second photoelectric conversion unit (102) are carried out in a time-sharing mode, and the display panel (11) multiplexes image display and image acquisition functions in a part of display area. It also relates to a display terminal and a display device comprising a display panel (11).

Description

Display panel, display terminal and display device Technical Field
The present application relates to the field of image display and image acquisition, and in particular, to a display panel, a display terminal, and a display device.
Background
In the process of displaying images on the self-luminous display panel, in order to acquire images on an image display interface facing a user, an image acquisition device separately at the position of the display interface is needed, for example, a front camera is needed to be arranged on the display interface. Obviously, the front camera tends to occupy the position of a part of the image display interface, so that the display area of the display interface is limited, and the screen occupation ratio of the display interface is small.
Disclosure of Invention
The embodiment of the application provides a display panel with a larger screen occupation ratio and better collected images.
In one implementation of the present application, a display panel is provided, which includes a display area, where the display area includes a plurality of pixel units arranged in a matrix, and each pixel unit includes at least one first photoelectric conversion unit for emitting light to display an image. And an image acquisition module is arranged between the pixel units in the first area in the display area. The image acquisition module includes lens layer and second photoelectric conversion unit, the lens layer be used for with the outside ambient light transmission of display panel extremely second photoelectric conversion unit, second photoelectric conversion unit be used for when the image acquisition state will ambient light converts the signal of telecommunication into, the signal of telecommunication is used for reconstructing the image that ambient light corresponds, wherein, first photoelectric conversion unit outgoing light with second photoelectric conversion unit output the signal of telecommunication timesharing goes on. Therefore, the display panel can execute image display and image acquisition in a time-sharing manner, so that the display panel can directly multiplex the functions of image display and image acquisition without independently arranging image acquisition devices such as a camera and the like, thereby realizing comprehensive screen display and effectively improving the screen occupation ratio of a display interface.
In one implementation manner of the present application, the first area includes an image display state and an image capture state, and when the first area is in the image display state, the first photoelectric conversion unit emits light to perform image display, and the second photoelectric conversion unit stops outputting the electrical signal. When the first area is in the image acquisition state, the first photoelectric conversion unit stops emitting light, and the second photoelectric conversion unit converts the ambient light into the electric signal. The lens layer is a condensing lens and is used for converging and transmitting the ambient light to the second photoelectric conversion unit, and when the first area is in an image collecting state, the second photoelectric conversion unit receives and collects the converged ambient light provided by the lens layer and converts the ambient light into an electric signal.
In one implementation manner of the present application, the first photoelectric conversion unit and the same layer of the lens layer are arranged in parallel, and the lens layer is opposite to and covers the second photoelectric conversion unit. Because the first photoelectric conversion unit and the lens layer are arranged in parallel in the same layer, the second photoelectric conversion unit and the first photoelectric conversion unit are separated by the distance of at least one layer of structure, and light emitted by the first photoelectric conversion unit can be effectively prevented from leaking to the second photoelectric conversion unit.
In one implementation manner of the present application, the second conversion unit is a photodetector, and the first conversion unit is a light emitting diode, an organic light emitting diode, or a micro light emitting diode.
In one implementation of the present application, the lens layer includes a condenser lens state and a flat lens state. When the first area is in an image display state, the first photoelectric conversion unit emits light to display an image, the lens layer is in a plane lens state, and the second photoelectric conversion unit stops converting the ambient light into the electric signal. When the first area is in an image acquisition state, the first photoelectric conversion unit stops emitting light, the lens layer is in a condensing lens state, ambient light is converged and transmitted to the second photoelectric conversion unit, and the second photoelectric conversion unit receives and acquires the ambient light which is provided by the lens layer and converged and converts the ambient light into an electric signal.
The lens layer can present two states of a condensing lens state and a plane lens state so as to adapt to the display panel in an image display state or an image acquisition state, and the better image display quality and the better acquired image quality are ensured.
In an implementation manner of the present application, the display panel further includes a control module, the control module is connected to the lens layer, the control module is used for outputting different voltages to the lens layer and controlling the lens layer is in a condensing lens state or a planar lens state. When the control module receives a first instruction, the control module outputs a first voltage to the lens layer and controls the lens layer to be in a plane lens state, and the first instruction is used for indicating the first area to display an image. Or when the control module receives a second instruction, the control module outputs a second voltage to the lens layer and controls the lens layer to be in a condensing lens state, and the second instruction is used for indicating the first area to acquire an image. Different voltages are provided to the lens layer according to the instruction corresponding to the image display state and the image acquisition state, so that the refractive index of the lens layer is accurately controlled to control the incident light phase, and the image display state or the image acquisition state of the display panel is accurately matched.
In one implementation of the present application, the lens layer is a hyperplane lens. The first voltage controls the phase offset angle of the environment light ray entering the super-plane lens to be 0 degree, the super-plane lens is a plane mirror, and the second voltage controls the phase offset angle of the environment light ray entering the super-plane lens to be
Figure PCTCN2020088534-APPB-000001
The hyperplane lens is provided with a condensing lens and is used for condensing and transmitting the ambient light to the second photoelectric conversion unit, and the phase shift angle is
Figure PCTCN2020088534-APPB-000002
For adjusting the focal length required for the currently acquired image. Because the lens layer is the super plane lens, can accurately control the refracting index of lens layer through providing different voltages to reach the control to incident light phase delay angle, especially when super plane lens is in condensing lens, just can make the focus of super plane lens adjust through the control to incident light phase delay angle, guarantee that the image of gathering has higher definition.
In one implementation manner of the present application, when the first area is the same as the shape and the area of the display area, the control module receives the first instruction, and provides the first voltage to the lens layer, controls the lens layer to be in a planar lens state, and controls the second photoelectric conversion unit to stop performing the photoelectric conversion. And the control module receives a second instruction, and the control module alternately outputs a first voltage and a second voltage according to a preset frequency. The second voltage controls the first photoelectric conversion unit to stop emitting light, controls the lens layer to be in a condensing lens state, and controls the second photoelectric conversion unit to perform photoelectric conversion on the converged ambient light received from the lens layer. The first region is extended to the whole display interface, so that the display panel does not influence a user to view an image while performing image acquisition, the preset frequency can be 60HZ, and the display interface of the user is kept in an image display state in the vision at the preset frequency, so that the visual experience of the user is guaranteed.
In an implementation manner of the present application, when the first area is smaller than the area of the display area, the control module receives the first instruction, the control module provides the first voltage to the lens layer, controls the lens layer to be in the plane lens state, and controls the second photoelectric conversion unit to stop performing the photoelectric conversion. The control module group receives the second instruction, the control module group outputs the second voltage, the second voltage control first photoelectric conversion unit stops emergent light, controls simultaneously the lens layer is in the condensing lens state, and controls second photoelectric conversion unit will certainly the lens layer receives through the ambient light execution photoelectric conversion after assembling. The region multiplexing the image display and image capture effects does not affect the image display performed only in the image display region when performing the image display, so that the image display and image capture can be performed simultaneously on the display panel.
In an implementation manner of the present application, when the control module receives the first instruction again, the control module exits from the image capturing state and enters into the image displaying state. And after the display panel finishes image acquisition, the display panel quits the image acquisition state after receiving the instruction of recovering the representation to the image display state again, and all pixel units in the display area execute image display.
In an implementation manner of the present application, the first photoelectric conversion unit and the second photoelectric conversion unit are arranged in parallel on the same layer, and the lens layer is opposite to and covers the second photoelectric conversion unit, so that the lens layer and the first photoelectric conversion unit are arranged at a certain distance from each other.
In one implementation manner of the present application, the first conversion unit is a light emitting diode, an organic light emitting diode, or a micro light emitting diode, and the second photoelectric conversion unit is a photodetector.
In one implementation manner of the present application, the first photoelectric conversion unit is further configured to receive the ambient light in an image capturing state and convert the ambient light into an electrical signal to perform image capturing. The second photoelectric conversion unit is also used for converting the image data into an optical signal to be emitted in an image display state so as to display an image. The first photoelectric conversion unit and the second photoelectric conversion unit are micro light emitting diodes. The first photoelectric conversion unit and the second photoelectric conversion unit can execute image display and image acquisition in a time-sharing manner, and the resolution and definition of image display and acquisition are further improved.
In one implementation of the present application, the first photoelectric conversion unit and the second photoelectric conversion unit are disposed in parallel on the same layer, and the lens layer covers the first photoelectric conversion unit and the second photoelectric conversion unit. From this, the lens layer can cover first photoelectric conversion unit and second photoelectric conversion unit simultaneously, and luminance when effectively having improved image display to and focus control's fineness when image acquisition, guarantee image acquisition's quality.
In this application implementation, as first region with the area of display area is the same, control module group receives first instruction, control module group provides first voltage extremely the lens layer, control the lens layer is in the plane lens state, simultaneous control first photoelectric conversion unit with second photoelectric conversion unit outgoing light shows the image simultaneously. The control module receives a second instruction, alternately outputs a first voltage and a second voltage according to a preset frequency, the second voltage controls the lens layer to be in a condensing lens state, controls the first photoelectric conversion unit and the second photoelectric conversion unit to stop emergent light, and simultaneously executes photoelectric conversion from the ambient light received by the lens layer after convergence. The first region is extended to the whole display interface, so that the display panel does not influence a user to view an image while performing image acquisition, the preset frequency can be 60HZ, and the display interface of the user is kept in an image display state in the vision at the preset frequency, so that the visual experience of the user is guaranteed.
In an implementation manner of the present application, when a first area is smaller than an area of the display area, the control module receives a first instruction, provides a first voltage to the lens layer, controls the lens layer to be in a planar lens state, and simultaneously controls the first photoelectric conversion unit and the second photoelectric conversion unit to emit light rays to display an image; the image acquisition state, the control module group receives the second instruction, the control module group outputs the second voltage, second voltage control the lens layer is in the condensing lens state, control first photoelectric conversion unit with the second photoelectric conversion unit number stops emergent ray, and simultaneously certainly the lens layer receives the ambient light after gathering carries out photoelectric conversion. The region multiplexing the image display and image capture effects does not affect the image display in which only the image display region is performed when the image display is performed, so that the image display and the image capture can be simultaneously performed on the display panel.
In an implementation manner of the present application, a display terminal is provided, which includes an input module and the display panel described in any one of the foregoing, where the input module is configured to receive a control instruction input by a user through an operation, and generate the first control instruction and the second control instruction according to the control instruction. The display panel in the display terminal can multiplex two functions of image display and image acquisition, so that the screen occupation ratio of the display panel is effectively improved, and a larger space is provided for realizing full-screen display.
In one implementation manner, a display device is provided and comprises the display panel.
Drawings
Fig. 1 is a schematic diagram illustrating a planar structure of a display terminal according to an embodiment of the present application;
fig. 2 is a schematic side view of the display terminal shown in fig. 1;
FIG. 3 is a schematic structural diagram of a plane of the display panel shown in FIG. 2;
FIG. 4 is a schematic diagram showing the distribution of the image capturing modules shown in FIG. 3 on a display interface;
FIG. 5 is a schematic view of the image capturing module shown in FIG. 3 distributed on a display interface;
FIG. 6 is an enlarged structural view of the first region shown in FIGS. 1 and 3;
FIG. 7 is a schematic cross-sectional view taken along line VI-VI of FIG. 6 in the first embodiment of the present application;
FIG. 8 is a schematic view of the connection between the image display module and the image capture module shown in FIG. 7;
FIG. 9 is a flow chart of the driving of the display panel for image display acquisition as shown in FIGS. 6-7;
FIG. 10 is a schematic diagram of timing control for image display acquisition;
FIG. 11 is a schematic cross-sectional view taken along line VI-VI as shown in FIG. 6 in the second embodiment of the present application;
FIG. 12 is a schematic diagram of a specific structure of the lens layer shown in FIG. 11;
FIG. 13 is a schematic diagram of the optical path structure of the lens layer of FIG. 11 in the condensing state;
FIG. 14 is a schematic view of the optical path of the lens layer of FIG. 13 in a flat mirror mode;
FIG. 15 is a schematic view of the optical path of the lens layer of FIG. 13 in the collection mode;
FIG. 16 is a schematic diagram of the functional modules for driving the display panel shown in FIG. 11;
fig. 17 is a flowchart of driving the display panel to display and collect images as shown in fig. 11 and 16;
FIG. 18 is a schematic diagram of timing control for driving the display panel shown in FIG. 11 and FIG. 16 to perform image display acquisition;
FIG. 19 is a flow chart of the driving of the display panel shown in FIGS. 11 and 16 for image display acquisition;
FIG. 20 is a schematic diagram of timing control for driving the display panel shown in FIG. 11 and FIG. 16 to perform image display acquisition;
FIG. 21 is a schematic cross-sectional view taken along line VI-VI of FIG. 6 in the third embodiment of the present application;
FIG. 22 is a schematic diagram of the functional modules for driving the display panel shown in FIG. 21;
FIG. 23 is a schematic diagram of timing control for driving the display panel shown in FIG. 11 and FIG. 16 to perform image display acquisition;
fig. 24 is a schematic diagram of timing control for driving the display panel to display and capture images as shown in fig. 11 and 16.
Detailed Description
Embodiments of the present invention will be described below with reference to the accompanying drawings.
Fig. 1 is a schematic plan view of a display terminal according to an embodiment of the present application. As shown in fig. 1, the display terminal 10 includes a display interface (Active Area) AA for performing image display and image acquisition and an instruction acquisition module for receiving user operations. Wherein, the user has represented the corresponding control command that the user input the same to the operation of display terminal 10, and in this embodiment, the command obtaining module may be: mechanical keys, a language pickup module, a motion sensor, a brain wave sensor and an image acquisition module.
In this embodiment, the shape and the size of the light emitting area on the front surface of the display interface AA are substantially the same as those of the light emitting area on the front surface of the display terminal 10, and the display interface AA executes image display or acquires light in an external environment to acquire an image according to image data in a time-sharing manner. The display interface AA may perform image display and image acquisition in a time-sharing manner in a partial region, or perform image display and image acquisition in a time-sharing manner in a whole region of the display interface AA. That is, the display terminal 10 can be in an image display state or an image acquisition state in a time-sharing manner in at least a partial area of the display interface AA, so that the display interface AA can perform image display and image acquisition in a time-sharing manner, and the display interface AA can multiplex the functions of image display and image acquisition without separately setting image acquisition devices such as a camera, thereby realizing full-screen display and effectively improving the screen occupation ratio of the display interface.
The display interface AA includes a plurality of Pixel units P uniformly arranged in an array, each Pixel includes a plurality of sub-pixels (pixels) arranged at a predetermined distance, each sub-Pixel is formed by a first photoelectric conversion unit (fig. 7), and the plurality of sub-pixels (pixels) serve as an image display module 12 (fig. 3).
The display interface AA includes a first area A1, in the first area A1, a plurality of second photoelectric conversion units (fig. 7) are disposed between each sub-Pixel, and the plurality of second photoelectric conversion units serve as an image capturing module 13 (fig. 3).
The first photoelectric conversion unit and the second photoelectric conversion unit are elements for converting photoelectric signals. The first photoelectric conversion unit converts the image signal into an optical signal to be emitted and display an image, and the second photoelectric conversion unit collects the environment light-changing line and converts the environment light-changing line into an electric signal to reconstruct the image.
Please refer to fig. 2, which is a schematic side view of the display terminal shown in fig. 1.
As shown in fig. 2, the display terminal 10 includes a touch layer TL and a display panel 11 stacked together. The display panel 11 includes a light emitting surface 11a for emitting light, and the touch layer TL is disposed on the surface of the light emitting surface 11a of the display panel 11. The touch layer TL is used to sense a touch operation of a user.
The display panel 11 at least includes an array substrate 111 and a photoelectric conversion layer 112 disposed on a surface of the array substrate 111. In this embodiment, the photoelectric conversion layer 112 includes a plurality of photoelectric conversion elements (not shown), and the photoelectric conversion elements may be Light Emitting Diodes (LEDs), organic Light Emitting semiconductor materials (OLEDs), micro Light Emitting diodes (μ -LEDs).
Of course, in other embodiments of the present disclosure, the touch layer TL may not be provided.
Please refer to fig. 3, which is a schematic plane structure diagram of the display panel shown in fig. 2.
As shown in fig. 3, the display panel 11 includes an image display module 12 for emitting light to display an image and an image capturing module 13 for capturing ambient light to obtain an image.
The image display modules 12 are distributed on all the display interfaces AA, and the image acquisition modules 13 are distributed on at least partial areas of the display interfaces AA.
The image display module 12 includes a plurality of Pixel units uniformly distributed on the entire display interface AA, each Pixel unit includes a plurality of sub-pixels (pixels) spaced at a predetermined distance, and each sub-Pixel serves as a first photoelectric conversion unit for converting an image signal of an analog electrical signal into an optical signal and emitting the optical signal. Each pixel unit at least comprises a red sub-pixel (R), a green sub-pixel (G) and a blue sub-pixel (B) which emit red light, green light and blue light respectively, the red light, the green light and the blue light emitted by the three-color sub-pixels are mixed with different brightness gray scales, and each pixel unit can emit colored light, so that the display interface AA can execute color image display.
The image collection modules 13 are at least distributed in a partial area of the display interface AA, wherein the image collection modules 13 are distributed among the sub-pixels Pixel and used for collecting ambient light and ambient light outside the display terminal 10, converting the ambient light into electrical signals, and reconstructing an image outside the display terminal by processing the electrical signals.
In this embodiment, the size of the image capturing module 13 is smaller than the size of the sub-Pixel in the image display module.
The display terminal 10 further includes an image display drive control circuit 12A for driving the image display module 12 to perform image display, and an image capture drive control circuit 13A for driving the image capture module 13 to perform image capture and reconstruction. The image display drive control circuit 12A and the image capture drive control circuit 13A are disposed in a non-image display area of the display terminal 10.
Specifically, please refer to fig. 4, which is a schematic diagram illustrating the distribution of the image capturing module shown in fig. 3 on the display interface AA.
The display interface AA includes a first area A1, the area of the first area A1 is smaller than that of the display interface AA, and the first area A1 may be disposed at any position of the display interface.
The first area A1 includes an image display module and an image capture module, wherein the image capture module is distributed between the sub-pixels Pixel.
Specifically, please refer to fig. 5, which is a schematic diagram illustrating the distribution of the image capturing module shown in fig. 3 on the display interface AA.
The display interface AA comprises a first area A1, and the area and the shape of the first area A1 are the same as those of the display interface AA, i.e. the first area A1 coincides with the display interface AA.
The first area A1 and the display interface AA simultaneously include an image display module and an image acquisition module, wherein the image acquisition module is distributed between the sub-pixels Pixel.
Please refer to fig. 6, which is an enlarged structural diagram of the first area A1 shown in fig. 1 and fig. 3.
As shown in fig. 6, in the first area A1 of the display interface AA, in the first area A1, a plurality of Pixel units P are included, each Pixel unit includes a plurality of sub-Pixel pixels disposed at a predetermined distance, and each sub-Pixel is formed by a first photoelectric conversion unit 101, and is configured to convert an image signal of an analog electrical signal into a light signal and emit the light signal.
Meanwhile, in the first area A1, a plurality of second photoelectric conversion units 102 are disposed between adjacent sub-Pixel pixels. The second photoelectric conversion unit 102 is configured to collect ambient light and convert the light signal into an electrical signal, which can be used to reconstruct an image of the ambient light.
The arrangement of the second photoelectric conversion units 102 and the sub-Pixel pixels can be set according to actual requirements, for example, as shown in fig. 6, one second photoelectric conversion unit 102 is disposed between two adjacent sub-Pixel pixels, and each sub-Pixel is surrounded by six second photoelectric conversion units 102 arranged in a rectangular shape. In other implementations of the present application, two or more second photoelectric conversion units 102 are disposed between two adjacent sub-Pixel pixels, and the number of the second photoelectric conversion units 102 disposed around the periphery of each sub-Pixel may also be four, and the formed shape may also be a diamond shape, a circle shape, or other shapes, which is not limited thereto.
In this embodiment, the first photoelectric conversion unit 101 converts the image signal into the optical signal to emit and display the image and the second photoelectric conversion unit 102 collects the ambient light and converts the ambient light into the electrical signal to reconstruct the image in a time-sharing manner, that is, when the first photoelectric conversion unit 101 converts the image signal into the optical signal to emit and display the image, the second photoelectric conversion unit 102 stops collecting the ambient light and converting the electrical signal. When the second photoelectric conversion unit 102 collects the ambient light and converts the ambient light into an electrical signal, the first photoelectric conversion unit 101 stops converting the image signal into an optical signal and emits the optical signal.
Please refer to fig. 7, which is a schematic cross-sectional view taken along line VI-VI in fig. 6 according to a first embodiment of the present application.
The image display module 12 includes a first photoelectric conversion unit 101 and a first reading circuit 121, and the first photoelectric conversion unit 101 is used for emitting light to display an image. The first reading circuit 121 is configured to read image data to be displayed from the image display driving control circuit 12A, output a corresponding driving signal to the first photoelectric conversion unit 101 according to the image data, and drive the first photoelectric conversion unit 101 to emit light according to the driving signal to correspondingly display the image data.
The image capturing module 13 includes a lens layer 131 and a second photoelectric conversion unit 102. The lens layer 131 is used for transmitting ambient light outside the display panel to the second photoelectric conversion unit 102. The second photoelectric conversion unit 102 is configured to convert the ambient light into an electrical signal, the electrical signal is used to reconstruct an image corresponding to the ambient light,
in this embodiment, the lens layer 131 is spaced from the second photoelectric conversion unit 102 by a predetermined distance, so that the lens layer can collect a sufficient amount of collected ambient light to the second photoelectric conversion unit 102.
In this embodiment, the first photoelectric conversion unit 101 and the first readout circuit 121 are disposed opposite to each other, and meanwhile, the first photoelectric conversion unit 101 and the lens layer 131 are disposed on the same layer, and the second photoelectric conversion unit 102 is located right below the lens layer 131. The same layer as described in this embodiment is configured such that the first photoelectric conversion unit 101 and the lens layer 131 are substantially located in parallel and disposed in the same plane.
In this embodiment, the first photoelectric conversion unit 101 is an LED, an OLED, or a μ -LED, the second photoelectric conversion unit 102 is a Photodetector (PD), and the Lens layer is a metaplanar Lens (Meta-Lens).
Please refer to fig. 8, which is a schematic diagram illustrating a connection between the image display module and the image capturing module shown in fig. 7.
As shown in fig. 8, the control module 100 is electrically connected to the image display driving control circuit 12A, the image capturing driving control circuit 13A and the second photoelectric conversion unit 102.
The control module 100 is configured to receive a control instruction provided by the input module, where the control instruction includes instructing the display device to perform image display or acquire an image in the first area A1 of the display interface AA.
The control command may be input by a user touching the touch layer TL in the operation input module. For example, the display interface AA executes image display at the current moment, and when the user needs to take a picture, the user operates and triggers a camera application on the touch screen, so as to output a control instruction of image acquisition to the control module 100.
Further, when the image acquisition is completed and the corresponding position in the display interface AA is touched again, a control instruction for image display required after the image acquisition is completed is output to the control module 100.
In other embodiments of the present application, the control command may also be a command generated by a user operating a mechanical button, a voice module, a motion sensing module, or a brain wave sensing module of the input module.
When the control module 100 receives a control instruction of image acquisition, the control module 100 controls the image display drive control circuit 12A to stop outputting image data to the image display module 121, and at the same time, controls the second photoelectric conversion unit 102 to convert the received ambient light into an electrical signal, and the image acquisition drive control circuit 13A reconstructs an image corresponding to the ambient light after processing the electrical signal.
When the control module 100 receives a control instruction that the image acquisition is completed and the image display is required, the control module 100 controls the image display driving control circuit 12A to display the image data to be displayed to the image display module 121 for image display, and controls the second photoelectric conversion unit 102 to stop converting the ambient light into the electrical signal, that is, stop the image acquisition.
Referring to fig. 9-10, fig. 9 is a flowchart illustrating driving of the display panel to perform image display acquisition as shown in fig. 6-7, and fig. 10 is a timing control diagram illustrating image display acquisition.
As shown in fig. 9, the step of driving the display panel 11 to display and capture images includes:
in step 901, the control module 100 receives a second control instruction for image acquisition. As shown in fig. 10, at time t2, the display interface AA in the display terminal 10 enters an image capturing state of an image capturing time period Tc, and the control module 100 receives a second control instruction for image capturing. Note that, between times t1 to t1 before t2, the display interface AA is in an image display state for an image display period Td.
In step 903, the control module 100 outputs a first control signal to the second photoelectric conversion unit 102 and the image capturing driving control circuit 13A according to a second control instruction for instructing the first area to capture an image, so as to control the second photoelectric conversion unit 102 to be in an open state and convert the received ambient light into an electrical signal.
Meanwhile, the control module 100 outputs a first control signal to the image display driving control circuit 110 to control the image display driving control circuit 110 to stop outputting the image data to the image display module.
Step 905, the image acquisition drive control circuit 13A processes the electrical signal and reconstructs an image corresponding to the ambient light.
In step 907, the control module 100 receives a first control command for displaying an image according to the first area. As shown in fig. 10, at time t3, the control module 100 receives the first control instruction, and the display interface AA in the display terminal 10 enters an image display state of an image display period Td.
In step 909, the control module 100 outputs a second control signal to the image display driving control circuit 110 according to the first control instruction, and controls the image display driving control circuit 110 to output image data to the image display module for image display. In this embodiment, the image data output to the image display module for image display may be an image collected by the image collection module.
Meanwhile, the control module 100 outputs a second control signal to the second photoelectric conversion unit 102 and the image acquisition driving control circuit to control the second photoelectric conversion unit 102 to be in a closed state, and stops converting the ambient light into an electrical signal, i.e., stops image acquisition.
Please refer to fig. 11, which is a schematic cross-sectional view taken along line VI-VI of fig. 6 according to a second embodiment of the present application.
The image display module 12 includes a first photoelectric conversion unit 101 and a first reading circuit 121, and the first photoelectric conversion unit 101 is used for emitting light to display an image. The first reading circuit 121 is configured to read image data to be displayed from the image display driving control circuit 12A, and output a corresponding driving signal to the first photoelectric conversion unit 101 according to the image data, and the first photoelectric conversion unit 101 emits light according to the driving signal to display the image data.
The image capturing module 13 includes a lens layer 131 and a second photoelectric conversion unit 102. The lens layer 131 is used for transmitting ambient light outside the display panel 11 to the second photoelectric conversion unit 102. The second photoelectric conversion unit 102 is configured to convert the ambient light into an electrical signal, where the electrical signal is used to reconstruct an image corresponding to the ambient light. In this embodiment, the lens layer 131 is spaced from the second photoelectric conversion unit 102 by a predetermined distance, so that the lens layer 131 can collect a sufficient amount of collected ambient light to the second photoelectric conversion unit 102.
In this embodiment, the lens layer 131 includes a condensing lens state or a flat lens state.
When the lens layer 131 is in a flat mirror state, the lens layer 131 makes the incident ambient light generate a phase shift angle of 0 °, and the lens layer 131 is a flat mirror.
When the lens layer 131 is in the condensing lens state, the lens layer 131 makes incident ambient light generate a certain phase shift angle, so that the incident ambient light is converged, and the converged ambient light is transmitted to the second photoelectric conversion unit 102.
The lens layer 102 in the condensing lens state or the flat lens may be switched by receiving different voltages or different mechanical pressures.
Specifically, the lens layer 131 controlled in the condensing lens state by applying different voltages or the planar lens may be: when a first voltage is applied to the lens layer 131, the refractive index of the lens layer 131 under the control of the first voltage is such that the incident light does not generate phase shift, and is in a planar lens state, i.e. a super-planar lensThe phase shift angle generated for the incident ambient light is 0 °; when a second voltage is applied to the lens layer 131, the refractive index of the lens layer 131 under the control of the first voltage causes a certain phase shift of the incident light, i.e. the phase shift angle of the super-planar lens generated for the incident ambient light is
Figure PCTCN2020088534-APPB-000003
Wherein the content of the first and second substances,
Figure PCTCN2020088534-APPB-000004
and if the optical power is larger than 0, the hyperplane lens is a condensing lens.
Further, when the control module 100 receives a second instruction to control the first area A1 to be in the image display state, the first photoelectric conversion unit 101 emits light to display an image, the lens layer 131 is in the flat lens state, and the second photoelectric conversion unit 102 stops converting the ambient light into the electrical signal.
When control module 100 receives first instruction and is in the image acquisition state in order to control first region A1, first photoelectric conversion unit 101 stops the outgoing light, and lens layer 131 is in the condensing lens state, and will ambient light assemble transmit to second photoelectric conversion unit 102, and second photoelectric conversion unit 102 receives and gathers from the lens layer provides through after assembling ambient light, and will ambient light converts the signal of telecommunication into.
In this embodiment, the first photoelectric conversion unit 101 and the first readout circuit 121 are disposed opposite to each other in the vertical direction, and meanwhile, the first photoelectric conversion unit 101 and the first readout circuit 121 on the lower side of the second photoelectric conversion unit 102 are disposed on the same layer, and the lens layer 131 is located right above the layer structure where the second photoelectric conversion unit 102 is located.
In this embodiment, the first conversion unit 101 is an LED, an OLED or a μ -LED, and the second conversion unit 102 is a PD.
Referring to fig. 12-13, fig. 12 is a schematic diagram illustrating a specific structure of the lens layer 131 shown in fig. 11, and fig. 13 is a schematic diagram illustrating an optical path structure when the lens layer 131 is in a condenser state.
As shown in fig. 12, the lens layer 131 is a hyperplane lens (metaplanar lens), and the hyperplane lens in the lens layer 131 includes a plurality of unit structures U, and any desired phase distribution can be accurately obtained by adjusting the size and arrangement of each unit structure U.
Specifically, as shown in fig. 13, the phase distribution required for the hyperplane lens satisfies the formula (1) according to the optical path difference requirement required to reach the lens focal point f:
Figure PCTCN2020088534-APPB-000005
in the formula (1), the center point of the lens is used as the origin of the coordinate system, (x, y) are the coordinates of a certain position on the lens, f is the focal length,
Figure PCTCN2020088534-APPB-000006
to phase, λ is the wavelength of the incident light.
The wavelength λ of the super-planar lens can be controlled by applying different voltages externally or by mechanical means, and the dynamic adjustment of the focal length of the lens layer 131 can be realized by adjusting the phase of the super-planar lens according to the formula.
The phase of the hyperplane lens is adjusted by loading different voltages, namely, the phase shift of incident light is controlled by adjusting the refractive index in the microstructure through different voltages, so that the focal length is changed.
Specifically, when light waves are transmitted in a medium, the transmission speed is lower than the free space wave velocity and is changed into c/n, wherein c is the free space wave velocity, and n is the refractive index of the medium. Under the condition of the same transmission distance, the refractive indexes of the materials are different, the time for delaying the optical wave is different, and the generated phase difference is different.
For example, as shown in fig. 12, the equivalent refractive index of the structural unit of the hyperplane lens can be modulated by a micro varactor or other active devices. In a medium with non-uniform refractive index, the change of adjacent refractive indexes of light waves is delta n, and the phase difference generated by the transmission d length is formula (2):
Figure PCTCN2020088534-APPB-000007
in the formula (2), λ is a free space wavelength.
In other embodiments of the present application, the phase adjustment of the super-planar lens through the mechanical structure includes using a transparent elastic material as a substrate, adjusting different stretching degrees of the elastic film by loading different voltages, and changing the shape of the lens and the period size of the super-surface array during stretching, so that the phase of the super-surface is redistributed, thereby changing the focal length f.
It can be seen that the focal length f of the lens layer 131 can be adjusted in real time according to the requirements of the pixels of the acquired image, so that the definition and quality of the image acquired by the image acquisition module 13 can be ensured.
Referring to fig. 14-15, fig. 14 is a schematic diagram of an optical path of the lens layer in the plane mirror mode shown in fig. 13, and fig. 15 is a schematic diagram of an optical path of the lens layer in the collecting mirror mode shown in fig. 13.
As shown in fig. 14, the hyperplane lens in the mirror sheet 131 makes the phase shift angle of the incident ambient light be 0 °, and the mirror sheet 131 is a plane mirror. At this time, the light emitted from the first photoelectric conversion unit 101 is emitted from the lens layer to the outside of the display panel 11, that is, from the light emitting surface to the external environment. Since the super-plane mirror is a plane mirror, it can be ensured that the light inside the display panel 10 can be accurately emitted from the mirror layer 131 and the light-emitting surface, and abnormal phenomena such as distortion of the light emitted from the first photoelectric conversion unit 101 serving as the sub-Pixel for performing image display will not occur.
As shown in FIG. 15, the hyperplane lens in the lens layer 131 makes the phase shift angle of the incident ambient light be
Figure PCTCN2020088534-APPB-000008
The lens layer 131 is in a condensing lens state, at this time, the ambient light enters the lens layer from the light exit surface and enters the display panel 11, the lens layer converges the ambient light at the same time, and the converged light is transmitted to the second photoelectric conversion unit 102, so that the collected image has better quality.
Please refer to fig. 16, which is a connection diagram of the functional module for driving the display panel shown in fig. 11.
As shown in fig. 16, the control module 100 is electrically connected to the image display driving control circuit 12A, the lens layer 131, the second photoelectric conversion unit 102 and the image capturing driving control circuit 13A. The control module 100 is configured to receive a control instruction provided by the input module, where the control instruction includes instructing the display device to perform image display or acquire an image in the first area A1 of the display interface AA.
When the control module 100 receives a first control instruction for image acquisition, the control module 100 controls the image display drive control circuit 12A to stop outputting image data to the image display module 12, and at the same time, controls the second photoelectric conversion unit 102 to convert the received ambient light into an electrical signal, and the image acquisition drive control circuit 13A reconstructs an image corresponding to the ambient light after processing the electrical signal.
When the control module 100 receives a second control instruction that the image acquisition is completed and the image display is required to be performed, the control module 100 controls the image display driving control circuit 12A to display the image data to be displayed to the image display module to perform the image 12 display, and controls the second photoelectric conversion unit 102 to stop converting the ambient light into the electric signal, that is, stop the image acquisition.
Specifically, the control module 100 is electrically connected to the lens layer 131, and is configured to provide different voltages to the lens layer 131 according to different control commands, and control the lens layer 131 to be in a condensing lens state or a flat lens state.
When the control module 100 receives a first instruction corresponding to image display, the control module 100 provides a first voltage to the lens layer 131 to control the lens layer 131 to be in a flat lens state, and the first instruction indicates that the first area needs to be in an image display state. When the control module 100 receives a second instruction corresponding to image acquisition, the control module 100 provides a second voltage to the lens layer 131 to control the lens layer 131 to be in a condensing lens state, and the second instruction represents that the first area needs to be in an image acquisition state.
Referring to fig. 17-18, fig. 17 is a flowchart illustrating driving of the display panel for image display and acquisition as shown in fig. 11 and 16, and fig. 18 is a timing control diagram illustrating driving of the display panel for image display and acquisition as shown in fig. 11 and 16.
As shown in fig. 17 and 4, when the first area A1 is smaller than the area of the display area AA, the step of driving the display panel to display and collect images includes:
step 1701, a second control instruction instructing the first region to perform image acquisition is received. As shown in fig. 18, the image capturing period Tc is entered from time t2, and the control module 100 receives a control command for image capturing. It should be noted that, between the time t1 and the time t2 before t2, the display interface AA is in an image display state corresponding to the image display time period Td.
Step 1703, the control module 100 outputs a second voltage to the lens layer 131 according to a second control instruction of image acquisition, so that the lens layer 131 is in a condenser state and condenses ambient light; meanwhile, the control module 100 outputs a first control signal to the second photoelectric conversion unit 102 and the image capturing driving control circuit, controls the second photoelectric conversion unit 102 to be turned on, and converts the received ambient light into an electrical signal.
Meanwhile, the control module 100 outputs a first control signal to the first photoelectric conversion unit 101 and the image display driving control circuit 110 to control the image display driving control circuit 110 to stop outputting the image data to the image display module and control the first photoelectric conversion unit 101 not to emit light.
In step 1705, the image acquisition driving control circuit 13A processes the electrical signal to reconstruct an image corresponding to the ambient light. The image acquisition drive control circuit 13A performs amplification, noise reduction, and other transportation processing on the electric signal to obtain an image corresponding to the ambient light.
Step 1707, a first control instruction instructing the first area to display an image is received. As shown in fig. 18, the control module 100 receives a first control instruction for image display starting to enter the image display period Td at time t 3.
Step 1709, according to a first control instruction of image display, the control module 100 correspondingly outputs a second control signal to the image display driving control circuit 12A, and controls the image display driving control circuit 110 to output image data to the image display module 12 and the first photoelectric conversion unit 101, so that the first photoelectric unit 101 emits light according to the image data and performs image display, and at the same time, the control module 100 outputs a first voltage to the lens layer 131, so that the lens layer 131 is in a plane mirror state to assist in performing image display. In this embodiment, the image data output to the image display module 12 for image display may be an image collected by the image collecting module 13.
Meanwhile, the control module 100 outputs a second control signal to the second photoelectric conversion unit 102 and the image capturing driving control circuit 13A to control the second photoelectric conversion unit 102 to be turned off and stop converting the ambient light into an electrical signal, i.e., stop image capturing.
Referring to fig. 19-20, fig. 19 is a flowchart illustrating driving of the display panel for image display and acquisition as shown in fig. 11 and 16, and fig. 20 is a timing control diagram illustrating driving of the display panel for image display and acquisition as shown in fig. 11 and 16.
As shown in fig. 19 and fig. 5, when the areas of the first area AA and the display area AA are the same, the step of driving the display panel 11 to perform image display and acquisition includes:
in step 1901, a second control command for image capture is received. As shown in fig. 20, the image capturing period Tc is started from time t2, and the control module 100 receives a control command for image capturing. It should be noted that, between the time t1 and the time t2 before t2, the display interface AA is in an image display state corresponding to the image display time period Td.
In the image display period Td, the control module 100 receives a first instruction corresponding to image display, the control module 100 supplies a first voltage to the lens layer 131, controls the lens layer 131 to be in a planar lens state, and controls the second photoelectric conversion unit 102 to stop performing photoelectric conversion.
In the image capturing period Tc, the control module 100 receives the second instruction, and the control module 100 alternately outputs the first voltage and the second voltage to the lens layer 131 according to the preset frequency, and simultaneously alternately outputs the first control signal and the second control signal to the first photoelectric conversion unit 101 and the second photoelectric conversion unit 102 according to the preset frequency. That is, the image display module 12 and the image capture module 13 are controlled to alternately perform image display and image capture according to a preset frequency.
Specifically, the second voltage control lens layer 131 is in a condensing lens state and condenses light for ambient light, the first voltage control lens layer 131 is in a planar lens state to assist in executing image display, and meanwhile, the first photoelectric conversion unit 101 is controlled to be in a state where no emergent light is emitted or the emergent light is emitted respectively through the first control signal and the second control signal, and the second photoelectric conversion unit 102 is controlled to be in a state where the execution of photoelectric conversion is started or the stop of the conversion of ambient light into an electrical signal is performed, so that image display and image acquisition are respectively realized.
In this embodiment, the preset frequency is 60HZ, and the user visually displays the interface AA in the image display state at the preset frequency.
In step 1907, a first control instruction instructing the first region to display an image is received. As shown in fig. 20, the entry into the image display period Td is started at time t3, and the control module 100 receives a first control instruction for image display.
Step 1909, according to the first control instruction of image display, the control module 100 correspondingly outputs a second control signal to the image display driving control circuit 12A, and controls the image display driving control circuit 110 to output image data to the image display module 12 and the first photoelectric conversion unit 101, so that the first photoelectric unit 101 emits light according to the image data and performs image display, and at the same time, the control module 100 outputs a first voltage to the lens layer 131, so that the lens layer 131 is in a plane mirror state to assist in performing image display. In this embodiment, the image data output to the image display module 12 for image display may be an image collected by the image collection module 13.
Meanwhile, the control module 100 outputs a second control signal to the second photoelectric conversion unit 102 and the image capturing driving control circuit 13A to control the second photoelectric conversion unit 102 to be turned off and stop converting the ambient light into an electrical signal, i.e., stop image capturing.
Please refer to fig. 21, which is a schematic cross-sectional view taken along line VI-VI in fig. 6 according to a third embodiment of the present application.
The image display module 12 includes a first photoelectric conversion unit 101 and a first reading circuit 131, and the first photoelectric conversion unit 101 is configured to convert image data into an optical signal and emit the optical signal to display an image, or convert ambient light into an electrical signal to perform image capturing.
The first reading circuit 131 is configured to read image data to be displayed from the image display driving control circuit 12A, and output a corresponding driving signal to the first photoelectric conversion unit according to the image data, so as to drive the first photoelectric conversion unit 101 to emit light according to the driving signal to correspondingly display the image data.
Or receives an electrical signal into which the first photoelectric conversion unit 101 converts the optical signal, and transmits the electrical signal to the image pickup drive control circuit.
The image capturing module 13 includes a lens layer 131 and a second photoelectric conversion unit 102. The lens layer 131 is used for transmitting ambient light outside the display panel 11 to the second photoelectric conversion unit 102.
The second photoelectric conversion unit 102 is configured to convert the ambient light into an electrical signal, where the electrical signal is used to reconstruct an image corresponding to the ambient light, or convert the image data into an optical signal and emit the optical signal to display the image.
The first photoelectric conversion unit 101 and the second photoelectric conversion unit 102 emit light rays and receive light rays at different times.
In this embodiment, the first photoelectric conversion unit 101 and the second photoelectric conversion unit 102 are arranged in parallel and at the same layer, the lens layer 131 covers the surfaces of the first photoelectric conversion unit 101 and the second photoelectric conversion unit 102, and the reading circuit 121 is correspondingly arranged on the surfaces of the first photoelectric conversion unit 101 and the second photoelectric conversion unit 102 away from the lens layer 131, and is connected with the first photoelectric conversion unit 101 and the second photoelectric conversion unit 102 to transmit the read image data to the first photoelectric conversion unit 101 and the second photoelectric conversion unit 102 for performing photoelectric conversion.
In this embodiment, the lens layer 131 includes a condensing lens state or a flat lens state. When the lens layer 131 is in a flat mirror state, the phase shift angle of the hyperplane lenses in the lens layer 131 is 0 °, and the lens layer 131 is a flat mirror.
When the lens layer 131 is in the condensing state, the lens layer 131 condenses and transmits the ambient light to the second photoelectric conversion unit 102.
The lens layer 131 is in the state of a condenser lens or the flat lens can be switched by receiving different voltages.
Specifically, a first voltage is provided to the lens layer 131, the lens layer 131 is controlled to be in a planar lens state, and the hyperplane lens enables the phase shift angle of incident ambient light to be 0 ° and is in the planar lens state; the second voltage control hyperplane lens makes the incident ambient light phase shift angle as
Figure PCTCN2020088534-APPB-000009
The planar lens is provided with a condensing lens.
When the first area A1 is in an image display state, the first photoelectric conversion unit 101 and the second photoelectric conversion unit 102 emit light to display an image, and the lens layer 131 is in a planar lens state.
When the first area A1 is in an image capturing state, the first photoelectric conversion unit 101 and the second photoelectric conversion unit 102 stop emitting light, the lens layer 131 is in a condensing lens state, and the ambient light is converged and transmitted to the first photoelectric conversion unit 101 and the second photoelectric conversion unit 102, and the first photoelectric conversion unit 101 and the second photoelectric conversion unit 102 receive and capture the converged ambient light provided by the lens layer 131, and convert the ambient light into an electrical signal and provide the electrical signal to the reading circuit 121.
In this embodiment, the first conversion unit 101 and the second conversion unit 102 are both μ -LEDs, and can convert the electrical signal into the optical signal to perform image display or convert the ambient light into the electrical signal to perform image acquisition in a time-sharing manner.
Please refer to fig. 22, which is a schematic connection diagram of the functional module for driving the display panel shown in fig. 21.
As shown in fig. 22, the control module 100 is electrically connected to the image display driving control circuit 110, the lens layer, the image display driving control circuit 120, the first photoelectric conversion unit 101, and the second photoelectric conversion unit 102.
The control module 100 is configured to receive a control instruction provided by the input module, where the control instruction includes instructing the display device to display an image or acquire an image in the first area A1 of the display interface AA.
The control instruction may be that a user operates a touch screen in the input module, for example, the display interface AA executes image display at the current moment, and when the user needs to take a picture, the user operates and triggers a camera application on the touch screen, so as to output a control instruction for image acquisition to the control module 100.
Further, when the image capture is completed and the user performs the corresponding touch operation again, for example, clicking the position of the "take picture" icon, a control instruction that the image capture is completed and an image display is required is output to the control module 100.
In other embodiments of the present application, the control command may also be a command generated by a user operating a mechanical key, a voice module, a motion sensing module, or a brain wave sensing module of the input module.
The reading circuit 121 is electrically connected to the image display driving control circuit 110 and the image display driving control circuit 120, respectively.
When the control module 100 receives a first control instruction of image acquisition, the control module 100 controls the image display driving control circuit 110 to stop outputting image data to the image display module, and at the same time, controls the lens layer 131 to be in a condenser state, and controls the first photoelectric conversion unit 101 and the second photoelectric conversion unit 102 to convert the received ambient light into an electrical signal, and the image acquisition driving control circuit reconstructs an image corresponding to the ambient light after processing the electrical signal.
When the control module 100 receives a second control instruction that the image acquisition is completed and the image display is required, the control module 100 controls the image display driving control circuit 110 to send image data to be displayed to the image display module 12 for image display, and at the same time, controls the lens layer 131 to be in a plane mirror state, and controls the first photoelectric conversion unit 101 and the second photoelectric conversion unit 102 to stop converting ambient light into an electrical signal, that is, stop the image acquisition.
Specifically, the control module 100 is electrically connected to the lens layer 131, and is configured to provide different voltages to the lens layer 131 according to different control commands and control the lens layer 131 to be in a condensing lens state or a flat lens state.
When the control module 100 receives a first command, a first voltage is provided to the lens layer 131 to control the lens layer 131 to be in a plane lens state, and the first command indicates that the first area needs to be in an image display state.
When the control module 100 receives a second instruction, a second voltage is provided to the lens layer 131 to control the lens layer 131 to be in the condensing lens state, and the second instruction indicates that the first area needs to be in the image capturing state.
Referring to fig. 23, fig. 23 is a schematic diagram illustrating timing control for driving the display panel to perform image display acquisition as shown in fig. 11 and 16.
As shown in fig. 23, when the first region is smaller than the area of the display region.
The control module 100 receives a second control instruction for image acquisition. As shown in fig. 23, at time t2, the control module 100 receives a second control instruction indicating that the first area enters image acquisition, the first area entering an image acquisition period Tc. It should be noted that the display interface AA is in an image display state between times t1-t1 included in the image display period Td before t 2.
The control module 100 outputs a second voltage to the lens layer 131 according to the first control instruction, so that the lens layer 131 is in a condenser state to condense light for ambient light; the first control signal is output to the second photoelectric conversion unit 102 and the image acquisition driving control circuit, and the first photoelectric conversion unit 101 and the second photoelectric conversion unit 102 are controlled to be in a photosensitive state, so that the received ambient light is converted into an electric signal.
Meanwhile, the control module 100 outputs a first control signal to the image display driving control circuit 110 to control the image display driving control circuit 110 to stop outputting the image data to the image display module.
The image acquisition drive control circuit 13A processes the electrical signals and reconstructs an image corresponding to the ambient light.
The control module 100 receives a control instruction for image display. As shown in fig. 23, at time t3, control module 100 receives a first control instruction instructing the first region to perform image display.
The output control module 100 outputs a second control signal to the image display driving control circuit 110 according to the first control instruction, and controls the image display driving control circuit 110 to output image data to the image display module for image display. In this embodiment, the image data output to the image display module for image display may be an image collected by the image collection module.
Meanwhile, the control module 100 outputs a first voltage to the lens layer 131, so that the lens layer 131 is in a plane mirror state to assist in image display; a second control signal is output to the second photoelectric conversion unit 101 and the second photoelectric conversion unit 102 to control both to emit light to perform image display. In this embodiment, the first control signal and the second control signal may multiplex the first voltage and the second voltage to perform control for the first photoelectric conversion unit 101 and the second photoelectric conversion unit 102.
Referring to fig. 24, fig. 24 is a schematic diagram illustrating timing control for driving the display panel to perform image display acquisition as shown in fig. 11 and 16. As shown in fig. 24, when the areas of the first region and the display region are the same:
in the image display period Tc, the control module 100 receives a first instruction, the control module 100 provides a first voltage to the lens layer 131, controls the lens layer 131 to be in a planar lens state to assist in performing classmatic display, and simultaneously controls the first photoelectric conversion unit 101 and the second photoelectric conversion unit 102 to emit light simultaneously to perform display for image data.
In the image capturing time period Td, the control module 100 receives the second instruction, and the control module 100 outputs the first voltage and the second voltage alternately according to the preset frequency. The second voltage control lens layer 131 is in a condenser state to condense light with respect to ambient light, and controls the first photoelectric conversion unit 101 and the second photoelectric conversion unit 102 to be in a photosensitive state to convert the condensed ambient light into an electrical signal; the first voltage control mirror layer 131 is in a flat mirror state to assist image display, and at the same time, controls the first photoelectric conversion unit 101 and the second photoelectric conversion unit 102 to emit light to perform image display. In this embodiment, the preset frequency is 60HZ, and the user visually displays the interface AA in the image display state at this frequency.
The above detailed description is provided for a pixel circuit provided in the embodiments of the present application, and specific examples are applied herein to illustrate the principles and embodiments of the present application, and the above description of the embodiments is only used to help understanding the method and the core idea of the present application; meanwhile, for a person skilled in the art, according to the idea of the present application, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present application.

Claims (16)

  1. A display panel comprises a display area, wherein the display area comprises a plurality of pixel units arranged in a matrix manner, each pixel unit comprises at least one first photoelectric conversion unit for emitting light to display an image, an image acquisition module is arranged between the pixel units in a first area in the display area,
    the image acquisition module includes lens layer and second photoelectric conversion unit, the lens layer be used for with the outside ambient light transmission of display panel extremely second photoelectric conversion unit, second photoelectric conversion unit be used for when the image acquisition state will ambient light converts the signal of telecommunication into, the signal of telecommunication is used for reconstructing the image that ambient light corresponds, wherein, first photoelectric conversion unit outgoing light with second photoelectric conversion unit output the signal of telecommunication timesharing goes on.
  2. The display panel according to claim 1,
    the first area comprises an image display state and an image acquisition state, when the first area is in the image display state, the first photoelectric conversion unit emits light to execute image display, and the second photoelectric conversion unit stops outputting the electric signal; when the first area is in the image acquisition state, the first photoelectric conversion unit stops emitting light, and the second photoelectric conversion unit converts the ambient light into the electric signal;
    the lens layer is a condensing lens and is used for converging and transmitting the ambient light to the second photoelectric conversion unit, and when the first area is in an image collecting state, the second photoelectric conversion unit receives and collects the converged ambient light provided by the lens layer and converts the ambient light into an electric signal.
  3. The display panel according to claim 1, wherein the first photoelectric conversion unit is juxtaposed in the same layer as the lens layer, and the lens layer faces and covers the second photoelectric conversion unit.
  4. The display panel of claim 1 wherein the lens layer comprises a condenser lens state and a flat lens state,
    when the first area is in an image display state, the first photoelectric conversion unit emits light to display an image, the lens layer is in a plane lens state, and the second photoelectric conversion unit stops converting the ambient light into the electric signal;
    when the first area is in an image collecting state, the first photoelectric conversion unit stops emitting light, the lens layer is in a condensing lens state and converges and transmits the ambient light to the second photoelectric conversion unit, and the second photoelectric conversion unit receives and collects the ambient light which is converged and provided by the lens layer and converts the ambient light into an electric signal.
  5. The display panel according to claim 4, further comprising a control module connected to the lens layer, wherein the control module is configured to output different voltages to the lens layer and control the lens layer to be in a condensing lens state or a flat lens state;
    when the control module receives a first instruction, the control module outputs a first voltage to the lens layer and controls the lens layer to be in a plane lens state, and the first instruction is used for indicating the first area to display an image; or
    When the control module receives a second instruction, the control module outputs a second voltage to the lens layer and controls the lens layer to be in a condensing lens state, and the second instruction is used for indicating the first area to acquire an image.
  6. The display panel according to claim 4 or 5,
    the lens layer is a super-planar lens,
    the phase offset angle of the ambient light entering the super-plane lens is controlled to be 0 degrees by the first voltage, and the super-plane lens is a plane mirror;
    the second voltage controls the ambient light to enter the hyperplaneThe phase of the mirror is shifted by an angle of
    Figure PCTCN2020088534-APPB-100001
    The hyperplane lens is provided with a condensing lens and is used for condensing and transmitting the ambient light to the second photoelectric conversion unit, and the phase shift angle is
    Figure PCTCN2020088534-APPB-100002
    For adjusting the focal length required for the currently acquired image.
  7. The display panel according to claim 6, wherein when the first region and the display region have the same shape and area,
    the control module receives a first instruction, provides a first voltage to the lens layer, controls the lens layer to be in a plane lens state, and simultaneously controls the second photoelectric conversion unit to stop executing photoelectric conversion;
    the control module receives a second instruction, the control module alternately outputs a first voltage and a second voltage according to a preset frequency,
    the second voltage controls the first photoelectric conversion unit to stop emitting light, controls the lens layer to be in a condensing lens state, and controls the second photoelectric conversion unit to perform photoelectric conversion on the converged ambient light received from the lens layer.
  8. The display panel according to claim 6, wherein when the first region is smaller than an area of the display region,
    the control module receives a first instruction, provides a first voltage to the lens layer, controls the lens layer to be in a plane lens state, and simultaneously controls the second photoelectric conversion unit to stop executing photoelectric conversion;
    the control module receives a second instruction, the control module outputs a second voltage, the second voltage controls the first photoelectric conversion unit to stop emitting light, the lens layer is controlled to be in a condensing lens state, and the second photoelectric conversion unit is controlled to perform photoelectric conversion on the ambient light received by the lens layer and converged.
  9. The display panel according to claim 8, wherein when the control module receives the first instruction again, the display panel exits the image capture state and enters the image display state.
  10. The display panel according to any one of claims 4 to 9, wherein the first photoelectric conversion unit and the second photoelectric conversion unit are juxtaposed in the same layer, and wherein the lens layer faces and covers the second photoelectric conversion unit.
  11. The display panel according to claim 6,
    the first photoelectric conversion unit is also used for receiving the ambient light in an image acquisition state and converting the ambient light into an electric signal to execute image acquisition;
    the second photoelectric conversion unit is also used for converting image data into optical signals to be emitted in an image display state so as to display images;
    the first photoelectric conversion unit and the second photoelectric conversion unit are micro light emitting diodes.
  12. The display panel according to claim 11, wherein the first photoelectric conversion unit and the second photoelectric conversion unit are juxtaposed in the same layer, and wherein the mirror layer covers the first photoelectric conversion unit and the second photoelectric conversion unit.
  13. The display panel according to claim 11 or 12,
    when the area of the first region is the same as the display region,
    the control module receives a first instruction, provides a first voltage to the lens layer, controls the lens layer to be in a plane lens state, and simultaneously controls the first photoelectric conversion unit and the second photoelectric conversion unit to emit light rays to display an image;
    the control module receives a second instruction, alternately outputs a first voltage and a second voltage according to a preset frequency, the second voltage controls the lens layer to be in a condensing lens state, controls the first photoelectric conversion unit and the second photoelectric conversion unit to stop emitting light, and simultaneously executes photoelectric conversion on converged ambient light received from the lens layer.
  14. The display panel according to claim 11 or 12,
    when the first region is smaller than the area of the display region,
    the control module receives a first instruction, provides a first voltage to the lens layer, controls the lens layer to be in a plane lens state, and simultaneously controls the first photoelectric conversion unit and the second photoelectric conversion unit to emit light rays to display an image;
    the control module receives a second instruction, the control module outputs a second voltage,
    the second voltage controls the lens layer to be in a condensing lens state, controls the first photoelectric conversion unit and the second photoelectric conversion unit to stop emitting light, and simultaneously executes photoelectric conversion on converged ambient light received from the lens layer.
  15. A display terminal is characterized by comprising an input module and the display panel, wherein the input module is used for receiving a control instruction input by the operation of a user and generating a first control instruction and a second control instruction according to the control instruction.
  16. A display device comprising the display panel of any one of the preceding claims.
CN202080099986.6A 2020-04-30 2020-04-30 Display panel, display terminal and display device Pending CN115428063A (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2020/088534 WO2021217676A1 (en) 2020-04-30 2020-04-30 Display panel, display terminal and display device

Publications (1)

Publication Number Publication Date
CN115428063A true CN115428063A (en) 2022-12-02

Family

ID=78373159

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202080099986.6A Pending CN115428063A (en) 2020-04-30 2020-04-30 Display panel, display terminal and display device

Country Status (2)

Country Link
CN (1) CN115428063A (en)
WO (1) WO2021217676A1 (en)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108174071A (en) * 2018-01-23 2018-06-15 深圳市群晖智能科技股份有限公司 A kind of low camera module for accounting for screen rate
CN208271897U (en) * 2018-03-16 2018-12-21 华为技术有限公司 A kind of display screen and display terminal
CN110794604A (en) * 2019-11-29 2020-02-14 武汉华星光电技术有限公司 Display device and manufacturing method thereof
CN110928075A (en) * 2019-12-17 2020-03-27 京东方科技集团股份有限公司 Display device, manufacturing method, and display and camera shooting method
CN111029381A (en) * 2019-12-09 2020-04-17 武汉华星光电半导体显示技术有限公司 Organic light emitting display panel and organic light emitting display device
CN111047996A (en) * 2020-01-03 2020-04-21 武汉天马微电子有限公司 Display module assembly and display device

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101958434B1 (en) * 2011-09-05 2019-03-15 삼성디스플레이 주식회사 Organic light emitting diode display
CN112433561A (en) * 2018-06-29 2021-03-02 中兴通讯股份有限公司 Display screen module, terminal, control method of terminal and computer storage medium

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108174071A (en) * 2018-01-23 2018-06-15 深圳市群晖智能科技股份有限公司 A kind of low camera module for accounting for screen rate
CN208271897U (en) * 2018-03-16 2018-12-21 华为技术有限公司 A kind of display screen and display terminal
CN110794604A (en) * 2019-11-29 2020-02-14 武汉华星光电技术有限公司 Display device and manufacturing method thereof
CN111029381A (en) * 2019-12-09 2020-04-17 武汉华星光电半导体显示技术有限公司 Organic light emitting display panel and organic light emitting display device
CN110928075A (en) * 2019-12-17 2020-03-27 京东方科技集团股份有限公司 Display device, manufacturing method, and display and camera shooting method
CN111047996A (en) * 2020-01-03 2020-04-21 武汉天马微电子有限公司 Display module assembly and display device

Also Published As

Publication number Publication date
WO2021217676A1 (en) 2021-11-04

Similar Documents

Publication Publication Date Title
US9300909B2 (en) Image display apparatus, electronic apparatus, image display system, image acquisition method and program
US20180323243A1 (en) Array substrate, image collection method and display device
US6104431A (en) Visual axis detecting apparatus and method including scanning light source, and image device using same
US10394406B2 (en) Touch display device
US20210232791A1 (en) Display panel, fingerprint identification display module and fingerprint identification method
CN104301647B (en) The display device of different images can be projected on the display region
JPH06342146A (en) Picture display device, semiconductor device and optical instrument
WO2018201693A1 (en) Array substrate, image collecting method and display apparatus
EP2827185B1 (en) Display device with infrared photosensors
US20160147091A1 (en) Optical detection device and method of controlling same
CN110347295B (en) Sensing plate and display with same
WO2021098349A1 (en) Camera module, camera, terminal device and image information determination method
CN109491007B (en) Light guide structure, display device and use method
TW200925965A (en) Display apparatus
US20220075104A1 (en) Image sensor and electronic camera
US20210216148A1 (en) Display device, electronic device and method for driving display device
US20060044451A1 (en) Wide angle lenslet camera
JP4632129B2 (en) Image reading device
JP5459085B2 (en) Image display device, electronic device, image display system, image acquisition method, program
CN110969146B (en) Fingerprint identification component, display substrate, display panel and fingerprint identification method
CN115428063A (en) Display panel, display terminal and display device
KR20080029051A (en) Device having image sensor and method for getting image
EP4060405A1 (en) Electronic device
CN110995902B (en) Electronic device, electronic apparatus, and image processing method
CN114650359A (en) Camera module and electronic equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination