WO2021217676A1 - Display panel, display terminal and display device - Google Patents

Display panel, display terminal and display device Download PDF

Info

Publication number
WO2021217676A1
WO2021217676A1 PCT/CN2020/088534 CN2020088534W WO2021217676A1 WO 2021217676 A1 WO2021217676 A1 WO 2021217676A1 CN 2020088534 W CN2020088534 W CN 2020088534W WO 2021217676 A1 WO2021217676 A1 WO 2021217676A1
Authority
WO
WIPO (PCT)
Prior art keywords
photoelectric conversion
conversion unit
display
lens
lens layer
Prior art date
Application number
PCT/CN2020/088534
Other languages
French (fr)
Chinese (zh)
Inventor
王铠尧
刘永俊
杨晖
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Priority to CN202080099986.6A priority Critical patent/CN115428063A/en
Priority to PCT/CN2020/088534 priority patent/WO2021217676A1/en
Publication of WO2021217676A1 publication Critical patent/WO2021217676A1/en

Links

Images

Classifications

    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G3/00Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
    • G09G3/20Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
    • G09G3/34Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters by control of light from an independent source
    • G09G3/36Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters by control of light from an independent source using liquid crystals

Definitions

  • This application relates to the field of image display and image acquisition, and in particular to a display panel, a display terminal and a display device.
  • an image acquisition device at the position of the display interface is required.
  • a front camera needs to be set on the display interface.
  • the setting of the front camera inevitably occupies a part of the position of the image display interface, which causes the display area of the display interface to be limited, resulting in a relatively small screen occupancy of the display interface.
  • the embodiment of the present application provides a display panel with a relatively large screen and better image collection.
  • a display panel including a display area, the display area includes a plurality of pixel units arranged in a matrix, and each pixel unit includes at least one first device for emitting light to display an image. Photoelectric conversion unit. An image acquisition module is arranged between the pixel units in the first area in the display area.
  • the image acquisition module includes a lens layer and a second photoelectric conversion unit, the lens layer is used to transmit ambient light outside the display panel to the second photoelectric conversion unit, the second photoelectric conversion unit is used to In the acquisition state, the ambient light is converted into an electrical signal, and the electrical signal is used to reconstruct an image corresponding to the ambient light, wherein the light emitted by the first photoelectric conversion unit and the second photoelectric conversion unit output the electrical signal.
  • the signal is time-sharing.
  • the display panel can perform image display and image acquisition in a time-sharing manner, and the display panel can directly multiplex the functions of image display and image acquisition without the need to separately set up image acquisition devices such as cameras to achieve full-screen display and effectively improve the display.
  • the screen-to-body ratio of the interface is time-sharing.
  • the first area includes an image display state and an image acquisition state, and when the first area is in the image display state, the first photoelectric conversion unit emits light to perform image display, so The second photoelectric conversion unit stops outputting the electrical signal.
  • the lens layer is a condensing lens, which is used to converge and transmit the ambient light to the second photoelectric conversion unit.
  • the second photoelectric conversion unit receives and collects it from the second photoelectric conversion unit. The converged ambient light provided by the lens layer converts the ambient light into an electrical signal.
  • the first photoelectric conversion unit and the lens layer are arranged side by side in the same layer, and the lens layer faces and covers the second photoelectric conversion unit. Since the first photoelectric conversion unit and the lens layer are arranged side by side in the same layer, the second photoelectric conversion unit is separated from the first photoelectric conversion unit by at least a structural distance, which can effectively prevent the light emitted by the first photoelectric conversion unit Leak to the second photoelectric conversion unit.
  • the second conversion unit is a photodetector
  • the first conversion unit is a light emitting diode, an organic light emitting diode, or a micro light emitting diode.
  • the lens layer includes a condensing lens state and a flat lens state.
  • the first photoelectric conversion unit emits light to display the image
  • the lens layer is in the flat lens state
  • the second photoelectric conversion unit stops converting the ambient light into all ⁇ Said electrical signal.
  • the first photoelectric conversion unit stops emitting light
  • the lens layer is in the condenser state
  • the ambient light is converged and transmitted to the second photoelectric conversion unit.
  • the second photoelectric conversion unit receives and collects the converged ambient light provided from the lens layer, and converts the ambient light into an electrical signal.
  • the lens layer can present two states: a condensing lens state and a flat lens state, to adapt to the image display state or the image acquisition state of the display panel, it is ensured that the image display quality is better and the collected image quality is better.
  • the display panel further includes a control module connected to the lens layer, and the control module is used to output different voltages to the lens layer and control the lens layer.
  • the lens layer is in a condensing lens state or a flat lens state.
  • the control module receives the first instruction, the control module outputs a first voltage to the lens layer and controls the lens layer to be in a flat lens state, and the first instruction is used to instruct the first Area for image display.
  • the control module receives the second instruction
  • the control module outputs a second voltage to the lens layer and controls the lens layer to be in the state of the condensing lens, and the second instruction is used to instruct the Image acquisition is performed in the first area.
  • the lens layer is a hyperplanar lens.
  • the first voltage controls the phase shift angle of the ambient light entering the hyperplanar lens to 0°
  • the hyperplanar lens is a flat mirror
  • the second voltage controls the ambient light entering the hyperplanar lens
  • the phase shift angle is
  • the hyperplane lens has a condenser lens for condensing and transmitting the ambient light to the second photoelectric conversion unit, and the phase shift angle It is used to adjust the focal length required for the currently acquired image.
  • the lens layer is a hyperplanar lens
  • the refractive index of the lens layer can be accurately controlled by providing different voltages, so as to achieve the control of the incident light phase retardation angle, especially when the hyperplanar lens is in the condenser lens, through the phase retardation of the incident light
  • the control of the angle can adjust the focal length of the hyperplanar lens to ensure that the captured image has a higher definition.
  • the control module when the shape and area of the first area and the display area are the same, receives a first instruction, and the control module provides a first voltage to the lens layer , Controlling the lens layer to be in a flat lens state, and controlling the second photoelectric conversion unit to stop performing photoelectric conversion at the same time.
  • the control module receives the second instruction, and the control module alternately outputs the first voltage and the second voltage according to a preset frequency.
  • the second voltage controls the first photoelectric conversion unit to stop emitting light, and at the same time controls the lens layer to be in the condensing lens state, and controls the second photoelectric conversion unit to control the converged environment received from the lens layer The light performs photoelectric conversion.
  • the preset frequency can be 60HZ, at which the user can visually display the interface In the state of image display, the user's visual experience is guaranteed.
  • the control module when the first area is smaller than the area of the display area, the control module receives a first instruction, and the control module provides a first voltage to the lens layer to control all The lens layer is in a flat lens state, and at the same time, the second photoelectric conversion unit is controlled to stop performing photoelectric conversion.
  • the control module receives a second instruction, the control module outputs a second voltage, the second voltage controls the first photoelectric conversion unit to stop emitting light, and at the same time controls the lens layer to be in a condensing lens state, and
  • the second photoelectric conversion unit is controlled to perform photoelectric conversion on the condensed ambient light received from the lens layer.
  • the area where the multiplexing of the image display and the image acquisition function is performed will not affect the image display of only the image display area when performing the image display, so that the image display and the image acquisition can be performed on the display panel at the same time.
  • control module when the control module receives the first instruction again, it exits the image acquisition state and enters the image display state. After the display panel completes image acquisition, it exits the image acquisition state by receiving an instruction indicating that it returns to the image display state again, and all pixel units in the display area perform image display.
  • the first photoelectric conversion unit and the second photoelectric conversion unit are arranged side by side in the same layer, and the lens layer faces and covers the second photoelectric conversion unit, so that the lens layer and the second photoelectric conversion unit
  • the first photoelectric conversion unit is arranged at a certain distance.
  • the lens layer can assist in transmitting the light emitted by the first photoelectric conversion unit to the outside of the display panel to effectively improve image display brightness.
  • the first conversion unit is a light emitting diode, an organic light emitting diode or a micro light emitting diode
  • the second photoelectric conversion unit is a photodetector
  • the first photoelectric conversion unit is further configured to receive the ambient light in an image acquisition state and convert the ambient light into an electrical signal to perform image acquisition.
  • the second photoelectric conversion unit is also used to convert the image data into a light signal and emit it to display the image in the image display state.
  • the first photoelectric conversion unit and the second photoelectric conversion unit are micro light emitting diodes. Both the first photoelectric conversion unit and the second photoelectric conversion unit can perform image display and image collection in a time-sharing manner, which further improves the resolution and clarity of image display and collection.
  • the first photoelectric conversion unit and the second photoelectric conversion unit are arranged side by side on the same layer, and the lens layer covers the first conversion unit and the second photoelectric conversion unit.
  • the lens layer can simultaneously cover the first photoelectric conversion unit and the second photoelectric conversion unit, which effectively improves the brightness during image display and the fineness of focus adjustment during image capture, thereby ensuring the quality of image capture.
  • the control module when the area of the first area and the display area are the same, receives the first instruction, and the control module provides the first voltage to the lens layer to control The lens layer is in a flat lens state, and the first photoelectric conversion unit and the second photoelectric conversion unit are simultaneously controlled to emit light to display images.
  • the control module receives a second instruction, the control module alternately outputs a first voltage and a second voltage according to a preset frequency, and the second voltage controls the lens layer to be in a condensing lens state, and controls the first The photoelectric conversion unit and the second photoelectric conversion order stop emitting light, and at the same time perform photoelectric conversion of the condensed ambient light received from the lens layer.
  • the preset frequency can be 60HZ, at which the user can visually display the interface In the state of image display, the user's visual experience is guaranteed.
  • the control module when the first area is smaller than the area of the display area, the control module receives a first instruction, and the control module provides a first voltage to the lens layer to control all
  • the lens layer is in a flat lens state, and the first photoelectric conversion unit and the second photoelectric conversion unit are simultaneously controlled to emit light to display images; in the image acquisition state, the control module receives the second instruction, so The control module outputs a second voltage, and the second voltage controls the lens layer to be in a condensing lens state, controls the first photoelectric conversion unit and the second photoelectric conversion order to stop emitting light, and simultaneously
  • the condensed ambient light received by the lens layer performs photoelectric conversion.
  • the area where the multiplexing of the image display and the image acquisition function is performed will not affect the image display of only the image display area when performing the image display, so that the image display and the image acquisition can be performed on the display panel at the same time.
  • a display terminal which includes an input module and the display panel described in any one of the foregoing, and the input module is used to accept a user's operation and input control instructions according to the
  • the control instruction generates the first control instruction and the second control instruction correspondingly.
  • the display panel in the display terminal can multiplex the two functions of image display and image acquisition, so that the screen-to-body ratio of the display panel is effectively increased, and a larger space is provided for realizing a full-screen display.
  • a display device including the display panel described in any one of the foregoing.
  • FIG. 1 is a schematic diagram of a plane structure of a display terminal in an embodiment of the application
  • FIG. 2 is a schematic diagram of a side structure of the display terminal shown in FIG. 1;
  • FIG. 3 is a schematic diagram of the structure of the plane of the display panel shown in FIG. 2;
  • Fig. 4 is a schematic diagram showing the distribution of the image acquisition module shown in Fig. 3 on the display interface;
  • Fig. 5 is a schematic diagram of the image acquisition module distribution on the display interface as shown in Fig. 3;
  • FIG. 6 is a schematic diagram of an enlarged structure of the first area shown in FIG. 1 and FIG. 3;
  • FIG. 7 is a schematic diagram of the cross-sectional structure along the line VI-VI as shown in FIG. 6 in the first embodiment of the application;
  • FIG. 8 is a schematic diagram of the connection between the image display module and the image acquisition module shown in FIG. 7;
  • Fig. 9 is a flowchart of driving the display panel to perform image display acquisition as shown in Figs. 6-7;
  • Figure 10 is a schematic diagram of time sequence control of image display acquisition
  • FIG. 11 is a schematic diagram of the cross-sectional structure along the VI-VI line as shown in FIG. 6 in the second embodiment of the application;
  • FIG. 12 is a schematic diagram of the specific structure of the lens layer as shown in FIG. 11;
  • FIG. 13 is a schematic diagram of the optical path structure of the lens layer in the condenser state as shown in FIG. 11; FIG.
  • Fig. 14 is a schematic diagram of the optical path of the lens layer in the plane mirror mode as shown in Fig. 13;
  • FIG. 15 is a schematic diagram of the optical path of the lens layer in the condenser mode as shown in FIG. 13;
  • FIG. 16 is a schematic diagram of the connection of the driving display panel function module shown in FIG. 11;
  • FIG. 17 is a flowchart of driving the display panel to perform image display collection as shown in FIG. 11 and FIG. 16;
  • FIGS. 11 and 16 are schematic diagrams of timing control for driving the display panel to perform image display acquisition as shown in FIGS. 11 and 16;
  • FIG. 19 is a flowchart of driving the display panel to perform image display acquisition as shown in FIG. 11 and FIG. 16;
  • FIG. 20 is a schematic diagram of timing control for driving the display panel to perform image display acquisition as shown in FIG. 11 and FIG. 16;
  • 21 is a schematic diagram of the cross-sectional structure along the VI-VI line shown in FIG. 6 in the third embodiment of the application;
  • FIG. 22 is a schematic diagram of the connection of the driving display panel function module shown in FIG. 21;
  • FIG. 23 is a schematic diagram of timing control for driving the display panel to perform image display acquisition as shown in FIG. 11 and FIG. 16;
  • FIG. 24 is a schematic diagram of timing control for driving the display panel to perform image display acquisition as shown in FIG. 11 and FIG. 16.
  • FIG. 1 is a schematic diagram of a plane structure of a display terminal in an embodiment of the application.
  • the display terminal 10 includes a display interface (Active Area) AA for performing image display and graphics collection, and an instruction acquisition module for receiving user operations.
  • the operation of the user for the display terminal 10 represents the corresponding control command input by the user.
  • the command acquisition module may be: a mechanical button, a language pickup module, a motion sensor, a brain wave sensor, and an image acquisition module. Group.
  • the shape and size of the light-emitting area on the front of the display interface AA and the display terminal 10 are basically the same, and the display interface AA performs image display according to image data in a time-sharing manner or acquires light in the external environment for image collection.
  • the display interface AA may perform image display and image acquisition in a time-sharing part of the area, or perform image display and image acquisition in a time-sharing manner in all the entire area of the display interface AA. That is, the display terminal 10 can be in an image display state or an image acquisition state in at least a part of the display interface AA in a time-sharing state.
  • the display interface AA can perform image display and image acquisition in a time-sharing manner, and the display interface AA can multiplex the image display.
  • image acquisition there is no need to separately set up an image acquisition device such as a camera to realize a full-screen display and effectively increase the screen-to-body ratio of the display interface.
  • the display interface AA includes a plurality of pixel units P uniformly arranged in an array, and each pixel includes a plurality of sub-pixels (Pixel) arranged at intervals of a preset distance, and each sub-pixel is composed of a first photoelectric conversion unit ( Figure 7 ) Structure, a plurality of sub-pixels Pixel as an image display module 12 (FIG. 3).
  • the display interface AA includes a first area A1.
  • a plurality of second photoelectric conversion units (FIG. 7) are arranged between each sub-pixel Pixel, and the plurality of second photoelectric conversion units are used as an image acquisition module.
  • Group 13 ( Figure 3).
  • the first photoelectric conversion unit and the second photoelectric conversion unit are elements that convert photoelectric signals.
  • the first photoelectric conversion unit converts the image signal into an optical signal to display the image
  • the second photoelectric conversion unit collects the environment and converts the light into an electrical signal to reconstruct the image.
  • FIG. 2 is a schematic diagram of the side structure of the display terminal shown in FIG. 1.
  • the display terminal 10 includes a touch layer TL and a display panel 11 which are laminated.
  • the display panel 11 includes a light-emitting surface 11 a for emitting light, and the touch layer TL is disposed on the surface of the light-emitting surface 11 a of the display panel 11.
  • the touch layer TL is used to sense the user's touch operation.
  • the display panel 11 at least includes an array substrate 111 and a photoelectric conversion layer 112 disposed on the surface of the array substrate 111.
  • the photoelectric conversion layer 112 includes a plurality of photoelectric conversion elements (not shown).
  • the photoelectric conversion elements may be light-emitting diodes (LEDs), organic light-emitting semiconductor materials (Organic Electroluminescence Diodes, OLEDs), and miniature light-emitting diodes. Diode (Micro-Size Light Emitting Diode, ⁇ -LED).
  • the touch layer TL may not need to be provided.
  • FIG. 3 is a schematic diagram of the planar structure of the display panel shown in FIG.
  • the display panel 11 includes an image display module 12 that emits light to display an image and an image capture module 13 that collects ambient light to obtain an image.
  • the image display module 12 is distributed on all the display interfaces AA, and the image acquisition module 13 is distributed on at least a part of the display interface.
  • each pixel includes a plurality of sub-pixels (Pixel) spaced a predetermined distance apart, and each sub-pixel serves as a first photoelectric conversion unit , Used to convert the image signal of the analog electrical signal into an optical signal and emit it.
  • each pixel unit includes at least a red sub-pixel (R), a green sub-pixel (G) and a blue sub-pixel (B) respectively emitting red light, green light and blue light three-color sub-pixels, through the three-color sub-pixel
  • R red sub-pixel
  • G green sub-pixel
  • B blue sub-pixel
  • the red light, green light and blue light emitted by the pixels are mixed with different brightness and gray scales, and each pixel unit can emit colored light, thereby realizing the display interface AA to perform color image display.
  • the image acquisition module 13 is distributed at least in a partial area of the display interface AA.
  • the image acquisition module 13 is distributed between the sub-pixels, and is used to collect ambient light outside the display terminal 10 and convert the ambient light into The electrical signal is processed to reconstruct an image outside the display terminal.
  • the size of the image acquisition module 13 is smaller than the size of the sub-pixels in the image display module.
  • the display terminal 10 also includes an image display drive control circuit 12A for driving the image display module 12 to perform image display, and an image acquisition drive control circuit 13A for driving the image acquisition module 13 to perform image acquisition and reconstruction.
  • the image display drive control circuit 12A and the image capture drive control circuit 13A are arranged in the non-image display area of the display terminal 10.
  • FIG. 4 is a schematic diagram of the image acquisition module distribution on the display interface AA as shown in FIG.
  • the display interface AA includes a first area A1, the first area A1 is smaller than the area of the display interface AA, and the first area A1 can be set at any position of the display interface.
  • the first area A1 includes an image display module and an image acquisition module at the same time, wherein the image acquisition module is distributed between the sub-pixels.
  • FIG. 5 is a schematic diagram of the image acquisition module distribution on the display interface AA as shown in FIG. 3.
  • the display interface AA includes a first area A1, and the area and shape of the first area A1 are the same as the area and shape of the display interface AA, that is, the first area A1 overlaps the display interface AA.
  • the first area A1 and the display interface AA include both an image display module and an image acquisition module, wherein the image acquisition module is distributed between the sub-pixels.
  • FIG. 6 is a schematic diagram of an enlarged structure of the first area A1 shown in FIG. 1 and FIG. 3.
  • the first area A1 of the display interface AA includes a plurality of pixel units P, and each pixel includes a plurality of sub-pixels set at intervals of a preset distance, and each sub-pixel
  • the pixel Pixel is composed of a first photoelectric conversion unit 101, and is used for converting an image signal of an analog electric signal into an optical signal and emitting it.
  • a plurality of second photoelectric conversion units 102 are provided between adjacent sub-pixels Pixel.
  • the second photoelectric conversion unit 102 is used to collect ambient light and convert the light signal into an electrical signal, which can be used to reconstruct an image of the ambient light.
  • the arrangement of the second photoelectric conversion unit 102 and the sub-pixels Pixel can be set according to actual needs.
  • a second photoelectric conversion unit 102 is arranged between two adjacent sub-pixels as shown in FIG. 6, and each sub-pixel The pixel Pixel is surrounded by six second photoelectric conversion units 102 arranged in a rectangular shape.
  • two or more second photoelectric conversion units 102 are arranged between two adjacent sub-pixels Pixel, and the number of second photoelectric conversion units 102 arranged around each sub-pixel Pixel may also be
  • the shape of the four components can also be rhombus, circle or other shapes, and is not limited to this.
  • the first photoelectric conversion unit 101 converts the image signal into an optical signal and emits the displayed image.
  • the second photoelectric conversion unit 102 collects the environment and converts the light into an electrical signal to reconstruct the image in a time-sharing process, that is, the first photoelectric conversion
  • the unit 101 converts an image signal into a light signal and emits an image to display an image
  • the second photoelectric conversion unit 102 stops collecting the ambient light conversion and at the same time stops the electrical signal conversion.
  • the first photoelectric conversion unit 101 stops converting the image signal into an optical signal and emits it.
  • FIG. 7 is a schematic diagram of the cross-sectional structure along the line VI-VI as shown in FIG. 6 in the first embodiment of the application.
  • the image display module 12 includes a first photoelectric conversion unit 101 and a first reading circuit 121, and the first photoelectric conversion unit 101 is used to emit light to display images.
  • the first reading circuit 121 is used to read the image data to be displayed from the image display drive control circuit 12A, and output corresponding drive signals to the first photoelectric conversion unit 101 according to the image data, and drive the first photoelectric conversion unit 101 according to the drive The signal emits light to display the image data accordingly.
  • the image acquisition module 13 includes a lens layer 131 and a second photoelectric conversion unit 102.
  • the lens layer 131 is used to transmit ambient light outside the display panel to the second photoelectric conversion unit 102.
  • the second photoelectric conversion unit 102 is used to convert the ambient light into an electric signal, and the electric signal is used to reconstruct an image corresponding to the ambient light,
  • the lens layer 131 is separated from the second photoelectric conversion unit 102 by a predetermined distance, so that the lens layer converges a sufficient amount of collected ambient light to the second photoelectric conversion unit 102 shown.
  • the first photoelectric conversion unit 101 and the first reading circuit 121 are arranged directly opposite each other.
  • the first photoelectric conversion unit 101 and the lens layer 131 are arranged on the same layer, and the second photoelectric conversion unit 102 is located on the lens layer. 131 is directly below.
  • the same layer arrangement described in this embodiment is that the first photoelectric conversion unit 101 and the lens layer 131 are basically arranged side by side in the same plane.
  • the first photoelectric conversion unit 101 is an LED, OLED or ⁇ -LED
  • the second photoelectric conversion unit 102 is a photodetector (PD)
  • the lens layer is a metamaterial lens (Meta-Lens). ).
  • FIG. 8 is a schematic diagram of the connection between the image display module and the image acquisition module as shown in FIG. 7.
  • control module 100 is electrically connected to the image display drive control circuit 12A, the image capture drive control circuit 13A, and the second photoelectric conversion unit 102.
  • control module 100 is configured to receive a control instruction provided by the input module, and the control instruction includes instructing the display device to perform image display or capture an image in the first area A1 of the display interface AA.
  • the control command can be input by the user touching the touch layer TL in the operation input module.
  • the display interface AA performs image display at the current moment.
  • the camera application program on the touch screen is operated and triggered, thereby outputting a control instruction for image collection to the control module 100.
  • control instruction may also be an instruction generated by a user operating a mechanical button, a voice module, a motion sensing module, or a brain wave sensing module in the input module.
  • control module 100 When the control module 100 receives the control instruction for image capture, the control module 100 controls the image display drive control circuit 12A to stop outputting image data to the image display module 121, and at the same time, controls the ambient light received by the second photoelectric conversion unit 102 It is converted into an electrical signal, and the image acquisition drive control circuit 13A processes the electrical signal and reconstructs the image corresponding to the ambient light.
  • control module 100 When the control module 100 receives the image acquisition completion and the image display control instruction, the control module 100 controls the image display drive control circuit 12A to send the image data to be displayed to the image display module 121 for image display, and at the same time, controls The second photoelectric conversion unit 102 stops converting the ambient light into electrical signals, that is, stops image acquisition.
  • FIG. 9 is a flowchart of driving the display panel to perform image display acquisition as shown in FIGS. 6-7
  • FIG. 10 is a schematic diagram of timing control of image display acquisition.
  • the steps of driving the display panel 11 to display and collect images include:
  • step 901 the control module 100 receives a second control instruction for image collection.
  • the display interface AA in the display terminal 10 enters the image acquisition state of the image acquisition time period Tc, and the control module 100 receives the second control instruction for image acquisition. It should be noted that between t1 and t1 before t2, the display interface AA is in the image display state of the image display time period Td.
  • Step 903 the control module 100 outputs the first control signal to the second photoelectric conversion unit 102 and the image capture drive control circuit 13A according to the second control instruction used to instruct the first area to perform image capture, and controls the second photoelectric conversion unit 102 It is in the open state and converts the received ambient light into electrical signals.
  • control module 100 outputs the first control signal to the image display drive control circuit 110 to control the image display drive control circuit 110 to stop outputting image data to the image display module.
  • Step 905 The image acquisition drive control circuit 13A processes the electrical signal and reconstructs an image corresponding to the ambient light.
  • step 907 the control module 100 receives a first control instruction used to instruct the first area to perform image display. As shown in FIG. 10, at time t3, the control module 100 receives the first control instruction, and the display interface AA in the display terminal 10 enters the image display state of the image display time period Td.
  • step 909 the control module 100 outputs a second control signal to the image display drive control circuit 110 according to the first control instruction, and controls the image display drive control circuit 110 to output image data to the image display module for image display.
  • the image data output to the image display module for image display may be images collected by the image acquisition module.
  • control module 100 outputs a second control signal to the second photoelectric conversion unit 102 and the image capture drive control circuit to control the second photoelectric conversion unit 102 to be in the off state, stop converting the ambient light into electrical signals, that is, stop the image collection.
  • FIG. 11 is a schematic cross-sectional structure diagram along the line VI-VI as shown in FIG. 6 in the second embodiment of the application.
  • the image display module 12 includes a first photoelectric conversion unit 101 and a first reading circuit 121, and the first photoelectric conversion unit 101 is used to emit light to display images.
  • the first reading circuit 121 is used to read the image data to be displayed from the image display drive control circuit 12A, and output a corresponding drive signal according to the image data to the first photoelectric conversion unit 101, and the first photoelectric conversion unit 101 emits according to the drive signal Light to display the image data.
  • the image acquisition module 13 includes a lens layer 131 and a second photoelectric conversion unit 102.
  • the lens layer 131 is used to transmit ambient light outside the display panel 11 to the second photoelectric conversion unit 102.
  • the second photoelectric conversion unit 102 is configured to convert the ambient light into an electrical signal, and the electrical signal is used to reconstruct an image corresponding to the ambient light.
  • the lens layer 131 is separated from the second photoelectric conversion unit 102 by a predetermined distance, so that the lens layer 131 converges a sufficient amount of collected ambient light to the second photoelectric conversion unit 102 shown.
  • the lens layer 131 includes two states: a condenser lens state or a flat lens state.
  • the lens layer 131 When the lens layer 131 is in a plane mirror state, the lens layer 131 causes the incident ambient light to produce a phase shift angle of 0°, and the lens layer 131 is a plane mirror at this time.
  • the lens layer 131 When the lens layer 131 is in the condenser state, the lens layer 131 causes the incident ambient light to generate a certain phase shift angle, thereby converging the incident ambient light, and transmitting the concentrated light to the second photoelectric conversion unit 102.
  • the lens layer 102 is in the condensing lens state or the flat lens can be switched by receiving different voltages or different mechanical pressures.
  • the lens layer 131 to be in the condensing lens state or the flat lens can be: when the first voltage is applied to the lens layer 131, the refractive index of the lens layer 131 under the control of the first voltage is such that the incident The light does not produce a phase shift, and it is in the state of a flat lens, that is, the phase shift angle of the hyperplanar lens with respect to the incident ambient light is 0°; when the second voltage is applied to the lens layer 131, the lens layer 131 is in this state.
  • the refractive index under the control of the first voltage causes the incident light to produce a certain phase shift, that is, the phase shift angle of the hyperplanar lens for the incident ambient light is in, Greater than 0, at this time, the hyperplane lens is a condenser lens.
  • control module 100 receives the second instruction to control the first area A1 to be in the image display state
  • the first photoelectric conversion unit 101 emits light to display the image
  • the lens layer 131 is in the flat lens state
  • the second The photoelectric conversion unit 102 stops converting the ambient light into the electrical signal.
  • the control module 100 When the control module 100 receives the first instruction to control the first area A1 to be in the image acquisition state, the first photoelectric conversion unit 101 stops emitting light, the lens layer 131 is in the condenser state, and the ambient light is concentrated and transmitted to the The second photoelectric conversion unit 102, the second photoelectric conversion unit 102 receives and collects the converged ambient light provided from the lens layer, and converts the ambient light into an electrical signal.
  • the first photoelectric conversion unit 101 and the first reading circuit 121 are arranged upside down, and at the same time, the first photoelectric conversion unit 101 and the first reading circuit 121 on the lower side of the second photoelectric conversion unit 102 are arranged on the same layer.
  • the lens layer 131 is located directly above the layer structure where the second photoelectric conversion unit 102 is located.
  • the first conversion unit 101 is an LED, OLED or ⁇ -LED
  • the second conversion unit 102 is a PD.
  • FIG. 12 is a schematic diagram of the specific structure of the lens layer 131 shown in FIG. 11, and FIG. 13 is a schematic diagram of the optical path structure of the lens layer 131 in the condenser state.
  • the lens layer 131 is a metamaterial lens, and the hyperplane lens in the lens layer 131 includes a plurality of unit structures U. By adjusting the size and arrangement of each unit structure U, the desired value can be accurately obtained. Arbitrary phase distribution.
  • the phase distribution required by the hyperplanar lens satisfies the formula (1):
  • the center point of the lens is the origin of the coordinate system
  • (x, y) is the coordinates of a certain position on the lens
  • f is the focal length
  • Is the phase
  • is the wavelength of the incident light.
  • the wavelength ⁇ of the hyperplane lens can be controlled by externally applying different voltages or mechanically to control the phase. According to the aforementioned formula, the hyperplane lens can dynamically adjust the focal length of the lens layer 131 by adjusting the phase of the hyperplane lens.
  • the hyperplane lens adjusts the phase by applying different voltages, that is, adjusts the refractive index in the microstructure through different voltages, controls the phase shift of the incident light, and thus changes the focal length.
  • the transmission speed when a light wave propagates in a medium, the transmission speed will be less than the free space wave speed, becoming c/n, where c is the free space wave speed and n is the refractive index of the medium.
  • c the free space wave speed
  • n the refractive index of the medium.
  • the refractive index of the material is different, the delay time of the light wave is different, and the phase difference produced is also different.
  • the equivalent refractive index of the structural unit of the hyperplanar lens can be adjusted by miniature varactor diodes or other active devices.
  • the change of adjacent refractive index of light wave is ⁇ n
  • the phase difference produced by the length of transmission d is formula (2):
  • is the free space wavelength
  • the phase adjustment of the hyperplane lens through the mechanical structure includes the use of a transparent elastic material as the substrate, and the different stretching degree of the elastic film is adjusted by applying different voltages, and the shape and superstructure of the lens are changed during the stretching process.
  • the size of the period of the surface array makes the phase of the metasurface redistribute, thereby changing the focal length f.
  • the focal length f of the lens layer 131 can be adjusted in real time according to the requirements of the pixels of the captured image, so as to ensure the clarity and quality of the image captured by the image capturing module 13.
  • FIG. 14 is a schematic diagram of the optical path of the lens layer in the flat lens mode as shown in FIG. 13, and FIG. 15 is a schematic diagram of the optical path of the lens layer in the condenser mode as shown in FIG.
  • the hyperplane lens in the lens layer 131 makes the phase shift angle of the incident ambient light 0°, and the lens layer 131 is a plane lens.
  • the light emitted from the first photoelectric conversion unit 101 is emitted from the lens layer to the outside of the display panel 11, that is, emitted from the light emitting surface to the external environment.
  • the hyperplane mirror is a flat mirror at this time, it can ensure that the light inside the display panel 10 can be accurately emitted from the lens layer 131 and the light-emitting surface, without causing the first photoelectric conversion unit 101 as the sub-pixel to be emitted for execution.
  • the light displayed in the image will not appear distortions and other abnormal phenomena.
  • the hyperplane lens in the lens layer 131 makes the phase shift angle of the incident ambient light
  • the lens layer 131 is in a condensing lens state. At this time, ambient light enters the lens layer from the light exit surface and enters the interior of the display panel 11.
  • the lens layer condenses the ambient light at the same time, and transmits the condensed light to the second photoelectric conversion unit 102. Ensure that the collected images have better quality.
  • FIG. 16 is a schematic diagram of the connection of the driving display panel function module shown in FIG. 11.
  • control module 100 is electrically connected to the image display drive control circuit 12A, the lens layer 131, the second photoelectric conversion unit 102, and the image capture drive control circuit 13A.
  • the control module 100 is used to receive control instructions provided by the input module.
  • the control instructions shown include instructing the display device to perform image display or capture images in the first area A1 of the display interface AA.
  • control module 100 When the control module 100 receives the first control instruction for image capture, the control module 100 controls the image display drive control circuit 12A to stop outputting image data to the image display module 12, and at the same time, controls the second photoelectric conversion unit 102 to receive The ambient light is converted into an electrical signal, and the image acquisition drive control circuit 13A processes the electrical signal and reconstructs an image corresponding to the ambient light.
  • control module 100 When the control module 100 receives the second control instruction that the image acquisition is complete and the image display is required, the control module 100 controls the image display drive control circuit 12A to send the image data to be displayed to the image display module for image 12 display, and at the same time , Controlling the second photoelectric conversion unit 102 to stop converting the ambient light into electrical signals, that is, to stop image collection.
  • control module 100 is electrically connected to the lens layer 131 for providing different voltages to the lens layer 131 according to different control commands, and controlling the lens layer 131 to be in a condensing lens state or a flat lens state.
  • the control module 100 When the control module 100 receives the first instruction corresponding to the image display, the control module 100 provides a first voltage to the lens layer 131 to control the lens layer 131 to be in a flat lens state, and the first instruction represents the first The area needs to be in the image display state.
  • the control module 100 receives a second instruction corresponding to image capture, the control module 100 provides a second voltage to the lens layer 131 to control the lens layer 131 to be in a condensing lens state, and the second instruction represents the first The area needs to be in the image acquisition state.
  • Figure 17 is a flowchart of driving the display panel for image display acquisition as shown in Figure 11 and Figure 16
  • Figure 18 is the timing of driving the display panel for image display acquisition as shown in Figure 11 and Figure 16. Control diagram.
  • the steps of driving the display panel to perform image display collection include:
  • Step 1701 Receive a second control instruction instructing the first area to perform image collection.
  • the image acquisition time period Tc is entered from time t2, and the control module 100 receives a control instruction for image acquisition. It should be noted that between t1 and t2 before t2, the display interface AA is in the image display state corresponding to the image display time period Td.
  • step 1703 the control module 100 outputs the second voltage to the lens layer 131 according to the second control command for image acquisition, so that the lens layer 131 is in the condenser state and condenses the ambient light; at the same time, the control module 100 outputs the first control signal to the second photoelectric conversion unit 102 and the image acquisition drive control circuit, controls the second photoelectric conversion unit 102 to turn on, and converts the received ambient light into electrical signals.
  • control module 100 outputs the first control signal to the first photoelectric conversion unit 101 and the image display drive control circuit 110 to control the image display drive control circuit 110 to stop outputting image data to the image display module, and to control the first photoelectric conversion The cell 101 does not emit light.
  • step 1705 the image acquisition drive control circuit 13A processes the electrical signal and reconstructs the image corresponding to the ambient light.
  • the image acquisition drive control circuit 13A performs amplification, noise reduction, and other transportation processing on the electrical signal to obtain an image corresponding to the ambient light.
  • Step 1707 Receive a first control instruction instructing the first area to perform image display.
  • the image display time period Td is entered at time t3, and the control module 100 receives the first control instruction for image display.
  • Step 1709 according to the first control instruction for image display, the control module 100 correspondingly outputs a second control signal to the image display drive control circuit 12A, and controls the image display drive control circuit 110 to output image data to the image display module 12 and the first photoelectric
  • the conversion unit 101 causes the first photoelectric unit 101 to emit light according to image data and perform image display.
  • the control module 100 outputs the first voltage to the lens layer 131 so that the lens layer 131 is in a flat mirror state to assist in performing image display.
  • the image data output to the image display module 12 for image display may be an image acquired by the image acquisition module 13.
  • control module 100 outputs a second control signal to the second photoelectric conversion unit 102 and the image capture drive control circuit 13A to control the second photoelectric conversion unit 102 to turn off and stop converting ambient light into electrical signals, that is, stop image capture .
  • Figure 19 is a flowchart of driving the display panel for image display acquisition as shown in Figure 11 and Figure 16
  • Figure 20 is the timing of driving the display panel for image display acquisition as shown in Figure 11 and Figure 16. Control diagram.
  • the steps of driving the display panel 11 to perform image display collection include:
  • Step 1901 Receive a second control instruction for image collection.
  • the image acquisition time period Tc is entered from time t2, and the control module 100 receives a control instruction for image acquisition. It should be noted that between t1 and t2 before t2, the display interface AA is in the image display state corresponding to the image display time period Td.
  • the control module 100 receives the first instruction corresponding to the image display, and the control module 100 provides the first voltage to the lens layer 131, controls the lens layer 131 to be in a flat lens state, and controls the second photoelectric
  • the conversion unit 102 stops performing photoelectric conversion.
  • the control module 100 receives the second instruction, the control module 100 alternately outputs the first voltage and the second voltage to the lens layer 131 according to the preset frequency, and at the same time, alternately outputs the first control according to the preset frequency
  • the signal and the second control signal are sent to the first photoelectric conversion unit 101 and the second photoelectric conversion unit 102. That is, the image display module 12 and the image acquisition module 13 are controlled to alternately perform image display and image acquisition according to a preset frequency.
  • the second voltage control lens layer 131 is in the condensing lens state to condense the ambient light
  • the first voltage control lens layer 131 is in the flat lens state to assist in performing image display.
  • the first photoelectric conversion unit 101 is controlled to not emit light or the emitted light emits light
  • the second photoelectric conversion unit 102 is controlled to be turned on to perform photoelectric conversion or turned off to stop the conversion of ambient light into electrical signals, thereby respectively realizing image display and image display. collection.
  • the preset frequency is 60 Hz, and this frequency allows the user to visually display the interface AA in an image display state.
  • Step 1907 Receive a first control instruction instructing the first area to perform image display. As shown in FIG. 20, at time t3, the image display time period Td is entered, and the control module 100 receives the first control instruction for image display.
  • Step 1909 according to the first control instruction for image display, the control module 100 correspondingly outputs a second control signal to the image display drive control circuit 12A, and controls the image display drive control circuit 110 to output image data to the image display module 12 and the first photoelectric
  • the conversion unit 101 causes the first photoelectric unit 101 to emit light according to image data and perform image display.
  • the control module 100 outputs the first voltage to the lens layer 131 so that the lens layer 131 is in a flat mirror state to assist in performing image display.
  • the image data output to the image display module 12 for image display may be an image acquired by the image acquisition module 13.
  • control module 100 outputs a second control signal to the second photoelectric conversion unit 102 and the image capture drive control circuit 13A to control the second photoelectric conversion unit 102 to turn off and stop converting ambient light into electrical signals, that is, stop image capture .
  • FIG. 21 is a schematic diagram of the cross-sectional structure along the VI-VI line shown in FIG. 6 in the third embodiment of the present application.
  • the image display module 12 includes a first photoelectric conversion unit 101 and a first reading circuit 131.
  • the first photoelectric conversion unit 101 is used to convert image data into light signals and output and display images, or convert ambient light into electrical signals to execute images collection.
  • the first reading circuit 131 is used to read the image data to be displayed from the image display drive control circuit 12A, and output a corresponding drive signal to the first photoelectric conversion unit according to the image data, and drive the first photoelectric conversion unit 101 to emit according to the drive signal The light can display the image data accordingly.
  • the electrical signal converted from the optical signal by the first photoelectric conversion unit 101 is received, and the electrical signal is transmitted to the image capture drive control circuit.
  • the image acquisition module 13 includes a lens layer 131 and a second photoelectric conversion unit 102.
  • the lens layer 131 is used to transmit ambient light outside the display panel 11 to the second photoelectric conversion unit 102.
  • the second photoelectric conversion unit 102 is configured to convert the ambient light into an electric signal, and the electric signal is used to reconstruct an image corresponding to the ambient light, or convert it into an optical signal according to image data, and emit a display image.
  • the first photoelectric conversion unit 101 and the second photoelectric conversion unit 102 emit light and receive light at different times.
  • the first photoelectric conversion unit 101 and the second photoelectric conversion unit 102 are arranged side by side in the same layer, and the lens layer 131 covers the surfaces of the first photoelectric conversion unit 101 and the second photoelectric conversion unit 102.
  • the reading circuit 121 Correspondingly arranged on the surface of the first photoelectric conversion unit 101 and the second photoelectric conversion unit 102 away from the lens layer 131, and are connected with the first photoelectric conversion unit 101 and the second photoelectric conversion unit 102 to transmit the read image data to the first photoelectric conversion unit 101 and the second photoelectric conversion unit 102.
  • the photoelectric conversion unit 101 and the second photoelectric conversion unit 102 perform photoelectric conversion.
  • the lens layer 131 includes two states: a condenser lens state or a flat lens state.
  • a condenser lens state When the lens layer 131 is in a plane mirror state, the phase offset angle of the hyperplane lens in the lens layer 131 is 0°, and the lens layer 131 is a plane lens.
  • the lens layer 131 When the lens layer 131 is in the condenser state, the lens layer 131 converges and transmits the ambient light to the second photoelectric conversion unit 102.
  • the lens layer 131 is in a condensing lens state or a flat lens can be switched by receiving different voltages.
  • a first voltage is provided to the lens layer 131, and the lens layer 131 is controlled to be in a flat lens state.
  • the hyperplane lens makes the incident ambient light phase shift angle of 0° and is in the flat lens state; the second voltage controls the hyperplane The lens makes the incident ambient light phase shift angle by The plane lens has a condenser lens.
  • the first photoelectric conversion unit 101 and the second photoelectric conversion unit 102 emit light to display an image, and the lens layer 131 is in a flat lens state.
  • the first photoelectric conversion unit 101 and the second photoelectric conversion unit 102 stop emitting light
  • the lens layer 131 is in the condenser state
  • the ambient light is concentrated and transmitted to the first
  • the photoelectric conversion unit 101 and the second photoelectric conversion unit 102, the first photoelectric conversion unit 101 and the second photoelectric conversion unit 102 receive and collect the converged ambient light provided from the lens layer 131, and combine the ambient light
  • the light is converted into electrical signals and provided to the reading circuit 121.
  • the first conversion unit 101 and the second conversion unit 102 are both ⁇ -LEDs, which can time-sharing convert electrical signals into optical signals to perform image display or convert ambient light into electrical signals to perform image acquisition.
  • FIG. 22 is a schematic diagram of the connection of the driving display panel function module shown in FIG. 21.
  • control module 100 is electrically connected to the image display drive control circuit 110, the lens layer, the image display drive control circuit 120, the first photoelectric conversion unit 101 and the second photoelectric conversion unit 102.
  • control module 100 is configured to receive a control instruction provided by the input module, and the control instruction includes instructing the display device to perform image display or capture an image in the first area A1 of the display interface AA.
  • the control instruction can be the user's touch screen in the input module.
  • the display interface AA executes image display at the current moment.
  • the camera application program on the touch screen is operated and triggered to output the control instruction for image collection to the control module. Group 100.
  • control instruction for image display is output to the control module 100 after the image acquisition is completed.
  • control instruction may also be an instruction generated by a user operating a mechanical button, a voice module, a motion sensing module, or a brain wave sensing module in the input module.
  • the reading circuit 121 is electrically connected to the image display driving control circuit 110 and the image display driving control circuit 120 respectively.
  • control module 100 When the control module 100 receives the first control instruction for image capture, the control module 100 controls the image display drive control circuit 110 to stop outputting image data to the image display module, and at the same time, controls the lens layer 131 to be in the condenser state, and controls the first A photoelectric conversion unit 101 and a second photoelectric conversion unit 102 convert the received ambient light into electrical signals, and the image acquisition drive control circuit processes the electrical signals and reconstructs an image corresponding to the ambient light.
  • control module 100 When the control module 100 receives the second control instruction that the image acquisition is completed and the image display needs to be performed, the control module 100 controls the image display drive control circuit 110 to send the image data to be displayed to the image display module 12 for image display, and at the same time , Controlling the lens layer 131 to be in a plane mirror state, and controlling the first photoelectric conversion unit 101 and the second photoelectric conversion unit 102 to stop converting ambient light into electrical signals, that is, stop image collection.
  • control module 100 is electrically connected to the lens layer 131 for providing different voltages to the lens layer 131 according to different control commands and controlling the lens layer 131 to be in a condensing lens state or a flat lens state.
  • control module 100 When the control module 100 receives the first command, it provides a first voltage to the lens layer 131 to control the lens layer 131 to be in a flat lens state.
  • the first command indicates that the first area needs to be in an image display state.
  • control module 100 When the control module 100 receives the second instruction, it provides a second voltage to the lens layer 131 to control the lens layer 131 to be in the condensing lens state.
  • the second instruction indicates that the first area needs to be in the image acquisition state.
  • FIG. 23 is a schematic diagram of timing control for driving the display panel to perform image display acquisition as shown in FIG. 11 and FIG. 16.
  • the control module 100 receives the second control instruction for image collection. As shown in FIG. 23, at time t2, the control module 100 receives a second control instruction instructing the first area to enter the image capture, and the first area enters the image capture period Tc. It should be noted that the display interface AA is in the image display state between t1-t1 included in the image display time period Td before t2.
  • the control module 100 outputs a second voltage to the lens layer 131 according to the first control instruction, so that the lens layer 131 is in the condenser state to condense light from the ambient light; outputs the first control signal to the second photoelectric conversion unit 102 and the image capture driver
  • the control circuit controls the first photoelectric conversion unit 101 and the second photoelectric conversion unit 102 to be in a photosensitive state to convert the received ambient light into electrical signals.
  • control module 100 outputs the first control signal to the image display drive control circuit 110 to control the image display drive control circuit 110 to stop outputting image data to the image display module.
  • the image acquisition drive control circuit 13A processes the electrical signal and reconstructs the image corresponding to the ambient light.
  • the control module 100 receives a control command for image display. As shown in FIG. 23, at time t3, the control module 100 receives a first control instruction instructing the first area to perform image display.
  • the control module 100 outputs a second control signal to the image display drive control circuit 110, and controls the image display drive control circuit 110 to output image data to the image display module for image display.
  • the image data output to the image display module for image display may be images collected by the image acquisition module.
  • the control module 100 outputs the first voltage to the lens layer 131 so that the lens layer 131 is in a flat mirror state to assist in image display; and outputs a second control signal to the second photoelectric conversion unit 101 and the second photoelectric conversion unit 102 to Both are controlled to emit light to perform image display.
  • the first control signal and the second control signal can multiplex the first voltage and the second voltage to perform control of the first photoelectric conversion unit 101 and the second photoelectric conversion unit 102.
  • FIG. 24 is a schematic diagram of timing control for driving the display panel to perform image display acquisition as shown in FIG. 11 and FIG. 16. As shown in FIG. 24, when the area of the first area and the display area are the same:
  • the control module 100 receives the first command, and the control module 100 provides the first voltage to the lens layer 131, controls the lens layer 131 to be in a flat lens state to assist students in displaying, and at the same time controls the first
  • the photoelectric conversion unit 101 and the second photoelectric conversion unit 102 emit light at the same time to display image data.
  • the control module 100 receives the second instruction, and the control module 100 alternately outputs the first voltage and the second voltage according to the preset frequency.
  • the second voltage controls the lens layer 131 to be in the condensing lens state to condense the ambient light, while controlling the first photoelectric conversion unit 101 and the second photoelectric conversion unit 102 to be in a photosensitive state to convert the concentrated ambient light into electrical signals; the first voltage
  • the lens layer 131 is controlled to be in a flat mirror state to assist in image display, and at the same time, the first photoelectric conversion unit 101 and the second photoelectric conversion unit 102 are controlled to emit light to perform image display.
  • the preset frequency is 60 Hz, and this frequency allows the user to visually display the interface AA in an image display state.

Landscapes

  • Engineering & Computer Science (AREA)
  • Chemical & Material Sciences (AREA)
  • Crystallography & Structural Chemistry (AREA)
  • Physics & Mathematics (AREA)
  • Computer Hardware Design (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Control Of El Displays (AREA)
  • Electroluminescent Light Sources (AREA)

Abstract

A display panel (11) for increasing the screen-to-body ratio and capable of performing image display and image acquisition in a time-sharing manner, wherein the display panel (11) comprises a plurality of pixel units (P) arranged in a matrix, and each pixel unit (P) comprises at least one first photoelectric conversion unit (101) used for emitting light so as to display an image. An image acquisition module (13) is provided between the pixel units (P) in at least a part of a display region. The image acquisition module (13) comprises a lens layer (131) for acquiring ambient light and a second photoelectric conversion unit (102) for converting the ambient light into an electrical signal, the electrical signal being used to reconstruct an image corresponding to the ambient light. The emission of the light by the first photoelectric conversion unit (101) and the outputting of the electrical signal by the second photoelectric conversion unit (102) are performed in a time-sharing manner, and the display panel (11) multiplexes image display and image acquisition functions in a part of the display region. The present application further relates to a display terminal and display device comprising the display panel (11).

Description

显示面板、显示终端与显示装置Display panel, display terminal and display device 技术领域Technical field
本申请涉及图像显示与图像采集领域,特别是涉及一种显示面板、显示终端与显示装置。This application relates to the field of image display and image acquisition, and in particular to a display panel, a display terminal and a display device.
背景技术Background technique
在自发光显示面板显示图像的过程中,为了实现正对用户的图像显示界面能够采集到图像,需要单独在显示界面的位置的图像采集装置,例如需要再显示界面设置前置摄像头。显然,前置摄像头的设置势必占用部分图像显示界面的位置,由此造成显示界面的显示面积受限,导致显示界面的屏占比较小。In the process of displaying images on the self-luminous display panel, in order to realize that the image display interface facing the user can collect images, an image acquisition device at the position of the display interface is required. For example, a front camera needs to be set on the display interface. Obviously, the setting of the front camera inevitably occupies a part of the position of the image display interface, which causes the display area of the display interface to be limited, resulting in a relatively small screen occupancy of the display interface.
发明内容Summary of the invention
本申请实施例提供一种屏占比较大且采集图像较佳的显示面板。The embodiment of the present application provides a display panel with a relatively large screen and better image collection.
在本申请一种实现方式中,提供一种显示面板,包括显示区域,所述显示区域包括多个呈矩阵排列的像素单元,每一个像素单元包括至少一个用于出射光线以显示图像的第一光电转换单元。所述显示区域内的第一区域中像素单元之间设置有图像采集模组。所述图像采集模组包括镜片层与第二光电转换单元,所述镜片层用于将显示面板外部的环境光线传输至所述第二光电转换单元,所述第二光电转换单元用于在图像采集状态时将所述环境光线转换为电信号,所述电信号用于重构环境光线对应的图像,其中,所述第一光电转换单元出射光线与所述第二光电转换单元输出所述电信号分时进行。由此,显示面板能够分时执行图像显示与图像采集,那么显示面板就能够直接复用图像显示与图像采集的功能,而无需单独设置摄像头等图像采集装置,实现全面屏显示以及能够有效提高显示界面的屏占比。In an implementation manner of the present application, a display panel is provided, including a display area, the display area includes a plurality of pixel units arranged in a matrix, and each pixel unit includes at least one first device for emitting light to display an image. Photoelectric conversion unit. An image acquisition module is arranged between the pixel units in the first area in the display area. The image acquisition module includes a lens layer and a second photoelectric conversion unit, the lens layer is used to transmit ambient light outside the display panel to the second photoelectric conversion unit, the second photoelectric conversion unit is used to In the acquisition state, the ambient light is converted into an electrical signal, and the electrical signal is used to reconstruct an image corresponding to the ambient light, wherein the light emitted by the first photoelectric conversion unit and the second photoelectric conversion unit output the electrical signal. The signal is time-sharing. As a result, the display panel can perform image display and image acquisition in a time-sharing manner, and the display panel can directly multiplex the functions of image display and image acquisition without the need to separately set up image acquisition devices such as cameras to achieve full-screen display and effectively improve the display. The screen-to-body ratio of the interface.
在本申请一种实现方式中,所述第一区域包括图像显示状态与图像采集状态,所述第一区域处于所述图像显示状态时,所述第一光电转换单元出射光线执行图像显示,所述第二光电转换单元停止输出所述电信号。所述第一区域处于所述图像采集状态时,所述第一光电转换单元停止出射光线,所述第二光电转换单元将所述环境光线转换为所述电信号。所述镜片层为聚光镜片,用于将所述环境光线汇聚传输至所述第二光电转换单元,当所述第一区域处于图像采集状态时,所述第二光电转换单元接收并采集自所述镜片层提供的经汇聚后的所述环境光线,并将所述环境光线转换为电信号。In an implementation manner of the present application, the first area includes an image display state and an image acquisition state, and when the first area is in the image display state, the first photoelectric conversion unit emits light to perform image display, so The second photoelectric conversion unit stops outputting the electrical signal. When the first area is in the image acquisition state, the first photoelectric conversion unit stops emitting light, and the second photoelectric conversion unit converts the ambient light into the electrical signal. The lens layer is a condensing lens, which is used to converge and transmit the ambient light to the second photoelectric conversion unit. When the first area is in an image capture state, the second photoelectric conversion unit receives and collects it from the second photoelectric conversion unit. The converged ambient light provided by the lens layer converts the ambient light into an electrical signal.
在本申请一种实现方式中,所述第一光电转换单元与所述镜片层同一层并列设置,所述镜片层正对并覆盖所述第二光电转换单元。由于所述第一光电转换单元与所述镜片层同一层并列设置,那么第二光电转换单元就与第一光电转换单元间隔至少一层结构的距离,能够有效防止第一光电转换单元出射的光线泄露至第二光电转换单元。In an implementation manner of the present application, the first photoelectric conversion unit and the lens layer are arranged side by side in the same layer, and the lens layer faces and covers the second photoelectric conversion unit. Since the first photoelectric conversion unit and the lens layer are arranged side by side in the same layer, the second photoelectric conversion unit is separated from the first photoelectric conversion unit by at least a structural distance, which can effectively prevent the light emitted by the first photoelectric conversion unit Leak to the second photoelectric conversion unit.
在本申请一种实现方式中,所述第二转换单元为光电探测器,所述第一转换单元为发光二极管、有机发光二极管或者微发光二极管。In an implementation manner of the present application, the second conversion unit is a photodetector, and the first conversion unit is a light emitting diode, an organic light emitting diode, or a micro light emitting diode.
在本申请一种实现方式中,所述镜片层包括聚光镜片状态与平面镜片状态。当所述第 一区域处于图像显示状态时,所述第一光电转换单元出射光线以显示图像,所述镜片层处于平面镜片状态,所述第二光电转换单元停止将所述环境光线转换为所述电信号。当所述第一区域处于图像采集状态时,所述第一光电转换单元停止出射光线,所述镜片层处于聚光镜状态,并将所述环境光线汇聚传输至所述第二光电转换单元,所述第二光电转换单元接收并采集自所述镜片层提供的经汇聚后的所述环境光线,并将所述环境光线转换为电信号。In an implementation manner of the present application, the lens layer includes a condensing lens state and a flat lens state. When the first area is in the image display state, the first photoelectric conversion unit emits light to display the image, the lens layer is in the flat lens state, and the second photoelectric conversion unit stops converting the ambient light into all述电信号。 Said electrical signal. When the first area is in the image capturing state, the first photoelectric conversion unit stops emitting light, the lens layer is in the condenser state, and the ambient light is converged and transmitted to the second photoelectric conversion unit. The second photoelectric conversion unit receives and collects the converged ambient light provided from the lens layer, and converts the ambient light into an electrical signal.
由于所述镜片层能够呈现聚光镜片状态与平面镜片状态两种状态,以适应显示面板处于图像显示状态或者图像采集状态,保证了图像显示品质较佳、采集的图像品质较佳。Since the lens layer can present two states: a condensing lens state and a flat lens state, to adapt to the image display state or the image acquisition state of the display panel, it is ensured that the image display quality is better and the collected image quality is better.
在本申请一种实现方式中,所述显示面板还包括控制模组,所述控制模组连接于所述镜片层,所述控制模组用于输出不同的电压至所述镜片层并控制所述镜片层处于聚光镜片状态或者平面镜片状态。当所述控制模组接收到第一指令时,所述控制模组输出第一电压至所述镜片层并控制所述镜片层处于平面镜片状态,所述第一指令用于指示所述第一区域进行图像显示。或者,当所述控制模组接收到第二指令时,所述控制模组输出第二电压至所述镜片层并控制所述镜片层处于聚光镜片状态,所述第二指令用于指示所述第一区域进行图像采集。依据对应图像显示状态与图像采集状态的指令来提供不同的电压至镜片层,从而准确控制镜片层的折射率来针对入射光相位的控制,保证准确匹配于显示面板的图像显示状态或者图像采集状态。In an implementation manner of the present application, the display panel further includes a control module connected to the lens layer, and the control module is used to output different voltages to the lens layer and control the lens layer. The lens layer is in a condensing lens state or a flat lens state. When the control module receives the first instruction, the control module outputs a first voltage to the lens layer and controls the lens layer to be in a flat lens state, and the first instruction is used to instruct the first Area for image display. Or, when the control module receives the second instruction, the control module outputs a second voltage to the lens layer and controls the lens layer to be in the state of the condensing lens, and the second instruction is used to instruct the Image acquisition is performed in the first area. Provide different voltages to the lens layer according to the instructions corresponding to the image display state and the image acquisition state, so as to accurately control the refractive index of the lens layer to control the phase of incident light and ensure that it accurately matches the image display state or image acquisition state of the display panel .
在本申请一种实现方式中,所述镜片层为超平面透镜。所述第一电压控制所述环境光线进入所述超平面透镜的相位偏移角度为0°,所述超平面透镜为平面镜,所述第二电压控制所述环境光线进入所述超平面透镜的相位偏移角度为
Figure PCTCN2020088534-appb-000001
所述超平面透镜为具有聚光透镜,用于将所述环境光线汇聚并透射至所述第二光电转换单元,所述相位偏移角度
Figure PCTCN2020088534-appb-000002
用于调整当前采集图像所需的焦距。由于镜片层为超平面透镜,通过提供不同的电压即可准确控制镜片层的折射率,从而达到针对入射光相位延迟角度的控制,尤其超平面透镜处于聚光透镜时,通过针对入射光相位延迟角度的控制就能够使得超平面透镜的焦距进行调整,保证采集的图像具有较高的清晰度。
In an implementation manner of the present application, the lens layer is a hyperplanar lens. The first voltage controls the phase shift angle of the ambient light entering the hyperplanar lens to 0°, the hyperplanar lens is a flat mirror, and the second voltage controls the ambient light entering the hyperplanar lens The phase shift angle is
Figure PCTCN2020088534-appb-000001
The hyperplane lens has a condenser lens for condensing and transmitting the ambient light to the second photoelectric conversion unit, and the phase shift angle
Figure PCTCN2020088534-appb-000002
It is used to adjust the focal length required for the currently acquired image. Since the lens layer is a hyperplanar lens, the refractive index of the lens layer can be accurately controlled by providing different voltages, so as to achieve the control of the incident light phase retardation angle, especially when the hyperplanar lens is in the condenser lens, through the phase retardation of the incident light The control of the angle can adjust the focal length of the hyperplanar lens to ensure that the captured image has a higher definition.
在本申请一种实现方式中,当第一区域与所述显示区域的形状与面积相同时,所述控制模组接收到第一指令,所述控制模组提供第一电压至所述镜片层,控制所述镜片层处于平面镜片状态,同时控制所述第二光电转换单元停止执行光电转换。所述控制模组接收到第二指令,所述控制模组按照预设频率交替输出第一电压与第二电压。所述第二电压控制所述第一光电转换单元停止出射光线,同时控制所述镜片层处于聚光镜片状态,以及控制所述第二光电转换单元将自所述镜片层接收的经过汇聚后的环境光线执行光电转换。其中,由于第一区域扩展至整个显示界面,为了保证显示面板在执行图像采集的同时也不影响用户查看图像,所述预设频率可为60HZ,在该频率下使得用户在视觉上显示界面保持在图像显示的状态,保证用户的视觉体验。In an implementation of the present application, when the shape and area of the first area and the display area are the same, the control module receives a first instruction, and the control module provides a first voltage to the lens layer , Controlling the lens layer to be in a flat lens state, and controlling the second photoelectric conversion unit to stop performing photoelectric conversion at the same time. The control module receives the second instruction, and the control module alternately outputs the first voltage and the second voltage according to a preset frequency. The second voltage controls the first photoelectric conversion unit to stop emitting light, and at the same time controls the lens layer to be in the condensing lens state, and controls the second photoelectric conversion unit to control the converged environment received from the lens layer The light performs photoelectric conversion. Among them, since the first area extends to the entire display interface, in order to ensure that the display panel does not affect the user's viewing of images while performing image acquisition, the preset frequency can be 60HZ, at which the user can visually display the interface In the state of image display, the user's visual experience is guaranteed.
在本申请一种实现方式中,当第一区域小于所述显示区域的面积时,所述控制模组接收到第一指令,所述控制模组提供第一电压至所述镜片层,控制所述镜片层处于平面镜片状态,同时控制所述第二光电转换单元停止执行光电转换。所述控制模组接收到第二指令,所述控制模组输出第二电压,所述第二电压控制所述第一光电转换单元停止出射光线,同 时控制所述镜片层处于聚光镜片状态,以及控制所述第二光电转换单元将自所述镜片层接收的经过汇聚后的环境光线执行光电转换。复用图像显示与图像采集功效的区域在执行图像显示时不会影响仅执行图像显示区域的图像显示,使得在显示面板上能够同时执行图像显示与图像采集。In an implementation manner of the present application, when the first area is smaller than the area of the display area, the control module receives a first instruction, and the control module provides a first voltage to the lens layer to control all The lens layer is in a flat lens state, and at the same time, the second photoelectric conversion unit is controlled to stop performing photoelectric conversion. The control module receives a second instruction, the control module outputs a second voltage, the second voltage controls the first photoelectric conversion unit to stop emitting light, and at the same time controls the lens layer to be in a condensing lens state, and The second photoelectric conversion unit is controlled to perform photoelectric conversion on the condensed ambient light received from the lens layer. The area where the multiplexing of the image display and the image acquisition function is performed will not affect the image display of only the image display area when performing the image display, so that the image display and the image acquisition can be performed on the display panel at the same time.
在本申请一种实现方式中,当所述控制模组再次接收到所述第一指令时,退出所述图像采集状态并进入所述图像显示状态。当显示面板执行完成图像采集之后,通过再次接收到表征恢复至图像显示状态的指令后,退出图像采集状态,显示区域内的全部像素单元执行图像显示。In an implementation manner of the present application, when the control module receives the first instruction again, it exits the image acquisition state and enters the image display state. After the display panel completes image acquisition, it exits the image acquisition state by receiving an instruction indicating that it returns to the image display state again, and all pixel units in the display area perform image display.
在本申请一种实现方式中所述第一光电转换单元与所述第二光电转换单元同层并列设置,所述镜片层正对并覆盖所述第二光电转换单元,由此,镜片层与第一光电转换单元间隔一定距离设置,当第一光电转换单元出射光线且镜片层处于平面镜片时,镜片层就能够协助将第一光电转换单元出射的光线传输至显示面板外以有效提高图像显示亮度。In one implementation of the present application, the first photoelectric conversion unit and the second photoelectric conversion unit are arranged side by side in the same layer, and the lens layer faces and covers the second photoelectric conversion unit, so that the lens layer and the second photoelectric conversion unit The first photoelectric conversion unit is arranged at a certain distance. When the first photoelectric conversion unit emits light and the lens layer is in a flat lens, the lens layer can assist in transmitting the light emitted by the first photoelectric conversion unit to the outside of the display panel to effectively improve image display brightness.
在本申请一种实现方式中,所述第一转换单元为发光二极管、有机发光二极管或者微发光二极管,所述第二光电转换单元为光电探测器。In an implementation manner of the present application, the first conversion unit is a light emitting diode, an organic light emitting diode or a micro light emitting diode, and the second photoelectric conversion unit is a photodetector.
在本申请一种实现方式中,所述第一光电转换单元还用于在图像采集状态接收所述环境光线并将所述环境光线转换为电信号执行图像采集。所述第二光电转换单元还用于在图像显示状态将将图像数据转换为光信号出射以显示图像。所述第一光电转换单元与所述第二光电转换单元为微发光二极管。第一光电转换单元与第二光电转换单元均能够分时执行图像显示与图像采集,进一步提高了图像显示与采集的解析度与清晰度。In an implementation manner of the present application, the first photoelectric conversion unit is further configured to receive the ambient light in an image acquisition state and convert the ambient light into an electrical signal to perform image acquisition. The second photoelectric conversion unit is also used to convert the image data into a light signal and emit it to display the image in the image display state. The first photoelectric conversion unit and the second photoelectric conversion unit are micro light emitting diodes. Both the first photoelectric conversion unit and the second photoelectric conversion unit can perform image display and image collection in a time-sharing manner, which further improves the resolution and clarity of image display and collection.
在本申请一种实现方式中所述第一光电转换单元与所述第二光电转换单元同一层并列设置,所述镜片层覆盖所述第一转换单元与所述第二光电转换单元。由此,镜片层能够同时覆盖第一光电转换单元与第二光电转换单元,有效提高了图像显示时的亮度,以及图像采集时焦距调节的精细度,保证图像采集的品质。In an implementation manner of the present application, the first photoelectric conversion unit and the second photoelectric conversion unit are arranged side by side on the same layer, and the lens layer covers the first conversion unit and the second photoelectric conversion unit. As a result, the lens layer can simultaneously cover the first photoelectric conversion unit and the second photoelectric conversion unit, which effectively improves the brightness during image display and the fineness of focus adjustment during image capture, thereby ensuring the quality of image capture.
在本申请一种实现方式中,当第一区域与所述显示区域的面积相同时,所述控制模组接收到第一指令,所述控制模组提供第一电压至所述镜片层,控制所述镜片层处于平面镜片状态,同时控制所述第一光电转换单元与所述第二光电转换单元同时出射光线显示图像。所述控制模组接收到第二指令,所述控制模组按照预设频率交替输出第一电压与第二电压,所述第二电压控制所述镜片层处于聚光镜片状态,控制所述第一光电转换单元与所述第二光电转换单号停止出射光线,并同时自所述镜片层接收的经过汇聚后的环境光线执行光电转换。其中,由于第一区域扩展至整个显示界面,为了保证显示面板在执行图像采集的同时也不影响用户查看图像,所述预设频率可为60HZ,在该频率下使得用户在视觉上显示界面保持在图像显示的状态,保证用户的视觉体验。In an implementation of the present application, when the area of the first area and the display area are the same, the control module receives the first instruction, and the control module provides the first voltage to the lens layer to control The lens layer is in a flat lens state, and the first photoelectric conversion unit and the second photoelectric conversion unit are simultaneously controlled to emit light to display images. The control module receives a second instruction, the control module alternately outputs a first voltage and a second voltage according to a preset frequency, and the second voltage controls the lens layer to be in a condensing lens state, and controls the first The photoelectric conversion unit and the second photoelectric conversion order stop emitting light, and at the same time perform photoelectric conversion of the condensed ambient light received from the lens layer. Among them, since the first area extends to the entire display interface, in order to ensure that the display panel does not affect the user's viewing of images while performing image acquisition, the preset frequency can be 60HZ, at which the user can visually display the interface In the state of image display, the user's visual experience is guaranteed.
在本申请一种实现方式中,当第一区域小于所述显示区域的面积时,所述控制模组接收到第一指令,所述控制模组提供第一电压至所述镜片层,控制所述镜片层处于平面镜片状态,同时控制所述第一光电转换单元与所述第二光电转换单元同时出射光线显示图像;在所述图像采集状态,所述控制模组接收到第二指令,所述控制模组输出第二电压,所述第二电压控制所述镜片层处于聚光镜片状态,控制所述第一光电转换单元与所述第二光电转换单号停止出射光线,并同时自所述镜片层接收的经过汇聚后的环境光线执行光电转换。 复用图像显示与图像采集功效的区域在执行图像显示时不会影响仅执行图像显示区域的图像显示,使得在显示面板上能够同时执行图像显示与图像采集。In an implementation manner of the present application, when the first area is smaller than the area of the display area, the control module receives a first instruction, and the control module provides a first voltage to the lens layer to control all The lens layer is in a flat lens state, and the first photoelectric conversion unit and the second photoelectric conversion unit are simultaneously controlled to emit light to display images; in the image acquisition state, the control module receives the second instruction, so The control module outputs a second voltage, and the second voltage controls the lens layer to be in a condensing lens state, controls the first photoelectric conversion unit and the second photoelectric conversion order to stop emitting light, and simultaneously The condensed ambient light received by the lens layer performs photoelectric conversion. The area where the multiplexing of the image display and the image acquisition function is performed will not affect the image display of only the image display area when performing the image display, so that the image display and the image acquisition can be performed on the display panel at the same time.
在本申请一种实现方式中,提供一种显示终端,包括输入模组与前述任意一项所述的显示面板,所述输入模组用于接受用户的操作而输入的控制指令,依据所述控制指令对应产生所述第一控制指令与所述第二控制指令。显示终端中显示面板能够复用图像显示与图像采集两种功能,使得显示面板的屏占比有效得到提高,为实现全面屏显示提供了更大的空间。In an implementation manner of the present application, a display terminal is provided, which includes an input module and the display panel described in any one of the foregoing, and the input module is used to accept a user's operation and input control instructions according to the The control instruction generates the first control instruction and the second control instruction correspondingly. The display panel in the display terminal can multiplex the two functions of image display and image acquisition, so that the screen-to-body ratio of the display panel is effectively increased, and a larger space is provided for realizing a full-screen display.
在本申请一种实现方式中,提供一种显示装置,包括前述任意一项所述的显示面板。In an implementation manner of the present application, a display device is provided, including the display panel described in any one of the foregoing.
附图说明Description of the drawings
图1为本申请一实施例中显示终端平面结构示意图;FIG. 1 is a schematic diagram of a plane structure of a display terminal in an embodiment of the application;
图2为图1所示显示终端的侧面结构示意图;FIG. 2 is a schematic diagram of a side structure of the display terminal shown in FIG. 1;
图3为如图2显示面板的平面的结构示意图;FIG. 3 is a schematic diagram of the structure of the plane of the display panel shown in FIG. 2; FIG.
图4为如图3所示图像采集模组在显示界面分布示意图;Fig. 4 is a schematic diagram showing the distribution of the image acquisition module shown in Fig. 3 on the display interface;
图5为如图3所示图像采集模组在显示界面分布示意图;Fig. 5 is a schematic diagram of the image acquisition module distribution on the display interface as shown in Fig. 3;
图6为如图1与图3所示第一区域的放大结构示意图;FIG. 6 is a schematic diagram of an enlarged structure of the first area shown in FIG. 1 and FIG. 3;
图7为本申请第一实施例中如图6所示沿着VI-VI线的剖面结构示意图;FIG. 7 is a schematic diagram of the cross-sectional structure along the line VI-VI as shown in FIG. 6 in the first embodiment of the application;
图8为如图7所示图像显示模组与图像采集模组的连接示意图;FIG. 8 is a schematic diagram of the connection between the image display module and the image acquisition module shown in FIG. 7;
图9为如图6-图7所示驱动显示面板进行图像显示采集的流程图;Fig. 9 is a flowchart of driving the display panel to perform image display acquisition as shown in Figs. 6-7;
图10为图像显示采集的时序控制示意图;Figure 10 is a schematic diagram of time sequence control of image display acquisition;
图11为本申请第二实施例中如图6所示沿着VI-VI线的剖面结构示意图;11 is a schematic diagram of the cross-sectional structure along the VI-VI line as shown in FIG. 6 in the second embodiment of the application;
图12为如图11所示镜片层的具体结构示意图;FIG. 12 is a schematic diagram of the specific structure of the lens layer as shown in FIG. 11;
图13为如图11镜片层处于聚光镜状态时光路结构示意图;FIG. 13 is a schematic diagram of the optical path structure of the lens layer in the condenser state as shown in FIG. 11; FIG.
图14为如图13所示镜片层处于平面镜模式光路示意图;Fig. 14 is a schematic diagram of the optical path of the lens layer in the plane mirror mode as shown in Fig. 13;
图15为如图13所示镜片层处于聚光镜模式的光路示意图;15 is a schematic diagram of the optical path of the lens layer in the condenser mode as shown in FIG. 13;
图16为如图11所示驱动显示面板功能模组连接示意图;FIG. 16 is a schematic diagram of the connection of the driving display panel function module shown in FIG. 11;
图17为如图11、图16所示驱动显示面板进行图像显示采集的流程图;FIG. 17 is a flowchart of driving the display panel to perform image display collection as shown in FIG. 11 and FIG. 16;
图18为如图11、图16所示驱动显示面板进行图像显示采集的时序控制示意图;18 is a schematic diagram of timing control for driving the display panel to perform image display acquisition as shown in FIGS. 11 and 16;
图19为如图11、图16所示驱动显示面板进行图像显示采集的流程图;FIG. 19 is a flowchart of driving the display panel to perform image display acquisition as shown in FIG. 11 and FIG. 16;
图20为如图11、图16所示驱动显示面板进行图像显示采集的时序控制示意图;20 is a schematic diagram of timing control for driving the display panel to perform image display acquisition as shown in FIG. 11 and FIG. 16;
图21为本申请第三实施例中针对图6所示沿着VI-VI线的剖面结构示意图;21 is a schematic diagram of the cross-sectional structure along the VI-VI line shown in FIG. 6 in the third embodiment of the application;
图22为如图21所示驱动显示面板功能模组连接示意图;22 is a schematic diagram of the connection of the driving display panel function module shown in FIG. 21;
图23为如图11、图16所示驱动显示面板进行图像显示采集的时序控制示意图;FIG. 23 is a schematic diagram of timing control for driving the display panel to perform image display acquisition as shown in FIG. 11 and FIG. 16;
图24为如图11、图16所示驱动显示面板进行图像显示采集的时序控制示意图。FIG. 24 is a schematic diagram of timing control for driving the display panel to perform image display acquisition as shown in FIG. 11 and FIG. 16.
具体实施方式Detailed ways
下面结合附图,对本发明的实施例进行描述。The embodiments of the present invention will be described below with reference to the accompanying drawings.
图1为本申请一实施例中显示终端平面结构示意图。如图1所示,显示终端10包括用 于执行图像显示与图形采集的显示界面(Active Area)AA以及用于接收用户操作的指令获取模组。其中,用户针对显示终端10的操作表征了用户相同输入的相应的控制指令,本实施例中,指令获取模组可以为:机械按键、语言拾取模组、动作传感器、脑电波传感器、图像采集模组。FIG. 1 is a schematic diagram of a plane structure of a display terminal in an embodiment of the application. As shown in Fig. 1, the display terminal 10 includes a display interface (Active Area) AA for performing image display and graphics collection, and an instruction acquisition module for receiving user operations. Among them, the operation of the user for the display terminal 10 represents the corresponding control command input by the user. In this embodiment, the command acquisition module may be: a mechanical button, a language pickup module, a motion sensor, a brain wave sensor, and an image acquisition module. Group.
本实施例中,显示界面AA与显示终端10正面出光区域的形状、大小基本相同,显示界面AA分时依据图像数据执行图像显示或者获取外界环境中的光线以进行图像采集。其中,显示界面AA可以部分区域分时执行图像显示与图像采集,或者显示界面AA全部整体区域分时执行图像显示与图像采集。即显示终端10能够分时在显示界面AA的至少部分区域处于图像显示状态或者图像采集状态,由此,显示界面AA能够分时执行图像显示与图像采集,那么显示界面AA就能够复用图像显示与图像采集的功能,而无需单独设置摄像头等图像采集装置,实现全面屏显示以及能够有效提高显示界面的屏占比。In this embodiment, the shape and size of the light-emitting area on the front of the display interface AA and the display terminal 10 are basically the same, and the display interface AA performs image display according to image data in a time-sharing manner or acquires light in the external environment for image collection. Among them, the display interface AA may perform image display and image acquisition in a time-sharing part of the area, or perform image display and image acquisition in a time-sharing manner in all the entire area of the display interface AA. That is, the display terminal 10 can be in an image display state or an image acquisition state in at least a part of the display interface AA in a time-sharing state. Therefore, the display interface AA can perform image display and image acquisition in a time-sharing manner, and the display interface AA can multiplex the image display. With the function of image acquisition, there is no need to separately set up an image acquisition device such as a camera to realize a full-screen display and effectively increase the screen-to-body ratio of the display interface.
在显示界面AA内包括多个阵列均匀排布的像素单元P,每一个像素中包括多个间隔预设距离设置的子像素(Pixel),每一个子像素由一个第一光电转换单元(图7)构成,多个子像素Pixel作为一个图像显示模组12(图3)。The display interface AA includes a plurality of pixel units P uniformly arranged in an array, and each pixel includes a plurality of sub-pixels (Pixel) arranged at intervals of a preset distance, and each sub-pixel is composed of a first photoelectric conversion unit (Figure 7 ) Structure, a plurality of sub-pixels Pixel as an image display module 12 (FIG. 3).
在显示界面AA包括第一区域A1,在第一区域A1中,每一个子像素Pixel之间设置有多个第二光电转换单元(图7),多个第二光电转换单元作为一个图像采集模组13(图3)。The display interface AA includes a first area A1. In the first area A1, a plurality of second photoelectric conversion units (FIG. 7) are arranged between each sub-pixel Pixel, and the plurality of second photoelectric conversion units are used as an image acquisition module. Group 13 (Figure 3).
其中,第一光电转换单元与第二光电转换单元为将光电信号进行转换的元件。第一光电转换单元将图像信号转换为光信号出射而显示图像,第二光电转换单元采集环境换光线转换为电信号以重构图像。Wherein, the first photoelectric conversion unit and the second photoelectric conversion unit are elements that convert photoelectric signals. The first photoelectric conversion unit converts the image signal into an optical signal to display the image, and the second photoelectric conversion unit collects the environment and converts the light into an electrical signal to reconstruct the image.
请参阅图2,其为图1所示显示终端的侧面结构示意图。Please refer to FIG. 2, which is a schematic diagram of the side structure of the display terminal shown in FIG. 1.
如图2所示,显示终端10包括层叠设置的触控层TL与显示面板11。其中,显示面板11包括用于出射光线的出光面11a,触控层TL设置于显示面板11的出光面11a的表面。触控层TL用于感测用户的触摸操作。As shown in FIG. 2, the display terminal 10 includes a touch layer TL and a display panel 11 which are laminated. The display panel 11 includes a light-emitting surface 11 a for emitting light, and the touch layer TL is disposed on the surface of the light-emitting surface 11 a of the display panel 11. The touch layer TL is used to sense the user's touch operation.
显示面板11至少包括有阵列基板111以及设置于阵列基板111表面的光电转换层112。本实施例中,光电转换层112包括多个光电转换元件(图未示),光电转换元件可以为发光二极管(Light Emitting Diode,LED)、有机发光半导体材料(Organic Electroluminescence Diode,OLED)、微型发光二极管(Micro-Size Light Emitting Diode,μ-LED)。The display panel 11 at least includes an array substrate 111 and a photoelectric conversion layer 112 disposed on the surface of the array substrate 111. In this embodiment, the photoelectric conversion layer 112 includes a plurality of photoelectric conversion elements (not shown). The photoelectric conversion elements may be light-emitting diodes (LEDs), organic light-emitting semiconductor materials (Organic Electroluminescence Diodes, OLEDs), and miniature light-emitting diodes. Diode (Micro-Size Light Emitting Diode, μ-LED).
当然,在本申请其他实施例中,触控层TL也可以无需设置。Of course, in other embodiments of the present application, the touch layer TL may not need to be provided.
请参阅图3,其为如图2所示显示面板的平面的结构示意图。Please refer to FIG. 3, which is a schematic diagram of the planar structure of the display panel shown in FIG.
如图3所示,显示面板11包括执行出射光线而显示图像的图像显示模组12与采集环境光线而获得图像的图像采集模组13。As shown in FIG. 3, the display panel 11 includes an image display module 12 that emits light to display an image and an image capture module 13 that collects ambient light to obtain an image.
其中,图像显示模组12分布于全部的显示界面AA,图像采集模组13至少分布于显示界面的部分区域。The image display module 12 is distributed on all the display interfaces AA, and the image acquisition module 13 is distributed on at least a part of the display interface.
对于图像显示模组12而言,包括均匀分布全部显示界面AA的多个像素单元,每一个像素中包括多个间隔预设距离的子像素(Pixel),每一个子像素作为第一光电转换单元,用于将模拟电信号的图像信号转换为光信号并进行出射。其中,每一个像素单元至少包括 红色子像素(R)、绿色子像素(G)以及蓝色子像素(B)分别出射红色光线、绿色光线以及蓝色光线的三色子像素,通过三色子像素出射的红色光线、绿色光线以及蓝色光线进行不同亮度灰阶的混合,每一个像素单元可出射彩色的光线,进而实现显示界面AA执行彩色图像显示。For the image display module 12, it includes a plurality of pixel units evenly distributed across the display interface AA, each pixel includes a plurality of sub-pixels (Pixel) spaced a predetermined distance apart, and each sub-pixel serves as a first photoelectric conversion unit , Used to convert the image signal of the analog electrical signal into an optical signal and emit it. Among them, each pixel unit includes at least a red sub-pixel (R), a green sub-pixel (G) and a blue sub-pixel (B) respectively emitting red light, green light and blue light three-color sub-pixels, through the three-color sub-pixel The red light, green light and blue light emitted by the pixels are mixed with different brightness and gray scales, and each pixel unit can emit colored light, thereby realizing the display interface AA to perform color image display.
图像采集模组13至少分布于显示界面AA的部分区域,其中,图像采集模组13分布于子像素Pixel之间,用于采集显示终端10之外的环境光线环境光线,并将环境光线转换为电信号,通过对电信号进行处理而重构显示终端外部的图像。The image acquisition module 13 is distributed at least in a partial area of the display interface AA. The image acquisition module 13 is distributed between the sub-pixels, and is used to collect ambient light outside the display terminal 10 and convert the ambient light into The electrical signal is processed to reconstruct an image outside the display terminal.
本实施例中,图像采集模组13的尺寸小于图像显示模组中子像素Pixel的尺寸。In this embodiment, the size of the image acquisition module 13 is smaller than the size of the sub-pixels in the image display module.
显示终端10还包括用于驱动图像显示模组12执行图像显示的图像显示驱动控制电路12A,以及用于驱动图像采集模组13执行图像采集与重构的图像采集驱动控制电路13A。其中,图像显示驱动控制电路12A与图像采集驱动控制电路13A设置于显示终端10的非图像显示区域。The display terminal 10 also includes an image display drive control circuit 12A for driving the image display module 12 to perform image display, and an image acquisition drive control circuit 13A for driving the image acquisition module 13 to perform image acquisition and reconstruction. The image display drive control circuit 12A and the image capture drive control circuit 13A are arranged in the non-image display area of the display terminal 10.
具体地,请参阅图4,其为如图3所示图像采集模组在显示界面AA分布示意图。Specifically, please refer to FIG. 4, which is a schematic diagram of the image acquisition module distribution on the display interface AA as shown in FIG.
显示界面AA包括第一区域A1,第一区域A1小于显示界面AA的面积,第一区域A1可以设置于显示界面的任意位置。The display interface AA includes a first area A1, the first area A1 is smaller than the area of the display interface AA, and the first area A1 can be set at any position of the display interface.
第一区域A1同时包括图像显示模组与图像采集模组,其中,图像采集模组分布于子像素Pixel之间。The first area A1 includes an image display module and an image acquisition module at the same time, wherein the image acquisition module is distributed between the sub-pixels.
具体地,请参阅图5,其为如图3所示图像采集模组在显示界面AA分布示意图。Specifically, please refer to FIG. 5, which is a schematic diagram of the image acquisition module distribution on the display interface AA as shown in FIG. 3.
显示界面AA包括第一区域A1,第一区域A1的面积与形状和显示界面AA的面积与形状相同,即第一区域A1与显示界面AA重合。The display interface AA includes a first area A1, and the area and shape of the first area A1 are the same as the area and shape of the display interface AA, that is, the first area A1 overlaps the display interface AA.
第一区域A1与显示界面AA中同时包括图像显示模组与图像采集模组,其中,图像采集模组分布于子像素Pixel之间。The first area A1 and the display interface AA include both an image display module and an image acquisition module, wherein the image acquisition module is distributed between the sub-pixels.
请参阅图6,其为如图1与图3所示第一区域A1的放大结构示意图。Please refer to FIG. 6, which is a schematic diagram of an enlarged structure of the first area A1 shown in FIG. 1 and FIG. 3.
如图6所示,在显示界面AA的第一区域A1,在第一区域A1中,包括多个像素单元P,每一个像素中包括多个间隔预设距离设置的子像素Pixel,每一个子像素Pixel由第一光电转换单元101构成,用于将模拟电信号的图像信号转换为光信号并进行出射。As shown in FIG. 6, in the first area A1 of the display interface AA, the first area A1 includes a plurality of pixel units P, and each pixel includes a plurality of sub-pixels set at intervals of a preset distance, and each sub-pixel The pixel Pixel is composed of a first photoelectric conversion unit 101, and is used for converting an image signal of an analog electric signal into an optical signal and emitting it.
同时,在第一区域A1中,相邻的子像素Pixel之间设置有多个第二光电转换单元102。第二光电转换单元102用于采集环境光线并且将光线信号转换为电信号,电信号能够用于重构环境光线的图像。Meanwhile, in the first area A1, a plurality of second photoelectric conversion units 102 are provided between adjacent sub-pixels Pixel. The second photoelectric conversion unit 102 is used to collect ambient light and convert the light signal into an electrical signal, which can be used to reconstruct an image of the ambient light.
对于第二光电转换单元102与子像素Pixel的排列方式可以依据实际需求进行设置,例如采用如图6所示相邻的两个子像素Pixel之间设置一个第二光电转换单元102,且每一个子像素Pixel由呈矩形排列的六个第二光电转换单元102环绕包围。在本申请其他实现方式中,相邻的两个子像素Pixel之间设置两个或者多个第二光电转换单元102,每一个子像素Pixel周边环绕设置的第二光电转单元102的数量也可以为四个、构成的形状还可以是菱形、圆形或者其他形状,并不以此为限。The arrangement of the second photoelectric conversion unit 102 and the sub-pixels Pixel can be set according to actual needs. For example, a second photoelectric conversion unit 102 is arranged between two adjacent sub-pixels as shown in FIG. 6, and each sub-pixel The pixel Pixel is surrounded by six second photoelectric conversion units 102 arranged in a rectangular shape. In other implementations of the present application, two or more second photoelectric conversion units 102 are arranged between two adjacent sub-pixels Pixel, and the number of second photoelectric conversion units 102 arranged around each sub-pixel Pixel may also be The shape of the four components can also be rhombus, circle or other shapes, and is not limited to this.
本实施例中,第一光电转换单元101将图像信号转换为光信号出射而显示图像与第二 光电转换单元102采集环境换光线转换为电信号以重构图像分时进行,即第一光电转换单元101将图像信号转换为光信号出射而显示图像时,第二光电转换单元102停止采集环境光线转换同时停止电信号转换。第二光电转换单元102采集环境换光线转换为电信号时,第一光电转换单元101停止将图像信号转换为光信号出射。In this embodiment, the first photoelectric conversion unit 101 converts the image signal into an optical signal and emits the displayed image. The second photoelectric conversion unit 102 collects the environment and converts the light into an electrical signal to reconstruct the image in a time-sharing process, that is, the first photoelectric conversion When the unit 101 converts an image signal into a light signal and emits an image to display an image, the second photoelectric conversion unit 102 stops collecting the ambient light conversion and at the same time stops the electrical signal conversion. When the second photoelectric conversion unit 102 collects the environment and converts the light into an electrical signal, the first photoelectric conversion unit 101 stops converting the image signal into an optical signal and emits it.
请参阅图7,其为本申请第一实施例中如图6所示沿着VI-VI线的剖面结构示意图。Please refer to FIG. 7, which is a schematic diagram of the cross-sectional structure along the line VI-VI as shown in FIG. 6 in the first embodiment of the application.
图像显示模组12包括第一光电转换单元101与第一读取电路121,第一光电转换单元101用于出射光线以显示图像。第一读取电路121用于自图像显示驱动控制电12A路读取待显示的图像数据,并且依据图像数据输出相应的驱动信号至第一光电转换单元101,驱动第一光电转单元101依据驱动信号出射光线以相应显示所述图像数据。The image display module 12 includes a first photoelectric conversion unit 101 and a first reading circuit 121, and the first photoelectric conversion unit 101 is used to emit light to display images. The first reading circuit 121 is used to read the image data to be displayed from the image display drive control circuit 12A, and output corresponding drive signals to the first photoelectric conversion unit 101 according to the image data, and drive the first photoelectric conversion unit 101 according to the drive The signal emits light to display the image data accordingly.
图像采集模组13包括镜片层131与第二光电转换单元102。其中,镜片层131用于将显示面板外部的环境光线传输至所述第二光电转换单元102。第二光电转换单元102用于将所述环境光线转换为电信号,所述电信号用于重构环境光线对应的图像,The image acquisition module 13 includes a lens layer 131 and a second photoelectric conversion unit 102. The lens layer 131 is used to transmit ambient light outside the display panel to the second photoelectric conversion unit 102. The second photoelectric conversion unit 102 is used to convert the ambient light into an electric signal, and the electric signal is used to reconstruct an image corresponding to the ambient light,
本实施例中,镜片层131与第二光电转换单元102间隔预设距离,以便于镜片层将足够数量的采集的环境光线汇聚至所示第二光电转换单元102。In this embodiment, the lens layer 131 is separated from the second photoelectric conversion unit 102 by a predetermined distance, so that the lens layer converges a sufficient amount of collected ambient light to the second photoelectric conversion unit 102 shown.
本实施例中,第一光电转换单元101与第一读取电路121上下正对设置,同时,第一光电转换单元101与镜片层131同一层设置,第二光电转换单元102位于所述镜片层131正下方。本实施例中所述的同一层设置为第一光电转换单元101与镜片层131基本为位于并列设置于同一个平面内。In this embodiment, the first photoelectric conversion unit 101 and the first reading circuit 121 are arranged directly opposite each other. At the same time, the first photoelectric conversion unit 101 and the lens layer 131 are arranged on the same layer, and the second photoelectric conversion unit 102 is located on the lens layer. 131 is directly below. The same layer arrangement described in this embodiment is that the first photoelectric conversion unit 101 and the lens layer 131 are basically arranged side by side in the same plane.
本实施例中,第一光电转换单元101为LED、OLED或者μ-LED,第二光电转换单元102为光电探测器(Photo detector,PD),镜片层为超平面透镜(Metamaterial lens,Meta-Lens)。In this embodiment, the first photoelectric conversion unit 101 is an LED, OLED or μ-LED, the second photoelectric conversion unit 102 is a photodetector (PD), and the lens layer is a metamaterial lens (Meta-Lens). ).
请参阅图8,其为如图7所示图像显示模组与图像采集模组的连接示意图。Please refer to FIG. 8, which is a schematic diagram of the connection between the image display module and the image acquisition module as shown in FIG. 7.
如图8所示,控制模组100电性连接图像显示驱动控制电路12A、图像采集驱动控制电路13A以及第二光电转换单元102。As shown in FIG. 8, the control module 100 is electrically connected to the image display drive control circuit 12A, the image capture drive control circuit 13A, and the second photoelectric conversion unit 102.
其中,控制模组100用于接收来自于输入模组提供的控制指令,控制指令包括指示显示设备在显示界面AA的第一区域A1执行图像显示或者采集图像。Wherein, the control module 100 is configured to receive a control instruction provided by the input module, and the control instruction includes instructing the display device to perform image display or capture an image in the first area A1 of the display interface AA.
控制指令可以为用户触摸操作输入模组中的触摸层TL而输入的。例如显示界面AA当前时刻执行图像显示,当用户需要进行拍照时,操作并触发触摸屏上的摄像应用程序,从而输出图像采集的控制指令到控制模组100。The control command can be input by the user touching the touch layer TL in the operation input module. For example, the display interface AA performs image display at the current moment. When the user needs to take a photo, the camera application program on the touch screen is operated and triggered, thereby outputting a control instruction for image collection to the control module 100.
进一步,当图像采集完成,再次触摸操作显示界面AA中相应位置时,输出图像采集完成而需要进行图像显示的控制指令到控制模组100。Further, when the image acquisition is completed, and the corresponding position in the operation display interface AA is touched again, a control instruction for image display is output to the control module 100 after the image acquisition is completed.
在本申请其他实施例中,控制指令也可以为用户操作输入模组中的机械按键、语音模组、动作传感模组或者脑电波感测模组而产生的指令。In other embodiments of the present application, the control instruction may also be an instruction generated by a user operating a mechanical button, a voice module, a motion sensing module, or a brain wave sensing module in the input module.
当控制模组100接收到图像采集的控制指令时,控制模组100控制图像显示驱动控制电路12A停止输出图像数据至图像显示模组121,同时,控制第二光电转换单元102将接收的环境光线转换为电信号,而图像采集驱动控制电路13A则将电信号进行处理后重构环 境光线对应的图像。When the control module 100 receives the control instruction for image capture, the control module 100 controls the image display drive control circuit 12A to stop outputting image data to the image display module 121, and at the same time, controls the ambient light received by the second photoelectric conversion unit 102 It is converted into an electrical signal, and the image acquisition drive control circuit 13A processes the electrical signal and reconstructs the image corresponding to the ambient light.
当控制模组100接收到图像采集完成并需要进行图像显示的控制指令时,控制模组100控制图像显示驱动控制电路12A将待显示的图像数据至图像显示模组121进行图像显示,同时,控制第二光电转换单元102停止将将环境光线转换为电信号,即停止图像采集。When the control module 100 receives the image acquisition completion and the image display control instruction, the control module 100 controls the image display drive control circuit 12A to send the image data to be displayed to the image display module 121 for image display, and at the same time, controls The second photoelectric conversion unit 102 stops converting the ambient light into electrical signals, that is, stops image acquisition.
请参阅图9-图10,图9为如图6-图7所示驱动显示面板进行图像显示采集的流程图,图10为图像显示采集的时序控制示意图。Please refer to FIGS. 9-10. FIG. 9 is a flowchart of driving the display panel to perform image display acquisition as shown in FIGS. 6-7, and FIG. 10 is a schematic diagram of timing control of image display acquisition.
如图9所示,驱动显示面板11进行图像显示与采集的步骤包括:As shown in FIG. 9, the steps of driving the display panel 11 to display and collect images include:
步骤901,控制模组100接收到图像采集的第二控制指令。如图10所示,在t2时刻显示终端10中显示界面AA进入图像采集时间段Tc的图像采集状态,控制模组100接收到图像采集的第二控制指令。需要说明的是,在t2之前的t1-t1时刻之间,显示界面AA处于图像显示时间段Td的图像显示状态。In step 901, the control module 100 receives a second control instruction for image collection. As shown in FIG. 10, at time t2, the display interface AA in the display terminal 10 enters the image acquisition state of the image acquisition time period Tc, and the control module 100 receives the second control instruction for image acquisition. It should be noted that between t1 and t1 before t2, the display interface AA is in the image display state of the image display time period Td.
步骤903,控制模组100依据用来指示第一区域进行图像采集的第二控制指令,输出第一控制信号至第二光电转换单元102以及图像采集驱动控制电路13A,控制第二光电转换单元102处于打开状态,并且将接收的环境光线转换为电信号。 Step 903, the control module 100 outputs the first control signal to the second photoelectric conversion unit 102 and the image capture drive control circuit 13A according to the second control instruction used to instruct the first area to perform image capture, and controls the second photoelectric conversion unit 102 It is in the open state and converts the received ambient light into electrical signals.
同时,控制模组100输出第一控制信号至图像显示驱动控制电路110,以控制图像显示驱动控制电路110停止输出图像数据至图像显示模组。At the same time, the control module 100 outputs the first control signal to the image display drive control circuit 110 to control the image display drive control circuit 110 to stop outputting image data to the image display module.
步骤905,图像采集驱动控制电路13A将电信号进行处理后重构环境光线对应的图像。Step 905: The image acquisition drive control circuit 13A processes the electrical signal and reconstructs an image corresponding to the ambient light.
步骤907,控制模组100接收依据用来指示第一区域进行图像显示的第一控制指令。如图10所示,在t3时刻,控制模组100接收到第一控制指令,显示终端10中显示界面AA进入图像显示时间段Td的图像显示状态。In step 907, the control module 100 receives a first control instruction used to instruct the first area to perform image display. As shown in FIG. 10, at time t3, the control module 100 receives the first control instruction, and the display interface AA in the display terminal 10 enters the image display state of the image display time period Td.
步骤909,控制模组100依据第一控制指令,输出第二控制信号至图像显示驱动控制电路110,控制图像显示驱动控制电路110输出图像数据至图像显示模组进行图像显示。本实施例中,输出至图像显示模组进行图像显示的图像数据可以为通过图像采集模组采集图像。In step 909, the control module 100 outputs a second control signal to the image display drive control circuit 110 according to the first control instruction, and controls the image display drive control circuit 110 to output image data to the image display module for image display. In this embodiment, the image data output to the image display module for image display may be images collected by the image acquisition module.
同时,控制模组100输出第二控制信号至第二光电转换单元102以及图像采集驱动控制电路,以控制第二光电转换单元102处于关闭状态,停止将将环境光线转换为电信号,即停止图像采集。At the same time, the control module 100 outputs a second control signal to the second photoelectric conversion unit 102 and the image capture drive control circuit to control the second photoelectric conversion unit 102 to be in the off state, stop converting the ambient light into electrical signals, that is, stop the image collection.
请参阅图11,其为本申请第二实施例中如图6所示沿着VI-VI线的剖面结构示意图。Please refer to FIG. 11, which is a schematic cross-sectional structure diagram along the line VI-VI as shown in FIG. 6 in the second embodiment of the application.
图像显示模组12包括第一光电转换单元101与第一读取电路121,第一光电转换单元101用于出射光线以显示图像。第一读取电路121用于自图像显示驱动控制电路12A读取待显示的图像数据,并且依据图像数据输出相应的驱动信号至第一光电转换单元101,第一光电转单元101依据驱动信号出射光线以显示所述图像数据。The image display module 12 includes a first photoelectric conversion unit 101 and a first reading circuit 121, and the first photoelectric conversion unit 101 is used to emit light to display images. The first reading circuit 121 is used to read the image data to be displayed from the image display drive control circuit 12A, and output a corresponding drive signal according to the image data to the first photoelectric conversion unit 101, and the first photoelectric conversion unit 101 emits according to the drive signal Light to display the image data.
图像采集模组13包括镜片层131与第二光电转换单元102。其中,镜片层131用于将显示面板11外部的环境光线传输至第二光电转换单元102。第二光电转换单元102用于将所述环境光线转换为电信号,所述电信号用于重构环境光线对应的图像。本实施例中,镜片层131与第二光电转换单元102间隔预设距离,以便于镜片层131将足够数量的采集的 环境光线汇聚至所示第二光电转换单元102。The image acquisition module 13 includes a lens layer 131 and a second photoelectric conversion unit 102. The lens layer 131 is used to transmit ambient light outside the display panel 11 to the second photoelectric conversion unit 102. The second photoelectric conversion unit 102 is configured to convert the ambient light into an electrical signal, and the electrical signal is used to reconstruct an image corresponding to the ambient light. In this embodiment, the lens layer 131 is separated from the second photoelectric conversion unit 102 by a predetermined distance, so that the lens layer 131 converges a sufficient amount of collected ambient light to the second photoelectric conversion unit 102 shown.
本实施例中,镜片层131包括聚光镜片状态或者平面镜片状态两种状态。In this embodiment, the lens layer 131 includes two states: a condenser lens state or a flat lens state.
当镜片层131处于平面镜状态时,镜片层131使得入射的环境光线产生相位偏移角度为0°,此时镜片层131为平面镜。When the lens layer 131 is in a plane mirror state, the lens layer 131 causes the incident ambient light to produce a phase shift angle of 0°, and the lens layer 131 is a plane mirror at this time.
当镜片层131处于聚光镜状态时,镜片层131使得入射的环境光线产生一定的相位偏移角度,从而对入射的环境光线进行汇聚,并将汇聚后的光线传输至第二光电转换单元102。When the lens layer 131 is in the condenser state, the lens layer 131 causes the incident ambient light to generate a certain phase shift angle, thereby converging the incident ambient light, and transmitting the concentrated light to the second photoelectric conversion unit 102.
镜片层102处于聚光镜片状态或者平面镜片可以通过接收不同的电压或者不同的机械压力来实现切换。The lens layer 102 is in the condensing lens state or the flat lens can be switched by receiving different voltages or different mechanical pressures.
具体地,通过加载不同的电压来控制镜片层131处于聚光镜片状态或者平面镜片可以为:加载第一电压至镜片层131时,所述镜片层131在该第一电压控制下的折射率使得入射光线并不会产生相位偏移,处于平面镜片状态,即超平面透镜针对入射的环境光线产生的相位偏移角度为0°;加载第二电压至镜片层131时,所述镜片层131在该第一电压控制下的折射率使得入射光线产生一定相位偏移,即超平面透镜针对入射的环境光线产生的相位偏移角度为
Figure PCTCN2020088534-appb-000003
其中,
Figure PCTCN2020088534-appb-000004
大于0,此时,超平面透镜为聚光透镜。
Specifically, by applying different voltages to control the lens layer 131 to be in the condensing lens state or the flat lens can be: when the first voltage is applied to the lens layer 131, the refractive index of the lens layer 131 under the control of the first voltage is such that the incident The light does not produce a phase shift, and it is in the state of a flat lens, that is, the phase shift angle of the hyperplanar lens with respect to the incident ambient light is 0°; when the second voltage is applied to the lens layer 131, the lens layer 131 is in this state. The refractive index under the control of the first voltage causes the incident light to produce a certain phase shift, that is, the phase shift angle of the hyperplanar lens for the incident ambient light is
Figure PCTCN2020088534-appb-000003
in,
Figure PCTCN2020088534-appb-000004
Greater than 0, at this time, the hyperplane lens is a condenser lens.
进一步,当控制模组100接收到第二指令以控制第一区域A1处于图像显示状态时,第一光电转换单元101出射光线以显示图像,所述镜片层131处于平面镜片状态,所述第二光电转换单元102停止将所述环境光线转换为所述电信号。Further, when the control module 100 receives the second instruction to control the first area A1 to be in the image display state, the first photoelectric conversion unit 101 emits light to display the image, the lens layer 131 is in the flat lens state, and the second The photoelectric conversion unit 102 stops converting the ambient light into the electrical signal.
当控制模组100接收到第一指令以控制第一区域A1处于图像采集状态时,第一光电转换单元101停止出射光线,镜片层131处于聚光镜状态,并将所述环境光线汇聚传输至所述第二光电转换单元102,第二光电转换单元102接收并采集自所述镜片层提供的经汇聚后的所述环境光线,并将所述环境光线转换为电信号。When the control module 100 receives the first instruction to control the first area A1 to be in the image acquisition state, the first photoelectric conversion unit 101 stops emitting light, the lens layer 131 is in the condenser state, and the ambient light is concentrated and transmitted to the The second photoelectric conversion unit 102, the second photoelectric conversion unit 102 receives and collects the converged ambient light provided from the lens layer, and converts the ambient light into an electrical signal.
本实施例中,第一光电转换单元101与第一读取电路121上下正对设置,同时,第一光电转换单元101与第二光电转换单元102下侧的第一读取电路121同一层设置,镜片层131位于第二光电转换单元102所在层结构的正上方。In this embodiment, the first photoelectric conversion unit 101 and the first reading circuit 121 are arranged upside down, and at the same time, the first photoelectric conversion unit 101 and the first reading circuit 121 on the lower side of the second photoelectric conversion unit 102 are arranged on the same layer. , The lens layer 131 is located directly above the layer structure where the second photoelectric conversion unit 102 is located.
本实施例中,所述第一转换单元101为LED、OLED或者μ-LED,第二转换单元102为PD。In this embodiment, the first conversion unit 101 is an LED, OLED or μ-LED, and the second conversion unit 102 is a PD.
请参阅图12-图13,图12为如图11所示镜片层131的具体结构示意图,图13为镜片层131处于聚光镜状态时光路结构示意图。Please refer to FIGS. 12-13. FIG. 12 is a schematic diagram of the specific structure of the lens layer 131 shown in FIG. 11, and FIG. 13 is a schematic diagram of the optical path structure of the lens layer 131 in the condenser state.
如图12所示,镜片层131为超平面透镜(Metamaterial lens),镜片层131中超平面透镜包括多个单元结构U,通过调整每个单元结构U的尺寸和排布方式可以准确地得到所需任意的相位分布。As shown in Fig. 12, the lens layer 131 is a metamaterial lens, and the hyperplane lens in the lens layer 131 includes a plurality of unit structures U. By adjusting the size and arrangement of each unit structure U, the desired value can be accurately obtained. Arbitrary phase distribution.
具体地,如图13所示,根据到达透镜焦点f所需的光程差要求,超平面透镜所需的相位分布满足公式(1):Specifically, as shown in Fig. 13, according to the optical path difference required to reach the focal point f of the lens, the phase distribution required by the hyperplanar lens satisfies the formula (1):
Figure PCTCN2020088534-appb-000005
Figure PCTCN2020088534-appb-000005
公式(1)中,以透镜的中心点为坐标系原点,(x,y)为透镜上某一位置的坐标,f为焦距,
Figure PCTCN2020088534-appb-000006
为相位,λ为入射光的波长。
In formula (1), the center point of the lens is the origin of the coordinate system, (x, y) is the coordinates of a certain position on the lens, f is the focal length,
Figure PCTCN2020088534-appb-000006
Is the phase, and λ is the wavelength of the incident light.
超平面透镜的波长λ可以通过通过外部加载不同的电压或机械方式控制相位,根据前述公式可知,超平面透镜通过调整超平面透镜的相位即可实现镜片层131焦距的动态调整。The wavelength λ of the hyperplane lens can be controlled by externally applying different voltages or mechanically to control the phase. According to the aforementioned formula, the hyperplane lens can dynamically adjust the focal length of the lens layer 131 by adjusting the phase of the hyperplane lens.
超平面透镜通过加载不同的电压调整相位即为通过不同的电压调整微结构中的折射率,控制入射光的相位偏移,从而改变焦距。The hyperplane lens adjusts the phase by applying different voltages, that is, adjusts the refractive index in the microstructure through different voltages, controls the phase shift of the incident light, and thus changes the focal length.
具体地,光波在介质中传输时,传输的速度将小于自由空间波速,变为c/n,其中c为自由空间波速,n为介质的折射率。在相同传输距离的情况下,材料的折射率不同,对光波延迟的时间不同,产生的位相差也不相同。Specifically, when a light wave propagates in a medium, the transmission speed will be less than the free space wave speed, becoming c/n, where c is the free space wave speed and n is the refractive index of the medium. In the case of the same transmission distance, the refractive index of the material is different, the delay time of the light wave is different, and the phase difference produced is also different.
例如,如图12所示,超平面透镜的结构单元的等效折射率可以通过微型变容二极管或其他有源器件进行调控。光波在折射率不均匀的介质中,相邻折射率的变化为Δn,传输d长度产生的位相差为公式(2):For example, as shown in FIG. 12, the equivalent refractive index of the structural unit of the hyperplanar lens can be adjusted by miniature varactor diodes or other active devices. In a medium with non-uniform refractive index, the change of adjacent refractive index of light wave is Δn, and the phase difference produced by the length of transmission d is formula (2):
Figure PCTCN2020088534-appb-000007
Figure PCTCN2020088534-appb-000007
式(2)中λ为自由空间波长。In formula (2), λ is the free space wavelength.
在本申请其他实施例中,超平面透镜通过机械结构调整相位包括采用透明弹性材料作为基底,通过加载不同的电压调整弹性薄膜的不同拉伸程度,在拉伸的过程中改变透镜的形状及超表面阵列的周期大小,使得超表面所具有的相位重新分布,从而改变焦距f。In other embodiments of the present application, the phase adjustment of the hyperplane lens through the mechanical structure includes the use of a transparent elastic material as the substrate, and the different stretching degree of the elastic film is adjusted by applying different voltages, and the shape and superstructure of the lens are changed during the stretching process. The size of the period of the surface array makes the phase of the metasurface redistribute, thereby changing the focal length f.
可见,镜片层131的焦距f可以依据采集的图像的像素的需求进行实时调整,从而能够保证图像采集模组13采集的图像的清晰度与品质。It can be seen that the focal length f of the lens layer 131 can be adjusted in real time according to the requirements of the pixels of the captured image, so as to ensure the clarity and quality of the image captured by the image capturing module 13.
请参阅图14-图15,图14为如图13所示镜片层处于平面镜模式光路示意图,图15为如图13所示镜片层处于聚光镜模式的光路示意图。Please refer to FIGS. 14-15. FIG. 14 is a schematic diagram of the optical path of the lens layer in the flat lens mode as shown in FIG. 13, and FIG. 15 is a schematic diagram of the optical path of the lens layer in the condenser mode as shown in FIG.
如图14所示,镜片层131中超平面透镜使得入射的环境光线的相位偏移角度为0°,镜片层131为平面镜。此时,自第一光电转换单元101出射的光线自镜片层出射至显示面板11之外,也即是从出光面出射至外部环境中。由于此时超平面镜为平面镜,因此,能够保证显示面板10内部的光线能够准确的自镜片层131以及出光面出射,而不会导致作为子像素Pixel的第一光电转换单元101出射的用于执行图像显示的光线不会出现扭曲等异常现象。As shown in FIG. 14, the hyperplane lens in the lens layer 131 makes the phase shift angle of the incident ambient light 0°, and the lens layer 131 is a plane lens. At this time, the light emitted from the first photoelectric conversion unit 101 is emitted from the lens layer to the outside of the display panel 11, that is, emitted from the light emitting surface to the external environment. Since the hyperplane mirror is a flat mirror at this time, it can ensure that the light inside the display panel 10 can be accurately emitted from the lens layer 131 and the light-emitting surface, without causing the first photoelectric conversion unit 101 as the sub-pixel to be emitted for execution. The light displayed in the image will not appear distortions and other abnormal phenomena.
如图15所示,镜片层131中超平面透镜使得入射的环境光线的相位偏移角度为
Figure PCTCN2020088534-appb-000008
镜片层131处于聚光镜片状态,此时,环境光线自出光面入射至镜片层,并进入显示面板11内部,镜片层同时针对环境光线进行汇聚,以及将汇聚后的光线传输至第二光电转换单元102,保证采集的图像具有较佳的品质。
As shown in Figure 15, the hyperplane lens in the lens layer 131 makes the phase shift angle of the incident ambient light
Figure PCTCN2020088534-appb-000008
The lens layer 131 is in a condensing lens state. At this time, ambient light enters the lens layer from the light exit surface and enters the interior of the display panel 11. The lens layer condenses the ambient light at the same time, and transmits the condensed light to the second photoelectric conversion unit 102. Ensure that the collected images have better quality.
请参阅图16,其为如图11所示驱动显示面板功能模组连接示意图。Please refer to FIG. 16, which is a schematic diagram of the connection of the driving display panel function module shown in FIG. 11.
如图16所示,控制模组100电性连接图像显示驱动控制电路12A、镜片层131、第二光电转换单元102以及图像采集驱动控制电路13A。其中,控制模组100用于接收来自于输入模组提供的控制指令,所示控制指令包括指示显示设备在显示界面AA的第一区域A1执行图像显示或者采集图像。As shown in FIG. 16, the control module 100 is electrically connected to the image display drive control circuit 12A, the lens layer 131, the second photoelectric conversion unit 102, and the image capture drive control circuit 13A. The control module 100 is used to receive control instructions provided by the input module. The control instructions shown include instructing the display device to perform image display or capture images in the first area A1 of the display interface AA.
当控制模组100接收到图像采集的第一控制指令时,控制模组100控制图像显示驱动控制电路12A停止输出图像数据至图像显示模组12,同时,控制第二光电转换单元102将 接收的环境光线转换为电信号,而图像采集驱动控制电路13A则将电信号进行处理后重构环境光线对应的图像。When the control module 100 receives the first control instruction for image capture, the control module 100 controls the image display drive control circuit 12A to stop outputting image data to the image display module 12, and at the same time, controls the second photoelectric conversion unit 102 to receive The ambient light is converted into an electrical signal, and the image acquisition drive control circuit 13A processes the electrical signal and reconstructs an image corresponding to the ambient light.
当控制模组100接收到图像采集完成并需要进行图像显示的第二控制指令时,控制模组100控制图像显示驱动控制电路12A将待显示的图像数据至图像显示模组进行图像12显示,同时,控制第二光电转换单元102停止将将环境光线转换为电信号,即停止图像采集。When the control module 100 receives the second control instruction that the image acquisition is complete and the image display is required, the control module 100 controls the image display drive control circuit 12A to send the image data to be displayed to the image display module for image 12 display, and at the same time , Controlling the second photoelectric conversion unit 102 to stop converting the ambient light into electrical signals, that is, to stop image collection.
具体地,控制模组100电性连接镜片层131,用于依据不同的控制指令提供不同的电压至镜片层131,并控制镜片层131处于聚光镜片状态或者平面镜片状态。Specifically, the control module 100 is electrically connected to the lens layer 131 for providing different voltages to the lens layer 131 according to different control commands, and controlling the lens layer 131 to be in a condensing lens state or a flat lens state.
当所述控制模组100接收到对应图像显示的第一指令时,控制模组100提供第一电压至镜片层131,控制所述镜片层131处于平面镜片状态,第一指令表征所述第一区域需处于图像显示状态。当所述控制模组100接收到对应图像采集的第二指令时,控制模组100提供第二电压至镜片层131,控制所述镜片层131处于聚光镜片状态,第二指令表征所述第一区域需处于图像采集状态。When the control module 100 receives the first instruction corresponding to the image display, the control module 100 provides a first voltage to the lens layer 131 to control the lens layer 131 to be in a flat lens state, and the first instruction represents the first The area needs to be in the image display state. When the control module 100 receives a second instruction corresponding to image capture, the control module 100 provides a second voltage to the lens layer 131 to control the lens layer 131 to be in a condensing lens state, and the second instruction represents the first The area needs to be in the image acquisition state.
请参阅图17-图18,图17为如图11、图16所示驱动显示面板进行图像显示采集的流程图,图18为如图11、图16所示驱动显示面板进行图像显示采集的时序控制示意图。Please refer to Figure 17-18. Figure 17 is a flowchart of driving the display panel for image display acquisition as shown in Figure 11 and Figure 16, and Figure 18 is the timing of driving the display panel for image display acquisition as shown in Figure 11 and Figure 16. Control diagram.
如图17与图4所示,当第一区域A1小于所述显示区域AA的面积时,驱动显示面板进行图像显示采集的步骤包括:As shown in FIG. 17 and FIG. 4, when the first area A1 is smaller than the area of the display area AA, the steps of driving the display panel to perform image display collection include:
步骤1701,接收到指示第一区域进行图像采集的第二控制指令。如图18所示,自t2时刻开始进入图像采集时间段Tc,控制模组100接收到图像采集的控制指令。需要说明的是,在t2之前的t1-t2时刻之间,显示界面AA处于图像显示时间段Td对应的图像显示状态。Step 1701: Receive a second control instruction instructing the first area to perform image collection. As shown in FIG. 18, the image acquisition time period Tc is entered from time t2, and the control module 100 receives a control instruction for image acquisition. It should be noted that between t1 and t2 before t2, the display interface AA is in the image display state corresponding to the image display time period Td.
步骤1703,控制模组100依据图像采集的第二控制指令,控制模组100输出第二电压至镜片层131,以使得镜片层131处于聚光镜状态并对环境光线进行聚光;同时,控制模组100输出第一控制信号至第二光电转换单元102以及图像采集驱动控制电路,控制第二光电转换单元102打开,并将接收的环境光线转换为电信号。In step 1703, the control module 100 outputs the second voltage to the lens layer 131 according to the second control command for image acquisition, so that the lens layer 131 is in the condenser state and condenses the ambient light; at the same time, the control module 100 outputs the first control signal to the second photoelectric conversion unit 102 and the image acquisition drive control circuit, controls the second photoelectric conversion unit 102 to turn on, and converts the received ambient light into electrical signals.
同时,控制模组100输出第一控制信号至第一光电转换单元101与图像显示驱动控制电路110,以控制图像显示驱动控制电路110停止输出图像数据至图像显示模组,以及控制第一光电转换单元101不发光。At the same time, the control module 100 outputs the first control signal to the first photoelectric conversion unit 101 and the image display drive control circuit 110 to control the image display drive control circuit 110 to stop outputting image data to the image display module, and to control the first photoelectric conversion The cell 101 does not emit light.
步骤1705,图像采集驱动控制电路13A则将电信号进行处理后重构环境光线对应的图像。图像采集驱动控制电路13A针对电信号执行放大、降噪以及其他运输处理而获得对应环境光线的图像。In step 1705, the image acquisition drive control circuit 13A processes the electrical signal and reconstructs the image corresponding to the ambient light. The image acquisition drive control circuit 13A performs amplification, noise reduction, and other transportation processing on the electrical signal to obtain an image corresponding to the ambient light.
步骤1707,接收到指示第一区域进行图像显示的第一控制指令。如图18所示,在t3时刻开始进入图像显示时间段Td,控制模组100接收到图像显示的第一控制指令。Step 1707: Receive a first control instruction instructing the first area to perform image display. As shown in FIG. 18, the image display time period Td is entered at time t3, and the control module 100 receives the first control instruction for image display.
步骤1709,依据图像显示的第一控制指令,控制模组100对应输出第二控制信号至图像显示驱动控制电路12A,控制图像显示驱动控制电路110输出图像数据至图像显示模组12与第一光电转换单元101,使得第一光电单元101依据图像数据发光并进行图像显示,同时,控制模组100输出第一电压至镜片层131,以使得镜片层131处于平面镜状态以协 助执行图像的显示。本实施例中,输出至图像显示模组12进行图像显示的图像数据可以为通过图像采集模组13采集图像。 Step 1709, according to the first control instruction for image display, the control module 100 correspondingly outputs a second control signal to the image display drive control circuit 12A, and controls the image display drive control circuit 110 to output image data to the image display module 12 and the first photoelectric The conversion unit 101 causes the first photoelectric unit 101 to emit light according to image data and perform image display. At the same time, the control module 100 outputs the first voltage to the lens layer 131 so that the lens layer 131 is in a flat mirror state to assist in performing image display. In this embodiment, the image data output to the image display module 12 for image display may be an image acquired by the image acquisition module 13.
同时,控制模组100输出第二控制信号至第二光电转换单元102以及图像采集驱动控制电路13A,以控制第二光电转换单元102关闭并停止将将环境光线转换为电信号,即停止图像采集。At the same time, the control module 100 outputs a second control signal to the second photoelectric conversion unit 102 and the image capture drive control circuit 13A to control the second photoelectric conversion unit 102 to turn off and stop converting ambient light into electrical signals, that is, stop image capture .
请参阅图19-图20,图19为如图11、图16所示驱动显示面板进行图像显示采集的流程图,图20为如图11、图16所示驱动显示面板进行图像显示采集的时序控制示意图。Please refer to Figure 19-20. Figure 19 is a flowchart of driving the display panel for image display acquisition as shown in Figure 11 and Figure 16, and Figure 20 is the timing of driving the display panel for image display acquisition as shown in Figure 11 and Figure 16. Control diagram.
如图19与图5所示,当第一区域AA与所述显示区域AA的面积相同时,驱动显示面板11进行图像显示采集的步骤包括:As shown in FIG. 19 and FIG. 5, when the area of the first area AA is the same as that of the display area AA, the steps of driving the display panel 11 to perform image display collection include:
步骤1901,接收到图像采集的第二控制指令。如图20所示,自t2时刻开始进入图像采集时间段Tc,控制模组100接收到图像采集的控制指令。需要说明的是,在t2之前的t1-t2时刻之间,显示界面AA处于图像显示时间段Td对应的图像显示状态。Step 1901: Receive a second control instruction for image collection. As shown in FIG. 20, the image acquisition time period Tc is entered from time t2, and the control module 100 receives a control instruction for image acquisition. It should be noted that between t1 and t2 before t2, the display interface AA is in the image display state corresponding to the image display time period Td.
在图像显示时间段Td,控制模组100接收到对应图像显示的第一指令,控制模组100提供第一电压至所述镜片层131,控制镜片层131处于平面镜片状态,同时控制第二光电转换单元102停止执行光电转换。During the image display time period Td, the control module 100 receives the first instruction corresponding to the image display, and the control module 100 provides the first voltage to the lens layer 131, controls the lens layer 131 to be in a flat lens state, and controls the second photoelectric The conversion unit 102 stops performing photoelectric conversion.
在图像采集时间段Tc,控制模组100接收到第二指令,控制模组100按照预设频率交替输出第一电压与第二电压至镜片层131,同时,按照预设频率交替输出第一控制信号与第二控制信号至第一光电转换单元101以及第二光电转换单元102。也即是控制图像显示模组12与图像采集模组13按照预设频率交替执行图像显示与图像采集。During the image acquisition time period Tc, the control module 100 receives the second instruction, the control module 100 alternately outputs the first voltage and the second voltage to the lens layer 131 according to the preset frequency, and at the same time, alternately outputs the first control according to the preset frequency The signal and the second control signal are sent to the first photoelectric conversion unit 101 and the second photoelectric conversion unit 102. That is, the image display module 12 and the image acquisition module 13 are controlled to alternately perform image display and image acquisition according to a preset frequency.
具体地,第二电压控制镜片层131处于聚光镜片状态针对环境光线进行聚光,第一电压控制镜片层131处于平面镜片状态协助执行图像显示,同时,通过第一控制信号与第二控制信号,分别控制所述第一光电转换单101处于未出射光线不发光或者出射光线发光,控制第二光电转换单元102处于打开执行光电转换或者关闭停止环境光线转换为电信号,从而分别实现图像显示与图像采集。Specifically, the second voltage control lens layer 131 is in the condensing lens state to condense the ambient light, and the first voltage control lens layer 131 is in the flat lens state to assist in performing image display. At the same time, through the first control signal and the second control signal, The first photoelectric conversion unit 101 is controlled to not emit light or the emitted light emits light, and the second photoelectric conversion unit 102 is controlled to be turned on to perform photoelectric conversion or turned off to stop the conversion of ambient light into electrical signals, thereby respectively realizing image display and image display. collection.
本实施例中,预设频率为60HZ,该频率下使得用户在视觉上显示界面AA保持在图像显示的状态。In this embodiment, the preset frequency is 60 Hz, and this frequency allows the user to visually display the interface AA in an image display state.
步骤1907,接收到指示第一区域进行图像显示的第一控制指令。如图20所示,在t3时刻开始进入图像显示时间段Td,控制模组100接收到图像显示的第一控制指令。Step 1907: Receive a first control instruction instructing the first area to perform image display. As shown in FIG. 20, at time t3, the image display time period Td is entered, and the control module 100 receives the first control instruction for image display.
步骤1909,依据图像显示的第一控制指令,控制模组100对应输出第二控制信号至图像显示驱动控制电路12A,控制图像显示驱动控制电路110输出图像数据至图像显示模组12与第一光电转换单元101,使得第一光电单元101依据图像数据发光并进行图像显示,同时,控制模组100输出第一电压至镜片层131,以使得镜片层131处于平面镜状态以协助执行图像的显示。本实施例中,输出至图像显示模组12进行图像显示的图像数据可以为通过图像采集模组13采集图像。 Step 1909, according to the first control instruction for image display, the control module 100 correspondingly outputs a second control signal to the image display drive control circuit 12A, and controls the image display drive control circuit 110 to output image data to the image display module 12 and the first photoelectric The conversion unit 101 causes the first photoelectric unit 101 to emit light according to image data and perform image display. At the same time, the control module 100 outputs the first voltage to the lens layer 131 so that the lens layer 131 is in a flat mirror state to assist in performing image display. In this embodiment, the image data output to the image display module 12 for image display may be an image acquired by the image acquisition module 13.
同时,控制模组100输出第二控制信号至第二光电转换单元102以及图像采集驱动控制电路13A,以控制第二光电转换单元102关闭并停止将将环境光线转换为电信号,即停止图像采集。At the same time, the control module 100 outputs a second control signal to the second photoelectric conversion unit 102 and the image capture drive control circuit 13A to control the second photoelectric conversion unit 102 to turn off and stop converting ambient light into electrical signals, that is, stop image capture .
请参阅图21,其为本申请第三实施例中针对图6所示沿着VI-VI线的剖面结构示意图。Please refer to FIG. 21, which is a schematic diagram of the cross-sectional structure along the VI-VI line shown in FIG. 6 in the third embodiment of the present application.
图像显示模组12包括第一光电转换单元101与第一读取电路131,第一光电转换单元101用于依据图像数据转换为光信号并出射显示图像,或者将环境光线转换为电信号执行图像采集。The image display module 12 includes a first photoelectric conversion unit 101 and a first reading circuit 131. The first photoelectric conversion unit 101 is used to convert image data into light signals and output and display images, or convert ambient light into electrical signals to execute images collection.
第一读取电路131用于自图像显示驱动控制电路12A读取待显示的图像数据,并且依据图像数据输出相应的驱动信号至第一光电转换单元,驱动第一光电转单元101依据驱动信号出射光线以相应显示所述图像数据。The first reading circuit 131 is used to read the image data to be displayed from the image display drive control circuit 12A, and output a corresponding drive signal to the first photoelectric conversion unit according to the image data, and drive the first photoelectric conversion unit 101 to emit according to the drive signal The light can display the image data accordingly.
或者接收第一光电转换单元101将光信号转换成的电信号,并且将电信号传输至图像采集驱动控制电路。Alternatively, the electrical signal converted from the optical signal by the first photoelectric conversion unit 101 is received, and the electrical signal is transmitted to the image capture drive control circuit.
图像采集模组13包括镜片层131与第二光电转换单元102。其中,镜片层131用于将显示面板11外部的环境光线传输至所述第二光电转换单元102。The image acquisition module 13 includes a lens layer 131 and a second photoelectric conversion unit 102. The lens layer 131 is used to transmit ambient light outside the display panel 11 to the second photoelectric conversion unit 102.
第二光电转换单元102用于将所述环境光线转换为电信号,所述电信号用于重构环境光线对应的图像,或者依据图像数据转换为光信号并出射显示图像。The second photoelectric conversion unit 102 is configured to convert the ambient light into an electric signal, and the electric signal is used to reconstruct an image corresponding to the ambient light, or convert it into an optical signal according to image data, and emit a display image.
其中,第一光电转换单元101、第二光电转换单元102出射光线与接收光线不同时进行。Wherein, the first photoelectric conversion unit 101 and the second photoelectric conversion unit 102 emit light and receive light at different times.
本实施例中,第一光电转换单元101与第二光电转换单元102并列同层设置,且镜片层131覆盖第一光电转换单元101与第二光电转换单元102的表面,同时,读取电路121对应设置于第一光电转换单元101与第二光电转换单元102远离镜片层131的表面,并且与第一光电转换单元101与第二光电转换单元102,以将读取的图像数据传输至第一光电转换单元101与第二光电转换单元102执行光电转换。In this embodiment, the first photoelectric conversion unit 101 and the second photoelectric conversion unit 102 are arranged side by side in the same layer, and the lens layer 131 covers the surfaces of the first photoelectric conversion unit 101 and the second photoelectric conversion unit 102. At the same time, the reading circuit 121 Correspondingly arranged on the surface of the first photoelectric conversion unit 101 and the second photoelectric conversion unit 102 away from the lens layer 131, and are connected with the first photoelectric conversion unit 101 and the second photoelectric conversion unit 102 to transmit the read image data to the first photoelectric conversion unit 101 and the second photoelectric conversion unit 102. The photoelectric conversion unit 101 and the second photoelectric conversion unit 102 perform photoelectric conversion.
本实施例中,镜片层131包括聚光镜片状态或者平面镜片状态两种状态。当镜片层131处于平面镜状态时,镜片层131中的超平面透镜相位偏移角度为0°,所述镜片层131为平面镜。In this embodiment, the lens layer 131 includes two states: a condenser lens state or a flat lens state. When the lens layer 131 is in a plane mirror state, the phase offset angle of the hyperplane lens in the lens layer 131 is 0°, and the lens layer 131 is a plane lens.
当镜片层131处于聚光镜状态时,镜片层131将所述环境光线汇聚传输至所述第二光电转换单元102。When the lens layer 131 is in the condenser state, the lens layer 131 converges and transmits the ambient light to the second photoelectric conversion unit 102.
所述镜片层131处于聚光镜片状态或者平面镜片可以通过接受不同的电压来实现切换。The lens layer 131 is in a condensing lens state or a flat lens can be switched by receiving different voltages.
具体地,提供第一电压至所述镜片层131,控制镜片层131处于平面镜片状态,超平面透镜使得入射的环境光线相位偏移角度为0°,处于平面镜片状态;第二电压控制超平面透镜使得入射的环境光线相位偏移角度为
Figure PCTCN2020088534-appb-000009
所述平面透镜为具有聚光透镜。
Specifically, a first voltage is provided to the lens layer 131, and the lens layer 131 is controlled to be in a flat lens state. The hyperplane lens makes the incident ambient light phase shift angle of 0° and is in the flat lens state; the second voltage controls the hyperplane The lens makes the incident ambient light phase shift angle by
Figure PCTCN2020088534-appb-000009
The plane lens has a condenser lens.
当所述第一区域A1处于图像显示状态时,所述第一光电转换单元101与第二光电转换单元102出射光线以显示图像,镜片层131处于平面镜片状态。When the first area A1 is in an image display state, the first photoelectric conversion unit 101 and the second photoelectric conversion unit 102 emit light to display an image, and the lens layer 131 is in a flat lens state.
当所述第一区域A1处于图像采集状态时,所述第一光电转换单元101与第二光电转换单元102停止出射光线,镜片层131处于聚光镜状态,并将所述环境光线汇聚传输至第一光电转换单元101与第二光电转换单元102,第一光电转换单元101与第二光电转换单元102接收并采集自所述镜片层131提供的经汇聚后的所述环境光线,并将所述环境光线 转换为电信号提供至读取电路121。When the first area A1 is in the image acquisition state, the first photoelectric conversion unit 101 and the second photoelectric conversion unit 102 stop emitting light, the lens layer 131 is in the condenser state, and the ambient light is concentrated and transmitted to the first The photoelectric conversion unit 101 and the second photoelectric conversion unit 102, the first photoelectric conversion unit 101 and the second photoelectric conversion unit 102 receive and collect the converged ambient light provided from the lens layer 131, and combine the ambient light The light is converted into electrical signals and provided to the reading circuit 121.
本实施例中,所述第一转换单元101与第二转换单元102均为μ-LED,才能够分时将电信号转换为光信号执行图像显示或者将环境光线转换为电信号执行图像采集。In this embodiment, the first conversion unit 101 and the second conversion unit 102 are both μ-LEDs, which can time-sharing convert electrical signals into optical signals to perform image display or convert ambient light into electrical signals to perform image acquisition.
请参阅图22,其为如图21所示驱动显示面板功能模组连接示意图。Please refer to FIG. 22, which is a schematic diagram of the connection of the driving display panel function module shown in FIG. 21.
如图22所示,控制模组100电性连接图像显示驱动控制电路110、镜片层、图像显示驱动控制电路120以及第一光电转换单元101、第二光电转换单元102。As shown in FIG. 22, the control module 100 is electrically connected to the image display drive control circuit 110, the lens layer, the image display drive control circuit 120, the first photoelectric conversion unit 101 and the second photoelectric conversion unit 102.
其中,控制模组100用于接收来自于输入模组提供的控制指令,控制指令包括指示显示设备在显示界面AA的第一区域A1执行图像显示或者采集图像。Wherein, the control module 100 is configured to receive a control instruction provided by the input module, and the control instruction includes instructing the display device to perform image display or capture an image in the first area A1 of the display interface AA.
控制指令可以为用户操作输入模组中的触摸屏,例如显示界面AA当前时刻执行图像显示,当用户需要进行拍照时,操作并触发触摸屏上的摄像应用程序,从而输出图像采集的控制指令到控制模组100。The control instruction can be the user's touch screen in the input module. For example, the display interface AA executes image display at the current moment. When the user needs to take a picture, the camera application program on the touch screen is operated and triggered to output the control instruction for image collection to the control module. Group 100.
进一步,当图像采集完成,用户再次执行相应的触摸操作时,例如点击操作“拍照”图标所在的位置时,输出图像采集完成而需要进行图像显示的控制指令到控制模组100。Further, when the image acquisition is completed and the user performs a corresponding touch operation again, for example, when the user clicks the position where the "photograph" icon is located, the control instruction for image display is output to the control module 100 after the image acquisition is completed.
在本申请其他实施例中,控制指令也可以为用户操作输入模组中的机械按键、语音模组、动作传感模组或者脑电波感测模组而产生的指令。In other embodiments of the present application, the control instruction may also be an instruction generated by a user operating a mechanical button, a voice module, a motion sensing module, or a brain wave sensing module in the input module.
读取电路121分别电性连接图像显示驱动控制电路110与图像显示驱动控制电路120。The reading circuit 121 is electrically connected to the image display driving control circuit 110 and the image display driving control circuit 120 respectively.
当控制模组100接收到图像采集的第一控制指令时,控制模组100控制图像显示驱动控制电路110停止输出图像数据至图像显示模组,同时,控制镜片层131处于聚光镜状态,以及控制第一光电转单元101、第二光电转换单元102将接收的环境光线转换为电信号,而图像采集驱动控制电路则将电信号进行处理后重构环境光线对应的图像。When the control module 100 receives the first control instruction for image capture, the control module 100 controls the image display drive control circuit 110 to stop outputting image data to the image display module, and at the same time, controls the lens layer 131 to be in the condenser state, and controls the first A photoelectric conversion unit 101 and a second photoelectric conversion unit 102 convert the received ambient light into electrical signals, and the image acquisition drive control circuit processes the electrical signals and reconstructs an image corresponding to the ambient light.
当控制模组100接收到图像采集完成并需要进行图像显示的第二控制指令时,控制模组100控制图像显示驱动控制电路110将待显示的图像数据至图像显示模组12进行图像显示,同时,控制镜片层131处于平面镜状态,以及控制第一光电转换单元101、第二光电转换单元102停止将将环境光线转换为电信号,即停止图像采集。When the control module 100 receives the second control instruction that the image acquisition is completed and the image display needs to be performed, the control module 100 controls the image display drive control circuit 110 to send the image data to be displayed to the image display module 12 for image display, and at the same time , Controlling the lens layer 131 to be in a plane mirror state, and controlling the first photoelectric conversion unit 101 and the second photoelectric conversion unit 102 to stop converting ambient light into electrical signals, that is, stop image collection.
具体地,控制模组100电性连接所述镜片层131,用于依据不同的控制指令提供不同的电压至镜片层131并控制镜片层131处于聚光镜片状态或者平面镜片状态。Specifically, the control module 100 is electrically connected to the lens layer 131 for providing different voltages to the lens layer 131 according to different control commands and controlling the lens layer 131 to be in a condensing lens state or a flat lens state.
当所述控制模组100接收到第一指令时,提供第一电压至镜片层131,控制镜片层131处于平面镜片状态,第一指令表征所述第一区域需处于图像显示状态。When the control module 100 receives the first command, it provides a first voltage to the lens layer 131 to control the lens layer 131 to be in a flat lens state. The first command indicates that the first area needs to be in an image display state.
当所述控制模组100接收到第二指令时,提供第二电压至镜片层131,控制所述镜片层131处于聚光镜片状态,第二指令表征所述第一区域需处于图像采集状态。When the control module 100 receives the second instruction, it provides a second voltage to the lens layer 131 to control the lens layer 131 to be in the condensing lens state. The second instruction indicates that the first area needs to be in the image acquisition state.
请参阅图23,图23为如图11、图16所示驱动显示面板进行图像显示采集的时序控制示意图。Please refer to FIG. 23. FIG. 23 is a schematic diagram of timing control for driving the display panel to perform image display acquisition as shown in FIG. 11 and FIG. 16.
如图23所示,当第一区域小于所述显示区域的面积时。As shown in FIG. 23, when the first area is smaller than the area of the display area.
控制模组100接收到图像采集的第二控制指令。如图23所示,在t2时刻,控制模组100接收指示第一区域进入图像采集的第二控制指令,第一区域进入图像采集时段Tc。需要说明的是,在t2之前的图像显示时间段Td包括的t1-t1时刻之间,显示界面AA处于图 像显示状态。The control module 100 receives the second control instruction for image collection. As shown in FIG. 23, at time t2, the control module 100 receives a second control instruction instructing the first area to enter the image capture, and the first area enters the image capture period Tc. It should be noted that the display interface AA is in the image display state between t1-t1 included in the image display time period Td before t2.
控制模组100依据第一控制指令,输出第二电压至镜片层131,使得镜片层131处于聚光镜状态以针对环境光线进行聚光;输出第一控制信号至第二光电转换单元102以及图像采集驱动控制电路,控制第一光电转换单元101与第二光电转换单元102处于感光状态,以将接收的环境光线转换为电信号。The control module 100 outputs a second voltage to the lens layer 131 according to the first control instruction, so that the lens layer 131 is in the condenser state to condense light from the ambient light; outputs the first control signal to the second photoelectric conversion unit 102 and the image capture driver The control circuit controls the first photoelectric conversion unit 101 and the second photoelectric conversion unit 102 to be in a photosensitive state to convert the received ambient light into electrical signals.
同时,控制模组100输出第一控制信号至图像显示驱动控制电路110,以控制图像显示驱动控制电路110停止输出图像数据至图像显示模组。At the same time, the control module 100 outputs the first control signal to the image display drive control circuit 110 to control the image display drive control circuit 110 to stop outputting image data to the image display module.
图像采集驱动控制电路13A则将电信号进行处理后重构环境光线对应的图像。The image acquisition drive control circuit 13A processes the electrical signal and reconstructs the image corresponding to the ambient light.
控制模组100接收到图像显示的控制指令。如图23所示,在t3时刻,控制模组100接收到指示第一区域进行图像显示的第一控制指令。The control module 100 receives a control command for image display. As shown in FIG. 23, at time t3, the control module 100 receives a first control instruction instructing the first area to perform image display.
控制模组100依据第一控制指令,输出控制模组100输出第二控制信号至图像显示驱动控制电路110,控制图像显示驱动控制电路110输出图像数据至图像显示模组进行图像显示。本实施例中,输出至图像显示模组进行图像显示的图像数据可以为通过图像采集模组采集图像。According to the first control instruction, the control module 100 outputs a second control signal to the image display drive control circuit 110, and controls the image display drive control circuit 110 to output image data to the image display module for image display. In this embodiment, the image data output to the image display module for image display may be images collected by the image acquisition module.
同时,控制模组100输出第一电压至至镜片层131,使得镜片层131处于平面镜状态以协助进行图像显示;输出第二控制信号至第二光电转换单元101与第二光电转换单元102,以控制二者均发光以执行图像显示。本实施例中,第一控制信号与第二控制信号可以复用第一电压与第二电压来执行针对第一光电转换单元101与第二光电转换单元102的控制。At the same time, the control module 100 outputs the first voltage to the lens layer 131 so that the lens layer 131 is in a flat mirror state to assist in image display; and outputs a second control signal to the second photoelectric conversion unit 101 and the second photoelectric conversion unit 102 to Both are controlled to emit light to perform image display. In this embodiment, the first control signal and the second control signal can multiplex the first voltage and the second voltage to perform control of the first photoelectric conversion unit 101 and the second photoelectric conversion unit 102.
请参阅图24,图24为如图11、图16所示驱动显示面板进行图像显示采集的时序控制示意图。如图24所示,当第一区域与所述显示区域的面积相同时:Please refer to FIG. 24. FIG. 24 is a schematic diagram of timing control for driving the display panel to perform image display acquisition as shown in FIG. 11 and FIG. 16. As shown in FIG. 24, when the area of the first area and the display area are the same:
在图像显示时间段Tc,控制模组100接收到第一指令,控制模组100提供第一电压至所述镜片层131,控制镜片层131处于平面镜片状态以协助进行同学显示,同时控制第一光电转换单元101与第二光电转换单元102同时发光以针对图像数据进行显示。During the image display time period Tc, the control module 100 receives the first command, and the control module 100 provides the first voltage to the lens layer 131, controls the lens layer 131 to be in a flat lens state to assist students in displaying, and at the same time controls the first The photoelectric conversion unit 101 and the second photoelectric conversion unit 102 emit light at the same time to display image data.
在图像采集时间段Td,控制模组100接收到第二指令,控制模组100按照预设频率交替输出第一电压与第二电压。第二电压控制镜片层131处于聚光镜状态以针对环境光线进行聚光,同时控制第一光电转换单元101与第二光电转换单元102处于感光状态以将汇聚的环境光线转换为电信号;第一电压控制镜片层131处于平面镜状态以针对协助进行图像显示,同时控制第一光电转换单元101与第二光电转换单元102发光以执行图像显示。本实施例中,所述预设频率为60HZ,该频率下使得用户在视觉上显示界面AA保持在图像显示的状态。During the image acquisition time period Td, the control module 100 receives the second instruction, and the control module 100 alternately outputs the first voltage and the second voltage according to the preset frequency. The second voltage controls the lens layer 131 to be in the condensing lens state to condense the ambient light, while controlling the first photoelectric conversion unit 101 and the second photoelectric conversion unit 102 to be in a photosensitive state to convert the concentrated ambient light into electrical signals; the first voltage The lens layer 131 is controlled to be in a flat mirror state to assist in image display, and at the same time, the first photoelectric conversion unit 101 and the second photoelectric conversion unit 102 are controlled to emit light to perform image display. In this embodiment, the preset frequency is 60 Hz, and this frequency allows the user to visually display the interface AA in an image display state.
以上对本申请实施例所提供的一种像素电路进行了详细介绍,本文中应用了具体个例对本申请的原理及实施例进行了阐述,以上实施例的说明只是用于帮助理解本申请的方法及其核心思想;同时,对于本领域的一般技术人员,依据本申请的思想,在具体实施例及应用范围上均会有改变之处,综上所述,本说明书内容不应理解为对本申请的限制。The above is a detailed introduction to a pixel circuit provided by the embodiments of the present application, and specific examples are used in this article to illustrate the principles and embodiments of the present application. The descriptions of the above embodiments are only used to help understand the method and Its core idea; at the same time, for those of ordinary skill in the art, according to the idea of this application, there will be changes in the specific embodiments and scope of application. limit.

Claims (16)

  1. 一种显示面板,包括显示区域,所述显示区域包括多个呈矩阵排列的像素单元,每一个像素单元包括至少一个用于出射光线以显示图像的第一光电转换单元,其特征在于,所述显示区域内的第一区域中像素单元之间设置有图像采集模组,A display panel includes a display area, the display area includes a plurality of pixel units arranged in a matrix, and each pixel unit includes at least one first photoelectric conversion unit for emitting light to display an image, wherein the An image acquisition module is arranged between the pixel units in the first area in the display area,
    所述图像采集模组包括镜片层与第二光电转换单元,所述镜片层用于将显示面板外部的环境光线传输至所述第二光电转换单元,所述第二光电转换单元用于在图像采集状态时将所述环境光线转换为电信号,所述电信号用于重构环境光线对应的图像,其中,所述第一光电转换单元出射光线与所述第二光电转换单元输出所述电信号分时进行。The image acquisition module includes a lens layer and a second photoelectric conversion unit, the lens layer is used to transmit ambient light outside the display panel to the second photoelectric conversion unit, the second photoelectric conversion unit is used to In the acquisition state, the ambient light is converted into an electrical signal, and the electrical signal is used to reconstruct an image corresponding to the ambient light, wherein the light emitted by the first photoelectric conversion unit and the second photoelectric conversion unit output the electrical signal. The signal is time-sharing.
  2. 根据权利要求1所述的显示面板,其特征在于,The display panel of claim 1, wherein:
    所述第一区域包括图像显示状态与图像采集状态,所述第一区域处于所述图像显示状态时,所述第一光电转换单元出射光线执行图像显示,所述第二光电转换单元停止输出所述电信号;所述第一区域处于所述图像采集状态时,所述第一光电转换单元停止出射光线,所述第二光电转换单元将所述环境光线转换为所述电信号;The first area includes an image display state and an image acquisition state. When the first area is in the image display state, the first photoelectric conversion unit emits light to perform image display, and the second photoelectric conversion unit stops outputting The electrical signal; when the first area is in the image acquisition state, the first photoelectric conversion unit stops emitting light, and the second photoelectric conversion unit converts the ambient light into the electrical signal;
    所述镜片层为聚光镜片,用于将所述环境光线汇聚传输至所述第二光电转换单元,当所述第一区域处于图像采集状态时,所述第二光电转换单元接收并采集自所述镜片层提供的经汇聚后的所述环境光线,并将所述环境光线转换为电信号。The lens layer is a condensing lens, which is used to converge and transmit the ambient light to the second photoelectric conversion unit. When the first area is in an image capture state, the second photoelectric conversion unit receives and collects it from the second photoelectric conversion unit. The converged ambient light provided by the lens layer converts the ambient light into an electrical signal.
  3. 根据权利要求1所述的显示面板,其特征在于,所述第一光电转换单元与所述镜片层同一层并列设置,所述镜片层正对并覆盖所述第二光电转换单元。4. The display panel of claim 1, wherein the first photoelectric conversion unit and the lens layer are arranged side by side in the same layer, and the lens layer faces and covers the second photoelectric conversion unit.
  4. 根据权利要求1所述的显示面板,其特征在于,所述镜片层包括聚光镜片状态与平面镜片状态,The display panel of claim 1, wherein the lens layer includes a condensing lens state and a flat lens state,
    当所述第一区域处于图像显示状态时,所述第一光电转换单元出射光线以显示图像,所述镜片层处于平面镜片状态,所述第二光电转换单元停止将所述环境光线转换为所述电信号;When the first area is in the image display state, the first photoelectric conversion unit emits light to display the image, the lens layer is in the flat lens state, and the second photoelectric conversion unit stops converting the ambient light into all The electrical signal;
    当所述第一区域处于图像采集状态时,所述第一光电转换单元停止出射光线,所述镜片层处于聚光镜状态,并将所述环境光线汇聚传输至所述第二光电转换单元,所述第二光电转换单元接收并采集自所述镜片层提供的经汇聚后的所述环境光线,并将所述环境光线转换为电信号。When the first area is in the image capturing state, the first photoelectric conversion unit stops emitting light, the lens layer is in the condenser state, and the ambient light is converged and transmitted to the second photoelectric conversion unit. The second photoelectric conversion unit receives and collects the converged ambient light provided from the lens layer, and converts the ambient light into an electrical signal.
  5. 根据权利要求4所述的显示面板,其特征在于,所述显示面板还包括控制模组,所述控制模组连接于所述镜片层,所述控制模组用于输出不同的电压至所述镜片层并控制所述镜片层处于聚光镜片状态或者平面镜片状态;The display panel according to claim 4, wherein the display panel further comprises a control module, the control module is connected to the lens layer, and the control module is used to output different voltages to the The lens layer and controlling the lens layer to be in a condensing lens state or a flat lens state;
    当所述控制模组接收到第一指令时,所述控制模组输出第一电压至所述镜片层并控制所述镜片层处于平面镜片状态,所述第一指令用于指示所述第一区域进行图像显示;或When the control module receives the first instruction, the control module outputs a first voltage to the lens layer and controls the lens layer to be in a flat lens state, and the first instruction is used to instruct the first Area for image display; or
    当所述控制模组接收到第二指令时,所述控制模组输出第二电压至所述镜片层并控制 所述镜片层处于聚光镜片状态,所述第二指令用于指示所述第一区域进行图像采集。When the control module receives the second instruction, the control module outputs a second voltage to the lens layer and controls the lens layer to be in the condensing lens state, and the second instruction is used to instruct the first Area for image acquisition.
  6. 根据权利要求4或者5所述的显示面板,其特征在于,The display panel according to claim 4 or 5, wherein:
    所述镜片层为超平面透镜,The lens layer is a hyperplane lens,
    所述第一电压控制所述环境光线进入所述超平面透镜的相位偏移角度为0°,所述超平面透镜为平面镜;The first voltage controls the phase shift angle of the ambient light entering the hyperplane lens to 0°, and the hyperplane lens is a plane mirror;
    所述第二电压控制所述环境光线进入所述超平面透镜的相位偏移角度为
    Figure PCTCN2020088534-appb-100001
    所述超平面透镜为具有聚光透镜,用于将所述环境光线汇聚并透射至所述第二光电转换单元,所述相位偏移角度
    Figure PCTCN2020088534-appb-100002
    用于调整当前采集图像所需的焦距。
    The second voltage controls the phase shift angle of the ambient light entering the hyperplane lens to be
    Figure PCTCN2020088534-appb-100001
    The hyperplane lens has a condenser lens for condensing and transmitting the ambient light to the second photoelectric conversion unit, and the phase shift angle
    Figure PCTCN2020088534-appb-100002
    It is used to adjust the focal length required for the currently acquired image.
  7. 根据权利要求6所述的显示面板,其特征在于,当第一区域与所述显示区域的形状与面积相同时,7. The display panel of claim 6, wherein when the shape and area of the first area and the display area are the same,
    所述控制模组接收到第一指令,所述控制模组提供第一电压至所述镜片层,控制所述镜片层处于平面镜片状态,同时控制所述第二光电转换单元停止执行光电转换;The control module receives the first instruction, the control module provides a first voltage to the lens layer, controls the lens layer to be in a flat lens state, and at the same time controls the second photoelectric conversion unit to stop performing photoelectric conversion;
    所述控制模组接收到第二指令,所述控制模组按照预设频率交替输出第一电压与第二电压,The control module receives the second instruction, and the control module alternately outputs the first voltage and the second voltage according to a preset frequency,
    所述第二电压控制所述第一光电转换单元停止出射光线,同时控制所述镜片层处于聚光镜片状态,以及控制所述第二光电转换单元将自所述镜片层接收的经过汇聚后的环境光线执行光电转换。The second voltage controls the first photoelectric conversion unit to stop emitting light, and at the same time controls the lens layer to be in the condensing lens state, and controls the second photoelectric conversion unit to control the converged environment received from the lens layer The light performs photoelectric conversion.
  8. 根据权利要求6所述的显示面板,其特征在于,当第一区域小于所述显示区域的面积时,7. The display panel of claim 6, wherein when the first area is smaller than the area of the display area,
    所述控制模组接收到第一指令,所述控制模组提供第一电压至所述镜片层,控制所述镜片层处于平面镜片状态,同时控制所述第二光电转换单元停止执行光电转换;The control module receives the first instruction, the control module provides a first voltage to the lens layer, controls the lens layer to be in a flat lens state, and at the same time controls the second photoelectric conversion unit to stop performing photoelectric conversion;
    所述控制模组接收到第二指令,所述控制模组输出第二电压,所述第二电压控制所述第一光电转换单元停止出射光线,同时控制所述镜片层处于聚光镜片状态,以及控制所述第二光电转换单元将自所述镜片层接收的经过汇聚后的环境光线执行光电转换。The control module receives a second instruction, the control module outputs a second voltage, the second voltage controls the first photoelectric conversion unit to stop emitting light, and at the same time controls the lens layer to be in a condensing lens state, and The second photoelectric conversion unit is controlled to perform photoelectric conversion on the condensed ambient light received from the lens layer.
  9. 根据权利要求8所述的显示面板,其特征在于,当所述控制模组再次接收到所述第一指令时,所述显示面板退出所述图像采集状态并进入所述图像显示状态。8. The display panel according to claim 8, wherein when the control module receives the first instruction again, the display panel exits the image acquisition state and enters the image display state.
  10. 根据权利要求4-9任意一项所述的显示面板,其特征在于,所述第一光电转换单元与所述第二光电转换单元同层并列设置,所述镜片层正对并覆盖所述第二光电转换单元。The display panel according to any one of claims 4-9, wherein the first photoelectric conversion unit and the second photoelectric conversion unit are arranged side by side on the same layer, and the lens layer is directly opposite and covers the first photoelectric conversion unit. Two photoelectric conversion unit.
  11. 根据权利要求6所述的显示面板,其特征在于,The display panel of claim 6, wherein:
    所述第一光电转换单元还用于在图像采集状态接收所述环境光线并将所述环境光线转换为电信号执行图像采集;The first photoelectric conversion unit is further configured to receive the ambient light in an image acquisition state and convert the ambient light into electrical signals to perform image acquisition;
    所述第二光电转换单元还用于在图像显示状态将将图像数据转换为光信号出射以显示 图像;The second photoelectric conversion unit is also used for converting image data into light signals and emitting them to display images in an image display state;
    所述第一光电转换单元与所述第二光电转换单元为微发光二极管。The first photoelectric conversion unit and the second photoelectric conversion unit are micro light emitting diodes.
  12. 根据权利要求11所述的显示面板,其特征在于,所述第一光电转换单元与所述第二光电转换单元同一层并列设置,所述镜片层覆盖所述第一转换单元与所述第二光电转换单元。The display panel of claim 11, wherein the first photoelectric conversion unit and the second photoelectric conversion unit are arranged side by side on the same layer, and the lens layer covers the first conversion unit and the second photoelectric conversion unit. Photoelectric conversion unit.
  13. 根据权利要求11或者12所述的显示面板,其特征在于,The display panel according to claim 11 or 12, wherein:
    当第一区域与所述显示区域的面积相同时,When the area of the first area and the display area are the same,
    所述控制模组接收到第一指令,所述控制模组提供第一电压至所述镜片层,控制所述镜片层处于平面镜片状态,同时控制所述第一光电转换单元与所述第二光电转换单元同时出射光线显示图像;The control module receives the first instruction, the control module provides a first voltage to the lens layer, controls the lens layer to be in a flat lens state, and controls the first photoelectric conversion unit and the second photoelectric conversion unit at the same time. The photoelectric conversion unit emits light at the same time to display images;
    所述控制模组接收到第二指令,所述控制模组按照预设频率交替输出第一电压与第二电压,所述第二电压控制所述镜片层处于聚光镜片状态,控制所述第一光电转换单元与所述第二光电转换单号停止出射光线,并同时自所述镜片层接收的经过汇聚后的环境光线执行光电转换。The control module receives a second instruction, the control module alternately outputs a first voltage and a second voltage according to a preset frequency, and the second voltage controls the lens layer to be in a condensing lens state, and controls the first The photoelectric conversion unit and the second photoelectric conversion order stop emitting light, and at the same time perform photoelectric conversion of the condensed ambient light received from the lens layer.
  14. 根据权利要求11或者12所述的显示面板,其特征在于,The display panel according to claim 11 or 12, wherein:
    当第一区域小于所述显示区域的面积时,When the first area is smaller than the area of the display area,
    所述控制模组接收到第一指令,所述控制模组提供第一电压至所述镜片层,控制所述镜片层处于平面镜片状态,同时控制所述第一光电转换单元与所述第二光电转换单元同时出射光线显示图像;The control module receives the first instruction, the control module provides a first voltage to the lens layer, controls the lens layer to be in a flat lens state, and controls the first photoelectric conversion unit and the second photoelectric conversion unit at the same time. The photoelectric conversion unit emits light at the same time to display images;
    所述控制模组接收到第二指令,所述控制模组输出第二电压,The control module receives the second instruction, and the control module outputs the second voltage,
    所述第二电压控制所述镜片层处于聚光镜片状态,控制所述第一光电转换单元与所述第二光电转换单号停止出射光线,并同时自所述镜片层接收的经过汇聚后的环境光线执行光电转换。The second voltage controls the lens layer to be in a condensing lens state, controls the first photoelectric conversion unit and the second photoelectric conversion order to stop emitting light, and at the same time receives the converged environment from the lens layer The light performs photoelectric conversion.
  15. 一种显示终端,其特征在于,包括输入模组与前述任意一项所述的显示面板,所述输入模组用于接受用户的操作而输入的控制指令,依据所述控制指令产生所述第一控制指令与所述第二控制指令。A display terminal, characterized by comprising an input module and the display panel of any one of the foregoing, the input module is used to accept a control command input by a user's operation, and generate the first control command according to the control command. A control instruction and the second control instruction.
  16. 一种显示装置,其特征在于,包括前述任意一项所述的显示面板。A display device, characterized by comprising the display panel described in any one of the foregoing.
PCT/CN2020/088534 2020-04-30 2020-04-30 Display panel, display terminal and display device WO2021217676A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN202080099986.6A CN115428063A (en) 2020-04-30 2020-04-30 Display panel, display terminal and display device
PCT/CN2020/088534 WO2021217676A1 (en) 2020-04-30 2020-04-30 Display panel, display terminal and display device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2020/088534 WO2021217676A1 (en) 2020-04-30 2020-04-30 Display panel, display terminal and display device

Publications (1)

Publication Number Publication Date
WO2021217676A1 true WO2021217676A1 (en) 2021-11-04

Family

ID=78373159

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/088534 WO2021217676A1 (en) 2020-04-30 2020-04-30 Display panel, display terminal and display device

Country Status (2)

Country Link
CN (1) CN115428063A (en)
WO (1) WO2021217676A1 (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130057521A1 (en) * 2011-09-05 2013-03-07 Gun-Shik Kim Organic light emitting diode display
CN108174071A (en) * 2018-01-23 2018-06-15 深圳市群晖智能科技股份有限公司 A kind of low camera module for accounting for screen rate
WO2020001244A1 (en) * 2018-06-29 2020-01-02 中兴通讯股份有限公司 Display screen module, terminal and control method therefor, apparatus, and computer storage medium
CN110794604A (en) * 2019-11-29 2020-02-14 武汉华星光电技术有限公司 Display device and manufacturing method thereof
CN111029381A (en) * 2019-12-09 2020-04-17 武汉华星光电半导体显示技术有限公司 Organic light emitting display panel and organic light emitting display device

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN208271897U (en) * 2018-03-16 2018-12-21 华为技术有限公司 A kind of display screen and display terminal
CN110928075B (en) * 2019-12-17 2023-04-18 京东方科技集团股份有限公司 Display device, manufacturing method, and display and camera shooting method
CN111047996B (en) * 2020-01-03 2021-12-10 武汉天马微电子有限公司 Display module assembly and display device

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130057521A1 (en) * 2011-09-05 2013-03-07 Gun-Shik Kim Organic light emitting diode display
CN108174071A (en) * 2018-01-23 2018-06-15 深圳市群晖智能科技股份有限公司 A kind of low camera module for accounting for screen rate
WO2020001244A1 (en) * 2018-06-29 2020-01-02 中兴通讯股份有限公司 Display screen module, terminal and control method therefor, apparatus, and computer storage medium
CN110794604A (en) * 2019-11-29 2020-02-14 武汉华星光电技术有限公司 Display device and manufacturing method thereof
CN111029381A (en) * 2019-12-09 2020-04-17 武汉华星光电半导体显示技术有限公司 Organic light emitting display panel and organic light emitting display device

Also Published As

Publication number Publication date
CN115428063A (en) 2022-12-02

Similar Documents

Publication Publication Date Title
JP6246292B2 (en) OLED display device with light detection function
US9300909B2 (en) Image display apparatus, electronic apparatus, image display system, image acquisition method and program
JP2011242616A (en) Image display device, electronic apparatus, image display system, image acquisition method, and program
JP5644928B2 (en) Image display device with imaging device
JPH06342146A (en) Picture display device, semiconductor device and optical instrument
US10354597B2 (en) Optical detection device and method of controlling same
JP6118293B2 (en) display
EP2330819A2 (en) Image display device with imaging unit
WO2021098349A1 (en) Camera module, camera, terminal device and image information determination method
US20180267651A1 (en) Touch Display Device
JP2009093497A (en) Display system and method for detecting pointed position
US11397475B2 (en) Display device, electronic device and method for driving display device
TW200925965A (en) Display apparatus
JP4632129B2 (en) Image reading device
CN101783884B (en) Camera device
US20220343471A1 (en) Electronic apparatus
JP2011151652A (en) Image display apparatus with imaging device
WO2021217676A1 (en) Display panel, display terminal and display device
JP2011150583A (en) Image display device having imaging device
JP2011257496A (en) Image display device, electric equipment, image display system, image display method, illumination light distribution correction device, illumination light distribution correction method, and program
CN113810578B (en) Under-screen camera module and display device
CN110995902B (en) Electronic device, electronic apparatus, and image processing method
JP2013174725A (en) Optical finder and optical device using the same
WO2020181939A1 (en) Display device and display method therefor
JP2013120988A (en) Head mounted type display device

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20933249

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20933249

Country of ref document: EP

Kind code of ref document: A1