WO2018161563A1 - 显示面板、显示装置及其获取图像的方法 - Google Patents

显示面板、显示装置及其获取图像的方法 Download PDF

Info

Publication number
WO2018161563A1
WO2018161563A1 PCT/CN2017/105526 CN2017105526W WO2018161563A1 WO 2018161563 A1 WO2018161563 A1 WO 2018161563A1 CN 2017105526 W CN2017105526 W CN 2017105526W WO 2018161563 A1 WO2018161563 A1 WO 2018161563A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
imaging
display panel
display
imaging members
Prior art date
Application number
PCT/CN2017/105526
Other languages
English (en)
French (fr)
Inventor
郭玉珍
董学
王海生
刘英明
丁小梁
吴俊纬
郑智仁
韩艳玲
许睿
李昌峰
秦云科
顾品超
Original Assignee
京东方科技集团股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 京东方科技集团股份有限公司 filed Critical 京东方科技集团股份有限公司
Priority to US15/773,755 priority Critical patent/US10623697B2/en
Publication of WO2018161563A1 publication Critical patent/WO2018161563A1/zh

Links

Images

Classifications

    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09F—DISPLAYING; ADVERTISING; SIGNS; LABELS OR NAME-PLATES; SEALS
    • G09F9/00—Indicating arrangements for variable information in which the information is built-up on a support by selection or combination of individual elements
    • G09F9/30—Indicating arrangements for variable information in which the information is built-up on a support by selection or combination of individual elements in which the desired character or characters are formed by combining individual elements
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/14—Systems for two-way working
    • H04N7/141—Systems for two-way working between two video terminals, e.g. videophone
    • H04N7/142—Constructional details of the terminal equipment, e.g. arrangements of the camera and the display
    • H04N7/144—Constructional details of the terminal equipment, e.g. arrangements of the camera and the display camera and display on the same optical axis, e.g. optically multiplexing the camera and display for eye to eye contact
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/95—Computational photography systems, e.g. light-field imaging systems
    • H04N23/957—Light-field or plenoptic cameras or camera modules
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/50—Constructional details

Definitions

  • Embodiments of the present disclosure relate to a display panel, a display device, and a method of acquiring an image thereof.
  • a front camera having an image capturing function configured in a display device such as a mobile phone is generally located in a non-display area of the display screen, and the front camera takes up space in a peripheral area of the display screen, which is disadvantageous for a narrow bezel design.
  • Embodiments of the present disclosure provide a display panel, a display device, and a method thereof for acquiring an image, to implement an image acquisition function in a display area of a display panel.
  • An embodiment of the present disclosure provides a display panel including a display area and an image acquisition device, wherein at least a portion of the image acquisition device is located in the display area in a plan view of the display panel.
  • the display panel has a display surface
  • the image acquisition device includes: a plurality of imaging members and an image sensor, wherein the plurality of imaging members are located between the display surface and the image sensor, wherein
  • the plurality of imaging components includes a plurality of substantially identical first imaging components and a plurality of substantially identical second imaging components, the first imaging components and the second imaging components configured to target at different object distances Imaged to the same image plane.
  • the first imaging component and the second imaging component are configured to have different maximum object distances at the same resolution.
  • the image acquisition device further includes a plurality of microlenses between the plurality of imaging members and the image sensor.
  • the microlens layer is located between the same image plane and the image sensor.
  • the display panel further includes a plurality of display units located in the display area, wherein the plurality of display units are located between the display surface and the image sensor.
  • the plurality of display units include an opaque conductive layer, wherein the plurality of first imaging members and the plurality of second imaging members are located in the opaque conductive layer.
  • the display panel further includes a black matrix layer, wherein the plurality of first imaging members and the plurality of second imaging members are located in the black matrix layer.
  • each of the plurality of first imaging members and the plurality of second imaging members includes at least one of a hole and a convex lens.
  • the pores have a pore diameter between 700 nm and 10 ⁇ m.
  • the focal length of the convex lens is between 1 ⁇ m and 20 ⁇ m.
  • the display area includes a first sub-area and a second sub-area that do not overlap each other, the plurality of first imaging components are located in the first sub-area, and the plurality of second imaging The component is located in the second sub-area.
  • each of the plurality of first imaging components and the plurality of second imaging components are apertures, each first imaging component having substantially the same first aperture, each second imaging component having substantially the same second An aperture, and the first aperture is different from the second aperture.
  • each of the plurality of first imaging members and the plurality of second imaging members is a convex lens, each of the first imaging members having substantially the same first focal length, each of the second imaging members having substantially the same a second focal length, the first focal length being different from the second focal length.
  • first region and the second region are substantially the same size, and the number of the plurality of first imaging members and the plurality of second imaging members is the same.
  • each of the display units includes: a light emitting unit, and a pixel control circuit connected to the light emitting unit; the opaque conductive layer is included in the pixel control circuit.
  • the image portions formed by any two of the first imaging members on the same image plane do not overlap, and the image portions formed by any two of the second imaging members on the same image plane do not overlap.
  • the image portions formed on the same image plane of any one of the first imaging member and any of the second imaging members do not overlap.
  • Another embodiment of the present disclosure provides a display device including any of the above display panels.
  • Yet another embodiment of the present disclosure provides a method of acquiring an image of a display device, wherein the display device includes a display panel including a display area and an image acquisition device, wherein, in a plan view of the display panel, At least a portion of the image acquisition device is located within the display area, the display panel has a display surface, and the image acquisition device includes: a plurality of imaging components and an image sensor, wherein the plurality of imaging components are located Between the display surface and the image sensor, wherein the plurality of imaging components comprise a plurality of substantially identical first imaging components and a plurality of substantially identical second imaging components, the first imaging components and the second The imaging component is configured to image targets at different object distances to the same image plane,
  • the method includes forming a plurality of first image portions on the image plane by the plurality of first imaging members, and forming a plurality of second image portions on the image plane by the plurality of second imaging members And acquiring, by the image acquiring device, the plurality of first image signals and the plurality of second image signals, wherein the plurality of first image signals are in one-to-one corresponding to the plurality of first image portions, the plurality of Two image signals one-to-one corresponding to the plurality of second image portions; processing the plurality of first image signals to obtain a first sub-image signal; processing the plurality of second image signals to obtain a second sub-image signal; and processing The first sub image signal and the second sub image signal obtain a signal of an image having a depth of field.
  • FIG. 1a to 1d are schematic structural views of a display panel according to an embodiment of the present disclosure
  • FIG. 2 is a schematic diagram of an imaging method of an aperture when an imaging member is a small hole in a display panel according to an embodiment of the present disclosure
  • FIG. 3 is a second schematic diagram of an aperture imaging method when an imaging member is a small hole in a display panel according to an embodiment of the present disclosure
  • FIG. 4 is a schematic structural diagram of a sub-area of a display panel according to an embodiment of the present disclosure
  • FIG. 5 is a schematic diagram of a combined imaging of an imaging member in a display panel according to an embodiment of the present disclosure
  • FIG. 6 is a flowchart of a method for acquiring an image of a display panel according to an embodiment of the present disclosure.
  • the user When the user performs a self-timer action using the front camera function of a display device such as a mobile phone, the user can look at the self-portrait of the front camera above the display screen to make the gaze in the photo face forward.
  • the user due to the habits and the adjustment of the photographing posture when looking at the display screen, the user tends to look at the display screen habitually, so that the photograph taken has a problem of low eyesight.
  • Embodiments of the present disclosure provide a display panel, a display device, and a method for acquiring an image thereof, so as to incorporate a function of acquiring an image into a display screen, thereby enhancing a user experience of acquiring an image function and saving a frame occupying space of the display screen.
  • each film layer and the size of the area shape in the drawings do not reflect the true scale of the display panel, and are merely intended to illustrate the present disclosure.
  • An embodiment of the present disclosure provides a display panel, as shown in FIGS. 1a to 1d, comprising: a plurality of display units 100 and an image acquisition device 200 disposed in a display area; wherein the display panel 10 has a display surface S.
  • the image acquisition device 200 includes a plurality of image sensors 210 disposed on a side of each display unit 100 facing away from the display surface S, a plurality of imaging members 220 disposed between the display units 100, and a plurality of imaging members 220 and respective image sensors.
  • Each imaging component 220 is configured to image the targets A1, A2, and A3 placed in front of the display surface of the display panel through the microlens 230 to the corresponding image sensor 210; wherein each imaging component 220 is divided into at least two types, different The imaging component 220 of the class is configured to have different maximum object distances at the same resolution.
  • the image sensor 210, the imaging member 220, and the microlens 230 constituting the image pickup device 200 are built in the display area of the display panel.
  • the space occupied by the front camera in the peripheral area of the display screen can be eliminated, and on the other hand, the user can get a better image by pointing the eye toward the display area according to the habit, which can improve the user experience.
  • the display unit is disposed in the display unit.
  • the imaging principle of the imaging member 220 between 100, the image of the target placed in front of the display surface of the display panel is projected to the image sensor 210 after being focused by the microlens 230 placed between the imaging member 220 and the image sensor 210.
  • the image capturing device 200 is integrated into the display region to avoid excessively increasing the thickness of the display panel.
  • the display unit 100 in the above display panel provided by the embodiment of the present disclosure is an active light-emitting display unit, as shown in FIG. 1a and FIG. 1c, and may include: a light-emitting unit 110, and pixel control connected to the light-emitting unit 110. Circuit 120.
  • each of the imaging components 220 may be disposed on at least one of the light shielding film layers of the pixel control circuit 120, for example, as shown in FIG. 1a and FIG. 1c, and disposed in the metal film layer of the data line, or may be disposed.
  • the imaging member 220 may be disposed in the pattern of the original light shielding film layer, for example, the line width of the data line is widened, and then the inside of the data line is opened to form the imaging member 220, or may be
  • the imaging member 220 is disposed in a blank area other than the image of the light shielding film layer, which is not limited herein. Also, the imaging member 220 does not overlap with the light emitting unit 110.
  • the display unit 100 in the above display panel provided by the embodiment of the present disclosure when using the white light emitting unit 110, includes the light emitting unit 110 as shown in FIGS. 1a and 1c and the pixel control connected to the light emitting unit 110.
  • a filter 130 is further included.
  • each of the imaging members 220 may be disposed in the black matrix 131 between the adjacent two filters 130, for example, the inside of the black matrix 131 is apertured to form the imaging member 220.
  • FIGS. 1b and 1d are only schematic illustrations of the components included in each display unit 100, and do not represent the true proportions of the components.
  • the display unit in the above display panel provided by the embodiment of the present disclosure may be a top emission type or a bottom emission type, which is not limited herein.
  • the display unit is of a top emission type, in order to prevent the display light of the display unit 100 from affecting image acquisition, as shown in FIGS. 1a and 1b, the image sensor 210 and the microlens 230 are disposed on a side of the pixel control circuit 120 away from the light emitting unit 110.
  • the display unit is of the bottom emission type, in order to prevent the display light of the display unit 100 from affecting image acquisition, as shown in FIG. 1c and FIG. 1d, the image sensor 210 and the microlens 230 are disposed on a side of the light emitting unit 110 away from the pixel control circuit 120.
  • microlens 230 and the image sensor 210 in the above display panel may be a one-to-one correspondence between the microlens 230 and the image sensor 210 in the above display panel provided by the embodiment of the present disclosure, that is, a setting above the receiving surface of one image sensor 210 A microlens 230 can directly project the focused light of the microlens into the corresponding image sensor 210.
  • the correspondence between the plurality of microlenses 230 and the image sensor 210 may be set, which is not limited herein.
  • the microlens 230 in order to realize the focusing action of the microlens 230, is generally fabricated by using a spherical crown type convex lens, that is, the spherical crown type convex lens is formed on the receiving surface of the image sensor 210. Thereafter, in order to ensure the flatness of the upper surface of the microlens 230, in order to subsequently form other display film layers to form the display unit 100 and the imaging member 220, it is generally required to form a transparent flat layer on the surface of the microlens 230, and the transparent flat layer may be a transparent package.
  • the film may also be other film layers, which is not limited herein.
  • the imaging member 220 is disposed to correspond to the plurality of image sensors 210, that is, the plurality of image sensors 210 simultaneously receive imaging light projected by one imaging member 220.
  • the plurality of image sensors 210 corresponding to one imaging member 220 may simultaneously receive the same imaging portion; respectively, may also receive partial imaging portions, respectively, and then The image stitching process of the image sensor 210 synthesizes a complete image, which is not limited herein.
  • the imaging member 220 can be implemented, for example, by using an aperture as shown in FIGS. 1a and 1b, or by using a convex lens as shown in FIGS. 1c and 1d.
  • the object becomes an inverted and reduced real image on the imaging receiving screen on the other side of the aperture.
  • the aperture of the apertures should not be too small, requiring at least several orders of magnitude above the wavelength of the light to ensure that no diffraction occurs. Therefore, in the above display panel provided by the embodiment of the present disclosure, the aperture of the small hole is generally controlled to be between 700 nm and 10 ⁇ m.
  • the focal length f of the adjustment convex lens can correspond to different object distances u.
  • Target imaging That is, for example, the larger the focal length f of the convex lens, the larger the maximum object distance u at the preset resolution corresponding to the convex lens.
  • the focal length of the convex lens is between 1 ⁇ m and 20 ⁇ m.
  • the aperture of the aperture is larger and smaller.
  • a small hole with a fixed smaller aperture can ensure the resolution of Lr from all objects within the range of Lw, but when the object AB can be completely captured by the small hole
  • the imaged object is moved from the object Lw to the object distance Lw', only a part of the EF can be captured by the small hole, that is, the rest of the object is outside the field of view of the small hole.
  • the settings in the above display panel provided by the embodiments of the present disclosure are divided into at least two types of imaging components 220, and the different types of imaging components 220 are configured to have different maximum object distances at the same resolution, and corresponding image sensors thereof.
  • 210 assumes target imaging with different object distances, respectively.
  • the images acquired by the image sensors corresponding to the same type of imaging component are selected to be the most clear image, and then spliced and combined to obtain a sub-image; the sub-images obtained by different types of imaging components are fused to synthesize the depth of field.
  • the display panel may be divided into a plurality of regions arranged in an array, each region having the same type of imaging member 220.
  • a dashed box in Fig. 4 represents an area.
  • the imaging member 220 when the imaging member 220 is a small hole, the apertures of the small holes in the same region have the same aperture, and the apertures having the small holes in the adjacent two regions are different; when the imaging member 220 is a convex lens, each of the same region has The focal lengths of the convex lenses are the same, and the focal lengths of the convex lenses in the adjacent two regions are different.
  • the imaging member 220 can include both the small hole and the convex lens at the same time, and the above technical effects can be achieved as long as it is set according to the optical characteristic parameters of the imaging member 220. There is no limit here.
  • the distribution density of the imaging members 220 in each region is uniform.
  • a suitable number of imaging members 220 of the same type may be disposed in each region.
  • each imaging member 220 is responsible for imaging a portion of the target, and the plurality of imaging members 220 are imaged at the image receiving screen, ie, image sensor 210.
  • the merger will play a role in expanding the horizon.
  • an embodiment of the present disclosure further provides a display device, which includes the above display panel provided by the embodiment of the present disclosure, and the display device may be: a mobile phone, a tablet computer, a television, a display, a notebook computer, a digital photo frame, Any product or part that has a display function, such as a navigator.
  • the display device reference may be made to the embodiment of the above display panel, and the repeated description is omitted.
  • the embodiment of the present disclosure further provides a method for acquiring an image of the foregoing display device. As shown in FIG. 6, the method includes the following steps:
  • each imaging component images the target placed in front of the display surface of the display panel, is focused by the microlens, and transmitted to the corresponding image sensor;
  • a display panel, a display device, and a method for acquiring an image thereof are provided by the embodiment of the present disclosure.
  • the image sensor is disposed on a side facing away from the display surface of the display unit, and is placed on the imaging principle of the imaging member disposed between the display units.
  • the image of the target in front of the display surface of the display panel is placed Projected to the image sensor after focusing of the microlens between the imaging member and the image sensor.
  • the imaging components are divided into at least two types, and different types of imaging components are configured to have different maximum object distances at the same resolution, and their corresponding image sensors respectively undertake target imaging with different object distances.
  • the images acquired by the image sensors corresponding to the same type of imaging component are selected to be the most clear image, and then spliced and combined to obtain a sub-image; the sub-images obtained by different types of imaging components are fused to synthesize a complete image with depth of field. To achieve clear image acquisition for targets of different object distances.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computing Systems (AREA)
  • Devices For Indicating Variable Information By Combining Individual Elements (AREA)

Abstract

一种显示面板(10)、显示装置及其获取图像的方法。显示面板(10)，包括显示区域以及图像获取装置(200)，其中，在显示面板(10)的平面图中，至少部分的图像获取装置(200)位于显示区域内。这样，可以在显示面板(10)的显示区域实现图像获取功能。

Description

显示面板、显示装置及其获取图像的方法
本申请要求于2017年3月10日递交的中国专利申请第201710142983.6号的优先权，在此全文引用上述中国专利申请公开的内容以作为本申请的一部分。
技术领域
本公开的实施例涉及一种显示面板、显示装置及其获取图像的方法。
背景技术
目前，在诸如手机等显示设备中配置的具有获取图像功能的前置摄像头一般位于显示屏的非显示区域，前置摄像头会在显示屏的周边区域占用空间，不利于窄边框设计。
发明内容
本公开实施例提供了一种显示面板、显示装置及其获取图像的方法，用以在显示面板的显示区域实现图像获取功能。
本公开实施例提供一种显示面板，包括显示区域以及图像获取装置，其中，在所述显示面板的平面图中，至少部分的所述图像获取装置位于所述显示区域内。
例如，所述显示面板具有一显示面，其中，所述图像获取装置包括：多个成像部件和图像传感器，其中，所述多个成像部件位于所述显示面与所述图像传感器之间，其中，所述多个成像部件包括多个实质相同的第一成像部件和多个实质相同的第二成像部件，所述第一成像部件和所述第二成像部件配置为将不同物距处的目标成像到同一像平面。
例如，所述第一成像部件和所述第二成像部件配置为在相同分辨率下的最大物距不同。
例如，所述图像获取装置还包括：多个微透镜，位于所述多个成像部件与所述图像传感器之间。
例如，所述微透镜层位于所述同一像平面与所述图像传感器之间。
例如，所述显示面板还包括位于所述显示区域的多个显示单元，其中，所述多个显示单元位于所述显示面与所述图像传感器之间。
例如，所述多个显示单元包括一不透光导电层，其中，所述多个第一成像部件和所述多个第二成像部件位于所述不透光导电层中。
例如，所述显示面板还包括黑矩阵层，其中，所述多个第一成像部件和所述多个第二成像部件位于所述黑矩阵层中。
例如，所述多个第一成像部件和所述多个第二成像部件的每一个包括孔和凸透镜中的至少之一。
例如，所述孔的孔径在700nm至10μm之间。
例如，所述凸透镜的焦距在1μm至20μm之间。
例如，在所述平面图中，所述显示区域包括互不重叠的第一子区域和第二子区域，所述多个第一成像部件位于所述第一子区域，所述多个第二成像部件位于所述第二子区域。
例如，所述多个第一成像部件和所述多个第二成像部件的每个均为孔，各个第一成像部件具有实质相同的第一孔径，各个第二成像部件具有实质相同的第二孔径，且所述第一孔径不同于所述第二孔径。
例如，所述多个第一成像部件和所述多个第二成像部件的每个均为凸透镜，各个第一成像部件的具有实质相同的第一焦距，各个第二成像部件的具有实质相同的第二焦距，所述第一焦距不同于所述第二焦距。
例如，所述第一区域和第二区域的尺寸基本相同，且所述多个第一成像部件和所述多个第二成像部件的个数相同。
例如，每个所述显示单元包括：发光单元，以及与所述发光单元连接的像素控制电路；所述不透光导电层包含于所述像素控制电路中。
例如，任意两个所述第一成像部件在所述同一像平面上形成的图像部分不重叠，任意两个所述第二成像部件在所述同一像平面上形成的图像部分不重叠。
例如，任一个所述第一成像部件和任一个所述第二成像部件所述同一像平面上形成的图像部分不重叠。
本公开另一实施例提供一种显示装置，包括上述任一项显示面板。
本公开又一实施例提供一种显示装置的获取图像的方法，其中，所述显示装置包括显示面板，所述显示面板包括显示区域以及图像获取装置，其中，在所述显示面板的平面图中，至少部分的所述图像获取装置位于所述显示区域内，所述显示面板具有一显示面，所述图像获取装置包括：多个成像部件和图像传感器，其中，所述多个成像部件位于所述显示面与所述图像传感器之间，其中，所述多个成像部件包括多个实质相同的第一成像部件和多个实质相同的第二成像部件，所述第一成像部件和所述第二成像部件配置为将不同物距处的目标成像到同一像平面，
所述方法包括：通过所述多个第一成像部件在所述像平面上形成多个第一图像部分；通过所述多个第二成像部件在所述像平面上形成多个第二图像部分；通过所述图像获取装置获取多个第一图像信号和多个第二图像信号，其中，所述多个第一图像信号一一对应于所述多个第一图像部分，所述多个第二图像信号一一对应于所述多个第二图像部分；处理所述多个第一图像信号得到第一子图像信号；处理所述多个第二图像信号得到第二子图像信号；以及处理所述第一子图像信号和所述第二子图像信号得到具有景深的图像的信号。
附图说明
为了更清楚地说明本公开实施例的技术方案，下面将对实施例的附图作简单地介绍，显而易见地，下面描述中的附图仅仅涉及本公开的一些实施例，而非对本公开的限制。
图1a至图1d分别为本公开实施例提供的显示面板的结构示意图；
图2为本公开实施例提供的显示面板中成像部件为小孔时的小孔成像原理图之一；
图3为本公开实施例提供的显示面板中成像部件为小孔时的小孔成像原理图之二；
图4为本公开实施例提供的显示面板分区域的结构示意图；
图5为本公开实施例提供的显示面板中成像部件合并成像的示意图；
图6为本公开实施例提供的显示面板的获取图像的方法的流程图。
具体实施方式
当用户利用诸如手机等显示设备的前置摄像功能进行自拍动作时，用户看向显示屏上方的前置摄像头的自拍姿势才能使拍出照片中的目光朝前。但出于习惯使然，以及看向显示屏时调整自己的拍照姿势，用户往往习惯性的将目光朝向显示屏，使得拍出来的照片出现眼光低垂的问题。
本公开实施例提供一种显示面板、显示装置及其获取图像的方法，以将获取图像功能内置于显示屏内部，增强获取图像功能的用户体验且节省显示屏的边框占用空间。
为使本公开实施例的目的、技术方案和优点更加清楚，下面将结合本公开实施例的附图，对本公开实施例的技术方案进行清楚、完整地描述。显然，所描述的实施例是本公开的一部分实施例，而不是全部的实施例。基于所描述的本公开的实施例，本领域普通技术人员在无需创造性劳动的前提下所获得的所有其他实施例，都属于本公开保护的范围。
附图中各膜层的厚度和区域形状的大小不反映显示面板的真实比例，目的只是示意说明本公开内容。
本公开实施例提供了一种显示面板，如图1a至1d所示，包括：设置于显示区域的多个显示单元100和图像获取装置200；其中，显示面板10具有显示面S。图像获取装置200包括：设置于各显示单元100背离显示面S一侧的多个图像传感器210，设置于显示单元100之间的多个成像部件220，以及设置于各成像部件220与各图像传感器210之间的多个微透镜230。
各成像部件220用于将放置于显示面板的显示面前方的目标A1、A2、A3经微透镜230的聚焦后成像于对应的图像传感器210；其中，各成像部件220分为至少两类，不同类的成像部件220被配置为在相同分辨率下的最大物距不同。
例如，在本公开实施例提供的上述显示面板中，将构成图像获取装置200的图像传感器210、成像部件220和微透镜230内置于显示面板的显示区域。一方面可以消除前置摄像头在显示屏周边区域所占用的空间，另一方面使用户在拍照时按照习惯将目光朝向显示区域即可获得效果较好的图像，可以提高用户体验。
例如，在本公开实施例提供的上述显示面板中是利用设置在显示单元 100之间的成像部件220的成像原理，将放置于显示面板的显示面前方的目标的像，经过放置在成像部件220与图像传感器210之间的微透镜230的聚焦后投射到图像传感器210。通过微透镜230的聚焦功能，代替目前摄像头装置中由多个透镜相互配合构成的光路相对复杂的光学透镜组，有利于图像获取装置200集成于显示区域内部，避免过度增加显示面板的厚度。
进一步地，在本公开实施例提供的上述显示面板中的显示单元100为主动发光的显示单元，如图1a和图1c所示，可以包括：发光单元110，以及与发光单元110连接的像素控制电路120。为避免增加制作工艺步骤，各成像部件220可以设置于像素控制电路120中的至少任一遮光膜层，例如可以如图1a和图1c所示，设置于数据线金属膜层中，也可以设置于栅线金属膜层中；并且，可以在原有的遮光膜层的图形内设置成像部件220，例如增宽数据线的线宽后在数据线内部进行开孔形成成像部件220，也可以在原有的遮光膜层的图像之外的空白区域设置成像部件220，在此不做限定。并且，成像部件220不与发光单元110重叠。
此外，在本公开实施例提供的上述显示面板中的显示单元100在采用发白光的发光单元110时，除了包括如图1a和图1c所示的发光单元110以及与发光单元110连接的像素控制电路120之外，如图1b和图1d所示，还包括：滤光片130。此时，为避免增加制作工艺步骤，各成像部件220也可以设置于相邻两个滤光片130之间的黑矩阵131中，例如在黑矩阵131内部进行开孔形成成像部件220。值得注意的是，图1b和图1d只是示意性的说明各显示单元100包含的部件，并不代表部件的真实比例。
例如，在本公开实施例提供的上述显示面板中的显示单元可以为顶发射型，也可以为底发射型，在此不做限定。当显示单元为顶发射型，为避免显示单元100的显示光影响图像获取，如图1a和图1b所示，图像传感器210和微透镜230设置于像素控制电路120远离发光单元110的一侧。当显示单元为底发射型，为避免显示单元100的显示光影响图像获取，如图1c和图1d所示，图像传感器210和微透镜230设置于发光单元110远离像素控制电路120的一侧。
例如，在本公开实施例提供的上述显示面板中的微透镜230与图像传感器210之间可以是一一对应关系，即一个图像传感器210的接收面上方设置 一个微透镜230，可以使微透镜聚焦后的光直接投射至对应的图像传感器210中。当然，也可以设置成多个微透镜230对应一个图像传感器210等对应关系，在此不做限定。
并且，在本公开实施例提供的上述显示面板中为了实现微透镜230的聚焦作用，一般采用球冠型凸透镜制作微透镜230，即在图像传感器210的接收面表面制作该球冠型凸透镜。之后，为了保证微透镜230上表面的平整性，以便后续制作其他显示膜层构成显示单元100和成像部件220，一般需要在微透镜230表面形成一透明平坦层，该透明平坦层可以是透明封装膜，也可以其他膜层，在此不做限定。
例如，为避免相邻成像部件220的成像光透射至同一个图像传感器210中，造成成像的交叠，对后方图像信号处理带来影响的问题，在本公开实施例提供的上述显示面板中，例如将成像部件220设置为对应于多个图像传感器210，即多个图像传感器210同时接收一个成像部件220投射的成像光。根据成像部件220和对应的多个图像传感器210之间的相对尺寸，对应于一个成像部件220的多个图像传感器210可以同时接收到相同的成像部分；也可以分别接收部分成像部分，之后经过各图像传感器210的图像拼接处理合成一完整成像，在此不做限定。
例如，在本公开实施例提供的上述显示面板中，成像部件220例如可以采用如图1a和图1b所示的小孔，或者采用如图1c和图1d所示的凸透镜实现。
例如，在采用小孔作为成像部件220时，根据小孔成像原理，物体在小孔另一侧的成像接收屏上会成一个倒立缩小的实像。并且，小孔的孔径不能太小，需要至少高于光波长的几个量级，以保证不会有衍射的发生。因此，在本公开实施例提供的上述显示面板中，小孔的孔径一般控制在700nm至10μm之间。
在此基础上增大小孔的孔径可以调整成像的分辨率。如图2所示，如果需要分辨物距Lw处物体的相距Lr的两个点，则小孔的孔径x可以根据公式：x/Lr＝Lp/(Lp+Lw)得出，其中Lp为像距。如果物体的物距在Lw之外，则不能分辨相距Lr的两个点，如果物体的物距在Lw之内，则可以分辨相距小于Lr的两个点。也就是小孔的孔径为x时，可以保证物距Lw之内的物体上可 以被分辨相距≤Lr的两个点。增大小孔的孔径x，则可以保证更远物体的相距Lr的分辨率。这就是通过调整小孔的孔径来调整显示屏可以获取到不同物距的物体清晰图像的依据。
同样，在采用凸透镜作为成像部件220时，根据凸透镜的成像原理，通过以下公式1/u+1/v＝1/f，其中u、v、f分别为物距、像距和焦距，可知应用于本公开实施例提供的显示面板中由于凸透镜的像距v是一定的，需要对不同物距u在同样的像距v下成像，因此，调整凸透镜的焦距f可以对应不同物距u下的目标成像。即例如，凸透镜的焦距f越大，凸透镜对应的在预设分辨率下的最大物距u越大。例如，凸透镜的焦距在1μm至20μm之间。
进一步地，例如，为了保证承担像距较小目标成像的成像部件220具有较大的视野，在具体实施时，在本公开实施例提供的上述显示面板中，需要小孔的孔径越大，小孔对应的在预设分辨率下的最大物距越小。例如，出于以下原因考虑：如图3所示，一个固定较小孔径的小孔虽然可以保证物距Lw范围内的所有物体相距Lr的分辨率，但是当物体AB从可以全部被小孔捕获成像的物距Lw处移动至物距Lw’时，只有一部分EF能够被小孔捕获，即物体的其余部分在小孔的视野之外。虽然可以通过配置多个小孔去扩大视野，但是会导致为捕获物距较近的物体而设计分布密度较大的小孔区域，从而导致小孔的分布密度不均匀，其与显示单元100的非发光区域分布不一致的情况，从而影响发光区域的设计。基于此，本公开实施例提供的上述显示面板中，通过采用不同孔径的小孔对物距不同的物体进行成像，孔径大的小孔对应的视野较大，可以对物距较近的目标进行成像，以使小孔的分布密度不进行太多限制。
基于此，在本公开实施例提供的上述显示面板中的设置分为至少两类的成像部件220，不同类成像部件220被配置为在相同分辨率下的最大物距不同，其对应的图像传感器210分别承担具有不同物距的目标成像。这样，在进行获取图像时，对同一类成像部件对应的各图像传感器获取到的图像选取最清晰成像后进行拼接合成得到子图像；对不同类成像部件得到的子图像进行融合，合成具有景深的完整成像，实现对于不同物距的目标进行清晰的获取图像功能。
例如，为便于不同类成像部件220对应的图像传感器210分别承担具有 不同物距的目标成像，在本公开实施例提供的上述显示面板中，如图4所示，可以将显示面板分为呈阵列排布的多个区域，每个区域内具有同一类成像部件220，以使每个区域分别承担不同物距的目标成像，在图4中一个虚线框表示一个区域。
例如，成像部件220为小孔时，同一区域内具有的各小孔的孔径相同，相邻的两个区域内的具有小孔的孔径不同；成像部件220为凸透镜时，同一区域内具有的各凸透镜的焦距相同，相邻的两个区域内的具有凸透镜的焦距不同。当然，成像部件220既可以同时包括小孔又同时包括凸透镜，只要根据成像部件220的光学特性参数进行设置，也能够达到上述技术效果。在此不做限定。
并且，例如，在本公开实施例提供的上述显示面板中，各区域内的成像部件220的分布密度一致。例如，可以在各区域内设置合适数量的同一类成像部件220，如图5所示，每个成像部件220负责目标物的一部分成像，多个成像部件220所成像在像接收屏即图像传感器210上合并，起到扩大视野的作用。
基于同一发明构思，本公开实施例还提供了一种显示装置，包括本公开实施例提供的上述显示面板，该显示装置可以为：手机、平板电脑、电视机、显示器、笔记本电脑、数码相框、导航仪等任何具有显示功能的产品或部件。该显示装置的实施可以参见上述显示面板的实施例，重复之处不再赘述。
本公开实施例还提供了一种上述显示装置的获取图像的方法，如图6所示，包括以下步骤：
S601、各成像部件将放置于显示面板的显示面前方的目标的成像，经过微透镜的聚焦后透射至对应的图像传感器中；
S602、对同一类成像部件对应的各所述图像传感器获取到的图像选取最清晰成像后进行拼接合成得到子图像；
S603、对不同类成像部件得到的子图像进行融合，合成具有景深的完整成像。
本公开实施例提供的一种显示面板、显示装置及其获取图像的方法，将图像传感器配置在背离显示单元显示面一侧，利用设置在显示单元之间的成像部件的成像原理，将放置于显示面板的显示面前方的目标的像，经过放置 在成像部件与图像传感器之间的微透镜的聚焦后投射到图像传感器。成像部件分为至少两类，不同类的成像部件被配置为在相同分辨率下的最大物距不同，其对应的图像传感器分别承担具有不同物距的目标成像。在进行获取图像时，对同一类成像部件对应的各图像传感器获取到的图像选取最清晰成像后进行拼接合成得到子图像；对不同类成像部件得到的子图像进行融合，合成具有景深的完整成像，实现对于不同物距的目标进行清晰的获取图像功能。
显然，本领域的技术人员可以对本公开进行各种改动和变型而不脱离本公开的精神和范围。这样，倘若本公开的这些修改和变型属于本公开权利要求及其等同技术的范围之内，则本公开也意图包含这些改动和变型在内。
以上所述仅是本公开的示范性实施方式，而非用于限制本公开的保护范围，本公开的保护范围由所附的权利要求确定。

Claims (20)

  1. 一种显示面板，包括显示区域以及图像获取装置，其中，在所述显示面板的平面图中，至少部分的所述图像获取装置位于所述显示区域内。
  2. 如权利要求1所述的显示面板，其中，所述显示面板具有一显示面，其中，所述图像获取装置包括：多个成像部件和图像传感器，其中，所述多个成像部件位于所述显示面与所述图像传感器之间，
    其中，所述多个成像部件包括多个实质相同的第一成像部件和多个实质相同的第二成像部件，所述第一成像部件和所述第二成像部件配置为将不同物距处的目标成像到同一像平面。
  3. 如权利要求2所述的显示面板，其中，所述第一成像部件和所述第二成像部件配置为在相同分辨率下的最大物距不同。
  4. 如权利要求2或3所述的显示面板，其中，所述图像获取装置还包括：多个微透镜，位于所述多个成像部件与所述图像传感器之间。
  5. 如权利要求4所述的显示面板，其中，所述微透镜层位于所述同一像平面与所述图像传感器之间。
  6. 如权利要求2至5中任一项所述的显示面板，还包括位于所述显示区域的多个显示单元，其中，所述多个显示单元位于所述显示面与所述图像传感器之间。
  7. 如权利要求6所述的显示面板，其中，所述多个显示单元包括一不透光导电层，其中，所述多个第一成像部件和所述多个第二成像部件位于所述不透光导电层中。
  8. 如权利要求1至6中任一项所述的显示面板，还包括黑矩阵层，其中，所述多个第一成像部件和所述多个第二成像部件位于所述黑矩阵层中。
  9. 如权利要求1至6中任一项所述的显示面板，其中，所述多个第一成像部件和所述多个第二成像部件的每一个包括孔和凸透镜中的至少之一。
  10. 如权利要求9所述的显示面板，其中，所述孔的孔径在700nm至10μm之间。
  11. 如权利要求9所述的显示面板，其中，所述凸透镜的焦距在1μm至20μm之间。
  12. 如权利要求1至11中任一项所述的显示面板，其中，
    在所述平面图中，所述显示区域包括互不重叠的第一子区域和第二子区域，所述多个第一成像部件位于所述第一子区域，所述多个第二成像部件位于所述第二子区域。
  13. 如权利要求12所述的显示面板，其中，
    所述多个第一成像部件和所述多个第二成像部件的每个均为孔，各个第一成像部件具有实质相同的第一孔径，各个第二成像部件具有实质相同的第二孔径，且所述第一孔径不同于所述第二孔径。
  14. 如权利要求12所述的显示面板，其中，
    所述多个第一成像部件和所述多个第二成像部件的每个均为凸透镜，各个第一成像部件的具有实质相同的第一焦距，各个第二成像部件的具有实质相同的第二焦距，所述第一焦距不同于所述第二焦距。
  15. 如权利要求12至14中任一项所述的显示面板，其中，所述第一区域和第二区域的尺寸基本相同，且所述多个第一成像部件和所述多个第二成像部件的个数相同。
  16. 如权利要求7所述的显示面板，其中，每个所述显示单元包括：发光单元，以及与所述发光单元连接的像素控制电路；所述不透光导电层包含于所述像素控制电路中。
  17. 如权利要求2至7中任一项所述的显示面板，其中，任意两个所述第一成像部件在所述同一像平面上形成的图像部分不重叠，任意两个所述第二成像部件在所述同一像平面上形成的图像部分不重叠。
  18. 如权利要求17所述的显示面板，其中，任一个所述第一成像部件和任一个所述第二成像部件所述同一像平面上形成的图像部分不重叠。
  19. 一种显示装置，包括如权利要求1至18任一项所述的显示面板。
  20. 一种显示装置的获取图像的方法，其中，所述显示装置包括显示面板，所述显示面板包括显示区域以及图像获取装置，其中，在所述显示面板的平面图中，至少部分的所述图像获取装置位于所述显示区域内，所述显示面板具有一显示面，所述图像获取装置包括：多个成像部件和图像传感器，其中，所述多个成像部件位于所述显示面与所述图像传感器之间，其中，所述多个成像部件包括多个实质相同的第一成像部件和多个实质相同的第二成 像部件，所述第一成像部件和所述第二成像部件配置为将不同物距处的目标成像到同一像平面，
    所述方法包括：
    通过所述多个第一成像部件在所述像平面上形成多个第一图像部分；
    通过所述多个第二成像部件在所述像平面上形成多个第二图像部分；
    通过所述图像获取装置获取多个第一图像信号和多个第二图像信号，其中，所述多个第一图像信号一一对应于所述多个第一图像部分，所述多个第二图像信号一一对应于所述多个第二图像部分；
    处理所述多个第一图像信号得到第一子图像信号；
    处理所述多个第二图像信号得到第二子图像信号；以及
    处理所述第一子图像信号和所述第二子图像信号得到具有景深的图像的信号。
PCT/CN2017/105526 2017-03-10 2017-10-10 显示面板、显示装置及其获取图像的方法 WO2018161563A1 (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US15/773,755 US10623697B2 (en) 2017-03-10 2017-10-10 Display panel, display device and image pickup method therefor

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201710142983.6 2017-03-10
CN201710142983.6A CN106847092B (zh) 2017-03-10 2017-03-10 一种显示面板、显示装置及其获取图像的方法

Publications (1)

Publication Number Publication Date
WO2018161563A1 true WO2018161563A1 (zh) 2018-09-13

Family

ID=59145057

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/105526 WO2018161563A1 (zh) 2017-03-10 2017-10-10 显示面板、显示装置及其获取图像的方法

Country Status (3)

Country Link
US (1) US10623697B2 (zh)
CN (1) CN106847092B (zh)
WO (1) WO2018161563A1 (zh)

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106847092B (zh) * 2017-03-10 2020-03-31 京东方科技集团股份有限公司 一种显示面板、显示装置及其获取图像的方法
CN110536049A (zh) * 2018-05-25 2019-12-03 印象认知（北京）科技有限公司 图像采集设备、图像采集方法、电子设备及成像装置
KR102198341B1 (ko) 2018-12-18 2021-01-04 삼성전자주식회사 전자 장치 및 그 제어 방법
CN109830495B (zh) 2019-03-21 2021-10-08 京东方科技集团股份有限公司 阵列基板及其制备方法、显示装置及其成像方法
CN110071217B (zh) * 2019-03-29 2023-12-12 武汉华星光电半导体显示技术有限公司 掩膜板、显示面板的制作方法及显示装置
US10999483B2 (en) * 2019-06-04 2021-05-04 Gopro, Inc. Display-based camera apparatus and methods
CN112051668B (zh) * 2019-06-05 2022-07-05 杭州海康汽车技术有限公司 图像拼接系统
WO2022014305A1 (ja) * 2020-07-16 2022-01-20 パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカ マルチピンホールカメラ及び画像識別システム
CN114422729B (zh) * 2021-12-23 2024-09-17 北京集创北方科技股份有限公司 图像传感器、图像采集系统和图像采集方法

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2273411A (en) * 1992-12-11 1994-06-15 Ibm Video conferencing terminal
US20020030768A1 (en) * 1999-03-15 2002-03-14 I-Wei Wu Integrated high resolution image sensor and display on an active matrix array with micro-lens
CN1401186A (zh) * 2000-11-22 2003-03-05 皇家菲利浦电子有限公司 用于图象处理系统的结合的显示器摄象机
WO2006109010A1 (en) * 2005-04-12 2006-10-19 John Michael Green Display assembly with photosensitive elements
CN102160370A (zh) * 2008-09-16 2011-08-17 阿尔卡特朗讯美国公司 具有集成摄像机的监控器及其操作方法
CN103901653A (zh) * 2014-04-23 2014-07-02 无锡芯盟科技有限公司 具有光学摄像功能的微显示器件
CN205105320U (zh) * 2015-10-19 2016-03-23 杨永建 带有摄像头的显示屏幕
CN106019671A (zh) * 2016-07-22 2016-10-12 杨永建 一种集显示和摄像于一体的单元、组件和板面
CN106847092A (zh) * 2017-03-10 2017-06-13 京东方科技集团股份有限公司 一种显示面板、显示装置及其获取图像的方法

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7009663B2 (en) * 2003-12-17 2006-03-07 Planar Systems, Inc. Integrated optical light sensitive active matrix liquid crystal display
JP4456806B2 (ja) * 2002-03-19 2010-04-28 セイコーエプソン株式会社 液晶表示装置、電気光学装置とその製造方法、電子機器
US8502756B2 (en) * 2009-11-02 2013-08-06 Sony Corporation Image display device with imaging unit
GB2506631A (en) * 2012-10-04 2014-04-09 Sony Comp Entertainment Europe Combined image display and sensing device
US10334151B2 (en) * 2013-04-22 2019-06-25 Google Llc Phase detection autofocus using subaperture images

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2273411A (en) * 1992-12-11 1994-06-15 Ibm Video conferencing terminal
US20020030768A1 (en) * 1999-03-15 2002-03-14 I-Wei Wu Integrated high resolution image sensor and display on an active matrix array with micro-lens
CN1401186A (zh) * 2000-11-22 2003-03-05 皇家菲利浦电子有限公司 用于图象处理系统的结合的显示器摄象机
WO2006109010A1 (en) * 2005-04-12 2006-10-19 John Michael Green Display assembly with photosensitive elements
CN102160370A (zh) * 2008-09-16 2011-08-17 阿尔卡特朗讯美国公司 具有集成摄像机的监控器及其操作方法
CN103901653A (zh) * 2014-04-23 2014-07-02 无锡芯盟科技有限公司 具有光学摄像功能的微显示器件
CN205105320U (zh) * 2015-10-19 2016-03-23 杨永建 带有摄像头的显示屏幕
CN106019671A (zh) * 2016-07-22 2016-10-12 杨永建 一种集显示和摄像于一体的单元、组件和板面
CN106847092A (zh) * 2017-03-10 2017-06-13 京东方科技集团股份有限公司 一种显示面板、显示装置及其获取图像的方法

Also Published As

Publication number Publication date
US20190260963A1 (en) 2019-08-22
CN106847092A (zh) 2017-06-13
CN106847092B (zh) 2020-03-31
US10623697B2 (en) 2020-04-14

Similar Documents

Publication Publication Date Title
WO2018161563A1 (zh) 显示面板、显示装置及其获取图像的方法
US7196728B2 (en) Method and apparatus for displaying images in combination with taking images
CN108461045B (zh) 显示装置及其制造方法
CN103119516B (zh) 光场摄像装置和图像处理装置
US8155478B2 (en) Image creation with software controllable depth of field
JP5098405B2 (ja) 撮像素子、焦点検出装置および撮像装置
JP6120508B2 (ja) 撮像素子および撮像装置
WO2020107997A1 (zh) 成像装置和电子设备
CN101656835A (zh) 图像拾取设备、显示器和图像处理设备
JP7286024B2 (ja) 回転可能なリフレクターを備えた撮像システム
JP2018121235A (ja) 画像処理装置、撮像装置、画像処理方法およびプログラム
US11624947B2 (en) Electronic device and control method thereof
US7170690B2 (en) Zoom lens
CN105590939A (zh) 图像传感器及输出方法、相位对焦方法、成像装置和终端
JP2018139272A (ja) 撮像素子および撮像装置
JP6486149B2 (ja) 画像処理装置、撮像装置、画像処理方法、プログラム、および、記憶媒体
WO2020107984A1 (zh) 微透镜阵列结构及其制造方法、复眼镜头、电子装置
JP2020088029A (ja) 撮像素子および撮像装置
JP2014026051A (ja) 撮像装置、画像処理装置
CN104954645B (zh) 摄像元件、摄像设备和图像处理方法
WO2019223449A1 (zh) 图像采集设备、图像采集方法、电子设备及成像装置
US11832001B2 (en) Image processing method and image processing system
CN110536049A (zh) 图像采集设备、图像采集方法、电子设备及成像装置
JPH08289329A (ja) 立体画像撮像装置
WO2020181939A1 (zh) 显示装置及其显示方法

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17900086

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 13/02/2020)

122 Ep: pct application non-entry in european phase

Ref document number: 17900086

Country of ref document: EP

Kind code of ref document: A1