CN115499640B - Display device and electronic device with 3D camera module - Google Patents
Display device and electronic device with 3D camera module Download PDFInfo
- Publication number
- CN115499640B CN115499640B CN202210003173.3A CN202210003173A CN115499640B CN 115499640 B CN115499640 B CN 115499640B CN 202210003173 A CN202210003173 A CN 202210003173A CN 115499640 B CN115499640 B CN 115499640B
- Authority
- CN
- China
- Prior art keywords
- light
- lens
- laser
- floodlight
- camera module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000003384 imaging method Methods 0.000 claims abstract description 75
- 239000011159 matrix material Substances 0.000 claims abstract description 60
- 239000000758 substrate Substances 0.000 claims abstract description 57
- 230000001678 irradiating effect Effects 0.000 claims abstract 3
- 230000003287 optical effect Effects 0.000 claims description 24
- 230000005540 biological transmission Effects 0.000 claims description 10
- 230000000149 penetrating effect Effects 0.000 claims 2
- 238000010586 diagram Methods 0.000 description 16
- 238000009434 installation Methods 0.000 description 8
- 239000004973 liquid crystal related substance Substances 0.000 description 8
- 238000012545 processing Methods 0.000 description 8
- 238000005286 illumination Methods 0.000 description 7
- 125000006850 spacer group Chemical group 0.000 description 7
- 238000009792 diffusion process Methods 0.000 description 6
- 238000013461 design Methods 0.000 description 4
- 230000003796 beauty Effects 0.000 description 3
- 230000000903 blocking effect Effects 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 239000011521 glass Substances 0.000 description 3
- 238000012986 modification Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 101001121408 Homo sapiens L-amino-acid oxidase Proteins 0.000 description 2
- 102100026388 L-amino-acid oxidase Human genes 0.000 description 2
- 101100233916 Saccharomyces cerevisiae (strain ATCC 204508 / S288c) KAR5 gene Proteins 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 230000000750 progressive effect Effects 0.000 description 2
- 101000827703 Homo sapiens Polyphosphoinositide phosphatase Proteins 0.000 description 1
- 102100023591 Polyphosphoinositide phosphatase Human genes 0.000 description 1
- 101100012902 Saccharomyces cerevisiae (strain ATCC 204508 / S288c) FIG2 gene Proteins 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000006073 displacement reaction Methods 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 238000000034 method Methods 0.000 description 1
- 230000001902 propagating effect Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
- 238000002834 transmittance Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09F—DISPLAYING; ADVERTISING; SIGNS; LABELS OR NAME-PLATES; SEALS
- G09F9/00—Indicating arrangements for variable information in which the information is built-up on a support by selection or combination of individual elements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
- H04N13/261—Image signal generators with monoscopic-to-stereoscopic image conversion
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/20—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from infrared radiation only
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/12—Picture reproducers
- H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
- H04N9/3141—Constructional details thereof
- H04N9/315—Modulator illumination systems
- H04N9/3161—Modulator illumination systems using laser light sources
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Optics & Photonics (AREA)
- Studio Devices (AREA)
Abstract
Description
技术领域Technical Field
本发明涉及显示技术领域,更具体地说,涉及一种具有3D摄像模组的显示装置和电子设备。The present invention relates to the field of display technology, and more specifically, to a display device and electronic equipment with a 3D camera module.
背景技术Background technique
随着市场的发展,消费者对于显示屏显示效果的要求越来越严苛,不仅要求外观设计多样化,而且要求屏占比越高越好。全面屏技术,通过超窄边框甚至无边框的设计,实现了大于90%的屏占比。With the development of the market, consumers have increasingly stringent requirements for display effects, requiring not only diversified appearance designs, but also a higher screen-to-body ratio. Full-screen technology achieves a screen-to-body ratio of more than 90% through ultra-narrow or even borderless designs.
全面屏手机在机身不变的情况下,实现了显示面积的最大化,使得显示效果更加惊艳。现有的基于全面屏的结构设计,为了安装3D摄像模组中的深度相机模组等器件,在显示基板的顶部设置了非显示区,即刘海区,但是,这样还是会影响显示装置的美观和全面屏体验。Full-screen mobile phones maximize the display area without changing the body, making the display effect more amazing. In the existing full-screen structural design, in order to install devices such as the depth camera module in the 3D camera module, a non-display area, i.e., the bangs area, is set on the top of the display substrate. However, this still affects the beauty of the display device and the full-screen experience.
发明内容Summary of the invention
有鉴于此,本发明提供了一种具有3D摄像模组的显示装置和电子设备,以解决现有的安装深度相机模组的非显示区影响显示装置的美观和全面屏体验的问题。In view of this, the present invention provides a display device and an electronic device with a 3D camera module to solve the problem that the non-display area of the existing installation of the depth camera module affects the aesthetics and full-screen experience of the display device.
为实现上述目的,第一方面,本发明提供如下技术方案:To achieve the above objectives, in a first aspect, the present invention provides the following technical solutions:
根据本发明提供的具有3D摄像模组的显示装置,包括显示基板以及3D摄像模组;A display device with a 3D camera module provided by the present invention includes a display substrate and a 3D camera module;
所述显示基板包括显示区域和环绕所述显示区域的黑色矩阵区域;所述黑色矩阵区域包括第一透光区域;The display substrate comprises a display area and a black matrix area surrounding the display area; the black matrix area comprises a first light-transmitting area;
所述3D摄像模组包括深度相机模组;所述深度相机模组包括激光器模块和成像模块;所述激光器模块位于所述黑色矩阵区域背光侧;所述成像模块位于所述显示区域的背光侧;The 3D camera module includes a depth camera module; the depth camera module includes a laser module and an imaging module; the laser module is located on the backlight side of the black matrix area; the imaging module is located on the backlight side of the display area;
所述激光器模块包括结构光投射器和投影镜头;所述投影镜头包括透镜组件和灯镜;所述结构光投射器,用于向所述透镜组件投射结构光,所述结构光包括随机分布的多束激光;所述透镜组件,用于将所述多束激光汇聚后入射至所述灯镜的入光面;所述灯镜,用于使得入射的所述多束激光通过第一透光区域照射到待拍摄物体上;The laser module includes a structured light projector and a projection lens; the projection lens includes a lens assembly and a light mirror; the structured light projector is used to project structured light to the lens assembly, and the structured light includes a plurality of randomly distributed laser beams; the lens assembly is used to converge the plurality of laser beams and then make them incident on the light incident surface of the light mirror; the light mirror is used to make the incident plurality of laser beams pass through the first light-transmitting area and irradiate the object to be photographed;
所述成像模块,用于接收所述待拍摄物体反射后穿透所述显示区域的激光,并根据接收到的所述待拍摄物体反射的激光的光斑图案,获得所述待拍摄物体表面的深度图像。The imaging module is used to receive the laser light that is reflected by the object to be photographed and then penetrates the display area, and obtain a depth image of the surface of the object to be photographed according to the received spot pattern of the laser light reflected by the object to be photographed.
优选地,所述第一透光区域设置有第一红外膜层;Preferably, the first light-transmitting area is provided with a first infrared film layer;
所述灯镜,用于使得发散入射所述多束红外激光透过第一红外膜层、第一透光区域照射到待拍摄物体上。The lamp mirror is used to allow the divergent and incident multiple infrared laser beams to pass through the first infrared film layer and the first light-transmitting area and irradiate the object to be photographed.
优选地,所述透镜组件包括第一透镜、第二透镜以及镜筒;Preferably, the lens assembly comprises a first lens, a second lens and a lens barrel;
所述第一透镜、第二透镜顺次设置在所述镜筒的入光侧;所述灯镜设置在所述镜筒的出光侧;The first lens and the second lens are sequentially arranged on the light incident side of the lens barrel; the lamp lens is arranged on the light exit side of the lens barrel;
所述第一透镜,用于将所述多束激光汇聚后投射至所述第二透镜;The first lens is used to converge the multiple laser beams and project them to the second lens;
所述第二透镜,用于将所述第一透镜投射的所述多束激光再次汇聚后投射至所述灯镜的入光面。The second lens is used to converge the multiple laser beams projected by the first lens again and project them onto the light incident surface of the lamp mirror.
优选地,所述灯镜的入光侧设置有一凹形的入光口;Preferably, a concave light entrance is provided on the light entrance side of the lamp mirror;
所述入光口的底面为入光面;所述入光面为凸面;所述投影镜头的光阑设置在所述凸面上;The bottom surface of the light entrance is a light entrance surface; the light entrance surface is a convex surface; the aperture of the projection lens is arranged on the convex surface;
所述入光面,用于使得入射的所述多束激光平行出射或接近平行出射。The light incident surface is used to make the incident multiple laser beams emerge in parallel or nearly in parallel.
优选地,所述激光器模块包括位于所述结构光投射器和所述投影镜头之间的分光器件;Preferably, the laser module comprises a light splitter located between the structured light projector and the projection lens;
所述结构光投射器采用激光器阵列,用于投射点阵激光;The structured light projector uses a laser array to project dot matrix lasers;
所述分光器件位于所述激光器阵列的出光侧,用于将所述点阵激光分成随机分布的多束激光。The beam splitter is located at the light-emitting side of the laser array and is used to split the dot matrix laser into a plurality of randomly distributed laser beams.
优选地,所述结构光投射器包括位于所述激光器模块和所述投影镜头之间的边发射激光器、准直镜头、反射器件以及分光器件;Preferably, the structured light projector comprises an edge-emitting laser, a collimating lens, a reflecting device and a light splitting device located between the laser module and the projection lens;
所述边发射激光器,用于向所述准直镜头投射激光;The edge emitting laser is used to project laser light toward the collimating lens;
所述准直镜头位于所述边发射激光器的出光侧,用于对入射的所述激光进行准直,并出射准直光束;The collimating lens is located at the light-emitting side of the edge-emitting laser, and is used to collimate the incident laser and emit a collimated light beam;
所述反射器件位于所述准直镜头的出光侧,用于将所述准直光束折转后投射至所述分光器件;The reflective device is located at the light-emitting side of the collimating lens, and is used to fold the collimated light beam and project it to the beam splitting device;
所述分光器件位于所述反射器件的出光侧,用于将所述反射器件投射的准直光束分成随机分布的多束激光。The beam splitter is located at the light-emitting side of the reflector, and is used to split the collimated light beam projected by the reflector into a plurality of randomly distributed laser beams.
优选地,所述深度相机模组包括与所述激光器模块和所述成像模块相连的驱动电路;Preferably, the depth camera module includes a driving circuit connected to the laser module and the imaging module;
所述驱动电路,用于控制所述激光器模块和所述成像模块同时开启或关闭,并通过控制所述激光器模块的驱动电流控制所述激光器模块的输出光功率。The driving circuit is used to control the laser module and the imaging module to be turned on or off simultaneously, and to control the output optical power of the laser module by controlling the driving current of the laser module.
优选地,所述成像模块包括接收镜头和光探测器阵列;所述光探测器阵列包括多个呈阵列分布的光探测器;Preferably, the imaging module comprises a receiving lens and a light detector array; the light detector array comprises a plurality of light detectors distributed in an array;
所述接收镜头,用于将同一角度入射的平行激光会聚在位于接收镜头焦平面的上光探测器;The receiving lens is used to converge parallel lasers incident at the same angle onto an upper light detector located on the focal plane of the receiving lens;
所述光探测器,用于接收所述激光生成光斑图案,并根据所述光斑图案获得所述待拍摄物体表面的深度图像。The light detector is used to receive the laser to generate a spot pattern, and obtain a depth image of the surface of the object to be photographed according to the spot pattern.
优选地,还包括泛光投射器;Preferably, it also includes a floodlight projector;
所述泛光投射器设置在位于所述黑色矩阵区域背光侧,用于根据预设置的光照度阈值,通过所述黑色矩阵区域上设置的第二透光区域向所述待拍摄物体投射泛光,以进行照明;The floodlight projector is arranged on the backlight side of the black matrix area, and is used to project floodlight to the object to be photographed through the second light-transmitting area arranged on the black matrix area according to a preset light illumination threshold, so as to illuminate the object;
或,所述泛光投射器位于所述显示区域的背光侧,用于根据预设置的光照度阈值,使所述泛光穿透所述显示区域后照射到待拍摄物体上以进行照明。Alternatively, the floodlight projector is located at the backlight side of the display area, and is used to allow the floodlight to penetrate the display area and illuminate the object to be photographed for illumination according to a preset light intensity threshold.
根据本发明提供的电子设备,其特征在于,包括所述的显示装置。The electronic device provided according to the present invention is characterized by comprising the above-mentioned display device.
第二方面,本发明提供如下技术方案:In a second aspect, the present invention provides the following technical solutions:
根据本发明提供的具有3D摄像模组的显示装置,包括显示基板以及3D摄像模组;A display device with a 3D camera module provided by the present invention includes a display substrate and a 3D camera module;
所述显示基板包括显示区域和环绕所述显示区域的黑色矩阵区域;所述黑色矩阵区域包括第一透光区域;The display substrate comprises a display area and a black matrix area surrounding the display area; the black matrix area comprises a first light-transmitting area;
所述3D摄像模组包括深度相机模组;所述深度相机模组包括激光器模块和成像模块;所述激光器模块位于所述显示区域背光侧;所述成像模块位于所述黑色矩阵区域的背光侧;The 3D camera module includes a depth camera module; the depth camera module includes a laser module and an imaging module; the laser module is located on the backlight side of the display area; the imaging module is located on the backlight side of the black matrix area;
所述激光器模块包括结构光投射器和投影镜头;所述结构光投射器,用于向所述投影镜头投射结构光,所述结构光包括随机分布的多束激光;所述投影镜头,用于将入射的所述多束激光穿透所述显示区域照射到待拍摄物体上;The laser module includes a structured light projector and a projection lens; the structured light projector is used to project structured light to the projection lens, wherein the structured light includes a plurality of randomly distributed laser beams; the projection lens is used to allow the incident plurality of laser beams to penetrate the display area and irradiate the object to be photographed;
所述成像模块包括灯镜、接收镜头以及光探测器阵列;所述光探测器阵列包括多个呈阵列分布的光探测器;所述灯镜,用于通过第一透光区域接收所述待拍摄物体反射的激光,并在光阑处收缩至最窄后,发散投射至接收镜头;所述接收镜头,用于将同一角度入射的平行激光会聚在位于接收镜头焦平面的光探测器上;所述光探测器,用于接收所述激光生成光斑图案,并根据所述光斑图案获得所述待拍摄物体表面的深度图像。The imaging module includes a light mirror, a receiving lens and a light detector array; the light detector array includes a plurality of light detectors distributed in an array; the light mirror is used to receive the laser reflected by the object to be photographed through the first light-transmitting area, and after shrinking to the narrowest at the aperture, it is divergently projected to the receiving lens; the receiving lens is used to converge parallel lasers incident at the same angle onto the light detector located in the focal plane of the receiving lens; the light detector is used to receive the laser to generate a spot pattern, and obtain a depth image of the surface of the object to be photographed according to the spot pattern.
优选地,所述第一透光区域设置有第一红外膜层;Preferably, the first light-transmitting area is provided with a first infrared film layer;
所述灯镜,用于依次通过第一透光区域、第一红外膜层接收所述待拍摄物体反射的激光,并在光阑处收缩至最窄后,发散投射至所述接收镜头。The lamp mirror is used to receive the laser reflected by the object to be photographed through the first light-transmitting area and the first infrared film layer in sequence, and after shrinking to the narrowest at the aperture, divergently project it to the receiving lens.
优选地,所述接收镜头包括第一透镜、第二透镜以及镜筒;Preferably, the receiving lens comprises a first lens, a second lens and a lens barrel;
所述第一透镜、第二透镜顺次设置在所述镜筒的出光侧;所述灯镜设置在所述镜筒的如光侧;The first lens and the second lens are arranged in sequence on the light-emitting side of the lens barrel; the lamp lens is arranged on the light-receiving side of the lens barrel;
所述第二透镜,用于将所述灯镜投射的所述多束激光会聚后投射至所述第一透镜的入光面;The second lens is used to converge the multiple laser beams projected by the lamp mirror and project them onto the light incident surface of the first lens;
所述第一透镜,用于将所述第二透镜投射的多束激光再次会聚后投射至所述光探测器阵列上。The first lens is used to converge the multiple laser beams projected by the second lens and project them onto the photodetector array.
优选地,所述灯镜的出光侧设置有一凹形的出光口;Preferably, a concave light outlet is provided on the light outlet side of the lamp mirror;
所述出光口的底面为出光面;所述出光面为凸面;所述接收镜头的光阑设置在所述凸面上;The bottom surface of the light outlet is a light outlet surface; the light outlet surface is a convex surface; the aperture of the receiving lens is arranged on the convex surface;
所述出光面,用于使得入射的所述多束激光发散出射。The light-emitting surface is used to make the incident multiple laser beams diverge and emit.
优选地,所述激光器模块包括位于所述结构光投射器和所述投影镜头之间的分光器件;Preferably, the laser module comprises a light splitter located between the structured light projector and the projection lens;
所述结构光投射器采用激光器阵列,用于投射点阵激光;The structured light projector uses a laser array to project dot matrix lasers;
所述分光器件位于所述激光器阵列的出光侧,用于将所述点阵激光分成随机分布的多束激光。The beam splitter is located at the light-emitting side of the laser array and is used to split the dot matrix laser into a plurality of randomly distributed laser beams.
优选地,所述结构光投射器包括位于所述激光器模块和所述显示基板之间的边发射激光器、准直镜头、反射器件以及分光器件;Preferably, the structured light projector comprises an edge-emitting laser, a collimating lens, a reflective device and a light splitting device located between the laser module and the display substrate;
所述边发射激光器,用于向所述准直镜头投射激光;The edge emitting laser is used to project laser light toward the collimating lens;
所述准直镜头位于所述边发射激光器的出光侧,用于对入射的所述激光进行准直,并出射准直光束;The collimating lens is located at the light-emitting side of the edge-emitting laser, and is used to collimate the incident laser and emit a collimated light beam;
所述反射器件位于所述准直镜头的出光侧,用于将所述准直光束折转后投射至所述分光器件;The reflective device is located at the light-emitting side of the collimating lens, and is used to fold the collimated light beam and project it to the beam splitting device;
所述分光器件位于所述反射器件的出光侧,用于将所述反射器件投射的准直光束分成随机分布的多束激光。The beam splitter is located at the light-emitting side of the reflector, and is used to split the collimated light beam projected by the reflector into a plurality of randomly distributed laser beams.
优选地,所述深度相机模组包括与所述激光器模块和所述成像模块相连的驱动电路;Preferably, the depth camera module includes a driving circuit connected to the laser module and the imaging module;
所述驱动电路,用于控制所述激光器模块和所述成像模块同时开启或关闭,并通过控制所述激光器模块的驱动电流控制所述激光器模块的输出光功率。The driving circuit is used to control the laser module and the imaging module to be turned on or off simultaneously, and to control the output optical power of the laser module by controlling the driving current of the laser module.
优选地,所述深度相机模组包括处理模块;所述3D摄像模组还包括2D成像模组;Preferably, the depth camera module includes a processing module; the 3D camera module also includes a 2D imaging module;
所述2D成像模组用于拍摄所述待拍摄物体的2D图像;The 2D imaging module is used to capture a 2D image of the object to be captured;
所述处理模块,用于根据所述深度图像和所述2D图像得到所述待拍摄物体的3D图像。The processing module is used to obtain a 3D image of the object to be photographed according to the depth image and the 2D image.
优选地,还包括泛光投射器;Preferably, it also includes a floodlight projector;
所述泛光投射器设置在位于所述黑色矩阵区域背光侧,用于根据预设置的光照度阈值,通过所述黑色矩阵区域上设置的第二透光区域向所述待拍摄物体投射泛光,以进行照明;The floodlight projector is arranged on the backlight side of the black matrix area, and is used to project floodlight to the object to be photographed through the second light-transmitting area arranged on the black matrix area according to a preset light illumination threshold, so as to illuminate the object;
或,所述泛光投射器位于所述显示区域的背光侧,用于根据预设置的光照度阈值,使所述泛光穿透所述显示区域后照射到待拍摄物体上以进行照明。Alternatively, the floodlight projector is located at the backlight side of the display area, and is used to allow the floodlight to penetrate the display area and illuminate the object to be photographed for illumination according to a preset light intensity threshold.
根据本发明提供的电子设备,其特征在于,包括所述的显示装置。The electronic device provided according to the present invention is characterized by comprising the above-mentioned display device.
第三方面,本发明提供如下技术方案:In a third aspect, the present invention provides the following technical solutions:
根据本发明提供的具有3D摄像模组的显示装置,包括显示基板以及3D摄像模组;A display device with a 3D camera module provided by the present invention includes a display substrate and a 3D camera module;
所述显示基板包括显示区域和环绕所述显示区域的黑色矩阵区域;所述黑色矩阵区域包括透光区域;The display substrate comprises a display area and a black matrix area surrounding the display area; the black matrix area comprises a light-transmitting area;
所述3D摄像模组包括深度相机模组;所述深度相机模组包括激光器模块和成像模块;所述激光器模块位于所述黑色矩阵区域背光侧;所述成像模块位于所述显示区域的背光侧;The 3D camera module includes a depth camera module; the depth camera module includes a laser module and an imaging module; the laser module is located on the backlight side of the black matrix area; the imaging module is located on the backlight side of the display area;
所述激光器模块包括泛光光源和投影镜头;所述投影镜头包括透镜组件和灯镜;所述泛光光源,用于发射泛光;所述透镜组件,用于将所述泛光会聚后入射至所述灯镜的入光面;所述灯镜,用于使得入射的所述泛光通过透光区域照射到待拍摄物体上;The laser module includes a floodlight source and a projection lens; the projection lens includes a lens assembly and a lamp mirror; the floodlight source is used to emit floodlight; the lens assembly is used to converge the floodlight and then make it incident on the light incident surface of the lamp mirror; the lamp mirror is used to make the incident floodlight pass through the light-transmitting area and irradiate the object to be photographed;
所述成像模块,用于接收所述待拍摄物体反射后穿透所述显示区域的泛光,并根据所述泛光的延时或相位差,获得所述待拍摄物体表面的深度图像。The imaging module is used to receive the floodlight that is reflected by the object to be photographed and penetrates the display area, and obtain a depth image of the surface of the object to be photographed according to the delay or phase difference of the floodlight.
优选地,所述透光区域设置有红外膜层;Preferably, the light-transmitting area is provided with an infrared film layer;
所述灯镜,用于使得发散入射的所述红外泛光透过一红外膜层、一透光区域照射到待拍摄物体上。The lamp mirror is used to allow the diffused incident infrared floodlight to pass through an infrared film layer and a light-transmitting area to illuminate the object to be photographed.
优选地,所述透镜组件包括第一透镜、第二透镜以及镜筒;Preferably, the lens assembly comprises a first lens, a second lens and a lens barrel;
所述第一透镜、第二透镜顺次设置在所述镜筒的入光侧;所述灯镜设置在所述镜筒的出光侧;The first lens and the second lens are sequentially arranged on the light incident side of the lens barrel; the lamp lens is arranged on the light exit side of the lens barrel;
所述第一透镜,用于将所述泛光会聚后投射至所述第二透镜;The first lens is used to converge the flood light and then project it to the second lens;
所述第二透镜,用于将所述第一透镜投射的所述泛光再次会聚后投射至所述灯镜的入光面。The second lens is used to converge the floodlight projected by the first lens again and project it onto the light incident surface of the lamp mirror.
优选地,所述灯镜的入光侧设置有一凹形的入光口;Preferably, a concave light entrance is provided on the light entrance side of the lamp mirror;
所述入光口的底面为入光面;所述入光面为凸面;所述投影镜头的光阑设置在所述凸面上;The bottom surface of the light entrance is a light entrance surface; the light entrance surface is a convex surface; the aperture of the projection lens is arranged on the convex surface;
所述入光面,用于使得入射的所述泛光平行出射或接近平行出射。The light incident surface is used to make the incident floodlight emerge in parallel or nearly in parallel.
优选地,所述泛光光源包括结构光投射器、分光器件以及扩散片;Preferably, the floodlight source includes a structured light projector, a light splitting device and a diffuser;
所述结构光投射器采用激光器阵列,用于投射点阵激光;The structured light projector uses a laser array to project dot matrix lasers;
所述分光器件位于所述激光器阵列的出光侧,用于将所述点阵激光分成离散分布的多束激光;The optical splitter is located at the light-emitting side of the laser array and is used to split the dot matrix laser into multiple discretely distributed laser beams;
所述扩散片设置在所述分光器件的出光侧,用于对所述多束激光进行扩散,并使所述多束激光泛光出射到所述投影镜头上。The diffusion sheet is arranged on the light-emitting side of the light-splitting device, and is used for diffusing the multiple laser beams and making the multiple laser beams emit flood light onto the projection lens.
优选地,所述泛光光源包括边发射激光器、准直镜头、反射器件、分光器件以及扩散片;Preferably, the floodlight source comprises an edge-emitting laser, a collimating lens, a reflective device, a beam splitter and a diffuser;
所述边发射激光器,用于向所述准直镜头投射激光;The edge emitting laser is used to project laser light toward the collimating lens;
所述准直镜头位于所述边发射激光器的出光侧,用于对入射的所述激光进行准直,并出射准直光束;The collimating lens is located at the light-emitting side of the edge-emitting laser, and is used to collimate the incident laser and emit a collimated light beam;
所述反射器件位于所述准直镜头的出光侧,用于将所述准直光束折转后投射至所述分光器件;The reflective device is located at the light-emitting side of the collimating lens, and is used to fold the collimated light beam and project it to the beam splitting device;
所述分光器件位于所述反射器件的出光侧,用于将所述反射器件投射的准直光束分成离散分布的多束激光;The beam splitter is located at the light-emitting side of the reflector, and is used to split the collimated light beam projected by the reflector into a plurality of discretely distributed laser beams;
所述扩散片设置在所述分光器件的出光侧,用于对所述多束激光进行扩散,并使所述多束激光泛光出射到所述投影镜头上。The diffusion sheet is arranged on the light-emitting side of the light-splitting device, and is used for diffusing the multiple laser beams and making the multiple laser beams emit flood light onto the projection lens.
优选地,所述深度相机模组包括与所述激光器模块和所述成像模块相连的驱动电路;Preferably, the depth camera module includes a driving circuit connected to the laser module and the imaging module;
所述驱动电路,用于控制所述激光器模块和所述成像模块同时开启或关闭,并通过控制所述激光器模块的驱动电流控制所述激光器模块的输出光功率。The driving circuit is used to control the laser module and the imaging module to be turned on or off simultaneously, and to control the output optical power of the laser module by controlling the driving current of the laser module.
优选地,所述成像模块包括接收镜头和光探测器阵列;所述光探测器阵列包括多个呈阵列分布的光探测器;Preferably, the imaging module comprises a receiving lens and a light detector array; the light detector array comprises a plurality of light detectors distributed in an array;
所述接收镜头,用于将同一角度入射的平行泛光会聚在位于接收镜头焦平面的光探测器上;The receiving lens is used to focus the parallel flood light incident at the same angle onto the light detector located at the focal plane of the receiving lens;
所述光探测器阵列,用于接收经所述泛光,并根据所述泛光的延时或相位差,获得所述待拍摄物体表面的深度图像。The photodetector array is used to receive the floodlight and obtain a depth image of the surface of the object to be photographed according to the time delay or phase difference of the floodlight.
优选地,所述泛光光源采用LED光源。Preferably, the floodlight source is an LED light source.
第四方面,本发明提供如下技术方案:In a fourth aspect, the present invention provides the following technical solutions:
根据本发明提供的具有3D摄像模组的显示装置,包括显示基板以及3D摄像模组;A display device with a 3D camera module provided by the present invention includes a display substrate and a 3D camera module;
所述显示基板包括显示区域和环绕所述显示区域的黑色矩阵区域;所述黑色矩阵区域包括透光区域;The display substrate comprises a display area and a black matrix area surrounding the display area; the black matrix area comprises a light-transmitting area;
所述3D摄像模组包括深度相机模组;所述深度相机模组包括激光器模块和成像模块;所述激光器模块位于所述显示区域背光侧;所述成像模块位于所述黑色矩阵区域的背光侧;The 3D camera module includes a depth camera module; the depth camera module includes a laser module and an imaging module; the laser module is located on the backlight side of the display area; the imaging module is located on the backlight side of the black matrix area;
所述激光器模块包括泛光光源和投影镜头;所述泛光光源,用于发射泛光;所述投影镜头,用于将入射的所述泛光穿透所述显示区域照射到待拍摄物体上;The laser module includes a floodlight source and a projection lens; the floodlight source is used to emit floodlight; the projection lens is used to allow the incident floodlight to penetrate the display area and irradiate the object to be photographed;
所述成像模块包括灯镜、接收镜头以及光探测器阵列;所述光探测器阵列包括多个呈阵列分布的光探测器;所述灯镜,用于通过透光区域接收所述待拍摄物体反射的所述泛光,并在光阑处收缩至最窄后,发散投射至接收镜头;所述接收镜头,用于将同一角度入射的平行泛光会聚在位于接收镜头焦平面的光探测器上;所述光探测器阵列,用于接收所述待拍摄物体反射后穿透所述显示区域的泛光,并根据所述泛光的延时或相位差,获得所述待拍摄物体表面的深度图像。The imaging module includes a light mirror, a receiving lens and a light detector array; the light detector array includes a plurality of light detectors distributed in an array; the light mirror is used to receive the floodlight reflected by the object to be photographed through a light-transmitting area, and after shrinking to the narrowest at the aperture, divergently projects it to the receiving lens; the receiving lens is used to converge parallel floodlight incident at the same angle onto the light detector located on the focal plane of the receiving lens; the light detector array is used to receive the floodlight that penetrates the display area after being reflected by the object to be photographed, and obtain a depth image of the surface of the object to be photographed based on the delay or phase difference of the floodlight.
优选地,所述透光区域设置有红外膜层;Preferably, the light-transmitting area is provided with an infrared film layer;
所述灯镜,用于依次通过透光区域、红外膜层接收所述待拍摄物体反射的所述泛光,并在光阑处收缩至最窄后,发散投射至所述接收镜头。The light mirror is used to receive the floodlight reflected by the object to be photographed through the light-transmitting area and the infrared film layer in sequence, and after shrinking to the narrowest at the aperture, it is divergently projected to the receiving lens.
优选地,所述接收镜头包括第一透镜、第二透镜以及镜筒;Preferably, the receiving lens comprises a first lens, a second lens and a lens barrel;
所述第一透镜、第二透镜顺次设置在所述镜筒的出光侧;所述灯镜设置在所述镜筒的如光侧;The first lens and the second lens are arranged in sequence on the light-emitting side of the lens barrel; the lamp lens is arranged on the light-receiving side of the lens barrel;
所述第二透镜,用于将所述灯镜投射的所述泛光会聚后投射至所述第一透镜的入光面;The second lens is used to converge the floodlight projected by the lamp mirror and then project it onto the light incident surface of the first lens;
所述第一透镜,用于将所述第二透镜投射的所述泛光再次会聚后投射至所述光探测器阵列上。The first lens is used to converge the floodlight projected by the second lens again and project it onto the photodetector array.
优选地,所述灯镜的出光侧设置有一凹形的出光口;Preferably, a concave light outlet is provided on the light outlet side of the lamp mirror;
所述出光口的底面为出光面;所述出光面为凸面;所述接收镜头的光阑设置在所述凸面上;The bottom surface of the light outlet is a light outlet surface; the light outlet surface is a convex surface; the aperture of the receiving lens is arranged on the convex surface;
所述出光面,用于使得入射的所述泛光发散出射。The light emitting surface is used to make the incident flood light diverge and emit.
优选地,所述泛光光源包括结构光投射器、分光器件以及扩散片;Preferably, the floodlight source includes a structured light projector, a light splitting device and a diffuser;
所述结构光投射器采用激光器阵列,用于投射点阵激光;The structured light projector uses a laser array to project dot matrix lasers;
所述分光器件位于所述激光器阵列的出光侧,用于将所述点阵激光分成离散分布的多束激光;The optical splitter is located at the light-emitting side of the laser array and is used to split the dot matrix laser into multiple discretely distributed laser beams;
所述扩散片设置在所述分光器件的出光侧,用于对所述多束激光进行扩散,并使所述多束激光泛光出射到所述投影镜头上。The diffusion sheet is arranged on the light-emitting side of the light-splitting device, and is used for diffusing the multiple laser beams and making the multiple laser beams emit flood light onto the projection lens.
优选地,所述泛光光源包括边发射激光器、准直镜头、反射器件、分光器件以及扩散片;Preferably, the floodlight source comprises an edge-emitting laser, a collimating lens, a reflective device, a beam splitter and a diffuser;
所述边发射激光器,用于向所述准直镜头投射激光;The edge emitting laser is used to project laser light toward the collimating lens;
所述准直镜头位于所述边发射激光器的出光侧,用于对入射的所述激光进行准直,并出射准直光束;The collimating lens is located at the light-emitting side of the edge-emitting laser, and is used to collimate the incident laser and emit a collimated light beam;
所述反射器件位于所述准直镜头的出光侧,用于将所述准直光束折转后投射至所述分光器件;The reflective device is located at the light-emitting side of the collimating lens, and is used to fold the collimated light beam and project it to the beam splitting device;
所述分光器件位于所述反射器件的出光侧,用于将所述反射器件投射的准直光束分成离散分布的多束激光;The beam splitter is located at the light-emitting side of the reflector, and is used to split the collimated light beam projected by the reflector into a plurality of discretely distributed laser beams;
所述扩散片设置在所述分光器件的出光侧,用于对所述多束激光进行扩散,并使所述多束激光泛光出射到所述投影镜头上。The diffusion sheet is arranged on the light-emitting side of the light-splitting device, and is used for diffusing the multiple laser beams and making the multiple laser beams emit flood light onto the projection lens.
优选地,所述深度相机模组包括与所述激光器模块和所述成像模块相连的驱动电路;Preferably, the depth camera module includes a driving circuit connected to the laser module and the imaging module;
所述驱动电路,用于控制所述激光器模块和所述成像模块同时开启或关闭,并通过控制所述激光器模块的驱动电流控制所述激光器模块的输出光功率。The driving circuit is used to control the laser module and the imaging module to be turned on or off simultaneously, and to control the output optical power of the laser module by controlling the driving current of the laser module.
优选地,所述深度相机模组包括处理模块;所述3D摄像模组还包括2D成像模组;Preferably, the depth camera module includes a processing module; the 3D camera module also includes a 2D imaging module;
所述2D成像模组用于拍摄所述待拍摄物体的2D图像;The 2D imaging module is used to capture a 2D image of the object to be captured;
所述处理模块,用于根据所述深度图像和所述2D图像得到所述待拍摄物体的3D图像。The processing module is used to obtain a 3D image of the object to be photographed according to the depth image and the 2D image.
优选地,所述光路调制器为液晶调制器;Preferably, the optical path modulator is a liquid crystal modulator;
所述液晶调制器包括:相对设置的第一基板和第二基板;The liquid crystal modulator comprises: a first substrate and a second substrate arranged opposite to each other;
设置在所述第一基板和所述第二基板之间的液晶层;a liquid crystal layer disposed between the first substrate and the second substrate;
其中,通过控制所述液晶层中液晶的偏转,以使所述液晶层处于透明状态或扩散状态;Wherein, the liquid crystal layer is placed in a transparent state or a diffuse state by controlling the deflection of the liquid crystal in the liquid crystal layer;
所述液晶层处于透明状态时,所述结构光投射器通过所述光路调制器投射结构光;所述液晶层处于扩散状态时,所述结构光投射器通过所述光路调制器投射泛光。When the liquid crystal layer is in a transparent state, the structured light projector projects structured light through the optical path modulator; when the liquid crystal layer is in a diffuse state, the structured light projector projects flood light through the optical path modulator.
根据本发明提供的电子设备,其特征在于,包括所述的显示装置。The electronic device provided according to the present invention is characterized by comprising the above-mentioned display device.
与现有技术相比,本发明具有如下的有益效果:Compared with the prior art, the present invention has the following beneficial effects:
本发明投影镜头通过透镜组件将光线汇聚至灯镜上,且使光阑位于灯镜入光面上,使装有投影镜头的深度相机模组适合安装在狭小的缝隙内,而不会被遮挡FOV,如实现本发明在窄边框屏幕(黑色矩阵区域较窄屏幕)上的应用,且还可以能够使灯镜贴紧手机玻璃盖板,起到防尘作用;The projection lens of the present invention converges light onto the lamp mirror through a lens assembly, and the aperture is located on the light incident surface of the lamp mirror, so that the depth camera module equipped with the projection lens is suitable for installation in a narrow gap without blocking the FOV, such as realizing the application of the present invention on a narrow-frame screen (a screen with a narrow black matrix area), and the lamp mirror can also be close to the glass cover of the mobile phone to play a dust-proof role;
本发明实施例中所提供的具有3D摄像模组的显示装置和电子设备,将激光器模块设置在显示基板的黑色矩阵区域背光侧,将成像器模块设置在显示基板的显示区域背光侧,从而不需要在显示装置的顶部设置非显示区即留海区,来安装深度相机模组,进而不会影响显示装置的美观和全面屏体验;In the display device and electronic device with a 3D camera module provided in the embodiments of the present invention, the laser module is arranged on the backlight side of the black matrix area of the display substrate, and the imager module is arranged on the backlight side of the display area of the display substrate, so that there is no need to arrange a non-display area, i.e., a notch area, on the top of the display device to install the depth camera module, thereby not affecting the aesthetics of the display device and the full-screen experience;
本发明中在黑色矩阵区域的透光区域设置红外膜层,该红外膜层能够透过红外光从而不会影响深度相机模组的工作,但是可见光无法穿越红外膜层,保证了黑色矩阵区域的完整性,不影响显示屏幕的美观。In the present invention, an infrared film layer is set in the light-transmitting area of the black matrix area. The infrared film layer can transmit infrared light and will not affect the operation of the depth camera module, but visible light cannot pass through the infrared film layer, thereby ensuring the integrity of the black matrix area and not affecting the appearance of the display screen.
附图说明BRIEF DESCRIPTION OF THE DRAWINGS
为了更清楚地说明本发明实施例或现有技术中的技术方案,下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本发明的实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据提供的附图获得其他的附图。In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on the provided drawings without paying creative work.
图1为本发明实施例中显示装置的一组结构示意图;FIG1 is a schematic diagram of a structure of a display device according to an embodiment of the present invention;
图2为本发明变形例中显示装置的一组结构示意图;FIG2 is a schematic diagram of a group of structures of a display device in a modified example of the present invention;
图3为本发明实施例中激光器模块的一组安装示意图;FIG3 is a schematic diagram of a group of installation of a laser module in an embodiment of the present invention;
图4为本发明实施例中激光器模块的另一组安装示意图;FIG4 is another schematic diagram of the installation of the laser module according to an embodiment of the present invention;
图5为本发明实施例中成像模块的一组安装示意图;FIG5 is a schematic diagram of a group of installation of an imaging module in an embodiment of the present invention;
图6为本发明实施例中基于EEL激光器的显示装置示意图;FIG6 is a schematic diagram of a display device based on an EEL laser according to an embodiment of the present invention;
图7为本发明实施例中基于VCSEL激光器的显示装置示意图;FIG7 is a schematic diagram of a display device based on a VCSEL laser in an embodiment of the present invention;
图8为本发明第一具体实施例提供的一组显示装置的结构示意图;FIG8 is a schematic structural diagram of a group of display devices provided in a first specific embodiment of the present invention;
图9为本发明第二具体实施例提供的一种显示装置的结构示意图;FIG9 is a schematic structural diagram of a display device provided in a second specific embodiment of the present invention;
图10为本发明实施例投影镜头的一种结构示意图;FIG10 is a schematic diagram of a structure of a projection lens according to an embodiment of the present invention;
图11为本发明实施例投影镜头的另一种结构示意图;FIG11 is another schematic diagram of the structure of a projection lens according to an embodiment of the present invention;
图12为本发明实施例中3D摄像头的安装示意图;FIG12 is a schematic diagram of the installation of a 3D camera in an embodiment of the present invention;
图13为本发明实施例多束激光的光斑图。FIG. 13 is a spot diagram of multiple laser beams according to an embodiment of the present invention.
图中:In the figure:
10为显示基板;11为激光器模块;1101为激光器阵列;1102为边发射激光器;12为成像模块;1201为第二灯镜;1202为接收镜头;1203为光探测器阵列;13为分光器件;14为驱动电路;15为处理模块;16为透镜组件;1601为第一透镜;1602为第二透镜;1603为隔圈;1604为镜筒;1605为隔框;17为反射器件;18为准直镜头;19为灯镜;20为黑色矩阵区域;21为扩散片;30为显示区域;40为内屏;50为泛光投射器;60为RGB摄像头。10 is a display substrate; 11 is a laser module; 1101 is a laser array; 1102 is an edge-emitting laser; 12 is an imaging module; 1201 is a second lamp mirror; 1202 is a receiving lens; 1203 is a light detector array; 13 is a spectrometer; 14 is a driving circuit; 15 is a processing module; 16 is a lens assembly; 1601 is a first lens; 1602 is a second lens; 1603 is a spacer ring; 1604 is a lens barrel; 1605 is a spacer frame; 17 is a reflective device; 18 is a collimating lens; 19 is a lamp mirror; 20 is a black matrix area; 21 is a diffuser; 30 is a display area; 40 is an inner screen; 50 is a floodlight projector; 60 is an RGB camera.
具体实施方式Detailed ways
下面结合具体实施例对本发明进行详细说明。以下实施例将有助于本领域的技术人员进一步理解本发明,但不以任何形式限制本发明。应当指出的是,对本领域的普通技术人员来说,在不脱离本发明构思的前提下,还可以做出若干变形和改进。这些都属于本发明的保护范围。The present invention is described in detail below in conjunction with specific embodiments. The following embodiments will help those skilled in the art to further understand the present invention, but are not intended to limit the present invention in any form. It should be noted that, for those of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present invention. These all belong to the protection scope of the present invention.
需要说明的是,当元件被称为“固定于”或“设置于”另一个元件,它可以直接在另一个元件上或者间接在该另一个元件上。当一个元件被称为是“连接于”另一个元件,它可以是直接连接到另一个元件或间接连接至该另一个元件上。另外,连接即可以是用于固定作用也可以是用于电路连通作用。It should be noted that when a component is referred to as being "fixed to" or "disposed on" another component, it can be directly on the other component or indirectly on the other component. When an element is referred to as being "connected to" another element, it can be directly connected to the other element or indirectly connected to the other element. In addition, connection can be used for fixing or for circuit connection.
需要理解的是,术语“长度”、“宽度”、“上”、“下”、“前”、“后”、“左”、“右”、“竖直”、“水平”、“顶”、“底”“内”、“外”等指示的方位或位置关系为基于附图所示的方位或位置关系,仅是为了便于描述本发明实施例和简化描述,而不是指示或暗示所指的装置或元件必须具有特定的方位、以特定的方位构造和操作,因此不能理解为对本发明的限制。It should be understood that the terms "length", "width", "up", "down", "front", "back", "left", "right", "vertical", "horizontal", "top", "bottom", "inside", "outside", etc., indicating the orientation or position relationship are based on the orientation or position relationship shown in the accompanying drawings, and are only for the convenience of describing the embodiments of the present invention and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore cannot be understood as a limitation on the present invention.
此外,术语“第一”、“第二”仅用于描述目的,而不能理解为指示或暗示相对重要性或者隐含指明所指示的技术特征的数量。由此,限定有“第一”、“第二”的特征可以明示或者隐含地包括一个或者更多该特征。在本发明实施例的描述中,“多个”的含义是两个或两个以上,除非另有明确具体的限定。In addition, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of the features. In the description of the embodiments of the present invention, the meaning of "plurality" is two or more, unless otherwise clearly and specifically defined.
正如背景技术所述,现有的基于全面屏的结构设计,为了安装3D摄像模组中的深度相机模组等器件,在显示基板的顶部设置了非显示区即刘海区,但是,这样会影响显示装置的美观和全面屏体验。As described in the background technology, in the existing full-screen based structural design, in order to install devices such as the depth camera module in the 3D camera module, a non-display area, i.e., a bangs area, is set on the top of the display substrate. However, this will affect the aesthetics of the display device and the full-screen experience.
发明人研究发现,现有的深度相机模组都是采用垂直腔表面发光激光器(Vertical Cavity Surface Emitting Laser,VCSEL)作为光源,但是,由于VCSEL激光器的输出光功率较低,当显示基板的透射率较低时,通过显示面板后的激光的光功率较低,不能得到有效地深度图像,因此,需要在显示基板的顶部设置非显示区即刘海区,并对非显示区进行挖孔来安装VCSEL激光器。The inventors have found that existing depth camera modules all use vertical cavity surface emitting lasers (VCSEL) as light sources. However, since the output light power of the VCSEL laser is low, when the transmittance of the display substrate is low, the light power of the laser passing through the display panel is low and an effective depth image cannot be obtained. Therefore, it is necessary to set a non-display area, i.e., a bangs area, on the top of the display substrate and to dig a hole in the non-display area to install the VCSEL laser.
为使本发明的目的、特征和优点能够更加明显易懂,下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅仅是本发明一部分实施例,而不是全部的实施例。基于本发明中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都属于本发明保护的范围。In order to make the purpose, features and advantages of the present invention more obvious and easy to understand, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.
本发明实施例提供了一种具有3D摄像模组的显示装置,如图1所示,包括显示基板10和3D摄像模组,该3D摄像模组包括位于显示基板10背光侧的深度相机模组。需要说明的是,本发明实施例中的深度相机模组为红外摄像模组,激光器模块采用发射红外激光的红外激光器。所述激光器模块采用垂直腔面发射激光器阵列、边发射激光器以及半导体激光器。The embodiment of the present invention provides a display device with a 3D camera module, as shown in FIG1 , comprising a display substrate 10 and a 3D camera module, wherein the 3D camera module comprises a depth camera module located on the backlight side of the display substrate 10. It should be noted that the depth camera module in the embodiment of the present invention is an infrared camera module, and the laser module adopts an infrared laser that emits infrared laser. The laser module adopts a vertical cavity surface emitting laser array, an edge emitting laser, and a semiconductor laser.
其中,显示基板的出光侧为可以显示图像的一侧,背光侧为不能显示图像的一侧。也就是说,本发明实施例中的深度相机模组可以位于显示基板10的下方即可以设置在屏幕下方,而不需要破坏显示基板10的结构,如不需要在显示基板10顶部的非显示区挖孔来设置深度相机模组。所述显示基板包括显示区域和环绕所述显示区域的黑色矩阵区域;所述黑色矩阵区域包括透光区域。在部分实施例中,所述黑色矩阵区域进一步包括第一透光区域和第二透光区域。所述透光区域为直径小于1毫米的圆形区域。Among them, the light-emitting side of the display substrate is the side that can display the image, and the backlight side is the side that cannot display the image. That is to say, the depth camera module in the embodiment of the present invention can be located below the display substrate 10, that is, it can be set below the screen without destroying the structure of the display substrate 10, such as there is no need to dig a hole in the non-display area at the top of the display substrate 10 to set the depth camera module. The display substrate includes a display area and a black matrix area surrounding the display area; the black matrix area includes a light-transmitting area. In some embodiments, the black matrix area further includes a first light-transmitting area and a second light-transmitting area. The light-transmitting area is a circular area with a diameter of less than 1 mm.
本发明实施例中,深度相机模组包括泛光投射器50、激光器模块11和成像模块12。其中,激光器模块11和成像模块12都位于显示基板10的背光侧,并且,激光器模块11的出光口朝向显示基板10设置,以使激光能够通过第一透光区照射到位于显示基板10出光侧的待拍摄物体上,成像模块12的入光口朝向显示基板10设置,以使待拍摄物体反射的激光穿透所述显示区域后进入成像模块12。In the embodiment of the present invention, the depth camera module includes a flood projector 50, a laser module 11 and an imaging module 12. The laser module 11 and the imaging module 12 are both located on the backlight side of the display substrate 10, and the light outlet of the laser module 11 is arranged toward the display substrate 10, so that the laser can be irradiated onto the object to be photographed located on the light outlet side of the display substrate 10 through the first light transmission area, and the light inlet of the imaging module 12 is arranged toward the display substrate 10, so that the laser reflected by the object to be photographed can penetrate the display area and enter the imaging module 12.
其中,所述激光器模块11包括结构光投射器和投影镜头;所述投影镜头包括透镜组件16和灯镜19;所述结构光投射器,用于向所述透镜组件16投射结构光,所述结构光包括随机分布的多束激光;所述透镜组件16,用于将所述多束激光汇聚后入射至所述灯镜的入光面;所述灯镜19,用于使得入射的所述多束激光平行出射或接近平行出射以使所述激光通过第一透光区域照射到待拍摄物体上;The laser module 11 includes a structured light projector and a projection lens; the projection lens includes a lens assembly 16 and a lamp mirror 19; the structured light projector is used to project structured light to the lens assembly 16, and the structured light includes a plurality of randomly distributed laser beams; the lens assembly 16 is used to converge the plurality of laser beams and then make them incident on the light incident surface of the lamp mirror; the lamp mirror 19 is used to make the incident plurality of laser beams emit in parallel or nearly in parallel so that the laser beams can be irradiated onto the object to be photographed through the first light-transmitting area;
在部分实施例中,深度相机模组包括激光器模块11和成像模块12。其中,激光器模块11和成像模块12都位于显示基板10的背光侧,并且,激光器模块11的出光口朝向显示基板10设置,以使激光能够通过第一透光区照射到位于显示基板10出光侧的待拍摄物体上,成像模块12的入光口朝向显示基板10设置,以使待拍摄物体反射的激光穿透所述显示区域后进入成像模块12。In some embodiments, the depth camera module includes a laser module 11 and an imaging module 12. The laser module 11 and the imaging module 12 are both located on the backlight side of the display substrate 10, and the light outlet of the laser module 11 is arranged toward the display substrate 10, so that the laser can be irradiated onto the object to be photographed located on the light outlet side of the display substrate 10 through the first light-transmitting area, and the light inlet of the imaging module 12 is arranged toward the display substrate 10, so that the laser reflected by the object to be photographed penetrates the display area and enters the imaging module 12.
其中,所述激光器模块11包括泛光光源和投影镜头;所述投影镜头包括透镜组件16和灯镜19;所述泛光光源,用于发射泛光;所述透镜组件16,用于将所述泛光会聚后入射至所述灯镜的入光面;所述灯镜19,用于使得入射的所述泛光通过透光区域照射到待拍摄物体上。Among them, the laser module 11 includes a floodlight source and a projection lens; the projection lens includes a lens assembly 16 and a lamp mirror 19; the floodlight source is used to emit floodlight; the lens assembly 16 is used to converge the floodlight and make it incident on the light incident surface of the lamp mirror; the lamp mirror 19 is used to allow the incident floodlight to pass through the light-transmitting area and irradiate the object to be photographed.
所述成像模块12,用于接收所述待拍摄物体反射后穿透所述显示区域的激光,并根据接收到的所述待拍摄物体反射的激光的光斑图案,获得所述待拍摄物体表面的深度图像。该深度图像包括待拍摄物体表面不同区域的深度信息。The imaging module 12 is used to receive the laser light reflected by the object to be photographed and then penetrate the display area, and obtain a depth image of the surface of the object to be photographed according to the received spot pattern of the laser light reflected by the object to be photographed. The depth image includes depth information of different areas on the surface of the object to be photographed.
在部分实施例中,所述成像模块12包括第二灯镜1201、接收镜头1202以及光探测器阵列1203;所述光探测器阵列1203包括多个呈阵列分布的光探测器;所述灯镜1201,用于通过第一透光区域接收所述待拍摄物体反射的激光,并在光阑处收缩至最窄后,发散投射至接收镜头;所述接收镜头1202,用于将同一角度入射的平行激光会聚在位于接收镜头焦平面的光探测器上;所述光探测器,用于接收所述激光生成光斑图案,并根据所述光斑图案获得所述待拍摄物体表面的深度图像。该深度图像包括待拍摄物体表面不同区域的深度信息。In some embodiments, the imaging module 12 includes a second light mirror 1201, a receiving lens 1202, and a light detector array 1203; the light detector array 1203 includes a plurality of light detectors distributed in an array; the light mirror 1201 is used to receive the laser reflected by the object to be photographed through the first light-transmitting area, and after shrinking to the narrowest at the aperture, divergently project it to the receiving lens; the receiving lens 1202 is used to converge parallel lasers incident at the same angle onto the light detector located in the focal plane of the receiving lens; the light detector is used to receive the laser to generate a spot pattern, and obtain a depth image of the surface of the object to be photographed according to the spot pattern. The depth image includes depth information of different areas on the surface of the object to be photographed.
所述泛光投射器50,用于根据预设置的光照度阈值,通过所述第二透光区域向所述待拍摄物体投射泛光,以进行照明。所述预设置的光照度阈值为10lux至50lux的任意值,优选所述预设值的光照度阈值为10lux。The floodlight projector 50 is used to project floodlight to the object to be photographed through the second light-transmitting area for illumination according to a preset light threshold. The preset light threshold is any value from 10 lux to 50 lux, and preferably the preset light threshold is 10 lux.
在本发明变形例中,所述泛光投射器50还可以设置于所述显示区域的背光侧,用于根据预设置的光照度阈值,使所述泛光穿透所述显示区域后照射到待拍摄物体上以进行照明。In a variation of the present invention, the floodlight projector 50 may also be disposed on the backlight side of the display area, and is used to allow the floodlight to penetrate the display area and illuminate the object to be photographed for illumination according to a preset light intensity threshold.
由于激光器模块11设置在黑色矩阵区域的背光侧,成像模块12设置在所述显示区域的背光侧,从而不需要在显示装置的顶部设置非显示区来安装深度相机模组,进而不会影响显示装置的美观和全面屏体验。Since the laser module 11 is arranged on the backlight side of the black matrix area, and the imaging module 12 is arranged on the backlight side of the display area, there is no need to set a non-display area on the top of the display device to install the depth camera module, which will not affect the appearance and full-screen experience of the display device.
并且,由于激光器模块11和成像模块12都设置在显示基板10的背光侧,因此,使得激光器模块11和成像模块12的排列组合有多种可能性,在不影响美观的前提下,可以增加激光器模块11和成像模块12之间的距离,以提高深度相机模组的拍摄精度,如图2a所示,还可以将激光器模块11和成像模块12分别设置在两侧的黑色矩阵区域。如图2b所示,还可以将激光器模块11设置在两侧中任一侧显示区域,成像模块12设置在两侧中任一侧的黑色矩阵区域。如图2c所示,还可以将激光器模块11和成像模块12分别设置在两侧的黑色矩阵区域。如图2d所示,还可以将激光器模块11设置在两侧中任一侧显示区域,成像模块12设置在两侧中任一侧的黑色矩阵区域。Moreover, since the laser module 11 and the imaging module 12 are both arranged on the backlight side of the display substrate 10, there are many possibilities for the arrangement and combination of the laser module 11 and the imaging module 12. Without affecting the aesthetics, the distance between the laser module 11 and the imaging module 12 can be increased to improve the shooting accuracy of the depth camera module. As shown in FIG2a, the laser module 11 and the imaging module 12 can also be arranged in the black matrix area on both sides. As shown in FIG2b, the laser module 11 can also be arranged in the display area on either side of the two sides, and the imaging module 12 can be arranged in the black matrix area on either side of the two sides. As shown in FIG2c, the laser module 11 and the imaging module 12 can also be arranged in the black matrix area on both sides. As shown in FIG2d, the laser module 11 can also be arranged in the display area on either side of the two sides, and the imaging module 12 can be arranged in the black matrix area on either side of the two sides.
可选地,所述透光区域设置有红外膜层;在部分实施例中,所述第一透光区域设置有第一红外膜层,所述第二透光区域设置有第二红外膜层;Optionally, the light-transmitting area is provided with an infrared film layer; in some embodiments, the first light-transmitting area is provided with a first infrared film layer, and the second light-transmitting area is provided with a second infrared film layer;
所述灯镜19,用于使得发散入射的所述红外泛光透过一红外膜层、一透光区域照射到待拍摄物体上。The lamp mirror 19 is used to allow the diffused incident infrared flood light to pass through an infrared film layer and a light-transmitting area to illuminate the object to be photographed.
在部分实施例中,所述灯镜19,用于使得发散入射所述多束激光平行出射或接近平行出射以使所述激光透过第一红外膜层、第一透光区域照射到待拍摄物体上;In some embodiments, the lamp mirror 19 is used to make the divergent incident multiple laser beams be emitted in parallel or nearly in parallel so that the laser beams can pass through the first infrared film layer and the first light-transmitting area to irradiate the object to be photographed;
在部分实施例中,所述灯镜19,用于依次通过第一透光区域、第一红外膜层接收所述待拍摄物体反射的激光,并在光阑处收缩至最窄后,发散投射至所述接收镜头;In some embodiments, the lamp mirror 19 is used to receive the laser reflected by the object to be photographed through the first light-transmitting area and the first infrared film layer in sequence, and after shrinking to the narrowest at the aperture, diverge and project to the receiving lens;
所述泛光投射器,用于在光照度低于根据预设置的光照度阈值,通过第二红外膜层、第二透光区域向所述待拍摄物体投射泛光,以进行照明。The floodlight projector is used to project floodlight to the object to be photographed through the second infrared film layer and the second light-transmitting area for illumination when the light intensity is lower than a preset light intensity threshold.
可选地,如图3、图8所示,所述激光器模块包括位于所述结构光投射器和所述投影镜头之间的分光器件;Optionally, as shown in FIG3 and FIG8 , the laser module includes a light splitting device located between the structured light projector and the projection lens;
所述结构光投射器采用激光器阵列1101,用于投射点阵激光;The structured light projector uses a laser array 1101 for projecting dot matrix lasers;
所述分光器件13位于所述激光器阵列1101的出光侧,用于将结构光投射器发射的点阵激光分成随机分布的多束激光。The beam splitter 13 is located at the light-emitting side of the laser array 1101 and is used to split the dot-matrix laser emitted by the structured light projector into a plurality of randomly distributed laser beams.
在部分实施例中,所述泛光光源包括结构光投射器、分光器件13以及扩散片21;In some embodiments, the floodlight source includes a structured light projector, a light splitting device 13 and a diffuser 21;
所述结构光投射器采用激光器阵列1101,用于投射点阵激光;The structured light projector uses a laser array 1101 for projecting dot matrix lasers;
所述分光器件13位于所述激光器阵列1101的出光侧,用于将结构光投射器发射的点阵激光分成离散分布的多束激光。The optical splitter 13 is located at the light-emitting side of the laser array 1101 and is used to split the dot-matrix laser emitted by the structured light projector into multiple discretely distributed laser beams.
所述扩散片21设置在所述分光器件的出光侧,用于对所述多束激光进行扩散,并使所述多束激光泛光出射到所述投影镜头上。The diffusion sheet 21 is disposed on the light-emitting side of the light-splitting device, and is used to diffuse the multiple laser beams and make the multiple laser beams emit flood light onto the projection lens.
即在本发明实施例中,所述显示基板10可以为玻璃基板,所述显示基板10内侧为所述显示装置的内屏40。That is, in the embodiment of the present invention, the display substrate 10 may be a glass substrate, and the inner side of the display substrate 10 is the inner screen 40 of the display device.
本发明实施例中,如图6和图7所示,深度相机模组包括与激光器模块11和成像模块12相连的驱动电路14。该驱动电路14用于控制激光器模块11和成像模块12同时开启或关闭,并通过控制激光器模块11的驱动电流控制激光器模块11的输出光功率,以通过控制激光器模块11的输出光功率控制通过第一透光区域的激光的光功率。In an embodiment of the present invention, as shown in FIGS. 6 and 7 , the depth camera module includes a driving circuit 14 connected to the laser module 11 and the imaging module 12. The driving circuit 14 is used to control the laser module 11 and the imaging module 12 to be turned on or off at the same time, and to control the output optical power of the laser module 11 by controlling the driving current of the laser module 11, so as to control the optical power of the laser passing through the first light-transmitting area by controlling the output optical power of the laser module 11.
进一步地,深度相机模组还包括处理模块15,3D摄像模组还包括2D成像模组。2D成像模组用于拍摄待拍摄物体的2D图像。处理模块15用于根据3D摄像模组拍摄的深度图像和2D成像模组拍摄的2D图像,得到待拍摄物体的3D图像。Furthermore, the depth camera module also includes a processing module 15, and the 3D camera module also includes a 2D imaging module. The 2D imaging module is used to capture a 2D image of the object to be captured. The processing module 15 is used to obtain a 3D image of the object to be captured based on the depth image captured by the 3D camera module and the 2D image captured by the 2D imaging module.
需要说明的是,为了将深度相机模组设置在显示基板10的背光侧,可以通过驱动电路14增大驱动电流,降低激光器模块11的脉冲宽度,将激光器模块11的光功率大幅度提高的同时,使激光器模块11的总脉冲能量基本保持不变,满足人眼安全的光功率限制。It should be noted that in order to set the depth camera module on the backlight side of the display substrate 10, the driving current can be increased through the driving circuit 14, the pulse width of the laser module 11 can be reduced, and the optical power of the laser module 11 can be greatly improved while the total pulse energy of the laser module 11 is basically kept unchanged to meet the optical power limit for human eye safety.
本发明的一个实施例中,如图4、图9所示,所述结构光投射器包括位于所述激光器模块和所述投影镜头之间的边发射激光器1102、准直镜头18、反射器件17以及分光器件13;分光器件13和激光器模块11之间还具有准直镜头18、反射器件17;In one embodiment of the present invention, as shown in FIG. 4 and FIG. 9 , the structured light projector includes an edge-emitting laser 1102, a collimating lens 18, a reflecting device 17, and a spectroscopic device 13 located between the laser module and the projection lens; a collimating lens 18 and a reflecting device 17 are also provided between the spectroscopic device 13 and the laser module 11;
所述边发射激光器1102,用于向所述准直镜头投射激光;The edge emitting laser 1102 is used to project laser light toward the collimating lens;
所述准直镜头18位于所述边发射激光器1102的出光侧,用于对入射的所述激光进行准直,并出射准直光束;The collimating lens 18 is located at the light-emitting side of the edge-emitting laser 1102, and is used to collimate the incident laser and emit a collimated light beam;
所述反射器件17位于所述准直镜头的出光侧,用于将所述准直光束折转后投射至所述分光器件13;The reflector 17 is located at the light-emitting side of the collimating lens, and is used to fold the collimated light beam and project it to the beam splitter 13;
所述分光器件13位于所述反射器件的出光侧,用于将所述反射器件17投射的准直光束分成随机分布的多束激光。The beam splitter 13 is located at the light-emitting side of the reflector 17 and is used to split the collimated light beam projected by the reflector 17 into a plurality of randomly distributed laser beams.
具体地,分光器件13会将边发射激光器1102发射的激光分成随机分布的多个激光,这些激光照射在平面上时,会形成一如图13所示的光斑图像,当多个激光照射到待拍摄物体上时,光斑图案会有形变或位移,第一成像模块拍摄得到待拍摄物体表面的光斑图案后,会根据光斑图案的形变或位移,得到待拍摄物体表面的深度图像,即得到待拍摄物体表面的凹凸不平的深度信息。处理模块15根据深度图像和2D图像即可获得待拍摄物体的3D图像。Specifically, the optical splitter 13 will divide the laser emitted by the edge-emitting laser 1102 into a plurality of randomly distributed lasers. When these lasers are irradiated on a plane, a light spot image as shown in FIG. 13 will be formed. When multiple lasers are irradiated on the object to be photographed, the light spot pattern will be deformed or displaced. After the first imaging module captures the light spot pattern on the surface of the object to be photographed, it will obtain a depth image of the surface of the object to be photographed based on the deformation or displacement of the light spot pattern, that is, obtain the depth information of the unevenness of the surface of the object to be photographed. The processing module 15 can obtain a 3D image of the object to be photographed based on the depth image and the 2D image.
所述成像模块12为第一成像模块,可选地,第一成像模块为红外摄像头。第一成像模块12根据接收到的待拍摄物体反射的激光的光斑图案,获得待拍摄物体表面的深度图像。The imaging module 12 is a first imaging module, and optionally, the first imaging module is an infrared camera. The first imaging module 12 obtains a depth image of the surface of the object to be photographed according to the received spot pattern of the laser reflected by the object to be photographed.
在部分实施例中,所述泛光光源包括位边发射激光器1102、准直镜头18、反射器件17、分光器件13以及扩散片21;In some embodiments, the floodlight source includes an edge emitting laser 1102, a collimating lens 18, a reflector 17, a beam splitter 13, and a diffuser 21;
所述边发射激光器1102,用于向所述准直镜头投射激光;The edge emitting laser 1102 is used to project laser light toward the collimating lens;
所述准直镜头18位于所述边发射激光器1102的出光侧,用于对入射的所述激光进行准直,并出射准直光束;The collimating lens 18 is located at the light-emitting side of the edge-emitting laser 1102, and is used to collimate the incident laser and emit a collimated light beam;
所述反射器件17位于所述准直镜头的出光侧,用于将所述准直光束折转后投射至所述分光器件13;The reflector 17 is located at the light-emitting side of the collimating lens, and is used to fold the collimated light beam and project it to the beam splitter 13;
所述分光器件13位于所述反射器件的出光侧,用于将所述反射器件17投射的准直光束分成离散分布的多束激光;The beam splitter 13 is located at the light-emitting side of the reflector, and is used to split the collimated light beam projected by the reflector 17 into a plurality of discretely distributed laser beams;
所述扩散片21设置在所述分光器件的出光侧,用于对所述多束激光进行扩散,并使所述多束激光泛光出射到所述投影镜头上。The diffusion sheet 21 is disposed on the light-emitting side of the light-splitting device, and is used to diffuse the multiple laser beams and make the multiple laser beams flood-emitted onto the projection lens.
在本发明实施例中,所述反射器件17可以采用反射镜或者三角棱镜。所述三角棱镜的反射面上可以镀一层反射膜。In the embodiment of the present invention, the reflective device 17 may be a reflective mirror or a triangular prism. A reflective film may be coated on the reflective surface of the triangular prism.
在本发明实施例中,如图5所示,所述成像模块12包括接收镜头1202和光探测器阵列1201;所述光探测器阵列1201包括多个呈阵列分布的光探测器;In the embodiment of the present invention, as shown in FIG5 , the imaging module 12 includes a receiving lens 1202 and a light detector array 1201 ; the light detector array 1201 includes a plurality of light detectors distributed in an array;
所述接收镜头1202,用于接收所述待拍摄物体反射后穿透所述显示区域的的激光,并将同一角度入射的平行激光会聚在位于接收镜头焦平面的上光探测器;The receiving lens 1202 is used to receive the laser light that is reflected by the object to be photographed and penetrates the display area, and to converge the parallel laser light incident at the same angle onto the upper light detector located on the focal plane of the receiving lens;
所述光探测器,用于接收所述激光生成光斑图案,并根据所述光斑图案获得所述待拍摄物体表面的深度图像。The light detector is used to receive the laser to generate a spot pattern, and obtain a depth image of the surface of the object to be photographed according to the spot pattern.
在本发明实施例中,所述光探测器可以采用CMOS或者CCD传感器。In the embodiment of the present invention, the light detector may be a CMOS or CCD sensor.
在部分实施例中,所述成像模块12包括第二灯镜1201、接收镜头1202以及光探测器阵列1203;所述光探测器阵列1203包括多个呈阵列分布的光探测器;In some embodiments, the imaging module 12 includes a second light lens 1201, a receiving lens 1202, and a light detector array 1203; the light detector array 1203 includes a plurality of light detectors distributed in an array;
所述第二灯镜1201,用于通过另一透光区域接收所述待拍摄物体反射的激光,并在光阑处收缩至最窄后,发散投射至接收镜头。The second light mirror 1201 is used to receive the laser reflected by the object to be photographed through another light-transmitting area, and after shrinking to the narrowest at the aperture, divergently projects it to the receiving lens.
在部分实施例中,所述成像模块12包括接收镜头1202和光探测器阵列1201;所述光探测器阵列1201包括多个呈阵列分布的光探测器;In some embodiments, the imaging module 12 includes a receiving lens 1202 and a light detector array 1201; the light detector array 1201 includes a plurality of light detectors distributed in an array;
所述接收镜头1202,用于接收所述待拍摄物体反射后穿透所述显示区域的泛光,并将同一角度入射的平行泛光会聚在位于接收镜头焦平面的光探测器上;The receiving lens 1202 is used to receive the floodlight reflected by the object to be photographed and penetrate the display area, and to focus the parallel floodlight incident at the same angle onto a light detector located on the focal plane of the receiving lens;
所述光探测器阵列,用于接收经所述泛光,并根据所述泛光的延时或相位差,获得所述待拍摄物体表面的深度图像。The photodetector array is used to receive the floodlight and obtain a depth image of the surface of the object to be photographed according to the time delay or phase difference of the floodlight.
图10为本发明实施例投影镜头的一种结构示意图,图11为本发明实施例投影镜头的另一种结构示意图,如图10、图11所示,所述投影镜头包括透镜组件16和灯镜19;所述结构光投射器,用于向所述透镜组件投射结构光,所述结构光包括随机分布的多束激光;所述透镜组件16,用于将所述多束激光汇聚后入射至所述灯镜19的入光面;所述灯镜19,用于使得入射的所述多束激光平行出射或接近平行出射以使所述激光通过第一透光区域照射到待拍摄物体上;FIG10 is a schematic diagram of a structure of a projection lens according to an embodiment of the present invention, and FIG11 is another schematic diagram of a structure of a projection lens according to an embodiment of the present invention. As shown in FIGS. 10 and 11 , the projection lens includes a lens assembly 16 and a lamp mirror 19; the structured light projector is used to project structured light to the lens assembly, and the structured light includes a plurality of randomly distributed laser beams; the lens assembly 16 is used to converge the plurality of laser beams and then make them incident on a light incident surface of the lamp mirror 19; the lamp mirror 19 is used to make the incident plurality of laser beams emit in parallel or nearly in parallel so that the laser beams can irradiate the object to be photographed through the first light-transmitting area;
在本发明实施例中,所述接近平行具体为两束激光之间的夹角小于预设置的夹角阈值,所述夹角阈值可以设置为5°。所述多束激光平行具体为多束激光形成多组激光,每组激光内的多束激光相互平行。In the embodiment of the present invention, the nearly parallel means that the angle between the two laser beams is less than a preset angle threshold, and the angle threshold can be set to 5°. The parallelism of multiple laser beams means that multiple laser beams form multiple groups of laser beams, and the multiple laser beams in each group of laser beams are parallel to each other.
在本发明实施例中,所述透镜组件16包括第一透镜1601、第二透镜1602以及镜筒1604;所述第一透镜1601、第二透镜1602顺次设置在所述镜筒的入光侧;所述灯镜19设置在所述镜筒的出光侧;所述第一透镜1601,用于将所述多束激光汇聚后投射至所述第二透镜;所述第二透镜1602,用于将所述第一透镜投射的所述多束激光再次汇聚后投射至所述灯镜的入光面。所述镜筒1604,用于将第一透镜1601、第二透镜1602以及灯镜19组装固定于一体。所述灯镜19的入光侧设置有一凹形的入光口;所述入光口的底面为入光面;所述入光面为凸面;所述投影镜头的光阑设置在所述凸面上。所述入光面,用于使得入射的所述多束激光平行出射或接近平行出射以成像于无穷远或远处指定距离的位置。In the embodiment of the present invention, the lens assembly 16 includes a first lens 1601, a second lens 1602 and a lens barrel 1604; the first lens 1601 and the second lens 1602 are sequentially arranged on the light-entering side of the lens barrel; the lamp mirror 19 is arranged on the light-exiting side of the lens barrel; the first lens 1601 is used to converge the multiple laser beams and project them to the second lens; the second lens 1602 is used to converge the multiple laser beams projected by the first lens again and project them to the light-entering surface of the lamp mirror. The lens barrel 1604 is used to assemble and fix the first lens 1601, the second lens 1602 and the lamp mirror 19 into one body. A concave light entrance is arranged on the light-entering side of the lamp mirror 19; the bottom surface of the light entrance is the light entrance surface; the light entrance surface is a convex surface; the aperture of the projection lens is arranged on the convex surface. The light entrance surface is used to make the multiple incident laser beams exit in parallel or nearly in parallel to form an image at a position at infinity or a specified distance away.
在部分实施例中,所述灯镜19,用于使得入射的所述多束激光在光阑处收缩至最窄后,发散投射至接收镜头;所述接收镜头16,用于将同一角度入射的平行激光会聚在位于接收镜头焦平面的光探测器上;In some embodiments, the lamp mirror 19 is used to make the incident multiple laser beams shrink to the narrowest at the aperture and then diverge and project to the receiving lens; the receiving lens 16 is used to converge the parallel laser beams incident at the same angle onto the light detector located at the focal plane of the receiving lens;
所述接收镜头16包括第一透镜1601、第二透镜1602以及镜筒1604;所述灯镜19的出光侧设置有一凹形的出光口;所述出光口的底面为出光面;所述出光面为凸面;所述灯镜19的光阑设置在所述凸面上。所述出光面,用于使得入射的所述多束激光的所述多束激光发散出射。所述第二透镜1602、第一透镜1601顺次设置在所述镜筒的出光侧;所述灯镜19设置在所述镜筒的入光侧;所述第二透镜1602,用于将所述灯镜19投射的所述多束激光会聚后投射至所述第一透镜1601的入光面;所述第一透镜1601,用于将所述第二透镜1602投射的多束激光再次会聚后投射至所述光探测器阵列上。所述镜筒1604,用于将第一透镜1601、第二透镜1602以及灯镜19组装固定于一体。The receiving lens 16 includes a first lens 1601, a second lens 1602 and a lens barrel 1604; a concave light outlet is provided on the light outlet side of the lamp mirror 19; the bottom surface of the light outlet is the light outlet surface; the light outlet surface is a convex surface; the aperture of the lamp mirror 19 is provided on the convex surface. The light outlet surface is used to make the multiple laser beams of the incident multiple laser beams diverge and emit. The second lens 1602 and the first lens 1601 are sequentially arranged on the light outlet side of the lens barrel; the lamp mirror 19 is arranged on the light entrance side of the lens barrel; the second lens 1602 is used to converge the multiple laser beams projected by the lamp mirror 19 and project them onto the light entrance surface of the first lens 1601; the first lens 1601 is used to converge the multiple laser beams projected by the second lens 1602 again and project them onto the light detector array. The lens barrel 1604 is used to assemble and fix the first lens 1601, the second lens 1602 and the lamp mirror 19 into one body.
在本发明实施例中,由于深度相机模组安装在出光狭窄的缝隙下,光阑的位置即光束最窄的位置应为于狭小缝隙高度中间的位置,那么在上下两侧都不会遮挡光线的情况下,镜头能够达到的视场角最大。In an embodiment of the present invention, since the depth camera module is installed under a narrow light-emitting gap, the position of the aperture, i.e., the position where the light beam is narrowest, should be in the middle of the height of the narrow gap. Then, without blocking the light on the upper and lower sides, the lens can achieve the maximum field of view.
当投影镜头位于显示基板10的背光侧时,需要在透镜组件16与显示基板10之间填充灯镜19。由于可供通光的区域越是尺寸狭小,需要将投影镜头的光线的汇聚点即光阑放置在灯镜19的位置,那么需要投影镜头的直径尺寸较大,才能使具有一定角度的出射光线在传播一定距离之后在指定位置汇聚。将灯镜19下表面做成凸面,并将投影镜头的光阑放置在该凸面上,可以让灯镜19承担一部分光焦度,相当于一个凸透镜,同时减小从灯镜19下方镜片出射光线的角度,能够减小投影镜头有效口径,进而减小整个系统的尺寸。When the projection lens is located on the backlight side of the display substrate 10, it is necessary to fill the lamp mirror 19 between the lens assembly 16 and the display substrate 10. As the area available for light transmission is smaller, it is necessary to place the convergence point of the light from the projection lens, i.e., the aperture, at the position of the lamp mirror 19. Therefore, the diameter of the projection lens needs to be larger so that the outgoing light with a certain angle can converge at a specified position after propagating a certain distance. Making the lower surface of the lamp mirror 19 convex and placing the aperture of the projection lens on the convex surface can allow the lamp mirror 19 to bear part of the optical focal length, which is equivalent to a convex lens. At the same time, reducing the angle of the light emitted from the lens below the lamp mirror 19 can reduce the effective aperture of the projection lens, thereby reducing the size of the entire system.
在本发明实施例中,所述灯镜19的上表面紧贴显示基板10的下表面,灯镜19上部的凸台结构与内屏40的下表面紧贴,所述灯镜19的下边缘紧贴投影镜头镜筒,方便组装和测试。In the embodiment of the present invention, the upper surface of the lamp mirror 19 is in close contact with the lower surface of the display substrate 10, the boss structure on the upper part of the lamp mirror 19 is in close contact with the lower surface of the inner screen 40, and the lower edge of the lamp mirror 19 is in close contact with the projection lens barrel, which is convenient for assembly and testing.
所述第一透镜1601、所述第二透镜1602之间设置有隔圈,所述隔圈1603,用于固定第一透镜2和第二透镜4之间的相对位置。A spacer ring is disposed between the first lens 1601 and the second lens 1602 , and the spacer ring 1603 is used to fix the relative position between the first lens 2 and the second lens 4 .
在本发明实施例中,所述灯镜的出光侧设置有一凸台结构;所述凸台结构的端面为出光面。所述第一透镜1601、所述第二透镜1602采用凸透镜。所述灯镜19的入光侧面与所述第二透镜1602贴合设置。所述灯镜19采用光学塑胶材料制成,既能实现承担光焦度的功能,也能实现投影镜头与显示基板10之间防尘的作用。In the embodiment of the present invention, a boss structure is provided on the light-emitting side of the lamp mirror; the end face of the boss structure is the light-emitting surface. The first lens 1601 and the second lens 1602 are convex lenses. The light-entering side of the lamp mirror 19 is fitted with the second lens 1602. The lamp mirror 19 is made of optical plastic material, which can not only realize the function of taking on the optical focal length, but also realize the dust-proof function between the projection lens and the display substrate 10.
在本发明变形例中,所述镜筒1604上设置有隔框1605;所述第二透镜1602设置在所述隔框1605的一侧面,所述镜筒1604设置在所述隔框1605的另一侧面。In a modified example of the present invention, a spacer frame 1605 is disposed on the lens barrel 1604 ; the second lens 1602 is disposed on one side of the spacer frame 1605 , and the lens barrel 1604 is disposed on the other side of the spacer frame 1605 .
在本发明实施例中,所述第一透镜1601入射的光线,可以通过任意的光投射器进行投射,如结构光投射器、边发射激光器以投射图案。光投射器发出的结构光可以是多束平行的远心光束,也可以是主光线具有一定角度的光束。In an embodiment of the present invention, the light incident on the first lens 1601 can be projected by any light projector, such as a structured light projector or an edge-emitting laser to project a pattern. The structured light emitted by the light projector can be a plurality of parallel telecentric light beams or a light beam whose main light has a certain angle.
本发明实施例中,分光器件13可以是波导器件,纳米光子芯片,也可以是衍射光栅(Diffractive Optics Element,DOE)或编码结构光掩膜等,本发明并不仅限于此。In the embodiment of the present invention, the optical splitter 13 may be a waveguide device, a nanophotonic chip, a diffraction grating (Diffractive Optics Element, DOE) or a coded structured optical mask, etc., but the present invention is not limited thereto.
图12为本发明实施例中3D摄像头的安装示意图,如图12所示,当实施本发明提供的具有3D摄像模组的显示装置时,泛光投射器50、激光器模块11安装在显示基板10的背光侧,所述成像模块12和RGB摄像头60安装在内屏的背光侧。FIG12 is a schematic diagram of the installation of a 3D camera in an embodiment of the present invention. As shown in FIG12 , when the display device with a 3D camera module provided by the present invention is implemented, the floodlight projector 50 and the laser module 11 are installed on the backlight side of the display substrate 10, and the imaging module 12 and the RGB camera 60 are installed on the backlight side of the inner screen.
本发明实施例还提供了一种电子设备,该电子设备包括上述任一实施例提供的显示装置,该电子设备可以为手机、平板电脑和数码相机等。本发明所提供的具有3D摄像模组的电子设备,不需要在显示装置的顶部设置非显示区来安装深度相机模组,外观更美观和更有利于实现全面屏体验。An embodiment of the present invention further provides an electronic device, which includes the display device provided by any of the above embodiments, and the electronic device can be a mobile phone, a tablet computer, a digital camera, etc. The electronic device with a 3D camera module provided by the present invention does not need to set a non-display area on the top of the display device to install the depth camera module, and the appearance is more beautiful and more conducive to achieving a full-screen experience.
本发明实施例中,通过透镜组件的第一透镜、第二透镜将光线汇聚至灯镜上,且使光阑位于灯镜入光面上,使装有投影镜头的深度相机模组适合安装在狭小的缝隙内,而不会被遮挡FOV,如实现本发明在窄边框屏幕(黑色矩阵区域较窄屏幕)上的应用,且还可以能够使灯镜贴紧手机玻璃盖板,起到防尘作用;本发明实施例中所提供的具有3D摄像模组的显示装置和电子设备,将激光器模块设置在显示基板的黑色矩阵区域背光侧,将成像器模块设置在显示基板的显示区域背光侧,从而不需要在显示装置的顶部设置非显示区即留海区,来安装深度相机模组,进而不会影响显示装置的美观和全面屏体验;本发明实施例中在黑色矩阵区域的透光区域设置红外膜层,该红外膜层能够透过红外光从而不会影响深度相机模组的工作,但是可见光无法穿越红外膜层,保证了黑色矩阵区域的完整性,不影响显示屏幕的美观。In the embodiment of the present invention, the light is converged onto the lamp mirror through the first lens and the second lens of the lens assembly, and the aperture is located on the light incident surface of the lamp mirror, so that the depth camera module equipped with the projection lens is suitable for installation in a narrow gap without blocking the FOV, such as realizing the application of the present invention on a narrow-frame screen (a screen with a narrow black matrix area), and the lamp mirror can also be close to the glass cover of the mobile phone to play a dust-proof role; the display device and electronic device with a 3D camera module provided in the embodiment of the present invention set the laser module on the backlight side of the black matrix area of the display substrate, and set the imager module on the backlight side of the display area of the display substrate, so that there is no need to set a non-display area, i.e., a fringe area, on the top of the display device to install the depth camera module, thereby not affecting the beauty of the display device and the full-screen experience; in the embodiment of the present invention, an infrared film layer is set in the light-transmitting area of the black matrix area, and the infrared film layer can transmit infrared light and thus will not affect the operation of the depth camera module, but visible light cannot pass through the infrared film layer, thereby ensuring the integrity of the black matrix area and not affecting the beauty of the display screen.
本说明书中各个实施例采用递进的方式描述,每个实施例重点说明的都是与其他实施例的不同之处,各个实施例之间相同相似部分互相参见即可。对所公开的实施例的上述说明,使本领域专业技术人员能够实现或使用本发明。对这些实施例的多种修改对本领域的专业技术人员来说将是显而易见的,本文中所定义的一般原理可以在不脱离本发明的精神或范围的情况下,在其它实施例中实现。因此,本发明将不会被限制于本文所示的这些实施例,而是要符合与本文所公开的原理和新颖特点相一致的最宽的范围。In this specification, each embodiment is described in a progressive manner, and each embodiment focuses on the differences from other embodiments, and the same and similar parts between the embodiments can be referred to each other. The above description of the disclosed embodiments enables professionals and technicians in this field to implement or use the present invention. Various modifications to these embodiments will be obvious to professionals and technicians in this field, and the general principles defined herein can be implemented in other embodiments without departing from the spirit or scope of the present invention. Therefore, the present invention will not be limited to these embodiments shown in this article, but will comply with the widest range consistent with the principles and novel features disclosed herein.
本说明书中各个实施例采用递进的方式描述,每个实施例重点说明的都是与其他实施例的不同之处,各个实施例之间相同相似部分互相参见即可。对所公开的实施例的上述说明,使本领域专业技术人员能够实现或使用本发明。对这些实施例的多种修改对本领域的专业技术人员来说将是显而易见的,本文中所定义的一般原理可以在不脱离本发明的精神或范围的情况下,在其它实施例中实现。因此,本发明将不会被限制于本文所示的这些实施例,而是要符合与本文所公开的原理和新颖特点相一致的最宽的范围。In this specification, each embodiment is described in a progressive manner, and each embodiment focuses on the differences from other embodiments, and the same and similar parts between the embodiments can be referred to each other. The above description of the disclosed embodiments enables professionals and technicians in this field to implement or use the present invention. Various modifications to these embodiments will be obvious to professionals and technicians in this field, and the general principles defined herein can be implemented in other embodiments without departing from the spirit or scope of the present invention. Therefore, the present invention will not be limited to these embodiments shown in this article, but will comply with the widest range consistent with the principles and novel features disclosed herein.
以上对本发明的具体实施例进行了描述。需要理解的是,本发明并不局限于上述特定实施方式,本领域技术人员可以在权利要求的范围内做出各种变形或修改,这并不影响本发明的实质内容。The above describes the specific embodiments of the present invention. It should be understood that the present invention is not limited to the above specific embodiments, and those skilled in the art may make various modifications or variations within the scope of the claims, which do not affect the essence of the present invention.
Claims (10)
Priority Applications (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202410511147.0A CN118509570A (en) | 2021-06-17 | 2022-01-04 | Display device and electronic device with 3D camera module |
CN202410510957.4A CN118214843A (en) | 2021-06-17 | 2022-01-04 | Display device and electronic equipment with 3D camera module |
CN202410510616.7A CN118945307A (en) | 2021-06-17 | 2022-01-04 | Display device and electronic device with 3D camera module |
Applications Claiming Priority (8)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202110672553 | 2021-06-17 | ||
CN202110672557X | 2021-06-17 | ||
CN2021106725531 | 2021-06-17 | ||
CN202110672552 | 2021-06-17 | ||
CN2021106725527 | 2021-06-17 | ||
CN202110672557 | 2021-06-17 | ||
CN202110697290X | 2021-06-23 | ||
CN202110697290 | 2021-06-23 |
Related Child Applications (3)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202410510957.4A Division CN118214843A (en) | 2021-06-17 | 2022-01-04 | Display device and electronic equipment with 3D camera module |
CN202410510616.7A Division CN118945307A (en) | 2021-06-17 | 2022-01-04 | Display device and electronic device with 3D camera module |
CN202410511147.0A Division CN118509570A (en) | 2021-06-17 | 2022-01-04 | Display device and electronic device with 3D camera module |
Publications (2)
Publication Number | Publication Date |
---|---|
CN115499640A CN115499640A (en) | 2022-12-20 |
CN115499640B true CN115499640B (en) | 2024-05-07 |
Family
ID=84465329
Family Applications (4)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202210003173.3A Active CN115499640B (en) | 2021-06-17 | 2022-01-04 | Display device and electronic device with 3D camera module |
CN202410510616.7A Pending CN118945307A (en) | 2021-06-17 | 2022-01-04 | Display device and electronic device with 3D camera module |
CN202410510957.4A Pending CN118214843A (en) | 2021-06-17 | 2022-01-04 | Display device and electronic equipment with 3D camera module |
CN202410511147.0A Pending CN118509570A (en) | 2021-06-17 | 2022-01-04 | Display device and electronic device with 3D camera module |
Family Applications After (3)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202410510616.7A Pending CN118945307A (en) | 2021-06-17 | 2022-01-04 | Display device and electronic device with 3D camera module |
CN202410510957.4A Pending CN118214843A (en) | 2021-06-17 | 2022-01-04 | Display device and electronic equipment with 3D camera module |
CN202410511147.0A Pending CN118509570A (en) | 2021-06-17 | 2022-01-04 | Display device and electronic device with 3D camera module |
Country Status (1)
Country | Link |
---|---|
CN (4) | CN115499640B (en) |
Citations (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN106412557A (en) * | 2016-11-02 | 2017-02-15 | 深圳市魔眼科技有限公司 | 3D camera control method and 3D camera control device |
CN107483796A (en) * | 2017-09-26 | 2017-12-15 | 广东欧珀移动通信有限公司 | Camera components and terminals |
CN207321405U (en) * | 2017-11-01 | 2018-05-04 | 信丰世嘉科技有限公司 | A kind of camera lens module |
WO2018082481A1 (en) * | 2016-11-02 | 2018-05-11 | 深圳全息信息科技发展有限公司 | 3d camera module and 3d photographing device |
CN109756725A (en) * | 2017-08-25 | 2019-05-14 | 华为技术有限公司 | Structured light projector, 3D camera module and terminal equipment |
CN110062084A (en) * | 2019-05-30 | 2019-07-26 | Oppo广东移动通信有限公司 | A kind of terminal device |
CN110232863A (en) * | 2019-06-26 | 2019-09-13 | 深圳市光鉴科技有限公司 | Display device and electronic equipment with 3D camera module |
WO2020057208A1 (en) * | 2018-09-17 | 2020-03-26 | 深圳奥比中光科技有限公司 | Electronic device |
CN111399245A (en) * | 2020-05-13 | 2020-07-10 | 浙江水晶光电科技股份有限公司 | Laser emission module and 3D imaging device |
CN111556308A (en) * | 2020-06-15 | 2020-08-18 | 广东朗呈医疗器械科技有限公司 | Lens, three-dimensional imaging module and three-dimensional imaging equipment |
-
2022
- 2022-01-04 CN CN202210003173.3A patent/CN115499640B/en active Active
- 2022-01-04 CN CN202410510616.7A patent/CN118945307A/en active Pending
- 2022-01-04 CN CN202410510957.4A patent/CN118214843A/en active Pending
- 2022-01-04 CN CN202410511147.0A patent/CN118509570A/en active Pending
Patent Citations (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN106412557A (en) * | 2016-11-02 | 2017-02-15 | 深圳市魔眼科技有限公司 | 3D camera control method and 3D camera control device |
WO2018082481A1 (en) * | 2016-11-02 | 2018-05-11 | 深圳全息信息科技发展有限公司 | 3d camera module and 3d photographing device |
CN109756725A (en) * | 2017-08-25 | 2019-05-14 | 华为技术有限公司 | Structured light projector, 3D camera module and terminal equipment |
CN107483796A (en) * | 2017-09-26 | 2017-12-15 | 广东欧珀移动通信有限公司 | Camera components and terminals |
CN207321405U (en) * | 2017-11-01 | 2018-05-04 | 信丰世嘉科技有限公司 | A kind of camera lens module |
WO2020057208A1 (en) * | 2018-09-17 | 2020-03-26 | 深圳奥比中光科技有限公司 | Electronic device |
CN110062084A (en) * | 2019-05-30 | 2019-07-26 | Oppo广东移动通信有限公司 | A kind of terminal device |
CN110232863A (en) * | 2019-06-26 | 2019-09-13 | 深圳市光鉴科技有限公司 | Display device and electronic equipment with 3D camera module |
CN111399245A (en) * | 2020-05-13 | 2020-07-10 | 浙江水晶光电科技股份有限公司 | Laser emission module and 3D imaging device |
CN111556308A (en) * | 2020-06-15 | 2020-08-18 | 广东朗呈医疗器械科技有限公司 | Lens, three-dimensional imaging module and three-dimensional imaging equipment |
Also Published As
Publication number | Publication date |
---|---|
CN118214843A (en) | 2024-06-18 |
CN118509570A (en) | 2024-08-16 |
CN115499640A (en) | 2022-12-20 |
CN118945307A (en) | 2024-11-12 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
RU2536080C2 (en) | Efficient collimation of light with optical wedge | |
CN113840129B (en) | Display device and electronic device with 3D camera module | |
KR20140004102A (en) | Directional flat illuminators | |
JP2011118383A (en) | Flash, camera, and method of generating flash | |
KR20120007015U (en) | Polarizing beam splitter and projection apparatus | |
JP6316494B1 (en) | Surface light source device and display device | |
KR20080042213A (en) | Backlight Unit for Display Panel | |
CN110232863B (en) | Display device and electronic equipment with 3D camera module | |
CN115499640B (en) | Display device and electronic device with 3D camera module | |
KR100754683B1 (en) | Laser projector | |
CN215499367U (en) | Display device and electronic equipment with 3D module of making a video recording | |
CN215499365U (en) | Projection lens, light projector and depth camera module | |
CN115499639B (en) | Display device and electronic equipment with 3D camera module | |
CN115499638B (en) | Display device and electronic equipment with 3D camera module | |
CN221595500U (en) | Image projector for projecting images | |
CN215499048U (en) | Display device and electronic equipment with 3D module of making a video recording | |
CN215499368U (en) | Display device and electronic equipment with 3D module of making a video recording | |
CN215499371U (en) | Display device and electronic equipment with 3D module of making a video recording | |
CN215499369U (en) | Display device and electronic equipment with 3D module of making a video recording | |
TWI388890B (en) | Light guide plate and backlight module | |
CN215499366U (en) | Display device and electronic equipment with 3D module of making a video recording | |
CN215499370U (en) | Display device and electronic equipment with 3D module of making a video recording | |
CN215871663U (en) | Display device and electronic equipment with 3D module of making a video recording | |
CN215871662U (en) | Display device and electronic equipment with 3D module of making a video recording | |
CN216561292U (en) | Display device and electronic equipment with 3D module of making a video recording |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |