CN115499640A - Display device and electronic equipment with 3D module of making a video recording - Google Patents

Display device and electronic equipment with 3D module of making a video recording Download PDF

Info

Publication number
CN115499640A
CN115499640A CN202210003173.3A CN202210003173A CN115499640A CN 115499640 A CN115499640 A CN 115499640A CN 202210003173 A CN202210003173 A CN 202210003173A CN 115499640 A CN115499640 A CN 115499640A
Authority
CN
China
Prior art keywords
light
laser
lens
floodlight
module
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202210003173.3A
Other languages
Chinese (zh)
Other versions
CN115499640B (en
Inventor
张天舒
黄瑞彬
朱力
吕方璐
汪博
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Guangjian Technology Co Ltd
Original Assignee
Shenzhen Guangjian Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Guangjian Technology Co Ltd filed Critical Shenzhen Guangjian Technology Co Ltd
Priority to CN202410510957.4A priority Critical patent/CN118214843A/en
Publication of CN115499640A publication Critical patent/CN115499640A/en
Application granted granted Critical
Publication of CN115499640B publication Critical patent/CN115499640B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20Image signal generators
    • H04N13/261Image signal generators with monoscopic-to-stereoscopic image conversion
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03BAPPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B17/00Details of cameras or camera bodies; Accessories therefor
    • G03B17/02Bodies
    • G03B17/17Bodies with reflectors arranged in beam forming the photographic image, e.g. for reducing dimensions of camera
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03BAPPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B17/00Details of cameras or camera bodies; Accessories therefor
    • G03B17/48Details of cameras or camera bodies; Accessories therefor adapted for combination with other photographic or optical apparatus
    • G03B17/54Details of cameras or camera bodies; Accessories therefor adapted for combination with other photographic or optical apparatus with projector
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/30Transforming light or analogous information into electric information
    • H04N5/33Transforming infrared radiation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00Details of colour television systems
    • H04N9/12Picture reproducers
    • H04N9/31Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
    • H04N9/3141Constructional details thereof
    • H04N9/315Modulator illumination systems
    • H04N9/3161Modulator illumination systems using laser light sources

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)
  • Studio Devices (AREA)

Abstract

The invention provides a display device with a 3D camera module and electronic equipment, comprising a display substrate and the 3D camera module; the display substrate comprises a display area and a black matrix area surrounding the display area; the black matrix region includes a first light transmission region; the 3D camera module comprises a depth camera module; the depth camera module comprises a laser module and an imaging module; the laser module is positioned on the backlight side of the black matrix area; the imaging module is positioned on the backlight side of the display area; the laser module includes a structured light projector; a structured light projector for projecting structured light towards the lens assembly; the lens assembly is used for converging a plurality of laser beams and then transmitting the laser beams to the light incident surface of the lamp mirror; the lamp mirror is used for enabling the incident multiple beams of laser to irradiate the object to be shot through the first light transmission area; and the imaging module is used for receiving the laser which penetrates through the display area after being reflected by the object to be shot. The invention can ensure that the depth camera module with the projection lens is arranged in a narrow gap without being shielded by the FOV.

Description

Display device and electronic equipment with 3D module of making a video recording
Technical Field
The invention relates to the technical field of display, in particular to a display device with a 3D camera module and electronic equipment.
Background
With the development of the market, the requirements of consumers on the display effect of the display screen are more and more stringent, and the requirements are not only on diversified appearance designs, but also on the requirement that the screen ratio is higher and better. The full screen technology realizes the screen occupation ratio of more than 90 percent by the design of an ultra-narrow frame or even no frame.
Under the condition that the mobile phone with the comprehensive screen is unchanged, the maximization of the display area is realized, and the display effect is more vivid. Present structural design based on full-face screen, for devices such as the degree of depth camera module in the installation 3D camera module, set up the non-display area at display substrate's top, bang district promptly, but, still can influence display device's pleasing to the eye and the experience of full screen like this.
Disclosure of Invention
In view of this, the present invention provides a display device and an electronic apparatus having a 3D camera module, so as to solve the problem that the non-display area of the existing depth camera module affects the beauty and the overall screen experience of the display device.
In order to achieve the above object, in a first aspect, the present invention provides the following technical solutions:
the display device with the 3D camera module comprises a display substrate and the 3D camera module;
the display substrate comprises a display area and a black matrix area surrounding the display area; the black matrix region includes a first light-transmitting region;
the 3D camera module comprises a depth camera module; the depth camera module comprises a laser module and an imaging module; the laser module is positioned on the backlight side of the black matrix area; the imaging module is positioned on the backlight side of the display area;
the laser module comprises a structured light projector and a projection lens; the projection lens comprises a lens component and a lamp mirror; the structured light projector is used for projecting structured light to the lens assembly, and the structured light comprises a plurality of laser beams which are distributed randomly; the lens assembly is used for converging the multiple laser beams and then enabling the multiple laser beams to enter the light incident surface of the lamp mirror; the lamp mirror is used for enabling the incident multiple laser beams to irradiate an object to be shot through a first light transmission area;
the imaging module is used for receiving the laser penetrating the display area after the laser is reflected by the object to be shot, and obtaining a depth image of the surface of the object to be shot according to the received spot pattern of the laser reflected by the object to be shot.
Preferably, the first light-transmitting area is provided with a first infrared film layer;
and the lamp mirror is used for enabling the divergent incidence of the multiple beams of infrared laser to penetrate through the first infrared film layer and the first light transmission area to irradiate on an object to be shot.
Preferably, the lens assembly includes a first lens, a second lens and a lens barrel;
the first lens and the second lens are sequentially arranged on the light incident side of the lens barrel; the lamp mirror is arranged on the light-emitting side of the lens barrel;
the first lens is used for converging the laser beams and then projecting the laser beams to the second lens;
the second lens is used for converging the laser beams projected by the first lens again and projecting the laser beams to the light incident surface of the lamp mirror.
Preferably, a concave light inlet is arranged on the light inlet side of the lamp mirror;
the bottom surface of the light inlet is a light inlet surface; the light incident surface is a convex surface; the diaphragm of the projection lens is arranged on the convex surface;
the light incident surface is used for enabling the incident multiple beams of laser to be emitted in parallel or to be emitted approximately in parallel.
Preferably, the laser module comprises a beam splitting device located between the structured light projector and the projection lens;
the structured light projector adopts a laser array and is used for projecting dot matrix laser;
the light splitting device is positioned on the light emitting side of the laser array and used for splitting the lattice laser into a plurality of randomly distributed laser beams.
Preferably, the structured light projector comprises an edge-emitting laser, a collimating lens, a reflecting device and a light splitting device between the laser module and the projection lens;
the edge-emitting laser is used for projecting laser to the collimating lens;
the collimating lens is positioned on the light-emitting side of the edge-emitting laser, and is used for collimating the incident laser and emitting a collimated light beam;
the reflecting device is positioned on the light-emitting side of the collimating lens and used for projecting the collimated light beams to the light splitting device after being converted;
the light splitting device is positioned on the light emitting side of the reflecting device and used for splitting the collimated light beams projected by the reflecting device into a plurality of laser beams which are distributed randomly.
Preferably, the depth camera module comprises a driving circuit connected with the laser module and the imaging module;
the driving circuit is used for controlling the laser module and the imaging module to be simultaneously turned on or turned off, and controlling the output light power of the laser module by controlling the driving current of the laser module.
Preferably, the imaging module comprises a receiving lens and a photodetector array; the light detector array comprises a plurality of light detectors distributed in an array;
the receiving lens is used for converging the parallel laser beams incident at the same angle on the upper optical detector positioned on the focal plane of the receiving lens;
the optical detector is used for receiving the laser to generate a light spot pattern and obtaining a depth image of the surface of the object to be shot according to the light spot pattern.
Preferably, a floodlight projector is also included;
the floodlight projector is arranged on the backlight side of the black matrix area and used for projecting floodlight to the object to be shot through a second light-transmitting area arranged on the black matrix area according to a preset illuminance threshold value so as to illuminate;
or the floodlight projector is positioned on the backlight side of the display area and used for enabling the floodlight to penetrate through the display area and then irradiate the object to be shot to illuminate according to a preset illuminance threshold value.
The electronic equipment provided by the invention is characterized by comprising the display device.
In a second aspect, the present invention provides the following technical solutions:
the display device with the 3D camera module comprises a display substrate and the 3D camera module;
the display substrate comprises a display area and a black matrix area surrounding the display area; the black matrix region includes a first light-transmitting region;
the 3D camera module comprises a depth camera module; the depth camera module comprises a laser module and an imaging module; the laser module is positioned on the backlight side of the display area; the imaging module is positioned on the backlight side of the black matrix area;
the laser module comprises a structured light projector and a projection lens; the structured light projector is used for projecting structured light to the projection lens, and the structured light comprises a plurality of beams of laser light which are distributed randomly; the projection lens is used for enabling the incident multiple laser beams to penetrate through the display area to irradiate an object to be shot;
the imaging module comprises a lamp mirror, a receiving lens and a light detector array; the light detector array comprises a plurality of light detectors distributed in an array; the lamp mirror is used for receiving the laser reflected by the object to be shot through the first light-transmitting area, and after the laser is contracted to the narrowest position at the diaphragm, the laser is divergently projected to the receiving lens; the receiving lens is used for converging the parallel laser beams incident at the same angle on the optical detector positioned on the focal plane of the receiving lens; the optical detector is used for receiving the laser to generate a light spot pattern and obtaining a depth image of the surface of the object to be shot according to the light spot pattern.
Preferably, the first light-transmitting area is provided with a first infrared film layer;
the lamp mirror is used for receiving the laser reflected by the object to be shot sequentially through the first light transmission area and the first infrared film layer, and after the laser is contracted to the narrowest position at the diaphragm, the laser is divergently projected to the receiving lens.
Preferably, the receiving lens includes a first lens, a second lens, and a lens barrel;
the first lens and the second lens are sequentially arranged on the light-emitting side of the lens barrel; the lamp mirror is arranged on the light-emitting side of the lens barrel;
the second lens is used for converging the laser beams projected by the lamp mirror and projecting the laser beams to the light inlet surface of the first lens;
and the first lens is used for converging the laser beams projected by the second lens again and projecting the laser beams onto the photodetector array.
Preferably, a concave light outlet is arranged on the light outlet side of the lamp mirror;
the bottom surface of the light outlet is a light outlet surface; the light emitting surface is a convex surface; the diaphragm of the receiving lens is arranged on the convex surface;
the light emitting surface is used for enabling the incident multiple laser beams to be diverged and emitted.
Preferably, the laser module comprises a beam splitting device located between the structured light projector and the projection lens;
the structured light projector adopts a laser array and is used for projecting dot matrix laser;
the light splitting device is positioned on the light emitting side of the laser array and used for splitting the lattice laser into a plurality of randomly distributed laser beams.
Preferably, the structured light projector comprises an edge-emitting laser, a collimating lens, a reflecting device and a light splitting device between the laser module and the display substrate;
the edge-emitting laser is used for projecting laser to the collimating lens;
the collimating lens is positioned on the light-emitting side of the edge-emitting laser and is used for collimating the incident laser and emitting a collimated light beam;
the reflecting device is positioned on the light-emitting side of the collimating lens and used for reflecting the collimated light beam and projecting the collimated light beam to the light splitting device;
the light splitting device is positioned on the light emitting side of the reflecting device and used for splitting the collimated light beams projected by the reflecting device into a plurality of laser beams which are distributed randomly.
Preferably, the depth camera module comprises a driving circuit connected with the laser module and the imaging module;
the driving circuit is used for controlling the laser module and the imaging module to be simultaneously turned on or turned off and controlling the output light power of the laser module by controlling the driving current of the laser module.
Preferably, the depth camera module comprises a processing module; the 3D camera module further comprises a 2D imaging module;
the 2D imaging module is used for shooting a 2D image of the object to be shot;
and the processing module is used for obtaining a 3D image of the object to be shot according to the depth image and the 2D image.
Preferably, a floodlight projector is also included;
the floodlight projector is arranged on the backlight side of the black matrix area and used for projecting floodlight to the object to be shot through a second light-transmitting area arranged on the black matrix area according to a preset illuminance threshold value so as to illuminate;
or the floodlight projector is positioned on the backlight side of the display area and used for enabling the floodlight to penetrate through the display area and then irradiate the object to be shot to illuminate according to a preset illuminance threshold value.
The electronic equipment provided by the invention is characterized by comprising the display device.
In a third aspect, the present invention provides the following technical solutions:
the display device with the 3D camera module comprises a display substrate and the 3D camera module;
the display substrate comprises a display area and a black matrix area surrounding the display area; the black matrix region includes a light-transmitting region;
the 3D camera module comprises a depth camera module; the depth camera module comprises a laser module and an imaging module; the laser module is positioned on the backlight side of the black matrix area; the imaging module is positioned on the backlight side of the display area;
the laser module comprises a floodlight source and a projection lens; the projection lens comprises a lens component and a lamp mirror; the floodlight source is used for emitting floodlight; the lens assembly is used for converging the floodlight and then enabling the floodlight to be incident to the light incident surface of the lamp mirror; the lamp mirror is used for enabling the incident floodlight to irradiate the object to be shot through the light transmission area;
and the imaging module is used for receiving floodlight which penetrates through the display area after being reflected by the object to be shot and obtaining a depth image of the surface of the object to be shot according to the time delay or the phase difference of the floodlight.
Preferably, the light-transmitting area is provided with an infrared film layer;
the lamp mirror is used for enabling the diffused and incident infrared floodlight to penetrate through an infrared film layer and a light transmission area to irradiate on an object to be shot.
Preferably, the lens assembly includes a first lens, a second lens and a lens barrel;
the first lens and the second lens are sequentially arranged on the light incident side of the lens barrel; the lamp mirror is arranged on the light-emitting side of the lens barrel;
the first lens is used for projecting the floodlight after being converged to the second lens;
and the second lens is used for converging the floodlight projected by the first lens again and projecting the floodlight to the light incident surface of the lamp mirror.
Preferably, a concave light inlet is arranged on the light inlet side of the lamp mirror;
the bottom surface of the light inlet is a light inlet surface; the light incident surface is a convex surface; the diaphragm of the projection lens is arranged on the convex surface;
the light incident surface is used for enabling the incident floodlight to be emitted in parallel or to be emitted nearly in parallel.
Preferably, the floodlight source comprises a structured light projector, a light splitting device and a diffusion sheet;
the structured light projector adopts a laser array and is used for projecting dot matrix laser;
the light splitting device is positioned on the light emitting side of the laser array and is used for splitting the lattice laser into a plurality of beams of laser which are distributed discretely;
the diffusion sheet is arranged on the light emitting side of the light splitting device and used for diffusing the multiple laser beams and enabling the multiple laser beams to be subjected to floodlight emission to the projection lens.
Preferably, the floodlight source comprises an edge-emitting laser, a collimating lens, a reflecting device, a light splitting device and a diffusion sheet;
the edge-emitting laser is used for projecting laser to the collimating lens;
the collimating lens is positioned on the light-emitting side of the edge-emitting laser and is used for collimating the incident laser and emitting a collimated light beam;
the reflecting device is positioned on the light-emitting side of the collimating lens and used for reflecting the collimated light beam and projecting the collimated light beam to the light splitting device;
the light splitting device is positioned on the light outlet side of the reflecting device and is used for splitting the collimated light beam projected by the reflecting device into a plurality of laser beams which are distributed discretely;
the diffusion sheet is arranged on the light emitting side of the light splitting device and used for diffusing the multiple laser beams and enabling the multiple laser beams to be subjected to floodlight emission to the projection lens.
Preferably, the depth camera module comprises a driving circuit connected with the laser module and the imaging module;
the driving circuit is used for controlling the laser module and the imaging module to be simultaneously turned on or turned off, and controlling the output light power of the laser module by controlling the driving current of the laser module.
Preferably, the imaging module comprises a receiving lens and a photodetector array; the light detector array comprises a plurality of light detectors distributed in an array;
the receiving lens is used for converging the parallel floodlight incident at the same angle on a light detector positioned on a focal plane of the receiving lens;
and the light detector array is used for receiving the floodlight and obtaining a depth image of the surface of the object to be shot according to the time delay or the phase difference of the floodlight.
Preferably, the floodlight source adopts an LED light source.
In a fourth aspect, the present invention provides the following technical solutions:
the display device with the 3D camera module comprises a display substrate and the 3D camera module;
the display substrate comprises a display area and a black matrix area surrounding the display area; the black matrix region includes a light-transmitting region;
the 3D camera module comprises a depth camera module; the depth camera module comprises a laser module and an imaging module; the laser module is positioned on the backlight side of the display area; the imaging module is positioned on the backlight side of the black matrix area;
the laser module comprises a floodlight source and a projection lens; the floodlight source is used for emitting floodlight; the projection lens is used for irradiating the incident floodlight to the object to be shot by penetrating through the display area;
the imaging module comprises a lamp mirror, a receiving lens and a light detector array; the light detector array comprises a plurality of light detectors distributed in an array; the lamp mirror is used for receiving the floodlight reflected by the object to be shot through a light transmission area, and after the floodlight is contracted to the narrowest position at the diaphragm, the floodlight is divergently projected to the receiving lens; the receiving lens is used for converging parallel floodlight incident at the same angle on the light detector positioned on the focal plane of the receiving lens; and the light detector array is used for receiving floodlight which penetrates through the display area after being reflected by the object to be shot, and obtaining a depth image of the surface of the object to be shot according to the delay or phase difference of the floodlight.
Preferably, the light-transmitting area is provided with an infrared film layer;
the lamp mirror is used for receiving the floodlight reflected by the object to be shot sequentially through a light transmission area and an infrared film layer, and after the floodlight is contracted to the narrowest position at the diaphragm, the floodlight is divergently projected to the receiving lens.
Preferably, the receiving lens includes a first lens, a second lens, and a lens barrel;
the first lens and the second lens are sequentially arranged on the light-emitting side of the lens barrel; the lamp mirror is arranged on the light-emitting side of the lens barrel;
the second lens is used for converging the floodlight projected by the lamp mirror and projecting the floodlight to the light inlet surface of the first lens;
and the first lens is used for converging the floodlight projected by the second lens again and projecting the floodlight onto the light detector array.
Preferably, a concave light outlet is arranged on the light outlet side of the lamp mirror;
the bottom surface of the light outlet is a light outlet surface; the light emitting surface is a convex surface; the diaphragm of the receiving lens is arranged on the convex surface;
the light emitting surface is used for enabling the incident floodlight to be divergently emitted.
Preferably, the floodlight source comprises a structured light projector, a light splitting device and a diffusion sheet;
the structured light projector adopts a laser array and is used for projecting lattice laser;
the light splitting device is positioned on the light emitting side of the laser array and is used for splitting the lattice laser into a plurality of discretely distributed laser beams;
the diffusion sheet is arranged on the light emitting side of the light splitting device and used for diffusing the multiple laser beams and enabling the multiple laser beams to be subjected to floodlight emission to the projection lens.
Preferably, the floodlight source comprises an edge-emitting laser, a collimating lens, a reflecting device, a light splitting device and a diffusion sheet;
the edge-emitting laser is used for projecting laser to the collimating lens;
the collimating lens is positioned on the light-emitting side of the edge-emitting laser and is used for collimating the incident laser and emitting a collimated light beam;
the reflecting device is positioned on the light-emitting side of the collimating lens and used for reflecting the collimated light beam and projecting the collimated light beam to the light splitting device;
the light splitting device is positioned on the light outlet side of the reflecting device and is used for splitting the collimated light beam projected by the reflecting device into a plurality of laser beams which are distributed discretely;
the diffusion sheet is arranged on the light emitting side of the light splitting device and used for diffusing the multiple laser beams and enabling the multiple laser beams to be subjected to floodlight emission to the projection lens.
Preferably, the depth camera module comprises a driving circuit connected with the laser module and the imaging module;
the driving circuit is used for controlling the laser module and the imaging module to be simultaneously turned on or turned off and controlling the output light power of the laser module by controlling the driving current of the laser module.
Preferably, the depth camera module comprises a processing module; the 3D camera module further comprises a 2D imaging module;
the 2D imaging module is used for shooting a 2D image of the object to be shot;
and the processing module is used for obtaining a 3D image of the object to be shot according to the depth image and the 2D image.
Preferably, the optical path modulator is a liquid crystal modulator;
the liquid crystal modulator includes: the first substrate and the second substrate are oppositely arranged;
a liquid crystal layer disposed between the first substrate and the second substrate;
wherein the liquid crystal layer is in a transparent state or a diffused state by controlling the deflection of liquid crystals in the liquid crystal layer;
when the liquid crystal layer is in a transparent state, the structured light projector projects structured light through the light path modulator; and when the liquid crystal layer is in a diffusion state, the structured light projector projects floodlight through the light path modulator.
The electronic equipment provided by the invention is characterized by comprising the display device.
Compared with the prior art, the invention has the following beneficial effects:
the projection lens of the invention gathers the light to the lamp mirror through the lens assembly, and make the diaphragm locate at the light incoming surface of the lamp mirror, make the depth camera module with projection lens suitable for installing in narrow gap, but will not be sheltered from FOV, realize the application on narrow frame screen (the narrow screen of black matrix area) of the invention, and can also make the lamp mirror stick to the glass cover plate of the mobile phone, play a dustproof role;
according to the display device and the electronic equipment with the 3D camera module, the laser module is arranged on the backlight side of the black matrix area of the display substrate, and the imager module is arranged on the backlight side of the display area of the display substrate, so that a non-display area, namely a sea area, does not need to be arranged at the top of the display device to install the depth camera module, and the attractiveness and the overall screen experience of the display device cannot be influenced;
according to the invention, the infrared film layer is arranged in the light-transmitting area of the black matrix area, the infrared film layer can transmit infrared light so as not to influence the work of the depth camera module, but visible light cannot pass through the infrared film layer, so that the integrity of the black matrix area is ensured, and the attractiveness of a display screen is not influenced.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the provided drawings without creative efforts.
FIG. 1 is a schematic diagram of a display device according to an embodiment of the present invention;
FIG. 2 is a schematic diagram of a display device according to a variation of the present invention;
FIG. 3 is a schematic diagram of a set of laser module installations in accordance with an embodiment of the present invention;
FIG. 4 is a schematic view of another set of laser modules according to an embodiment of the present invention;
FIG. 5 is a schematic view of a set of installations of an imaging module in an embodiment of the invention;
FIG. 6 is a schematic diagram of a display device based on an EEL laser according to an embodiment of the present invention;
FIG. 7 is a schematic diagram of a VCSEL laser based display device in an embodiment of the present invention;
FIG. 8 is a schematic structural diagram of a display device according to a first embodiment of the present invention;
fig. 9 is a schematic structural diagram of a display device according to a second embodiment of the present invention;
FIG. 10 is a schematic structural diagram of a projection lens according to an embodiment of the invention;
FIG. 11 is a schematic view of another structure of a projection lens according to an embodiment of the present invention;
fig. 12 is a schematic mounting diagram of a 3D camera in an embodiment of the present invention;
FIG. 13 is a spot diagram of multiple lasers according to an embodiment of the present invention.
In the figure:
10 is a display substrate; 11 is a laser module; 1101 is a laser array; 1102 is an edge-emitting laser; 12 is an imaging module; 1201 is a second lamp mirror; 1202 is receiving lens; 1203 is a photodetector array; 13 is a light splitting device; 14 is a driving circuit; 15 is a processing module; 16 is a lens assembly; 1601 is a first lens; 1602 is a second lens; 1603 is a space ring; 1604 is a lens barrel; 1605 is a bulkhead; 17 is a reflecting device; 18 is a collimating lens; 19 is a lamp mirror; 20 is a black matrix region; 21 is a diffusion sheet; 30 is a display area; 40 is an inner screen; 50 is a floodlight projector; and 60 is an RGB camera.
Detailed Description
The present invention will be described in detail with reference to specific examples. The following examples will assist those skilled in the art in further understanding the invention, but are not intended to limit the invention in any way. It should be noted that variations and modifications can be made by persons skilled in the art without departing from the spirit of the invention. All falling within the scope of the present invention.
It will be understood that when an element is referred to as being "secured to" or "disposed on" another element, it can be directly on the other element or be indirectly on the other element. When an element is referred to as being "connected to" another element, it can be directly connected to the other element or be indirectly connected to the other element. The connection may be for fixation or for circuit connection.
It is to be understood that the terms "length," "width," "upper," "lower," "front," "rear," "left," "right," "vertical," "horizontal," "top," "bottom," "inner," "outer," and the like are used in an orientation or positional relationship indicated in the drawings for convenience in describing the embodiments of the present invention and to simplify the description, and are not intended to indicate or imply that the referenced device or element must have a particular orientation, be constructed in a particular orientation, and be in any way limiting of the present invention.
Furthermore, the terms "first", "second" and "first" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature. In the description of the embodiments of the present invention, "a plurality" means two or more unless specifically limited otherwise.
As described in the background art, in the existing structural design based on a full-face screen, in order to install devices such as a depth camera module in a 3D camera module, a non-display area, i.e., a bang area, is disposed at the top of a display substrate, but this may affect the beauty and the overall screen experience of the display device.
The inventor has found that, in the existing depth camera modules, a Vertical Cavity Surface Emitting Laser (VCSEL) is used as a light source, but since the output optical power of the VCSEL Laser is low, when the transmittance of the display substrate is low, the optical power of the Laser passing through the display panel is low, and an effective depth image cannot be obtained, it is necessary to provide a bang area, which is a non-display area, on the top of the display substrate, and to dig a hole in the non-display area to install the VCSEL Laser.
In order to make the objects, features and advantages of the present invention comprehensible, embodiments of the present invention are described in detail below with reference to the accompanying drawings. All other embodiments, which can be obtained by a person skilled in the art without making any creative effort based on the embodiments in the present invention, belong to the protection scope of the present invention.
An embodiment of the present invention provides a display device with a 3D camera module, as shown in fig. 1, including a display substrate 10 and a 3D camera module, where the 3D camera module includes a depth camera module located on a backlight side of the display substrate 10. It should be noted that the depth camera module in the embodiment of the present invention is an infrared camera module, and the laser module employs an infrared laser that emits infrared laser. The laser module employs a vertical cavity surface emitting laser array, an edge emitting laser, and a semiconductor laser.
The light-emitting side of the display substrate is a side capable of displaying images, and the backlight side is a side incapable of displaying images. That is, the depth camera module in the embodiment of the invention may be located below the display substrate 10, i.e., may be disposed below the screen, without damaging the structure of the display substrate 10, for example, without digging a hole in the non-display area on the top of the display substrate 10 to dispose the depth camera module. The display substrate comprises a display area and a black matrix area surrounding the display area; the black matrix region includes a light-transmitting region. In some embodiments, the black matrix region further includes a first light-transmitting region and a second light-transmitting region. The light-transmitting area is a circular area with the diameter smaller than 1 millimeter.
In an embodiment of the present invention, the depth camera module comprises a floodlight projector 50, a laser module 11 and an imaging module 12. The laser module 11 and the imaging module 12 are both located on the backlight side of the display substrate 10, and the light outlet of the laser module 11 is disposed toward the display substrate 10, so that laser can irradiate an object to be photographed on the light outlet side of the display substrate 10 through the first light-transmitting area, and the light inlet of the imaging module 12 is disposed toward the display substrate 10, so that laser reflected by the object to be photographed penetrates through the display area and then enters the imaging module 12.
Wherein the laser module 11 comprises a structured light projector and a projection lens; the projection lens comprises a lens assembly 16 and a lamp mirror 19; the structured light projector for projecting structured light towards the lens assembly 16, the structured light comprising a plurality of randomly distributed laser beams; the lens assembly 16 is configured to converge the multiple laser beams and then irradiate the multiple laser beams to the light incident surface of the lamp mirror; the lamp mirror 19 is used for enabling the incident multiple laser beams to be emitted in parallel or approximately in parallel so as to enable the laser beams to irradiate an object to be shot through a first light transmission area;
in some embodiments, the depth camera module includes a laser module 11 and an imaging module 12. The laser module 11 and the imaging module 12 are both located on the backlight side of the display substrate 10, and the light outlet of the laser module 11 is disposed toward the display substrate 10, so that laser can irradiate an object to be photographed on the light outlet side of the display substrate 10 through the first light-transmitting area, and the light inlet of the imaging module 12 is disposed toward the display substrate 10, so that laser reflected by the object to be photographed penetrates through the display area and then enters the imaging module 12.
Wherein the laser module 11 comprises a floodlight source and a projection lens; the projection lens comprises a lens assembly 16 and a lamp mirror 19; the floodlight source is used for emitting floodlight; the lens assembly 16 is used for converging the floodlight and then enabling the floodlight to be incident to the light incident surface of the lamp mirror; and the lamp mirror 19 is used for enabling the incident floodlight to irradiate the object to be shot through the light transmission area.
The imaging module 12 is configured to receive the laser that penetrates the display area after being reflected by the object to be photographed, and obtain a depth image of the surface of the object to be photographed according to a spot pattern of the received laser that is reflected by the object to be photographed. The depth image comprises depth information of different areas of the surface of the object to be photographed.
In some embodiments, the imaging module 12 includes a second lamp mirror 1201, a receiving lens 1202, and a photo detector array 1203; the photo-detector array 1203 comprises a plurality of photo-detectors distributed in an array; the light mirror 1201 is used for receiving the laser reflected by the object to be shot through the first light transmission area, and after the laser is contracted to the narrowest position at the diaphragm, the laser is divergently projected to the receiving lens; the receiving lens 1202 is configured to converge parallel laser beams incident at the same angle on a light detector located in a focal plane of the receiving lens; the optical detector is used for receiving the laser to generate a light spot pattern and obtaining a depth image of the surface of the object to be shot according to the light spot pattern. The depth image comprises depth information of different areas of the surface of the object to be photographed.
And the floodlight projector 50 is configured to project floodlight to the object to be photographed through the second light transmission area according to a preset light intensity threshold value, so as to perform illumination. The preset illuminance threshold is any value from 10lux to 50lux, and preferably the preset illuminance threshold is 10lux.
In the modified example of the present invention, the floodlight projector 50 may be further disposed on a backlight side of the display area, and configured to irradiate the floodlight onto the object to be photographed after penetrating through the display area according to a preset light illumination threshold value, so as to illuminate the object.
Because the laser module 11 is arranged at the backlight side of the black matrix area, and the imaging module 12 is arranged at the backlight side of the display area, a non-display area is not required to be arranged at the top of the display device to install the depth camera module, and the attractiveness and the comprehensive screen experience of the display device cannot be influenced.
Moreover, since the laser module 11 and the imaging module 12 are both disposed on the backlight side of the display substrate 10, the arrangement and combination of the laser module 11 and the imaging module 12 are more possible, and the distance between the laser module 11 and the imaging module 12 can be increased on the premise of not affecting the appearance, so as to improve the shooting accuracy of the depth camera module, as shown in fig. 2a, the laser module 11 and the imaging module 12 can be further disposed in the black matrix areas on both sides, respectively. As shown in fig. 2b, it is also possible to arrange the laser module 11 in the display area on either of the two sides and the imaging module 12 in the black matrix area on either of the two sides. As shown in fig. 2c, the laser module 11 and the imaging module 12 may also be disposed in black matrix regions on both sides, respectively. As shown in fig. 2d, the laser module 11 may be disposed in any one of the two sides of the display region, and the imaging module 12 may be disposed in the black matrix region in any one of the two sides.
Optionally, the light-transmitting region is provided with an infrared film layer; in some embodiments, the first light-transmitting area is provided with a first infrared film layer, and the second light-transmitting area is provided with a second infrared film layer;
the lamp mirror 19 is used for making the diffused incident infrared floodlight irradiate on an object to be shot through an infrared film layer and a light transmission area.
In some embodiments, the lamp mirror 19 is configured to enable the divergent incident laser beams to exit in parallel or to exit in a near-parallel manner, so that the laser beams pass through the first infrared film layer and the first light-transmitting area to irradiate on the object to be photographed;
in some embodiments, the lamp mirror 19 is configured to receive the laser reflected by the object to be photographed sequentially through the first light-transmitting region and the first infrared film layer, and after the laser is shrunk to the narrowest point at the diaphragm, the laser is divergently projected to the receiving lens;
and the floodlight projector is used for projecting floodlight to the object to be shot through the second infrared film layer and the second light transmission area when the illuminance is lower than a preset illuminance threshold value so as to illuminate.
Optionally, as shown in fig. 3 and 8, the laser module includes a light splitting device located between the structured light projector and the projection lens;
the structured light projector adopts a laser array 1101 for projecting dot matrix laser;
the light splitting device 13 is located on the light emitting side of the laser array 1101, and is configured to split the lattice laser emitted by the structured light projector into a plurality of randomly distributed laser beams.
In some embodiments, the flood light source includes a structured light projector, a light splitter 13, and a diffuser 21;
the structured light projector adopts a laser array 1101 for projecting dot matrix laser;
the light splitting device 13 is located on the light emitting side of the laser array 1101, and is configured to split the lattice laser emitted by the structured light projector into a plurality of discretely distributed laser beams.
The diffusion sheet 21 is arranged on the light outgoing side of the light splitting device, and is used for diffusing the multiple laser beams and enabling the multiple laser beams to be subjected to floodlight outgoing to the projection lens.
That is, in the embodiment of the present invention, the display substrate 10 may be a glass substrate, and the inner screen 40 of the display device is located inside the display substrate 10.
In the embodiment of the present invention, as shown in fig. 6 and 7, the depth camera module includes a driving circuit 14 connected to the laser module 11 and the imaging module 12. The driving circuit 14 is configured to control the laser module 11 and the imaging module 12 to be turned on or off simultaneously, and control the output optical power of the laser module 11 by controlling the driving current of the laser module 11, so as to control the optical power of the laser passing through the first light-transmitting area by controlling the output optical power of the laser module 11.
Further, the depth camera module further comprises a processing module 15, and the 3D camera module further comprises a 2D imaging module. The 2D imaging module is used for shooting a 2D image of an object to be shot. The processing module 15 is used for obtaining a 3D image of the object to be shot according to the depth image shot by the 3D camera module and the 2D image shot by the 2D imaging module.
It should be noted that, in order to set the depth camera module on the backlight side of the display substrate 10, the driving circuit 14 may increase the driving current, reduce the pulse width of the laser module 11, and greatly increase the optical power of the laser module 11, while the total pulse energy of the laser module 11 is kept unchanged, so as to meet the optical power limitation of human eye safety.
In one embodiment of the present invention, as shown in fig. 4 and 9, the structured light projector includes an edge-emitting laser 1102 located between the laser module and the projection lens, a collimating lens 18, a reflecting device 17, and a light splitting device 13; a collimating lens 18 and a reflecting device 17 are arranged between the light splitting device 13 and the laser module 11;
the edge-emitting laser 1102 is configured to project laser light to the collimator lens;
the collimating lens 18 is located on the light exit side of the edge-emitting laser 1102, and is configured to collimate the incident laser light and emit a collimated light beam;
the reflecting device 17 is located on the light-emitting side of the collimating lens, and is configured to fold the collimated light beam and project the collimated light beam to the light splitting device 13;
the light splitting device 13 is located on the light-emitting side of the reflecting device, and is used for splitting the collimated light beam projected by the reflecting device 17 into a plurality of laser beams which are randomly distributed.
Specifically, the light splitting device 13 divides the laser light emitted by the edge-emitting laser 1102 into a plurality of laser light which are randomly distributed, when the laser light is irradiated on a plane, a light spot image as shown in fig. 13 is formed, when the plurality of laser light is irradiated on an object to be photographed, the light spot pattern is deformed or displaced, after the first imaging module photographs the light spot pattern on the surface of the object to be photographed, a depth image of the surface of the object to be photographed is obtained according to the deformation or displacement of the light spot pattern, that is, the depth information of the surface of the object to be photographed is obtained. The processing module 15 can obtain a 3D image of the object to be photographed according to the depth image and the 2D image.
The imaging module 12 is a first imaging module, and optionally, the first imaging module is an infrared camera. The first imaging module 12 obtains a depth image of the surface of the object to be photographed according to the received spot pattern of the laser light reflected by the object to be photographed.
In some embodiments, the floodlight source includes a bit edge emitting laser 1102, a collimating lens 18, a reflecting device 17, a light splitting device 13, and a diffusion sheet 21;
the edge-emitting laser 1102 is configured to project laser light to the collimator lens;
the collimating lens 18 is located on the light exit side of the edge-emitting laser 1102, and is configured to collimate the incident laser light and emit a collimated light beam;
the reflecting device 17 is located on the light-emitting side of the collimating lens, and is configured to fold the collimated light beam and project the collimated light beam to the light splitting device 13;
the light splitting device 13 is positioned on the light emitting side of the reflecting device and is used for splitting the collimated light beam projected by the reflecting device 17 into a plurality of discretely distributed laser beams;
the diffusion sheet 21 is disposed on the light exit side of the light splitter, and is configured to diffuse the multiple laser beams and enable the multiple laser beams to be emitted to the projection lens in a floodlight manner.
In the embodiment of the present invention, the reflecting device 17 may adopt a mirror or a triangular prism. The reflecting surface of the triangular prism can be plated with a layer of reflecting film.
In an embodiment of the present invention, as shown in fig. 5, the imaging module 12 includes a receiving lens 1202 and a photodetector array 1201; the photodetector array 1201 comprises a plurality of photodetectors distributed in an array;
the receiving lens 1202 is configured to receive the laser that penetrates through the display area after being reflected by the object to be photographed, and converge parallel laser that is incident at the same angle on the upper optical detector located on the focal plane of the receiving lens;
the optical detector is used for receiving the laser to generate a light spot pattern and obtaining a depth image of the surface of the object to be shot according to the light spot pattern.
In the embodiment of the invention, the light detector can adopt a CMOS or CCD sensor.
In some embodiments, the imaging module 12 includes a second lamp 1201, a receiving lens 1202, and a photo detector array 1203; the photo detector array 1203 comprises a plurality of photo detectors distributed in an array;
the second light mirror 1201 is configured to receive the laser reflected by the object to be photographed through another light-transmitting area, and after the laser is shrunk to the narrowest point at the diaphragm, the laser is divergently projected to the receiving lens.
In some embodiments, the imaging module 12 includes a receiving lens 1202 and a photodetector array 1201; the photodetector array 1201 comprises a plurality of photodetectors distributed in an array;
the receiving lens 1202 is used for receiving floodlight which penetrates through the display area after being reflected by the object to be shot and converging the parallel floodlight which is incident at the same angle on a light detector positioned on a focal plane of the receiving lens;
and the light detector array is used for receiving the floodlight and obtaining a depth image of the surface of the object to be shot according to the time delay or the phase difference of the floodlight.
Fig. 10 is a schematic structural diagram of a projection lens according to an embodiment of the present invention, and fig. 11 is another schematic structural diagram of a projection lens according to an embodiment of the present invention, as shown in fig. 10 and fig. 11, the projection lens includes a lens assembly 16 and a lamp mirror 19; the structured light projector is used for projecting structured light to the lens assembly, and the structured light comprises a plurality of laser beams which are distributed randomly; the lens assembly 16 is configured to converge the multiple laser beams and then enter the light incident surface of the lamp mirror 19; the lamp mirror 19 is used for enabling the incident multiple laser beams to be emitted in parallel or approximately in parallel so as to enable the laser beams to irradiate an object to be shot through a first light transmission area;
in the embodiment of the present invention, the angle between the two laser beams is smaller than a preset angle threshold, and the angle threshold may be set to be 5 °. The multiple laser beams are parallel, namely multiple laser beams form multiple groups of laser beams, and the multiple laser beams in each group of laser beams are parallel to each other.
In the embodiment of the present invention, the lens assembly 16 includes a first lens 1601, a second lens 1602, and a lens barrel 1604; the first lens 1601 and the second lens 1602 are sequentially arranged on the light incident side of the lens barrel; the lamp mirror 19 is arranged on the light-emitting side of the lens barrel; the first lens 1601 is configured to converge the plurality of laser beams and project the converged laser beams to the second lens; the second lens 1602 is configured to converge the multiple laser beams projected by the first lens again and project the multiple laser beams to the light incident surface of the lamp mirror. The lens barrel 1604 is used for integrally assembling and fixing the first lens 1601, the second lens 1602 and the lamp mirror 19. A concave light inlet is arranged on the light inlet side of the lamp mirror 19; the bottom surface of the light inlet is a light inlet surface; the light incident surface is a convex surface; and the diaphragm of the projection lens is arranged on the convex surface. The light incident surface is used for enabling the incident multiple laser beams to be emitted in parallel or approximately emitted in parallel so as to form an image at a specified distance from infinity or a distance.
In some embodiments, the lamp mirror 19 is configured to make the incident multiple laser beams divergently projected to the receiving lens after being narrowed to the narrowest at the stop; the receiving lens 16 is used for converging the parallel laser beams incident at the same angle on a light detector positioned on a focal plane of the receiving lens;
the receiving lens 16 includes a first lens 1601, a second lens 1602, and a lens barrel 1604; a concave light outlet is arranged on the light outlet side of the lamp mirror 19; the bottom surface of the light outlet is a light outlet surface; the light emitting surface is a convex surface; the stop of the lamp mirror 19 is arranged on the convex surface. The light emitting surface is used for enabling the incident multiple laser beams of the multiple laser beams to be divergently emitted. The second lens 1602 and the first lens 1601 are sequentially arranged on the light emitting side of the lens barrel; the lamp mirror 19 is arranged on the light incident side of the lens barrel; the second lens 1602 is configured to converge the laser beams projected by the lamp mirror 19 and project the laser beams to the light incident surface of the first lens 1601; the first lens 1601 is configured to converge the plurality of laser beams projected by the second lens 1602 again and project the converged laser beams onto the photodetector array. The lens barrel 1604 is used for integrally assembling and fixing the first lens 1601, the second lens 1602 and the lamp mirror 19.
In the embodiment of the invention, because the depth camera module is arranged under the narrow gap for emitting light, the position of the diaphragm, namely the position of the narrowest light beam, is the position in the middle of the height of the narrow gap, the lens can reach the largest angle of field under the condition that the upper side and the lower side can not shield the light.
When the projection lens is located on the backlight side of the display substrate 10, a lamp mirror 19 needs to be filled between the lens assembly 16 and the display substrate 10. Since the area available for light transmission is smaller in size, the convergence point of the light rays of the projection lens, that is, the diaphragm, needs to be placed at the position of the lamp mirror 19, and then the diameter size of the projection lens needs to be larger, so that the emergent light rays with a certain angle can be converged at a specified position after being transmitted for a certain distance. The lower surface of the lamp lens 19 is made into a convex surface, and the diaphragm of the projection lens is placed on the convex surface, so that the lamp lens 19 can bear part of focal power, which is equivalent to a convex lens, and meanwhile, the angle of emergent light rays from the lens below the lamp lens 19 is reduced, the effective caliber of the projection lens can be reduced, and further, the size of the whole system is reduced.
In the embodiment of the present invention, the upper surface of the lamp mirror 19 is tightly attached to the lower surface of the display substrate 10, the boss structure on the upper portion of the lamp mirror 19 is tightly attached to the lower surface of the inner screen 40, and the lower edge of the lamp mirror 19 is tightly attached to the projection lens barrel, which is convenient for assembly and testing.
A spacer is disposed between the first lens 1601 and the second lens 1602, and the spacer 1603 is used to fix a relative position between the first lens 2 and the second lens 4.
In the embodiment of the invention, a boss structure is arranged on the light emergent side of the lamp mirror; the end face of the boss structure is a light emergent face. The first lens 1601 and the second lens 1602 are convex lenses. The light incident side surface of the lamp mirror 19 is attached to the second lens 1602. The lamp lens 19 is made of optical plastic materials, so that the function of bearing focal power can be realized, and the dustproof function between the projection lens and the display substrate 10 can also be realized.
In the modified example of the present invention, the lens barrel 1604 is provided with a barrier 1605; the second lens 1602 is disposed on one side of the bezel 1605, and the lens barrel 1604 is disposed on the other side of the bezel 1605.
In the embodiment of the present invention, the light incident from the first lens 1601 may be projected by any light projector, such as a structured light projector, an edge emitting laser, to project a pattern. The structured light emitted by the light projector can be a plurality of parallel telecentric beams or beams with the chief rays having certain angles.
In the embodiment of the present invention, the light splitting device 13 may be a waveguide device, a nano-photonic chip, a diffraction grating (DOE), a code structure photomask, or the like, but the present invention is not limited thereto.
Fig. 12 is a schematic installation diagram of a 3D camera in an embodiment of the present invention, and as shown in fig. 12, when implementing the display device with a 3D camera module provided by the present invention, the floodlight projector 50 and the laser module 11 are installed on the backlight side of the display substrate 10, and the imaging module 12 and the RGB camera 60 are installed on the backlight side of the inner screen.
The embodiment of the invention also provides electronic equipment, which comprises the display device provided by any one of the embodiments, and the electronic equipment can be a mobile phone, a tablet computer, a digital camera and the like. According to the electronic equipment with the 3D camera module, the depth camera module is not required to be installed in the non-display area arranged at the top of the display device, the appearance is more attractive, and the full-screen experience is more favorably realized.
In the embodiment of the invention, light rays are converged on the lamp lens through the first lens and the second lens of the lens component, and the diaphragm is positioned on the light incident surface of the lamp lens, so that the depth camera module with the projection lens is suitable for being installed in a narrow gap without being shielded by an FOV (field of view), thus the application of the invention on a narrow-frame screen (a narrow screen with a black matrix area) is realized, and the lamp lens can be attached to a mobile phone glass cover plate to play a role in dust prevention; according to the display device and the electronic equipment with the 3D camera module, the laser module is arranged on the backlight side of the black matrix area of the display substrate, and the imager module is arranged on the backlight side of the display area of the display substrate, so that a non-display area, namely a sea area, does not need to be arranged at the top of the display device to install the depth camera module, and the attractiveness and the overall screen experience of the display device cannot be influenced; according to the embodiment of the invention, the infrared film layer is arranged in the light-transmitting area of the black matrix area, the infrared film layer can transmit infrared light so as not to influence the work of the depth camera module, but visible light cannot pass through the infrared film layer, so that the integrity of the black matrix area is ensured, and the attractiveness of a display screen is not influenced.
The embodiments in the present description are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other. The previous description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the invention. Thus, the present invention is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
The embodiments in the present description are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other. The previous description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the invention. Thus, the present invention is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
The foregoing description has described specific embodiments of the present invention. It is to be understood that the present invention is not limited to the specific embodiments described above, and that various changes and modifications may be made by one skilled in the art within the scope of the appended claims without departing from the spirit of the invention.

Claims (10)

1. A display device with a 3D camera module is characterized by comprising a display substrate and the 3D camera module;
the display substrate comprises a display area and a black matrix area surrounding the display area; the black matrix region includes a first light-transmitting region;
the 3D camera module comprises a depth camera module; the depth camera module comprises a laser module and an imaging module; the laser module is positioned on the backlight side of the black matrix area; the imaging module is positioned on the backlight side of the display area;
the laser module comprises a structured light projector and a projection lens; the projection lens comprises a lens component and a lamp mirror; the structured light projector is used for projecting structured light to the lens assembly, and the structured light comprises a plurality of laser beams which are distributed randomly; the lens assembly is used for converging the multiple laser beams and then enabling the multiple laser beams to enter the light incident surface of the lamp mirror; the lamp mirror is used for enabling the incident multiple laser beams to irradiate an object to be shot through a first light transmission area;
the imaging module is used for receiving the laser which penetrates through the display area after being reflected by the object to be shot, and obtaining a depth image of the surface of the object to be shot according to the received spot pattern of the laser reflected by the object to be shot.
2. The display device according to claim 1, wherein the first light-transmitting region is provided with a first infrared film layer;
and the lamp mirror is used for enabling the plurality of beams of infrared laser to be divergently incident to penetrate through the first infrared film layer and the first light transmission area to irradiate on an object to be shot.
3. The display device according to claim 1, wherein the lens assembly includes a first lens, a second lens, and a lens barrel;
the first lens and the second lens are sequentially arranged on the light incident side of the lens barrel; the lamp mirror is arranged on the light-emitting side of the lens barrel;
the first lens is used for converging the laser beams and then projecting the laser beams to the second lens;
the second lens is used for converging the laser beams projected by the first lens again and then projecting the laser beams to the light inlet surface of the lamp mirror.
4. A display device with a 3D camera module is characterized by comprising a display substrate and the 3D camera module;
the display substrate comprises a display area and a black matrix area surrounding the display area; the black matrix region includes a first light transmission region;
the 3D camera module comprises a depth camera module; the depth camera module comprises a laser module and an imaging module; the laser module is positioned on the backlight side of the display area; the imaging module is positioned on the backlight side of the black matrix area;
the laser module comprises a structured light projector and a projection lens; the structured light projector is used for projecting structured light to the projection lens, and the structured light comprises a plurality of beams of laser light which are distributed randomly; the projection lens is used for enabling the incident multiple laser beams to penetrate through the display area to irradiate an object to be shot;
the imaging module comprises a lamp mirror, a receiving lens and a light detector array; the light detector array comprises a plurality of light detectors distributed in an array; the lamp mirror is used for receiving the laser reflected by the object to be shot through the first light transmission area, and after the laser is contracted to the narrowest position at the diaphragm, the laser is divergently projected to the receiving lens; the receiving lens is used for converging the parallel laser beams incident at the same angle on the optical detector positioned on the focal plane of the receiving lens; the optical detector is used for receiving the laser to generate a light spot pattern and obtaining a depth image of the surface of the object to be shot according to the light spot pattern.
5. The display device according to claim 4, wherein the first light-transmitting region is provided with a first infrared film layer;
the lamp mirror is used for receiving the laser reflected by the object to be shot sequentially through the first light transmission area and the first infrared film layer, and after the laser is shrunk to the narrowest position at the diaphragm, the laser is divergently projected to the receiving lens.
6. A display device with a 3D camera module is characterized by comprising a display substrate and the 3D camera module;
the display substrate comprises a display area and a black matrix area surrounding the display area; the black matrix region includes a light-transmitting region;
the 3D camera module comprises a depth camera module; the depth camera module comprises a laser module and an imaging module; the laser module is positioned on the backlight side of the black matrix area; the imaging module is positioned on the backlight side of the display area;
the laser module comprises a floodlight source and a projection lens; the projection lens comprises a lens component and a lamp mirror; the floodlight source is used for emitting floodlight; the lens assembly is used for converging the floodlight and then enabling the floodlight to be incident to the light incident surface of the light mirror; the lamp mirror is used for enabling the incident floodlight to irradiate on an object to be shot through a light transmission area;
and the imaging module is used for receiving floodlight which penetrates through the display area after being reflected by the object to be shot and obtaining a depth image of the surface of the object to be shot according to the time delay or the phase difference of the floodlight.
7. The display device according to claim 6, wherein the light-transmitting region is provided with an infrared film layer;
the lamp mirror is used for enabling the diffused and incident infrared floodlight to penetrate through an infrared film layer and a light transmission area to irradiate on an object to be shot.
8. A display device with a 3D camera module is characterized by comprising a display substrate and the 3D camera module;
the display substrate comprises a display area and a black matrix area surrounding the display area; the black matrix region includes a light transmitting region;
the 3D camera module comprises a depth camera module; the depth camera module comprises a laser module and an imaging module; the laser module is positioned on the backlight side of the display area; the imaging module is positioned on the backlight side of the black matrix area;
the laser module comprises a floodlight source and a projection lens; the floodlight source is used for emitting floodlight; the projection lens is used for irradiating the incident floodlight to the object to be shot through the display area;
the imaging module comprises a lamp mirror, a receiving lens and a light detector array; the light detector array comprises a plurality of light detectors distributed in an array; the lamp mirror is used for receiving the floodlight reflected by the object to be shot through a light transmission area, and after the floodlight is contracted to be narrowest at the diaphragm, the floodlight is divergently projected to the receiving lens; the receiving lens is used for converging the parallel floodlight incident at the same angle on a light detector positioned on a focal plane of the receiving lens; and the light detector array is used for obtaining the depth image of the surface of the object to be shot according to the floodlight delay or phase difference.
9. The display device according to claim 8, wherein the light-transmitting region is provided with an infrared film layer;
the lamp mirror is used for receiving the floodlight reflected by the object to be shot sequentially through a light transmission area and an infrared film layer, and after the floodlight is contracted to the narrowest position at the diaphragm, the floodlight is divergently projected to the receiving lens.
10. An electronic device comprising the display device according to any one of claims 1 to 9.
CN202210003173.3A 2021-06-17 2022-01-04 Display device and electronic equipment with 3D camera module Active CN115499640B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202410510957.4A CN118214843A (en) 2021-06-17 2022-01-04 Display device and electronic equipment with 3D camera module

Applications Claiming Priority (8)

Application Number Priority Date Filing Date Title
CN2021106725531 2021-06-17
CN202110672552 2021-06-17
CN202110672557X 2021-06-17
CN2021106725527 2021-06-17
CN202110672557 2021-06-17
CN202110672553 2021-06-17
CN202110697290X 2021-06-23
CN202110697290 2021-06-23

Related Child Applications (1)

Application Number Title Priority Date Filing Date
CN202410510957.4A Division CN118214843A (en) 2021-06-17 2022-01-04 Display device and electronic equipment with 3D camera module

Publications (2)

Publication Number Publication Date
CN115499640A true CN115499640A (en) 2022-12-20
CN115499640B CN115499640B (en) 2024-05-07

Family

ID=84465329

Family Applications (2)

Application Number Title Priority Date Filing Date
CN202410510957.4A Pending CN118214843A (en) 2021-06-17 2022-01-04 Display device and electronic equipment with 3D camera module
CN202210003173.3A Active CN115499640B (en) 2021-06-17 2022-01-04 Display device and electronic equipment with 3D camera module

Family Applications Before (1)

Application Number Title Priority Date Filing Date
CN202410510957.4A Pending CN118214843A (en) 2021-06-17 2022-01-04 Display device and electronic equipment with 3D camera module

Country Status (1)

Country Link
CN (2) CN118214843A (en)

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106412557A (en) * 2016-11-02 2017-02-15 深圳市魔眼科技有限公司 3D camera control method and 3D camera control device
CN107483796A (en) * 2017-09-26 2017-12-15 广东欧珀移动通信有限公司 CCD camera assembly and terminal
CN207321405U (en) * 2017-11-01 2018-05-04 信丰世嘉科技有限公司 A kind of camera lens module
WO2018082481A1 (en) * 2016-11-02 2018-05-11 深圳全息信息科技发展有限公司 3d camera module and 3d photographing device
CN109756725A (en) * 2017-08-25 2019-05-14 华为技术有限公司 Structured light projection device, three-dimensional camera mould group and terminal device
CN110062084A (en) * 2019-05-30 2019-07-26 Oppo广东移动通信有限公司 A kind of terminal device
CN110232863A (en) * 2019-06-26 2019-09-13 深圳市光鉴科技有限公司 Display device and electronic equipment with 3D camera module
WO2020057208A1 (en) * 2018-09-17 2020-03-26 深圳奥比中光科技有限公司 Electronic device
CN111399245A (en) * 2020-05-13 2020-07-10 浙江水晶光电科技股份有限公司 Laser emission module and 3D imaging device
CN111556308A (en) * 2020-06-15 2020-08-18 广东朗呈医疗器械科技有限公司 Lens, three-dimensional imaging module and three-dimensional imaging equipment

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106412557A (en) * 2016-11-02 2017-02-15 深圳市魔眼科技有限公司 3D camera control method and 3D camera control device
WO2018082481A1 (en) * 2016-11-02 2018-05-11 深圳全息信息科技发展有限公司 3d camera module and 3d photographing device
CN109756725A (en) * 2017-08-25 2019-05-14 华为技术有限公司 Structured light projection device, three-dimensional camera mould group and terminal device
CN107483796A (en) * 2017-09-26 2017-12-15 广东欧珀移动通信有限公司 CCD camera assembly and terminal
CN207321405U (en) * 2017-11-01 2018-05-04 信丰世嘉科技有限公司 A kind of camera lens module
WO2020057208A1 (en) * 2018-09-17 2020-03-26 深圳奥比中光科技有限公司 Electronic device
CN110062084A (en) * 2019-05-30 2019-07-26 Oppo广东移动通信有限公司 A kind of terminal device
CN110232863A (en) * 2019-06-26 2019-09-13 深圳市光鉴科技有限公司 Display device and electronic equipment with 3D camera module
CN111399245A (en) * 2020-05-13 2020-07-10 浙江水晶光电科技股份有限公司 Laser emission module and 3D imaging device
CN111556308A (en) * 2020-06-15 2020-08-18 广东朗呈医疗器械科技有限公司 Lens, three-dimensional imaging module and three-dimensional imaging equipment

Also Published As

Publication number Publication date
CN115499640B (en) 2024-05-07
CN118214843A (en) 2024-06-18

Similar Documents

Publication Publication Date Title
CN210894768U (en) Display device
CN109188711B (en) Under-screen optical system, design method of diffractive optical element, and electronic apparatus
US11300828B2 (en) Display device
RU2536080C2 (en) Efficient collimation of light with optical wedge
CN215499367U (en) Display device and electronic equipment with 3D module of making a video recording
CN108415209A (en) Project structured light module, camera assembly and electronic device
CN215499365U (en) Projection lens, light projector and depth camera module
US20110221663A1 (en) Edge type backlighting module
CN215499371U (en) Display device and electronic equipment with 3D module of making a video recording
CN215499368U (en) Display device and electronic equipment with 3D module of making a video recording
CN215499369U (en) Display device and electronic equipment with 3D module of making a video recording
CN215499370U (en) Display device and electronic equipment with 3D module of making a video recording
CN215499366U (en) Display device and electronic equipment with 3D module of making a video recording
CN115499640B (en) Display device and electronic equipment with 3D camera module
CN215871663U (en) Display device and electronic equipment with 3D module of making a video recording
CN215871662U (en) Display device and electronic equipment with 3D module of making a video recording
CN216561292U (en) Display device and electronic equipment with 3D module of making a video recording
CN115499639B (en) Display device and electronic equipment with 3D camera module
CN115499638B (en) Display device and electronic equipment with 3D camera module
CN115580720A (en) Projection lens, light projector and depth camera module
CN215499363U (en) Display device and electronic equipment with 3D module of making a video recording
CN215529177U (en) Display device and electronic equipment with 3D module of making a video recording
CN215499050U (en) Display device and electronic equipment with 3D module of making a video recording
CN215499049U (en) Display device and electronic equipment with 3D module of making a video recording
CN215499048U (en) Display device and electronic equipment with 3D module of making a video recording

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant