CN115499640B - Display device and electronic equipment with 3D camera module - Google Patents
Display device and electronic equipment with 3D camera module Download PDFInfo
- Publication number
- CN115499640B CN115499640B CN202210003173.3A CN202210003173A CN115499640B CN 115499640 B CN115499640 B CN 115499640B CN 202210003173 A CN202210003173 A CN 202210003173A CN 115499640 B CN115499640 B CN 115499640B
- Authority
- CN
- China
- Prior art keywords
- light
- lens
- laser
- floodlight
- camera module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000003384 imaging method Methods 0.000 claims abstract description 74
- 239000000758 substrate Substances 0.000 claims abstract description 57
- 239000011159 matrix material Substances 0.000 claims abstract description 48
- 230000001678 irradiating effect Effects 0.000 claims abstract description 5
- 230000005540 biological transmission Effects 0.000 claims description 25
- 230000003287 optical effect Effects 0.000 claims description 19
- 230000000149 penetrating effect Effects 0.000 claims description 5
- 238000009792 diffusion process Methods 0.000 description 13
- 238000010586 diagram Methods 0.000 description 12
- 239000004973 liquid crystal related substance Substances 0.000 description 8
- 238000012545 processing Methods 0.000 description 8
- 238000012986 modification Methods 0.000 description 7
- 230000004048 modification Effects 0.000 description 7
- 238000013461 design Methods 0.000 description 3
- 230000000694 effects Effects 0.000 description 3
- 239000011521 glass Substances 0.000 description 3
- 125000006850 spacer group Chemical group 0.000 description 3
- 238000009434 installation Methods 0.000 description 2
- 230000000750 progressive effect Effects 0.000 description 2
- 238000003491 array Methods 0.000 description 1
- 230000003796 beauty Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 239000000428 dust Substances 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000005286 illumination Methods 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 230000002265 prevention Effects 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09F—DISPLAYING; ADVERTISING; SIGNS; LABELS OR NAME-PLATES; SEALS
- G09F9/00—Indicating arrangements for variable information in which the information is built-up on a support by selection or combination of individual elements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
- H04N13/261—Image signal generators with monoscopic-to-stereoscopic image conversion
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/20—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from infrared radiation only
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/12—Picture reproducers
- H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
- H04N9/3141—Constructional details thereof
- H04N9/315—Modulator illumination systems
- H04N9/3161—Modulator illumination systems using laser light sources
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Optics & Photonics (AREA)
- Studio Devices (AREA)
Abstract
The invention provides a display device with a 3D camera module and electronic equipment, comprising a display substrate and the 3D camera module; the display substrate includes a display area and a black matrix area surrounding the display area; the black matrix region includes a first light-transmitting region; the 3D camera module comprises a depth camera module; the depth camera module comprises a laser module and an imaging module; the laser module is positioned on the backlight side of the black matrix area; the imaging module is positioned on the backlight side of the display area; the laser module includes a structured light projector; a structured light projector for projecting structured light toward the lens assembly; the lens assembly is used for converging a plurality of laser beams and then making the laser beams incident on the light incident surface of the lamp mirror; a lamp mirror for irradiating incident laser beams onto an object to be photographed through a first light-transmitting region; and the imaging module is used for receiving the laser which penetrates the display area after being reflected by the object to be shot. The invention can make the depth camera module with projection lens installed in a narrow gap without shielding the FOV.
Description
Technical Field
The invention relates to the technical field of display, in particular to a display device with a 3D camera module and electronic equipment.
Background
With the development of the market, consumers have increasingly stringent requirements on the display effect of the display screen, and not only diversification of the appearance design but also higher and better screen occupation ratio are required. The full screen technology realizes the screen duty ratio of more than 90% through the design of ultra-narrow frames and even no frames.
Under the condition that the body of the full-screen mobile phone is unchanged, the display area is maximized, and the display effect is more attractive. In order to install devices such as a depth camera module in a 3D camera module, a non-display area is arranged at the top of a display substrate, namely Liu Haiou, based on the structural design of a full screen, but the attractive appearance and full screen experience of a display device are affected.
Disclosure of Invention
In view of the above, the present invention provides a display device and an electronic apparatus with a 3D camera module, so as to solve the problem that the existing non-display area where the depth camera module is installed affects the aesthetic appearance and the overall screen experience of the display device.
In order to achieve the above object, in a first aspect, the present invention provides the following technical solutions:
The display device with the 3D camera module comprises a display substrate and the 3D camera module;
The display substrate includes a display region and a black matrix region surrounding the display region; the black matrix region includes a first light-transmitting region;
The 3D camera module comprises a depth camera module; the depth camera module comprises a laser module and an imaging module; the laser module is positioned on the backlight side of the black matrix area; the imaging module is positioned on the backlight side of the display area;
the laser module comprises a structured light projector and a projection lens; the projection lens comprises a lens assembly and a lamp mirror; the structured light projector is used for projecting structured light to the lens assembly, and the structured light comprises a plurality of laser lights which are randomly distributed; the lens assembly is used for converging the plurality of laser beams and then making the laser beams incident to the light incident surface of the lamp mirror; the lamp mirror is used for enabling the incident multiple laser beams to irradiate on an object to be shot through the first light transmission area;
the imaging module is used for receiving the laser which penetrates through the display area after being reflected by the object to be shot, and obtaining a depth image of the surface of the object to be shot according to the received light spot pattern of the laser reflected by the object to be shot.
Preferably, the first light-transmitting region is provided with a first infrared film layer;
The lamp mirror is used for enabling the divergent incident infrared laser beams to irradiate on an object to be shot through the first infrared film layer and the first light transmission area.
Preferably, the lens assembly includes a first lens, a second lens, and a lens barrel;
The first lens and the second lens are sequentially arranged on the light incident side of the lens barrel; the lamp mirror is arranged on the light emitting side of the lens barrel;
The first lens is used for converging the plurality of laser beams and projecting the converged laser beams to the second lens;
the second lens is used for converging the plurality of laser beams projected by the first lens again and then projecting the converged laser beams to the light incident surface of the lamp mirror.
Preferably, the light incident side of the lamp mirror is provided with a concave light incident port;
the bottom surface of the light inlet is a light inlet surface; the light incident surface is a convex surface; the diaphragm of the projection lens is arranged on the convex surface;
The light incident surface is used for enabling the incident multiple laser beams to exit in parallel or nearly in parallel.
Preferably, the laser module comprises a beam splitting device located between the structured light projector and the projection lens;
the structured light projector adopts a laser array for projecting lattice laser;
the beam splitter is positioned at the light emitting side of the laser array and is used for dividing the lattice laser into a plurality of randomly distributed lasers.
Preferably, the structured light projector includes an edge-emitting laser, a collimator lens, a reflecting device, and a spectroscopic device between the laser module and the projection lens;
the edge-emitting laser is used for projecting laser to the collimating lens;
The collimating lens is positioned at the light-emitting side of the edge-emitting laser and is used for collimating the incident laser and emitting collimated light beams;
the reflecting device is positioned at the light-emitting side of the collimating lens and is used for projecting the collimated light beam to the light splitting device after being folded;
the beam splitter is positioned at the light emergent side of the reflecting device and is used for dividing the collimated light beam projected by the reflecting device into a plurality of randomly distributed lasers.
Preferably, the depth camera module comprises a driving circuit connected with the laser module and the imaging module;
The driving circuit is used for controlling the laser module and the imaging module to be simultaneously turned on or turned off, and controlling the output light power of the laser module by controlling the driving current of the laser module.
Preferably, the imaging module comprises a receiving lens and a photodetector array; the light detector array comprises a plurality of light detectors distributed in an array;
The receiving lens is used for converging parallel laser beams incident at the same angle on an upper light detector positioned on the focal plane of the receiving lens;
The optical detector is used for receiving the laser to generate a light spot pattern and obtaining a depth image of the surface of the object to be shot according to the light spot pattern.
Preferably, the floodlight projector is further included;
The floodlight projector is arranged on the backlight side of the black matrix area and is used for projecting floodlight to the object to be shot through a second light transmission area arranged on the black matrix area according to a preset illuminance threshold value so as to illuminate;
Or the floodlight projector is positioned at the backlight side of the display area and is used for enabling the floodlight to penetrate through the display area and then irradiate the object to be shot to illuminate according to a preset illuminance threshold value.
The electronic equipment provided by the invention is characterized by comprising the display device.
In a second aspect, the present invention provides the following technical solutions:
The display device with the 3D camera module comprises a display substrate and the 3D camera module;
The display substrate includes a display region and a black matrix region surrounding the display region; the black matrix region includes a first light-transmitting region;
the 3D camera module comprises a depth camera module; the depth camera module comprises a laser module and an imaging module; the laser module is positioned on the backlight side of the display area; the imaging module is positioned on the backlight side of the black matrix area;
The laser module comprises a structured light projector and a projection lens; the structure light projector is used for projecting structure light to the projection lens, wherein the structure light comprises a plurality of randomly distributed laser beams; the projection lens is used for penetrating the incident multiple laser beams into the display area and irradiating the multiple laser beams onto an object to be photographed;
The imaging module comprises a lamp mirror, a receiving lens and a light detector array; the light detector array comprises a plurality of light detectors distributed in an array; the lamp mirror is used for receiving laser reflected by the object to be shot through the first light transmission area, and divergently projecting the laser to the receiving lens after the laser is contracted to the narrowest at the diaphragm; the receiving lens is used for converging parallel laser beams incident at the same angle on the optical detector positioned on the focal plane of the receiving lens; the optical detector is used for receiving the laser to generate a light spot pattern and obtaining a depth image of the surface of the object to be shot according to the light spot pattern.
Preferably, the first light-transmitting region is provided with a first infrared film layer;
The lamp mirror is used for sequentially receiving laser reflected by the object to be shot through the first light transmission area and the first infrared film layer, and divergently projecting the laser to the receiving lens after the laser is contracted to the narrowest at the diaphragm.
Preferably, the receiving lens includes a first lens, a second lens, and a lens barrel;
The first lens and the second lens are sequentially arranged on the light emergent side of the lens barrel; the lamp lens is arranged on the light side of the lens barrel;
the second lens is used for converging the plurality of laser beams projected by the lamp lens and then projecting the converged laser beams to the light incident surface of the first lens;
The first lens is used for converging the laser beams projected by the second lens again and then projecting the converged laser beams onto the optical detector array.
Preferably, the light emitting side of the lamp mirror is provided with a concave light emitting opening;
the bottom surface of the light outlet is a light outlet surface; the light-emitting surface is a convex surface; the diaphragm of the receiving lens is arranged on the convex surface;
The light emitting surface is used for enabling the incident multiple beams of laser to emit in a divergent mode.
Preferably, the laser module comprises a beam splitting device located between the structured light projector and the projection lens;
the structured light projector adopts a laser array for projecting lattice laser;
the beam splitter is positioned at the light emitting side of the laser array and is used for dividing the lattice laser into a plurality of randomly distributed lasers.
Preferably, the structured light projector includes an edge-emitting laser, a collimator lens, a reflecting device, and a spectroscopic device between the laser module and the display substrate;
the edge-emitting laser is used for projecting laser to the collimating lens;
The collimating lens is positioned at the light-emitting side of the edge-emitting laser and is used for collimating the incident laser and emitting collimated light beams;
the reflecting device is positioned at the light-emitting side of the collimating lens and is used for projecting the collimated light beam to the light splitting device after being folded;
the beam splitter is positioned at the light emergent side of the reflecting device and is used for dividing the collimated light beam projected by the reflecting device into a plurality of randomly distributed lasers.
Preferably, the depth camera module comprises a driving circuit connected with the laser module and the imaging module;
The driving circuit is used for controlling the laser module and the imaging module to be simultaneously turned on or turned off, and controlling the output light power of the laser module by controlling the driving current of the laser module.
Preferably, the depth camera module comprises a processing module; the 3D camera module further comprises a 2D imaging module;
The 2D imaging module is used for shooting a 2D image of the object to be shot;
The processing module is used for obtaining the 3D image of the object to be shot according to the depth image and the 2D image.
Preferably, the floodlight projector is further included;
The floodlight projector is arranged on the backlight side of the black matrix area and is used for projecting floodlight to the object to be shot through a second light transmission area arranged on the black matrix area according to a preset illuminance threshold value so as to illuminate;
Or the floodlight projector is positioned at the backlight side of the display area and is used for enabling the floodlight to penetrate through the display area and then irradiate the object to be shot to illuminate according to a preset illuminance threshold value.
The electronic equipment provided by the invention is characterized by comprising the display device.
In a third aspect, the present invention provides the following technical solutions:
The display device with the 3D camera module comprises a display substrate and the 3D camera module;
the display substrate includes a display region and a black matrix region surrounding the display region; the black matrix region includes a light-transmitting region;
The 3D camera module comprises a depth camera module; the depth camera module comprises a laser module and an imaging module; the laser module is positioned on the backlight side of the black matrix area; the imaging module is positioned on the backlight side of the display area;
The laser module comprises a floodlight source and a projection lens; the projection lens comprises a lens assembly and a lamp mirror; the floodlight source is used for emitting floodlight; the lens component is used for converging the floodlight and then making the floodlight enter the light incident surface of the lamp mirror; the lamp mirror is used for enabling the incident floodlight to irradiate on an object to be shot through the light transmission area;
The imaging module is used for receiving floodlight which penetrates through the display area after being reflected by the object to be shot, and obtaining a depth image of the surface of the object to be shot according to the delay or the phase difference of the floodlight.
Preferably, the light-transmitting region is provided with an infrared film layer;
The lamp mirror is used for enabling the scattered incident infrared floodlight to irradiate on an object to be shot through an infrared film layer and a light transmission area.
Preferably, the lens assembly includes a first lens, a second lens, and a lens barrel;
The first lens and the second lens are sequentially arranged on the light incident side of the lens barrel; the lamp mirror is arranged on the light emitting side of the lens barrel;
the first lens is used for converging the floodlight and then projecting the floodlight to the second lens;
The second lens is used for converging the floodlight projected by the first lens again and then projecting the floodlight onto the light incident surface of the lamp mirror.
Preferably, the light incident side of the lamp mirror is provided with a concave light incident port;
the bottom surface of the light inlet is a light inlet surface; the light incident surface is a convex surface; the diaphragm of the projection lens is arranged on the convex surface;
The light incident surface is used for enabling the incident floodlight to exit in parallel or nearly in parallel.
Preferably, the floodlight source comprises a structured light projector, a light splitting device and a diffusion sheet;
the structured light projector adopts a laser array for projecting lattice laser;
The beam splitter is positioned at the light emitting side of the laser array and is used for dividing the lattice laser into a plurality of laser beams which are discretely distributed;
The diffusion sheet is arranged on the light emitting side of the light splitting device and is used for diffusing the plurality of laser beams and enabling the plurality of laser beams to flood and emit the laser beams to the projection lens.
Preferably, the floodlight source comprises an edge-emitting laser, a collimating lens, a reflecting device, a light splitting device and a diffusion sheet;
the edge-emitting laser is used for projecting laser to the collimating lens;
The collimating lens is positioned at the light-emitting side of the edge-emitting laser and is used for collimating the incident laser and emitting collimated light beams;
the reflecting device is positioned at the light-emitting side of the collimating lens and is used for projecting the collimated light beam to the light splitting device after being folded;
the beam splitting device is positioned at the light emergent side of the reflecting device and is used for splitting the collimated light beam projected by the reflecting device into a plurality of discretely distributed lasers;
The diffusion sheet is arranged on the light emitting side of the light splitting device and is used for diffusing the plurality of laser beams and enabling the plurality of laser beams to flood and emit the laser beams to the projection lens.
Preferably, the depth camera module comprises a driving circuit connected with the laser module and the imaging module;
The driving circuit is used for controlling the laser module and the imaging module to be simultaneously turned on or turned off, and controlling the output light power of the laser module by controlling the driving current of the laser module.
Preferably, the imaging module comprises a receiving lens and a photodetector array; the light detector array comprises a plurality of light detectors distributed in an array;
the receiving lens is used for converging parallel floodlights incident at the same angle on the optical detector positioned on the focal plane of the receiving lens;
The light detector array is used for receiving the floodlight and obtaining a depth image of the surface of the object to be shot according to the delay or the phase difference of the floodlight.
Preferably, the floodlight source adopts an LED light source.
In a fourth aspect, the present invention provides the following technical solutions:
The display device with the 3D camera module comprises a display substrate and the 3D camera module;
the display substrate includes a display region and a black matrix region surrounding the display region; the black matrix region includes a light-transmitting region;
the 3D camera module comprises a depth camera module; the depth camera module comprises a laser module and an imaging module; the laser module is positioned on the backlight side of the display area; the imaging module is positioned on the backlight side of the black matrix area;
The laser module comprises a floodlight source and a projection lens; the floodlight source is used for emitting floodlight; the projection lens is used for penetrating the incident floodlight into the display area and irradiating the floodlight onto an object to be photographed;
The imaging module comprises a lamp mirror, a receiving lens and a light detector array; the light detector array comprises a plurality of light detectors distributed in an array; the lamp mirror is used for receiving the floodlight reflected by the object to be shot through the light transmission area, and divergently projecting the floodlight to the receiving lens after the floodlight is contracted to the narrowest at the diaphragm; the receiving lens is used for converging parallel floodlights incident at the same angle on the optical detector positioned on the focal plane of the receiving lens; the light detector array is used for receiving floodlight which penetrates through the display area after being reflected by the object to be shot, and obtaining a depth image of the surface of the object to be shot according to the delay or the phase difference of the floodlight.
Preferably, the light-transmitting region is provided with an infrared film layer;
The lamp mirror is used for sequentially receiving floodlight reflected by the object to be shot through the light transmission area and the infrared film layer, and divergently projecting the floodlight to the receiving lens after the floodlight is contracted to the narrowest at the diaphragm.
Preferably, the receiving lens includes a first lens, a second lens, and a lens barrel;
The first lens and the second lens are sequentially arranged on the light emergent side of the lens barrel; the lamp lens is arranged on the light side of the lens barrel;
The second lens is used for converging the floodlight projected by the lamp lens and then projecting the floodlight onto the light incident surface of the first lens;
the first lens is used for converging the floodlight projected by the second lens again and then projecting the floodlight onto the light detector array.
Preferably, the light emitting side of the lamp mirror is provided with a concave light emitting opening;
the bottom surface of the light outlet is a light outlet surface; the light-emitting surface is a convex surface; the diaphragm of the receiving lens is arranged on the convex surface;
the light emitting surface is used for enabling the incident floodlight to be emitted in a divergent mode.
Preferably, the floodlight source comprises a structured light projector, a light splitting device and a diffusion sheet;
the structured light projector adopts a laser array for projecting lattice laser;
The beam splitter is positioned at the light emitting side of the laser array and is used for dividing the lattice laser into a plurality of laser beams which are discretely distributed;
The diffusion sheet is arranged on the light emitting side of the light splitting device and is used for diffusing the plurality of laser beams and enabling the plurality of laser beams to flood and emit the laser beams to the projection lens.
Preferably, the floodlight source comprises an edge-emitting laser, a collimating lens, a reflecting device, a light splitting device and a diffusion sheet;
the edge-emitting laser is used for projecting laser to the collimating lens;
The collimating lens is positioned at the light-emitting side of the edge-emitting laser and is used for collimating the incident laser and emitting collimated light beams;
the reflecting device is positioned at the light-emitting side of the collimating lens and is used for projecting the collimated light beam to the light splitting device after being folded;
the beam splitting device is positioned at the light emergent side of the reflecting device and is used for splitting the collimated light beam projected by the reflecting device into a plurality of discretely distributed lasers;
The diffusion sheet is arranged on the light emitting side of the light splitting device and is used for diffusing the plurality of laser beams and enabling the plurality of laser beams to flood and emit the laser beams to the projection lens.
Preferably, the depth camera module comprises a driving circuit connected with the laser module and the imaging module;
The driving circuit is used for controlling the laser module and the imaging module to be simultaneously turned on or turned off, and controlling the output light power of the laser module by controlling the driving current of the laser module.
Preferably, the depth camera module comprises a processing module; the 3D camera module further comprises a 2D imaging module;
The 2D imaging module is used for shooting a 2D image of the object to be shot;
The processing module is used for obtaining the 3D image of the object to be shot according to the depth image and the 2D image.
Preferably, the optical path modulator is a liquid crystal modulator;
the liquid crystal modulator includes: a first substrate and a second substrate disposed opposite to each other;
A liquid crystal layer disposed between the first substrate and the second substrate;
wherein the liquid crystal layer is in a transparent state or a diffusion state by controlling deflection of liquid crystal in the liquid crystal layer;
when the liquid crystal layer is in a transparent state, the structure light projector projects structure light through the light path modulator; when the liquid crystal layer is in a diffusion state, the structured light projector projects floodlight through the light path modulator.
The electronic equipment provided by the invention is characterized by comprising the display device.
Compared with the prior art, the invention has the following beneficial effects:
The projection lens of the invention converges light to the lamp lens through the lens component, and the diaphragm is positioned on the light incident surface of the lamp lens, so that the depth camera module provided with the projection lens is suitable for being installed in a narrow gap without being blocked by the FOV, the application of the invention on a narrow frame screen (a screen with a narrower black matrix area) is realized, and the lamp lens can be tightly attached to the glass cover plate of the mobile phone, thereby playing a role in dust prevention;
according to the display device and the electronic equipment with the 3D camera module, the laser module is arranged on the backlight side of the black matrix area of the display substrate, and the imager module is arranged on the backlight side of the display area of the display substrate, so that a non-display area, namely a sea area, is not required to be arranged at the top of the display device, the depth camera module is installed, and the attractiveness and the overall screen experience of the display device are not affected;
According to the invention, the infrared film layer is arranged in the light-transmitting area of the black matrix area, and can transmit infrared light so as not to influence the work of the depth camera module, but visible light cannot pass through the infrared film layer, so that the integrity of the black matrix area is ensured, and the attractiveness of a display screen is not influenced.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings that are required to be used in the embodiments or the description of the prior art will be briefly described below, and it is obvious that the drawings in the following description are only embodiments of the present invention, and that other drawings can be obtained according to the provided drawings without inventive effort for a person skilled in the art.
FIG. 1 is a schematic diagram of a display device according to an embodiment of the invention;
FIG. 2 is a schematic diagram of a display device according to a modification of the present invention;
FIG. 3 is a set of mounting schematic diagrams of a laser module according to an embodiment of the present invention;
FIG. 4 is a schematic diagram of another set of mounting of a laser module in accordance with an embodiment of the present invention;
FIG. 5 is a set of mounting schematic diagrams of an imaging module according to an embodiment of the present invention;
FIG. 6 is a schematic diagram of an EEL laser-based display device according to an embodiment of the present invention;
FIG. 7 is a schematic diagram of a display device based on a VCSEL laser according to an embodiment of the present invention;
FIG. 8 is a schematic structural diagram of a group of display devices according to a first embodiment of the present invention;
fig. 9 is a schematic structural diagram of a display device according to a second embodiment of the present invention;
FIG. 10 is a schematic view illustrating a structure of a projection lens according to an embodiment of the present invention;
FIG. 11 is a schematic view illustrating another structure of a projection lens according to an embodiment of the present invention;
fig. 12 is an installation schematic diagram of a 3D camera according to an embodiment of the present invention;
FIG. 13 is a spot diagram of a plurality of lasers according to an embodiment of the present invention.
In the figure:
10 is a display substrate; 11 is a laser module; 1101 is a laser array; 1102 is an edge-emitting laser; 12 is an imaging module; 1201 is a second lamp mirror; 1202 is a receiving lens; 1203 are photodetector arrays; 13 is a light splitting device; 14 is a driving circuit; 15 is a processing module; 16 is a lens assembly; 1601 is a first lens; 1602 is a second lens; 1603 is a spacer; 1604 is a lens barrel; 1605 is a spacer; 17 is a reflecting device; 18 is a collimating lens; 19 is a lamp mirror; 20 is a black matrix region; 21 is a diffusion sheet; 30 is a display area; 40 is an inner screen; 50 is a floodlight projector; 60 is an RGB camera.
Detailed Description
The present invention will be described in detail with reference to specific examples. The following examples will assist those skilled in the art in further understanding the present invention, but are not intended to limit the invention in any way. It should be noted that variations and modifications could be made by those skilled in the art without departing from the inventive concept. These are all within the scope of the present invention.
It will be understood that when an element is referred to as being "mounted" or "disposed" on another element, it can be directly on the other element or be indirectly on the other element. When an element is referred to as being "connected to" another element, it can be directly connected to the other element or be indirectly connected to the other element. In addition, the connection may be for a fixing function or for a circuit communication function.
It is to be understood that the terms "length," "width," "upper," "lower," "front," "rear," "left," "right," "vertical," "horizontal," "top," "bottom," "inner," "outer," and the like are merely for convenience in describing embodiments of the invention and to simplify the description by referring to the figures, rather than to indicate or imply that the devices or elements referred to must have a particular orientation, be constructed and operated in a particular orientation, and thus are not to be construed as limiting the invention.
Furthermore, the terms "first," "second," and the like, are used for descriptive purposes only and are not to be construed as indicating or implying a relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defining "a first" or "a second" may explicitly or implicitly include one or more such feature. In the description of the embodiments of the present invention, the meaning of "plurality" is two or more, unless explicitly defined otherwise.
As described in the background art, in order to install devices such as a depth camera module in a 3D camera module, a non-display area, that is Liu Haiou, is disposed on the top of a display substrate, but this affects the aesthetic appearance and the overall screen experience of the display device.
The inventor researches and discovers that the conventional depth camera modules all adopt a vertical cavity Surface light emitting laser (VERTICAL CAVITY Surface EMITTING LASER, VCSEL) as a light source, but because the output light power of the VCSEL laser is low, when the transmissivity of a display substrate is low, the light power of laser light passing through the display panel is low, and an effective depth image cannot be obtained, therefore, a non-display area, namely Liu Haiou, needs to be arranged on the top of the display substrate, and the non-display area needs to be hollowed to be mounted for installing the VCSEL laser.
In order to make the objects, features and advantages of the present invention more comprehensible, the technical solutions according to the embodiments of the present invention will be clearly described in the following description with reference to the accompanying drawings, and it is apparent that the described embodiments are only some embodiments of the present invention, not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
The embodiment of the invention provides a display device with a 3D camera module, as shown in fig. 1, comprising a display substrate 10 and the 3D camera module, wherein the 3D camera module comprises a depth camera module positioned on the backlight side of the display substrate 10. It should be noted that, the depth camera module in the embodiment of the present invention is an infrared camera module, and the laser module adopts an infrared laser that emits infrared laser. The laser module adopts a vertical cavity surface emitting laser array, an edge emitting laser and a semiconductor laser.
The light-emitting side of the display substrate is a side capable of displaying an image, and the backlight side is a side incapable of displaying an image. That is, the depth camera module according to the embodiment of the invention may be located below the display substrate 10, i.e. may be disposed below the screen, without damaging the structure of the display substrate 10, such as without digging holes in the non-display area on the top of the display substrate 10 to dispose the depth camera module. The display substrate includes a display region and a black matrix region surrounding the display region; the black matrix region includes a light transmitting region. In some embodiments, the black matrix region further includes a first light transmissive region and a second light transmissive region. The light-transmitting area is a circular area with the diameter smaller than 1 millimeter.
In an embodiment of the present invention, the depth camera module includes a flood projector 50, a laser module 11, and an imaging module 12. The laser module 11 and the imaging module 12 are both located at the backlight side of the display substrate 10, and the light outlet of the laser module 11 is disposed towards the display substrate 10, so that laser can be irradiated onto an object to be photographed located at the light outlet side of the display substrate 10 through the first light-transmitting area, and the light inlet of the imaging module 12 is disposed towards the display substrate 10, so that laser reflected by the object to be photographed penetrates through the display area and then enters the imaging module 12.
Wherein the laser module 11 comprises a structured light projector and a projection lens; the projection lens comprises a lens assembly 16 and a lamp mirror 19; the structured light projector is configured to project structured light toward the lens assembly 16, the structured light comprising a plurality of randomly distributed lasers; the lens assembly 16 is configured to converge the plurality of laser beams and then make the converged laser beams incident on the light incident surface of the lamp mirror; the lamp mirror 19 is used for enabling the incident multiple laser beams to emit in parallel or nearly in parallel so as to enable the laser beams to irradiate on an object to be shot through a first light transmission area;
in some embodiments, the depth camera module includes a laser module 11 and an imaging module 12. The laser module 11 and the imaging module 12 are both located at the backlight side of the display substrate 10, and the light outlet of the laser module 11 is disposed towards the display substrate 10, so that laser can be irradiated onto an object to be photographed located at the light outlet side of the display substrate 10 through the first light-transmitting area, and the light inlet of the imaging module 12 is disposed towards the display substrate 10, so that laser reflected by the object to be photographed penetrates through the display area and then enters the imaging module 12.
Wherein the laser module 11 comprises a floodlight source and a projection lens; the projection lens comprises a lens assembly 16 and a lamp mirror 19; the floodlight source is used for emitting floodlight; the lens assembly 16 is configured to converge the floodlight and then make the floodlight incident on the light incident surface of the lamp lens; the lamp mirror 19 is used for enabling the incident floodlight to irradiate on an object to be photographed through a light transmission area.
The imaging module 12 is configured to receive the laser beam reflected by the object to be shot and penetrating through the display area, and obtain a depth image of the surface of the object to be shot according to the received spot pattern of the laser beam reflected by the object to be shot. The depth image includes depth information of different areas of the surface of the object to be photographed.
In some embodiments, the imaging module 12 includes a second light mirror 1201, a receiving lens 1202, and a light detector array 1203; the photodetector array 1203 comprises a plurality of photodetectors distributed in an array; the lamp lens 1201 is configured to receive the laser reflected by the object to be photographed through the first light-transmitting area, and after the laser is contracted to the narrowest position at the aperture, the laser diverges and projects the laser to the receiving lens; the receiving lens 1202 is configured to converge parallel laser beams incident at the same angle on a photodetector located at a focal plane of the receiving lens; the optical detector is used for receiving the laser to generate a light spot pattern and obtaining a depth image of the surface of the object to be shot according to the light spot pattern. The depth image includes depth information of different areas of the surface of the object to be photographed.
The floodlight projector 50 is configured to project floodlight to the object to be photographed through the second light-transmitting area according to a preset illuminance threshold value, so as to illuminate. The preset illuminance threshold is any value from 10lux to 50lux, and preferably the preset illuminance threshold is 10lux.
In a modification of the present invention, the floodlight projector 50 may be further disposed on a backlight side of the display area, and configured to enable the floodlight to penetrate through the display area and then irradiate onto the object to be photographed for illumination according to a preset illuminance threshold.
Because the laser module 11 is disposed on the backlight side of the black matrix region, the imaging module 12 is disposed on the backlight side of the display region, so that the non-display region is not required to be disposed on the top of the display device to mount the depth camera module, and the aesthetic appearance and the overall screen experience of the display device are not affected.
In addition, since the laser module 11 and the imaging module 12 are disposed on the backlight side of the display substrate 10, the arrangement and combination of the laser module 11 and the imaging module 12 are possible, and the distance between the laser module 11 and the imaging module 12 can be increased to improve the photographing accuracy of the depth camera module without affecting the beauty, and as shown in fig. 2a, the laser module 11 and the imaging module 12 can be disposed in the black matrix areas on both sides, respectively. As shown in fig. 2b, the laser module 11 may also be arranged in the display area on either side, and the imaging module 12 is arranged in the black matrix area on either side. As shown in fig. 2c, the laser module 11 and the imaging module 12 may also be disposed in the black matrix region on both sides, respectively. As shown in fig. 2d, the laser module 11 may also be arranged in the display area on either side, and the imaging module 12 is arranged in the black matrix area on either side.
Optionally, the light-transmitting region is provided with an infrared film layer; in some embodiments, the first light transmissive region is provided with a first infrared film layer and the second light transmissive region is provided with a second infrared film layer;
The lamp lens 19 is used for enabling the infrared floodlight which is scattered and incident to penetrate through an infrared film layer and a light transmission area to irradiate on an object to be photographed.
In some embodiments, the lamp lens 19 is configured to make the multiple laser beams incident in a divergent manner exit in parallel or nearly parallel so that the laser beams penetrate the first infrared film layer and the first light-transmitting area to irradiate on an object to be photographed;
In some embodiments, the lamp lens 19 is configured to receive the laser light reflected by the object to be photographed sequentially through the first light-transmitting area and the first infrared film layer, and converge to the narrowest at the aperture, and then divergently project the laser light to the receiving lens;
and the floodlight projector is used for projecting floodlight to the object to be shot through the second infrared film layer and the second light transmission area when the illuminance is lower than the preset illuminance threshold value so as to illuminate.
Optionally, as shown in fig. 3 and 8, the laser module includes a beam splitter between the structured light projector and the projection lens;
The structured light projector adopts a laser array 1101 for projecting lattice laser;
The beam splitter 13 is located at the light emitting side of the laser array 1101, and is configured to split the lattice laser emitted by the structured light projector into multiple randomly distributed laser beams.
In some embodiments, the floodlight comprises a structured light projector, a light splitting device 13 and a diffuser 21;
The structured light projector adopts a laser array 1101 for projecting lattice laser;
The beam splitter 13 is located at the light emitting side of the laser array 1101, and is configured to split the lattice laser emitted by the structured light projector into multiple laser beams with discrete distribution.
The diffusion sheet 21 is disposed on the light emitting side of the light splitting device, and is configured to diffuse the multiple laser beams and make the multiple laser beams flood and emit the multiple laser beams onto the projection lens.
That is, in the embodiment of the present invention, the display substrate 10 may be a glass substrate, and the inner side of the display substrate 10 is the inner screen 40 of the display device.
In an embodiment of the present invention, as shown in fig. 6 and 7, the depth camera module includes a driving circuit 14 connected to the laser module 11 and the imaging module 12. The driving circuit 14 is used for controlling the laser module 11 and the imaging module 12 to be turned on or off simultaneously, and controlling the output optical power of the laser module 11 by controlling the driving current of the laser module 11 so as to control the optical power of the laser light passing through the first light transmission region by controlling the output optical power of the laser module 11.
Further, the depth camera module further includes a processing module 15,3D and the camera module further includes a 2D imaging module. The 2D imaging module is used for shooting a 2D image of an object to be shot. The processing module 15 is configured to obtain a 3D image of the object to be photographed according to the depth image photographed by the 3D photographing module and the 2D image photographed by the 2D imaging module.
In order to set the depth camera module on the backlight side of the display substrate 10, the driving circuit 14 may increase the driving current, reduce the pulse width of the laser module 11, and substantially increase the optical power of the laser module 11, while keeping the total pulse energy of the laser module 11 substantially unchanged, so as to satisfy the optical power limitation of eye safety.
In one embodiment of the present invention, as shown in fig. 4 and 9, the structured light projector includes an edge emitting laser 1102, a collimating lens 18, a reflecting device 17 and a beam splitting device 13, which are located between the laser module and the projection lens; a collimating lens 18 and a reflecting device 17 are arranged between the beam splitter 13 and the laser module 11;
The edge-emitting laser 1102 is configured to project laser light to the collimator lens;
the collimating lens 18 is located at the light-emitting side of the edge-emitting laser 1102, and is configured to collimate the incident laser light and emit a collimated light beam;
the reflecting device 17 is located at the light emitting side of the collimating lens, and is configured to convert the collimated light beam and then project the converted collimated light beam to the beam splitter 13;
The beam splitter 13 is located at the light emitting side of the reflecting device, and is used for splitting the collimated light beam projected by the reflecting device 17 into a plurality of randomly distributed laser beams.
Specifically, the beam splitter 13 divides the laser beam emitted by the edge emitting laser 1102 into a plurality of randomly distributed lasers, when the lasers are irradiated on a plane, a spot image as shown in fig. 13 is formed, when the plurality of lasers are irradiated on an object to be photographed, the spot pattern deforms or shifts, after the first imaging module photographs the spot pattern on the surface of the object to be photographed, a depth image of the surface of the object to be photographed is obtained according to the deformation or shift of the spot pattern, and then the depth information of the roughness of the surface of the object to be photographed is obtained. The processing module 15 can obtain a 3D image of the object to be photographed according to the depth image and the 2D image.
The imaging module 12 is a first imaging module, optionally an infrared camera. The first imaging module 12 obtains a depth image of the surface of the object to be photographed according to the received spot pattern of the laser reflected by the object to be photographed.
In some embodiments, the floodlight comprises a bit-edge emitting laser 1102, a collimating lens 18, a reflecting device 17, a light splitting device 13, and a diffuser 21;
The edge-emitting laser 1102 is configured to project laser light to the collimator lens;
the collimating lens 18 is located at the light-emitting side of the edge-emitting laser 1102, and is configured to collimate the incident laser light and emit a collimated light beam;
the reflecting device 17 is located at the light emitting side of the collimating lens, and is configured to convert the collimated light beam and then project the converted collimated light beam to the beam splitter 13;
the beam splitter 13 is located at the light emergent side of the reflecting device, and is used for splitting the collimated light beam projected by the reflecting device 17 into a plurality of laser beams in discrete distribution;
the diffusion sheet 21 is disposed on the light emitting side of the light splitting device, and is configured to diffuse the multiple laser beams and make the multiple laser beams flood and emit the multiple laser beams onto the projection lens.
In the embodiment of the present invention, the reflecting device 17 may be a mirror or a triangular prism. The reflecting surface of the triangular prism can be plated with a layer of reflecting film.
In an embodiment of the present invention, as shown in fig. 5, the imaging module 12 includes a receiving lens 1202 and a photodetector array 1201; the photodetector array 1201 comprises a plurality of photodetectors distributed in an array;
The receiving lens 1202 is configured to receive the laser beam that has penetrated the display area after being reflected by the object to be photographed, and converge the parallel laser beam incident at the same angle on an upper photodetector located on the focal plane of the receiving lens;
The optical detector is used for receiving the laser to generate a light spot pattern and obtaining a depth image of the surface of the object to be shot according to the light spot pattern.
In an embodiment of the present invention, the photodetector may be a CMOS or CCD sensor.
In some embodiments, the imaging module 12 includes a second light mirror 1201, a receiving lens 1202, and a light detector array 1203; the photodetector array 1203 comprises a plurality of photodetectors distributed in an array;
The second lamp 1201 is configured to receive the laser light reflected by the object to be photographed through another light-transmitting area, and after the laser light is shrunk to the narrowest position at the aperture, the laser light diverges and projects the laser light to the receiving lens.
In some embodiments, the imaging module 12 includes a receiving lens 1202 and a photodetector array 1201; the photodetector array 1201 comprises a plurality of photodetectors distributed in an array;
the receiving lens 1202 is configured to receive floodlight that penetrates the display area after being reflected by the object to be photographed, and converge parallel floodlights incident at the same angle on a light detector located at a focal plane of the receiving lens;
The light detector array is used for receiving the floodlight and obtaining a depth image of the surface of the object to be shot according to the delay or the phase difference of the floodlight.
Fig. 10 is a schematic structural view of a projection lens according to an embodiment of the present invention, and fig. 11 is another schematic structural view of a projection lens according to an embodiment of the present invention, as shown in fig. 10 and 11, wherein the projection lens includes a lens assembly 16 and a lamp lens 19; the structured light projector is used for projecting structured light to the lens assembly, and the structured light comprises a plurality of laser lights which are randomly distributed; the lens assembly 16 is configured to converge the plurality of laser beams and then make the converged laser beams incident on the light incident surface of the lamp mirror 19; the lamp mirror 19 is used for enabling the incident multiple laser beams to emit in parallel or nearly in parallel so as to enable the laser beams to irradiate on an object to be shot through a first light transmission area;
in the embodiment of the present invention, the angle between the two lasers near to parallel is specifically smaller than a preset angle threshold, and the angle threshold may be set to 5 °. The plurality of laser parallels are specifically that a plurality of laser forms a plurality of groups of laser, and a plurality of laser in each group of laser is mutually parallel.
In an embodiment of the present invention, the lens assembly 16 includes a first lens 1601, a second lens 1602, and a barrel 1604; the first lens 1601 and the second lens 1602 are sequentially disposed on the light incident side of the lens barrel; the lamp lens 19 is arranged on the light-emitting side of the lens barrel; the first lens 1601 is configured to converge and project the plurality of laser beams to the second lens; the second lens 1602 is configured to converge the multiple laser beams projected by the first lens again and then project the converged laser beams onto the light incident surface of the lamp lens. The lens barrel 1604 is used for assembling and fixing the first lens 1601, the second lens 1602 and the lamp lens 19 together. The light incident side of the lamp mirror 19 is provided with a concave light incident port; the bottom surface of the light inlet is a light inlet surface; the light incident surface is a convex surface; the diaphragm of the projection lens is arranged on the convex surface. The light incident surface is used for enabling the incident multiple laser beams to emit in parallel or emit near parallel so as to image at a position of infinity or a specified distance away from infinity.
In some embodiments, the lamp lens 19 is configured to divergently project the incident laser beams to the receiving lens after the incident laser beams are narrowed to the narrowest at the aperture; the receiving lens 16 is used for converging parallel laser beams incident at the same angle on a light detector positioned on the focal plane of the receiving lens;
The receiving lens 16 includes a first lens 1601, a second lens 1602, and a barrel 1604; the light-emitting side of the lamp mirror 19 is provided with a concave light-emitting opening; the bottom surface of the light outlet is a light outlet surface; the light-emitting surface is a convex surface; the diaphragm of the lamp mirror 19 is arranged on the convex surface. The light emitting surface is used for enabling the incident multiple laser beams to be emitted in a divergent mode. The second lens 1602 and the first lens 1601 are sequentially disposed on the light-emitting side of the lens barrel; the lamp lens 19 is arranged on the light incident side of the lens barrel; the second lens 1602 is configured to converge the plurality of laser beams projected by the lamp lens 19 and then project the converged laser beams onto the light incident surface of the first lens 1601; the first lens 1601 is configured to re-converge the plurality of laser beams projected by the second lens 1602 and then project the converged laser beams onto the photodetector array. The lens barrel 1604 is used for assembling and fixing the first lens 1601, the second lens 1602 and the lamp lens 19 together.
In the embodiment of the invention, since the depth camera module is installed under the narrow slit, the position of the diaphragm, i.e. the position of the narrowest beam, is the position in the middle of the height of the narrow slit, and the lens can achieve the largest angle of view under the condition that the upper side and the lower side can not shade light.
When the projection lens is located on the backlight side of the display substrate 10, it is necessary to fill the lamp mirror 19 between the lens assembly 16 and the display substrate 10. Because the smaller the size of the area available for light transmission, the more the light converging point of the projection lens, i.e. the aperture, needs to be placed at the position of the lamp lens 19, the larger the diameter size of the projection lens is needed, so that the outgoing light rays with a certain angle can be converged at a designated position after being transmitted for a certain distance. The lower surface of the lamp lens 19 is made into a convex surface, and the diaphragm of the projection lens is placed on the convex surface, so that the lamp lens 19 bears a part of optical power and is equivalent to a convex lens, and meanwhile, the angle of emergent light rays from the lens below the lamp lens 19 is reduced, the effective caliber of the projection lens can be reduced, and the size of the whole system is further reduced.
In the embodiment of the invention, the upper surface of the lamp mirror 19 is tightly attached to the lower surface of the display substrate 10, the boss structure on the upper part of the lamp mirror 19 is tightly attached to the lower surface of the inner screen 40, and the lower edge of the lamp mirror 19 is tightly attached to the projection lens barrel, so that the assembly and the test are convenient.
A spacer ring 1603 is disposed between the first lens 1601 and the second lens 1602, and is used for fixing the relative position between the first lens 2 and the second lens 4.
In the embodiment of the invention, the light emergent side of the lamp mirror is provided with a boss structure; the end face of the boss structure is a light-emitting face. The first lens 1601 and the second lens 1602 are convex lenses. The light incident side surface of the lamp lens 19 is attached to the second lens 1602. The lamp lens 19 is made of optical plastic materials, so that not only can the function of bearing focal power be realized, but also the dustproof effect between the projection lens and the display substrate 10 can be realized.
In a modification of the present invention, a bulkhead 1605 is provided on the barrel 1604; the second lens 1602 is disposed on one side of the bulkhead 1605, and the lens barrel 1604 is disposed on the other side of the bulkhead 1605.
In the embodiment of the present invention, the light incident by the first lens 1601 may be projected by any light projector, such as a structured light projector, an edge-emitting laser, to project a pattern. The structured light emitted by the light projector may be a plurality of parallel telecentric light beams, or may be a light beam having a principal ray with a certain angle.
In the embodiment of the present invention, the light-splitting device 13 may be a waveguide device, a nano-photon chip, a diffraction grating (DIFFRACTIVE OPTICS ELEMENT, DOE), a coded structure photomask, or the like, and the present invention is not limited thereto.
Fig. 12 is an installation schematic diagram of a 3D camera according to an embodiment of the present invention, as shown in fig. 12, when the display device with a 3D camera module provided by the present invention is implemented, the floodlight projector 50 and the laser module 11 are installed on the backlight side of the display substrate 10, and the imaging module 12 and the RGB camera 60 are installed on the backlight side of the internal screen.
The embodiment of the invention also provides electronic equipment which comprises the display device provided by any embodiment, and the electronic equipment can be a mobile phone, a tablet personal computer, a digital camera and the like. According to the electronic equipment with the 3D camera module, a non-display area is not required to be arranged at the top of the display device to install the depth camera module, so that the appearance is more attractive, and the comprehensive screen experience is realized more conveniently.
In the embodiment of the invention, the first lens and the second lens of the lens assembly are used for converging light rays to the lamp lens, and the diaphragm is positioned on the light incident surface of the lamp lens, so that the depth camera module provided with the projection lens is suitable for being installed in a narrow gap without being blocked by the FOV, the application of the invention on a narrow-frame screen (a screen with a narrower black matrix area) is realized, and the lamp lens can be tightly attached to the glass cover plate of the mobile phone to play a dustproof role; according to the display device and the electronic equipment with the 3D camera module, the laser module is arranged on the backlight side of the black matrix area of the display substrate, and the imager module is arranged on the backlight side of the display area of the display substrate, so that a non-display area, namely a sea area, is not required to be arranged at the top of the display device, the depth camera module is installed, and the attractiveness and the overall screen experience of the display device are not affected; according to the embodiment of the invention, the infrared film layer is arranged in the light-transmitting area of the black matrix area, and can transmit infrared light so as not to influence the operation of the depth camera module, but visible light cannot pass through the infrared film layer, so that the integrity of the black matrix area is ensured, and the attractiveness of a display screen is not influenced.
In the present specification, each embodiment is described in a progressive manner, and each embodiment is mainly described in a different point from other embodiments, and identical and similar parts between the embodiments are all enough to refer to each other. The previous description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the invention. Thus, the present invention is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
In the present specification, each embodiment is described in a progressive manner, and each embodiment is mainly described in a different point from other embodiments, and identical and similar parts between the embodiments are all enough to refer to each other. The previous description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the invention. Thus, the present invention is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
The foregoing describes specific embodiments of the present invention. It is to be understood that the invention is not limited to the particular embodiments described above, and that various changes and modifications may be made by one skilled in the art within the scope of the claims without affecting the spirit of the invention.
Claims (10)
1. The display device with the 3D camera module is characterized by comprising a display substrate and the 3D camera module;
The display substrate includes a display region and a black matrix region surrounding the display region; the black matrix region includes a first light-transmitting region;
The 3D camera module comprises a depth camera module; the depth camera module comprises a laser module and an imaging module; the laser module is positioned on the backlight side of the black matrix area; the imaging module is positioned on the backlight side of the display area;
the laser module comprises a structured light projector and a projection lens; the projection lens comprises a lens assembly and a lamp mirror; the structured light projector is used for projecting structured light to the lens assembly, and the structured light comprises a plurality of laser lights which are randomly distributed; the lens assembly is used for converging the plurality of laser beams and then making the laser beams incident to the light incident surface of the lamp mirror; the lamp mirror is used for enabling the incident multiple laser beams to irradiate on an object to be shot through the first light transmission area;
The light incident side of the lamp mirror is provided with a concave light incident port;
the bottom surface of the light inlet is a light inlet surface; the light incident surface is a convex surface; the diaphragm of the projection lens is arranged on the convex surface;
the light incident surface is used for enabling the incident multiple laser beams to exit in parallel or nearly in parallel;
the imaging module is used for receiving the laser which penetrates through the display area after being reflected by the object to be shot, and obtaining a depth image of the surface of the object to be shot according to the received light spot pattern of the laser reflected by the object to be shot.
2. The display device of claim 1, wherein the first light transmissive region is provided with a first infrared film layer;
the lamp mirror is used for enabling the divergent incidence of the plurality of laser beams to irradiate on an object to be shot through the first infrared film layer and the first light transmission area.
3. The display device according to claim 1, wherein the lens assembly includes a first lens, a second lens, and a lens barrel;
The first lens and the second lens are sequentially arranged on the light incident side of the lens barrel; the lamp mirror is arranged on the light emitting side of the lens barrel;
The first lens is used for converging the plurality of laser beams and projecting the converged laser beams to the second lens;
the second lens is used for converging the plurality of laser beams projected by the first lens again and then projecting the converged laser beams to the light incident surface of the lamp mirror.
4. The display device with the 3D camera module is characterized by comprising a display substrate and the 3D camera module;
The display substrate includes a display region and a black matrix region surrounding the display region; the black matrix region includes a first light-transmitting region;
the 3D camera module comprises a depth camera module; the depth camera module comprises a laser module and an imaging module; the laser module is positioned on the backlight side of the display area; the imaging module is positioned on the backlight side of the black matrix area;
The laser module comprises a structured light projector and a projection lens; the structure light projector is used for projecting structure light to the projection lens, wherein the structure light comprises a plurality of randomly distributed laser beams; the projection lens is used for penetrating the incident multiple laser beams into the display area and irradiating the multiple laser beams onto an object to be photographed;
The imaging module comprises a lamp mirror, a receiving lens and a light detector array; the light detector array comprises a plurality of light detectors distributed in an array; the lamp mirror is used for receiving laser reflected by the object to be shot through the first light transmission area, and divergently projecting the laser to the receiving lens after the laser is contracted to the narrowest at the diaphragm; the receiving lens is used for converging parallel laser beams incident at the same angle on the optical detector positioned on the focal plane of the receiving lens; the optical detector is used for receiving the laser to generate a light spot pattern and obtaining a depth image of the surface of the object to be shot according to the light spot pattern.
5. The display device of claim 4, wherein the first light transmissive region is provided with a first infrared film layer;
The lamp mirror is used for sequentially receiving laser reflected by the object to be shot through the first light transmission area and the first infrared film layer, and divergently projecting the laser to the receiving lens after the laser is contracted to the narrowest at the diaphragm.
6. The display device with the 3D camera module is characterized by comprising a display substrate and the 3D camera module;
the display substrate includes a display region and a black matrix region surrounding the display region; the black matrix region includes a light-transmitting region;
The 3D camera module comprises a depth camera module; the depth camera module comprises a laser module and an imaging module; the laser module is positioned on the backlight side of the black matrix area; the imaging module is positioned on the backlight side of the display area;
The laser module comprises a floodlight source and a projection lens; the projection lens comprises a lens assembly and a lamp mirror; the floodlight source is used for emitting floodlight; the lens component is used for converging the floodlight and then making the floodlight enter the light incident surface of the lamp mirror; the lamp mirror is used for enabling the incident floodlight to irradiate on an object to be shot through the light transmission area;
The light incident side of the lamp mirror is provided with a concave light incident port;
the bottom surface of the light inlet is a light inlet surface; the light incident surface is a convex surface; the diaphragm of the projection lens is arranged on the convex surface;
the light incident surface is used for enabling the incident floodlight to exit in parallel or nearly in parallel;
The imaging module is used for receiving floodlight which penetrates through the display area after being reflected by the object to be shot, and obtaining a depth image of the surface of the object to be shot according to the delay or the phase difference of the floodlight.
7. The display device according to claim 6, wherein the light-transmitting region is provided with an infrared film layer;
the lamp mirror is used for enabling the scattered incident floodlight to irradiate on an object to be shot through an infrared film layer and a light transmission area.
8. The display device with the 3D camera module is characterized by comprising a display substrate and the 3D camera module;
the display substrate includes a display region and a black matrix region surrounding the display region; the black matrix region includes a light-transmitting region;
the 3D camera module comprises a depth camera module; the depth camera module comprises a laser module and an imaging module; the laser module is positioned on the backlight side of the display area; the imaging module is positioned on the backlight side of the black matrix area;
The laser module comprises a floodlight source and a projection lens; the floodlight source is used for emitting floodlight; the projection lens is used for penetrating the incident floodlight into the display area and irradiating the floodlight onto an object to be photographed;
The imaging module comprises a lamp mirror, a receiving lens and a light detector array; the light detector array comprises a plurality of light detectors distributed in an array; the lamp mirror is used for receiving the floodlight reflected by the object to be shot through the light transmission area, and divergently projecting the floodlight to the receiving lens after the floodlight is contracted to the narrowest at the diaphragm; the receiving lens is used for converging parallel floodlights incident at the same angle on the optical detector positioned on the focal plane of the receiving lens; and the light detector array is used for obtaining the depth image of the surface of the object to be shot according to the time delay or the phase difference of the floodlight.
9. The display device according to claim 8, wherein the light-transmitting region is provided with an infrared film layer;
The lamp mirror is used for sequentially receiving floodlight reflected by the object to be shot through the light transmission area and the infrared film layer, and divergently projecting the floodlight to the receiving lens after the floodlight is contracted to the narrowest at the diaphragm.
10. An electronic device comprising the display device according to any one of claims 1 to 9.
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202410510957.4A CN118214843A (en) | 2021-06-17 | 2022-01-04 | Display device and electronic equipment with 3D camera module |
CN202410511147.0A CN118509570A (en) | 2021-06-17 | 2022-01-04 | Display device and electronic equipment with 3D camera module |
Applications Claiming Priority (8)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202110672557X | 2021-06-17 | ||
CN2021106725531 | 2021-06-17 | ||
CN202110672553 | 2021-06-17 | ||
CN202110672557 | 2021-06-17 | ||
CN202110672552 | 2021-06-17 | ||
CN2021106725527 | 2021-06-17 | ||
CN202110697290X | 2021-06-23 | ||
CN202110697290 | 2021-06-23 |
Related Child Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202410510957.4A Division CN118214843A (en) | 2021-06-17 | 2022-01-04 | Display device and electronic equipment with 3D camera module |
CN202410511147.0A Division CN118509570A (en) | 2021-06-17 | 2022-01-04 | Display device and electronic equipment with 3D camera module |
Publications (2)
Publication Number | Publication Date |
---|---|
CN115499640A CN115499640A (en) | 2022-12-20 |
CN115499640B true CN115499640B (en) | 2024-05-07 |
Family
ID=84465329
Family Applications (3)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202410511147.0A Pending CN118509570A (en) | 2021-06-17 | 2022-01-04 | Display device and electronic equipment with 3D camera module |
CN202210003173.3A Active CN115499640B (en) | 2021-06-17 | 2022-01-04 | Display device and electronic equipment with 3D camera module |
CN202410510957.4A Pending CN118214843A (en) | 2021-06-17 | 2022-01-04 | Display device and electronic equipment with 3D camera module |
Family Applications Before (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202410511147.0A Pending CN118509570A (en) | 2021-06-17 | 2022-01-04 | Display device and electronic equipment with 3D camera module |
Family Applications After (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202410510957.4A Pending CN118214843A (en) | 2021-06-17 | 2022-01-04 | Display device and electronic equipment with 3D camera module |
Country Status (1)
Country | Link |
---|---|
CN (3) | CN118509570A (en) |
Citations (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN106412557A (en) * | 2016-11-02 | 2017-02-15 | 深圳市魔眼科技有限公司 | 3D camera control method and 3D camera control device |
CN107483796A (en) * | 2017-09-26 | 2017-12-15 | 广东欧珀移动通信有限公司 | CCD camera assembly and terminal |
CN207321405U (en) * | 2017-11-01 | 2018-05-04 | 信丰世嘉科技有限公司 | A kind of camera lens module |
WO2018082481A1 (en) * | 2016-11-02 | 2018-05-11 | 深圳全息信息科技发展有限公司 | 3d camera module and 3d photographing device |
CN109756725A (en) * | 2017-08-25 | 2019-05-14 | 华为技术有限公司 | Structured light projection device, three-dimensional camera mould group and terminal device |
CN110062084A (en) * | 2019-05-30 | 2019-07-26 | Oppo广东移动通信有限公司 | A kind of terminal device |
CN110232863A (en) * | 2019-06-26 | 2019-09-13 | 深圳市光鉴科技有限公司 | Display device and electronic equipment with 3D camera module |
WO2020057208A1 (en) * | 2018-09-17 | 2020-03-26 | 深圳奥比中光科技有限公司 | Electronic device |
CN111399245A (en) * | 2020-05-13 | 2020-07-10 | 浙江水晶光电科技股份有限公司 | Laser emission module and 3D imaging device |
CN111556308A (en) * | 2020-06-15 | 2020-08-18 | 广东朗呈医疗器械科技有限公司 | Lens, three-dimensional imaging module and three-dimensional imaging equipment |
-
2022
- 2022-01-04 CN CN202410511147.0A patent/CN118509570A/en active Pending
- 2022-01-04 CN CN202210003173.3A patent/CN115499640B/en active Active
- 2022-01-04 CN CN202410510957.4A patent/CN118214843A/en active Pending
Patent Citations (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN106412557A (en) * | 2016-11-02 | 2017-02-15 | 深圳市魔眼科技有限公司 | 3D camera control method and 3D camera control device |
WO2018082481A1 (en) * | 2016-11-02 | 2018-05-11 | 深圳全息信息科技发展有限公司 | 3d camera module and 3d photographing device |
CN109756725A (en) * | 2017-08-25 | 2019-05-14 | 华为技术有限公司 | Structured light projection device, three-dimensional camera mould group and terminal device |
CN107483796A (en) * | 2017-09-26 | 2017-12-15 | 广东欧珀移动通信有限公司 | CCD camera assembly and terminal |
CN207321405U (en) * | 2017-11-01 | 2018-05-04 | 信丰世嘉科技有限公司 | A kind of camera lens module |
WO2020057208A1 (en) * | 2018-09-17 | 2020-03-26 | 深圳奥比中光科技有限公司 | Electronic device |
CN110062084A (en) * | 2019-05-30 | 2019-07-26 | Oppo广东移动通信有限公司 | A kind of terminal device |
CN110232863A (en) * | 2019-06-26 | 2019-09-13 | 深圳市光鉴科技有限公司 | Display device and electronic equipment with 3D camera module |
CN111399245A (en) * | 2020-05-13 | 2020-07-10 | 浙江水晶光电科技股份有限公司 | Laser emission module and 3D imaging device |
CN111556308A (en) * | 2020-06-15 | 2020-08-18 | 广东朗呈医疗器械科技有限公司 | Lens, three-dimensional imaging module and three-dimensional imaging equipment |
Also Published As
Publication number | Publication date |
---|---|
CN118509570A (en) | 2024-08-16 |
CN115499640A (en) | 2022-12-20 |
CN118214843A (en) | 2024-06-18 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11300828B2 (en) | Display device | |
CN109188711B (en) | Under-screen optical system, design method of diffractive optical element, and electronic apparatus | |
CN108469704B (en) | Hide in light emitting module of cell-phone screen below | |
US11546453B2 (en) | Projection module and terminal | |
RU2536080C2 (en) | Efficient collimation of light with optical wedge | |
CN110149510B (en) | 3D camera module and electronic equipment used under screen | |
EP3447561B1 (en) | Head-up display device | |
CN110290376B (en) | Display device with 3D camera module and electronic equipment | |
CN215499367U (en) | Display device and electronic equipment with 3D module of making a video recording | |
CN215499365U (en) | Projection lens, light projector and depth camera module | |
CN115499640B (en) | Display device and electronic equipment with 3D camera module | |
CN115499639B (en) | Display device and electronic equipment with 3D camera module | |
CN115499638B (en) | Display device and electronic equipment with 3D camera module | |
CN215499048U (en) | Display device and electronic equipment with 3D module of making a video recording | |
CN215499371U (en) | Display device and electronic equipment with 3D module of making a video recording | |
CN215499368U (en) | Display device and electronic equipment with 3D module of making a video recording | |
CN215499369U (en) | Display device and electronic equipment with 3D module of making a video recording | |
CN215499370U (en) | Display device and electronic equipment with 3D module of making a video recording | |
CN215499366U (en) | Display device and electronic equipment with 3D module of making a video recording | |
JP2011133583A (en) | Liquid crystal display device | |
CN215871663U (en) | Display device and electronic equipment with 3D module of making a video recording | |
CN216561292U (en) | Display device and electronic equipment with 3D module of making a video recording | |
CN215871662U (en) | Display device and electronic equipment with 3D module of making a video recording | |
CN213122576U (en) | Projection device | |
CN215499363U (en) | Display device and electronic equipment with 3D module of making a video recording |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |