CN111721233A - Three-dimensional sensing device, light emitting module and control method thereof - Google Patents
Three-dimensional sensing device, light emitting module and control method thereof Download PDFInfo
- Publication number
- CN111721233A CN111721233A CN202010565867.7A CN202010565867A CN111721233A CN 111721233 A CN111721233 A CN 111721233A CN 202010565867 A CN202010565867 A CN 202010565867A CN 111721233 A CN111721233 A CN 111721233A
- Authority
- CN
- China
- Prior art keywords
- light
- optical element
- area
- module
- transmitting area
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01B—MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
- G01B11/00—Measuring arrangements characterised by the use of optical techniques
- G01B11/24—Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
- G01S17/02—Systems using the reflection of electromagnetic waves other than radio waves
- G01S17/06—Systems determining position data of a target
- G01S17/46—Indirect determination of position data
- G01S17/48—Active triangulation systems, i.e. using the transmission and reflection of electromagnetic waves other than radio waves
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
- G01S17/88—Lidar systems specially adapted for specific applications
- G01S17/89—Lidar systems specially adapted for specific applications for mapping or imaging
- G01S17/894—3D imaging with simultaneous measurement of time-of-flight at a 2D array of receiver pixels, e.g. time-of-flight cameras or flash lidar
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
- G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
- G01S7/481—Constructional features, e.g. arrangements of optical elements
- G01S7/4816—Constructional features, e.g. arrangements of optical elements of receivers alone
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/09—Beam shaping, e.g. changing the cross-sectional area, not otherwise provided for
- G02B27/0938—Using specific optical elements
- G02B27/0944—Diffractive optical elements, e.g. gratings, holograms
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/09—Beam shaping, e.g. changing the cross-sectional area, not otherwise provided for
- G02B27/0938—Using specific optical elements
- G02B27/095—Refractive optical elements
Abstract
A three-dimensional sensing device is suitable for sensing an object to be detected. The three-dimensional sensing device comprises a light emitting module and a sensing module. The light emitting module is provided with a light transmitting area and an accommodating area which are communicated. The light emitting module comprises a light emitting element, a switching component, a first optical element and a second optical element. The light emitting element is positioned in the light transmitting area and used for outputting light rays. The switching component is used for selectively switching one of the first optical element and the second optical element to be positioned in the light transmission area and the other to be positioned in the accommodating area. The first optical element receives the light and outputs diffused light in the light-transmitting area, and the second optical element receives the light and outputs structured light spots in the light-transmitting area. The sensing module is adjacent to the light-emitting module and used for sensing diffused light or structural light spots reflected by the object to be detected.
Description
Technical Field
The present invention relates to a sensing device, a light emitting module and a control method thereof, and more particularly, to a three-dimensional sensing device, a light emitting module and a control method thereof suitable for a mobile device.
Background
Three-dimensional image acquisition technology has started to be applied to cameras of mobile devices such as smartphones in recent years with multifunctional applications, for example: face recognition is used for screen lock release application, distance measurement application and the like.
Disclosure of Invention
The inventor realizes that the front camera in the traditional mobile equipment is limited by a thin mechanism design space and cannot accommodate a larger type, so that the practical application is limited; however, if the designer configures a plurality of lenses with different functions to achieve diversified sensing functions, the front camera module is more likely to be bulky, which causes a problem in the application of the mobile device with a thin size.
In view of this, some embodiments of the present invention provide a three-dimensional sensing device, a light emitting module and a control method thereof, which are suitable for sensing a three-dimensional object to be measured, so as to solve the problem of the three-dimensional sensing device in the mechanism design.
In one embodiment, the three-dimensional sensing device is suitable for sensing an object to be measured. The three-dimensional sensing device comprises a light emitting module and a sensing module. The light emitting module is provided with a light transmitting area and an accommodating area which are communicated. The light emitting module comprises a light emitting element, a switching component, a first optical element and a second optical element. The light emitting element is located in the light transmitting area. The light emitting element is used for outputting luminous light. The first optical element can be movable between the light-transmitting area and the accommodating area. The first optical element receives the luminous light in the light-transmitting area and outputs diffused light. The second optical element can be movable between the light-transmitting area and the accommodating area. The second optical element receives the luminous light in the light-transmitting area and outputs the structural light spot. The switching component is connected to the first optical element and the second optical element. The switching component is used for selectively switching one of the first optical element and the second optical element to be positioned in the light transmission area and the other to be positioned in the accommodating area. The sensing module is adjacent to the light emitting module. The sensing module is used for sensing diffused light or structural light spots reflected by the object to be detected.
In one embodiment, the method further comprises: and the processing module is coupled with the sensing module and used for generating a three-dimensional image of the object to be detected according to the reflected diffused light or the structural light spots.
In one embodiment, the switching assembly further comprises a first transfer mechanism and a second transfer mechanism. The first transmission mechanism comprises a first connecting element connected with the first optical element, a first transmission assembly connected with the first connecting element, and a first driving unit connected with the first transmission assembly, wherein the first driving unit drives the first transmission assembly and the first connecting element to move the first optical element. The second transmission mechanism comprises a second connecting element connected with the second optical element, a second transmission assembly connected with the second connecting element, and a second driving unit connected with the second transmission assembly, wherein the second driving unit drives the second transmission assembly and the second connecting element to move the second optical element, and the first transmission mechanism and the second transmission mechanism are positioned in the accommodating area.
In one embodiment, the first and second transmission assemblies include transmission shafts, and the first and second driving units include stepping motors.
In one embodiment, the first optical element comprises a diffuser and the second optical element comprises a diffractive optical element.
In an embodiment, the surface area of the first optical element and the surface area of the second optical element are equal to or smaller than the surface area of the accommodating area, and the first optical element and the second optical element are parallel to the plane of the light emitting element.
In one embodiment, the light emitting module is suitable for a three-dimensional sensing device. The light emitting module comprises a light transmitting area, an accommodating area, a light emitting element, a first optical element, a second optical element and a switching assembly which are communicated with each other. And the light-emitting element is positioned in the light-transmitting area and used for outputting luminous rays. The first optical element can move between the light-transmitting area and the accommodating area, and receives the luminous light and outputs diffused light in the light-transmitting area. The second optical element can be movably arranged between the light-transmitting area and the accommodating area, and receives the luminous light in the light-transmitting area and outputs the structural light spots. And the switching component is connected with the first optical element and the second optical element and used for selectively switching one of the first optical element and the second optical element to be positioned in the light-transmitting area and the other to be positioned in the accommodating area.
In one embodiment, the switching assembly further comprises a first transfer mechanism and a second transfer mechanism. The first transmission mechanism comprises a first connecting element connected with the first optical element, a first transmission assembly connected with the first connecting element, and a first driving unit connected with the first transmission assembly, wherein the first driving unit drives the first transmission assembly and the first connecting element to move the first optical element. The second transmission mechanism comprises a second connecting element connected with the second optical element, a second transmission assembly connected with the second connecting element, and a second driving unit connected with the second transmission assembly, wherein the second driving unit drives the second transmission assembly and the second connecting element to move the second optical element, and the first transmission mechanism and the second transmission mechanism are positioned in the accommodating area.
In one embodiment, the first and second transmission assemblies include transmission shafts, and the first and second driving units include stepping motors.
In one embodiment, the first optical element comprises a diffuser and the second optical element comprises a diffractive optical element.
In an embodiment, the surface area of the first optical element and the surface area of the second optical element are equal to or smaller than the surface area of the accommodating area, and the first optical element and the second optical element are parallel to the plane of the light emitting element.
In one embodiment, a method for controlling a light emitting module suitable for three-dimensional sensing of an object to be measured includes the steps of:
outputting light rays in the light-transmitting area by the light-emitting element;
the switching component selectively switches one of the first optical element and the second optical element to be positioned in the light-transmitting area and the other one to be positioned in the accommodating area communicated with the light-transmitting area, wherein the first optical element and the second optical element can be movably arranged between the light-transmitting area and the accommodating area;
when the first optical element is positioned in the light-transmitting area, the first optical element receives the luminous light and outputs diffused light, and the second optical element is positioned in the accommodating area;
when the second optical element is positioned in the light-transmitting area, the second optical element receives the luminous light and outputs the structural light spot, and the first optical element is positioned in the accommodating area; and
the sensing module senses the diffused light or the structural light spots reflected by the object to be measured.
In one embodiment, the method further comprises the following steps:
when the first optical element is positioned in the light-transmitting area, the processing module generates a three-dimensional image of the object to be measured according to the reflected diffused light; and
when the second optical element is positioned in the light-transmitting area, the processing module generates a three-dimensional image of the object to be measured according to the reflected structural light spots.
In one embodiment, the switching assembly further drives the first transmission assembly and the first connecting element connected to each other through the first driving unit to move the first optical element, and drives the second transmission assembly and the second connecting element connected to each other through the second driving unit to move the second optical element.
In one embodiment, the first optical element comprises a diffuser and the second optical element comprises a diffractive optical element.
The three-dimensional sensing device mainly utilizes the switching component to selectively switch one of the first optical element and the second optical element to be positioned in the light transmission area, thereby forming the composite optical lens group, being capable of adaptively providing the required diffused light or structural light spots under different applications, then the sensing module receives the reflected diffused light or structural light spots and converts the corresponding optical signals into electric signals, so that the device can be used for carrying out three-dimensional identification on the application light spots subsequently. Meanwhile, the accommodating area positioned in the three-dimensional sensing device can accommodate components required by the light-emitting module, so that the space utilization rate is improved, and the thin packaging requirement is met.
The invention is described in detail below with reference to the drawings and specific examples, but the invention is not limited thereto.
Drawings
Fig. 1 is a functional block diagram of a three-dimensional sensing device according to an embodiment of the invention.
Fig. 2A is a schematic side view of a three-dimensional sensing device according to an embodiment of the invention.
Fig. 2B is a schematic view illustrating an operation state of the three-dimensional sensing device shown in fig. 2A.
Fig. 2C is a schematic view illustrating an operation state of the three-dimensional sensing device shown in fig. 2A.
FIG. 3A is a schematic diagram illustrating a second perspective side view of the three-dimensional sensing device shown in FIG. 2B.
FIG. 3B is a schematic diagram illustrating a second perspective side view of the three-dimensional sensing device shown in FIG. 2C.
Fig. 4A is a schematic top view of a light emitting module according to another embodiment of the invention.
Fig. 4B is a side view of the light emitting module shown in fig. 4A.
Fig. 5 is a flowchart illustrating a method for controlling a light emitting module suitable for three-dimensional sensing of an object according to another embodiment of the invention.
Detailed Description
The invention will be described in detail with reference to the following drawings, which are provided for illustration purposes and the like:
the following detailed description of embodiments of the invention is provided for the purpose of illustration in the accompanying drawings. Aside from the details given herein, this invention is capable of broad application to other embodiments and that various other substitutions, modifications, and equivalents may be made in the embodiments without departing from the scope of the invention as defined by the appended claims. In the description of the specification, numerous specific details are set forth in order to provide a more thorough understanding of the invention; however, the present invention may be practiced without some or all of these specific details. In other instances, well-known steps or elements have not been described in detail so as not to unnecessarily obscure the present invention. The same or similar components in the drawings will be denoted by the same or similar symbols. It is specifically noted that the drawings are merely schematic and do not represent actual sizes or numbers of components.
Fig. 1 is a functional block diagram of a three-dimensional sensing device according to an embodiment of the invention. Fig. 2A is a schematic side view of a three-dimensional sensing device according to an embodiment of the invention. Fig. 2B is a schematic view illustrating an operation state of the three-dimensional sensing device shown in fig. 2A. Fig. 2C is a schematic view illustrating an operation state of the three-dimensional sensing device shown in fig. 2A. FIG. 3A is a schematic diagram illustrating a second perspective side view of the three-dimensional sensing device shown in FIG. 2B. FIG. 3B is a schematic diagram illustrating a second perspective side view of the three-dimensional sensing device shown in FIG. 2C. Meanwhile, fig. 3B is a schematic diagram of different operating states of the three-dimensional sensing device shown in fig. 3A.
Referring to fig. 1 to fig. 3B, a three-dimensional sensing device according to an embodiment of the invention includes a light emitting module 10 and a sensing module 20. For example, three-dimensional sensing devices such as: front-facing and/or rear-facing cameras of mobile devices such as smart phones and tablet computers. The three-dimensional sensing device is used for acquiring a three-dimensional image of the object to be measured A or measuring the distance between the object to be measured A and the three-dimensional sensing device, namely the depth. The analyte a may be, but is not limited to: an object, animal or human face.
The light emitting module 10 includes a light emitting device 12, a first optical device 14, a second optical device 16 and a switching component 18, wherein the first optical device 14 and the second optical device 16 are respectively connected to the switching component 18. On the other hand, the light emitting module 10 has a light transmitting region 100 and a receiving region 102 communicating with each other. The light emitting element 12 is located in the transparent region 100, the switching element 18 is located in the accommodating region 102, the first optical element 14 is movable between the transparent region 100 and the accommodating region 102, and the second optical element 16 is movable between the transparent region 100 and the accommodating region 102. Specifically, the light-transmitting area 100 and the accommodating area 102 are communicated with each other along the horizontal direction, and the first optical element 14 and the second optical element 16 can move back and forth between the communicated positions. In addition, the switching element 18 is connected to the first optical element 14 and the second optical element 16, and the switching element 18 is used for selectively switching one of the first optical element 14 and the second optical element 16 to be located in the light-transmitting area 100 and the other to be located in the accommodating area 102.
For example, as shown in fig. 3A, the light emitting module 10 has a housing 11 viewed from a second perspective, i.e., a Y-Z cross-section, of the three-dimensional sensing device. The housing 11 forms a cavity, and further divides a light-transmitting region 100 and a receiving region 102 inside the cavity, wherein the light-transmitting region 100 and the receiving region 102 are adjacent to each other and integrated into a single body. The housing 11 further has an opening 110 above the light-transmitting area 100 and a receiving space 112 above the receiving area 102. In some examples, the light emitting element 12 and the first optical element 14 are disposed below the opening 110, and the second optical element 16, the switching element 18, and the components 13 required by the light emitting module 10 are accommodated in the accommodating space 112. Wherein, the component 13 can be, but is not limited to: electronic components, Integrated Circuits (ICs), circuit boards (PCBs), and heat sinks.
In different operation states, the first optical element 14 can move into the receiving space 112 of the accommodating area 102, and the second optical element 16 can move below the opening 110 of the light-transmitting area 100 at the same time, as shown in fig. 3B, which will be described in detail later.
Referring to fig. 3A and fig. 3B, the light emitting element 12 is located in the transparent region 100 and outputs the light L upward from a second viewing angle of the three-dimensional sensing device, i.e., a Y-Z cross section. For example, the light emitting element may be a Vertical Cavity Surface Emitting Laser (VCSEL), a laser diode, a Light Emitting Diode (LED), or an Organic Light Emitting Diode (OLED), but is not limited thereto. In at least one embodiment, the light L includes, but is not limited to, infrared light. In the present embodiment, in the operation state shown in fig. 3A, the first optical element 14 is located above the light emitting element 12 in the light transmitting region 100, and the second optical element 16 is located in the accommodating region 102. Thereby, the first optical element 14 receives the emitted light L from the light emitting element 12 in the light transmitting region 100, and outputs the diffused light L1 to the object a through the opening 110. For example, the first optical element 14 can be a diffusion sheet (Diffuser), or a light-transmissive plate with a light-homogenizing effect, such as but not limited to: acrylic sheets, glass sheets, plastic sheets, and the like.
However, in a different operation state, as shown in fig. 3B, the second optical element 16 is located above the light emitting element 12 in the light transmitting region 100, and the first optical element 14 is located in the accommodating region 102. Thereby, the second optical element 16 receives the emitted light L from the light emitting element 12 in the light transmitting region 100, and outputs the structure light spot L2 to the object a through the opening 110. For example, the second optical element 16 may be a Diffractive Optical Element (DOE), but is not limited thereto.
The sensing module 20 is adjacent to the light emitting module 10, and the sensing module 20 receives external light and converts a corresponding optical signal into a digital/analog electrical signal through a conversion circuit to output the electrical signal. As mentioned above, when the light emitting module 10 outputs the diffused light L1 to the object a to be measured, the external light received by the sensing module 20 is the diffused light L1 reflected by the object a to be measured; however, when the light emitting module 10 outputs the structure light spot L2 to the object a to be tested, the external light received by the sensing module 20 is the structure light spot L2 reflected by the object a to be tested. In short, the sensing module 20 senses the diffused light L1 or the structure light spot L2 reflected by the object a to be measured. Specifically, the sensing module 20 is a sensor such as, but not limited to, a CMOS sensor or a CCD sensor.
According to the above structure, the three-dimensional sensing device mainly utilizes the switching component 18 to selectively switch one of the first optical element 14 and the second optical element 16 to be located in the transparent region 100, thereby forming a composite optical lens set, which can adaptively provide the diffused light L1 or the structural light spot L2 required under different applications, and then the sensing module 20 receives the reflected diffused light L1 or the structural light spot L2 and converts the corresponding optical signal into an electrical signal for the device to perform the subsequent three-dimensional recognition application. For example, in practical applications, the scene sensed by the three-dimensional sensing device may be a distant scene (e.g., a distant building) or a close scene (e.g., a human face), the diffused light is suitable for sensing the distant scene, and the structured light spot is suitable for sensing the close scene (described later), so that the functions of the distant scene and the close scene in the sensed scene can be switched on the same three-dimensional sensing device, thereby achieving a more accurate three-dimensional image recognition application. In some embodiments, the three-dimensional sensing device is a front lens of a mobile device, and the switching component 18 switches the compound optical lens group to the first optical element 14 to output a uniform light source, i.e., diffused light L1, for long-range sensing identification application, or to the second optical element 16 to output a speckle point light source, i.e., a structure light spot L2, for short-range sensing identification application, so as to switch long-range sensing and short-range sensing identification. Meanwhile, the accommodating area 102 in the three-dimensional sensing device can accommodate the components 13 required by the light emitting module 10, thereby improving the space utilization rate and meeting the requirement of thin packaging.
In some embodiments, referring to fig. 1 and fig. 2A together, the three-dimensional sensing device further includes a processing module 30. The processing module 30 is coupled to the sensing module 20, and the processing module 30 receives the electrical signal output by the sensing module 20. In an exemplary embodiment, when the switching component 18 switches the first optical element 14 to the transparent region 100, the processing module 30 generates a three-dimensional image of the object a to be measured according to the reflected diffused light L1 by using a time-of-flight ranging (Tof) algorithm, for example, for a three-dimensional image recognition application; when the switching component 18 switches the second optical element 16 to the transparent region 100, the processing module 30 generates a three-dimensional image of the object a to be measured by, for example, a depth algorithm according to the reflected structure light spot L2 for three-dimensional image recognition application. The time-of-flight distance measurement (Tof) algorithm achieves the function of three-dimensional image recognition by calculating the light reflection time, and the depth algorithm achieves the function of three-dimensional image recognition by calculating the light reflection angle. Therefore, the sensing effect of the diffused light adopting the time-of-flight distance measurement (Tof) algorithm as the calculation basis on the long-range view is excellent, and the sensing effect of the structural light spot adopting the depth algorithm as the calculation basis on the short-range view is excellent.
In some embodiments, the light emitting module 10 and the sensing module 20 are adjacent to each other and located at the same horizontal plane, for example, the light emitting module 10 and the sensing module 20 are located on the same substrate (not numbered) as illustrated in fig. 2A.
In some embodiments, the light emitting element 12 has a plurality of light emitting units in a regular distribution, for example, an array (array) distribution, for example, the surface of the light emitting element 12 has a plurality of openings in an array for outputting light. Therefore, when the light emitting element 12 is driven to light, the luminous light L can be output.
In some embodiments, the second optical element 16 has a plurality of microstructure units distributed irregularly, which is not meant to be distributed randomly, for example, the second optical element 16 has a microstructure distributed randomly along a horizontal direction, such as a Y-axis shown in fig. 3B. Here, when the light emitting element 12 is driven to light, the light emitting light L is output toward the second optical element 16 to output the irregular pattern of the structured light spot L2.
In some embodiments, the surface area of the first optical element 14 and the surface area of the second optical element 16 are equal to or smaller than the surface area of the receiving area 102, and the first optical element 14 and the second optical element 16 are parallel to the plane of the light emitting element 12.
Fig. 4A is a schematic top view of a light emitting module according to another embodiment of the invention. Fig. 4B is a side view of the light emitting module shown in fig. 4A.
Referring to fig. 4A and 4B, in some embodiments, the switching assembly 18 further includes a first conveying mechanism 180 and a second conveying mechanism 182, and the first conveying mechanism 180 and the second conveying mechanism 182 are located in the accommodating area 102. The first transfer mechanism 180 comprises a first linkage element 1800, a first transmission module 1802, and a first drive unit 1804. Wherein the first connecting element 1800 is connected to the first optical element 14, the first transmission module 1802 is connected to the first connecting element 1800, and the first drive unit 1804 is connected to the first transmission module 1802. Here, the first driving unit 1804 drives the first transmission member 1802 and the first connecting member 1800, thereby moving the first optical element 14 in the Y-axis direction.
The second transmission mechanism 182 includes a second connecting element 1820, a second transmission assembly 1822, and a second driving unit 1824. The second connecting element 1820 is connected to the second optical element 16, the second actuator 1822 is connected to the second connecting element 1820, and the second driving unit 1824 is connected to the second actuator 1822. Here, the second driving unit 1824 drives the second transmission member 1822 and the second connecting element 1820, thereby moving the second optical element 16 along the Y-axis direction.
In some embodiments, the first and second drive assemblies 1802, 1822 may be, but are not limited to, drive shafts, and the first and second drive units 1804, 1824 may be, but are not limited to, stepper motors.
Referring to fig. 1 to 5, a method for controlling a light emitting module suitable for three-dimensional sensing of an object to be measured according to another embodiment of the present invention includes the following steps. First, the light emitting element 12 outputs the light emitting light L in the light transmitting area 100 (S1). In some embodiments of step S1, the light emitting element 12 is located in the light transmitting area 100 and outputs the light L upward. For example, the light emitting element may be a Vertical Cavity Surface Emitting Laser (VCSEL), a laser diode, a Light Emitting Diode (LED), or an Organic Light Emitting Diode (OLED), but is not limited thereto. In at least one embodiment, the light L includes, but is not limited to, infrared light. The details, advantages, and derivations of the embodiments are set forth in the description.
Next, the switching component 18 selectively switches one of the first optical element 14 and the second optical element 16 to be located in the transparent region 100 and the other to be located in the accommodating region 102 communicated with the transparent region 100, wherein the first optical element 14 and the second optical element 16 are movable between the transparent region 100 and the accommodating region 102 (S2). In some embodiments of step S2, the light emitting module 10 has a light-transmitting area 100 and a receiving area 102 communicating with each other. The light emitting element 12 is located in the transparent region 100, the switching element 18 is located in the accommodating region 102, the first optical element 14 is movable between the transparent region 100 and the accommodating region 102, and the second optical element 16 is movable between the transparent region 100 and the accommodating region 102. Specifically, the light-transmitting area 100 and the accommodating area 102 are communicated with each other along the horizontal direction, and the first optical element 14 and the second optical element 16 can move back and forth between the communicated positions. In addition, the switching element 18 is connected to the first optical element 14 and the second optical element 16, and the switching element 18 is used for selectively switching one of the first optical element 14 and the second optical element 16 to be located in the light-transmitting area 100 and the other to be located in the accommodating area 102. The details, advantages, and derivations of the embodiments are set forth in the description.
Next, when the first optical element 14 is located in the light-transmitting area 100, the first optical element 14 receives the light-emitting light L and outputs the diffused light L1, and the second optical element 16 is located in the accommodating area 102 (S31); however, when the second optical element 16 is located in the light-transmitting area 100, the second optical element 16 receives the light L and outputs the structure light spot L2, and the first optical element 14 is located in the accommodating area 102 (S32). For example, in an exemplary case of the step S31, the first optical element 14 is, for example but not limited to, a diffusion sheet to receive the light L from the light emitting element 12 and output a diffused light L1; in an exemplary case of step S32, the second optical element 16 is, for example but not limited to, a diffractive optical element to receive the light L from the light emitting element 12 and output the structure light spot L2. The details, advantages, and derivations of the embodiments are set forth in the description.
Subsequently, the sensing module 20 senses the diffused light L1 or the structure light spot L2 reflected by the object a (S4). In some embodiments of step S4, the sensing module 20 receives external light and converts the corresponding light signal into a digital/analog electrical signal through a conversion circuit to output the electrical signal. As mentioned above, when the light emitting module 10 outputs the diffused light L1 to the object a to be measured, the external light received by the sensing module 20 is the diffused light L1 reflected by the object a to be measured; however, when the light emitting module 10 outputs the structure light spot L2 to the object a to be tested, the external light received by the sensing module 20 is the structure light spot L2 reflected by the object a to be tested. The details, advantages, and derivations of the embodiments are set forth in the description.
According to the above description, the method for controlling a light emitting module suitable for three-dimensional sensing of an object to be tested mainly utilizes the switching component 18 to selectively switch one of the first optical element 14 and the second optical element 16 to be located in the light transmitting region 100, thereby forming a composite optical lens assembly, which can adaptively provide the diffused light L1 or the structural light spot L2 required by different applications, and then the sensing module 20 receives the reflected diffused light L1 and converts the corresponding optical signal into an electrical signal for the subsequent three-dimensional recognition application of the device, or the sensing module 20 receives the reflected structural light spot L2 and converts the corresponding optical signal into an electrical signal for the subsequent three-dimensional recognition application of the device. For example, the three-dimensional sensing device is a front lens of a mobile device, and the switching component 18 switches the compound optical lens group to the first optical element 14 to output a uniform light source, i.e., a diffused light L1, for long-range sensing identification application, or switches to the second optical element 16 to output a speckle point light source, i.e., a structure light spot L2, for short-range sensing identification application, so as to realize switching between long-range sensing and short-range sensing identification.
In some embodiments, when the first optical element 14 is located in the light-transmitting area 100, the processing module 30 generates a three-dimensional image of the object a according to the reflected diffused light L1; when the second optical element 16 is located in the light-transmitting area 100, the processing module 30 generates a three-dimensional image of the object a according to the reflected structure light spot L2. For example, when the switching component 18 switches the first optical element 14 to the transparent region 100, the processing module 30 generates a three-dimensional image of the object a to be measured by, for example, a time-of-flight distance measurement (Tof) algorithm according to the reflected diffused light L1 for application of three-dimensional image recognition; when the switching component 18 switches the second optical element 16 to the transparent region 100, the processing module 30 generates a three-dimensional image of the object a to be measured by, for example, a depth algorithm according to the reflected structure light spot L2 for three-dimensional image recognition application.
In some embodiments, the switching assembly 18 also drives the first transmission assembly 1802 and the first connecting element 1800 coupled to move the first optical element 14 via the first drive unit 1804, and drives the second transmission assembly 1822 and the second connecting element 1820 coupled to move the second optical element 16 via the second drive unit 1824. The details, advantages, and derivations of the embodiments are set forth in the description.
In summary, according to the three-dimensional sensing device, the light emitting module and the control method thereof of some embodiments of the present invention, the switching assembly 18 is mainly utilized to selectively switch one of the first optical element 14 and the second optical element 16 to be located in the light transmitting area 100, so as to form a composite optical lens set, which can adaptively provide the diffused light L1 or the structural light spot L2 required by different applications, and then the sensing module 20 receives the reflected diffused light L1 and converts the corresponding light signal into an electrical signal for the subsequent three-dimensional identification application of the device, or the sensing module 20 receives the reflected structural light spot L2 and converts the corresponding light signal into an electrical signal for the subsequent three-dimensional identification application of the device. For example, the three-dimensional sensing device is a front lens of a mobile device, and the switching component 18 switches the compound optical lens group to the first optical element 14 to output a uniform light source, i.e., a diffused light L1, for long-range sensing identification application, or switches to the second optical element 16 to output a speckle point light source, i.e., a structure light spot L2, for short-range sensing identification application, so as to realize switching between long-range sensing and short-range sensing identification. Meanwhile, the accommodating area 102 in the three-dimensional sensing device can accommodate the components 13 required by the light emitting module 10, thereby improving the space utilization rate and meeting the requirement of thin packaging. Therefore, the three-dimensional sensing device can be compactly configured in a limited space of the mobile equipment, and a diversified sensing function is realized, so that the problem of the three-dimensional sensing device in mechanism design is solved.
The present invention may be embodied in other specific forms without departing from the spirit or essential attributes thereof, and it should be understood that various changes and modifications can be effected therein by one skilled in the art without departing from the spirit and scope of the invention as defined in the appended claims.
Claims (15)
1. A three-dimensional sensing device suitable for sensing an object to be measured, comprising:
the light emitting module, have the light transmission region and the holding region that are linked together, this light emitting module contains:
a light emitting element located in the light transmitting region for outputting light;
the first optical element can move between the light-transmitting area and the accommodating area, and receives the luminous light and outputs diffused light in the light-transmitting area;
the second optical element can move between the light-transmitting area and the accommodating area, and receives the luminous light in the light-transmitting area and outputs structural light spots; and
a switching assembly connected to the first optical element and the second optical element for selectively switching one of the first optical element and the second optical element to be located in the transparent region and the other to be located in the accommodating region; and
and the sensing module is adjacent to the light-emitting module and used for sensing the diffused light or the structural light spot reflected by the object to be detected.
2. The apparatus of claim 1, further comprising:
and the processing module is coupled with the sensing module and used for generating a three-dimensional image of the object to be detected according to the reflected diffused light or the structure light spot.
3. The apparatus of claim 1, wherein the switching element further comprises:
a first transmission mechanism including a first connecting element connected to the first optical element, a first transmission assembly connected to the first connecting element, and a first driving unit connected to the first transmission assembly, wherein the first driving unit drives the first transmission assembly and the first connecting element to move the first optical element; and
the second transmission mechanism comprises a second connecting element connected with the second optical element, a second transmission assembly connected with the second connecting element, and a second driving unit connected with the second transmission assembly, wherein the second driving unit drives the second transmission assembly and the second connecting element to move the second optical element, and the first transmission mechanism and the second transmission mechanism are positioned in the accommodating area.
4. The apparatus of claim 3, wherein the first and second transmission assemblies comprise transmission shafts, and the first and second driving units comprise stepper motors.
5. The apparatus of claim 1, wherein the first optical element comprises a diffuser and the second optical element comprises a diffractive optical element.
6. The apparatus of claim 1, wherein the surface area of the first optical element and the surface area of the second optical element are equal to or smaller than the surface area of the receiving area, and the first optical element and the second optical element are parallel to the plane of the light-emitting element.
7. A light emitting module suitable for a three-dimensional sensing device, comprising:
the light transmitting area and the accommodating area are communicated;
a light emitting element located in the light transmitting region for outputting light;
the first optical element can move between the light-transmitting area and the accommodating area, and receives the luminous light and outputs diffused light in the light-transmitting area;
the second optical element can move between the light-transmitting area and the accommodating area, and receives the luminous light in the light-transmitting area and outputs structural light spots; and
and the switching component is connected with the first optical element and the second optical element and used for selectively switching one of the first optical element and the second optical element to be positioned in the light-transmitting area and the other to be positioned in the accommodating area.
8. The module of claim 7, wherein the switching element further comprises:
a first transmission mechanism including a first connecting element connected to the first optical element, a first transmission assembly connected to the first connecting element, and a first driving unit connected to the first transmission assembly, wherein the first driving unit drives the first transmission assembly and the first connecting element to move the first optical element; and
the second transmission mechanism comprises a second connecting element connected with the second optical element, a second transmission assembly connected with the second connecting element, and a second driving unit connected with the second transmission assembly, wherein the second driving unit drives the second transmission assembly and the second connecting element to move the second optical element, and the first transmission mechanism and the second transmission mechanism are positioned in the accommodating area.
9. The module of claim 8, wherein the first transmission assembly and the second transmission assembly comprise transmission shafts, and the first drive unit and the second drive unit comprise stepper motors.
10. The module of claim 7, wherein the first optical element comprises a diffuser and the second optical element comprises a diffractive optical element.
11. The module of claim 7, wherein the surface area of the first optical element and the surface area of the second optical element are equal to or smaller than the surface area of the receiving area, and the first optical element and the second optical element are parallel to the plane of the light-emitting element.
12. A control method of a light emitting module suitable for three-dimensional sensing of an object to be measured is characterized by comprising the following steps:
outputting light rays in the light-transmitting area by the light-emitting element;
the switching component selectively switches one of the first optical element and the second optical element to be positioned in the light-transmitting area and the other one to be positioned in the accommodating area communicated with the light-transmitting area, wherein the first optical element and the second optical element can be movably arranged between the light-transmitting area and the accommodating area;
when the first optical element is positioned in the light-transmitting area, the first optical element receives the luminous light and outputs diffused light, and the second optical element is positioned in the accommodating area;
when the second optical element is positioned in the light-transmitting area, the second optical element receives the luminous light and outputs a structural light spot, and the first optical element is positioned in the accommodating area; and
the sensing module senses the diffused light or the structural light spot reflected by the object to be measured.
13. The method of claim 12, further comprising the steps of:
when the first optical element is positioned in the light-transmitting area, the processing module generates a three-dimensional image of the object to be detected according to the reflected diffused light; and
when the second optical element is positioned in the light-transmitting area, the processing module generates a three-dimensional image of the object to be measured according to the reflected structural light spot.
14. The method of claim 12, wherein the switching assembly further drives a first transmission assembly and a first connecting element connected through a first driving unit to move the first optical element, and drives a second transmission assembly and a second connecting element connected through a second driving unit to move the second optical element.
15. The method of claim 12, wherein the first optical element comprises a diffuser and the second optical element comprises a diffractive optical element.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010565867.7A CN111721233B (en) | 2020-06-19 | 2020-06-19 | Three-dimensional sensing device, light emitting module and control method thereof |
| TW109129964A TWI755046B (en) | 2020-06-19 | 2020-09-01 | 3d sensing device, lighting module and control method thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010565867.7A CN111721233B (en) | 2020-06-19 | 2020-06-19 | Three-dimensional sensing device, light emitting module and control method thereof |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111721233A true CN111721233A (en) | 2020-09-29 |
| CN111721233B CN111721233B (en) | 2022-05-31 |
Family
ID=72567766
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010565867.7A Active CN111721233B (en) | 2020-06-19 | 2020-06-19 | Three-dimensional sensing device, light emitting module and control method thereof |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN111721233B (en) |
| TW (1) | TWI755046B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112965152A (en) * | 2021-03-16 | 2021-06-15 | 广州立景创新科技有限公司 | Composite diffusion sheet, illumination module, and three-dimensional scanning device |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH1075051A (en) * | 1996-07-05 | 1998-03-17 | Toyota Motor Corp | Visual inspection device |
| CN1866084A (en) * | 2005-05-17 | 2006-11-22 | 日本电气株式会社 | Display device with switchable viewing angle, and terminal device |
| CN101504477A (en) * | 2008-02-04 | 2009-08-12 | 富士施乐株式会社 | Optical transmission module |
| CN101833225A (en) * | 2010-05-06 | 2010-09-15 | 东莞市南星电子有限公司 | Method and mechanism for switching optical filter of photographic lens |
| CN102053297A (en) * | 2010-12-14 | 2011-05-11 | 中国科学院长春光学精密机械与物理研究所 | Multispectral reflective filtering mechanism |
| CN102222347A (en) * | 2010-06-16 | 2011-10-19 | 微软公司 | Creating range image through wave front coding |
| CN106123915A (en) * | 2016-06-08 | 2016-11-16 | 中国科学院光电技术研究所 | A kind of pneumatic degraded image recovery system based on direct point spread function |
| CN110296825A (en) * | 2019-08-02 | 2019-10-01 | 永康微唯智能科技有限公司 | A kind of materials used for cement pipes internal interstices detection device |
| CN110493400A (en) * | 2019-08-28 | 2019-11-22 | Oppo广东移动通信有限公司 | Projective module group and terminal |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2005010623A2 (en) * | 2003-07-24 | 2005-02-03 | Zebra Imaging, Inc. | Enhanced environment visualization using holographic stereograms |
| US10969668B2 (en) * | 2018-07-24 | 2021-04-06 | Qualcomm Incorporated | Adjustable light distribution for active depth sensing systems |
-
2020
- 2020-06-19 CN CN202010565867.7A patent/CN111721233B/en active Active
- 2020-09-01 TW TW109129964A patent/TWI755046B/en active
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH1075051A (en) * | 1996-07-05 | 1998-03-17 | Toyota Motor Corp | Visual inspection device |
| CN1866084A (en) * | 2005-05-17 | 2006-11-22 | 日本电气株式会社 | Display device with switchable viewing angle, and terminal device |
| CN101504477A (en) * | 2008-02-04 | 2009-08-12 | 富士施乐株式会社 | Optical transmission module |
| CN101833225A (en) * | 2010-05-06 | 2010-09-15 | 东莞市南星电子有限公司 | Method and mechanism for switching optical filter of photographic lens |
| CN102222347A (en) * | 2010-06-16 | 2011-10-19 | 微软公司 | Creating range image through wave front coding |
| CN102053297A (en) * | 2010-12-14 | 2011-05-11 | 中国科学院长春光学精密机械与物理研究所 | Multispectral reflective filtering mechanism |
| CN106123915A (en) * | 2016-06-08 | 2016-11-16 | 中国科学院光电技术研究所 | A kind of pneumatic degraded image recovery system based on direct point spread function |
| CN110296825A (en) * | 2019-08-02 | 2019-10-01 | 永康微唯智能科技有限公司 | A kind of materials used for cement pipes internal interstices detection device |
| CN110493400A (en) * | 2019-08-28 | 2019-11-22 | Oppo广东移动通信有限公司 | Projective module group and terminal |
Non-Patent Citations (3)
| Title |
|---|
| YOUNG RAN PARK等: "Resistive switching functional quantum-dot light-emitting diodes", 《CURRENT APPLIED PHYSICS》, vol. 19, no. 2, 28 February 2019 (2019-02-28), pages 102 - 107 * |
| 宋宪政: "皮下静脉三维重建及快速显影系统研究", 《中国优秀硕士学位论文全文数据库（信息科技辑）》, no. 7, 15 July 2015 (2015-07-15), pages 51 * |
| 田丰等: "真三维影像的编解码和几何校正方法研究", 《华东师范大学学报(自然科学版)》, no. 3, 31 December 2012 (2012-12-31), pages 97 - 102 * |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112965152A (en) * | 2021-03-16 | 2021-06-15 | 广州立景创新科技有限公司 | Composite diffusion sheet, illumination module, and three-dimensional scanning device |
| CN112965152B (en) * | 2021-03-16 | 2023-02-03 | 广州立景创新科技有限公司 | Composite diffusion sheet, illumination module and three-dimensional scanning device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111721233B (en) | 2022-05-31 |
| TW202109140A (en) | 2021-03-01 |
| TWI755046B (en) | 2022-02-11 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106055172B (en) | Optical navigation chip, optical navigation module and optical encoder | |
| US8866064B2 (en) | Multi-directional proximity sensor | |
| US7244925B2 (en) | Compact and low profile optical navigation device | |
| CN107845627B (en) | Multiple proximity detection light sensor | |
| CN106662740B (en) | Compact lighting system | |
| CN109597211B (en) | Projection module, depth camera and depth image acquisition method | |
| CN211378086U (en) | Camera module type sensor device and camera module | |
| CN111721233B (en) | Three-dimensional sensing device, light emitting module and control method thereof | |
| US8847915B2 (en) | Light pipe array lens, optical finger navigation device with the lens and method for making the device | |
| US7615733B2 (en) | Optical navigation apparatus and method for making the apparatus | |
| KR20080043930A (en) | Optical sensor module | |
| US20210305224A1 (en) | Optical navigation module capable of performing lateral detection | |
| CN109766861A (en) | Multifunctional bio feature detection device and electronic equipment | |
| CN100527063C (en) | Optical input mechanism of luminous chip fixed on sensing chip and manufacturing method therefor | |
| TWI583985B (en) | Optical device | |
| KR20230042544A (en) | Flash light emitter with remote communication function | |
| CN209486696U (en) | Multifunctional bio feature detection device and electronic equipment | |
| CN209707875U (en) | Electronic equipment and back light unit | |
| TWM520147U (en) | Optical device | |
| CN111721232B (en) | Three-dimensional sensing device, light emitting module and control method thereof | |
| CN113472995B (en) | Dynamic automatic focusing system and method based on SPAD sensor receiving module | |
| CN201302646Y (en) | An integrated imaging device and a related portable electronic device | |
| KR20220013778A (en) | Distance measuring camera | |
| JP3098881U (en) | Displacement sensor head that inputs and outputs directly to a personal computer with digital output | |
| KR20140060174A (en) | Visual presenter |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |