CN109541876B - Light source structure, optical projection module, sensing device and equipment - Google Patents
Light source structure, optical projection module, sensing device and equipment Download PDFInfo
- Publication number
- CN109541876B CN109541876B CN201811411412.9A CN201811411412A CN109541876B CN 109541876 B CN109541876 B CN 109541876B CN 201811411412 A CN201811411412 A CN 201811411412A CN 109541876 B CN109541876 B CN 109541876B
- Authority
- CN
- China
- Prior art keywords
- light
- light emitting
- emitting units
- emitting unit
- correlation coefficient
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 230000003287 optical effect Effects 0.000 title claims abstract description 36
- 239000004065 semiconductor Substances 0.000 claims abstract description 46
- 239000000758 substrate Substances 0.000 claims abstract description 45
- 230000000875 corresponding effect Effects 0.000 description 15
- 238000000034 method Methods 0.000 description 9
- 230000002596 correlated effect Effects 0.000 description 8
- 238000004364 calculation method Methods 0.000 description 7
- 230000006870 function Effects 0.000 description 7
- 238000004519 manufacturing process Methods 0.000 description 6
- 238000011835 investigation Methods 0.000 description 5
- 230000008569 process Effects 0.000 description 5
- 238000010586 diagram Methods 0.000 description 4
- 239000000463 material Substances 0.000 description 4
- 230000009466 transformation Effects 0.000 description 4
- 238000000059 patterning Methods 0.000 description 3
- 238000013519 translation Methods 0.000 description 3
- 230000008859 change Effects 0.000 description 2
- 230000005284 excitation Effects 0.000 description 2
- 230000005484 gravity Effects 0.000 description 2
- 238000010191 image analysis Methods 0.000 description 2
- 230000002452 interceptive effect Effects 0.000 description 2
- 239000011159 matrix material Substances 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- PXFBZOLANLWPMH-UHFFFAOYSA-N 16-Epiaffinine Natural products C1C(C2=CC=CC=C2N2)=C2C(=O)CC2C(=CC)CN(C)C1C2CO PXFBZOLANLWPMH-UHFFFAOYSA-N 0.000 description 1
- 230000004888 barrier function Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000005229 chemical vapour deposition Methods 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000013135 deep learning Methods 0.000 description 1
- 238000009826 distribution Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000008451 emotion Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000005530 etching Methods 0.000 description 1
- 238000011156 evaluation Methods 0.000 description 1
- 230000008921 facial expression Effects 0.000 description 1
- 230000014509 gene expression Effects 0.000 description 1
- 230000036541 health Effects 0.000 description 1
- 238000007689 inspection Methods 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000004020 luminiscence type Methods 0.000 description 1
- 239000002184 metal Substances 0.000 description 1
- 238000000206 photolithography Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
- G03B21/00—Projectors or projection-type viewers; Accessories therefor
- G03B21/14—Details
- G03B21/20—Lamp housings
- G03B21/2006—Lamp housings characterised by the light source
- G03B21/2033—LED or laser light sources
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01B—MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
- G01B11/00—Measuring arrangements characterised by the use of optical techniques
- G01B11/24—Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
- G03B21/00—Projectors or projection-type viewers; Accessories therefor
- G03B21/14—Details
- G03B21/20—Lamp housings
- G03B21/2006—Lamp housings characterised by the light source
- G03B21/2013—Plural light sources
Abstract
The application is applicable to the technical field of optics and electronics, and provides a light source structure which is used for emitting light beams to a detected object to perform three-dimensional sensing. The light source structure includes a semiconductor substrate and a plurality of light emitting units formed on the semiconductor substrate. The light emitting units are distributed on the semiconductor substrate in a two-dimensional lattice form. The peak value of the normalized correlation coefficient of the whole light emitting units is greater than or equal to 0.3 and less than 1. The light emitting unit may be divided into a plurality of two light emitting unit sets. There is no correlation between light emitting units within at least one set of light emitting units. The application also provides an optical projection module, a sensing device and equipment using the light source structure.
Description
Technical Field
The application belongs to the technical field of optics, and particularly relates to a light source structure, an optical projection module, a sensing device and equipment.
Background
Existing three-dimensional (Three Dimensional, 3D) sensing modules generally employ a light source structure with irregularly distributed light emitting units to project a corresponding irregularly distributed light spot pattern for three-dimensional sensing. However, forming irregularly distributed light emitting units on a semiconductor substrate requires precise positioning of the light emitting units, and is difficult to manufacture. If the light emitting units are distributed and designed into regular pattern arrangement to reduce the manufacturing difficulty, the projected regular light spot patterns cannot realize three-dimensional sensing because the relative position relations are too similar, and if the irregularly distributed light spot patterns are projected by using the regularly distributed light emitting units, diffraction optical elements with complex structures are required to be specially customized to rearrange the regularly distributed light fields emitted by the light sources, but the diffraction optical elements with complex structures are expensive in manufacturing cost and are not beneficial to product popularization.
Disclosure of Invention
The application provides a light source structure, an optical projection module, a sensing device and equipment for realizing three-dimensional sensing.
The embodiment of the application provides a light source structure which is used for emitting light beams to a detected object to perform three-dimensional sensing. The light source structure includes a semiconductor substrate and a plurality of light emitting units formed on the semiconductor substrate. The light emitting units are distributed on the semiconductor substrate in a two-dimensional lattice form. The peak value of the normalized correlation coefficient of the whole light emitting units is greater than or equal to 0.3 and less than 1. The light emitting units may be divided into at least two sets of light emitting units. There is no correlation between light emitting units within at least one set of light emitting units.
In some embodiments, there is at least one normalized correlation coefficient between light emitting units within the set of light emitting units of less than 0.3.
In some embodiments, the light emitting unit set includes a proportion of the number of light emitting units to the total number of all light emitting units that is greater than or equal to 10%, or the light emitting unit set includes more than ten light emitting units.
In certain embodiments, the total number of all light emitting units is greater than or equal to 50.
In some embodiments, the light-emitting unit set includes two or more types of light-emitting unit sets that perform light-emitting unit arrangement according to different arrangement patterns, and a normalized correlation coefficient between the different types of light-emitting unit sets is less than 0.3, and there is no correlation between light-emitting units in the same light-emitting unit set.
In some embodiments, the light source structure comprises two sets of light emitting units, the normalized correlation coefficient between light emitting units within the same set of light emitting units is less than 0.3, and the normalized correlation coefficient between the two sets of light emitting units is greater than or equal to 0.3 and less than or equal to 1.
The embodiment of the application provides an optical projection module for projecting a patterned beam with a preset pattern onto a measured object for three-dimensional sensing, which comprises a beam adjusting element, a patterned optical element and a light source structure provided by any one of the embodiments. The light beam adjusting element is used for adjusting the light beam emitted by the light source structure so as to enable the light beam to meet the preset propagation characteristic requirement. The patterning optical element is used for rearranging the light field emitted by the light source structure to form a patterning light beam with a preset pattern.
In some embodiments, the optical projection module further includes a driving circuit, and the driving circuit provides current to drive the light emitting unit to emit light.
The embodiment of the application provides a sensing device which is used for sensing three-dimensional information of a detected object. The optical projection module comprises the optical projection module and the sensing module, wherein the sensing module is used for sensing a preset pattern projected by the optical module on a detected object and acquiring three-dimensional information of the detected object by analyzing an image of the preset pattern.
The embodiment of the application provides equipment, which comprises the sensing device provided by the embodiment. The device executes corresponding functions according to the three-dimensional information of the detected object sensed by the sensing device.
The light source structure, the optical projection module, the sensing device and the equipment provided by the embodiment of the application have correlation between the light-emitting units of different light-emitting unit sets, and the position of the light-emitting unit on the semiconductor substrate can be easily and accurately determined, so that the manufacturing difficulty is reduced.
Additional aspects and advantages of embodiments of the application will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of embodiments of the application.
Drawings
Fig. 1 is a schematic structural view of a light source structure according to a first embodiment of the present application.
Fig. 2 is a schematic diagram showing a distribution of light emitting units of the light source structure shown in fig. 1.
Fig. 3 is a schematic structural view of a light source structure according to a second embodiment of the present application.
Fig. 4 is a schematic structural view of a light source structure according to a third embodiment of the present application.
Fig. 5 is a schematic structural view of a light source structure according to a fourth embodiment of the present application.
Fig. 6 is a schematic diagram of calculating correlation coefficients between sets of light emitting units of non-uniform size.
Fig. 7 is a schematic structural view of a light source structure according to a fifth embodiment of the present application.
Fig. 8 is a schematic structural view of a light source structure provided in a sixth embodiment of the present application.
Fig. 9 is a schematic structural diagram of an optical module according to a seventh embodiment of the present application.
Fig. 10 is a schematic structural diagram of a sensing device according to an eighth embodiment of the present application.
Fig. 11 is a schematic structural view of an apparatus provided in a ninth embodiment of the present application.
Detailed Description
Embodiments of the present application are described in detail below, examples of which are illustrated in the accompanying drawings, wherein the same or similar reference numerals refer to the same or similar elements or elements having the same or similar functions throughout. The embodiments described below by referring to the drawings are exemplary only for the purpose of explaining the present application and are not to be construed as limiting the present application. In the description of the present application, it should be understood that the terms "first" and "second" are used for descriptive purposes only and are not to be interpreted as indicating or implying a relative importance or order of such features. Thus, a feature defining "a first" or "a second" may explicitly or implicitly include one or more of the described feature. In the description of the present application, the meaning of "a plurality" is two or more, unless explicitly defined otherwise.
In the description of the present application, it should be noted that, unless explicitly specified or limited otherwise, the terms "mounted," "connected," and "connected" are to be construed broadly, and may be, for example, fixedly connected, detachably connected, or integrally connected; can be mechanically connected, electrically connected or communicated with each other; can be directly connected or indirectly connected through an intermediate medium, and can be communication between two elements or interaction relationship between the two elements. The specific meaning of the terms in this application will be understood by those of ordinary skill in the art as the case may be.
The following disclosure provides many different embodiments or examples for implementing different structures of the application. In order to simplify the disclosure of this application, only the components and settings of a particular example are described below. Of course, they are merely examples and are not intended to limit the present application. Furthermore, the use of reference numerals and/or letters in the various examples is repeated herein for the purpose of simplicity and clarity of presentation and is not in itself an indication of a particular relationship between the various embodiments and/or settings discussed. In addition, the various specific processes and materials provided in the following description of the present application are merely examples of implementing the technical solutions of the present application, but one of ordinary skill in the art should recognize that the technical solutions of the present application may also be implemented by other processes and/or other materials not described below.
Further, the described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments. In the following description, numerous specific details are provided to provide a thorough understanding of embodiments of the present application. It will be appreciated, however, by one skilled in the art that the subject matter of the present application may be practiced without one or more of the specific details, or with other structures, components, etc. In other instances, well-known structures or operations are not shown or described in detail to avoid obscuring aspects of the application.
It should be understood that the embodiments and/or methods described herein are exemplary in nature and should not be construed as limiting the application's solution. The embodiments or methods described herein are only one or more of numerous technical solutions covered by the technical ideas related to the present application, and thus, the steps of the described method technical solutions may be performed in the order indicated, may be performed in other orders, may be performed simultaneously, or may be omitted in some cases, and all the above modifications should be considered as being covered by the technical solutions claimed in the present application.
As shown in fig. 1, a first embodiment of the present application provides a light source structure 1 for emitting a light beam onto a target object to be measured for three-dimensional sensing. The light beam may be a light beam having a specific wavelength according to a sensing principle and an application scene. In this embodiment, the light beam is used to sense three-dimensional information of the measured object, and may be an infrared or near-infrared wavelength light beam with a wavelength ranging from 750 nanometers (nm) to 1650nm.
The light source structure 1 includes a semiconductor substrate 10, a plurality of light emitting units 12 formed on the semiconductor substrate 10, an anode 14, and a cathode 16. The light emitting unit 12 is a semiconductor structure capable of emitting light by electric excitation, and is formed on the semiconductor substrate 10 by photolithography, etching, metal organic chemical vapor deposition, or the like. For example, the light emitting unit 12 may be, but is not limited to, a vertical cavity surface emitting laser (Vertical Cavity Surface Emitting Laser, VCSEL). The anode 14 and the cathode 16 are respectively disposed on two opposite end surfaces of the semiconductor substrate 10, so as to induce a current signal to excite the light emitting unit 12 to emit light. The excitation current is greater than 1mA.
It is understood that in other embodiments, the light emitting unit 12 may be a light emitting Diode (Light Emitting Diode, LED) or a Laser Diode (LD). Accordingly, the light emitting unit 12 is selected from any one of a VCSEL, an LED, and an LD, and a combination thereof.
Referring to fig. 1 and 2, the light emitting units 12 are distributed in a two-dimensional lattice in the light emitting region of the semiconductor substrate 10, wherein at least three adjacent light emitting units 12 are non-uniformly spaced on the semiconductor substrate 10. The entire light emitting units 12 have a correlation as a whole.
The correlation of the arrangement pattern composed of the plurality of light emitting units 12 is evaluated typically by calculating a correlation coefficient f between the plurality of light emitting units 12 n To proceed if the calculated correlation coefficient f n Greater than or equal to a preset threshold, the light emitting units 12 are considered to have a correlation therebetween.
The correlation coefficient f n The calculation formula of (c) may be, but is not limited to, a normalized correlation coefficient formula (Normalized Correlation Coefficient, NCC) as follows:
wherein,the R is 0 To be in accordance with preset conditionsArbitrarily selected light emitting unit 12 reference subarea among all light emitting units 12 on the semiconductor substrate 10, the light emitting unit 12 reference subarea R 0 Traversing the entire semiconductor substrate 10 light emitting region except for R 0 Other than and calculating the reference sub-region R of the light-emitting unit 12 0 And the luminous unit subarea R passing through in the traversal process n Is of the correlation coefficient f of (2) n . The said H is the sub-region R of the lighting unit 12 under investigation n W is the height of the sub-region R of the lighting unit 12 under investigation n Is a width of (c). The selected light emitting unit 12 refers to the sub-region R 0 The preset condition of (1) is that the selected lighting unit 12 reference sub-area includes a proportion of the number of lighting units 12 to the total number of all lighting units 12 that is greater than or equal to 10% or that the selected lighting unit 12 reference sub-area includes more than ten lighting units 12. The total number of all light emitting units 12 is greater than or equal to 50.
It will be appreciated that the light emitting unit 12 refers to the sub-region R 0 Traversing by adopting a translation mode in a plane rectangular coordinate system. In order to exclude the influence of the background area other than the light emitting units 12 in the arrangement pattern on the normalized correlation coefficient when calculating the normalized correlation coefficient of the light emitting units 12, the area of the light emitting units 12 is expanded by taking the center of the light emitting units 12 as the origin before calculation, so as to avoid that the normalized correlation coefficient calculated by the formula cannot reflect the actual correlation between the light emitting units 12 due to the fact that the background area in the whole arrangement pattern has too large specific gravity when the physical size of the light emitting units 12 is small. For example, the light emitting unit 12 arrangement pattern with low correlation can also calculate a high normalized correlation coefficient. The specific gravity of the background area is reduced after the expansion of the area of the light emitting unit 12, and the calculated normalized correlation coefficient of the arrangement pattern of the light emitting unit 12 can reflect the light emitting unit to the maximum extent12. The areas of each light emitting unit 12 are expanded in the same scale to the extent that the adjacent light emitting unit 12 areas do not overlap after expansion.
In addition, it is also possible to take only the reference subarea R of the light emitting unit 12 when the normalized correlation coefficient is calculated according to the above formula 0 And traversed luminous unit subarea R n Coordinates corresponding to the area occupied by the light emitting unit 12 are not taken from coordinates corresponding to the background area. That is, R (i, j) =1 (i, j takes the corresponding coordinates in the area occupied by the light emitting unit) to exclude the influence of the background area on the actual correlation of the light emitting unit 12 when calculating the normalized correlation coefficient.
It will be appreciated that in other embodiments, the light emitting unit 12 references the sub-region R 0 Traversal may also be performed in a polar coordinate system in a manner that rotates about the origin of coordinates.
Normalized correlation coefficient f calculated according to the normalized correlation coefficient formula n The value range of (2) is 0-f n And is less than or equal to 1. If f n =0, explaining the selected light emitting cell 12 reference sub-region R 0 The light-emitting units 12 in (a) and the traversing light-emitting unit 12 sub-region R n The light emitting units 12 in (1) are completely staggered without any overlap, i.e. the light emitting units 12 refer to the sub-regions R 0 And the luminous unit 12 is divided into a region R n Completely uncorrelated.
If f n Let =1 illustrate that the selected light emitting cell 12 references the sub-region R 0 The light-emitting units 12 in (a) and the traversing light-emitting unit 12 sub-region R n The light-emitting units 12 in (1) are identical, i.e. the light-emitting units 12 refer to the sub-regions R 0 And the luminous unit 12 is divided into a region R n Is completely correlated.
If 0 is<f n <1 description of the selected light emitting cell 12 reference sub-region R 0 The light-emitting units 12 in (a) and the traversing light-emitting unit 12 sub-region R n The light emitting units 12 in (1) partially overlap, i.e. the light emitting units 12 refer to the sub-region R 0 And the luminous unit 12 is divided into a region R n Partial correlation, the normalized correlation coefficient f n The larger the reference sub-region R of the selected light emitting unit 12 is illustrated 0 The light-emitting units 12 in (a) and the traversing light-emitting unit 12 sub-region R n The more the light emitting units 12 overlap each other, i.e. the light emitting units 12 refer to the sub-region R 0 And the luminous unit 12 is divided into a region R n The higher the correlation between them.
If the normalized correlation coefficient f n Not less than 0.3, the light-emitting unit 12 can be considered to be referenced to the sub-region R 0 And the luminous unit 12 is divided into a region R n And the light emitting units 12 have correlation. If the normalized correlation coefficient f n Not less than 0.5, the light-emitting unit 12 can be considered to be referenced to the sub-region R 0 And the luminous unit 12 is divided into a region R n Highly correlated, the light emitting units 12 have a high correlation therebetween.
In this embodiment, the correlation coefficient is a normalized correlation coefficient f n The preset threshold is 0.3, i.e. the light emitting unit 12 references the sub-region R 0 If there is a normalized correlation coefficient f calculated in the traversal process n Not less than 0.3, or the light-emitting unit 12 refers to the sub-region R 0 Normalized correlation coefficient f calculated in traversal n Peak f of (2) n_max And 0.3 or more, the light emitting units 12 as a whole may be considered to have a correlation therebetween.
Because of the correlation between the light emitting units 12, the position of the light emitting unit 12 on the semiconductor substrate 10 can be easily determined, and the manufacturing difficulty is reduced.
As shown in fig. 3, the second embodiment of the present application provides a light source structure 2 which is substantially the same as the light source structure 1 in the first embodiment, the main difference being that the correlation between the light emitting units 22 is evaluated while considering the proportion of the light emitting units 22 that are greater than or equal to a preset normalized correlation coefficient threshold value to all the light emitting units 22 in addition to the normalized correlation coefficient of the light emitting units 22.
Thereby, a method for evaluating the correlation between the light emitting units 22 is definedCorrelation intensity functionWherein a is the proportion of the light-emitting units 22 with the correlation coefficient larger than or equal to the preset correlation coefficient threshold value to the total light-emitting units 22, and the calculation formula is +.>Wherein R is 0 For the light emitting unit 22 reference subarea selected according to preset conditions, the subarea R is referenced by the light emitting unit 22 0 Traversing the entire light emitting area of the semiconductor substrate 20 and calculating the reference sub-area R of the light emitting unit 22 0 With the whole semiconductor substrate 20 except R 0 Correlation coefficients of other parts than the N and R are assumed to exist 0 The sub-areas of the light-emitting units 22 with the correlation coefficient greater than or equal to the preset correlation coefficient threshold are respectively denoted as R 1 ,…,R N Then the P represents the reference sub-region R of the light emitting unit 22 and the entire light emitting region of the semiconductor substrate 20 0 The set { R of all the light emitting units 22 having a correlation coefficient therebetween greater than or equal to a preset correlation coefficient threshold 0 ,R 1 ,…,R N -said set p= { R 0 ,R 1 ,…,R N There is a correlation between the light-emitting units 22 in. The S is a set of all light emitting units on the entire semiconductor substrate 20. The ratio may be, but is not limited to, a ratio of the number of the related light emitting units 22 to the total number of all the light emitting units 22, or a ratio of the area of the related light emitting units 22 to the total surface of the whole light emitting area, which may be selected according to practical situations.
The P and S may be the number of light emitting units 22 within the corresponding set of light emitting units 12. If the light emitting units 22 are uniformly distributed, the P and S may be areas corresponding to the areas where the sets of light emitting units 22 are located. It will be appreciated that the calculations of P and S herein are for R 0 ,R 1 ,…,R N The overlap that may occur in (a) is calculated only once and is not repeated.
The saidFor the set p= { R 0 ,R 1 ,…,R N All light-emitting cell 22 sub-regions R within } n (0 < n.ltoreq.N) and the light-emitting unit 22 reference subarea R 0 Normalized correlation coefficient f between n Is calculated as +.>Wherein f n Is R n (0 < n.ltoreq.N) and R 0 Normalized correlation coefficient between.
In the present embodiment, since the preset correlation coefficient threshold is 0.3, i.e. when f n When the temperature is more than or equal to 0.3, the corresponding sub-region R of the light-emitting unit 22 is considered n Light emitting cells 12 in (0 < n.ltoreq.N) and selected light emitting cell 22 reference sub-region R 0 Has correlation with the sub-region R of the light emitting unit 22 n (0 < n.ltoreq.N) may be applied to the correlation strength function defined aboveTo evaluate the overall dependence of all light emitting cells 22 on the semiconductor substrate 10.
The a is the proportion of the related light-emitting units 22 to the whole light-emitting units 22, so that a is more than or equal to 0 and less than or equal to 1. The saidFor normalizing the correlation coefficient f n Average value of (2), so->Therefore, the correlation intensity function->The calculated correlation intensity value F also meets the value range of 0-1. It is defined herein that if the correlation intensity value F satisfies 0.ltoreq.F < 0.1, all the light-emitting units 22 on the semiconductor substrate 10 are not correlated as a whole. If the correlation is strongThe degree value F satisfies 0.1.ltoreq.F < 0.25, and all the light emitting cells 22 on the semiconductor substrate 20 are weakly correlated as a whole. If the correlation intensity value F satisfies 0.25.ltoreq.F < 0.5, all the light emitting units 22 on the semiconductor substrate 20 have correlation as a whole. If the correlation intensity value F satisfies 0.5.ltoreq.F.ltoreq.1, all the light emitting cells 22 on the semiconductor substrate 20 are strongly correlated as a whole.
It will be appreciated that for the same light emitting unit 22 arrangement pattern on the semiconductor substrate 20, the calculated correlation intensity value F may be associated with the light emitting unit 22 reference sub-region R selected during the calculation 0 Is not always consistent, so that the sub-region R is referenced according to all the light emitting units 22 satisfying the preset condition in judging the correlation intensity of all the light emitting units 22 on the semiconductor substrate 20 as a whole 0 The maximum value of the calculated correlation intensity values F is determined. That is, as long as there is a reference sub-region R of the light emitting unit 22 selected according to the preset condition 0 So that the sub-region R is referenced according to the light-emitting unit 22 0 The calculated correlation intensity value F satisfies the above-defined correlation intensity corresponding range, and the light-emitting units 22 on the semiconductor substrate 20 can be regarded as having corresponding correlation intensities as a whole.
In the present embodiment, all the light emitting units 22 on the semiconductor substrate 20 have correlation as a whole. The maximum value F of the correlation intensity values F of the whole light-emitting units 22 max Greater than or equal to 0.25 and less than 1. I.e. there is a reference sub-region R of the lighting unit 22 selected according to preset conditions 0 The calculated correlation strength value F is greater than or equal to 0.25 and less than 1.
It will be appreciated that in other embodiments, all of the light emitting cells 22 on the semiconductor substrate 20 have a strong correlation as a whole. The maximum value F of the correlation intensity values F of the whole light-emitting units 22 max Greater than or equal to 0.5 and less than 1. I.e. there is a reference sub-region R of the lighting unit 22 selected according to preset conditions 0 The calculated correlation strength value F is greater than or equal to 0.5 and less than 1.
As shown in fig. 4, the third embodiment of the present application provides a light source structure 3 which is substantially the same as the light source structure 2 of the second embodiment, the main difference being that the reference sub-region R is referred to in calculating the selected light emitting unit 32 0 Correlation coefficient f with other portions of the light-emitting region of the semiconductor substrate 30 traversed n The reference sub-region R of the light-emitting unit 32 is considered 0 With the traversed sub-region R of the lighting unit 32 n (0 < n.ltoreq.N) the change sub-region R 'of the light emitting unit 32 obtained after the transformation T' n Normalized correlation coefficient f between (0 < n.ltoreq.N) n . The transformation T may be, but is not limited to, an affine transformation including translation, rotation, mirroring, etc. In the present embodiment, the transforms T are all referenced to a planar rectangular coordinate system.
Namely, the original luminescent unit 32 subarea R on the semiconductor substrate 30 n (N is more than 0 and less than or equal to N) and the luminous unit 32 obtained after the transformation T is transformed into a sub-region R' n And the selected light-emitting unit 32 reference subarea R 0 Normalized correlation coefficient f between n Satisfy f n When the temperature is more than or equal to 0.3, the luminous unit 32 is divided into subareas R n (0 < n.ltoreq.N) the number of light emitting units 32 and the corresponding normalized correlation coefficient f n Correlation intensity function applied to the definitionTo evaluate the overall correlation of all light emitting cells 32 on the semiconductor substrate 30. In this embodiment, the normalized correlation coefficient f n The expression of (2) is as follows:
wherein,h is the subarea R of the lighting unit 32 under investigation n (0 < n.ltoreq.N), W is the light-emitting unit 32 sub-under investigationRegion R n (0 < n.ltoreq.N).
As shown in fig. 5, the fourth embodiment of the present application provides a light source structure 4, which is substantially the same as the light source structure 1 in the first embodiment, and is mainly different in that all the light emitting units 42 on the semiconductor substrate 40 may be divided into a plurality of light emitting unit sets 420, where a plurality refers to two or more. The set of light emitting units 420 have a correlation between them. There is no correlation between the light emitting units 42 inside at least one of the light emitting unit sets 420.
The correlation between the light-emitting unit sets 420 may be determined by calculating a normalized correlation coefficient f between the light-emitting unit sets 420 n To evaluate. The calculation formula is as above, and can be:
wherein R is 0 And R is n Respectively, the normalized correlation coefficient f needs to be calculated n Is provided for the two sets of light emitting units 420,h is the height of the set of light emitting units 420 under investigation and W is the width of the set of light emitting units 420 under investigation. The normalized correlation coefficient f n The numerical range of (2) is 0.ltoreq.f n Not more than 1, when f n When < 0.3, the light emitting unit set 420 is considered to have no correlation therebetween; when f n When the number is more than or equal to 0.3, the light-emitting unit sets 420 are considered to have correlation; when f n And ≡ 0.5, the light emitting unit sets 420 are considered to be highly correlated.
In the present embodiment, the number of the light emitting units 42 included in the light emitting unit set 420 is 10 or more, or the ratio of the number of the included light emitting units 42 to the total number of all the light emitting units 42 is 10 or more. Normalized correlation coefficient between the light-emitting unit sets 420 is 0.3.ltoreq.f n ＜1。
It will be appreciated that among othersIn an embodiment, the light emitting unit sets 420 can also be highly correlated, and the normalized correlation coefficient between the light emitting unit sets 420 is 0.5.ltoreq.f n ＜1。
It will be appreciated that if the size of the areas of the divided light emitting unit sets 420 and 421 and/or the number of included light emitting units 42 are not uniform, as shown in fig. 6, it may be employed to expand the periphery of one of the light emitting unit sets 420 to form a large enough area 400 to accommodate one round of translation of the other light emitting unit set 421 around the periphery of the light emitting unit set 420. At this time, the light emitting unit set 421 is used as a reference subarea according to the normalized correlation coefficient f n Is traversed within the extended region 400 to calculate a normalized correlation coefficient f between the light emitting units 42 throughout the region 400 n As normalized correlation coefficient f between the above-described light emitting unit set 420 and light emitting unit set 421 n . It should be noted that the normalized correlation coefficient f n In the calculation process of (2), the coordinate values except the light-emitting unit set 420 and the light-emitting unit set 421 in the extension area 400 are required to be 0, so as to eliminate the normalized correlation coefficient f between the extension part and the light-emitting unit 42 originally existing in the light-emitting unit set 420 and the light-emitting unit set 421 n The resulting effect.
It should be noted that, the correlation between the light emitting unit sets 420 may be the correlation between every two light emitting unit sets 420, or there may be at least a case where there are correlations between two light emitting unit sets 420, and not all the light emitting unit sets 420 are correlated with each other.
The correlation between the light emitting units 42 in the light emitting unit set 420 uses the correlation intensity function described in the first embodimentFor evaluation, please refer to the corresponding content in the first embodiment, and the detailed description is omitted herein. In this embodiment, at least one of the luminescence sheets is presentThere is no correlation between the light emitting units 42 within the meta-collection 420, and the correlation intensity value F between all the light emitting units 42 within the light emitting unit collection 420 is equal to or less than 0.1.
As shown in fig. 7, the fifth embodiment of the present application provides a light source structure 5, which is substantially the same as the light source structure 4 in the fourth embodiment, and the main difference is that the light emitting unit set 520 includes a third type of light emitting unit set 521 and a fourth type of light emitting unit set 522. There is no correlation between the light units 52 within the third set 521 of light units. The light emitting units 52 in the third light emitting unit set 521 are all arranged according to the same first arrangement pattern. There is no correlation between the light units within the fourth set 522 of light units. The light emitting units 52 in the fourth light emitting unit set 522 are all arranged according to the same second arrangement pattern, and the second arrangement pattern is different from the first arrangement pattern. There is no correlation between the different classes of light-emitting cell sets 521 and 522. That is, the normalized correlation coefficient between the different classes of light-emitting unit sets 521 and 522 is less than 0.3.
In this embodiment, all the light emitting units 52 on the semiconductor substrate 50 may be divided into nine light emitting unit sets 520. The number of the third type of light emitting unit sets 521 is four, and the number of the fourth type of light emitting unit sets 522 is five. Each of the light emitting unit sets 520 includes at least ten of the light emitting units 52. It is understood that the positions of the third type of light emitting unit set 521 and the fourth type of light emitting unit set 522 may be any one of the grids in the matrix arrangement, as long as the requirements of the corresponding number and arrangement pattern are satisfied.
In other embodiments, the total number of the light emitting unit sets 520 is not limited to nine, and the arrangement manner is not limited to a nine-grid or matrix arrangement. So long as the condition of at least one of the third type of light emitting unit set 521 and at least one of the fourth type of light emitting unit set 522 is satisfied.
As shown in fig. 8, a sixth embodiment of the present application provides a light source structure 6, which is substantially identical to the light source structure 4 in the fourth embodiment,the main difference is that the light source structure 6 comprises two sets 620 of light emitting units. There is no correlation between the light units 62 within each light unit set 620. The two sets 620 of light emitting units have a correlation therebetween. That is, the normalized correlation coefficient between the two light emitting unit sets 620 is 0.3.ltoreq.f n And 1, normalized correlation coefficient f between light emitting units 62 within each light emitting unit 620 n < 0.3. In this embodiment, each light emitting unit set 620 includes at least one hundred uncorrelated light emitting units 62.
As shown in fig. 9, a seventh embodiment of the present application provides an optical projection module 7 for projecting a patterned beam with a predetermined pattern onto a target object to be sensed. The optical projection module 7 includes a beam adjusting element 70, a patterning optical element 72, and the light source structure 1 in the first to sixth embodiments.
The beam adjusting element 70 includes, but is not limited to, a collimating element, a beam expanding element, a reflecting element, an optical microlens array set, and a grating. The beam adjusting element 70 is configured to adjust the beam emitted by the light source structure 1 so as to meet a preset propagation characteristic requirement, for example: propagation direction, collimation, beam aperture, etc. The patterned optical element 72 is configured to rearrange the light field emitted by the light source structure 1 to form a patterned beam capable of projecting a preset pattern on the measured object. The patterned optical element 72 includes, but is not limited to, one or more of a diffractive optical element (Diffractive Optical Element, DOE), an optical microlens array set, or a grating. In this embodiment, the diffractive optical element copies the light beam emitted from the light source structure 1 and spreads the light beam within a predetermined angle range to form a patterned light beam to be projected onto the measured object.
As shown in fig. 10, an eighth embodiment of the present application provides a sensing device 8 for sensing three-dimensional information of a measured object. The sensed spatial information of the measured object may be used to identify the measured object or to construct a three-dimensional model of the measured object.
The sensing device 8 includes the optical projection module 7 and the sensing module 80 according to the seventh embodiment. The optical projection module 7 is used for projecting a specific light beam onto the measured object. The sensing module 80 includes a lens 81, an image sensor 82, and an image analysis processor 83. The image sensor 82 senses an image formed on the object to be measured by the patterned beam through the lens 81. The image analysis processor 83 analyzes the sensed image projected on the object to be measured to acquire three-dimensional information of the object to be measured.
In this embodiment, the sensing device 8 is a three-dimensional face recognition device that senses three-dimensional information on the surface of the object to be detected and recognizes the identity of the object to be detected accordingly.
The sensing module 80 analyzes three-dimensional information of the surface of the measured object according to the shape change of the preset pattern projected on the measured object by the sensed patterned beam, and performs face recognition on the measured object according to the three-dimensional information.
As shown in fig. 11, a ninth embodiment of the present application provides an apparatus 9, such as a mobile phone, a notebook computer, a tablet computer, a touch interactive screen, a door, a vehicle, a robot, an automatic numerical control machine, and the like. The apparatus 9 comprises at least one sensing device 8 provided by the eighth embodiment described above. The device 9 is configured to correspondingly perform a corresponding function according to the sensing result of the sensing means 8. The corresponding functions include, but are not limited to, unlocking after identifying the identity of the user, paying, starting a preset application program, avoiding barriers, and judging any one or more of emotion and health conditions of the user by using a deep learning technology after identifying facial expressions of the user.
In this embodiment, the sensing device 8 is a three-dimensional face recognition device that senses three-dimensional information on the surface of the object to be detected and recognizes the identity of the object to be detected accordingly. The device 9 is an electronic terminal such as a mobile phone, a notebook computer, a tablet computer, a touch interactive screen and the like provided with the three-dimensional face recognition device, or is a device 9 related to access rights such as a door, a vehicle, a security inspection instrument, an access gate and the like.
Compared with the prior art, the light source structure 1, the optical projection module 7, the sensing device 8 and the equipment 9 provided by the application have correlation in arrangement positions of the light emitting units 12 of the different light emitting unit sets 120, and the positions of the light emitting units 12 on the semiconductor substrate 10 can be easily and accurately determined, so that the manufacturing difficulty is reduced.
In the description of the present specification, reference to the terms "one embodiment," "certain embodiments," "illustrative embodiments," "examples," "specific examples," or "some examples," etc., means that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the present application. In this specification, schematic representations of the above terms do not necessarily refer to the same embodiments or examples. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.
The foregoing description of the preferred embodiments of the present application is not intended to be limiting, but is intended to cover any and all modifications, equivalents, and alternatives falling within the spirit and principles of the present application.
Claims (10)
1. The light source structure is used for emitting light beams to a tested object for three-dimensional sensing, and comprises a semiconductor substrate and a plurality of light emitting units formed on the semiconductor substrate, wherein the light emitting units are distributed on the semiconductor substrate in a two-dimensional lattice mode, the peak value of a normalized correlation coefficient of the whole light emitting units is more than or equal to 0.3 and less than 1, the light emitting units can be divided into a plurality of light emitting unit sets, and at least one light emitting unit in the light emitting unit set has no correlation;
normalized correlation coefficient of all light-emitting units as a whole is according to correlation strength functionEvaluating, wherein a is that the correlation coefficient is greater than or equal to a preset correlation coefficient threshold valueThe proportion of the luminous units in the whole luminous units is calculated as +.>P＝{R 0 ,R 1 ,…,R N (wherein R is) 0 For the luminous unit reference subarea selected according to the preset condition, the luminous unit reference subarea R is used for 0 Traversing the whole semiconductor substrate luminous area and calculating the luminous unit reference subarea R 0 And the whole semiconductor substrate light-emitting region except R 0 Correlation coefficients of other parts than the N and R are assumed to exist 0 The luminous unit subareas with the correlation coefficient larger than or equal to the preset correlation coefficient threshold value are respectively expressed as R 1 ,…,R N The P represents the whole semiconductor substrate luminous area and the luminous unit reference subarea R 0 The set { R of all light emitting units having a correlation coefficient therebetween greater than or equal to a preset correlation coefficient threshold 0 ,R 1 ,…,R N -said set p= { R 0 ,R 1 ,…,R N The light-emitting units in the semiconductor substrate have correlation, and S is a set of all the light-emitting units on the whole semiconductor substrate; said->For the set p= { R 0 ,R 1 ,…,R N All light-emitting cell sub-regions R within }, are n (0<N is less than or equal to N) and the luminous unit reference subarea R 0 Normalized correlation coefficient f between n Is calculated as +.>Wherein f n Is R n (0<N is less than or equal to N) and R 0 Normalized correlation coefficient between.
2. A light source structure as recited in claim 1, wherein: the normalized correlation coefficient between light emitting units within at least one set of light emitting units is less than 0.3.
3. A light source structure as recited in claim 1, wherein: the ratio of the number of the light-emitting units contained in the light-emitting unit set to the total number of all the light-emitting units is more than or equal to 10%, or the light-emitting unit set contains more than ten light-emitting units.
4. A light source structure as recited in claim 1, wherein: the total number of all light emitting units is greater than or equal to 50.
5. A light source structure as recited in claim 1, wherein: the light-emitting unit set comprises more than two types of light-emitting unit sets which are respectively arranged according to different arrangement patterns, the normalized correlation coefficient between the different types of light-emitting unit sets is less than 0.3, and the light-emitting units in the same light-emitting unit set have no correlation.
6. A light source structure as recited in claim 1, wherein: the light source structure comprises two light-emitting unit sets, the normalized correlation coefficient between the light-emitting units in the same light-emitting unit set is smaller than 0.3, and the normalized correlation coefficient between the two light-emitting unit sets is larger than or equal to 0.3 and smaller than or equal to 1.
7. An optical projection module for projecting a patterned beam with a preset pattern onto a target object to be measured for three-dimensional sensing, comprising a beam adjusting element, a patterned optical element and the light source structure according to any one of claims 1 to 6, wherein the beam adjusting element is used for adjusting the beam emitted by the light source structure so as to meet the preset propagation characteristic requirement, and the patterned optical element is used for rearranging the light field emitted by the light source structure to form the patterned beam with the preset pattern.
8. The optical projection module of claim 7, wherein: the optical projection module further comprises a driving circuit, and the driving circuit provides current to drive the light-emitting unit to emit light.
9. A sensing device for sensing three-dimensional information of a measured object, comprising a sensing module and the optical projection module according to any one of claims 7 or 8, wherein the sensing module is used for sensing a preset pattern projected by the optical projection module on the measured object and obtaining the three-dimensional information of the measured object by analyzing an image of the preset pattern.
10. An electronic device comprising the sensing apparatus of claim 9, the electronic device performing a corresponding function according to three-dimensional information of a measured object sensed by the sensing apparatus.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811411412.9A CN109541876B (en) | 2018-11-24 | 2018-11-24 | Light source structure, optical projection module, sensing device and equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811411412.9A CN109541876B (en) | 2018-11-24 | 2018-11-24 | Light source structure, optical projection module, sensing device and equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109541876A CN109541876A (en) | 2019-03-29 |
| CN109541876B true CN109541876B (en) | 2024-02-13 |
Family
ID=65850128
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811411412.9A Active CN109541876B (en) | 2018-11-24 | 2018-11-24 | Light source structure, optical projection module, sensing device and equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109541876B (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2006266725A (en) * | 2005-03-22 | 2006-10-05 | Sharp Corp | Device for optical measurement |
| JP2009021197A (en) * | 2007-07-13 | 2009-01-29 | Ｎｅｃディスプレイソリューションズ株式会社 | Lighting device and control method for lighting device |
| CN102735187A (en) * | 2012-07-05 | 2012-10-17 | 北京理工大学 | Searching method for annular sub-aperture boundary splicing |
| CN106990660A (en) * | 2017-05-09 | 2017-07-28 | 深圳奥比中光科技有限公司 | Structured light projection module |
| CN209327766U (en) * | 2018-11-24 | 2019-08-30 | 深圳阜时科技有限公司 | A kind of light-source structure, optical projection mould group, sensing device and equipment |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| DE102014005181A1 (en) * | 2014-04-03 | 2015-10-08 | Astrium Gmbh | Position and orientation of objects |
-
2018
- 2018-11-24 CN CN201811411412.9A patent/CN109541876B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2006266725A (en) * | 2005-03-22 | 2006-10-05 | Sharp Corp | Device for optical measurement |
| JP2009021197A (en) * | 2007-07-13 | 2009-01-29 | Ｎｅｃディスプレイソリューションズ株式会社 | Lighting device and control method for lighting device |
| CN102735187A (en) * | 2012-07-05 | 2012-10-17 | 北京理工大学 | Searching method for annular sub-aperture boundary splicing |
| CN106990660A (en) * | 2017-05-09 | 2017-07-28 | 深圳奥比中光科技有限公司 | Structured light projection module |
| CN209327766U (en) * | 2018-11-24 | 2019-08-30 | 深圳阜时科技有限公司 | A kind of light-source structure, optical projection mould group, sensing device and equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109541876A (en) | 2019-03-29 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108954025B (en) | Light source structure and equipment using same | |
| WO2012137674A1 (en) | Information acquisition device, projection device, and object detection device | |
| US20130002859A1 (en) | Information acquiring device and object detecting device | |
| US20130010292A1 (en) | Information acquiring device, projection device and object detecting device | |
| CN109683439B (en) | Optical projection module, sensing device, equipment and optical projection module assembling method | |
| CN109581795A (en) | A kind of optical projection mould group, sensing device and equipment | |
| CN109541876B (en) | Light source structure, optical projection module, sensing device and equipment | |
| CN109541875B (en) | Light source structure, optical projection module, sensing device and equipment | |
| CN109471320B (en) | Light source structure, optical projection module, sensing device and equipment | |
| CN114089348A (en) | Structured light projector, structured light system, and depth calculation method | |
| CN209446959U (en) | A kind of light-source structure, optical projection mould group, sensing device and equipment | |
| CN109643052B (en) | Light source structure, optical projection module, sensing device and equipment | |
| EP3798569B1 (en) | Dual-pattern optical 3d dimensioning | |
| CN109643051B (en) | Light source structure, optical projection module, sensing device and equipment | |
| CN209803547U (en) | Light source structure, optical projection module, sensing device and equipment | |
| CN110941132B (en) | Light source structure, optical projection module, sensing device and equipment | |
| CN109683440B (en) | Optical projection module, sensing device, equipment and optical projection module assembling method | |
| JP7230358B2 (en) | Diffraction optical element, light irradiation device, light irradiation system, projection pattern correction method | |
| CN209327766U (en) | A kind of light-source structure, optical projection mould group, sensing device and equipment | |
| CN209327767U (en) | A kind of light-source structure, optical projection mould group, sensing device and equipment | |
| CN109471321A (en) | A kind of light-source structure, optical projection mould group, sensing device and equipment | |
| CN209570792U (en) | A kind of light-source structure, optical projection mould group, sensing device and equipment | |
| CN209802320U (en) | Transmitting unit, sensing module and electronic equipment | |
| CN209446960U (en) | A kind of light-source structure, optical projection mould group, sensing device and equipment | |
| TWI753452B (en) | Projecting a structured light pattern from an apparatus having an oled display screen |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |