TWI663377B - Optical device and light emitting device thereof - Google Patents

Abstract

The invention provides an optical device including a light-emitting device and a sensing unit, and the light-emitting device is used to provide one of the first structure light and a second structure light projected to a subject to be measured, corresponding to the first structure light. A plurality of first patterns of a structured light and a plurality of second patterns corresponding to the second structured light are presented on the target under test, and the sensing unit is configured to sense the plurality of first patterns present on the target under test and A plurality of second patterns; wherein the first patterns and the second patterns have multiple relative positional relationships, and the relative positional relationships are used to obtain at least one depth information of the target under test.

Description

Optical device and light emitting device

The present invention relates to an optical device and a light emitting device thereof, and more particularly, to an optical device and a light emitting device applied to a portable electronic device.

In recent years, with the evolution of the electronics industry and the vigorous development of industrial technology, the design and development of various electronic devices has gradually evolved toward lightness and portability, so that users can use it in mobile commerce, entertainment or leisure, anytime, anywhere. . For example, various image capture devices are being widely used in various fields, such as portable electronic devices such as smart phones, wearable electronic devices, etc., which have the advantages of small size and convenient portability, allowing users to It can be taken out at any time and used for image capture and storage at any time, or further uploaded to the Internet through the mobile network, which not only has important commercial value, but also adds color to the daily life of the general public.

Furthermore, with the improvement of the quality of life, people have more demands for the images captured by the image capture device. For example, people hope that the obtained images can be 3D stereo images, and the 3D stereo images include: Accurate depth information. For another example, people hope that portable electronic devices have the function of distance measurement, so that gesture recognition can be performed. The measurement of related depth information or the measurement of distance can currently be performed by Time of Flight (TOF), single structured light (structure light) distance measurement method or dual camera distance measurement method, but they are all known to those skilled in the art, and will not be repeated here.

However, although the measurement results obtained by the time-of-flight measurement method have Better accuracy, but if it is to be extended to surface or multi-point emotional mirror applications, it is extremely complicated in software calculations, and special calculation chips and integrated circuits (ICs) need to be introduced, so the power consumption is large and the calculation cost is also High, in addition, the time-of-flight distance method is also susceptible to the influence of environmental brightness, which makes it less accurate when the external light is harmful; while the dual-lens distance method is used in software calculations There is also a considerable degree of complexity, which is not easy, and the power consumption and calculation cost are because of the use of dual mirrors. Although it has advantages compared to the time-of-flight method, it has a poor performance on the distance of smooth surfaces. The accuracy of the measurement results obtained is low; and because the single structured light distance method obtains depth information or distance information through the detection of light distortion in the image, its measurement results are also vulnerable to the environment The effect of brightness, that is, the accuracy of the measurement results that can be obtained in the case of large external light damage is low.

According to the above description, it is known that the knowledge can be used to obtain 3D stereoscopic images. There is still room for improvement in depth information, portable electronic devices and image capture devices (optical devices) that can be used for 3D stereo reconstruction or distance measurement for gesture recognition.

An object of the present invention is to provide an optical device and a light-emitting device thereof, particularly an optical device and a light-emitting device thereof capable of measuring distance (depth information) of a target by using at least two structured lights, so as to bring high distance accuracy. And its measurement results are not susceptible to the effects of environmental brightness.

In a preferred embodiment, the present invention provides a light emitting device including: a first structured light generating unit for providing a first structured light (structure) light), and the first structured light is projected onto a subject to be tested, so that at least one first pattern corresponding to a first pattern combination of the first structured light is presented on the subject; And a second structured light generating unit for providing a second structured light, and the second structured light is projected to the subject to be measured so as to correspond to at least one of a second pattern combination corresponding to the second structured light A second pattern is presented on the target under test, and a second optical axis direction of one of the second structured light is different from a first optical axis direction of one of the first structured light; The at least one first pattern and the at least one second pattern have at least one relative positional relationship, and the at least one relative positional relationship is used to obtain at least one depth distance of the target under test.

In a preferred embodiment, the first structured light generation unit includes a first light source and a first lens group corresponding to the first pattern combination, and the second structured light generation unit includes a second light source And a second lens group corresponding to one of the second pattern combinations.

In a preferred embodiment, the first light emitting source system includes at least one of a laser diode (LD), a light emitting diode (LED), and an organic light emitting diode (OLED). A light-emitting unit for outputting a light beam having a thermal sensing wavelength interval; and / or the second light-emitting source system includes a laser diode (LD), a light-emitting diode (LED), and an organic light-emitting diode (OLED) and at least one of a light-emitting unit for outputting a light beam having a thermal sensing wavelength range; and / or the light-emitting device further includes a housing for the first structured light generating unit And at least one of the second structured light generating units is disposed therein, and the casing is a surface-mounted element (SMD).

In a preferred embodiment, the first light source is configured to output a light beam having a first wavelength and / or a light beam having a second wavelength.

In a preferred embodiment, the light beam having the first wavelength is a visible light beam, and the light beam having the second wavelength is an invisible light beam.

In a preferred embodiment, the second light source is configured to output A light beam of a first wavelength and / or a light beam of a second wavelength.

In a preferred embodiment, the light beam having the first wavelength is a visible light beam, and the light beam having the second wavelength is an invisible light beam.

In a preferred embodiment, the first structured light and the second structured light system have a first cone shape and a second cone shape, respectively.

In a preferred embodiment, the first cone system includes at least one of a conical shape, an elliptical cone, and a side cone; and / or the second cone system includes a conical shape and an elliptical cone. Shape and at least one of a cone shape.

In a preferred embodiment, the at least one first pattern includes at least one dot pattern, and / or the second pattern includes at least one line pattern or at least one rectangular pattern.

In a preferred embodiment, the present invention also provides an optical device, including: a light emitting device for providing a first structure light and a second structure light, and the first structure light and the first structure light The two structured lights are respectively projected onto a subject to be measured, so that at least a first pattern corresponding to a first pattern combination of the first structured light and a second corresponding to one of the second structured light are second At least one second pattern in the pattern combination is respectively displayed on the subject; wherein a second optical axis direction of one of the second structured light is different from a first optical axis direction of the first structured light; and a sensor A unit for sensing the at least one first pattern and the at least one second pattern presented on the target under test; wherein the at least one first pattern and the at least one second pattern appear on the target under test There is at least one relative positional relationship between them, and the at least one relative positional relationship is used to obtain at least one depth distance of the measured target.

In a preferred embodiment, the light-emitting device includes at least one light-emitting source, a first lens group corresponding to the first pattern combination, and a second lens group corresponding to the second pattern combination, and the at least one light-emitting device The first complex beam system The first structured light is formed after passing through the first lens group, and a second complex light beam of one of the at least one light emitting source is formed through the second lens group to form the second structured light.

In a preferred embodiment, the at least one light emitting source includes a laser. At least one of a diode (LD), a light-emitting diode (LED), an organic light-emitting diode (OLED), and a light-emitting unit for outputting a light beam having a heat-sensing wavelength range.

In a preferred embodiment, the first complex light beam includes a first A light beam having a wavelength and / or a light beam having a second wavelength.

In a preferred embodiment, the second complex light beam includes a first A light beam with a wavelength and / or a light beam with a second wavelength.

In a preferred embodiment, the first structured light and the second structure The light system has a first cone shape and a second cone shape.

In a preferred embodiment, the first cone system includes at least one of a conical shape, an elliptical cone, and a side cone; and / or the second cone system includes a cone, an elliptical cone Shape and at least one of a cone shape.

In a preferred embodiment, the at least one first pattern includes at least one dot pattern, and / or the second pattern includes at least one line pattern or at least one rectangular pattern.

In a preferred embodiment, the light emitting device and the sensing unit are integrated on a circuit board (PCB).

In a preferred embodiment, the optical device is applied to a portable electronic device.

1‧‧‧ optical device

4‧‧‧ Portable electronic device

11‧‧‧light-emitting device

12‧‧‧ induction unit

21‧‧‧The first pattern combination

22‧‧‧The second pattern combination

71‧‧‧Image

72‧‧‧Image

81‧‧‧tested

82‧‧‧tested

91‧‧‧ Beam

92‧‧‧ Beam

111‧‧‧first structured light generating unit

112‧‧‧Second Structured Light Generation Unit

113‧‧‧First structured light

114‧‧‧Second structured light

115‧‧‧shell

121‧‧‧Visible light sensing unit

122‧‧‧Invisible light sensing unit

211‧‧‧The first pattern

221‧‧‧Second Pattern

1131‧‧‧ Optical axis

1141‧‧‧Optical axis

1111‧‧‧First light source

1112‧‧‧The first lens group

1121‧‧‧Second luminous source

1122‧‧‧Second lens group

A‧‧‧ staggered area

D11‧‧‧Pitch

D12‧‧‧Pitch

D21‧‧‧Pitch

D22‧‧‧Pitch

X1‧‧‧dot pattern

X2‧‧‧dot pattern

L1‧‧‧line pattern

L2‧‧‧ line pattern

Fig. 1: Structure of an optical device according to a preferred embodiment of the present invention

Read the diagram.

Fig. 2: The light emitting device shown in Fig. 1 and its first structured light and Conceptual diagram of two structured light from another perspective.

Figure 3: The first structured light and the second structured light shown in Figure 2 are projected to The conceptual diagram of the target under test, so that the first pattern and the second pattern appear on the target under test.

FIG. 4A shows the sensing unit located at the first structured light at the target. A preferred conceptual diagram of an image captured at a first position in the staggered area of the second and second structured light.

Figure 4B: The sensing unit is located at the first structured light at the target to be measured. A preferred conceptual diagram of an image captured at a second position in the interlaced area of the second structured light and the second structured light.

FIG. 5 shows the application of the optical device of the present invention to a portable electronic device. A schematic diagram of a preferred structure.

Please refer to FIG. 1 and FIG. 2. FIG. 1 is a schematic structural conceptual diagram of an optical device according to a preferred embodiment of the present invention. FIG. 2 is a light emitting device shown in FIG. A conceptual diagram of the viewing angle. FIG. 3 is a conceptual diagram of the first structured light and the second structured light shown in FIG. 2 being projected onto the subject to be tested, so that the first pattern and the second pattern are presented on the subject.

The optical device 1 includes a light-emitting device 11 and a sensing unit 12. The light-emitting device 11 is used to provide a target 81 that can be projected so that the target 81 presents at least one first pattern in the first pattern combination 21. A first structure light 113 of 211 and a second structure light 114 for providing 81 which can be projected to the target to be tested so that at least one second pattern 221 of the second pattern combination 22 is displayed on the target 81; The direction of the optical axis 1131 (first optical axis) of the first structured light 113 is different from the direction of the optical axis 1141 (second optical axis) of the second structured light 114.

Furthermore, the sensing unit 12 includes a visible light sensing unit 121 and an invisible light sensing unit 122, and is configured to sense at least one of the targets 81 shown on the target. The first pattern 211 and at least one second pattern 221, and the at least one first pattern 211 and the at least one second pattern 221 present on the target 81 have at least one relative positional relationship, and the at least one relative positional relationship Is used to obtain at least a depth distance of the measured target 81, which will be further detailed later with reference to FIG. 3 and FIG. 4.

In the preferred embodiment, the light emitting device 11 includes a first structured light output. The light emitting unit 111 and the second structured light generating unit 112 include a first light emitting source 1111 and a first lens group 1112. The first light emitting source 1111 may include a laser diode (LD), At least one of a diode (OLED), an organic light emitting diode (OLED), and a light emitting unit for outputting a light beam having a thermal sensing wavelength range, and / or the first light emitting source 1111 may further include Laser light emitting diodes, light emitting diodes, and organic light emitting diodes and other semiconductor light emitting units; the first light source 1111 is used to output a complex light beam 91, and the light beam 91 may be a light beam having a first wavelength (Such as a visible light beam) and / or a light beam with a second wavelength (such as an invisible light beam or a light beam with a thermally induced wavelength), and the first lens group 1112 at least includes an optical element corresponding to the first pattern combination 21 ( (Not shown, such as a diffractive element), and allows the light beam 91 output by the first light source 1111 to pass therethrough, so that the first structured light generating unit 111 generates an output having a first pattern combination 21 and a first cone shape First structured light 113.

Among them, although the first structured light 113 of the preferred embodiment presents The first cone shape is a cone shape, but it may also be an elliptical cone shape or a side cone shape. The above-mentioned method of generating the first structured light 113 through the first lens group 1112 and its optical elements is only an example. It is known to those skilled in the art, so it will not be repeated here, and the method of generating the first structured light 113 is not limited to the above.

Furthermore, the second structured light generating unit 112 includes a second light emitting source 1121. And a second lens group 1122, the second light source 1121 may include a laser diode (LD), a light emitting diode (LED), an organic light emitting diode (OLED), and an output having a thermal sensing wavelength range At least one of a light-emitting unit of the light beam and / or the first light-emitting source 1111 may further include other light-emitting units similar to semiconductors such as a laser diode, a light-emitting diode, and an organic light-emitting diode; and, The output of the second light source 1121 is complex The light beam 92 may be a light beam with a third wavelength (such as a visible light beam) and / or a light beam with a fourth wavelength (such as an invisible light beam or a light beam with a thermally induced wavelength), and the second lens group 1122 is At least another optical element (not shown, such as a diffractive element) corresponding to the second pattern combination 22 is included, and the light beam 92 output by the second light source 1121 passes through it, so as to make the second structured light generating unit. 112 produces a second structured light 114 having a second pattern combination 22 and having a second cone shape.

Similarly, although the second structured light 114 of the preferred embodiment presents The second cone shape is a cone shape, but it can also be an elliptical cone shape or a side cone shape. The above-mentioned method of generating the second structured light 114 through the second lens group 1122 and its optical elements is only an implementation. For example, it is known to those skilled in the art, so it will not be repeated here, and the method of generating the second structured light 114 is not limited to the above.

Of course, the above are only examples, the number of light sources, the number of lens groups Both the number and the number of sensing units can be changed in any equal design according to actual application requirements. For example, the number of sensing units can be multiple to receive light beams with different wavelengths and / or different orientations and directions. Alternatively, the first light source 1111 and the second light source 1121 may be the same light source, and the light emitting device 11 may further include a housing 115 in the form of a surface-fixed element (SMD) for the first light source. 1111, the first lens group 1112, the second light source 1121, and / or the second lens group 1122 are fixed therein to improve the reliability and achieve the protection effect; in addition, the light emitting device 11 and the sensing unit 12 can also be integrated in On the same circuit board (PCB).

Next, it is explained that the present case transmits the first structured light 113 and the second structure. The principle of distance measurement (depth distance) is performed by the light 114. Please refer to FIG. 1 and FIG. 2 simultaneously. As shown in FIG. 2, in the preferred embodiment, the first pattern combination 21 corresponding to the first structured light 113 includes a plurality of first patterns 211 (ie, a plurality of dot patterns). ), And the second pattern combination 22 corresponding to the second structured light 114 includes a plurality of rectangular patterns composed of a plurality of second patterns 212 (ie, a plurality of horizontal / straight patterns); The direction of the optical axis 1131 (the first optical axis) is different from the direction of the optical axis 1141 (the second optical axis) of the second structured light 114, so the first structured light 113 having a first cone shape and the There will be a staggered area A between the second cone-shaped second structured light 114 (see the slanted area in FIG. 1), so that at least 81 of the first pattern combinations 21 are present on the test target 81 located in the staggered area A. Partial and at least part of the second pattern combination 22, and at least a relative positional relationship between the at least one first pattern 211 and the at least one second pattern 221 presented on the target 81 to be tested will depend on where it is located The position varies depending on the position, and the depth distance of the target to be measured can be quickly and accurately obtained by such a change.

For example, please refer to FIG. 4A and FIG. 4B. FIG. A better conceptual diagram of an image captured when the target is located at a first position in the staggered area of the first structured light and the second structured light. FIG. 4B shows the sensing unit located in the first structure of the target. A preferred conceptual diagram of an image captured at a second position in an interlaced area of light and a second structured light. For the convenience of description, the test target 82 shown in FIG. 4A and FIG. 4B are the same test target and are in a flat form, that is, if the test target 82 is in the same position, each block on the test target 82 All have the same distance from the sensing unit 12; as can be seen from FIG. 4A and FIG. 4B, the relative positional relationship between the plurality of first patterns 211 (that is, the plurality of dot patterns) and the plurality of second patterns 221 (that is, the plurality of line patterns) It will vary depending on whether the target 82 is in the first position or in the second position. For example, when the target 82 is in the first position in one of the staggered areas A of the first structured light 113 and the second structured light 114 , The distance between the dot pattern X1 and the line pattern L1 on the measured target 82 in the image 71 captured by the sensing unit 12 is D11, and the distance between the dot pattern X2 and the line pattern L2 is D21; and when the measured target 82 is located at the first At a second position in the staggered area A of the structured light 113 and the second structured light 114, the distance between the dot pattern X1 and the line pattern L1 on the measured target 82 in the image 72 captured by the sensing unit 12 is D12 , The distance between the dot pattern X2 and the line pattern L2 is D22; among them, the distance D11 is different The distance D12 and the distance D21 are different from the distance D22, and according to the distance D11, the distance D21, and / or the distance between other dot patterns and line patterns when the target 82 is in the first position, the depth distance of the first position can be derived ( (As obtained by looking up the table), similarly, according to the distance D12, the distance D22 and / or when When the measured target 82 is at the second position, the distance between other dot patterns and line patterns can be quickly pushed to the second position's depth distance (such as through a look-up table). In this way, you can also get the first The depth difference between the position and the second position.

According to the same principle, please refer to Fig. 3 again, the test target shown in Fig. 3 81 is a hand body, and because the hand body presents a gesture, the distance between each block on the hand body and the sensing unit 12 is different, but according to the above description, it can be known that the target object is captured by the sensing unit 12 The image of 81 can capture a plurality of first patterns 211 and a plurality of second patterns 221 mapped on the measured target 81, and then pass through the plurality of first patterns 211 and the plurality of second patterns 221. Relative position relationship, the depth distance of each block on the hand body can be obtained; of course, the size of each block on the hand body (that is, the degree to which it can be parsed) depends on the style of the first pattern 211 and / Or the style of the second pattern 221, for example, the smaller the distance between the line pattern and the line pattern, and / or the smaller the distance between the dot pattern and the dot pattern, each block on the hand body can be resolved The finer.

Please refer to FIG. 5, which shows that the optical device of the present invention is applied to a portable electronic device. A schematic diagram of a preferred structure of the device. The portable electronic device 4 may be a mobile phone, a tablet computer, or a wearable device, but is not limited to the above, and includes the light-emitting device 11 and the sensing unit 12, and the light-emitting device 11 and the sensing unit 12 are as described above. I will not repeat them here. Therefore, the portable electronic device 4 can capture 3D stereoscopic images and provide functions of 3D stereoscopic reconstruction and gesture recognition. According to the above description, the distance measurement accuracy of the optical device 1 of the present invention is good, and the measurement results are not easily affected by the environmental brightness, so it can bring more substantial benefits to the portable electronic device 4.

The above is only a preferred embodiment of the present invention, and is not intended to limit the scope of patent application of the present invention. Therefore, all other equivalent changes or modifications made without departing from the spirit disclosed by the present invention should be included in this case. Within the scope of patent application.

Claims (20)

A light emitting device includes: a first structured light generating unit for providing a first structured light, and the first structured light is projected to a target to be measured so as to correspond to the first structured light A plurality of first patterns in a first pattern combination are presented on the subject; and a second structured light generating unit for providing a second structured light, and the second structured light is projected to The target under test causes a plurality of second patterns corresponding to one of the second pattern combinations of the second structured light to appear on the target under test, and a second optical axis direction of one of the second structured lights is different from the One of the first structured lights in a first optical axis direction, and any one of the plurality of first patterns is different from any one of the plurality of second patterns; wherein one of the targets There is a plural first relative position relationship between the plural first patterns and the plural second patterns presented on the first block, and the plural first relative positions are closed to obtain the first block of the measured target. Depth distance, and one of the targets There is a plurality of second relative positional relationships between the plurality of first patterns and the plurality of second patterns presented on the blocks, and the plurality of second relative positional relationships are used to obtain the depth of the second block of the subject under test distance. The light emitting device according to item 1 of the scope of patent application, wherein the first structured light generating unit includes a first light source and a first lens group corresponding to the first pattern combination, and the second structured light generating unit It includes a second light source and a second lens group corresponding to the second pattern combination. The light-emitting device according to item 2 of the patent application scope, wherein the first light-emitting source system includes a laser diode (LD), a light-emitting diode (LED), an organic light-emitting diode (OLED), and At least one of a light emitting unit for outputting a light beam having a thermal sensing wavelength range; and / or the second light emitting source comprises a laser diode (LD), a light emitting diode (LED), At least one of an organic light-emitting diode (OLED) and a light-emitting unit for outputting a light beam having a thermal sensing wavelength interval; and / or the light-emitting device further includes a housing for the housing At least one of the first structured light generating unit and the second structured light generating unit is disposed therein, and the casing is a surface-mounting device (SMD). The light-emitting device according to item 2 of the scope of patent application, wherein the first light-emitting source is configured to output a light beam having a first wavelength and / or a light beam having a second wavelength. The light-emitting device according to item 4 of the patent application, wherein the light beam having the first wavelength is a visible light beam, and the light beam having the second wavelength is an invisible light beam. The light-emitting device according to item 2 of the scope of patent application, wherein the second light-emitting source is configured to output a light beam having a first wavelength and / or a light beam having a second wavelength. The light-emitting device according to item 6 of the application, wherein the light beam having the first wavelength is a visible light beam, and the light beam having the second wavelength is an invisible light beam. The light-emitting device according to item 1 of the scope of the patent application, wherein the first structured light and the second structured light respectively have a first cone shape and a second cone shape. The light-emitting device according to item 8 of the scope of patent application, wherein the first cone system includes at least one of a cone shape, an elliptical cone shape, and a side cone shape; and / or the second cone system includes a At least one of a conical shape, an elliptical cone shape, and a one-sided cone shape. The light-emitting device according to item 1 of the scope of patent application, wherein the plurality of first patterns include at least one dot pattern, and / or the plurality of second patterns include at least one line pattern or at least one rectangular pattern. An optical device includes: a light-emitting device for providing a first structure light and a second structure light, and the first structure light and the second structure light are respectively projected to a target to be measured, and Causing a plurality of first patterns in a first pattern combination corresponding to the first structured light and a plurality of second patterns in a second pattern combination corresponding to the second structured light to be respectively presented in the subject The second optical axis direction of one of the second structured light is different from the first optical axis direction of one of the first structured light, and any one of the plurality of first patterns is different from the first pattern Any one of the plurality of second patterns, the second pattern; and a sensing unit for sensing the plurality of first patterns and the plurality of second patterns present on the target under test; wherein one of the targets under test is There is a plurality of first relative positional relationships between the plurality of first patterns and the plurality of second patterns presented on a block, and the plurality of first relative positional relationships are used to obtain the first block of the target under test. Depth distance, and the subject There is a plurality of second relative positional relationships between the plurality of first patterns and the plurality of second patterns presented on a second block of the target, and the plurality of second relative positional relationships are used to obtain the first target The depth distance of the two blocks. The optical device according to item 1 of the patent application scope, wherein the light emitting device comprises at least one light source, a first lens group corresponding to the first pattern combination, and a second lens group corresponding to the second pattern combination. And a first complex light beam of one of the at least one light emitting source passes through the first lens group to form the first structured light, and a second complex light beam of one of the at least one light emitting source passes through the second lens group to form the first structured light Second structured light. The optical device according to item 12 of the application, wherein the at least one light emitting source system includes a laser diode (LD), a light emitting diode (LED), an organic light emitting diode (OLED), and At least one of a light emitting unit for outputting a light beam having a thermal sensing wavelength range. The optical device according to item 12 of the application, wherein the first plurality of light beams includes a light beam having a first wavelength and / or a light beam having a second wavelength. The optical device according to item 12 of the application, wherein the second complex light beam includes a light beam having a first wavelength and / or a light beam having a second wavelength. The optical device according to item 11 of the scope of patent application, wherein the first structured light and the second structured light respectively have a first cone shape and a second cone shape. The optical device according to item 16 of the application, wherein the first cone system includes at least one of a conical shape, an elliptical cone, and a side cone; and / or the second cone system includes a At least one of a conical shape, an elliptical cone shape, and a one-sided cone shape. The optical device according to item 11 of the application, wherein the plurality of first patterns include at least one dot pattern, and / or the plurality of second patterns include at least one line pattern or at least one rectangular pattern. The optical device according to item 11 of the scope of patent application, wherein the light emitting device and the sensing unit are integrated on a circuit board (PCB). The optical device described in item 11 of the scope of patent application is applied to portable electronic devices.