CN109005316B

CN109005316B - Image sensing module

Info

Publication number: CN109005316B
Application number: CN201810207632.3A
Authority: CN
Inventors: 蔡庆隆
Original assignee: Lite On Technology Corp
Current assignee: Lite On Technology Corp
Priority date: 2017-06-06
Filing date: 2018-03-14
Publication date: 2021-03-23
Anticipated expiration: 2038-03-14
Also published as: CN109001883A; CN109001883B; TWI659238B; TW201903450A; CN109005316A

Abstract

The invention provides an image sensing module. The image sensing module comprises a rotating mechanism, a light source, a reflecting element and a depth detection component. The light source and the reflecting element are fixed on the rotating mechanism and rotate by taking a rotating shaft of the rotating mechanism as a center. The light source sends a light beam toward the object to be measured. The light beam is reflected by the object to be detected and then transmitted to the depth detection component through the reflection of the reflection element. The image sensing module is beneficial to reducing the volume, the weight and the cost.

Description

Image sensing module

Technical Field

The present disclosure relates to optical modules, and particularly to an image sensor module.

Background

In recent years, the application range of the related art of stereoscopic image in daily life is gradually expanding in addition to the professional medical diagnosis and surgery, for example: information displays for vehicles, electronic games, multimedia entertainment, and the like, and achieve effects of self-experience by using technologies such as Augmented Reality (AR), Virtual Reality (VR), and Mixed Reality (MR). The stereoscopic image is generated by mainly using a multimedia device, such as a stereo camera (stereo camera), to capture image information, and then generating a depth map (depth map) of the captured scene through subsequent image processing. With the increasing popularity of augmented reality in mobile phone application software, mobile phones that carry stereoscopic depth sensing (3D depth sensing) technology are gradually emerging in the market. Current mobile phones are equipped with front and rear lenses. In addition to the shooting of general scenes, the need for face recognition (face recognition) or video communication (video communication) requires that both the front and rear lenses be equipped with stereo depth sensors. This may result in the mobile phone becoming heavy and costly.

Disclosure of Invention

The present invention provides an image sensing module, which can improve the above problems.

According to an embodiment of the present invention, the image sensing module includes a rotation mechanism, a light source, a reflective element and a depth detection component. The light source and the reflecting element are fixed on the rotating mechanism and rotate by taking a rotating shaft of the rotating mechanism as a center. The light source sends a light beam toward the object to be measured. The light beam is reflected by the object to be detected and then transmitted to the depth detection component through the reflection of the reflection element.

In an embodiment according to the invention, the reflecting element comprises a prism, a mirror or a beam splitter.

In an embodiment according to the present invention, the depth detection part includes a lens group and a time-of-flight sensor, wherein the light beam reflected by the reflection element is transmitted to the time-of-flight sensor via the lens group.

In an embodiment of the invention, the light exit side of the light source and the light entrance side of the reflection element are the same side.

In an embodiment according to the invention, the light beam comprises infrared light or visible light.

In an embodiment of the present invention, the light beam is a pulse light beam, and the light source continuously transmits a plurality of pulse light beams toward the object to be measured.

In an embodiment according to the present invention, the light beam is a pulse light beam, and a rotation axis of the rotation mechanism is parallel to an optical axis of the depth detection member.

In an embodiment of the invention, the image sensing module further includes a rotation control module. And the rotation control module controls the rotation of the rotation mechanism.

In an embodiment according to the invention, the rotation control module comprises a motor, a shape memory alloy, a piezoelectric material or a magnetostrictive material.

In an embodiment of the invention, the image sensing module is applied to an electronic device to sense depth information of the object to be measured.

In an embodiment of the present invention, the electronic device includes at least one rotation control module.

In the image sensing module according to the embodiment of the invention, the light source and the reflecting element are fixed on the rotating mechanism, and the depth detection component is arranged on a transmission path of the light beam from the reflecting element. By rotating the rotating mechanism to turn the light source and the reflecting element, depth information of different directions can be obtained without increasing a depth detection component. Therefore, compared to the prior art that requires the depth information of multiple directions by increasing the number of stereo depth sensors, the image sensing module of the embodiment of the invention is helpful to reduce the volume, weight and cost.

In order to make the aforementioned and other features and advantages of the invention more comprehensible, embodiments accompanied with figures are described in detail below.

Drawings

FIG. 1 is a schematic top view of an electronic device to which an image sensor module according to an embodiment of the invention is applied;

FIGS. 2A and 2B are schematic cross-sectional views illustrating the image sensor module of FIG. 1 rotated to different orientations;

fig. 3 is a schematic view of another electronic device to which an image sensing module according to an embodiment of the invention is applied.

Detailed Description

Fig. 1 is a schematic top view of an electronic device to which an image sensing module according to an embodiment of the invention is applied. Referring to fig. 1, the image sensing module 100 of the present embodiment is a depth sensing module, which is suitable for obtaining depth information of an object to be measured. The image sensing module 100 can be applied to the electronic device 10, so that the electronic device 10 has a depth sensing function. Fig. 1 schematically shows that the electronic device 10 is a portable device (portable device) with a display screen ds (display screen), such as a mobile phone (mobile phone), a tablet computer (tablet computer) or a notebook computer (laptop), but is not limited thereto. The display screen DS is adapted to provide image frames. In one embodiment, the display screen DS may also have a touch sensing function. That is, the display screen may include a display module or a touch display module.

The image sensing module 100 is disposed at one side of the display screen DS. For example, the front lens and the rear lens of the electronic device 10 may share the image sensing module 100, so that both the front lens and the rear lens of the electronic device 10 have a depth sensing function.

The image sensing module 100 includes a rotation mechanism 110, a light source 120, a reflection element 130, and a depth detection component 140. The rotating mechanism 110 has a rotating axis RA, and the rotating mechanism 110 is adapted to drive the components fixed to the rotating mechanism 110 to rotate around the rotating axis RA. Fig. 1 schematically shows the rotary mechanism 110 as a rectangular parallelepiped. However, the embodiment of the rotating mechanism 110 may be changed according to the requirement, and is not limited to the one shown in fig. 1.

The light source 120 is adapted to provide the light beam B required for depth sensing. The light source 120 may include a visible light source or a non-visible light source. The non-visible light source may be an infrared light source, but is not limited thereto. Correspondingly, the light beam B may comprise visible light or infrared light. In addition, the light beam may be a pulse light beam, and the light source 120 is adapted to continuously transmit a plurality of pulse light beams toward an object (not shown) to be measured (not shown) for obtaining depth information. The method for obtaining the depth information of the object to be measured will be described later.

The reflective element 130 is adapted to divert the light beam B 'reflected by the object to be measured, so that the light beam B' is transmitted toward the depth detection component 140, which is helpful for thinning the thickness of the image sensing module 100. The reflective element 130 may include any element having a reflective surface (not shown), such as a prism, a mirror, or a beam splitter, but not limited thereto.

The depth detection component 140 is adapted to receive the light beam B' reflected by the object to be measured, so that the image sensing module 100 can obtain the depth information of the object to be measured. The depth detection part 140 may include a lens group 142 and a Time Of Flight (TOF) sensor 144, wherein the light beam B' reflected by the reflective element 130 is transferred to the TOF sensor 144 via the lens group 142. The lens group 142 may include one or more lenses. Fig. 1 schematically shows a lens, but the types and the number of elements in the lens group are not limited thereto.

The light source 120 and the reflective element 130 are fixed to the rotating mechanism 110 and are adapted to rotate around the rotation axis RA of the rotating mechanism 110. The light exit side SE of the light source 120 and the light entrance side SI of the reflective element 130 are, for example, the same side. In other words, the light-emitting side SE of the light source 120 and the light-entering side SI of the reflective element 130 face the same direction (e.g., both face the object to be measured for which the depth information is to be obtained). In this way, after the light beam B emitted by the light source 120 (the light beam B is emitted from the paper surface, for example) is reflected by the object to be measured, the reflection element 130 can receive the light beam B 'reflected by the object to be measured (the light beam B' is emitted into the paper surface, for example). The depth detection part 140 is disposed on a transmission path of the light beam B 'from the reflection element 130 to receive the light beam B' reflected by the reflection element 130.

In the present embodiment, the reflection element 130 is disposed between the light source 120 and the depth detection part 140. Further, the rotation axis RA of the rotation mechanism 110 is parallel to the optical axis OA of the depth detection member 140, and the rotation axis RA of the rotation mechanism 110 is coaxial with the optical axis OA of the depth detection member 140, for example. However, the relative arrangement relationship among the light source 120, the reflective element 130 and the depth detection part 140 may be changed according to the requirement, and is not limited to that shown in fig. 1. For example, in fig. 1, the light source 120 may be disposed on a side of the reflective element 130 away from the display screen DS, such that the reflective element 130 is located between the light source 120 and the display screen DS. Alternatively, the light source 120 may be arranged between the reflective element 130 and the display screen DS. In addition, other components can be arranged as required to change the optical path. In other words, the rotation axis RA of the rotation mechanism 110 and the optical axis OA of the depth detection member 140 do not need to be coaxial.

The following describes a method for obtaining depth information of different orientations by the image sensor module 100 with reference to fig. 2A and 2B. Fig. 2A and 2B are schematic cross-sectional views illustrating that the image sensor module of fig. 1 is rotated to different orientations, wherein fig. 2A illustrates that the image sensor module 100 obtains depth information of an object OBJ1 located in front of the electronic device 10, and fig. 2B illustrates that the image sensor module 100 obtains depth information of an object OBJ2 located in back of the electronic device 10.

When it is required to obtain the depth information of the object OBJ1 in front of the electronic device 10 (or the depth information of the object OBJ2 in back of the electronic device 10), the light source 120 and the reflective element 130 can be turned to face the object OBJ1 (or the object OBJ2) by rotating the rotating mechanism 110. Here, the rotation of the rotation mechanism 110 may be performed by a user manually rotating the rotation mechanism 110. Alternatively, as shown in fig. 1, the image sensing module 100 may further include a rotation control module 150 to control the rotation of the rotation mechanism 110, such as controlling the rotation direction, the rotation angle and when to rotate. Specifically, the image sensing module 100 can instruct the rotation control module 150 to rotate the rotation mechanism 110 according to the instruction of the user. The rotation control module 150 may include a shape memory alloy, a piezoelectric material, or a magnetostrictive material, and controls the deformation amount of the shape memory alloy, the piezoelectric material, or the magnetostrictive material according to the electrical signal sent by the rotation control module 150, so as to control the rotation of the rotation mechanism 110, but is not limited thereto. In one embodiment, the rotation control module 150 may include a motor to control rotation of the rotation mechanism 110.

Referring to fig. 2A, when it is required to obtain the depth information of the object OBJ1 in front of the electronic device 10, the light source 120 and the reflective element 130 face the object OBJ1 in front of the electronic device 10 through the rotation of the rotation mechanism 110. Light source 120 sends a beam B toward object OBJ 1. The light beam B is reflected by the object OBJ1 (forming a light beam B' with depth information), and then transmitted to the depth detection unit 140 by reflection on the reflection surface SR of the reflection element 130. The depth detection component 140 can determine the distance between the object OBJ1 and the electronic device 10 by analyzing the time difference (or phase difference) between the light beam B transmitted by the light source 120 and the light beam B' received by the depth detection component 140.

Referring to fig. 2B, when it is required to obtain the depth information of the object OBJ2 behind the electronic device 10, the light source 120 and the reflective element 130 face the object OBJ2 behind the electronic device 10 through the rotation of the rotation mechanism 110. Light source 120 sends a beam B toward object OBJ 2. The light beam B is reflected by the object OBJ2 (forming a light beam B' with depth information), and then transmitted to the depth detection unit 140 by reflection of the reflection element 130. The depth detection component 140 can determine the distance between the object OBJ2 and the electronic device 10 by analyzing the time difference (or phase difference) between the light beam B transmitted by the light source 120 and the light beam B' received by the depth detection component 140.

By rotating the rotating mechanism 110 to turn the light source 120 and the reflective element 130, depth information of different orientations can be obtained without adding the depth detection part 140. For example, in the example of fig. 2A and 2B, depth information for the front and back of the electronic device 10 may be obtained with one depth detection component 140. Therefore, compared to the prior art that needs to obtain depth information of multiple directions by increasing the number of stereo depth sensors, the image sensing module 100 of the present embodiment is helpful to reduce the volume, weight and cost. In other words, the image sensing module 100 of the present embodiment facilitates the thinning of the electronic device 10, and can reduce the cost of the electronic device 10 required to have the depth sensing function.

Fig. 3 is a schematic view of another electronic device to which an image sensing module according to an embodiment of the invention is applied. Referring to fig. 3, fig. 3 schematically shows that the electronic device 20 is an unmanned aerial vehicle. In addition, the image sensor module 100 is disposed such that the rotation axis RA of the rotation mechanism 110 and the optical axis OA of the depth detection unit 140 are perpendicular to the electronic device 20. In this configuration, the light source 120 of the image sensor module 100 may be disposed on a plane below the electronic device 20, and the image sensor module 100 may obtain 360 degrees of depth information on the plane by rotating the rotating mechanism 110. Furthermore, the image sensor module 100 can be configured with another rotation control module, and the light source 120 is deviated from the rotation axis RA (or the optical axis OA) by a specific angle, so that the image sensor module 100 can also obtain the depth information of 180 degrees right below the plane. In another embodiment, the image sensing module 100 can also be configured such that the rotation axis RA of the rotation mechanism 110 and the optical axis OA of the depth detection component 140 are parallel to the electronic device 20.

It should be noted that the application scope of the image sensing module 100 is not limited to portable devices and drones. For example, the image sensing module 100 can also be applied to an unmanned vehicle or any device requiring a depth sensing function, and at least one rotation control module is configured according to the requirements of the device to obtain depth information relative to the device in a specific direction and/or space.

In the image sensing module according to the embodiment of the invention, the light source and the reflecting element are turned by rotating the rotating mechanism, so that the depth information of different directions can be obtained without adding a depth detection component. Therefore, compared to the prior art that requires the depth information of multiple directions by increasing the number of stereo depth sensors, the image sensing module of the embodiment of the invention is helpful to reduce the volume, weight and cost. In other words, the image sensing module according to the embodiment of the invention facilitates the thinning of the electronic device, and can reduce the cost of the electronic device required to have the depth sensing function.

Finally, it should be noted that: the above embodiments are only used to illustrate the technical solution of the present invention, and not to limit the same; while the invention has been described in detail and with reference to the foregoing embodiments, it will be understood by those skilled in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some or all of the technical features may be equivalently replaced; and the modifications or the substitutions do not make the essence of the corresponding technical solutions depart from the scope of the technical solutions of the embodiments of the present invention.

Claims

1. An image sensing module, comprising:

a rotation mechanism;

a light source;

a reflective element; and

a depth detection means for detecting the depth of the image,

the light source and the reflecting element are fixed on the rotating mechanism and rotate by taking a rotating shaft of the rotating mechanism as a center, the light source sends a light beam to an object to be detected, the light beam is reflected by the object to be detected and then transmitted to the depth detection component through reflection of the reflecting element, and the rotating shaft of the rotating mechanism is parallel to an optical axis of the depth detection component.

2. The image sensing module of claim 1, wherein the reflective element comprises: prisms, mirrors or beam splitters.

3. The image sensing module of claim 1, wherein the depth detection component comprises a lens group and a time-of-flight sensor, wherein the light beam reflected by the reflective element is transmitted to the time-of-flight sensor via the lens group.

4. The image sensor module of claim 1, wherein the light exit side of the light source is the same as the light entrance side of the reflective element.

5. The image sensing module of claim 1, wherein the light beam comprises infrared light or visible light.

6. The image sensing module of claim 1, wherein the light beam is a pulsed light beam, and the light source continuously transmits a plurality of pulsed light beams toward the object.

7. The image sensing module of claim 1, further comprising:

and the rotation control module controls the rotation of the rotation mechanism.

8. The image sensing module of claim 7, wherein the rotation control module comprises a motor, a shape memory alloy, a piezoelectric material, or a magnetostrictive material.

9. The image sensing module of claim 1, wherein the image sensing module is applied in an electronic device for sensing depth information of the object.

10. The image sensing module of claim 9, wherein the electronic device comprises at least one rotation control module.