TWI761128B - Dual lens imaging module and capturing method thereof - Google Patents

Abstract

A dual lens imaging module adapted to an electronic device is provided. The dual lens imaging module includes a first lens, a second lens and a movement module. The movement module is connected to the second lens and is adapted to move or tilt the second lens, wherein the first lens is a lens with an autofocus function, and the working distance of the dual lens imaging module is adapted to vary according to the spacing between the first lens and the second lens. In addition, a capturing method thereof is also provided.

Description

Dual-lens imaging module and its capturing method

The present invention relates to an optical imaging module and a capturing method thereof, and in particular, to a dual-lens imaging module and a capturing method thereof.

In recent years, with the continuous advancement of display technology, viewers have higher and higher requirements for the display quality (such as image resolution, color saturation, etc.) of the display. However, in addition to high image resolution and high color saturation, for viewers, whether the display can display stereoscopic images has gradually become one of the considerations in purchasing. However, in the current mobile phone, tablet or head-mounted display, the working distance of lens imaging or photography is often limited due to the limitation of the size of the device.

In addition, many current image information can also be displayed as a stereoscopic image with depth information. However, in the current technology, it is impossible to perform 3D imaging or 3D photography with simple components, and simultaneously perform depth sensing to obtain depth information and optimize the 3D image display effect.

The present invention provides a dual-lens imaging module, which can increase the range of its working distance and achieve a good display effect for stereo imaging.

The invention provides a dual-lens imaging module suitable for an electronic device, comprising a first lens, a second lens and a moving module. The moving module is connected to the second lens and is suitable for moving or tilting the second lens, wherein the first lens is a lens with an auto-focus function, and the working distance of the dual-lens imaging module is adapted to be based on the distance between the first lens and the second lens Change.

In an embodiment of the present invention, the above-mentioned dual-lens imaging module further includes a light-transmitting substrate configured to cover the first lens and the second lens.

In an embodiment of the present invention, the surface of the above-mentioned light-transmitting substrate is flush with the surface of the outer shape of the electronic device.

In an embodiment of the present invention, the above-mentioned dual-lens imaging module further includes an optical element, which is detachably disposed on the light-transmitting substrate. The second lens is adapted to be moved to the effective optical path of the optical element by the moving module.

In an embodiment of the present invention, the above-mentioned optical element is at least one lens having a diopter, a neutral gray filter, a color filter, or a polarizer.

In an embodiment of the present invention, the above-mentioned moving module includes a driving element and a carrying element. The driving element is connected to the mounting element, and the second lens is arranged on the mounting element. The driving element is adapted to drive the mounting element to move or tilt the second lens.

In an embodiment of the present invention, the above-mentioned moving module is a linear motor driving module, a voice coil motor driving module, a shape memory alloy component, a piezoelectric material module or a Hall sensor.

In an embodiment of the present invention, the above-mentioned moving module includes a first moving module and a second moving module. The first moving module and the second moving module are respectively connected to the first lens and the second lens. The first moving module is adapted to move or tilt the first lens, and the second moving module is adapted to move or tilt the second lens.

In an embodiment of the present invention, the above-mentioned dual-lens imaging module further includes a depth identification module disposed on the first lens. The depth identification module includes a first aperture, a second aperture and a switching element. The switching element is suitable for switching the first aperture and the second aperture to the effective optical path of the first lens or the second lens. The first aperture has a light-shielding pattern.

In an embodiment of the present invention, the above-mentioned first lens further includes an auto-focusing element, and the auto-focusing element is electrically connected to the depth identification module.

In an embodiment of the present invention, the above-mentioned light-shielding pattern is formed by a light-shielding film.

In an embodiment of the present invention, the above-mentioned shading pattern is an asymmetric pattern.

The present invention further provides a method for capturing a dual-lens imaging module, wherein the dual-lens imaging module includes a first lens and a second lens, and the capturing method for the dual-lens imaging module includes: using the first lens and the second lens respectively extracting a first image and a second image; forming a stereoscopic image according to the first image and the second image; adjusting the first lens or the second lens to obtain optimized data; and forming an optimized stereoscopic image according to the optimized data and the stereoscopic image image.

In an embodiment of the present invention, the step of adjusting the first lens or the second lens to obtain the optimization data includes: changing the focal length of the first lens; capturing an out-of-focus image with the first lens; and obtaining according to the out-of-focus image Optimize data.

In an embodiment of the present invention, the step of adjusting the first lens or the second lens to obtain optimized data includes: switching an aperture to an effective optical path of the first lens; capturing an out-of-focus image with the first lens; and recognizing the pattern change of the out-of-focus image to measure the optimization data, wherein the aperture has a shading pattern.

In an embodiment of the present invention, the step of forming an optimized stereoscopic image according to the optimization data and the stereoscopic image includes: obtaining a depth data according to the stereoscopic image; and modifying the depth data according to the optimization data to form an optimized stereoscopic image.

Based on the above, in the dual-lens imaging module and its capturing method of the present invention, the first lens is a lens with an auto-focus function, and the second lens is connected to the moving module to move or tilt to change the relationship with the first lens. spacing between. Therefore, the dual-lens imaging module can capture objects with a short or far working distance, and is suitable for users with different distances between eyes. In addition, the dual-lens imaging module can also capture multiple images at different positions by moving the second lens, so as to obtain a stereoscopic image or a stereoscopic image that can display a stereoscopic effect. In this way, the range of the working distance of the dual-lens imaging module can be increased, and a good display effect of the stereoscopic imaging can be obtained.

In order to make the above-mentioned features and advantages of the present invention more obvious and easy to understand, the following embodiments are given and described in detail with the accompanying drawings as follows.

FIG. 1 is a schematic rear view of an electronic device according to an embodiment of the present invention. Please refer to Figure 1. This embodiment provides a dual-lens imaging module 100 that can be mounted on an electronic device 10, such as a smart phone, tablet, head-mounted display device, etc., and can be applied to stereo imaging, stereo photography, panoramic photography, virtual reality in technologies such as Virtual Reality (VR) or Augmented Reality (AR). This embodiment is described by taking the electronic device 10 as a smart phone as an example, but the present invention is not limited to this. In this embodiment, the dual-lens imaging module 100 can be mounted on one side of the electronic device 10 opposite to the display surface, as shown in FIG. 1 . In this embodiment, the dual-lens imaging module 100 includes a first lens 110 , a second lens 120 and a moving module 130 .

2A and 2B are schematic side views of the dual-lens imaging module before and after moving the lens, respectively, according to an embodiment of the present invention. Please refer to FIG. 1 and FIG. 2A first. In this embodiment, the dual-lens imaging module 100 further includes a light-transmitting substrate 140 configured to cover the first lens 110 and the second lens 120 , wherein the first lens 110 is a lens with an auto-focus function. In this embodiment, the surface of the transparent substrate 140 is flush with the surface of the outer shape of the electronic device 10 . For example, the light-transmitting substrate 140 is a plastic cover, and its surface is flush with the surface of the casing of the smart phone, but the invention is not limited thereto.

The moving module 130 is connected to the second lens 120 . Specifically, the moving module 130 includes a driving element 132 and a mounting element 134 . The driving element 132 is connected to the mounting element 134 , and the second lens 120 is disposed on the mounting element 134 . In this embodiment, the moving module 130 is a linear motor driving module. However, in other embodiments, the moving module 130 may be a voice coil motor (VCM) drive module, a shape memory alloy (Shape Memory Alloys, SMA) component, a piezoelectric material module, or a Hall sensor (Hall sensor). effect sensor), the present invention is not limited to this.

Please refer to FIG. 1 to FIG. 2B first. In this embodiment, the moving module 130 can move the second lens 120 so that the distance between the second lens 120 and the first lens 110 is changed from the distance D1 before the movement to the distance D2 after the movement, as shown in FIGS. 2A and 2B . shown. Specifically, in this embodiment, the driving element 132 is adapted to drive the mounting element 134 to move the second lens 120 . Therefore, changing the distance between the first lens 110 and the second lens 120 enables the dual-lens imaging module 100 to photograph objects with a short or far working distance, and is suitable for users with different distances between eyes. In addition, the dual-lens imaging module 100 can also capture a plurality of images at different positions by moving the second lens 120 to obtain a stereoscopic image or a stereoscopic image that can display a stereoscopic effect. In this way, the range of the working distance of the dual-lens imaging module 100 can be increased, and a good display effect can be obtained for the stereoscopic imaging.

It is worth mentioning that, in this embodiment, an optimized stereoscopic image can be further obtained by using an algorithm. Specifically, the first lens 110 with the auto-focus function can be adjusted to capture an out-of-focus image at the non-focus position, and then an algorithm is used to compare the out-of-focus image with the in-focus image previously obtained at the in-focus position to obtain optimized data. Finally, an algorithm is used to combine this optimized data into the previous stereoscopic image to obtain an optimized stereoscopic image with better depth information. In this way, an optimized stereoscopic image with better depth information can be obtained by defocusing the captured image and the operation of the algorithm.

In some embodiments, according to different types of moving modules 130 , the second lens 120 can also be tilted to change its optical axis angle, thereby improving the display effect of stereoscopic imaging, but the present invention is not limited thereto. In addition, in other embodiments, the moving module 130 may include a first moving module and a second moving module (not shown). The first moving module and the second moving module are respectively connected to the first lens 110 and the second lens 120 . The first moving module is adapted to move or tilt the first lens 110 , and the second moving module is adapted to move or tilt the second lens 120 . In other words, in these embodiments, an additional moving module 130 can be configured to move the first lens 110 so that both lenses can be moved or tilted, but the present invention is not limited thereto.

FIG. 3 is a schematic side view of a dual-lens imaging module according to another embodiment of the present invention. Please refer to Figure 3. The dual-lens imaging module 100A of this embodiment is similar to the dual-lens imaging module 100 shown in FIG. 1 . The difference between the two is that, in this embodiment, the dual-lens imaging module 100A further includes an optical element 150 , which is detachably disposed on the light-transmitting substrate 140 . The second lens 120 is adapted to be moved to the effective optical path of the optical element 150 by the moving module 130 . In this embodiment, the optical element 150 is, for example, a neutral density filter (Neutral Density filter, ND filter). Therefore, when the second lens 120 is moved under the optical element 150 by the moving module 130 , the light received by the second lens 120 can pass through the optical element 150 first to generate a filter effect.

FIG. 4 is a schematic side view of a dual-lens imaging module according to another embodiment of the present invention. Please refer to Figure 4. The dual-lens imaging module 100B of this embodiment is similar to the dual-lens imaging module 100A shown in FIG. 3 . The difference between the two is that, in this embodiment, the optical element 150A is, for example, at least one lens having a diopter. Therefore, when the second lens 120 is moved under the optical element 150A by the moving module 130 , the light received by the second lens 120 can be generated by the optical element 150A to have different fields of view (FOV). Effect. In the present embodiment, the optical element 150A may additionally select a color filter or a polarizer to achieve different optical imaging effects, but the present invention is not limited thereto. And in these embodiments, the optical element 150A can be replaced simply via manipulation. In this way, various optical imaging effects can be obtained by simply replacing the optical element 150A as required.

5 is a schematic side view of a dual-lens imaging module according to another embodiment of the present invention. FIG. 6A and FIG. 6B are schematic top views of part of the depth identification module in FIG. 5 , respectively. FIG. 7 is a schematic diagram of imaging of the first lens in FIG. 5 when it is out of focus. Please refer to Figure 5 to Figure 7. The dual-lens imaging module 100C of this embodiment is similar to the dual-lens imaging module 100 shown in FIG. 2A . The difference between the two is that, in this embodiment, the dual-lens imaging module 100C further includes a depth identification module 160 , which is disposed on the first lens 110 . In this embodiment, the depth identification module 160 is a plurality of aperture switching modules for switching out different apertures to change the first lens 110 to be a photography function or a depth sensing function. Specifically, the depth recognition module 160 includes a first aperture 162 , a second aperture 164 and a switching element 166 . The first aperture 162 is a special aperture with a light-shielding pattern A, as shown in FIG. 6A . In this embodiment, the light-shielding pattern A is an asymmetric pattern, and the light-shielding pattern A is formed of a light-shielding film. However, the present invention does not limit the forming material, shape, size or quantity of the light-shielding pattern A.

The second aperture 164 is an aperture used in general photography, as shown in FIG. 6B . The switching element 166 is suitable for switching the first aperture 162 and the second aperture 164 to the effective optical path of the first lens 110 , but the present invention does not limit the form and type of the switching element 166 . When the switching element 166 switches the first aperture 162 with the shading pattern A to the effective optical path of the first lens 110 , the first lens 110 can be defocused to capture images by the autofocus system of the first lens 110 . Since the first aperture 162 has the shading pattern A, the image captured in the out-of-focus state will display the shading pattern A, as shown in FIG. 7 . The size of the pattern displayed in the captured image varies according to different defocus positions. In other words, when the first aperture 162 is switched to the effective optical path of the first lens 110, the first lens 110 can be used as a depth sensor. In this way, the depth information of the image can be obtained by changing the focus state of a single lens, thereby further optimizing the stereoscopic image. In one embodiment, the auto-focusing element of the first lens 110 can be electrically connected to the depth recognition module 160 to passively measure the depth. In this way, the power saving effect can be further achieved.

FIG. 8 is a flow chart of steps of a method for capturing a dual-lens imaging module according to an embodiment of the present invention. Please refer to FIG. 2B and FIG. 8 . This embodiment provides a method for capturing a dual-lens imaging module, which is at least applicable to the dual-lens imaging module 100 shown in FIG. 2B , so the following description will take the dual-lens imaging module 100 shown in FIG. 2B as an example for description , but the present invention is not limited to this. In this embodiment, step 200 is first executed, and a first image and a second image are captured by the first lens 110 and the second lens 120, respectively. Next, after the above steps, step S210 is executed to form a stereoscopic image according to the first image and the second image. That is, after using the images captured by the first lens 110 and the second lens 120 as the left image and the right image, the left image and the right image are combined into a stereoscopic image with depth information.

Next, after the above steps, step S220 is executed to adjust the first lens 110 to obtain an optimization data. For example, in one embodiment, the focal length of the first lens 110 can be changed first, and then a defocused image can be captured by the first lens 110 . Finally, the optimization data is obtained based on the out-of-focus image. In some embodiments, the second lens 120 can also be operated to capture out-of-focus images in the same way, but the invention is not limited thereto. For another example, in another embodiment, an aperture with a shading pattern can be switched to the effective optical path of the first lens 110 , and then an out-of-focus image can be captured by the first lens 110 . Finally, the pattern changes of the out-of-focus images are identified to measure the optimization data.

Next, after the above steps, step S230 is executed to form an optimized stereoscopic image according to the optimization data and the stereoscopic image. Specifically, in this embodiment, a depth data is obtained according to the stereoscopic image, and then the depth data is modified according to the optimized data to form an optimized stereoscopic image. The method for obtaining depth data according to the stereoscopic image can be sufficiently taught from the above-mentioned method of moving the second lens 120 , so it is not repeated here.

To sum up, in the dual-lens imaging module and the capturing method of the present invention, the first lens is a lens with an auto-focus function, and the second lens is connected to the moving module to move or tilt to change the relationship with the first lens. Spacing between lenses. Therefore, the dual-lens imaging module can capture objects with a short or far working distance, and is suitable for users with different distances between eyes. In addition, the dual-lens imaging module can also capture multiple images at different positions by moving the second lens, so as to obtain a stereoscopic image or a stereoscopic image that can display a stereoscopic effect. In this way, the range of the working distance of the dual-lens imaging module can be increased, and a good display effect of the stereoscopic imaging can be obtained.

Although the present invention has been disclosed as above with examples, it is not intended to limit the present invention. Anyone with ordinary knowledge in the technical field can make some changes and modifications without departing from the spirit and scope of the present invention. The protection scope of the present invention shall be determined by the scope of the appended patent application.

10: Electronics 100, 100A, 100B, 100C: Dual-lens imaging module 110: The first shot 120: Second shot 130: Mobile Mods 132: Drive Components 134: Mounted Components 140: Light-transmitting substrate 150, 150A: Optical Components 160: Deep Recognition Module 162: First aperture 164: second aperture 166: Toggle element A: Shading pattern D1, D2: Spacing S200~S230: Steps

FIG. 1 is a schematic rear view of an electronic device according to an embodiment of the present invention. 2A and 2B are schematic side views of the dual-lens imaging module before and after moving the lens, respectively, according to an embodiment of the present invention. FIG. 3 is a schematic side view of a dual-lens imaging module according to another embodiment of the present invention. FIG. 4 is a schematic side view of a dual-lens imaging module according to another embodiment of the present invention. 5 is a schematic side view of a dual-lens imaging module according to another embodiment of the present invention. FIG. 6A and FIG. 6B are schematic top views of part of the depth identification module in FIG. 5 , respectively. FIG. 7 is a schematic diagram of imaging of the first lens in FIG. 5 when it is out of focus. FIG. 8 is a flow chart of steps of a method for capturing a dual-lens imaging module according to an embodiment of the present invention.

100: Dual-lens imaging module

110: The first shot

120: Second shot

130: Mobile Mods

132: Drive Components

134: Mounted Components

140: Light-transmitting substrate

D2: Spacing

Claims (6)

A method for capturing a dual-lens imaging module, the dual-lens imaging module includes a first lens and a second lens, and the capturing method for the dual-lens imaging module comprises: using the first lens and the second lens respectively extracting a first image and a second image; forming a stereoscopic image according to the first image and the second image; adjusting the first lens or the second lens to obtain an optimization data, including: changing the first lens or the focal length of the second lens; capturing an out-of-focus image with the first lens or the second lens; obtaining the optimization data according to the out-of-focus image; and forming an optimized stereoscopic image with the stereoscopic image according to the optimization data. The method for capturing a dual-lens imaging module according to claim 1, wherein the step of capturing the first image and the second image by using the first lens and the second lens respectively comprises: the first lens and the second image respectively. The images captured by the second lens are respectively used as a left image and a right image. The method for capturing a dual-lens imaging module according to claim 2, wherein the step of forming the stereoscopic image according to the first image and the second image comprises: combining the left image and the right image to form the stereoscopic image with depth information image. The method for capturing a dual-lens imaging module as claimed in claim 1, wherein the step of adjusting the first lens or the second lens to obtain the optimization data comprises: Switching an aperture to the effective optical path of the first lens; capturing the out-of-focus image with the first lens; and recognizing the pattern change of the out-of-focus image to measure the optimization data, wherein the aperture has a light-shielding pattern. The method for capturing a dual-lens imaging module according to claim 1, wherein the step of forming the optimized stereoscopic image according to the optimized data and the stereoscopic image comprises: obtaining a depth data according to the stereoscopic image; and modifying the optimized stereoscopic image according to the optimized data depth data to form the optimized stereoscopic image. The method for capturing a dual-lens imaging module according to claim 5, wherein the step of obtaining the depth data according to the stereoscopic image comprises: moving the second lens to capture a plurality of images at different positions.

Images