CN114070997A - Multi-camera module, camera system, electronic equipment and automatic zooming imaging method - Google Patents

Multi-camera module, camera system, electronic equipment and automatic zooming imaging method Download PDF

Info

Publication number
CN114070997A
CN114070997A CN202010753090.7A CN202010753090A CN114070997A CN 114070997 A CN114070997 A CN 114070997A CN 202010753090 A CN202010753090 A CN 202010753090A CN 114070997 A CN114070997 A CN 114070997A
Authority
CN
China
Prior art keywords
camera
image
unit
camera module
distance
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202010753090.7A
Other languages
Chinese (zh)
Inventor
戎琦
袁栋立
王启
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Ningbo Sunny Opotech Co Ltd
Original Assignee
Ningbo Sunny Opotech Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Ningbo Sunny Opotech Co Ltd filed Critical Ningbo Sunny Opotech Co Ltd
Priority to CN202010753090.7A priority Critical patent/CN114070997A/en
Priority to CN202180060940.8A priority patent/CN116250246A/en
Priority to PCT/CN2021/109581 priority patent/WO2022022682A1/en
Publication of CN114070997A publication Critical patent/CN114070997A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/67—Focus control based on electronic image sensor signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/69—Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/90—Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/95—Computational photography systems, e.g. light-field imaging systems
    • H04N23/951—Computational photography systems, e.g. light-field imaging systems by using two or more images to influence resolution, frame rate or aspect ratio

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computing Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Studio Devices (AREA)
  • Lens Barrels (AREA)

Abstract

Disclosed are a multi-camera module, a camera system, an electronic device and an automatic zooming imaging method. The many camera modules include: the camera comprises a first camera unit with a zooming function and a second camera unit with a preset relative position relation between the first camera unit, wherein a driving assembly of the first camera unit drives at least part of lenses in at least one lens group of the first camera unit to perform optical zooming based on an adjusting instruction, the adjusting instruction is generated based on the distance between the multi-camera module and a photographed target, and the distance is obtained based on the first camera module and the second camera module through a binocular distance measuring principle. In this way, the structural configuration of the multi-camera module enables the multi-camera module to perform automatic optical zooming based on the distance between the multi-camera module and a subject to provide better shooting experience.

Description

Multi-camera module, camera system, electronic equipment and automatic zooming imaging method
Technical Field
The application relates to the field of camera modules, in particular to a multi-camera module, a camera system, an electronic device and an automatic zooming imaging method.
Background
With the popularization of mobile electronic devices, technologies related to camera modules applied to mobile electronic devices for helping users to obtain images (such as videos or images) have been rapidly developed and advanced. Especially along with the development of smart mobile phone, the pursuit of consumer to shooting function is more and more diversified, also is higher and higher to the requirement of formation of image quality, and this has provided more challenges to the module of making a video recording.
In recent years, the camera module has experienced a change from a single camera module to a multi-camera module, and the recent demand for carrying a camera module with an optical zoom capability on a smartphone to meet camera shooting at different distances has emerged.
In the existing solutions, when shooting with the camera module having an optical zoom function, an optical zoom operation, i.e. zooming an image, needs to be performed manually to obtain a satisfactory shooting effect. In actual use, such manual zoom operation has many drawbacks.
First, through manual zooming, the adjustment range is difficult to control, and is often turned up or down, which affects the user experience.
Secondly, partly because of the first drawback, in practical use, manual adjustment is often required many times to enable the shooting range and the imaging quality to meet the requirements.
Therefore, a multi-camera module with an automatic zooming function and an imaging scheme thereof are needed.
Disclosure of Invention
An advantage of the present application is to provide a multi-camera module, a camera system, an electronic device, and an automatic zoom imaging method, wherein the structural configuration of the multi-camera module enables the multi-camera module to perform automatic optical zoom based on a distance between the multi-camera module and a subject to provide better shooting experience.
Another advantage of the present application is to provide a multi-camera module, a camera system, an electronic device, and an automatic zoom imaging method, wherein the multi-camera module measures a distance based on its own configured camera unit and provides required distance information for automatic optical zooming, that is, the multi-camera module according to an embodiment of the present application expands the function of its own configured camera unit to realize an automatic zooming function. That is, according to this application embodiment many camera modules have realized the automatic optics function of zooming under the prerequisite that need not additionally to dispose the range module.
Other advantages and features of the present application will become apparent from the following description and may be realized by means of the instrumentalities and combinations particularly pointed out in the appended claims.
In order to realize above-mentioned at least one purpose or advantage, the application provides a module of making a video recording more, and it includes:
the first camera shooting unit comprises a photosensitive chip, at least one lens group positioned on a photosensitive path of the photosensitive chip, and a driving component for driving at least part of lenses in the at least one lens group to perform optical zooming; and
the second camera shooting unit and the first camera shooting unit have a preset relative position relation;
wherein the driving component is configured to drive at least part of the lenses in the at least one lens group to perform optical zooming based on an adjustment instruction, the adjustment instruction is generated based on a distance of the multi-camera module relative to a subject, the distance of the multi-camera module relative to the subject is calculated based at least in part on a first image of the subject acquired by the first camera unit, a second image of the subject acquired by the second camera unit, and a relative positional relationship between the first camera unit and the second camera unit.
In a multi-camera module according to the present application, the at least one lens group comprises a first lens group and a second lens group, and the driving assembly comprises a first driving element configured to drive at least a part of the lenses of the first lens group for optical zooming based on the adjustment instruction.
In the multi-camera module according to the present application, the driving assembly further includes a second driving element configured to drive the second lens group for optical focusing based on the adjustment instruction.
In the multi-camera module according to the present application, the first camera unit further includes a reflection element disposed on the photosensitive path of the photosensitive chip for turning the imaging light.
In the multi-camera module according to the present application, the driving assembly further includes an anti-shake mechanism for driving the reflective element to perform optical anti-shake.
In the multi-camera module according to the present application, the driving assembly further includes an anti-shake mechanism for driving the first lens group and/or the second lens group for optical anti-shake.
In the multi-shot camera module according to the application, the multi-shot camera module further comprises a third camera unit having a preset position relationship with the first camera unit, and a third equivalent focal length of the third camera unit is larger than a second equivalent focal length of the second camera unit, wherein the adjusting instruction is generated based on a second distance of the multi-shot camera module relative to the object when a distance of the multi-shot camera module relative to the object, which is obtained based at least in part on the first image of the object captured by the first camera unit, the second image of the object captured by the second camera unit and a relative position relationship between the first camera unit and the second camera unit, exceeds a preset threshold value, wherein the second distance is generated based at least in part on the first image of the object captured by the first camera unit, And the third image of the shot target acquired by the third camera shooting unit and the relative position relationship between the first camera shooting unit and the third camera shooting unit are obtained by calculation.
According to another aspect of the present application, there is also provided an image pickup system including:
the multi-camera module; and
a processor communicably connected to the multi-shot camera module, wherein the processor is configured to generate adjustment instructions based on a distance of the multi-shot camera module relative to a subject.
In the camera system according to the present application, the processor is further configured to fuse a first image of the object captured by the first camera module and a second image of the object captured by the second camera module after the optical zoom is performed to obtain a fused image of the object; or, the first image of the object collected by the first camera module after the optical zooming is performed and the third image of the object collected by the third camera module are fused to obtain a fused image of the object.
According to still another aspect of the present application, there is also provided an auto-zoom imaging method including:
acquiring a zooming instruction;
responding to the zooming instruction, and acquiring the distance between a multi-shooting module and a shot target, wherein the multi-shooting module comprises a first shooting unit;
generating an adjusting instruction based on the distance, wherein the adjusting instruction is used for driving a driving assembly of the first camera shooting unit to drive at least part of lenses in at least one lens group of the first camera shooting unit to perform optical zooming; and
and fusing the first image of the object acquired by the first camera shooting unit after the optical zooming and the images of the object acquired by other camera shooting units of the multi-camera shooting module to obtain a fused image.
In an automatic zoom imaging method according to the present application, acquiring a distance between a multi-camera module and a subject in response to the zoom instruction includes:
obtaining a first image of the object by the first image pickup unit;
obtaining a second image of the object by the second image pickup unit; and
and obtaining a first distance between the multi-shooting module and the object to be shot based at least in part on the first image, the second image and the relative position relationship between the first shooting unit and the second shooting unit, wherein the first distance is the distance between the multi-shooting module and the object to be shot.
In the automatic zoom imaging method according to the present application, before the first image of the subject is obtained by the first image capturing unit, the method further includes: the driving assembly of the first camera shooting unit is pre-driven to drive at least part of lenses in at least one lens group of the first camera shooting unit to carry out optical zooming.
In the automatic zoom imaging method according to the present application, acquiring a distance between the multi-camera module and a subject in response to the zoom instruction, further includes:
when the first distance is larger than a preset threshold value, starting a third camera shooting unit of the multi-camera shooting module to obtain a third image of the shot target through the third camera shooting unit, wherein a third equivalent focal length of the third camera shooting unit is larger than a second equivalent focal length of the second camera shooting unit; and
and obtaining a second distance between the multi-shooting module and the object to be shot based at least in part on the first image, the third image and the relative position relationship between the first shooting unit and the third shooting unit, wherein the second distance is the distance between the multi-shooting module and the object to be shot.
In the auto-zoom imaging method according to the present application, the adjustment instruction is further configured to drive a first driving element of the driving assembly to drive at least a portion of lenses in a first lens group of the at least one lens group for optical zooming.
In the auto-zoom imaging method according to the present application, the adjustment instruction is further used to drive a second driving element of the driving assembly to drive a second lens group of the at least one lens group for optical focusing.
In the automatic zoom imaging method according to the present application, fusing a first image of the subject captured by the first imaging unit after performing optical zooming and images of the subject captured by other imaging units of the multi-camera module to obtain a fused image, includes: and fusing the first image of the object acquired by the first image pickup unit and the second image of the object acquired by the second image pickup unit after the optical zooming is performed to obtain a fused image.
In the automatic zoom imaging method according to the present application, fusing a first image of the subject captured by the first imaging unit after performing optical zooming and images of the subject captured by other imaging units of the multi-camera module to obtain a fused image, includes: and fusing the first image of the object acquired by the first image pickup unit and the third image of the object acquired by the third image pickup unit after the optical zooming is performed to obtain a fused image.
In the auto-zoom imaging method according to the present application, the auto-zoom imaging method further includes: and moving the multi-shooting camera module based on the motion trail of the shot target so that the shot target is always positioned in a shooting window of the multi-shooting camera module.
In the auto-zoom imaging method according to the present application, the auto-zoom imaging method further includes: the reflective element of the first imaging unit is moved based on a motion trajectory of a subject.
In the auto-zoom imaging method according to the present application, the auto-zoom imaging method further includes: rotating a reflective element of the first imaging unit based on a motion trajectory of a subject.
Further objects and advantages of the present application will become apparent from an understanding of the ensuing description and drawings.
These and other objects, features and advantages of the present application will become more fully apparent from the following detailed description, the accompanying drawings and the claims.
Drawings
The above and other objects, features and advantages of the present application will become more apparent by describing in more detail embodiments of the present application with reference to the attached drawings. The accompanying drawings are included to provide a further understanding of the embodiments of the application and are incorporated in and constitute a part of this specification, illustrate embodiments of the application and together with the description serve to explain the principles of the application. In the drawings, like reference numbers generally represent like parts or steps.
Fig. 1 illustrates a schematic diagram of a multi-camera module according to an embodiment of the present application.
Fig. 2 illustrates a schematic diagram of a binocular distance principle according to an embodiment of the present application.
Fig. 3 illustrates a schematic diagram of another multi-camera module according to an embodiment of the present application.
Fig. 4 illustrates a schematic diagram of an imaging system according to an embodiment of the application.
Fig. 5 illustrates a perspective view of an electronic device according to an embodiment of the application.
FIG. 6 illustrates a flow diagram of an auto-zoom imaging method according to an embodiment of the present application.
Fig. 7 illustrates a first schematic diagram of tracking a photographic target in an auto-zoom imaging method according to an embodiment of the present application.
Fig. 8 illustrates a second schematic diagram of tracking a photographic target in an auto-zoom imaging method according to an embodiment of the present application.
Fig. 9 illustrates a third schematic diagram of tracking a photographic target in the auto-zoom imaging method according to the embodiment of the present application.
Detailed Description
Hereinafter, example embodiments according to the present application will be described in detail with reference to the accompanying drawings. It should be understood that the described embodiments are only some embodiments of the present application and not all embodiments of the present application, and that the present application is not limited by the example embodiments described herein.
Summary of the application
In recent years, the camera module has experienced the change from single camera module to many camera modules, and the demand of carrying the camera module with optical zoom capability on the smart phone to meet different distance shooting has appeared recently, and this has provided more challenges to the camera module
In the conventional proposals, when an image pickup module having an optical zoom function is used to pick up images of objects (e.g., a person, a subject, etc.) at different distances, the image pickup module performs image pickup based on a manual adjustment of the image pickup range. Because the control range is not good in the manual adjustment process, multiple adjustments are usually required, which affects the zoom efficiency to a certain extent and reduces the shooting experience of the user.
Based on this, the basic idea of the present application is to provide an image pickup apparatus capable of realizing automatic optical zooming. Specifically, in constructing a solution for implementing automatic optical zooming, two elements need to be taken into account: the method includes obtaining a distance between the image pickup apparatus and a subject, and generating a parameter of the optical zoom based on the distance.
Based on this, this application has proposed a many camera modules, camera system, electronic equipment and automatic zoom imaging method, wherein, many camera modules include: the first camera shooting unit comprises a photosensitive chip, at least one lens group positioned on a photosensitive path of the photosensitive chip, and a driving component for driving at least part of lenses in the at least one lens group to perform optical zooming; the second camera shooting unit and the first camera shooting unit have a preset relative position relation; wherein the driving component is configured to drive at least part of the lenses in the at least one lens group to perform optical zooming based on an adjustment instruction, the adjustment instruction is generated based on a distance of the multi-camera module relative to a subject, the distance of the multi-camera module relative to the subject is calculated based at least in part on a first image of the subject acquired by the first camera unit, a second image of the subject acquired by the second camera unit, and a relative positional relationship between the first camera unit and the second camera unit. In this way, the structural configuration of the multi-camera module enables the multi-camera module to perform automatic optical zooming based on the distance between the multi-camera module and a subject to provide better shooting experience.
Exemplary Multi-camera Module
As shown in fig. 1, a multi-camera module according to an embodiment of the present application is illustrated, wherein the multi-camera module is configured such that it can perform automatic optical zooming based on its distance from a subject to provide a better shooting experience.
As shown in fig. 1, the multi-camera module 10 according to the embodiment of the present application includes a first camera unit 11 having an optical zoom function, and a second camera unit 12 having a preset relative positional relationship with the first camera unit 11. Specifically, the first image capturing unit 11 includes a photosensitive chip 111, at least one lens group 112 located on a photosensitive path set by the photosensitive chip 111, and a driving assembly 113 for driving at least a portion of lenses in the at least one lens group 112 to perform optical zooming.
Accordingly, the first imaging unit 11 and the second imaging unit 12 can capture images of a subject. In particular, in the present embodiment, the application of the first camera unit 11 and the second camera unit 12 of the multi-camera module 10 is further expanded, and more specifically, in the present embodiment, the first camera unit 11 and the second camera unit 12 measure the distance information between the multi-camera module 10 and the object based on the binocular distance measuring principle, that is, the distance between the multi-camera module 10 and the object is obtained by calculating at least partially based on the first image of the object captured by the first camera unit 11, the second image of the object captured by the second camera unit 12, and the relative positional relationship between the first camera unit 11 and the second camera unit 12. Further, the driving assembly 113 of the first camera unit 11 is configured to drive at least a part of the lenses of the at least one lens group 112 for optical zooming based on the adjustment instruction generated by the distance information, in such a way that the multi-camera module 10 structure is configured to realize the function of automatic optical zooming.
Fig. 2 illustrates a schematic diagram of a binocular ranging principle according to an embodiment of the present application. As shown in fig. 2, when P is a certain point on the object, OR and OT are optical centers of the first imaging unit 11 and the second imaging unit 12, respectively, imaging points formed by the point P on the photosensitive chips 111 of the first imaging unit 11 and the second imaging unit 12 are P and P ', respectively, f is an effective focal length of the second imaging unit 12, B is a center distance between the first imaging unit 11 and the second imaging unit 12, Z is depth information (i.e., distance information) to be calculated, and a distance from the imaging point P to the point P' is X:
X＝B-(XR-XT)
according to the triangle-like principle:
(B-(XR-XT))/B＝(Z-f)/Z
it is found that Z ═ fB/(X)R-XT)
The focal length and the camera center distance B can be obtained by calibration, so that only X is needed to be obtainedRThe value of X (i.e. the disparity d) yields the depth information Z, i.e. the distance.
It is worth mentioning that the first image capturing unit 11 and the second image capturing unit 12 have radial distortion due to the characteristics of the optical lenses, and accordingly, the distortion degree can be determined by three parameters, K1, K2 and K3; moreover, due to assembly errors, the photosensitive chip 111 is not perfectly parallel to the optical lens, so that the images of the first and second imaging units 11 and 12 are also distorted tangentially, and accordingly, the distortion degree can be determined by two parameters P1 and P2. In calibration of a single camera unit, internal parameters (including but not limited to the focal length f, the imaging origin Cx, Cy, the five distortion parameters mentioned above) and external parameters (world coordinates of a calibration object) of the single camera unit are mainly determined, and calibration of a binocular camera module (i.e., a camera unit combination composed of the first camera unit 11 and the second camera unit 12) is required to obtain not only internal parameters of each camera unit, but also a relative position between the first camera unit 11 and the second camera unit 12 (i.e., a rotation matrix R and a translational vector t of the second camera unit 12 relative to the first camera unit 11) through calibration.
After calibration, the images acquired by the first camera unit 11 and the second camera unit 12 can be respectively corrected based on the calibrated internal reference and binocular relative position relationship, so as to eliminate distortion and perform line alignment, and perform binocular distance measurement.
It should be noted that, in the embodiment of the present application, since the requirement of the multi-camera module 10 on the distance measurement accuracy is relatively low, in order to reduce the workload, calibration may be performed at specific points, for example, at points in the depth of field areas (i.e., window areas) of the first camera unit 11 and the second camera unit 12. Further, for example, the farthest depth of field point and the closest depth of field point are selected, the connecting line between the closest depth of field point X1 and the farthest depth of field point X2 is divided into N equal parts, the farthest depth of field point, the closest depth of field point and each equal part are calibrated, and the acquired parameters are burned, so that the ranging efficiency is improved, and the workload required for calibration is reduced.
Further, in the present embodiment, the second imaging unit 12 may be configured as a main imaging unit for acquiring a first image of a subject, which preferably has a relatively large field angle, for example, the field angle of the second imaging unit 12 is greater than 60 °; and the first camera unit 11 is configured as a sub-camera unit for adjusting the focal length thereof based on the distance between the multi-camera module and the object and capturing a first image of the object. Accordingly, after obtaining the first image and the second image, the multi-camera module 10 can fuse the first image and the second image to generate a fused image with higher imaging quality.
More specifically, as shown in fig. 1, in the embodiment of the present application, the at least one lens group 112 of the first image capturing unit 11 includes a first lens group 114 and a second lens group 115, and the driving assembly 113 includes a first driving element 117, and the first driving element 117 is configured to drive at least a part of lenses in the first lens group 114 to perform optical zooming based on the adjustment instruction. That is, in the embodiment of the present application, the first driving element 117 is a zoom driver for driving at least a part of the lenses in the first lens group 114 to move for optical zooming.
As shown in fig. 1, in the embodiment of the present application, the driving assembly 113 of the first image capturing unit 11 further includes a second driving element 118, and the second driving element 118 is configured to drive the second lens group 115 for optical focusing based on the adjustment instruction. That is, in the embodiment of the present application, the first image pickup unit 11 further has a focusing function, and the second driving element 118 is a focusing driver. It should be understood that after the optical zooming is performed by the first driving element 117, the second driver can drive the second lens group 115 to move, so as to not only achieve the optical focusing, but also compensate the effect of the optical zooming, so as to improve the image quality. That is, in the present invention, the first driving element 117 and the second driving element 118 respectively drive the first lens group 114 and the second lens group 115 to jointly realize optical zooming, and ensure ttl (total Track length) to be unchanged so as to have higher imaging quality after optical zooming; that is, the first lens group 114 is driven by the first driving element 117 to achieve zooming, and the second driving element 118 drives the second lens group 115 to achieve compensation and/or focusing, thereby acquiring a high-quality image.
It is worth mentioning that in other examples of the present application, the first driving element 117 and the second driving element 118 may be implemented as the same driver (i.e. the zoom driver and the focus driver are implemented as the same driver), or the first driving element 117 and the second driving element 118 have an integrated structure, which is not limited by the present application. Preferably, first lens group 114 and second lens group 115 are fixed to a connecting shaft at the same time, so that first lens group 114 and second lens group 115 do not shift during movement, and further from the connecting shaft, a guide rail (first lens group 114 and second lens group 115 are assembled to the same guide rail) or a hole axis structure (first lens group 114 and second lens group 115 are connected by a shaft and move along the shaft) may be used.
It should be understood that, in the embodiment of the present application, the at least one lens group 122 may further include a greater number of lens groups, for example, a third lens group 126 is further included, and the position of the third lens group 126 is fixed as a fixed lens group, which is not limited by the present application.
It is also worth mentioning that for some terminal devices (e.g. smart phones), there is a requirement for the thickness of the multi-camera module 10, i.e. it is necessary to ensure that the thickness of the multi-camera module 10 is less than a certain value. Accordingly, in other examples of the present application, the first image capturing unit 11 may be implemented as a periscopic image capturing unit, and accordingly, in these examples, the first image capturing unit 11 further includes a reflective element 119 disposed on the photosensitive path of the photosensitive chip 111 for turning the imaging light.
In order to further improve the imaging performance of the first camera unit 11, in some examples of the present application, the first camera unit 11 is further configured with an optical anti-shake function. For example, in some examples of the present application, the first image capturing unit 11 further includes a reflective element 119 disposed on a photosensitive path of the photosensitive chip 111 for turning imaging light; alternatively, the driving assembly 113 further includes an anti-shake mechanism for driving the first lens group 114 and/or the second lens group 115 to perform optical anti-shake, thereby compensating for an error due to a hand shake of a photographer.
In practical applications, when the object is far from the multi-camera module 10, the first camera unit 11 and the second camera unit 12 may not be able to measure the distance, that is, the distance between the object and the multi-camera module 10 is beyond the shooting range. Accordingly, as shown in fig. 3, in the embodiment of the present application, on the basis of the structure of the multi-camera module 10, a third camera unit 13 with a longer shooting range may be further configured, that is, the third equivalent focal length of the third camera unit 13 is greater than the second equivalent focal length of the second camera unit 12. Further, the third camera unit 13 and the first unit obtain the distance between the multi-camera module 10 and the object by the binocular distance measuring principle, that is, at least partially based on the first image of the object captured by the first camera unit 11, the third image of the object captured by the third camera unit 13, and the relative position relationship between the first camera unit 11 and the third camera unit 13.
More specifically, in the embodiment of the present application, when the distance between the multi-camera module 10 and the object is greater than a preset threshold, the distance is measured in a manner that the first camera unit 11 and the third camera unit 13 cooperate with each other; when the distance between the multi-camera module 10 and the object is lower than a preset threshold, the distance is measured by matching the first camera unit 11 with the second camera unit 12. That is, in some examples of the present application, the multi-camera module 10 may further include a determination module for determining a shooting distance to decide which two camera units to activate for ranging.
In summary, the multi-camera module 10 according to the embodiment of the present application is clarified, and the structural configuration of the multi-camera module 10 enables the multi-camera module 10 to perform automatic optical zooming based on the distance between the multi-camera module 10 and the object to be photographed, so as to provide better shooting experience.
Exemplary image pickup System
According to another aspect of the present application, a camera system is also provided.
Fig. 4 illustrates a schematic diagram of the camera system according to an embodiment of the application.
As shown in fig. 4, the imaging system 30 includes the multi-shot imaging module 10 as described above and a processor 20 communicably connected to the multi-shot imaging module 10, wherein the processor 20 is configured to generate an adjustment instruction based on a distance of the multi-shot imaging module 10 with respect to a subject. Accordingly, the image capturing system 30 realizes an auto-zoom function by driving at least a part of the lenses in the at least one lens group 112 to perform an optical zoom after the driving component 113 of the first image capturing unit 11 receives the adjustment instruction.
Accordingly, in the embodiment of the present application, the processor 20 is further configured to fuse the first image of the object captured by the first camera module and the second image of the object captured by the second camera module after the optical zoom is performed to obtain a fused image of the object.
Alternatively, in this embodiment, the processor 20 is further configured to fuse the first image of the object captured by the first camera module and the third image of the object captured by the third camera module after the optical zoom is performed, so as to obtain a fused image of the object.
Illustrative electronic device
According to another aspect of the present application, an electronic device is also provided.
Fig. 5 illustrates a perspective view of an electronic device according to an embodiment of the application.
As shown in fig. 5, the electronic apparatus 100 according to the embodiment of the present application includes an electronic apparatus main body 101 and the multi-camera module 10 as described above assembled to the electronic apparatus main body 101. In a specific implementation, the multi-camera module 10 is preferably configured on the back of the electronic device main body 101 to be configured as a rear camera module, but may be configured on the front of the electronic device main body 101 to be configured as a front camera module.
As shown in fig. 5, in the embodiment of the present application, the electronic device main body 101 includes a screen and an integrated circuit, wherein the screen can be used to display the image data collected by the multi-camera module 10, and the integrated circuit can be used to process the image data collected by the multi-camera module 10, so as to control the multi-camera module 10 to realize an automatic zoom shooting function.
Schematic automatic zooming imaging method
According to still another aspect of the present application, there is also provided an auto-zoom imaging method.
FIG. 6 illustrates a flow diagram of an auto-zoom imaging method according to an embodiment of the present application.
As shown in fig. 6, the auto-zoom imaging method according to the embodiment of the present application includes the steps of: s110, acquiring a zooming instruction; s120, responding to the zooming instruction, acquiring the distance between a multi-shooting module 10 and a shot object, wherein the multi-shooting module 10 comprises a first shooting unit 11; s130, generating an adjustment instruction based on the distance, where the adjustment instruction is used to drive the driving assembly 113 of the first camera unit 11 to drive at least a part of lenses in at least one lens group 112 of the first camera unit 11 to perform optical zooming; and S140, fusing the first image of the subject captured by the first imaging unit 11 after the optical zoom and the images of the subject captured by the other imaging units of the multi-camera module 10 to obtain a fused image.
In step S110, a zoom instruction is acquired. In the embodiment of the present application, the zoom instruction includes, but is not limited to, a subject displayed in a single-click screen, a subject displayed in a double-click screen, a subject displayed in a two-hand telescopic screen, and the like. It should be understood that the zoom command may be set in advance based on the user's needs, and may not conflict with other command settings.
In step S120, in response to the zoom instruction, a distance between a multi-shot camera module 10 and a subject is acquired, the multi-shot camera module 10 including the first image pickup unit 11.
In an example of the present application, a process of acquiring a distance between the multi-camera module 10 and a subject in response to the zoom instruction includes: firstly, a first image of the object is obtained through the first image pick-up unit 11, and a second image of the object is obtained through the second image pick-up unit 12; then, a first distance between the multi-shot camera module 10 and the object is obtained based at least in part on the first image, the second image, and the relative positional relationship between the first camera unit 11 and the second camera unit 12, wherein the first distance is the distance between the multi-shot camera module 10 and the object.
It is worth mentioning that when the distance measurement is performed by the first image capturing unit 11 and the second image capturing unit 12 according to the principle of binocular distance measurement, in order to capture a better first image to improve the distance measurement accuracy, at least a part of the lenses of the at least one lens group 112 of the first image capturing unit 11 may be moved by the driving assembly 113 in advance to perform optical zooming before the binocular distance measurement is performed.
That is, in the embodiment of the present application, before the first image of the subject is obtained by the first image capturing unit 11, the method further includes: the driving assembly 113 of the first camera unit 11 is pre-driven to drive at least a part of lenses in at least one lens group 112 of the first camera unit 11 to perform optical zooming.
It should be understood that, just as the first camera unit 11 has performed the pre-zooming in step S120, in step S130, the driving assembly 113 can reduce the moving distance required for zooming, so as to improve the zooming efficiency and the shooting experience.
In another example of the present application, the process of acquiring the distance between the multi-camera module 10 and the subject in response to the zoom instruction further includes: when the first distance is larger than a preset threshold value, starting a third camera unit 13 of the multi-camera module 10 to obtain a third image of the object to be photographed through the third camera unit 13, wherein a third equivalent focal length of the third camera unit 13 is larger than a second equivalent focal length of the second camera unit 12; and obtaining a second distance between the multi-camera module 10 and the object based at least in part on the first image, the third image and the relative position relationship between the first camera unit 11 and the third camera unit 13, wherein the second distance is the distance between the multi-camera module 10 and the object.
In step S130, based on the distance, an adjustment instruction is generated, where the adjustment instruction is used to drive the driving assembly 113 of the first image capturing unit 11 to drive at least a part of lenses in at least one lens group 112 of the first image capturing unit 11 to perform optical zooming.
Specifically, in the embodiment of the present application, the adjustment instruction is used to drive the first driving element 117 of the driving assembly 113 to drive at least a portion of the lenses in the first lens group 114 of the at least one lens group 112 for optical zooming; moreover, the adjustment instruction is further used for driving the second driving element 118 of the driving assembly 113 to drive the second lens group 115 of the at least one lens group 112 for optical focusing.
That is, in the embodiment of the present application, after the optical zoom is performed by the first driving element 117, the optical focus is performed by the second driving element 118 to achieve compensation, so as to improve the imaging quality of the first image capturing unit 11 after the zoom.
In step S140, the first image of the subject captured by the first imaging unit 11 after the optical zoom is performed and the images of the subject captured by the other imaging units of the multi-camera module 10 are fused to obtain a fused image.
In an example of the present application, fusing a first image of the subject captured by the first imaging unit 11 after performing optical zooming and images of the subject captured by other imaging units of the multi-camera module 10 to obtain a fused image includes: the first image of the subject captured by the first imaging unit 11 after the optical zoom is performed and the second image of the subject captured by the second imaging unit 12 are fused to obtain a fused image.
In another example of the present application, fusing a first image of the subject captured by the first imaging unit 11 after performing optical zooming and images of the subject captured by other imaging units of the multi-camera module 10 to obtain a fused image includes: the first image of the subject captured by the first imaging unit 11 after the optical zoom is performed and the third image of the subject captured by the third imaging unit 13 are fused to obtain a fused image.
In summary, the auto-focus imaging method according to the embodiment of the present application is clarified, which is implemented based on the structural configuration of the multi-camera module 10 to improve the shooting experience of the photographer.
In particular, the automatic zoom imaging method is applicable to image photographing as well as video photographing. When taking an image, the multi-camera module 10 (or the electronic device) is normally kept in a disabled state, and at this time, the photographer issues a zoom command to complete the image taking after completing the auto zoom.
When the autofocus imaging method is applied to video shooting, a subject may move during shooting, and the movement may be irregular, especially, movement along the shooting direction (i.e., distance variation), and it is difficult to achieve matching by a mobile device, so that the shape and size of a shot object in a video are not changed, or imaging quality is guaranteed. That is, the object to be shot moves irregularly, and moves left and right or up and down relative to the photographer, and the photographer can move the device in the same direction, and the object to be shot is kept at the center of the picture, the invention further meets the requirement of video shooting better, in practical application, the photographer can shoot by the following method:
1. the photographer does not move the electronic device, and the whole multi-camera module 10 is driven by the driver to realize tracking shooting, as shown in fig. 7;
2. the photographer does not move the electronic device, the multi-camera module 10 is also kept still relative to the electronic device, and the reflecting unit of the first camera unit 11 is moved to realize tracking shooting, as shown in fig. 8;
3. the photographer does not move the electronic device, the multi-camera module 10 is also kept stationary with respect to the electronic device, and the reflecting unit of the first camera unit 11 is turned to realize tracking shooting, as shown in fig. 9.
A further concern is that the distance between the object to be shot and the photographer often changes during video shooting, and at this time, if the zoom magnification is not adjusted in time, imaging blur or the size of the object to be shot changes, so the automatic zoom can adjust the zoom magnification all the time, so that the object to be shot can keep clear imaging or the size of the object to be shot in the video when the video is shot is unchanged. That is, the present invention is applied to capturing a video, and can ensure that the object is always positioned at the center of the screen of the video (or at a position desired by the photographer), and that the sharpness and the size of the object do not change.
Accordingly, in an embodiment of the present application, the auto zoom imaging method may further include: based on the motion trail of the object, the multi-shooting camera module 10 is moved so that the object is always positioned in the shooting window of the multi-shooting camera module 10.
Accordingly, in an embodiment of the present application, the auto zoom imaging method may further include: the reflective element 119 of the first imaging unit 11 is moved based on the motion trajectory of the object to be photographed.
Accordingly, in the embodiment of the present application, the auto zoom imaging method may further include: the reflective element 119 of the first imaging unit 11 is rotated based on the movement locus of the object.
In the process of video shooting based on the method, the required zoom multiple can be adjusted along with the forward and backward movement of the object, so that the size or the position of the shot object displayed in the image is unchanged, and the shooting experience is improved.
It will be appreciated by persons skilled in the art that the embodiments of the invention described above and shown in the drawings are given by way of example only and are not limiting of the invention. The objects of the invention have been fully and effectively accomplished. The functional and structural principles of the present invention have been shown and described in the examples, and any variations or modifications of the embodiments of the present invention may be made without departing from the principles.

Claims (20)

1. The utility model provides a module of making a video recording more which characterized in that includes:
the first camera shooting unit comprises a photosensitive chip, at least one lens group positioned on a photosensitive path of the photosensitive chip, and a driving component for driving at least part of lenses in the at least one lens group to perform optical zooming; and
the second camera shooting unit and the first camera shooting unit have a preset relative position relation;
wherein the driving component is configured to drive at least part of the lenses in the at least one lens group to perform optical zooming based on an adjustment instruction, the adjustment instruction is generated based on a distance of the multi-camera module relative to a subject, the distance of the multi-camera module relative to the subject is calculated based at least in part on a first image of the subject acquired by the first camera unit, a second image of the subject acquired by the second camera unit, and a relative positional relationship between the first camera unit and the second camera unit.
2. The multi-camera module of claim 1, wherein the at least one lens group comprises a first lens group and a second lens group, and the drive assembly comprises a first drive element configured to drive at least some of the lenses of the first lens group for optical zooming based on the adjustment instruction.
3. The multi-camera module of claim 2, wherein the drive assembly further comprises a second drive element configured to drive the second lens group based on the adjustment instruction.
4. The multi-camera module of claim 1, wherein the first camera unit further comprises a reflective element disposed on a photosensitive path of the photosensitive chip for diverting imaging light.
5. The multi-camera module of claim 4, wherein the drive assembly further comprises an anti-shake mechanism for driving the reflective element for optical anti-shake.
6. The multi-camera module of claim 2, wherein the drive assembly further comprises an anti-shake mechanism for driving the first lens group and/or the second lens group for optical anti-shake.
7. The multi-shot camera module of claim 1, further comprising a third camera element having a predetermined positional relationship with the first camera element, the third equivalent focal length of the third camera element being greater than the second equivalent focal length of the second camera element, wherein the adjustment instruction is generated based on a second distance of the multi-shot camera module with respect to the object, the second distance being based at least in part on the first image of the object captured by the first camera element, the second image of the object captured by the second camera element, and the relative positional relationship between the first camera element and the second camera element, when the distance of the multi-shot camera module with respect to the object, obtained based at least in part on the first image of the object captured by the first camera element, exceeds a predetermined threshold, wherein the second distance is based at least in part on the first image of the object captured by the first camera element, And the third image of the shot target acquired by the third camera shooting unit and the relative position relationship between the first camera shooting unit and the third camera shooting unit are obtained by calculation.
8. An image pickup system, comprising:
a multi-camera module as claimed in any one of claims 1 to 7; and
a processor communicably connected to the multi-shot camera module, wherein the processor is configured to generate adjustment instructions based on a distance of the multi-shot camera module relative to a subject.
9. The camera system of claim 8, wherein the processor is further configured to fuse a first image of the subject captured by the first camera module and a second image of the subject captured by the second camera module after the optical zoom to obtain a fused image of the subject; or, the first image of the object collected by the first camera module after the optical zooming is performed and the third image of the object collected by the third camera module are fused to obtain a fused image of the object.
10. An electronic apparatus comprising the multi-camera module according to any one of claims 1 to 7.
11. An auto-zoom imaging method, comprising:
acquiring a zooming instruction;
responding to the zooming instruction, and acquiring the distance between a multi-shooting module and a shot target, wherein the multi-shooting module comprises a first shooting unit;
generating an adjusting instruction based on the distance, wherein the adjusting instruction is used for driving a driving assembly of the first camera shooting unit to drive at least part of lenses in at least one lens group of the first camera shooting unit to perform optical zooming; and
and fusing the first image of the object acquired by the first camera shooting unit after the optical zooming and the images of the object acquired by other camera shooting units of the multi-camera shooting module to obtain a fused image.
12. The automatic zoom imaging method of claim 11, wherein acquiring a distance between a multi-shot camera module and a subject in response to the zoom instruction comprises:
obtaining a first image of the object by the first image pickup unit;
obtaining a second image of the object by the second image pickup unit; and
and obtaining a first distance between the multi-shooting module and the object to be shot based at least in part on the first image, the second image and the relative position relationship between the first shooting unit and the second shooting unit, wherein the first distance is the distance between the multi-shooting module and the object to be shot.
13. The automatic zoom imaging method according to claim 12, further comprising, before obtaining the first image of the subject by the first imaging unit:
the driving assembly of the first camera shooting unit is pre-driven to drive at least part of lenses in at least one lens group of the first camera shooting unit to carry out optical zooming.
14. The automatic zoom imaging method according to claim 12, wherein acquiring a distance between the multi-shot camera module and a subject in response to the zoom instruction, further comprises:
when the first distance is larger than a preset threshold value, starting a third camera shooting unit of the multi-camera shooting module to obtain a third image of the shot target through the third camera shooting unit, wherein a third equivalent focal length of the third camera shooting unit is larger than a second equivalent focal length of the second camera shooting unit; and
and obtaining a second distance between the multi-shooting module and the object to be shot based at least in part on the first image, the third image and the relative position relationship between the first shooting unit and the third shooting unit, wherein the second distance is the distance between the multi-shooting module and the object to be shot.
15. The auto-zoom imaging method according to any one of claims 12 to 14, wherein the adjustment command is further configured to drive a first driving element of the driving assembly to drive at least a portion of the lenses of the first lens group of the at least one lens group for optical zooming.
16. The auto-zoom imaging method according to claim 15, wherein the adjustment command is further used to drive a second driving element of the driving assembly to bring a second lens group of the at least one lens group for optical focusing and/or compensation.
17. The automatic zoom imaging method according to claim 12, wherein fusing the first image of the subject captured by the first imaging unit after the optical zoom and the images of the subject captured by the other imaging units of the multi-camera module to obtain a fused image, comprises:
and fusing the first image of the object acquired by the first image pickup unit and the second image of the object acquired by the second image pickup unit after the optical zooming is performed to obtain a fused image.
18. The automatic zoom imaging method according to claim 14, wherein fusing the first image of the subject captured by the first imaging unit after performing the optical zoom and the images of the subject captured by the other imaging units of the multi-camera module to obtain a fused image, comprises:
and fusing the first image of the object acquired by the first image pickup unit and the third image of the object acquired by the third image pickup unit after the optical zooming is performed to obtain a fused image.
19. The auto-zoom imaging method of claim 11, further comprising:
and moving the multi-shooting camera module based on the motion trail of the shot target so that the shot target is always positioned in a shooting window of the multi-shooting camera module.
20. The auto-zoom imaging method of claim 11, further comprising:
and moving and/or rotating the reflecting element of the first image pickup unit based on the motion track of the object to be photographed.
CN202010753090.7A 2020-07-30 2020-07-30 Multi-camera module, camera system, electronic equipment and automatic zooming imaging method Pending CN114070997A (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
CN202010753090.7A CN114070997A (en) 2020-07-30 2020-07-30 Multi-camera module, camera system, electronic equipment and automatic zooming imaging method
CN202180060940.8A CN116250246A (en) 2020-07-30 2021-07-30 Image pickup module device, multi-image pickup module, image pickup system, electronic apparatus, and auto-zoom imaging method
PCT/CN2021/109581 WO2022022682A1 (en) 2020-07-30 2021-07-30 Photographing module apparatus, multi-camera photographing module, photographing system, electronic device, and auto-zoom imaging method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010753090.7A CN114070997A (en) 2020-07-30 2020-07-30 Multi-camera module, camera system, electronic equipment and automatic zooming imaging method

Publications (1)

Publication Number Publication Date
CN114070997A true CN114070997A (en) 2022-02-18

Family

ID=80226646

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010753090.7A Pending CN114070997A (en) 2020-07-30 2020-07-30 Multi-camera module, camera system, electronic equipment and automatic zooming imaging method

Country Status (1)

Country Link
CN (1) CN114070997A (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104144295A (en) * 2014-08-12 2014-11-12 北京智谷睿拓技术服务有限公司 Imaging control method and device and imaging equipment
CN105578024A (en) * 2015-05-27 2016-05-11 宇龙计算机通信科技(深圳)有限公司 Camera focusing method, focusing device and mobile terminal
CN106896343A (en) * 2017-03-31 2017-06-27 中冶赛迪工程技术股份有限公司 A kind of servo-actuated machine vision device of servo and dynamic tracking distance-finding method
CN107343174A (en) * 2017-07-26 2017-11-10 浙江树人学院 The false proof face iris grasp shoot device of mobile target and method at a distance
CN107515459A (en) * 2016-06-17 2017-12-26 宁波舜宇光电信息有限公司 Periscopic camera module and its imaging method

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104144295A (en) * 2014-08-12 2014-11-12 北京智谷睿拓技术服务有限公司 Imaging control method and device and imaging equipment
CN105578024A (en) * 2015-05-27 2016-05-11 宇龙计算机通信科技(深圳)有限公司 Camera focusing method, focusing device and mobile terminal
CN107515459A (en) * 2016-06-17 2017-12-26 宁波舜宇光电信息有限公司 Periscopic camera module and its imaging method
CN106896343A (en) * 2017-03-31 2017-06-27 中冶赛迪工程技术股份有限公司 A kind of servo-actuated machine vision device of servo and dynamic tracking distance-finding method
CN107343174A (en) * 2017-07-26 2017-11-10 浙江树人学院 The false proof face iris grasp shoot device of mobile target and method at a distance

Similar Documents

Publication Publication Date Title
CN105007420B (en) A kind of focusing method and mobile terminal
CN111479065B (en) Camera field angle synchronization method and device and image shooting method and device
JP4731705B2 (en) Imaging apparatus, camera, photographing lens, focus adjustment method, and storage medium
CN111580237A (en) Electronic device and control method thereof
CN110022433B (en) Image pickup apparatus, lens apparatus, and control method thereof
TW201312249A (en) Image processing system and automatic focusing method
CN1450398A (en) Image pick up apparatus and camera system thereof
JP2008054206A (en) Ghost detection device and its related technology
CN101251706A (en) Optical die set, camera and mobile terminal equipment
CN103475805A (en) Active range focusing system and active range focusing method
WO2021134179A1 (en) Focusing method and apparatus, photographing device, movable platform and storage medium
CN112911109B (en) Electronic device and shooting method
CN103852954A (en) Method for achieving phase focusing
US8379135B2 (en) Zoom lens and imaging apparatus including focus cam for converting rotation amounts into focus lens group movement
CN107147848B (en) Automatic focusing method and real-time video acquisition system adopting same
JP2001141982A (en) Automatic focusing device for electronic camera
JP2003241074A (en) Automatic focusing device and camera system
WO2022017069A1 (en) Multi-shot image capture module, image capture system, electronic device, and imaging method
US20070058962A1 (en) Lens apparatus
WO2022022682A1 (en) Photographing module apparatus, multi-camera photographing module, photographing system, electronic device, and auto-zoom imaging method
JP3551932B2 (en) Distance measuring device and imaging device using the same
JPH05211625A (en) Image pickup device
CN114070997A (en) Multi-camera module, camera system, electronic equipment and automatic zooming imaging method
JP2016142924A (en) Imaging apparatus, method of controlling the same, program, and storage medium
JP2015184614A (en) Automatic focus adjustment device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20220218

RJ01 Rejection of invention patent application after publication