WO2022022682A1 - 摄像模组装置、多摄摄像模组、摄像系统、电子设备和自动变焦成像方法 - Google Patents

摄像模组装置、多摄摄像模组、摄像系统、电子设备和自动变焦成像方法 Download PDF

Info

Publication number
WO2022022682A1
WO2022022682A1 PCT/CN2021/109581 CN2021109581W WO2022022682A1 WO 2022022682 A1 WO2022022682 A1 WO 2022022682A1 CN 2021109581 W CN2021109581 W CN 2021109581W WO 2022022682 A1 WO2022022682 A1 WO 2022022682A1
Authority
WO
WIPO (PCT)
Prior art keywords
camera
camera module
image
camera unit
lens group
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2021/109581
Other languages
English (en)
French (fr)
Inventor
戎琦
袁栋立
王启
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Ningbo Sunny Opotech Co Ltd
Original Assignee
Ningbo Sunny Opotech Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from CN202010751498.0A external-priority patent/CN114070994B/zh
Priority claimed from CN202010753090.7A external-priority patent/CN114070997A/zh
Application filed by Ningbo Sunny Opotech Co Ltd filed Critical Ningbo Sunny Opotech Co Ltd
Priority to CN202180060940.8A priority Critical patent/CN116250246B/zh
Publication of WO2022022682A1 publication Critical patent/WO2022022682A1/zh
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/68—Control of cameras or camera modules for stable pick-up of the scene, e.g. compensating for camera body vibrations
    • H04N23/682—Vibration or motion blur correction
    • H04N23/685—Vibration or motion blur correction performed by mechanical compensation
    • H04N23/687—Vibration or motion blur correction performed by mechanical compensation by shifting the lens or sensor position
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules

Definitions

  • the present application relates to the field of camera modules, and in particular, to a camera module device, a multi-camera camera module, a camera system, electronic equipment, and an automatic zoom imaging method.
  • the user holds the mobile electronic device with one hand and slides the other hand on the screen, which reduces the stability of the user holding the electronic device, resulting in blurred images or videos.
  • An advantage of the present application is to provide a multi-camera camera module, a camera system, an electronic device and an automatic zoom imaging method, wherein the multi-camera camera module has a structural configuration such that the multi-camera camera module can be based on its The distance between the subjects is automatically optically zoomed to provide a better shooting experience.
  • Another advantage of the present application is to provide a multi-camera camera module, a camera system, an electronic device and an automatic zoom imaging method, wherein the multi-camera camera module performs ranging based on its own configured camera unit, which is an automatic optical Zooming provides required distance information, that is, the multi-camera camera module according to the embodiment of the present application expands the function of the camera unit configured by itself to realize the automatic zooming function. That is, the multi-camera camera module according to the embodiment of the present application realizes the automatic optical zoom function without additionally configuring a ranging module.
  • a multi-camera camera module which includes:
  • a first camera unit comprising a photosensitive chip, at least one lens group located on a photosensitive path of the photosensitive chip, and a driving component for driving at least part of the lenses in the at least one lens group to perform optical zooming;
  • the second camera unit has a preset relative positional relationship with the first camera unit
  • the driving component is configured to drive at least part of the lenses in the at least one lens group to perform optical zooming based on an adjustment instruction
  • the adjustment instruction is generated based on the distance of the multi-camera camera group relative to the photographed target, so
  • the distance of the multi-camera camera module relative to the photographed target is at least partially based on the first image of the photographed target collected by the first camera unit and the second image of the photographed target collected by the second camera unit , and the relative positional relationship between the first camera unit and the second camera unit is obtained by calculation.
  • the at least one lens group includes a first lens group and a second lens group
  • the driving assembly includes a first driving element
  • the first driving element is configured based on the The adjustment instruction drives at least part of the lenses in the first lens group to perform optical zooming.
  • the driving assembly further includes a second driving element configured to drive the second lens group to perform optical focusing based on the adjustment instruction.
  • the first camera unit further includes a reflective element disposed on the photosensitive path of the photosensitive chip for deflecting imaging light.
  • the driving assembly further includes an anti-shake mechanism for driving the reflective element to perform optical anti-shake.
  • the driving assembly further includes an anti-shake mechanism for driving the first lens group and/or the second lens group to perform optical anti-shake.
  • the multi-camera camera module further includes a third camera unit having a preset positional relationship with the first camera unit, and a third camera unit of the third camera unit has a preset positional relationship with the first camera unit.
  • the equivalent focal length is greater than the second equivalent focal length of the second camera unit, wherein when based at least in part on the first image of the subject captured by the first camera unit, the The second image of the subject, and the distance of the multi-camera module relative to the subject obtained from the relative positional relationship between the first camera unit and the second camera unit exceeds a preset distance
  • the adjustment instruction is generated based on a second distance of the multi-camera camera module relative to the photographed target, wherein the second distance is at least partially based on the photographed target collected by the first camera unit.
  • the first image, the third image of the photographed object collected by the third camera unit, and the relative positional relationship between the first camera unit and the third camera unit are calculated and obtained.
  • a camera system comprising:
  • the multi-camera camera module as described above;
  • a processor connected to the multi-camera camera module is communicatively connected, wherein the processor is configured to generate an adjustment instruction based on the distance of the multi-camera camera module relative to the photographed target.
  • the processor is further configured to fuse the first image of the subject captured by the first camera module and the image captured by the second camera module after performing optical zooming.
  • the second image of the subject is obtained to obtain a fused image of the subject; or, the first image of the subject collected by the first camera module and the third image captured by the first camera module after performing optical zooming are fused
  • the third image of the photographed target collected by the module is used to obtain a fusion image of the photographed target.
  • an automatic zoom imaging method which includes:
  • an adjustment instruction is generated, and the adjustment instruction is used to drive the driving component of the first camera unit to drive at least part of the lenses in at least one lens group of the first camera unit to perform optical zooming;
  • the first image of the photographed target collected by the first camera unit and the images of the photographed target collected by other camera units of the multi-camera camera module are fused to obtain a fusion image.
  • acquiring the distance between the multi-camera camera module and the photographed target includes:
  • the multi-camera module and the subject based at least in part on the first image, the second image, and the relative positional relationship between the first camera unit and the second camera unit
  • the method before obtaining the first image of the photographed object through the first camera unit, the method further includes: pre-driving a driving component of the first camera unit to drive the first camera At least some of the lenses in at least one lens group of the camera unit are used for optical zooming.
  • the third camera unit of the multi-camera camera module is activated to obtain a third image of the subject through the third camera unit, and the third camera unit of the third camera unit.
  • the three equivalent focal lengths are greater than the second equivalent focal length of the second camera unit;
  • the multi-camera module and the subject based at least in part on the first image, the third image, and the relative positional relationship between the first camera unit and the third camera unit.
  • the adjustment instruction is further used to drive the first drive element of the drive assembly to drive at least part of the lenses in the first lens group of the at least one lens group to perform optical zooming .
  • the adjustment instruction is further used to drive the second driving element of the driving assembly to drive the second lens group of the at least one lens group to perform optical focusing.
  • the first image of the subject captured by the first camera unit and the subject captured by other camera units of the multi-camera module are fused after performing optical zooming.
  • obtaining the image of the target to obtain a fusion image comprising: fusing a first image of the target captured by the first camera unit and a second image of the target captured by the second camera unit after performing optical zooming, to obtain a fused image.
  • the first image of the subject captured by the first camera unit and the subject captured by other camera units of the multi-camera module are fused after performing optical zooming.
  • obtaining the image of the target to obtain a fusion image including: fusing the first image of the target captured by the first camera unit and the third image of the target captured by the third camera unit after performing optical zooming, to obtain a fused image.
  • the automatic zoom imaging method further includes: moving the multi-camera camera module based on the motion trajectory of the photographed target, so that the photographed target is always located in the multi-camera camera in the shooting window of the module.
  • the automatic zoom imaging method further comprises: moving the reflective element of the first camera unit based on the movement trajectory of the photographed object.
  • the automatic zoom imaging method further includes: based on the movement trajectory of the photographed object, rotating the reflective element of the first camera unit.
  • a camera module device which includes:
  • a camera unit comprising a photosensitive chip, at least one lens group located on a photosensitive path of the photosensitive chip, and a driving component for driving at least part of the lenses in the at least one lens group to perform optical zooming;
  • the driving component is configured to drive at least part of the lenses in the at least one lens group to perform optical zooming based on an adjustment instruction, the adjustment instruction is generated based on the distance of the camera module device relative to the object to be photographed, the The distance of the camera module device relative to the photographed target is measured by the ranging unit.
  • the at least one lens group includes a first lens group and a second lens group
  • the driving assembly includes a first driving element
  • the first driving element is configured based on the The adjustment instruction drives at least part of the lenses in the first lens group to perform optical zooming.
  • the driving assembly further includes a second driving element configured to drive the second lens group to perform optical focusing based on the adjustment instruction.
  • the camera unit further includes a reflective element disposed on the light-sensing path of the light-sensing chip for deflecting imaging light.
  • the driving assembly further includes an anti-shake mechanism for driving the reflective element to perform optical anti-shake.
  • the driving component further includes an anti-shake mechanism for driving the first lens group and/or the second lens group to perform optical anti-shake.
  • the ranging unit includes a projector and a receiver
  • the projector is configured to project a detection signal with a specific wavelength to a subject
  • the receiver is configured to receive The detection signal reflected from the photographed target determines the distance between the ranging module and the photographed target based on the time-of-flight law.
  • the detection signals include ultrasonic detection signals, millimeter wave detection signals, and laser pulse detection signals.
  • the ranging unit is implemented as a TOF camera unit, so as to collect the distance between the camera module device and the photographed target through the TOF camera unit.
  • a camera system comprising:
  • a processor connected to the camera module device is communicatively connected, wherein the processor is configured to generate an adjustment instruction based on the distance of the camera module device relative to the photographed target.
  • an automatic zoom imaging method which includes:
  • an adjustment instruction is generated, and the adjustment instruction is used to drive the driving component of the camera unit to drive at least some lenses in at least one lens group of the camera unit to perform optical zooming;
  • the zoom imaging method in response to the zoom instruction, obtaining the distance between the camera module device and the photographed target through the ranging module, including:
  • the adjustment instruction is further used to drive the first drive element of the drive assembly to drive at least part of the lenses in the first lens group of the at least one lens group to perform optical zooming .
  • the adjustment instruction is further used to drive the second driving element of the driving assembly to drive the second lens group of the at least one lens group to perform optical focusing.
  • the auto-focus imaging method further comprises: moving the camera module device based on the motion trajectory of the photographed target, so that the photographed target is always located in the camera module device in the shooting window.
  • the auto-focus imaging method further includes: moving the reflective element of the imaging unit based on the motion trajectory of the photographed target.
  • the automatic zoom imaging method further includes: based on the movement trajectory of the photographed object, rotating the reflective element of the camera unit
  • FIG. 1 illustrates a schematic diagram of a multi-camera camera module according to an embodiment of the present application.
  • FIG. 2 illustrates a schematic diagram of a binocular distance principle according to an embodiment of the present application.
  • FIG. 3 illustrates a schematic diagram of another multi-camera camera module according to an embodiment of the present application.
  • FIG. 4 illustrates a schematic diagram of a camera system according to an embodiment of the present application.
  • FIG. 5 illustrates a schematic perspective view of an electronic device according to an embodiment of the present application.
  • FIG. 6 illustrates a flowchart of an automatic zoom imaging method according to an embodiment of the present application.
  • FIG. 7 illustrates a first schematic diagram of tracking a photographed target in an automatic zoom imaging method according to an embodiment of the present application.
  • FIG. 8 illustrates a second schematic diagram of tracking a photographed target in an automatic zoom imaging method according to an embodiment of the present application.
  • FIG. 9 illustrates a third schematic diagram of tracking a photographed target in an automatic zoom imaging method according to an embodiment of the present application.
  • FIG. 10 illustrates a schematic diagram of a camera module device according to an embodiment of the present application.
  • FIG. 11 illustrates a schematic diagram of ranging of a ranging unit according to an embodiment of the present application.
  • FIG. 12 illustrates a schematic diagram of the ranging unit implemented as a TOF camera unit according to an embodiment of the present application.
  • FIG. 13 illustrates a schematic diagram of a partition of a projection area of a projection element of the TOF camera unit according to an embodiment of the present application.
  • FIG. 14 illustrates another schematic diagram in which the ranging unit according to an embodiment of the present application is implemented as a TOF camera unit.
  • FIG. 15 illustrates a flowchart of an automatic zoom imaging method according to an embodiment of the present application.
  • FIG. 16 illustrates a schematic diagram of a camera system according to an embodiment of the present application.
  • FIG. 17 illustrates a schematic perspective view of an electronic device according to an embodiment of the present application.
  • FIG. 18 illustrates a first schematic diagram of tracking a photographed target in an automatic zoom imaging method according to an embodiment of the present application.
  • FIG. 19 illustrates a second schematic diagram of tracking a photographed target in an automatic zoom imaging method according to an embodiment of the present application.
  • FIG. 20 illustrates a third schematic diagram of tracking a photographed target in an automatic zoom imaging method according to an embodiment of the present application.
  • a multi-camera camera module according to an embodiment of the present application is illustrated, wherein the structure and configuration of the multi-camera camera module enables the multi-camera camera module to Automatic optical zoom from distance to provide a better shooting experience.
  • the multi-camera camera module 710 includes a first camera unit 711 with an optical zoom function, and a camera unit 711 having a preset relative positional relationship with the first camera unit 711 The second camera unit 712 .
  • the first camera unit 711 includes a photosensitive chip 7111, at least one lens group 7112 located on the photosensitive path set by the photosensitive chip 7111, and is used to drive at least part of the at least one lens group 7112 Lens to drive assembly 7113 for optical zooming.
  • the first camera unit 711 and the second camera unit 712 can capture the image of the object to be photographed.
  • the applications of the first camera unit 711 and the second camera unit 712 of the multi-camera camera module 710 are further expanded.
  • the first camera unit 711 and the second camera unit 712 measure the distance information between the multi-camera module 710 and the subject based on the binocular ranging principle, that is, at least partially based on the The first image of the subject captured by the first camera unit 711, the second image of the subject captured by the second camera unit 712, and the first camera unit 711 and the second camera
  • the relative positional relationship between the units 712 is calculated to obtain the distance between the multi-camera module 710 and the photographed target.
  • the driving component 7113 of the first camera unit 711 is configured to drive at least some of the lenses in the at least one lens group 7112 to perform optical zooming based on the adjustment instruction generated from the distance information. In this way,
  • the structure and configuration of the multi-camera camera module 710 realizes the function of automatic optical zooming.
  • FIG. 2 illustrates a schematic diagram of the principle of binocular ranging according to an embodiment of the present application.
  • P is a certain point on the object to be photographed
  • OR and OT are the optical centers of the first camera unit 711 and the second camera unit 712 respectively
  • point P is on the first camera unit 711 and the imaging points formed on the photosensitive chip 7111 of the second camera unit 712 are P and P' respectively
  • f is the effective focal length of the second camera unit 712
  • B is the first camera unit 711 and the The center distance of the second camera unit 712
  • Z is the depth information (ie, distance information) that needs to be calculated, and if the distance from the image point P to the point P' is X, then:
  • the focal length and the camera center distance B can be obtained by calibration. Therefore, only the value of X R -X (ie, parallax d) can be obtained to obtain the depth information Z, that is, the distance.
  • the first camera unit 711 and the second camera unit 712 have radial distortion due to the characteristics of their optical lenses.
  • the degree of distortion can be determined by three parameters K71, K72 and K73 ; and, due to errors in assembly and other aspects, the photosensitive chip 7111 is not completely parallel to the optical lens, therefore, the imaging of the first camera unit 711 and the second camera unit 712 also has tangential distortion, and accordingly, the distortion
  • the degree can be determined by two parameters P71 and P72.
  • the internal parameters of the single camera unit including but not limited to the focal length f, the imaging origin Cx, Cy, and the above five distortion parameters
  • external parameters the world coordinates of the calibration object
  • the binocular camera The calibration of the module (that is, the combination of the camera unit composed of the first camera unit 711 and the second camera unit 712 ) not only needs to obtain the internal parameters of each camera unit, but also needs to measure the first camera unit through calibration.
  • the relative position between a camera unit 711 and the second camera unit 712 ie, the rotation matrix R and translation vector t of the second camera unit 712 relative to the first camera unit 711 ).
  • the images captured by the first camera unit 711 and the second camera unit 712 can be corrected based on the calibrated internal reference and the binocular relative positional relationship, respectively, so as to eliminate distortion and perform line alignment. , for binocular ranging.
  • calibration can be performed at some specific points, for example, selecting Points in the depth of field area (ie, the viewing window area) of the first camera unit 711 and the second camera unit 712 are calibrated.
  • the farthest depth of field point and the nearest depth of field point select the farthest depth of field point and the nearest depth of field point, then divide the line between the nearest depth of field point X71 and the farthest depth of field point X72 into N equal parts, and then divide the farthest depth of field point, the nearest depth of field point and the Each aliquot point is calibrated, and then the acquired parameters are programmed, thereby improving the efficiency of ranging and reducing the workload required for calibration.
  • the second camera unit 712 may be configured as a main camera unit for capturing the first image of the subject, which preferably has a relatively large field of view, for example, The field of view of the second camera unit 712 is greater than 760°; and the first camera unit 711 is configured as a sub-camera unit for adjusting its focal length based on the distance between the multi-camera module and the subject. And collect the first image of the subject.
  • the multi-camera camera module 710 can fuse the first image and the second image to generate a fused image with higher imaging quality.
  • At least one lens group 7112 of the first camera unit 711 includes a first lens group 7114 and a second lens group 7115
  • the driving component 7113 includes a first lens group 7114 and a second lens group 7115
  • a driving element 7117, the first driving element 7117 is configured to drive at least some of the lenses in the first lens group 7114 to perform optical zooming based on the adjustment instruction. That is, in the embodiment of the present application, the first driving element 7117 is a zoom driver, which is used to drive at least some of the lenses in the first lens group 7114 to move to perform optical zooming.
  • the driving component 7113 of the first camera unit 711 further includes a second driving element 7118, and the second driving element 7118 is configured to drive the The second lens group 7115 is used for optical focusing. That is, in the embodiment of the present application, the first imaging unit 711 further has a focusing function, and the second driving element 7118 is a focusing driver. It should be understood that, after the optical zoom is performed by the first driving element 7117, the second driver can drive the second lens group 7115 to move so as not only to achieve optical focusing, but also to compensate for the resulting optical zoom. to improve imaging quality.
  • the first driving element 7117 and the second driving element 7118 respectively drive the first lens group 7114 and the second lens group 7115 to achieve optical zooming together, and ensure that the TTL (Total Track length) remains unchanged so that the optical After zooming, it still has high imaging quality; that is, the first driving element 7117 drives the first lens group 7114 to achieve zooming, and the second driving element 7118 drives the second lens group 7115 to achieve compensation and/or focusing, thereby Get high-quality images.
  • the first driving element 7117 and the second driving element 7118 may be implemented as the same driver (ie, the zoom driver and the focus driver are implemented as the same driver), or , the first driving element 7117 and the second driving element 7118 have an integrated structure, which is not limited by this application.
  • the first lens group 7114 and the second lens group 7115 are fixed to a connecting shaft at the same time, so that the first lens group 7114 and the second lens group 7115 will not be generated during the movement.
  • the connecting axis can be a guide rail (both the first lens group 7114 and the second lens group 7115 are assembled on the same guide rail), or a hole axis structure (the first lens group 7114 and the second lens group 7115 use a shaft connected and move along the axis).
  • the at least one lens group 7122 may further include a larger number of lens groups, for example, further include a third lens group 7126, and the position of the third lens group 7126 is fixed as a fixed position
  • the lens group in this regard, is not limited by this application.
  • the first camera unit 711 may be implemented as a periscope camera unit.
  • the first camera unit 711 further includes The reflective element 7119 on the photosensitive path of the chip 7111 is used to deflect the imaging light.
  • the first camera unit 711 is further configured with an optical anti-shake function.
  • the first camera unit 711 further includes a reflective element 7119 disposed on the photosensitive path of the photosensitive chip 7111 for deflecting imaging light; or, the driving component 7113 further includes a An anti-shake mechanism for driving the first lens group 7114 and/or the second lens group 7115 to perform optical anti-shake, so as to compensate for the error caused by the photographer's hand shaking.
  • a third camera unit 713 with a longer shooting range may be further configured on the basis of the structure of the multi-camera camera module 710 previously described, that is, the The third equivalent focal length of the third camera unit 713 is greater than the second equivalent focal length of the second camera unit 712 .
  • the third camera unit 713 and the first unit obtain the distance between the multi-camera module 710 and the photographed target through the binocular ranging principle, that is, based at least in part on the The first image of the subject captured by a camera unit 711 , the third image of the subject captured by the third camera unit 713 , and the first camera unit 711 and the third camera unit 713 The relative positional relationship between them is calculated.
  • the multi-camera camera module 710 when the distance between the multi-camera camera module 710 and the subject is greater than a preset threshold, the first camera unit 711 and the third camera unit 713 are used. When the distance between the multi-camera module 710 and the target is lower than a preset threshold, the first camera unit 711 and the second camera unit 712 are used to cooperate way to measure distance. That is, in some examples of the present application, the multi-camera camera module 710 may further include a determination module for determining the shooting distance to determine which two camera units to activate for distance measurement.
  • the multi-camera camera module 710 according to the embodiment of the present application is clarified, and the structure and configuration of the multi-camera camera module 710 enables the multi-camera camera module 710 to perform a Automatic optical zoom for better shooting experience.
  • a camera system is also provided.
  • FIG. 4 illustrates a schematic diagram of the camera system according to an embodiment of the present application.
  • the camera system 730 includes a multi-camera camera module 710 as described above and a processor 720 communicatively connected to the multi-camera camera module 710 , wherein the processor 720 is configured
  • An adjustment instruction is generated based on the distance of the multi-camera camera module 710 relative to the photographed target.
  • the driving component 7113 of the first camera unit 711 drives at least some of the lenses in the at least one lens group 7112 to perform optical zooming. In this way, the camera system 730 Realize the automatic zoom shooting function.
  • the processor 720 is further configured to fuse the first image of the subject captured by the first camera module and the second camera module after performing optical zooming A second image of the photographed object is collected to obtain a fusion image of the photographed object.
  • the processor 720 is further configured to fuse the first image of the subject captured by the first camera module and captured by the third camera module after performing optical zooming The third image of the photographed target is obtained to obtain a fusion image of the photographed target.
  • an electronic device is also provided.
  • FIG. 5 illustrates a schematic perspective view of an electronic device according to an embodiment of the present application.
  • the electronic device 7100 includes an electronic device main body 7101 and the above-mentioned multi-camera camera module 710 assembled in the electronic device main body 7101 .
  • the multi-camera camera module 710 is preferably configured on the back of the electronic device body 7101 to be configured as a rear camera module, of course, it can also be configured as the electronic device body
  • the front of the 7101 is configured as a front camera module.
  • the electronic device main body 7101 includes a screen and an integrated circuit, wherein the screen can be used to display image data collected by the multi-camera module 710 , and the integrated circuit The circuit can be used to process the image data collected by the multi-camera camera module 710 to control the multi-camera camera module 710 to realize the automatic zoom shooting function.
  • an automatic zoom imaging method is also provided.
  • FIG. 6 illustrates a flowchart of an automatic zoom imaging method according to an embodiment of the present application.
  • the automatic zoom imaging method includes the steps of: S7110, acquiring a zoom instruction; S7120, in response to the zoom instruction, acquiring the distance between the multi-camera camera module 710 and the photographed target distance, the multi-camera camera module 710 includes a first camera unit 711; S7130, based on the distance, an adjustment instruction is generated, and the adjustment instruction is used to drive the driving component 7113 of the first camera unit 711 to drive the at least part of the lenses in the at least one lens group 7112 of the first camera unit 711 to perform optical zooming; and, S7140, fuse the first image of the subject captured by the first camera unit 711 after the optical zoom is performed and the The image of the subject captured by other camera units of the multi-camera camera module 710 is used to obtain a fusion image.
  • a zoom instruction is obtained.
  • the zoom instruction includes, but is not limited to, single-clicking on the object displayed on the screen, double-clicking on the object displayed on the screen, stretching the object displayed on the screen with both hands, and the like. It should be understood that the zoom instruction can be set in advance based on the user's needs, and cannot conflict with other instruction settings.
  • step S7120 in response to the zoom instruction, the distance between the multi-camera camera module 710 and the photographed target is obtained, and the multi-camera camera module 710 includes a first camera unit 711.
  • the process of obtaining the distance between the multi-camera camera module 710 and the object to be photographed includes: firstly obtaining the first image of the object to be photographed through the first camera unit 711 . an image and a second image of the subject obtained by the second camera unit 712; then, based at least in part on the first image, the second image, and the relationship between the first camera unit 711 and the object
  • the relative positional relationship between the second camera units 712 is used to obtain the first distance between the multi-camera module 710 and the subject, wherein the first distance is the multi-camera module 710 distance from the subject.
  • the first camera unit 711 and the second camera unit 712 are used for distance measurement through the binocular distance measurement principle, in order to capture a better first image and improve the distance measurement accuracy, you can Before performing binocular ranging, at least some of the lenses in at least one lens group 7112 of the first camera unit 711 are moved in advance by the driving component 7113 to perform optical zooming.
  • the method before obtaining the first image of the photographed object through the first camera unit 711, the method further includes: pre-driving the driving component 7113 of the first camera unit 711 to drive the At least some of the lenses in the at least one lens group 7112 of the first camera unit 711 are used for optical zooming.
  • step S7120 the first camera unit 711 has performed pre-zooming, so in step S7130, the driving component 7113 can reduce the moving distance required for zooming, so as to improve zooming efficiency and improve shooting. experience.
  • the process of acquiring the distance between the multi-camera camera module 710 and the object to be photographed further includes: in response to the first distance being greater than a preset threshold , activate the third camera unit 713 of the multi-camera camera module 710 to obtain a third image of the subject through the third camera unit 713, the third equivalent focal length of the third camera unit 713 is greater than the third camera unit 713
  • the second equivalent focal length of the two camera units 712 and, based at least in part on the first image, the third image, and the relative relationship between the first camera unit 711 and the third camera unit 713
  • the positional relationship is used to obtain the second distance between the multi-camera camera module 710 and the photographed target, wherein the second distance is the distance between the multi-camera camera module 710 and the photographed target.
  • step S7130 an adjustment instruction is generated based on the distance, and the adjustment instruction is used to drive the driving component 7113 of the first camera unit 711 to drive at least part of at least one lens group 7112 of the first camera unit 711 lens for optical zoom.
  • the adjustment instruction is used to drive the first drive element 7117 of the drive assembly 7113 to drive at least some of the lenses in the first lens group 7114 of the at least one lens group 7112 to perform Optical zoom; and, the adjustment instruction is further used to drive the second driving element 7118 of the driving component 7113 to drive the second lens group 7115 of the at least one lens group 7112 to perform optical focusing.
  • the optical focusing is performed by the second driving element 7118 to realize compensation and improve the zooming speed of the first camera unit 711. image quality after that.
  • step S7140 the first image of the subject captured by the first camera unit 711 after the optical zooming is fused with the images of the subject captured by other camera units of the multi-camera module 710 to Obtain fused images.
  • the first image of the subject captured by the first camera unit 711 after optical zooming is merged with the image of the subject captured by other camera units of the multi-camera module 710 .
  • image to obtain a fusion image including: fusing the first image of the subject captured by the first camera unit 711 and the second image of the subject captured by the second camera unit 712 after performing optical zooming, to obtain a fused image.
  • the first image of the subject captured by the first camera unit 711 and the subject captured by other camera units of the multi-camera module 710 are fused after performing optical zooming to obtain a fused image, including: fusing the first image of the subject captured by the first camera unit 711 and the third image of the subject captured by the third camera unit 713 after performing optical zooming , to obtain a fused image.
  • the auto-focus imaging method based on the embodiment of the present application is clarified, and it is implemented based on the structural configuration of the multi-camera camera module 710 to improve the shooting experience of the photographer.
  • the automatic zoom imaging method can be applied to image shooting, and can also be used for video shooting.
  • the multi-camera module 710 (or the electronic device) is usually kept in a disabled state. At this time, the photographer can complete the image by sending a zoom command to bring up the automatic zoom. shoot.
  • the subject may move, and the movement may be irregular, especially along the shooting direction (that is, the distance changes), which is very difficult to achieve. It is difficult to achieve matching through mobile devices, so that the shape and size of the objects captured in the video remain unchanged, or the imaging quality can be guaranteed. That is, the movement of the object to be photographed is irregular. Relative to the photographer, it moves left and right or up and down. The photographer can move the device in the same direction. The object is kept in the center of the screen.
  • the present invention further meets the needs of video shooting. , in practical applications, the photographer can shoot in the following ways:
  • the photographer does not move the electronic device, and the multi-camera module 710 is driven by the driver as a whole to realize tracking shooting, as shown in FIG. 7 ;
  • the multi-camera camera module 710 also remains stationary relative to the electronic device, and the reflection unit of the first camera unit 711 is moved to achieve tracking shooting, as shown in FIG. 8 ;
  • the multi-camera camera module 710 also remains stationary relative to the electronic device, and the reflection unit of the first camera unit 711 is rotated to realize tracking shooting, as shown in FIG. 9 .
  • the present invention automatically The zoom can adjust the zoom ratio at any time, so that when shooting a video, the photographed object can be clearly imaged or its size displayed in the video remains unchanged. That is, when the present invention is applied to shooting a video, the object to be shot can always be located in the center of the video (or the position desired by the photographer), and at the same time, the sharpness and size of the object to be shot can be guaranteed not to change.
  • the automatic zoom imaging method may further include: moving the multi-camera camera module 710 based on the motion trajectory of the photographed target, so that the photographed target is always located in the multi-camera within the shooting window of the camera module 710 .
  • the automatic zoom imaging method may further include: moving the reflective element 7119 of the first camera unit 711 based on the movement trajectory of the photographed object.
  • the automatic zoom imaging method may further include: rotating the reflection element 7119 of the first camera unit 711 based on the movement trajectory of the photographed object.
  • the required zoom factor can be adjusted following the forward and backward movement of the object, so that the size or position of the subject displayed in the image can be achieved, so as to improve the shooting experience .
  • the camera module device As shown in FIG. 10 , the camera module device according to the embodiment of the present application is illustrated, wherein the structural configuration of the camera module device enables the camera module device to automatically Optical zoom for a better shooting experience.
  • the camera module device 810 includes a camera unit 811 with an optical zoom function, and is configured to measure the distance between the camera module device 810 and a photographed target
  • the camera unit 811 includes a photosensitive chip 8111 , at least one lens group 8112 located on the photosensitive path set by the photosensitive chip 8111 , and is used to drive the at least one lens group At least some of the lenses in 8112 are used to drive components 8113 for optical zooming.
  • the distance measuring unit 812 can measure the distance information between the camera module device 810 and the photographed target, so that the driving component 8113 of the camera unit 811 can be It is configured to drive at least part of the lenses in the at least one lens group 8112 to perform optical zooming based on the adjustment instruction generated from the distance information.
  • the structural configuration of the camera module device 810 realizes the function of automatic optical zooming.
  • the camera unit 811 and the ranging unit 812 refer to two structurally integrated components in the camera module device 810, rather than structurally separate parts.
  • the distance measuring unit 812 and the camera unit 811 can be integrally formed by a process such as molding to make the camera module device 810, and the camera module The apparatus 810 as a whole is connected with other peripheral devices, such as an image processor.
  • the distance measuring unit 812 can obtain the distance between the camera module device 810 and the photographed target through the law of flight of time.
  • the ranging unit 812 has implementation means such as ultrasonic wave, millimeter wave radar, and lidar.
  • FIG. 11 illustrates a schematic diagram of ranging of the ranging unit 812 according to an embodiment of the present application.
  • the ranging unit 812 includes a projector 8121 and a receiver 8122, the projector 8121 is configured to project a detection signal with a specific wavelength to a subject, and the receiver 8122 is configured to receive The detection signal reflected from the photographed target determines the distance between the ranging module and the photographed target based on the time-of-flight law.
  • the projector 8121 projects an ultrasonic detection signal to the photographed target.
  • the ultrasonic detection signal propagates in the air and will be reflected back after hitting the photographed target. and received by the receiver 8122.
  • the timer will calculate the time elapsed from the sending of the ultrasonic waves to the receiving of the ultrasonic waves.
  • the projector 8121 projects a millimeter wave detection signal to the subject, wherein the millimeter wave refers to the 830-8300 GHz frequency domain (wavelength is 81-810 mm).
  • the millimeter wave refers to the 830-8300 GHz frequency domain (wavelength is 81-810 mm).
  • electromagnetic waves Since millimeter waves are weakly attenuated in the atmosphere, they can detect and perceive longer distances, of which long-distance radar can achieve perception and detection of more than 8200m.
  • the projector 8121 projects a laser pulse detection signal to the photographed target.
  • the laser pulse detection signal propagates in the air and will be reflected back after hitting the photographed target. and received by the receiver 8122.
  • the timer calculates the time period from when the laser pulse detection signal is sent to when the laser pulse detection signal is received, and then the distance measuring unit 812 and the received signal can be obtained based on the time length and the propagation speed of the laser pulse detection signal. distance between objects.
  • the ranging unit 812 is an integrated component of the camera module device 810 . Therefore, the distance between the ranging unit 812 and the photographed target is the The distance between the camera module device 810 and the photographed object.
  • the ranging unit 812 may be composed of one or more of the above-mentioned types, so as to realize ranging at different distances and improve the accuracy of the overall ranging.
  • the ranging unit 812 is implemented as a TOF camera unit 812A, that is, preferably, the TOF camera unit 812A not only obtains distance information through the law of flight, but also can obtain the measured distance information.
  • Image data of the object ie, obtain the texture information of the object).
  • the TOF camera units 812A can be used to capture 83D images or other applications.
  • the distance information collected by the TOF camera unit 812A is introduced into the application.
  • its main function is to collect the texture information and depth information of the photographed object, so its accuracy must be high enough.
  • the The main function of the TOF camera unit 812A is to provide distance information, therefore, its accuracy requirements can be relatively reduced to reduce costs. It is worth noting that the projected power may be relatively large when ranging, so it is necessary to ensure human eye safety.
  • FIG. 12 illustrates a schematic diagram in which the ranging unit 812 is implemented as a TOF camera unit 812A according to an embodiment of the present application.
  • the TOF camera unit 812A includes a projection assembly 8121A and a receiving assembly 8122A, wherein the projection assembly 8121A includes a projection element 8123A, an optical element 8124A, a circuit board 8125A and a bracket 8126A, and the projection element 8123A is attached to Attached to the circuit board 8125A, the optical element 8124A is held on the projection path of the projection element 8123A through the bracket 8126A, and the detection signal projected by the projection element 8123A is subjected to optical processing; It is configured to receive a detection signal from a photographed object to obtain the distance between the TOF camera unit 812A and the photographed object based on the time-of-flight law.
  • the projection assembly 8121A further includes a detection element 8127A, which is configured to detect whether the TOF camera unit 812A is in an abnormal working state.
  • the detection element 8127A is A PD element (Photo-Diode, photodiode) is used to detect the energy of the projection signal generated by the projection element 8123A; of course, the detection element 8127A can also be implemented as other mechanisms for detecting whether the projection element 8123A is normal.
  • the projection element 8123A is implemented as a VCSEL laser projector, and the VCSEL laser projector is divided into a plurality of regions, wherein the VCSEL projection includes a plurality of laser projection points.
  • the projection element 8123A is divided into four projection areas A, B, C, and D, wherein the number of projection lattices in area A is smaller than the number of projection lattices in other areas, but the The projected lattice energy of region A is greater than that of other regions.
  • the area A is preferably used for projection to achieve ranging, and the other areas B, C, and D have high measurement accuracy and are suitable for other applications, such as acquiring depth information, due to the large number of projection points.
  • the number of area divisions of the projection element 8123A is not limited by this application, and the division result only needs to satisfy: the number of lattices in at least one area is smaller than the number of lattices in other areas, and, preferably, the lattices The area with the largest number is 83-810 times the area with the least number of lattices.
  • FIG. 14 illustrates another schematic diagram in which the ranging unit 812 is implemented as a TOF camera unit 812A according to an embodiment of the present application.
  • the projection assembly 8121A further includes a collimating element 8129A disposed between the projection element 8123A and the optical element 8124A, and is configured as The detection signal projected by the projection element 8123A is beamed.
  • the collimation unit collimates the detection signal generated when the distance measurement is performed, so that the projection distance of the detection signal can be more far, so that the power consumption required for projection can be reduced.
  • the projection element 8123A is implemented as a VCSEL laser projector, and the pattern formed by the projection points of the VCSEL laser is regular.
  • the ranging unit 812 when the ranging unit 812 is implemented as the TOF camera unit, that is, when the camera module device 810 is implemented as a multi-camera camera module, all The camera unit 811 and the TOF camera unit 812A refer to two camera units 811 that are structurally integrated in the camera module device 810, rather than structurally separated camera modules.
  • the TOF camera unit 812A and the camera unit 811 can be integrally formed by a process such as molding to make the camera module device 810, and the camera module The apparatus 810 as a whole is connected with other peripheral devices, such as an image processor.
  • the ranging unit 812 can also be used as an auxiliary ranging tool during the calibration process of the camera unit 811 of the camera module device 810, that is, shooting Scenes at different distances are recorded to the camera unit 811 .
  • At least one lens group 8112 of the camera unit 811 includes a first lens group 8114 and a second lens group 8115
  • the driving component 8113 includes a first driving element 8117
  • the first driving element 8117 is configured to drive at least part of the lenses in the first lens group 8114 to perform optical zooming based on the adjustment instruction.
  • the first driving element 8117 is a zoom driver, which is used to drive at least part of the lenses in the first lens group 8114 to move to perform optical zooming.
  • the driving component 8113 of the camera unit 811 further includes a second driving element 8118, and the second driving element 8118 is configured to drive the second driving element 8118 based on the adjustment instruction Lens group 8115 for optical focusing and/or compensation. That is, in the embodiment of the present application, the imaging unit 811 further has a focusing function, and the second driving element 8118 is a focusing driver. It should be understood that, after the optical zoom is performed by the first driving element 8117, the second driver can drive the second lens group 8115 to move to supplement the influence brought by the optical zoom, so as to improve the imaging quality.
  • first driving element 8117 and the second driving element 8118 may be implemented as the same driver (ie, the zoom driver and the focus driver are implemented as the same driver), or , the first driving element 8117 and the second driving element 8118 have an integrated structure, which is not limited by this application.
  • the at least one lens group 8112 may further include a greater number of lens groups, for example, further include a third lens group 8116, and the position of the third lens group 8116 is fixed as a fixed position
  • the lens group in this regard, is not limited by this application.
  • the camera unit 811 may be implemented as a periscope camera unit 811 .
  • the camera unit 811 further includes a camera disposed on the photosensitive chip 8111 Reflective element 8119 on the photosensitive path for deflecting imaging light.
  • the camera unit 811 is further configured with an optical image stabilization function.
  • the camera unit 811 further includes a reflective element 8119 disposed on the photosensitive path of the photosensitive chip 8111 for deflecting imaging light; or, the driving component 8113 further includes a reflective element for driving
  • the first lens group 8114 and/or the second lens group 8115 is an anti-shake mechanism for optical anti-shake, so as to compensate for the error caused by the photographer's hand shaking.
  • the camera module device 810 according to the embodiment of the present application is clarified, and the structure and configuration of the camera module device 810 enables the camera module device 810 to perform automatic optical zooming based on the distance between the camera module device and the object to be photographed. , for a better shooting experience.
  • the camera module device 810 performs automatic optical zoom (ie, how the camera unit 811 performs automatic optical zoom), the following describes an automatic zoom imaging method applicable to the camera module device 810 .
  • FIG. 15 illustrates a flowchart of an automatic zoom imaging method according to an embodiment of the present application.
  • the automatic zoom imaging method includes the steps of: S8110, acquiring a zoom instruction; S8120, in response to the zoom instruction, acquiring the distance between the camera module device 810 and the photographed target distance, the camera module device 810 includes a camera unit 811; S8130, based on the distance, an adjustment instruction is generated, and the adjustment instruction is used to drive the driving component 8113 of the camera unit 811 to drive at least the camera unit 811. At least some of the lenses in a lens group 8112 are used to perform optical zooming; and, in S8140, the image of the subject captured by the imaging unit 811 is obtained after the optical zooming is performed.
  • a zoom instruction is acquired.
  • the zoom instruction includes, but is not limited to, single-clicking on the object displayed on the screen, double-clicking on the object displayed on the screen, stretching the object displayed on the screen with both hands, and the like. It should be understood that the zoom instruction can be set in advance based on the user's needs, and cannot conflict with other instruction settings.
  • step S8120 in response to the zoom instruction, the distance between the camera module device 810 and the photographed target is obtained, and the camera module device 810 includes a camera unit 811 .
  • the process of acquiring the distance between the camera module device 810 and the object to be photographed includes: the projector 8121 of the ranging unit 812 projects a detection signal on the object to be photographed target; then, receiving the detection signal reflected back from the photographed target; then, based on the time-of-flight law, determine the distance between the ranging module and the photographed target, wherein the ranging module
  • the distance between the group and the subject is set as the distance between the camera module device 810 and the subject.
  • the detection signals include but are not limited to millimeter wave detection signals, ultrasonic detection signals, and laser pulse detection signals.
  • the ranging unit 812 is implemented as a TOF camera unit 812A.
  • the detection signal projected by the TOF camera unit 812A is a laser pulse, which poses a certain safety hazard to human eyes.
  • the auto-focus imaging method further includes: collecting an image of the photographed object through the TOF camera unit 812A; analyzing the image to determine the image Whether the content of the image contains human eyes; in response to the content of the image containing human eyes, delay ranging, if not, start ranging.
  • the auto-focus imaging method further includes: in response to the content of the image including human eyes, passing through the TOF camera unit 812A with a relatively small projected energy. area to project detection signals for ranging. That is, in this example, the projection area of the TOF camera unit 812A includes a plurality of areas, and the energy of the projection beam generated by some areas is relatively small. That is, when the human eye is included in the image, a region with less energy is used to project the beam to achieve distance measurement.
  • step S8130 based on the distance, an adjustment instruction is generated, and the adjustment instruction is used to drive the driving component 8113 of the camera unit 811 to drive at least part of the lenses in at least one lens group 8112 of the camera unit 811 to perform optics zoom.
  • the adjustment instruction is used to drive the first driving element 8117 of the driving component 8113 to drive at least some of the lenses in the first lens group 8114 of the at least one lens group 8112 to perform Optical zoom; and the adjustment instruction is further used to drive the second driving element 8118 of the driving component 8113 to drive the second lens group 8115 of the at least one lens group 8112 to perform optical focusing.
  • optical zooming is performed by the first driving element 8117
  • optical focusing is performed by the second driving element 8118 to realize compensation and improve the zooming capability of the camera unit 811 after zooming. image quality.
  • step S8140 an image of the subject captured by the imaging unit 811 after the optical zooming is obtained is obtained. That is, after the optical zooming is performed, the image of the object to be photographed is captured by the zoomed imaging unit 811 .
  • the autofocus imaging method applicable to the above-mentioned camera module device 810 based on the embodiment of the present application is clarified, which is implemented based on the structural configuration of the camera module device 810 to improve the shooting experience of the photographer.
  • the automatic zoom imaging method can be applied to image shooting, and can also be used for video shooting.
  • the camera module device 810 or, in other words, the electronic device
  • the photographer can complete the image shooting by sending a zoom command to complete the automatic zooming. .
  • the photographed object may move during the shooting process, and the movement may be irregular.
  • the photographer can shoot in the following ways:
  • the photographer does not move the electronic device, and the camera module device 810 is driven by the driver as a whole to realize tracking shooting, as shown in FIG. 18 ;
  • the camera module device 810 also remains stationary relative to the electronic equipment, and the reflection unit of the camera unit 811 is moved to achieve tracking shooting, as shown in FIG. 19 ;
  • the photographer does not move the electronic device, the camera module device 810 also remains stationary relative to the electronic device, and the reflection unit of the camera unit 811 is rotated to realize tracking shooting, as shown in FIG. 20 .
  • the automatic zoom imaging method may further include: moving the camera module device 810 based on the movement trajectory of the photographed target, so that the photographed target is always located in the camera module within the capture window of the group device 810 .
  • the automatic zoom imaging method may further include: moving the reflective element 8119 of the camera unit 811 based on the movement trajectory of the photographed object.
  • the automatic zoom imaging method may further include: rotating the reflective element 8119 of the imaging unit 811 based on the movement trajectory of the photographed object.
  • the required zoom factor can be adjusted following the forward and backward movement of the object, so that the size or position of the subject displayed in the image can be achieved, so as to improve the shooting experience .
  • a camera system is also provided.
  • FIG. 16 illustrates a schematic diagram of the camera system according to an embodiment of the present application.
  • the camera system 830 includes the camera module device 810 described above and a processor 820 communicatively connected to the camera module device 810 , wherein the processor 820 is configured based on
  • the camera module device 810 generates an adjustment instruction relative to the distance of the photographed target.
  • the driving component 8113 of the camera unit 811 drives at least some of the lenses in the at least one lens group 8112 to perform optical zooming. In this way, the camera system 830 automatically Zoom shooting function.
  • an electronic device is also provided.
  • FIG. 17 illustrates a schematic perspective view of an electronic device according to an embodiment of the present application.
  • the electronic device 8100 includes a main body of the electronic device 8100 and the above-mentioned camera module device 810 assembled in the main body of the electronic device 8101 .
  • the camera module device 810 is preferably configured on the back of the electronic device main body 8101 to be configured as a rear camera module, of course, it can also be configured as the electronic device main body 8101 the front to be configured as a front camera module.
  • the electronic device main body 8101 includes a screen and an integrated circuit, wherein the screen can be used to display image data collected by the camera module device 810 , and the integrated circuit It can be used to process the image data collected by the camera module device 810 to control the camera module device 810 to realize the automatic zoom shooting function.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Lens Barrels (AREA)
  • Studio Devices (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)

Abstract

公开了一种摄像模组装置、多摄摄像模组、摄像系统、电子设备和自动变焦成像方法。所述多摄摄像模组包括：具有变焦功能的第一摄像单元，以及，与所述第一摄像单元之间具有预设的相对位置关系的第二摄像单元，其中，所述第一摄像单元的驱动组件基于调整指令驱动所述第一摄像单元的至少一透镜组中至少部分透镜以进行光学变焦，其中，所述调整指令基于所述多摄摄像模组相对于被摄目标的距离生成，所述距离基于所述第一摄像模组和所述第二摄像模组通过双目测距原理获得。这样，所述多摄摄像模组的结构配置使得所述多摄摄像模组能够基于其与被摄目标之间的距离进行自动光学变焦，以提供更好的拍摄体验。

Description

摄像模组装置、多摄摄像模组、摄像系统、电子设备和自动变焦成像方法 技术领域
本申请涉及摄像模组领域，尤其涉及摄像模组装置、多摄摄像模组、摄像系统、电子设备和自动变焦成像方法。
背景技术
随着移动电子设备的普及，被应用于移动电子设备的用于帮助使用者获取影像(例如视频或者图像)的摄像模组的相关技术得到了迅猛的发展和进步。尤其随着智能手机的发展，消费者对于拍摄功能的追求越来越多样化，对于成像质量的要求也越来越高，这对摄像模组提出了更多的挑战。
近年来，摄像模组经历了从单摄摄像模组到多摄摄像模组的变化，近期更是出现了在智能手机上搭载具有光学变焦能力的摄像模组以满足不同距离摄像的需求。
在现行的方案中，在利用具有光学变焦功能的摄像模组进行拍摄时，需手动进行光学变焦操作。在现行的一种方案中，用户通过手指在屏幕上滑动，以手动地控制光学变焦操作，以切换远近景拍摄。在实际使用过程中，这种手动变焦操作具有诸多缺陷。
第一，用户一只手握持移动电子设备，另一手在屏幕上滑动，这会降低用户握持电子设备的稳定性，导致拍摄的图像或者视频模糊不清晰。
第二，当用户通过变焦后的摄像模组进行远景拍摄时，电子设备的抖动造成的不利影响会被放大，降低了拍摄体验。
第三，通过手动变焦，调整范围很难把控，往往是调大了或者调小了，因此，用户往往需要多次进行手动调整方能使得拍摄范围和成像质量符合要求。
因此，需要一种具有自动变焦功能的多摄摄像模组及其成像方案。
发明内容
本申请的一优势在于提供一种多摄摄像模组、摄像系统、电子设备和自 动变焦成像方法，其中，所述多摄摄像模组的结构配置使得所述多摄摄像模组能够基于其与被摄目标之间的距离进行自动光学变焦，以提供更好的拍摄体验。
本申请的另一优势在于提供一种多摄摄像模组、摄像系统、电子设备和自动变焦成像方法，其中，所述多摄摄像模组基于其自身配置的摄像单元进行测距，为自动光学变焦提供所需的距离信息，也就是，根据本申请实施例的所述多摄摄像模组将其自身配置的摄像单元的功能进行扩充，以实现自动变焦功能。也就是，根据本申请实施例的所述多摄摄像模组在无需额外配置测距模组的前提下实现了自动光学变焦功能。
通过下面的描述，本申请的其它优势和特征将会变得显而易见，并可以通过权利要求书中特别指出的手段和组合得到实现。
为实现上述至少一目的或优势，本申请提供一种多摄摄像模组，其包括：
第一摄像单元，包括感光芯片、位于所述感光芯片的感光路径上的至少一透镜组，以及，用于驱动所述至少一透镜组中至少部分透镜以进行光学变焦的驱动组件；以及
第二摄像单元，与所述第一摄像单元之间具有预设的相对位置关系；
其中，所述驱动组件被配置为基于调整指令驱动所述至少一透镜组中至少部分透镜以进行光学变焦，所述调整指令基于所述多摄摄像模组相对于被摄目标的距离生成，所述多摄摄像模组相对于被摄目标的距离至少部分地基于所述第一摄像单元采集的该被摄目标的第一图像、所述第二摄像单元采集的该被摄目标的第二图像，以及，所述第一摄像单元与所述第二摄像单元之间的相对位置关系计算获得。
在根据本申请的多摄摄像模组中，所述至少一透镜组包括第一透镜组和第二透镜组，所述驱动组件包括第一驱动元件，所述第一驱动元件被配置为基于所述调整指令驱动所述第一透镜组中至少部分透镜以进行光学变焦。
在根据本申请的多摄摄像模组中，所述驱动组件进一步包括第二驱动元件，所述第二驱动元件被配置为基于所述调整指令驱动所述第二透镜组以进行光学对焦。
在根据本申请的多摄摄像模组中，所述第一摄像单元进一步包括被设置于所述感光芯片的感光路径上用于转折成像光线的反射元件。
在根据本申请的多摄摄像模组中，所述驱动组件进一步包括用于驱动所 述反射元件以进行光学防抖的防抖机构。
在根据本申请的多摄摄像模组中，所述驱动组件进一步包括用于驱动所述第一透镜组和/或所述第二透镜组以进行光学防抖的防抖机构。
在根据本申请的多摄摄像模组中，所述多摄摄像模组进一步包括第三摄像单元，与所述第一摄像单元之间具有预设位置关系，所述第三摄像单元的第三等效焦距大于所述第二摄像单元的第二等效焦距，其中，当至少部分地基于所述第一摄像单元采集的该被摄目标的第一图像、所述第二摄像单元采集的该被摄目标的第二图像，以及，所述第一摄像单元与所述第二摄像单元之间的相对位置关系获得的所述多摄摄像模组相对于所述被摄目标的距离超过预设阈值时，所述调整指令基于所述多摄摄像模组相对于被摄目标的第二距离生成，其中，所述第二距离至少部分地基于所述第一摄像单元采集的该被摄目标的第一图像、所述第三摄像单元采集的该被摄目标的第三图像，以及，所述第一摄像单元与所述第三摄像单元之间的相对位置关系计算获得。
根据本申请的另一方面，还提供可一种摄像系统，其包括：
如上所述的多摄摄像模组；以及
可通信地连接连接于所述多摄摄像模组的处理器，其中，所述处理器被配置为基于所述多摄摄像模组相对于被摄目标的距离生成调整指令。
在根据本申请的摄像系统中，所述处理器进一步被配置为融合在进行光学变焦后所述第一摄像模组采集的该被摄目标的第一图像和所述第二摄像模组采集的该被摄目标的第二图像，以获得该被摄目标的融合图像；或者，融合在进行光学变焦后所述第一摄像模组采集的该被摄目标的第一图像和所述第三摄像模组采集的该被摄目标的第三图像，以获得该被摄目标的融合图像。
根据本申请的又一方面，还提供了一种自动变焦成像方法，其包括：
获取变焦指令；
响应于所述变焦指令，获取多摄摄像模组与被摄目标之间的距离，所述多摄摄像模组包括第一摄像单元；
基于所述距离，生成调整指令，所述调整指令用于驱动所述第一摄像单元的驱动组件以带动所述第一摄像单元的至少一透镜组中至少部分透镜以进行光学变焦；以及
融合在进行光学变焦后所述第一摄像单元采集的该被摄目标的第一图 像和所述多摄摄像模组的其他摄像单元采集的该被摄目标的图像以获得融合图像。
在根据本申请的自动变焦成像方法中，响应于所述变焦指令，获取多摄摄像模组与被摄目标之间的距离，包括：
通过所述第一摄像单元获得该被摄目标的第一图像；
通过所述第二摄像单元获得该被摄目标的第二图像；以及
至少部分地基于所述第一图像、所述第二图像，以及，所述第一摄像单元与所述第二摄像单元之间的相对位置关系，获得所述多摄摄像模组与该被摄目标之间的第一距离，其中，所述第一距离为所述多摄摄像模组与被摄目标之间的距离。
在根据本申请的自动变焦成像方法中，在通过所述第一摄像单元获得该被摄目标的第一图像之前，还包括：预驱动所述第一摄像单元的驱动组件以带动所述第一摄像单元的至少一透镜组中至少部分透镜以进行光学变焦。
在根据本申请的自动变焦成像方法中，响应于所述变焦指令，获取所述多摄摄像模组与被摄目标之间的距离，进一步包括：
响应于所述第一距离大于预设阈值时，启动所述多摄摄像模组的第三摄像单元以通过第三摄像单元获得该被摄目标的第三图像，所述第三摄像单元的第三等效焦距大于所述第二摄像单元的第二等效焦距；以及
至少部分地基于所述第一图像、所述第三图像，以及，所述第一摄像单元与所述第三摄像单元之间的相对位置关系，获得所述多摄摄像模组与该被摄目标之间的第二距离，其中，所述第二距离为所述多摄摄像模组与被摄目标之间的距离。
在根据本申请的自动变焦成像方法中，所述调整指令进一步用于驱动所述驱动组件的第一驱动元件，以带动所述至少一透镜组的第一透镜组中至少部分透镜以进行光学变焦。
在根据本申请的自动变焦成像方法中，所述调整指令进一步用于驱动所述驱动组件的第二驱动元件，以带动所述至少一透镜组的第二透镜组以进行光学对焦。
在根据本申请的自动变焦成像方法中，融合在进行光学变焦后所述第一摄像单元采集的该被摄目标的第一图像和所述多摄摄像模组的其他摄像单元采集的该被摄目标的图像以获得融合图像，包括：融合在进行光学变焦后 所述第一摄像单元采集的该被摄目标的第一图像和所述第二摄像单元采集的该被摄目标的第二图像，以获得融合图像。
在根据本申请的自动变焦成像方法中，融合在进行光学变焦后所述第一摄像单元采集的该被摄目标的第一图像和所述多摄摄像模组的其他摄像单元采集的该被摄目标的图像以获得融合图像，包括：融合在进行光学变焦后所述第一摄像单元采集的该被摄目标的第一图像和所述第三摄像单元采集的该被摄目标的第三图像，以获得融合图像。
在根据本申请的自动变焦成像方法中，所述自动变焦成像方法进一步包括：基于被摄目标的运动轨迹，移动所述多摄摄像模组，以使得该被摄目标始终位于所述多摄摄像模组的拍摄视窗内。
在根据本申请的自动变焦成像方法中，所述自动变焦成像方法进一步包括：基于被摄目标的运动轨迹，移动所述第一摄像单元的反射元件。
在根据本申请的自动变焦成像方法中，所述自动变焦成像方法进一步包括：基于被摄目标的运动轨迹，转动所述第一摄像单元的反射元件。
根据本申请的又一方面，还提供一种摄像模组装置，其包括：
摄像单元，包括感光芯片、位于所述感光芯片的感光路径上的至少一透镜组和用于驱动所述至少一透镜组中至少部分透镜以进行光学变焦的驱动组件；以及
测距单元；
其中，所述驱动组件被配置为基于调整指令驱动所述至少一透镜组中至少部分透镜以进行光学变焦，所述调整指令基于所述摄像模组装置相对于被摄目标的距离生成，所述摄像模组装置相对于被摄目标的距离由所述测距单元测得。
在根据本申请的摄像模组装置中，所述至少一透镜组包括第一透镜组和第二透镜组，所述驱动组件包括第一驱动元件，所述第一驱动元件被配置为基于所述调整指令驱动所述第一透镜组中至少部分透镜以进行光学变焦。
在根据本申请的摄像模组装置中，所述驱动组件进一步包括第二驱动元件，所述第二驱动元件被配置为基于所述调整指令驱动所述第二透镜组以进行光学对焦。
在根据本申请的摄像模组装置中，所述摄像单元进一步包括被设置于所述感光芯片的感光路径上用于转折成像光线的反射元件。
在根据本申请的摄像模组装置中，所述驱动组件进一步包括用于驱动所述反射元件以进行光学防抖的防抖机构。
在根据本申请的摄像模组装置中，所述驱动组件进一步包括用于驱动所述第一透镜组和/或所述第二透镜组以进行光学防抖的防抖机构。
在根据本申请的摄像模组装置中，所述测距单元包括投射器和接收器，所述投射器被配置为投射具有特定波长的检测信号至被摄目标，所述接收器被配置为接收自该被摄目标反射回的所述检测信号，并基于时间飞行法则确定所述测距模组与该被摄目标之间的距离。
在根据本申请的摄像模组装置中，所述检测信号包括超声波检测信号、毫米波检测信号、激光脉冲检测信号。
在根据本申请的摄像模组装置中，所述测距单元被实施为TOF摄像单元，以通过所述TOF摄像单元采集所述摄像模组装置与被摄目标之间的距离。
根据本申请的另一方面，还提供可一种摄像系统，其包括：
如上所述的摄像模组装置；以及
可通信地连接连接于所述摄像模组装置的处理器，其中，所述处理器被配置为基于所述摄像模组装置相对于被摄目标的距离生成调整指令。
根据本申请的又一方面，还提供了一种自动变焦成像方法，其包括：
获取变焦指令；
响应于所述变焦指令，通过测距模组获取摄像模组装置与被摄目标之间的距离；
基于所述距离，生成调整指令，所述调整指令用于驱动所述摄像单元的驱动组件以带动所述摄像单元的至少一透镜组中至少部分透镜以进行光学变焦；以及
获得在进行光学变焦后所述摄像单元采集的该被摄目标的图像。
在根据本申请的自动变焦成像方法中，响应于所述变焦指令，通过测距模组获取摄像模组装置与被摄目标之间的距离，包括：
投射一检测信号于被摄目标；
接收自该被摄目标反射回的所述检测信号；以及
基于时间飞行法则，确定所述测距模组与所述被摄目标之间的距离，其中，所述测距模组与所述被摄目标之间的距离被设定为所述摄像模组装置与 被摄目标之间的距离。
在根据本申请的自动变焦成像方法中，所述调整指令进一步用于驱动所述驱动组件的第一驱动元件，以带动所述至少一透镜组的第一透镜组中至少部分透镜以进行光学变焦。
在根据本申请的自动变焦成像方法中，所述调整指令进一步用于驱动所述驱动组件的第二驱动元件，以带动所述至少一透镜组的第二透镜组以进行光学对焦。
在根据本申请的自动变焦成像方法中，所述自动对焦成像方法进一步包括：基于被摄目标的运动轨迹，移动所述摄像模组装置，以使得该被摄目标始终位于所述摄像模组装置的拍摄视窗内。
在根据本申请的自动变焦成像方法中，所述自动对焦成像方法进一步包括：基于被摄目标的运动轨迹，移动所述摄像单元的反射元件。
在根据本申请的自动变焦成像方法中，所述自动变焦成像方法进一步包括：基于被摄目标的运动轨迹，转动所述摄像单元的反射元件
通过对随后的描述和附图的理解，本申请进一步的目的和优势将得以充分体现。
本申请的这些和其它目的、特点和优势，通过下述的详细说明，附图和权利要求得以充分体现。
附图说明
通过结合附图对本申请实施例进行更详细的描述，本申请的上述以及其他目的、特征和优势将变得更加明显。附图用来提供对本申请实施例的进一步理解，并且构成说明书的一部分，与本申请实施例一起用于解释本申请，并不构成对本申请的限制。在附图中，相同的参考标号通常代表相同部件或步骤。
图1图示了根据本申请实施例的多摄摄像模组的示意图。
图2图示了根据本申请实施例的双目距离原理的示意图。
图3图示了根据本申请实施例的另一多摄摄像模组的示意图。
图4图示了根据本申请实施例的摄像系统的示意图。
图5图示了根据本申请实施例的电子设备的立体示意图。
图6图示了根据本申请实施例的自动变焦成像方法的流程图。
图7图示了根据本申请实施例的自动变焦成像方法中跟踪被摄目标的第一示意图。
图8图示了根据本申请实施例的自动变焦成像方法中跟踪被摄目标的第二示意图。
图9图示了根据本申请实施例的自动变焦成像方法中跟踪被摄目标的第三示意图。
图10图示了根据本申请实施例的摄像模组装置的示意图。
图11图示了根据本申请实施例的测距单元的测距示意图。
图12图示了根据本申请实施例的所述测距单元被实施为TOF摄像单元的示意图。
图13图示了根据本申请实施例的所述TOF摄像单元的投射元件的投射区域的分区示意图。
图14图示了根据本申请实施例的所述测距单元被实施为TOF摄像单元的另一示意图。
图15图示了根据本申请实施例的自动变焦成像方法的流程图。
图16图示了根据本申请实施例的摄像系统的示意图。
图17图示了根据本申请实施例的电子设备的立体示意图。
图18图示了根据本申请实施例的自动变焦成像方法中跟踪被摄目标的第一示意图。
图19图示了根据本申请实施例的自动变焦成像方法中跟踪被摄目标的第二示意图。
图20图示了根据本申请实施例的自动变焦成像方法中跟踪被摄目标的第三示意图。
具体实施方式
下面，将参考附图详细地描述根据本申请的示例实施例。显然，所描述的实施例仅仅是本申请的一部分实施例，而不是本申请的全部实施例，应理解，本申请不受这里描述的示例实施例的限制。
示例性多摄摄像模组
如图1所示，根据本申请实施例的多摄摄像模组被阐明，其中，所述多 摄摄像模组的结构配置使得所述多摄摄像模组能够基于其与被摄目标之间的距离进行自动光学变焦，以提供更好的拍摄体验。
如图1所示，根据本申请实施例的所述多摄摄像模组710，包括具有光学变焦功能的第一摄像单元711，以及，与所述第一摄像单元711具有预设相对位置关系的第二摄像单元712。具体地，所述第一摄像单元711，包括感光芯片7111、位于所述感光芯片7111设定的感光路径上的至少一透镜组7112，以及，用于驱动所述至少一透镜组7112中至少部分透镜以进行光学变焦的驱动组件7113。
相应地，所述第一摄像单元711和所述第二摄像单元712能够采集被摄目标的图像。特别地，在本申请实施例中，所述多摄摄像模组710的所述第一摄像单元711和所述第二摄像单元712的应用被进一步地拓展，更明确地，在本申请实施例中，所述第一摄像单元711与所述第二摄像单元712基于双目测距原理测得所述多摄摄像模组710与被摄目标之间的距离信息，即，至少部分地基于所述第一摄像单元711采集的该被摄目标的第一图像、所述第二摄像单元712采集的该被摄目标的第二图像，以及，所述第一摄像单元711与所述第二摄像单元712之间的相对位置关系计算获得所述多摄摄像模组710与被摄目标之间的距离。进一步地，所述第一摄像单元711的所述驱动组件7113被配置为基于所述距离信息生成的调整指令驱动所述至少一透镜组7112中至少部分透镜以进行光学变焦，通过这样的方式，所述多摄摄像模组710结构配置实现了自动光学变焦的功能。
图2图示了根据本申请实施例的双目测距原理的示意图。如图2所示，P是被摄目标上的某一个点，OR与OT分别是所述第一摄像单元711与所述第二摄像单元712的光心，点P在所述第一摄像单元711和所述第二摄像单元712的感光芯片7111上所成的成像点分别为P和P′，f为所述第二摄像单元712的有效焦距，B为所述第一摄像单元711与所述第二摄像单元712的中心距，Z为所需要计算的深度信息(即，距离信息)，设成像点P到点P′的距离为X，则：
X＝B-(X R-X T)
根据三角形相似三角形原理：
(B-(X R-X T))/B＝(Z-f)/Z
可知，Z＝fB/(X R-X T)
其中，焦距和摄像中心距B可通过标定得到，因此，只需获得X R-X(即视差d)的值即可求得深度信息Z，即距离。
值得一提的是，所述第一摄像单元711与所述第二摄像单元712由于其光学透镜的特性使得成像存在着径向畸变，相应地，畸变程度可由三个参数K71、K72和K73确定；并且，由于装配等方面的误差，感光芯片7111与光学镜头并非完全平行，因此，所述第一摄像单元711所述所述第二摄像单元712的成像也存在切向畸变，相应地，畸变程度可由两个参数P71和P72确定。在单个摄像单元的标定中，主要确定单摄单元的内参(包括但不限于焦距f、成像原点Cx、Cy、上述五个畸变参数)和外参(标定物的世界坐标)，而双目摄像模组的标定(即，由所述第一摄像单元711与所述第二摄像单元712组成的摄像单元组合)不仅要得出每个摄像单元的内部参数，还需要通过标定来测量所述第一摄像单元711与所述第二摄像单元712之间的相对位置(即，第二摄像单元712相对于第一摄像单元711的旋转矩阵R和平移向量t)。
在进行标定后，便能够基于标定的内参和双目相对位置关系，分别对所述第一摄像单元711和所述第二摄像单元712所采集的图像进行校正，以消除畸变和进行行对准，以进行双目测距。
值得一提的是，在本申请实施例中，由于所述多摄摄像模组710对测距精度要求相对较低，因此，为了降低工作量，可选择在一些特定点进行标定，例如，选择所述第一摄像单元711和所述第二摄像单元712的景深区域(即，视窗区域)中的点进行标定。更进一步地，例如，选择最远景深点和最近景深点，再将最近景深点X71与最远景深点X72之间的连线进行N等分，进而，对最远景深点、最近景深点和每个等分点进行标定，再将获取的参数进行烧录，从而提高测距的效率，降低标定所需的工作量。
进一步地，在本申请实施例中，所述第二摄像单元712可被配置为主摄像单元，用于采集被摄目标的第一图像，其优选地具有相对较大的视场角，例如，所述第二摄像单元712的视场角大于760°；而所述第一摄像单元711被配置为副摄像单元，用于基于所述多摄像模组与被摄目标之间的距离调整其焦距并采集被摄目标的第一图像。相应地，在获得所述第一图像和所述第二图像后，所述多摄摄像模组710能融合所述第一图像和所述第二图像以生成具有更高成像质量的融合图像。
更具体地，如图1所示，在本申请实施例中，所述第一摄像单元711的至少一透镜组7112包括第一透镜组7114和第二透镜组7115，所述驱动组件7113包括第一驱动元件7117，所述第一驱动元件7117被配置为基于所述调整指令驱动所述第一透镜组7114中至少部分透镜以进行光学变焦。也就是，在本申请实施例中，所述第一驱动元件7117为变焦驱动器，其用于驱动所述第一透镜组7114中至少部分透镜移动以进行光学变焦。
如图1所示，在本申请实施例中，所述第一摄像单元711的驱动组件7113还包括第二驱动元件7118，所述第二驱动元件7118被配置为基于所述调整指令驱动所述第二透镜组7115以进行光学对焦。也就是，在本申请实施例中，所述第一摄像单元711进一步具有对焦功能，所述第二驱动元件7118为对焦驱动器。应可以理解，在通过所述第一驱动元件7117进行光学变焦后，所述第二驱动器能驱动所述第二透镜组7115移动以不仅能够实现光学对焦，同时还能够补偿光学变焦后带来的影响，以提高成像质量。即，在本发明中所述第一驱动元件7117和第二驱动元件7118分别驱动第一透镜组7114和第二透镜组7115共同实现光学变焦，并确保TTL(Total Track length)不变以在光学变焦后仍具有较高成像质量；也就是，由第一驱动元件7117驱动第一透镜组7114实现变焦，所述第二驱动元件7118驱动所述第二透镜组7115实现补偿和/或对焦，从而获取高质量图像。
值得一提的是，在本申请其他示例中，所述第一驱动元件7117和所述第二驱动元件7118可被实施为同一驱动器(即，变焦驱动器和对焦驱动器被实施为同一驱动器)，或者，所述第一驱动元件7117和所述第二驱动元件7118有一体式结构，对此，并不为本申请所局限。其中，优选地所述第一透镜组7114和所述第二透镜组7115同时被固定于一连接轴，从而所述第一透镜组7114和所述第二透镜组7115在移动过程中不会产生偏移，进一步距离所述连接轴可以为导轨(第一透镜组7114和第二透镜组7115都被组装于同一导轨)、或者孔轴结构(第一透镜组7114和第二透镜组7115用轴连接，并沿着轴运动)。
应可以理解，在本申请实施例中，所述至少一透镜组7122还可以包括更多数量的透镜组，例如，还包括第三透镜组7126，所述第三透镜组7126的位置固定作为固定透镜组，对此，并不为本申请所局限。
也值得一提的是，对于某些终端设备(例如，智能手机)而言，对于多 摄摄像模组710的厚度有要求，即，需要确保多摄摄像模组710的厚度小于某一值。相应地，在本申请其他示例中，所述第一摄像单元711可被实施为潜望式摄像单元，相应地，在这些示例中，所述第一摄像单元711进一步包括被设置于所述感光芯片7111的感光路径上用于转折成像光线的反射元件7119。
为了进一步地提高所述第一摄像单元711的成像性能，在本申请一些示例中，所述第一摄像单元711还被配置有光学防抖功能。例如，在本申请一些示例中，所述第一摄像单元711进一步包括被设置于所述感光芯片7111的感光路径上用于转折成像光线的反射元件7119；或者，所述驱动组件7113进一步包括用于驱动所述第一透镜组7114和/或所述第二透镜组7115以进行光学防抖的防抖机构，从而弥补由于拍摄者手抖带来的误差。
在实际应用中，当被摄目标距离所述多摄摄像模组710较远时，可能会发生所述第一摄像单元711和所述第二摄像单元712无法测距的情况，即，被摄目标与所述多摄摄像模组710之间的距离超出拍摄范围。相应地，如图3所示，在本申请实施例中，可在原先所述多摄摄像模组710的结构基础上，进一步配置一具有更远拍摄范围的第三摄像单元713，即，所述第三摄像单元713的第三等效焦距大于所述第二摄像单元712的第二等效焦距。并进一步地，所述第三摄像单元713和所述第一单元通过双目测距原理获得所述多摄摄像模组710与被摄目标之间的距离，即，至少部分地基于所述第一摄像单元711采集的该被摄目标的第一图像、所述第三摄像单元713采集的该被摄目标的第三图像，以及，所述第一摄像单元711与所述第三摄像单元713之间的相对位置关系计算获得。
更明确地，在本申请实施例中，当所述多摄摄像模组710与被摄目标之间的距离大于预设阈值时，采用所述第一摄像单元711和所述第三摄像单元713相配合的方式来测距；当所述多摄摄像模组710与被摄目标之间的距离低于预设阈值时，采用所述第一摄像单元711与所述第二摄像单元712相配合的方式来测距。也就是，在本申请一些示例中，所述多摄摄像模组710可进一步包括判断模块，用于对拍摄距离进行判定从而决定启动哪两个摄像单元来进行测距。
综上，基于本申请实施例的多摄摄像模组710被阐明，所述多摄摄像模组710的结构配置使得所述多摄摄像模组710能够基于其与被摄目标之间的 距离进行自动光学变焦，以提供更好的拍摄体验。
示意性摄像系统
根据本申请另一方面，还提供一种摄像系统。
图4图示了根据本申请实施例的所述摄像系统的示意图。
如图4所示，所述摄像系统730包括如上所述的多摄摄像模组710以及可通信地连接于所述多摄摄像模组710的处理器720，其中，所述处理器720被配置为基于所述多摄摄像模组710相对于被摄目标的距离生成调整指令。相应地，所述第一摄像单元711的驱动组件7113在接收到所述调整指令后，驱动所述至少一透镜组7112中至少部分透镜以进行光学变焦，通过这样的方式，所述摄像系统730实现自动变焦拍摄功能。
相应地，在本申请实施例中，所述处理器720进一步被配置为融合在进行光学变焦后所述第一摄像模组采集的该被摄目标的第一图像和所述第二摄像模组采集的该被摄目标的第二图像，以获得该被摄目标的融合图像。
或者，在本申请实施例中，所述处理器720进一步被配置为融合在进行光学变焦后所述第一摄像模组采集的该被摄目标的第一图像和所述第三摄像模组采集的该被摄目标的第三图像，以获得该被摄目标的融合图像。
示意性电子设备
根据本申请另一方面，还提供一种电子设备。
图5图示了根据本申请实施例的电子设备的立体示意图。
如图5所示，根据本申请实施例的所述电子设备7100包括电子设备主体7101和被组装于所述电子设备主体7101的如上所述的多摄摄像模组710。在具体实施中，所述多摄摄像模组710优选地被配置于所述电子设备主体7101的背面，以被配置为后置摄像模组，当然，其也可被配置为所述电子设备主体7101的前面，以被配置为前置摄像模组。
如图5所示，在本申请实施例中，所述电子设备主体7101包括屏幕和集成电路，其中，所述屏幕可用于显示所述多摄摄像模组710所采集的图像数据，所述集成电路可用于处理所述多摄摄像模组710所采集的图像数据，以控制所述多摄摄像模组710实现自动变焦拍摄功能。
示意性自动变焦成像方法
根据本申请的又一方面，还提供一种自动变焦成像方法。
图6图示了根据本申请实施例的自动变焦成像方法的流程图。
如图6所示，根据本申请实施例的所述自动变焦成像方法，包括步骤：S7110，获取变焦指令；S7120，响应于所述变焦指令，获取多摄摄像模组710与被摄目标之间的距离，所述多摄摄像模组710包括第一摄像单元711；S7130，基于所述距离，生成调整指令，所述调整指令用于驱动所述第一摄像单元711的驱动组件7113以带动所述第一摄像单元711的至少一透镜组7112中至少部分透镜以进行光学变焦；以及，S7140，融合在进行光学变焦后所述第一摄像单元711采集的该被摄目标的第一图像和所述多摄摄像模组710的其他摄像单元采集的该被摄目标的图像以获得融合图像。
在步骤S7110中，获取变焦指令。在本申请实施例中，所述变焦指令包括但不限于单击屏幕中显示的被摄目标、双击屏幕中显示的被摄目标、双手伸缩屏幕中显示的被摄目标等。应可以理解，所述变焦指令可基于使用者的需求提前设定，并且，不能与其他指令设定相冲突。
在步骤S7120中，响应于所述变焦指令，获取多摄摄像模组710与被摄目标之间的距离，所述多摄摄像模组710包括第一摄像单元711。
在本申请一示例中，响应于所述变焦指令，获取多摄摄像模组710与被摄目标之间的距的过程，包括：首先通过所述第一摄像单元711获得该被摄目标的第一图像和通过所述第二摄像单元712获得该被摄目标的第二图像；然后，至少部分地基于所述第一图像、所述第二图像，以及，所述第一摄像单元711与所述第二摄像单元712之间的相对位置关系，获得所述多摄摄像模组710与该被摄目标之间的第一距离，其中，所述第一距离为所述多摄摄像模组710与被摄目标之间的距离。
值得一提的是，在通过所述第一摄像单元711和所述第二摄像单元712通过双目测距原理进行测距时，为了拍摄更优的第一图像以提高测距精度，可在进行双目测距前，预先通过所述驱动组件7113移动所述第一摄像单元711的至少一透镜组7112中至少部分透镜以进行光学变焦。
也就是，在本申请实施例中，在通过所述第一摄像单元711获得该被摄目标的第一图像之前，还包括：预驱动所述第一摄像单元711的驱动组件7113以带动所述第一摄像单元711的至少一透镜组7112中至少部分透镜以进行 光学变焦。
应可以理解，正因为在步骤S7120中，所述第一摄像单元711已进行预变焦，从而在步骤S7130中，所述驱动组件7113可减少变焦所需的移动距离，以提高变焦效率，提升拍摄体验。
在本申请另一示例中，响应于所述变焦指令，获取所述多摄摄像模组710与被摄目标之间的距离的过程，进一步包括：响应于所述第一距离大于预设阈值时，启动所述多摄摄像模组710的第三摄像单元713以通过第三摄像单元713获得该被摄目标的第三图像，所述第三摄像单元713的第三等效焦距大于所述第二摄像单元712的第二等效焦距；以及，至少部分地基于所述第一图像、所述第三图像，以及，所述第一摄像单元711与所述第三摄像单元713之间的相对位置关系，获得所述多摄摄像模组710与该被摄目标之间的第二距离，其中，所述第二距离为所述多摄摄像模组710与被摄目标之间的距离。
在步骤S7130中，基于所述距离，生成调整指令，所述调整指令用于驱动所述第一摄像单元711的驱动组件7113以带动所述第一摄像单元711的至少一透镜组7112中至少部分透镜以进行光学变焦。
具体地，在本申请实施例中，所述调整指令用于驱动所述驱动组件7113的第一驱动元件7117，以带动所述至少一透镜组7112的第一透镜组7114中至少部分透镜以进行光学变焦；并且，所述调整指令进一步用于驱动所述驱动组件7113的第二驱动元件7118，以带动所述至少一透镜组7112的第二透镜组7115以进行光学对焦。
也就是，在本申请实施例中，在通过所述第一驱动元件7117进行光学变焦后，通过所述第二驱动元件7118进行光学对焦，以实现补偿，提高所述第一摄像单元711在变焦之后的成像质量。
在步骤S7140中，融合在进行光学变焦后所述第一摄像单元711采集的该被摄目标的第一图像和所述多摄摄像模组710的其他摄像单元采集的该被摄目标的图像以获得融合图像。
在本申请一示例中，融合在进行光学变焦后所述第一摄像单元711采集的该被摄目标的第一图像和所述多摄摄像模组710的其他摄像单元采集的该被摄目标的图像以获得融合图像，包括：融合在进行光学变焦后所述第一摄像单元711采集的该被摄目标的第一图像和所述第二摄像单元712采集的该 被摄目标的第二图像，以获得融合图像。
在本申请另一示例中，融合在进行光学变焦后所述第一摄像单元711采集的该被摄目标的第一图像和所述多摄摄像模组710的其他摄像单元采集的该被摄目标的图像以获得融合图像，包括：融合在进行光学变焦后所述第一摄像单元711采集的该被摄目标的第一图像和所述第三摄像单元713采集的该被摄目标的第三图像，以获得融合图像。
综上，基于本申请实施例的自动对焦成像方法被阐明，其基于所述多摄摄像模组710的结构配置得以实施，以提高拍摄者的拍摄体验。
具体地，所述自动变焦成像方法可应用于图像拍摄，也可用于视频拍摄。在进行图像拍摄时，所述多摄摄像模组710(或者说，所述电子设备)通常保持于禁止状态，此时，拍摄者通过发出变焦指令，带起完成自动变焦后，便可完整图像拍摄。
当所述自动对焦成像方法被应用于视频拍摄时，在拍摄过程中，被摄目标可能发生移动，并且，该移动可能是不规则的，尤其是沿着拍摄方向移动(即距离变动)，很难通过移动设备来实现匹配，从而使得视频中拍摄物体形状尺寸不变、或者成像质量得以保证。即，被拍摄物体移动是不规则的，相对拍摄者其左右或者上下移动，拍摄者可以通过往相同方向移动设备实现，拍摄物体保持在画面中心，本发明进一步为了更好地满足视频拍摄的需求，在实际应用中，拍摄者可通过如下方式来拍摄：
1、拍摄者不移动电子设备，所述多摄摄像模组710整体被驱动器驱动，以实现跟踪拍摄，如图7所示；
2、拍摄者不移动电子设备，所述多摄摄像模组710相对于所述电子设备同样保持静止，所述第一摄像单元711的反射单元被移动以实现跟踪拍摄，如图8所示；
3、拍摄者不移动电子设备，所述多摄摄像模组710相对于所述电子设备同样保持静止，所述第一摄像单元711的反射单元被转动以实现跟踪拍摄，如图9所示。
更进一步需要关注的在于，在视频拍摄时，被拍摄物体往往跟拍摄者的距离会产生变化，此时，如果不及时调整变焦倍率会导致成像模糊或者被拍摄物体尺寸发生变化，因此本发明自动变焦可实现时刻调整变焦倍率，使得拍摄视频时，被拍摄物体可保持清晰成像或其在视频中呈现的尺寸不变。即 本发明，应用于拍摄视频时，可实现被拍摄物体始终位于视频的画面中心(或者拍摄者希望的位置)，同时也可确保被拍摄物体的清晰度和尺寸大小不变化。
相应地，在本申请实施例中，所述自动变焦成像方法，可进一步包括：基于被摄目标的运动轨迹，移动所述多摄摄像模组710，以使得该被摄目标始终位于所述多摄摄像模组710的拍摄视窗内。
相应地，在本申请实施例中，所述自动变焦成像方法，可进一步包括：基于被摄目标的运动轨迹，移动所述第一摄像单元711的反射元件7119。
相应地，相应地，在本申请实施例中，所述自动变焦成像方法，可进一步包括：基于被摄目标的运动轨迹，转动所述第一摄像单元711的反射元件7119。
基于如上所述的方法在进行视频拍摄的过程中，能够跟随着物体的前后移动，调整所需的变焦倍数，实现被摄目标在图像中显示的尺寸大小，或者位置不变，以提升拍摄体验。
示例性摄像模组装置
如图10所示，根据本申请实施例的摄像模组装置被阐明，其中，所述摄像模组装置的结构配置使得所述摄像模组装置能够基于其与被摄目标之间的距离进行自动光学变焦，以提供更好的拍摄体验。
如图10所示，根据本申请实施例的所述摄像模组装置810，包括具有光学变焦功能的摄像单元811，以及，被配置为用于测量所述摄像模组装置810与被摄目标之间的距离的测距单元812。具体地，如图10所示，所述摄像单元811，包括感光芯片8111、位于所述感光芯片8111设定的感光路径上的至少一透镜组8112，以及，用于驱动所述至少一透镜组8112中至少部分透镜以进行光学变焦的驱动组件8113。
相应地，在本申请实施例中，所述测距单元812能够测得所述摄像模组装置810与被摄目标之间的距离信息，从而所述摄像单元811的所述驱动组件8113能够被配置为基于所述距离信息生成的调整指令驱动所述至少一透镜组8112中至少部分透镜以进行光学变焦，通过这样的方式，所述摄像模组装置810结构配置实现了自动光学变焦的功能。
值得注意的是，在本申请实施例中，所述摄像单元811与所述测距单元 812指的是所述摄像模组装置810中在结构上集成的两个部件，而不是指在结构上分离的部件。具体地，在所述摄像模组装置810中，所述测距单元812和所述摄像单元811可通过模塑等工艺整体成型以制成所述摄像模组装置810，且所述摄像模组装置810作为整体与其他外设设备，比如，图像处理器连接。
特别地，在本申请实施例中，所述测距单元812可通过时间飞行法则来获得所述摄像模组装置810与被摄目标之间的距离。根据所使用的检测信号的波长的不同，所述测距单元812有超声波、毫米波雷达、激光雷达等实现手段。
图11图示了根据本申请实施例的测距单元812的测距示意图。如图11所示，所述测距单元812包括投射器8121和接收器8122，所述投射器8121被配置为投射具有特定波长的检测信号至被摄目标，所述接收器8122被配置为接收自该被摄目标反射回的所述检测信号，并基于时间飞行法则确定所述测距模组与该被摄目标之间的距离。
具体地，当所述测距单元812通过超声波时间进行测距时，所述投射器8121向被摄目标投射超声波检测信号，超声波检测信号在空气中传播，碰到被摄目标后会被反射回来并被所述接收器8122接收到。相应地，计时器会计算从超声波发出到超声波被接收到所经历的时长，相应地，所述测距单元812与被摄目标之间的距离为S＝8340t/82，其中，S表示所述测距单元812与所述被摄目标之间的距离，t表示从超声波发出到超声波被接收到所经历的时长。
当所述测距单元812通过毫米雷达波进行测距时，所述投射器8121向被摄目标投射毫米波检测信号，其中，毫米波是指830～8300GHz频域(波长为81～810mm)的电磁波。由于毫米波在大气中衰减弱，所以可以探测感知到更远的距离，其中远距离雷达可以实现超过8200m的感知与探测。
当所述测距单元812通过激光雷达进行测距时，所述投射器8121向被摄目标投射一个激光脉冲检测信号，激光脉冲检测信号在空气中传播，碰到被摄目标后会被反射回来并被所述接收器8122接收到。相应地，计时器会计算从激光脉冲检测信号发出到激光脉冲检测信号被接收到所经历的时长，进而基于时长与激光脉冲检测信号的传播速度便能够获得所述测距单元812与所述被摄目标之间的距离。
应可以理解，在本申请实施例中，所述测距单元812为所述摄像模组装置810的一个集成部件，因此，所述测距单元812与被摄目标之间的距离即为所述摄像模组装置810与被摄目标之间的距离。
值得一提的是，所述测距单元812可以是上述多种类型的一种或多种组合构成，从而实现不同距离的测距，提高整体测距的精度。
优选地，在本申请实施例中，所述测距单元812被实施为TOF摄像单元812A，也就是，优选地，所述TOF摄像单元812A不仅通过时间飞行法则获得距离信息，还能够获得被测目标的图像数据(即，获得被摄目标的纹理信息)。
本领域普通技术人员应知晓，随着市场发展，终端设备尤其是智能手机后置TOF摄像单元812A逐渐得以应用，所述TOF摄像单元812A可以用以拍摄83D图像或其他应用。相应地，在本申请实施例中，所述TOF摄像单元812A所采集的距离信息被引入应用中。应可以理解，在现有的TOF摄像单元812A中，其主要功能在于采集被摄目标的纹理信息和深度信息，因此，其精度必须需要确保足够高，然而，在本申请实施例中，所述TOF摄像单元812A的主要功能在于提供距离信息，因此，其精度要求相对可以降低一些，以降低成本。值得注意的是，当在进行测距时可能投射功率会比较大，因此，需要确保人眼安全。
图12图示了根据本申请实施例的所述测距单元812被实施为TOF摄像单元812A的示意图。如图12所示，所述TOF摄像单元812A包括投射组件8121A和接收组件8122A，其中，所述投射组件8121A包括投射元件8123A、光学元件8124A、线路板8125A和支架8126A，所述投射元件8123A贴附于所述线路板8125A，所述光学元件8124A通过所述支架8126A被保持预所述投射元件8123A的投射路径上，对投射元件8123A投射出的检测信号进行光学处理；所述接收组件8122A被配置为接收来自被摄目标的检测信号，以基于时间飞行法则获得所述TOF摄像单元812A与被摄目标之间的距离。
进一步地，如图12所示，所述投射组件8121A进一步包括检测元件8127A，被配置为检测所述TOF摄像单元812A工作状态是否异常，例如，在本申请一示例中，所述检测元件8127A为PD元件(Photo-Diode，光电二极管)，用以检测所述投射元件8123A产生的投射信号的能量；当然，所述检测元件8127A也可以被实施为其他机构，用于检测所述投射元件8123A 是否正常。
进一步地，在本申请实施例中，所述投射元件8123A被实施为VCSEL激光投射器，且该VCSEL激光投射器分为多个区域，其中VCSEL投射包括多个激光投射点。举例但不限定，如图13所示，所述投射元件8123A被分为四个投射区域A、B、C、D，其中区域A的投射点阵数目小于其他区域投射点阵数，但是所述区域A的投射点阵能量大于其他区域点阵。相应地，所述区域A优选地用以投射实现测距，其他区域B、C、D由于投射点数量多，因此测量精度高适用于其他应用，例如获取深度信息。应可以理解，所述投射元件8123A的区域划分数量并不为本申请所局限，其划分结果仅需满足：存在至少一区域的点阵数目小于其他区域点阵数，并且，优选地，点阵数最多的区域为点阵数最少的区域83-810倍。
图14图示了根据本申请实施例的所述测距单元812被实施为TOF摄像单元812A的另一示意图。相较于图12所示意的TOF摄像单元812A，在该实施例中，所述投射组件8121A进一步包括设置于所述投射元件8123A和所述光学元件8124A之间的准直元件8129A，被配置为对所述投射元件8123A投射的检测信号进行整束。相应地，当所述投射元件8123A的投射区域被划分为多个区域的时候，所述准直单元在实现测距的时候对所产生的检测信号进行准直，使得检测信号的投射距离可以更远，从而能够降低投射所需功耗。优选地，所述投射元件8123A被实施为VCSEL激光投射器，所述VCSEL激光器的投射点所形成的图案是规则的。
值得注意的是，在本申请实施例中，当所述测距单元812被实施为所述TOF摄像单元时，也就是，所述摄像模组装置810被实施为多摄摄像模组时，所述摄像单元811与所述TOF摄像单元812A指的是所述摄像模组装置810中在结构上集成的两个摄像单元811，而不是指在结构上分离的摄像模块。具体地，在所述摄像模组装置810中，所述TOF摄像单元812A和所述摄像单元811可通过模塑等工艺整体成型以制成所述摄像模组装置810，且所述摄像模组装置810作为整体与其他外设设备，比如，图像处理器连接。
值得一提的是，在本申请实施例中，所述测距单元812还可以在所述摄像模组装置810的所述摄像单元811标定的标定过程中作为辅助测距工具使用，即，拍摄不同距离的景象，并进行烧录至所述摄像单元811。
进一步地，如图10所示，在本申请实施例中，所述摄像单元811的至 少一透镜组8112包括第一透镜组8114和第二透镜组8115，所述驱动组件8113包括第一驱动元件8117，所述第一驱动元件8117被配置为基于所述调整指令驱动所述第一透镜组8114中至少部分透镜以进行光学变焦。也就是，在本申请实施例中，所述第一驱动元件8117为变焦驱动器，其用于驱动所述第一透镜组8114中至少部分透镜移动以进行光学变焦。
如图10所示，在本申请实施例中，所述摄像单元811的驱动组件8113还包括第二驱动元件8118，所述第二驱动元件8118被配置为基于所述调整指令驱动所述第二透镜组8115以进行光学对焦和/或进行补偿。也就是，在本申请实施例中，所述摄像单元811进一步具有对焦功能，所述第二驱动元件8118为对焦驱动器。应可以理解，在通过所述第一驱动元件8117进行光学变焦后，所述第二驱动器能驱动所述第二透镜组8115移动以补充光学变焦后带来的影响，以提高成像质量。
值得一提的是，在本申请其他示例中，所述第一驱动元件8117和所述第二驱动元件8118可被实施为同一驱动器(即，变焦驱动器和对焦驱动器被实施为同一驱动器)，或者，所述第一驱动元件8117和所述第二驱动元件8118具有一体式结构，对此，并不为本申请所局限。
应可以理解，在本申请实施例中，所述至少一透镜组8112还可以包括更多数量的透镜组，例如，还包括第三透镜组8116，所述第三透镜组8116的位置固定作为固定透镜组，对此，并不为本申请所局限。
也值得一提的是，对于某些终端设备(例如，智能手机)而言，对于摄像模组装置810的厚度有要求，即，需要确保摄像模组装置810的厚度小于某一值。相应地，在本申请其他示例中，所述摄像单元811可被实施为潜望式摄像单元811，相应地，在这些示例中，所述摄像单元811进一步包括被设置于所述感光芯片8111的感光路径上用于转折成像光线的反射元件8119。
为了进一步地提高所述摄像单元811的成像性能，在本申请一些示例中，所述摄像单元811还被配置有光学防抖功能。例如，在本申请一些示例中，所述摄像单元811进一步包括被设置于所述感光芯片8111的感光路径上用于转折成像光线的反射元件8119；或者，所述驱动组件8113进一步包括用于驱动所述第一透镜组8114和/或所述第二透镜组8115以进行光学防抖的防抖机构，从而弥补由于拍摄者手抖带来的误差。
综上，基于本申请实施例的摄像模组装置810被阐明，所述摄像模组装 置810的结构配置使得所述摄像模组装置810能够基于其与被摄目标之间的距离进行自动光学变焦，以提供更好的拍摄体验。
为了说明所述摄像模组装置810如何进行自动光学变焦(即，所述摄像单元811如何进行自动光学变焦)，以下对适用于所述摄像模组装置810的自动变焦成像方法进行说明。
示意性自动变焦成像方法
图15图示了根据本申请实施例的自动变焦成像方法的流程图。
如图15所示，根据本申请实施例的所述自动变焦成像方法，包括步骤：S8110，获取变焦指令；S8120，响应于所述变焦指令，获取摄像模组装置810与被摄目标之间的距离，所述摄像模组装置810包括摄像单元811；S8130，基于所述距离，生成调整指令，所述调整指令用于驱动所述摄像单元811的驱动组件8113以带动所述摄像单元811的至少一透镜组8112中至少部分透镜以进行光学变焦；以及，S8140，获得在进行光学变焦后所述摄像单元811采集的该被摄目标的图像。
在步骤S8110中，获取变焦指令。在本申请实施例中，所述变焦指令包括但不限于单击屏幕中显示的被摄目标、双击屏幕中显示的被摄目标、双手伸缩屏幕中显示的被摄目标等。应可以理解，所述变焦指令可基于使用者的需求提前设定，并且，不能与其他指令设定相冲突。
在步骤S8120中，响应于所述变焦指令，获取摄像模组装置810与被摄目标之间的距离，所述摄像模组装置810包括摄像单元811。
在本申请一示例中，响应于所述变焦指令，获取摄像模组装置810与被摄目标之间的距的过程，包括：所述测距单元812的投射器8121投射一检测信号于被摄目标；接着，接收自该被摄目标反射回的所述检测信号；然后，基于时间飞行法则，确定所述测距模组与所述被摄目标之间的距离，其中，所述测距模组与所述被摄目标之间的距离被设定为所述摄像模组装置810与被摄目标之间的距离。
在本申请实施例中，所述检测信号包括但不限于毫米波检测信号、超声波检测信号、激光脉冲检测信号。
优选地，在本申请实施例中，所述测距单元812被实施为TOF摄像单元812A。
当所述测距单元812被实施为TOF摄像单元812A时，所述TOF摄像单元812A所投射的检测信号为激光脉冲，对人眼而言存在一定的安全隐患。相应地，在所述TOF摄像单元812A进行测距之前，所述自动对焦成像方法进一步包括：通过所述TOF摄像单元812A采集被摄目标的图像；对所述图像进行分析，以确定所述图像的内容中是否包含人眼；响应于所述图像的内容中包含人眼，则延迟测距，如无则开始测距。
同样可行的是，在本申请另一实施例中，所述自动对焦成像方法进一步包括：响应于所述图像的内容中包含人眼，通过所述TOF摄像单元812A的具有相对较小投射能量的区域来投射检测信号，以进行测距。也就是，在该示例中，所述TOF摄像单元812A的投射区域包含多个区域，其中，部分区域产生的投射光束的能量较小。也就是，当所述图像中包含人眼时，采取能量较小的区域进行投射光束实现测距。
在步骤S8130中，基于所述距离，生成调整指令，所述调整指令用于驱动所述摄像单元811的驱动组件8113以带动所述摄像单元811的至少一透镜组8112中至少部分透镜以进行光学变焦。
具体地，在本申请实施例中，所述调整指令用于驱动所述驱动组件8113的第一驱动元件8117，以带动所述至少一透镜组8112的第一透镜组8114中至少部分透镜以进行光学变焦；并且，所述调整指令进一步用于驱动所述驱动组件8113的第二驱动元件8118，以带动所述至少一透镜组8112的第二透镜组8115以进行光学对焦。
也就是，在本申请实施例中，在通过所述第一驱动元件8117进行光学变焦后，通过所述第二驱动元件8118进行光学对焦，以实现补偿，提高所述摄像单元811在变焦之后的成像质量。
在步骤S8140中，获得在进行光学变焦后所述摄像单元811采集的该被摄目标的图像。也就是，在进行光学变焦后，通过变焦后的所述摄像单元811采集被摄目标的图像。
综上，基于本申请实施例的适用于上述摄像模组装置810的自动对焦成像方法被阐明，其基于所述摄像模组装置810的结构配置得以实施，以提高拍摄者的拍摄体验。
具体地，所述自动变焦成像方法可应用于图像拍摄，也可用于视频拍摄。在进行图像拍摄时，所述摄像模组装置810(或者说，所述电子设备)通常 保持于禁止状态，此时，拍摄者通过发出变焦指令，带起完成自动变焦后，便可完整图像拍摄。
当所述自动对焦成像方法被应用于视频拍摄时，在拍摄过程中，被摄目标可能发生移动，并且，该移动可能是不规则的。为了更好地满足视频拍摄的需求，在实际应用中，拍摄者可通过如下方式来拍摄：
1、拍摄者不移动电子设备，所述摄像模组装置810整体被驱动器驱动，以实现跟踪拍摄，如图18所示；
2、拍摄者不移动电子设备，所述摄像模组装置810相对于所述电子设备同样保持静止，所述摄像单元811的反射单元被移动以实现跟踪拍摄，如图19所示；
3、拍摄者不移动电子设备，所述摄像模组装置810相对于所述电子设备同样保持静止，所述摄像单元811的反射单元被转动以实现跟踪拍摄，如图20所示。
相应地，在本申请实施例中，所述自动变焦成像方法，可进一步包括：基于被摄目标的运动轨迹，移动所述摄像模组装置810，以使得该被摄目标始终位于所述摄像模组装置810的拍摄视窗内。
相应地，在本申请实施例中，所述自动变焦成像方法，可进一步包括：基于被摄目标的运动轨迹，移动所述摄像单元811的反射元件8119。
相应地，相应地，在本申请实施例中，所述自动变焦成像方法，可进一步包括：基于被摄目标的运动轨迹，转动所述摄像单元811的反射元件8119。
基于如上所述的方法在进行视频拍摄的过程中，能够跟随着物体的前后移动，调整所需的变焦倍数，实现被摄目标在图像中显示的尺寸大小，或者位置不变，以提升拍摄体验。
示意性摄像系统
根据本申请另一方面，还提供一种摄像系统。
图16图示了根据本申请实施例的所述摄像系统的示意图。
如图16所示，所述摄像系统830包括如上所述的摄像模组装置810以及可通信地连接于所述摄像模组装置810的处理器820，其中，所述处理器820被配置为基于所述摄像模组装置810相对于被摄目标的距离生成调整指令。相应地，所述摄像单元811的驱动组件8113在接收到所述调整指令后， 驱动所述至少一透镜组8112中至少部分透镜以进行光学变焦，通过这样的方式，所述摄像系统830实现自动变焦拍摄功能。
示意性电子设备
根据本申请另一方面，还提供一种电子设备。
图17图示了根据本申请实施例的电子设备的立体示意图。
如图17所示，根据本申请实施例的所述电子设备8100包括电子设备8100主体和被组装于所述电子设备主体8101的如上所述的摄像模组装置810。在具体实施中，所述摄像模组装置810优选地被配置于所述电子设备主体8101的背面，以被配置为后置摄像模组，当然，其也可被配置为所述电子设备主体8101的前面，以被配置为前置摄像模组。
如图17所示，在本申请实施例中，所述电子设备主体8101包括屏幕和集成电路，其中，所述屏幕可用于显示所述摄像模组装置810所采集的图像数据，所述集成电路可用于处理所述摄像模组装置810所采集的图像数据，以控制所述摄像模组装置810实现自动变焦拍摄功能。
本领域的技术人员应理解，上述描述及附图中所示的本发明的实施例只作为举例而并不限制本发明。本发明的目的已经完整并有效地实现。本发明的功能及结构原理已在实施例中展示和说明，在没有背离所述原理下，本发明的实施方式可以有任何变形或修改。

Claims (36)

  1. 一种多摄摄像模组，其特征在于，包括：
    第一摄像单元，包括感光芯片、位于所述感光芯片的感光路径上的至少一透镜组，以及，用于驱动所述至少一透镜组中至少部分透镜以进行光学变焦的驱动组件；以及
    第二摄像单元，与所述第一摄像单元之间具有预设的相对位置关系；
    其中，所述驱动组件被配置为基于调整指令驱动所述至少一透镜组中至少部分透镜以进行光学变焦，所述调整指令基于所述多摄摄像模组相对于被摄目标的距离生成，所述多摄摄像模组相对于被摄目标的距离至少部分地基于所述第一摄像单元采集的该被摄目标的第一图像、所述第二摄像单元采集的该被摄目标的第二图像，以及，所述第一摄像单元与所述第二摄像单元之间的相对位置关系计算获得。
  2. 根据权利要求1所述的多摄摄像模组，其中，所述至少一透镜组包括第一透镜组和第二透镜组，所述驱动组件包括第一驱动元件，所述第一驱动元件被配置为基于所述调整指令驱动所述第一透镜组中至少部分透镜以进行光学变焦。
  3. 根据权利要求2所述的多摄摄像模组，其中，所述驱动组件进一步包括第二驱动元件，所述第二驱动元件被配置为基于所述调整指令驱动所述第二透镜组。
  4. 根据权利要求1所述的多摄摄像模组，其中，所述第一摄像单元进一步包括被设置于所述感光芯片的感光路径上用于转折成像光线的反射元件。
  5. 根据权利要求4所述的多摄摄像模组，其中，所述驱动组件进一步包括用于驱动所述反射元件以进行光学防抖的防抖机构。
  6. 根据权利要求2所述的多摄摄像模组，其中，所述驱动组件进一步 包括用于驱动所述第一透镜组和/或所述第二透镜组以进行光学防抖的防抖机构。
  7. 根据权利要求1所述的多摄摄像模组，进一步包括第三摄像单元，与所述第一摄像单元之间具有预设位置关系，所述第三摄像单元的第三等效焦距大于所述第二摄像单元的第二等效焦距，其中，当至少部分地基于所述第一摄像单元采集的该被摄目标的第一图像、所述第二摄像单元采集的该被摄目标的第二图像，以及，所述第一摄像单元与所述第二摄像单元之间的相对位置关系获得的所述多摄摄像模组相对于所述被摄目标的距离超过预设阈值时，所述调整指令基于所述多摄摄像模组相对于被摄目标的第二距离生成，其中，所述第二距离至少部分地基于所述第一摄像单元采集的该被摄目标的第一图像、所述第三摄像单元采集的该被摄目标的第三图像，以及，所述第一摄像单元与所述第三摄像单元之间的相对位置关系计算获得。
  8. 一种摄像系统，其特征在于，包括：
    如权利要求1至7任一所述的多摄摄像模组；以及
    可通信地连接连接于所述多摄摄像模组的处理器，其中，所述处理器被配置为基于所述多摄摄像模组相对于被摄目标的距离生成调整指令。
  9. 根据权利要求8所述的摄像系统，其中，所述处理器进一步被配置为融合在进行光学变焦后所述第一摄像模组采集的该被摄目标的第一图像和所述第二摄像模组采集的该被摄目标的第二图像，以获得该被摄目标的融合图像；或者，融合在进行光学变焦后所述第一摄像模组采集的该被摄目标的第一图像和所述第三摄像模组采集的该被摄目标的第三图像，以获得该被摄目标的融合图像。
  10. 一种电子设备，其特征在于，包括根据权利要求1-7任一所述的多摄摄像模组。
  11. 一种自动变焦成像方法，其特征在于，包括：
    获取变焦指令；
    响应于所述变焦指令，获取多摄摄像模组与被摄目标之间的距离，所述多摄摄像模组包括第一摄像单元；
    基于所述距离，生成调整指令，所述调整指令用于驱动所述第一摄像单元的驱动组件以带动所述第一摄像单元的至少一透镜组中至少部分透镜以进行光学变焦；以及
    融合在进行光学变焦后所述第一摄像单元采集的该被摄目标的第一图像和所述多摄摄像模组的其他摄像单元采集的该被摄目标的图像以获得融合图像。
  12. 根据权利要求11所述的自动变焦成像方法，其中，响应于所述变焦指令，获取多摄摄像模组与被摄目标之间的距离，包括：
    通过所述第一摄像单元获得该被摄目标的第一图像；
    通过所述第二摄像单元获得该被摄目标的第二图像；以及
    至少部分地基于所述第一图像、所述第二图像，以及，所述第一摄像单元与所述第二摄像单元之间的相对位置关系，获得所述多摄摄像模组与该被摄目标之间的第一距离，其中，所述第一距离为所述多摄摄像模组与被摄目标之间的距离。
  13. 根据权利要求12所述的自动变焦成像方法，其中，在通过所述第一摄像单元获得该被摄目标的第一图像之前，还包括：
    预驱动所述第一摄像单元的驱动组件以带动所述第一摄像单元的至少一透镜组中至少部分透镜以进行光学变焦。
  14. 根据权利要求12所述的自动变焦成像方法，其中，响应于所述变焦指令，获取所述多摄摄像模组与被摄目标之间的距离，进一步包括：
    响应于所述第一距离大于预设阈值时，启动所述多摄摄像模组的第三摄像单元以通过第三摄像单元获得该被摄目标的第三图像，所述第三摄像单元的第三等效焦距大于所述第二摄像单元的第二等效焦距；以及
    至少部分地基于所述第一图像、所述第三图像，以及，所述第一摄像单元与所述第三摄像单元之间的相对位置关系，获得所述多摄摄像模组与该被摄目标之间的第二距离，其中，所述第二距离为所述多摄摄像模组与被摄目 标之间的距离。
  15. 根据权利要求12至14任一所述的自动变焦成像方法，其中，所述调整指令进一步用于驱动所述驱动组件的第一驱动元件，以带动所述至少一透镜组的第一透镜组中至少部分透镜以进行光学变焦。
  16. 根据权利要求15所述的自动变焦成像方法，其中，所述调整指令进一步用于驱动所述驱动组件的第二驱动元件，以带动所述至少一透镜组的第二透镜组以进行光学对焦和/或补偿。
  17. 根据权利要求12所述的自动变焦成像方法，其中，融合在进行光学变焦后所述第一摄像单元采集的该被摄目标的第一图像和所述多摄摄像模组的其他摄像单元采集的该被摄目标的图像以获得融合图像，包括：
    融合在进行光学变焦后所述第一摄像单元采集的该被摄目标的第一图像和所述第二摄像单元采集的该被摄目标的第二图像，以获得融合图像。
  18. 根据权利要求14所述的自动变焦成像方法，其中，融合在进行光学变焦后所述第一摄像单元采集的该被摄目标的第一图像和所述多摄摄像模组的其他摄像单元采集的该被摄目标的图像以获得融合图像，包括：
    融合在进行光学变焦后所述第一摄像单元采集的该被摄目标的第一图像和所述第三摄像单元采集的该被摄目标的第三图像，以获得融合图像。
  19. 根据权利要求11所述的自动变焦成像方法，进一步包括：
    基于被摄目标的运动轨迹，移动所述多摄摄像模组，以使得该被摄目标始终位于所述多摄摄像模组的拍摄视窗内。
  20. 根据权利要求11所述的自动变焦成像方法，进一步包括：
    基于被摄目标的运动轨迹，移动和/或转动所述第一摄像单元的反射元件。
  21. 一种摄像模组装置，其特征在于，包括：
    摄像单元，包括感光芯片、位于所述感光芯片的感光路径上的至少一透 镜组和用于驱动所述至少一透镜组中至少部分透镜以进行光学变焦的驱动组件；以及
    测距单元；
    其中，所述驱动组件被配置为基于调整指令驱动所述至少一透镜组中至少部分透镜以进行光学变焦，所述调整指令基于所述摄像模组装置相对于被摄目标的距离生成，所述摄像模组装置相对于被摄目标的距离由所述测距单元测得。
  22. 根据权利要求21所述的摄像模组装置，其中，所述至少一透镜组包括第一透镜组和第二透镜组，所述驱动组件包括第一驱动元件，所述第一驱动元件被配置为基于所述调整指令驱动所述第一透镜组中至少部分透镜以进行光学变焦。
  23. 根据权利要求22所述的摄像模组装置，其中，所述驱动组件进一步包括第二驱动元件，所述第二驱动元件被配置为基于所述调整指令驱动所述第二透镜组以进行光学对焦。
  24. 根据权利要求21所述的摄像模组装置，其中，所述摄像单元进一步包括被设置于所述感光芯片的感光路径上用于转折成像光线的反射元件。
  25. 根据权利要求24所述的摄像模组装置，其中，所述驱动组件进一步包括用于驱动所述反射元件以进行光学防抖的防抖机构。
  26. 根据权利要求22所述的摄像模组装置，其中，所述驱动组件进一步包括用于驱动所述第一透镜组和/或所述第二透镜组以进行光学防抖的防抖机构。
  27. 根据权利要求21所述的摄像模组装置，其中，所述测距单元包括投射器和接收器，所述投射器被配置为投射具有特定波长的检测信号至被摄目标，所述接收器被配置为接收自该被摄目标反射回的所述检测信号，并基于时间飞行法则确定所述测距模组与该被摄目标之间的距离。
  28. 根据权利要求21所述的摄像模组装置，其中，所述测距单元被实施为TOF摄像单元，以通过所述TOF摄像单元采集所述摄像模组装置与被摄目标之间的距离。
  29. 一种摄像系统，其特征在于，包括：
    如权利要求21至28任一所述的摄像模组装置；以及
    可通信地连接连接于所述摄像模组装置的处理器，其中，所述处理器被配置为基于所述摄像模组装置相对于被摄目标的距离生成调整指令。
  30. 一种电子设备，其特征在于，包括根据权利要求21-28任一所述的摄像模组装置。
  31. 一种自动变焦成像方法，其特征在于，包括：
    获取变焦指令；
    响应于所述变焦指令，通过测距模组获取摄像模组装置与被摄目标之间的距离；
    基于所述距离，生成调整指令，所述调整指令用于驱动所述摄像单元的驱动组件以带动所述摄像单元的至少一透镜组中至少部分透镜以进行光学变焦；以及
    获得在进行光学变焦后所述摄像单元采集的该被摄目标的图像。
  32. 根据权利要求31所述的自动变焦成像方法，其中，响应于所述变焦指令，通过测距模组获取摄像模组装置与被摄目标之间的距离，包括：
    投射一检测信号于被摄目标；
    接收自该被摄目标反射回的所述检测信号；以及
    基于时间飞行法则，确定所述测距模组与所述被摄目标之间的距离，其中，所述测距模组与所述被摄目标之间的距离被设定为所述摄像模组装置与被摄目标之间的距离。
  33. 根据权利要求31所述的自动变焦成像方法，其中，所述调整指令 进一步用于驱动所述驱动组件的第一驱动元件，以带动所述至少一透镜组的第一透镜组中至少部分透镜以进行光学变焦。
  34. 根据权利要求33所述的自动变焦成像方法，其中，所述调整指令进一步用于驱动所述驱动组件的第二驱动元件，以带动所述至少一透镜组的第二透镜组以进行光学对焦。
  35. 根据权利要求31所述的自动变焦成像方法，进一步包括：
    基于被摄目标的运动轨迹，移动所述摄像模组装置，以使得该被摄目标始终位于所述摄像模组装置的拍摄视窗内。
  36. 根据权利要求31所述的自动变焦成像方法，进一步包括：
    基于被摄目标的运动轨迹，移动和/或转动所述摄像单元的反射元件。
PCT/CN2021/109581 2020-07-30 2021-07-30 摄像模组装置、多摄摄像模组、摄像系统、电子设备和自动变焦成像方法 Ceased WO2022022682A1 (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202180060940.8A CN116250246B (zh) 2020-07-30 2021-07-30 摄像模组装置、多摄摄像模组、摄像系统、电子设备和自动变焦成像方法

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
CN202010751498.0A CN114070994B (zh) 2020-07-30 2020-07-30 摄像模组装置、摄像系统、电子设备和自动变焦成像方法
CN202010753090.7A CN114070997A (zh) 2020-07-30 2020-07-30 多摄摄像模组、摄像系统、电子设备和自动变焦成像方法
CN202010751498.0 2020-07-30
CN202010753090.7 2020-07-30

Publications (1)

Publication Number Publication Date
WO2022022682A1 true WO2022022682A1 (zh) 2022-02-03

Family

ID=80037659

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/109581 Ceased WO2022022682A1 (zh) 2020-07-30 2021-07-30 摄像模组装置、多摄摄像模组、摄像系统、电子设备和自动变焦成像方法

Country Status (2)

Country Link
CN (1) CN116250246B (zh)
WO (1) WO2022022682A1 (zh)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114598789A (zh) * 2022-03-02 2022-06-07 厦门聚视智创科技有限公司 一种虚拟现实图像采集用触发式变焦系统及其工作方法
CN116503488A (zh) * 2023-04-27 2023-07-28 信利光电股份有限公司 一种多工位摄像头标定工艺及标定机台

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103152517A (zh) * 2013-02-06 2013-06-12 北京中科虹霸科技有限公司 用于移动虹膜识别设备的成像模组及移动设备
CN103297573A (zh) * 2013-05-16 2013-09-11 董昊程 一种可实现光学变焦的手机摄像模块
CN103760660A (zh) * 2014-01-21 2014-04-30 武汉虹识技术有限公司 一种光学变焦、自动对焦镜头及方法
CN104717427A (zh) * 2015-03-06 2015-06-17 广东欧珀移动通信有限公司 一种自动变焦方法、装置和移动终端
US20150285631A1 (en) * 2013-03-13 2015-10-08 Panasonic Intellectual Property Management Co., Ltd. Distance measuring apparatus, imaging apparatus, and distance measuring method
CN205883405U (zh) * 2016-07-29 2017-01-11 深圳众思科技有限公司 一种自动追焦装置及终端
CN107659758A (zh) * 2017-09-26 2018-02-02 努比亚技术有限公司 潜望式拍摄装置及移动终端
CN209030296U (zh) * 2018-12-19 2019-06-25 信利光电股份有限公司 一种摄像头模组
US20200099864A1 (en) * 2017-01-26 2020-03-26 Sony Olympus Medical Solutions Inc. Medical observation apparatus and control method
CN210839753U (zh) * 2019-11-13 2020-06-23 晋城三赢精密电子有限公司 潜望式变焦摄像模组

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN207321438U (zh) * 2017-07-26 2018-05-04 浙江树人学院 一种远距离移动目标防伪人脸虹膜抓拍装置
CN107343174A (zh) * 2017-07-26 2017-11-10 浙江树人学院 远距离移动目标防伪人脸虹膜抓拍装置及方法
CN109639974A (zh) * 2018-12-20 2019-04-16 Oppo广东移动通信有限公司 控制方法、控制装置、电子装置及介质
CN110381256B (zh) * 2019-07-31 2021-02-19 维沃移动通信（杭州）有限公司 终端设备及其控制方法和控制装置、计算机可读存储介质

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103152517A (zh) * 2013-02-06 2013-06-12 北京中科虹霸科技有限公司 用于移动虹膜识别设备的成像模组及移动设备
US20150285631A1 (en) * 2013-03-13 2015-10-08 Panasonic Intellectual Property Management Co., Ltd. Distance measuring apparatus, imaging apparatus, and distance measuring method
CN103297573A (zh) * 2013-05-16 2013-09-11 董昊程 一种可实现光学变焦的手机摄像模块
CN103760660A (zh) * 2014-01-21 2014-04-30 武汉虹识技术有限公司 一种光学变焦、自动对焦镜头及方法
CN104717427A (zh) * 2015-03-06 2015-06-17 广东欧珀移动通信有限公司 一种自动变焦方法、装置和移动终端
CN205883405U (zh) * 2016-07-29 2017-01-11 深圳众思科技有限公司 一种自动追焦装置及终端
US20200099864A1 (en) * 2017-01-26 2020-03-26 Sony Olympus Medical Solutions Inc. Medical observation apparatus and control method
CN107659758A (zh) * 2017-09-26 2018-02-02 努比亚技术有限公司 潜望式拍摄装置及移动终端
CN209030296U (zh) * 2018-12-19 2019-06-25 信利光电股份有限公司 一种摄像头模组
CN210839753U (zh) * 2019-11-13 2020-06-23 晋城三赢精密电子有限公司 潜望式变焦摄像模组

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114598789A (zh) * 2022-03-02 2022-06-07 厦门聚视智创科技有限公司 一种虚拟现实图像采集用触发式变焦系统及其工作方法
CN116503488A (zh) * 2023-04-27 2023-07-28 信利光电股份有限公司 一种多工位摄像头标定工艺及标定机台

Also Published As

Publication number Publication date
CN116250246A8 (zh) 2024-05-31
CN116250246A (zh) 2023-06-09
CN116250246B (zh) 2026-03-27

Similar Documents

Publication Publication Date Title
US8446519B2 (en) Focus control apparatus and optical apparatus
US12301996B2 (en) Optical image stabilization apparatus and control method based on reflector rotations
TWI471630B (zh) 主動式距離對焦系統及方法
CN108833795B (zh) 一种图像获取设备的对焦方法及装置
CN103475805A (zh) 主动式距离对焦系统及方法
US11240421B2 (en) Methods and apparatus for defocus reduction using laser autofocus
CN108156371B (zh) 一种红外自动对焦快速搜索方法
CN103945133A (zh) 一种可见光镜头的自动聚焦装置及方法
WO2017028652A1 (zh) 一种镜头、摄像机、包裹检测系统和图像处理方法
CN103852954B (zh) 一种实现相位对焦的方法
CN116250246B (zh) 摄像模组装置、多摄摄像模组、摄像系统、电子设备和自动变焦成像方法
CN114070994B (zh) 摄像模组装置、摄像系统、电子设备和自动变焦成像方法
JP2001141982A (ja) 電子カメラの自動焦点調節装置
JPH09211308A (ja) 自動焦点撮像装置の被写体検出機構
US7526190B2 (en) Automatic focusing apparatus and optical instrument including automatic focusing apparatus
JP2001141984A (ja) 電子カメラの自動焦点調節装置
JP5966299B2 (ja) 焦点検出装置およびそれを備えた撮像装置
JP2004109864A (ja) 撮像装置およびそれを有する撮像システム
JP2001141983A (ja) 電子カメラの自動焦点調節装置
CN114070997A (zh) 多摄摄像模组、摄像系统、电子设备和自动变焦成像方法
JP2006215398A (ja) 撮像装置
CN103852955B (zh) 一种实现相位对焦的装置
JP2001141986A (ja) 電子カメラ及び電子カメラの自動焦点調節装置
CN119402636A (zh) 红外图像延迟测试系统及方法
KR100573578B1 (ko) 이안 반사식 카메라의 초점 확인 장치

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21848864

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 202180060940.8

Country of ref document: CN

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21848864

Country of ref document: EP

Kind code of ref document: A1