WO2021092846A1 - Zoom tracking method and system, lens, imaging apparatus and unmanned aerial vehicle - Google Patents

Zoom tracking method and system, lens, imaging apparatus and unmanned aerial vehicle Download PDF

Info

Publication number
WO2021092846A1
WO2021092846A1 PCT/CN2019/118431 CN2019118431W WO2021092846A1 WO 2021092846 A1 WO2021092846 A1 WO 2021092846A1 CN 2019118431 W CN2019118431 W CN 2019118431W WO 2021092846 A1 WO2021092846 A1 WO 2021092846A1
Authority
WO
WIPO (PCT)
Prior art keywords
zoom
focus
lens
distance
zoom position
Prior art date
Application number
PCT/CN2019/118431
Other languages
French (fr)
Chinese (zh)
Inventor
韩守谦
潘子逸
Original Assignee
深圳市大疆创新科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳市大疆创新科技有限公司 filed Critical 深圳市大疆创新科技有限公司
Priority to CN201980040403.XA priority Critical patent/CN112313940A/en
Priority to PCT/CN2019/118431 priority patent/WO2021092846A1/en
Publication of WO2021092846A1 publication Critical patent/WO2021092846A1/en

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/67Focus control based on electronic image sensor signals
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/67Focus control based on electronic image sensor signals
    • H04N23/675Focus control based on electronic image sensor signals comprising setting of focusing regions

Definitions

  • the present disclosure relates to the field of camera technology, and in particular to a zoom tracking method and system, a lens, an imaging device, and an unmanned aerial vehicle.
  • the focal length of the imaging device can be adjusted according to different subjects.
  • zoom tracking technology In order to maintain focus during zooming, zoom tracking technology has emerged.
  • the focus position can be changed according to the change of the focal length during the zooming process to achieve the purpose of maintaining a clear image of the subject.
  • the proportional mapping method is an existing zoom tracking technology.
  • the present disclosure provides a zoom tracking method, including:
  • the zoom lens passes through multiple zoom positions during the zooming process, and performs the following operations at each of the zoom positions:
  • the focusing lens moves to the focusing position corresponding to the image distance.
  • the present disclosure also provides a zoom tracking system, including:
  • the zoom lens passes through multiple zoom positions during the zooming process
  • the distance measuring unit is used to measure the object distance of the imaging object in real time during the zooming process
  • a processing unit configured to perform the following operations at each of the zoom positions: obtain the image distance at the zoom position according to the focal length corresponding to the zoom position, the object distance measured in real time, and an imaging formula;
  • the focusing lens is used to move to the focusing position corresponding to the image distance.
  • the present disclosure also provides a lens including: the above-mentioned zoom tracking system.
  • the present disclosure also provides an imaging device, including an imaging device body and the above-mentioned lens, and the lens is fixedly or detachably mounted on the imaging device body.
  • the present disclosure also provides an unmanned aerial vehicle, including: an unmanned aerial vehicle body, a power device, and the above-mentioned imaging device.
  • the present disclosure can obtain the image distance and focus position at the zoom position according to the focal length, the object distance and the imaging formula, which eliminates the error magnification problem of the isometric mapping method; and is also effective for high-magnification zoom lenses; when the object distance occurs
  • the precise focus position can still be obtained when changing, which is suitable for scenes where the object distance changes.
  • Figure 1 shows the zoom tracking curve
  • Figure 2 is a schematic diagram of the error magnification of the isometric mapping method.
  • Figure 3 shows the object distance range of a high-magnification zoom lens at different focal lengths.
  • FIG. 4 is a flowchart of a zoom tracking method according to an embodiment of the disclosure.
  • Figure 5 shows the change in the position of the zoom lens during zooming.
  • Figure 6 shows the change in the position of the focus lens during zooming.
  • FIG. 7 is a flowchart of the focus lens moving to the focus position corresponding to the image distance in the zoom tracking method according to the embodiment of the disclosure.
  • FIG. 8 is a schematic structural diagram of a zoom tracking system according to an embodiment of the disclosure.
  • FIG. 9 is a schematic structural diagram of an imaging device according to an embodiment of the disclosure.
  • FIG. 10 is a schematic structural diagram of an unmanned aerial vehicle according to an embodiment of the disclosure.
  • the proportional mapping method is a method of mapping the focus position of the current focal length to the focal position of the target focal length based on the zoom tracking curve and the principle of proportional mapping.
  • the zoom tracking curve is a curve representing the relationship between the zoom position of the zoom lens and the diagonal position of the focus lens under different object distances.
  • Figure 1 shows an example of a zoom tracking curve.
  • the zoom tracking curve includes a curve 400 corresponding to the infinity end, a curve 402 corresponding to the nearest end, and curves corresponding to various object distances between the infinity end and the nearest end.
  • the corresponding current focus position is P1.
  • the distance between the current focus position P1 and the nearest end curve 402 is b
  • the distance between the infinity end curve 400 and the nearest end curve 402 at the current zoom position is a+b, and thus the ratio b/ of the current focus position P1 is obtained. (a+b).
  • the distance between the infinite end curve 400 and the closest end curve 402 is a'+b'.
  • the position P2 where the distance from the closest curve 402 is b'and the ratio of b'to the distance a'+b' is equal to b/(a+b) is taken as the target focus position.
  • the numerical range of the image distance expands as the focal length increases.
  • the stroke of the focus motor is n
  • the stroke of the focus motor is 2 ⁇ n.
  • the focus motor has a total of 5 steps in the wide end and 10 steps in the tele end. If the focus position of the wide end (ie the ideal focus position) is at step 4.5, the actual focus position of the focus motor is at step 4. Step or Step 5, that is, the error between the actual focus position and the ideal focus position is 0.5 step.
  • the actual focus position of the focus motor is the 8th or 10th step
  • the error between the 9th step and the ideal focus position of the tele end is 1 step, so the focus position error
  • the magnification is doubled (from 0.5 step to 1 step). If it is a 6x zoom lens, as shown in Figure 2, the error will be magnified six times for similar reasons. For high magnification zoom lenses of ten times or tens of times, the error will also be magnified by the corresponding magnification. Therefore, the isometric mapping method has the disadvantage of amplifying errors.
  • Figure 3 shows a lens with a wide end of the closest focusing distance of 0.5m, a hyperfocal distance of 4m, and a tele end of the lens with a shortest focusing distance of 10m and a hyperfocal distance of 1000m. If the lens of FIG. 3 images a subject with an object distance of 8 m at the wide end, the object distance of 8 m corresponds to the infinite end curve 400 in FIG. 1. According to the proportional projection method, after zooming to the tele end, the target focus position is still a point on the infinity end curve 400.
  • the isometric mapping method cannot obtain the correct target focus position and is completely ineffective.
  • the isometric mapping method In addition, if the subject and the lens move relative to each other during the zooming process, and the object distance changes, it is difficult for the isometric mapping method to ensure that the focus is maintained during the zooming process, that is, the isometric projection method is not suitable for scenes with varying object distances. At the same time, the proportional projection method also requires the lens to be in focus before zooming, which depends on the focus state before zooming.
  • the equal-proportion projection method has the defects of magnification errors, failure of high-magnification zoom lenses, unsuitable scenes with varying object distances, and dependence on the focus state before zooming.
  • the present disclosure provides a zoom tracking method and a zoom tracking system, as well as a lens, an imaging device and an unmanned aerial vehicle including the zoom tracking system.
  • the zoom tracking method and zoom tracking system of the present disclosure have high accuracy and strong adaptability, and do not have the problem of magnification errors, are suitable for high-magnification zoomable lenses and scenes with varying object distances, and do not rely on the focus state before zooming.
  • the zoom tracking method of an embodiment of the present disclosure includes:
  • Step S101 Perform a zooming process, during which the object distance of the imaging object is measured in real time.
  • Step S102 The zoom lens passes through multiple zoom positions during the zooming process, and performs the following operations at each of the zoom positions:
  • the image distance at the zoom position is obtained according to the focal length corresponding to the zoom position, the object distance measured in real time, and an imaging formula.
  • the focusing lens moves to the focusing position corresponding to the image distance.
  • the zoom tracking method of this embodiment is for a zoom lens.
  • the zoomable lens includes a zoom lens and a focus lens, and a zoom lens drive unit and a focus lens drive unit for driving the zoom lens and the focus lens, respectively. Driven by the zoom lens drive unit and the focus lens drive unit, the zoom lens and the focus lens can move along the axis of the lens.
  • the zooming process of this embodiment will be described below.
  • the target focal length is usually input by the user, and the corresponding target zoom position can be obtained after receiving the target focal length.
  • the current zoom position of the zoom lens is used as the starting zoom position, and the zoom lens driving unit drives the zoom lens to move from the starting zoom position to the target zoom position along the axis of the lens.
  • the zoom lens usually passes through at least one intermediate zoom position, and these intermediate zoom positions are located between the initial zoom position and the target zoom position.
  • the zoom lens first moves from the initial zoom position to the first zoom position, then from the first zoom position to the second zoom position, and so on, and finally moves to the target zoom position.
  • This embodiment does not limit the number of intermediate zoom positions, and the number is generally determined according to the zoom range, that is, the distance between the initial zoom position and the target zoom position.
  • the zoom change amount between the next zoom position and the previous zoom position is obtained, and the zoom lens moves by the zoom change amount to reach the next zoom position.
  • Figure 5 when the zoom lens is moved from the first zoom position to the second zoom position, first obtain the zoom change amount between the second zoom position and the first zoom position, and the zoom lens can move to the second zoom position by moving the zoom change amount .
  • each zoom position is reached through the above-mentioned method.
  • the object distance of the shooting object may be fixed or may change, for example, at least one of the shooting object and the shooting device has moved. In this case, the object distances of the various zoom positions are not equal.
  • the focus lens drive unit drives the focus lens to move to the focus position, so that the focus lens is in the closed position at the zoom position. Focus state, and then the zoom lens moves to the next zoom position. Repeat the above process until the zoom lens moves to the target zoom position. At this time, the focus lens is also in focus at the target zoom position, and the entire zoom process is completed. For example, in FIG. 6, the focus lens first moves to the first focus position, and then moves from the first focus position to the second focus position, and so on, and finally moves to the target focus position.
  • the current focus position is first obtained, and then the focus change amount between the next focus position and the current focus position is obtained.
  • the focus lens moves by the focus change amount to reach the next focus position.
  • the zoom process in this embodiment is a dynamic process.
  • the zoom lens moves one step, and the focus lens moves one step; then the zoom lens moves one more step, and the focus lens also moves one step, and so on until the target focus position is reached. In focus.
  • a distance measuring unit is provided on the lens or the imaging device on which the lens is installed.
  • the distance measuring unit measures the object distance of the subject in real time during the aforementioned zooming process.
  • the zoom lens can be at any zoom position. Get the corresponding object distance.
  • the object distance can be measured in any one or several of the following methods: monocular distance measurement, binocular distance measurement, laser distance measurement, TOF distance measurement, and structured light distance measurement. The foregoing is only an example, this embodiment does not limit the object distance measurement method, and it may also be any other type of method.
  • the following describes how to obtain the corresponding focus position at each zoom position after the initial zoom position, so that the focus lens is in focus at the zoom position.
  • step S102 at each zoom position, the image distance at the zoom position is obtained according to the focal length corresponding to the zoom position, the object distance measured in real time, and the imaging formula; the focus lens is moved to the corresponding image distance The focus position.
  • the imaging formula is a Gaussian imaging formula.
  • the Gaussian imaging formula is:
  • u is the object distance
  • v is the image distance
  • f is the focal length
  • the focal length f corresponding to the zoom position and the object distance u measured in real time are substituted into the above-mentioned Gaussian imaging formula to obtain the image distance at the zoom position.
  • the zoom lens moves to the first zoom position, assuming that the focal length corresponding to the first zoom position is f1, the measured object distance of the subject is u1. Substituting f1 and u1 into the Gaussian imaging formula can be obtained in the first zoom position. Image distance v1 at the zoom position. The same is true for other intermediate zoom positions. When the zoom lens moves to the target zoom position, the image distance at the target zoom position is obtained.
  • the zoom position and the focal length f have a fixed correspondence relationship, and this correspondence relationship is determined in advance and stored in the lens.
  • the zoom position can be obtained from a sensor set in the lens or a zoom lens drive unit. After the zoom position is obtained, the focal length f can be obtained through the corresponding relationship.
  • the image distance at the zoom position is obtained, the image distance is converted to a focus position, and the focus lens is moved to the focus position.
  • the image distance u1 at the first zoom position is obtained, the image distance u1 is converted to the first focus position, and the focus lens is moved to the first focus position, so that the focus lens is in focus.
  • the focus lens is moved to the target focus position so that the focus lens is in focus at the target zoom position.
  • the focus position and the image distance v Similar to the zoom position and the focal length f, the focus position and the image distance v also have a fixed correspondence relationship, which is determined in advance and stored in the lens. First, the focus position corresponding to the image distance v is obtained according to the corresponding relationship, and then the focus lens driving unit drives the focus lens to move to the focus position.
  • the image distance at the zoom position can be obtained in various ways.
  • the focal length corresponding to the zoom position and the object distance measured in real time can be directly substituted into the Gaussian imaging formula to calculate the image distance at the zoom position.
  • a correspondence table may be prepared in advance according to a Gaussian imaging formula, and the correspondence table reflects the numerical correspondence between the object distance, the focal length, and the image distance, and the correspondence table is stored in the lens.
  • the correspondence table is read from the lens, and the focal length corresponding to the zoom position and the image at the zoom position corresponding to the object distance measured in real time are found in the correspondence table by looking up the table. distance.
  • the image distance and focus position at the zoom position can be obtained only according to the focal length and the object distance, instead of focusing on the current focal length like the isometric mapping method.
  • the position is mapped to the focus position of the target focal length. Therefore, the error magnification problem of the isometric mapping method when zooming from the wide end to the tele end is fundamentally eliminated, and the zoom tracking accuracy is greatly improved.
  • accurate image distance and focus position can be obtained, so it is also effective for high-magnification zoom lenses.
  • the object distance of the subject may change.
  • the zoom tracking method of this embodiment measures the object distance in real time, and the image distance at the zoom position is obtained based on the real-time measurement value of the object distance, even if the object When the distance changes, the precise focus position can still be obtained, so it is suitable for scenes where the object distance changes. And when acquiring the image distance and focus position at the zoom position, it does not depend on the focus state of the zoom position before the zoom position, that is to say, the focus of the next zoom position can be obtained without focusing at the previous zoom position. The location is in focus. As shown in FIG. 6, when acquiring the first focus position, at the initial zoom position, there is no need to focus the focus lens. Therefore, the zoom tracking method of this embodiment has the advantages of small errors, high zoom tracking accuracy, suitable for high-magnification zoom lenses and scenes with varying object distances, and independent of the focus state before zooming.
  • the corresponding relationship between the focus position and the image distance v should remain unchanged.
  • the error introduced in the lens manufacturing process makes the correspondence between the focus position and the image distance v of different batches of lenses different.
  • the corresponding relationship between the focus position and the image distance v of the same lens will also change.
  • moving the focus lens to the focus position corresponding to the image distance includes the following steps:
  • Step S201 Correct the focus position corresponding to the image distance according to the calibration coefficient
  • Step S202 the focus lens is moved to the corrected focus position.
  • the calibration coefficient can be determined by calibrating the lens in advance and stored in the lens.
  • the calibration of the lens can be performed in the following manner. Firstly, multiple sets of focus positions and their corresponding image distances are actually measured, and the actually measured multiple sets of focus positions and their corresponding image distances can be fitted to obtain the actual corresponding relationship between the focus positions and the image distance v. Then, the calibration coefficient is obtained according to the difference between the actual corresponding relationship and the theoretical corresponding relationship.
  • the focus position corresponding to the image distance is corrected by using the calibration coefficient, the focus position will be more accurate, thereby further improving the accuracy of zoom tracking, and the imaging effect is clearer.
  • FIG. 8 Another embodiment of the present disclosure provides a zoom tracking system, as shown in FIG. 8, including: a zoom lens, a focus lens, a zoom lens drive unit, a focus lens drive unit, a zoom position sensor, a focus position sensor, a distance measuring unit, Processing unit and memory.
  • the zoom lens passes through multiple zoom positions during zooming.
  • the distance measuring unit is used to measure the object distance of the imaging object in real time during the zooming process.
  • the processing unit is configured to perform the following operations at each zoom position: obtain the image distance at the zoom position according to the focal length corresponding to the zoom position, the object distance measured in real time, and an imaging formula.
  • the focus lens moves to the focus position corresponding to the image distance.
  • the zoom tracking system When the zoom tracking system performs a zooming process, it first obtains the target zoom position of the zoom lens.
  • the target focal length is usually input by the user, and the corresponding target zoom position can be obtained after receiving the target focal length. Then, the current zoom position of the zoom lens is used as the starting zoom position, and the zoom lens driving unit drives the zoom lens to move from the starting zoom position to the target zoom position along the axis of the lens.
  • the zoom lens usually passes through at least one intermediate zoom position, and these intermediate zoom positions are located between the initial zoom position and the target zoom position.
  • This embodiment does not limit the number of intermediate zoom positions, and the number is generally determined according to the zoom range, that is, the distance between the initial zoom position and the target zoom position.
  • the zoom position sensor detects the next zoom position and the previous zoom position
  • the processing unit calculates the amount of zoom change between the next zoom position and the previous zoom position
  • the zoom lens drive unit drives the zoom lens Move the zoom change amount to reach the next zoom position.
  • the object distance of the shooting object may be fixed or may change, for example, at least one of the shooting object and the shooting device has moved. In this case, the object distances of the various zoom positions are not equal.
  • the focus lens drive unit drives the focus lens to move to the focus position, so that the focus lens is in the closed position at the zoom position. Focus state, and then the zoom lens moves to the next zoom position. Repeat the above process until the zoom lens moves to the target zoom position. At this time, the focus lens is also in focus at the target zoom position, and the entire zoom process is completed.
  • the focus position sensor obtains the current focus position and the next focus position
  • the processing unit calculates the focus change amount between the next focus position and the current focus position
  • the focus lens drive unit drives the focus lens to move the focus change amount. Can reach the next focus position.
  • the zoom process in this embodiment is a dynamic process.
  • the zoom lens moves one step, and the focus lens moves one step; then the zoom lens moves one more step, and the focus lens also moves one step, and so on until the target focus position is reached. In focus.
  • the distance measuring unit measures the object distance of the shooting object in real time during the above-mentioned zooming process, and the zoom lens can obtain the corresponding object distance at any zoom position.
  • the distance measuring unit of this embodiment may be one or more of the following: a monocular distance measuring camera, a binocular vision camera, a lidar, a TOF distance meter, and a structured light distance meter.
  • a monocular distance measuring camera a binocular vision camera
  • a lidar a TOF distance meter
  • a structured light distance meter a structured light distance meter
  • the following describes how to obtain the corresponding focus position at each zoom position after the initial zoom position, so that the focus lens is in focus at the zoom position.
  • the processing unit performs the following operations at each zoom position: obtaining the image distance at the zoom position according to the focal length corresponding to the zoom position, the object distance measured in real time, and the imaging formula.
  • the focus lens moves to the focus position corresponding to the image distance.
  • the imaging formula is a Gaussian imaging formula.
  • the Gaussian imaging formula is:
  • u is the object distance
  • v is the image distance
  • f is the focal length
  • the processing unit substitutes the focal length f corresponding to the zoom position and the object distance u measured in real time into the above-mentioned Gaussian imaging formula to obtain the image distance at the zoom position.
  • the processing unit substitutes f1 and u1 into the Gaussian imaging formula, namely The image distance v1 at the first zoom position can be obtained.
  • the zoom lens moves to the target zoom position, the image distance at the target zoom position is obtained.
  • the zoom position and the focal length f have a fixed correspondence relationship, and this correspondence relationship is determined in advance and stored in the memory. After the zoom position sensor detects the zoom position, the processing unit reads the corresponding relationship from the memory, and the focal length f can be obtained through the corresponding relationship.
  • the processing unit After obtaining the image distance at the zoom position, the processing unit converts the image distance into a focus position, and the focus lens driving unit moves the focus lens to the focus position. After the processing unit obtains the image distance at the target focus position, the focus lens driving unit moves the focus lens to the target focus position so that the focus lens is in focus at the target zoom position.
  • the focus position and the image distance v Similar to the zoom position and the focal length f, the focus position and the image distance v also have a fixed correspondence relationship, which is determined in advance and stored in the memory.
  • the processing unit reads the correspondence relationship from the memory, obtains the focus position corresponding to the image distance v according to the correspondence relationship, and then the focus lens driving unit drives the focus lens to move the focus position.
  • the image distance at the zoom position can be obtained in various ways.
  • the processing unit may directly substitute the focal length corresponding to the zoom position and the object distance measured in real time into the Gaussian imaging formula to calculate the image distance at the zoom position.
  • a correspondence table may be prepared in advance according to a Gaussian imaging formula, and the correspondence table reflects the numerical correspondence between the object distance, the focal length, and the image distance, and the correspondence table is stored in the memory.
  • the processing unit reads the correspondence table from the memory, and finds the focal length corresponding to the zoom position and the zoom position corresponding to the object distance measured in real time in the correspondence table by looking up the table. The image distance.
  • the image distance and focus position at the zoom position can be obtained only according to the focal length and the object distance, instead of focusing on the current focal length like the isometric mapping method.
  • the position is mapped to the focus position of the target focal length. Therefore, the error magnification problem of the isometric mapping method when zooming from the wide end to the tele end is fundamentally eliminated, and the zoom tracking accuracy is greatly improved.
  • accurate image distance and focus position can be obtained, so it is also effective for high-magnification zoom lenses.
  • the object distance of the subject may change.
  • the zoom tracking system of this embodiment measures the object distance in real time, and the image distance at the zoom position is obtained based on the real-time measurement value of the object distance, even if the object When the distance changes, the precise focus position can still be obtained, so it is suitable for scenes where the object distance changes. And when acquiring the image distance and focus position at the zoom position, it does not depend on the focus state of the zoom position before the zoom position, that is to say, the focus of the next zoom position can be obtained without focusing at the previous zoom position. The location is in focus. Therefore, the zoom tracking method of this embodiment has the advantages of small errors, high zoom tracking accuracy, suitable for high-magnification zoom lenses and scenes with varying object distances, and independent of the focus state before zooming.
  • the processing unit corrects the focus position corresponding to the image distance according to the calibration coefficient, and the focus lens driving unit drives the focus lens to move to the corrected focus position.
  • the calibration coefficient can be determined by calibrating the lens in advance and stored in the memory.
  • the calibration of the lens can be performed in the following manner. Firstly, multiple sets of focus positions and their corresponding image distances are actually measured, and the actually measured multiple sets of focus positions and their corresponding image distances can be fitted to obtain the actual corresponding relationship between the focus positions and the image distance v. Then, the calibration coefficient is obtained according to the difference between the actual corresponding relationship and the theoretical corresponding relationship.
  • the focus position corresponding to the image distance is corrected by using the calibration coefficient, the focus position will be more accurate, thereby further improving the accuracy of zoom tracking, and the imaging effect is clearer.
  • the memory is a non-volatile memory.
  • the memory may include: at least one of EPROM, EEPROM, FLASH and other memories.
  • the zoom lens does not refer to a single lens, but a group of lenses, and this group of lenses includes at least one lens. At least part of the at least one lens is a movable lens. Driven by the zoom lens drive unit, at least part of the lens can move along the axial direction of the lens, thereby changing the focal length of the lens.
  • the focus lens also does not refer to a single lens, but a group of lenses, and this group of lenses includes at least one lens. At least part of the at least one lens is a movable lens. Driven by the focusing lens drive unit, at least part of the lens can move along the axial direction of the lens, thereby changing the focus position of the lens.
  • the zoom lens driving unit may include a transmission part and an actuator.
  • the actuator may include a stepper motor.
  • Transmission components may include components such as cam rings.
  • the stepping motor drives the zoom lens to move along the axis of the lens through components such as cam rings.
  • the focus lens driving unit may include a transmission part and an actuator.
  • the actuator may include a stepper motor.
  • Transmission components may include components such as cam rings.
  • the stepping motor drives the focusing lens to move along the axis of the lens through components such as cam rings.
  • the processing unit may include any type of data processing device with data processing capabilities, such as but not limited to CPU, DSP, FPGA, CPLD, etc.
  • Another embodiment of the present disclosure provides a lens including a lens barrel and the zoom tracking system of the previous embodiment.
  • Yet another embodiment of the present disclosure provides an imaging device, as shown in FIG. 9, comprising: an imaging device body and the lens of the previous embodiment, the lens being fixedly or detachably mounted on the imaging device body .
  • an unmanned aerial vehicle including: an unmanned aerial vehicle body, a power device, a pan/tilt, and the imaging device of the foregoing embodiments.
  • the pan/tilt is mounted on the drone body, and the imaging device is mounted on the pan/tilt.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Lens Barrels (AREA)

Abstract

Disclosed are a zoom tracking method and system, a lens, an imaging apparatus and an unmanned aerial vehicle. The zoom tracking method comprises: executing a zoom process, and measuring the object distance of an imaging target in real time during the zoom process (S101); and a zoom lens passing a plurality of zoom positions during the zoom process, and executing the following operations at each zoom position: obtaining the image distance at the zoom position according to the focal length corresponding to the zoom position, the object distance that is measured in real time, and an imaging formula; and a focus lens moving to a focus position corresponding to the image distance (S102).

Description

一种变焦跟踪方法和系统、镜头、成像装置和无人机Zoom tracking method and system, lens, imaging device and unmanned aerial vehicle 技术领域Technical field
本公开涉及摄像技术领域,尤其涉及一种变焦跟踪方法和系统、镜头、成像装置和无人机。The present disclosure relates to the field of camera technology, and in particular to a zoom tracking method and system, a lens, an imaging device, and an unmanned aerial vehicle.
背景技术Background technique
当使用可变焦的成像装置拍摄时,可根据拍摄对象的不同调节成像装置的焦距。在变焦过程中,如果不改变对焦位置,则无法保持对拍摄对象的清晰成像。为了在变焦过程中保持合焦状态,出现了变焦跟踪技术。利用变焦跟踪技术,可在变焦过程中根据焦距的变化改变对焦位置,达到保持对拍摄对象清晰成像的目的。等比例映射法就是一种现有的变焦跟踪技术。When shooting with a zoomable imaging device, the focal length of the imaging device can be adjusted according to different subjects. During the zooming process, if you do not change the focus position, you cannot maintain a clear image of the subject. In order to maintain focus during zooming, zoom tracking technology has emerged. Using the zoom tracking technology, the focus position can be changed according to the change of the focal length during the zooming process to achieve the purpose of maintaining a clear image of the subject. The proportional mapping method is an existing zoom tracking technology.
公开内容Public content
本公开提供了一种变焦跟踪方法,包括:The present disclosure provides a zoom tracking method, including:
执行一变焦过程,在所述变焦过程中实时测量成像对象的物距;Performing a zooming process in which the object distance of the imaging object is measured in real time during the zooming process;
变焦镜头在所述变焦过程中经过多个变焦位置,在每一个所述变焦位置执行如下操作:The zoom lens passes through multiple zoom positions during the zooming process, and performs the following operations at each of the zoom positions:
根据所述变焦位置对应的焦距、实时测量的所述物距、以及成像公式得到所述变焦位置处的像距;Obtaining the image distance at the zoom position according to the focal length corresponding to the zoom position, the object distance measured in real time, and an imaging formula;
对焦镜头移动至所述像距对应的对焦位置。The focusing lens moves to the focusing position corresponding to the image distance.
本公开还提供了一种变焦跟踪系统,包括:The present disclosure also provides a zoom tracking system, including:
变焦镜头,在变焦过程中经过多个变焦位置;The zoom lens passes through multiple zoom positions during the zooming process;
测距单元,用于在所述变焦过程中实时测量成像对象的物距;The distance measuring unit is used to measure the object distance of the imaging object in real time during the zooming process;
处理单元,用于在每一个所述变焦位置执行如下操作:根据所述变焦位置对应的焦距、实时测量的所述物距、以及成像公式得到所述变焦位置处的像距;A processing unit, configured to perform the following operations at each of the zoom positions: obtain the image distance at the zoom position according to the focal length corresponding to the zoom position, the object distance measured in real time, and an imaging formula;
对焦镜头,用于移动至所述像距对应的对焦位置。The focusing lens is used to move to the focusing position corresponding to the image distance.
本公开还提供了一种镜头,包括:上述变焦跟踪系统。The present disclosure also provides a lens including: the above-mentioned zoom tracking system.
本公开还提供了一种成像装置,包括成像装置机身、以及上述镜头,所述镜头固定或可拆卸地安装于所述成像装置机身。The present disclosure also provides an imaging device, including an imaging device body and the above-mentioned lens, and the lens is fixedly or detachably mounted on the imaging device body.
本公开还提供了一种无人机,包括:无人机机身、动力装置、以及上述成像装置。The present disclosure also provides an unmanned aerial vehicle, including: an unmanned aerial vehicle body, a power device, and the above-mentioned imaging device.
本公开根据焦距、物距和成像公式即可得到变焦位置处的像距以及对焦位置,消除了等比例映射法存在的误差放大问题;并且对高倍率的可变焦镜头同样有效;当物距发生变化时仍然可以得到精确的对焦位置,适用于物距变化的场景。The present disclosure can obtain the image distance and focus position at the zoom position according to the focal length, the object distance and the imaging formula, which eliminates the error magnification problem of the isometric mapping method; and is also effective for high-magnification zoom lenses; when the object distance occurs The precise focus position can still be obtained when changing, which is suitable for scenes where the object distance changes.
附图说明Description of the drawings
附图是用来提供对本公开的进一步理解,并且构成说明书的一部分,与下面的具体实施方式一起用于解释本公开,但并不构成对本公开的限制。在附图中:The accompanying drawings are used to provide a further understanding of the present disclosure and constitute a part of the specification. Together with the following specific embodiments, they are used to explain the present disclosure, but do not constitute a limitation to the present disclosure. In the attached picture:
图1显示了变焦跟踪曲线。Figure 1 shows the zoom tracking curve.
图2为等比例映射法的误差放大示意图。Figure 2 is a schematic diagram of the error magnification of the isometric mapping method.
图3显示了高倍率的可变焦镜头在不同焦距下的物距范围。Figure 3 shows the object distance range of a high-magnification zoom lens at different focal lengths.
图4为本公开实施例的变焦跟踪方法流程图。FIG. 4 is a flowchart of a zoom tracking method according to an embodiment of the disclosure.
图5显示了变焦过程中变焦镜头的位置变化。Figure 5 shows the change in the position of the zoom lens during zooming.
图6显示了变焦过程中对焦镜头的位置变化。Figure 6 shows the change in the position of the focus lens during zooming.
图7为本公开实施例的变焦跟踪方法中,对焦镜头移动至像距对应的对焦位置的流程图。FIG. 7 is a flowchart of the focus lens moving to the focus position corresponding to the image distance in the zoom tracking method according to the embodiment of the disclosure.
图8为本公开实施例的变焦跟踪系统的结构示意图。FIG. 8 is a schematic structural diagram of a zoom tracking system according to an embodiment of the disclosure.
图9为本公开实施例的成像装置的结构示意图。FIG. 9 is a schematic structural diagram of an imaging device according to an embodiment of the disclosure.
图10为本公开实施例的无人机的结构示意图。FIG. 10 is a schematic structural diagram of an unmanned aerial vehicle according to an embodiment of the disclosure.
具体实施方式Detailed ways
等比例映射法是一种依据变焦跟踪曲线,根据等比例映射原则,将当前焦距的对焦位置映射到目标焦距的对焦位置的方法。其中,变焦跟踪曲线是表示不同物距下,变焦镜头的变焦位置与对焦镜头的对角位置之间的关系的曲线。The proportional mapping method is a method of mapping the focus position of the current focal length to the focal position of the target focal length based on the zoom tracking curve and the principle of proportional mapping. Among them, the zoom tracking curve is a curve representing the relationship between the zoom position of the zoom lens and the diagonal position of the focus lens under different object distances.
图1为变焦跟踪曲线的一个示例。变焦跟踪曲线包括无穷远端对应的曲线400、最近端对应的曲线402、以及无穷远端和最近端之间的各个物距所对应的曲线。Figure 1 shows an example of a zoom tracking curve. The zoom tracking curve includes a curve 400 corresponding to the infinity end, a curve 402 corresponding to the nearest end, and curves corresponding to various object distances between the infinity end and the nearest end.
在变焦跟踪过程中,假设拍摄对象的物距位于无穷远端与最近端之间, 在当前变焦位置下,对应的当前聚焦位置为P1。此时,当前聚焦位置P1与最近端曲线402的距离为b,当前变焦位置下,无穷远端曲线400与最近端曲线402的距离为a+b,由此得到当前聚焦位置P1的比例b/(a+b)。In the zoom tracking process, assuming that the object distance of the subject is between the infinity end and the closest end, at the current zoom position, the corresponding current focus position is P1. At this time, the distance between the current focus position P1 and the nearest end curve 402 is b, and the distance between the infinity end curve 400 and the nearest end curve 402 at the current zoom position is a+b, and thus the ratio b/ of the current focus position P1 is obtained. (a+b).
在变焦后的目标变焦位置,无穷远端曲线400与最近端曲线402的距离为a’+b’。在等比例映射法中,将与最近端曲线402的距离为b’、且b’与距离a’+b’的比例等于b/(a+b)的位置P2作为目标对焦位置。At the target zoom position after zooming, the distance between the infinite end curve 400 and the closest end curve 402 is a'+b'. In the isometric mapping method, the position P2 where the distance from the closest curve 402 is b'and the ratio of b'to the distance a'+b' is equal to b/(a+b) is taken as the target focus position.
对于变焦镜头,像距的数值范围随焦距的扩大而扩大。例如,对于2x的可变焦镜头,如果在广角端(wide端),对焦电机的行程为n,那么在远摄端(tele端),对焦电机的行程即为2×n。如图2所示,对焦电机在wide端的行程共有5步,tele端共有10步,如果wide端的合焦位置(即理想对焦位置)在第4.5步,则对焦电机的实际对焦位置是在第4步或第5步,即实际对焦位置与理想对焦位置的误差为0.5步。当变焦到tele端后,根据等比例映射法,对焦电机的实际对焦位置为第8步或第10步,与tele端的理想对焦位置第9步之间的误差为1步,所以对焦位置的误差放大了一倍(由0.5步到1步)。如果是6x的可变焦镜头,如图2所示,基于类似的原因,误差将会放大六倍。对于十倍、几十倍的高倍率可变焦镜头,误差同样会放大相应的倍数。因此,等比例映射法具有使误差放大的缺陷。For a zoom lens, the numerical range of the image distance expands as the focal length increases. For example, for a 2x zoom lens, if at the wide end (wide end), the stroke of the focus motor is n, then at the tele end (tele), the stroke of the focus motor is 2×n. As shown in Figure 2, the focus motor has a total of 5 steps in the wide end and 10 steps in the tele end. If the focus position of the wide end (ie the ideal focus position) is at step 4.5, the actual focus position of the focus motor is at step 4. Step or Step 5, that is, the error between the actual focus position and the ideal focus position is 0.5 step. After zooming to the tele end, according to the isometric mapping method, the actual focus position of the focus motor is the 8th or 10th step, and the error between the 9th step and the ideal focus position of the tele end is 1 step, so the focus position error The magnification is doubled (from 0.5 step to 1 step). If it is a 6x zoom lens, as shown in Figure 2, the error will be magnified six times for similar reasons. For high magnification zoom lenses of ten times or tens of times, the error will also be magnified by the corresponding magnification. Therefore, the isometric mapping method has the disadvantage of amplifying errors.
对于高倍率的可变焦镜头,不同焦距下的物距范围相差很大。图3示出了一个wide端最近对焦距离为0.5m、超焦距为4m,tele端最近对焦距离为10m、超焦距为1000m的镜头。如果图3的镜头在wide端对8m物距的拍摄对象成像,8m物距对应图1中的无穷远端曲线400。根据等比例投影法,当变焦到tele端后,目标对焦位置仍然是无穷远端曲线400上的一个点。但对于tele端来说,8m的物距小于tele端的最近对焦距离,对应最近端曲线402,tele端的目标对焦位置实际应位于最近端曲线402上。因此,对于高倍率的可变焦镜头,等比例映射法不能得到正确的目标对焦位置,是完全失效的。For high-magnification zoom lenses, the range of object distances at different focal lengths varies greatly. Figure 3 shows a lens with a wide end of the closest focusing distance of 0.5m, a hyperfocal distance of 4m, and a tele end of the lens with a shortest focusing distance of 10m and a hyperfocal distance of 1000m. If the lens of FIG. 3 images a subject with an object distance of 8 m at the wide end, the object distance of 8 m corresponds to the infinite end curve 400 in FIG. 1. According to the proportional projection method, after zooming to the tele end, the target focus position is still a point on the infinity end curve 400. However, for the tele end, the object distance of 8 m is smaller than the closest focus distance of the tele end, which corresponds to the closest end curve 402, and the target focus position of the tele end should actually be on the closest end curve 402. Therefore, for a high-magnification zoom lens, the isometric mapping method cannot obtain the correct target focus position and is completely ineffective.
另外,如果变焦过程中拍摄对象与镜头发生相对移动,物距发生变化,等比例映射法难以保证在变焦过程中保持合焦状态,即等比例投影法不适用物距变化的场景。同时,等比例投影法还要求变焦开始前,镜头处于合 焦状态,即依赖于变焦前的对焦状态。In addition, if the subject and the lens move relative to each other during the zooming process, and the object distance changes, it is difficult for the isometric mapping method to ensure that the focus is maintained during the zooming process, that is, the isometric projection method is not suitable for scenes with varying object distances. At the same time, the proportional projection method also requires the lens to be in focus before zooming, which depends on the focus state before zooming.
综上所述,等比例投影法存在放大误差、对高倍率的可变焦镜头失效、不适用物距变化的场景、以及依赖变焦前的对焦状态的缺陷。In summary, the equal-proportion projection method has the defects of magnification errors, failure of high-magnification zoom lenses, unsuitable scenes with varying object distances, and dependence on the focus state before zooming.
本公开提供了一种变焦跟踪方法和变焦跟踪系统,以及包括该变焦跟踪系统的镜头、成像装置和无人机。本公开的变焦跟踪方法和变焦跟踪系统精度高、适应性强,不存在放大误差的问题,适用于高倍率的可变焦镜头和物距变化的场景,且不依赖变焦前的对焦状态。The present disclosure provides a zoom tracking method and a zoom tracking system, as well as a lens, an imaging device and an unmanned aerial vehicle including the zoom tracking system. The zoom tracking method and zoom tracking system of the present disclosure have high accuracy and strong adaptability, and do not have the problem of magnification errors, are suitable for high-magnification zoomable lenses and scenes with varying object distances, and do not rely on the focus state before zooming.
下面将结合实施例和实施例中的附图,对本公开技术方案进行清楚、完整的描述。显然,所描述的实施例仅仅是本公开一部分实施例,而不是全部的实施例。基于本公开中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都属于本公开保护的范围。The technical solutions of the present disclosure will be clearly and completely described below in conjunction with the embodiments and the drawings in the embodiments. Obviously, the described embodiments are only a part of the embodiments of the present disclosure, rather than all of the embodiments. Based on the embodiments in the present disclosure, all other embodiments obtained by those of ordinary skill in the art without creative work shall fall within the protection scope of the present disclosure.
本公开一实施例的变焦跟踪方法,参见图4,包括:The zoom tracking method of an embodiment of the present disclosure, referring to FIG. 4, includes:
步骤S101:执行一变焦过程,在所述变焦过程中实时测量成像对象的物距。Step S101: Perform a zooming process, during which the object distance of the imaging object is measured in real time.
步骤S102:变焦镜头在所述变焦过程中经过多个变焦位置,在每一个所述变焦位置执行如下操作:Step S102: The zoom lens passes through multiple zoom positions during the zooming process, and performs the following operations at each of the zoom positions:
根据所述变焦位置对应的焦距、实时测量的所述物距、以及成像公式得到所述变焦位置处的像距。The image distance at the zoom position is obtained according to the focal length corresponding to the zoom position, the object distance measured in real time, and an imaging formula.
对焦镜头移动至所述像距对应的对焦位置。The focusing lens moves to the focusing position corresponding to the image distance.
本实施例的变焦跟踪方法针对的是可变焦镜头。可变焦镜头包括:变焦镜头和对焦镜头、以及分别用于驱动变焦镜头和对焦镜头的变焦镜头驱动单元和对焦镜头驱动单元。在变焦镜头驱动单元和对焦镜头驱动单元的驱动下,变焦镜头和对焦镜头可沿镜头的轴向移动。The zoom tracking method of this embodiment is for a zoom lens. The zoomable lens includes a zoom lens and a focus lens, and a zoom lens drive unit and a focus lens drive unit for driving the zoom lens and the focus lens, respectively. Driven by the zoom lens drive unit and the focus lens drive unit, the zoom lens and the focus lens can move along the axis of the lens.
下面介绍本实施例的变焦过程。当执行一变焦过程时,首先获取变焦镜头的目标变焦位置。目标焦距通常由用户输入,接收到目标焦距后即可得到对应的目标变焦位置。然后将变焦镜头的当前变焦位置作为起始变焦位置,变焦镜头驱动单元驱动变焦镜头沿镜头的轴向、从起始变焦位置向目标变焦位置移动。The zooming process of this embodiment will be described below. When performing a zooming process, first obtain the target zoom position of the zoom lens. The target focal length is usually input by the user, and the corresponding target zoom position can be obtained after receiving the target focal length. Then, the current zoom position of the zoom lens is used as the starting zoom position, and the zoom lens driving unit drives the zoom lens to move from the starting zoom position to the target zoom position along the axis of the lens.
在移动的过程中,变焦镜头通常经过至少一个中间变焦位置,这些中间变焦位置位于起始变焦位置与目标变焦位置之间。例如图5,变焦镜头 首先由起始变焦位置移动至第一变焦位置,再由第一变焦位置移动至第二变焦位置,依次类推,最终移动至目标变焦位置。本实施例对中间变焦位置的数量不做限定,该数量一般根据变焦范围,即起始变焦位置与目标变焦位置之间的距离来确定。During the movement, the zoom lens usually passes through at least one intermediate zoom position, and these intermediate zoom positions are located between the initial zoom position and the target zoom position. For example, in Figure 5, the zoom lens first moves from the initial zoom position to the first zoom position, then from the first zoom position to the second zoom position, and so on, and finally moves to the target zoom position. This embodiment does not limit the number of intermediate zoom positions, and the number is generally determined according to the zoom range, that is, the distance between the initial zoom position and the target zoom position.
对于相邻的两个变焦位置,获取后一个变焦位置与前一个变焦位置之间的变焦变化量,变焦镜头移动所述变焦变化量,到达后一个变焦位置。例如图5,变焦镜头由第一变焦位置移动至第二变焦位置时,首先获取第二变焦位置与第一变焦位置之间的变焦变化量,变焦镜头移动变焦变化量即可到达第二变焦位置。对于其他变焦位置也是如此,通过上述方式到达各个变焦位置。For two adjacent zoom positions, the zoom change amount between the next zoom position and the previous zoom position is obtained, and the zoom lens moves by the zoom change amount to reach the next zoom position. For example, in Figure 5, when the zoom lens is moved from the first zoom position to the second zoom position, first obtain the zoom change amount between the second zoom position and the first zoom position, and the zoom lens can move to the second zoom position by moving the zoom change amount . The same is true for other zoom positions, each zoom position is reached through the above-mentioned method.
需要说明的是,在变焦过程中,拍摄对象的物距可能是固定的,也可能发生变化,例如,拍摄对象和拍摄装置的至少一个发生了移动。在这种情况下,各个变焦位置的物距不相等。It should be noted that during the zooming process, the object distance of the shooting object may be fixed or may change, for example, at least one of the shooting object and the shooting device has moved. In this case, the object distances of the various zoom positions are not equal.
当变焦镜头移动至起始变焦位置之后的每个变焦位置后,确定出与该变焦位置对应的对焦位置,对焦镜头驱动单元驱动对焦镜头移动至该对焦位置,使对焦镜头在该变焦位置处于合焦状态,然后变焦镜头再向下一个变焦位置移动。重复上述过程,直到变焦镜头移动至目标变焦位置,此时对焦镜头在目标变焦位置也处于合焦状态,完成整个变焦过程。例如图6,对焦镜头首先移动至第一对焦位置,再由第一对焦位置移动至第二对焦位置,依次类推,最终移动至目标对焦位置。After the zoom lens moves to each zoom position after the initial zoom position, the focus position corresponding to the zoom position is determined, and the focus lens drive unit drives the focus lens to move to the focus position, so that the focus lens is in the closed position at the zoom position. Focus state, and then the zoom lens moves to the next zoom position. Repeat the above process until the zoom lens moves to the target zoom position. At this time, the focus lens is also in focus at the target zoom position, and the entire zoom process is completed. For example, in FIG. 6, the focus lens first moves to the first focus position, and then moves from the first focus position to the second focus position, and so on, and finally moves to the target focus position.
变焦镜头的移动过程中,首先获取当前的对焦位置,再获取下一个对焦位置与当前对焦位置之间的对焦变化量,对焦镜头移动对焦变化量即可到达下一个对焦位置。In the moving process of the zoom lens, the current focus position is first obtained, and then the focus change amount between the next focus position and the current focus position is obtained. The focus lens moves by the focus change amount to reach the next focus position.
也就是说,本实施例的变焦过程是一个动态过程,变焦镜头移动一步,对焦镜头跟着移动一步;然后变焦镜头再移动一步,对焦镜头跟着也移动一步,如此循环,直至到达目标对焦位置,实现合焦。That is to say, the zoom process in this embodiment is a dynamic process. The zoom lens moves one step, and the focus lens moves one step; then the zoom lens moves one more step, and the focus lens also moves one step, and so on until the target focus position is reached. In focus.
本实施例的变焦跟踪方法,在镜头或安装该镜头的成像装置上,设置有测距单元,这个测距单元在上述变焦过程中实时测量拍摄对象的物距,变焦镜头在任一个变焦位置都能得到对应的物距。本实施例可通过以下任一种或几种方式测量物距:单目测距、双目测距、激光测距、TOF测距、 结构光测距。以上只是举例说明,本实施例不对物距测量方式进行限定,其还可以是其他任何类型的方式。In the zoom tracking method of this embodiment, a distance measuring unit is provided on the lens or the imaging device on which the lens is installed. The distance measuring unit measures the object distance of the subject in real time during the aforementioned zooming process. The zoom lens can be at any zoom position. Get the corresponding object distance. In this embodiment, the object distance can be measured in any one or several of the following methods: monocular distance measurement, binocular distance measurement, laser distance measurement, TOF distance measurement, and structured light distance measurement. The foregoing is only an example, this embodiment does not limit the object distance measurement method, and it may also be any other type of method.
下面介绍如何在起始变焦位置之后的每个变焦位置得到对应的对焦位置,以使对焦镜头在该变焦位置处于合焦状态。The following describes how to obtain the corresponding focus position at each zoom position after the initial zoom position, so that the focus lens is in focus at the zoom position.
如步骤S102所述,在每个变焦位置,根据所述变焦位置对应的焦距、实时测量的物距、以及成像公式得到所述变焦位置处的像距;将对焦镜头移动至所述像距对应的对焦位置。As described in step S102, at each zoom position, the image distance at the zoom position is obtained according to the focal length corresponding to the zoom position, the object distance measured in real time, and the imaging formula; the focus lens is moved to the corresponding image distance The focus position.
本实施例中,所述成像公式为高斯成像公式。高斯成像公式为:In this embodiment, the imaging formula is a Gaussian imaging formula. The Gaussian imaging formula is:
1/u+1/v=1/f1/u+1/v=1/f
其中,u是物距,v是像距,f是焦距。Among them, u is the object distance, v is the image distance, and f is the focal length.
具体来说,在每个变焦位置,将所述变焦位置对应的焦距f、实时测量的物距u代入上述高斯成像公式,即可得到在所述变焦位置处的像距。Specifically, at each zoom position, the focal length f corresponding to the zoom position and the object distance u measured in real time are substituted into the above-mentioned Gaussian imaging formula to obtain the image distance at the zoom position.
例如,当变焦镜头移动第一变焦位置后,假设第一变焦位置对应的焦距为f1,此时测量出的拍摄对象物距为u1,将f1和u1代入高斯成像公式,即可得到在第一变焦位置处的像距v1。对其他中间变焦位置也是如此。当变焦镜头移动目标变焦位置后,得到在目标变焦位置处的像距。For example, when the zoom lens moves to the first zoom position, assuming that the focal length corresponding to the first zoom position is f1, the measured object distance of the subject is u1. Substituting f1 and u1 into the Gaussian imaging formula can be obtained in the first zoom position. Image distance v1 at the zoom position. The same is true for other intermediate zoom positions. When the zoom lens moves to the target zoom position, the image distance at the target zoom position is obtained.
其中,变焦位置与焦距f具有固定的对应关系,这一对应关系事先确定并存储在镜头中。变焦位置可从镜头内设置的传感器、或变焦镜头驱动单元获取。当获取到变焦位置后,即可通过所述对应关系得到焦距f。Among them, the zoom position and the focal length f have a fixed correspondence relationship, and this correspondence relationship is determined in advance and stored in the lens. The zoom position can be obtained from a sensor set in the lens or a zoom lens drive unit. After the zoom position is obtained, the focal length f can be obtained through the corresponding relationship.
得到变焦位置处的像距后,将像距转换为对焦位置,并将对焦镜头移动至所述对焦位置。After the image distance at the zoom position is obtained, the image distance is converted to a focus position, and the focus lens is moved to the focus position.
例如,当得到第一变焦位置处的像距u1后,将像距u1转换为第一对焦位置,并将对焦镜头移动第一对焦位置,使对焦镜头处于合焦状态。对其他中间变焦位置也是如此,使对焦镜头在每个中间变焦位置均处于合焦状态。当得到目标变焦位置处的像距后,将对焦镜头移动目标对焦位置,使对焦镜头在目标变焦位置处于合焦状态。For example, after the image distance u1 at the first zoom position is obtained, the image distance u1 is converted to the first focus position, and the focus lens is moved to the first focus position, so that the focus lens is in focus. The same is true for other intermediate zoom positions, so that the focus lens is in focus at each intermediate zoom position. When the image distance at the target zoom position is obtained, the focus lens is moved to the target focus position so that the focus lens is in focus at the target zoom position.
与变焦位置与焦距f类似,对焦位置与像距v也具有固定的对应关系,这一对应关系事先确定并存储在镜头中。首先根据所述对应关系得到像距v对应的对焦位置,然后对焦镜头驱动单元驱动对焦镜头移动至所述对焦位置。Similar to the zoom position and the focal length f, the focus position and the image distance v also have a fixed correspondence relationship, which is determined in advance and stored in the lens. First, the focus position corresponding to the image distance v is obtained according to the corresponding relationship, and then the focus lens driving unit drives the focus lens to move to the focus position.
本实施例中,可通过多种方式得到变焦位置处的像距。In this embodiment, the image distance at the zoom position can be obtained in various ways.
作为一个方式,可将变焦位置对应的焦距、实时测量的物距直接代入高斯成像公式,解算出变焦位置处的像距。As a way, the focal length corresponding to the zoom position and the object distance measured in real time can be directly substituted into the Gaussian imaging formula to calculate the image distance at the zoom position.
作为另一个方式,可事先根据高斯成像公式制作对应关系表,该对应关系表反映物距、焦距和像距的数值对应关系,并将对应关系表存储在镜头中。当需要计算像距时,从镜头中读取所述对应关系表,通过查表的方式,在对应关系表中查找出与变焦位置对应的焦距、实时测量的物距对应的变焦位置处的像距。As another way, a correspondence table may be prepared in advance according to a Gaussian imaging formula, and the correspondence table reflects the numerical correspondence between the object distance, the focal length, and the image distance, and the correspondence table is stored in the lens. When the image distance needs to be calculated, the correspondence table is read from the lens, and the focal length corresponding to the zoom position and the image at the zoom position corresponding to the object distance measured in real time are found in the correspondence table by looking up the table. distance.
由此可见,本实施例的变焦跟踪方法,在每个变焦位置,只根据焦距、物距即可得到变焦位置处的像距以及对焦位置,而不是像等比例映射法那样将当前焦距的对焦位置映射到目标焦距的对焦位置,因此,从根本上消除了等比例映射法存在的由wide端向tele端变焦时的误差放大问题,变焦跟踪精度大幅提升。对于高倍率的可变焦镜头,不论是在wide端还是tele端,均可得到精确的像距以及对焦位置,因此对高倍率的可变焦镜头同样有效。在整个变焦过程中,拍摄对象的物距有可能发生变化,由于本实施例的变焦跟踪方法实时测量物距,并且变焦位置处的像距是根据物距的实时测量值得到的,所以即使物距发生变化,仍然可以得到精确的对焦位置,因此适用物距变化的场景。并且在获取变焦位置处的像距和对焦位置时,不依赖该变焦位置之前的变焦位置的对焦状态,也就是说,不需要在之前的变焦位置合焦,就可以得到下一个变焦位置的对焦位置而合焦。如图6所述,在获取第一对焦位置时,在起始变焦位置,无需对焦镜头合焦。因此,本实施例的变焦跟踪方法具有误差小、变焦跟踪精度高、适用高倍率的可变焦镜头和物距变化的场景、以及不依赖变焦前的对焦状态的优点。It can be seen that, in the zoom tracking method of this embodiment, at each zoom position, the image distance and focus position at the zoom position can be obtained only according to the focal length and the object distance, instead of focusing on the current focal length like the isometric mapping method. The position is mapped to the focus position of the target focal length. Therefore, the error magnification problem of the isometric mapping method when zooming from the wide end to the tele end is fundamentally eliminated, and the zoom tracking accuracy is greatly improved. For high-magnification zoom lenses, whether on the wide end or the tele end, accurate image distance and focus position can be obtained, so it is also effective for high-magnification zoom lenses. During the entire zooming process, the object distance of the subject may change. Because the zoom tracking method of this embodiment measures the object distance in real time, and the image distance at the zoom position is obtained based on the real-time measurement value of the object distance, even if the object When the distance changes, the precise focus position can still be obtained, so it is suitable for scenes where the object distance changes. And when acquiring the image distance and focus position at the zoom position, it does not depend on the focus state of the zoom position before the zoom position, that is to say, the focus of the next zoom position can be obtained without focusing at the previous zoom position. The location is in focus. As shown in FIG. 6, when acquiring the first focus position, at the initial zoom position, there is no need to focus the focus lens. Therefore, the zoom tracking method of this embodiment has the advantages of small errors, high zoom tracking accuracy, suitable for high-magnification zoom lenses and scenes with varying object distances, and independent of the focus state before zooming.
对于可变焦镜头来说,理想情况下,其对焦位置与像距v的对应关系应该是保持不变的。但是由于镜头一致性、温度等因素的影响,实际上,对焦位置与像距v的对应关系很难保持不变。例如,镜头制造环节引入的误差使得不同批次镜头的对焦位置与像距v的对应关系有所差异。当拍摄环境的温度发生剧烈变化时,同一镜头的对焦位置与像距v的对应关系也会发生变化。For a zoom lens, ideally, the corresponding relationship between the focus position and the image distance v should remain unchanged. However, due to the influence of lens consistency, temperature and other factors, in fact, it is difficult to maintain the correspondence between the focus position and the image distance v. For example, the error introduced in the lens manufacturing process makes the correspondence between the focus position and the image distance v of different batches of lenses different. When the temperature of the shooting environment changes drastically, the corresponding relationship between the focus position and the image distance v of the same lens will also change.
针对上述情况,本实施例的变焦跟踪方法,得到变焦位置处的像距后,对焦镜头移动至像距对应的对焦位置包括以下步骤:In view of the above situation, in the zoom tracking method of this embodiment, after obtaining the image distance at the zoom position, moving the focus lens to the focus position corresponding to the image distance includes the following steps:
步骤S201:根据标定系数对所述像距对应的对焦位置进行修正;Step S201: Correct the focus position corresponding to the image distance according to the calibration coefficient;
步骤S202:所述对焦镜头移动至修正后的对焦位置。Step S202: the focus lens is moved to the corrected focus position.
所述标定系数可通过事先对镜头进行标定来确定,并存储在镜头中。对镜头的标定可以以如下方式进行。首先实际测量多组对焦位置及其对应的像距,可对实际测量的多组对焦位置及其对应的像距进行拟合,得到对焦位置与像距v的实际对应关系。然后根据实际对应关系与理论对应关系的差异,得到所述标定系数。The calibration coefficient can be determined by calibrating the lens in advance and stored in the lens. The calibration of the lens can be performed in the following manner. Firstly, multiple sets of focus positions and their corresponding image distances are actually measured, and the actually measured multiple sets of focus positions and their corresponding image distances can be fitted to obtain the actual corresponding relationship between the focus positions and the image distance v. Then, the calibration coefficient is obtained according to the difference between the actual corresponding relationship and the theoretical corresponding relationship.
利用标定系数对像距对应的对焦位置修正后,所述对焦位置会更加精确,从而进一步提高了变焦跟踪的精度,成像效果更加清晰。After the focus position corresponding to the image distance is corrected by using the calibration coefficient, the focus position will be more accurate, thereby further improving the accuracy of zoom tracking, and the imaging effect is clearer.
本公开另一实施例提供了一种变焦跟踪系统,如图8所示,包括:变焦镜头、对焦镜头、变焦镜头驱动单元、对焦镜头驱动单元、变焦位置传感器、对焦位置传感器、测距单元、处理单元和存储器。Another embodiment of the present disclosure provides a zoom tracking system, as shown in FIG. 8, including: a zoom lens, a focus lens, a zoom lens drive unit, a focus lens drive unit, a zoom position sensor, a focus position sensor, a distance measuring unit, Processing unit and memory.
变焦镜头在变焦过程中经过多个变焦位置。The zoom lens passes through multiple zoom positions during zooming.
测距单元用于在所述变焦过程中实时测量成像对象的物距。The distance measuring unit is used to measure the object distance of the imaging object in real time during the zooming process.
处理单元用于在每一个所述变焦位置执行如下操作:根据所述变焦位置对应的焦距、实时测量的所述物距、以及成像公式得到所述变焦位置处的像距。The processing unit is configured to perform the following operations at each zoom position: obtain the image distance at the zoom position according to the focal length corresponding to the zoom position, the object distance measured in real time, and an imaging formula.
对焦镜头移动至像距对应的对焦位置。The focus lens moves to the focus position corresponding to the image distance.
当变焦跟踪系统执行一变焦过程时,首先获取变焦镜头的目标变焦位置。目标焦距通常由用户输入,接收到目标焦距后即可得到对应的目标变焦位置。然后将变焦镜头的当前变焦位置作为起始变焦位置,变焦镜头驱动单元驱动变焦镜头沿镜头的轴向、从起始变焦位置向目标变焦位置移动。When the zoom tracking system performs a zooming process, it first obtains the target zoom position of the zoom lens. The target focal length is usually input by the user, and the corresponding target zoom position can be obtained after receiving the target focal length. Then, the current zoom position of the zoom lens is used as the starting zoom position, and the zoom lens driving unit drives the zoom lens to move from the starting zoom position to the target zoom position along the axis of the lens.
在移动的过程中,变焦镜头通常经过至少一个中间变焦位置,这些中间变焦位置位于起始变焦位置与目标变焦位置之间。本实施例对中间变焦位置的数量不做限定,该数量一般根据变焦范围,即起始变焦位置与目标变焦位置之间的距离来确定。During the movement, the zoom lens usually passes through at least one intermediate zoom position, and these intermediate zoom positions are located between the initial zoom position and the target zoom position. This embodiment does not limit the number of intermediate zoom positions, and the number is generally determined according to the zoom range, that is, the distance between the initial zoom position and the target zoom position.
对于相邻的两个变焦位置,变焦位置传感器检测出后一个变焦位置与前一个变焦位置,处理单元计算后一个变焦位置与前一个变焦位置之间的 变焦变化量,变焦镜头驱动单元驱动变焦镜头移动所述变焦变化量,到达后一个变焦位置。通过上述方式到达各个变焦位置。For two adjacent zoom positions, the zoom position sensor detects the next zoom position and the previous zoom position, the processing unit calculates the amount of zoom change between the next zoom position and the previous zoom position, and the zoom lens drive unit drives the zoom lens Move the zoom change amount to reach the next zoom position. Through the above method to reach each zoom position.
需要说明的是,在变焦过程中,拍摄对象的物距可能是固定的,也可能发生变化,例如,拍摄对象和拍摄装置的至少一个发生了移动。在这种情况下,各个变焦位置的物距不相等。It should be noted that during the zooming process, the object distance of the shooting object may be fixed or may change, for example, at least one of the shooting object and the shooting device has moved. In this case, the object distances of the various zoom positions are not equal.
当变焦镜头移动至起始变焦位置之后的每个变焦位置后,确定出与该变焦位置对应的对焦位置,对焦镜头驱动单元驱动对焦镜头移动至该对焦位置,使对焦镜头在该变焦位置处于合焦状态,然后变焦镜头再向下一个变焦位置移动。重复上述过程,直到变焦镜头移动至目标变焦位置,此时对焦镜头在目标变焦位置也处于合焦状态,完成整个变焦过程。After the zoom lens moves to each zoom position after the initial zoom position, the focus position corresponding to the zoom position is determined, and the focus lens drive unit drives the focus lens to move to the focus position, so that the focus lens is in the closed position at the zoom position. Focus state, and then the zoom lens moves to the next zoom position. Repeat the above process until the zoom lens moves to the target zoom position. At this time, the focus lens is also in focus at the target zoom position, and the entire zoom process is completed.
变焦镜头的移动过程中,对焦位置传感器获取当前对焦位置与下一个对焦位置,处理单元计算下一个对焦位置与当前对焦位置之间的对焦变化量,对焦镜头驱动单元驱动对焦镜头移动对焦变化量即可到达下一个对焦位置。During the movement of the zoom lens, the focus position sensor obtains the current focus position and the next focus position, the processing unit calculates the focus change amount between the next focus position and the current focus position, and the focus lens drive unit drives the focus lens to move the focus change amount. Can reach the next focus position.
也就是说,本实施例的变焦过程是一个动态过程,变焦镜头移动一步,对焦镜头跟着移动一步;然后变焦镜头再移动一步,对焦镜头跟着也移动一步,如此循环,直至到达目标对焦位置,实现合焦。That is to say, the zoom process in this embodiment is a dynamic process. The zoom lens moves one step, and the focus lens moves one step; then the zoom lens moves one more step, and the focus lens also moves one step, and so on until the target focus position is reached. In focus.
本实施例的变焦跟踪系统,测距单元在上述变焦过程中实时测量拍摄对象的物距,变焦镜头在任一个变焦位置都能得到对应的物距。本实施例的测距单元可以是以下的一种或几种:单目测距相机、双目视觉相机、激光雷达、TOF测距仪、结构光测距仪。以上只是举例说明,本实施例不对测距单元的具体类型进行限定,其还可以是其他任何类型的测距单元。In the zoom tracking system of this embodiment, the distance measuring unit measures the object distance of the shooting object in real time during the above-mentioned zooming process, and the zoom lens can obtain the corresponding object distance at any zoom position. The distance measuring unit of this embodiment may be one or more of the following: a monocular distance measuring camera, a binocular vision camera, a lidar, a TOF distance meter, and a structured light distance meter. The foregoing is only an example, this embodiment does not limit the specific type of the ranging unit, and it may also be any other type of ranging unit.
下面介绍如何在起始变焦位置之后的每个变焦位置得到对应的对焦位置,以使对焦镜头在该变焦位置处于合焦状态。The following describes how to obtain the corresponding focus position at each zoom position after the initial zoom position, so that the focus lens is in focus at the zoom position.
处理单元在每一个所述变焦位置执行如下操作:根据所述变焦位置对应的焦距、实时测量的所述物距、以及成像公式得到所述变焦位置处的像距。对焦镜头移动至像距对应的对焦位置。The processing unit performs the following operations at each zoom position: obtaining the image distance at the zoom position according to the focal length corresponding to the zoom position, the object distance measured in real time, and the imaging formula. The focus lens moves to the focus position corresponding to the image distance.
本实施例中,所述成像公式为高斯成像公式。高斯成像公式为:In this embodiment, the imaging formula is a Gaussian imaging formula. The Gaussian imaging formula is:
1/u+1/v=1/f1/u+1/v=1/f
其中,u是物距,v是像距,f是焦距。Among them, u is the object distance, v is the image distance, and f is the focal length.
具体来说,在每个变焦位置,处理单元将所述变焦位置对应的焦距f、实时测量的物距u代入上述高斯成像公式,即可得到在所述变焦位置处的像距。Specifically, at each zoom position, the processing unit substitutes the focal length f corresponding to the zoom position and the object distance u measured in real time into the above-mentioned Gaussian imaging formula to obtain the image distance at the zoom position.
例如,当变焦镜头移动第一变焦位置后,假设第一变焦位置对应的焦距为f1,此时测距单元测量出的拍摄对象物距为u1,处理单元将f1和u1代入高斯成像公式,即可得到在第一变焦位置处的像距v1。对其他中间变焦位置也是如此。当变焦镜头移动目标变焦位置后,得到在目标变焦位置处的像距。For example, when the zoom lens moves to the first zoom position, assuming that the focal length corresponding to the first zoom position is f1, the object distance measured by the distance measuring unit is u1, and the processing unit substitutes f1 and u1 into the Gaussian imaging formula, namely The image distance v1 at the first zoom position can be obtained. The same is true for other intermediate zoom positions. When the zoom lens moves to the target zoom position, the image distance at the target zoom position is obtained.
其中,变焦位置与焦距f具有固定的对应关系,这一对应关系事先确定并存储在存储器中。变焦位置传感器检测到变焦位置后,处理单元从存储器中读取该对应关系,即可通过所述对应关系得到焦距f。Wherein, the zoom position and the focal length f have a fixed correspondence relationship, and this correspondence relationship is determined in advance and stored in the memory. After the zoom position sensor detects the zoom position, the processing unit reads the corresponding relationship from the memory, and the focal length f can be obtained through the corresponding relationship.
处理单元得到变焦位置处的像距后,将像距转换为对焦位置,对焦镜头驱动单元将对焦镜头移动至所述对焦位置。当处理单元得到目标对焦位置处的像距后,对焦镜头驱动单元将对焦镜头移动目标对焦位置,使对焦镜头在目标变焦位置处于合焦状态。After obtaining the image distance at the zoom position, the processing unit converts the image distance into a focus position, and the focus lens driving unit moves the focus lens to the focus position. After the processing unit obtains the image distance at the target focus position, the focus lens driving unit moves the focus lens to the target focus position so that the focus lens is in focus at the target zoom position.
与变焦位置与焦距f类似,对焦位置与像距v也具有固定的对应关系,这一对应关系事先确定并存储在存储器中。处理单元从存储器中读取所述对应关系,根据所述对应关系得到像距v对应的对焦位置,然后对焦镜头驱动单元驱动对焦镜头移动所述对焦位置。Similar to the zoom position and the focal length f, the focus position and the image distance v also have a fixed correspondence relationship, which is determined in advance and stored in the memory. The processing unit reads the correspondence relationship from the memory, obtains the focus position corresponding to the image distance v according to the correspondence relationship, and then the focus lens driving unit drives the focus lens to move the focus position.
本实施例中,可通过多种方式得到变焦位置处的像距。In this embodiment, the image distance at the zoom position can be obtained in various ways.
作为一个方式,处理单元可将变焦位置对应的焦距、实时测量的物距直接代入高斯成像公式,解算出变焦位置处的像距。As a way, the processing unit may directly substitute the focal length corresponding to the zoom position and the object distance measured in real time into the Gaussian imaging formula to calculate the image distance at the zoom position.
作为另一个方式,可事先根据高斯成像公式制作对应关系表,该对应关系表反映物距、焦距和像距的数值对应关系,并将对应关系表存储在存储器中。当需要计算像距时,处理单元从存储器中读取所述对应关系表,通过查表的方式,在对应关系表中查找出与变焦位置对应的焦距、实时测量的物距对应的变焦位置处的像距。As another way, a correspondence table may be prepared in advance according to a Gaussian imaging formula, and the correspondence table reflects the numerical correspondence between the object distance, the focal length, and the image distance, and the correspondence table is stored in the memory. When the image distance needs to be calculated, the processing unit reads the correspondence table from the memory, and finds the focal length corresponding to the zoom position and the zoom position corresponding to the object distance measured in real time in the correspondence table by looking up the table. The image distance.
由此可见,本实施例的变焦跟踪系统,在每个变焦位置,只根据焦距、物距即可得到变焦位置处的像距以及对焦位置,而不是像等比例映射法那样将当前焦距的对焦位置映射到目标焦距的对焦位置,因此,从根本上消 除了等比例映射法存在的由wide端向tele端变焦时的误差放大问题,变焦跟踪精度大幅提升。对于高倍率的可变焦镜头,不论是在wide端还是tele端,均可得到精确的像距以及对焦位置,因此对高倍率的可变焦镜头同样有效。在整个变焦过程中,拍摄对象的物距有可能发生变化,由于本实施例的变焦跟踪系统实时测量物距,并且变焦位置处的像距是根据物距的实时测量值得到的,所以即使物距发生变化,仍然可以得到精确的对焦位置,因此适用物距变化的场景。并且在获取变焦位置处的像距和对焦位置时,不依赖该变焦位置之前的变焦位置的对焦状态,也就是说,不需要在之前的变焦位置合焦,就可以得到下一个变焦位置的对焦位置而合焦。因此,本实施例的变焦跟踪方法具有误差小、变焦跟踪精度高、适用高倍率的可变焦镜头和物距变化的场景、以及不依赖变焦前的对焦状态的优点。It can be seen that, in the zoom tracking system of this embodiment, at each zoom position, the image distance and focus position at the zoom position can be obtained only according to the focal length and the object distance, instead of focusing on the current focal length like the isometric mapping method. The position is mapped to the focus position of the target focal length. Therefore, the error magnification problem of the isometric mapping method when zooming from the wide end to the tele end is fundamentally eliminated, and the zoom tracking accuracy is greatly improved. For high-magnification zoom lenses, whether on the wide end or the tele end, accurate image distance and focus position can be obtained, so it is also effective for high-magnification zoom lenses. During the entire zooming process, the object distance of the subject may change. Because the zoom tracking system of this embodiment measures the object distance in real time, and the image distance at the zoom position is obtained based on the real-time measurement value of the object distance, even if the object When the distance changes, the precise focus position can still be obtained, so it is suitable for scenes where the object distance changes. And when acquiring the image distance and focus position at the zoom position, it does not depend on the focus state of the zoom position before the zoom position, that is to say, the focus of the next zoom position can be obtained without focusing at the previous zoom position. The location is in focus. Therefore, the zoom tracking method of this embodiment has the advantages of small errors, high zoom tracking accuracy, suitable for high-magnification zoom lenses and scenes with varying object distances, and independent of the focus state before zooming.
本实施例的变焦跟踪系统,处理单元根据标定系数对所述像距对应的对焦位置进行修正,对焦镜头驱动单元驱动所述对焦镜头移动至修正后的对焦位置。In the zoom tracking system of this embodiment, the processing unit corrects the focus position corresponding to the image distance according to the calibration coefficient, and the focus lens driving unit drives the focus lens to move to the corrected focus position.
所述标定系数可通过事先对镜头进行标定来确定,并存储在存储器中。对镜头的标定可以以如下方式进行。首先实际测量多组对焦位置及其对应的像距,可对实际测量的多组对焦位置及其对应的像距进行拟合,得到对焦位置与像距v的实际对应关系。然后根据实际对应关系与理论对应关系的差异,得到所述标定系数。The calibration coefficient can be determined by calibrating the lens in advance and stored in the memory. The calibration of the lens can be performed in the following manner. Firstly, multiple sets of focus positions and their corresponding image distances are actually measured, and the actually measured multiple sets of focus positions and their corresponding image distances can be fitted to obtain the actual corresponding relationship between the focus positions and the image distance v. Then, the calibration coefficient is obtained according to the difference between the actual corresponding relationship and the theoretical corresponding relationship.
利用标定系数对像距对应的对焦位置修正后,所述对焦位置会更加精确,从而进一步提高了变焦跟踪的精度,成像效果更加清晰。After the focus position corresponding to the image distance is corrected by using the calibration coefficient, the focus position will be more accurate, thereby further improving the accuracy of zoom tracking, and the imaging effect is clearer.
需要说明的是,所述存储器为非易失性存储器。所述存储器可包括:EPROM、EEPROM、FLASH等存储器中的至少一个。It should be noted that the memory is a non-volatile memory. The memory may include: at least one of EPROM, EEPROM, FLASH and other memories.
变焦镜头并非单指一个镜头,而是指一组镜头,这一组镜头包括至少一个镜头。至少一个镜头中的至少部分镜头为可移动镜头。在变焦镜头驱动单元的驱动下,至少部分镜头可沿镜头的轴向移动,从而改变镜头的焦距。The zoom lens does not refer to a single lens, but a group of lenses, and this group of lenses includes at least one lens. At least part of the at least one lens is a movable lens. Driven by the zoom lens drive unit, at least part of the lens can move along the axial direction of the lens, thereby changing the focal length of the lens.
对焦镜头也并非单指一个镜头,而是指一组镜头,这一组镜头包括至少一个镜头。至少一个镜头中的至少部分镜头为可移动镜头。在对焦镜头驱动单元的驱动下,至少部分镜头可沿镜头的轴向移动,从而改变镜头的 对焦位置。The focus lens also does not refer to a single lens, but a group of lenses, and this group of lenses includes at least one lens. At least part of the at least one lens is a movable lens. Driven by the focusing lens drive unit, at least part of the lens can move along the axial direction of the lens, thereby changing the focus position of the lens.
变焦镜头驱动单元可包括传动部件和致动器。致动器可包括步进马达。传动部件可包括凸轮环等部件。步进马达通过凸轮环等部件驱动变焦镜头沿镜头的轴向移动。The zoom lens driving unit may include a transmission part and an actuator. The actuator may include a stepper motor. Transmission components may include components such as cam rings. The stepping motor drives the zoom lens to move along the axis of the lens through components such as cam rings.
对焦镜头驱动单元可包括传动部件和致动器。致动器可包括步进马达。传动部件可包括凸轮环等部件。步进马达通过凸轮环等部件驱动对焦镜头沿镜头的轴向移动。The focus lens driving unit may include a transmission part and an actuator. The actuator may include a stepper motor. Transmission components may include components such as cam rings. The stepping motor drives the focusing lens to move along the axis of the lens through components such as cam rings.
所述处理单元可包括具有数据处理能力的任何类型的数据处理装置,例如但不限于CPU、DSP、FPGA、CPLD等。The processing unit may include any type of data processing device with data processing capabilities, such as but not limited to CPU, DSP, FPGA, CPLD, etc.
本公开又一实施例提供了一种镜头,包括镜筒、以及上一实施例的变焦跟踪系统。Another embodiment of the present disclosure provides a lens including a lens barrel and the zoom tracking system of the previous embodiment.
本公开再一实施例提供了一种成像装置,如图9所示,包括:成像装置机身、以及上一实施例的镜头,所述镜头固定或可拆卸地安装于所述成像装置机身。Yet another embodiment of the present disclosure provides an imaging device, as shown in FIG. 9, comprising: an imaging device body and the lens of the previous embodiment, the lens being fixedly or detachably mounted on the imaging device body .
本公开再一实施例提供了一种无人机,包括:无人机机身、动力装置、云台、以及上述实施例的成像装置。所述云台安装于所述无人机机身,所述成像装置安装于所述云台。Yet another embodiment of the present disclosure provides an unmanned aerial vehicle, including: an unmanned aerial vehicle body, a power device, a pan/tilt, and the imaging device of the foregoing embodiments. The pan/tilt is mounted on the drone body, and the imaging device is mounted on the pan/tilt.
本领域技术人员可以清楚地了解到,为描述的方便和简洁,仅以上述各功能模块的划分进行举例说明,实际应用中,可以根据需要而将上述功能分配由不同的功能模块完成,即将装置的内部结构划分成不同的功能模块,以完成以上描述的全部或者部分功能。上述描述的装置的具体工作过程,可以参考前述方法实施例中的对应过程,在此不再赘述。Those skilled in the art can clearly understand that for the convenience and conciseness of the description, only the division of the above-mentioned functional modules is used as an example. In practical applications, the above-mentioned functions can be allocated by different functional modules as required, that is, the device The internal structure is divided into different functional modules to complete all or part of the functions described above. For the specific working process of the device described above, reference may be made to the corresponding process in the foregoing method embodiment, which will not be repeated here.
最后应说明的是:以上各实施例仅用以说明本公开的技术方案,而非对其限制;尽管参照前述各实施例对本公开进行了详细的说明,本领域的普通技术人员应当理解:其依然可以对前述各实施例所记载的技术方案进行修改,或者对其中部分或者全部技术特征进行等同替换;在不冲突的情况下,本公开实施例中的特征可以任意组合;而这些修改或者替换,并不使相应技术方案的本质脱离本公开各实施例技术方案的范围。Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present disclosure, not to limit it; although the present disclosure has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that: The technical solutions described in the foregoing embodiments can still be modified, or some or all of the technical features can be equivalently replaced; in the case of no conflict, the features in the embodiments of the present disclosure can be combined arbitrarily; and these modifications or replacements It does not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present disclosure.

Claims (24)

  1. 一种变焦跟踪方法,其特征在于,包括:A zoom tracking method, characterized in that it comprises:
    执行一变焦过程,在所述变焦过程中实时测量成像对象的物距;Performing a zooming process, and measuring the object distance of the imaging object in real time during the zooming process;
    变焦镜头在所述变焦过程中经过多个变焦位置,在每一个所述变焦位置执行如下操作:The zoom lens passes through multiple zoom positions during the zooming process, and performs the following operations at each of the zoom positions:
    根据所述变焦位置对应的焦距、实时测量的所述物距、以及成像公式得到所述变焦位置处的像距;Obtaining the image distance at the zoom position according to the focal length corresponding to the zoom position, the object distance measured in real time, and an imaging formula;
    对焦镜头移动至所述像距对应的对焦位置。The focusing lens moves to the focusing position corresponding to the image distance.
  2. 如权利要求1所述的变焦跟踪方法,其特征在于,所述成像公式为高斯成像公式。The zoom tracking method according to claim 1, wherein the imaging formula is a Gaussian imaging formula.
  3. 如权利要求1所述的变焦跟踪方法,其特征在于,通过以下至少其中之一的方法实时测量成像对象的所述物距:单目测距、双目测距、激光测距、TOF测距、结构光测距。The zoom tracking method according to claim 1, wherein the object distance of the imaging object is measured in real time by at least one of the following methods: monocular ranging, binocular ranging, laser ranging, TOF ranging , Structured light ranging.
  4. 如权利要求1所述的变焦跟踪方法,其特征在于,在所述变焦过程中所述物距发生变化,使所述多个变焦位置中的至少部分变焦位置处的物距不相等。The zoom tracking method according to claim 1, wherein the object distance changes during the zooming process, so that the object distances at at least some of the multiple zoom positions are not equal.
  5. 如权利要求1所述的变焦跟踪方法,其特征在于,所述变焦镜头在所述变焦过程中经过多个变焦位置,包括:The zoom tracking method of claim 1, wherein the zoom lens passes through multiple zoom positions during the zooming process, including:
    对于相邻的两个变焦位置,获取后一个变焦位置与前一个变焦位置之间的变焦变化量;For two adjacent zoom positions, obtain the zoom change amount between the next zoom position and the previous zoom position;
    所述变焦镜头移动所述变焦变化量,到达后一个变焦位置。The zoom lens moves by the zoom change amount to reach the next zoom position.
  6. 如权利要求1所述的变焦跟踪方法,其特征在于,所述对焦镜头移动至所述像距对应的对焦位置,包括:The zoom tracking method of claim 1, wherein the moving the focus lens to the focus position corresponding to the image distance comprises:
    获取当前对焦位置;Get the current focus position;
    获取所述像距对应的对焦位置与所述当前对焦位置之间的对焦变化量;Acquiring a focus change amount between the focus position corresponding to the image distance and the current focus position;
    所述对焦镜头移动所述对焦变化量,到达所述像距对应的对焦位置。The focus lens moves by the focus change amount to reach a focus position corresponding to the image distance.
  7. 如权利要求1所述的变焦跟踪方法,其特征在于,所述多个变焦位置依次包括:起始变焦位置、至少一个中间变焦位置、以及目标变焦位置。The zoom tracking method according to claim 1, wherein the multiple zoom positions sequentially include: a starting zoom position, at least one intermediate zoom position, and a target zoom position.
  8. 如权利要求1所述的变焦跟踪方法,其特征在于,所述对焦镜头移动至所述像距对应的对焦位置,包括:The zoom tracking method of claim 1, wherein the moving the focus lens to the focus position corresponding to the image distance comprises:
    根据标定系数对所述像距对应的对焦位置进行修正;Correcting the focus position corresponding to the image distance according to the calibration coefficient;
    所述对焦镜头移动至修正后的对焦位置。The focus lens moves to the corrected focus position.
  9. 如权利要求1所述的变焦跟踪方法,其特征在于,所述根据所述变焦位置对应的焦距、实时测量的所述物距、以及成像公式得到所述变焦位置处的像距,包括:The zoom tracking method of claim 1, wherein the obtaining the image distance at the zoom position according to the focal length corresponding to the zoom position, the object distance measured in real time, and an imaging formula includes:
    将所述变焦位置对应的焦距、实时测量的所述物距代入所述成像公式,计算出所述变焦位置处的像距。The focal length corresponding to the zoom position and the object distance measured in real time are substituted into the imaging formula to calculate the image distance at the zoom position.
  10. 如权利要求1所述的变焦跟踪方法,其特征在于,所述根据所述变焦位置对应的焦距、实时测量的所述物距、以及成像公式得到所述变焦位置处的像距,包括:The zoom tracking method of claim 1, wherein the obtaining the image distance at the zoom position according to the focal length corresponding to the zoom position, the object distance measured in real time, and an imaging formula includes:
    读取物距、焦距与像距的对应关系表,所述对应关系表根据所述成像公式确定;Reading a correspondence table of object distance, focal length and image distance, the correspondence table being determined according to the imaging formula;
    查找所述对应关系表,确定与所述变焦位置对应的焦距、实时测量的所述物距对应的所述变焦位置处的像距。Look up the correspondence table, and determine the focal length corresponding to the zoom position and the image distance at the zoom position corresponding to the object distance measured in real time.
  11. 一种变焦跟踪系统,其特征在于,包括:A zoom tracking system, which is characterized in that it comprises:
    变焦镜头,在变焦过程中经过多个变焦位置;The zoom lens passes through multiple zoom positions during the zooming process;
    测距单元,用于在所述变焦过程中实时测量成像对象的物距;The distance measuring unit is used to measure the object distance of the imaging object in real time during the zooming process;
    处理单元,用于在每一个所述变焦位置执行如下操作:根据所述变焦位置对应的焦距、实时测量的所述物距、以及成像公式得到所述变焦位置处的像距;A processing unit, configured to perform the following operations at each of the zoom positions: obtain the image distance at the zoom position according to the focal length corresponding to the zoom position, the object distance measured in real time, and an imaging formula;
    对焦镜头,用于移动至所述像距对应的对焦位置。The focusing lens is used to move to the focusing position corresponding to the image distance.
  12. 如权利要求11所述的变焦跟踪系统,其特征在于,所述成像公式为高斯成像公式。The zoom tracking system of claim 11, wherein the imaging formula is a Gaussian imaging formula.
  13. 如权利要求11所述的变焦跟踪系统,其特征在于,所述测距单元包括以下至少一种:单目测距相机、双目视觉相机、激光雷达、TOF测距仪、结构光测距仪。The zoom tracking system of claim 11, wherein the distance measurement unit comprises at least one of the following: a monocular rangefinder camera, a binocular vision camera, a lidar, a TOF rangefinder, a structured light rangefinder .
  14. 如权利要求11所述的变焦跟踪系统,其特征在于,在所述变焦过程中所述物距发生变化,使所述多个变焦位置中的至少部分变焦位置处 的物距不相等。The zoom tracking system according to claim 11, wherein the object distance changes during the zooming process, so that the object distances at at least a part of the multiple zoom positions are not equal.
  15. 如权利要求11所述的变焦跟踪系统,其特征在于,还包括:The zoom tracking system of claim 11, further comprising:
    变焦位置传感器,用于获取相邻两个变焦位置的后一个变焦位置与前一个变焦位置;The zoom position sensor is used to obtain the next zoom position and the previous zoom position of two adjacent zoom positions;
    所述处理单元获取后一个变焦位置与前一个变焦位置之间的变焦变化量;Acquiring, by the processing unit, the amount of zoom change between the next zoom position and the previous zoom position;
    所述变焦镜头驱动单元,用于驱动所述变焦镜头移动所述变焦变化量,到达后一个变焦位置。The zoom lens driving unit is used to drive the zoom lens to move the zoom change amount to reach the next zoom position.
  16. 如权利要求11所述的变焦跟踪系统,其特征在于,还包括:The zoom tracking system of claim 11, further comprising:
    对焦位置传感器,用于获取当前对焦位置;Focus position sensor, used to obtain the current focus position;
    所述处理单元获取所述像距对应的对焦位置与所述当前对焦位置之间的对焦变化量;Acquiring, by the processing unit, the amount of focus change between the focus position corresponding to the image distance and the current focus position;
    对焦镜头驱动单元,驱动所述对焦镜头移动所述对焦变化量,到达所述像距对应的对焦位置。The focus lens driving unit drives the focus lens to move the focus change amount to reach the focus position corresponding to the image distance.
  17. 如权利要求11所述的变焦跟踪系统,其特征在于,所述多个变焦位置依次包括:起始变焦位置、至少一个中间变焦位置、以及目标变焦位置。The zoom tracking system according to claim 11, wherein the multiple zoom positions sequentially include: a starting zoom position, at least one intermediate zoom position, and a target zoom position.
  18. 如权利要求11所述的变焦跟踪系统,其特征在于,所述处理单元还根据标定系数对所述像距对应的对焦位置进行修正;The zoom tracking system of claim 11, wherein the processing unit further corrects the focus position corresponding to the image distance according to a calibration coefficient;
    所述对焦镜头移动至修正后的对焦位置。The focus lens moves to the corrected focus position.
  19. 如权利要求11所述的变焦跟踪系统,其特征在于,所述处理单元将所述变焦位置对应的焦距、实时测量的所述物距代入所述成像公式,计算出所述变焦位置处的像距。The zoom tracking system of claim 11, wherein the processing unit substitutes the focal length corresponding to the zoom position and the object distance measured in real time into the imaging formula to calculate the image at the zoom position distance.
  20. 如权利要求11所述的变焦跟踪系统,其特征在于,所述处理单元读取物距、焦距与像距的对应关系表,所述对应关系表根据所述成像公式确定,查找所述对应关系表,确定与所述变焦位置对应的焦距、实时测量的所述物距对应的所述变焦位置处的像距。The zoom tracking system according to claim 11, wherein the processing unit reads a correspondence table of object distance, focal length, and image distance, and the correspondence table is determined according to the imaging formula, and the correspondence relationship is searched. Table to determine the focal length corresponding to the zoom position and the image distance at the zoom position corresponding to the object distance measured in real time.
  21. 一种镜头,其特征在于,包括:权利要求11至20任一项所述的变焦跟踪系统。A lens, characterized by comprising: the zoom tracking system according to any one of claims 11 to 20.
  22. 一种成像装置,其特征在于,包括成像装置机身、以及权利要求 21所述的镜头,所述镜头固定或可拆卸地安装于所述成像装置机身。An imaging device, characterized by comprising an imaging device body and the lens of claim 21, the lens being fixedly or detachably mounted on the imaging device body.
  23. 一种无人机,其特征在于,包括:无人机机身、动力装置、以及权利要求22所述的成像装置。An unmanned aerial vehicle, characterized by comprising: an unmanned aerial vehicle body, a power device, and the imaging device according to claim 22.
  24. 如权利要求23所述的无人机,其特征在于,还包括:云台;所述云台安装于所述无人机机身,所述成像装置安装于所述云台。The drone according to claim 23, further comprising: a pan/tilt; the pan/tilt is installed on the body of the drone, and the imaging device is mounted on the pan/tilt.
PCT/CN2019/118431 2019-11-14 2019-11-14 Zoom tracking method and system, lens, imaging apparatus and unmanned aerial vehicle WO2021092846A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201980040403.XA CN112313940A (en) 2019-11-14 2019-11-14 Zooming tracking method and system, lens, imaging device and unmanned aerial vehicle
PCT/CN2019/118431 WO2021092846A1 (en) 2019-11-14 2019-11-14 Zoom tracking method and system, lens, imaging apparatus and unmanned aerial vehicle

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2019/118431 WO2021092846A1 (en) 2019-11-14 2019-11-14 Zoom tracking method and system, lens, imaging apparatus and unmanned aerial vehicle

Publications (1)

Publication Number Publication Date
WO2021092846A1 true WO2021092846A1 (en) 2021-05-20

Family

ID=74336513

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2019/118431 WO2021092846A1 (en) 2019-11-14 2019-11-14 Zoom tracking method and system, lens, imaging apparatus and unmanned aerial vehicle

Country Status (2)

Country Link
CN (1) CN112313940A (en)
WO (1) WO2021092846A1 (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115484379A (en) * 2021-06-15 2022-12-16 宁波舜宇光电信息有限公司 Imaging method, imaging device and electronic equipment

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101140349A (en) * 2006-09-06 2008-03-12 鸿富锦精密工业(深圳)有限公司 Camera module group
CN101236348A (en) * 2008-03-13 2008-08-06 北京中星微电子有限公司 Automatic focusing method and image collecting device
CN106170064A (en) * 2016-09-14 2016-11-30 广东欧珀移动通信有限公司 Camera focusing method, system and electronic equipment
JP6503607B2 (en) * 2017-04-07 2019-04-24 エスゼット ディージェイアイ テクノロジー カンパニー リミテッドSz Dji Technology Co.,Ltd Imaging control apparatus, imaging apparatus, imaging system, moving object, imaging control method, and program
CN109983372A (en) * 2016-11-29 2019-07-05 索尼半导体解决方案公司 Imaging optical system, camera model and electronic device
CN110073652A (en) * 2016-12-12 2019-07-30 索尼半导体解决方案公司 Imaging device and the method for controlling imaging device

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4478419B2 (en) * 2003-09-02 2010-06-09 キヤノン株式会社 LENS CONTROL DEVICE, OPTICAL DEVICE, AND LENS CONTROL METHOD
CN104469169A (en) * 2014-12-29 2015-03-25 信利光电股份有限公司 Phase ranging camera shooting module and automatic focusing method thereof
JP6706819B2 (en) * 2016-02-15 2020-06-10 パナソニックIpマネジメント株式会社 Imaging device and interchangeable lens with zoom mechanism
CN107911612B (en) * 2017-12-22 2020-02-07 神思电子技术股份有限公司 Automatic focusing method and device for camera

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101140349A (en) * 2006-09-06 2008-03-12 鸿富锦精密工业(深圳)有限公司 Camera module group
CN101236348A (en) * 2008-03-13 2008-08-06 北京中星微电子有限公司 Automatic focusing method and image collecting device
CN106170064A (en) * 2016-09-14 2016-11-30 广东欧珀移动通信有限公司 Camera focusing method, system and electronic equipment
CN109983372A (en) * 2016-11-29 2019-07-05 索尼半导体解决方案公司 Imaging optical system, camera model and electronic device
CN110073652A (en) * 2016-12-12 2019-07-30 索尼半导体解决方案公司 Imaging device and the method for controlling imaging device
JP6503607B2 (en) * 2017-04-07 2019-04-24 エスゼット ディージェイアイ テクノロジー カンパニー リミテッドSz Dji Technology Co.,Ltd Imaging control apparatus, imaging apparatus, imaging system, moving object, imaging control method, and program

Also Published As

Publication number Publication date
CN112313940A (en) 2021-02-02

Similar Documents

Publication Publication Date Title
US8861948B2 (en) Image pickup apparatus
CN104730802A (en) Optical axis included angle calibrating and focusing method and system and double-camera equipment
JP6702765B2 (en) Focus adjusting device and control method thereof, imaging device, program, storage medium
CN108921797B (en) Method for calibrating distorted image
CN102884395A (en) Height measuring method and height measuring device
CN107534715B (en) Camera production method and advanced driving assistance system
WO2021092846A1 (en) Zoom tracking method and system, lens, imaging apparatus and unmanned aerial vehicle
JP2773310B2 (en) Zoom lens with focus adjustment means
WO2017117750A1 (en) Simple follow focus system based on multiple ranging approaches, and photographing system
JP6642998B2 (en) Image shift amount calculating apparatus, imaging apparatus, and image shift amount calculating method
JP2006215398A (en) Image pickup device
CN112630924B (en) Zoom curve correction method, device, storage medium and system
JP2012063520A (en) Distance-measuring device, lens system and image pickup device
JP2014194502A (en) Imaging apparatus and imaging system
JP6304964B2 (en) Information processing apparatus, control method thereof, and system
JP5625876B2 (en) Focus detection optical system
JPH0252204A (en) Measuring instrument for three-dimensional coordinate
JP2768459B2 (en) Focus detection device
JP2020197549A (en) Lens device, camera, camera system, and control method
CN116793257B (en) Three-dimensional measurement system and method
JPH11304651A (en) Lens inspecting method
JP2858146B2 (en) Automatic focus correction device for zoom lens
JPH0455806A (en) Lens position controller for zoom lens
CN118042112A (en) Visible light camera and method for adjusting and calibrating visible light camera
JP3047250B2 (en) Focus control device and distance measuring method

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19952164

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19952164

Country of ref document: EP

Kind code of ref document: A1