WO2021253167A1 - Digital zoom imaging method and apparatus, camera, and unmanned aerial vehicle system - Google Patents

Digital zoom imaging method and apparatus, camera, and unmanned aerial vehicle system Download PDF

Info

Publication number
WO2021253167A1
WO2021253167A1 PCT/CN2020/096128 CN2020096128W WO2021253167A1 WO 2021253167 A1 WO2021253167 A1 WO 2021253167A1 CN 2020096128 W CN2020096128 W CN 2020096128W WO 2021253167 A1 WO2021253167 A1 WO 2021253167A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
parameter
digital zoom
focus
exposure
Prior art date
Application number
PCT/CN2020/096128
Other languages
French (fr)
Chinese (zh)
Inventor
马骏
陆海龙
鄢蕾
滕文猛
Original Assignee
深圳市大疆创新科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳市大疆创新科技有限公司 filed Critical 深圳市大疆创新科技有限公司
Priority to CN202080005247.6A priority Critical patent/CN112805991A/en
Priority to PCT/CN2020/096128 priority patent/WO2021253167A1/en
Publication of WO2021253167A1 publication Critical patent/WO2021253167A1/en

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/67—Focus control based on electronic image sensor signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/695—Control of camera direction for changing a field of view, e.g. pan, tilt or based on tracking of objects
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70—Circuitry for compensating brightness variation in the scene
    • H04N23/71—Circuitry for evaluating the brightness variation

Definitions

  • the present invention relates to the field of image processing, and more specifically, to a digital zoom imaging method, a corresponding digital zoom imaging device, and a camera and an unmanned aerial vehicle system including the imaging device.
  • camera equipment generally has a digital zoom function.
  • the related image needs to be zoomed.
  • the user can operate the touch screen of the camera device with a finger or operate the digital zoom dial. Use the wheel or lever to digitally zoom the image. After the digital zoom operation is completed, you can operate the shutter to take the desired image.
  • the existing zoom operation process can usually only perform step-wise digital zoom on the image.
  • a camera device can perform digital zoom from 1 to 10 times, but the camera device can only perform 1.1 times, 1.2 times on the image...
  • the cascade zoom processing can not be performed at any multiple zoom according to the customer’s needs. That is to say, the digital zoom parameters of the existing camera equipment are only multiple fixed values, and the digital zoom parameters do not support stepless modification.
  • the image is continuously digitally zoomed. Therefore, this brings inconvenience to users with high digital zoom requirements.
  • the digital zoom processing process of the existing camera equipment is relatively long.
  • the specific performance is that the entire processing process from setting digital zoom parameters, to internal processing of the zoom, and then to feedback the digital zoom result to the user takes a long time, or the camera cannot be
  • the auto-focus, auto-exposure, and zoom result presentation processes are linked, so that the user can obtain the zoom effect after a long delay after setting the digital zoom parameters. Further, the user needs to evaluate the zoom effect after obtaining the zoom effect. If the zoom effect does not meet the user's needs, the user needs to repeat the above-mentioned digital zoom process.
  • This serial zoom processing flow of the existing camera equipment is used It brings a very bad user experience.
  • an embodiment of the present invention provides a digital zoom imaging method, which includes the following steps:
  • the digital zoom imaging method of the present invention by performing image cropping processing and image quality optimization processing, and adjustment of the focus parameters and exposure parameters of the camera unit in parallel, it greatly shortens the camera device from inputting zoom parameters to performing zooming actions and exposure imaging actions.
  • the time required for the entire process brings users the shooting effect of both zoom and imaging, greatly improves the user experience of the camera equipment, and eliminates the imaging smear caused by the serial execution of image quality optimization, zoom and exposure steps Phenomenon.
  • the method before at least two of the steps S1-S3 are executed in parallel, the method further includes the step of: acquiring the cropping parameter of the first image according to the digital zoom parameter, and The cropping parameter performs cropping processing on the first image.
  • the step of optimizing the image quality of the first image includes a first optimization step
  • the step of generating the focusing parameters of the camera unit includes a first focusing step
  • the step of generating the exposure parameters of the camera unit includes a first exposure step
  • performing at least two of steps S1-S3 in parallel includes simultaneously performing at least two of the first optimization step, the first focusing step, and the first exposure step.
  • the first optimization step includes: adjusting an image coordinate reference datum according to the cropping parameter to determine a first image coordinate reference datum different from the first image The second image coordinate reference datum.
  • the first focusing step includes: adjusting a first focus coordinate parameter reference of the first image according to the cropping parameter to obtain a second focus coordinate parameter reference .
  • the first focusing step further includes: calculating the phase of the phase focusing module of the camera unit according to the second focusing coordinate parameter reference and the cropping parameter.
  • the first exposure step includes: determining an ambient light amount sampling coordinate reference based on the focus position of the object to be imaged corresponding to the digitally zoomed image, and sampling based on the ambient light amount
  • the coordinate base performs sampling of the amount of ambient light.
  • the step of optimizing the image quality of the first image further includes a second optimization step, and the second optimization step includes: The trimmed image of the first image is corrected.
  • the second optimization step further includes: optimizing the image quality of the corrected image to obtain the second image.
  • the first focusing step includes: adjusting a first focus coordinate parameter reference of the first image according to the cropping parameter to obtain a second focus coordinate parameter reference .
  • the step of generating the focusing parameters of the camera unit further includes a second focusing step, and the second focusing step includes: according to the second focusing coordinate parameter reference and/or The data for correcting the image cropped from the first image, the contrast value of the contrast focus module of the camera unit and the related focus parameters are counted, and implemented based on the contrast contrast value and the focus parameter The focusing operation of the camera unit.
  • the first exposure step includes: determining an ambient light amount sampling coordinate reference based on the focus position of the object to be imaged corresponding to the digitally zoomed image, and sampling based on the ambient light amount
  • the coordinate base performs sampling of the amount of ambient light.
  • the step of generating the exposure parameters of the camera unit further includes a second exposure step: the second exposure step includes: sampling coordinate references and/or pairings according to the amount of ambient light The exposure value is calculated from the data corrected by the image cropped from the first image.
  • the second exposure step further includes: adjusting the sensitivity of the sensor of the imaging unit according to the calculated exposure value, so as to obtain an image of desired image quality.
  • the step of receiving a digital zoom parameter includes receiving a steplessly changing digital zoom parameter.
  • the input of the digital zoom parameter is received through a stepless digital zoom input component that can be displayed on the display unit.
  • the input of the digital zoom parameter is received through a mechanical zoom input mechanism.
  • the step of displaying the first image is further included.
  • the present invention also relates to a computer-readable storage medium, the computer-readable storage medium stores executable instructions, and the executable instructions are executed to implement any of the above-mentioned digital zoom imaging methods.
  • the invention discloses a digital zoom imaging device.
  • the digital zoom imaging device includes:
  • a zoom parameter receiving unit for receiving digital zoom parameters
  • the control unit is in communication connection with the zoom parameter receiving unit, and is configured to execute at least two of steps S1-S3 in parallel according to the digital zoom parameter:
  • the digital zoom imaging device of the present invention further includes an image cropping unit, the image cropping unit is communicatively connected with the zoom parameter receiving unit and the control unit, and is configured to execute the steps in parallel by the control unit At least two of S1-S3 previously obtained the cropping parameter of the first image according to the digital zoom parameter, and performed cropping processing on the first image according to the cropping parameter.
  • the control unit includes: a first optimization module, configured to perform a first optimization process on a first image; a first focusing module, configured to execute the generation of the camera unit A first focusing process for focusing parameters; and a first exposure module for performing the first exposure process for generating the exposure parameters of the camera unit,
  • At least two of the first optimization processing, the first focusing processing, and the first exposure processing are performed at the same time.
  • the first optimization processing includes: adjusting an image coordinate reference datum according to the cropping parameter to determine a first image coordinate reference datum different from the first image The second image coordinate reference datum.
  • the first focus processing includes: adjusting a first focus coordinate parameter reference of the first image according to the cropping parameter to obtain a second focus coordinate parameter reference .
  • the first focus processing further includes: calculating the phase of the phase focus module of the camera unit according to the second focus coordinate parameter reference and the cropping parameter.
  • the first exposure processing includes: determining an ambient light amount sampling coordinate reference based on the focus position of the object to be imaged corresponding to the digitally zoomed image, and sampling based on the ambient light amount
  • the coordinate base performs sampling of the amount of ambient light.
  • control unit further includes a second optimization module that performs an image clipped from the first image based on the second image coordinate reference datum. Rectify.
  • the second optimization module optimizes the image quality of the corrected image to obtain the second image.
  • the first focus processing includes: adjusting a first focus coordinate parameter reference of the first image according to the cropping parameter to obtain a second focus coordinate parameter reference .
  • control unit further includes a second focusing module, the second focusing module according to the second focusing coordinate parameter reference and/or cutting from the first image Based on the correction data of the image of the camera unit, the contrast value of the contrast focusing module of the camera unit and the related focusing parameters are counted, and the focusing operation of the camera unit is implemented based on the contrast value and the focusing parameter.
  • the first exposure processing includes: determining an ambient light amount sampling coordinate reference based on the focus position of the object to be imaged corresponding to the digitally zoomed image, and sampling based on the ambient light amount
  • the coordinate base performs sampling of the amount of ambient light.
  • control unit further includes a second exposure module that samples the coordinate reference according to the amount of ambient light and/or adjusts the data clipped from the first image
  • the image correction data calculates the exposure value.
  • the second exposure module further adjusts the sensitivity of the sensor of the camera unit according to the calculated exposure value, so as to obtain an image of desired image quality.
  • the digital zoom imaging device of the present invention further includes a stepless zoom parameter input module for inputting the steplessly changing digital zoom parameter to the zoom parameter receiving unit.
  • the stepless zoom parameter input module includes a stepless digital zoom input component that can be displayed on a display unit.
  • the stepless zoom parameter input module includes a mechanical zoom input mechanism.
  • the digital zoom imaging device of the present invention further includes a display unit for displaying the first image.
  • the present invention also relates to a camera, which includes an optical module for performing digital zoom imaging of the camera, and the optical module includes:
  • a zoom parameter receiving unit for receiving digital zoom parameters
  • the control unit is in communication connection with the zoom parameter receiving unit, and is configured to execute at least two of steps S1-S3 in parallel according to the digital zoom parameter:
  • the optical module further includes an image cropping unit, the image cropping unit is communicatively connected to the zoom parameter receiving unit and the control unit, and is configured to perform a parallel connection between the control unit and the zoom parameter receiving unit.
  • the cropping parameter of the first image is acquired according to the digital zoom parameter, and the first image is cropped according to the cropping parameter.
  • control unit includes: a first optimization module, configured to perform first optimization processing on a first image; A first focusing process; and a first exposure module for performing a first exposure process for generating exposure parameters of the camera unit,
  • At least two of the first optimization processing, the first focusing processing, and the first exposure processing are performed at the same time.
  • the first optimization processing includes: adjusting an image coordinate reference datum according to the cropping parameter to determine a second image coordinate reference datum that is different from the first image coordinate reference datum of the first image. Image coordinate reference datum.
  • the first focus processing includes: adjusting a first focus coordinate parameter reference of the first image according to the cropping parameter to obtain a second focus coordinate parameter reference.
  • the first focus processing further includes: calculating the phase of the phase focus module of the camera unit according to the second focus coordinate parameter reference and the cropping parameter.
  • the first exposure processing includes: determining an ambient light amount sampling coordinate reference based on the focus position of the object to be imaged corresponding to the digitally zoomed image, and performing it based on the ambient light amount sampling coordinate reference Sampling of the amount of ambient light.
  • control unit further includes a second optimization module that corrects the image clipped from the first image based on the second image coordinate reference datum.
  • the second optimization module optimizes the image quality of the corrected image to obtain the second image.
  • the first focus processing includes: adjusting a first focus coordinate parameter reference of the first image according to the cropping parameter to obtain a second focus coordinate parameter reference.
  • control unit further includes a second focusing module, which performs an operation on the image clipped from the first image according to the second focusing coordinate parameter reference and/or
  • the corrected data collects statistics on the contrast value of the contrast focusing module of the camera unit and the related focusing parameters, and implements the focusing operation of the camera unit based on the contrast value and the focusing parameter.
  • the first exposure processing includes: determining an ambient light amount sampling coordinate reference based on the focus position of the object to be imaged corresponding to the digitally zoomed image, and performing it based on the ambient light amount sampling coordinate reference Sampling of the amount of ambient light.
  • control unit further includes a second exposure module that performs correction on the image clipped from the first image according to the ambient light amount sampling coordinate reference Calculate the exposure value from the data.
  • the second exposure module further adjusts the sensitivity of the sensor of the imaging unit according to the calculated exposure value, so as to obtain an image of desired image quality.
  • the camera further includes a stepless zoom parameter input module for inputting a steplessly changing digital zoom parameter to the zoom parameter receiving unit.
  • the stepless zoom parameter receiving module includes a stepless digital zoom input component that can be displayed on a display unit of the camera.
  • the stepless zoom parameter receiving module includes a mechanical zoom input mechanism.
  • the camera further includes a display unit for displaying the first image.
  • the invention also discloses an unmanned aerial vehicle system.
  • the unmanned aerial vehicle system includes:
  • PTZ device carried by the unmanned aerial vehicle
  • a control device which is in communication connection with the unmanned aerial vehicle, the pan/tilt device, and the photographing device, and is used to control the unmanned aerial vehicle, the pan/tilt device, and the photographing device,
  • a zoom parameter receiving unit for receiving digital zoom parameters
  • the control unit is in communication connection with the zoom parameter receiving unit, and is configured to execute at least two of steps S1-S3 in parallel according to the digital zoom parameter:
  • the camera unit is arranged on the pan-tilt device.
  • the photographing device further includes an image cropping unit, the image cropping unit is in communication connection with the zoom parameter receiving unit and the control unit, and is configured to communicate with the control unit Before performing at least two of steps S1-S3 in parallel, the cropping parameter of the first image is obtained according to the digital zoom parameter, and the first image is cropped according to the cropping parameter.
  • the control unit includes: a first optimization module, configured to perform a first optimization process on a first image; a first focusing module, configured to execute the generation of the camera unit A first focusing process for focusing parameters; and a first exposure module for performing the first exposure process for generating the exposure parameters of the camera unit,
  • At least two of the first optimization processing, the first focusing processing, and the first exposure processing are performed at the same time.
  • the first optimization processing includes: adjusting an image coordinate reference datum according to the cropping parameter to determine a first image coordinate reference datum different from the first image The second image coordinate reference datum.
  • the first focus processing includes: adjusting a first focus coordinate parameter reference of the first image according to the cropping parameter to obtain a second focus coordinate parameter reference .
  • the first focus processing further includes: calculating the phase of the phase focus module of the camera unit according to the second focus coordinate parameter reference and the clipping parameter.
  • the first exposure processing includes: determining an ambient light amount sampling coordinate reference based on the focus position of the object to be imaged corresponding to the digitally zoomed image, and sampling based on the ambient light amount
  • the coordinate base performs sampling of the amount of ambient light.
  • control unit further includes a second optimization module that performs an image clipped from the first image based on the second image coordinate reference datum. Rectify.
  • the second optimization module optimizes the image quality of the corrected image to obtain the second image.
  • the first focus processing includes: adjusting a first focus coordinate parameter reference of the first image according to the cropping parameter to obtain a second focus coordinate parameter reference .
  • the control unit further includes a second focus module, which is based on the second focus coordinate parameter reference and/or the first image is cropped Based on the correction data of the image of the camera unit, the contrast value of the contrast focusing module of the camera unit and the related focusing parameters are counted, and the focusing operation of the camera unit is implemented based on the contrast value and the focusing parameter.
  • the first exposure processing includes: determining an ambient light amount sampling coordinate reference based on the focus position of the object to be imaged corresponding to the digitally zoomed image, and sampling based on the ambient light amount
  • the coordinate base performs sampling of the amount of ambient light.
  • control unit further includes a second exposure module, the second exposure module sampling coordinate reference according to the amount of ambient light and/or the The image correction data calculates the exposure value.
  • the second exposure module further adjusts the sensitivity of the sensor of the camera unit according to the calculated exposure value, so as to obtain an image of desired image quality.
  • the photographing device further includes a stepless zoom parameter input module for inputting a steplessly changing digital zoom parameter to the zoom parameter receiving unit.
  • the stepless zoom parameter input module includes a stepless digital zoom input component that can be displayed on a display unit.
  • the stepless zoom parameter input module includes a mechanical zoom input mechanism.
  • the unmanned aerial vehicle system further includes a display unit for displaying the first image, and the display unit is provided in the control device.
  • the digital zoom imaging device can input infinitely variable digital zoom parameters to the photographing device through the stepless zoom parameter input unit, thereby being able to obtain an image of the object to be imaged with continuously variable magnification, so as to meet the requirements of the relevant magnification.
  • the digital zoom control unit synchronously sends the required digital zoom parameters to the focus control unit, the exposure control unit, and the image signal processing unit, so that the focus control unit, the exposure control unit, and the image signal processing unit perform subsequent operations in parallel
  • the imaging efficiency of the imaging device is greatly improved, and the user experience is improved.
  • Fig. 1 is a schematic structural diagram of an embodiment of a digital zoom imaging device according to the present invention.
  • Fig. 2 is a schematic structural diagram of an embodiment of a digital zoom imaging device according to the present invention.
  • Fig. 3 is a schematic structural diagram of an embodiment of a digital zoom imaging device according to the present invention.
  • Fig. 4 is a schematic structural diagram of an embodiment of a control unit according to the present invention.
  • Fig. 5 is a schematic structural diagram of an embodiment of a control unit according to the present invention.
  • Fig. 6 is a schematic structural diagram of an embodiment of a digital zoom imaging device according to the present invention.
  • Fig. 7 is a flowchart of a digital zoom imaging method according to the present invention.
  • Fig. 8 is a schematic diagram of the structure of the camera according to the present invention.
  • Fig. 9 is a schematic structural diagram of an unmanned aerial vehicle system according to the present invention.
  • first and second are only used for description purposes, and cannot be understood as indicating or implying relative importance or implicitly indicating the number of indicated technical features. Therefore, the features defined with “first” and “second” may explicitly or implicitly include one or more of the features.
  • “plurality” means two or more than two, unless specifically defined otherwise.
  • the digital zoom imaging device 10 includes a zoom parameter receiving unit 12 for receiving digital zoom parameters and a control unit 14 communicatively connected with the zoom parameter receiving unit 12, and the control unit 14 is configured to execute parallel operations according to the digital zoom parameters.
  • steps S1-S3 At least two of steps S1-S3: S1. Optimize the image quality of the first image, which is obtained by the camera unit; S2. Generate the focus parameters of the camera unit; and, S3. Generate the exposure parameters of the camera unit.
  • the zoom parameter receiving unit 12 may be used to receive externally input zoom parameters from the digital zoom imaging device 10, such as zoom parameters input by the user, and may also receive zoom parameters from the digital zoom imaging device 10 itself, such as when using When the digital zoom imaging device 10 performs imaging of an object, it can automatically select appropriate zoom parameters.
  • the control unit 14 may execute in parallel at least two steps of the steps of optimizing the image quality of the first image captured by the imaging unit, generating the focus parameters of the imaging unit, and generating the exposure parameters of the imaging unit according to the zoom parameters of the zoom parameter receiving unit 12 .
  • executing in parallel refers to executing at least two of the above three steps S1, S2, and S3 at the same time or simultaneously, or refers to executing at least two of the above three steps S1, S2, and S3 at the same time or simultaneously. At least a part of each of the two steps. That is, the step of optimizing the image quality of the first image captured by the photographing unit and the step of generating the focus parameters of the image capturing unit can be performed simultaneously, or the step of optimizing the image quality of the first image captured by the photographing unit can be performed simultaneously.
  • the step and the step of generating the exposure parameters of the camera unit may also be synchronized to perform the step of generating the focus parameters of the camera unit and the step of generating the exposure parameters of the camera unit, or may simultaneously perform at least a part of each of the above-mentioned two steps .
  • the above three steps can also be performed simultaneously, that is, while optimizing the image quality of the first image captured by the camera unit, the step of generating the focus parameters of the camera unit and the step of generating the exposure parameters of the camera unit are performed, or it can be At least a part of each of the three steps is executed synchronously.
  • the digital zoom imaging device 10 can simultaneously perform image quality optimization, lens focus of the camera unit, and sensor exposure of the camera unit according to digital zoom parameters after receiving a zoom instruction from the outside or automatically generated. Therefore, the time required to perform the three steps in sequence can be greatly shortened, so as to realize the zooming of the digital zoom imaging device 10, that is, the fast digital zoom imaging process of imaging, thereby eliminating the imaging process during the imaging process.
  • Image smearing caused by serial actions that is, a phenomenon in which a zoomed image can only be obtained after a certain period of time when performing a digital zoom operation on an image.
  • the digital zoom imaging device 10 further includes an image cropping unit 16, as shown in FIG.
  • the cropping parameter of the first image is obtained according to the digital zoom parameter, and the first image is cropped according to the cropping parameter.
  • the image cropping unit 16 After receiving the digital zoom parameter through the zoom parameter receiving unit 12, the image cropping unit 16 first obtains the digital zoom parameter, and performs cropping processing on the first image according to the digital zoom parameter, thereby expanding or reducing the angle of view of the first image To obtain the desired zoomed image.
  • the digital zoom parameter of the first image corresponds to the cropping parameter of the first image one-to-one, that is, after the zoom parameter is received by the zoom parameter receiving unit 12, the image cropping unit 16 can obtain the corresponding zoom parameter.
  • the tailoring parameters are provided.
  • the image cropping unit 16 obtains the cropping parameters of the first image according to the digital zoom parameters, and performs operations such as cropping and zooming in the first image with a delay of 1-2 frames, but preferably, the cropping parameters will be real-time
  • it is issued to the optimization module, focus module, exposure module and other subsequent modules to optimize the image according to the cropping parameters, adjust the focus parameters, adjust the exposure parameters and other subsequent processing, thereby further increasing the image output rate and shortening the stepless zoom.
  • the optimization module may include an image signal processor (Image Signal Processor)
  • the focus module may include an auto focus module (Auto Focus Module)
  • the exposure module may include an automatic exposure module (Auto Exposure Module).
  • a display unit 18 may be provided for the digital zoom imaging device 10, as shown in FIG. 3, so that the first image acquired by the camera unit and the image with optimized image quality can be displayed through the display unit 18, so that the image to be imaged can be realized.
  • the pre-existing effect of object imaging is that the zoomed image is displayed on the display unit 18, that is, the image of the first image of the object to be imaged displayed on the display unit 18 is enlarged or reduced.
  • the digital zoom imaging device 10 can realize the control of the camera unit through the control unit 14, and realize the final imaging of the object to be imaged through the focusing and exposure steps.
  • the imaging effect of the object to be imaged is the same as that displayed by the display unit 18. The two images are the same.
  • the digital zoom imaging device 10 realizes the rapid imaging of the object to be imaged through the simultaneous execution of display, focus, and exposure, thereby realizing the imaging effect of seeing what you get, and eliminating the stringency of the imaging process in the imaging process.
  • the phenomenon of image smearing caused by the action that is, it takes a certain time to see the zoom effect when performing the digital zoom operation on the image.
  • the control unit 14 can obtain the cropping parameters through the image cropping unit 16 synchronously or asynchronously, and use the cropping parameters to perform subsequent focusing operations and exposure operations.
  • the control unit 14 includes a first optimization module 142 for performing a first optimization process on a first image, a first focusing module 144 for performing a first focus process for generating focus parameters of the camera unit, and a user
  • the first exposure module 146 that executes the first exposure process that generates the exposure parameters of the camera unit, here, at least two processes of the first optimization process, the first focus process, and the first exposure process are simultaneously executed.
  • the first optimization process is performed by the first optimization module 142
  • the first focus process is performed by the first focus module 144
  • the first exposure process is performed by the first exposure module 146.
  • the first optimization process and the first focus process can be performed at the same time. Any two of the processing and the first exposure processing, or performing the three at the same time, can greatly save the time required to perform the image optimization operation, the focus operation, and the exposure operation in series, and realize the synchronization processing of the three. Greatly shorten the time from zoom to imaging.
  • the above-mentioned first optimization processing includes adjusting the image coordinate reference datum according to the trimming parameter from the image trimming unit 16 to determine a second image coordinate reference datum that is different from the first image coordinate reference datum of the first image.
  • the image coordinate reference reference may be, for example, the center of the image.
  • the center of the first image is the first image coordinate reference reference.
  • the center of the zoomed or cropped image is not the center of the first image. At this time, it is necessary to determine the center of the zoomed image and use this center as the second image coordinate reference of the cropped second image.
  • control unit 14 may further include a second optimization module 143, which corrects the image cropped from the first image based on the re-determined second image coordinate reference datum, and thereby obtains relevant correction data.
  • the image may be distorted or deformed due to digital zoom.
  • the second optimization module 143 of the control unit 14 corrects the image by combining the image data signal obtained by the image sensor of the camera unit, and then performs the image quality of the corrected image. Optimized to make the image better present the original shape and color of the photographed object, thereby obtaining a second image.
  • the image quality optimization processing of the second optimization module 143 may include prior art techniques such as white balance adjustment, grayscale adjustment, saturation adjustment, image noise reduction, etc., which will not be repeated here. So far, the digital zoom imaging device 10 according to the present invention has completed the cropping processing, correction processing, and image quality optimization processing of the zoomed image, and presents the processed second image to the user through the display unit 18.
  • the first focus processing performed by the first focus module 144 may include adjusting the first focus coordinate parameter reference of the first image according to the cropping parameter from the image cropping module 16 to obtain the second focus coordinate parameter reference.
  • the control unit 14 receives the cropping parameters from the image cropping unit 16
  • the first focus module 144 of the control unit 14 adjusts the first focus coordinate reference datum of the first image to obtain the second focus coordinate reference datum of the second image , And calculate the focus parameters of the lens of the camera unit according to the second focus coordinate reference standard.
  • the control unit 14 may receive a digital zoom instruction through the image cropping unit 16 For example, it is the cropping parameter from the image cropping unit 16, and the cropping parameter is sent to the first focusing module 144 of the control unit 14.
  • the first focusing module 144 first analyzes and processes the cropping parameter, and passes The cropping parameter calculates the relevant zoom parameter, and then the first focusing module 144 adjusts the first focusing coordinate parameter of the first image.
  • the coordinate reference origin forming the first image may be referred to as the first focusing coordinate reference.
  • the focus position of the object to be photographed changes. Therefore, it is necessary to re-determine the focus coordinate reference origin according to the changed focus position, that is, the second focus coordinate that forms the second image of the object to be imaged needs to be determined Reference origin.
  • the first focus coordinate reference origin may be set as the center position of the first image
  • the second focus coordinate reference origin may be set as the center position of the second image.
  • the steps of adjusting the focus coordinate parameter reference described above are equally applicable to the phase focus mode and the contrast focus mode.
  • the focus position is determined, so regardless of
  • the focus coordinate parameter reference is also determined, that is, the focus coordinate parameter reference can be determined by the same method.
  • the first focusing process performed by the first focusing module 142 may further include the following steps, that is, after the adjustment of the focus coordinate parameter reference is completed, that is, the first focusing is performed.
  • the phase of the phase focus module of the camera unit is calculated according to the second focus coordinate parameter reference and the cropping parameter from the image cropping unit.
  • the focus operation of the lens of the camera unit can be further implemented according to the phase.
  • the control unit 14 further includes a second focusing module 145, and the second focusing module 145 is based on the first focusing module 144 determined during the first focusing operation performed by the first focusing module 144.
  • the second focus coordinate parameter reference and/or the data corrected by the second optimization module 143 on the image cropped from the first image, the contrast value of the contrast focus module of the camera unit and the related focus parameters are counted, and based on the contrast contrast The value and focus parameter realize the focus operation of the camera unit.
  • the contrast value of the contrast focus module of the camera unit can be counted according to either or both of the second focus coordinate parameter reference and the data corrected by the second optimization module 143 on the image cropped from the first image. And its related focus parameters. As a result, the focusing of the lens using the contrast focusing module is realized.
  • the first exposure processing performed by the first exposure module 146 of the control unit 14 may include determining an ambient light amount sampling coordinate reference based on the focus position of the object to be imaged corresponding to the digitally zoomed image, and performing environmental analysis based on the ambient light amount sampling coordinate reference. Sampling of the amount of light. Since the focus position of the object to be imaged has changed, the brightness of the ambient light in focus also changes accordingly.
  • the first exposure module 146 determines the ambient light amount sampling coordinate reference according to the focus position of the object to be imaged corresponding to the zoomed image , And sample the amount of ambient light based on the ambient light amount sampling coordinate reference, and calculate the brightness of the environment where the camera unit is located based on the sampled amount of ambient light.
  • control unit 14 further includes a second exposure module 147.
  • the second exposure module 147 calculates the exposure value according to the ambient light amount sampling coordinate reference and/or the data corrected by the second optimization module 143 on the image cropped from the first image. That is, the exposure value can be calculated according to either or both of the ambient light amount sampling coordinate reference and the data corrected by the second optimization module 143 on the image clipped from the first image.
  • the second exposure module 147 adjusts the sensitivity of the sensor of the camera unit according to the calculated exposure value, so as to obtain an image of the required image quality.
  • the structure and principle of the digital zoom imaging device 10 according to the present invention are described only by taking the process of taking a single photo as an example. It can be understood that, based on similar principles, the digital zoom imaging device 10 according to the present invention is also It can be used for video shooting. During the video shooting process, the user can continuously digitally zoom the video within a certain range, and can observe the zoomed video on the display unit 18, while continuously focusing and exposing the video , So as to complete the video recording.
  • continuous digital zoom refers to the following situation. In the case of taking a photo, the image of the object to be imaged displayed on the display unit 18 can be continuously zoomed, that is, the angle of view of the image can be continuously changed.
  • continuous zooming refers to the continuous zooming of the continuous video stream during the video shooting process
  • the zooming process is also a stepless zooming process, that is, the arbitrary change of the angle of view of the video image can be achieved .
  • the user can perform digital zoom operation of the video image at any time, and can perform continuous stepless zoom operation on the video.
  • the maximum magnification of digital zoom can be dynamically adjusted to ensure that the digital zoom can be output at the same time.
  • the image quality of is better and there is no tailing effect.
  • the requirement for the digital zoom speed is low, so the higher image resolution can be adapted to a higher maximum magnification.
  • the 4K resolution can adapt to the 4 times maximum magnification; while in the video scene ,
  • the requirements for digital zoom speed are high, so higher maximum magnification can be adapted when the image resolution is low, for example, the resolution of 1080P can be adapted to the maximum magnification of 4 times.
  • the zoom parameter receiving unit 12 of the digital zoom imaging device 10 can receive steplessly changing digital zoom parameters from the outside, and can also receive zoom instructions from its inside.
  • the outside here usually refers to the user’s enter.
  • the user can input a zoom parameter, such as a digital zoom factor, through the stepless zoom parameter input module 20 of the digital zoom imaging device 10, and the image cropping unit 16 processes the input zoom parameter, such as converting it into a corresponding cropping parameter.
  • the first image is cropped and the cropping parameters are transmitted to the control unit 14.
  • the stepless zoom parameter input module 20 may include a stepless zoom parameter input component that can be displayed on the display unit 18, for example, it may be a sliding bar displayed on the screen of the display unit 18, and digital zoom is realized through the operation of the sliding bar by the user.
  • the slide bar can be operated by the user's finger, and it can be continuously changed on the screen, that is, steplessly adjusted, so as to achieve stepless adjustment of digital zoom parameters.
  • the digital zoom imaging device 10 according to the present invention may further include a mechanical zoom input mechanism for adjusting the zoom parameters of digital zooming of the first image, for example, it may be a dial wheel or a lever.
  • a touch screen needs to be used to set the sliding bar, and the digital zoom parameters can be executed by directly operating the sliding bar on the touch screen with a finger input of.
  • digital zoom parameters can be input by turning the dial wheel, and the zoom effect can be observed through the display unit 18.
  • a non-touch general The display screen is fine.
  • the working principle and working process of the digital zoom imaging device 10 will be exemplified below.
  • the stepless zoom parameter input component 20, such as a slide bar displayed on the display unit 18 receives the digital zoom instruction from the outside, the zoomed image needs to be processed and displayed.
  • the display unit 18 transmits the zoom parameter to the zoom parameter receiving unit 12, where the zoom parameter receiving unit 12 can digitally process the zoom parameter and send the digitally processed zoom parameter to the image trimming unit 16.
  • the image cropping unit 16 analyzes the zoom parameters and converts them into cropping parameters. At the same time, the image cropping unit 16 performs cropping processing on the first image that needs to be zoomed.
  • the image cropping unit 16 After the image cropping unit 16 obtains the cropping parameters for the first image, the image cropping unit 16 transmits the cropping parameters to the control unit 14, and the control unit 14 controls its first optimization module 142, second optimization module 143, and 143 respectively according to the cropping parameters.
  • the first focus module 144, the second focus module 145, the first exposure module 146, and the second exposure module 147 operate, wherein at least two of the first optimization module 142, the first focus module 144, and the first exposure module 146 The actions are synchronized.
  • the first optimization module 142 performs the first optimization process, that is, determines the second image coordinate reference datum for the second image according to the cropping parameters.
  • the second optimization module 143 corrects the image cropped from the first image based on the operation of the first optimization module 142, and then optimizes the image quality of the corrected image to obtain the second image.
  • the action of the first focusing module 144 it can be divided into two situations.
  • One is the digital zoom imaging device 10 adopting the phase focusing mode.
  • the phase focus coordinate parameter reference of the second image, and then the phase of the phase focus module of the camera unit is calculated according to the phase focus coordinate parameter reference and the cropping parameter, so that the second focus module 145 can adjust the lens focus, thereby realizing the lens focusing action;
  • another is a digital zoom imaging device 10 that adopts a contrast focusing mode.
  • the first focusing module 144 also performs the first focusing process, that is, acquiring the contrast focusing coordinate parameter reference for the second image according to the cropping parameters, and then passing the second focusing module 145 To perform subsequent operations, the second focus module 145 performs correction data on the image cropped from the first image according to the contrast focus coordinate parameter reference of the second image and the second optimization module 143 to correct the contrast value of the contrast focus module of the camera unit, and The related focus parameters are counted, and the focus operation of the camera unit is realized based on the contrast value and the focus parameters.
  • the above-mentioned setting of the second focus processing step compares the single focus coordinate parameter reference based on the contrast of the second image or based on the correction data of the image cropped from the first image by the second optimization module 143 to focus on the contrast of the camera unit.
  • Statistics on the contrast value of the module and its related focus parameters can further enhance the accuracy of contrast focus, thereby improving the user experience of stepless zoom.
  • the first exposure module 146 performs the first exposure process, that is, according to the focus position of the object to be imaged corresponding to the digitally zoomed image, determines the ambient light amount sampling coordinate reference, and performs the sampling of the ambient light amount based on the ambient light amount sampling coordinate reference, and then passes
  • the second exposure module 147 executes the steps of the second exposure processing, that is, the exposure value is calculated according to the ambient light sampling coordinate reference and the data corrected by the second optimization module 143 on the image cropped from the first image, and the exposure value of the camera unit is calculated based on the exposure value.
  • the sensitivity of the sensor is adjusted in order to obtain the corresponding image.
  • the above setting of the second exposure processing step can further improve the exposure value and the actual scene compared to the single calculation of the exposure value based on the ambient light amount sampling coordinate reference or the data corrected by the second optimization module 143 on the image cropped from the first image.
  • the amount of ambient light fits to improve the user experience of stepless zoom.
  • the second focus module 145 and the second exposure module 147 both use the data related to the image correction in the second optimization module 143, that is, In other words, after the second optimization module 143 corrects the image cropped from the first image and sends the relevant correction data to the second focus module 145 and the second exposure module 147, the second optimization module 143, the second focus module 145, and the The subsequent operations of the second exposure module 147 are independent of each other. Similarly, it is preferable to perform the subsequent operations of the second optimization module 143, the second focus module 145, and the second exposure module 147 as synchronously as possible, so as to further shorten the time required from the input of the zoom parameters to the final exposure and imaging. That is to achieve the imaging effect of what you see and what you get.
  • the digital zoom imaging method includes the following steps. First, a digital zoom parameter is received.
  • the digital zoom parameter can be input from the outside or generated by the digital camera itself; at least two of steps S1-S3 are executed in parallel according to the digital zoom parameter.
  • the digital zoom imaging method is similar to the above description of the operation steps of the digital zoom imaging device 10 of the present invention, and the expanded description of related steps will not be repeated.
  • the following steps are further included, that is, obtaining the cropping parameters of the first image according to the digital zoom parameters, and performing cropping processing on the first image according to the cropping parameters.
  • the step of optimizing the image quality of the first image in step S1 includes a first optimization step
  • the step of generating focus parameters of the camera unit in step S2 includes a first focusing step
  • the step of generating exposure parameters of the camera unit in step S3 includes The first exposure step, here, performing at least two of the steps S1-S3 in parallel includes simultaneously performing at least two of the first optimization step, the first focusing step, and the first exposure step. It should be noted that performing at least two of steps S1-S3 in parallel includes performing a part of each of at least two of steps S1-S3 at the same time.
  • the above-mentioned first optimization step includes adjusting the image coordinate reference datum according to the cropping parameters to determine a second image coordinate reference datum that is different from the first image coordinate reference datum of the first image.
  • the above-mentioned first focusing step includes adjusting the first focus coordinate parameter reference of the first image according to the cropping parameter to obtain the second focus coordinate parameter reference.
  • the above-mentioned first optimization step is applicable to both the digital camera adopting the phase focusing mode and the digital camera adopting the contrast focusing mode.
  • the first focusing step further includes calculating the phase of the phase focusing module of the camera unit according to the second focusing coordinate parameter reference and the cropping parameter.
  • the above-mentioned first exposure step includes determining the ambient light amount sampling coordinate reference based on the focus position of the object to be imaged corresponding to the digitally zoomed image, and sampling the ambient light amount based on the ambient light amount sampling coordinate reference.
  • the step of optimizing the image quality of the first image further includes a second optimization step, and the second optimization step includes correcting the image cropped from the first image based on the second image coordinate reference standard.
  • the second optimization step further includes the step of optimizing the image quality of the corrected image to obtain a second image.
  • the step of generating the focus parameters of the camera unit further includes a second focusing step.
  • the second focusing step includes a reference to the second focus coordinate parameter and/or an image cropped from the first image.
  • the contrast value of the contrast focusing module of the camera unit and the related focusing parameters are counted, and the focusing operation of the camera unit is realized based on the contrast contrast value and the focusing parameters.
  • the step of generating the exposure parameters of the camera unit further includes a second exposure step including calculating an exposure value according to the ambient light amount sampling coordinate reference and/or data for correcting the image cropped from the first image. Then, the second exposure step further includes adjusting the sensitivity of the sensor of the imaging unit according to the calculated exposure value, so as to obtain an image of desired image quality.
  • the step of receiving a digital zoom parameter may include receiving a steplessly changing digital zoom parameter.
  • the input of zoom parameters can be performed in the following ways. One is to receive the input of continuously variable digital zoom parameters through a stepless zoom parameter input component that can be displayed on the display unit, and the other is to use a mechanical zoom input mechanism. Receive input of stepless change of digital zoom parameters.
  • the digital zoom imaging method according to the present invention further includes a step of displaying the first image before the step of receiving digital zoom parameters.
  • the digital zoom imaging method can sufficiently shorten the zoom by executing at least two of the step of optimizing image quality, the step of generating focus parameters, and the step of generating exposure parameters in parallel, or at least a part of each of the at least two steps.
  • Improved user experience In addition, it can be combined with a display unit, and by displaying images before and after zooming, the effect of zoom imaging is achieved, and the user-friendliness of the digital zoom imaging method is further improved.
  • the present invention also relates to a computer-readable storage medium storing executable instructions, and executing the above-mentioned executable instructions can realize the digital zoom imaging method as described above.
  • the present invention also discloses a camera 30.
  • the camera 30 includes an optical module 32 for performing digital zoom imaging of the camera 30, and the optical module 32 includes The zoom parameter receiving unit 12 receiving the digital zoom parameter and the control unit 14 communicatively connected with the zoom parameter receiving unit 12, the control unit 14 is configured to execute at least two of the following steps S1-S3 in parallel according to the digital zoom parameter, where S1 .
  • S1 Optimize the image quality of the first image, the first image is obtained by the camera unit of the camera; S2. Generate the focus parameters of the camera unit; and, S3. Generate the exposure parameters of the camera unit.
  • the optical module 32 has basically the same structure as the digital zoom imaging device 10 described above, and therefore, the same content will not be repeated here.
  • the optical module 32 of the camera 30 further includes an image cropping unit, which is communicatively connected with the zoom parameter receiving unit and the control unit, and is configured to execute at least two of steps S1-S3 in parallel by the control unit.
  • image cropping unit communicatively connected with the zoom parameter receiving unit and the control unit, and is configured to execute at least two of steps S1-S3 in parallel by the control unit.
  • the cropping parameters of the first image were obtained according to the digital zoom parameters, and the first image was cropped according to the cropping parameters.
  • the control unit of the optical module 32 includes: a first optimization module, configured to perform a first optimization process on a first image; a first focus module, configured to perform a first focus process for generating focus parameters of the camera unit; and a first The exposure module is configured to perform a first exposure process for generating exposure parameters of the camera unit, wherein at least two of the first optimization process, the first focus process, and the first exposure process are simultaneously performed.
  • the first optimization process includes adjusting the image coordinate reference datum according to the cropping parameter to determine a second image coordinate reference datum that is different from the first image coordinate reference datum of the first image.
  • the first focus processing includes adjusting the first focus coordinate parameter reference of the first image according to the cropping parameter to obtain the second focus coordinate parameter reference.
  • the first focusing processing further includes calculating the phase of the phase focusing module of the camera unit according to the second focusing coordinate parameter reference and the cropping parameter.
  • the focusing operation of the optical module is realized according to the calculated phase.
  • the first exposure processing includes determining an ambient light amount sampling coordinate reference based on the focus position of the object to be imaged corresponding to the digitally zoomed image, and sampling the ambient light amount based on the ambient light amount sampling coordinate reference.
  • the control unit of the optical module 32 further includes a second optimization module, which corrects the image cropped from the first image based on the second image coordinate reference datum.
  • the second optimization module further optimizes the image quality of the corrected image to obtain the second image.
  • the first focus processing performed by the first focus module also includes the following steps, that is, the first focus coordinate parameter reference of the first image is adjusted according to the cropping parameter to obtain the first focus 2.
  • the focus coordinate parameter reference Further, the control unit further includes a second focus module, the second focus module according to the second focus coordinate parameter reference and/or correction data of the image cropped from the first image, the contrast of the camera unit contrast focus module contrast The value and the related focus parameters are counted, and the focus operation of the camera unit is realized based on the contrast value and the focus parameter.
  • the first exposure processing further includes determining an ambient light amount sampling coordinate reference based on the focus position of the object to be imaged corresponding to the digitally zoomed image, and sampling the ambient light amount based on the ambient light amount sampling coordinate reference.
  • the control unit of the optical module 32 of the camera 30 according to the present invention also includes a second exposure module that calculates data based on the sampling coordinate reference of the ambient light amount and/or the image clipped from the first image Exposure value. Further, the second exposure module can also adjust the sensitivity of the sensor of the camera unit according to the calculated exposure value, so as to obtain an image of desired image quality.
  • the camera 30 further includes a stepless zoom parameter input module for inputting a steplessly changing digital zoom parameter to the zoom parameter receiving unit.
  • the stepless zoom parameter receiving module may include a stepless zoom parameter input component that can be displayed on the display unit of the camera, or may include a mechanical zoom input mechanism.
  • the camera 30 may further include a display unit for displaying the first image, and the display unit may simultaneously display an image after the first image is zoomed.
  • the various components of the digital zoom imaging device 10 may be integratedly configured in the same device.
  • the device may be, for example, a camera, a video camera, or a smart device with an image capturing function. Terminal equipment, such as mobile phones, tablets, or laptops.
  • Terminal equipment such as mobile phones, tablets, or laptops.
  • the various components of the aforementioned digital zoom imaging device 10 can also be configured in different equipment.
  • the camera unit of the aforementioned digital zoom imaging device 10 can be configured in an unmanned aerial vehicle, and the display unit 18 can be configured to be able to interact with the unmanned aerial vehicle.
  • control terminal for example, a remote control or a smart terminal installed with a control program
  • other components of the digital zoom imaging device 10 can be configured in the unmanned aerial vehicle or in the control terminal.
  • the present invention is here. No particular limitation is made.
  • the unmanned aerial vehicle system can carry payloads used to perform specific tasks through the carrier.
  • the unmanned aerial vehicle system may carry a photographing device through a pan/tilt.
  • the photographing device is, for example, the digital zoom imaging device 10 according to an embodiment of the present invention.
  • FIG. 9 is a schematic structural diagram of an unmanned aerial vehicle system 40 according to an embodiment of the present invention.
  • the unmanned aerial vehicle system 40 may include an unmanned aerial vehicle 42, a pan/tilt device 44 carried by the unmanned aerial vehicle 42, a photographing device, and a control for communicating and controlling the unmanned aerial vehicle 42, the pan/tilt device 44, and the photographing device.
  • the photographing device of the UAV system 40 is the digital zoom imaging device 10 according to the embodiment of the present invention, or may have basically the same structure as the digital zoom imaging device 10, wherein the digital zoom imaging device 10
  • the camera unit of the device 10 is configured in the pan-tilt device 44, and the display unit 18 of the digital zoom imaging device 10 is configured in the control device 46.
  • the zoom parameter receiving unit 12 of the digital zoom imaging device 10 may be integrated in the display unit 18, the control unit 14 may be integrated with the camera unit, and other components of the digital zoom imaging device 10 may be set according to actual requirements.
  • the digital zoom imaging device 10 is provided with a mechanical zoom input mechanism, the mechanical zoom input mechanism is also provided in the control device 46.
  • the control device 46 can be combined with the unmanned aerial vehicle 42, the pan/tilt device 44, and the pan/tilt device 44.
  • the camera unit on the computer is connected in communication to control the unmanned aerial vehicle 42, the pan-tilt device 44 and the camera unit.
  • the display unit 18 and the control device 46 can also be arranged independently of each other, and the mutual relationship between the two is not particularly limited here.
  • the unmanned aerial vehicle 42 can perform related flight operations according to pre-programmed program instructions, or can also control the unmanned aerial vehicle 42 by responding to one or more control instructions from the control device 46.
  • the pan/tilt device 44 can also move in response to instructions from the control device 46 to drive the camera unit to perform the required movement or action.
  • the flight trajectory and related flight status of the unmanned aerial vehicle 42 can be controlled by the control device 46, and at the same time, the control device 46 can control the related actions of the pan/tilt device 44.
  • the control device 46 can control the related actions of the pan/tilt device 44.
  • another control device dedicated to controlling the pan-tilt device 44 can also be provided, so that the pan-tilt device 44 drives the camera unit to perform related shooting tasks as required.
  • the viewfinder of the camera unit can be observed through the display unit 18 provided in the control device 46, and the camera unit can be activated in a timely manner according to actual needs in order to capture the desired image.
  • the image displayed on the display unit 18 can be digitally zoomed to display the digitally zoomed image on the display unit 18.
  • the imaging unit completes the imaging operation of the object to be imaged.
  • the specific imaging process please refer to the above description of the imaging process of the digital zoom imaging device 10, which will not be repeated here.
  • the size of the sequence numbers of the above-mentioned processes does not mean the order of execution.
  • the execution order of the processes should be determined by their functions and internal logic, and should not be used in the present invention.
  • the implementation process of the embodiment constitutes any limitation.
  • the disclosed system, device, and method may be implemented in other ways.
  • the device embodiments described above are only illustrative.
  • the division of the units is only a logical function division, and there may be other divisions in actual implementation, for example, multiple units or components may be combined or may be Integrate into another system, or some features can be ignored or not implemented.
  • the displayed or discussed mutual associations or communication connections may be indirect associations or communication connections through some interfaces, devices or units, and may be in electrical, mechanical or other forms.
  • the units described as separate components may or may not be physically separate, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the objectives of the solutions of the embodiments.
  • each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units may be integrated into one unit.

Abstract

Provided in the present invention is a digital zoom imaging method, the method comprising the following steps: receiving digital zoom parameters; on the basis of the digital zoom parameters, executing at least two of steps S1-S3 in parallel: S1: optimising the image quality of a first image, the first image being acquired by a photographic unit; S2: generating focusing parameters of the photographic unit; and S3: generating exposure parameters of the photographic unit. The method of the present invention greatly shortens the time required by a photographic device for the process from inputting zoom parameters to executing the zoom action and then presenting the zoom effect to the user, enhancing the user experience of the photographic device. Also provided are a computer readable storage medium for executing the present method, a digital zoom imaging apparatus, an unmanned aerial vehicle system comprising said apparatus, and a camera.

Description

数字变焦成像方法、装置、相机以及无人飞行器系统Digital zoom imaging method, device, camera and unmanned aerial vehicle system 技术领域Technical field
本发明涉及图像处理领域，更具体地，涉及一种数字变焦成像方法、相应的数字变焦成像装置以及包括这种成像装置的相机和无人飞行器系统。The present invention relates to the field of image processing, and more specifically, to a digital zoom imaging method, a corresponding digital zoom imaging device, and a camera and an unmanned aerial vehicle system including the imaging device.
背景技术Background technique
目前，摄像设备已普遍具有数字变焦功能，当用于需要对待成像客体的图像进行放大或缩小时，需要对相关图像进行变焦操作，比如用户可以通过手指操作摄像设备的触摸屏或者通过操作数字变焦拨轮或拨杆来对图像进行数字变焦操作，当完成数字变焦操作之后，可以操作快门，以便对所需图像进行拍摄。At present, camera equipment generally has a digital zoom function. When it is used to zoom in or zoom out the image of the object to be imaged, the related image needs to be zoomed. For example, the user can operate the touch screen of the camera device with a finger or operate the digital zoom dial. Use the wheel or lever to digitally zoom the image. After the digital zoom operation is completed, you can operate the shutter to take the desired image.
现有的变焦操作流程通常仅能够对图像进行梯级式的数字变焦，比如摄像设备能够对图像进行1倍-10倍的数字变焦，但是该摄像设备仅能对图像进行1.1倍、1.2倍……的梯级式变焦处理，而不能依据客户的需求进行任意倍数的变焦，也就是说，现有的摄像设备的数字变焦参数仅为多个固定数值，数字变焦参数不支持无级修改，即不能对图像进行连续的数字变焦。因此这对数字变焦要求较高的用户带来了不便。The existing zoom operation process can usually only perform step-wise digital zoom on the image. For example, a camera device can perform digital zoom from 1 to 10 times, but the camera device can only perform 1.1 times, 1.2 times on the image... The cascade zoom processing can not be performed at any multiple zoom according to the customer’s needs. That is to say, the digital zoom parameters of the existing camera equipment are only multiple fixed values, and the digital zoom parameters do not support stepless modification. The image is continuously digitally zoomed. Therefore, this brings inconvenience to users with high digital zoom requirements.
另外，现有摄像设备的数字变焦处理过程较长，具体表现为从设置数字变焦参数，到内部处理变焦，再到向用户反馈数字变焦结果的整个处理过程耗时较长，或者无法对摄像设备的自动对焦、自动曝光和变焦结果呈现过程进行联动，使得用户在设置数字变焦参数之后延迟较长时间才能获得变焦效果。进一步地，用户在获得变焦效果之后需要对变焦效果进行评估，如果变焦效果达不到用户的需求，则用户需要重复上述数字变焦过程，现有摄像设备的这种串行式变焦处理流程给使用者带来非常不好的用户体验。In addition, the digital zoom processing process of the existing camera equipment is relatively long. The specific performance is that the entire processing process from setting digital zoom parameters, to internal processing of the zoom, and then to feedback the digital zoom result to the user takes a long time, or the camera cannot be The auto-focus, auto-exposure, and zoom result presentation processes are linked, so that the user can obtain the zoom effect after a long delay after setting the digital zoom parameters. Further, the user needs to evaluate the zoom effect after obtaining the zoom effect. If the zoom effect does not meet the user's needs, the user needs to repeat the above-mentioned digital zoom process. This serial zoom processing flow of the existing camera equipment is used It brings a very bad user experience.
因此，现有技术中需要提供一种能够进行图像的无级数字变焦并且大大缩短数字变焦过程的时间的摄像设备。Therefore, there is a need in the prior art to provide an imaging device that can perform stepless digital zooming of images and greatly shorten the time of the digital zooming process.
发明内容Summary of the invention
为了解决上述技术问题中的至少一个方面，本发明的实施例提供了一种数字变焦成像方法，该方法包括以下步骤：In order to solve at least one aspect of the above technical problems, an embodiment of the present invention provides a digital zoom imaging method, which includes the following steps:
接收数字变焦参数；Receive digital zoom parameters;
根据所述数字变焦参数并行地执行步骤S1-S3中的至少两个：Perform at least two of steps S1-S3 in parallel according to the digital zoom parameter:
S1.优化第一图像的画质，所述第一图像通过摄像单元获取；S1. Optimize the image quality of the first image, the first image being acquired by the camera unit;
S2.生成所述摄像单元的对焦参数；和S2. Generate focus parameters of the camera unit; and
S3.生成所述摄像单元的曝光参数。S3. Generate exposure parameters of the camera unit.
根据本发明的数字变焦成像方法通过并行地执行图像的剪裁处理和画质优化处理以及摄像单元的对焦参数和曝光参数的调整，大大缩短了摄像设备从输入变焦参数到执行变焦动作和曝光成像动作的整个过程所需的时间，为用户带来了变焦既成像的拍摄效果，大大改善了摄像设备的用户体验，消除了由于串行地执行画质优化、变焦和曝光步骤而导致的成像拖尾现象。According to the digital zoom imaging method of the present invention, by performing image cropping processing and image quality optimization processing, and adjustment of the focus parameters and exposure parameters of the camera unit in parallel, it greatly shortens the camera device from inputting zoom parameters to performing zooming actions and exposure imaging actions. The time required for the entire process brings users the shooting effect of both zoom and imaging, greatly improves the user experience of the camera equipment, and eliminates the imaging smear caused by the serial execution of image quality optimization, zoom and exposure steps Phenomenon.
根据本发明的数字变焦成像方法的一个实施例，在并行地执行步骤S1-S3中的至少两个之前还包括步骤：根据所述数字变焦参数获取所述第一图像的剪裁参数，并根据所述剪裁参数对所述第一图像进行剪裁处理。According to an embodiment of the digital zoom imaging method of the present invention, before at least two of the steps S1-S3 are executed in parallel, the method further includes the step of: acquiring the cropping parameter of the first image according to the digital zoom parameter, and The cropping parameter performs cropping processing on the first image.
根据本发明的数字变焦成像方法的一个实施例，优化第一图像的画质的步骤包括第一优化步骤；According to an embodiment of the digital zoom imaging method of the present invention, the step of optimizing the image quality of the first image includes a first optimization step;
生成所述摄像单元的对焦参数的步骤包括第一对焦步骤；以及The step of generating the focusing parameters of the camera unit includes a first focusing step; and
生成所述摄像单元的曝光参数的步骤包括第一曝光步骤；The step of generating the exposure parameters of the camera unit includes a first exposure step;
其中，并行地执行步骤S1-S3中的至少两个包括同时执行所述第一优化步骤、所述第一对焦步骤和所述第一曝光步骤中的至少两个。Wherein, performing at least two of steps S1-S3 in parallel includes simultaneously performing at least two of the first optimization step, the first focusing step, and the first exposure step.
根据本发明的数字变焦成像方法的一个实施例，所述第一优化步骤包括：根据所述剪裁参数对图像坐标参考基准进行调整，以确定不同于所述第一图像的第一图像坐标参考基准的第二图像坐标参考基准。According to an embodiment of the digital zoom imaging method of the present invention, the first optimization step includes: adjusting an image coordinate reference datum according to the cropping parameter to determine a first image coordinate reference datum different from the first image The second image coordinate reference datum.
根据本发明的数字变焦成像方法的一个实施例，所述第一对焦步骤 包括：根据所述剪裁参数对所述第一图像的第一对焦坐标参数基准进行调整，以获得第二对焦坐标参数基准。According to an embodiment of the digital zoom imaging method of the present invention, the first focusing step includes: adjusting a first focus coordinate parameter reference of the first image according to the cropping parameter to obtain a second focus coordinate parameter reference .
根据本发明的数字变焦成像方法的一个实施例，所述第一对焦步骤还包括：根据所述第二对焦坐标参数基准和所述剪裁参数计算所述摄像单元的相位对焦模块的相位。According to an embodiment of the digital zoom imaging method of the present invention, the first focusing step further includes: calculating the phase of the phase focusing module of the camera unit according to the second focusing coordinate parameter reference and the cropping parameter.
根据本发明的数字变焦成像方法的一个实施例，所述第一曝光步骤包括：根据数字变焦后的图像所对应的待成像客体的对焦位置确定环境光量采样坐标基准，并基于所述环境光量采样坐标基准进行环境光量的采样。According to an embodiment of the digital zoom imaging method of the present invention, the first exposure step includes: determining an ambient light amount sampling coordinate reference based on the focus position of the object to be imaged corresponding to the digitally zoomed image, and sampling based on the ambient light amount The coordinate base performs sampling of the amount of ambient light.
根据本发明的数字变焦成像方法的一个实施例，优化第一图像的画质的步骤还包括第二优化步骤，所述第二优化步骤包括：基于所述第二图像坐标参考基准对由所述第一图像剪裁的图像进行矫正。According to an embodiment of the digital zoom imaging method of the present invention, the step of optimizing the image quality of the first image further includes a second optimization step, and the second optimization step includes: The trimmed image of the first image is corrected.
根据本发明的数字变焦成像方法的一个实施例，所述第二优化步骤还包括：对矫正后的图像进行画质优化，以获得第二图像。According to an embodiment of the digital zoom imaging method of the present invention, the second optimization step further includes: optimizing the image quality of the corrected image to obtain the second image.
根据本发明的数字变焦成像方法的一个实施例，所述第一对焦步骤包括：根据所述剪裁参数对所述第一图像的第一对焦坐标参数基准进行调整，以获得第二对焦坐标参数基准。According to an embodiment of the digital zoom imaging method of the present invention, the first focusing step includes: adjusting a first focus coordinate parameter reference of the first image according to the cropping parameter to obtain a second focus coordinate parameter reference .
根据本发明的数字变焦成像方法的一个实施例，生成所述摄像单元的对焦参数的步骤还包括第二对焦步骤，所述第二对焦步骤包括：根据所述第二对焦坐标参数基准和/或对由所述第一图像剪裁的图像进行矫正的数据，对所述摄像单元的反差对焦模块的对比度反差值以及与其相关的对焦参数进行统计，并基于所述对比度反差值和所述对焦参数实现所述摄像单元的对焦操作。According to an embodiment of the digital zoom imaging method of the present invention, the step of generating the focusing parameters of the camera unit further includes a second focusing step, and the second focusing step includes: according to the second focusing coordinate parameter reference and/or The data for correcting the image cropped from the first image, the contrast value of the contrast focus module of the camera unit and the related focus parameters are counted, and implemented based on the contrast contrast value and the focus parameter The focusing operation of the camera unit.
根据本发明的数字变焦成像方法的一个实施例，所述第一曝光步骤包括：根据数字变焦后的图像所对应的待成像客体的对焦位置确定环境光量采样坐标基准，并基于所述环境光量采样坐标基准进行环境光量的采样。According to an embodiment of the digital zoom imaging method of the present invention, the first exposure step includes: determining an ambient light amount sampling coordinate reference based on the focus position of the object to be imaged corresponding to the digitally zoomed image, and sampling based on the ambient light amount The coordinate base performs sampling of the amount of ambient light.
根据本发明的数字变焦成像方法的一个实施例，生成所述摄像单元的曝光参数的步骤还包括第二曝光步骤：所述第二曝光步骤包括：根据 所述环境光量采样坐标基准和/或对由所述第一图像剪裁的图像进行矫正的数据计算曝光值。According to an embodiment of the digital zoom imaging method of the present invention, the step of generating the exposure parameters of the camera unit further includes a second exposure step: the second exposure step includes: sampling coordinate references and/or pairings according to the amount of ambient light The exposure value is calculated from the data corrected by the image cropped from the first image.
根据本发明的数字变焦成像方法的一个实施例，所述第二曝光步骤还包括：根据计算出的曝光值对所述摄像单元的传感器的感光度进行调整，以便获得所需画质的图像。According to an embodiment of the digital zoom imaging method of the present invention, the second exposure step further includes: adjusting the sensitivity of the sensor of the imaging unit according to the calculated exposure value, so as to obtain an image of desired image quality.
根据本发明的数字变焦成像方法的一个实施例，接收数字变焦参数的步骤包括接收无级变化的数字变焦参数。According to an embodiment of the digital zoom imaging method of the present invention, the step of receiving a digital zoom parameter includes receiving a steplessly changing digital zoom parameter.
根据本发明的数字变焦成像方法的一个实施例，通过能够在显示单元上显示的无级数字变焦输入组件接收所述数字变焦参数的输入。According to an embodiment of the digital zoom imaging method of the present invention, the input of the digital zoom parameter is received through a stepless digital zoom input component that can be displayed on the display unit.
根据本发明的数字变焦成像方法的一个实施例，通过机械变焦输入机构接收所述数字变焦参数的输入。According to an embodiment of the digital zoom imaging method of the present invention, the input of the digital zoom parameter is received through a mechanical zoom input mechanism.
根据本发明的数字变焦成像方法的一个实施例，在接收数字变焦参数的步骤之前还包括对第一图像进行显示的步骤。According to an embodiment of the digital zoom imaging method of the present invention, before the step of receiving digital zoom parameters, the step of displaying the first image is further included.
本发明还涉及一种计算机可读存储介质，所述计算机可读存储介质存储有可执行指令，执行所述可执行指令以实现如上所述任一种数字变焦成像方法。The present invention also relates to a computer-readable storage medium, the computer-readable storage medium stores executable instructions, and the executable instructions are executed to implement any of the above-mentioned digital zoom imaging methods.
本发明公开了一种数字变焦成像装置，该数字变焦成像装置包括：The invention discloses a digital zoom imaging device. The digital zoom imaging device includes:
变焦参数接收单元，用于接收数字变焦参数；以及A zoom parameter receiving unit for receiving digital zoom parameters; and
控制单元，与所述变焦参数接收单元通信连接，用于根据所述数字变焦参数并行地执行步骤S1-S3中的至少两个：The control unit is in communication connection with the zoom parameter receiving unit, and is configured to execute at least two of steps S1-S3 in parallel according to the digital zoom parameter:
S1.优化第一图像的画质，所述第一图像通过摄像单元获取；S1. Optimize the image quality of the first image, the first image being acquired by the camera unit;
S2.生成所述摄像单元的对焦参数；和S2. Generate focus parameters of the camera unit; and
S3.生成所述摄像单元的曝光参数。S3. Generate exposure parameters of the camera unit.
根据本发明的数字变焦成像装置的一个实施例，还包括图像剪裁单元，所述图像剪裁单元与所述变焦参数接收单元和所述控制单元通信连接，用于在所述控制单元并行地执行步骤S1-S3中的至少两个之前根据所述数字变焦参数获取所述第一图像的剪裁参数，并根据所述剪裁参数对所述第一图像进行剪裁处理。According to an embodiment of the digital zoom imaging device of the present invention, it further includes an image cropping unit, the image cropping unit is communicatively connected with the zoom parameter receiving unit and the control unit, and is configured to execute the steps in parallel by the control unit At least two of S1-S3 previously obtained the cropping parameter of the first image according to the digital zoom parameter, and performed cropping processing on the first image according to the cropping parameter.
根据本发明的数字变焦成像装置的一个实施例，所述控制单元包括： 第一优化模块，用于对第一图像进行第一优化处理；第一对焦模块，用于执行生成所述摄像单元的对焦参数的第一对焦处理；以及第一曝光模块，用于执行生成所述摄像单元的曝光参数的第一曝光处理，According to an embodiment of the digital zoom imaging device of the present invention, the control unit includes: a first optimization module, configured to perform a first optimization process on a first image; a first focusing module, configured to execute the generation of the camera unit A first focusing process for focusing parameters; and a first exposure module for performing the first exposure process for generating the exposure parameters of the camera unit,
其中，同时执行所述第一优化处理、所述第一对焦处理和所述第一曝光处理中的至少两个。Wherein, at least two of the first optimization processing, the first focusing processing, and the first exposure processing are performed at the same time.
根据本发明的数字变焦成像装置的一个实施例，所述第一优化处理包括：根据所述剪裁参数对图像坐标参考基准进行调整，以确定不同于所述第一图像的第一图像坐标参考基准的第二图像坐标参考基准。According to an embodiment of the digital zoom imaging device of the present invention, the first optimization processing includes: adjusting an image coordinate reference datum according to the cropping parameter to determine a first image coordinate reference datum different from the first image The second image coordinate reference datum.
根据本发明的数字变焦成像装置的一个实施例，所述第一对焦处理包括：根据所述剪裁参数对所述第一图像的第一对焦坐标参数基准进行调整，以获得第二对焦坐标参数基准。According to an embodiment of the digital zoom imaging device of the present invention, the first focus processing includes: adjusting a first focus coordinate parameter reference of the first image according to the cropping parameter to obtain a second focus coordinate parameter reference .
根据本发明的数字变焦成像装置的一个实施例，所述第一对焦处理还包括：根据所述第二对焦坐标参数基准和所述剪裁参数计算所述摄像单元的相位对焦模块的相位。According to an embodiment of the digital zoom imaging device of the present invention, the first focus processing further includes: calculating the phase of the phase focus module of the camera unit according to the second focus coordinate parameter reference and the cropping parameter.
根据本发明的数字变焦成像装置的一个实施例，所述第一曝光处理包括：根据数字变焦后的图像所对应的待成像客体的对焦位置确定环境光量采样坐标基准，并基于所述环境光量采样坐标基准进行环境光量的采样。According to an embodiment of the digital zoom imaging device of the present invention, the first exposure processing includes: determining an ambient light amount sampling coordinate reference based on the focus position of the object to be imaged corresponding to the digitally zoomed image, and sampling based on the ambient light amount The coordinate base performs sampling of the amount of ambient light.
根据本发明的数字变焦成像装置的一个实施例，所述控制单元还包括第二优化模块，所述第二优化模块基于所述第二图像坐标参考基准对由所述第一图像剪裁的图像进行矫正。According to an embodiment of the digital zoom imaging device of the present invention, the control unit further includes a second optimization module that performs an image clipped from the first image based on the second image coordinate reference datum. Rectify.
根据本发明的数字变焦成像装置的一个实施例，所述第二优化模块对矫正后的图像进行画质优化，以获得第二图像。According to an embodiment of the digital zoom imaging device of the present invention, the second optimization module optimizes the image quality of the corrected image to obtain the second image.
根据本发明的数字变焦成像装置的一个实施例，所述第一对焦处理包括：根据所述剪裁参数对所述第一图像的第一对焦坐标参数基准进行调整，以获得第二对焦坐标参数基准。According to an embodiment of the digital zoom imaging device of the present invention, the first focus processing includes: adjusting a first focus coordinate parameter reference of the first image according to the cropping parameter to obtain a second focus coordinate parameter reference .
根据本发明的数字变焦成像装置的一个实施例，所述控制单元还包括第二对焦模块，所述第二对焦模块根据所述第二对焦坐标参数基准和/或对由所述第一图像剪裁的图像进行矫正的数据，对所述摄像单元的 反差对焦模块的对比度反差值以及与其相关的对焦参数进行统计，并基于所述对比度反差值和所述对焦参数实现所述摄像单元的对焦操作。According to an embodiment of the digital zoom imaging device of the present invention, the control unit further includes a second focusing module, the second focusing module according to the second focusing coordinate parameter reference and/or cutting from the first image Based on the correction data of the image of the camera unit, the contrast value of the contrast focusing module of the camera unit and the related focusing parameters are counted, and the focusing operation of the camera unit is implemented based on the contrast value and the focusing parameter.
根据本发明的数字变焦成像装置的一个实施例，所述第一曝光处理包括：根据数字变焦后的图像所对应的待成像客体的对焦位置确定环境光量采样坐标基准，并基于所述环境光量采样坐标基准进行环境光量的采样。According to an embodiment of the digital zoom imaging device of the present invention, the first exposure processing includes: determining an ambient light amount sampling coordinate reference based on the focus position of the object to be imaged corresponding to the digitally zoomed image, and sampling based on the ambient light amount The coordinate base performs sampling of the amount of ambient light.
根据本发明的数字变焦成像装置的一个实施例，所述控制单元还包括第二曝光模块，所述第二曝光模块根据所述环境光量采样坐标基准和/或对由所述第一图像剪裁的图像进行矫正的数据计算曝光值。According to an embodiment of the digital zoom imaging device of the present invention, the control unit further includes a second exposure module that samples the coordinate reference according to the amount of ambient light and/or adjusts the data clipped from the first image The image correction data calculates the exposure value.
根据本发明的数字变焦成像装置的一个实施例，所述第二曝光模块还根据计算出的曝光值对所述摄像单元的传感器的感光度进行调整，以便获得所需画质的图像。According to an embodiment of the digital zoom imaging device of the present invention, the second exposure module further adjusts the sensitivity of the sensor of the camera unit according to the calculated exposure value, so as to obtain an image of desired image quality.
根据本发明的数字变焦成像装置的一个实施例，还包括用于向所述变焦参数接收单元输入无级变化的数字变焦参数的无级变焦参数输入模块。According to an embodiment of the digital zoom imaging device of the present invention, it further includes a stepless zoom parameter input module for inputting the steplessly changing digital zoom parameter to the zoom parameter receiving unit.
根据本发明的数字变焦成像装置的一个实施例，所述无级变焦参数输入模块包括能够在显示单元上显示的无级数字变焦输入组件。According to an embodiment of the digital zoom imaging device of the present invention, the stepless zoom parameter input module includes a stepless digital zoom input component that can be displayed on a display unit.
根据本发明的数字变焦成像装置的一个实施例，所述无级变焦参数输入模块包括机械变焦输入机构。According to an embodiment of the digital zoom imaging device of the present invention, the stepless zoom parameter input module includes a mechanical zoom input mechanism.
根据本发明的数字变焦成像装置的一个实施例，还包括用于显示第一图像的显示单元。According to an embodiment of the digital zoom imaging device of the present invention, it further includes a display unit for displaying the first image.
本发明还涉及一种相机，该相机包括光学模组，所述光学模组用于执行所述相机的数字变焦成像，所述光学模组包括：The present invention also relates to a camera, which includes an optical module for performing digital zoom imaging of the camera, and the optical module includes:
变焦参数接收单元，用于接收数字变焦参数；以及A zoom parameter receiving unit for receiving digital zoom parameters; and
控制单元，与所述变焦参数接收单元通信连接，用于根据所述数字变焦参数并行地执行步骤S1-S3中的至少两个：The control unit is in communication connection with the zoom parameter receiving unit, and is configured to execute at least two of steps S1-S3 in parallel according to the digital zoom parameter:
S1.优化第一图像的画质，所述第一图像通过所述相机的摄像单元获取；S1. Optimize the image quality of the first image, the first image being acquired by the camera unit of the camera;
S2.生成所述摄像单元的对焦参数；和S2. Generate focus parameters of the camera unit; and
S3.生成所述摄像单元的曝光参数。S3. Generate exposure parameters of the camera unit.
根据本发明的相机的一个实施例，所述光学模组还包括图像剪裁单元，所述图像剪裁单元与所述变焦参数接收单元和所述控制单元通信连接，用于在所述控制单元并行地执行步骤S1-S3中的至少两个之前根据所述数字变焦参数获取所述第一图像的剪裁参数，并根据所述剪裁参数对所述第一图像进行剪裁处理。According to an embodiment of the camera of the present invention, the optical module further includes an image cropping unit, the image cropping unit is communicatively connected to the zoom parameter receiving unit and the control unit, and is configured to perform a parallel connection between the control unit and the zoom parameter receiving unit. Before performing at least two of steps S1-S3, the cropping parameter of the first image is acquired according to the digital zoom parameter, and the first image is cropped according to the cropping parameter.
根据本发明的相机的一个实施例，所述控制单元包括：第一优化模块，用于对第一图像进行第一优化处理；第一对焦模块，用于执行生成所述摄像单元的对焦参数的第一对焦处理；以及第一曝光模块，用于执行生成所述摄像单元的曝光参数的第一曝光处理，According to an embodiment of the camera of the present invention, the control unit includes: a first optimization module, configured to perform first optimization processing on a first image; A first focusing process; and a first exposure module for performing a first exposure process for generating exposure parameters of the camera unit,
其中，同时执行所述第一优化处理、所述第一对焦处理和所述第一曝光处理中的至少两个。Wherein, at least two of the first optimization processing, the first focusing processing, and the first exposure processing are performed at the same time.
根据本发明的相机的一个实施例，所述第一优化处理包括：根据所述剪裁参数对图像坐标参考基准进行调整，以确定不同于所述第一图像的第一图像坐标参考基准的第二图像坐标参考基准。According to an embodiment of the camera of the present invention, the first optimization processing includes: adjusting an image coordinate reference datum according to the cropping parameter to determine a second image coordinate reference datum that is different from the first image coordinate reference datum of the first image. Image coordinate reference datum.
根据本发明的相机的一个实施例，所述第一对焦处理包括：根据所述剪裁参数对所述第一图像的第一对焦坐标参数基准进行调整，以获得第二对焦坐标参数基准。According to an embodiment of the camera of the present invention, the first focus processing includes: adjusting a first focus coordinate parameter reference of the first image according to the cropping parameter to obtain a second focus coordinate parameter reference.
根据本发明的相机的一个实施例，所述第一对焦处理还包括：根据所述第二对焦坐标参数基准和所述剪裁参数计算所述摄像单元的相位对焦模块的相位。According to an embodiment of the camera of the present invention, the first focus processing further includes: calculating the phase of the phase focus module of the camera unit according to the second focus coordinate parameter reference and the cropping parameter.
根据本发明的相机的一个实施例，所述第一曝光处理包括：根据数字变焦后的图像所对应的待成像客体的对焦位置确定环境光量采样坐标基准，并基于所述环境光量采样坐标基准进行环境光量的采样。According to an embodiment of the camera of the present invention, the first exposure processing includes: determining an ambient light amount sampling coordinate reference based on the focus position of the object to be imaged corresponding to the digitally zoomed image, and performing it based on the ambient light amount sampling coordinate reference Sampling of the amount of ambient light.
根据本发明的相机的一个实施例，所述控制单元还包括第二优化模块，所述第二优化模块基于所述第二图像坐标参考基准对由所述第一图像剪裁的图像进行矫正。According to an embodiment of the camera of the present invention, the control unit further includes a second optimization module that corrects the image clipped from the first image based on the second image coordinate reference datum.
根据本发明的相机的一个实施例，所述第二优化模块对矫正后的图像进行画质优化，以获得第二图像。According to an embodiment of the camera of the present invention, the second optimization module optimizes the image quality of the corrected image to obtain the second image.
根据本发明的相机的一个实施例，所述第一对焦处理包括：根据所述剪裁参数对所述第一图像的第一对焦坐标参数基准进行调整，以获得第二对焦坐标参数基准。According to an embodiment of the camera of the present invention, the first focus processing includes: adjusting a first focus coordinate parameter reference of the first image according to the cropping parameter to obtain a second focus coordinate parameter reference.
根据本发明的相机的一个实施例，所述控制单元还包括第二对焦模块，所述第二对焦模块根据所述第二对焦坐标参数基准和/或对由所述第一图像剪裁的图像进行矫正的数据，对所述摄像单元的反差对焦模块的对比度反差值以及与其相关的对焦参数进行统计，并基于所述对比度反差值和所述对焦参数实现所述摄像单元的对焦操作。According to an embodiment of the camera of the present invention, the control unit further includes a second focusing module, which performs an operation on the image clipped from the first image according to the second focusing coordinate parameter reference and/or The corrected data collects statistics on the contrast value of the contrast focusing module of the camera unit and the related focusing parameters, and implements the focusing operation of the camera unit based on the contrast value and the focusing parameter.
根据本发明的相机的一个实施例，所述第一曝光处理包括：根据数字变焦后的图像所对应的待成像客体的对焦位置确定环境光量采样坐标基准，并基于所述环境光量采样坐标基准进行环境光量的采样。According to an embodiment of the camera of the present invention, the first exposure processing includes: determining an ambient light amount sampling coordinate reference based on the focus position of the object to be imaged corresponding to the digitally zoomed image, and performing it based on the ambient light amount sampling coordinate reference Sampling of the amount of ambient light.
根据本发明的相机的一个实施例，所述控制单元还包括第二曝光模块，所述第二曝光模块根据所述环境光量采样坐标基准和/或对由所述第一图像剪裁的图像进行矫正的数据计算曝光值。According to an embodiment of the camera of the present invention, the control unit further includes a second exposure module that performs correction on the image clipped from the first image according to the ambient light amount sampling coordinate reference Calculate the exposure value from the data.
根据本发明的相机的一个实施例，所述第二曝光模块还根据计算出的曝光值对所述摄像单元的传感器的感光度进行调整，以便获得所需画质的图像。According to an embodiment of the camera of the present invention, the second exposure module further adjusts the sensitivity of the sensor of the imaging unit according to the calculated exposure value, so as to obtain an image of desired image quality.
根据本发明的相机的一个实施例，还包括用于向所述变焦参数接收单元输入无级变化的数字变焦参数的无级变焦参数输入模块。According to an embodiment of the camera of the present invention, the camera further includes a stepless zoom parameter input module for inputting a steplessly changing digital zoom parameter to the zoom parameter receiving unit.
根据本发明的相机的一个实施例，所述无级变焦参数接收模块包括能够在所述相机的显示单元上显示的无级数字变焦输入组件。According to an embodiment of the camera of the present invention, the stepless zoom parameter receiving module includes a stepless digital zoom input component that can be displayed on a display unit of the camera.
根据本发明的相机的一个实施例，所述无级变焦参数接收模块包括机械变焦输入机构。According to an embodiment of the camera of the present invention, the stepless zoom parameter receiving module includes a mechanical zoom input mechanism.
根据本发明的相机的一个实施例，还包括用于显示第一图像的显示单元。According to an embodiment of the camera of the present invention, the camera further includes a display unit for displaying the first image.
本发明还公开了一种无人飞行器系统，该无人飞行器系统包括：The invention also discloses an unmanned aerial vehicle system. The unmanned aerial vehicle system includes:
无人飞行器；Unmanned aerial vehicle
云台装置，由所述无人飞行器承载；PTZ device, carried by the unmanned aerial vehicle;
拍摄装置；以及Camera device; and
控制装置，与所述无人飞行器、所述云台装置和所述拍摄装置通信连接，并用于控制所述无人飞行器、所述云台装置和所述拍摄装置，A control device, which is in communication connection with the unmanned aerial vehicle, the pan/tilt device, and the photographing device, and is used to control the unmanned aerial vehicle, the pan/tilt device, and the photographing device,
其特征在于，所述拍摄装置包括：It is characterized in that the photographing device includes:
变焦参数接收单元，用于接收数字变焦参数；以及A zoom parameter receiving unit for receiving digital zoom parameters; and
控制单元，与所述变焦参数接收单元通信连接，用于根据所述数字变焦参数并行地执行步骤S1-S3中的至少两个：The control unit is in communication connection with the zoom parameter receiving unit, and is configured to execute at least two of steps S1-S3 in parallel according to the digital zoom parameter:
S1.优化第一图像的画质，所述第一图像通过所述拍摄装置的摄像单元获取；S1. Optimize the image quality of the first image, the first image being acquired by the camera unit of the camera;
S2.生成所述摄像单元的对焦参数；和S2. Generate focus parameters of the camera unit; and
S3.生成所述摄像单元的曝光参数，S3. Generate exposure parameters of the camera unit,
其中，所述摄像单元设置在所述云台装置上。Wherein, the camera unit is arranged on the pan-tilt device.
根据本发明的无人飞行器系统的一个实施例，所述拍摄装置还包括图像剪裁单元，所述图像剪裁单元与所述变焦参数接收单元和所述控制单元通信连接，用于在所述控制单元并行地执行步骤S1-S3中的至少两个之前根据所述数字变焦参数获取所述第一图像的剪裁参数，并根据所述剪裁参数对所述第一图像进行剪裁处理。According to an embodiment of the unmanned aerial vehicle system of the present invention, the photographing device further includes an image cropping unit, the image cropping unit is in communication connection with the zoom parameter receiving unit and the control unit, and is configured to communicate with the control unit Before performing at least two of steps S1-S3 in parallel, the cropping parameter of the first image is obtained according to the digital zoom parameter, and the first image is cropped according to the cropping parameter.
根据本发明的无人飞行器系统的一个实施例，所述控制单元包括：第一优化模块，用于对第一图像进行第一优化处理；第一对焦模块，用于执行生成所述摄像单元的对焦参数的第一对焦处理；以及第一曝光模块，用于执行生成所述摄像单元的曝光参数的第一曝光处理，According to an embodiment of the unmanned aerial vehicle system of the present invention, the control unit includes: a first optimization module, configured to perform a first optimization process on a first image; a first focusing module, configured to execute the generation of the camera unit A first focusing process for focusing parameters; and a first exposure module for performing the first exposure process for generating the exposure parameters of the camera unit,
其中，同时执行所述第一优化处理、所述第一对焦处理和所述第一曝光处理中的至少两个。Wherein, at least two of the first optimization processing, the first focusing processing, and the first exposure processing are performed at the same time.
根据本发明的无人飞行器系统的一个实施例，所述第一优化处理包括：根据所述剪裁参数对图像坐标参考基准进行调整，以确定不同于所述第一图像的第一图像坐标参考基准的第二图像坐标参考基准。According to an embodiment of the unmanned aerial vehicle system of the present invention, the first optimization processing includes: adjusting an image coordinate reference datum according to the cropping parameter to determine a first image coordinate reference datum different from the first image The second image coordinate reference datum.
根据本发明的无人飞行器系统的一个实施例，所述第一对焦处理包括：根据所述剪裁参数对所述第一图像的第一对焦坐标参数基准进行调整，以获得第二对焦坐标参数基准。According to an embodiment of the unmanned aerial vehicle system of the present invention, the first focus processing includes: adjusting a first focus coordinate parameter reference of the first image according to the cropping parameter to obtain a second focus coordinate parameter reference .
根据本发明的无人飞行器系统的一个实施例，所述第一对焦处理还 包括：根据所述第二对焦坐标参数基准和所述剪裁参数计算所述摄像单元的相位对焦模块的相位。According to an embodiment of the unmanned aerial vehicle system of the present invention, the first focus processing further includes: calculating the phase of the phase focus module of the camera unit according to the second focus coordinate parameter reference and the clipping parameter.
根据本发明的无人飞行器系统的一个实施例，所述第一曝光处理包括：根据数字变焦后的图像所对应的待成像客体的对焦位置确定环境光量采样坐标基准，并基于所述环境光量采样坐标基准进行环境光量的采样。According to an embodiment of the unmanned aerial vehicle system of the present invention, the first exposure processing includes: determining an ambient light amount sampling coordinate reference based on the focus position of the object to be imaged corresponding to the digitally zoomed image, and sampling based on the ambient light amount The coordinate base performs sampling of the amount of ambient light.
根据本发明的无人飞行器系统的一个实施例，所述控制单元还包括第二优化模块，所述第二优化模块基于所述第二图像坐标参考基准对由所述第一图像剪裁的图像进行矫正。According to an embodiment of the unmanned aerial vehicle system of the present invention, the control unit further includes a second optimization module that performs an image clipped from the first image based on the second image coordinate reference datum. Rectify.
根据本发明的无人飞行器系统的一个实施例，所述第二优化模块对矫正后的图像进行画质优化，以获得第二图像。According to an embodiment of the unmanned aerial vehicle system of the present invention, the second optimization module optimizes the image quality of the corrected image to obtain the second image.
根据本发明的无人飞行器系统的一个实施例，所述第一对焦处理包括：根据所述剪裁参数对所述第一图像的第一对焦坐标参数基准进行调整，以获得第二对焦坐标参数基准。According to an embodiment of the unmanned aerial vehicle system of the present invention, the first focus processing includes: adjusting a first focus coordinate parameter reference of the first image according to the cropping parameter to obtain a second focus coordinate parameter reference .
根据本发明的无人飞行器系统的一个实施例，所述控制单元还包括第二对焦模块，所述第二对焦模块根据所述第二对焦坐标参数基准和/或对由所述第一图像剪裁的图像进行矫正的数据，对所述摄像单元的反差对焦模块的对比度反差值以及与其相关的对焦参数进行统计，并基于所述对比度反差值和所述对焦参数实现所述摄像单元的对焦操作。According to an embodiment of the unmanned aerial vehicle system of the present invention, the control unit further includes a second focus module, which is based on the second focus coordinate parameter reference and/or the first image is cropped Based on the correction data of the image of the camera unit, the contrast value of the contrast focusing module of the camera unit and the related focusing parameters are counted, and the focusing operation of the camera unit is implemented based on the contrast value and the focusing parameter.
根据本发明的无人飞行器系统的一个实施例，所述第一曝光处理包括：根据数字变焦后的图像所对应的待成像客体的对焦位置确定环境光量采样坐标基准，并基于所述环境光量采样坐标基准进行环境光量的采样。According to an embodiment of the unmanned aerial vehicle system of the present invention, the first exposure processing includes: determining an ambient light amount sampling coordinate reference based on the focus position of the object to be imaged corresponding to the digitally zoomed image, and sampling based on the ambient light amount The coordinate base performs sampling of the amount of ambient light.
根据本发明的无人飞行器系统的一个实施例，所述控制单元还包括第二曝光模块，所述第二曝光模块根据所述环境光量采样坐标基准和/或对由所述第一图像剪裁的图像进行矫正的数据计算曝光值。According to an embodiment of the unmanned aerial vehicle system of the present invention, the control unit further includes a second exposure module, the second exposure module sampling coordinate reference according to the amount of ambient light and/or the The image correction data calculates the exposure value.
根据本发明的无人飞行器系统的一个实施例，所述第二曝光模块还根据计算出的曝光值对所述摄像单元的传感器的感光度进行调整，以便获得所需画质的图像。According to an embodiment of the unmanned aerial vehicle system of the present invention, the second exposure module further adjusts the sensitivity of the sensor of the camera unit according to the calculated exposure value, so as to obtain an image of desired image quality.
根据本发明的无人飞行器系统的一个实施例，所述拍摄装置还包括用于向所述变焦参数接收单元输入无级变化的数字变焦参数的无级变焦参数输入模块。According to an embodiment of the unmanned aerial vehicle system of the present invention, the photographing device further includes a stepless zoom parameter input module for inputting a steplessly changing digital zoom parameter to the zoom parameter receiving unit.
根据本发明的无人飞行器系统的一个实施例，所述无级变焦参数输入模块包括能够在显示单元上显示的无级数字变焦输入组件。According to an embodiment of the unmanned aerial vehicle system of the present invention, the stepless zoom parameter input module includes a stepless digital zoom input component that can be displayed on a display unit.
根据本发明的无人飞行器系统的一个实施例，所述无级变焦参数输入模块包括机械变焦输入机构。According to an embodiment of the unmanned aerial vehicle system of the present invention, the stepless zoom parameter input module includes a mechanical zoom input mechanism.
根据本发明的无人飞行器系统的一个实施例，还包括用于显示第一图像的显示单元，所述显示单元设置在所述控制装置中。According to an embodiment of the unmanned aerial vehicle system of the present invention, the unmanned aerial vehicle system further includes a display unit for displaying the first image, and the display unit is provided in the control device.
根据本发明的数字变焦成像装置能够通过无级变焦参数输入单元向拍摄装置输入无级变化的数字变焦参数，从而能够获得待成像客体的无级变化放大倍数的图像，以便满足对相关放大倍数的图像的需求。另外，通过使数字变焦控制单元同步地向对焦控制单元、曝光控制单元和图像信号处理单元发送所需的数字变焦参数，以使对焦控制单元、曝光控制单元和图像信号处理单元并行地执行后续操作来缩短从接收变焦参数到执行变焦操作再到呈现变焦结果所需的时间，从而大大提高了成像装置的成像效率，提升了用户体验。The digital zoom imaging device according to the present invention can input infinitely variable digital zoom parameters to the photographing device through the stepless zoom parameter input unit, thereby being able to obtain an image of the object to be imaged with continuously variable magnification, so as to meet the requirements of the relevant magnification. The demand for images. In addition, the digital zoom control unit synchronously sends the required digital zoom parameters to the focus control unit, the exposure control unit, and the image signal processing unit, so that the focus control unit, the exposure control unit, and the image signal processing unit perform subsequent operations in parallel In order to shorten the time required from receiving the zoom parameter to performing the zoom operation and then to presenting the zoom result, the imaging efficiency of the imaging device is greatly improved, and the user experience is improved.
本发明的附加方面和优点将在下面的描述部分中变得明显，或通过本发明的实践了解到。The additional aspects and advantages of the present invention will become apparent in the following description, or be understood through the practice of the present invention.
附图说明Description of the drawings
图1为根据本发明的数字变焦成像装置的一个实施例的示意性结构图。Fig. 1 is a schematic structural diagram of an embodiment of a digital zoom imaging device according to the present invention.
图2为根据本发明的数字变焦成像装置的一个实施例的结构示意图。Fig. 2 is a schematic structural diagram of an embodiment of a digital zoom imaging device according to the present invention.
图3为根据本发明的数字变焦成像装置的一个实施例的结构示意图。Fig. 3 is a schematic structural diagram of an embodiment of a digital zoom imaging device according to the present invention.
图4为根据本发明的控制单元的一个实施例的结构示意图。Fig. 4 is a schematic structural diagram of an embodiment of a control unit according to the present invention.
图5为根据本发明的控制单元的一个实施例的结构示意图。Fig. 5 is a schematic structural diagram of an embodiment of a control unit according to the present invention.
图6为根据本发明的数字变焦成像装置的一个实施例的结构示意图。Fig. 6 is a schematic structural diagram of an embodiment of a digital zoom imaging device according to the present invention.
图7为根据本发明的数字变焦成像方法的流程图。Fig. 7 is a flowchart of a digital zoom imaging method according to the present invention.
图8为根据本发明的相机的结构示意图。Fig. 8 is a schematic diagram of the structure of the camera according to the present invention.
图9为根据本发明的无人飞行器系统的结构示意图。Fig. 9 is a schematic structural diagram of an unmanned aerial vehicle system according to the present invention.
具体实施方式detailed description
下面详细描述本发明的实施方式，所述实施方式的示例在附图中示出，其中自始至终相同或类似的标号表示相同或类似的元件或具有相同或类似功能的元件。下面通过参考附图描述的实施方式是示例性的，仅用于解释本发明，而不能理解为对本发明的限制。The following describes the embodiments of the present invention in detail. Examples of the embodiments are shown in the accompanying drawings, in which the same or similar reference numerals indicate the same or similar elements or elements with the same or similar functions. The following embodiments described with reference to the accompanying drawings are exemplary, and are only used to explain the present invention, but should not be understood as a limitation to the present invention.
在本发明的描述中，需要理解的是，术语“第一”、“第二”仅用于描述目的，而不能理解为指示或暗示相对重要性或者隐含指明所指示的技术特征的数量。由此，限定有“第一”、“第二”的特征可以明示或者隐含地包括一个或者更多个所述特征。在本发明的描述中，“多个”的含义是两个或两个以上，除非另有明确具体的限定。In the description of the present invention, it should be understood that the terms “first” and “second” are only used for description purposes, and cannot be understood as indicating or implying relative importance or implicitly indicating the number of indicated technical features. Therefore, the features defined with “first” and “second” may explicitly or implicitly include one or more of the features. In the description of the present invention, "plurality" means two or more than two, unless specifically defined otherwise.
下文的公开提供了许多不同的实施方式或例子用来实现本发明的不同结构。为了简化本发明的公开，下文中对特定例子的部件和设置进行描述。当然，它们仅仅为示例，并且目的不在于限制本发明。此外，本发明可以在不同例子中重复参考数字，这种重复是为了简化和清楚的目的，其本身不指示所讨论各种实施方式和/或设置之间的关系。The following disclosure provides many different embodiments or examples for realizing different structures of the present invention. In order to simplify the disclosure of the present invention, the components and settings of specific examples are described below. Of course, they are only examples, and are not intended to limit the invention. In addition, the present invention may repeat reference numerals in different examples, and this repetition is for the purpose of simplification and clarity, and does not indicate the relationship between the various embodiments and/or settings discussed.
下面详细描述本发明的实施方式，所述实施方式的示例在附图中示出，其中自始至终相同或类似的标号表示相同或类似的元件或具有相同或类似功能的元件。下面通过参考附图描述的实施方式是示例性的，仅用于解释本发明，而不能理解为对本发明的限制。The following describes the embodiments of the present invention in detail. Examples of the embodiments are shown in the accompanying drawings, in which the same or similar reference numerals indicate the same or similar elements or elements with the same or similar functions. The following embodiments described with reference to the accompanying drawings are exemplary, and are only used to explain the present invention, but should not be understood as a limitation to the present invention.
首先，结合附图1对根据本发明实施例的数字变焦成像装置10的结构进行详细说明。根据本发明实施例的数字变焦成像装置10包括用于接收数字变焦参数的变焦参数接收单元12和与变焦参数接收单元12通信连接的控制单元14，控制单元14用于根据数字变焦参数并行地执行步骤S1-S3中的至少两个：S1.优化第一图像的画质，该第一图像通过摄像单元获取；S2.生成摄像单元的对焦参数；和，S3.生成摄像单元的曝光参数。在此，变焦参数接收单元12可以用于接收来自数字变焦成像装置10的外部输入的变焦参数，比如为用户输入的变焦参数，也可以接收来自数字变 焦成像装置10自身的变焦参数，比如当利用数字变焦成像装置10进行物体成像时，其自身可以自动选择合适的变焦参数。控制单元14可以根据变焦参数接收单元12的变焦参数并行地执行优化由拍摄单元拍摄的第一图像的画质、生成摄像单元的对焦参数和生成摄像单元的曝光参数的步骤中的至少两个步骤。在此，并行地执行指的是同时或同步地执行上述三个步骤S1、S2和S3中的至少两个，或者指的是同时或同步地执行上述三个步骤S1、S2和S3中的至少两个的各自的至少一部分步骤。也就是说，可以同步地执行优化由拍摄单元拍摄的第一图像的画质的步骤和生成摄像单元的对焦参数的步骤，也可以同步地执行优化由拍摄单元拍摄的第一图像的画质的步骤和生成摄像单元的曝光参数的步骤，还可以同步地执行生成摄像单元的对焦参数的步骤和生成摄像单元的曝光参数的步骤，或者可以同步地执行上述任意两个步骤的各自的至少一部分步骤。当然，还可以同步地执行上述三个步骤，即在优化由拍摄单元拍摄的第一图像的画质的同时，执行生成摄像单元的对焦参数的步骤和生成摄像单元的曝光参数的步骤，或者可以同步地执行三个步骤的各自的至少一部分步骤。First, the structure of the digital zoom imaging device 10 according to the embodiment of the present invention will be described in detail with reference to FIG. 1. The digital zoom imaging device 10 according to the embodiment of the present invention includes a zoom parameter receiving unit 12 for receiving digital zoom parameters and a control unit 14 communicatively connected with the zoom parameter receiving unit 12, and the control unit 14 is configured to execute parallel operations according to the digital zoom parameters. At least two of steps S1-S3: S1. Optimize the image quality of the first image, which is obtained by the camera unit; S2. Generate the focus parameters of the camera unit; and, S3. Generate the exposure parameters of the camera unit. Here, the zoom parameter receiving unit 12 may be used to receive externally input zoom parameters from the digital zoom imaging device 10, such as zoom parameters input by the user, and may also receive zoom parameters from the digital zoom imaging device 10 itself, such as when using When the digital zoom imaging device 10 performs imaging of an object, it can automatically select appropriate zoom parameters. The control unit 14 may execute in parallel at least two steps of the steps of optimizing the image quality of the first image captured by the imaging unit, generating the focus parameters of the imaging unit, and generating the exposure parameters of the imaging unit according to the zoom parameters of the zoom parameter receiving unit 12 . Here, executing in parallel refers to executing at least two of the above three steps S1, S2, and S3 at the same time or simultaneously, or refers to executing at least two of the above three steps S1, S2, and S3 at the same time or simultaneously. At least a part of each of the two steps. That is, the step of optimizing the image quality of the first image captured by the photographing unit and the step of generating the focus parameters of the image capturing unit can be performed simultaneously, or the step of optimizing the image quality of the first image captured by the photographing unit can be performed simultaneously. The step and the step of generating the exposure parameters of the camera unit may also be synchronized to perform the step of generating the focus parameters of the camera unit and the step of generating the exposure parameters of the camera unit, or may simultaneously perform at least a part of each of the above-mentioned two steps . Of course, the above three steps can also be performed simultaneously, that is, while optimizing the image quality of the first image captured by the camera unit, the step of generating the focus parameters of the camera unit and the step of generating the exposure parameters of the camera unit are performed, or it can be At least a part of each of the three steps is executed synchronously.
根据本发明的数字变焦成像装置10由于能够在接收到来自外部或自动生成的变焦指令之后，根据数字变焦参数同时进行图像的画质优化、摄像单元的镜头对焦以及摄像单元的传感器曝光等步骤中的至少两个，由此可以大大地缩短依次执行三个步骤所需要的时间，以便实现数字变焦成像装置10的变焦即成像的快速数字变焦成像过程，从而消除了成像过程中的由于成像过程的串行动作而导致的成像拖尾现象，即在对图像进行数字变焦操作时需要等待一定时间之后才能获得变焦后的图像的现象。The digital zoom imaging device 10 according to the present invention can simultaneously perform image quality optimization, lens focus of the camera unit, and sensor exposure of the camera unit according to digital zoom parameters after receiving a zoom instruction from the outside or automatically generated. Therefore, the time required to perform the three steps in sequence can be greatly shortened, so as to realize the zooming of the digital zoom imaging device 10, that is, the fast digital zoom imaging process of imaging, thereby eliminating the imaging process during the imaging process. Image smearing caused by serial actions, that is, a phenomenon in which a zoomed image can only be obtained after a certain period of time when performing a digital zoom operation on an image.
根据本发明的数字变焦成像装置10还包括图像剪裁单元16，如图2所示，图像剪裁单元16与变焦参数接收单元12和控制单元14通信连接，用于在控制单元14并行地执行步骤S1-S3中的至少两个步骤之前根据数字变焦参数获取第一图像的剪裁参数，并根据剪裁参数对第一图像进行剪裁处理。在通过变焦参数接收单元12接收到数字变焦参数之后，图像剪裁单元16首先获取该数字变焦参数，并根据该数字变焦参数对第一图像进行剪裁处理，从而扩大或缩小第一图像的视场角，以获得所需的变焦后 的图像。在此，对第一图像的数字变焦参数与第一图像的剪裁参数一一对应，也就是通过变焦参数接收单元12接收变焦参数之后，即可通过图像剪裁单元16获取与该变焦参数相对应的剪裁参数。某些情况下，图像剪裁单元16根据数字变焦参数获取第一图像的剪裁参数，并延迟1-2帧时间对第一图像进行剪切、放大等操作，但较佳地，剪裁参数会被实时地同时下发给优化模块、对焦模块、曝光模块等后续模块，以根据剪裁参数对图像进行优化、调整对焦参数、调整曝光参数等后续处理，从而进一步提高图像输出速率，缩短了无级变焦中的迟滞。示例性地，优化模块可以包括图像信号处理器(Image Signal Processor)、对焦模块可以包括自动对焦模块(Auto Focus Module)、曝光模块可以包括自动曝光模块(Auto Exposure Module)。The digital zoom imaging device 10 according to the present invention further includes an image cropping unit 16, as shown in FIG. Before at least two steps in S3, the cropping parameter of the first image is obtained according to the digital zoom parameter, and the first image is cropped according to the cropping parameter. After receiving the digital zoom parameter through the zoom parameter receiving unit 12, the image cropping unit 16 first obtains the digital zoom parameter, and performs cropping processing on the first image according to the digital zoom parameter, thereby expanding or reducing the angle of view of the first image To obtain the desired zoomed image. Here, the digital zoom parameter of the first image corresponds to the cropping parameter of the first image one-to-one, that is, after the zoom parameter is received by the zoom parameter receiving unit 12, the image cropping unit 16 can obtain the corresponding zoom parameter. The tailoring parameters. In some cases, the image cropping unit 16 obtains the cropping parameters of the first image according to the digital zoom parameters, and performs operations such as cropping and zooming in the first image with a delay of 1-2 frames, but preferably, the cropping parameters will be real-time At the same time, it is issued to the optimization module, focus module, exposure module and other subsequent modules to optimize the image according to the cropping parameters, adjust the focus parameters, adjust the exposure parameters and other subsequent processing, thereby further increasing the image output rate and shortening the stepless zoom. Of lag. Exemplarily, the optimization module may include an image signal processor (Image Signal Processor), the focus module may include an auto focus module (Auto Focus Module), and the exposure module may include an automatic exposure module (Auto Exposure Module).
另外，可以为数字变焦成像装置10设置显示单元18，如图3所示，以便通过显示单元18对由摄像单元获取的第一图像以及画质优化后的图像进行显示，由此能够实现待成像客体成像的既见既所得的效果，即在显示单元18上显示变焦后的图像，也就是显示单元18上所显示的待成像客体的第一图像的视场角放大或缩小的图像，与此同时，数字变焦成像装置10能够通过控制单元14实现对摄像单元的控制，通过对焦和曝光步骤实现待成像客体的最终成像，在此，对待成像客体的成像效果如同通过显示单元18所显示的第二图像一样。根据本发明的数字变焦成像装置10通过显示、对焦和曝光的同步执行实现了待成像客体的快速成像，由此实现了既见既所得的成像效果，消除了成像过程中的由于成像过程的串行动作而导致的成像拖尾现象，即在对图像进行数字变焦操作时需要等待一定时间才能看到变焦效果的现象。In addition, a display unit 18 may be provided for the digital zoom imaging device 10, as shown in FIG. 3, so that the first image acquired by the camera unit and the image with optimized image quality can be displayed through the display unit 18, so that the image to be imaged can be realized. The pre-existing effect of object imaging is that the zoomed image is displayed on the display unit 18, that is, the image of the first image of the object to be imaged displayed on the display unit 18 is enlarged or reduced. At the same time, the digital zoom imaging device 10 can realize the control of the camera unit through the control unit 14, and realize the final imaging of the object to be imaged through the focusing and exposure steps. Here, the imaging effect of the object to be imaged is the same as that displayed by the display unit 18. The two images are the same. The digital zoom imaging device 10 according to the present invention realizes the rapid imaging of the object to be imaged through the simultaneous execution of display, focus, and exposure, thereby realizing the imaging effect of seeing what you get, and eliminating the stringency of the imaging process in the imaging process. The phenomenon of image smearing caused by the action, that is, it takes a certain time to see the zoom effect when performing the digital zoom operation on the image.
在通过图像剪裁单元16确定对第一图像进行剪裁的剪裁参数之后，控制单元14能够同步或异步通过图像剪裁单元16获取所述剪裁参数，并利用剪裁参数执行后续的对焦操作和曝光操作。如图4所示，控制单元14包括用于对第一图像进行第一优化处理的第一优化模块142、用于执行生成摄像单元的对焦参数的第一对焦处理的第一对焦模块144以及用于执行生成摄像单元的曝光参数的第一曝光处理的第一曝光模块146，在此，同 时执行第一优化处理、第一对焦处理和第一曝光处理中的至少两个处理。也就是说，在此例举了一种通过控制单元14的三个模块分别同步地执行步骤S1、S2和S3中的至少两个步骤的各自的至少一部分步骤的方式。通过第一优化模块142执行第一优化处理，通过第一对焦模块144执行第一对焦处理，以及通过第一曝光模块146执行第一曝光处理，在此可以同时执行第一优化处理、第一对焦处理和第一曝光处理中的任意两者，或者同时执行三者，这样，可以大大地节省串行地执行图像优化操作、对焦操作和曝光操作所需的时间，实现三者的同步处理，从而大大缩短从变焦到成像的时间。After the image cropping unit 16 determines the cropping parameters for cropping the first image, the control unit 14 can obtain the cropping parameters through the image cropping unit 16 synchronously or asynchronously, and use the cropping parameters to perform subsequent focusing operations and exposure operations. As shown in FIG. 4, the control unit 14 includes a first optimization module 142 for performing a first optimization process on a first image, a first focusing module 144 for performing a first focus process for generating focus parameters of the camera unit, and a user For the first exposure module 146 that executes the first exposure process that generates the exposure parameters of the camera unit, here, at least two processes of the first optimization process, the first focus process, and the first exposure process are simultaneously executed. That is to say, a manner in which at least two of the steps S1, S2, and S3 are simultaneously executed by the three modules of the control unit 14 is exemplified here. The first optimization process is performed by the first optimization module 142, the first focus process is performed by the first focus module 144, and the first exposure process is performed by the first exposure module 146. Here, the first optimization process and the first focus process can be performed at the same time. Any two of the processing and the first exposure processing, or performing the three at the same time, can greatly save the time required to perform the image optimization operation, the focus operation, and the exposure operation in series, and realize the synchronization processing of the three. Greatly shorten the time from zoom to imaging.
进一步地，上述第一优化处理包括根据来自图像剪裁单元16的剪裁参数对图像坐标参考基准进行调整，以确定不同于第一图像的第一图像坐标参考基准的第二图像坐标参考基准。经由图像坐标参考基准的变化，第一优化处理排除了数字变焦带来的图像处理差异，因此第一优化处理之后的画质优化处理可以更为高效地进行。在此，图像坐标参考基准比如可以是图像的中心，在数字变焦操作之前，第一图像的中心为第一图像坐标参考基准，当对图像进行数字变焦操作之后，也就是进行了剪裁处理之后，明显地，变焦或剪裁后的图像的中心并非第一图像的中心，此时需要确定变焦后的图像的中心，并将该中心作为剪裁后的第二图像的第二图像坐标参考基准。Further, the above-mentioned first optimization processing includes adjusting the image coordinate reference datum according to the trimming parameter from the image trimming unit 16 to determine a second image coordinate reference datum that is different from the first image coordinate reference datum of the first image. Through the change of the image coordinate reference standard, the first optimization process eliminates the difference in image processing caused by the digital zoom, so the image quality optimization process after the first optimization process can be performed more efficiently. Here, the image coordinate reference reference may be, for example, the center of the image. Before the digital zoom operation, the center of the first image is the first image coordinate reference reference. After the image is digitally zoomed, that is, after the cropping process is performed, Obviously, the center of the zoomed or cropped image is not the center of the first image. At this time, it is necessary to determine the center of the zoomed image and use this center as the second image coordinate reference of the cropped second image.
进一步地，控制单元14还可以包括第二优化模块143，第二优化模块143基于重新确定的第二图像坐标参考基准对由第一图像剪裁的图像进行矫正，并由此获得相关的矫正数据。比如由于数字变焦的原因可能引起图像的扭曲或变形，控制单元14的第二优化模块143通过结合摄像单元的图像传感器所获得的图像数据信号对图像进行矫正，接着对矫正后的图像进行画质优化，以使图像更佳地呈现所拍摄客体的原本形状和色彩，由此获得第二图像。第二优化模块143的画质优化处理可以包括白平衡调整、灰度调整、饱和度调整、降低图像噪声等现有技术，此处不再累述。至此，根据本发明的数字变焦成像装置10完成了对变焦后的图像的剪裁处理、矫正处理和画质优化处理，并通过显示单元18将经过处理后的第二图像 呈现给用户。Further, the control unit 14 may further include a second optimization module 143, which corrects the image cropped from the first image based on the re-determined second image coordinate reference datum, and thereby obtains relevant correction data. For example, the image may be distorted or deformed due to digital zoom. The second optimization module 143 of the control unit 14 corrects the image by combining the image data signal obtained by the image sensor of the camera unit, and then performs the image quality of the corrected image. Optimized to make the image better present the original shape and color of the photographed object, thereby obtaining a second image. The image quality optimization processing of the second optimization module 143 may include prior art techniques such as white balance adjustment, grayscale adjustment, saturation adjustment, image noise reduction, etc., which will not be repeated here. So far, the digital zoom imaging device 10 according to the present invention has completed the cropping processing, correction processing, and image quality optimization processing of the zoomed image, and presents the processed second image to the user through the display unit 18.
接着，对利用控制单元14的第一对焦模块144执行第一对焦操作的过程进行说明。通过第一对焦模块144执行的第一对焦处理可以包括根据来自图像剪裁模块16的剪裁参数对第一图像的第一对焦坐标参数基准进行调整，以获得第二对焦坐标参数基准。在控制单元14从图像剪裁单元16接收到剪裁参数之后，控制单元14的第一对焦模块144对第一图像的第一对焦坐标参考基准进行调整，以获得第二图像的第二对焦坐标参考基准，并依据第二对焦坐标参考基准计算摄像单元的镜头的对焦参数。在通过用户的输入对第一图像进行数字变焦操作或根据数字变焦成像装置10的自身需求进行变焦时，即对第一图像进行剪裁处理时，控制单元14可以通过图像剪裁单元16接收数字变焦指令，比如为来自图像剪裁单元16的剪裁参数，并将剪裁参数发送至控制单元14的第一对焦模块144，第一对焦模块144在接收到剪裁参数之后，首先对剪裁参数进行分析和处理，通过该剪裁参数计算出相关的变焦参数，接着第一对焦模块144对第一图像的第一对焦坐标参数进行调整，在此，比如可以将形成第一图像的坐标参考原点称为第一对焦坐标参考原点，在发生数字变焦之后，所要拍摄的客体的对焦位置发生改变，由此需要根据发生改变的对焦位置重新确定对焦坐标参考原点，即需要确定形成待成像客体的第二图像的第二对焦坐标参考原点。比如，可以将第一对焦坐标参考原点设定为第一图像的中心位置，相应地，第二对焦坐标参考原点设定为第二图像的中心位置。在调整好对焦坐标参考原点之后，可以对摄像单元的镜头进行对焦调节，对于对焦调节的过程，以下将根据对焦原理的不同分别进行说明，在此以相位对焦模式和反差对焦模式为例进行说明。也就是说，以上所说明的对焦坐标参数基准的调整的步骤对于相位对焦模式和反差对焦模式是同样适用的，对于确定了变焦参数的第一图像而言，其对焦位置是确定的，因此不管对于相位对焦模式还是反差对焦模式来说，其对焦坐标参数基准也是确定的，即可以通过相同的方法确定对焦坐标参数基准。Next, the process of using the first focusing module 144 of the control unit 14 to perform the first focusing operation will be described. The first focus processing performed by the first focus module 144 may include adjusting the first focus coordinate parameter reference of the first image according to the cropping parameter from the image cropping module 16 to obtain the second focus coordinate parameter reference. After the control unit 14 receives the cropping parameters from the image cropping unit 16, the first focus module 144 of the control unit 14 adjusts the first focus coordinate reference datum of the first image to obtain the second focus coordinate reference datum of the second image , And calculate the focus parameters of the lens of the camera unit according to the second focus coordinate reference standard. When performing a digital zoom operation on the first image through a user input or zooming according to the needs of the digital zoom imaging device 10, that is, when performing a cropping process on the first image, the control unit 14 may receive a digital zoom instruction through the image cropping unit 16 For example, it is the cropping parameter from the image cropping unit 16, and the cropping parameter is sent to the first focusing module 144 of the control unit 14. After receiving the cropping parameter, the first focusing module 144 first analyzes and processes the cropping parameter, and passes The cropping parameter calculates the relevant zoom parameter, and then the first focusing module 144 adjusts the first focusing coordinate parameter of the first image. Here, for example, the coordinate reference origin forming the first image may be referred to as the first focusing coordinate reference. Origin: After the digital zoom occurs, the focus position of the object to be photographed changes. Therefore, it is necessary to re-determine the focus coordinate reference origin according to the changed focus position, that is, the second focus coordinate that forms the second image of the object to be imaged needs to be determined Reference origin. For example, the first focus coordinate reference origin may be set as the center position of the first image, and correspondingly, the second focus coordinate reference origin may be set as the center position of the second image. After adjusting the focus coordinate reference origin, you can adjust the focus of the lens of the camera unit. The focus adjustment process will be explained according to the different focusing principles. Here, the phase focus mode and the contrast focus mode are used as examples. . That is to say, the steps of adjusting the focus coordinate parameter reference described above are equally applicable to the phase focus mode and the contrast focus mode. For the first image whose zoom parameters are determined, the focus position is determined, so regardless of For the phase focus mode or the contrast focus mode, the focus coordinate parameter reference is also determined, that is, the focus coordinate parameter reference can be determined by the same method.
在摄像单元的镜头采用相位对焦模块的情况下，上述的由第一对焦模块142执行第一对焦处理还可以包括以下步骤，即在完成对焦坐标参数基 准的调整之后，也就是在将第一对焦坐标参数基准调整为第二对焦坐标参数基准之后，根据第二对焦坐标参数基准和来自图像剪裁单元的剪裁参数计算摄像单元的相位对焦模块的相位。而在第一对焦处理之后，可进一步根据该相位实现摄像单元的镜头的对焦操作。In the case that the lens of the camera unit adopts the phase focusing module, the first focusing process performed by the first focusing module 142 may further include the following steps, that is, after the adjustment of the focus coordinate parameter reference is completed, that is, the first focusing is performed. After the coordinate parameter reference is adjusted to the second focus coordinate parameter reference, the phase of the phase focus module of the camera unit is calculated according to the second focus coordinate parameter reference and the cropping parameter from the image cropping unit. After the first focus processing, the focus operation of the lens of the camera unit can be further implemented according to the phase.
另外，在摄像单元的镜头采用反差对焦模块的情况下，控制单元14进一步包括第二对焦模块145，第二对焦模块145根据由第一对焦模块144执行第一对焦操作的过程中所确定的第二对焦坐标参数基准和/或第二优化模块143对由第一图像剪裁的图像进行矫正的数据，对摄像单元的反差对焦模块的对比度反差值以及与其相关的对焦参数进行统计，并基于对比度反差值和对焦参数实现摄像单元的对焦操作。也就是说，可以根据第二对焦坐标参数基准和第二优化模块143对由第一图像剪裁的图像进行矫正的数据中的任一者或两者来统计摄像单元的反差对焦模块的对比度反差值以及与其相关的对焦参数。由此实现了采用反差对焦模块的镜头的对焦。In addition, when the lens of the camera unit adopts a contrast focusing module, the control unit 14 further includes a second focusing module 145, and the second focusing module 145 is based on the first focusing module 144 determined during the first focusing operation performed by the first focusing module 144. The second focus coordinate parameter reference and/or the data corrected by the second optimization module 143 on the image cropped from the first image, the contrast value of the contrast focus module of the camera unit and the related focus parameters are counted, and based on the contrast contrast The value and focus parameter realize the focus operation of the camera unit. That is to say, the contrast value of the contrast focus module of the camera unit can be counted according to either or both of the second focus coordinate parameter reference and the data corrected by the second optimization module 143 on the image cropped from the first image. And its related focus parameters. As a result, the focusing of the lens using the contrast focusing module is realized.
由控制单元14的第一曝光模块146执行的第一曝光处理可以包括根据数字变焦后的图像所对应的待成像客体的对焦位置确定环境光量采样坐标基准，并基于该环境光量采样坐标基准进行环境光量的采样。由于待成像客体的对焦位置发生了改变，因此，对焦的环境光亮度也随之发生了变化，第一曝光模块146根据变焦后的图像所对应的待成像客体的对焦位置确定环境光量采样坐标基准，并基于该环境光量采样坐标基准进行环境光量的采样，基于所采样的环境光量计算摄像单元所处的环境亮度。进一步地，控制单元14还包括第二曝光模块147，第二曝光模块147根据环境光量采样坐标基准和/或第二优化模块143对由第一图像剪裁的图像进行矫正的数据计算曝光值，也就是可以根据环境光量采样坐标基准和第二优化模块143对由第一图像剪裁的图像进行矫正的数据中的任一者或两者计算曝光值。第二曝光模块147根据计算出的曝光值对摄像单元的传感器的感光度进行调整，以便获得所需画质的图像。The first exposure processing performed by the first exposure module 146 of the control unit 14 may include determining an ambient light amount sampling coordinate reference based on the focus position of the object to be imaged corresponding to the digitally zoomed image, and performing environmental analysis based on the ambient light amount sampling coordinate reference. Sampling of the amount of light. Since the focus position of the object to be imaged has changed, the brightness of the ambient light in focus also changes accordingly. The first exposure module 146 determines the ambient light amount sampling coordinate reference according to the focus position of the object to be imaged corresponding to the zoomed image , And sample the amount of ambient light based on the ambient light amount sampling coordinate reference, and calculate the brightness of the environment where the camera unit is located based on the sampled amount of ambient light. Further, the control unit 14 further includes a second exposure module 147. The second exposure module 147 calculates the exposure value according to the ambient light amount sampling coordinate reference and/or the data corrected by the second optimization module 143 on the image cropped from the first image. That is, the exposure value can be calculated according to either or both of the ambient light amount sampling coordinate reference and the data corrected by the second optimization module 143 on the image clipped from the first image. The second exposure module 147 adjusts the sensitivity of the sensor of the camera unit according to the calculated exposure value, so as to obtain an image of the required image quality.
在此仅以拍摄单张照片的过程为例对根据本发明的数字变焦成像装置10的结构和原理进行了说明，可以理解的是，基于类似的原理，根据本发明的数字变焦成像装置10也可以用于视频的拍摄，在视频的拍摄过 程中，用户可以在一定范围内对视频进行连续地数字变焦，能够在显示单元18上观察到变焦后的视频，同时对视频进行连续地对焦和曝光，从而完成视频的录制。在此，连续地数字变焦指的是以下情况，在拍摄照片的情况下，可以对待成像物体的呈现在显示单元18上的图像进行无级地变焦调节，即无级地改变图像的视场角，以便能够根据用户需要选择最佳的数字变焦参数，也就是最佳的视场角。在拍摄视频的情况下，连续地变焦指的是在视频拍摄过程中对连续的视频流进行的连续变焦，并且该变焦过程也是无级变焦过程，即可以实现视频图像的视场角的任意变化。在视频的拍摄过程中，用户可以随时进行视频图像的数字变焦操作，可以对视频进行连续的无级变焦操作。Here, the structure and principle of the digital zoom imaging device 10 according to the present invention are described only by taking the process of taking a single photo as an example. It can be understood that, based on similar principles, the digital zoom imaging device 10 according to the present invention is also It can be used for video shooting. During the video shooting process, the user can continuously digitally zoom the video within a certain range, and can observe the zoomed video on the display unit 18, while continuously focusing and exposing the video , So as to complete the video recording. Here, continuous digital zoom refers to the following situation. In the case of taking a photo, the image of the object to be imaged displayed on the display unit 18 can be continuously zoomed, that is, the angle of view of the image can be continuously changed. , In order to be able to select the best digital zoom parameters according to user needs, that is, the best field of view. In the case of shooting video, continuous zooming refers to the continuous zooming of the continuous video stream during the video shooting process, and the zooming process is also a stepless zooming process, that is, the arbitrary change of the angle of view of the video image can be achieved . During the video shooting process, the user can perform digital zoom operation of the video image at any time, and can perform continuous stepless zoom operation on the video.
在此基础上，根据拍照、录像场景的不同，综合考虑图像分辨率、画质需求、数字变焦速度等要求，可以对数字变焦的最大倍率进行动态调整，以确保无级数字变焦的同时，输出的图像画质较好且没有拖尾效果。拍照场景下，对数字变焦速度的要求较低，所以图像分辨率较高的情况下能够适配更高的最大倍率，例如，4K的分辨率能够适配4倍的最大倍率；而录像场景下，对数字变焦速度的要求较高，所以图像分辨率较低的情况下能够适配更高的最大倍率，例如，1080P的分辨率能够适配4倍的最大倍率。On this basis, according to different photo and video scenes, comprehensive consideration of image resolution, image quality requirements, digital zoom speed and other requirements, the maximum magnification of digital zoom can be dynamically adjusted to ensure that the digital zoom can be output at the same time. The image quality of is better and there is no tailing effect. In the photo scene, the requirement for the digital zoom speed is low, so the higher image resolution can be adapted to a higher maximum magnification. For example, the 4K resolution can adapt to the 4 times maximum magnification; while in the video scene , The requirements for digital zoom speed are high, so higher maximum magnification can be adapted when the image resolution is low, for example, the resolution of 1080P can be adapted to the maximum magnification of 4 times.
在此，根据本发明的数字变焦成像装置10的变焦参数接收单元12可以接收来自外部的无级变化的数字变焦参数，也可以接收来自其内部的变焦指令，此处的外部通常是指用户的输入。用户可以通过数字变焦成像装置10的无级变焦参数输入模块20输入变焦参数，比如为数字变焦倍数，由图像剪裁单元16对输入的变焦参数进行处理，比如将其转换为相应的剪裁参数，以便对第一图像进行剪裁处理并且将剪裁参数传输至控制单元14。该无级变焦参数输入模块20可以包括能够在显示单元18上显示的无级变焦参数输入组件，比如可以是显示在显示单元18的屏幕上的滑动条，通过用户对滑动条的操作实现数字变焦参数的输入，该滑动条可以由用户的手指进行操作，其可以在屏幕上连续地变化，即无级地调节，从而实现对数字变焦参数的无级调节。根据本发明的数字变焦成像装置10的还可以包括用于对第一图像进行数字变焦的变焦参数进行调节的机械变焦输 入机构，比如可以为拨轮或拨杆。在此，在采用显示单元18上显示的滑动条的数字变焦输入组件的情况下，需要采用触控屏进行滑动条的设置，并通过手指直接操作触控屏上的滑动条来执行数字变焦参数的输入。而在采用比如为拨轮的机械变焦输入机构的情况下，可以通过转动拨轮来进行数字变焦参数的输入，通过显示单元18对变焦后的效果进行观察，此时可以采用非触控的一般显示屏即可。Here, the zoom parameter receiving unit 12 of the digital zoom imaging device 10 according to the present invention can receive steplessly changing digital zoom parameters from the outside, and can also receive zoom instructions from its inside. The outside here usually refers to the user’s enter. The user can input a zoom parameter, such as a digital zoom factor, through the stepless zoom parameter input module 20 of the digital zoom imaging device 10, and the image cropping unit 16 processes the input zoom parameter, such as converting it into a corresponding cropping parameter. The first image is cropped and the cropping parameters are transmitted to the control unit 14. The stepless zoom parameter input module 20 may include a stepless zoom parameter input component that can be displayed on the display unit 18, for example, it may be a sliding bar displayed on the screen of the display unit 18, and digital zoom is realized through the operation of the sliding bar by the user. For parameter input, the slide bar can be operated by the user's finger, and it can be continuously changed on the screen, that is, steplessly adjusted, so as to achieve stepless adjustment of digital zoom parameters. The digital zoom imaging device 10 according to the present invention may further include a mechanical zoom input mechanism for adjusting the zoom parameters of digital zooming of the first image, for example, it may be a dial wheel or a lever. Here, in the case of a digital zoom input component using a sliding bar displayed on the display unit 18, a touch screen needs to be used to set the sliding bar, and the digital zoom parameters can be executed by directly operating the sliding bar on the touch screen with a finger input of. In the case of a mechanical zoom input mechanism such as a dial wheel, digital zoom parameters can be input by turning the dial wheel, and the zoom effect can be observed through the display unit 18. At this time, a non-touch general The display screen is fine.
以下对根据本发明的数字变焦成像装置10的工作原理和工作过程进行示例性说明。在通过显示单元18上显示的比如为滑动条的无级变焦参数输入组件20接收到来自外部的数字变焦指令之后，需要对变焦后的图像进行处理和显示。在此，显示单元18将变焦参数传输至变焦参数接收单元12，在此变焦参数接收单元12可以将变焦参数进行数字化处理并将数字化处理后的变焦参数发送至图像剪裁单元16。图像剪裁单元16对变焦参数进行分析处理，并将其转换为剪裁参数，同时图像剪裁单元16对需要进行变焦处理的第一图像进行剪裁处理。The working principle and working process of the digital zoom imaging device 10 according to the present invention will be exemplified below. After the stepless zoom parameter input component 20, such as a slide bar, displayed on the display unit 18 receives the digital zoom instruction from the outside, the zoomed image needs to be processed and displayed. Here, the display unit 18 transmits the zoom parameter to the zoom parameter receiving unit 12, where the zoom parameter receiving unit 12 can digitally process the zoom parameter and send the digitally processed zoom parameter to the image trimming unit 16. The image cropping unit 16 analyzes the zoom parameters and converts them into cropping parameters. At the same time, the image cropping unit 16 performs cropping processing on the first image that needs to be zoomed.
在图像剪裁单元16获取对第一图像的剪裁参数之后，图像剪裁单元16将剪裁参数传送至控制单元14，控制单元14则根据剪裁参数分别控制其第一优化模块142、第二优化模块143、第一对焦模块144、第二对焦模块145、第一曝光模块146和第二曝光模块147进行操作，其中，第一优化模块142、第一对焦模块144和第一曝光模块146中的至少两者的动作是同步的。第一优化模块142执行第一优化处理，即根据剪裁参数确定用于第二图像的第二图像坐标参考基准。第二优化模块143则在第一优化模块142操作的基础上对由第一图像剪裁的图像进行矫正，随后对矫正后的图像进行画质优化，以获得第二图像。After the image cropping unit 16 obtains the cropping parameters for the first image, the image cropping unit 16 transmits the cropping parameters to the control unit 14, and the control unit 14 controls its first optimization module 142, second optimization module 143, and 143 respectively according to the cropping parameters. The first focus module 144, the second focus module 145, the first exposure module 146, and the second exposure module 147 operate, wherein at least two of the first optimization module 142, the first focus module 144, and the first exposure module 146 The actions are synchronized. The first optimization module 142 performs the first optimization process, that is, determines the second image coordinate reference datum for the second image according to the cropping parameters. The second optimization module 143 corrects the image cropped from the first image based on the operation of the first optimization module 142, and then optimizes the image quality of the corrected image to obtain the second image.
关于第一对焦模块144的动作，则可以分为两种情况，一种是采用相位对焦模式的数字变焦成像装置10，第一对焦模块144执行第一对焦处理，即根据剪裁参数获取用于第二图像的相位对焦坐标参数基准，接着根据该相位对焦坐标参数基准和剪裁参数计算摄像单元的相位对焦模块的相位，以便第二对焦模块145调整镜头对焦，进而实现镜头的对焦动作；另一种是采用反差对焦模式的数字变焦成像装置10，第一对焦模块144同样地执 行第一对焦处理，即根据剪裁参数获取用于第二图像的反差对焦坐标参数基准，然后，通过第二对焦模块145执行后续操作，第二对焦模块145根据第二图像的反差对焦坐标参数基准和第二优化模块143对由第一图像剪裁的图像进行矫正的数据，对摄像单元的反差对焦模块的对比度反差值以及与其相关的对焦参数进行统计，并基于对比度反差值和对焦参数实现摄像单元的对焦操作。第二对焦处理的步骤的上述设置，较之单一的根据第二图像的反差对焦坐标参数基准或根据第二优化模块143对由第一图像剪裁的图像进行矫正的数据，对摄像单元的反差对焦模块的对比度反差值以及与其相关的对焦参数进行统计，能够进一步加强反差对焦的准确性，从而提高无级变焦的用户体验。Regarding the action of the first focusing module 144, it can be divided into two situations. One is the digital zoom imaging device 10 adopting the phase focusing mode. The phase focus coordinate parameter reference of the second image, and then the phase of the phase focus module of the camera unit is calculated according to the phase focus coordinate parameter reference and the cropping parameter, so that the second focus module 145 can adjust the lens focus, thereby realizing the lens focusing action; another It is a digital zoom imaging device 10 that adopts a contrast focusing mode. The first focusing module 144 also performs the first focusing process, that is, acquiring the contrast focusing coordinate parameter reference for the second image according to the cropping parameters, and then passing the second focusing module 145 To perform subsequent operations, the second focus module 145 performs correction data on the image cropped from the first image according to the contrast focus coordinate parameter reference of the second image and the second optimization module 143 to correct the contrast value of the contrast focus module of the camera unit, and The related focus parameters are counted, and the focus operation of the camera unit is realized based on the contrast value and the focus parameters. The above-mentioned setting of the second focus processing step compares the single focus coordinate parameter reference based on the contrast of the second image or based on the correction data of the image cropped from the first image by the second optimization module 143 to focus on the contrast of the camera unit. Statistics on the contrast value of the module and its related focus parameters can further enhance the accuracy of contrast focus, thereby improving the user experience of stepless zoom.
第一曝光模块146则执行第一曝光处理，即根据数字变焦后的图像所对应的待成像客体的对焦位置确定环境光量采样坐标基准，并基于环境光量采样坐标基准进行环境光量的采样，接着通过第二曝光模块147执行第二曝光处理的步骤，即根据环境光量采样坐标基准以及第二优化模块143对由第一图像剪裁的图像进行矫正的数据计算曝光值，基于该曝光值对摄像单元的传感器的感光度进行调整，以便获得相应图像。第二曝光处理步骤的上述设置，较之单一的根据环境光量采样坐标基准或根据第二优化模块143对由第一图像剪裁的图像进行矫正的数据计算曝光值，能够进一步提高曝光值与实际场景环境光量的契合度，从而提高无级变焦的用户体验。The first exposure module 146 performs the first exposure process, that is, according to the focus position of the object to be imaged corresponding to the digitally zoomed image, determines the ambient light amount sampling coordinate reference, and performs the sampling of the ambient light amount based on the ambient light amount sampling coordinate reference, and then passes The second exposure module 147 executes the steps of the second exposure processing, that is, the exposure value is calculated according to the ambient light sampling coordinate reference and the data corrected by the second optimization module 143 on the image cropped from the first image, and the exposure value of the camera unit is calculated based on the exposure value. The sensitivity of the sensor is adjusted in order to obtain the corresponding image. The above setting of the second exposure processing step can further improve the exposure value and the actual scene compared to the single calculation of the exposure value based on the ambient light amount sampling coordinate reference or the data corrected by the second optimization module 143 on the image cropped from the first image. The amount of ambient light fits to improve the user experience of stepless zoom.
在上述示例中，对于采用反差对焦模式的数字变焦成像装置10来说，其第二对焦模块145和第二曝光模块147均采用了第二优化模块143中对图像进行矫正的相关数据，也就是说，在第二优化模块143对由第一图像剪裁的图像进行矫正并将相关矫正数据发送至第二对焦模块145和第二曝光模块147之后，第二优化模块143、第二对焦模块145和第二曝光模块147的后续操作是各自独立的。同样地，在此优选地使第二优化模块143、第二对焦模块145和第二曝光模块147的后续操作尽可能同步地执行，以便进一步缩短从输入变焦参数到最终曝光成像所需的时间，即实现既见既所得的成像效果。In the above example, for the digital zoom imaging device 10 that adopts the contrast focus mode, the second focus module 145 and the second exposure module 147 both use the data related to the image correction in the second optimization module 143, that is, In other words, after the second optimization module 143 corrects the image cropped from the first image and sends the relevant correction data to the second focus module 145 and the second exposure module 147, the second optimization module 143, the second focus module 145, and the The subsequent operations of the second exposure module 147 are independent of each other. Similarly, it is preferable to perform the subsequent operations of the second optimization module 143, the second focus module 145, and the second exposure module 147 as synchronously as possible, so as to further shorten the time required from the input of the zoom parameters to the final exposure and imaging. That is to achieve the imaging effect of what you see and what you get.
以下参照附图7对根据本发明的数字变焦成像方法的步骤进行详细说 明。在此以数码相机为例对根据本发明的数字变焦成像方法进行说明，当然，根据本发明的数字变焦成像方法不局限于用于数码相机，其可以应用于手机相机、无人飞行器航拍相机以及其他用于拍摄的相机上。该数字变焦成像方法包括如下的步骤，首先，接收数字变焦参数，该数字变焦参数可以来自外部的输入，也可以由数码相机自身生成；根据数字变焦参数并行地执行步骤S1-S3中的至少两个：S1.优化第一图像的画质，第一图像通过摄像单元获取；S2.生成摄像单元的对焦参数；和，S3.生成摄像单元的曝光参数。该数字变焦成像方法与以上对本发明的数字变焦成像装置10的操作步骤的说明类似，对相关步骤的展开说明不再赘述。Hereinafter, the steps of the digital zoom imaging method according to the present invention will be described in detail with reference to FIG. 7. Here, a digital camera is taken as an example to describe the digital zoom imaging method according to the present invention. Of course, the digital zoom imaging method according to the present invention is not limited to digital cameras, and can be applied to mobile phone cameras, unmanned aerial vehicle aerial cameras, and Other cameras used for shooting. The digital zoom imaging method includes the following steps. First, a digital zoom parameter is received. The digital zoom parameter can be input from the outside or generated by the digital camera itself; at least two of steps S1-S3 are executed in parallel according to the digital zoom parameter. A: S1. Optimize the image quality of the first image, which is obtained by the camera unit; S2. Generate the focus parameters of the camera unit; and, S3. Generate the exposure parameters of the camera unit. The digital zoom imaging method is similar to the above description of the operation steps of the digital zoom imaging device 10 of the present invention, and the expanded description of related steps will not be repeated.
紧接着，在并行地执行步骤S1-S3中的至少两个步骤之前还包括以下步骤，即根据数字变焦参数获取第一图像的剪裁参数，并根据剪裁参数对第一图像进行剪裁处理。Immediately afterwards, before at least two of the steps S1-S3 are executed in parallel, the following steps are further included, that is, obtaining the cropping parameters of the first image according to the digital zoom parameters, and performing cropping processing on the first image according to the cropping parameters.
步骤S1中的优化第一图像的画质的步骤包括第一优化步骤，步骤S2中的生成摄像单元的对焦参数的步骤包括第一对焦步骤，步骤S3中的生成摄像单元的曝光参数的步骤包括第一曝光步骤，在此，并行地执行步骤S1-S3中的至少两个包括同时执行第一优化步骤、第一对焦步骤和第一曝光步骤中的至少两个。需要说明的是，并行地执行步骤S1-S3中的至少两个包括同时执行步骤S1-S3中的至少两个步骤的各自的一部分步骤。The step of optimizing the image quality of the first image in step S1 includes a first optimization step, the step of generating focus parameters of the camera unit in step S2 includes a first focusing step, and the step of generating exposure parameters of the camera unit in step S3 includes The first exposure step, here, performing at least two of the steps S1-S3 in parallel includes simultaneously performing at least two of the first optimization step, the first focusing step, and the first exposure step. It should be noted that performing at least two of steps S1-S3 in parallel includes performing a part of each of at least two of steps S1-S3 at the same time.
上述第一优化步骤包括根据剪裁参数对图像坐标参考基准进行调整，以确定不同于所述第一图像的第一图像坐标参考基准的第二图像坐标参考基准。上述第一对焦步骤包括根据剪裁参数对第一图像的第一对焦坐标参数基准进行调整，以获得第二对焦坐标参数基准。上述第一优化步骤对于采用相位对焦模式和采用反差对焦模式的数码相机而言均是适用的。对于采用相位对焦模式的数码相机而言，该第一对焦步骤还包括根据第二对焦坐标参数基准和剪裁参数计算摄像单元的相位对焦模块的相位。上述第一曝光步骤包括根据数字变焦后的图像所对应的待成像客体的对焦位置确定环境光量采样坐标基准，并基于环境光量采样坐标基准进行环境光量的采样。The above-mentioned first optimization step includes adjusting the image coordinate reference datum according to the cropping parameters to determine a second image coordinate reference datum that is different from the first image coordinate reference datum of the first image. The above-mentioned first focusing step includes adjusting the first focus coordinate parameter reference of the first image according to the cropping parameter to obtain the second focus coordinate parameter reference. The above-mentioned first optimization step is applicable to both the digital camera adopting the phase focusing mode and the digital camera adopting the contrast focusing mode. For a digital camera adopting a phase focusing mode, the first focusing step further includes calculating the phase of the phase focusing module of the camera unit according to the second focusing coordinate parameter reference and the cropping parameter. The above-mentioned first exposure step includes determining the ambient light amount sampling coordinate reference based on the focus position of the object to be imaged corresponding to the digitally zoomed image, and sampling the ambient light amount based on the ambient light amount sampling coordinate reference.
进一步地，在完成第一优化步骤之后，优化第一图像的画质的步骤还 包括第二优化步骤，第二优化步骤包括基于第二图像坐标参考基准对由第一图像剪裁的图像进行矫正。在此还能够获取对由第一图像剪裁的图像进行矫正的相关数据。紧接着，该第二优化步骤还包括对矫正后的图像进行画质优化，以获得第二图像的步骤。Further, after the first optimization step is completed, the step of optimizing the image quality of the first image further includes a second optimization step, and the second optimization step includes correcting the image cropped from the first image based on the second image coordinate reference standard. Here, it is also possible to obtain relevant data for correcting the image cropped from the first image. Next, the second optimization step further includes the step of optimizing the image quality of the corrected image to obtain a second image.
对于采用反差对焦模式的数码相机而言，生成摄像单元的对焦参数的步骤还包括第二对焦步骤，该第二对焦步骤包括根据第二对焦坐标参数基准和/或对由第一图像剪裁的图像进行矫正的数据，对摄像单元的反差对焦模块的对比度反差值以及与其相关的对焦参数进行统计，并基于对比度反差值和对焦参数实现摄像单元的对焦操作。For a digital camera that adopts a contrast focusing mode, the step of generating the focus parameters of the camera unit further includes a second focusing step. The second focusing step includes a reference to the second focus coordinate parameter and/or an image cropped from the first image. For the corrected data, the contrast value of the contrast focusing module of the camera unit and the related focusing parameters are counted, and the focusing operation of the camera unit is realized based on the contrast contrast value and the focusing parameters.
进一步地，生成摄像单元的曝光参数的步骤还包括第二曝光步骤，该第二曝光步骤包括根据环境光量采样坐标基准和/或对由第一图像剪裁的图像进行矫正的数据计算曝光值。接着，第二曝光步骤还包括根据计算出的曝光值对摄像单元的传感器的感光度进行调整，以便获得所需画质的图像。Further, the step of generating the exposure parameters of the camera unit further includes a second exposure step including calculating an exposure value according to the ambient light amount sampling coordinate reference and/or data for correcting the image cropped from the first image. Then, the second exposure step further includes adjusting the sensitivity of the sensor of the imaging unit according to the calculated exposure value, so as to obtain an image of desired image quality.
在根据本发明的数字变焦成像方法中，接收数字变焦参数的步骤可以包括接收无级变化的数字变焦参数。在此，可以通过以下方式进行变焦参数的输入，一种是通过能够在显示单元上显示的无级变焦参数输入组件接收无级变化的数字变焦参数的输入，另一种是通过机械变焦输入机构接收无级变化的数字变焦参数的输入。另外，根据本发明的数字变焦成像方法还包括在接收数字变焦参数的步骤之前对第一图像进行显示的步骤。In the digital zoom imaging method according to the present invention, the step of receiving a digital zoom parameter may include receiving a steplessly changing digital zoom parameter. Here, the input of zoom parameters can be performed in the following ways. One is to receive the input of continuously variable digital zoom parameters through a stepless zoom parameter input component that can be displayed on the display unit, and the other is to use a mechanical zoom input mechanism. Receive input of stepless change of digital zoom parameters. In addition, the digital zoom imaging method according to the present invention further includes a step of displaying the first image before the step of receiving digital zoom parameters.
根据本发明的数字变焦成像方法通过并行地执行优化画质步骤、生成对焦参数步骤和生成曝光参数步骤中的至少两个或所述至少两个步骤的各自的至少一部分步骤，能够充分地缩短变焦参数输入至最终成像的时间，以便实现变焦即成像的及时变焦成像效果，防止了由于串行地执行优化画质、对焦和曝光而引起的变焦成像的拖尾现象，从而提高了变焦成像效率，改善了用户体验。另外，可以与显示单元结合，通过对变焦前后的图像的显示，实现了变焦成像的既见既所得的效果，进一步改进了数字变焦成像方法的用户友好性。The digital zoom imaging method according to the present invention can sufficiently shorten the zoom by executing at least two of the step of optimizing image quality, the step of generating focus parameters, and the step of generating exposure parameters in parallel, or at least a part of each of the at least two steps. The time when parameters are input to the final imaging in order to achieve the zoom imaging effect of zooming that is imaging in time, preventing the tailing phenomenon of zoom imaging caused by serially performing optimization of image quality, focus and exposure, thereby improving the efficiency of zoom imaging. Improved user experience. In addition, it can be combined with a display unit, and by displaying images before and after zooming, the effect of zoom imaging is achieved, and the user-friendliness of the digital zoom imaging method is further improved.
本发明还涉及一种计算机可读存储介质，该计算机可读存储介质存储 有可执行指令，执行上述可执行指令可以实现如上所述的数字变焦成像方法。The present invention also relates to a computer-readable storage medium storing executable instructions, and executing the above-mentioned executable instructions can realize the digital zoom imaging method as described above.
此外，本发明还公开了一种相机30，如图8所示，该相机30包括光学模组32，该光学模组32用于执行相机30的数字变焦成像，该光学模组32包括用于接收数字变焦参数的变焦参数接收单元12和与变焦参数接收单元12通信连接的控制单元14，控制单元14用于根据数字变焦参数并行地执行以下步骤S1-S3中的至少两个，其中，S1.优化第一图像的画质，第一图像通过相机的摄像单元获取；S2.生成摄像单元的对焦参数；和，S3.生成摄像单元的曝光参数。在此，该光学模组32与以上说明的数字变焦成像装置10具有基本相同的结构，因此，有关相同的内容在此不再赘述。In addition, the present invention also discloses a camera 30. As shown in FIG. 8, the camera 30 includes an optical module 32 for performing digital zoom imaging of the camera 30, and the optical module 32 includes The zoom parameter receiving unit 12 receiving the digital zoom parameter and the control unit 14 communicatively connected with the zoom parameter receiving unit 12, the control unit 14 is configured to execute at least two of the following steps S1-S3 in parallel according to the digital zoom parameter, where S1 . Optimize the image quality of the first image, the first image is obtained by the camera unit of the camera; S2. Generate the focus parameters of the camera unit; and, S3. Generate the exposure parameters of the camera unit. Here, the optical module 32 has basically the same structure as the digital zoom imaging device 10 described above, and therefore, the same content will not be repeated here.
根据本发明所述的相机30的光学模组32还包括图像剪裁单元，该图像剪裁单元与变焦参数接收单元和控制单元通信连接，用于在控制单元并行地执行步骤S1-S3中的至少两个之前根据数字变焦参数获取第一图像的剪裁参数，并根据剪裁参数对第一图像进行剪裁处理。The optical module 32 of the camera 30 according to the present invention further includes an image cropping unit, which is communicatively connected with the zoom parameter receiving unit and the control unit, and is configured to execute at least two of steps S1-S3 in parallel by the control unit. Previously, the cropping parameters of the first image were obtained according to the digital zoom parameters, and the first image was cropped according to the cropping parameters.
该光学模组32的控制单元包括：第一优化模块，用于对第一图像进行第一优化处理；第一对焦模块，用于执行生成摄像单元的对焦参数的第一对焦处理；以及第一曝光模块，用于执行生成摄像单元的曝光参数的第一曝光处理，其中，同时执行第一优化处理、第一对焦处理和第一曝光处理中的至少两个。The control unit of the optical module 32 includes: a first optimization module, configured to perform a first optimization process on a first image; a first focus module, configured to perform a first focus process for generating focus parameters of the camera unit; and a first The exposure module is configured to perform a first exposure process for generating exposure parameters of the camera unit, wherein at least two of the first optimization process, the first focus process, and the first exposure process are simultaneously performed.
第一优化处理包括根据剪裁参数对图像坐标参考基准进行调整，以确定不同于第一图像的第一图像坐标参考基准的第二图像坐标参考基准。第一对焦处理包括根据剪裁参数对第一图像的第一对焦坐标参数基准进行调整，以获得第二对焦坐标参数基准。对于采用相位对焦模式的光学模组32而言，第一对焦处理还包括根据第二对焦坐标参数基准和剪裁参数计算摄像单元的相位对焦模块的相位。根据计算出的相位实现光学模组的对焦操作。第一曝光处理包括根据数字变焦后的图像所对应的待成像客体的对焦位置确定环境光量采样坐标基准，并基于所述环境光量采样坐标基准进行环境光量的采样。The first optimization process includes adjusting the image coordinate reference datum according to the cropping parameter to determine a second image coordinate reference datum that is different from the first image coordinate reference datum of the first image. The first focus processing includes adjusting the first focus coordinate parameter reference of the first image according to the cropping parameter to obtain the second focus coordinate parameter reference. For the optical module 32 adopting the phase focusing mode, the first focusing processing further includes calculating the phase of the phase focusing module of the camera unit according to the second focusing coordinate parameter reference and the cropping parameter. The focusing operation of the optical module is realized according to the calculated phase. The first exposure processing includes determining an ambient light amount sampling coordinate reference based on the focus position of the object to be imaged corresponding to the digitally zoomed image, and sampling the ambient light amount based on the ambient light amount sampling coordinate reference.
该光学模组32的控制单元还包括第二优化模块，第二优化模块基于第二图像坐标参考基准对由第一图像剪裁的图像进行矫正。在此，第二优化模块进一步对矫正后的图像进行画质优化，以获得第二图像。The control unit of the optical module 32 further includes a second optimization module, which corrects the image cropped from the first image based on the second image coordinate reference datum. Here, the second optimization module further optimizes the image quality of the corrected image to obtain the second image.
对于采用反差对焦模式的光学模组32而言，由第一对焦模块执行的第一对焦处理也包括以下步骤，即根据剪裁参数对第一图像的第一对焦坐标参数基准进行调整，以获得第二对焦坐标参数基准。进一步地，控制单元还包括第二对焦模块，该第二对焦模块根据第二对焦坐标参数基准和/或对由第一图像剪裁的图像进行矫正的数据，对摄像单元的反差对焦模块的对比度反差值以及与其相关的对焦参数进行统计，并基于对比度反差值和对焦参数实现摄像单元的对焦操作。该第一曝光处理还包括根据数字变焦后的图像所对应的待成像客体的对焦位置确定环境光量采样坐标基准，并基于环境光量采样坐标基准进行环境光量的采样。For the optical module 32 that adopts the contrast focus mode, the first focus processing performed by the first focus module also includes the following steps, that is, the first focus coordinate parameter reference of the first image is adjusted according to the cropping parameter to obtain the first focus 2. The focus coordinate parameter reference. Further, the control unit further includes a second focus module, the second focus module according to the second focus coordinate parameter reference and/or correction data of the image cropped from the first image, the contrast of the camera unit contrast focus module contrast The value and the related focus parameters are counted, and the focus operation of the camera unit is realized based on the contrast value and the focus parameter. The first exposure processing further includes determining an ambient light amount sampling coordinate reference based on the focus position of the object to be imaged corresponding to the digitally zoomed image, and sampling the ambient light amount based on the ambient light amount sampling coordinate reference.
根据本发明所述的相机30的光学模组32的控制单元还包括第二曝光模块，该第二曝光模块根据环境光量采样坐标基准和/或对由第一图像剪裁的图像进行矫正的数据计算曝光值。进一步地，该第二曝光模块还可以根据计算出的曝光值对摄像单元的传感器的感光度进行调整，以便获得所需画质的图像。The control unit of the optical module 32 of the camera 30 according to the present invention also includes a second exposure module that calculates data based on the sampling coordinate reference of the ambient light amount and/or the image clipped from the first image Exposure value. Further, the second exposure module can also adjust the sensitivity of the sensor of the camera unit according to the calculated exposure value, so as to obtain an image of desired image quality.
优选地，根据本发明的相机30还包括用于向变焦参数接收单元输入无级变化的数字变焦参数的无级变焦参数输入模块。在此，该无级变焦参数接收模块可以包括能够在相机的显示单元上显示的无级变焦参数输入组件，也可以包括机械变焦输入机构。该相机30还可以包括用于显示第一图像的显示单元，该显示单元同时可以显示对第一图像进行变焦处理后的图像。Preferably, the camera 30 according to the present invention further includes a stepless zoom parameter input module for inputting a steplessly changing digital zoom parameter to the zoom parameter receiving unit. Here, the stepless zoom parameter receiving module may include a stepless zoom parameter input component that can be displayed on the display unit of the camera, or may include a mechanical zoom input mechanism. The camera 30 may further include a display unit for displaying the first image, and the display unit may simultaneously display an image after the first image is zoomed.
在根据本发明所述的数字变焦成像装置10的实施例中，数字变焦成像装置10的各个部件可以集成地配置在同一设备中，该设备可以为例如，照相机、摄像机或具有图像拍摄功能的智能终端设备，比如手机、平板电脑或笔记本电脑等。或者，上述数字变焦成像装置10的各个部件也可以配置在不同的设备中，比如，上述数字变焦成像装置10的摄像单元可以配置在无人飞行器中，显示单元18可以配置在能够与该无人飞行器通信 连接的控制终端(例如，遥控器或安装有控制程序的智能终端)中，数字变焦成像装置10的其他部件可以配置在无人飞行器中，也可以配置在控制终端中，本发明在此并未做出特别限定。In the embodiment of the digital zoom imaging device 10 according to the present invention, the various components of the digital zoom imaging device 10 may be integratedly configured in the same device. The device may be, for example, a camera, a video camera, or a smart device with an image capturing function. Terminal equipment, such as mobile phones, tablets, or laptops. Alternatively, the various components of the aforementioned digital zoom imaging device 10 can also be configured in different equipment. For example, the camera unit of the aforementioned digital zoom imaging device 10 can be configured in an unmanned aerial vehicle, and the display unit 18 can be configured to be able to interact with the unmanned aerial vehicle. In the control terminal (for example, a remote control or a smart terminal installed with a control program) of the aircraft communication connection, other components of the digital zoom imaging device 10 can be configured in the unmanned aerial vehicle or in the control terminal. The present invention is here. No particular limitation is made.
在特定场景下，无人飞行器系统可以通过载体携带用于执行特定任务的负载。例如，在利用无人飞行器系统进行航空拍摄时，无人飞行器系统可以通过云台携带拍摄设备，拍摄设备例如为根据本发明的实施例所述的数字变焦成像装置10。图9是根据本发明的实施例的无人飞行器系统40的示意性结构图。该无人飞行器系统40可以包括无人飞行器42、由无人飞行器42承载的云台装置44、拍摄装置以及与无人飞行器42、云台装置44和拍摄装置通信连接并对其进行控制的控制装置46，其中，该无人飞行器系统40的拍摄装置即为根据本发明的实施例所述的数字变焦成像装置10，或者可以具有与数字变焦成像装置10基本相同的结构，其中，数字变焦成像装置10的摄像单元配置在云台装置44中，数字变焦成像装置10的显示单元18配置在控制装置46中。在此，数字变焦成像装置10的变焦参数接收单元12可以集成在显示单元18中，控制单元14可以与摄像单元集成地设置，数字变焦成像装置10的其他部件可以根据实际需求进行设置。当然，如果数字变焦成像装置10设置有机械变焦输入机构时，该机械变焦输入机构也设置在控制装置46中，控制装置46可以与无人飞行器42、云台装置44以及搭载在云台装置44上的摄像单元通信连接，以便对无人飞行器42、云台装置44和摄像单元进行控制。当然，显示单元18也可以与控制装置46相互独立地设置，在此对两者的相互关系不做特别限定。In certain scenarios, the unmanned aerial vehicle system can carry payloads used to perform specific tasks through the carrier. For example, when an unmanned aerial vehicle system is used for aerial photography, the unmanned aerial vehicle system may carry a photographing device through a pan/tilt. The photographing device is, for example, the digital zoom imaging device 10 according to an embodiment of the present invention. FIG. 9 is a schematic structural diagram of an unmanned aerial vehicle system 40 according to an embodiment of the present invention. The unmanned aerial vehicle system 40 may include an unmanned aerial vehicle 42, a pan/tilt device 44 carried by the unmanned aerial vehicle 42, a photographing device, and a control for communicating and controlling the unmanned aerial vehicle 42, the pan/tilt device 44, and the photographing device. Device 46, wherein the photographing device of the UAV system 40 is the digital zoom imaging device 10 according to the embodiment of the present invention, or may have basically the same structure as the digital zoom imaging device 10, wherein the digital zoom imaging device 10 The camera unit of the device 10 is configured in the pan-tilt device 44, and the display unit 18 of the digital zoom imaging device 10 is configured in the control device 46. Here, the zoom parameter receiving unit 12 of the digital zoom imaging device 10 may be integrated in the display unit 18, the control unit 14 may be integrated with the camera unit, and other components of the digital zoom imaging device 10 may be set according to actual requirements. Of course, if the digital zoom imaging device 10 is provided with a mechanical zoom input mechanism, the mechanical zoom input mechanism is also provided in the control device 46. The control device 46 can be combined with the unmanned aerial vehicle 42, the pan/tilt device 44, and the pan/tilt device 44. The camera unit on the computer is connected in communication to control the unmanned aerial vehicle 42, the pan-tilt device 44 and the camera unit. Of course, the display unit 18 and the control device 46 can also be arranged independently of each other, and the mutual relationship between the two is not particularly limited here.
无人飞行器42可以根据预先编好的程序指令执行相关飞行操作，或者也可以通过响应来自控制装置46的一个或多个控制指令对无人飞行器42进行控制。云台装置44同样也可以响应于控制装置46的指令而运动，从而带动摄像单元执行所需的运动或动作。The unmanned aerial vehicle 42 can perform related flight operations according to pre-programmed program instructions, or can also control the unmanned aerial vehicle 42 by responding to one or more control instructions from the control device 46. The pan/tilt device 44 can also move in response to instructions from the control device 46 to drive the camera unit to perform the required movement or action.
在利用根据本发明的无人飞行器系统40执行航拍任务时，可以通过控制装置46控制无人飞行器42的飞行轨迹和相关飞行状态，并且同时通过控制装置46控制云台装置44的相关动作，当然，在此也可以设置另外 的专门用于控制云台装置44的控制装置，以便使云台装置44按照需求带动摄像单元执行相关拍摄任务。进一步地，可以通过设置在控制装置46中的显示单元18对摄像单元的取景进行观察，根据实际需要适时地启用摄像单元以便对所需图像进行拍摄。当需要对相关图像进行数字变焦时，比如当需要改变图像的视场角时，可以通过对显示单元18上显示的图像进行数字变焦操作，在显示单元18上显示数字变焦后的图像的同时，摄像单元完成待成像客体的成像操作，具体成像过程参见以上对数字变焦成像装置10的成像过程的描述，在此不再赘述。When using the unmanned aerial vehicle system 40 according to the present invention to perform aerial photography tasks, the flight trajectory and related flight status of the unmanned aerial vehicle 42 can be controlled by the control device 46, and at the same time, the control device 46 can control the related actions of the pan/tilt device 44. Of course Here, another control device dedicated to controlling the pan-tilt device 44 can also be provided, so that the pan-tilt device 44 drives the camera unit to perform related shooting tasks as required. Further, the viewfinder of the camera unit can be observed through the display unit 18 provided in the control device 46, and the camera unit can be activated in a timely manner according to actual needs in order to capture the desired image. When the related image needs to be digitally zoomed, such as when the angle of view of the image needs to be changed, the image displayed on the display unit 18 can be digitally zoomed to display the digitally zoomed image on the display unit 18. The imaging unit completes the imaging operation of the object to be imaged. For the specific imaging process, please refer to the above description of the imaging process of the digital zoom imaging device 10, which will not be repeated here.
需要说明的是，本专利的说明书通篇中提到的“一个实施例”或“实施例”意味着与实施例有关的特定特征、结构或特性包括在本发明的至少一个实施例中。因此，在整个说明书各处出现的“在一个实施例中”未必一定指相同的实施例。此外，在不冲突的情况下，这些实施例及实施例中特定的特征、结构或特性可以任意适合的方式结合在一个或多个实施例中。It should be noted that "one embodiment" or "an embodiment" mentioned throughout the specification of this patent means that a specific feature, structure, or characteristic related to the embodiment is included in at least one embodiment of the present invention. Therefore, the appearance of "in one embodiment" in various places throughout the specification does not necessarily refer to the same embodiment. In addition, if there is no conflict, these embodiments and specific features, structures, or characteristics in the embodiments can be combined in one or more embodiments in any suitable manner.
应当理解的是，在本发明的各种实施例中，上述各过程的序号的大小并不意味着执行顺序的先后，各过程的执行顺序应以其功能和内在逻辑确定，而不应对本发明实施例的实施过程构成任何限定。It should be understood that, in various embodiments of the present invention, the size of the sequence numbers of the above-mentioned processes does not mean the order of execution. The execution order of the processes should be determined by their functions and internal logic, and should not be used in the present invention. The implementation process of the embodiment constitutes any limitation.
本领域普通技术人员可以意识到的是，结合本文中所公开的实施例描述的各个示例的单元和算法步骤，能够以电子硬件、或者计算机软件和电子硬件的结合来实现。这些功能究竟以硬件还是软件方式来执行，取决于技术方案的特定应用和设计约束条件。本领域技术人员可以对每个特定的应用来使用不同方法以实现所描述的功能，但是这种实现不应被视为超出了本发明的保护范围。Those of ordinary skill in the art may be aware that the units and algorithm steps of the various examples described in combination with the embodiments disclosed herein can be implemented by electronic hardware or a combination of computer software and electronic hardware. Whether these functions are executed by hardware or software depends on the specific application and design constraint conditions of the technical solution. Those skilled in the art can use different methods for each specific application to realize the described functions, but this realization should not be regarded as going beyond the protection scope of the present invention.
在本申请所提供的几个实施例中，应该理解的是，所公开的系统、装置和方法，可以通过其他的方式实现。例如，以上所描述的装置实施例仅是示意性的，例如，所述单元的划分仅为一种逻辑功能划分，实际实现时可以有另外的划分方式，例如多个单元或组件可以结合或者可以集成到另一个系统中，或者一些特征可以忽略，或不执行。另外，所显示或讨论的相互之间的关联或通信连接可以是通过一些接口、装置或单元的间接关联或通信连接，可以是电性的、机械的或其他的形式。In the several embodiments provided in this application, it should be understood that the disclosed system, device, and method may be implemented in other ways. For example, the device embodiments described above are only illustrative. For example, the division of the units is only a logical function division, and there may be other divisions in actual implementation, for example, multiple units or components may be combined or may be Integrate into another system, or some features can be ignored or not implemented. In addition, the displayed or discussed mutual associations or communication connections may be indirect associations or communication connections through some interfaces, devices or units, and may be in electrical, mechanical or other forms.
作为分离部件说明的单元可以是或者也可以不是物理上分开的，作为单元显示的部件可以是或者也可以不是物理单元，即可以位于一个地方，或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的目的。The units described as separate components may or may not be physically separate, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the objectives of the solutions of the embodiments.
另外，在本发明各个实施例中的各个功能单元可以集成在一个处理单元中，也可以是各个单元单独物理存在，也可以两个或两个以上单元集成在一个单元中。In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units may be integrated into one unit.
以上所述仅为本发明的优选实施例而已，并不用于限制本发明，对于本领域的技术人员来说，本发明可以有各种更改和变化。凡在本发明的精神和原则之内，所作的任何修改、等同替换、改进等，均应包含在本发明的保护范围之内。The above descriptions are only preferred embodiments of the present invention and are not used to limit the present invention. For those skilled in the art, the present invention can have various modifications and changes. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims (73)

  1. 一种数字变焦成像方法，其特征在于，所述方法包括：A digital zoom imaging method, characterized in that the method includes:
    接收数字变焦参数；Receive digital zoom parameters;
    根据所述数字变焦参数并行地执行步骤S1-S3中的至少两个：Perform at least two of steps S1-S3 in parallel according to the digital zoom parameter:
    S1.优化第一图像的画质，所述第一图像通过摄像单元获取；S1. Optimize the image quality of the first image, the first image being acquired by the camera unit;
    S2.生成所述摄像单元的对焦参数；和S2. Generate focus parameters of the camera unit; and
    S3.生成所述摄像单元的曝光参数。S3. Generate exposure parameters of the camera unit.
  2. 根据权利要求1所述的数字变焦成像方法，其特征在于，The digital zoom imaging method of claim 1, wherein:
    在并行地执行步骤S1-S3中的至少两个之前还包括步骤：根据所述数字变焦参数获取所述第一图像的剪裁参数，并根据所述剪裁参数对所述第一图像进行剪裁处理。Before performing at least two of steps S1-S3 in parallel, the method further includes the step of: acquiring a cropping parameter of the first image according to the digital zoom parameter, and performing cropping processing on the first image according to the cropping parameter.
  3. 根据权利要求2所述的数字变焦成像方法，其特征在于，The digital zoom imaging method of claim 2, wherein:
    优化第一图像的画质的步骤包括第一优化步骤；The step of optimizing the image quality of the first image includes a first optimization step;
    生成所述摄像单元的对焦参数的步骤包括第一对焦步骤；以及The step of generating the focusing parameters of the camera unit includes a first focusing step; and
    生成所述摄像单元的曝光参数的步骤包括第一曝光步骤；The step of generating the exposure parameters of the camera unit includes a first exposure step;
    其中，并行地执行步骤S1-S3中的至少两个包括同时执行所述第一优化步骤、所述第一对焦步骤和所述第一曝光步骤中的至少两个。Wherein, performing at least two of steps S1-S3 in parallel includes simultaneously performing at least two of the first optimization step, the first focusing step, and the first exposure step.
  4. 根据权利要求3所述的数字变焦成像方法，其特征在于，The digital zoom imaging method according to claim 3, wherein:
    所述第一优化步骤包括：根据所述剪裁参数对图像坐标参考基准进行调整，以确定不同于所述第一图像的第一图像坐标参考基准的第二图像坐标参考基准。The first optimization step includes: adjusting an image coordinate reference datum according to the cropping parameter to determine a second image coordinate reference datum that is different from the first image coordinate reference datum of the first image.
  5. 根据权利要求3所述的数字变焦成像方法，其特征在于，The digital zoom imaging method according to claim 3, wherein:
    所述第一对焦步骤包括：根据所述剪裁参数对所述第一图像的第一对焦坐标参数基准进行调整，以获得第二对焦坐标参数基准。The first focusing step includes: adjusting a first focus coordinate parameter reference of the first image according to the cropping parameter to obtain a second focus coordinate parameter reference.
  6. 根据权利要求5所述的数字变焦成像方法，其特征在于，The digital zoom imaging method of claim 5, wherein:
    所述第一对焦步骤还包括：根据所述第二对焦坐标参数基准和所述剪裁参数计算所述摄像单元的相位对焦模块的相位。The first focusing step further includes: calculating the phase of the phase focusing module of the camera unit according to the second focusing coordinate parameter reference and the cropping parameter.
  7. 根据权利要求3所述的数字变焦成像方法，其特征在于，The digital zoom imaging method according to claim 3, wherein:
    所述第一曝光步骤包括：根据数字变焦后的图像所对应的待成像客体的对焦位置确定环境光量采样坐标基准，并基于所述环境光量采样坐标基准进行环境光量的采样。The first exposure step includes: determining an ambient light amount sampling coordinate reference based on the focus position of the object to be imaged corresponding to the digitally zoomed image, and sampling the ambient light amount based on the ambient light amount sampling coordinate reference.
  8. 根据权利要求4所述的数字变焦成像方法，其特征在于，The digital zoom imaging method of claim 4, wherein:
    优化第一图像的画质的步骤还包括第二优化步骤，所述第二优化步骤包括：基于所述第二图像坐标参考基准对由所述第一图像剪裁的图像进行矫正。The step of optimizing the image quality of the first image further includes a second optimization step, and the second optimization step includes: correcting the image cropped from the first image based on the second image coordinate reference standard.
  9. 根据权利要求8所述的数字变焦成像方法，其特征在于，The digital zoom imaging method according to claim 8, wherein:
    所述第二优化步骤还包括：对矫正后的图像进行画质优化，以获得第二图像。The second optimization step further includes: optimizing the image quality of the corrected image to obtain a second image.
  10. 根据权利要求8所述的数字变焦成像方法，其特征在于，The digital zoom imaging method according to claim 8, wherein:
    所述第一对焦步骤包括：根据所述剪裁参数对所述第一图像的第一对焦坐标参数基准进行调整，以获得第二对焦坐标参数基准。The first focusing step includes: adjusting a first focus coordinate parameter reference of the first image according to the cropping parameter to obtain a second focus coordinate parameter reference.
  11. 根据权利要求10所述的数字变焦成像方法，其特征在于，The digital zoom imaging method of claim 10, wherein:
    生成所述摄像单元的对焦参数的步骤还包括第二对焦步骤，所述第二对焦步骤包括：根据所述第二对焦坐标参数基准和/或对由所述第一图像剪裁的图像进行矫正的数据，对所述摄像单元的反差对焦模块的对比度反差值以及与其相关的对焦参数进行统计，并基于所述对比度反差值和所述对焦参数实现所述摄像单元的对焦操作。The step of generating the focusing parameters of the camera unit further includes a second focusing step, and the second focusing step includes: correcting the image cropped from the first image according to the second focusing coordinate parameter reference and/or According to the data, the contrast value of the contrast focus module of the camera unit and the related focus parameters are counted, and the focusing operation of the camera unit is implemented based on the contrast value and the focus parameter.
  12. 根据权利要求8所述的数字变焦成像方法，其特征在于，The digital zoom imaging method according to claim 8, wherein:
    所述第一曝光步骤包括：根据数字变焦后的图像所对应的待成像客体的对焦位置确定环境光量采样坐标基准，并基于所述环境光量采样坐标基准进行环境光量的采样。The first exposure step includes: determining an ambient light amount sampling coordinate reference based on the focus position of the object to be imaged corresponding to the digitally zoomed image, and sampling the ambient light amount based on the ambient light amount sampling coordinate reference.
  13. 根据权利要求12所述的数字变焦成像方法，其特征在于，The digital zoom imaging method of claim 12, wherein:
    生成所述摄像单元的曝光参数的步骤还包括第二曝光步骤：所述第二曝光步骤包括：根据所述环境光量采样坐标基准和/或对由所述第一图像剪裁的图像进行矫正的数据计算曝光值。The step of generating the exposure parameters of the camera unit further includes a second exposure step: the second exposure step includes: sampling coordinate references according to the amount of ambient light and/or data for correcting the image cropped from the first image Calculate the exposure value.
  14. 根据权利要求13所述的数字变焦成像方法，其特征在于，The digital zoom imaging method of claim 13, wherein:
    所述第二曝光步骤还包括：根据计算出的曝光值对所述摄像单元的传感器的感光度进行调整，以便获得所需画质的图像。The second exposure step further includes: adjusting the sensitivity of the sensor of the imaging unit according to the calculated exposure value, so as to obtain an image of desired image quality.
  15. 根据权利要求1所述的数字变焦成像方法，其特征在于，The digital zoom imaging method of claim 1, wherein:
    接收数字变焦参数的步骤包括接收无级变化的数字变焦参数。The step of receiving the digital zoom parameter includes receiving the stepless change of the digital zoom parameter.
  16. 根据权利要求15所述的数字变焦成像方法，其特征在于，The digital zoom imaging method of claim 15, wherein:
    通过能够在显示单元上显示的无级变焦参数输入组件接收所述数字变焦参数的输入。The input of the digital zoom parameter is received through a stepless zoom parameter input component that can be displayed on the display unit.
  17. 根据权利要求15所述的数字变焦成像方法，其特征在于，The digital zoom imaging method of claim 15, wherein:
    通过机械变焦输入机构接收所述数字变焦参数的输入。The input of the digital zoom parameter is received through a mechanical zoom input mechanism.
  18. 根据权利要求1所述的数字变焦成像方法，其特征在于，The digital zoom imaging method of claim 1, wherein:
    在接收数字变焦参数的步骤之前还包括对第一图像进行显示的步骤。Before the step of receiving the digital zoom parameter, the method further includes the step of displaying the first image.
  19. 一种计算机可读存储介质，所述计算机可读存储介质存储有可执行指令，其特征在于，A computer-readable storage medium storing executable instructions, characterized in that:
    执行所述可执行指令以实现根据权利要求1至18中任一项所述的数字变焦成像方法。The executable instructions are executed to implement the digital zoom imaging method according to any one of claims 1 to 18.
  20. 一种数字变焦成像装置，其特征在于，所述数字变焦成像装置包括：A digital zoom imaging device, characterized in that the digital zoom imaging device includes:
    变焦参数接收单元，用于接收数字变焦参数；以及A zoom parameter receiving unit for receiving digital zoom parameters; and
    控制单元，与所述变焦参数接收单元通信连接，用于根据所述数字变焦参数并行地执行步骤S1-S3中的至少两个：The control unit is communicatively connected with the zoom parameter receiving unit, and is configured to execute at least two of steps S1-S3 in parallel according to the digital zoom parameter:
    S1.优化第一图像的画质，所述第一图像通过摄像单元获取；S1. Optimize the image quality of the first image, the first image being acquired by the camera unit;
    S2.生成所述摄像单元的对焦参数；和S2. Generate focus parameters of the camera unit; and
    S3.生成所述摄像单元的曝光参数。S3. Generate exposure parameters of the camera unit.
  21. 根据权利要求20所述的数字变焦成像装置，其特征在于，The digital zoom imaging device of claim 20, wherein:
    还包括图像剪裁单元，所述图像剪裁单元与所述变焦参数接收单元和所述控制单元通信连接，用于在所述控制单元并行地执行步骤S1-S3中的至少两个之前根据所述数字变焦参数获取所述第一图像的剪裁参数，并根据所述剪裁参数对所述第一图像进行剪裁处理。It also includes an image trimming unit, which is communicatively connected to the zoom parameter receiving unit and the control unit, and configured to perform according to the number before the control unit executes at least two of steps S1-S3 in parallel. The zoom parameter acquires the cropping parameter of the first image, and performs cropping processing on the first image according to the cropping parameter.
  22. 根据权利要求21所述的数字变焦成像装置，其特征在于，The digital zoom imaging device according to claim 21, wherein:
    所述控制单元包括：第一优化模块，用于对第一图像进行第一优化处理；第一对焦模块，用于执行生成所述摄像单元的对焦参数的第一对焦处理；以及第一曝光模块，用于执行生成所述摄像单元的曝光参数的第一曝光处理，The control unit includes: a first optimization module for performing first optimization processing on a first image; a first focusing module for performing first focusing processing for generating focusing parameters of the camera unit; and a first exposure module , For performing the first exposure process for generating the exposure parameters of the camera unit,
    其中，同时执行所述第一优化处理、所述第一对焦处理和所述第一曝光处理中的至少两个。Wherein, at least two of the first optimization processing, the first focusing processing, and the first exposure processing are performed at the same time.
  23. 根据权利要求22所述的数字变焦成像装置，其特征在于，The digital zoom imaging device of claim 22, wherein:
    所述第一优化处理包括：根据所述剪裁参数对图像坐标参考基准进行调整，以确定不同于所述第一图像的第一图像坐标参考基准的第二图像坐标参考基准。The first optimization processing includes: adjusting an image coordinate reference datum according to the cropping parameter to determine a second image coordinate reference datum that is different from the first image coordinate reference datum of the first image.
  24. 根据权利要求23所述的数字变焦成像装置，其特征在于，The digital zoom imaging device of claim 23, wherein:
    所述第一对焦处理包括：根据所述剪裁参数对所述第一图像的第一对焦坐标参数基准进行调整，以获得第二对焦坐标参数基准。The first focus processing includes: adjusting a first focus coordinate parameter reference of the first image according to the cropping parameter to obtain a second focus coordinate parameter reference.
  25. 根据权利要求24所述的数字变焦成像装置，其特征在于，The digital zoom imaging device of claim 24, wherein:
    所述第一对焦处理还包括：根据所述第二对焦坐标参数基准和所述剪裁参数计算所述摄像单元的相位对焦模块的相位。The first focus processing further includes: calculating the phase of the phase focus module of the camera unit according to the second focus coordinate parameter reference and the cropping parameter.
  26. 根据权利要求22所述的数字变焦成像装置，其特征在于，The digital zoom imaging device of claim 22, wherein:
    所述第一曝光处理包括：根据数字变焦后的图像所对应的待成像客体的对焦位置确定环境光量采样坐标基准，并基于所述环境光量采样坐标基准进行环境光量的采样。The first exposure processing includes: determining an ambient light amount sampling coordinate reference based on the focus position of the object to be imaged corresponding to the digitally zoomed image, and sampling the ambient light amount based on the ambient light amount sampling coordinate reference.
  27. 根据权利要求23所述的数字变焦成像装置，其特征在于，The digital zoom imaging device of claim 23, wherein:
    所述控制单元还包括第二优化模块，所述第二优化模块基于所述第二图像坐标参考基准对由所述第一图像剪裁的图像进行矫正。The control unit further includes a second optimization module that corrects the image cropped from the first image based on the second image coordinate reference datum.
  28. 根据权利要求27所述的数字变焦成像装置，其特征在于，The digital zoom imaging device of claim 27, wherein:
    所述第二优化模块对矫正后的图像进行画质优化，以获得第二图像。The second optimization module optimizes the image quality of the corrected image to obtain a second image.
  29. 根据权利要求27所述的数字变焦成像装置，其特征在于，The digital zoom imaging device of claim 27, wherein:
    所述第一对焦处理包括：根据所述剪裁参数对所述第一图像的第一对焦坐标参数基准进行调整，以获得第二对焦坐标参数基准。The first focus processing includes: adjusting a first focus coordinate parameter reference of the first image according to the cropping parameter to obtain a second focus coordinate parameter reference.
  30. 根据权利要求29所述的数字变焦成像装置，其特征在于，The digital zoom imaging device of claim 29, wherein:
    所述控制单元还包括第二对焦模块，所述第二对焦模块根据所述第二对焦坐标参数基准和/或对由所述第一图像剪裁的图像进行矫正的数据，对所述摄像单元的反差对焦模块的对比度反差值以及与其相关的对焦参数进行统计，并基于所述对比度反差值和所述对焦参数实现所述摄像单元的对焦操作。The control unit further includes a second focusing module, which performs correction on the image clipped from the first image according to the second focusing coordinate parameter reference and/or data for correcting the image cropped from the first image The contrast value of the contrast focusing module and the related focusing parameters are counted, and the focusing operation of the camera unit is implemented based on the contrast value and the focusing parameter.
  31. 根据权利要求27所述的数字变焦成像装置，其特征在于，The digital zoom imaging device of claim 27, wherein:
    所述第一曝光处理包括：根据数字变焦后的图像所对应的待成像客体的对焦位置确定环境光量采样坐标基准，并基于所述环境光量采样坐标基准进行环境光量的采样。The first exposure processing includes: determining an ambient light amount sampling coordinate reference based on the focus position of the object to be imaged corresponding to the digitally zoomed image, and sampling the ambient light amount based on the ambient light amount sampling coordinate reference.
  32. 根据权利要求31所述的数字变焦成像装置，其特征在于，The digital zoom imaging device according to claim 31, wherein:
    所述控制单元还包括第二曝光模块，所述第二曝光模块根据所述环境光量采样坐标基准和/或对由所述第一图像剪裁的图像进行矫正的数据计算曝光值。The control unit further includes a second exposure module that calculates an exposure value according to the ambient light amount sampling coordinate reference and/or data for correcting the image cropped from the first image.
  33. 根据权利要求32所述的数字变焦成像装置，其特征在于，The digital zoom imaging device of claim 32, wherein:
    所述第二曝光模块还根据计算出的曝光值对所述摄像单元的传感器的感光度进行调整，以便获得所需画质的图像。The second exposure module further adjusts the sensitivity of the sensor of the imaging unit according to the calculated exposure value, so as to obtain an image of required image quality.
  34. 根据权利要求20所述的数字变焦成像装置，其特征在于，The digital zoom imaging device of claim 20, wherein:
    还包括用于向所述变焦参数接收单元输入无级变化的数字变焦参数的无级变焦参数输入模块。It also includes a stepless zoom parameter input module for inputting a steplessly changing digital zoom parameter to the zoom parameter receiving unit.
  35. 根据权利要求34所述的数字变焦成像装置，其特征在于，The digital zoom imaging device according to claim 34, wherein:
    所述无级变焦参数输入模块包括能够在显示单元上显示的无级变焦参数输入组件。The stepless zoom parameter input module includes a stepless zoom parameter input component that can be displayed on a display unit.
  36. 根据权利要求34所述的数字变焦成像装置，其特征在于，The digital zoom imaging device according to claim 34, wherein:
    所述无级变焦参数输入模块包括机械变焦输入机构。The stepless zoom parameter input module includes a mechanical zoom input mechanism.
  37. 根据权利要求20所述的数字变焦成像装置，其特征在于，The digital zoom imaging device of claim 20, wherein:
    还包括用于显示第一图像的显示单元。It also includes a display unit for displaying the first image.
  38. 一种相机，包括光学模组，所述光学模组用于执行所述相机的数字变焦成像，所述光学模组包括：A camera includes an optical module configured to perform digital zoom imaging of the camera, and the optical module includes:
    变焦参数接收单元，用于接收数字变焦参数；以及A zoom parameter receiving unit for receiving digital zoom parameters; and
    控制单元，与所述变焦参数接收单元通信连接，用于根据所述数字变焦参数并行地执行步骤S1-S3中的至少两个：The control unit is in communication connection with the zoom parameter receiving unit, and is configured to execute at least two of steps S1-S3 in parallel according to the digital zoom parameter:
    S1.优化第一图像的画质，所述第一图像通过所述相机的摄像单元获取；S1. Optimize the image quality of the first image, the first image being acquired by the camera unit of the camera;
    S2.生成所述摄像单元的对焦参数；和S2. Generate focus parameters of the camera unit; and
    S3.生成所述摄像单元的曝光参数。S3. Generate exposure parameters of the camera unit.
  39. 根据权利要求38所述的相机，其特征在于，The camera of claim 38, wherein:
    所述光学模组还包括图像剪裁单元，所述图像剪裁单元与所述变焦参数接收单元和所述控制单元通信连接，用于在所述控制单元并行地执行步骤S1-S3中的至少两个之前根据所述数字变焦参数获取所述第一图像的剪裁参数，并根据所述剪裁参数对所述第一图像进行剪裁处理。The optical module further includes an image cutting unit, which is communicatively connected with the zoom parameter receiving unit and the control unit, and is configured to execute at least two of steps S1-S3 in parallel by the control unit Previously, the cropping parameter of the first image was obtained according to the digital zoom parameter, and the first image was cropped according to the cropping parameter.
  40. 根据权利要求39所述的相机，其特征在于，The camera of claim 39, wherein:
    所述控制单元包括：第一优化模块，用于对第一图像进行第一优化处理；第一对焦模块，用于执行生成所述摄像单元的对焦参数的第一对焦处理；以及第一曝光模块，用于执行生成所述摄像单元的曝光参数的第一曝光处理，The control unit includes: a first optimization module for performing first optimization processing on a first image; a first focusing module for performing first focusing processing for generating focusing parameters of the camera unit; and a first exposure module , For performing the first exposure process for generating the exposure parameters of the camera unit,
    其中，同时执行所述第一优化处理、所述第一对焦处理和所述第一曝光处理中的至少两个。Wherein, at least two of the first optimization processing, the first focusing processing, and the first exposure processing are performed at the same time.
  41. 根据权利要求40所述的相机，其特征在于，The camera of claim 40, wherein:
    所述第一优化处理包括：根据所述剪裁参数对图像坐标参考基准进行调整，以确定不同于所述第一图像的第一图像坐标参考基准的第二图像坐标参考基准。The first optimization processing includes: adjusting an image coordinate reference datum according to the cropping parameter to determine a second image coordinate reference datum that is different from the first image coordinate reference datum of the first image.
  42. 根据权利要求40所述的相机，其特征在于，The camera of claim 40, wherein:
    所述第一对焦处理包括：根据所述剪裁参数对所述第一图像的第一对焦坐标参数基准进行调整，以获得第二对焦坐标参数基准。The first focus processing includes: adjusting a first focus coordinate parameter reference of the first image according to the cropping parameter to obtain a second focus coordinate parameter reference.
  43. 根据权利要求42所述的相机，其特征在于，The camera of claim 42, wherein:
    所述第一对焦处理还包括：根据所述第二对焦坐标参数基准和所述剪裁参数计算所述摄像单元的相位对焦模块的相位。The first focus processing further includes: calculating the phase of the phase focus module of the camera unit according to the second focus coordinate parameter reference and the cropping parameter.
  44. 根据权利要求40所述的相机，其特征在于，The camera of claim 40, wherein:
    所述第一曝光处理包括：根据数字变焦后的图像所对应的待成像客体的对焦位置确定环境光量采样坐标基准，并基于所述环境光量采样坐标基准进行环境光量的采样。The first exposure processing includes: determining an ambient light amount sampling coordinate reference based on the focus position of the object to be imaged corresponding to the digitally zoomed image, and sampling the ambient light amount based on the ambient light amount sampling coordinate reference.
  45. 根据权利要求41所述的相机，其特征在于，The camera of claim 41, wherein:
    所述控制单元还包括第二优化模块，所述第二优化模块基于所述第二图像坐标参考基准对由所述第一图像剪裁的图像进行矫正。The control unit further includes a second optimization module that corrects the image cropped from the first image based on the second image coordinate reference datum.
  46. 根据权利要求45所述的相机，其特征在于，The camera of claim 45, wherein:
    所述第二优化模块对矫正后的图像进行画质优化，以获得第二图像。The second optimization module optimizes the image quality of the corrected image to obtain a second image.
  47. 根据权利要求45所述的相机，其特征在于，The camera of claim 45, wherein:
    所述第一对焦处理包括：根据所述剪裁参数对所述第一图像的第一对焦坐标参数基准进行调整，以获得第二对焦坐标参数基准。The first focus processing includes: adjusting a first focus coordinate parameter reference of the first image according to the cropping parameter to obtain a second focus coordinate parameter reference.
  48. 根据权利要求47所述的相机，其特征在于，The camera of claim 47, wherein:
    所述控制单元还包括第二对焦模块，所述第二对焦模块根据所述第二对焦坐标参数基准和/或对由所述第一图像剪裁的图像进行矫正的数据，对所述摄像单元的反差对焦模块的对比度反差值以及与其相关的对焦参数进行统计，并基于所述对比度反差值和所述对焦参数实现所述摄像单元的对焦操作。The control unit further includes a second focusing module, which performs correction on the image clipped from the first image according to the second focusing coordinate parameter reference and/or data for correcting the image cropped from the first image The contrast value of the contrast focusing module and the related focusing parameters are counted, and the focusing operation of the camera unit is implemented based on the contrast value and the focusing parameter.
  49. 根据权利要求45所述的相机，其特征在于，The camera of claim 45, wherein:
    所述第一曝光处理包括：根据数字变焦后的图像所对应的待成像客体 的对焦位置确定环境光量采样坐标基准，并基于所述环境光量采样坐标基准进行环境光量的采样。The first exposure processing includes: determining an ambient light amount sampling coordinate reference based on the focus position of the object to be imaged corresponding to the digitally zoomed image, and sampling the ambient light amount based on the ambient light amount sampling coordinate reference.
  50. 根据权利要求49所述的相机，其特征在于，The camera of claim 49, wherein:
    所述控制单元还包括第二曝光模块，所述第二曝光模块根据所述环境光量采样坐标基准和/或对由所述第一图像剪裁的图像进行矫正的数据计算曝光值。The control unit further includes a second exposure module that calculates an exposure value according to the ambient light amount sampling coordinate reference and/or data for correcting the image cropped from the first image.
  51. 根据权利要求50所述的相机，其特征在于，The camera of claim 50, wherein:
    所述第二曝光模块还根据计算出的曝光值对所述摄像单元的传感器的感光度进行调整，以便获得所需画质的图像。The second exposure module further adjusts the sensitivity of the sensor of the imaging unit according to the calculated exposure value, so as to obtain an image of required image quality.
  52. 根据权利要求38所述的相机，其特征在于，The camera of claim 38, wherein:
    还包括用于向所述变焦参数接收单元输入无级变化的数字变焦参数的无级变焦参数输入模块。It also includes a stepless zoom parameter input module for inputting a steplessly changing digital zoom parameter to the zoom parameter receiving unit.
  53. 根据权利要求52所述的相机，其特征在于，The camera of claim 52, wherein:
    所述无级变焦参数接收模块包括能够在所述相机的显示单元上显示的无级变焦参数输入组件。The stepless zoom parameter receiving module includes a stepless zoom parameter input component that can be displayed on the display unit of the camera.
  54. 根据权利要求52所述的相机，其特征在于，The camera of claim 52, wherein:
    所述无级变焦参数接收模块包括机械变焦输入机构。The stepless zoom parameter receiving module includes a mechanical zoom input mechanism.
  55. 根据权利要求38所述的相机，其特征在于，The camera of claim 38, wherein:
    还包括用于显示第一图像的显示单元。It also includes a display unit for displaying the first image.
  56. 一种无人飞行器系统，包括：An unmanned aerial vehicle system, including:
    无人飞行器；Unmanned aerial vehicle
    云台装置，由所述无人飞行器承载；PTZ device, carried by the unmanned aerial vehicle;
    拍摄装置；以及Camera device; and
    控制装置，与所述无人飞行器、所述云台装置和所述拍摄装置通信连接，并用于控制所述无人飞行器、所述云台装置和所述拍摄装置，A control device, which is in communication connection with the unmanned aerial vehicle, the pan/tilt device, and the photographing device, and is used to control the unmanned aerial vehicle, the pan/tilt device, and the photographing device,
    其特征在于，所述拍摄装置包括：It is characterized in that the photographing device includes:
    变焦参数接收单元，用于接收数字变焦参数；以及A zoom parameter receiving unit for receiving digital zoom parameters; and
    控制单元，与所述变焦参数接收单元通信连接，用于根据所述数字变焦参数并行地执行步骤S1-S3中的至少两个：The control unit is in communication connection with the zoom parameter receiving unit, and is configured to execute at least two of steps S1-S3 in parallel according to the digital zoom parameter:
    S1.优化第一图像的画质，所述第一图像通过所述拍摄装置的摄像单元获取；S1. Optimize the image quality of the first image, the first image being acquired by the camera unit of the camera;
    S2.生成所述摄像单元的对焦参数；和S2. Generate focus parameters of the camera unit; and
    S3.生成所述摄像单元的曝光参数，S3. Generate exposure parameters of the camera unit,
    其中，所述摄像单元设置在所述云台装置上。Wherein, the camera unit is arranged on the pan-tilt device.
  57. 根据权利要求56所述的无人飞行器系统，其特征在于，The unmanned aerial vehicle system of claim 56, wherein:
    所述拍摄装置还包括图像剪裁单元，所述图像剪裁单元与所述变焦参数接收单元和所述控制单元通信连接，用于在所述控制单元并行地执行步骤S1-S3中的至少两个之前根据所述数字变焦参数获取所述第一图像的剪裁参数，并根据所述剪裁参数对所述第一图像进行剪裁处理。The photographing device further includes an image cropping unit, which is communicatively connected with the zoom parameter receiving unit and the control unit, and is configured to perform before the control unit executes at least two of steps S1-S3 in parallel Acquire a cropping parameter of the first image according to the digital zoom parameter, and perform cropping processing on the first image according to the cropping parameter.
  58. 根据权利要求57所述的无人飞行器系统，其特征在于，The unmanned aerial vehicle system of claim 57, wherein:
    所述控制单元包括：第一优化模块，用于对第一图像进行第一优化处理；第一对焦模块，用于执行生成所述摄像单元的对焦参数的第一对焦处理；以及第一曝光模块，用于执行生成所述摄像单元的曝光参数的第一曝光处理，The control unit includes: a first optimization module for performing first optimization processing on a first image; a first focusing module for performing first focusing processing for generating focusing parameters of the camera unit; and a first exposure module , For performing the first exposure process for generating the exposure parameters of the camera unit,
    其中，同时执行所述第一优化处理、所述第一对焦处理和所述第一曝光处理中的至少两个。Wherein, at least two of the first optimization processing, the first focusing processing, and the first exposure processing are performed at the same time.
  59. 根据权利要求58所述的无人飞行器系统，其特征在于，The unmanned aerial vehicle system of claim 58, wherein:
    所述第一优化处理包括：根据所述剪裁参数对图像坐标参考基准进行调整，以确定不同于所述第一图像的第一图像坐标参考基准的第二图像坐标参考基准。The first optimization processing includes: adjusting an image coordinate reference datum according to the cropping parameter to determine a second image coordinate reference datum that is different from the first image coordinate reference datum of the first image.
  60. 根据权利要求58所述的无人飞行器系统，其特征在于，The unmanned aerial vehicle system of claim 58, wherein:
    所述第一对焦处理包括：根据所述剪裁参数对所述第一图像的第一对焦坐标参数基准进行调整，以获得第二对焦坐标参数基准。The first focus processing includes: adjusting a first focus coordinate parameter reference of the first image according to the cropping parameter to obtain a second focus coordinate parameter reference.
  61. 根据权利要求60所述的无人飞行器系统，其特征在于，The unmanned aerial vehicle system of claim 60, wherein:
    所述第一对焦处理还包括：根据所述第二对焦坐标参数基准和所述剪裁参数计算所述摄像单元的相位对焦模块的相位。The first focus processing further includes: calculating the phase of the phase focus module of the camera unit according to the second focus coordinate parameter reference and the cropping parameter.
  62. 根据权利要求58所述的无人飞行器系统，其特征在于，The unmanned aerial vehicle system of claim 58, wherein:
    所述第一曝光处理包括：根据数字变焦后的图像所对应的待成像客体的对焦位置确定环境光量采样坐标基准，并基于所述环境光量采样坐标基准进行环境光量的采样。The first exposure processing includes: determining an ambient light amount sampling coordinate reference based on the focus position of the object to be imaged corresponding to the digitally zoomed image, and sampling the ambient light amount based on the ambient light amount sampling coordinate reference.
  63. 根据权利要求59所述的无人飞行器系统，其特征在于，The unmanned aerial vehicle system of claim 59, wherein:
    所述控制单元还包括第二优化模块，所述第二优化模块基于所述第二图像坐标参考基准对由所述第一图像剪裁的图像进行矫正。The control unit further includes a second optimization module that corrects the image cropped from the first image based on the second image coordinate reference datum.
  64. 根据权利要求63所述的无人飞行器系统，其特征在于，The unmanned aerial vehicle system of claim 63, wherein:
    所述第二优化模块对矫正后的图像进行画质优化，以获得第二图像。The second optimization module optimizes the image quality of the corrected image to obtain a second image.
  65. 根据权利要求63所述的无人飞行器系统，其特征在于，The unmanned aerial vehicle system of claim 63, wherein:
    所述第一对焦处理包括：根据所述剪裁参数对所述第一图像的第一对焦坐标参数基准进行调整，以获得第二对焦坐标参数基准。The first focus processing includes: adjusting a first focus coordinate parameter reference of the first image according to the cropping parameter to obtain a second focus coordinate parameter reference.
  66. 根据权利要求65所述的无人飞行器系统，其特征在于，The unmanned aerial vehicle system of claim 65, wherein:
    所述控制单元还包括第二对焦模块，所述第二对焦模块根据所述第二对焦坐标参数基准和/或对由所述第一图像剪裁的图像进行矫正的数据，对所述摄像单元的反差对焦模块的对比度反差值以及与其相关的对焦参数进行统计，并基于所述对比度反差值和所述对焦参数实现所述摄像单元 的对焦操作。The control unit further includes a second focusing module, which performs correction on the image clipped from the first image according to the second focusing coordinate parameter reference and/or data for correcting the image cropped from the first image The contrast value of the contrast focusing module and the related focusing parameters are counted, and the focusing operation of the camera unit is implemented based on the contrast value and the focusing parameter.
  67. 根据权利要求63所述的无人飞行器系统，其特征在于，The unmanned aerial vehicle system of claim 63, wherein:
    所述第一曝光处理包括：根据数字变焦后的图像所对应的待成像客体的对焦位置确定环境光量采样坐标基准，并基于所述环境光量采样坐标基准进行环境光量的采样。The first exposure processing includes: determining an ambient light amount sampling coordinate reference based on the focus position of the object to be imaged corresponding to the digitally zoomed image, and sampling the ambient light amount based on the ambient light amount sampling coordinate reference.
  68. 根据权利要求67所述的无人飞行器系统，其特征在于，The unmanned aerial vehicle system of claim 67, wherein:
    所述控制单元还包括第二曝光模块，所述第二曝光模块根据所述环境光量采样坐标基准和/或对由所述第一图像剪裁的图像进行矫正的数据计算曝光值。The control unit further includes a second exposure module that calculates an exposure value according to the ambient light amount sampling coordinate reference and/or data for correcting the image cropped from the first image.
  69. 根据权利要求68所述的无人飞行器系统，其特征在于，The unmanned aerial vehicle system of claim 68, wherein:
    所述第二曝光模块还根据计算出的曝光值对所述摄像单元的传感器的感光度进行调整，以便获得所需画质的图像。The second exposure module further adjusts the sensitivity of the sensor of the imaging unit according to the calculated exposure value, so as to obtain an image of required image quality.
  70. 根据权利要求56所述的无人飞行器系统，其特征在于，The unmanned aerial vehicle system of claim 56, wherein:
    所述拍摄装置还包括用于向所述变焦参数接收单元输入无级变化的数字变焦参数的无级变焦参数输入模块。The photographing device further includes a stepless zoom parameter input module for inputting a steplessly changing digital zoom parameter to the zoom parameter receiving unit.
  71. 根据权利要求70所述的无人飞行器系统，其特征在于，The unmanned aerial vehicle system of claim 70, wherein:
    所述无级变焦参数输入模块包括能够在显示单元上显示的无级变焦参数输入组件。The stepless zoom parameter input module includes a stepless zoom parameter input component that can be displayed on a display unit.
  72. 根据权利要求70所述的无人飞行器系统，其特征在于，The unmanned aerial vehicle system of claim 70, wherein:
    所述无级变焦参数输入模块包括机械变焦输入机构。The stepless zoom parameter input module includes a mechanical zoom input mechanism.
  73. 根据权利要求56所述的无人飞行器系统，其特征在于，The unmanned aerial vehicle system of claim 56, wherein:
    还包括用于显示第一图像的显示单元，所述显示单元设置在所述控制装置中。It also includes a display unit for displaying the first image, and the display unit is provided in the control device.
PCT/CN2020/096128 2020-06-15 2020-06-15 Digital zoom imaging method and apparatus, camera, and unmanned aerial vehicle system WO2021253167A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN202080005247.6A CN112805991A (en) 2020-06-15 2020-06-15 Digital zoom imaging method and device, camera and unmanned aerial vehicle system
PCT/CN2020/096128 WO2021253167A1 (en) 2020-06-15 2020-06-15 Digital zoom imaging method and apparatus, camera, and unmanned aerial vehicle system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2020/096128 WO2021253167A1 (en) 2020-06-15 2020-06-15 Digital zoom imaging method and apparatus, camera, and unmanned aerial vehicle system

Publications (1)

Publication Number Publication Date
WO2021253167A1 true WO2021253167A1 (en) 2021-12-23

Family

ID=75809284

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/096128 WO2021253167A1 (en) 2020-06-15 2020-06-15 Digital zoom imaging method and apparatus, camera, and unmanned aerial vehicle system

Country Status (2)

Country Link
CN (1) CN112805991A (en)
WO (1) WO2021253167A1 (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113438414B (en) * 2021-06-11 2022-10-11 深圳市道通智能航空技术股份有限公司 Focusing method, focusing device and unmanned aerial vehicle

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101848268A (en) * 2009-03-26 2010-09-29 乐金电子(中国)研究开发中心有限公司 3G mobile phone and method thereof for realizing image stepless zooming
CN102461155A (en) * 2009-06-23 2012-05-16 捷讯研究有限公司 Adjusting image sharpness during digital zoom photography
CN102625037A (en) * 2011-01-31 2012-08-01 三洋电机株式会社 Image pickup apparatus, image reproduction apparatus, and image processing apparatus
CN104137529A (en) * 2012-02-13 2014-11-05 诺基亚公司 Method and apparatus for enhanced automatic adjustment of focus, exposure and white balance in digital photography
CN105827942A (en) * 2015-09-24 2016-08-03 维沃移动通信有限公司 Rapid photographing method and electronic device
CN107430762A (en) * 2015-02-25 2017-12-01 高通股份有限公司 Digital zooming method and system
CN108111744A (en) * 2016-11-25 2018-06-01 努比亚技术有限公司 A kind of filming apparatus and method

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101848268A (en) * 2009-03-26 2010-09-29 乐金电子(中国)研究开发中心有限公司 3G mobile phone and method thereof for realizing image stepless zooming
CN102461155A (en) * 2009-06-23 2012-05-16 捷讯研究有限公司 Adjusting image sharpness during digital zoom photography
CN102625037A (en) * 2011-01-31 2012-08-01 三洋电机株式会社 Image pickup apparatus, image reproduction apparatus, and image processing apparatus
CN104137529A (en) * 2012-02-13 2014-11-05 诺基亚公司 Method and apparatus for enhanced automatic adjustment of focus, exposure and white balance in digital photography
CN107430762A (en) * 2015-02-25 2017-12-01 高通股份有限公司 Digital zooming method and system
CN105827942A (en) * 2015-09-24 2016-08-03 维沃移动通信有限公司 Rapid photographing method and electronic device
CN108111744A (en) * 2016-11-25 2018-06-01 努比亚技术有限公司 A kind of filming apparatus and method

Also Published As

Publication number Publication date
CN112805991A (en) 2021-05-14

Similar Documents

Publication Publication Date Title
WO2021208706A1 (en) High dynamic range image composition method and device, image processing chip and aerial camera
US9253407B2 (en) Digital photographing apparatus, method of controlling the same, and computer-readable recording medium
US9578260B2 (en) Digital photographing apparatus and method of controlling the digital photographing apparatus
US9137447B2 (en) Imaging apparatus that generates an image including an emphasized in-focus part of a captured image
US8823837B2 (en) Zoom control method and apparatus, and digital photographing apparatus
US8937677B2 (en) Digital photographing apparatus, method of controlling the same, and computer-readable medium
US9538080B2 (en) Digital photographing apparatus, methods of controlling the same, and computer-readable storage medium to increase success rates in panoramic photography
RU2608771C2 (en) Digital photography device and its control method for increasing of continuous capturing rate to capture panoramic photographs
KR101890305B1 (en) Photographing apparatus, method for controlling the same, and computer-readable recording medium
US8395682B2 (en) System and methods for image depth-of-field modulation
US9167150B2 (en) Apparatus and method for processing image in mobile terminal having camera
CN107613190A (en) A kind of photographic method and terminal
CN110636227A (en) High dynamic range HDR image synthesis method and high-speed camera integrating same
KR20140089672A (en) Digital photographing apparatus, method for controlling the same, and computer-readable recording medium
KR20090090357A (en) Image pickup apparatus and method of controlling the same
WO2021253167A1 (en) Digital zoom imaging method and apparatus, camera, and unmanned aerial vehicle system
JP4385383B2 (en) Programmable anti-aliasing system and method for a camera
CN112822371B (en) Image processing chip, application processing chip, data statistical system and method
US11064135B2 (en) Image capturing apparatus, control method for image capturing apparatus, and control program for image capturing apparatus
KR101502344B1 (en) Interchangeable lens materializing method by software for camera of smart device
US11483488B2 (en) Imaging apparatus, inter-exposure zoom imaging method, program, and recording medium
CN111614865B (en) Multi-shot brightness synchronization method, equipment, device and storage medium
US20190052803A1 (en) Image processing system, imaging apparatus, image processing apparatus, control method, and storage medium
JP2020036091A (en) Imaging device and control method therefor, program, and storage medium
JP2019033470A (en) Image processing system, imaging apparatus, image processing apparatus, control method, and program

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20941231

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20941231

Country of ref document: EP

Kind code of ref document: A1