WO2017076050A1 - 防抖动的延时摄影方法和装置 - Google Patents

防抖动的延时摄影方法和装置 Download PDF

Info

Publication number
WO2017076050A1
WO2017076050A1 PCT/CN2016/089042 CN2016089042W WO2017076050A1 WO 2017076050 A1 WO2017076050 A1 WO 2017076050A1 CN 2016089042 W CN2016089042 W CN 2016089042W WO 2017076050 A1 WO2017076050 A1 WO 2017076050A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
time
cycle
video
frame
Prior art date
Application number
PCT/CN2016/089042
Other languages
English (en)
French (fr)
Inventor
姜天宇
张乃雷
王文峰
Original Assignee
乐视控股（北京）有限公司
乐视移动智能信息技术（北京）有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 乐视控股（北京）有限公司, 乐视移动智能信息技术（北京）有限公司 filed Critical 乐视控股（北京）有限公司
Publication of WO2017076050A1 publication Critical patent/WO2017076050A1/zh

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/68—Control of cameras or camera modules for stable pick-up of the scene, e.g. compensating for camera body vibrations
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70—Circuitry for compensating brightness variation in the scene
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70—Circuitry for compensating brightness variation in the scene
    • H04N23/73—Circuitry for compensating brightness variation in the scene by influencing the exposure time
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/80—Camera processing pipelines; Components thereof

Definitions

  • the embodiments of the present invention relate to the field of image processing technologies, and in particular, to a method and an apparatus for delaying photography of anti-shake.
  • the current mainstream time-lapse photography scheme based on HyperLapse technology relies on the technology of gyroscope and acceleration to trim the edge of the frame image to realize the video anti-shake processing.
  • the problem with this solution is that the resulting video frame image is smaller than the actual recorded preview image size; generating a time-lapse short video after recording ends requires a large amount of post-processing calculations to achieve anti-shake and time compression, and is inefficient;
  • the frame drawing causes a waste of actual data.
  • the anti-shake delay photography method and device provided by the embodiments of the present application can complete the anti-shake processing during the recording of the video, and the data processing is simple and efficient; meanwhile, after the anti-shake processing is completed, the video image remains original recorded. Frame image size.
  • an embodiment of the present application provides a method for delaying photography of anti-shake, including: recording video, and periodically adjusting the exposure time, the speed of light ISO, and the amount of light entering the electronic aperture during recording of the video, thereby Obtaining a plurality of frame images with different parameters under each cycle time; performing image synthesis on a plurality of frame images with different parameters under each cycle time to form a corresponding frame image in each cycle time; The frame images synthesized in the cycle time are combined in time series to generate a play video.
  • the embodiment of the present application further provides an anti-shake time-lapse photography device, including: a video recording module, configured to record video, and periodically adjust the exposure time, the light-speed ISO, and the electronic aperture light amount during the recording of the video. , thereby obtaining a plurality of frame images with different parameters under each cycle time; an image synthesis module for multi-plates in each cycle time The frame image with different parameters is image-combined to form a corresponding frame image in each cycle time; the play video forming module is configured to combine the frame images synthesized in each cycle time in time sequence to generate a play video.
  • a video recording module configured to record video, and periodically adjust the exposure time, the light-speed ISO, and the electronic aperture light amount during the recording of the video. , thereby obtaining a plurality of frame images with different parameters under each cycle time
  • an image synthesis module for multi-plates in each cycle time
  • the frame image with different parameters is image-combined to form a corresponding frame image in each cycle time
  • an embodiment of the present application provides an anti-shake delay photography apparatus, including a memory, one or more processors, and one or more programs, wherein the one or more programs are in the one
  • the following operations are performed: recording video, and periodically adjusting the exposure time, the speed ISO, and the amount of electron aperture in the process of recording video, thereby obtaining multiple exposures with different parameters in each cycle time.
  • Frame image image synthesis for multiple frame images with different parameters under each cycle time to form a corresponding frame image in each cycle time; combining frame images synthesized in each cycle time in chronological order Play the video.
  • embodiments of the present application provide a computer readable storage medium having computer executable instructions stored thereon, the computer executable instructions being responsive to performing a time delay photography device that causes anti-shake Performing operations include: recording a video, and periodically dynamically adjusting an exposure time, a speed of exposure ISO, and an amount of light entering the electronic aperture during recording of the video, thereby obtaining a plurality of frame images having exposures with different parameters in each cycle time; Image synthesis is performed for a plurality of frame images with different parameters under each cycle time to form a corresponding frame image in each cycle time; the frame images synthesized in each cycle time are combined in time series to generate a play video.
  • the anti-shake time-lapse photography method and device dynamically adjust the exposure time, the speed of exposure ISO, and the amount of light entering the electronic aperture during the recording of the video, thereby obtaining multiple parameters with different parameters in each cycle time.
  • the frame image of the lower exposure; then the image of the frame with the exposure under different parameters is image-combined to form a corresponding frame image in each cycle time; finally, the synthesized frame image is combined and generated in time sequence to generate a play video.
  • Such a process that is, the image of the original recorded frame image is retained, and the image of the lost frame image is utilized, and the picture is smooth and anti-jitter.
  • FIG. 1 is a flowchart of an embodiment of a method for delaying photography of anti-shake according to an embodiment of the present application
  • FIG. 2 is a diagram of an embodiment of an anti-shake delay photography device according to an embodiment of the present application; Block diagram.
  • FIG. 3 is a schematic structural diagram of still another embodiment of the anti-shake time-lapse photography apparatus provided by the present application.
  • FIG. 4 is a schematic structural diagram of an embodiment of a computer program product for time-lapse photography for anti-shake provided by the present application.
  • a frame image of different exposure time, a speed of exposure ISO, and an amount of electron aperture light is recorded, and then the frame images are periodically and combined to generate a frame image, and then the frame images synthesized in each cycle are performed. Combine to form a play video.
  • FIG. 1 is a flowchart of an embodiment of an anti-shake delay photography method according to an embodiment of the present disclosure.
  • the execution body of the method may be a terminal configured with a camera function, such as a mobile phone or an iPad, or integrated on the terminals. Device or chip.
  • the anti-jitter time-lapse photography method includes the following steps:
  • Existing terminals such as mobile phones and ipads have integrated photography functions to record video.
  • a periodic dynamic adjustment exposure time, a light-sensing speed ISO, and an electronic aperture light-input amount are added, thereby obtaining multiple sheets with different parameters in each cycle time.
  • the frame image of the exposure is added.
  • the photographing function module of the terminal is controlled by hardware or software to record in a fixed time period
  • the exposure time, the speed of the ISO, and the amount of light entering the electronic aperture are dynamically adjusted in a preset manner in each time period, thereby generating a plurality of sheets.
  • the exposure time is 1/30 second (1/2 cycle), and the first image is mainly caused by the exposure time being longer;
  • the exposure time is 1/90 second (1/6 cycle), and the image that is not dithered but darker, that is, the second image, is darker because the amount of light caused by a sudden halving of the exposure time decreases;
  • the exposure time is 1/90 second (1/6 cycle), and the brighter image of ISO is not shaken, that is, the third image, the image jitter is weaker and the brightness is higher, but the noise is also more;
  • the exposure time is 1/90 second (1/6 cycle), and the image that adjusts the aperture light amount without shaking, that is, the fourth image, the image jitter is weak, and the depth of field is large, and the image at the edge of the frame image is clear, but light may appear. Halo or overexposure.
  • S120 Perform image synthesis on a plurality of frame images with different parameters under each cycle time to form a corresponding frame image in each cycle time.
  • the feature parameters with good image effects on the synthesized images are selected for image synthesis, thereby forming a frame image with better visual effects in each cycle time.
  • the frame image with the longest exposure time (such as the first image) in each cycle can be used as the master
  • the template image with the darkest frame image (second image) as the standard can be used as the standard image.
  • the contour edge sharpening process is performed to adjust the brightness value of the frame image (such as the third image) after the ISO is enlarged to perform the brightness adjustment value of the master image to adjust the frame image of the electronic aperture into which the light amount is increased (eg, Four images)
  • the depth of field adjustment for the standard image of the bottom image is clearer than the image content at the edge of the focus.
  • the above process of image synthesis can also be regarded as a process of frame-time frame-splitting, that is, each recording period (a plurality of frame images can be recorded) corresponding to one frame image, and therefore, the synthesized frame images are time-independent.
  • Sequential combination that is, when the synthesized frame image data is performed Inter-compression processing can generate a play video, and the play video is a play video generated by time-lapse photography.
  • the anti-shake processing process in the time-lapse photography of the present embodiment is performed synchronously during video recording, which improves the calculation efficiency and reduces the amount of post-processing data.
  • the anti-shake processing process in the solution utilizes the data of the last discarded frame image, and the anti-shake scheme is implemented by cutting only the reserved frame image in the prior art, and the original video can be retained.
  • the consistency of the content, while also ensuring that the recorded frame image and the frame image that ultimately forms the playback video, the image size is consistent with the picture.
  • the final synthesized frame image sequence may be subjected to secondary frame extraction and synthesis processing in time, thereby generating a playback video having different frame playback rates.
  • the anti-shake time-lapse photography method provides a plurality of exposures with different parameters in each cycle time by periodically dynamically adjusting the exposure time, the speed of exposure ISO, and the amount of light entering the electronic aperture during recording of the video.
  • the frame image is then image-combined with these frame images with different parameters to form a corresponding frame image in each cycle time; finally, the synthesized frame image is combined in time sequence to generate a play video, that is, retained.
  • the picture of the original recorded frame image takes advantage of the image of the lost frame image, and the picture is smooth and anti-jitter.
  • FIG. 2 a structural block diagram of an embodiment of an anti-shake delay photography apparatus provided in an embodiment of the present application may be used to perform the method steps shown in FIG. 1, including:
  • the video recording module 210 is configured to record video, and periodically adjust the exposure time, the light-speed ISO, and the electronic aperture light amount during the recording of the video, thereby obtaining a plurality of frame images with different parameters under each cycle time;
  • the synthesis module 220 is configured to perform image synthesis on a plurality of frame images with different parameters under each cycle time to form a corresponding frame image in each cycle time; and play a video forming module 230 for each cycle time
  • the internally synthesized frame images are combined in time series to generate a play video.
  • the video recording module 210 is specifically configured to dynamically adjust the exposure time, the speed of exposure ISO, and the amount of light entering the electronic aperture in each recording period, thereby obtaining four frame images having exposures with different parameters in each cycle time:
  • the exposure time is the first image at 1/2 cycle
  • the exposure time is a second image at a 1/6 cycle
  • the exposure time is 1/6 cycle to adjust the third image after the ISO becomes larger
  • the exposure time is a 1/6 cycle to adjust the fourth image after the amount of light entering the electronic aperture becomes larger.
  • the image synthesizing module 220 may be specifically configured to use a frame image with the longest exposure time in each cycle as a base plate, and sharpen the contour edge with the darkest frame image as a standard to adjust the ISO to become larger.
  • the brightness of the frame image is adjusted according to the standard, and the depth of the electronic aperture is increased to adjust the depth of field, and the image of the frame image exposed under different parameters is synthesized to form a corresponding one of each cycle time.
  • Frame image may be specifically configured to use a frame image with the longest exposure time in each cycle as a base plate, and sharpen the contour edge with the darkest frame image as a standard to adjust the ISO to become larger.
  • the brightness of the frame image is adjusted according to the standard, and the depth of the electronic aperture is increased to adjust the depth of field, and the image of the frame image exposed under different parameters is synthesized to form a corresponding one of each cycle time.
  • Frame image is specifically configured to use a frame image with the longest exposure time in each cycle as a base plate, and sharp
  • the play video forming module may be specifically configured to perform frame drawing processing on the corresponding frame images in each cycle time to generate play videos having different frame play rates.
  • the time-lapse photography device provided by the embodiment of the present invention periodically adjusts the exposure time, the light-speed ISO, and the electronic aperture light-input amount during the recording of the video, thereby obtaining a plurality of frame images with different parameters under each cycle time; Then, the frame images with different parameters are image-combined to form a corresponding frame image in each cycle time. Finally, the synthesized frame images are combined in time sequence to generate a play video, that is, the original recorded frame image is retained.
  • the picture also takes advantage of the image of the lost frame image, and the picture is smooth and anti-jitter.
  • FIG. 3 is a schematic structural diagram of still another embodiment of the anti-shake time-lapse photography apparatus provided by the present application.
  • the anti-jitter delay photography apparatus of the embodiment of the present application includes a memory 61, one or more processors 62, and one or more programs 63.
  • the one or more programs 63 when executed by one or more processors 62, perform any of the above-described embodiments.
  • the anti-shake time-lapse photography method and device provided by the embodiments of the present application dynamically adjust the exposure time, the speed of exposure ISO, and the amount of light entering the electronic aperture during the recording of the video, thereby obtaining multiple parameters with different parameters in each cycle time.
  • the frame image of the lower exposure; then the image of the frame with the exposure under different parameters is image-combined to form a corresponding frame image in each cycle time; finally, the synthesized frame image is combined and generated in time sequence to generate a play video.
  • Such processing that is, retaining the original recorded frame
  • the image of the image takes advantage of the image of the lost frame image, and the screen is smooth and anti-jitter.
  • the computer program product 71 for anti-jitter time-lapse photography of the embodiment of the present application may include a signal bearing medium 72.
  • Signal bearing medium 72 may include one or more instructions 73 that, when executed by, for example, a processor, may provide the functionality described above with respect to Figures 1-2.
  • the instruction 73 may include: recording a video, and periodically dynamically adjusting the exposure time, the speed of the ISO, and the amount of the electronic aperture into the light during the recording of the video, thereby obtaining a plurality of frame images with different parameters in each cycle time.
  • the anti-jitter time-lapse photography device can perform one or more of the steps shown in FIG. 1 in response to instruction 73.
  • signal bearing medium 72 can include computer readable media 74 such as, but not limited to, a hard disk drive, a compact disk (CD), a digital versatile disk (DVD), a digital tape, a memory, and the like.
  • the signal bearing medium 72 can include a recordable medium 75 such as, but not limited to, a memory, a read/write (R/W) CD, an R/W DVD, and the like.
  • the signal bearing medium 72 can include a communication medium 76 such as, but not limited to, a digital and/or analog communication medium (eg, fiber optic cable, waveguide, wired communication link, wireless communication link, etc.).
  • the computer program product 71 can be transmitted by the RF signal bearing medium 72 to one or more modules of the identification device of the multi-finger swipe gesture, wherein the signal bearing medium 72 is comprised of a wireless communication medium (eg, wireless compliant with the IEEE 802.11 standard) Communication medium) transmission.
  • a wireless communication medium eg, wireless compliant with the IEEE 802.11 standard
  • the computer program product of the embodiment of the present application dynamically adjusts the exposure time, the speed of exposure ISO, and the amount of electron aperture into the light during the recording of the video, thereby obtaining a plurality of frame images with different parameters under each cycle time; These have different parameters
  • the frame image of the lower exposure is image-combined to form a corresponding frame image in each cycle time; finally, the synthesized video image is combined and generated in time sequence by the synthesized frame image, and the original recorded frame image is retained by such processing.
  • the screen also takes advantage of the image of the lost frame image, and the picture is smooth and anti-jitter.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Studio Devices (AREA)

Abstract

一种防抖动的延时摄影方法和装置，所述方法包括：录制视频，并在录制视频过程中周期性动态调节曝光时间、感光速度ISO以及电子光圈进光量，从而得到各周期时间内多张具有不同参数下曝光的帧图像；针对各周期时间内多张具有不同参数下曝光的帧图像进行图像合成，以形成各周期时间内对应的一张帧图像；将各周期时间内合成的帧图像按时间顺序组合生成播放视频。可在录制视频过程中完成防抖动处理，数据处理简单高效；同时，在完成防抖动处理后，视频图像仍保持原始录制的帧图像大小。

Description

防抖动的延时摄影方法和装置
本专利申请要求申请日为2015年11月8日、申请号为2015107567934的中国专利申请的优先权，并将上述专利申请以引用的方式全文引入本文中。
技术领域
本申请实施例涉及图像处理技术领域，尤其涉及一种防抖动的延时摄影方法和装置。
背景技术
当前主流的基于HyperLapse技术的延时摄影方案在进行视频录制时，是依赖于陀螺仪和加速度等传感器对帧图像进行裁剪边缘合成中间区域的技术实现视频防抖处理的。此种方案的问题在于，最终生成的视频帧图像小于实际录制的Preview图像大小；录制结束后生成延时摄影短视频还需要进行大量后处理计算实现防抖和时间压缩，效率低下；同时过多的抽帧造成实际数据上的浪费。
发明内容
本申请实施例提供的防抖动的延时摄影方法和装置，可在录制视频过程中完成防抖动处理，数据处理简单高效；同时，在完成防抖动处理后，视频图像仍保持原始录制的帧图像大小。
为达到上述目的，本申请实施例提供了一种防抖动的延时摄影方法，包括：录制视频，并在录制视频过程中周期性动态调节曝光时间、感光速度ISO以及电子光圈进光量，从而得到各周期时间内多张具有不同参数下曝光的帧图像；针对各周期时间内多张具有不同参数下曝光的帧图像进行图像合成，以形成各周期时间内对应的一张帧图像；将各周期时间内合成的帧图像按时间顺序组合生成播放视频。
本申请实施例还提供了一种防抖动的延时摄影装置，包括：视频录制模块，用于录制视频，并在录制视频过程中周期性动态调节曝光时间、感光速度ISO以及电子光圈进光量，从而得到各周期时间内多张具有不同参数下曝光的帧图像；图像合成模块，用于针对各周期时间内多张具 有不同参数下曝光的帧图像进行图像合成，以形成各周期时间内对应的一张帧图像；播放视频形成模块，用于将各周期时间内合成的帧图像按时间顺序组合生成播放视频。
另一方面，本申请实施例提供一种防抖动的延时摄影装置，包括存储器、一个或多个处理器以及一个或多个程序，其中，所述一个或多个程序在由所述一个或多个处理器执行时执行下述操作：录制视频，并在录制视频过程中周期性动态调节曝光时间、感光速度ISO以及电子光圈进光量，从而得到各周期时间内多张具有不同参数下曝光的帧图像；针对各周期时间内多张具有不同参数下曝光的帧图像进行图像合成，以形成各周期时间内对应的一张帧图像；将各周期时间内合成的帧图像按时间顺序组合生成播放视频。
另一方面，本申请实施例提供一种计算机可读存储介质，所述计算机可读存储介质上存储有计算机可执行指令，所述计算机可执行指令响应于执行使得防抖动的延时摄影装置执行操作，所述操作包括：录制视频，并在录制视频过程中周期性动态调节曝光时间、感光速度ISO以及电子光圈进光量，从而得到各周期时间内多张具有不同参数下曝光的帧图像；针对各周期时间内多张具有不同参数下曝光的帧图像进行图像合成，以形成各周期时间内对应的一张帧图像；将各周期时间内合成的帧图像按时间顺序组合生成播放视频。本申请实施例提供的防抖动的延时摄影方法和装置，在录制视频过程中通过周期性动态调节曝光时间、感光速度ISO以及电子光圈进光量，从而得到各周期时间内多张具有不同参数下曝光的帧图像；然后将这些具有不同参数下曝光的帧图像进行图像合成，形成各周期时间内对应的一张帧图像；最后，利用合成的帧图像按其时间顺序组合生成播放视频，通过这样的处理，即保留了原始录制帧图像的画面，又利用了丢帧图像的图像优点，时画面具备流畅、防抖动性。
附图说明
图1为本申请实施例提供的防抖动的延时摄影方法一个实施例的流程图；
图2为本申请实施例提供的防抖动的延时摄影装置一个实施例的结 构框图。
图3为本申请提供的防抖动的延时摄影装置又一个实施例的结构示意图；
图4为本申请提供的用于防抖动的延时摄影的计算机程序产品一个实施例的结构示意图。
附图标记说明：210-视频录制模块、220-图像合成模块、230-播放视频形成模块。
具体实施方式
本申请实施例，通过录制不同曝光时间、感光速度ISO以及电子光圈进光量的帧图像，然后周期性的将这些帧图像进行和合成处理，生成一个帧图像，然后将各周期合成的帧图像进行组合形成播放视频。
下面结合附图对本申请实施例中的防抖动的延时摄影方法和装置进行详细描述。
实施例一
图1为本申请实施例提供的防抖动的延时摄影方法一个实施例的流程图，该方法的执行主体可以为配置有摄影功能的如手机、ipad等终端，或集成在这些终端上的装置或芯片。如图1所示，以终端为例，该防抖动的延时摄影方法包括如下步骤：
S110，录制视频，并在录制视频过程中周期性动态调节曝光时间、感光速度ISO以及电子光圈进光量，从而得到各周期时间内多张具有不同参数下曝光的帧图像。
现有终端如手机、ipad等都集成了摄影功能，可以录制视频。本实施例中主要是针对现有终端录制视频并生成帧图像的过程中，增设了周期性动态调节曝光时间、感光速度ISO以及电子光圈进光量，从而得到各周期时间内多张具有不同参数下曝光的帧图像。
具体地，通过硬件或软件控制终端的摄影功能模块按固定时间周期进行录像时，在每个时间周期内按预设方式动态调节曝光时间、感光速度ISO以及电子光圈进光量，从而生成多张的具有不同曝光时间、感光速度ISO以及电子光圈进光量的帧图像。
例如，可以1/15秒作为一个事件周期，在一个事件周期中通过动态 调节曝光时间、感光速度ISO以及电子光圈进光量，从而生成如以下4张具有不同参数特点的帧图像：
曝光时间为1/30秒(1/2周期)下的抖动图像，即第一图像，其抖动原因主要为曝光时间较长；
曝光时间为1/90秒(1/6周期)下不抖动但较暗的图像，即第二图像，其较暗原因为曝光时间突然减半导致的光量下降；
曝光时间为1/90秒(1/6周期)下不抖动调节ISO的较亮图像，即第三图像，图像抖动较弱且亮度较高，但噪点也较多；
曝光时间为1/90秒(1/6周期)下不抖动调节光圈进光量的图像，即第四图像，图像抖动较弱，且景深较大，帧图像边缘的图像较清晰，但可能出现光晕或者过曝等现象。
S120，针对各周期时间内多张具有不同参数下曝光的帧图像进行图像合成，以形成各周期时间内对应的一张帧图像。
基于录制的各周期中不同参数下曝光的帧图像的特点，选取对合成后的图像具有好的图像效果的特点参数进行图像合成，从而形成相应各周期时间内视觉效果较优的一张帧图像。
例如，对于上述例子中的4张帧图像，可以各周期中曝光时间最长的帧图像(如第一图像)作为底版，并以亮度最暗的帧图像(第二图像)为标准进行底版图像的轮廓边缘锐化处理，以调节ISO变大后的帧图像(如第三图像)的亮度值为标准进行底版图像的亮度调节值，以调节电子光圈进光量变大后的帧图像(如第四图像)为标准对底版图像进行景深的调节，是图像距离焦点的边缘处的图像内容更清晰。最后，通过将上述4个不同特点的帧图像按图像的特点进行图像合成，形成各周期时间内对应的一张帧图像，该帧图像集成了相邻数据的特点，从而实现了防抖动的效果。
S130，将各周期时间内合成的帧图像按时间顺序组合生成播放视频。
实际上，上述图像合成的过程也可以看做时帧图像抽帧的过程，即每一个录制周期(可录制多张帧图像)对应合成一个帧图像，因此，将这些合成后的帧图像按时间顺序组合，即对合成后的帧图像数据进行时 间压缩处理，即可生成播放视频，且该播放视频即为延时摄影生成的播放视频。
与现有技术不同的是，本实施例的延时摄影中防抖动的处理过程是在视频录制时同步进行的，提高了计算效率的同时减少了后处理数据量。同时，本方案中的防抖动的处理过程利用到了最后丢弃的帧图像的数据，相对于现有技术中仅针对保留的帧图像进行裁切处理实现防抖的方案，更能保留原有视频的内容的连贯性，同时还能确保录制的帧图像与最终形成播放视频的帧图像，其图像大小与画面保持一致。
在具体应用场景中，也可对上述最终合成的帧图像序列按时间顺进行二次抽帧及合成处理，从而生成具有不同帧播放率的播放视频。
本发明实施例提供的防抖动的延时摄影方法，在录制视频过程中通过周期性动态调节曝光时间、感光速度ISO以及电子光圈进光量，从而得到各周期时间内多张具有不同参数下曝光的帧图像；然后将这些具有不同参数下曝光的帧图像进行图像合成，形成各周期时间内对应的一张帧图像；最后，利用合成的帧图像按其时间顺序组合生成播放视频，即保留了原始录制帧图像的画面，又利用了丢帧图像的图像优点，时画面具备流畅、防抖动性。
实施例二
如图2所示，为本申请实施例提供的防抖动的延时摄影装置一个实施例的结构框图，可用于执行如图1所示的方法步骤，其中包括：
视频录制模块210，用于录制视频，并在录制视频过程中周期性动态调节曝光时间、感光速度ISO以及电子光圈进光量，从而得到各周期时间内多张具有不同参数下曝光的帧图像；图像合成模块220，用于针对各周期时间内多张具有不同参数下曝光的帧图像进行图像合成，以形成各周期时间内对应的一张帧图像；播放视频形成模块230，用于将各周期时间内合成的帧图像按时间顺序组合生成播放视频。
进一步地，上述视频录制模块210具体可用于，在各录制周期中动态调节曝光时间、感光速度ISO以及电子光圈进光量，从而得到各周期时间内4张具有不同参数下曝光的帧图像：
曝光时间为1/2周期下的第一图像；
曝光时间为1/6周期下的第二图像；
曝光时间为1/6周期下调节ISO变大后的第三图像；
曝光时间为1/6周期下调节电子光圈进光量变大后的第四图像。
进一步地，上述图像合成模块220可具体用于，以各周期中曝光时间最长的帧图像作为底版，并以亮度最暗的帧图像为标准进行轮廓边缘锐化，以调节ISO变大后的帧图像的亮度为标准进行亮度调节，以调节电子光圈进光量变大后的帧图像为标准进行景深调节，实现对不同参数下曝光的帧图像进行图像合成，形成各周期时间内对应的一张帧图像。
进一步地，上述播放视频形成模块可具体用于，将各周期时间内对应的帧图像按时间顺序进行抽帧处理，以生成具有不同帧播放率的播放视频。
本申请实施例提供的延时摄影装置，在录制视频过程中通过周期性动态调节曝光时间、感光速度ISO以及电子光圈进光量，从而得到各周期时间内多张具有不同参数下曝光的帧图像；然后将这些具有不同参数下曝光的帧图像进行图像合成，形成各周期时间内对应的一张帧图像；最后，利用合成的帧图像按其时间顺序组合生成播放视频，即保留了原始录制帧图像的画面，又利用了丢帧图像的图像优点，时画面具备流畅、防抖动性。
实施例三
图3为本申请提供的防抖动的延时摄影装置又一个实施例的结构示意图。如图3所示，本申请实施例的防抖动的延时摄影装置包括：存储器61、一个或多个处理器62以及一个或多个程序63。
其中，所述一个或多个程序63在由一个或多个处理器62执行时执行上述实施例中的任意一种方法。本申请实施例提供的防抖动的延时摄影方法和装置，在录制视频过程中通过周期性动态调节曝光时间、感光速度ISO以及电子光圈进光量，从而得到各周期时间内多张具有不同参数下曝光的帧图像；然后将这些具有不同参数下曝光的帧图像进行图像合成，形成各周期时间内对应的一张帧图像；最后，利用合成的帧图像按其时间顺序组合生成播放视频，通过这样的处理，即保留了原始录制帧 图像的画面，又利用了丢帧图像的图像优点，时画面具备流畅、防抖动性。
实施例四
图4为本申请提供的用于防抖动的延时摄影的计算机程序产品一个实施例的结构示意图。如图4所示，本申请实施例的用于防抖动的延时摄影的计算机程序产品71，可以包括信号承载介质72。信号承载介质72可以包括一个或更多个指令73，该指令73在由例如处理器执行时，处理器可以提供以上针对图1-2描述的功能。例如，指令73可以包括：用于录制视频，并在录制视频过程中周期性动态调节曝光时间、感光速度ISO以及电子光圈进光量，从而得到各周期时间内多张具有不同参数下曝光的帧图像的一个或多个指令；用于针对各周期时间内多张具有不同参数下曝光的帧图像进行图像合成，以形成各周期时间内对应的一张帧图像的一个或多个指令；以及用于将各周期时间内合成的帧图像按时间顺序组合生成播放视频的一个或多个指令。因此，例如，参照图2，防抖动的延时摄影装置可以响应于指令73来进行图1中所示的步骤中的一个或更多个。
在一些实现中，信号承载介质72可以包括计算机可读介质74，诸如但不限于硬盘驱动器、压缩盘(CD)、数字通用盘(DVD)、数字带、存储器等。在一些实现中，信号承载介质72可以包括可记录介质75，诸如但不限于存储器、读/写(R/W)CD、R/W DVD等。在一些实现中，信号承载介质72可以包括通信介质76，诸如但不限于数字和/或模拟通信介质(例如，光纤线缆、波导、有线通信链路、无线通信链路等)。因此，例如，计算机程序产品71可以通过RF信号承载介质72传送给多指滑动手势的识别装置的一个或多个模块，其中，信号承载介质72由无线通信介质(例如，符合IEEE 802.11标准的无线通信介质)传送。
本申请实施例的计算机程序产品，在录制视频过程中通过周期性动态调节曝光时间、感光速度ISO以及电子光圈进光量，从而得到各周期时间内多张具有不同参数下曝光的帧图像；然后将这些具有不同参数 下曝光的帧图像进行图像合成，形成各周期时间内对应的一张帧图像；最后，利用合成的帧图像按其时间顺序组合生成播放视频，通过这样的处理，即保留了原始录制帧图像的画面，又利用了丢帧图像的图像优点，时画面具备流畅、防抖动性。
通过以上的实施方式的描述，本领域的技术人员可以清楚地了解到各实施方式可借助软件加必需的通用硬件平台的方式来实现，当然也可以通过硬件。基于这样的理解，上述技术方案本质上或者说对现有技术做出贡献的部分可以以软件产品的形式体现出来，该计算机软件产品可以存储在计算机可读存储介质中，如ROM/RAM、磁碟、光盘等，包括若干指令用以使得一台计算机设备(可以是个人计算机，服务器，或者网络设备等)执行各个实施例或者实施例的某些部分所述的方法。
以上所述，仅为本申请的具体实施方式，但本申请的保护范围并不局限于此，任何熟悉本技术领域的技术人员在本申请揭露的技术范围内，可轻易想到变化或替换，都应涵盖在本申请的保护范围之内。因此，本申请的保护范围应以所述权利要求的保护范围为准。

Claims (8)

  1. 一种防抖动的延时摄影方法，其特征在于，所述方法包括：
    录制视频，并在录制视频过程中周期性动态调节曝光时间、感光速度ISO以及电子光圈进光量，从而得到各周期时间内多张具有不同参数下曝光的帧图像；
    针对各周期时间内多张具有不同参数下曝光的帧图像进行图像合成，以形成各周期时间内对应的一张帧图像；
    将各周期时间内合成的帧图像按时间顺序组合生成播放视频。
  2. 根据权利要求1所述的方法，其特征在于，所述录制视频，并在录制视频过程中周期性动态调节曝光时间、感光速度ISO以及电子光圈进光量，从而得到各周期时间内多张具有不同参数下曝光的帧图像包括：
    在各录制周期中动态调节曝光时间、感光速度ISO以及电子光圈进光量，从而得到各周期时间内4张具有不同参数下曝光的帧图像：
    曝光时间为1/2周期下的第一图像；
    曝光时间为1/6周期下的第二图像；
    曝光时间为1/6周期下调节ISO变大后的第三图像；
    曝光时间为1/6周期下调节电子光圈进光量变大后的第四图像。
  3. 根据权利要求1或2所述的方法，其特征在于，所述针对各周期时间内多张具有不同参数下曝光的帧图像进行图像合成，以形成各周期时间内对应的一张帧图像包括：
    以各周期中曝光时间最长的帧图像作为底版，并以亮度最暗的帧图像为标准进行轮廓边缘锐化，以调节ISO变大后的帧图像的亮度为标准进行亮度调节，以调节电子光圈进光量变大后的帧图像为标准进行景深调节，实现对不同参数下曝光的帧图像进行图像合成，形成各周期时间内对应的一张帧图像。
  4. 根据权利要求1-3中任一项所述的方法，其特征在于，所述将各周期时间内合成的帧图像按时间顺序组合生成播放视频。
    将各周期时间内对应的帧图像按时间顺序进行抽帧处理，以生成具有不同帧播放率的播放视频。
  5. 一种防抖动的延时摄影装置，其特征在于，所述装置包括：
    视频录制模块，用于录制视频，并在录制视频过程中周期性动态调节曝光时间、感光速度ISO以及电子光圈进光量，从而得到各周期时间内多张具有不同参数下曝光的帧图像；
    图像合成模块，用于针对各周期时间内多张具有不同参数下曝光的帧图像进行图像合成，以形成各周期时间内对应的一张帧图像；
    播放视频形成模块，用于将各周期时间内合成的帧图像按时间顺序组合生成播放视频。
  6. 根据权利要求5所述的装置，其特征在于，所述视频录制模块具体用于，
    在各录制周期中动态调节曝光时间、感光速度ISO以及电子光圈进光量，从而得到各周期时间内4张具有不同参数下曝光的帧图像：
    曝光时间为1/2周期下的第一图像；
    曝光时间为1/6周期下的第二图像；
    曝光时间为1/6周期下调节ISO变大后的第三图像；
    曝光时间为1/6周期下调节电子光圈进光量变大后的第四图像。
  7. 根据权利要求6所述的装置，其特征在于，所述图像合成模块具体用于，
    以各周期中曝光时间最长的帧图像作为底版，并以亮度最暗的帧图像为标准进行轮廓边缘锐化，以调节ISO变大后的帧图像的亮度为标准进行亮度调节，以调节电子光圈进光量变大后的帧图像为标准进行景深调节，实现对不同参数下曝光的帧图像进行图像合成，形成各周期时间内对应的一张帧图像。
  8. 根据权利要求5-7中任一项所述的装置，其特征在于，所述播放视频形成模块具体用于，
    将各周期时间内对应的帧图像按时间顺序进行抽帧处理，以生成具有不同帧播放率的播放视频。
PCT/CN2016/089042 2015-11-08 2016-07-07 防抖动的延时摄影方法和装置 WO2017076050A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201510756793.4 2015-11-08
CN201510756793.4A CN105657243A (zh) 2015-11-08 2015-11-08 防抖动的延时摄影方法和装置

Publications (1)

Publication Number Publication Date
WO2017076050A1 true WO2017076050A1 (zh) 2017-05-11

Family

ID=56482169

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/089042 WO2017076050A1 (zh) 2015-11-08 2016-07-07 防抖动的延时摄影方法和装置

Country Status (2)

Country Link
CN (1) CN105657243A (zh)
WO (1) WO2017076050A1 (zh)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110677557A (zh) * 2019-10-28 2020-01-10 Oppo广东移动通信有限公司 图像处理方法、装置、存储介质及电子设备
CN113747097A (zh) * 2020-05-14 2021-12-03 北京小米移动软件有限公司 视频的处理方法、装置及存储介质
CN114514738A (zh) * 2020-11-26 2022-05-17 深圳市大疆创新科技有限公司 延时摄影方法及设备、延时摄影视频生成方法及设备

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105657243A (zh) * 2015-11-08 2016-06-08 乐视移动智能信息技术（北京）有限公司 防抖动的延时摄影方法和装置
CN108419017B (zh) * 2018-04-28 2019-07-30 Oppo广东移动通信有限公司 控制拍摄的方法、装置、电子设备及计算机可读存储介质
CN109998447B (zh) * 2019-02-20 2021-12-10 西安蓝极医疗电子科技有限公司 一种医用手术内窥镜成像系统对高能量可见光激光的滤光方法
CN111294509A (zh) * 2020-01-22 2020-06-16 Oppo广东移动通信有限公司 视频拍摄方法、装置、终端及存储介质
CN114827487B (zh) 2020-04-28 2024-04-12 荣耀终端有限公司 一种高动态范围图像合成方法和电子设备
CN111917995B (zh) * 2020-06-29 2022-02-08 北京迈格威科技有限公司 图像处理方法、装置、电子设备及存储介质
WO2022256978A1 (zh) * 2021-06-07 2022-12-15 深圳市大疆创新科技有限公司 延时拍摄方法、装置及手持设备

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2010016599A (ja) * 2008-07-03 2010-01-21 Victor Co Of Japan Ltd カメラ
US8515270B1 (en) * 2012-08-03 2013-08-20 Granite Bay Software System and method for improved time-lapse photography
CN104349060A (zh) * 2013-08-06 2015-02-11 卡西欧计算机株式会社 图像处理装置以及图像处理方法
CN104754227A (zh) * 2015-03-26 2015-07-01 广东欧珀移动通信有限公司 一种拍摄视频的方法及装置
CN105657243A (zh) * 2015-11-08 2016-06-08 乐视移动智能信息技术（北京）有限公司 防抖动的延时摄影方法和装置

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100809345B1 (ko) * 2006-06-16 2008-03-05 삼성전자주식회사 영상 생성 장치 및 방법
JP4770907B2 (ja) * 2008-10-21 2011-09-14 ソニー株式会社 撮像装置、撮像方法及びプログラム
JP5136665B2 (ja) * 2010-07-21 2013-02-06 カシオ計算機株式会社 画像処理装置、及びプログラム

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2010016599A (ja) * 2008-07-03 2010-01-21 Victor Co Of Japan Ltd カメラ
US8515270B1 (en) * 2012-08-03 2013-08-20 Granite Bay Software System and method for improved time-lapse photography
CN104349060A (zh) * 2013-08-06 2015-02-11 卡西欧计算机株式会社 图像处理装置以及图像处理方法
CN104754227A (zh) * 2015-03-26 2015-07-01 广东欧珀移动通信有限公司 一种拍摄视频的方法及装置
CN105657243A (zh) * 2015-11-08 2016-06-08 乐视移动智能信息技术（北京）有限公司 防抖动的延时摄影方法和装置

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110677557A (zh) * 2019-10-28 2020-01-10 Oppo广东移动通信有限公司 图像处理方法、装置、存储介质及电子设备
CN110677557B (zh) * 2019-10-28 2022-04-22 Oppo广东移动通信有限公司 图像处理方法、装置、存储介质及电子设备
CN113747097A (zh) * 2020-05-14 2021-12-03 北京小米移动软件有限公司 视频的处理方法、装置及存储介质
CN114514738A (zh) * 2020-11-26 2022-05-17 深圳市大疆创新科技有限公司 延时摄影方法及设备、延时摄影视频生成方法及设备

Also Published As

Publication number Publication date
CN105657243A (zh) 2016-06-08

Similar Documents

Publication Publication Date Title
WO2017076050A1 (zh) 防抖动的延时摄影方法和装置
US9456138B2 (en) Image processing apparatus, image processing method and computer readable recording medium having program for generating time-lapse moving image
JP4516536B2 (ja) 動画生成装置、動画生成方法、及びプログラム
US9264585B2 (en) Enriched digital photographs
US20130021489A1 (en) Regional Image Processing in an Image Capture Device
US8106991B2 (en) Image processing apparatus and image processing method
JP7405131B2 (ja) 画像処理装置、画像処理方法、プログラム
KR102207633B1 (ko) 촬영 장치 및 그 제어 방법
WO2017076000A1 (zh) 夜景拍照方法、装置及移动终端
CN109167890B (zh) 一种音画同步方法和装置及显示设备
US10708499B2 (en) Method and apparatus having a function of constant automatic focusing when exposure changes
WO2017076042A1 (zh) 防抖拍照方法、装置及移动终端
WO2020118503A1 (zh) 一种确定图像对焦区域的方法及装置
CN112085686A (zh) 图像处理方法、装置、电子设备及计算机可读存储介质
US20160227114A1 (en) Automatic processing of automatic image capture parameter adjustment
CN104935804A (zh) 摄像装置以及摄像方法
WO2017076041A1 (zh) 防抖拍照方法、装置及移动终端
CN115516495A (zh) 基于选择区域优化高动态范围(hdr)图像处理
US10708555B2 (en) Image processing apparatus, image processing method, and storage medium
JP6498175B2 (ja) 撮像装置およびその制御方法
US9661217B2 (en) Image capturing apparatus and control method therefor
JP6767694B2 (ja) 撮像装置
CN115701869A (zh) 摄影图像处理方法及设备
JP2007036749A (ja) 撮像装置、撮像方法、及びプログラム
TW201805927A (zh) 利用腳本之影片編輯方法及其電子裝置

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16861320

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 16861320

Country of ref document: EP

Kind code of ref document: A1