CN114586337A - Video anti-shake optimization processing method and device and electronic equipment - Google Patents
Video anti-shake optimization processing method and device and electronic equipment Download PDFInfo
- Publication number
- CN114586337A CN114586337A CN201980101297.1A CN201980101297A CN114586337A CN 114586337 A CN114586337 A CN 114586337A CN 201980101297 A CN201980101297 A CN 201980101297A CN 114586337 A CN114586337 A CN 114586337A
- Authority
- CN
- China
- Prior art keywords
- frame image
- current frame
- image
- processed
- processed frame
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000005457 optimization Methods 0.000 title claims abstract description 38
- 238000003672 processing method Methods 0.000 title claims abstract description 12
- 238000012545 processing Methods 0.000 claims abstract description 154
- 238000001914 filtration Methods 0.000 claims abstract description 92
- 230000004927 fusion Effects 0.000 claims abstract description 67
- 238000000034 method Methods 0.000 claims description 41
- 239000011159 matrix material Substances 0.000 claims description 30
- 230000008569 process Effects 0.000 claims description 23
- 230000009467 reduction Effects 0.000 claims description 12
- 238000010586 diagram Methods 0.000 description 11
- 238000004364 calculation method Methods 0.000 description 8
- 238000003384 imaging method Methods 0.000 description 8
- 230000002123 temporal effect Effects 0.000 description 4
- 238000003705 background correction Methods 0.000 description 2
- 238000001514 detection method Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 230000006641 stabilisation Effects 0.000 description 2
- 238000011105 stabilization Methods 0.000 description 2
- 230000003068 static effect Effects 0.000 description 2
- 230000001360 synchronised effect Effects 0.000 description 2
- 230000009466 transformation Effects 0.000 description 2
- 238000012935 Averaging Methods 0.000 description 1
- 239000000872 buffer Substances 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000004590 computer program Methods 0.000 description 1
- 238000012937 correction Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/50—Image enhancement or restoration using two or more images, e.g. averaging or subtraction
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/265—Mixing
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02T—CLIMATE CHANGE MITIGATION TECHNOLOGIES RELATED TO TRANSPORTATION
- Y02T10/00—Road transport of goods or passengers
- Y02T10/10—Internal combustion engine [ICE] based vehicles
- Y02T10/40—Engine management systems
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Image Processing (AREA)
- Studio Devices (AREA)
Abstract
A video anti-shake optimization processing method comprises the following steps: acquiring a current frame image, current frame gyroscope information and a processed frame image; the current frame image and the processed frame image are adjacent in a time domain; carrying out anti-shake processing on the current frame image by using the gyroscope information of the current frame to generate a stable current frame image; and performing fusion filtering processing on the stabilized current frame image and the processed frame image to obtain an optimized video image corresponding to the current frame image.
Description
The present application relates to the field of computer technologies, and in particular, to a video anti-shake optimization method and apparatus, an electronic device, and a computer-readable storage medium.
With the development of computer technology, a wide variety of electronic devices are emerging. The shooting function of the electronic equipment provides convenience for people to shoot anytime and anywhere. Camera modules for electronic devices typically employ smaller sized sensors and lens sets. As the resolution increases, the pixel size of the sensor shrinks significantly more than before, but this can lead to a reduction in the signal-to-noise ratio of the output video.
In the related art, in order to ensure the quality of the output video, it is usually considered to perform temporal filtering processing first. However, the temporal filtering process has a large amount of calculation and a long calculation time, which results in a decrease in the stability of the output video.
Disclosure of Invention
According to various embodiments disclosed in the present application, a video anti-shake optimization processing method, an electronic device, and a computer-readable storage medium are provided.
A video anti-shake optimization processing method comprises the following steps:
acquiring a current frame image, current frame gyroscope information and a processed frame image; the current frame image and the processed frame image are adjacent in time domain;
carrying out anti-shake processing on the current frame image by using the gyroscope information of the current frame to generate a stable current frame image;
and performing fusion filtering processing on the stabilized current frame image and the processed frame image to obtain an optimized video image corresponding to the current frame image.
A video anti-shake optimization processing apparatus, comprising:
the acquisition module is used for acquiring a current frame image, current frame gyroscope information and a processed frame image; the current frame image and the processed frame image are adjacent in time domain;
the anti-shake module is used for carrying out anti-shake processing on the current frame image by utilizing the gyroscope information of the current frame to generate a stable current frame image; and
and the filtering module is used for carrying out fusion filtering processing on the stabilized current frame image and the processed frame image to obtain an optimized video image corresponding to the current frame image.
An electronic device comprising a memory and one or more processors, the memory having stored therein computer-readable instructions that, when executed by the one or more processors, cause the one or more processors to perform the steps of:
acquiring a current frame image, current frame gyroscope information and a processed frame image; the current frame image and the processed frame image are adjacent in time domain;
performing anti-shake processing on the current frame image by using the current frame gyroscope information to generate a stable current frame image;
and performing fusion filtering processing on the stabilized current frame image and the processed frame image to obtain an optimized video image corresponding to the current frame image.
One or more non-transitory computer-readable storage media embodying computer-executable instructions that, when executed by one or more processors, cause the processors to perform the steps of:
acquiring a current frame image, current frame gyroscope information and a processed frame image; the current frame image and the processed frame image are adjacent in time domain;
carrying out anti-shake processing on the current frame image by using the gyroscope information of the current frame to generate a stable current frame image;
and performing fusion filtering processing on the stabilized current frame image and the processed frame image to obtain an optimized video image corresponding to the current frame image.
The details of one or more embodiments of the application are set forth in the accompanying drawings and the description below. Other features and advantages of the application will be apparent from the description and drawings, and from the claims.
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present application, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
FIG. 1 is a diagram illustrating an exemplary embodiment of a video anti-shake optimization method;
FIG. 2 is a flow diagram of a video anti-shake optimization process in one embodiment;
FIG. 3 is a flowchart of a video anti-shake optimization processing method in another embodiment;
FIG. 4 is a flowchart of an embodiment of a process for performing fusion filtering on a stabilized current frame image and a processed frame image using initialized registration information;
FIG. 5 is a flowchart illustrating the steps of performing fusion filtering on the globally aligned current frame image and the globally aligned processed frame image according to one embodiment;
FIG. 6 is a block diagram of an embodiment of a video anti-shake optimization apparatus;
FIG. 7 is a block diagram of an apparatus for video anti-shake optimization processing according to another embodiment;
FIG. 8 is a schematic diagram showing an internal configuration of an electronic apparatus according to an embodiment;
FIG. 9 is a schematic diagram of an image processing circuit in one embodiment.
In order to make the objects, technical solutions and advantages of the present application more apparent, the present application is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the present application and are not intended to limit the present application.
Fig. 1 is a schematic diagram of an application environment of a video anti-shake optimization processing method in an embodiment. As shown in fig. 1, the application environment includes an electronic device 100. The electronic device 100 includes a camera 102, a sensor 104, and a processor 106. The electronic device 100 may take video shots through the camera 102. The sensor 104 may be a gyroscope sensor. In the shooting process, the gyroscope sensor acquires gyroscope information corresponding to each frame of video image. The processor 106 may perform optimization processing on the video image in the manner provided by the present application. The video image after the optimization processing may be referred to as a processed frame image. The processor 106 may perform optimization processing on the current frame image using the single frame or multiple frames of processed frame images adjacent in the time domain and the gyroscope information of the current frame. The processor 106 performs anti-shake processing on the current frame image by using the current frame gyroscope information to generate a stabilized current frame image. The processor 106 then performs fusion filtering processing on the stabilized current frame image and the processed frame image to obtain an optimized video image corresponding to the current frame image. Since the anti-shake processing is performed in advance during the optimization processing, the shake in the current frame image can be eliminated in advance. The stable current frame image and the processed frame image are subjected to fusion filtering processing, so that the filtering processing efficiency can be effectively improved, the time consumption of the operation of fusion filtering is saved, and the stability of an output video is effectively improved.
In an embodiment, as shown in fig. 2, a video anti-shake optimization processing method is provided, which is described by taking the electronic device in fig. 1 as an example, and specifically includes the following steps:
The electronic equipment receives the shooting instruction and carries out video shooting according to the shooting instruction. In the shooting process, the electronic equipment acquires gyroscope information corresponding to each frame of image through a gyroscope sensor. The processed frame image may be a single frame image temporally adjacent to the current frame image, or a multi-frame image. When the processed frame image is a single frame image, it may be a previous frame processed image temporally adjacent to the current frame image, and may also be referred to as a previous frame processed image. When the processed frame image is a multi-frame image, it may be a processed image of a previous frame temporally adjacent to the current frame image, a processed image of a previous frame, or the like. The specific number of processed frame images may be selected according to preset requirements. The processed frame images correspond to the processed frame gyroscope information, and the processed frame images of each frame have corresponding gyroscope information (for ease of distinction, referred to herein as processed frame gyroscope information).
And 204, performing anti-shake processing on the current frame image by using the current frame gyroscope information to generate a stabilized current frame image.
The electronic equipment carries out single-frame denoising processing on the current frame image to obtain a denoised current frame image. And after carrying out attitude estimation and filtering processing on the gyroscope information of the current frame by the electronic equipment, obtaining a current attitude and a target attitude corresponding to the image of the current frame. The filtering process may employ low-pass filtering. For the convenience of distinction, the current pose and the target pose corresponding to the current frame image are hereinafter referred to as the current frame pose and the current frame target pose, respectively. The gyroscope information of the current frame comprises rotation angle information of the camera. The electronic equipment performs image re-projection operation (image warp) by using the denoised current frame image, the current frame current attitude and the current frame target attitude, and rotates the current frame image from the current frame current attitude to the current frame target attitude according to the rotation angle information, so that the jitter in the current frame image is eliminated, and the stable current frame image is generated.
Specifically, the electronic device may further adjust the order of the single frame denoising and the image reprojection operation. When single frame denoising is carried out and image reprojection is carried out, interpolation processing is carried out on the pixel value of the current frame image. If the interpolation precision of single frame denoising is high, firstly performing single frame denoising processing on the current frame image, and then performing image re-projection operation by combining gyroscope information of the current frame to obtain a stable current frame image. And if the interpolation precision of the image re-projection operation is high, combining the gyroscope information of the current frame to perform the image re-projection operation, and then performing single-frame denoising processing to obtain the stable current frame image. Since the interpolation precision affects the image quality of the output video, the operation with high interpolation precision is adjusted to the front for processing, thereby effectively reducing the noise of the output video and improving the picture quality.
And step 206, performing fusion filtering processing on the stabilized current frame image and the processed frame image to obtain an optimized video image corresponding to the current frame image.
And the electronic equipment performs global alignment processing on the stabilized current frame image and the processed frame image to obtain global alignment information between the stabilized current frame image and the processed frame image. The electronic equipment carries out weighted average operation based on the global alignment information, and carries out multi-frame fusion noise reduction processing on the stabilized current frame image and the processed frame image, so as to obtain an optimized video image corresponding to the current frame image. The electronic equipment sends the optimized video image to the encoder for video coding, and the video image is sent to the display for displaying after video coding.
When the electronic device optimizes the next frame image, the optimized video image corresponding to the current frame image can be used as the processed frame image, and the optimized video image corresponding to the next frame image can be obtained by processing according to the method. The execution is repeated, so that the optimization of the whole video can be realized.
In the related art, the image anti-shake processing is considered after the filtering processing is performed on the image. Since the filtering process is to perform global image alignment operation according to the image content, if there is a moving object, the stability of the video is greatly disturbed. In the embodiment, the anti-shake processing is performed in a preposition mode, and the current attitude and the target attitude of the current frame image estimated based on the gyroscope information of the current frame are irrelevant to the graphic content, so that the global motion of the current frame image can be independently estimated, the interference of a moving object is avoided, and the stability of the video is effectively improved. In addition, in the related art, when performing the global alignment operation, the filtering process needs a long operation time for traversing the global alignment between the current frame image and the processed frame image based on the image content, which also causes a reduction in stability. In the embodiment, after the anti-shake processing, the stabilized current frame image and the processed frame image are basically aligned, and the precise image alignment only needs to traverse a small amount of image range, so that the calculation amount of the global alignment operation is effectively reduced, the fusion filtering processing efficiency is improved, and the stability of the output video is improved.
In this embodiment, by acquiring the current frame image, the current frame gyroscope information, and the processed frame image from the video, the current frame gyroscope information may be first utilized to perform anti-shake processing on the current frame image, so as to generate a stable current frame image. By advancing the anti-shake processing, the shake in the current frame image can be eliminated in advance. The stable current frame image and the processed frame image are subjected to fusion filtering processing, so that the filtering processing efficiency can be effectively improved, the time consumption of the operation of fusion filtering is saved, and the stability of an output video is effectively improved.
In one embodiment, the fusing and filtering the stabilized current frame image and the processed frame image includes: carrying out global alignment processing on the stabilized current frame image and the processed frame image; and performing fusion filtering processing on the globally aligned current frame image and the globally aligned processed frame image to obtain an optimized frame image.
When the electronic device performs the fusion Filtering process on the stabilized current frame image and the processed frame image, Motion Compensation Temporal Filtering (MCTF) may be used. When performing global alignment processing, the electronic device may perform matching using image features of the stabilized current frame image and the processed frame image. Specifically, the electronic device extracts image feature points of the stabilized current frame image and the processed frame image respectively. The image feature points corresponding to the stabilized current frame image may be referred to as current frame feature points. The image feature points of the processed frame image may be referred to as processed frame feature points. The electronic equipment finds a matching pair from the current frame feature point and the processed frame feature point, calculates a conversion matrix between the stabilized current frame image and the processed frame image based on the matching pair, and establishes a corresponding relation between all pixel points, thereby obtaining global alignment information between the stabilized current frame image and the processed frame image.
In the related art, when the current frame feature point is matched with the processed frame feature point, the stabilized current frame image and the processed frame image need to be traversed based on the image content, that is, all matching points need to be searched on the whole image to find a suitable matching pair. The whole matching process has large calculation amount, so that the matching stability is reduced, and the stability of an output video is influenced.
In this embodiment, since the stabilized current frame image is an image of the current frame image subjected to the stabilization processing based on the gyro information of the current frame image, the stabilized current frame image and the processed frame image are already substantially aligned. When the electronic equipment performs global alignment processing on the stabilized current frame image and the processed frame image, only a small amount of image range needs to be traversed, so that the operation speed and the matching precision can be greatly improved, and the stability of the video image can be effectively improved.
Further, the processed frame image may be a multi-frame image. The electronic device may perform global alignment on the processed frame image of each frame and the stabilized current frame image respectively according to the manner provided in the above embodiment, and then perform weighted average processing based on multiple items of global alignment information, thereby completing the multi-frame fusion filtering processing. Because the multi-frame fusion filtering processing is to calculate the pixel mean value between the adjacent multi-frame images in the time domain, compared with the global alignment performed by a single-frame processed frame image, the global alignment performed by the multi-frame processed frame image can ensure that the images of the output video are more balanced and have lower noise, thereby further improving the stability of the output video.
In an embodiment, as shown in fig. 3, a video anti-shake optimization processing method is provided, which specifically includes the following steps:
And 304, performing anti-shake processing on the current frame image by using the gyroscope information of the current frame to generate a stable current frame image.
And step 306, generating initialization registration information by using the gyroscope information of the current frame and the gyroscope information of the processed frame.
And 308, performing fusion filtering processing on the stabilized current frame image and the processed frame image by using the initialized registration information to obtain an optimized video image corresponding to the current frame image.
The electronic device may perform anti-shake processing on the current frame image in the manner provided in the above embodiment, so as to generate a stabilized current frame image. And the electronic equipment acquires corresponding processed frame gyroscope information according to the processed frame image. And after carrying out attitude estimation and filtering processing on the gyroscope information of the current frame by the electronic equipment, obtaining a current attitude and a target attitude corresponding to the image of the current frame. For the convenience of distinction, the current pose and the target pose corresponding to the current frame image are hereinafter referred to as the current frame pose and the current frame target pose, respectively. And after the electronic equipment carries out attitude estimation and filtering processing on the gyroscope information of the processed frame, respectively obtaining the current attitude and the target attitude corresponding to the processed frame image. For the convenience of distinction, the current pose and the target pose corresponding to the processed frame image are hereinafter referred to as the processed frame current pose and the processed frame target pose, respectively. The electronic equipment performs operation by using the current frame target attitude and the processed frame target attitude to generate the initialized registration information between the current frame image and the processed frame image.
And the electronic equipment obtains a reference point of global alignment operation according to the initialized registration information. Based on the reference point, the electronic device may perform global alignment operation on the stabilized current frame image and the processed frame image by referring to the manner in the above embodiment, so as to obtain global alignment information between the stabilized current frame image and the processed frame image. The electronic equipment carries out weighted average operation based on the global alignment information, and carries out multi-frame fusion noise reduction processing on the stabilized current frame image and the processed frame image, so as to obtain an optimized video image corresponding to the current frame image.
In this embodiment, the stabilized current frame image and the processed frame image are already substantially aligned. When the electronic device performs global alignment processing on the stabilized current frame image and the processed frame image, only a small amount of image range needs to be traversed. During traversal, by initializing the registration information as a reference point and searching matched feature points near the reference point, all matched points do not need to be violently searched on the whole image, and therefore matching accuracy and matching speed are further improved. Therefore, the calculation amount of fusion filtering processing is further reduced, the speed of fusion filtering is improved, and the stability of an output video is improved.
In one embodiment, as shown in fig. 4, the step of generating the initialized registration information by using the current frame gyroscope information and the processed frame gyroscope information includes:
and step 402, carrying out attitude estimation on the gyroscope information of the current frame to obtain the target attitude of the current frame.
And step 404, performing attitude estimation on the gyroscope information of the processed frame to obtain the target attitude of the processed frame.
And 406, generating initial registration information by using the current frame target posture and the processed frame target posture.
In this embodiment, the anti-shake processing may use EIS (Electronic image stabilization) anti-shake. And carrying out attitude estimation and filtering processing of EIS on gyroscope information of the current frame of the electronic equipment to obtain the current attitude of the current frame and the target attitude of the current frame. And the electronic equipment performs attitude estimation and filtering processing of EIS on the gyroscope information of the processed frame, wherein the current attitude of the processed frame and the target attitude of the processed frame are obtained. The filtering process may be a low-pass filtering process, which removes a high-frequency component (i.e., a shake amount) in the current frame gyroscope information or the processed frame gyroscope information and retains a low-frequency component, thereby removing shake. The electronic equipment calculates the relative attitude relationship between the current frame image and the processed frame image by the current frame target attitude and the processed frame target attitude, and the relative attitude relationship can be used as the initialized registration information between the current frame image and the processed frame image.
In one embodiment, generating the initial registration information using the current frame target pose and the processed frame target pose comprises: acquiring a current frame target attitude matrix corresponding to a current frame target attitude; acquiring a processed frame target attitude matrix corresponding to the processed frame target attitude; and calculating by using the current frame target attitude matrix and the processed frame target attitude matrix to obtain a registration matrix corresponding to the initialized registration information.
The current frame target pose may be represented by a current frame target pose matrix. The processed frame target pose may be represented by a processed frame target pose matrix. The current frame target attitude matrix may be a transformation matrix obtained by performing attitude estimation and filtering on the current frame gyroscope information. The processed frame target attitude matrix may be a transformation matrix obtained by performing attitude estimation and filtering on processed frame gyroscope information. And the electronic equipment calculates the current frame target attitude matrix and the processed frame target attitude matrix according to a preset rule to obtain a configuration matrix. For example, the configuration matrix may be calculated by multiplying the current frame target attitude matrix by the inverse of the processed frame target attitude matrix. The configuration matrix is used for representing the initialized registration information for carrying out global alignment operation on the current frame image and the processed frame image.
In the embodiment, the initial registration information between the current frame image and the processed frame image is calculated, so that the reference point for performing global alignment operation on the current frame image and the processed frame image can be obtained, the processed frame image can be accurately updated and aligned to the current frame image, the global alignment speed is effectively improved, the time consumed by fusion filtering operation is saved, and the improvement of the stability of an output video is promoted.
In one embodiment, when the processed frame image is a plurality of frames, the electronic device performs attitude estimation on the gyroscope information of the processed frame of each frame to obtain the target attitude of the processed frame of each frame. And the electronic equipment calculates the target attitude of the current frame and the target attitude of the processed frame of each frame respectively by referring to the mode to obtain a configuration matrix corresponding to the image of the current frame and the image of the processed frame of each frame. That is, when the processed frame images are multiple frames, the electronic device generates the same number of configuration matrices as the processed frame images to ensure that the corresponding initialized registration information can be used when the current frame image and the processed frame image of each frame are subjected to the global alignment operation, so as to ensure the accuracy of the global alignment of the current frame and the processed frame image of each frame.
In one embodiment, as shown in fig. 4, the step of performing the fusion filtering process on the stabilized current frame image and the processed frame image by using the initialized registration information includes:
And step 404, performing fusion noise reduction processing on the globally aligned current frame image and a plurality of frames of globally aligned processed frame images to obtain an optimized frame image.
The processed frame image includes a plurality of frames. The electronic device may calculate the initial registration information between the processed image of each frame and the stabilized current frame image in the manner provided in the above embodiments. The electronic device performs global alignment processing on the stabilized current frame image and the processed frame of each frame by using the initialized registration information according to the manner provided in the above embodiment, so as to obtain a plurality of items of global alignment information. The electronic equipment performs multi-frame fusion filtering processing based on multiple items of global alignment information.
Because the video has more time domain information than the static image, the embodiment combines the processed image of the previous frame or the processed images of the previous frames to perform fusion noise reduction, so that the noise reduction effect can be ensured under the condition that a moving object possibly appears between the adjacent frame images, and the stability of the output video is effectively improved.
In one embodiment, the filtering the stabilized current frame image and the processed frame image includes: carrying out global alignment processing on the stabilized current frame image and the processed frame image; locally aligning the processed frame image after global alignment with the current frame image after global alignment; and performing fusion filtering processing on the processed frame image after the local alignment and the current frame image after the local alignment to obtain an optimized frame image corresponding to the current frame image.
After the electronic device performs global alignment processing on the stabilized current frame image and the processed frame image according to the manner provided in the above embodiment, it may further detect whether there is local motion, that is, detect that a pixel point in the processed frame image after global alignment moves to a position in the current frame image after global alignment. If no object motion occurs, the motion relationship of moving the pixel points in the processed frame image after global alignment to the current frame image after global alignment is consistent, and the pixel points belong to the motion of the camera. The image obtained after fusion filtering is carried out based on the global alignment information without continuing to carry out local alignment processing can be used as the optimization processing result of the current frame image.
If the object motion occurs, local motion detection is needed to find the position of the moving object in the processed frame image after global alignment and the position in the current frame image after global alignment. Specifically, the electronic device may obtain an image block with a preset pixel size, search for different image blocks in the processed frame image after global alignment and the current frame image after global alignment based on the image block, and use the different image blocks as local areas. After the global alignment processing, the motion relationship of the pixel points in the processed frame image after the global alignment and the current frame image after the global alignment are basically consistent, and the corresponding relationship between the pixel points in the local area is established, so that the local alignment of the processed frame image after the global alignment and the current frame image after the global alignment can be completed. The electronic device performs multi-frame fusion filtering processing according to the method provided in the above embodiment by using the processed frame image after the local alignment and the current frame image after the local alignment, thereby obtaining the result after the optimization processing corresponding to the current frame image.
In this embodiment, by performing local alignment processing on the processed frame image after global alignment processing and the current frame image after global alignment processing, local jitter caused by a moving object can be eliminated, thereby further improving the stability of an output video.
Further, the processed frame image may be a plurality of frames. The electronic device may perform global alignment processing on the processed frame image of each frame and the stabilized current frame image respectively according to the manner provided in the foregoing embodiment, so as to obtain a globally aligned processed frame image of each frame and a globally aligned current frame image. The electronic device may further perform local alignment processing on the processed frame image after global alignment and the current frame image after global alignment of each frame according to the manner provided in the above embodiment, and perform multi-frame fusion filtering processing on the processed frame image after local alignment and the current frame image after local alignment of multiple frames to obtain an optimized result corresponding to the current frame image.
When a moving object exists, the global alignment processing and the local alignment processing are carried out by combining the processed image of the previous frame or the processed images of the previous frames, and then the fusion noise reduction is carried out, so that the local jitter of the moving object between the adjacent frame images can be effectively eliminated, and the stability of the output video is further improved.
In one embodiment, as shown in fig. 5, the step of performing the fusion filtering process on the globally aligned current frame image and the globally aligned processed frame image includes:
And step 504, acquiring the accumulated value of the pixels of the processed frame images of multiple frames.
When the processed frame image is a plurality of frames, the operation amount is increased when the stabilized current frame image and the processed frame image of each frame are subjected to global alignment processing, compared with the operation amount when the processed frame image is a single frame. In order to effectively balance the contradiction between the operation efficiency and the stability of output video caused by the increase of the operation amount. The electronic device may predictively calculate an accumulated value of pixels for a plurality of frames of processed frame images. The electronic equipment carries out anti-shake processing on the current frame image to generate a stabilized current frame image, and the electronic equipment calculates the pixel value of the stabilized current frame image as the current pixel value. In order to improve the operation speed of multi-frame fusion filtering, the electronic equipment performs average operation on the current pixel value and the pixel accumulated value to obtain an average pixel value, and the average pixel value is used as the pixel value of the video image after optimization processing.
For example, the number of processed frame images is N-1, and the current frame image is the Nth frame. The electronic device may accumulate pixel values of the previous N-1 frames of processed frame images to obtain an accumulated pixel value. After the anti-shake processing is performed on the nth frame image, the pixel value of the nth frame image may be calculated as the pixel value of the stabilized current frame image. And the electronic equipment carries out average calculation on the current pixel value and the pixel accumulated value of the processed frame image of the N-1 frame, and takes the average pixel as the optimized pixel value of the image of the Nth frame. The electronic device subtracts the pixel value of the processed frame image of frame 1 from the accumulated sum, adds the average pixel value, and updates the pixel accumulated value. And taking the updated pixel accumulated value as a pixel accumulated value required by the next frame of image when multi-frame fusion filtering is carried out. And repeating the steps until all the frame images in the video are optimized.
In the process, because the multi-frame fusion filtering processing adopts a mode of averaging adjacent image pixels in a time domain, the pixel value of a current frame image after noise reduction processing can be calculated only in each calculation, the pixel accumulated value of a multi-frame processed frame image only needs to update the pixels of a first frame and a last frame, and all pixel accumulated sums do not need to be repeatedly calculated, so that the corresponding operation amount is effectively reduced in the multi-frame fusion filtering process, and the effective balance between the operation efficiency and the stability of an output video is realized.
Further, when the local alignment processing is required after the local alignment processing, the electronic device may further perform the multi-frame fusion filtering processing according to the above manner after the local alignment processing. Therefore, local jitter can be eliminated, the efficiency of multi-frame fusion filtering processing can be improved, and the stability of an output video can be ensured.
It should be understood that although the various steps in the flow charts of fig. 2-5 are shown in order as indicated by the arrows, the steps are not necessarily performed in order as indicated by the arrows. The steps are not performed in the exact order shown and described, and may be performed in other orders, unless explicitly stated otherwise. Moreover, at least some of the steps in fig. 2-5 may include multiple sub-steps or multiple stages that are not necessarily performed at the same time, but may be performed at different times, and the order of performing the sub-steps or stages is not necessarily sequential, but may be performed in turn or alternately with other steps or at least some of the sub-steps or stages of other steps.
Fig. 6 is a block diagram illustrating an exemplary embodiment of an apparatus for video anti-shake optimization, the apparatus including: an obtaining module 602, an anti-shake module 604, and a filtering module 606, wherein:
the obtaining module 602 is configured to obtain a current frame image, current frame gyroscope information, and a processed frame image, where the current frame image and the processed frame image are adjacent in a time domain.
The anti-shake module 604 is configured to perform anti-shake processing on the current frame image by using the current frame gyroscope information, and generate a stabilized current frame image.
And a filtering module 606, configured to perform fusion filtering on the stabilized current frame image and the processed frame image to obtain an optimized video image corresponding to the current frame image.
In one embodiment, the filtering module 606 is further configured to perform global alignment processing on the stabilized current frame image and the processed frame image; and performing fusion filtering processing on the globally aligned current frame image and the globally aligned processed frame image to obtain an optimized frame image.
In one embodiment, the obtaining module 602 is further configured to obtain processed frame gyroscope information, and as shown in fig. 7, the apparatus further includes: an initialized registration module 608, configured to generate initialized registration information by using the current frame gyroscope information and the processed frame gyroscope information; the filtering module 606 is further configured to perform fusion filtering processing on the stabilized current frame image and the processed frame image by using the initialized registration information, so as to obtain an optimized video image corresponding to the current frame image.
In one embodiment, the initialization registration module 608 is further configured to perform attitude estimation on the gyroscope information of the current frame to obtain a target attitude of the current frame; carrying out attitude estimation on gyroscope information of the processed frame to obtain a target attitude of the processed frame; and generating initial registration information by using the current frame target attitude and the processed frame target attitude.
In one embodiment, the initialization registration module 608 is further configured to obtain a current frame target posture matrix corresponding to the current frame target posture; acquiring a processed frame target attitude matrix corresponding to the processed frame target attitude; and calculating by using the current frame target attitude matrix and the processed frame target attitude matrix to obtain a registration matrix corresponding to the initialized registration information.
In one embodiment, the initialized registration module 608 is further configured to process the frame image to include multiple frames, perform pose estimation on the gyroscope information of the processed frame of each frame, and obtain a target pose of the processed frame of each frame; and respectively generating a plurality of items of initialized registration information by using the target pose of the current frame and the target pose of the processed frame of each frame.
In one embodiment, the filtering module 606 is further configured to perform global alignment processing on the stabilized current frame image and the processed frame image of each frame respectively by using corresponding initialized registration information; and performing fusion noise reduction processing on the globally aligned current frame image and the processed frame image after multi-frame global alignment to obtain an optimized frame image.
In one embodiment, the filtering module 606 is further configured to perform global alignment processing on the stabilized current frame image and the processed frame image; locally aligning the processed frame image after global alignment with the current frame image after global alignment; and performing fusion filtering processing on the processed frame image after the local alignment and the current frame image after the local alignment to obtain an optimized frame image corresponding to the current frame image.
In one embodiment, the filtering module 606 is further configured to obtain a current pixel value of the globally aligned current frame image; acquiring a pixel accumulated value of a plurality of processed frame images; carrying out average operation on the current pixel value and the obtained pixel accumulated value to obtain an average pixel value; and taking the average pixel value as the pixel value of the video image after the optimization processing.
The division of each module in the video anti-shake optimization processing apparatus is only used for illustration, and in other embodiments, the video anti-shake optimization processing apparatus may be divided into different modules as needed to complete all or part of the functions of the video anti-shake optimization processing apparatus.
The implementation of each module in the video anti-shake optimization processing apparatus provided in the embodiment of the present application may be in the form of computer readable instructions. The computer readable instructions are executable on an electronic device. Program modules comprising the computer readable instructions may be stored on a memory of the electronic device. The computer readable instructions, when executed by a processor, perform the steps of the method described in the embodiments of the present application.
Fig. 8 is a schematic diagram of an internal structure of an electronic device in one embodiment. As shown in fig. 8, the electronic device includes a processor and a memory connected by a system bus. The processor is used for providing calculation and control capacity and supporting the operation of the whole electronic equipment. The memory may include a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and computer readable instructions. The computer readable instructions can be executed by a processor to implement a video anti-shake optimization processing method provided in the following embodiments. The internal memory provides a cached execution environment for the operating system computer-readable instructions in the non-volatile storage medium. The electronic device may be a mobile phone, a tablet computer, or a personal digital assistant or a wearable device, etc.
Those skilled in the art will appreciate that the architecture shown in fig. 8 is a block diagram of only a portion of the architecture associated with the subject application, and does not constitute a limitation on the servers to which the subject application applies, as a particular server may include more or less components than those shown, or may combine certain components, or have a different arrangement of components.
The embodiment of the application also provides the electronic equipment. The electronic device includes therein an Image Processing circuit, which may be implemented using hardware and/or software components, and may include various Processing units defining an ISP (Image Signal Processing) pipeline. FIG. 9 is a schematic diagram of an image processing circuit in one embodiment. As shown in fig. 9, for convenience of explanation, only aspects of the image processing technique related to the embodiments of the present application are shown.
As shown in fig. 9, the image processing circuit includes an ISP processor 940 and a control logic 950. The image data captured by the imaging device 910 is first processed by the ISP processor 940, and the ISP processor 940 analyzes the image data to capture image statistics that may be used to determine and/or control one or more parameters of the imaging device 910. The imaging device 910 may include a camera having one or more lenses 912 and an image sensor 914. Image sensor 914 may include an array of color filters (e.g., Bayer filters), and image sensor 914 may acquire light intensity and wavelength information captured with each imaging pixel of image sensor 914 and provide a set of raw image data that may be processed by ISP processor 940. The sensor 920 (e.g., a gyroscope) may provide parameters of the acquired image processing (e.g., anti-shake parameters) to the ISP processor 940 based on the type of interface of the sensor 920. The sensor 920 interface may utilize an SMIA (Standard Mobile Imaging Architecture) interface, other serial or parallel camera interfaces, or a combination thereof.
In addition, image sensor 914 may also send raw image data to sensor 920, sensor 920 may provide raw image data to ISP processor 940 based on the type of interface of sensor 920, or sensor 920 may store raw image data in image memory 930.
The ISP processor 940 processes the raw image data pixel by pixel in a variety of formats. For example, each image pixel may have a bit depth of 8, 10, 12, or 14 bits, and the ISP processor 940 may perform one or more image processing operations on the raw image data, collecting statistical information about the image data. Wherein the image processing operations may be performed with the same or different bit depth precision.
Upon receiving raw image data from image sensor 914 interface or from sensor 920 interface or from image memory 930, ISP processor 940 may perform one or more image processing operations, such as temporal filtering. The processed image data may be sent to image memory 930 for additional processing before being displayed. The image data processed by ISP processor 940 may be output to display 970 for viewing by a user and/or further processed by a Graphics Processing Unit (GPU). Further, the output of ISP processor 940 may also be sent to image memory 930 and display 970 may read image data from image memory 930. In one embodiment, image memory 930 may be configured to implement one or more frame buffers. In addition, the output of the ISP processor 940 may be transmitted to an encoder/decoder 960 for encoding/decoding the image data. The encoded image data may be saved and decompressed before being displayed on a display 970 device. The encoder/decoder 960 may be implemented by a CPU or GPU or coprocessor.
The statistical data determined by the ISP processor 940 may be transmitted to the control logic 950 unit. For example, the statistical data may include image sensor 914 statistics such as auto-exposure, auto-white balance, auto-focus, flicker detection, black level compensation, lens 912 shading correction, and the like. The control logic 950 may include a processor and/or microcontroller that executes one or more routines (e.g., firmware) that may determine control parameters of the imaging device 910 and control parameters of the ISP processor 940 based on the received statistical data. For example, the control parameters of imaging device 910 may include sensor 920 control parameters (e.g., gain, integration time for exposure control, anti-shake parameters, etc.), camera flash control parameters, lens 912 control parameters (e.g., focal length for focusing or zooming), or a combination of these parameters. The ISP control parameters may include gain levels and color correction matrices for automatic white balance and color adjustment (e.g., during RGB processing), as well as lens 912 shading correction parameters.
The steps involved in the various method embodiments described above may be implemented using the image processing technique of fig. 9. In one embodiment, the electronic device may capture video images using the imaging device 910 and capture sensor information corresponding to each frame of the video image via the image sensor 914. The image sensor 920 may be a gyro sensor, and the corresponding sensor information is gyro information. The gyro sensor provides the acquired gyro information and the corresponding video image to the ISP processor 940. The ISP processor 940 performs an optimization process on the current frame image. The ISP processor 940 performs anti-shake processing on the current frame image using the current frame gyroscope information to generate a stabilized current frame image. The ISP processor 940 then performs fusion filtering processing on the stabilized current frame image and the processed frame image to obtain an optimized video image corresponding to the current frame image. To effectively increase the speed of the fusion filtering, the ISP processor 940 obtains gyroscope information for the processed frame. The ISP processor 940 generates the initialization registration information using the current frame gyroscope information and the processed frame gyroscope information. The ISP processor 940 derives a reference point for the global alignment operation from the initialized registration information. Based on the reference point, the ISP processor 940 performs global alignment operation on the stabilized current frame image and the processed frame image, and performs multi-frame fusion filtering processing based on the global alignment information, thereby obtaining an optimized video image corresponding to the current frame image. The ISP processor 940 outputs the optimized video image to the encoder/decoder 960 to encode/decode image data. The encoded image data may be saved and may be displayed on a display 970 device. Since the anti-shake processing by the ISP processor 940 is preceded in the optimization process, it is possible to eliminate shake in the current frame image in advance. The stable current frame image and the processed frame image are subjected to fusion filtering processing, so that the filtering processing efficiency can be effectively improved, the time consumption of the operation of fusion filtering is saved, and the stability of an output video is effectively improved.
The embodiments of the present application further provide an electronic device, which includes a memory and one or more processors, where the memory stores computer-readable instructions, and the computer-readable instructions, when executed by the one or more processors, cause the one or more processors to perform the steps provided in the methods of the various embodiments described above.
The embodiment of the application also provides a computer readable storage medium. One or more non-transitory computer-readable storage media containing computer-executable instructions that, when executed by one or more processors, cause the processors to perform the steps provided in the various embodiment methods described above.
A computer program product comprising computer readable instructions which, when run on a computer, cause the computer to perform the video anti-shake optimization processing method provided in the various embodiments described above.
Any reference to memory, storage, databases, or other media used with embodiments of the application may include non-volatile and/or volatile memory. Suitable non-volatile memory can include read-only memory (ROM), Programmable ROM (PROM), Electrically Programmable ROM (EPROM), Electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM), which acts as external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms such as Static RAM (SRAM), Dynamic RAM (DRAM), Synchronous DRAM (SDRAM), double data rate SDRAM (DDR SDRAM), Enhanced SDRAM (ESDRAM), synchronous Link (Synchlink) DRAM (SLDRAM), Rambus (Rambus) direct RAM (RDRAM), direct bused dynamic RAM (DRDRAM), and bused dynamic RAM (RDRAM).
The above-mentioned embodiments only express several embodiments of the present application, and the description thereof is specific and detailed, but not construed as limiting the scope of the present application. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the concept of the present application, which falls within the scope of protection of the present application. Therefore, the protection scope of the present patent application shall be subject to the appended claims.
Claims (20)
- A video anti-shake optimization processing method comprises the following steps:acquiring a current frame image, current frame gyroscope information and a processed frame image; the current frame image and the processed frame image are adjacent in time domain;carrying out anti-shake processing on the current frame image by using the gyroscope information of the current frame to generate a stable current frame image; andand performing fusion filtering processing on the stabilized current frame image and the processed frame image to obtain an optimized video image corresponding to the current frame image.
- The method according to claim 1, wherein the performing the fusion filtering process on the stabilized current frame image and the processed frame image comprises:carrying out global alignment processing on the stabilized current frame image and the processed frame image; and performing fusion filtering processing on the globally aligned current frame image and the globally aligned processed frame image to obtain an optimized frame image.
- The method of claim 1, further comprising:acquiring gyroscope information of a processed frame, and generating initialized registration information by using the gyroscope information of the current frame and the gyroscope information of the processed frame; andthe performing fusion filtering processing on the stabilized current frame image and the processed frame image to obtain an optimized video image corresponding to the current frame image includes:and performing fusion filtering processing on the stabilized current frame image and the processed frame image by using the initialized registration information to obtain an optimized video image corresponding to the current frame image.
- The method of claim 3, wherein generating initialization registration information using the current frame gyroscope information and the processed frame gyroscope information comprises:carrying out attitude estimation on the gyroscope information of the current frame to obtain the target attitude of the current frame;carrying out attitude estimation on the gyroscope information of the processed frame to obtain the target attitude of the processed frame; andand generating initial registration information by using the current frame target attitude and the processed frame target attitude.
- The method of claim 4, wherein generating initialization registration information using the current frame target pose and the processed frame target pose comprises:acquiring a current frame target attitude matrix corresponding to the current frame target attitude;acquiring a processed frame target attitude matrix corresponding to the processed frame target attitude; andand calculating by using the current frame target attitude matrix and the processed frame target attitude matrix to obtain a registration matrix corresponding to the initialized registration information.
- The method of claim 4, wherein the processed frame image comprises a plurality of frames,the performing pose estimation on the processed frame gyroscope information comprises: carrying out attitude estimation on the gyroscope information of the processed frame of each frame to obtain the target attitude of the processed frame of each frame; andthe generating of the initialized registration information by using the current frame target pose and the processed frame target pose comprises: and respectively generating a plurality of items of initialization registration information by using the current frame target attitude and the processed frame target attitude of each frame.
- The method of claim 6, wherein the performing a fusion filtering process on the stabilized current frame image and the processed frame image by using the initial registration information comprises:respectively carrying out global alignment processing on the stabilized current frame image and the processed frame image of each frame by utilizing corresponding initialized registration information; andand performing fusion noise reduction processing on the globally aligned current frame image and the processed frame image after multi-frame global alignment to obtain an optimized frame image.
- The method according to claim 1, wherein said filtering said stabilized current frame image and said processed frame image comprises:carrying out global alignment processing on the stabilized current frame image and the processed frame image;locally aligning the processed frame image after global alignment with the current frame image after global alignment; andand performing fusion filtering processing on the processed frame image after the local alignment and the current frame image after the local alignment to obtain an optimized frame image corresponding to the current frame image.
- The method of claim 2, wherein the performing the fusion filtering process on the globally aligned current frame image and the globally aligned processed frame image comprises:acquiring the current pixel value of the globally aligned current frame image;acquiring a pixel accumulated value of a plurality of processed frame images;carrying out average operation on the current pixel value and the obtained pixel accumulated value to obtain an average pixel value; andand taking the average pixel value as the pixel value of the video image after optimization processing.
- A video anti-shake optimization processing apparatus, comprising:the acquisition module is used for acquiring a current frame image, current frame gyroscope information and a processed frame image;the anti-shake module is used for carrying out anti-shake processing on the current frame image and the current frame gyroscope information to generate a stable current frame image; andand the filtering module is used for performing fusion filtering processing on the stabilized current frame image and the processed frame image to obtain an optimized video image corresponding to the current frame image.
- An electronic device comprising a memory and one or more processors, the memory having stored therein computer-readable instructions that, when executed by the one or more processors, cause the one or more processors to perform the steps of:acquiring a current frame image, current frame gyroscope information and a processed frame image;performing anti-shake processing on the current frame image and the current frame gyroscope information to generate a stable current frame image; andand performing fusion filtering processing on the stabilized current frame image and the processed frame image to obtain an optimized video image corresponding to the current frame image.
- The electronic device of claim 11, wherein the processor further performs the steps of:carrying out global alignment processing on the stabilized current frame image and the processed frame image; and performing fusion filtering processing on the globally aligned current frame image and the globally aligned processed frame image to obtain an optimized frame image.
- The electronic device of claim 11, wherein the processor further performs the steps of:acquiring gyroscope information of a processed frame, and generating initialized registration information by using the gyroscope information of the current frame and the gyroscope information of the processed frame; andand performing fusion filtering processing on the stabilized current frame image and the processed frame image by using the initialized registration information to obtain an optimized video image corresponding to the current frame image.
- The electronic device of claim 13, wherein the processor further performs the steps of:carrying out attitude estimation on the gyroscope information of the current frame to obtain the target attitude of the current frame;carrying out attitude estimation on the gyroscope information of the processed frame to obtain the target attitude of the processed frame; andand generating initial registration information by using the current frame target attitude and the processed frame target attitude.
- The electronic device of claim 13, wherein the processor further performs the steps of:respectively carrying out global alignment processing on the stabilized current frame image and the processed frame image of each frame by utilizing corresponding initialized registration information; andand performing fusion noise reduction on the current frame image after global alignment and the processed frame image after multi-frame global alignment to obtain an optimized frame image.
- The electronic device of claim 11, wherein the processor further performs the steps of:carrying out global alignment processing on the stabilized current frame image and the processed frame image;locally aligning the processed frame image after global alignment with the current frame image after global alignment; andand performing fusion filtering processing on the processed frame image after the local alignment and the current frame image after the local alignment to obtain an optimized frame image corresponding to the current frame image.
- The electronic device of claim 12, wherein the processor further performs the steps of:acquiring the current pixel value of the globally aligned current frame image;acquiring a pixel accumulated value of a plurality of processed frame images;carrying out average operation on the current pixel value and the obtained pixel accumulated value to obtain an average pixel value; andand taking the average pixel value as the pixel value of the video image after optimization processing.
- One or more non-transitory computer-readable storage media embodying computer-executable instructions that, when executed by one or more processors, cause the processors to perform the steps of:acquiring a current frame image, current frame gyroscope information and a processed frame image;performing anti-shake processing on the current frame image and the current frame gyroscope information to generate a stable current frame image; andand performing fusion filtering processing on the stabilized current frame image and the processed frame image to obtain an optimized video image corresponding to the current frame image.
- The computer-readable storage medium of claim 18, wherein the processor further performs the steps of:acquiring gyroscope information of a processed frame, and generating initialized registration information by using the gyroscope information of the current frame and the gyroscope information of the processed frame; andand performing fusion filtering processing on the stabilized current frame image and the processed frame image by using the initialized registration information to obtain an optimized video image corresponding to the current frame image.
- The computer-readable storage medium of claim 19, wherein the processor further performs the steps of:carrying out attitude estimation on the gyroscope information of the current frame to obtain the target attitude of the current frame;carrying out attitude estimation on the gyroscope information of the processed frame to obtain the target attitude of the processed frame; andand generating initialization registration information by using the current frame target attitude and the processed frame target attitude.
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| PCT/CN2019/121913 WO2021102893A1 (en) | 2019-11-29 | 2019-11-29 | Method and apparatus for video anti-shaking optimization and electronic device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114586337A true CN114586337A (en) | 2022-06-03 |
| CN114586337B CN114586337B (en) | 2023-11-10 |
Family
ID=76129846
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201980101297.1A Active CN114586337B (en) | 2019-11-29 | 2019-11-29 | Video anti-shake optimization processing method and device and electronic equipment |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN114586337B (en) |
| WO (1) | WO2021102893A1 (en) |
Families Citing this family (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114071019A (en) * | 2021-11-19 | 2022-02-18 | Oppo广东移动通信有限公司 | Image processing method and device, electronic equipment and computer readable storage medium |
| CN114025105B (en) * | 2021-12-15 | 2023-11-28 | 北京达佳互联信息技术有限公司 | Video processing method, device, electronic equipment and storage medium |
| CN114862735A (en) * | 2022-05-23 | 2022-08-05 | Oppo广东移动通信有限公司 | Image processing method, image processing device, electronic equipment and computer readable storage medium |
| CN116048955B (en) * | 2022-07-19 | 2023-10-20 | 荣耀终端有限公司 | Test method and electronic equipment |
| CN116506732B (en) * | 2023-06-26 | 2023-12-05 | 浙江华诺康科技有限公司 | Image snapshot anti-shake method, device and system and computer equipment |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101150665A (en) * | 2006-09-20 | 2008-03-26 | 富士通株式会社 | Image capturing device having a hand shake correction function and hand shake correction method |
| US20120019678A1 (en) * | 2010-07-22 | 2012-01-26 | Canon Kabushiki Kaisha | Image processing apparatus and control method therefor |
| US20130107066A1 (en) * | 2011-10-27 | 2013-05-02 | Qualcomm Incorporated | Sensor aided video stabilization |
| CN103841297A (en) * | 2012-11-23 | 2014-06-04 | 中国航天科工集团第三研究院第八三五七研究所 | Electronic image-stabilizing method suitable for resultant-motion camera shooting carrier |
| CN110290323A (en) * | 2019-06-28 | 2019-09-27 | Oppo广东移动通信有限公司 | Image processing method, device, electronic equipment and computer readable storage medium |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP3267675B1 (en) * | 2015-03-31 | 2019-08-07 | Huawei Technologies Co., Ltd. | Terminal device and photographing method |
| CN108366201B (en) * | 2018-02-12 | 2020-11-06 | 天津天地伟业信息系统集成有限公司 | Electronic anti-shake method based on gyroscope |
-
2019
- 2019-11-29 CN CN201980101297.1A patent/CN114586337B/en active Active
- 2019-11-29 WO PCT/CN2019/121913 patent/WO2021102893A1/en active Application Filing
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101150665A (en) * | 2006-09-20 | 2008-03-26 | 富士通株式会社 | Image capturing device having a hand shake correction function and hand shake correction method |
| US20120019678A1 (en) * | 2010-07-22 | 2012-01-26 | Canon Kabushiki Kaisha | Image processing apparatus and control method therefor |
| US20130107066A1 (en) * | 2011-10-27 | 2013-05-02 | Qualcomm Incorporated | Sensor aided video stabilization |
| CN103841297A (en) * | 2012-11-23 | 2014-06-04 | 中国航天科工集团第三研究院第八三五七研究所 | Electronic image-stabilizing method suitable for resultant-motion camera shooting carrier |
| CN110290323A (en) * | 2019-06-28 | 2019-09-27 | Oppo广东移动通信有限公司 | Image processing method, device, electronic equipment and computer readable storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2021102893A1 (en) | 2021-06-03 |
| CN114586337B (en) | 2023-11-10 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN114586337B (en) | Video anti-shake optimization processing method and device and electronic equipment | |
| CN110536057B (en) | Image processing method and device, electronic equipment and computer readable storage medium | |
| US10764496B2 (en) | Fast scan-type panoramic image synthesis method and device | |
| CN110166695B (en) | Camera anti-shake method and device, electronic equipment and computer readable storage medium | |
| CN111246089B (en) | Jitter compensation method and apparatus, electronic device, computer-readable storage medium | |
| CN110473159B (en) | Image processing method and device, electronic equipment and computer readable storage medium | |
| US8559751B2 (en) | Method and device for removing motion blur effects | |
| US9202263B2 (en) | System and method for spatio video image enhancement | |
| CN110290323B (en) | Image processing method, image processing device, electronic equipment and computer readable storage medium | |
| CN110661977B (en) | Subject detection method and apparatus, electronic device, and computer-readable storage medium | |
| CN107395991B (en) | Image synthesis method, image synthesis device, computer-readable storage medium and computer equipment | |
| US20210099646A1 (en) | Method and Apparatus for Detecting Subject, Electronic Device, and Computer Readable Storage Medium | |
| CN108769523B (en) | Image processing method and device, electronic equipment and computer readable storage medium | |
| CN113875219B (en) | Image processing method and device, electronic equipment and computer readable storage medium | |
| KR102127306B1 (en) | Movement detecting apparatus and movement detecting method | |
| CN110177212B (en) | Image processing method and device, electronic equipment and computer readable storage medium | |
| CN111932587A (en) | Image processing method and device, electronic equipment and computer readable storage medium | |
| CN110889809A (en) | Image processing method and device, electronic device and storage medium | |
| CN110351508B (en) | Anti-shake processing method and device based on video recording mode and electronic equipment | |
| KR102003460B1 (en) | Device and Method for dewobbling | |
| CN107295261B (en) | Image defogging method and device, storage medium and mobile terminal | |
| CN110930440B (en) | Image alignment method, device, storage medium and electronic equipment | |
| CN117014726A (en) | Video image stabilizing method and system based on multi-angle processing | |
| CN112132879B (en) | Image processing method, device and storage medium | |
| KR101458099B1 (en) | Image Stabilization Method and Image Processing Apparatus usign the smae |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |