CN114827447B - Image jitter correction method and device - Google Patents
Image jitter correction method and device Download PDFInfo
- Publication number
- CN114827447B CN114827447B CN202110130610.3A CN202110130610A CN114827447B CN 114827447 B CN114827447 B CN 114827447B CN 202110130610 A CN202110130610 A CN 202110130610A CN 114827447 B CN114827447 B CN 114827447B
- Authority
- CN
- China
- Prior art keywords
- original image
- exposure time
- shake
- shake correction
- linear displacement
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000012937 correction Methods 0.000 title claims abstract description 47
- 238000000034 method Methods 0.000 title claims abstract description 39
- 230000003287 optical effect Effects 0.000 claims abstract description 24
- 238000012545 processing Methods 0.000 claims abstract description 15
- 238000005096 rolling process Methods 0.000 claims abstract description 15
- 230000002265 prevention Effects 0.000 claims abstract description 11
- 238000006073 displacement reaction Methods 0.000 claims description 117
- 238000000605 extraction Methods 0.000 claims description 37
- 230000005484 gravity Effects 0.000 claims description 11
- 238000012163 sequencing technique Methods 0.000 claims description 8
- 230000015572 biosynthetic process Effects 0.000 claims description 3
- 238000003786 synthesis reaction Methods 0.000 claims description 3
- 238000005516 engineering process Methods 0.000 abstract description 7
- 238000003384 imaging method Methods 0.000 abstract description 7
- 208000012788 shakes Diseases 0.000 description 84
- 238000004891 communication Methods 0.000 description 10
- 238000010586 diagram Methods 0.000 description 9
- 230000000694 effects Effects 0.000 description 5
- 230000006870 function Effects 0.000 description 5
- 230000008859 change Effects 0.000 description 4
- 230000005236 sound signal Effects 0.000 description 4
- 230000008569 process Effects 0.000 description 3
- 230000001133 acceleration Effects 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 238000007726 management method Methods 0.000 description 2
- 230000009467 reduction Effects 0.000 description 2
- 239000012925 reference material Substances 0.000 description 2
- 238000012216 screening Methods 0.000 description 2
- 230000002194 synthesizing effect Effects 0.000 description 2
- 230000009471 action Effects 0.000 description 1
- 230000006978 adaptation Effects 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 230000015556 catabolic process Effects 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 238000006731 degradation reaction Methods 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 238000005070 sampling Methods 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/68—Control of cameras or camera modules for stable pick-up of the scene, e.g. compensating for camera body vibrations
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Studio Devices (AREA)
Abstract
The present disclosure relates to an image shake correction method and apparatus. The method relates to an image processing technology, and solves the problem that the influence of shake occurring in the Roll axis direction cannot be eliminated by a two-axis optical shake prevention scheme. The method comprises the following steps: obtaining shaking information of a plurality of original image frames obtained through shooting in the rolling axial direction; extracting at least one original image frame according to the dithering information; and generating a shake correction image using the extracted at least one of the original image frames. The technical scheme provided by the disclosure is suitable for a two-axis optical anti-shake system, and realizes the two-axis optical anti-shake with higher imaging quality.
Description
Technical Field
The present disclosure relates to image processing technology, and in particular, to an image shake correction method and apparatus.
Background
The better photographing optical anti-shake scheme can perform anti-shake treatment on three axial directions of a pitching axis (Pitch), a piloting axis (Yaw) and a rolling axis (Roll). The optical anti-shake scheme is generally applied to relatively convenient photographing related equipment such as mobile phones, cameras and simple cloud platforms, but is limited by factors such as cost, equipment volume and the like, and the anti-shake system of relatively common mobile phones, cameras and other equipment is two-axis (i.e. Pitch and Yaw) anti-shake. However, the two-axis anti-shake scheme cannot eliminate the influence of shake occurring in the Roll axis direction, which results in a decrease in image sharpness.
Under the limiting factors of photographing related equipment, the problem of avoiding the reduction of the image imaging quality caused by shaking is a problem to be solved urgently.
Disclosure of Invention
In order to overcome the problems in the related art, the present disclosure provides an image shake correction method and apparatus, which can improve the anti-shake imaging effect of a photographing device without increasing the implementation cost by acquiring shake information of a scroll shaft in a two-axis optical anti-shake system.
According to a first aspect of embodiments of the present disclosure, there is provided an image shake correction method applied to a two-axis optical shake prevention system, including:
obtaining shaking information of a plurality of original image frames obtained through shooting in the rolling axial direction;
extracting at least one original image frame according to the dithering information;
a shake correction image is generated using the extracted at least one original image frame.
Preferably, the step of acquiring shake information of the plurality of original image frames obtained by shooting in the rolling axis direction includes:
and acquiring the maximum angular displacement of each original image frame in the single-frame exposure time in the rolling axis direction as the shaking information of the corresponding original image frame.
Preferably, the step of extracting at least one original image frame according to the dithering information includes:
comparing the maximum angular displacement within a single frame exposure time of each original image frame to a jitter threshold,
extracting original image frames with maximum angular displacement smaller than a jitter threshold in single frame exposure time.
Preferably, the step of extracting at least one original image frame according to the dithering information includes:
sequencing each original image frame according to the maximum angular displacement value in the single frame exposure time;
at least one original image frame is selected for which the value of the maximum angular displacement within the ordered single frame exposure time is minimum.
Preferably, the dithering information further includes a maximum pixel line displacement in the original image frames, and the step of extracting at least one original image frame based on the dithering information includes:
at least one original image frame having a maximum pixel linear displacement less than a preset linear displacement threshold is extracted.
Preferably, the maximum angular displacement within a single frame exposure time is obtained from the output of the gravity sensor of the photographing device.
According to a second aspect of the embodiments of the present disclosure, there is provided an image shake correction apparatus applied to a two-axis optical shake prevention system, including:
the shake information detection module is used for acquiring shake information of a plurality of original image frames obtained through shooting in the rolling axial direction;
the image extraction module is used for extracting at least one original image frame according to the dithering information;
and an image synthesis module for generating a shake correction image using the extracted at least one original image frame.
Preferably, the jitter information extraction module includes:
and the angular displacement information acquisition sub-module is used for acquiring the maximum angular displacement of each original image frame in the single-frame exposure time in the rolling axial direction as the shaking information of the corresponding original image frame.
Preferably, the image extraction module includes:
a jitter determination sub-module for comparing the maximum angular displacement of each original image frame within the single frame exposure time with a jitter threshold,
and the first extraction submodule is used for extracting the original image frames with the maximum angular displacement smaller than the jitter threshold in the single-frame exposure time.
Preferably, the image extraction module includes:
the sequencing sub-module is used for sequencing each original image frame according to the maximum angular displacement value in the single frame exposure time;
and the second extraction sub-module is used for selecting at least one original image frame with the minimum maximum angular displacement value in the single-frame exposure time after sequencing.
Preferably, the dithering information further includes a maximum pixel linear displacement in the original image frame, and the image extraction module includes:
the linear displacement judging sub-module is used for comparing the maximum pixel linear displacement in each original image frame with a preset linear displacement threshold;
and a third extraction sub-module, configured to extract at least one original image frame with a maximum pixel linear displacement less than the linear displacement threshold.
Preferably, the angular displacement information obtaining sub-module is configured to obtain the maximum angular displacement within a single frame exposure time according to an output of a gravity sensor of the photographing device.
According to a third aspect of embodiments of the present disclosure, there is provided a computer apparatus comprising:
a processor;
a memory for storing a processor executable program;
wherein the processor is configured to perform the above-described image shake correction method.
According to a fourth aspect of embodiments of the present disclosure, there is provided a non-transitory computer-readable storage medium, which when executed by a processor of a mobile terminal, enables the mobile terminal to perform the above-described one image shake correction method.
The technical scheme provided by the embodiment of the disclosure can comprise the following beneficial effects: in the two-axis optical anti-shake system, shake information of a plurality of original image frames obtained through shooting in the upward direction of a turning shaft is obtained, at least one original image frame is extracted according to the shake information, and a shake correction image is generated by using the at least one extracted original image frame. The problem that the influence of shake occurring in the Roll axis direction cannot be eliminated by the two-axis scheme is solved, and the two-axis optical anti-shake with higher imaging quality is realized.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and together with the description, serve to explain the principles of the invention.
Fig. 1 is a flowchart illustrating an image shake correction method according to an exemplary embodiment.
Fig. 2 is an example of a single frame exposure time interval internal angle shift change, according to an example embodiment.
Fig. 3 is an example of an exposure time internal angle displacement variation of a single frame among a plurality of original image frames continuously photographed according to an exemplary embodiment.
Fig. 4 is a flowchart illustrating an image shake correction method according to an exemplary embodiment.
Fig. 5 is a schematic diagram illustrating a jitter threshold calculation principle according to an exemplary embodiment.
Fig. 6 is a flowchart illustrating an image shake correction method according to an exemplary embodiment.
Fig. 7 is a block diagram illustrating an image shake correction apparatus according to an exemplary embodiment.
Fig. 8 is a schematic diagram showing the structure of the jitter information extraction module 701 according to an exemplary embodiment.
Fig. 9 is a schematic diagram showing the structure of the image extraction module 702 according to an exemplary embodiment.
Fig. 10 is a schematic diagram showing the structure of yet another image extraction module 702 according to an exemplary embodiment.
Fig. 11 is a schematic diagram showing the structure of yet another image extraction module 702 according to an exemplary embodiment.
Fig. 12 is a schematic diagram showing the structure of yet another image extraction module 702 according to an exemplary embodiment.
Fig. 13 is a block diagram of an apparatus according to an example embodiment.
Detailed Description
Reference will now be made in detail to exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, the same numbers in different drawings refer to the same or similar elements, unless otherwise indicated. The implementations described in the following exemplary examples do not represent all implementations consistent with the invention. Rather, they are merely examples of apparatus and methods consistent with aspects of the invention as detailed in the accompanying claims.
The two-axis anti-shake scheme cannot eliminate the influence of shake occurring in the Roll axis direction, thereby causing the degradation of image definition.
Under the limiting factors of photographing related equipment, the problem of avoiding the reduction of the image imaging quality caused by shaking is a problem to be solved urgently.
In order to solve the above-described problems, an exemplary embodiment of the present disclosure provides an image shake correction method applied to a two-axis optical shake prevention system, which completes the shake prevention process in the Roll axis direction based on the two-axis optical shake prevention system to obtain a photo with more excellent quality. The process of shooting anti-shake by using the method is shown in fig. 1, and comprises the following steps:
and step 101, obtaining shaking information of a plurality of original image frames obtained through shooting in the rolling axial direction.
In the step, a plurality of original image frames are obtained through shooting by a shooting device based on a two-axis optical anti-shake system, so that shake information of each original image frame in the rolling axis direction can be obtained.
The jitter information may be the maximum angular displacement within a single frame exposure time, and may be obtained from the output of the gravity sensor. The gravity sensor continuously acquires the angular displacement information in the single-frame exposure time, so that a plurality of angular displacements are acquired in the single-frame exposure time, and the maximum angular displacement is determined by screening the plurality of angular displacement data acquired in the single-frame exposure time, so that the maximum angular displacement in the single-frame exposure time is acquired.
The gravity sensor is arranged on the same shooting equipment, for example, the gravity sensor of the mobile phone is used for acquiring the maximum angular displacement in the single-frame exposure time when the mobile phone shoots; the camera can also be arranged on other auxiliary shooting equipment, for example, when a mobile phone is used for shooting, the angular displacement information is acquired through a gravity sensor of a cradle head connected with the mobile phone.
As shown in fig. 2, an example of one single frame exposure time interval inner angle shift sampling. In the single frame exposure time of an original image frame, the angular displacement value is continuously changed, so that the maximum angular displacement in the single frame exposure time exists, and the maximum jitter condition of the original image frame can be accurately reflected.
As shown in fig. 3, there is an example of a change in the exposure time internal angle displacement of a single frame in the case where a plurality of original image frames are continuously photographed. As can be seen from fig. 3, the varying angular displacement information is continuously acquired, forming a fluctuating network line. In a single frame exposure time, the value corresponding to the maximum point of the amplitude of the net wire is the maximum angular displacement in the single frame exposure time.
Step 102, at least one original image frame is extracted according to the dithering information.
In this step, at least one of the plurality of original image frames obtained by shooting may be extracted based on the shake information. The extraction principle can be customized according to user usage requirements or device characteristics to filter out one or more original image frames in which jitter is light in the Roll axis direction for generating a final output.
Step 103, generating a shake correction image by using the extracted at least one original image frame.
In the step, at least one extracted original image frame is used for synthesizing a shake correction image as a final output, and in the biaxial optical shake prevention system, shake conditions in the Roll axis direction in the shooting process are judged based on shake information, so that the influence of shake in the Roll axis direction is screened and eliminated.
An exemplary embodiment of the present disclosure further provides an image shake correction method, where the maximum angular displacement of each original image frame in a single frame exposure time in a rolling axis is obtained as shake information of a corresponding original image frame, and the image frame is extracted based on the maximum angular displacement in the single frame exposure time by using the method, and a specific flow is shown in fig. 4, and includes:
step 401, comparing the maximum angular displacement within the single frame exposure time of each original image frame with the jitter threshold.
In the embodiment of the disclosure, a jitter threshold may be preset, and the jitter threshold may be set according to a user usage habit or hardware performance.
A "jitter threshold=pixel width/maximum rotation radius" may be set, where the pixel width is the pixel width of the original image frame and the maximum rotation radius is the length from the rotation center of the photographing device to the pixel position farthest from the photosensitive area, as shown in fig. 5.
The rotation center of the camera is generally the center point of the projection of the camera on a plane constructed by two axes of Pitch and Yaw, and Roll is perpendicular to the plane through the rotation center.
The image sensor for capturing an image by the capturing device includes a photosensitive area array, which is formed by a plurality of pixel points, wherein one pixel is taken as the farthest pixel, and preferably a corner position pixel. As shown in fig. 5, the pixel at the upper left corner in the photosensitive region is taken as the farthest pixel, and the maximum radius of rotation is determined.
For example, the length from the rotation center to the farthest pixel position of the photosensitive area is 16mm, the pixel point width is 1.6um, and the jitter threshold is 0.0001 rad=0.0057 degrees.
Step 402, extracting an original image frame with the maximum angular displacement smaller than the jitter threshold in the single frame exposure time.
In the step, by comparing the image frame with the jitter threshold, the original image frame with the maximum angular displacement smaller than the jitter threshold in the single frame exposure time is determined to have lighter jitter degree, so that the image similar to the image without the hand-shake shooting effect can be selected. Preferably as a reference material for synthesizing the shake correction image, such an original image frame is extracted.
An exemplary embodiment of the present disclosure further provides an image shake correction method, where the maximum angular displacement of each original image frame in a single frame exposure time in a rolling axis is obtained as shake information of a corresponding original image frame, and the image frame is extracted based on the maximum angular displacement in the single frame exposure time by using the method, and a specific flow is shown in fig. 6, and includes:
step 601, sorting each original image frame according to the maximum angular displacement value in the single frame exposure time.
In this step, the original image frames may be ordered according to the value of the maximum angular displacement within a single frame exposure time. The ordering rules may be from large to small or from small to large, which is not limited by the embodiments of the present disclosure.
Step 602, selecting at least one original image frame with smaller maximum angular displacement value in the single frame exposure time after sequencing.
After sorting, one (e.g., the minimum value of the maximum angular displacement in a single frame exposure time) or more extractions are selected from the smaller side of the maximum angular displacement in the single frame exposure time as reference materials for subsequent generation of shake correction images. Only the original image frame with the smallest value of the largest angular displacement within a single frame exposure time may be selected as the final output.
In the step, the original image frames are extracted and selected according to the sorting result, and the threshold value is not required to be set, so that the image processing efficiency is improved.
An exemplary embodiment of the present disclosure further provides an image shake correction method, which obtains a maximum pixel line displacement in an original image frame as shake information of the corresponding original image frame. The partial or all pixels of the original image frame can generate different degrees of linear displacement, and the maximum pixel linear displacement is selected as the dithering information of the corresponding original image frame, so that the dithering degree of the original image frame can be accurately reflected. Especially in the case of serious jitter, for example, the maximum pixel linear displacement in the exposure time of all the original image frames is greater than 1 pixel, and at this time, the linear displacement is more consistent with the image characteristics than the maximum angular displacement in the exposure time of a single frame, which is helpful for more effectively picking out the original image frames with lighter jitter. And extracting at least one original image frame with the maximum pixel linear displacement smaller than the linear displacement threshold by comparing the maximum pixel linear displacement in each original image frame with a preset linear displacement threshold, and generating a shake correction image by taking the extracted original image frame as a material.
An exemplary embodiment of the present disclosure further provides an image shake correction method, after acquiring a plurality of original image frames, firstly acquiring a maximum pixel linear displacement in the original image frames, and judging an applicable shake information type according to the maximum pixel linear displacement.
For example, if the original image frame with the maximum linear displacement greater than 1 pixel reaches a certain proportion (for example, 80% or more, or 100%), the maximum linear displacement of the pixel is used as the dithering information; the maximum angular displacement within a single frame exposure time is used as dither information when the original image frame with a maximum linear displacement of less than 1 pixel reaches a certain scale (e.g., 80% or more, or 100%).
When the maximum pixel linear displacement is used as dithering information, comparing the dithering information with a preset displacement threshold to perform image screening. For example, a displacement threshold is preset to 2 pixels, the original image frame with the maximum pixel displacement reaching 2 pixels is removed, and the original image frame with the maximum pixel displacement smaller than 2 pixels is extracted.
When the maximum angular displacement in the single frame exposure time is used as the dithering information, the dithering threshold scheme shown in fig. 4 or the sorting scheme shown in fig. 6 is used for image extraction, and the schemes shown in fig. 4 and 6 are not described herein. In the same shooting device, the above-mentioned jitter threshold scheme and ordering scheme may be configured at the same time.
When the maximum angular displacement in the single frame exposure time is used as jitter information, one of the schemes can be set as a default scheme, and the other scheme is started when a certain condition is met. For example, a jitter threshold scheme is used by default, and an ordering scheme is called when the processor and/or memory usage is high; or by default, a sorting scheme is used, and a jitter threshold scheme is used in the case of automatic recognition or user instruction to enhance the anti-jitter effect.
The scheme selection rule can also be set, and when the anti-shake function is called, which scheme is selected is determined according to the current application scene and the use condition of the shooting equipment. For example, rules such as "if the processor usage rate reaches 70% when the photographing function is turned on, using a sorting scheme", "if the processor usage rate is lower than 70% when the photographing function is turned on, using a jitter threshold scheme", etc. are set.
An exemplary embodiment of the present disclosure further provides an image shake correction apparatus applied to a two-axis optical shake prevention system, having a structure as shown in fig. 7, including:
the shake information extraction module 701 is configured to obtain shake information of a plurality of captured original image frames in a rolling axis direction;
an image extraction module 702, configured to extract at least one original image frame according to the dithering information;
an image synthesis module 703, configured to generate a shake correction image using the extracted at least one original image frame.
The structure of the jitter information extraction module 701 is as shown in fig. 8, and includes:
the angular displacement information obtaining sub-module 801 is configured to obtain a maximum angular displacement of each original image frame within a single frame exposure time in a rolling axis direction as shake information of the corresponding original image frame.
The image extraction module 702 has a structure as shown in fig. 9, and includes:
a jitter determination sub-module 901 for comparing the maximum angular displacement within the single frame exposure time of each original image frame with a jitter threshold,
jitter threshold = pixel width/maximum radius of rotation,
the width of the pixel point is the width of the pixel point of the original image frame, and the maximum rotation radius is the length from the rotation center of the shooting device to the farthest pixel position of the photosensitive area;
a first extraction sub-module 902 is configured to extract an original image frame with a maximum angular displacement less than a jitter threshold during a single frame exposure time.
Preferably, the angular displacement information obtaining sub-module 801 is configured to obtain the maximum angular displacement within a single frame exposure time according to an output of a gravity sensor of the photographing device.
According to an exemplary embodiment of the present disclosure, a further image extraction module 702 is structured as shown in fig. 10, and includes:
a sorting submodule 1001, configured to sort each of the original image frames according to a value of a maximum angular displacement within the single-frame exposure time;
a second extraction sub-module 1002, configured to select at least one of the original image frames with a small value of the maximum angular displacement within the single frame exposure time after sorting.
According to an exemplary embodiment of the present disclosure, the dithering information further includes a maximum pixel linear displacement in the original image frame, and the further image extraction module 702 is structured as shown in fig. 11, and includes:
a linear displacement determination submodule 1101, configured to compare a maximum pixel linear displacement in each original image frame with a preset linear displacement threshold;
a third extraction submodule 1102 is configured to extract at least one of the original image frames with a maximum pixel linear displacement less than the linear displacement threshold.
According to an exemplary embodiment of the present disclosure, the sub-modules, as shown in fig. 9-11, may be integrated into the same image extraction module 702, as shown in fig. 12. And flexibly starting the corresponding sub-modules according to the actual application requirements so as to realize the required functions.
The specific manner in which the various modules perform the operations in the apparatus of the above embodiments have been described in detail in connection with the embodiments of the method, and will not be described in detail herein. The device can be integrated in main shooting equipment (such as a mobile phone, a camera and the like), and also can be integrated in auxiliary shooting equipment (such as external cradle head equipment of the mobile phone/camera and the like), and the shooting equipment realizes corresponding functions.
Fig. 13 is a block diagram illustrating an apparatus 1300 for image shake correction according to an example embodiment. For example, apparatus 1300 may be a mobile phone, computer, digital broadcast terminal, messaging device, game console, tablet device, medical device, exercise device, personal digital assistant, or the like.
Referring to fig. 13, apparatus 1300 may include one or more of the following components: a processing component 1302, a memory 1304, a power component 1306, a multimedia component 1308, an audio component 1310, an input/output (I/O) interface 1312, a sensor component 1314, and a communication component 1316.
The processing component 1302 generally controls overall operation of the apparatus 1300, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. The processing component 1302 may include one or more processors 1320 to execute processor-executable programs to perform all or part of the steps of the methods described above. Further, the processing component 1302 can include one or more modules that facilitate interactions between the processing component 1302 and other components. For example, the processing component 1302 may include a multimedia module to facilitate interaction between the multimedia component 1308 and the processing component 1302.
The memory 1304 is configured to store various types of data to support operations at the device 1300. Examples of such data include processor-executable programs, contact data, phonebook data, messages, pictures, videos, and the like for any application or method operating on apparatus 1300. The memory 1304 may be implemented by any type or combination of volatile or nonvolatile memory devices such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disk.
The power supply assembly 1306 provides power to the various components of the device 1300. The power supply components 1306 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the device 1300.
The multimedia component 1308 includes a screen between the device 1300 and the user that provides an output interface. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from a user. The touch panel includes one or more touch sensors to sense touches, swipes, and gestures on the touch panel. The touch sensor may sense not only the boundary of a touch or sliding action, but also the duration and pressure associated with the touch or sliding operation. In some embodiments, the multimedia component 1308 includes a front-facing camera and/or a rear-facing camera. The front camera and/or the rear camera may receive external multimedia data when the device 1300 is in an operational mode, such as a shooting mode or a video mode. Each front camera and rear camera may be a fixed optical lens system or have focal length and optical zoom capabilities.
The audio component 1310 is configured to output and/or input audio signals. For example, the audio component 1310 includes a Microphone (MIC) configured to receive external audio signals when the apparatus 1300 is in an operational mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signals may be further stored in the memory 1304 or transmitted via the communication component 1316. In some embodiments, the audio component 1310 also includes a speaker for outputting audio signals.
The I/O interface 1312 provides an interface between the processing component 1302 and peripheral interface modules, which may be a keyboard, click wheel, buttons, etc. These buttons may include, but are not limited to: homepage button, volume button, start button, and lock button.
The sensor assembly 1314 includes one or more sensors for providing status assessment of various aspects of the apparatus 1300. For example, the sensor assembly 1314 may detect the on/off state of the device 1300, the relative positioning of the components, such as the display and keypad of the device 1300, the sensor assembly 1314 may also detect the change in position of the device 1300 or a component of the device 1300, the presence or absence of user contact with the device 1300, the orientation or acceleration/deceleration of the device 1300, and the change in temperature of the device 1300. The sensor assembly 1314 may include a proximity sensor configured to detect the presence of nearby objects in the absence of any physical contact. The sensor assembly 1314 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 1314 may also include an acceleration sensor, a gyroscopic sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.
The communication component 1316 is configured to facilitate communication between the apparatus 1300 and other devices, either wired or wireless. The apparatus 1300 may access a wireless network based on a communication standard, such as WiFi,2G or 3G, or a combination thereof. In one exemplary embodiment, the communication component 1316 receives broadcast signals or broadcast related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 1316 further includes a Near Field Communication (NFC) module to facilitate short range communications. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, ultra Wideband (UWB) technology, bluetooth (BT) technology, and other technologies.
In an exemplary embodiment, the apparatus 1300 may be implemented by one or more Application Specific Integrated Circuits (ASICs), digital Signal Processors (DSPs), digital Signal Processing Devices (DSPDs), programmable Logic Devices (PLDs), field Programmable Gate Arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic elements for executing the methods described above.
In an exemplary embodiment, a non-transitory computer readable storage medium is also provided that includes a processor executable program, such as memory 1304 including a processor executable program that is executable by processor 1320 of apparatus 1300 to perform the above-described method. For example, the non-transitory computer readable storage medium may be ROM, random Access Memory (RAM), CD-ROM, magnetic tape, floppy disk, optical data storage device, etc.
A non-transitory computer readable storage medium, when a processor executable program in the storage medium is executed by a processor of a mobile terminal, enables the mobile terminal to perform an image shake correction method provided by an embodiment of the present disclosure.
The disclosure provides an image shake correction method and device, in a two-axis optical shake prevention system, shake information of a plurality of photographed original image frames in a turning shaft direction is obtained, at least one original image frame is extracted according to the shake information, and a shake correction image is generated by using the extracted at least one original image frame. The problem that the influence of shake occurring in the Roll axis direction cannot be eliminated by the two-axis scheme is solved, and the two-axis optical anti-shake with higher imaging quality is realized.
In the disclosure, the acquisition of the shake information can be completed according to the output of the gravity sensor, so that a basis is provided for subsequent processing. The main control chip has small operation burden and short photo processing, and improves the user experience.
The present disclosure can be used with a camera module or a cradle head using a two-axis (Pitch, yaw) optical anti-shake scheme to achieve an image resembling a three-axis anti-shake effect.
The two-axis anti-shake camera module is utilized to select image frames by adding signals of the gravity sensor, so that an effect similar to three-axis anti-shake is obtained, compared with a camera module provided with the three-axis anti-shake motor, the three-axis anti-shake device is not needed, the realization cost is effectively controlled, and the device space is saved.
Other embodiments of the invention will be apparent to those skilled in the art from consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the invention following, in general, the principles of the invention and including such departures from the present disclosure as come within known or customary practice within the art to which the invention pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the invention being indicated by the following claims.
It is to be understood that the invention is not limited to the precise arrangements and instrumentalities shown in the drawings, which have been described above, and that various modifications and changes may be effected without departing from the scope thereof. The scope of the invention is limited only by the appended claims.
Claims (12)
1. An image shake correction method applied to a two-axis optical shake prevention system, comprising:
acquiring the maximum pixel linear displacement in a plurality of original image frames obtained through shooting, if the maximum pixel linear displacement is larger than 1 pixel, the original image frames reach a set proportion, using the maximum pixel linear displacement as jitter information, and if the maximum pixel linear displacement is smaller than 1 pixel, the original image frames reach the set proportion, acquiring the maximum angular displacement of each original image frame in a single frame exposure time in a rolling axial direction as jitter information of the corresponding original image frames;
extracting at least one original image frame according to the dithering information;
and generating a shake correction image using the extracted at least one of the original image frames.
2. The image shake correction method according to claim 1, wherein the step of extracting at least one of the original image frames from the shake information comprises:
comparing the maximum angular displacement within the single frame exposure time of each original image frame with a jitter threshold;
extracting the original image frames with the maximum angular displacement smaller than the jitter threshold in single frame exposure time.
3. The image shake correction method according to claim 1, wherein the step of extracting at least one of the original image frames from the shake information comprises:
sorting each original image frame according to the maximum angular displacement value in the single frame exposure time;
at least one of the original image frames having a value of the largest angular displacement within the single frame exposure time after the ordering is selected.
4. The image shake correction method according to claim 1, wherein the step of extracting at least one of the original image frames from the shake information comprises:
comparing the maximum pixel linear displacement in each original image frame with a preset linear displacement threshold;
at least one of the original image frames having a maximum pixel linear displacement less than the linear displacement threshold is extracted.
5. The image shake correction method according to claim 1, wherein the maximum angular displacement within the single-frame exposure time is obtained from an output of a gravitational sensor of the photographing device.
6. An image shake correction apparatus applied to a two-axis optical shake prevention system, comprising:
the system comprises a jitter information extraction module, a jitter information extraction module and a processing module, wherein the jitter information extraction module is used for acquiring the maximum pixel linear displacement in a plurality of original image frames obtained through shooting, if the maximum pixel linear displacement is larger than 1 pixel, the original image frames reach a set proportion, the maximum pixel linear displacement is used as jitter information, and if the maximum pixel linear displacement is smaller than 1 pixel, the original image frames reach the set proportion, the maximum angular displacement of each original image frame in the single frame exposure time in the rolling axial direction is acquired as jitter information of the corresponding original image frame;
an image extraction module for extracting at least one original image frame according to the dithering information;
and an image synthesis module, configured to generate a shake correction image using the extracted at least one original image frame.
7. The image shake correction apparatus according to claim 6, wherein the image extraction module includes:
a jitter judging sub-module for comparing the maximum angular displacement of each original image frame within the single frame exposure time with a jitter threshold,
and the first extraction submodule is used for extracting the original image frames with the maximum angular displacement smaller than the jitter threshold in the single-frame exposure time.
8. The image shake correction apparatus according to claim 6, wherein the image extraction module includes:
the sequencing sub-module is used for sequencing each original image frame according to the value of the maximum angular displacement in the single frame exposure time;
and the second extraction sub-module is used for selecting at least one original image frame with a small maximum angular displacement value in the single frame exposure time after sequencing.
9. The image shake correction apparatus according to claim 6, wherein the image extraction module includes:
the linear displacement judging sub-module is used for comparing the maximum pixel linear displacement in each original image frame with a preset linear displacement threshold;
and a third extraction sub-module, configured to extract at least one original image frame with a maximum pixel linear displacement less than the linear displacement threshold.
10. The image shake correction apparatus according to claim 6, wherein the shake information extraction module includes an angular displacement information acquisition sub-module for acquiring the maximum angular displacement within the single frame exposure time from an output of a gravity sensor of the photographing apparatus.
11. A computer apparatus, comprising:
a processor;
a memory for storing a processor executable program;
wherein the processor is configured to perform the image shake correction method according to any one of claims 1 to 5.
12. A non-transitory computer readable storage medium, which when executed by a processor of a mobile terminal, causes the mobile terminal to perform an image shake correction method according to any one of claims 1 to 5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110130610.3A CN114827447B (en) | 2021-01-29 | 2021-01-29 | Image jitter correction method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110130610.3A CN114827447B (en) | 2021-01-29 | 2021-01-29 | Image jitter correction method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114827447A CN114827447A (en) | 2022-07-29 |
| CN114827447B true CN114827447B (en) | 2024-02-09 |
Family
ID=82525374
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110130610.3A Active CN114827447B (en) | 2021-01-29 | 2021-01-29 | Image jitter correction method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114827447B (en) |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104967785A (en) * | 2015-07-07 | 2015-10-07 | 小米科技有限责任公司 | Method and apparatus for controlling optical image stabilization |
| CN107615745A (en) * | 2016-04-05 | 2018-01-19 | 华为技术有限公司 | A kind of photographic method and terminal |
| CN110622091A (en) * | 2018-03-28 | 2019-12-27 | 深圳市大疆创新科技有限公司 | Cloud deck control method, device and system, computer storage medium and unmanned aerial vehicle |
| CN114631056A (en) * | 2019-10-29 | 2022-06-14 | 富士胶片株式会社 | Imaging support device, imaging support system, imaging support method, and program |
-
2021
- 2021-01-29 CN CN202110130610.3A patent/CN114827447B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104967785A (en) * | 2015-07-07 | 2015-10-07 | 小米科技有限责任公司 | Method and apparatus for controlling optical image stabilization |
| CN107615745A (en) * | 2016-04-05 | 2018-01-19 | 华为技术有限公司 | A kind of photographic method and terminal |
| CN110622091A (en) * | 2018-03-28 | 2019-12-27 | 深圳市大疆创新科技有限公司 | Cloud deck control method, device and system, computer storage medium and unmanned aerial vehicle |
| CN114631056A (en) * | 2019-10-29 | 2022-06-14 | 富士胶片株式会社 | Imaging support device, imaging support system, imaging support method, and program |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114827447A (en) | 2022-07-29 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP3010226B1 (en) | Method and apparatus for obtaining photograph | |
| CN106331504B (en) | Shooting method and device | |
| EP2991336B1 (en) | Image capturing method and apparatus | |
| CN108881703B (en) | Anti-shake control method and device | |
| US9959484B2 (en) | Method and apparatus for generating image filter | |
| CN106210496B (en) | Photo shooting method and device | |
| CN104869314A (en) | Photographing method and device | |
| CN105391940B (en) | A kind of image recommendation method and device | |
| CN114500821B (en) | Photographing method and device, terminal and storage medium | |
| CN106713656B (en) | Shooting method and mobile terminal | |
| EP2760197A1 (en) | Apparatus and method for processing image in mobile terminal having camera | |
| CN115134505B (en) | Preview picture generation method and device, electronic equipment and storage medium | |
| WO2017088600A1 (en) | Method and device for enlarging imaging range, mobile terminal and computer storage medium | |
| CN114827447B (en) | Image jitter correction method and device | |
| CN111343375A (en) | Image signal processing method and device, electronic device and storage medium | |
| CN106569666B (en) | Mask processing control device and method and terminal | |
| CN114079724B (en) | Taking-off snapshot method, device and storage medium | |
| CN117499794A (en) | Photographing method, photographing device and storage medium | |
| CN110876000B (en) | Camera module, image correction method and device, electronic equipment and storage medium | |
| CN107682623B (en) | Photographing method and device | |
| CN114339015B (en) | Photographing processing method, photographing processing device and storage medium | |
| CN113315903A (en) | Image acquisition method and device, electronic equipment and storage medium | |
| CN114339017B (en) | Distant view focusing method, device and storage medium | |
| CN112203015B (en) | Camera control method, device and medium system | |
| CN109862252B (en) | Image shooting method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |