CN115134505A - Preview picture generation method and device, electronic equipment and storage medium - Google Patents
Preview picture generation method and device, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN115134505A CN115134505A CN202110322170.1A CN202110322170A CN115134505A CN 115134505 A CN115134505 A CN 115134505A CN 202110322170 A CN202110322170 A CN 202110322170A CN 115134505 A CN115134505 A CN 115134505A
- Authority
- CN
- China
- Prior art keywords
- lens
- image
- offset
- optical anti
- shake
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Abstract
The disclosure relates to a preview screen generating method and device, electronic equipment and a storage medium. The method comprises the following steps: under the condition of switching from a first lens to a second lens, determining the optical anti-shake offset of a target lens with an optical anti-shake function in the first lens and the second lens in the switching process; performing offset correction on a pre-corrected image obtained by shooting through the target lens based on the optical anti-shake offset so as to eliminate the field angle offset of the pre-corrected image caused by the optical anti-shake function of the target lens and obtain a corrected image; generating an excessive frame image in the switching process based on the corrected image, and generating a preview screen corresponding to the switching process based on the excessive frame image and the corrected image.
Description
Technical Field
The present disclosure relates to the field of image processing, and in particular, to a preview screen generating method and apparatus, an electronic device, and a storage medium.
Background
In the process of image acquisition, if the used lens is switched, the electronic device is easy to cause the jump of a preview picture, and the visual experience of a user is influenced.
In order to solve the above problem, the related art proposes a method capable of smoothly transiting a preview screen in a shot change scene. According to the method, according to the displacement change in the lens switching process, image processing is carried out on the collected image so as to obtain a transition frame image; and the preview picture is made to be excessively smooth in a mode of displaying the excessive frame image in the preview picture corresponding to the shot switching process.
However, most lenses in the future have an optical anti-shake function, and the position of the lens can be automatically adjusted to avoid image shake in the shooting process without lens switching. When the method is applied to a lens with an optical anti-shake function, the lens is adjusted in position while the lens is switched, so that the determined lens position change process deviates from the actual change, and further, an excessive frame image obtained based on the position change process cannot enable a preview picture to be in smooth transition.
Disclosure of Invention
The present disclosure provides a preview screen display method and apparatus, an electronic device, and a storage medium, which can make a preview screen smoothly transited when a lens having an optical anti-shake function is switched.
According to a first aspect of the present disclosure, there is provided a preview screen generating method including:
under the condition of switching from a first lens to a second lens, determining the optical anti-shake offset of a target lens with an optical anti-shake function in the first lens and the second lens in the switching process;
performing offset correction on a pre-corrected image obtained by shooting through the target lens based on the optical anti-shake offset so as to eliminate the field angle offset of the pre-corrected image caused by the optical anti-shake function of the target lens and obtain a corrected image;
generating an excessive frame image in the switching process based on the corrected image, and generating a preview screen corresponding to the switching process based on the excessive frame image and the corrected image.
According to a second aspect of the present disclosure, there is provided a preview screen generating apparatus including:
the optical anti-shake device comprises a determining unit, a judging unit and a judging unit, wherein the determining unit is used for determining the optical anti-shake offset of a target lens with an optical anti-shake function in a switching process when a first lens is switched to a second lens;
the correcting unit is used for carrying out offset correction on a pre-correction image shot by the target lens based on the optical anti-shake offset so as to eliminate the field angle offset of the pre-correction image caused by the optical anti-shake function of the target lens and obtain a corrected image;
a generation unit that generates an excessive frame image in the switching process based on the corrected image, and generates a preview screen corresponding to the switching process based on the excessive frame image and the corrected image.
According to a third aspect of the present disclosure, there is provided an electronic device comprising:
a processor;
a memory for storing processor-executable instructions;
wherein the processor implements the method of the first aspect by executing the executable instructions.
According to a fourth aspect of the present disclosure, there is provided a computer readable storage medium having stored thereon computer instructions which, when executed by a processor, implement the steps of the method according to the first aspect.
In the technical scheme of the disclosure, under the condition that the first lens is switched to the second lens, the optical anti-shake offset of a target lens with an optical anti-shake function in the first lens and the second lens is obtained, and an image obtained by shooting through the target lens is subjected to offset correction based on the obtained optical anti-shake offset, so that the field angle offset of the target lens due to the optical anti-shake function is eliminated, and a corrected image is obtained. On the basis of the corrected image, an excessive frame image corresponding to the switching process is generated, and a corresponding preview screen is generated based on the excessive frame image.
It should be understood that the optical anti-shake function of the lens can effectively avoid the image shake caused by the shake of the device without switching the lens. However, in the process of switching the lens, the optical anti-shake function may mistake lens movement caused by lens switching as device shake, and then adjust the position of the lens. It is understood that, if there is no optical anti-shake adjustment, the positions of the main optical axes of the two lenses are consistent before and after the lenses are switched, and no deviation of the field angle occurs; when the lens has an optical anti-shake function, the optical anti-shake adjusts the position of the lens, inevitably resulting in the position of the main optical axes of the two lenses being inconsistent, and further resulting in the deviation of the field angle. As can be seen, in this scene, if the influence of the optical anti-shake on the captured image is not considered, and the images captured by the two lenses are necessarily shifted from each other by a certain viewing angle, the viewing angle is shifted due to the excessive frame image generated based on at least one of the two images, and finally the generated preview image is shaken.
In the technical solution of the present disclosure, the optical anti-shake offset of the target lens with the optical anti-shake function is preferentially determined, and the captured image is subjected to offset correction based on the optical anti-shake offset, so as to eliminate the field angle offset of the target lens caused by the optical anti-shake function in the captured image, and obtain a corrected image. And generating an excessive frame image based on the corrected image. In other words, according to the technical scheme, the influence of optical anti-shake on the image can be eliminated in a post-processing mode, and the problem that the field angle of the image obtained by shooting through the two lenses is shifted due to the adjustment of the optical anti-shake is avoided. Obviously, because the image obtained by shooting the target lens has no field angle offset, the excessive frame image generated based on the target lens has no field angle offset compared with the two images, so that the situation that a preview picture generated based on the two images and the excessive frame image does not generate picture jitter finally is avoided, and smooth transition in the lens switching process is realized.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and together with the description, serve to explain the principles of the disclosure.
FIG. 1A is a schematic view of a shot cut shown in an exemplary embodiment of the present disclosure;
FIG. 1B is another shot cut schematic diagram shown in an exemplary embodiment of the present disclosure;
FIG. 2 is a flowchart illustrating a preview screen presentation method according to an exemplary embodiment of the present disclosure;
fig. 3 is a flowchart illustrating another preview screen presentation method according to an exemplary embodiment of the present disclosure;
FIG. 4 is a block diagram of a preview screen presentation apparatus shown in an exemplary embodiment of the present disclosure;
fig. 5 is a schematic structural diagram of an electronic device in an exemplary embodiment of the present disclosure.
Detailed Description
Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the exemplary embodiments below do not represent all implementations consistent with the present disclosure. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present disclosure, as detailed in the appended claims.
The terminology used in the present disclosure is for the purpose of describing particular embodiments only and is not intended to be limiting of the disclosure. As used in this disclosure and the appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It should also be understood that the term "and/or" as used herein refers to and encompasses any and all possible combinations of one or more of the associated listed items.
It is to be understood that although the terms first, second, third, etc. may be used herein to describe various information, such information should not be limited to these terms. These terms are only used to distinguish one type of information from another. For example, first information may also be referred to as second information, and similarly, second information may also be referred to as first information, without departing from the scope of the present disclosure. The word "if" as used herein may be interpreted as "at … …" or "when … …" or "in response to a determination", depending on the context.
In the process of image acquisition, if the used lens is switched, the electronic device is easy to cause the jump of a preview picture, and the visual experience of a user is influenced.
In order to solve the above problem, the related art proposes a method capable of smoothly transiting a preview screen in a shot change scene. According to the method, according to the displacement change in the lens switching process, image processing is carried out on the collected image so as to obtain a transition frame image; the picture content in the transition frame image is approximately consistent with the first image captured by the first lens and the second image captured by the second lens, but the field angle size (or zoom factor) is between the two. Therefore, when the preview screen is displayed, the transition frame image can be used as a transition image of the first image and the second image, so that the preview screen is excessively smooth.
However, most lenses in the future have an optical anti-shake function, and the position of the lens can be automatically adjusted according to the shake of the device under the condition that the used lens is kept unchanged, so that the picture shake caused by the shake of the device in the image shooting process is avoided.
When the method is applied to a lens having an optical anti-shake function, if the lens is switched, the optical anti-shake function (which actually detects whether the lens is displaced, and if so, it is assumed that the device is shaken, and the lens is adjusted in the reverse direction) may mistakenly switch the lens as shaking of the device, and thus, the position of the lens is automatically adjusted. In other words, the lens is switched and the position of the lens is adjusted by the optical anti-shake apparatus. Specifically, the adjustment of the optical anti-shake function to the lens position may cause the positions of the main optical axes of the two lenses to be inconsistent before and after the lens is switched, so that the angle of view between the two captured images also deviates. In addition, the generated excessive frame image also has a viewing angle offset from the two images, which eventually causes a problem of screen blurring in a preview screen generated based on the image captured by the two-lens and the excessive frame image.
To illustrate the cause of picture judder:
if neither of the two lenses before and after the lens switching has the optical anti-shake function, the situation before and after the lens switching is as shown in fig. 1A. The area between the solid lines Y and Y 'in fig. 1A is a shooting channel of the electronic device, before the lens is switched, the electronic device collects an image through the combination of the first image sensor 1 and the lens 1', and at this time, the main optical axis of the lens 1 is X; after the lens is switched, the electronic device acquires an image through the combination of the second image sensor 2 and the lens 2', and at this time, the main optical axis of the lens 2 is still X. Therefore, when the two lenses do not have the optical anti-shake function, the main optical axes of the two lenses are consistent when the images are shot.
If the first lens before lens switching has an optical anti-shake function and the second lens after lens switching does not have the optical anti-shake function, the situation before and after lens switching is as shown in fig. 1B. Similar to fig. 1A, the area between the solid lines Y and Y 'in fig. 1B is also a shooting channel of the electronic device, before the lens is switched, the electronic device acquires an image through the combination of the first image sensor 1 and the lens 1', at this time, the optical anti-shake function mistakes the operation of switching the lens as a device shake, and therefore, the position of the lens 1 'is adjusted, so that the main optical axis of the lens is deviated, and the main optical axis of the lens is X' when the first image is shot; after the lens is switched, the electronic device collects an image through the combination of the second image sensor 2 and the lens 2', and at this time, the main optical axis of the lens 2 is still X. Obviously, when the lenses have an optical anti-shake function, the main optical axes of the two lenses are not the same when the images are captured, which inevitably causes a shift in the field angle. Accordingly, the excessive frame image generated based on the above-mentioned image may have a view angle offset from the two captured images, and a picture may be blurred in the generated preview picture.
As can be seen, the preview screen generation method in the related art is only suitable for switching between lenses without an optical anti-shake function. If any one of the two lenses before and after switching has an optical anti-shake function, the preview image cannot be smoothly transited.
Therefore, the present disclosure provides a preview method generation method to avoid a problem that a generated excessive frame image cannot make a preview picture in a shot switching process not smoothly excessive due to an application scene that a shot has an optical anti-shake function is not considered in the related art.
Fig. 2 illustrates a preview screen generating method according to an exemplary embodiment of the present disclosure. As shown in fig. 2, the method may include the steps of:
From the above analysis, when the lens has an optical anti-shake function, the optical anti-shake function can automatically adjust the position of the lens. However, in the related art, the influence of the "position adjustment of the lens by the optical anti-shake function" on the captured image is not considered, so that a field angle shift exists between the generated excessive frame image and the image captured by the two lenses, and further, the problem of image shake occurs after the excessive frame image is added to the preview image in the related art.
In view of the above, in the present disclosure, when the lenses are switched and one or two of the two lenses before and after the switching have the optical anti-shake function, an offset amount of the optical anti-shake function with respect to the lenses is preferentially determined, and an image captured through the lenses is offset-corrected based on the offset amount, so as to eliminate an influence of the optical anti-shake function on the captured image. On the basis, an excessive frame image is generated based on the corrected image, and a preview image is further generated according to the corrected image and the excessive frame image. It should be understood that the present disclosure eliminates the influence of the optical anti-shake function on the image, so that there is no field angle offset between the images respectively obtained by the two lenses, and accordingly, there is no field angle offset between the transition frame image obtained based on the above and the images respectively obtained by the two lenses, thereby avoiding the phenomenon of picture shake of the finally obtained preview picture caused by the fact that the optical anti-shake function is not considered in the related art.
And 204, performing offset correction on the pre-correction image obtained by shooting through the target lens based on the optical anti-shake offset amount so as to eliminate the field angle offset of the pre-correction image caused by the optical anti-shake function of the target lens, and thus obtaining a corrected image.
In the present disclosure, a lens having an optical anti-shake function of two lenses involved in a lens switching process is referred to as a target lens; the lens displacement caused by the optical anti-shake function adjusting the lens position during the lens switching process is called the optical anti-shake offset. In actual operation, the optical anti-shake offset can be determined by monitoring the adjustment operation of the optical anti-shake device on the lens; the attitude change information and the position change information of the electronic equipment can be monitored through sensors such as a gyroscope and the like, and the optical anti-shake device is reversely pushed to adjust the lens according to an optical anti-shake mechanism to generate a position offset. Of course, the above examples are only schematic, and it should be understood that, the present disclosure may be applied only in a manner of detecting the optical anti-shake offset, and how to determine the optical anti-shake offset may be determined by those skilled in the art according to actual needs, which is not limited by the present disclosure.
It should be understood that the optical anti-shake phenomenon, which causes the angle of view to shift in the image captured by the target lens, is essentially caused by the shift of the main optical axis of the target lens after the position of the target lens is adjusted (i.e. the target lens is shifted in the plane where the target lens is located; or the target lens is shifted in the plane perpendicular to the main optical axis), and the specific principle can refer to the above description of fig. 1A and 1B.
In the present disclosure, in order to avoid a situation that the optical anti-shake function causes a viewing angle shift in an image captured through a target lens, when the lens is switched, the actually determined optical anti-shake shift amount may be: a first optical anti-shake offset of the target lens on a plane where the target lens is located; and offset-correcting a pre-correction image captured through the target lens based on the first optical anti-shake offset amount. In practical operation, a pixel shift amount corresponding to the image before correction may be determined according to the first optical anti-shake shift amount, and the image before correction may be subjected to pixel shift according to the pixel shift amount. It should be noted that the actually determined first optical anti-shake offset amount includes an offset direction, and accordingly, the pixel offset amount determined according to the actually determined first optical anti-shake offset amount also includes an offset direction. How to define the direction can be determined by those skilled in the art according to actual needs, which is not limited by the present disclosure, and only the principle of "determining the pixel shift amount, and enabling the corrected image obtained by the shift correction to eliminate the field angle shift of the image before the correction due to the optical anti-shake function" is required.
In the present disclosure, after obtaining the corrected image based on the optical anti-shake offset amount, the excessive frame image may be generated based on the corrected image in various ways.
In an embodiment, the corrected image may be obtained by performing scaling processing on the corrected image after the corrected image is obtained. In actual operation, the target magnification corresponding to the excessive frame image is usually related to "the distance offset between two lenses before and after lens switching". The distance offset value refers to: a distance between the first lens and the corresponding image sensor, and a distance between the second lens and the corresponding image sensor. From the imaging principle, the distance offset is the image distance change value before and after the lens switching. The distance offset is the difference between the distances M and N as described in connection with fig. 1A.
It should be understood that, for any lens assembled in an electronic device, the distance between the lens and the corresponding image sensor is usually set by a technician in a hardware design stage, and is one or more (possibly a lens group including a plurality of lenses) fixed values, without considering the position adjustment of the lens by the optical anti-shake. Therefore, the distance shift amount determined based on the distance between the two lenses and the image sensors thereof is also a fixed value. In practical application, the value can be recorded in a storage space so as to be read and used at any time; it is also possible to temporarily calculate this value when it is desired to use it, based on the distances between the two lenses and the respective sensors (i.e. the distances M and N described above).
In fact, the distance offset is related to the target magnification of the transition frame image because the distance offset is related to the first magnification of the image captured by the first lens and the second magnification of the image captured by the second lens, and the magnification of the transition frame image is related to the first magnification and the second magnification. For example, if the magnification of the image captured by the first lens is 1 and the magnification of the image captured by the second lens is 2, the preview screen can be made excessively smooth to the maximum extent when the magnification of the transition frame image is 1.5 times. It should be noted that although the example is described as "the preview screen can be smoothed to be transited when the target magnification of the transition frame image is the intermediate value between the first magnification and the second magnification", in practical applications, the preview screen can be smoothed to be transited when the intermediate value is not necessarily adopted, and specifically, how to adopt the target magnification of the transition frame image can be determined by a technician according to practical tests.
In this embodiment, the actual scaling process may be determined according to actual conditions, for example, in the case of only one target lens (i.e., only one lens having the optical anti-shake function before and after switching), the corrected image may be scaled based on the determined target magnification on the premise that the corrected image corresponding to the target lens is obtained, so as to obtain the over-frame image. Of course, since there is no offset of the angle of view between the corrected image and the image captured through another lens, it is also feasible to perform the scaling processing on the image captured through another lens, and the magnification adopted for the image is obviously different from the target magnification, and needs to be determined additionally. When both the lenses are the target lenses (that is, both the lenses before and after the switching have the optical anti-shake function), one of the corrected images corresponding to the two target lenses may be selected and the selected corrected image may be zoomed in or out when the corrected images are acquired.
In practical applications, the optical anti-shake function not only adjusts the target lens on the plane where the target lens is located, but also adjusts the target lens in the direction of the main optical axis of the target lens. Obviously, adjustment in this direction causes the above-described distance shift amount to vary, and thus also affects the magnification of the excessive frame image. Therefore, if the distance offset determined in the original hardware design is still adopted, the determined magnification of the excessive frame image is inevitably inaccurate.
Therefore, in this embodiment, a second optical anti-shake offset amount of the target lens in the direction of the main optical axis of the target lens may be further obtained, and the distance offset amount is corrected based on the second optical anti-shake offset amount, so as to determine a target magnification corresponding to the transition frame image based on the corrected distance offset amount. It should be understood that, in this case, it is equivalent to acquiring adjustment data of the optical anti-shake on the target lens in the direction of the main optical axis, and correcting the distance offset based on the adjustment data, so as to avoid the problem that the target magnification of the excessive frame image is determined inaccurately because the influence of the optical anti-shake on the distance offset is not considered.
In another embodiment, since the field angle offset of the pre-corrected image by the optical anti-shake function is eliminated after the offset correction is performed on the pre-corrected image captured through the target lens, if only one of the two lenses is the target lens, there is no field angle offset between the corrected image corresponding to the target lens and the image captured through the other lens, and therefore the corrected image and the pre-corrected image captured through the other lens can be image-synthesized to obtain the transition frame image; accordingly, if both the lenses are target lenses, there is no deviation of the field angle between the corrected images corresponding to the two target lenses, so that the corrected images corresponding to the two lenses can be synthesized to obtain the transition frame image. Obviously, there is no viewing angle shift between images for synthesizing the excessive frame images, and therefore, the synthesized excessive frame images also do not have viewing angle shifts. In practical operation, any synthesis algorithm may be used to synthesize the transition frame image, and only the magnification of the transition frame image is ensured to be between the two images, which is not limited by the present disclosure.
In the present embodiment, two images for synthesizing the transition frame image, which correspond to the first lens and the second lens, respectively, may be referred to as a first image to be fused corresponding to the first lens and a second image to be fused corresponding to the second lens, respectively. If an image directly captured through the lens is referred to as a pre-correction image and an image obtained through offset correction is referred to as an over-corrected image regardless of whether the lens has an optical anti-shake function, the first image to be fused is inevitably a pre-correction image or a post-correction image corresponding to the first lens, and the second image to be fused is inevitably a pre-correction image or a post-correction image corresponding to the second lens.
In the present disclosure, when the corrected image is acquired, and the transition frame image is acquired, a preview screen corresponding to the shot switching process may be generated based on the transition frame image and the corrected image.
In an embodiment, the first lens and the second lens have an optical anti-shake function, and then the first corrected image corresponding to the first lens, the transition frame image, and the second corrected image corresponding to the second lens may be sequentially displayed as a preview of the switching process.
In another embodiment, only one of the first lens and the second lens has an optical anti-shake function, and the corrected image corresponding to the one having the optical anti-shake function, the transition frame image, and the image captured by the other lens having no optical anti-shake function are sequentially presented in the order of lens switching as a preview screen of the switching process.
Specifically, in the case where only the first lens of the two lenses has the optical anti-shake function, the corrected image corresponding to the first lens, the transition frame image, and the image captured through the second lens may be sequentially displayed as a preview image of the lens switching process. And in the case that only the second lens of the two lenses has the optical anti-shake function, the image captured through the first lens, the transition frame image, and the corrected image corresponding to the second lens may be sequentially displayed as a preview image of the lens switching process.
It is to be noted that the present disclosure may re-execute the operation of generating the preview screen in the case where the shot cut is completed. In other words, after images captured by the two lenses are acquired, the captured images are processed to obtain an excessive frame image. The present disclosure may also start the operation of generating the preview screen already during the lens switching, for example, in the case where the first lens has an optical anti-shake function, the operation of switching the first lens to the second lens may be performed while offset-correcting a pre-correction image captured by the first lens. In other words, the lens switching operation and the image processing operation are performed in parallel. It should be understood that, since the process of generating the preview screen is in milliseconds, whether or not the process is executed in parallel with the shot-cut operation, the process can be completed without the user's feeling, and how to execute the process can be set by those skilled in the art according to actual needs.
In addition, the technical scheme of the disclosure can be applied to any type of mobile terminal, and only the mobile terminal is provided with at least two lenses and at least one lens has an optical anti-shake function. For example, the mobile terminal may be a smartphone, a tablet computer, or the like. The technical solution of the present disclosure is particularly applicable to any mobile terminal, and can be determined by those skilled in the art according to actual needs, which is not limited by the present disclosure.
According to the technical scheme, in the case that the first lens is switched to the second lens, the optical anti-shake offset of the target lens with the optical anti-shake function is obtained, and the image obtained by shooting through the target lens is subjected to offset correction based on the obtained optical anti-shake offset, so that the field angle offset of the target lens due to the optical anti-shake function is eliminated, and the corrected image is obtained. On the basis of the corrected image, an excessive frame image corresponding to the switching process is generated, and a corresponding preview screen is generated based on the excessive frame image.
It should be understood that the optical anti-shake function of the lens can effectively avoid the image shake caused by the shake of the device without switching the lens. However, in the process of switching the lens, the optical anti-shake function may mistake lens movement caused by lens switching as device shake, and then adjust the position of the lens. It is understood that, if there is no adjustment for optical anti-shake, the positions of the main optical axes of the two lenses are consistent before and after the lenses are switched, and no deviation of the field angle occurs; when the lenses have the optical anti-shake function, the optical anti-shake adjusts the positions of the lenses, inevitably resulting in the position inconsistency of the main optical axes of the two lenses, and further resulting in the deviation of the field angle. In this scenario, if the influence of the optical anti-shake on the captured image is not considered, and the images captured by the two lenses are necessarily shifted from each other by a certain viewing angle, the viewing angle is shifted due to an excessive frame image generated based on at least one of the images, and finally the generated preview image is shaken.
In the technical solution of the present disclosure, an optical anti-shake offset amount of a target lens with an optical anti-shake function is preferentially determined, and offset correction is performed on a captured image based on the optical anti-shake offset amount to eliminate a field angle offset caused by the optical anti-shake function on the target lens in the captured image, obtain a corrected image, and generate a transition frame image based on the corrected image. In other words, according to the technical scheme, the influence of optical anti-shake on the image can be eliminated in a post-processing mode, and the problem that the field angle of the image obtained by shooting through the two lenses is shifted due to the adjustment of the optical anti-shake is avoided. Obviously, because the image obtained by shooting the target lens has no field angle offset, the excessive frame image generated based on the target lens has no field angle offset compared with the two images, so that the situation that a preview picture generated based on the two images and the excessive frame image does not generate picture jitter finally is avoided, and smooth transition in the lens switching process is realized.
Further, if the corrected image is scaled, the excessive frame image is obtained. The determined target magnification corresponding to the excessive frame image will directly affect the smoothness of the preview picture. For example, when the magnification of the transition frame image is similar to that of the image captured through the first lens but is far from that of the image captured through the second lens, the transition effect of the frame jump will inevitably occur when the transition frame image jumps to the image corresponding to the second lens. In the process of switching the lens, the target magnification is related to the distance offset, and the optical anti-shake function of the lens affects the distance offset. In view of this, the present disclosure is further based on determining a second optical anti-shake offset that affects the distance offset, and determining a target magnification for generating the excessive frame image after correcting the distance offset, so as to avoid the problem that the generated excessive frame image cannot make the preview screen smoothly excessive due to inaccurate determination of the target magnification.
Next, taking an example that a main lens of the smart phone before lens switching has an optical anti-shake function, and a wide-angle lens after lens switching does not have the optical anti-shake function, a technical solution of the present disclosure is introduced.
Fig. 3 illustrates another preview screen generating method according to an exemplary embodiment of the present disclosure. As shown in fig. 3, the method may include the steps of:
In this embodiment, a camera APP is usually pre-assembled on the smartphone to meet the shooting requirements of the user. In actual operation, the user can start the camera APP by triggering the APP icon corresponding to the camera APP on the desktop of the mobile phone.
In this embodiment, after the camera APP is started, an image can be acquired through a currently used lens and an image sensor corresponding to the currently used lens, and the image can be displayed as a preview image.
In practical applications, a smart phone is usually equipped with a plurality of lenses, wherein the smart phone includes a main lens, and the main lens can meet the shooting requirements of users in most scenes. When the camera APP is started, image acquisition is usually performed through the lens by default. Therefore, after the camera APP is started, image acquisition can be carried out through the main lens, and the acquired image is displayed as a preview picture.
And 303, switching the main lens to the wide-angle lens when detecting the triggering operation of the user for the lens switching control.
In this embodiment, after the camera APP is started, a corresponding display interface may be displayed. The lens switching control for switching the lens can be further displayed in the display interface, so that when a user needs to switch the lens to meet different shooting requirements, the lens currently used by the mobile phone is switched by triggering the lens switching control.
In the present embodiment, switching to the wide-angle lens is taken as an example, and therefore, the lens switching control may correspond to switching between the "main lens" and the wide-angle lens ".
And 304, acquiring the optical anti-shake offset corresponding to the main lens in the process of switching from the main lens to the wide-angle lens.
In the present embodiment, only the main lens has an optical anti-shake function. When the mobile phone is produced, the main lens can be configured with a corresponding optical anti-shake device, so that the main lens has an optical anti-shake function.
When the mobile phone switches the lens based on the triggering operation of the user for the lens switching control. Since the main lens has an optical anti-shake function, it is necessary to determine an optical anti-shake offset of the main lens due to the optical anti-shake function, so as to perform offset correction on a pre-correction image captured through the main lens.
In step 305, a pixel shift amount corresponding to an image captured by the main lens is determined based on the acquired optical anti-shake shift amount.
In this embodiment, the optical anti-shake offset refers to a displacement caused by the optical anti-shake apparatus adjusting the main lens. The displacement amount causing the deviation of the field angle in the pre-correction image obtained by shooting is as follows: displacement on the plane of the main lens. In actual operation, in order to cancel out the viewing angle shift in the screen due to the amount of displacement, the direction of the pixel shift amount determined based on the optical anti-shake shift amount is generally opposite to the direction of the optical anti-shake shift amount. For example, in the case of the optical anti-shake offset amount: +1mm, which means that when the optical anti-shake apparatus adjusts the main lens to make the main lens shift 1mm upwards, the determined pixel shift amount may be-1 mm, so that the pixels in the image before correction all shift 1mm downwards. Of course, this example is only an example of "when the main lens is shifted upward by 1mm, the pixels in the image are shifted downward by 1mm to exactly offset the viewing angle shift caused by the lens shift", and in practical applications, the pixels in the image need to be shifted to which direction more or less to offset the viewing angle shift caused by the lens shift.
And step 306, performing pixel offset on the image shot through the main lens according to the pixel offset to obtain a corrected image.
In this embodiment, since only the main lens has an optical anti-shake function, it is only necessary to perform offset correction on a pre-correction image captured by the main lens. It is understood that there is no deviation in the angle of view between the corrected image obtained by correction and the image captured through the wide-angle lens after switching.
In the present embodiment, the transition frame image is generated by scaling the corrected image, and the specific generation manner has been explained in the above embodiment, and the description is not repeated in the present embodiment.
And 308, carrying out scaling processing on the corrected image according to the magnification to generate a transition frame image.
It should be noted that this embodiment is merely an example of "the step of generating the excessive frame image is performed directly after the image before the correction is acquired", and in actual operation, this step may be performed in synchronization with a series of steps of generating the excessive frame image, or may be performed before the excessive frame image is generated, which is not limited by this embodiment.
And 310, sequentially displaying the corrected image, the transition frame image and the image shot by the wide-angle lens to be used as a preview image corresponding to the lens switching process.
According to the technical scheme, when the main lens with the optical anti-shake function is switched to the wide-angle lens without the optical anti-shake function, the displacement of the main lens caused by the optical anti-shake function can be determined, and the pixel offset is carried out on the image shot by the main lens based on the displacement, so that the field angle offset caused by the optical anti-shake function to the image in the lens switching process can be offset. On the basis, the excessive frame image is generated based on the corrected image obtained through pixel shift, and the condition that the image shakes in the finally obtained preview image is avoided.
Fig. 4 is a block diagram of a preview screen generating apparatus shown in an exemplary embodiment of the present disclosure. Referring to fig. 4, the apparatus includes a determination unit 401, a correction unit 402, and a generation unit 403.
A determination unit 401, configured to determine, when a first lens is switched to a second lens, an optical anti-shake offset of a target lens having an optical anti-shake function in the first lens and the second lens during switching;
a correction unit 402 configured to perform offset correction on a pre-correction image captured by the target lens based on the optical anti-shake offset amount to eliminate a field angle offset of the pre-correction image due to an optical anti-shake function of the target lens, so as to obtain a corrected image;
a generating unit 403 that generates an excessive frame image in the switching process based on the corrected image, and generates a preview screen corresponding to the switching process based on the excessive frame image and the corrected image.
Alternatively to this, the first and second parts may,
the determination unit 401 is further adapted to: determining a first optical anti-shake offset of the target lens on a plane where the target lens is located;
the correction unit 402 is further configured to: and determining a pixel offset corresponding to the image before correction based on the first optical anti-shake offset, and performing pixel offset on the image before correction according to the pixel offset.
Optionally, the generating unit 403 is further configured to:
obtaining the distance offset in the switching process; the distance offset is a difference value between a distance between the first lens and the corresponding image sensor and a distance between the second lens and the corresponding image sensor;
and determining a target magnification factor corresponding to the corrected image based on the distance offset, and carrying out zooming processing on the corrected image according to the target magnification factor to obtain the transition frame image.
In the alternative,
the determination unit 401 is further adapted to: determining a second optical anti-shake offset of the target lens in a main optical axis direction of the target lens;
the generating unit 403 is further configured to: and correcting the distance offset based on the second optical anti-shake offset, and determining a target magnification based on the corrected distance offset.
Optionally, the generating unit 403 is further configured to:
synthesizing a first image to be fused corresponding to the first lens and a second image to be fused corresponding to the second lens into a transition frame image;
the first image to be fused is a pre-corrected image or a post-corrected image corresponding to the first lens; the second lens to be fused is a pre-corrected image or a post-corrected image corresponding to the second lens; when any lens does not have the optical anti-shake function, the image before correction corresponding to the any lens is the image obtained by shooting through the any lens.
Optionally, the generating unit 403 is further configured to:
under the condition that the first lens and the second lens both have optical anti-shake functions, sequentially displaying a first corrected image corresponding to the first lens, the transition frame image and a second corrected image corresponding to the second lens as a preview picture of the switching process;
when only one of the first lens and the second lens has the optical anti-shake function, the corrected image corresponding to the one lens having the optical anti-shake function, the transition frame image, and an image captured by the other lens having no optical anti-shake function are sequentially displayed in order of lens switching as a preview screen of the switching process.
For the device embodiments, since they substantially correspond to the method embodiments, reference may be made to the partial description of the method embodiments for relevant points. The above-described embodiments of the apparatus are merely illustrative, and the units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules can be selected according to actual needs to achieve the purpose of the scheme of the disclosure. One of ordinary skill in the art can understand and implement it without inventive effort.
Correspondingly, the present disclosure also provides a preview screen generating apparatus, including: a processor; a memory for storing processor-executable instructions; wherein the processor is configured to implement the preview screen generating method as in any one of the above embodiments, for example, the method may include: under the condition of switching from a first lens to a second lens, determining the optical anti-shake offset of a target lens with an optical anti-shake function in the first lens and the second lens in the switching process; performing offset correction on a pre-corrected image obtained by shooting through the target lens based on the optical anti-shake offset so as to eliminate the field angle offset of the pre-corrected image caused by the optical anti-shake function of the target lens and obtain a corrected image; generating an excessive frame image in the switching process based on the corrected image, and generating a preview screen corresponding to the switching process based on the excessive frame image and the corrected image.
Accordingly, the present disclosure also provides an electronic device, which includes a memory, and one or more programs, where the one or more programs are stored in the memory, and configured to be executed by one or more processors, where the one or more programs include instructions for implementing the preview screen generating method as described in any of the above embodiments, such as the method may include: under the condition of switching from a first lens to a second lens, determining the optical anti-shake offset of a target lens with an optical anti-shake function in the first lens and the second lens in the switching process; performing offset correction on a pre-corrected image obtained by shooting through the target lens based on the optical anti-shake offset so as to eliminate the field angle offset of the pre-corrected image caused by the optical anti-shake function of the target lens and obtain a corrected image; generating an excessive frame image in the switching process based on the corrected image, and generating a preview screen corresponding to the switching process based on the excessive frame image and the corrected image.
Fig. 5 is a block diagram illustrating an apparatus 500 for implementing a preview screen generating method according to an exemplary embodiment. For example, the apparatus 500 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, an exercise device, a personal digital assistant, and the like.
Referring to fig. 5, the apparatus 500 may include one or more of the following components: processing component 502, memory 504, power component 506, multimedia component 508, audio component 510, input/output (I/O) interface 512, sensor component 514, and communication component 516.
The processing component 502 generally controls overall operation of the device 500, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. The processing components 502 may include one or more processors 520 to execute instructions to perform all or a portion of the steps of the methods described above. Further, the processing component 502 can include one or more modules that facilitate interaction between the processing component 502 and other components. For example, the processing component 502 can include a multimedia module to facilitate interaction between the multimedia component 508 and the processing component 502.
The memory 504 is configured to store various types of data to support operations at the apparatus 500. Examples of such data include instructions for any application or method operating on device 500, contact data, phonebook data, messages, pictures, videos, and so forth. The memory 504 may be implemented by any type or combination of volatile or non-volatile memory devices such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disks.
The power supply component 506 provides power to the various components of the device 500. The power components 506 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the apparatus 500.
The multimedia component 508 includes a screen that provides an output interface between the device 500 and the user. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive an input signal from a user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 508 includes a front lens and/or a rear lens. The front lens and/or the rear lens may receive external multimedia data when the device 500 is in an operating mode, such as a photographing mode or a video mode. Each of the front lens and the rear lens may be a fixed optical lens system or have a focal length and optical zoom capability.
The audio component 510 is configured to output and/or input audio signals. For example, audio component 510 includes a Microphone (MIC) configured to receive external audio signals when apparatus 500 is in operating modes, such as call mode, record mode, and voice recognition mode. The received audio signals may further be stored in the memory 504 or transmitted via the communication component 516. In some embodiments, audio component 510 further includes a speaker for outputting audio signals.
The I/O interface 512 provides an interface between the processing component 502 and peripheral interface modules, which may be keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to: a home button, a volume button, a start button, and a lock button.
The sensor component 514 includes one or more sensors for providing various aspects of state assessment for the apparatus 500. For example, the sensor assembly 514 may detect an open/closed state of the apparatus 500, the relative positioning of the components, such as a display and keypad of the apparatus 500, the sensor assembly 514 may also detect a change in the position of the apparatus 500 or a component of the apparatus 500, the presence or absence of user contact with the apparatus 500, orientation or acceleration/deceleration of the apparatus 500, and a change in the temperature of the apparatus 500. The sensor assembly 514 may include a proximity sensor configured to detect the presence of a nearby object without any physical contact. The sensor assembly 514 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 514 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.
The communication component 516 is configured to facilitate communication between the apparatus 500 and other devices in a wired or wireless manner. The apparatus 500 may access a wireless network based on a communication standard, such as WiFi, 2G or 3G, 4G LTE, 5G NR (New Radio), or a combination thereof. In an exemplary embodiment, the communication component 516 receives a broadcast signal or broadcast related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 516 further includes a Near Field Communication (NFC) module to facilitate short-range communications. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, Ultra Wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.
In an exemplary embodiment, the apparatus 500 may be implemented by one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), controllers, micro-controllers, microprocessors, or other electronic components for performing the above-described methods.
In an exemplary embodiment, a non-transitory computer-readable storage medium comprising instructions, such as the memory 504 comprising instructions, executable by the processor 520 of the apparatus 500 to perform the above-described method is also provided. For example, the non-transitory computer readable storage medium may be a ROM, a Random Access Memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.
Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This disclosure is intended to cover any variations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.
It will be understood that the present disclosure is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.
The above description is only exemplary of the present disclosure and should not be taken as limiting the disclosure, as any modification, equivalent replacement, or improvement made within the spirit and principle of the present disclosure should be included in the scope of the present disclosure.
Claims (10)
1. A preview screen generating method includes:
under the condition of switching from a first lens to a second lens, determining the optical anti-shake offset of a target lens with an optical anti-shake function in the first lens and the second lens in the switching process;
performing offset correction on a pre-corrected image obtained by shooting through the target lens based on the optical anti-shake offset so as to eliminate the field angle offset of the pre-corrected image caused by the optical anti-shake function of the target lens and obtain a corrected image;
generating an excessive frame image in the switching process based on the corrected image, and generating a preview screen corresponding to the switching process based on the excessive frame image and the corrected image.
2. The method of claim 1,
the determining of the optical anti-shake offset of the target lens includes: determining a first optical anti-shake offset of the target lens on a plane where the target lens is located;
the offset correction of the image captured through the target lens based on the optical anti-shake offset amount includes: and determining a pixel offset corresponding to the image before correction based on the first optical anti-shake offset, and performing pixel offset on the image before correction according to the pixel offset.
3. The method of claim 1, wherein generating the transition frame image in the switching process based on the corrected image comprises:
obtaining the distance offset in the switching process; the distance offset is a difference value between a distance between the first lens and the corresponding image sensor and a distance between the second lens and the corresponding image sensor;
and determining a target magnification factor corresponding to the corrected image based on the distance offset, and carrying out scaling processing on the corrected image according to the target magnification factor to obtain the transition frame image.
4. The method of claim 3,
the determining of the optical anti-shake offset of the target lens includes: determining a second optical anti-shake offset of the target lens in a main optical axis direction of the target lens;
the determining a target magnification corresponding to the corrected image based on the distance offset includes: and correcting the distance offset based on the second optical anti-shake offset, and determining a target magnification based on the corrected distance offset.
5. The method of claim 1, wherein generating the transition frame image in the switching process based on the corrected image comprises:
synthesizing a first image to be fused corresponding to the first lens and a second image to be fused corresponding to the second lens into a transition frame image;
the first image to be fused is a pre-corrected image or a post-corrected image corresponding to the first lens, the second lens to be fused is a pre-corrected image or a post-corrected image corresponding to the second lens, and at least one of the first image to be fused and the second image to be fused is a post-corrected image corresponding to the corresponding lens; when any lens does not have the optical anti-shake function, the image before correction corresponding to the any lens is the image obtained by shooting through the any lens.
6. The method according to claim 1, wherein the generating a preview screen corresponding to the switching process based on the transition frame image and the corrected image comprises:
under the condition that the first lens and the second lens both have optical anti-shake functions, sequentially displaying a first corrected image corresponding to the first lens, the transition frame image and a second corrected image corresponding to the second lens as a preview picture of the switching process;
when only one of the first lens and the second lens has the optical anti-shake function, the corrected image corresponding to the one lens having the optical anti-shake function, the transition frame image, and an image captured by the other lens having no optical anti-shake function are sequentially displayed in order of lens switching as a preview screen of the switching process.
7. A preview screen generating apparatus, comprising:
the optical anti-shake device comprises a determining unit, a judging unit and a judging unit, wherein the determining unit is used for determining the optical anti-shake offset of a target lens with an optical anti-shake function in a switching process when a first lens is switched to a second lens;
the correcting unit is used for carrying out offset correction on a pre-correction image shot by the target lens based on the optical anti-shake offset so as to eliminate the field angle offset of the pre-correction image caused by the optical anti-shake function of the target lens and obtain a corrected image;
a generation unit that generates an excessive frame image in the switching process based on the corrected image, and generates a preview screen corresponding to the switching process based on the excessive frame image and the corrected image.
8. The apparatus of claim 7,
the determination unit is further configured to: determining a first optical anti-shake offset of the target lens on a plane where the target lens is located;
the correction unit is further configured to: and determining a pixel offset corresponding to the image before correction based on the first optical anti-shake offset, and performing pixel offset on the image before correction according to the pixel offset.
9. An electronic device, comprising:
a processor;
a memory for storing processor-executable instructions;
wherein the processor implements the method of any one of claims 1-6 by executing the executable instructions.
10. A computer-readable storage medium having stored thereon computer instructions, which, when executed by a processor, carry out the steps of the method according to any one of claims 1-6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110322170.1A CN115134505A (en) | 2021-03-25 | 2021-03-25 | Preview picture generation method and device, electronic equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110322170.1A CN115134505A (en) | 2021-03-25 | 2021-03-25 | Preview picture generation method and device, electronic equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115134505A true CN115134505A (en) | 2022-09-30 |
Family
ID=83374581
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110322170.1A Pending CN115134505A (en) | 2021-03-25 | 2021-03-25 | Preview picture generation method and device, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115134505A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115514895A (en) * | 2022-10-18 | 2022-12-23 | Oppo广东移动通信有限公司 | Image anti-shake method, device, electronic equipment and computer-readable storage medium |
-
2021
- 2021-03-25 CN CN202110322170.1A patent/CN115134505A/en active Pending
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115514895A (en) * | 2022-10-18 | 2022-12-23 | Oppo广东移动通信有限公司 | Image anti-shake method, device, electronic equipment and computer-readable storage medium |
| CN115514895B (en) * | 2022-10-18 | 2024-04-12 | Oppo广东移动通信有限公司 | Image anti-shake method, apparatus, electronic device, and computer-readable storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110493526B (en) | Image processing method, device, equipment and medium based on multiple camera modules | |
| KR101793183B1 (en) | Method, device, program and recording medium for setting shooting parameter | |
| CN106210496B (en) | Photo shooting method and device | |
| CN107888984B (en) | Short video playing method and device | |
| CN110769147B (en) | Shooting method and electronic equipment | |
| CN110858873B (en) | Electronic device and photographing method | |
| EP3945494A1 (en) | Video processing method, apparatus and storage medium | |
| CN111314617A (en) | Video data processing method and device, electronic equipment and storage medium | |
| CN111614910B (en) | File generation method and device, electronic equipment and storage medium | |
| CN110620871A (en) | Video shooting method and electronic equipment | |
| CN115134505A (en) | Preview picture generation method and device, electronic equipment and storage medium | |
| CN112235509B (en) | Focal length adjusting method and device, mobile terminal and storage medium | |
| CN112087570B (en) | Image shooting method and device, electronic equipment and readable storage medium | |
| CN114339022A (en) | Camera shooting parameter determining method and neural network model training method | |
| CN115134516A (en) | Shooting method and device | |
| CN114339357A (en) | Image acquisition method, image acquisition device and storage medium | |
| CN113973172A (en) | Shooting method, shooting device, storage medium and electronic equipment | |
| CN114422687A (en) | Preview image switching method and device, electronic equipment and storage medium | |
| CN114500821A (en) | Photographing method and device, terminal and storage medium | |
| CN113315903A (en) | Image acquisition method and device, electronic equipment and storage medium | |
| CN111343375A (en) | Image signal processing method and device, electronic device and storage medium | |
| CN112188095B (en) | Photographing method, photographing device and storage medium | |
| CN114339015B (en) | Photographing processing method, photographing processing device and storage medium | |
| CN114339018B (en) | Method and device for switching lenses and storage medium | |
| CN116419069A (en) | Image preview method, device, terminal equipment and readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |