CN111970438A

CN111970438A - Zoom processing method and device, equipment and storage medium

Info

Publication number: CN111970438A
Application number: CN202010769013.0A
Authority: CN
Inventors: 赵明辉
Original assignee: Guangdong Oppo Mobile Telecommunications Corp Ltd
Current assignee: Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date: 2020-08-03
Filing date: 2020-08-03
Publication date: 2020-11-20
Anticipated expiration: 2040-08-03
Also published as: CN111970438B

Abstract

The embodiment of the application discloses a zoom processing method, a device, equipment and a storage medium, wherein the method comprises the following steps: determining a target zooming magnification interval according to a received zooming operation command; determining M cameras corresponding to the target zooming magnification interval, wherein M is a natural number greater than or equal to 1; each camera is used for shooting images in a specific zooming magnification interval, and different cameras correspond to different zooming magnification intervals; determining an output image of each camera in the zooming process; and displaying images satisfying conditions in the output images in a time sequence in response to the zoom operation command.

Description

Zoom processing method and device, equipment and storage medium

Technical Field

The embodiment of the application relates to electronic technology, and relates to, but is not limited to, a zoom processing method, a zoom processing device, equipment and a storage medium.

Background

At present, the market of mobile terminals such as smart phones and tablet computers is huge, and the mobile terminals are developed in a leap manner in performance and appearance, and can be compared with professional cameras in the aspect of shooting and shooting.

The image zooming is an important link in the aspect of photography and shooting, and in order to meet the focal length requirements of various use occasions, the existing mobile terminal usually uses a plurality of cameras to realize zooming. However, due to hardware differences of sensors in different cameras and defects of an existing focus switching process, jump or pause of an image generally occurs in the process of zooming.

Disclosure of Invention

In view of this, embodiments of the present application provide a zoom processing method and apparatus, a device, and a storage medium.

The technical scheme of the embodiment of the application is realized as follows:

in a first aspect, an embodiment of the present application provides a zoom processing method, where the method includes:

determining a target zooming magnification interval according to a received zooming operation command;

determining M cameras corresponding to the target zooming magnification interval, wherein M is a natural number greater than or equal to 1; each camera is used for shooting images in a specific zooming magnification interval, and different cameras correspond to different zooming magnification intervals;

determining an output image of each camera in the zooming process;

and displaying images satisfying conditions in the output images in a time sequence in response to the zoom operation command.

In a second aspect, an embodiment of the present application provides a zoom processing apparatus, including:

the first determining unit is used for determining a target zooming magnification interval according to the received zooming operation command;

the second determining unit is used for determining M cameras corresponding to the target zooming magnification interval, wherein M is a natural number which is greater than or equal to 1; each camera is used for shooting images in a specific zooming magnification interval, and different cameras correspond to different zooming magnification intervals;

a third determining unit, configured to determine an output image of each camera in the zooming process;

a display unit configured to display, in response to the zoom operation command, images satisfying a condition in the output images in chronological order.

In a third aspect, an embodiment of the present application provides an electronic device, which includes a memory and a processor, where the memory stores a computer program that is executable on the processor, and the processor implements the steps in the zoom processing method when executing the program.

In a fourth aspect, the present application provides a computer-readable storage medium, on which a computer program is stored, and the computer program, when executed by a processor, implements the steps in the zoom processing method described above.

The embodiment of the application provides a zoom processing method, a zoom processing device, equipment and a storage medium, wherein a target zoom magnification interval is determined according to a received zoom operation command; determining M cameras corresponding to the target zooming magnification interval, wherein M is a natural number greater than or equal to 1; each camera is used for shooting images in a specific zooming magnification interval, and different cameras correspond to different zooming magnification intervals; determining an output image of each camera in the zooming process; and responding to the zoom operation command, and displaying the images meeting the conditions in the output images according to the time sequence, so that the effects of image jump and image pause in the zoom switching process can be avoided.

Drawings

FIG. 1A is a first schematic diagram illustrating a point switch process in the related art;

FIG. 1B is a schematic diagram illustrating a point switch process in the related art;

fig. 2 is a first schematic flow chart illustrating an implementation of a zoom processing method according to an embodiment of the present application;

fig. 3 is a schematic flow chart illustrating an implementation of a zoom processing method according to an embodiment of the present application;

fig. 4 is a schematic flow chart illustrating a third implementation of the zoom processing method according to the embodiment of the present application;

fig. 5 is a schematic flow chart of an implementation of the zoom processing method according to the embodiment of the present application;

FIG. 6 is a schematic diagram of a 2x point-to-point switching display image according to embodiment 1 of the present application;

FIG. 7 is a schematic diagram of a display image switched by 5x at 0.6x point according to an embodiment of the present application;

fig. 8 is a schematic structural diagram of a zoom processing apparatus according to an embodiment of the present application;

fig. 9 is a hardware entity diagram of an electronic device according to an embodiment of the present application.

Detailed Description

Generally, the fluency of triple-light change (i.e., SAT, Spatial Alignment Transform, also known as Spatial Alignment Transform) includes two large classifications, one is the Zoom fluency effect and one is the dot-switch effect. Wherein in the dot switching, the integral dot positions of the dot switching include: 0.6x (magnification), 1x, 2x, 5x and 10 x. There are two main operation modes for the point switching, one is the alternate-cut, for example, 0.6x alternate-cut 1x, 1x alternate-cut 2x, 2x alternate-cut 5x, 5x alternate-cut 10x, and overlay Fallback (a mechanism for switching lens according to the distance of the shooting scene and the brightness of the shooting environment) scheme switching. Another is skip cut, e.g., 0.6x inter cut 2x, 1x inter cut 5x, 2x inter cut 10x, 0.6x inter cut 5x, 1x inter cut 10x and overlay Fallback scheme switching.

In the related art, an APP (Application) of a terminal is mainly implemented by the following technical scheme:

and dividing the section of the point cut into 5 equal parts, and continuously sending 5 scaling coefficients to Hal (Hardware abstraction layer) to realize the smooth transition effect of the point cut. Wherein,

if the same camera is used for the point-cut magnification (here, different cameras correspond to different sensors, and the same camera is used for the point-cut magnification, it can also be understood that the same sensor is used for the point-cut magnification), the 5 groups of scaling coefficients are generally received by the hardware abstraction layer, and the effect is not large in jump, but the uncomfortable feeling is still not provided. For example, the camera corresponding to the main shooting sensor is responsible for switching from 1x to 5x, and if the user selects 1x to 2x at this time, the main shooting lens is used in the switching process, and all the 5 groups of zoom coefficients are received by the hardware abstraction layer, so that the effect is not large in jump, but the user looks uncomfortable.

If different cameras are used for the click-to-click magnification, the creation of a Pipeline (a Pipeline, which is mainly used to implement a generic term for a certain set of camera functions, such as a whole set of Pipeline processes for acquiring preview data) will trigger the problem that the zoom factor is covered. In fact, the hardware abstraction layer only receives 2 or 3 coefficients, and the effect is very obvious in jamming or jumping.

Meanwhile, cameras are switched at integer magnification due to a Fallback mechanism, so that FOVs (Field Of views) Of different cameras with the same magnification are jumped seriously, and the effect is obvious in jamming or jumping.

For example, if the zoom factor issued by the APP is 1.23x, 1.51x, 1.77x, 1.93x, and 2.0x by switching from 1x point to 2x, the 1x is switched to 2x in the high-pass 865 model high-compatibility version 10x zoom, and the same camera interval belongs to. Fig. 1A is a schematic diagram of a point switching process in the related art, as shown in fig. 1A, in a high-pass 865 model high-distribution version 10x zoom, a process of switching a 1x point to 2x mainly includes: s101, issuing 5 scaling coefficients to a framework layer by an APP; s102, the framework layer transmits the 5 scaling coefficients to the hardware abstraction layer; and step S103, the hardware abstraction layer applies the received zoom factor to the frame data and then displays the frame data. The 5 scaling factors can be basically received by a hardware abstraction layer, and the effect is not serious in discomfort.

However, if inside the high-pass 865 model low-profile 5x zoom, 1x switches to 2x belonging to a different camera interval. Fig. 1B is a schematic diagram illustrating a point switching process in the related art, as shown in fig. 1B, in a high-pass 865 model low-configuration version 5x zoom, a process of switching a 1x point to 2x mainly includes: s111, issuing 5 scaling coefficients to a framework layer by an APP; step S112, the framework layer transmits the 5 scaling coefficients to the hardware abstraction layer; step S113, determining whether the zooming interval needs to rebuild the pipeline; if the pipeline needs to be created again, step S114 is executed; if no pipeline needs to be recreated, step S115 is performed. Step S114, after the pipeline is established, the hardware abstraction layer acts the zoom factor on the frame data, and then the frame data is displayed; step S115, the hardware abstraction layer directly applies the scaling factor to the frame data, and then displays the frame data. Thus, if a pipeline needs to be created, the pipeline creation time is usually 200ms (milliseconds), which causes the problem that the scaling factor is covered, for example, the scaling factors of 1.77x and 1.93x have the problem that the creation of Tele (Tele) thread is directly covered by 2 x. Visually, a 1.51x jump directly to 2x is seen. Meanwhile, the problem of jumping of the field angle is also caused by firstly seeing 2x of the Ultra wide lens and then displaying 2x of the telephoto lens.

That is, the hardware abstraction layer can receive the complete 5 scaling factors, and depending on the scaling factors, the hardware abstraction layer cannot be issued to the hardware abstraction layer in time with the Request (a processing Request in the standard hardware abstraction layer). If the framework layer continuously receives the scaling factor issued by the APP, but does not request to issue, the problem that the scaling factor is covered exists.

Therefore, it can be seen that the point switching scheme in the related art has the following disadvantages: (1) the scaling factor parameter needs to be sent to the hardware abstraction layer along with the request, so if there is no request, the scaling factor has coverage problem, which is a problem of the mechanism itself. (2) In the process of switching the cameras, the hardware abstraction layer needs to create a pipeline for switching the cameras. It takes a lot of time while pulling the request, directly resulting in the scaling factor being overwritten. (3) A Fallback mechanism is added on the hardware abstraction layer, and the camera is switched according to the current scene distance and the current environment brightness at the integer point position (namely, a sensor in the camera is switched according to the current environment distance and the current environment brightness). At this time, the switching belongs to the hard tangent of the two sensors at the integer point position, and the angle of view of the switched image jumps due to the difference of the angle of view of the hardware of the two sensors.

Therefore, the embodiment of the present application provides a zoom processing method, by introducing a new mechanism, i.e. Drop mechanism: after the APP clicks and switches, all abnormal display images in the middle are discarded until normal images are displayed, and negative effects brought by the framework and hardware are bypassed. So, can be in order to solve two main inevitable problems that frame and hardware brought: (1) the pipeline creation of the sensor in the camera is long, and the problem of the coverage of the scaling factor is caused. (2) The Fallback mechanism causes an image jump problem caused by direct switching of sensors with integral dot magnification and different field angles.

The technical solution of the present application is further elaborated below with reference to the drawings and the embodiments. It should be apparent that the described embodiments are only some of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments of the present application without making any creative effort, shall fall within the protection scope of the present application.

In the following description, reference is made to "some embodiments" which describe a subset of all possible embodiments, but it is understood that "some embodiments" may be the same subset or different subsets of all possible embodiments, and may be combined with each other without conflict.

In the following description, suffixes such as "module", "component", or "unit" used to denote elements are used only for the convenience of description of the present application, and have no specific meaning by themselves. Thus, "module", "component" or "unit" may be used mixedly.

It should be noted that the terms "first \ second \ third" referred to in the embodiments of the present application are only used for distinguishing similar objects and do not represent a specific ordering for the objects, and it should be understood that "first \ second \ third" may be interchanged under specific ordering or sequence if allowed, so that the embodiments of the present application described herein can be implemented in other orders than illustrated or described herein.

The embodiment of the present application provides a zoom processing method, which is applied to an electronic device, and functions implemented by the method may be implemented by a processor in the electronic device calling a program code, which may be stored in a storage medium of the electronic device. Fig. 2 is a first schematic flow chart of an implementation of a zoom processing method according to an embodiment of the present application, as shown in fig. 1, the method includes:

step S201, determining a target zooming magnification interval according to a received zooming operation command;

here, the electronic device may be various types of devices having information processing capability, such as a cellular phone, a personal digital assistant, a navigator, a digital phone, a video phone, a smart watch, a smart band, a wearable device, a tablet computer, a kiosk, and the like.

Here, when a user opens a camera APP of a mobile phone and clicks a target magnification ratio needing zooming on a display screen, a zooming operation command is triggered, and then the system receives the zooming operation command, wherein the zooming operation command indicates a target zooming magnification ratio interval. For example, after the user opens the camera APP, the displayed current zoom magnification is 1x, and then the user selects zooming to 2x, so that the target zoom magnification interval is 1x to 2 x. If the user then selects zoom to 5x, the target zoom magnification interval is 2x to 5 x.

Step S202, determining M cameras corresponding to the target zooming magnification interval, wherein M is a natural number greater than or equal to 1; each camera is used for shooting images in a specific zooming magnification interval, and different cameras correspond to different zooming magnification intervals;

in the embodiment of the application, the terminal comprises N cameras, N is a natural number greater than 1, and M is less than or equal to N.

For example, the terminal may include three cameras, which correspond to three different sensors, respectively, where a first sensor (i.e., a first camera) is responsible for 0.6x-1x zoom, a second sensor (i.e., a second camera) is responsible for 1x-5x zoom, and a third sensor (i.e., a third camera) is responsible for 5x-20x or 5x to 60x zoom. Further, zooming within a certain interval corresponds to switching between different sensors. For example, 0.6x to 60x is switched, the coefficient is changed during the switching process, and the section to which the coefficient falls is the corresponding sensor in which section is working. For example, first falling to 0.6x-1x, the first sensor (wide angle sensor) is operating. Further down to 1x-5x means that the second sensor (the main camera sensor) is in operation, and finally down to 5x-60x means that the third sensor (the tele sensor) is in operation.

Step S203, determining an output image of each camera in the zooming process;

for example, when switching between 0.6x and 3x, the first camera (wide-angle camera) outputs an image, and then the second camera (main camera) outputs an image. For another example, when switching between 0.6x and 10x, the first camera (wide-angle camera) outputs an image, the second camera (main camera) outputs an image, and the third camera (telephoto camera) outputs an image.

And step S204, responding to the zoom operation command, and displaying the images meeting the conditions in the output images according to the time sequence.

Here, the displaying, in chronological order, the images that satisfy the condition in the output image includes two cases: one is to determine which images of the output images satisfy a condition and then display the images in chronological order. Another is to determine which images of the output images do not satisfy the condition, then remove the images, and display the remaining images satisfying the condition in chronological order.

In some embodiments, the zoom operation is a point-shear focus operation; the zooming operation process is a zooming operation process without using a scaling factor.

In the embodiment of the present application, the zoom operation is a point-to-focus switching operation, and is not suitable for the zoom operation. For example, after the user opens the camera APP, the current zoom magnification displayed is 1x, and then the user directly clicks to switch to 2x zoom, which is the point-to-point zoom operation. If the user performs zooming by "zooming in" or "zooming out" with the opening and closing of the fingers, the zoom operation is zooming.

In some embodiments, the M cameras include a wide camera, a main camera, and a tele camera, wherein: the field angle of the wide-angle camera is larger than that of the main camera, and the field angle of the main camera is larger than that of the tele-camera; the focus of wide angle camera is less than the focus of main camera, the focus of main camera is less than the focus of tele camera.

In the embodiment of the application, a target zooming magnification interval is determined according to a received zooming operation command; determining M cameras corresponding to the target zooming magnification interval, wherein M is a natural number greater than or equal to 1; each camera is used for shooting images in a specific zooming magnification interval, and different cameras correspond to different zooming magnification intervals; determining an output image of each camera in the zooming process; and responding to the zoom operation command, and displaying the images meeting the conditions in the output images according to the time sequence, so that the effects of image jump and image pause in the zoom switching process can be avoided.

Based on the foregoing embodiments, an embodiment of the present application further provides a zoom processing method, and fig. 3 is a schematic flow chart illustrating implementation of the zoom processing method according to the embodiment of the present application, as shown in fig. 3, the method includes:

step S301, determining a target zooming magnification interval according to a received zooming operation command;

step S302, determining M cameras corresponding to the target zooming magnification interval, wherein M is a natural number greater than or equal to 1; each camera is used for shooting images in a specific zooming magnification interval, and different cameras correspond to different zooming magnification intervals;

step S303, determining an output image of each camera in the zooming process;

s304, in response to the zoom operation command, sequencing the output images according to a time sequence to obtain an image sequence;

here, the sorting of the output images in time sequence means that the output images of all the cameras in the zooming process are sorted in time sequence.

Step S305, in the image sequence, if the ith frame image and the (i +1) th frame image are images output by different cameras, removing the ith frame image; i is a natural number greater than 1;

here, if two adjacent frames of images are images output by different cameras, one of the frames of images is removed from the image sequence.

And S306, displaying the image sequence.

In the embodiment of the application, a target zooming magnification interval is determined according to a received zooming operation command; determining M cameras corresponding to the target zooming magnification interval, wherein M is a natural number greater than or equal to 1; each camera is used for shooting images in a specific zooming magnification interval, and different cameras correspond to different zooming magnification intervals; determining an output image of each camera in the zooming process; in response to the zoom operation command, sequencing the output images according to a time sequence to obtain an image sequence; in the image sequence, if the ith frame image and the (i +1) th frame image are images output by different cameras, removing the ith frame image; i is a natural number greater than 1; and displaying the image sequence, thus avoiding the effects of image jump and image blockage caused by the difference of the field angles in the zooming switching process.

Based on the foregoing embodiments, an embodiment of the present application further provides a zoom processing method, and fig. 4 is a schematic flow chart illustrating implementation of the zoom processing method according to the embodiment of the present application, as shown in fig. 4, the method includes:

step S401, determining a target zooming magnification interval according to a received zooming operation command;

s402, determining M cameras corresponding to the target zooming magnification interval, wherein M is a natural number greater than or equal to 1; each camera is used for shooting images in a specific zooming magnification interval, and different cameras correspond to different zooming magnification intervals;

step S403, determining an output image of each camera in the zooming process;

s404, in response to the zoom operation command, sequencing the output images according to a time sequence to obtain an image sequence;

step S405, in the image sequence, if the ith frame image and the (i +1) th frame image are images output by different cameras, removing the ith frame image; i is a natural number greater than 1;

step S406, if a return switching operation exists in the zooming processing process, determining one frame of image before the return switching operation is executed as a switching image; the return switching operation is a camera switching operation which is carried out by the terminal according to the shot scene distance and the ambient brightness;

in the embodiment of the present application, the Fallback switching operation (i.e., a series of operations of the camera itself under the Fallback mechanism) is an operation that is automatically triggered by the camera itself under a certain specific condition, and is not an operation of the user. For example, in the high-pass 865 model high-definition version 5x zoom, it is required that the zoom must be performed on a telephoto lens, but if the current environment is a macro (for example, the distance between the camera and the shot is less than or equal to a preset distance), and thus is a magnifying glass effect for the user, the zoom is performed on the main camera. That is, the zoom lens should be switched to, but the image blur is caused by the close distance or the dark light and the long focal length, so that the Fallback mechanism is triggered to switch to the main shooting.

Step S407 is to display images other than the switching image in the image sequence in chronological order.

Here, in the image sequence, the switching image is removed, and an image jump effect due to a backward switching operation during the spot-cut zooming can be avoided.

In the embodiment of the application, a target zooming magnification interval is determined according to a received zooming operation command; determining M cameras corresponding to the target zooming magnification interval, wherein M is a natural number greater than or equal to 1; each camera is used for shooting images in a specific zooming magnification interval, and different cameras correspond to different zooming magnification intervals; determining an output image of each camera in the zooming process; in response to the zoom operation command, sequencing the output images according to a time sequence to obtain an image sequence; in the image sequence, if the ith frame image and the (i +1) th frame image are images output by different cameras, removing the ith frame image; i is a natural number greater than 1; determining one frame image before the execution of the reverse switching operation as a switching image if the reverse switching operation exists in the zooming process; the return switching operation is a camera switching operation which is carried out by the terminal according to the shot scene distance and the ambient brightness; and displaying the images except the switching image in the image sequence according to the time sequence, so that the effects of image jump and image pause caused by the difference of the field angle and the existence of a Fallback mechanism in the zooming switching process can be avoided.

Based on the foregoing embodiments, an embodiment of the present application further provides a zoom processing method, and fig. 5 is a schematic diagram of an implementation flow of the zoom processing method according to the embodiment of the present application, as shown in fig. 5, the method includes:

step S501, determining a target zooming magnification interval according to a received zooming operation command;

step S502, determining M cameras corresponding to the target zooming magnification interval, wherein M is a natural number more than or equal to 1; each camera is used for shooting images in a specific zooming magnification interval, and different cameras correspond to different zooming magnification intervals;

step S503, determining an output image of each camera in the zooming process;

step S504, in response to the zoom operation command, sequencing the output images according to a time sequence to obtain a first image sequence;

step S505, in the first image sequence, if the ith frame image and the (i +1) th frame image are images output by different cameras, removing the ith frame image to obtain a second image sequence; i is a natural number greater than 1;

step S506, if a return switching operation exists in the zooming processing process, determining one frame of image before the return switching operation is executed as a switching image; the return switching operation is a camera switching operation which is carried out by the terminal according to the shot scene distance and the ambient brightness;

step S507, determining a third image sequence for the images except for the switching image in the second image sequence;

step S508, in the third image sequence, if a jth frame image and a (j +1) th frame image are images output by the same camera, and a difference value between a zoom magnification corresponding to the jth frame image and a zoom magnification corresponding to the (j +1) th frame image is greater than or equal to a preset value, removing the jth frame image; j is a natural number greater than 1;

here, if the difference between the zoom magnifications corresponding to two adjacent frames is greater than or equal to a preset value, the difference between the two frames of images is considered to be large, and therefore, one of the two frames of images is removed, so as to avoid the effects of image jump and image stutter during the process of point-cut zooming.

And step S509, displaying the third image sequence.

In the embodiment of the application, a target zooming magnification interval is determined according to a received zooming operation command; determining M cameras corresponding to the target zooming magnification interval, wherein M is a natural number greater than or equal to 1; each camera is used for shooting images in a specific zooming magnification interval, and different cameras correspond to different zooming magnification intervals; determining an output image of each camera in the zooming process; in response to the zoom operation command, sequencing the output images according to a time sequence to obtain a first image sequence; in the first image sequence, if the ith frame image and the (i +1) th frame image are images output by different cameras, removing the ith frame image to obtain a second image sequence; i is a natural number greater than 1; determining one frame image before the execution of the reverse switching operation as a switching image if the reverse switching operation exists in the zooming process; the return switching operation is a camera switching operation which is carried out by the terminal according to the shot scene distance and the ambient brightness; determining a third image sequence from the images except the switching image in the second image sequence; in the third image sequence, if a jth frame image and a (j +1) th frame image are images output by the same camera, and a difference value between a zoom magnification corresponding to the jth frame image and a zoom magnification corresponding to the (j +1) th frame image is greater than or equal to a preset value, removing the jth frame image; j is a natural number greater than 1; and displaying the third image sequence, thus avoiding the effects of image jump and image pause caused by the difference of the angle of view, the existence of a Fallback mechanism and the larger difference of adjacent image frames in the zooming switching process.

Based on the foregoing embodiments, an embodiment of the present application further provides a zoom processing method, including:

step S511, determining a target zooming magnification interval according to the received zooming operation command;

s512, determining M cameras corresponding to the target zooming magnification interval, wherein M is a natural number greater than or equal to 1; each camera is used for shooting images in a specific zooming magnification interval, and different cameras correspond to different zooming magnification intervals;

step S513, determining an output image of each camera in the zooming process;

step S514, responding to the zoom operation command, sequencing the output images according to a time sequence to obtain an image sequence; the image sequence comprises N frames of images;

and step S515, displaying the first frame image and the N frame image in the image sequence according to the time sequence.

Here, the first frame image and the last frame image in the image sequence may be directly displayed.

Based on the foregoing embodiments, the present application further provides a zoom processing method, which introduces a new Drop mechanism that can bypass negative effects of the framework and the hardware. The Drop mechanism can be described simply as: after the APP clicking switching occurs, all the abnormal display images in the middle are discarded until the normal images are displayed.

For example, when the Fallback mechanism is triggered during the switching process, when the switch is switched to 5x, a telephoto 5x image should be displayed first, but a main-shot 5x image is finally displayed because the object currently being compared is close. Therefore, the Drop mechanism in the embodiment of the application determines which image corresponding to the sensor under the camera is finally displayed according to the change of the current environment, and the Drop mechanism is triggered to Drop the image, so that the finally displayed image is reserved. For example, if a 5x main shot image is finally displayed, the 5x tele image is discarded and is not displayed (i.e., all images corresponding to the 5x tele image are abnormal images and are not displayed).

The premise of the Drop mechanism is that: scaling parameters of APP configuration are no longer adding smooth transitions, and switching is directly forced.

In the embodiment of the present application, the zoom processing method is described by way of example, and the zoom processing method does not need to configure an intermediate zoom factor from a current zoom magnification to a target zoom magnification, and only needs to configure the zoom factor of the target zoom magnification.

In the neighbor switching, 2x switching at 1x point is taken as an example for explanation:

fig. 6 is a schematic diagram of a display image with 2x dot switching according to embodiment 1x of the present application, and as shown in fig. 6, the image is a display image flow including a Fallback mechanism, and a phenomenon that a code does not perform any processing is observed: the preview is 1 × main shot image 61, then 2 × main shot image 62 is seen, and when 2 × main shot image 62 is cut into 2 × telephoto image 63, a jump is seen due to a difference in angle of view. If the Fallback mechanism is triggered at the moment, the 2x tele image 63 is switched to the 2x main shooting image 64, and the image jumps once again. Based on this, the Drop mechanism of the zoom processing method in the embodiment of the present application removes the 2 × main shot image 62 to prevent image jump due to the difference in the angle of view. The Drop mechanism also removes the 2x tele image 63 if triggered by a Fallback mechanism to prevent image jumps due to the Fallback mechanism triggering. In this way, when the 1x point is switched to 2x, after the Drop mechanism in the embodiment of the present application is used, the 1x main shot image 61 and then the 2x main shot image 64 are previewed, and no image jump effect occurs in the middle.

Fig. 7 is a schematic diagram of a display image switched from 0.6x point to 5x point in the embodiment of the present application, and as shown in fig. 7, the image is a display image flow including a Fallback mechanism, and a phenomenon that a code does not perform any processing is observed: the preview is first a 0.6x wide image 71, then the main shot will see a 1x main shot image 72, then the wide-angle will be destroyed to create the tele, then a 5x main shot image 73 will be seen, at which time the image jumps once. When the 5x main-shot image 73 is cut into the 5x telephoto image 74, the image jumps once again due to the difference in the angle of view. If there is a Fallback trigger, the 5x telephoto image 74 is switched to the 5x main shot image 73, and the image jumps once again, and the 5x main shot image 75 is displayed. Based on this, the Drop mechanism of the zoom processing method in the embodiment of the present application removes the 1x main image 72, the 5x main image 73, and the 5x tele image 74 to prevent the image jump effect. In this way, when the 0.6x point is switched to 5x, after the Drop mechanism in the embodiment of the present application is used, the preview is first the 0.6x wide-angle image 71 and then the 5x main shot image 75, and no image jump effect occurs in the middle.

The zoom processing method in the embodiment of the application skillfully avoids image jump caused by hardware difference (namely, viewing angle difference) of the sensor, avoids click-cut image effect blockage caused by continuous destruction pipelines and creation pipelines in a software implementation process, simultaneously can not depend on hardware and SAT processes, and does not generate side effect on smooth effect.

Based on the foregoing embodiments, the present application provides a zoom processing apparatus, which includes units, modules included in the units, and components included in the modules, and can be implemented by a processor in an electronic device; of course, the implementation can also be realized through a specific logic circuit; in the implementation process, the processor may be a CPU (Central Processing Unit), an MPU (Microprocessor Unit), a DSP (Digital Signal Processing), an FPGA (Field Programmable Gate Array), or the like.

Fig. 8 is a schematic structural diagram of a zoom processing apparatus according to an embodiment of the present application, and as shown in fig. 8, the apparatus 800 includes:

a first determining unit 801 configured to determine a target zoom magnification interval according to a received zoom operation command;

a second determining unit 802, configured to determine M cameras corresponding to the target zoom magnification interval, where M is a natural number greater than or equal to 1; each camera is used for shooting images in a specific zooming magnification interval, and different cameras correspond to different zooming magnification intervals;

a third determining unit 803, configured to determine an output image of each camera during the zooming process;

a display unit 804 configured to display, in response to the zoom operation command, images satisfying a condition in the output images in chronological order.

In some embodiments, the display unit 804 includes:

the first sequencing module is used for sequencing the output images according to a time sequence to obtain an image sequence;

the first removing module is used for removing the ith frame image if the ith frame image and the (i +1) th frame image in the image sequence are images output by different cameras; i is a natural number greater than 1;

a first display module for displaying the image sequence.

In some embodiments, the display unit 804 further includes:

a determination module configured to determine, if there is a reverse switching operation in the zoom processing, one frame of image before the reverse switching operation is performed as a switching image; the return switching operation is a camera switching operation which is carried out by the terminal according to the shot scene distance and the ambient brightness;

and the second display module is used for displaying the images except the switching image in the output images according to a time sequence.

In some embodiments, the display unit 804 further includes:

the second sorting module is used for sorting the output images according to a time sequence to obtain an image sequence;

a second removing module, configured to remove, in the image sequence, a jth frame image if the jth frame image and the (j +1) th frame image are images output by the same camera and a difference between a zoom magnification corresponding to the jth frame image and a zoom magnification corresponding to the (j +1) th frame image is greater than or equal to a preset value; j is a natural number greater than 1;

and the third display module is used for displaying the image sequence.

In some embodiments, the display unit 804 includes:

the image sequencing module is used for sequencing the output images according to a time sequence to obtain an image sequence; the image sequence comprises N frames of images;

and the image display module is used for displaying the first frame image and the Nth frame image in the image sequence according to the time sequence.

In some embodiments, the M cameras include a wide camera, a main camera, and a tele camera, wherein:

the field angle of the wide-angle camera is larger than that of the main camera, and the field angle of the main camera is larger than that of the tele-camera;

the focus of wide angle camera is less than the focus of main camera, the focus of main camera is less than the focus of tele camera.

The above description of the apparatus embodiments, similar to the above description of the method embodiments, has similar beneficial effects as the method embodiments. For technical details not disclosed in the embodiments of the apparatus of the present application, reference is made to the description of the embodiments of the method of the present application for understanding.

It should be noted that, in the embodiment of the present application, if the zoom processing method is implemented in the form of a software functional module and sold or used as a standalone product, the zoom processing method may also be stored in a computer-readable storage medium. Based on such understanding, the technical solutions of the embodiments of the present application may be essentially implemented or portions thereof contributing to the prior art may be embodied in the form of a software product stored in a storage medium, and including several instructions for causing an electronic device (which may be a personal computer, a server, etc.) to execute all or part of the methods described in the embodiments of the present application. And the aforementioned storage medium includes: various media capable of storing program codes, such as a usb disk, a removable hard disk, a Read Only Memory (ROM), a magnetic disk, or an optical disk. Thus, embodiments of the present application are not limited to any specific combination of hardware and software.

Correspondingly, an embodiment of the present application provides an electronic device, which includes a memory and a processor, where the memory stores a computer program that can be run on the processor, and the processor executes the program to implement the steps in the zoom processing method provided in the foregoing embodiment.

Correspondingly, the embodiment of the present application provides a readable storage medium, on which a computer program is stored, which when executed by a processor implements the steps in the zoom processing method described above.

Here, it should be noted that: the above description of the storage medium and device embodiments is similar to the description of the method embodiments above, with similar advantageous effects as the method embodiments. For technical details not disclosed in the embodiments of the storage medium and apparatus of the present application, reference is made to the description of the embodiments of the method of the present application for understanding.

It should be noted that fig. 9 is a schematic diagram of a hardware entity of an electronic device according to an embodiment of the present application, and as shown in fig. 9, the hardware entity of the electronic device 900 includes: a processor 901, a communication interface 902 and a memory 903, wherein

The processor 901 generally controls the overall operation of the electronic device 900.

The communication interface 902 may enable the electronic device 900 to communicate with other terminals or servers via a network.

The Memory 903 is configured to store instructions and applications executable by the processor 901, and may also buffer data (e.g., image data, audio data, voice communication data, and video communication data) to be processed or already processed by the processor 901 and modules in the electronic device 900, and may be implemented by a FLASH Memory or a RAM (Random Access Memory).

In the several embodiments provided in the present application, it should be understood that the disclosed apparatus and method may be implemented in other ways. The above-described device embodiments are merely illustrative, for example, the division of the unit is only a logical functional division, and there may be other division ways in actual implementation, such as: multiple units or components may be combined, or may be integrated into another system, or some features may be omitted, or not implemented. In addition, the coupling, direct coupling or communication connection between the components shown or discussed may be through some interfaces, and the indirect coupling or communication connection between the devices or units may be electrical, mechanical or other forms.

The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed on a plurality of network units; some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, all functional units in the embodiments of the present application may be integrated into one processing module, or each unit may be separately regarded as one unit, or two or more units may be integrated into one unit; the integrated unit can be realized in a form of hardware, or in a form of hardware plus a software functional unit. Those of ordinary skill in the art will understand that: all or part of the steps for implementing the method embodiments may be implemented by hardware related to program instructions, and the program may be stored in a computer readable storage medium, and when executed, the program performs the steps including the method embodiments; and the aforementioned storage medium includes: various media capable of storing program codes, such as a removable Memory device, a ROM (Read-Only Memory), a RAM (Random Access Memory), a magnetic disk, and an optical disk.

The methods disclosed in the several method embodiments provided in the present application may be combined arbitrarily without conflict to obtain new method embodiments.

Features disclosed in several of the product embodiments provided in the present application may be combined in any combination to yield new product embodiments without conflict.

The features disclosed in the several method or apparatus embodiments provided in the present application may be combined arbitrarily, without conflict, to arrive at new method embodiments or apparatus embodiments.

The above description is only for the specific embodiments of the present application, but the scope of the present application is not limited thereto, and any person skilled in the art can easily conceive of the changes or substitutions within the technical scope of the present application, and shall be covered by the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims

1. A zoom processing method, characterized in that the method comprises:

determining an output image of each camera in the zooming process;

2. The method of claim 1, wherein displaying the images of the output image that satisfy the condition in a chronological order comprises:

sequencing the output images according to a time sequence to obtain an image sequence;

in the image sequence, if the ith frame image and the (i +1) th frame image are images output by different cameras, removing the ith frame image; i is a natural number greater than 1;

and displaying the image sequence.

3. The method of claim 2, wherein displaying the images of the output image that satisfy the condition in a chronological order, further comprises:

determining one frame image before the execution of the reverse switching operation as a switching image if the reverse switching operation exists in the zooming process; the return switching operation is a camera switching operation which is carried out by the terminal according to the shot scene distance and the ambient brightness;

and displaying images except the switching image in the output images according to the time sequence.

4. The method according to any one of claims 1 to 3, wherein the displaying images satisfying the condition in the output image in chronological order further comprises:

in the image sequence, if a jth frame image and a (j +1) th frame image are images output by the same camera, and the difference value between the zoom magnification corresponding to the jth frame image and the zoom magnification corresponding to the (j +1) th frame image is greater than or equal to a preset value, removing the jth frame image; j is a natural number greater than 1;

and displaying the image sequence.

5. The method of claim 1, wherein displaying the images of the output image that satisfy the condition in a chronological order comprises:

sequencing the output images according to a time sequence to obtain an image sequence; the image sequence comprises N frames of images;

and displaying the first frame image and the Nth frame image in the image sequence according to the time sequence.

6. The method of claim 4, wherein the zoom operation is a point-shear focus operation; the zooming operation process is a zooming operation process without using a scaling factor.

7. The method of claim 6, wherein the M cameras comprise a Wide camera, a Master camera, and a tele camera, wherein:

8. A zoom processing apparatus, characterized in that the apparatus comprises:

9. An electronic device comprising a memory and a processor, the memory storing a computer program operable on the processor, the processor implementing the steps in the zoom processing method of any of claims 1 to 7 when executing the program.

10. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the steps in the zoom processing method according to any one of claims 1 to 7.