CN117528250A

CN117528250A - Multimedia file processing method, multimedia file processing device and electronic equipment

Info

Publication number: CN117528250A
Application number: CN202311508311.4A
Authority: CN
Inventors: 何柱材
Original assignee: Vivo Mobile Communication Co Ltd
Current assignee: Vivo Mobile Communication Co Ltd
Priority date: 2023-11-13
Filing date: 2023-11-13
Publication date: 2024-02-06

Abstract

The application discloses a multimedia file processing method, a multimedia file processing device and electronic equipment, and belongs to the technical field of image processing. The method comprises the following steps: acquiring N groups of original images, wherein the N groups of original images are images obtained by shooting the same scene, the zoom magnifications corresponding to the different groups of original images are different, and N is an integer larger than 1; receiving a first input of a user to a zoom editing interface under the condition that the zoom editing interface of a first multimedia file is displayed, wherein the first multimedia file has an association relationship with the N groups of original images; and responding to the first input, and obtaining a second multimedia file based on a first zoom magnification and the N groups of original images, wherein the first zoom magnification is determined based on the first input, and at least one second image in the second multimedia file is different from the corresponding at least one first image in the first multimedia file in zoom magnification.

Description

Multimedia file processing method, multimedia file processing device and electronic equipment

Technical Field

The application belongs to the technical field of image processing, and particularly relates to a multimedia file processing method, a multimedia file processing device and electronic equipment.

Background

In the related art, a user may adjust zoom (zoom) magnification of photographing by a preset touch operation during photographing of a photo or video by using an electronic device such as a mobile phone, for example, the zoom magnification of photographing is adjusted to be small by a touch operation of double-finger convergence (double-finger inward contraction), and the zoom magnification of photographing is adjusted to be large by a touch operation of double-finger separation (double-finger outward expansion).

However, in some scenes, it is inconvenient to perform a preset touch operation of adjusting the zoom magnification during photographing, for example: in the scene of underwater shooting, single-hand shooting, etc., it is inconvenient to perform a preset touch operation to adjust the zoom magnification of shooting.

As can be seen from the above, the zoom adjustment method in the related art is limited in applicable shooting scenes.

Disclosure of Invention

The embodiment of the application aims to provide a multimedia file processing method, a multimedia file processing device and electronic equipment, which can adjust zoom magnification of an image or video after shooting is completed, and solve the problem that the suitable shooting scene for zoom adjustment is limited.

In a first aspect, an embodiment of the present application provides a multimedia file processing method, where the method includes:

acquiring N groups of original images, wherein the N groups of original images are images obtained by shooting the same scene, the zoom magnifications corresponding to the different groups of original images are different, and N is an integer larger than 1;

Receiving a first input of a user to a zoom editing interface under the condition that the zoom editing interface of a first multimedia file is displayed, wherein the first multimedia file and the N groups of original images have an association relation;

and responding to the first input, and obtaining a second multimedia file based on a first zoom magnification and the N groups of original images, wherein the first zoom magnification is determined based on the first input, and at least one second image in the second multimedia file is different from at least one first image corresponding to the first multimedia file in zoom magnification.

In a second aspect, an embodiment of the present application provides a multimedia file processing apparatus, including:

the first acquisition module is used for acquiring N groups of original images, wherein the N groups of original images are images obtained by shooting the same scene, the zoom magnifications corresponding to the different groups of original images are different, and N is an integer larger than 1;

the first interaction module is used for receiving first input of a user to the zooming editing interface under the condition that the zooming editing interface of the first multimedia file is displayed, wherein the first multimedia file has an association relation with the N groups of original images;

The first processing module is used for responding to the first input, obtaining a second multimedia file based on a first zooming magnification and the N groups of original images, wherein the first zooming magnification is determined based on the first input, and at least one second image in the second multimedia file is different from the zooming magnification of at least one corresponding first image in the first multimedia file.

In a third aspect, embodiments of the present application provide an electronic device comprising a processor and a memory storing a program or instructions executable on the processor, which when executed by the processor, implement the steps of the method as described in the first aspect.

In a fourth aspect, embodiments of the present application provide a readable storage medium having stored thereon a program or instructions which when executed by a processor implement the steps of the method according to the first aspect.

In a fifth aspect, embodiments of the present application provide a chip, where the chip includes a processor and a communication interface, where the communication interface is coupled to the processor, and where the processor is configured to execute a program or instructions to implement a method according to the first aspect.

In a sixth aspect, embodiments of the present application provide a computer program product stored in a storage medium, the program product being executable by at least one processor to implement the method according to the first aspect.

In the embodiment of the application, under a shooting scene in which zoom adjustment operation is inconvenient, N cameras of an electronic device can be utilized to shoot images or videos according to different zoom magnifications, N groups of original images are obtained, under the condition that a zoom editing interface of a related multimedia file is displayed, a desired image or video can be obtained based on the zoom magnifications desired by a user and the N groups of original images, the zooming operation on the images and the videos after shooting is completed is realized, even if the images and the videos with the desired zoom magnifications are not obtained during shooting, the images and the videos can be obtained based on subsequent operations after shooting is completed, and the embodiment of the application does not need to be limited by the shooting scene, and can realize free zooming of the images or the videos.

Drawings

Fig. 1 is a flowchart of a multimedia file processing method provided in an embodiment of the present application;

fig. 2 is a schematic diagram of a shooting scene of a multimedia file processing method according to an embodiment of the present application;

Fig. 3 is one of application interface diagrams of a multimedia file processing method according to an embodiment of the present application;

FIG. 4 is a second diagram of an application interface of a multimedia file processing method according to an embodiment of the present disclosure;

fig. 5 is a schematic diagram of N sets of original images in a multimedia file processing method according to an embodiment of the present application;

fig. 6 is an interface schematic diagram of a multimedia file processing method in an application scenario one according to an embodiment of the present application;

fig. 7 is one of schematic diagrams of determining a first zoom magnification in an application scenario one according to a multimedia file processing method provided in an embodiment of the present application;

FIG. 8 is a second schematic diagram of determining a first zoom magnification in an application scenario I according to a multimedia file processing method provided in an embodiment of the present application;

fig. 9 is an interface schematic diagram of a multimedia file processing method in an application scenario two according to an embodiment of the present application;

fig. 10 is one of schematic diagrams of determining a first image in an application scenario two according to a multimedia file processing method provided in an embodiment of the present application;

fig. 11 is one of schematic diagrams of determining a first zoom magnification in an application scenario two according to a multimedia file processing method provided in an embodiment of the present application;

Fig. 12 is a second schematic diagram of determining a first zoom magnification in an application scenario two according to the method for processing a multimedia file provided in the embodiment of the present application;

FIG. 13 is a second schematic diagram of determining a first image in a second application scenario according to the method for processing a multimedia file provided in the embodiment of the present application;

fig. 14 is a schematic diagram showing a first zoom magnification in an application scenario two according to a multimedia file processing method provided in an embodiment of the present application;

fig. 15 is one of schematic diagrams of determining a first image and a first zoom magnification in an application scene two according to the method for processing a multimedia file provided in the embodiment of the present application;

fig. 16 is a second schematic diagram of determining a first image and a first zoom magnification in an application scene two according to the method for processing a multimedia file provided in the embodiment of the present application;

FIG. 17 is a block diagram of a multimedia file processing apparatus according to an embodiment of the present application;

fig. 18 is a schematic structural diagram of an electronic device according to an embodiment of the present application;

fig. 19 is a schematic hardware structure of an electronic device according to an embodiment of the present application.

Detailed Description

Technical solutions in the embodiments of the present application will be clearly described below with reference to the drawings in the embodiments of the present application, and it is apparent that the described embodiments are some embodiments of the present application, but not all embodiments. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments in the present application are within the scope of the protection of the present application.

The terms "first," "second," and the like in the description of the present application, are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used may be interchanged, as appropriate, such that embodiments of the present application may be implemented in sequences other than those illustrated or described herein, and that the objects identified by "first," "second," etc. are generally of a type and not limited to the number of objects, e.g., the first object may be one or more. In addition, "and/or" in the specification means at least one of the connected objects, and the character "/", generally means a relationship in which the associated objects are one kind of "or".

In the related art, a plurality of cameras are usually mounted on an electronic device (such as a mobile phone), a user needs to dial with two fingers on a camera preview interface to adjust the zoom magnification of shooting, and after the zoom magnification is determined, the selected camera and the angle of view are also determined, that is, the corresponding camera module is selected according to the distance of the object to be shot for imaging. For example, a photograph taken by a wide-angle camera has a larger field angle, and a long-focus camera can take a more distant object.

However, in a scenario where it is inconvenient to perform the zoom magnification adjustment operation on the camera preview interface, the zoom magnification default by the mobile phone is generally adopted for shooting, and at this time, there may be a problem that the shot photo or video does not meet the user requirement, for example, the photo does not include an object to be shot, or the object to be shot is not clear due to a long distance.

For example: in an underwater shooting scene, when shooting a fast moving object such as a fish shoal, a user cannot take out the mobile phone later or is difficult to perform zoom operation, and only a default zoom magnification can be used for shooting a photo, at this time, the photo may not contain the object to be shot, or the object to be shot may not be clearly shot due to a long distance.

In the embodiment of the present application, after shooting is completed, a zoom magnification adjustment process in the shooting process can be restored based on an original image shot with N zoom magnifications, so that a user obtains a photograph or video that matches a desired zoom magnification and a desired camera.

The multimedia file processing method, the multimedia file processing device and the electronic equipment provided by the embodiment of the application are described in detail below through specific embodiments and application scenes thereof with reference to the accompanying drawings.

Referring to fig. 1, the method for processing a multimedia file provided in the embodiment of the present application includes the following steps:

step 101, acquiring N groups of original images, wherein the N groups of original images are images obtained by shooting the same scene, the zoom magnifications corresponding to the different groups of original images are different, and N is an integer larger than 1.

It should be noted that, the multimedia file processing method in the embodiment of the present application is used for processing a multimedia file including an image, such as a picture file or a video file.

In some embodiments, each set of original images includes a photograph, such as: in the process of shooting the photo, shooting one photo by using N cameras according to different zoom magnifications, and obtaining N photos with different zoom magnifications.

In other embodiments, each set of original images includes at least two images, such as: in the process of shooting videos, N cameras are used for shooting videos according to different zoom magnifications, and at the moment, N videos with different zoom magnifications are obtained.

In some embodiments, the execution body of the multimedia file processing method provided in the embodiments of the present application may be an electronic device, such as a mobile phone, a tablet computer, a vehicle-mounted terminal, a smart glasses, a smart watch, or an electronic device with at least two cameras. At this time, the N sets of original images may be photographs or videos taken with N cameras, where the N cameras have different zoom magnifications, for example, the N cameras include a main camera, a wide-angle camera, a telephoto camera, and the like.

Of course, the execution body of the multimedia file processing method provided in the embodiment of the present application and the device for capturing the N sets of original images may be different devices. For example: after the N groups of original images are shot by the N cameras, the N groups of original images are transmitted to equipment for executing the multimedia file processing method provided by the embodiment of the application.

For convenience of explanation, in the embodiment of the present application, the execution body of the multimedia file processing method provided in the embodiment of the present application uses N cameras to capture N sets of original images as an example, which is not specifically limited herein.

In some embodiments, when the preset zoom mode is started, in the shooting process of the user, N cameras are used for shooting at the same time, so as to obtain N groups of original images.

For example: as shown in fig. 2 and 3, in the process of executing the underwater photographing scene shown in fig. 2, if the dynamic zoom mode or the underwater photographing mode is started, N cameras are used for photographing at the same time, so as to obtain N groups of original images.

For another example: assuming that the mobile phone has 3 cameras, such as a main camera, a wide-angle camera and a tele camera, when the mobile phone is used for shooting pictures in the underwater shooting scene shown in fig. 2, the 3 cameras on the mobile phone can be started at the same time to obtain 3 pictures with different zoom magnifications shown in fig. 5.

Step 102, under the condition of displaying a zooming editing interface of a first multimedia file, receiving a first input of a user to the zooming editing interface, wherein the first multimedia file has an association relation with the N groups of original images.

In some embodiments, the zoom editing interface of the first multimedia file may be a preview interface of the first multimedia file.

In some embodiments, the first multimedia file may be a combination of N sets of original images, and is displayed as only one set of original images in the album.

For example: in the case that the original image is a photo, the first multimedia file may be a dynamic photo formed by combining N photos, and at this time, the display preview image in the zoom editing interface of the first multimedia file may be a preview image of the original image captured by the first camera, where the first camera may be a main camera or a camera corresponding to any one of the N groups of original images.

In other embodiments, the first multimedia file may be a multimedia file obtained by fusing N sets of original images, for example, fusing image data of the N sets of original images according to a preset rule, so that the image data of the first multimedia file includes image data of the N sets of original images.

In still other embodiments, the first multimedia file may be one of N sets of original images, and the first multimedia file is associated with other of the N sets of original images, such that the associated other original images may be obtained by the first multimedia file, such as storing association information of the first multimedia file with the other of the N sets of original images in an album application.

As an alternative embodiment, the zoom editing interface may trigger the display based on a user operation on the first multimedia file.

In some embodiments, prior to the receiving the first input by the user to the zoom editing interface, the method further comprises:

displaying a first multimedia file, wherein the first multimedia file comprises a zooming mark;

receiving a fourth input from the user:

and responding to the fourth input, and displaying a zooming editing interface of the first multimedia file.

In some embodiments, the fourth input may be a touch operation on a preset icon.

For example: as shown in fig. 4, the zoom mark 41 is displayed on the top right corner of the play interface or the preview interface of the first multimedia file, and at this time, the fourth input may be a touch input such as clicking, long pressing, etc. on the zoom mark 41.

In other embodiments, the fourth input may be a pressing operation of a preset hardware button.

In still other embodiments, the fourth input may be a zoom adjustment operation, such as: under the condition of displaying the first multimedia file, if a touch operation of closing or separating the two fingers of the first multimedia file is received, a zooming editing interface for displaying the first multimedia file can be triggered.

In this embodiment, the zoom editing interface for displaying the first multimedia file may be triggered based on the user operation, so that the operation procedure for displaying the zoom editing interface for displaying the first multimedia file is simplified.

In some embodiments, only one set of preview images is displayed in the preview interface or the zoom editing interface of the first multimedia file, at this time, as shown in fig. 4, the preview image of the first multimedia file is displayed in the preview interface of the first multimedia file, and a zoom mark 41 may be displayed in an upper right corner of the preview image to distinguish the first multimedia file from a conventional photo or video by the zoom mark 41, and the zoom mark 41 indicates that the zoom editing may be performed on the first multimedia file.

In some embodiments, the preview image of the first multimedia file may default to a preview image of the original image captured by the first camera, such as displaying a preview of the original image captured by the main camera in the preview interface of the first multimedia file by default.

Step 103, responding to the first input, and obtaining a second multimedia file based on a first zoom magnification and the N groups of original images, wherein the first zoom magnification is determined based on the first input, and at least one second image in the second multimedia file is different from at least one first image corresponding to the first multimedia file in zoom magnification.

In some embodiments, the first input may include any operation for determining a first zoom magnification and triggering a determination of a second multimedia file matching the first zoom magnification based on the first zoom magnification.

In some embodiments, the second multimedia file is similar to the first multimedia file, and may be associated with N sets of original images, except that the method includes: the first multimedia file defaults to displaying a preview of an original image captured by the first camera in the album, and the second multimedia file displays a preview of an image corresponding to the first zoom magnification in the album.

For example: after the first zoom magnification is determined, the user clicks to save, and the photos of the second multimedia file, which are acquired by the default first camera, can be changed into photos corresponding to the first zoom magnification.

In some embodiments, the obtaining the second multimedia file based on the first zoom magnification and the N sets of original images may be searching for an original image matching the first zoom magnification from the N sets of original images, and replacing the searched original image with a corresponding image in the first multimedia file, such as an image photographed at the same time, or a photographed image of the same scene, so as to obtain the second multimedia file.

In other embodiments, the obtaining the second multimedia file based on the first zoom magnification and the N sets of original images may be searching at least one set of original images close to the first zoom magnification from the N sets of original images, and performing a first process on the at least one set of original images, for example: at least one of up-sampling, down-sampling, cropping, stitching and the like is performed to obtain an intermediate image, and finally, the intermediate image is replaced by a corresponding image in the first multimedia file, such as an image photographed at the same time or a photographed image of the same scene, so as to obtain a second multimedia file.

In the embodiment of the application, N groups of original images are acquired, under a shooting scene in which zooming adjustment operation is inconvenient, the N cameras of the electronic equipment can be utilized to shoot images or videos according to different zooming multiplying powers, so that N groups of original images are obtained, under the condition that a zooming editing interface of a related multimedia file is displayed, the wanted images or videos can be obtained based on the zooming multiplying power wanted by a user and the N groups of original images, zooming operation is carried out on the images and videos after shooting is completed, even if the images and videos with the wanted zooming multiplying power are not obtained during shooting, the images and videos can be obtained based on subsequent operation after shooting is completed, and the embodiment of the application does not need to be limited by the shooting scene, and free zooming of the images or videos can be realized.

In some implementations, the first input can be an operation performed by a user in the album application, such as: and displaying a zooming editing interface of the first multimedia file in the album interface, wherein the first zooming magnification can be adjusted through the first input so as to obtain a final second multimedia file according to N groups of original images corresponding to the first multimedia file.

Two alternative embodiments of the first input are exemplified below, and a manner of determining the first zoom magnification from the first input is exemplified:

mode one:

as an optional implementation manner, the zooming editing interface of the first multimedia file includes a first preview window and a second preview window, where the first preview window is used for displaying preview images of the first multimedia file, and the second preview window is used for displaying preview images of the N groups of original images;

the receiving a first input from a user to the zoom editing interface includes:

a first input from a user to the second preview window is received.

In some embodiments, the first input is a touch input to the second preview window, and at this time, the first zoom magnification may be determined according to information such as a position of the touch input, a touch time, and the like.

In some embodiments, the first input comprises a sliding input;

after the receiving the first input of the user to the zoom editing interface, the method further comprises:

and determining the first zoom magnification according to the sliding distance and the sliding direction of the first input.

In some embodiments, when the second preview window is slid for input, the preview images of N groups of original images in the second preview window may be triggered to be displayed in a switching manner, and finally, when the sliding input is finished, the zoom magnification of the original images displayed in the second preview window is the first zoom magnification.

In some embodiments, the sliding direction of the sliding input is used to adjust the switching order of the preview images displayed in the second preview window, such as switching the preview images of the N groups of original images in order of zoom magnification from large to small, or switching the preview images of the N groups of original images in order of zoom magnification from small to large. Further, the sliding distance of the sliding input is used to adjust the number of switching of preview images displayed in the second preview window, e.g., the larger the sliding distance, the more switching of preview images displayed in the second preview window.

In other embodiments, the first preview window displays a preview image of the first target image, and the second preview window displays a preview image of N sets of original images, the N sets of original images including the first target image; at this time, the first input may be a slide input to the second preview window, a slide distance and a slide direction of the slide input are related to a zoom increment, and the first zoom magnification is a sum of the zoom increment and a zoom magnification of the first target image.

In some embodiments, the first target image may be an image previewed in the first preview window, where in an initial stage, the first target image defaults to an original image captured by a specified camera, such as an original image captured by a main camera.

In some embodiments, the first preview window may be understood as a preview window of the first multimedia file.

In some embodiments, the second preview window may be understood as a preview window of zoom magnification, for example: as shown in fig. 6, the preview interface of the first multimedia file may include a first preview window 61 and a second preview window 62, where the first preview window 61 displays a preview image of the first multimedia file, and defaults to a preview image of an original image captured by the main camera, and the second preview window 62 displays a preview image of N groups of original images, or the second preview window 62 may also display a preview image of an image obtained by up-sampling or down-sampling based on at least one group of images in the N groups of original images.

In some embodiments, the first input may be a click operation on a set of preview images in the second preview window 62, and at this time, a zoom magnification corresponding to the preview image clicked by the user may be determined as the first zoom magnification.

In some embodiments, the first input may be a sliding input to the second preview window 62, where the first zoom magnification is related to a sliding direction and a sliding distance of the sliding input.

In some embodiments, the first input comprises a sliding input in a preset direction;

the determining a first zoom magnification according to the first input includes:

determining a zoom increment according to the sliding distance and the sliding direction of the first input;

and determining a first zoom magnification according to the sum of the zoom increment and the zoom magnification of the first target image.

The first target image may be an original image corresponding to an initial zoom magnification of the first multimedia file before the first input is performed, for example: and displaying a preview image of the original image shot by the first camera in the album preview interface by default, wherein at the moment, the initial zoom magnification of the first multimedia file is the zoom magnification of the original image shot by the first camera.

For example: as shown in fig. 6, 3 preview images of the original images are displayed in the second preview window 62 in order of zoom magnification from small to large, when the user's finger slides rightward in the second preview window 62, a zoom increment may be determined according to the distance the user's finger slides, at which time the zoom increment is greater than 0 and positively correlated with the sliding distance, i.e., the greater the sliding distance, the greater the zoom increment.

For another example: as shown in fig. 7, 3 preview images of the original images are displayed in the second preview window 62 in order of zoom magnification from small to large, when the user's finger slides leftwards in the second preview window 62, a zoom increment may be determined according to the sliding distance of the user's finger, at which time the zoom increment is smaller than 0 and inversely related to the sliding distance, i.e., the larger the sliding distance, the smaller the zoom increment.

It should be noted that, in some embodiments, there may be a case where the first input is performed multiple times to make multiple adjustments to the first zoom magnification, where the zoom magnification of the first target image may be the initial zoom magnification of the multimedia file before the first input is performed each time, that is, the first zoom magnification obtained when the first input is performed last time.

In some embodiments, in the case where the first input is a sliding input, the preview image in the second preview window 62 follows the sliding input to switch positions, for example: as shown in fig. 7, when the user's finger slides leftward, the preview image in the second preview window 62 is scrolled and displayed leftward, and when the user's finger slides rightward, the preview image in the second preview window 62 is scrolled and displayed rightward, so as to ensure that the zoom magnification corresponding to the preview image displayed in the middle area of the second preview window 62 is closest to the first zoom magnification.

In this embodiment, by displaying the first preview window and the second preview window in the zoom editing interface of the first multimedia file and displaying the preview images of the N groups of original images in the second preview window, the first zoom magnification may be determined based on the zoom magnifications of the N groups of original images according to the first input of the preview images of the N groups of original images by the user.

Mode two:

as an optional implementation manner, the zooming editing interface of the first multimedia file comprises a first preview window and a zooming control, wherein the first preview window is used for displaying a preview image of the first multimedia file;

The receiving a first input from a user to the zoom editing interface includes:

receiving a first input of a user to the zoom control;

or receiving touch input of a user to the first preview window.

In some embodiments, the zoom control may be associated with a zoom magnification of at least two candidates, and when a first input to the zoom control is received, the first zoom magnification may be determined from the zoom magnifications of the at least two candidates associated with the zoom control based on the first input.

In some implementations, the zoom control may be displayed within the first preview window.

In some embodiments, the transparency of the zoom control is greater than 0 and less than 100%.

In some embodiments, the zoom control is associated with at least two candidate zoom magnifications, and the zoom control may include options corresponding to at least two candidate zoom magnifications one by one, where the first input may be a selection operation of one of the options.

For example: as shown in fig. 8, the zoom control 81 includes, respectively, zoom magnifications: and the first zoom magnification is determined to be 0.6X when the user clicks the option corresponding to 0.6X, and the options corresponding to 0.6X, 1X, 3X and 5X.

In some embodiments, the zoom control is associated with at least two candidate zoom magnifications, the first zoom magnification may be adjusted by operating the zoom control, and the adjustment range of the first zoom magnification is the range of the at least two candidate zoom magnifications associated with the zoom control.

For example: as shown in fig. 8, the zoom control 81 includes, respectively, zoom magnifications: 0.6X, 1X, 3X, 5X, when the user drags the zoom control 81 to slide downwards, the zoom magnification of the preview image displayed in the first preview window 61 is switched from large to small in at least two candidate zoom magnifications associated with the zoom control, when the user leaves the zoom control, the zoom magnification of the preview image displayed in the first preview window 61 is stopped being switched, and the zoom magnification of the preview image displayed in the first preview window 61 at this time is determined to be the first zoom magnification.

In other embodiments, when the first image is displayed in the first preview window, the first zoom magnification of the first image may be gradually increased by the double-finger out-expansion touch operation; or gradually reducing the first zoom magnification of the first image through the double-finger inward-shrinking touch operation, wherein the expansion range or the inward-shrinking range of the double-finger outward-expansion touch operation or the double-finger inward-shrinking touch operation is used for determining the first zoom magnification of the first image displayed in the first preview window.

In this embodiment, the first preview window and the zoom control are displayed in the zoom editing interface of the first multimedia file, so that the first zoom magnification may be determined according to the first input of the zoom control by the user.

It should be noted that the implementation manners of the two first inputs may be combined, that is, the first preview window, the second preview window and the zoom control are displayed in the preview window of the first multimedia file, and at this time, the first zoom magnification may be adjusted by performing the first input on at least one of the second preview window and the zoom control.

It should be noted that the zoom magnification of the N sets of original images may include the first zoom magnification, or the first zoom magnification may be any zoom magnification between a maximum zoom magnification of the N sets of original images and a minimum zoom magnification of the N sets of original images.

In one embodiment, if the zoom magnification of the N sets of original images includes the first zoom magnification, a second multimedia file is generated from the original image corresponding to the first zoom magnification, for example: and taking the original image corresponding to the first zoom magnification as a second multimedia file.

In some embodiments, the determining the first zoom magnification according to the sliding distance and the sliding direction of the first input includes:

determining a third image from the N groups of original images according to the sliding distance and the sliding direction;

and determining the zooming magnification corresponding to the third image as the first zooming magnification.

For example: as shown in fig. 7, assuming that the first input is a slide input to the second preview window 62, when the user's finger slides leftward, the preview image in the second preview window 62 is displayed in a left scroll, when the user's finger slides rightward, the preview image in the second preview window 62 is displayed in a right scroll, and when the first input is ended, the preview image displayed in the middle area of the second preview window 62 is the preview image of the third image.

In another embodiment, if the zoom magnification of the N sets of original images does not include the first zoom magnification, the second multimedia file is generated according to the first zoom magnification and at least one set of original images of the N sets of original images.

As an optional implementation manner, the obtaining the second multimedia file based on the first zoom magnification and the N groups of original images includes:

Determining a second image from the N groups of original images based on the first zoom magnification; or determining at least one fourth image from the N groups of original images, and performing first processing on the at least one fourth image based on the first zoom magnification to obtain a second image;

replacing a corresponding first image in the first multimedia file based on the second image;

wherein the first process comprises at least one of:

upsampling, downsampling, cutting and splicing.

In an embodiment, the determining, based on the first zoom magnification, a second image from the N sets of original images indicates that the N sets of original images have the original image with the first zoom magnification, so that the original image is replaced by the corresponding first image in the first multimedia file, and a second multimedia file may be obtained.

In another embodiment, the determining at least one fourth image from the N sets of original images, and performing a first process on the at least one fourth image based on the first zoom magnification to obtain a second image, where the N sets of original images do not have the original image with the first zoom magnification, so that at least one set of original images close to the first zoom magnification or an original image captured at the same time as an image previewed in the first preview window is required to be used as the fourth image, and at least one of upsampling, downsampling, cropping, and stitching the fourth image is performed to obtain the second image. And finally, replacing the corresponding first image in the first multimedia file by the obtained second image so as to obtain the second multimedia file.

For example: let n=3, and the zoom magnifications of the 3 original images are respectively: 0.6 times, 1 time and 4 times, and the first zoom magnification is 3 times, then a second multimedia file with the first zoom magnification being 3 times may be generated based on the original image with the zoom magnification being 1 time, that is, the fourth image is the original image with the zoom magnification being 1 time, for example: and up-sampling the original image with the zooming magnification of 1 time to obtain an intermediate image with the zooming magnification of 3 times, and cutting the edge part of the intermediate image to obtain a second image with the first zooming magnification of 3 times and the image size consistent with that of the first image.

For another example: let n=3, and the zoom magnifications of the 3 original images are respectively: 0.6 times, 1 time and 4 times, and the first zoom magnification is 3 times, then the second image with the first zoom magnification being 3 times may be generated based on the original images with the zoom magnifications being 1 and 4 times, respectively, that is, the fourth image includes the original images with the zoom magnifications being 1 and 4 times, respectively, such as: and downsampling the original image with the zoom magnification of 4 times to obtain a first intermediate image with the zoom magnification of 3 times, upsampling the original image with the zoom magnification of 1 time to obtain a second intermediate image with the zoom magnification of 3 times, then cropping the first intermediate image, reserving the image content of a designated area (such as an image center area) to obtain a third intermediate image, cropping the second intermediate image, reserving an area (such as an edge area) matched with the cropping area of the third image to obtain a fourth intermediate image, and finally stitching the third intermediate image and the fourth intermediate image to obtain a complete image, namely the second image.

In this embodiment, at least one of upsampling, downsampling, cropping, and stitching is performed on at least some of the N sets of original images, so that the image sharpness, the view range covered by the image, and the like can be adjusted to obtain a second image matching the first zoom magnification.

In some embodiments, after the receiving the first input from the user to the editing interface, the method further comprises:

and updating the preview image displayed in the first preview window.

For example: the preview image displayed in the first preview window 61 changes following the change of the first zoom magnification. That is, in the case where the first input is received and the first zoom magnification is determined, the second multimedia file may be previewed through the first preview window 61.

In this embodiment, after the first zoom magnification is adjusted, the preview image of the second multimedia file matching the first zoom magnification may be displayed in the first preview window in synchronization with the first preview window.

In some embodiments, after the first zoom magnification is adjusted, a preview image matching the first zoom magnification may also be displayed at an intermediate position of the second preview window.

In some implementations, the candidate zoom magnification option for the first zoom magnification may also be highlighted on the zoom control after the first zoom magnification is adjusted.

For example: as shown in fig. 8, when the user clicks on the 0.6X option on the zoom control 81, a preview of the image of 0.6X is displayed in the first preview window 61, and correspondingly scrolls to the preview corresponding to 0.6X in the second preview window 62. When the user slides the zoom control 81 downward to zoom out the first zoom magnification, the preview image in the first preview window 61 is switched to the preview image of the image corresponding to the zoomed out first zoom magnification, and the preview image in the second preview window 62 is scrolled rightward until the preview image of the image corresponding to the zoomed out first zoom magnification is displayed. When the user slides the zoom control 81 upward to increase the first zoom magnification, the preview image in the first preview window 61 is switched to the preview image of the image corresponding to the increased first zoom magnification, and the preview image in the second preview window 62 is scrolled to the left until the preview image of the image corresponding to the increased first zoom magnification is displayed.

In this embodiment, after the first zoom magnification is adjusted to generate the second multimedia file, preview images of the second multimedia file are synchronously displayed in the first preview window and the second preview window, so that a user previews the second multimedia file or previews the zoom magnification of the second multimedia file.

In some embodiments, the display of the zoom editing interface of the first multimedia file may be triggered when the fourth input is received, and at least one of the above-mentioned second preview window and the above-mentioned zoom control is displayed in the zoom editing interface, for example: the preview interface of the first multimedia file comprises a first preview window by default, the preview image of the original image shot by the first camera (such as a main camera) is displayed in the first preview window by default, when the user is detected to execute a fourth input (such as a touch operation of two-finger zooming or two-finger separation) on the preview image, a zooming editing interface of the first multimedia file is displayed, and at least one of the second preview window and the zooming control is displayed in the zooming editing interface.

It is noted that the original images captured by different cameras differ in view range and sharpness, for example: the angle of view of the main camera is smaller than that of the wide-angle camera, so that the original image shot by the main camera may not contain the edge framing content of the original image shot by the wide-angle camera; in addition, the focal length of the main camera is shorter than that of the tele camera, and therefore, the view content in the original image photographed by the main camera is not clear. When the preview image of the original image shot by the main camera is displayed in the first preview window, the user can zoom the preview image of the first multimedia file through touch operation of double-finger closing or double-finger separation, and at this time, at least one of the second preview window and the zoom control can be triggered to be displayed on a zoom editing interface of the first multimedia file. So that the user can adjust the first zoom magnification by operating at least one of the second preview window and the zoom control.

In the above description of the present application, the first multimedia file and the second multimedia file are usually taken as examples to illustrate the pictures, and in addition, the first multimedia file and the second multimedia file may also be videos, that is, in the process of capturing the videos, N cameras are used to capture the videos based on different zoom magnifications, and after N original videos are obtained by capturing, the zoom magnifications of the final video may be adjusted through post-processing.

As an optional implementation manner, in a case that N sets of original images are frame images in N original videos, the first multimedia file includes a first video, the frame images in the first video are associated with at least one frame image in the N original videos, and the zoom editing interface includes a first preview window and a second preview window, where the first preview window is used for displaying preview images of the first video, and the second preview window is used for displaying preview images of the N original videos.

In some embodiments, the frame image in the first video is associated with at least one frame image in the N original videos, which may be that the frame images corresponding to the same frame time in the first video and the N original videos are associated.

In some embodiments, the frame rate or code rate of the N original videos is the same, and at this time, the frame moments of the image frames in the N original videos are the same. In this case, the N frame images corresponding to the same frame time in the N original videos are correlated, so that the N correlated frame images are pictures shot by different cameras at the same time.

Of course, the frame rate or code rate of the N original videos may be different, at this time, for the frame images in the first video, assuming that the frame time is the target frame time, only less than N original videos may have the frame image corresponding to the target frame time in the N original videos.

It should be noted that, based on the N original videos and the first zoom magnifications, the process of obtaining the second multimedia file (i.e. the second video) may refer to the first zoom magnifications determined according to the first input and the description content of generating the second multimedia file by using the N original images, where the difference includes: after determining the first zoom magnification according to the first input, a frame image in the first video needs to be subjected to zoom magnification adjustment frame by frame, wherein the process of performing zoom magnification adjustment on one frame image may include: and in the process of needing to adjust the zoom magnification of the first image in the first video, acquiring at least one frame of image associated with the first image in the N original videos, and performing at least one of up-sampling, down-sampling, cutting and splicing processing on the at least one frame of image based on the first zoom magnification to obtain a second image of a corresponding frame in the second video. The specific process is similar to the process of generating the second multimedia file according to the N groups of original images and the first zoom magnification, and will not be described herein.

In some embodiments, zoom magnification adjustment may be performed on each frame of image in the first video, so as to obtain a second multimedia file.

In other embodiments, zoom magnification adjustment may be performed on the partial frame images in the first video, so as to obtain a second multimedia file.

In some embodiments, different frame images in the first video may be adjusted based on different zoom magnifications.

In some embodiments, different frame images in the first video may be adjusted based on the same zoom magnification.

In some embodiments, the first zoom magnification adjustment may be performed on a portion of the frame images in the first video, and the second zoom magnification adjustment may be performed on another portion of the frame images in the first video, where the first zoom magnification adjustment and the second zoom magnification adjustment are different zoom magnification adjustment schemes.

In some embodiments, a special mirror mode may also be implemented by dynamically zooming the entire video, a frame image within a section of the video, or a frame image.

In some embodiments, the zoom magnification adjustment may be selected by default for all frame images in the first video. For example: the user selects 0.6X through a first input, and all frame images in the first video are switched to pictures corresponding to 0.6X; if the user selects 5X through the first input, all frame images in the first video are switched to the frames corresponding to 5X, and the Field angle (FOV) Of the whole video is reduced compared with 0.6X, but the distant object is clearer.

As an alternative embodiment, before the receiving the first input of the user to the zoom editing interface, the method further includes:

receiving a second input of a user to the first preview window;

in response to the second input, a first image is determined, and at least one fifth image associated with the first image is displayed in the second preview window, wherein the zooming magnification corresponding to the fifth image is different from the zooming magnification corresponding to the first image.

In some embodiments, the first image represents a frame image of the first video that needs to be zoomed in.

In some embodiments, the fifth image may be a frame image associated with the first image from among N original videos.

In some embodiments, the first image may be a frame image displayed within the first preview window during execution of the second input.

In this embodiment, a frame image for which zoom magnification adjustment is required may be selected from the first video by the second input to the first preview window.

In another embodiment, the second preview window includes a first display area for displaying video frame thumbnails of the first video and a second display area for displaying video frame thumbnails of the N original videos;

Before the receiving the first input of the user to the zoom editing interface, the method further comprises:

receiving a third input of a user to the first display area;

at least one frame of the first image is determined in response to the third input.

Wherein the first display area may be used to display a preview image of at least one frame of image in the first video.

In some embodiments, the third input may include at least one of a click, a slide, and a like touch input to the first display area, and the first image may include at least one of:

inputting the clicked frame image;

a frame image located on a sliding path of the third input;

all frame images located between the two frame images clicked by the third input.

In some embodiments, as shown in fig. 9, the zoom editing interface of the first video includes a first display area 91, a second display area 94, and a zoom control 93.

When the first display area 91 may preview at least two frame images in the first video and a third input is performed on a preview image of the frame images in the first display area 91, the frame images may be used as the first image for which zoom magnification adjustment is required.

For example: as shown in fig. 10, at least one preview image in the first display area 91 may be clicked, and a frame image corresponding to each of the at least one preview image may be selected as the first image, where the third input is a click input to at least one preview image in the first display area 91.

For another example: as shown in fig. 13, one or at least two adjacent preview images may be selected by a frame by sliding input or the like on the preview images in the first display area 91, and a frame image corresponding to the one or at least two adjacent preview images may be used as the first image.

In addition, as shown in fig. 9, the above-mentioned second display area 94 functions similarly to the second preview window in the case where the first multimedia file is a photo application scene, except that the second preview window may be a preview window of an original photo, and the second display area 94 is a preview window of a frame image of the original video.

In other embodiments, the second input includes a first touch operation on a first preview window, where the zoom editing interface of the first video further includes a first preview window, the first preview window is used to switch preview images of frame images in the first video in a preset order, and a duration of the first touch operation includes a time when the first image is switched to be displayed in the first preview window. For example: as shown in fig. 15, a preview image of the first video may be played in the first preview window 92, at this time, when a user performs a touch input of separating or combining two fingers on the preview image of the first video, a touch time of the touch input may be obtained, and a frame image corresponding to the preview image played in the first preview window 92 within the touch time may be used as the first image.

In some embodiments, at least two sets of first images may be selected from the first video, and each set of first images includes at least two adjacent frame images, where each set of first images may be processed at a respective corresponding first zoom magnification. In this way, different zoom magnification adjustments can be performed on different sets of first images.

and replacing the at least one first image with at least one second image with the zoom magnification being the first zoom magnification, wherein the at least one second image is obtained based on the N original videos.

For example: the first image is assumed to be one frame image in the first video, and the second image is an image corresponding to the first image in the same frame time in the N original videos, and at this time, one second image shot based on the first zoom magnification in the second image may be replaced by the first image in the first video, so as to obtain a second video.

In other embodiments, the third input comprises a first sub-input and a second sub-input, the first input comprising a third sub-input and a fourth sub-input;

The receiving a third input from the user to the first display area includes:

receiving a first sub-input of a user to a first thumbnail in the first display area, and receiving a second sub-input of a user to a second thumbnail in the first display area;

wherein at least one third thumbnail is included between the first thumbnail and the second thumbnail;

the third sub-input is used for determining a first sub-zoom magnification of the video frame corresponding to the first thumbnail, and the fourth sub-input is used for determining a second sub-zoom magnification of the video frame corresponding to the second thumbnail, wherein the first sub-zoom magnification is different from the second sub-zoom magnification;

the obtaining a second multimedia file based on the first zoom magnification and the N groups of original images includes:

determining at least one sixth image from the N sets of original images based on the first and second sub-zoom magnifications;

performing second processing on the at least one sixth image to obtain a zooming video frame sequence, wherein the first zooming magnification comprises zooming magnification of the zooming video frame sequence, and the zooming magnification of the zooming video frame sequence is changed from the first sub zooming magnification to the second sub zooming magnification;

Obtaining the second multimedia file based on the zoomed video frame sequence;

wherein the second process comprises at least one of:

upsampling, downsampling, cutting and splicing.

In some embodiments, the first thumbnail and the second thumbnail may be thumbnails of key frames in the first image, and the user may select an entire video frame located between the key frames as a video segment requiring zoom magnification adjustment by selecting the key frames.

In some embodiments, the first sub-input is used to select a start frame in a video segment for which zoom magnification adjustment is desired; the second sub-input is used for selecting a termination frame in the video segment requiring zoom magnification adjustment.

In some embodiments, the third sub-input is used to determine a zoom magnification of the start frame; and the fourth sub-input is used for determining the zoom magnification of the termination frame.

In some embodiments, the second processing is performed on the at least one sixth image to obtain a zoom video frame sequence, so that a difference between zoom magnifications between any two adjacent video frames in the video segment to be subjected to zoom magnification adjustment is equal, and thus the zoom magnifications of the frame images in the video segment to be subjected to zoom magnification adjustment are uniformly graded.

In some embodiments, after a video segment requiring zoom magnification adjustment, the zoom magnification of a frame image in the video segment requiring zoom magnification adjustment may be automatically adjusted by clicking a "gradual change" option under a "fortune mirror" function in a video preview interface (or referred to as a "video editing interface"), so as to form a fortune mirror mode of gradual change of zoom magnification, and realize a special fortune mirror effect from near to far or from far to near: the zoom magnification of each frame will be sequentially increased from the zoom magnification of the 1 st frame to the zoom magnification of the last 1 frame, e.g. setting the first frame F ₁ Is Z ₁ Last frame F _n Is Z _n The first image has n frames, and the zoom magnification of the latter frame is increased or decreased compared with that of the former frameWhen an intermediate frame F is set between the first frame and the last frame _i The corresponding zoom multiplying power is Z _i When the video is displayed, a certain frame F in the video _t Corresponding zoom multiplying power Z _t The method comprises the following steps:

in this embodiment, for a video segment requiring zoom magnification adjustment, the zoom magnification of frame images at both ends of the video segment may be selected, and zoom magnification adjustment processing is performed on each frame image in the video segment, so that the group of video segments implements a special mirror mode.

In some embodiments, as shown in fig. 9, the zoom editing interface of the first video includes a first preview window 92, a first display area 91, a second display area 94, and a zoom control 93.

In some embodiments, the first input includes a sliding input to the second display area 94 along a preset direction, where the second display area 94 displays preview images of N original images corresponding to a first frame time, and the first frame time is a frame time of the first image displayed in the first preview window 92, and a sliding distance of the sliding input is associated with a zoom increment of the first image.

The second display area 94 is similar to the second preview window in the above embodiment, except that it includes: after the first image is selected, the original image associated with the first image of each frame may be previewed on the second display area 94. In other words, the number of first images may be one frame or at least two frames, and if the first images are at least two frames, then the original images respectively associated with each frame of the first images need to be displayed in the second display area 94.

For example: as shown in fig. 13, when the user selects a frame image within a section of video section as the first image, N frames of original images associated with the leftmost 1 st frame first image selected by the black frame in the first display area 91 are displayed by default in the second display area.

The above manner of determining the zoom increment of the first image by the sliding input of the second display area along the preset direction according to the sliding distance of the sliding input has the same principle as the manner of executing the sliding input of the second preview window and determining the zoom increment according to the sliding distance and the sliding direction of the sliding input in the above embodiment, and will not be described herein.

For example: assuming that the initial zoom magnification of the 3-frame first image selected as in fig. 10 is 0.6X, as shown in fig. 11, the first zoom magnification of the 3-frame first image may be adjusted to 5X by performing a touch input to slide right on the second display area 94.

In other embodiments, the first input includes a second touch operation on the first preview window, wherein the second touch operation is for zooming a preview image of a first frame image displayed in the first preview window, and a zoom scale of the second touch operation is associated with a zoom increment of the first image.

As shown in fig. 15, the second touch operation may be a double-finger close-up or double-finger separate touch operation.

In some embodiments, when the user performs a touch operation of two-finger zooming on the first preview window, the zoom increment is smaller than zero, and at this time, the zoom magnification of the first image corresponding to the preview image in the first preview window may be reduced.

In some embodiments, when the user performs a touch operation of two-finger separation on the first preview window, the zoom increment is greater than zero, and at this time, the zoom magnification of the first image corresponding to the preview image in the first preview window may be increased.

In some embodiments, the first preview window is configured to switch the preview images of the frame images in the first video according to a preset sequence, at this time, the user may use, by a touch operation of double-finger zooming or double-finger separation, a frame image corresponding to the preview image displayed by the first preview window in the touch time as a first image, and perform zoom magnification adjustment on the first image according to the double-finger zooming or double-finger separation touch operation.

In this embodiment, the user may control the speed of the two-finger closing or the two-finger separating by himself, so as to adjust the zoom magnification change speed of the continuous frame images in the second video.

In still other embodiments, the third sub-input and the fourth sub-input may include inputs to a zoom control, where the zoom control is similar to the zoom control in the above embodiment, and a manner of determining the first zoom magnification by performing the first input to the zoom control is the same, which is not described herein.

For example: as shown in fig. 16, after one frame of the first image is selected, the candidate zoom magnification on the zoom control 93 may be clicked to determine the candidate zoom magnification as the zoom magnification of the first image in the selected state, or the zoom control is slid to adjust the zoom magnification of the first image in the selected state according to the sliding distance.

For another example: assuming that the initial zoom magnification of the 3-frame first image selected as in fig. 10 is 0.6X, as shown in fig. 12, the first zoom magnification of the 3-frame first image may be adjusted to 5X by making a touch input to slide up the zoom control 93.

In some embodiments, in the case that the number of the first images is at least two, a part of the first images may be selected first, and a first candidate zoom magnification on the zoom control may be clicked to determine the first candidate zoom magnification as a first sub-zoom magnification of the part of the first images, then another part of the first images may be selected again, and a second zoom magnification on the zoom control may be clicked to determine the first candidate zoom magnification as a second sub-zoom magnification of the another part of the first images.

In some embodiments, in a case where the number of the first images is at least two and the first zoom magnifications of the first images are not completely identical, the first zoom magnifications of the respective first images may be displayed in the first display region.

For example: as shown in fig. 14, for the first images adjacent to each other and having the first zoom magnification in agreement, the same box 911 in the first display area 91 may be displayed, and the corresponding first zoom magnification may be displayed in the box 911. In some embodiments, the frame colors or background colors of the boxes 911 corresponding to different first zoom magnifications may be different.

It should be noted that the first input and the second input may be the same input, for example: as shown in fig. 15, when a preview image of a first video is played in a first preview window, through a double-finger out-expansion touch operation, the respective first zoom magnifications of the first images corresponding to the preview image played in the first preview window during the touch period are gradually increased; or gradually reducing the first zoom ratio of the first image played in the first preview window during touch through the double-finger inward-contraction touch operation, wherein at this time, the touch time of the double-finger outward-expansion touch operation or the double-finger inward-contraction touch operation is used for selecting the first image, and the outward-expansion range or the inward-contraction range of the double-finger outward-expansion touch operation or the double-finger inward-contraction touch operation is used for determining the first zoom ratio of the selected first image.

In the present embodiment, after capturing a video, zoom magnification adjustment may be performed on all or part of frame images in the video.

According to the multimedia file processing method provided by the embodiment of the application, the execution main body can be a multimedia file processing device. In the embodiment of the present application, a multimedia file processing device executes a multimedia file processing method as an example, and the multimedia file processing device provided in the embodiment of the present application is described.

Referring to fig. 17, a block diagram of a multimedia file processing apparatus 1700 according to an embodiment of the present application is shown in fig. 7, where the multimedia file processing apparatus 1700 includes the following modules:

a first obtaining module 1701, configured to obtain N groups of original images, where N groups of original images are images obtained by photographing the same scene, and zoom magnifications corresponding to different groups of original images are different, and N is an integer greater than 1;

the first interaction module 1702 is configured to receive, when a zoom editing interface of a first multimedia file is displayed, a first input of a user to the zoom editing interface, where the first multimedia file has an association relationship with the N sets of original images;

the first processing module 1703 is configured to obtain, in response to the first input, a second multimedia file based on a first zoom magnification and the N sets of original images, where the first zoom magnification is a zoom magnification determined based on the first input, and at least one second image in the second multimedia file is different from a zoom magnification of at least one corresponding first image in the first multimedia file.

In some embodiments, the zoom editing interface of the first multimedia file includes a first preview window for displaying preview images of the first multimedia file and a second preview window for displaying preview images of the N sets of original images;

a first interaction module 1702 for:

a first input from a user to the second preview window is received.

In some embodiments, the zoom editing interface of the first multimedia file includes a first preview window for displaying a preview image of the first multimedia file and a zoom control;

a first interaction module 1702 for:

receiving a first input of a user to the zoom control;

or receiving touch input of a user to the first preview window.

In some embodiments, the first input comprises a sliding input;

the multimedia file processing apparatus 1700 further includes:

and the first determining module is used for determining the first zoom multiplying power according to the sliding distance and the sliding direction of the first input.

In some embodiments, the first determining module includes:

a first determining unit configured to determine a third image from the N sets of original images according to the sliding distance and the sliding direction;

And the second determining unit is used for determining the zooming magnification corresponding to the third image as the first zooming magnification.

In some embodiments, the first processing module 1703 includes:

a third determination unit configured to determine a second image from the N sets of original images based on the first zoom magnification; or the third determining unit is used for determining at least one fourth image from the N groups of original images, and performing first processing on the at least one fourth image based on the first zoom magnification to obtain a second image;

a replacing unit, configured to replace a corresponding first image in the first multimedia file based on the second image;

wherein the first process comprises at least one of:

upsampling, downsampling, cutting and splicing.

In some implementations, the multimedia file processing apparatus 1700 further comprises:

and the updating module is used for updating the preview image displayed in the first preview window.

In some embodiments, in a case where the N sets of original images are frame images in N original videos, the first multimedia file includes a first video, the frame images in the first video are associated with at least one frame image in the N original videos, and the zoom editing interface includes a first preview window for displaying preview images of the first video and a second preview window for displaying preview images of the N original videos.

the second interaction module is used for receiving a second input of a user to the first preview window;

and the second processing module is used for responding to the second input, determining a first image and controlling the display module to display at least one fifth image associated with the first image in the second preview window, wherein the zooming magnification corresponding to the fifth image is different from the zooming magnification corresponding to the first image.

In some embodiments, the second preview window includes a first display area for displaying video frame thumbnails of the first video and a second display area for displaying video frame thumbnails of the N original videos;

the multimedia file processing apparatus 1700 further includes:

the third interaction module is used for receiving a third input of a user to the first display area;

and a second determining module for determining at least one frame of the first image in response to the third input.

In some embodiments, the first processing module 1703 is configured to:

In some embodiments, the third input comprises a first sub-input and a second sub-input, the first input comprising a third sub-input and a fourth sub-input;

the third interaction module is configured to:

a first processing module 1703, comprising:

a fourth determining unit configured to determine at least one sixth image from the N sets of original images based on the first sub-zoom magnification and the second sub-zoom magnification;

a first processing unit, configured to perform a second process on the at least one sixth image to obtain a zoom video frame sequence, where the first zoom magnification includes a zoom magnification of the zoom video frame sequence, and the zoom magnification of the zoom video frame sequence changes from the first sub-zoom magnification to the second sub-zoom magnification;

A second processing unit, configured to obtain the second multimedia file based on the zoom video frame sequence;

wherein the second process comprises at least one of:

upsampling, downsampling, cutting and splicing.

the first display module is used for displaying a first multimedia file, and the first multimedia file comprises a zooming mark;

a fourth interaction module for receiving a fourth input from the user:

and the second display module is used for responding to the fourth input and displaying a zooming editing interface of the first multimedia file.

The multimedia file processing apparatus 1700 in the embodiment of the present application may be an electronic device, or may be a component in an electronic device, such as an integrated circuit or a chip. The electronic device may be a terminal, or may be other devices than a terminal. By way of example, the electronic device may be a mobile phone, tablet computer, notebook computer, palm computer, vehicle-mounted electronic device, mobile internet appliance (Mobile Internet Device, MID), augmented reality (augmented reality, AR)/Virtual Reality (VR) device, robot, wearable device, ultra-mobile personal computer, UMPC, netbook or personal digital assistant (personal digital assistant, PDA), etc., but may also be a server, network attached storage (Network Attached Storage, NAS), personal computer (personal computer, PC), television (TV), teller machine or self-service machine, etc., and the embodiments of the present application are not limited in particular.

The multimedia file processing apparatus 1700 in the embodiment of the present application may be an apparatus having an operating system. The operating system may be an Android operating system, an ios operating system, or other possible operating systems, which are not specifically limited in the embodiments of the present application.

The multimedia file processing apparatus 1700 provided in this embodiment of the present application can implement each process implemented by the method embodiment shown in fig. 1, so as to achieve the same technical effect, and in order to avoid repetition, a detailed description is omitted here.

In some embodiments, as shown in fig. 18, the embodiment of the present application further provides an electronic device 1800, including a processor 1801 and a memory 1802, where the memory 1802 stores a program or an instruction that can be executed on the processor 1801, where the program or the instruction implements each step of the embodiment of the method for processing a multimedia file when executed by the processor 1801, and the steps can achieve the same technical effects, so that repetition is avoided and no further description is given here.

The electronic device in the embodiment of the application includes the mobile electronic device and the non-mobile electronic device described above.

Fig. 19 is a schematic hardware structure of an electronic device implementing an embodiment of the present application.

The electronic device 1900 includes, but is not limited to: radio frequency unit 1901, network module 1902, audio output unit 1903, input unit 1904, sensor 1905, display unit 1906, user input unit 1907, interface unit 1908, memory 1909, and processor 1910.

Those skilled in the art will appreciate that the electronic device 1900 may further include a power source (e.g., a battery) for powering the various components, which may be logically connected to the processor 1910 by a power management system for performing functions such as managing charge, discharge, and power consumption by the power management system. The electronic device structure shown in fig. 19 does not constitute a limitation of the electronic device, and the electronic device may include more or less components than those shown in the drawings, or may combine some components, or may be arranged in different components, which will not be described in detail herein.

The processor 1910 is configured to obtain N groups of original images, where N groups of original images are images obtained by shooting a same scene, and zoom magnifications corresponding to different groups of original images are different, and N is an integer greater than 1;

a user input unit 1907, configured to receive, when the display unit 1906 displays a zoom editing interface of a first multimedia file, a first input of the user to the zoom editing interface, where the first multimedia file has an association relationship with the N sets of original images;

And a processor 1910, configured to obtain, in response to the first input, a second multimedia file based on a first zoom magnification and the N sets of original images, where the first zoom magnification is a zoom magnification determined based on the first input, and at least one second image in the second multimedia file is different from a zoom magnification of a corresponding at least one first image in the first multimedia file.

the receiving of the first input of the zoom editing interface by the user performed by the user input unit 1907 includes:

a first input from a user to the second preview window is received.

Receiving a first input of a user to the zoom control;

or receiving touch input of a user to the first preview window.

In some embodiments, the first input comprises a sliding input;

after the user input unit 1907 performs the receiving of the first input of the user to the zoom editing interface, the processor 1910 is further configured to:

In some implementations, the determining the first zoom magnification according to the sliding distance and the sliding direction of the first input performed by the processor 1910 includes:

In some embodiments, the obtaining, by the processor 1910, a second multimedia file based on the first zoom magnification and the N sets of original images includes:

wherein the first process comprises at least one of:

upsampling, downsampling, cutting and splicing.

In some embodiments, after the user input unit 1907 performs the receiving the first input of the user to the editing interface, the display unit 1906 is further configured to:

and updating the preview image displayed in the first preview window.

In some implementations, before the user input unit 1907 performs the receiving a first input of the user to the zoom editing interface:

a user input unit 1907 for receiving a second input from a user to the first preview window;

The processor 1910 is further configured to determine a first image in response to the second input, and display at least one fifth image associated with the first image in the second preview window, where a zoom magnification corresponding to the fifth image is different from a zoom magnification corresponding to the first image.

before the user input unit 1907 performs the receiving of the first input of the user to the zoom editing interface:

a user input unit 1907 for receiving a third input from a user to the first display area;

the processor 1910 is further configured to determine at least one frame of a first image in response to the third input.

the receiving of the third input of the first display area by the user input unit 1907 includes:

the obtaining, by the processor 1910, a second multimedia file based on the first zoom magnification and the N sets of original images includes:

Obtaining the second multimedia file based on the zoomed video frame sequence;

wherein the second process comprises at least one of: upsampling, downsampling, cutting and splicing.

a display unit 1906, further configured to display a first multimedia file, where the first multimedia file includes a zoom identifier;

the user input unit 1907 is further configured to receive a fourth input of a user:

the display unit 1906 is further configured to display a zoom editing interface of the first multimedia file in response to the fourth input.

The electronic device 1900 provided in the embodiment of the present application can implement the functions implemented by each module shown in fig. 17, and can obtain the same beneficial effects as the functions, so that repetition is avoided, and detailed descriptions are omitted herein.

It should be appreciated that in embodiments of the present application, the input unit 1904 may include a graphics processor (Graphics Processing Unit, GPU) 19041 and a microphone 19042, where the graphics processor 19041 processes image data of still pictures or video obtained by an image capturing device (e.g., a camera) in a video capturing mode or an image capturing mode. The display unit 1906 may include a display panel 19061, and the display panel 19061 may be configured in the form of a liquid crystal display, an organic light emitting diode, or the like. The user input unit 1907 includes at least one of a touch panel 19071 and other input devices 19072. Touch panel 19071, also referred to as a touch screen. Touch panel 19071 may include two parts, a touch detection device and a touch controller. Other input devices 19072 may include, but are not limited to, a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), a trackball, a mouse, a joystick, and so forth, which are not described in detail herein.

The memory 1909 may be used to store software programs and various data. The memory 1909 may mainly include a first memory area storing programs or instructions and a second memory area storing data, wherein the first memory area may store an operating system, application programs or instructions (such as a sound playing function, an image playing function, etc.) required for at least one function, and the like. Further, the memory 1909 may include volatile memory or nonvolatile memory, or the memory 1909 may include both volatile and nonvolatile memory. The nonvolatile Memory may be a Read-Only Memory (ROM), a Programmable ROM (PROM), an Erasable PROM (EPROM), an Electrically Erasable EPROM (EEPROM), or a flash Memory. The volatile memory may be random access memory (Random Access Memory, RAM), static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double Data Rate SDRAM (ddr SDRAM), enhanced SDRAM (Enhanced SDRAM), synchronous DRAM (SLDRAM), and Direct RAM (DRRAM). Memory 1909 in embodiments of the present application includes, but is not limited to, these and any other suitable types of memory.

The processor 1910 may include one or more processing units; optionally, processor 1910 integrates an application processor that primarily handles operations related to the operating system, user interface, and applications, etc., and a modem processor that primarily handles wireless communication signals, such as a baseband processor. It is to be appreciated that the modem processor described above may not be integrated into the processor 1910.

The embodiment of the present application further provides a readable storage medium, where a program or an instruction is stored on the readable storage medium, and when the program or the instruction is executed by a processor, the program or the instruction realizes each process of the embodiment of the multimedia file processing method, and the same technical effect can be achieved, so that repetition is avoided, and no further description is provided herein.

Wherein the processor is a processor in the electronic device described in the above embodiment. The readable storage medium includes computer readable storage medium such as computer readable memory ROM, random access memory RAM, magnetic or optical disk, etc.

The embodiment of the application further provides a chip, the chip includes a processor and a communication interface, the communication interface is coupled with the processor, and the processor is configured to run a program or an instruction, implement each process of the above embodiment of the multimedia file processing method, and achieve the same technical effect, so that repetition is avoided, and no further description is provided here.

It should be understood that the chips referred to in the embodiments of the present application may also be referred to as system-on-chip chips, chip systems, or system-on-chip chips, etc.

The embodiments of the present application provide a computer program product stored in a storage medium, where the program product is executed by at least one processor to implement the respective processes of the embodiments of the multimedia file processing method described above, and achieve the same technical effects, and are not repeated herein.

It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element. Furthermore, it should be noted that the scope of the methods and apparatus in the embodiments of the present application is not limited to performing the functions in the order shown or discussed, but may also include performing the functions in a substantially simultaneous manner or in an opposite order depending on the functions involved, e.g., the described methods may be performed in an order different from that described, and various steps may also be added, omitted, or combined. Additionally, features described with reference to certain examples may be combined in other examples.

From the above description of the embodiments, it will be clear to those skilled in the art that the above-described embodiment method may be implemented by means of software plus a necessary general hardware platform, but of course may also be implemented by means of hardware, but in many cases the former is a preferred embodiment. Based on such understanding, the technical solutions of the present application may be embodied essentially or in a part contributing to the prior art in the form of a computer software product stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk), comprising several instructions for causing a terminal (which may be a mobile phone, a computer, a server, or a network device, etc.) to perform the methods described in the embodiments of the present application.

The embodiments of the present application have been described above with reference to the accompanying drawings, but the present application is not limited to the above-described embodiments, which are merely illustrative and not restrictive, and many forms may be made by those of ordinary skill in the art without departing from the spirit of the present application and the scope of the claims, which are also within the protection of the present application.

Claims

1. A multimedia file processing method, comprising:

2. The method of claim 1, wherein the zoom editing interface of the first multimedia file comprises a first preview window for displaying preview images of the first multimedia file and a second preview window for displaying preview images of the N sets of original images;

The receiving a first input from a user to the zoom editing interface includes:

a first input from a user to the second preview window is received.

3. The method of claim 1, wherein the zoom editing interface of the first multimedia file comprises a first preview window and a zoom control, the first preview window for displaying a preview image of the first multimedia file;

the receiving a first input from a user to the zoom editing interface includes:

receiving a first input of a user to the zoom control;

or receiving touch input of a user to the first preview window.

4. A method according to claim 2 or 3, wherein the first input comprises a sliding input;

5. The method of claim 4, wherein determining the first zoom magnification based on the sliding distance and the sliding direction of the first input comprises:

6. The method of claim 1, wherein the obtaining a second multimedia file based on the first zoom magnification and the N sets of original images comprises:

wherein the first process comprises at least one of:

upsampling, downsampling, cutting and splicing.

7. A method according to claim 2 or 3, wherein after said receiving a first input from a user to the editing interface, the method further comprises:

and updating the preview image displayed in the first preview window.

8. The method of claim 1, wherein, in the case where N sets of the original images are frame images in N original videos, the first multimedia file includes a first video, the frame images in the first video are associated with at least one frame image in the N original videos, and the zoom editing interface includes a first preview window for displaying a preview image of the first video and a second preview window for displaying a preview image of the N original videos.

9. The method of claim 8, wherein prior to receiving the first input from the user to the zoom editing interface, the method further comprises:

receiving a second input of a user to the first preview window;

10. The method of claim 8, wherein the second preview window includes a first display area for displaying video frame thumbnails of the first video and a second display area for displaying video frame thumbnails of the N original videos;

receiving a third input of a user to the first display area;

11. The method of claim 10, wherein the obtaining a second multimedia file based on the first zoom magnification and the N sets of original images comprises:

12. The method of claim 10, wherein the third input comprises a first sub-input and a second sub-input, the first input comprising a third sub-input and a fourth sub-input;

the receiving a third input from the user to the first display area includes:

obtaining the second multimedia file based on the zoomed video frame sequence;

wherein the second process comprises at least one of:

upsampling, downsampling, cutting and splicing.

13. The method of claim 1, wherein prior to receiving the first input from the user to the zoom editing interface, the method further comprises:

receiving a fourth input from the user:

14. A multimedia file processing apparatus, comprising:

15. The apparatus of claim 14, wherein the first processing module comprises:

Wherein the first process comprises at least one of:

upsampling, downsampling, cutting and splicing.

16. The apparatus of claim 14, wherein, in the case where N sets of the original images are frame images in N original videos, the first multimedia file includes a first video, the frame images in the first video are associated with at least one frame image in the N original videos, the zoom editing interface includes a first preview window for displaying a preview image of the first video and a second preview window for displaying a preview image of the N original videos.

17. The apparatus of claim 16, wherein the apparatus further comprises:

18. The apparatus of claim 16, wherein the second preview window comprises a first display area for displaying video frame thumbnails of the first video and a second display area for displaying video frame thumbnails of the N original videos;

the apparatus further comprises:

19. An electronic device comprising a processor and a memory storing a program or instructions executable on the processor, which when executed by the processor, implement the steps of the multimedia file processing method of any one of claims 1 to 13.

20. A readable storage medium, characterized in that it has stored thereon a program or instructions which, when executed by a processor, implement the steps of the multimedia file method of any of claims 1 to 13.