WO2022033272A1

WO2022033272A1 - Image processing method and electronic device

Info

Publication number: WO2022033272A1
Application number: PCT/CN2021/106910
Authority: WO
Inventors: 李钊; 毛珊珊
Original assignee: 北京达佳互联信息技术有限公司
Priority date: 2020-08-13
Filing date: 2021-07-16
Publication date: 2022-02-17
Also published as: CN111954058A; CN111954058B

Abstract

The present disclosure relates to an image processing method and an electronic device, which belong to the technical field of multimedia. The method comprises: in response to a processing instruction for video material, acquiring a plurality of image frames from the video material; determining a target image frame from among the plurality of image frames according to the processing progress of the video material, wherein the target image frame is an image frame corresponding to the processing progress; and displaying the target image frame on a processing progress display interface.

Description

Image processing method and electronic device

The present disclosure claims priority to Chinese Patent Application No. 202010814852.X filed on August 13, 2020, the entire contents of which are incorporated herein by reference.

technical field

The present disclosure relates to the field of multimedia technologies, and in particular, to an image processing method and an electronic device.

Background technique

With the development of computer technology, more and more users will be entertained by watching videos. For the author of a video, in the process of making a video, one or more pieces of video material need to be processed by a video processing application, such as adding drawn graphics to a piece of video material or splicing multiple pieces of video material into a complete video .

SUMMARY OF THE INVENTION

The present disclosure provides an image processing method and an electronic device, and the technical solutions of the present disclosure are as follows:

In one aspect, an image processing method is provided, comprising:

obtaining a plurality of image frames from the video material in response to processing instructions for the video material;

determining a target image frame from the plurality of image frames according to the processing progress of the video material, where the target image frame is an image frame corresponding to the processing progress;

On the processing progress display interface, the target image frame is displayed.

In some embodiments, the determining a target image frame from the plurality of image frames according to the processing progress of the video material includes:

In response to starting to process any one of the plurality of image frames, the any one of the image frames is determined to be the target image frame.

In response to the completion of processing any one of the plurality of image frames, the processed one of the image frames is determined as the target image frame.

In some embodiments, the obtaining a plurality of image frames from the video material includes:

obtaining a plurality of reference image frames from the video material;

determining quality information for the plurality of reference image frames;

The plurality of image frames are determined from the plurality of reference image frames based on the quality information of the plurality of reference image frames, the quality information of the plurality of image frames conforming to the target condition.

In some embodiments, the determining the quality information of the plurality of reference image frames comprises:

acquiring at least two items of definition information, color richness information, and content information of the multiple reference image frames;

The quality information of the multiple reference image frames is obtained by fusing at least two items of the definition information, the color richness information and the content information of the multiple reference image frames.

In some embodiments, the displaying of the target image frame on the processing progress display interface includes:

The target image frame is cropped, and the cropped target image frame is displayed on the image frame display area of the processing progress display interface.

In some embodiments, the cropping the target image frame comprises:

determining a target area, the target area containing the target object;

Delete the portion outside the target area.

In response to the change of the processing progress, the first image frame is controlled to move outside the image frame display area of the processing progress display interface, and the first image frame is the image frame corresponding to the processing progress before the change;

In response to the first image frame being completely moved out of the image frame display area of the processing progress display interface, a second image frame is displayed on the image frame display area of the processing progress display interface, and the second image frame is after the change The processing progress of the corresponding image frame.

While the first image frame is moving, a second image frame is controlled to enter the image frame display area of the processing progress display interface, and the second image frame is an image frame corresponding to the changed processing progress.

In response to the change in the processing progress, cancel the display of the first image frame, the first image frame is the image frame corresponding to the processing progress before the change;

On the image frame display area of the processing progress display interface, a second image frame is displayed, and the second image frame is an image frame corresponding to the changed processing progress.

In one aspect, an image processing apparatus is provided, comprising:

an acquisition unit, configured to acquire a plurality of image frames from the video material in response to a processing instruction for the video material;

a determining unit, configured to determine a target image frame from the plurality of image frames according to the processing progress of the video material, where the target image frame is an image frame corresponding to the processing progress;

The display unit is configured to display the target image frame on the processing progress display interface.

In some embodiments, the determining unit is configured to, in response to starting to process any one of the plurality of image frames, determine the any one of the image frames as the target image frame.

In some embodiments, the determining unit is configured to, in response to completion of processing any image frame among the plurality of image frames, determine the processed image frame as the target image frame.

In some embodiments, the obtaining unit is configured to obtain a plurality of reference image frames from the video material; determine quality information of the plurality of reference image frames; based on the quality information of the plurality of reference image frames , determining the plurality of image frames from the plurality of reference image frames, and the quality information of the plurality of image frames conforms to the target condition.

In some embodiments, the obtaining unit is configured to obtain at least two items of sharpness information, color richness information and content information of the multiple reference image frames; At least two items of degree information, color richness information, and content information are obtained to obtain the quality information of the multiple reference image frames.

In some embodiments, the display unit is configured to crop the target image frame, and displays the cropped target image frame on the image frame display area of the processing progress display interface.

In some embodiments, the display unit is configured to determine a target area, the target area contains the target object; and delete the part outside the target area.

In some embodiments, the display unit is configured to control the first image frame to move out of the image frame display area of the processing progress display interface in response to the change of the processing progress, the first image frame is The image frame corresponding to the processing progress before the change; in response to the first image frame being completely moved out of the image frame display area of the processing progress display interface, the second image frame is displayed on the image frame display area of the processing progress display interface , the second image frame is an image frame corresponding to the changed processing progress.

In some embodiments, the display unit is configured to control the first image frame to move out of the image frame display area of the processing progress display interface in response to the change of the processing progress, the first image frame is The image frame corresponding to the processing progress before the change; while the first image frame is moving, control the second image frame to enter the image frame display area of the processing progress display interface, and the second image frame is the processing after the change The image frame corresponding to the progress.

In some embodiments, the display unit is configured to, in response to a change in the processing progress, cancel the display of a first image frame, where the first image frame is an image frame corresponding to the processing progress before the change; On the image frame display area of the processing progress display interface, a second image frame is displayed, and the second image frame is an image frame corresponding to the changed processing progress.

In one aspect, an electronic device is provided, the electronic device comprising:

one or more processors;

memory for storing executable program code for the processor;

wherein the processor is configured to perform the following steps:

In some embodiments, the processor is configured to:

obtaining a plurality of reference image frames from the video material;

determining quality information for the plurality of reference image frames;

In some embodiments, the processor is configured to:

determining a target area, the target area containing the target object;

Delete the portion outside the target area.

In some embodiments, the processor is configured to:

In one aspect, a non-volatile storage medium is provided, when the program code in the storage medium is executed by the processor of the electronic device, the server of the electronic device can perform the following steps:

In some embodiments, the processor is configured to:

In response to completion of processing any one of the plurality of image frames, determining the processed one of the image frames as the target image frame.

In some embodiments, the processor is configured to:

obtaining a plurality of reference image frames from the video material;

determining quality information for the plurality of reference image frames;

In some embodiments, the processor is configured to:

determining a target area, the target area containing the target object;

Delete the portion outside the target area.

In some embodiments, the processor is configured to:

In one aspect, a computer program product is provided, the computer program product stores one or more program codes, and the one or more program codes can be executed by a processor of an electronic device to complete the following steps:

According to the processing progress of the video material, a target image frame is determined from the plurality of image frames, and the target image frame is an image frame corresponding to the processing progress;

In some embodiments, the processor is configured to:

obtaining a plurality of reference image frames from the video material;

determining quality information for the plurality of reference image frames;

In some embodiments, the processor is configured to:

determining a target area, the target area containing the target object;

Delete the portion outside the target area.

In some embodiments, the processor is configured to:

In the present disclosure, in the process of processing the video material, the terminal can display the image frame corresponding to the processing progress to the user as the processing progress changes, so that the user can know the processing of the video material by viewing the image frame. schedule. Compared with displaying the processing progress of the video material to the user in the form of a progress bar or a percentage, the present disclosure displays the processing progress to the user through the image frame, which not only has a better and more vivid and intuitive display effect, but also has a higher efficiency of human-computer interaction. And it can reduce the user's perception of the time cost in the waiting process.

It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure.

Description of drawings

1 is a schematic diagram of an implementation environment of an image processing method according to an exemplary embodiment;

Fig. 2 is a schematic diagram showing a video material selection interface according to an exemplary embodiment;

3 is a flowchart of an image processing method according to an exemplary embodiment;

4 is a flowchart of an image processing method according to an exemplary embodiment;

5 is a schematic diagram of a processing progress display interface according to an exemplary embodiment;

6 is a schematic diagram of a processing progress display interface according to an exemplary embodiment;

7 is a schematic diagram of a processing progress display interface according to an exemplary embodiment;

8 is a schematic diagram of a processing progress display interface according to an exemplary embodiment;

FIG. 9 is a schematic structural diagram of an image processing apparatus according to an exemplary embodiment;

FIG. 10 is a schematic structural diagram of a terminal according to an exemplary embodiment;

Fig. 11 is a schematic structural diagram of a server according to an exemplary embodiment.

detailed description

It should be noted that the terms "first", "second" and the like in the description and claims of the present disclosure and the above drawings are used to distinguish similar objects, and are not necessarily used to describe a specific sequence or sequence. It is to be understood that the data so used may be interchanged under appropriate circumstances such that the embodiments of the disclosure described herein can be practiced in sequences other than those illustrated or described herein.

The implementations described in the illustrative examples below are not intended to represent all implementations consistent with this disclosure. Rather, they are merely examples of apparatus and methods consistent with some aspects of the present disclosure as recited in the appended claims.

The user information involved in the present disclosure may be information authorized by the user or fully authorized by all parties.

FIG. 1 is a schematic diagram of an implementation environment of an image processing method according to an exemplary embodiment. As shown in FIG. 1 , it includes a terminal 101 and a server 102 .

In some embodiments, the terminal 101 is at least one of a smartphone, a smart watch, a desktop computer, a laptop computer, and a laptop portable computer. An application program that supports video processing can be installed and run on the terminal 101, and the user can log in to the application program through the terminal 101 to perform speech recognition. For example, the user selects multiple pieces of video on the terminal 101, and the multiple pieces of video are synthesized into one piece through the application program. video. The terminal 101 can be connected to the server 102 through a wireless network or a wired network.

In some embodiments, the terminal 101 is one of multiple terminals, and this embodiment only takes the terminal 101 as an example for illustration. Those skilled in the art can know that the number of the above-mentioned terminals can be more or less. For example, the above-mentioned terminals 101 can be only a few, or the above-mentioned terminals 101 can be dozens or hundreds, or more, and the embodiments of the present disclosure do not limit the number of terminals 101 and device types.

In some embodiments, the server 102 is at least one of a server, multiple servers, a cloud computing platform, and a virtualization center. The server 102 can be used to determine the quality information of the image frame, and can also be used to process the video sent by the terminal 101 .

The number of the foregoing servers 102 can be more or less, which is not limited in this embodiment of the present disclosure. Of course, in some embodiments, the server 102 also includes other functional servers in order to provide more comprehensive and diverse services.

The image processing method provided by the present disclosure can be applied to a variety of scenarios. For ease of understanding, the application scenarios that may be involved in the present disclosure are first described. The terminal 101 and the server are also the server 102 in the above implementation environment.

The image processing method provided by the present disclosure can be applied in the process of synthesizing multiple video materials. In some embodiments, the user wants to synthesize three video materials: video material A, video material B, and video material C into one video D, Then, the user starts an application program supporting video processing through the terminal. The user imports video materials A, B, and C into the application, and the above three video materials are synthesized through the application. During the process of synthesizing video materials through the application, the terminal can display the image frames of video material A, video material B, and video material C on the processing progress display interface of the application, and the user can know the current video material synthesis through the image frames. progress. Referring to Figure 2, 201 is a video material selection interface provided by an application supporting video material processing, 202 is a content option, "All" means to display all video materials and pictures, "Video" means to display all video materials, "Picture" Indicates that all pictures are displayed, and the user selects different content by clicking on different content options. 203 is the cover of the video material to be processed, the total duration of the video material is displayed on the cover of the video material, and the number in the upper right corner of the cover of the video material indicates the order in which the video material was selected. to determine the video material for processing. 204 is a time display box, which is used to display the total duration of the video material selected by the user. 205 is the cover of the video material selected by the user, and the user can deselect the video material by clicking the "X" in the upper right corner of the cover. After the user completes the selection, the user clicks the "one-click film output" button, and in response to the click operation of the "one-click film output" button, the terminal synthesizes the video material selected by the user through an application program that supports video processing. Alternatively, after the user selects the video material, click the "Next" button to select different filters and synthesis methods for the video material, and the number after "Next" indicates the number of the video material selected by the user.

The image processing method provided by the present disclosure can be applied to the process of processing a single video material. In some embodiments, the user adds different display elements to different image frames of the video material through an application program that supports video material processing. , or the image frames are processed differently, such as adding a line of subtitles to image frame A, adding a pattern to image frame B, sharpening image frame C, and mosaicking image frame D . When the terminal performs the above-mentioned processing on the video material through the application program supporting video processing, if the above-mentioned image frame A, image frame B, image frame C, and image frame D are the target image frames, according to the progress of the video material processing, in the Image frame A, image frame B, image frame C, and image frame D are displayed on the interface of the application program, and the user can know the current video material processing progress by viewing the target image frame.

In some embodiments, in addition to displaying image frame A, image frame B, image frame C, and image frame D on the processing progress display interface of the application, the terminal can also display the post-processing on the processing progress display interface of the application. image frame A, image frame B, image frame C, and image frame D.

In this embodiment of the present disclosure, the execution body of the image processing method may be a terminal or a server. When the execution subject is the server, during the execution of the method, the user sends the video material to the server through the terminal, the server processes the video material, obtains the target image frame, and displays the target image frame through the terminal. For ease of understanding, the following description process is performed by taking the execution subject as the terminal as an example.

Fig. 3 is a flowchart of an image processing method according to an exemplary embodiment. As shown in Fig. 3 , the method includes the following steps.

S301. In response to the processing instruction for the video material, the terminal acquires a plurality of image frames from the video material.

In some embodiments, a video material includes multiple image frames.

S302. The terminal determines a target image frame from a plurality of image frames according to the processing progress of the video material, where the target image frame is an image frame corresponding to the processing progress.

In some embodiments, the processing progress is used to describe which image frame of the plurality of image frames the terminal has processed.

S303. The terminal displays the target image frame on the processing progress display interface.

In the present disclosure, the terminal can display the image frame corresponding to the processing progress to the user in the process of processing the video material, along with the change of the processing progress, so that the user can know the processing of the video material by viewing the image frame. schedule. Compared with displaying the processing progress of the video material to the user in the form of a progress bar or a percentage, the present disclosure displays the processing progress to the user through the image frame, which not only has a better and more vivid and intuitive display effect, but also has a higher efficiency of human-computer interaction. And it can reduce the user's perception of the time cost in the waiting process.

In a possible implementation, in some embodiments, according to the processing progress of the video material, determining the target image frame from the plurality of image frames includes:

In response to starting to process any one of the plurality of image frames, any one of the image frames is determined to be the target image frame.

In some embodiments, according to the processing progress of the video material, determining the target image frame from the plurality of image frames includes:

In response to the completion of processing any one of the plurality of image frames, any one of the processed image frames is determined as the target image frame.

In some embodiments, obtaining the plurality of image frames from the video footage includes:

Get multiple reference image frames from video footage.

Quality information for a plurality of reference image frames is determined.

Based on the quality information of the plurality of reference image frames, a plurality of image frames whose quality information meets the target condition are determined from the plurality of reference image frames.

In some embodiments, determining quality information for the plurality of reference image frames includes:

At least two items of definition information, color richness information, and content information of a plurality of reference image frames are acquired.

In some embodiments, on the processing progress display interface, displaying the target image frame includes:

In some embodiments, cropping the target image frame includes:

Determine the target area, the target area contains the target object.

Delete the part outside the target area.

In response to the change of the processing progress, the first image frame is controlled to move out of the image frame display area of the processing progress display interface, and the first image frame is the image frame corresponding to the processing progress before the change.

In response to the first image frame being completely moved out of the image frame display area of the processing progress display interface, a second image frame is displayed on the image frame display area of the processing progress display interface, where the second image frame is an image corresponding to the changed processing progress frame.

While the first image frame is moving, the second image frame is controlled to enter the image frame display area of the processing progress display interface, and the second image frame is the image frame corresponding to the changed processing progress.

In response to the change of the processing progress, the display of the first image frame is canceled, and the first image frame is the image frame corresponding to the processing progress before the change.

Fig. 4 is a flowchart of an image processing method according to an exemplary embodiment. As shown in Fig. 4 , the method includes the following steps.

S401. In response to the processing instruction for the video material, the terminal acquires a plurality of reference image frames from the video material.

In some embodiments, the video material is the video material stored on the terminal, or the video material obtained by the terminal from the Internet, or the video material captured by the terminal in real time. The number of video materials may be one or multiple, and the embodiments of the present disclosure do not limit the source and number of video materials.

In some embodiments, in response to the processing instruction on the video material, the terminal obtains reference image frames from the video material at every target time interval to obtain a plurality of reference image frames. In this case, the number of reference image frames is equal to the number of reference image frames. The total duration of the video footage is related.

In this implementation manner, the terminal can acquire reference image frames from the video material at target time intervals, which can ensure that the reference image frames acquired by the terminal are evenly distributed in the video material.

For example, in some embodiments, when the terminal processes a video material, in response to a processing instruction for the video material, the terminal decodes the video material to obtain a reference image frame in the video material. For example, the terminal obtains a reference image frame from the video material every M seconds, and obtains multiple reference image frames, where M is a positive integer. In some embodiments, the total duration of the video material A is 30 seconds, and the target time interval is 2 seconds, then the terminal acquires image frames from the video material A every 2 seconds, and a total of 15 image frames are acquired.

In some embodiments, when the terminal processes three video materials, in response to the processing instruction for the three video materials, the terminal decodes the three video materials to obtain reference image frames in the three video materials. The terminal determines the number N of acquired reference image frames according to the total duration of the three video materials and the target time interval M. According to the processing sequence of the three video materials, the terminal first obtains the reference image frame from the first video material. In response to the number of reference image frames acquired from the first video material reaching the first number, the terminal acquires the reference image frames from the second video material. In response to the number of reference image frames acquired from the second video material reaching the second number, the terminal acquires reference image frames from the third video material, and a third number of reference image frames are acquired from the third video material in total . The first quantity is the ratio of the total duration of the first video material to the target time interval M, the second quantity is the ratio of the total duration of the second video material to the target time interval M, and the third quantity is the third video The ratio of the total duration of the material to the target time interval M. In some embodiments, the terminal performs video material synthesis processing on video material A, video material B, and video material C. The total duration of video material A is 30 seconds, the total duration of video material B is 20 seconds, and the total duration of video material C is 20 seconds. The duration is 10 seconds, and the composition sequence of video material A, video material B, and video material C is A+video material B+video material C. When the target time interval is 2 seconds, the terminal determines that the first quantity corresponding to video material A is 15, the second quantity corresponding to video material B is 10, and the third quantity corresponding to video material C is 5. The terminal acquires 15 reference image frames from the video material A every 2 seconds. The terminal acquires 10 reference image frames from the video material B every 2 seconds. The terminal acquires 5 reference image frames from the video material C every 2 seconds, so that the terminal acquires a total of 30 reference image frames from the video material A, the video material B, and the video material C.

In some embodiments, in response to the processing instruction for at least one video material, the terminal randomly obtains reference image frames from at least one video material, respectively, to obtain multiple reference image frames. In this case, the terminal obtains multiple reference image frames from each video material. The number of randomly obtained reference image frames is related to the total duration of the video material.

In this implementation manner, the terminal acquires the reference image frame from at least one video material randomly, and the obtained reference image frame can better reflect the characteristics of each video material as a whole.

For example, in some embodiments, when the terminal processes three video materials, in response to the processing instruction for the three video materials, the terminal decodes the three video materials to obtain the reference in the three video materials. image frame. The terminal determines the number of reference image frames obtained from the three video materials respectively according to the total duration of the three video materials. The terminal randomly acquires reference image frames from the three video materials, respectively, to obtain multiple reference image frames. For example, there are three video materials: video material D, video material E, and video material F. The total duration of video material D is 10 seconds, the total duration of video material E is 5 seconds, and the total duration of video material F is 15 seconds. Obtain The number of reference image frames is 6, then the terminal determines, according to the total duration of video material D, video material E, and video material F, that the number of reference image frames obtained from video material D is 2, and the number of reference image frames obtained from video material E is 2. is 1, and the number of reference image frames obtained from the video material F is 3. The terminal randomly acquires two reference image frames from the video material D, one reference image frame from the video material E, and three reference image frames from the video material F.

S402. The terminal acquires at least two items of definition information, color richness information, and content information of multiple reference image frames.

Wherein, the terminal acquires at least two of the definition information, color richness information, and content information of the multiple reference image frames, including the following situations: the terminal acquires the sharpness information and color richness information of the multiple reference image frames; Acquire sharpness information and content information of multiple reference image frames; the terminal acquires color richness information and content information of multiple reference image frames; and the terminal acquires sharpness information, color richness information and content information of multiple reference image frames.

For ease of understanding, in the following description process, the number of reference image frames is taken as an example for description.

For the definition information, in some embodiments, the terminal converts the reference image frame into a grayscale reference image frame, executes an objective function to process the grayscale values of the pixels of the grayscale reference image frame, and obtains the reference image frame clarity. Of course, in the case where the reference image frame is originally a grayscale image frame, the terminal can directly execute the objective function to process the grayscale values of the pixels of the reference image frame to obtain the definition information of the reference image frame. The function is a sharpness information acquisition function, such as a Brenner gradient function, a Tenengrad gradient function, or a Laplacian gradient function, a grayscale variance (SMD) function, a grayscale variance product ( SMD2) function, entropy function and other functions, the embodiment of the present disclosure does not limit the type of the objective function.

First, a method for converting a reference image frame into a grayscale reference image frame by a terminal is described.

In some embodiments, the terminal adopts any one of formula (1), formula (2), formula (3) or formula (4) to convert the color channels of the pixels of the color reference image frame into the grayscale reference image frame The pixel value of the pixel point.

Gray=R*0.299+G*0.587+B*0.114 (1)

Gray=(R*299+G*587+B*114+500)/1000 (2)

Gray=(R^2.2*0.2973+G^2.2*0.6274+B^2.2*0.0753)^(1/2.2) (3)

Gray=(R+B+G)/3 (4)

Among them, Gray is the gray value of the pixel of the gray reference image frame, R is the red channel value of the pixel of the color reference image frame, G is the green channel value of the pixel of the color reference image frame, and B is the color reference image. The blue channel value of the frame's pixels.

The method for processing the grayscale reference image frame by the terminal executing the objective function to obtain the definition information of the reference image frame is described below:

Taking the objective function as the Brenner gradient function as an example, referring to formula (5), the terminal substitutes the gray value of the pixel point of the gray reference image frame into the Brenner gradient function to obtain the definition information of the reference image frame.

D(f)=Σ _x Σ _y |f(x+2,y)-f(x,y)| ² (5)

Among them, D(f) is the definition information of the reference image frame, (x, y) is the pixel point coordinate of the grayscale reference image frame, and f(x,y) is the grayscale value of the pixel point of the grayscale reference image frame .

Taking the objective function as the Tenengrad gradient function as an example, referring to formula (6), the terminal substitutes the gray value of the pixel point of the gray reference image frame into the Tenengrad gradient function to obtain the definition information of the reference image frame.

Among them, D(f) is the definition information of the reference image frame, (x, y) is the pixel coordinates of the gray reference image frame, and G _x (x, y) is the gray value of the x pixel in the x direction. Gradient value, G _y (x, y) is the gradient value of the gray value of the x pixel in the y direction, and T is the edge detection threshold.

For the color richness information, in some embodiments, the terminal determines the red channel value, the green channel value and the blue channel value of the pixel point of the reference image frame, according to the red channel value and the green channel value of the pixel point of the reference image frame The first parameter is obtained by the difference of the values, and the second parameter is obtained according to the red channel value, the green channel value and the blue channel value of the pixel point of the reference image frame. The terminal determines the average value and standard deviation of the first parameter of different pixel points of the reference image frame, and determines the average value and standard deviation of the second parameter of different pixel points of the reference image frame. The terminal obtains the color richness information of the reference image frame according to the average value and standard deviation of the first parameter and the average value and standard deviation of the second parameter.

In some embodiments, the first parameter is represented by rg and the second parameter is represented by yb, then the first parameter rg=|RH|, and the second parameter yb=|0.5(R+G)-B|. The terminal adds the first parameters rg of different pixel points of the reference image frame and divides it by the total number of pixels in the reference image frame to obtain the average value rg _mean and standard deviation of the first parameters rg of different pixel points of the reference image frame rg _sta . The terminal adds the second parameters yb of different pixel points of the reference image frame and divides it by the total number of pixels in the reference image frame to obtain the mean value yb _mean and the standard deviation of the first parameters yb of different pixel points of the reference image frame yb _sta . The terminal adds the square of rg _mean and the square of yb _mean and then takes the square root to obtain the third parameter a, and adds the square of rg _sta and the square of yb _sta to take the square root to obtain the fourth parameter b. The terminal obtains the color richness information of the reference image frame through the third parameter a and the fourth parameter b, and the color richness information C=b+0.3a.

For content information, in some embodiments, the terminal performs image recognition on the reference image frame to obtain target objects included in the reference image frame, where the target objects include human faces, pets, and buildings. In some embodiments, the terminal sets different weights for the reference image frames according to the recognized objects, for example, a weight of 1 is set for a reference image frame containing a human face, a weight of 0.8 is set for a reference image frame containing a pet, and a weight is set for a reference image frame containing a building. The reference image frame is set with a weight of 0.6, etc., and the terminal adopts the weight to represent the content information of the reference image frame.

In addition, the terminal can also identify completeness information and repetition information of the reference image frame, where the completeness information of the reference image frame is used to indicate whether there is a missing part in the reference image frame, and the coincidence information of the reference image frame is used to indicate the reference image frame. The number of identical content in an image frame. The terminal fuses the weights corresponding to the objects included in the reference image frame with the completeness information and the coincidence information of the reference image frame to obtain content information of the reference image frame. According to the content information of the reference image frame, the terminal can preferentially determine, from the multiple reference image frames, the target reference image frame that contains the target object, the content of the reference image frame is complete, and the content of the reference image frame is less repeated.

S403. The terminal fuses at least two items of definition information, color richness information, and content information of multiple reference image frames to obtain quality information of multiple reference image frames.

In some embodiments, the terminal performs weighted summation on at least two items among the definition information, color richness information, and content information of the reference image frame, to obtain quality information of the reference image frame, wherein the definition information of the reference image frame is , the color richness information, and the weight corresponding to the content information may be set according to the actual situation, which is not limited in this embodiment of the present disclosure.

S404. Based on the quality information of the multiple reference image frames, the terminal determines, from the multiple reference image frames, multiple image frames whose quality information meets the target condition.

The quality information conforming to the target condition means that the quality information is greater than the quality information threshold or the quality information is the K with the highest quality information among the multiple reference image frames, where K is a positive integer.

In this implementation manner, when the terminal performs subsequent display based on the image frame, a better display effect can be achieved.

S405. The terminal determines a target image frame from a plurality of image frames according to the processing progress of the video material.

In some embodiments, in response to the current processing progress being that the terminal starts to process any image frame among the plurality of image frames, the image frame is determined as the target image frame. That is, in response to starting to process any image frame among the plurality of image frames, the terminal determines the image frame as the target image frame.

In this implementation manner, the terminal can determine the image frame being processed as the target image frame when processing at least one video material.

Taking the processing as an example of adding graphics to the image frames in the video material, the user sets the graphics to be added to the video material through the video processing application and selects the image frame to be added, and then uses the video processing application to add graphics to the video. Add graphics to image frames in footage. In response to the video processing application starting to add graphics to any image frame, the terminal determines the image frame as the target image frame, and when the user sees the image frame, the user can know that the processing application is adding graphics to the image frame. The display is more intuitive.

Taking processing as the terminal to synthesize multiple video materials as an example, after the user sets the video materials to be synthesized through the video processing application, the video materials are synthesized through the video processing application. In response to the video processing application starting to synthesize the video material, the terminal determines the image frame currently being synthesized, and determines the image frame as the target image frame, and the user can know that the processing application is adding the image frame to the image frame when the user sees the image frame. Graphics, the display of processing progress is more intuitive.

In some embodiments, in response to the current processing progress being that the processing of any image frame among the plurality of image frames is completed, the terminal determines the processed image frame as the target image frame. That is, in response to the completion of processing any one of the multiple image frames, the terminal determines the processed image frame as the target image frame.

Taking the processing as an example of adding graphics to the image frames in the video material, after the user sets the graphics to be added to the video material through the video processing application and selects the image frames to be added, the user can use the video processing application to send graphics to the video material. Add graphics to image frames in video footage. In response to the completion of adding graphics to any image frame by the processing application, the terminal determines that the image frame to which the graphics have been added is the target image frame.

In some embodiments, during the processing of at least one video material, the terminal determines the display time of multiple image frames during the processing according to the processing progress of the video material. The terminal determines the display time corresponding to the processing progress, and determines the image frame corresponding to the display time as the target image frame.

In this implementation manner, the terminal can determine the image frame corresponding to the processing progress in real time during the processing process, the display of the processing progress is more intuitive, and the efficiency of human-computer interaction is higher.

For example, in some embodiments, the terminal determines the display time of the target image frame according to the number of image frames, the sequence of the target image frames in the multiple image frames, and the progress of the processing. In some embodiments, there are 100 image frames. , the order of the target image frame in the 100 image frames is 28, then when the progress of processing the video material reaches 28%, the terminal determines the image frame with the order of 28 as the target image frame, wherein the target image frame is in multiple The sequence in the image frames is determined according to the time when the terminal acquires the target image frame.

It should be noted that the above steps S401-S405 are described by taking the execution subject as the terminal as an example, and in other possible implementations, the server can also be executed as the execution subject. In the case where the above steps S401-S405 are performed by the server as the execution subject, after the server performs step S405, the target image frame can be sent to the terminal for display by the terminal.

S406. The terminal displays the target image frame on the processing progress display interface.

The display duration of the target image frame is the target duration, wherein the target duration is determined by the terminal according to the progress of the processing. In some embodiments, the terminal sets the target duration to be the same as the processing percentage change interval, for example, there are 100 image frames, In the case that the processing progress corresponding to the currently displayed image frame is 1%, then in response to the processing progress changing to 2%, the terminal displays the image frame corresponding to the processing progress 2%, and the target duration is that the processing progress changes by 1% for the duration of 2%. In addition, the target duration can also be determined by the terminal according to the processing time of the image frame. In some embodiments, in response to the image frame corresponding to the processing progress being 1%, the terminal displays the image frame corresponding to the processing progress of 1%, and in response to the image frame corresponding to the processing progress being 2%, the terminal displays the processing progress. For 2%, the time interval between the image frames corresponding to the processing progress of 1% and the image frames corresponding to the processing progress of 2% is the target duration. Of course, the terminal can also determine the target duration in other ways, such as The time interval between the image frames corresponding to the processing progress of 1% and the completion of processing of the image frames corresponding to the processing progress of 2% is determined as the target duration, which is not limited in this embodiment of the present disclosure. In addition, the terminal can set a duration threshold for the target duration, and in response to the target duration being greater than or equal to the display threshold, the terminal displays the image frame according to the target duration; in response to the target duration being less than the display threshold, the terminal displays the image frame according to the display threshold.

In some embodiments, the terminal crops the target image frame, and displays the cropped target image frame on the image frame display area of the processing progress display interface.

In some embodiments, the terminal determines a target area, and the target area includes a target object, wherein the target object is a human face, a pet or a building, and accordingly, the target area is an area including a human face, or an area including a pet, or an area including a building The content of the target area is not limited in this embodiment of the present disclosure. For example, the terminal performs image recognition on the target image frame to obtain the target area in the target image frame. The terminal deletes the part outside the target area, that is, the terminal deletes the part outside the target area in the target image frame. This can make the display size of the image frame corresponding to the processing progress more appropriate.

In addition, in the process of processing the video material by the terminal, the processing progress information and the manual editing button can also be displayed on the processing progress display interface of the processing application. The user can click the manual editing button to intervene in the processing process. Operations such as adding display elements to the target image frame, stopping the processing process, and adding other video materials to the video material being processed are not limited in this embodiment of the present disclosure. Referring to FIG. 5 , 501 is the processing progress display interface of the processing application, 502 is the target image frame, 503 is the progress information of the processing, and 504 is the manual editing button.

In some embodiments, in response to a change in the processing progress, the terminal controls the first image frame to move out of the image frame display area of the processing progress display interface, where the first image frame is an image frame corresponding to the processing progress before the change. In response to the first image frame being completely moved out of the image frame display area of the processing progress display interface, a second image frame is displayed on the image frame display area of the processing progress display interface, the second image frame being the image frame corresponding to the changed processing progress.

In this implementation, the display of the processing progress is more intuitive, and the efficiency of human-computer interaction is higher.

For example, in some embodiments, referring to FIG. 6 , 601 is a processing progress display interface of a video processing application, 602 is a first image frame, 603 is an image frame display area, and 604 is a second image frame. In response to a change in the processing progress, eg from 1% to 2%, the terminal moves the first image frame 602 out of the image frame display area 603 and displays the second image frame 604 in the image frame display area 603 .

In some embodiments, in response to a change in the processing progress, the terminal controls the first image frame to move out of the image frame display area of the processing progress display interface, where the first image frame is an image frame corresponding to the processing progress before the change. While the first image frame is moving, the terminal controls the second image frame to enter the image frame display area of the processing progress display interface, and the second image frame is the image frame corresponding to the changed processing progress.

In some embodiments, referring to FIG. 7 , 701 is a processing progress display interface of a video processing application, 702 is a first image frame, 703 is an image frame display area, and 704 is a second image frame. In response to a change in the processing progress, for example, from 1% to 2%, the terminal moves the first image frame 702 out of the image frame display area 703, and in the process of moving out of the first image frame 702, controls the second image frame 704 to follow The first image frame 702 enters the image frame display area 703 until the second image frame 704 completely enters the image frame display area 703 .

In some embodiments, in response to a change in the processing progress, the terminal cancels the display of the first image frame, which is an image frame corresponding to the processing progress before the change. On the image frame display area of the processing progress display interface, the terminal displays a second image frame, and the second image frame is an image frame corresponding to the changed processing progress.

In this implementation manner, the display process of the second image frame is more intuitive.

For example, in some embodiments, referring to FIG. 8 , 801 is a processing progress display interface of a video processing application, 802 is a first image frame, 803 is an image frame display area, and 804 is a second image frame. In response to a change in the processing progress, for example, from 1% to 2%, the terminal cancels the display of the first image frame 802 and displays the second image frame 804 on the processing progress display interface. In some embodiments, the terminal may combine at least one image frame to generate a Graphics Interchange Format (GIF) image, and display the GIF image on the processing progress display interface of the application, and the user can view the GIF image by viewing the GIF image. to sense the progress of processing.

FIG. 9 is a schematic structural diagram of an image processing apparatus according to an exemplary embodiment. Referring to FIG. 9 , the apparatus includes an acquisition unit 901 , a determination unit 902 and a display unit 903 .

The obtaining unit 901 is configured to obtain a plurality of image frames from the video material in response to the processing instruction for the video material.

The determining unit 902 is configured to determine a target image frame from a plurality of image frames according to the processing progress of the video material, where the target image frame is an image frame corresponding to the processing progress.

The display unit 903 is configured to display the target image frame on the processing progress display interface.

In some embodiments, the determining unit is configured to, in response to starting to process any one of the plurality of image frames, determine any one of the image frames as the target image frame.

In some embodiments, the determining unit is configured to, in response to the completion of processing any image frame in the plurality of image frames, determine any image frame that has been processed as the target image frame.

In some embodiments, the acquisition unit is configured to acquire a plurality of reference image frames from the video material. Quality information for a plurality of reference image frames is determined. Based on the quality information of the plurality of reference image frames, a plurality of image frames whose quality information meets the target condition are determined from the plurality of reference image frames.

In some embodiments, the obtaining unit is configured to obtain at least two items of sharpness information, color richness information and content information of the plurality of reference image frames. The quality information of the multiple reference image frames is obtained by fusing at least two items of the definition information, the color richness information and the content information of the multiple reference image frames.

In some embodiments, the display unit is configured to determine a target area, the target area containing the target object. Delete the part outside the target area. In some embodiments, the display unit is configured to control the first image frame to move out of the image frame display area of the processing progress display interface in response to the change in the processing progress, where the first image frame is an image corresponding to the processing progress before the change frame. In response to the first image frame being completely moved out of the image frame display area of the processing progress display interface, a second image frame is displayed on the image frame display area of the processing progress display interface, the second image frame being the image frame corresponding to the changed processing progress.

In some embodiments, the display unit is configured to control the first image frame to move out of the image frame display area of the processing progress display interface in response to the change in the processing progress, where the first image frame is an image corresponding to the processing progress before the change frame. While the first image frame is moving, the second image frame is controlled to enter the image frame display area of the processing progress display interface, and the second image frame is the image frame corresponding to the changed processing progress.

In some embodiments, the display unit is configured to, in response to a change in the processing progress, cancel the display of the first image frame, where the first image frame is an image frame corresponding to the processing progress before the change. On the image frame display area of the processing progress display interface, a second image frame is displayed, and the second image frame is an image frame corresponding to the changed processing progress.

Embodiments of the present disclosure provide an electronic device, including one or more processors;

Memory for storing program code executable by the processor.

wherein the processor is configured to perform the following steps:

In response to processing instructions for the video material, a plurality of image frames are obtained from the video material.

According to the processing progress of the video material, a target image frame is determined from a plurality of image frames, and the target image frame is an image frame corresponding to the processing progress.

In some embodiments, the processor is configured to, in response to initiating processing of any one of the plurality of image frames, determine any one of the image frames as the target image frame.

In some embodiments, the processor is configured to: in response to the completion of processing any one of the plurality of image frames, determine any processed image frame as the target image frame.

In some embodiments, the processor is configured to obtain a plurality of reference image frames from the video material.

Quality information for a plurality of reference image frames is determined.

Based on the quality information of the plurality of reference image frames, a plurality of image frames are determined from the plurality of reference image frames, and the quality information of the plurality of image frames conforms to the target condition.

In some embodiments, the processor is configured to:

Determine the target area, the target area contains the target object.

Delete the part outside the target area.

In some embodiments, the processor is configured to:

In response to the first image frame being completely moved out of the image frame display area of the processing progress display interface, a second image frame is displayed on the image frame display area of the processing progress display interface, the second image frame being the image frame corresponding to the changed processing progress.

In some embodiments, the processor is configured to:

In this embodiment of the present disclosure, the electronic device may be implemented as a terminal. First, the structure of the terminal will be described:

FIG. 10 is a schematic structural diagram of a terminal according to an exemplary embodiment. The terminal 1000 may be a terminal used by a user. The terminal 1000 can be: a smart phone, a tablet computer, a notebook computer or a desktop computer. Terminal 1000 may also be called user equipment, portable terminal, laptop terminal, desktop terminal, and the like by other names.

Generally, the terminal 1000 includes: a processor 1001 and a memory 1002 .

The processor 1001 may include one or more processing cores, such as a 4-core processor, an 8-core processor, and the like. The processor 1001 can use at least one hardware form among DSP (Digital Signal Processing, digital signal processing), FPGA (Field-Programmable Gate Array, field programmable gate array), PLA (Programmable Logic Array, programmable logic array) accomplish. The processor 1001 may also include a main processor and a coprocessor. The main processor is a processor used to process data in the wake-up state, also called CPU (Central Processing Unit, central processing unit); the coprocessor is A low-power processor for processing data in a standby state. In some embodiments, the processor 1001 may be integrated with a GPU (Graphics Processing Unit, image processor), and the GPU is used for rendering and drawing the content that needs to be displayed on the display screen. In some embodiments, the processor 1001 may further include an AI (Artificial Intelligence, artificial intelligence) processor, where the AI processor is used to process computing operations related to machine learning.

Memory 1002 may include one or more computer-readable storage media, which may be non-transitory. At least one piece of program code is stored in the memory 1002, and the at least one piece of program code is loaded and executed by the processor 1001 to implement the image processing methods provided by the above method embodiments. Memory 1002 may also include high-speed random access memory, as well as non-volatile memory, such as one or more disk storage devices, flash storage devices.

In some embodiments, the terminal 1000 may optionally further include: a peripheral device interface 1003 and at least one peripheral device. The processor 1001, the memory 1002 and the peripheral device interface 1003 may be connected through a bus or a signal line. Each peripheral device can be connected to the peripheral device interface 1003 through a bus, a signal line or a circuit board. In some embodiments, the peripheral device includes at least one of a radio frequency circuit 1004 , a display screen 1005 , a camera assembly 1006 , an audio circuit 1007 , a positioning assembly 1008 and a power supply 1009 .

The peripheral device interface 1003 may be used to connect at least one peripheral device related to I/O (Input/Output) to the processor 1001 and the memory 1002 . In some embodiments, processor 1001, memory 1002, and peripherals interface 1003 are integrated on the same chip or circuit board; in some other embodiments, any one of processor 1001, memory 1002, and peripherals interface 1003 or The two can be implemented on a separate chip or circuit board, which is not limited in this embodiment.

The radio frequency circuit 1004 is used for receiving and transmitting RF (Radio Frequency, radio frequency) signals, also called electromagnetic signals. The radio frequency circuit 1004 communicates with the communication network and other communication devices through electromagnetic signals. The radio frequency circuit 1004 converts electrical signals into electromagnetic signals for transmission, or converts received electromagnetic signals into electrical signals. In some embodiments, radio frequency circuitry 1004 includes: an antenna system, an RF transceiver, one or more amplifiers, tuners, oscillators, digital signal processors, codec chipsets, subscriber identity module cards, and the like. The radio frequency circuit 1004 can communicate with other terminals through at least one wireless communication protocol. The wireless communication protocols include, but are not limited to, metropolitan area networks, mobile communication networks of various generations (2G, 3G, 4G and 5G), wireless local area networks and/or WiFi (Wireless Fidelity, wireless fidelity) networks. In some embodiments, the radio frequency circuit 1004 may further include a circuit related to NFC (Near Field Communication, short-range wireless communication), which is not limited in the present disclosure.

The display screen 1005 is used for displaying UI (User Interface, user interface). The UI can include graphics, text, icons, video, and any combination thereof. Where display screen 1005 is a touch display screen, display screen 1005 also has the ability to acquire touch signals on or above the surface of display screen 1005 . The touch signal can be input to the processor 1001 as a control signal for processing. At this time, the display screen 1005 may also be used to provide virtual buttons and/or virtual keyboards, also referred to as soft buttons and/or soft keyboards. In some embodiments, there may be one display screen 1005, which is provided on the front panel of the terminal 1000; in other embodiments, there may be at least two display screens 1005, which are respectively arranged on different surfaces of the terminal 1000 or in a folded design; In some embodiments, the display screen 1005 may be a flexible display screen disposed on a curved surface or a folding surface of the terminal 1000 . Even, the display screen 1005 can also be set as a non-rectangular irregular figure, that is, a special-shaped screen. The display screen 1005 can be prepared by using materials such as LCD (Liquid Crystal Display, liquid crystal display), OLED (Organic Light-Emitting Diode, organic light emitting diode).

The camera assembly 1006 is used to capture images or video. In some embodiments, camera assembly 1006 includes a front-facing camera and a rear-facing camera. Usually, the front camera is arranged on the front panel of the terminal, and the rear camera is arranged on the back of the terminal. In some embodiments, there are at least two rear cameras, which are any one of a main camera, a depth-of-field camera, a wide-angle camera, and a telephoto camera, so as to realize the fusion of the main camera and the depth-of-field camera to realize the background blur function, the main camera It is integrated with the wide-angle camera to achieve panoramic shooting and VR (Virtual Reality, virtual reality) shooting functions or other integrated shooting functions. In some embodiments, the camera assembly 1006 may also include a flash. The flash can be a single color temperature flash or a dual color temperature flash. Dual color temperature flash refers to the combination of warm light flash and cold light flash, which can be used for light compensation under different color temperatures.

Audio circuitry 1007 may include a microphone and speakers. The microphone is used to collect the sound waves of the user and the environment, convert the sound waves into electrical signals, and input them to the processor 1001 for processing, or to the radio frequency circuit 1004 to realize voice communication. For the purpose of stereo collection or noise reduction, there may be multiple microphones, which are respectively disposed in different parts of the terminal 1000. The microphone may also be an array microphone or an omnidirectional collection microphone. The speaker is used to convert electrical signals from the processor 1001 or the radio frequency circuit 1004 into sound waves. The loudspeaker can be a traditional thin-film loudspeaker or a piezoelectric ceramic loudspeaker. In the case where the speaker is a piezoelectric ceramic speaker, it can not only convert electrical signals into sound waves audible to humans, but also convert electrical signals into sound waves inaudible to humans for purposes such as distance measurement. In some embodiments, the audio circuit 1007 may also include a headphone jack.

The positioning component 1008 is used to locate the current geographic location of the terminal 1000 to implement navigation or LBS (Location Based Service). The positioning component 1008 may be a positioning component based on the GPS (Global Positioning System, global positioning system) of the United States, the Beidou system of China, the Grenas system of Russia, or the Galileo system of the European Union.

The power supply 1009 is used to power various components in the terminal 1000 . The power source 1009 may be alternating current, direct current, disposable batteries or rechargeable batteries. Where the power source 1009 includes a rechargeable battery, the rechargeable battery may support wired charging or wireless charging. The rechargeable battery can also be used to support fast charging technology.

In some embodiments, the terminal 1000 further includes one or more sensors 1010 . The one or more sensors 1010 include, but are not limited to, an acceleration sensor 1011 , a gyro sensor 1012 , a pressure sensor 1013 , a fingerprint sensor 1014 , an optical sensor 1015 and a proximity sensor 1016 .

The acceleration sensor 1011 can detect the magnitude of acceleration on the three coordinate axes of the coordinate system established by the terminal 1000 . In some embodiments, the acceleration sensor 1011 can be used to detect the components of the gravitational acceleration on the three coordinate axes. The processor 1001 can control the display screen 1005 to display the user interface in a landscape view or a portrait view according to the gravitational acceleration signal collected by the acceleration sensor 1011 . The acceleration sensor 1011 can also be used for game or user movement data collection.

The gyroscope sensor 1012 can detect the body direction and rotation angle of the terminal 1000 , and the gyroscope sensor 1012 can cooperate with the acceleration sensor 1011 to collect 3D actions of the user on the terminal 1000 . The processor 1001 can implement the following functions according to the data collected by the gyroscope sensor 1012 : motion sensing (for example, changing the UI according to the user's tilt operation), image stabilization during shooting, game control, and inertial navigation.

The pressure sensor 1013 may be disposed on the side frame of the terminal 1000 and/or the lower layer of the display screen 1005 . When the pressure sensor 1013 is disposed on the side frame of the terminal 1000 , the user's holding signal of the terminal 1000 can be detected, and the processor 1001 can perform left and right hand identification or shortcut operations according to the holding signal collected by the pressure sensor 1013 . In the case where the pressure sensor 1013 is disposed at the lower layer of the display screen 1005 , the processor 1001 controls the operability controls on the UI interface according to the user's pressure operation on the display screen 1005 . The operability controls include at least one of button controls, scroll bar controls, icon controls, and menu controls.

The fingerprint sensor 1014 is used to collect the user's fingerprint, and the processor 1001 identifies the user's identity according to the fingerprint collected by the fingerprint sensor 1014, or the fingerprint sensor 1014 identifies the user's identity according to the collected fingerprint. When the user's identity is identified as a trusted identity, the processor 1001 authorizes the user to perform relevant sensitive operations, including unlocking the screen, viewing encrypted information, downloading software, making payments, and changing settings. The fingerprint sensor 1014 may be provided on the front, back or side of the terminal 1000 . In the case where the terminal 1000 is provided with a physical button or a manufacturer's logo, the fingerprint sensor 1014 may be integrated with the physical button or the manufacturer's logo.

The optical sensor 1015 is used to collect ambient light intensity. In one embodiment, the processor 1001 can control the display brightness of the display screen 1005 according to the ambient light intensity collected by the optical sensor 1015 . In some embodiments, when the ambient light intensity is high, the display brightness of the display screen 1005 is increased; when the ambient light intensity is low, the display brightness of the display screen 1005 is decreased. In another embodiment, the processor 1001 may also dynamically adjust the shooting parameters of the camera assembly 1006 according to the ambient light intensity collected by the optical sensor 1015 .

A proximity sensor 1016 , also called a distance sensor, is usually disposed on the front panel of the terminal 1000 . The proximity sensor 1016 is used to collect the distance between the user and the front of the terminal 1000 . In one embodiment, when the proximity sensor 1016 detects that the distance between the user and the front of the terminal 1000 gradually decreases, the processor 1001 controls the display screen 1005 to switch from the bright screen state to the off screen state; 1016 When it is detected that the distance between the user and the front of the terminal 1000 is gradually increasing, the processor 1001 controls the display screen 1005 to switch from the closed screen state to the bright screen state.

Those skilled in the art can understand that the structure shown in FIG. 10 does not constitute a limitation on the terminal 1000, and may include more or less components than the one shown, or combine some components, or adopt different component arrangements.

In this embodiment of the present disclosure, the electronic device may be implemented as a server, and the structure of the server will be described below:

FIG. 11 is a schematic structural diagram of a server 1100 according to an exemplary embodiment. The server 1100 may vary greatly due to different configurations or performance, and may include one or more processors (Central Processing Units, CPU) 1101 and one or more than one memory 1102, the storage medium included in the memory 1102 may be a read-only memory (Read-Only Memory, ROM) 1103 and a random access memory (RAM) 1104. Of course, the server may also have components such as a wired or wireless network interface 1105, an input and output interface 1106, etc. for input and output, the server 1100 may also include a mass storage device 1107, and the server 1100 may also include other devices for realizing device functions components, which will not be repeated here.

In an exemplary embodiment, a non-volatile storage medium including program codes is also provided, such as a memory 1002 including program codes, and the above program codes can be executed by the processor 1101 of the server 1100 to perform the following steps:

Quality information for a plurality of reference image frames is determined.

In some embodiments, the processor is configured to:

Determine the target area, the target area contains the target object.

Delete the part outside the target area.

In some embodiments, the processor is configured to:

In some embodiments, the storage medium is a non-transitory computer-readable storage medium, for example, the non-transitory computer-readable storage medium is ROM, random access memory (RAM), CD-ROM, magnetic tape, floppy disk, optical data storage devices, etc. .

In an exemplary embodiment, there is also provided a computer program product comprising one or more instructions executable by a processor of an electronic device to accomplish the following steps:

Quality information for a plurality of reference image frames is determined.

In some embodiments, the processor is configured to:

Determine the target area, the target area contains the target object.

The part other than the target area.

In some embodiments, the processor is configured to:

In response to the first image frame being completely moved out of the image frame display area of the processing progress display interface, a second image frame is displayed on the image frame display area of the processing progress display interface, and the second image frame is an image frame corresponding to the changed processing progress.

In some embodiments, the processor is configured to:

The specification and examples are to be regarded as exemplary only, with the true scope and spirit of the disclosure being indicated by the following claims.

Claims

An image processing method, comprising:

obtaining a plurality of image frames from the video material in response to processing instructions for the video material;

determining a target image frame from the plurality of image frames according to the processing progress of the video material, where the target image frame is an image frame corresponding to the processing progress;

On the processing progress display interface, the target image frame is displayed.
The image processing method according to claim 1, wherein the determining a target image frame from the plurality of image frames according to the processing progress of the video material comprises:

In response to starting to process any one of the plurality of image frames, the any one of the image frames is determined to be the target image frame.
The image processing method according to claim 1, wherein the determining a target image frame from the plurality of image frames according to the processing progress of the video material comprises:

In response to the completion of processing any one of the plurality of image frames, the processed one of the image frames is determined as the target image frame.
The image processing method according to claim 1, wherein the acquiring a plurality of image frames from the video material comprises:

obtaining a plurality of reference image frames from the video material;

determining quality information for the plurality of reference image frames;

The plurality of image frames are determined from the plurality of reference image frames based on the quality information of the plurality of reference image frames, the quality information of the plurality of image frames conforming to the target condition.
The image processing method according to claim 4, wherein the determining the quality information of the plurality of reference image frames comprises:

acquiring at least two items of definition information, color richness information, and content information of the multiple reference image frames;

The quality information of the multiple reference image frames is obtained by fusing at least two items of the definition information, the color richness information and the content information of the multiple reference image frames.
The image processing method according to claim 1, wherein, on the processing progress display interface, displaying the target image frame comprises:

The target image frame is cropped, and the cropped target image frame is displayed on the image frame display area of the processing progress display interface.
The image processing method according to claim 6, wherein the cropping the target image frame comprises:

determining a target area, the target area containing the target object;

Delete the portion outside the target area.
The image processing method according to claim 1, wherein, on the processing progress display interface, displaying the target image frame comprises:

In response to the change of the processing progress, the first image frame is controlled to move outside the image frame display area of the processing progress display interface, and the first image frame is the image frame corresponding to the processing progress before the change;

In response to the first image frame being completely moved out of the image frame display area of the processing progress display interface, a second image frame is displayed on the image frame display area of the processing progress display interface, and the second image frame is after the change The processing progress of the corresponding image frame.
The image processing method according to claim 1, wherein, on the processing progress display interface, displaying the target image frame comprises:

In response to the change of the processing progress, the first image frame is controlled to move outside the image frame display area of the processing progress display interface, and the first image frame is the image frame corresponding to the processing progress before the change;

While the first image frame is moving, a second image frame is controlled to enter the image frame display area of the processing progress display interface, and the second image frame is an image frame corresponding to the changed processing progress.
The image processing method according to claim 1, wherein, on the processing progress display interface, displaying the target image frame comprises:

In response to the change in the processing progress, cancel the display of the first image frame, the first image frame is the image frame corresponding to the processing progress before the change;

On the image frame display area of the processing progress display interface, a second image frame is displayed, and the second image frame is an image frame corresponding to the changed processing progress.
An image processing device, comprising:

an acquisition unit, configured to acquire a plurality of image frames from the video material in response to a processing instruction for the video material;

a determining unit, configured to determine a target image frame from the plurality of image frames according to the processing progress of the video material, where the target image frame is an image frame corresponding to the processing progress;

The display unit is configured to display the target image frame on the processing progress display interface.
11. The image processing apparatus according to claim 11, wherein the determination unit is configured to, in response to starting to process any one of the plurality of image frames, determine the any one of the image frames as the target image frame.
11. The image processing apparatus according to claim 11, wherein the determining unit is configured to, in response to the completion of processing any one of the plurality of image frames, determine the processed one of the image frames for the target image frame.
The image processing apparatus according to claim 11, wherein the obtaining unit is configured to obtain a plurality of reference image frames from the video material; determine quality information of the plurality of reference image frames; based on the plurality of reference image frames quality information of a plurality of reference image frames, the plurality of image frames are determined from the plurality of reference image frames, and the quality information of the plurality of image frames conforms to the target condition.
The image processing apparatus according to claim 14, wherein the acquisition unit is configured to acquire at least two items of definition information, color richness information and content information of the plurality of reference image frames; At least two items of definition information, color richness information, and content information of the multiple reference image frames are used to obtain the quality information of the multiple reference image frames.
The image processing apparatus according to claim 11, wherein the display unit is configured to crop the target image frame, and displays the cropped target image on the image frame display area of the processing progress display interface frame.
16. The image processing apparatus according to claim 16, wherein the display unit is configured to determine a target area, the target area containing the target object; and to delete a portion other than the target area.
The image processing apparatus according to claim 11, wherein the display unit is configured to control the first image frame to move out of the image frame display area of the processing progress display interface in response to the change of the processing progress, The first image frame is an image frame corresponding to the processing progress before the change; in response to the first image frame being completely moved out of the image frame display area of the processing progress display interface, the image frame display on the processing progress display interface A second image frame is displayed on the area, and the second image frame is an image frame corresponding to the changed processing progress.
The image processing apparatus according to claim 11, wherein the display unit is configured to control the first image frame to move out of the image frame display area of the processing progress display interface in response to the change of the processing progress, The first image frame is the image frame corresponding to the processing progress before the change; while the first image frame moves, the second image frame is controlled to enter the image frame display area of the processing progress display interface, and the second image frame is controlled to enter the image frame display area of the processing progress display interface. The image frame is the image frame corresponding to the changed processing progress.
The image processing apparatus according to claim 11, wherein the display unit is configured to cancel the display of a first image frame in response to a change in the processing progress, the first image frame being the processing progress before the change A corresponding image frame; on the image frame display area of the processing progress display interface, a second image frame is displayed, and the second image frame is an image frame corresponding to the changed processing progress.
An electronic device comprising:

processor;

memory for storing said processor executable program code;

Wherein, the processor is configured as the program code to implement the following steps:

obtaining a plurality of image frames from the video material in response to processing instructions for the video material;

According to the processing progress of the video material, a target image frame is determined from the plurality of image frames, and the target image frame is an image frame corresponding to the processing progress;

On the processing progress display interface, the target image frame is displayed.
21. The electronic device of claim 21, wherein the processor is configured to, in response to initiating processing of any of the plurality of image frames, determine the any of the image frames as the describe the target image frame.
21. The electronic device of claim 21, wherein the processor is configured to: in response to processing any one of the plurality of image frames, processing the processed one of the image frames The frame is determined to be the target image frame.
21. The electronic device of claim 21, wherein the processor is configured to: obtain a plurality of reference image frames from the video material;

determining quality information for the plurality of reference image frames;

The plurality of image frames are determined from the plurality of reference image frames based on the quality information of the plurality of reference image frames, the quality information of the plurality of image frames conforming to the target condition.
The electronic device of claim 24, wherein the processor is configured to:

acquiring at least two items of definition information, color richness information, and content information of the multiple reference image frames;

The quality information of the multiple reference image frames is obtained by fusing at least two items of the definition information, the color richness information and the content information of the multiple reference image frames.
The electronic device of claim 21, wherein the processor is configured to:

The target image frame is cropped, and the cropped target image frame is displayed on the image frame display area of the processing progress display interface.
The electronic device of claim 26, wherein the processor is configured to:

determining a target area, the target area containing the target object;

Delete the portion outside the target area.
The electronic device of claim 21, wherein the processor is configured to:

In response to the change of the processing progress, the first image frame is controlled to move outside the image frame display area of the processing progress display interface, and the first image frame is the image frame corresponding to the processing progress before the change;

In response to the first image frame being completely moved out of the image frame display area of the processing progress display interface, a second image frame is displayed on the image frame display area of the processing progress display interface, and the second image frame is after the change The processing progress of the corresponding image frame.
The electronic device of claim 21, wherein the processor is configured to:

In response to the change of the processing progress, the first image frame is controlled to move outside the image frame display area of the processing progress display interface, and the first image frame is the image frame corresponding to the processing progress before the change;

While the first image frame is moving, a second image frame is controlled to enter the image frame display area of the processing progress display interface, and the second image frame is an image frame corresponding to the changed processing progress.
The electronic device of claim 21, wherein the processor is configured to:

In response to the change in the processing progress, cancel the display of the first image frame, the first image frame is the image frame corresponding to the processing progress before the change;

On the image frame display area of the processing progress display interface, a second image frame is displayed, and the second image frame is an image frame corresponding to the changed processing progress.
A non-volatile storage medium, when program codes in the storage medium are executed by a processor of an electronic device, the electronic device can perform the following steps:

obtaining a plurality of image frames from the video material in response to processing instructions for the video material;

determining a target image frame from the plurality of image frames according to the processing progress of the video material, where the target image frame is an image frame corresponding to the processing progress;

On the processing progress display interface, the target image frame is displayed.
A computer program product, the computer program product stores one or more program codes, and the one or more program codes can be executed by a processor of an electronic device to complete the following steps:

obtaining a plurality of image frames from the video material in response to processing instructions for the video material;

determining a target image frame from the plurality of image frames according to the processing progress of the video material, where the target image frame is an image frame corresponding to the processing progress;

On the processing progress display interface, the target image frame is displayed.