WO2022116962A1

WO2022116962A1 - Video playback method and apparatus, and electronic device

Info

Publication number: WO2022116962A1
Application number: PCT/CN2021/134313
Authority: WO
Inventors: 邱靖
Original assignee: 维沃移动通信有限公司
Priority date: 2020-12-04
Filing date: 2021-11-30
Publication date: 2022-06-09
Also published as: CN112565868A; CN112565868B

Abstract

Disclosed in the present application are a video playback method and apparatus, and an electronic device, which belong to the technical field of video processing. Said method comprises: in the case where a first video is played back, receiving a first input to a first object, wherein the first object is a first image in the first video, or the first object is associated with the first image in the first video; and in response to the first input, inserting at least one third image between the first image and a second image, and playing back the first video inserted with the third image, wherein the content of the third image is related to that of the first image, and the second image comprises at least one of an image before the first image and an image after the first image in the first video.

Description

Video playback method, device and electronic device

CROSS-REFERENCE TO RELATED APPLICATIONS

This application claims priority to Chinese Patent Application No. 202011408989.1 filed in China on Dec. 4, 2020, the entire contents of which are incorporated herein by reference.

technical field

The present application belongs to the technical field of video processing, and in particular relates to a video playback method, device and electronic device.

Background technique

At present, most electronic devices have the function of playing video or recording video, but for electronic devices such as mobile phones, from the consideration of space saving and other aspects, when recording video, the recorded video generally contains the contents of the unit time. The number of frames is less, which will cause the video to slow down and not be able to restore much detail. If a high-speed camera is configured on the mobile phone, although this problem can be avoided, the cost is relatively high. Therefore, on the basis of avoiding the excessive occupation of video space, how to realize the presentation of details during video playback is a problem that needs to be solved at present.

SUMMARY OF THE INVENTION

The purpose of the embodiments of the present application is to provide a video playback method, device and electronic device, which can solve the current problem that details cannot be presented during video playback on the basis of avoiding excessive video occupation.

In order to solve the above technical problems, this application is implemented as follows:

In a first aspect, an embodiment of the present application provides a video playback method, including:

In the case of playing the first video, a first input to a first object is received; wherein the first object is the first image in the first video data, or the first object and the first object image association;

In response to the first input, inserting at least one frame of a third image between the first image and the second image, and playing the first video after inserting the third image;

Wherein, the content of the third image is related to the content of the first image, and the second image includes: a frame of image in the first video that is located before the first image and a frame of image located in the first image at least one of the following frame images.

In a second aspect, an embodiment of the present application provides a video playback device, including:

a receiving module, configured to receive a first input to a first object when the first video is played; wherein, the first object is the first image in the first video, or the first object is related to a first image association in the first video;

a response module, configured to insert at least one frame of a third image between the first image and the second image in response to the first input, and play the first video after inserting the third image;

In a third aspect, embodiments of the present application provide an electronic device, the electronic device includes a processor, a memory, and a program or instruction stored on the memory and executable on the processor, the program or instruction being The processor implements the steps of the video playback method according to the first aspect when executed.

In a fourth aspect, an embodiment of the present application provides a readable storage medium, where a program or an instruction is stored on the readable storage medium, and when the program or instruction is executed by a processor, the video playback method according to the first aspect is implemented A step of.

In a fifth aspect, an embodiment of the present application provides a chip, the chip includes a processor and a communication interface, the communication interface is coupled to the processor, and the processor is configured to run a program or an instruction, and implement the first aspect The steps of the video playback method.

In a sixth aspect, a computer program product is provided, the computer program product is stored in a non-transitory storage medium, the computer program product is executed by at least one processor to implement the method of the first aspect.

In the embodiment of the present application, when the first video is played, if the first input is received, at least one frame of the third image is inserted between the first image and the second image in the first video, so that Since the content of the inserted third image is related to the content of the first image, the content of the first video is enriched, so that when the first video after the insertion of the third image is played, the user can watch more details , and on the basis of avoiding the excessive occupation of video data, the detailed presentation of the video playback is realized.

Description of drawings

Fig. 1 is one of the flowcharts of the video playing method of the embodiment of the present application;

2 is a schematic diagram of frame insertion processing according to an embodiment of the present application;

3 is a schematic diagram of a slow motion picture according to an embodiment of the present application;

4 is a schematic diagram of a second target image according to an embodiment of the present application;

5 is a schematic diagram of a third target image according to an embodiment of the present application;

6 is a schematic diagram of a pressure value change curve of a first input in an embodiment of the present application;

7 is the second flowchart of the video playback method according to the embodiment of the present application;

8 is a block diagram of a video playback device according to an embodiment of the present application;

9 is a block diagram of an electronic device according to an embodiment of the present application;

FIG. 10 is a schematic diagram of a hardware structure of an electronic device according to an embodiment of the present application.

Detailed ways

The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative work fall within the protection scope of the present application.

The terms "first", "second" and the like in the description and claims of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It is to be understood that the data so used are interchangeable under appropriate circumstances so that the embodiments of the present application can be practiced in sequences other than those illustrated or described herein, and distinguish between "first", "second", etc. The objects are usually of one type, and the number of objects is not limited. For example, the first object may be one or more than one. In addition, "and/or" in the description and claims indicates at least one of the connected objects, and the character "/" generally indicates that the associated objects are in an "or" relationship.

The following describes the image and video playback method provided by the embodiments of the present application in detail through specific embodiments and application scenarios with reference to the accompanying drawings.

As shown in Figure 1, the embodiment of the present application provides a kind of video playing method, specifically can include the following steps:

Step 11: In the case of playing the first video, receive a first input to the first object.

The first object is the first image in the first video, or the first object is associated with the first image in the first video.

Optionally, the first video may be a part of a complete video. For example, the image of a complete video is: several frames of images containing the A object, several frames of images containing the B object, etc., wherein the images of the first video can be are several frames of images containing the A object.

Optionally, the first video may also be a complete video, for example, the video may be a short video, a gif image, or the like, which is not limited in this embodiment of the present application.

Optionally, the first object is the first image in the first video, that is, the first input may be the first input for the currently playing first image during the process of playing the first video. . The form of the first input is not limited, for example, the first input may be a pressing input, a continuous click input, a sliding input of a predetermined track, and the like.

Optionally, the first object may be a progress bar of video playback, and the first object is associated with the first image in the first video, that is, the first input may be for the progress bar with the first image. A long-press operation on a corresponding area associated with an image, etc., where a long-press operation refers to an operation whose pressing duration exceeds a preset threshold, and of course other pressing operations, etc., are not limited to this embodiment of the present application.

Optionally, the first object may be a target object in an image currently displayed in the first video, and the first object is associated with the first image, that is, the first input may be for the first video The first input of the image currently displayed in the first input, extract the target object in the currently displayed image according to the first input (for example, the target object may be the object corresponding to the operation position of the first input), and will be located in the The image containing the target object before the currently displayed image is determined as the first image; or, in the case that there is no image containing the target object between the currently displayed images, the currently displayed image identified as the first image.

Step 12: In response to the first input, insert at least one frame of a third image between the first image and the second image, and play the first video after inserting the third image.

Optionally, in response to the first input, at least one frame of a third image may be inserted between the first image and the second image following the first image; or, in response to the first input, may At least one frame of a third image is inserted between the first image and a second image preceding the first image; alternatively, in response to the first input, at least one frame may be inserted between two frames of the second image A third image, wherein the first image is located between the two frames of the second image.

Optionally, the content of the first image and the second image are related, that is, the first image and the second image both contain the target object; the third image is related to the content of the first image, that is, the first image and the third image are related. All contain the target object; or the contents of the first image, the second image and the third image are all related, that is, the first image, the second image and the third image all contain the target object.

Optionally, the step of playing the first video data inserted into the third image may specifically include:

In the case that the second image is located before the first image, playing the first video data inserted into the third image from the second image;

In a case where the second image is located after the first image, the first video data inserted into the third image is played from the first image.

For example, if the first video is a complete video, playing the first video after inserting the third image is to play the complete video after inserting the third image.

Another example: when the first video is a part of a complete video, playing the first video after inserting the third image may include: playing the complete video after inserting the third image; The paragraph of the first video corresponding to the third image, for example, when at least one frame of the third image is inserted between the first image and the second image after the first image, the first image is played from the first image to the second image. the end of the image; as in the case of inserting at least one frame of the third image between the first image and the second image preceding the first image, play from the second image to the end of the first image; as in The first image is located between two frames of the second image, and when at least one frame of the third image is inserted between the two frames of the second image, the playback starts from the second image located before the first image to the location where the second image is located. The second image after the first image ends.

Optionally, when playing the first video with the third image inserted, a pop-up window can be displayed in the playback window for playing the first video, and the first video with the third image inserted is played in the pop-up window, that is, by pop-up. The first video after the frame insertion is previewed in the window mode, that is, playing the first video in which the third image is inserted in the present application can be understood as the real-time frame insertion playback mode for the first video in the playback process, which can reduce the need for electronic equipment. memory space usage.

For example: in the process of playing the first video, if the user needs to view a segment or a certain area of its corresponding details, he can press and hold the corresponding video area, so that the electronic device can automatically and intelligently adjust the The video area performs real-time frame insertion processing, so that the video area can display more details and smooth and continuous slow motion during playback.

Optionally, in response to the first input, after inserting at least one frame of a third image between the first image and the second image, and playing the first video after the insertion of the third image, the method may further include: : When the first input ends, display prompt information, where the prompt information is used to prompt the user whether to save the first video after frame insertion.

For example: during the input process of the above-mentioned first input (such as long-press input), real-time frame interpolation processing is performed on the first video, and when the first input ends (such as when the operating object of the first input is separated from the electronic device) , prompting the user whether to save the first video after frame insertion processing by displaying prompt information, so that the user can choose to store the first video after frame insertion processing while reducing memory space occupation, further ensuring practical Effect.

Optionally, in the case of the end of the first input, the first video is restored to the initial playback state (that is, the playback state before frame insertion processing), which can satisfy the user's real-time response to the played video in any process of playing the video. The need for video processing, as well as reducing the occupation of memory space, and the operation is simple and convenient, reducing the difficulty of requiring professional video processing.

In the above solution of the present application, when the first video is played, if the first input is received, at least one frame of the third image is inserted between the first image and the second image in the first video, so that Since the content of the inserted third image is related to the content of the first image, the content of the first video is enriched, so that when the first video after the insertion of the third image is played, the user can watch more details , and on the basis of avoiding the excessive occupation of video data, the detailed presentation of the video playback is realized.

Optionally, the step of inserting at least one frame of a third image between the first image and the second image may specifically include:

Duplicating the first target image to obtain at least one frame of a third image; wherein the first target image is: a part or all of the images from the first image to the second image;

The third image is inserted adjacent to the first target image corresponding to the third image.

For example: in the process of playing the first video, you can read the frame images before and after the video in real time, and perform artificial intelligence (AI) learning to obtain repeated images, and insert the learning in a certain proportion in the frames before and after. The repeated images make the played video data more detailed, clearer and smoother, so that the slow-motion images can be obtained intuitively and quickly.

The following description is given by taking the example that each frame of image in the first video contains the target object:

For example, while playing the first video, the repeated images learned by AI are automatically inserted into adjacent positions of each frame of the first video. As shown in Figure 2(a), a blank rectangular area represents a frame of image in the initial video. After AI learning, a repeated frame of image is inserted adjacent to the initial image of each frame, as shown in Figure 2(b) The rectangular area filled with horizontal lines is shown; of course, according to the number of frames in the initial video, the degree of slow-motion detail that needs to be obtained, etc., multiple frames of repeated images can also be inserted adjacent to the initial image of each frame, as shown in Figure 2 ( c) The rectangular area filled by horizontal lines and the rectangular area filled by grid are shown.

Another example: while playing the first video, the repeated images learned by AI can be automatically inserted into the adjacent positions of some frame images in the first video. 3, 5, 7, and 9 frames of images are adjacent to insert one or more frames of repeated images learned by AI, or one or more frames can be inserted at the position where the 3, 4, 5, 6, and 7 frame images ring Repeated images learned by AI, etc., are not limited to this embodiment of the present application.

According to the content of the second target image and the third target image, a third image is generated; wherein the content of the third image is different from the content of the second target image and the third target image, and the second target image The image and the third target image are: any two adjacent frames of images from the first image to the second image;

The third image is inserted between the second target image and the third target image.

Among them, the adjacent second target image and the third target image both contain the same target object (here the same target object refers to the same object, and its action, position and shape may be the same or different), which means the second target image It is related to the content of the third target image. For example: the target object in the second target image is the object A in FIG. 3 , the target object in the second target image is the object E in FIG. 3 , the direction and position of the two may be different, but they are both “skiing objects”, then It is determined to be the same target object, or the motion, position, shape, etc. of the target objects contained in the second target image and the third target image may also be the same.

Wherein, the content of the third image is different from the content of the second target image and the third target image, which may mean that the third image contains the same target object as the second target image and the third target image, But the content of the target object is different (eg, at least one of the position, action, shape, etc. of the target object may be different).

The principle of frame insertion processing in this embodiment is: based on motion estimation and motion compensation algorithms, frame insertion processing is performed in real time. To put it simply, real-time video frame insertion technology can estimate the motion trajectory of objects based on the relationship between two adjacent frames, insert one or more intermediate images, and increase the video frame rate to ensure smoother video playback and better motion details. clear.

For example: the frame rate of the initial video is 24 frames. In the face of high refresh rate, in some high-speed scenes, the picture will appear incoherent and blurred, which greatly affects the viewing experience. In this way, through the real-time frame insertion technology, namely The motion trajectory is estimated by the relationship between adjacent frames, and multi-frame intermediate images are generated, so that the original 24 frames can be increased to 60 frames to enhance the viewing experience.

Another example: when the frame insertion ratio is increased by 8 times, 16 times and other higher magnifications, and a video of 240 frames or more is obtained through frame insertion processing, it can reflect that the video playback screen becomes slow, that is, the above-mentioned slow motion rendering. The frame insertion process can be seen in Figure 2. The rectangular area filled with horizontal lines is the intermediate image obtained after estimating the trajectory. After inserting the compensated intermediate image, the trajectory is relatively coherent. The rectangular area filled with grids is the pre/post frame after learning the estimated motion trajectory. Images, inserted repeating intermediate images, smoother browsing after further intermediate images are inserted. Of course, it is also possible to directly generate multiple frames of intermediate images based on the motion trajectory estimation according to the relationship between two adjacent frames of images, which is not limited to this embodiment of the present application.

Optionally, the step of generating the third image according to the content of the second target image and the third target image may specifically include:

determining the motion trajectory of the target object according to the target object contained in the second target image and the third target image;

generating a third image including the target object according to the motion trajectory of the target object;

Wherein, the position of the target object contained in the third image on the motion trajectory is different from the position of the target object contained in the second target image and the third target image on the motion trajectory.

Optionally, the target object may be determined according to the operation position of the first input, for example, in the case of receiving the first input to the first image, in response to the first input, extract the corresponding first image in the first image. An object at an input operation position is used as the target object, and the movement track of the target object is determined according to the target objects contained in the second target image and the third target image.

FIG. 3 shows a schematic diagram of a slow motion picture. In the slow motion picture 31, the second target image 41 including the object A in the initial video is shown in FIG. 4, and the third target image 51 including the object E is shown in FIG. 4 . As shown in Figure 5. For example: based on the object A in the second target image and the object E in the third target object, the motion trajectory of the target object can be estimated as shown by the dotted line in Figure 3. After the motion trajectory is determined, the motion trajectory of the target object can be estimated based on the object A and the The action of object E is learned through AI, and multiple objects B are determined, that is, a third image is obtained. Of course, the actions of object A and object E can also be learned through AI to determine multiple objects B, C, and D, that is, multiple objects B, C, and D can be determined. Frame the third image, which is not limited in this embodiment of the present application. In this way, based on motion trajectory estimation and AI learning, it is possible to ensure that the action details of the slow-motion picture 31 played after inserting the intermediate image are more vivid and specific, and the video playback picture can be guaranteed to be smoother.

determining the playback frame rate corresponding to the input parameter of the first input;

According to the playback frame rate, determine the frame number N of the third image inserted between the first image and the second image, and insert N frames between the first image and the second image For the third image, N is a positive integer.

Optionally, in the case that the first input is a long-press input, the input parameter may be the input duration of the long-press input, for example: the longer the pressing duration is, the larger the frame number N of the inserted third image is. , the motion of the embodied moving object is slower; or, in the case that the first input is a pressing input, the input parameter may be the pressure value of pressing, for example: the greater the pressure value of pressing, the inserted third image The larger the number of frames N, the slower the motion of the embodied moving object.

Optionally, the step of playing the first video after inserting the third image may specifically include:

determining the playback duration corresponding to the input parameter of the first input;

Playing the target video part in the first video after inserting the third image according to the playback duration;

The images corresponding to the target video part are: the first image, the second image and the third image.

Optionally, in the case that the first input is a long-press input, the input parameter may be the input duration of the long-press input, for example: if the pressing duration is longer, the playback duration is shorter, and the presentation delay is fast. Action playback, if the pressing time is shorter, the longer the playing time is, the slow-motion playback will appear; or, in the case that the first input is a pressing input, the input parameter can be the pressure value of pressing, such as: if the pressing The larger the pressure value, the shorter the playback time, and the delayed fast-motion playback is displayed. If the pressure value is smaller, the longer the playback time is, and the slow-motion playback is displayed.

Optionally, during the playback of the first video, when the electronic device detects that there is a pressing input, real-time frame image learning is enabled, and real-time frame insertion is performed on some or all of the frame images in the first video, so that the user The slow-motion presentation of the target object in the first video can be browsed in real time. Further, the corresponding interaction of the pressure value of the pressing input can be defined as the frame image multiple of the inserted frame, for example: the middle value of the pressing can be preset, as shown in paragraphs A-B in FIG. 6 , the pressure value of the pressing input is the pressing value. In the case of the middle value, the first video is played according to the initial state; when the pressure value of the press input is less than the middle value of the press, as shown in section C-D in Figure 6, if the pressure value of the press input is larger, the The slower the movement of the moving object; when the pressure value of the pressing input is greater than the middle value of the pressing, as shown in the E-F segment in Figure 6, if the pressure value of the pressing input is smaller, the faster the movement of the moving object is displayed.

In this embodiment, based on the corresponding relationship between the input parameters of the first input and the video playback frame rate, the first video with different frame rates can be previewed in real time, and the operation method is convenient and fast, avoiding multiple operation adjustments, and to a certain extent Conducive to simplifying user operations.

As shown in FIG. 7 , an embodiment of the present application also provides a flowchart of a video playback method, which specifically includes:

Step 701: When playing the first video, the electronic device detects in real time whether there is a pressing input.

For example: the electronic device detects the pressing area and time on the screen in real time.

Step 702: Determine a starting frame according to the first input.

For example, the obtained coordinate value is used to determine the target object in the current image, and the image that the target object first appears in the first video playback process is used as the starting frame. Alternatively, the currently displayed first image is used as the starting frame, etc., which is not limited in this embodiment of the present application.

Step 703: Compare the pressure value of the pressing input with a preset intermediate value.

Step 704: If the pressure value of the pressing input is greater than the preset intermediate value, and becomes larger and larger, it means that the magnification of the frame interpolation needs to be gradually increased; The smaller the value, the lower the magnification that needs to be interpolated.

Step 705: If the pressure value of the pressing input is equal to the preset intermediate value, or the pressure value of the pressing input is zero, resume normal playback.

Step 706: Insert a frame image in real time according to the magnification determined in the above step 704, and/or determine the video playback time according to the pressure value input by pressing.

Step 707: Play the first video after inserting the frame image. For example, in the case where the playback time is determined in the above step 705, the first video after the frame image is inserted is played according to the playback time, so as to present slow motion playback or fast motion playback.

Step 708: Cache the first video after inserting the frame image. For example: the effect of real-time frame insertion can also be cached in the database.

Step 709 : in the case of receiving the synthesis input from the user, the first video after frame insertion may be synthesized with other segments of the original video.

Step 710: In the case of receiving the user's format selection input, the target format can be determined, and the composited video can be saved locally according to the target format. If the user's composite input is received, the cache releases the insert. The first video after the frame.

In the above solution of the present application, in the process of playing the first video, the user can press the input to cause the electronic device to perform real-time frame insertion processing on the first video, so that the played frame-inserted first video has a better picture. More details, clearer and smoother. Moreover, based on the corresponding relationship between the pressure value of the pressing input and the video playback frame rate, the solution can preview the first video of different frame rates in real time, and the operation method is convenient and fast, avoiding multiple operation adjustments, which is beneficial to simplify the user to a certain extent. operation, and avoid occupying too much memory space by means of caching, and by providing a way to combine and save, it is also convenient for subsequent viewing and sharing. .

It should be noted that, in the video playback method provided by the embodiments of the present application, the execution body may be a video playback device, or a control module in the video playback device for executing the video playback method. In the embodiment of the present application, the video playing device provided by the embodiment of the present application is described by taking a video playing device executing a video playing method as an example.

As shown in FIG. 8 , an embodiment of the present application further provides a video playback device 800, including:

A receiving module 810, configured to receive a first input of a first object when the first video is played; wherein the first object is the first image in the first video, or the first object associated with a first image in the first video;

a response module 820, configured to, in response to the first input, insert at least one frame of a third image between the first image and the second image, and play the first video after inserting the third image;

Optionally, the response module 820 includes:

A copying sub-module, configured to perform copying processing on the first target image to obtain at least one frame of third image; wherein, the first target image is: the part from the first image to the second image or all images;

A first frame insertion submodule, configured to insert the third image into a position adjacent to the first target image corresponding to the third image.

Optionally, the response module 820 includes:

A generating submodule for generating a third image according to the content of the second target image and the third target image; wherein the content of the third image is different from the content of the second target image and the third target image , the second target image and the third target image are: any two adjacent frames of images from the first image to the second image;

A second frame insertion submodule, configured to insert the third image between the second target image and the third target image.

Optionally, the generating submodule includes:

a determining unit, configured to determine the motion trajectory of the target object according to the target object contained in the second target image and the third target image;

a generating unit, configured to generate a third image including the target object according to the motion trajectory of the target object;

Wherein, the position of the target object included in the third image on the motion track is different from the position of the target object included in the second target image and the third target image on the motion track.

Optionally, the response module 820 includes:

a first determination submodule, configured to determine the playback frame rate corresponding to the input parameter of the first input;

The second determination submodule is configured to determine the frame number N of the third image inserted between the first image and the second image according to the playback frame rate, and determine the frame number N of the third image to be inserted between the first image and the second image N frames of third images are inserted between the second images, where N is a positive integer.

Optionally, the response module 820 includes:

a first playing submodule, configured to play the first video data inserted into the third image from the second image when the second image is located before the first image;

A second playing submodule, configured to play the first video data inserted into the third image from the first image when the second image is located after the first image.

Optionally, the response module 820 includes:

a third determination submodule, configured to determine the playback duration corresponding to the input parameter of the first input;

The third playing submodule is used to play the target video part in the first video after inserting the third image according to the playing duration;

The video playback device in this embodiment of the present application may be a device, or may be a component, an integrated circuit, or a chip in a terminal. The apparatus may be a mobile electronic device or a non-mobile electronic device. Exemplarily, the mobile electronic device may be a mobile phone, a tablet computer, a notebook computer, a palmtop computer, an in-vehicle electronic device, a wearable device, an ultra-mobile personal computer (UMPC), a netbook, or a personal digital assistant (personal digital assistant). assistant, PDA), etc., non-mobile electronic devices can be servers, network attached storage (Network Attached Storage, NAS), personal computer (personal computer, PC), television (television, TV), teller machine or self-service machine, etc., this application Examples are not specifically limited.

The video playback device in the embodiment of the present application may be a device with an operating system. The operating system may be an Android (Android) operating system, an ios operating system, or other possible operating systems, which are not specifically limited in the embodiments of the present application.

The video playback device provided in the embodiment of the present application can implement each process implemented by the method embodiments in FIG. 1 to FIG. 7 , and to avoid repetition, details are not repeated here.

In the apparatus 800 in this embodiment of the present application, when the first video is played, if the first input is received, at least one frame of the third image is inserted between the first image and the second image in the first video , in this way, since the content of the inserted third image is related to the content of the first image, the content of the first video is enriched, so that when the first video after the insertion of the third image is played, the user can watch more More details, and on the basis of avoiding the excessive occupation of video data, the detailed presentation of the video playback is realized.

Optionally, as shown in FIG. 9 , an embodiment of the present application further provides an electronic device 900, including a processor 901, a memory 902, a program or instruction stored in the memory 902 and executable on the processor 901, When the program or instruction is executed by the processor 901, each process of the above video playback method embodiment is implemented, and the same technical effect can be achieved. To avoid repetition, details are not described here.

It should be noted that the electronic devices in the embodiments of the present application include the aforementioned mobile electronic devices and non-mobile electronic devices.

FIG. 10 is a schematic diagram of a hardware structure of an electronic device implementing an embodiment of the present application.

The electronic device 1000 includes but is not limited to: a radio frequency unit 1001, a network module 1002, an audio output unit 1003, an input unit 1004, a sensor 1005, a display unit 1006, a user input unit 1007, an interface unit 1008, a memory 1009, and a processor 1010, etc. part.

Those skilled in the art can understand that the electronic device 1000 may also include a power source (such as a battery) for supplying power to various components, and the power source may be logically connected to the processor 1010 through a power management system, so that the power management system can manage charging, discharging, and power functions. consumption management and other functions. The structure of the electronic device shown in FIG. 10 does not constitute a limitation on the electronic device, and the electronic device may include more or less components than the one shown, or combine some components, or arrange different components, which will not be repeated here. .

Wherein, the radio frequency unit 1001 is configured to receive a first input of a first object when the first video is played; wherein, the first object is the first image in the first video, or the first object An object is associated with the first image in the first video.

The processor 1010 is configured to, in response to the first input, insert at least one frame of a third image between the first image and the second image, and play the first image after the insertion of the third image through the display unit 1006 video, or play the first video after inserting the third image through the audio output unit 1003 and the display unit 1006 .

Optionally, the processor 1010 is configured to perform duplication processing on the first target image to obtain at least one frame of the third image; wherein the first target image is: from the first image to the second image Part or all of the images in between; inserting the third image to a position adjacent to the first target image corresponding to the third image.

Optionally, the processor 1010 is further configured to generate a third image according to the content of the second target image and the third target image; wherein the content of the third image is the same as the second target image and the third target image. The contents of the target images are different, and the second target image and the third target image are: any two adjacent frames of images from the first image to the second image; insert the third image into the to between the second target image and the third target image.

Optionally, the processor 1010 is further configured to determine the motion trajectory of the target object according to the target object contained in the second target image and the third target image; generate a motion trajectory according to the target object a third image including the target object; wherein, the position of the target object included in the third image on the motion track is the same as the target object included in the second target image and the third target image The positions on the motion trajectory are different.

Optionally, the processor 1010 is further configured to determine a playback frame rate corresponding to the input parameter of the first input; according to the playback frame rate, determine to insert between the first image and the second image The frame number N of the third image is N, and N frames of the third image are inserted between the first image and the second image, where N is a positive integer.

Optionally, the processor 1010 is further configured to, when the second image is located before the first image, start from the second image and play the first image after the third image is inserted through the display unit 1006. a video data, or play the first video data after inserting the third image through the audio output unit 1003 and the display unit 1006;

Optionally, the processor 1010 is further configured to, when the second image is located after the first image, start from the first image and play the first image after the third image is inserted through the display unit 1006 a video data, or play the first video data inserted into the third image through the audio output unit 1003 and the display unit 1006 .

Optionally, the processor 1010 is further configured to determine the playback duration corresponding to the input parameter of the first input; the display unit 1006 inserts the target video part in the first video after the third image according to the The audio output unit 1003 and the display unit 1006 play the target video part in the first video inserted after the third image according to the playback duration.

In the electronic device 1000 in this embodiment of the present application, in the case of playing the first video, if the first input is received, at least one frame of the third image is inserted between the first image and the second image in the first video. In this way, since the content of the inserted third image is related to the content of the first image, the content of the first video is enriched, so that when the first video after the insertion of the third image is played, the user can watch the More details, and on the basis of avoiding the excessive occupation of video data, the detailed presentation of the video playback is realized.

It should be understood that, in this embodiment of the present application, the input unit 1004 may include a graphics processor (Graphics Processing Unit, GPU) 10041 and a microphone 10042. Such as camera) to obtain still pictures or video image data for processing. The display unit 1006 may include a display panel 10061, which may be configured in the form of a liquid crystal display, an organic light emitting diode, or the like. The user input unit 1007 includes a touch panel 10071 and other input devices 10072 . The touch panel 10071 is also called a touch screen. The touch panel 10071 may include two parts, a touch detection device and a touch controller. Other input devices 10072 may include, but are not limited to, physical keyboards, function keys (such as volume control keys, switch keys, etc.), trackballs, mice, and joysticks, which will not be repeated here. Memory 1009 may be used to store software programs as well as various data, including but not limited to application programs and operating systems. The processor 1010 may integrate an application processor and a modem processor, wherein the application processor mainly handles the operating system, user interface, and application programs, and the like, and the modem processor mainly handles wireless communication. It can be understood that, the above-mentioned modulation and demodulation processor may not be integrated into the processor 1010.

Embodiments of the present application further provide a readable storage medium, where a program or an instruction is stored on the readable storage medium. When the program or instruction is executed by a processor, each process of the above video playback method embodiment can be achieved, and the same can be achieved. In order to avoid repetition, the technical effect will not be repeated here.

Wherein, the processor is the processor in the electronic device described in the foregoing embodiments. The readable storage medium includes a computer-readable storage medium, such as a computer read-only memory (Read-Only Memory, ROM), a random access memory (Random Access Memory, RAM), a magnetic disk or an optical disk, and the like.

An embodiment of the present application further provides a chip, where the chip includes a processor and a communication interface, the communication interface is coupled to the processor, and the processor is configured to run a program or an instruction to implement the above video playback method embodiments. Each process can achieve the same technical effect. In order to avoid repetition, it will not be repeated here.

An embodiment of the present application further provides a computer program product, wherein the computer program product is stored in a non-transitory readable storage medium, and the computer program product is executed by at least one process to implement the above method in FIG. 1 . In order to avoid repetition, the details are not repeated here.

It should be understood that the chip mentioned in the embodiments of the present application may also be referred to as a system-on-chip, a system-on-chip, a system-on-a-chip, or a system-on-a-chip, or the like.

It should be noted that, herein, the terms "comprising", "comprising" or any other variation thereof are intended to encompass non-exclusive inclusion, such that a process, method, article or device comprising a series of elements includes not only those elements, It also includes other elements not expressly listed or inherent to such a process, method, article or apparatus. Without further limitation, an element qualified by the phrase "comprising a..." does not preclude the presence of additional identical elements in a process, method, article or apparatus that includes the element. Furthermore, it should be noted that the scope of the methods and apparatus in the embodiments of the present application is not limited to performing the functions in the order shown or discussed, but may also include performing the functions in a substantially simultaneous manner or in the reverse order depending on the functions involved. To perform functions, for example, the described methods may be performed in an order different from that described, and various steps may also be added, omitted, or combined. Additionally, features described with reference to some examples may be combined in other examples.

From the description of the above embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus a necessary general hardware platform, and of course hardware can also be used, but in many cases the former is better implementation. Based on this understanding, the technical solution of the present application can be embodied in the form of a software product in essence or in a part that contributes to the prior art, and the computer software product is stored in a storage medium (such as ROM/RAM, magnetic disk, CD-ROM), including several instructions to make a terminal (which may be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) execute the methods described in the various embodiments of this application.

The embodiments of the present application have been described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific embodiments, which are merely illustrative rather than restrictive. Under the inspiration of this application, without departing from the scope of protection of the purpose of this application and the claims, many forms can be made, which all fall within the protection of this application.

Claims

A video playback method, comprising:

In the case of playing the first video, a first input of a first object is received; wherein the first object is a first image in the first video, or the first object and the first video The first image association in ;

In response to the first input, inserting at least one frame of a third image between the first image and the second image, and playing the first video after inserting the third image;

Wherein, the content of the third image is related to the content of the first image, and the second image includes: a frame of image in the first video that is located before the first image and a frame of image located in the first image at least one of the following frame images.
The video playback method according to claim 1, wherein inserting at least one frame of a third image between the first image and the second image comprises:

Duplicating the first target image to obtain at least one frame of a third image; wherein the first target image is: a part or all of the images from the first image to the second image;

The third image is inserted adjacent to the first target image corresponding to the third image.
The video playback method according to claim 1, wherein inserting at least one frame of a third image between the first image and the second image comprises:

According to the content of the second target image and the third target image, a third image is generated; wherein the content of the third image is different from the content of the second target image and the third target image, and the second target image The image and the third target image are: any two adjacent frames of images from the first image to the second image;

The third image is inserted between the second target image and the third target image.
The video playback method according to claim 3, wherein the generating the third image according to the content of the second target image and the third target image comprises:

determining the motion trajectory of the target object according to the target object contained in the second target image and the third target image;

generating a third image including the target object according to the motion trajectory of the target object;

Wherein, the position of the target object contained in the third image on the motion trajectory is different from the position of the target object contained in the second target image and the third target image on the motion trajectory.
The video playback method according to claim 1, wherein inserting at least one frame of a third image between the first image and the second image comprises:

determining the playback frame rate corresponding to the input parameter of the first input;

According to the playback frame rate, determine the frame number N of the third image inserted between the first image and the second image, and insert N frames between the first image and the second image For the third image, N is a positive integer.
The video playing method according to claim 1, wherein the playing the first video after inserting the third image comprises:

In the case that the second image is located before the first image, playing the first video after inserting the third image from the second image;

In the case where the second image is located after the first image, the first video inserted into the third image is played from the first image.
The video playing method according to claim 1, wherein the playing the first video after inserting the third image comprises:

determining the playback duration corresponding to the input parameter of the first input;

Playing the target video part in the first video after inserting the third image according to the playback duration;

The images corresponding to the target video part are: the first image, the second image and the third image.
A video playback device, comprising:

a receiving module, configured to receive a first input to a first object when the first video is played; wherein, the first object is the first image in the first video, or the first object is related to a first image association in the first video;

a response module, configured to insert at least one frame of a third image between the first image and the second image in response to the first input, and play the first video after inserting the third image;

Wherein, the content of the third image is related to the content of the first image, and the second image includes: a frame of image in the first video that is located before the first image and a frame of image located in the first image at least one of the following frame images.
The video playback device according to claim 8, wherein the response module comprises:

A copying sub-module, configured to perform copying processing on the first target image to obtain at least one frame of a third image; wherein, the first target image is: the part from the first image to the second image or all images;

A first frame insertion submodule, configured to insert the third image into a position adjacent to the first target image corresponding to the third image.
The video playback device according to claim 8, wherein the response module comprises:

A generating submodule for generating a third image according to the content of the second target image and the third target image; wherein the content of the third image is different from the content of the second target image and the third target image , the second target image and the third target image are: any two adjacent frames of images from the first image to the second image;

A second frame insertion submodule, configured to insert the third image between the second target image and the third target image.
The video playback device according to claim 10, wherein the generating submodule comprises:

a determining unit, configured to determine the motion trajectory of the target object according to the target object contained in the second target image and the third target image;

a generating unit, configured to generate a third image including the target object according to the motion trajectory of the target object;

Wherein, the position of the target object included in the third image on the motion track is different from the position of the target object included in the second target image and the third target image on the motion track.
The video playback device according to claim 8, wherein the response module comprises:

a first determination submodule, configured to determine the playback frame rate corresponding to the input parameter of the first input;

The second determination submodule is configured to determine the frame number N of the third image inserted between the first image and the second image according to the playback frame rate, and determine the frame number N of the third image to be inserted between the first image and the second image N frames of third images are inserted between the second images, where N is a positive integer.
The video playback device according to claim 8, wherein the response module comprises:

a first playing submodule, configured to play the first video data inserted into the third image from the second image when the second image is located before the first image;

A second playing submodule, configured to play the first video data inserted into the third image from the first image when the second image is located after the first image.
The video playback device according to claim 8, wherein the response module comprises:

a third determination submodule, configured to determine the playback duration corresponding to the input parameter of the first input;

The third playing submodule is used to play the target video part in the first video after inserting the third image according to the playing duration;

The images corresponding to the target video part are: the first image, the second image and the third image.
An electronic device, comprising a processor, a memory, and a program or instruction stored on the memory and executable on the processor, wherein the program or instruction is executed by the processor to achieve as claimed in claim 1 Steps of the video playback method described in any one of to 7.
A readable storage medium on which a program or an instruction is stored, wherein, when the program or instruction is executed by a processor, the steps of the video playback method according to any one of claims 1-7 are implemented .
A chip, comprising a processor and a communication interface, wherein the communication interface is coupled with the processor, and the processor is used to run a program or an instruction to implement the video playback according to any one of claims 1-7 steps of the method.
A computer program product, wherein the computer program product is stored in a non-transitory storage medium, the computer program product being executed by at least one processor to implement any one of claims 1-7 The steps of the video playback method.
An electronic device, characterized in that it includes the steps that the electronic device is used to execute the video playback method according to any one of claims 1-7.