CN113596520A

CN113596520A - Video playing control method and device and electronic equipment

Info

Publication number: CN113596520A
Application number: CN202110183645.3A
Authority: CN
Inventors: 黄海兵
Original assignee: Tencent Technology Shenzhen Co Ltd
Current assignee: Tencent Technology Shenzhen Co Ltd
Priority date: 2021-02-08
Filing date: 2021-02-08
Publication date: 2021-11-02

Abstract

The application provides a video playing control method, a video playing control device, electronic equipment and a computer readable storage medium; the method relates to a cloud technology and an artificial intelligence technology, and comprises the following steps: responding to a video playing operation, and playing the video; acquiring attribute information corresponding to a current plot unit, and acquiring a playing speed corresponding to the current plot unit according to the attribute information; and playing the current plot unit according to the playing double speed. By the method and the device, the human-computer interaction efficiency in the video playing process can be improved.

Description

Video playing control method and device and electronic equipment

Technical Field

The present application relates to artificial intelligence technologies, and in particular, to a method and an apparatus for controlling playing of a video, an electronic device, and a computer-readable storage medium.

Background

Artificial Intelligence (AI) is a theory, method and technique and application system that uses a digital computer or a machine controlled by a digital computer to simulate, extend and expand human Intelligence, perceive the environment, acquire knowledge and use the knowledge to obtain the best results.

The artificial intelligence technology can be applied to the field of video processing, for example, online videos are recommended to users through the artificial intelligence technology, and the related technology provides a function of setting the playing speed of the videos so as to meet the requirements of users on watching video contents with emphasis, but the mode needs to control the playing speed of the videos by means of frequent user operations, and therefore human-computer interaction efficiency is affected.

Disclosure of Invention

The embodiment of the application provides a video playing control method and device, electronic equipment and a computer readable storage medium, which can realize high-efficiency dynamic playing speed multiplication in the video playing process and improve the human-computer interaction efficiency.

The technical scheme of the embodiment of the application is realized as follows:

the embodiment of the application provides a video playing control method, which comprises the following steps:

responding to a video playing operation, and playing the video;

acquiring attribute information corresponding to a current plot unit, and acquiring a playing speed corresponding to the current plot unit according to the attribute information;

and playing the current plot unit according to the playing double speed.

An embodiment of the present application provides a video playing control device, including: .

The playing module is used for responding to video playing operation and playing the video;

the speed doubling module is used for acquiring attribute information corresponding to the current plot unit and acquiring playing speed doubling corresponding to the current plot unit according to the attribute information;

the playing module is further configured to play the current story unit according to the playing speed.

In the above solution, the apparatus further comprises: an acquisition module to: before obtaining attribute information corresponding to a current story unit, dividing the video into a plurality of story units by one of: dividing the video according to scenes; dividing the video according to the conversation; the video is divided according to content sources, wherein the types of the content sources comprise the original content of the video and recommendation information inserted in the video.

In the foregoing solution, the obtaining module is further configured to: carrying out scene identification processing on each video frame in the video to obtain a scene to which each video frame belongs; determining a plurality of video frames which belong to the same scene and have continuous playing time as belonging to the same plot unit, and determining a time period between a minimum time stamp and a maximum time stamp of the plurality of video frames as a playing time period of the plot unit.

In the foregoing solution, the obtaining module is further configured to: carrying out identity recognition processing on a sound production object of each audio frame in the video; determining a plurality of audio frames which belong to the same sound production object and have continuous playing time as belonging to the same plot unit, and determining a time period between a minimum time stamp and a maximum time stamp of the plurality of audio frames as a playing time period of the plot unit.

In the above scheme, the video further includes a transition unit; the obtaining module is further configured to: determining a transition unit in the video by at least one of: determining the information quantity of each plot unit, and taking the plot units smaller than the threshold value of the information quantity as transition units; determining plot units used for connecting different scenes in the plurality of plot units as transition units; determining an episode unit of the plurality of episode units for joining different conversations as a transition unit.

In the foregoing solution, the obtaining module is further configured to: when the playing progress of the video is in the playing time period of any transition unit in the video, applying a playing double speed corresponding to the transition unit in the playing time period of the transition unit; wherein the playback speed corresponding to the transition unit is any one of the following playback speeds: the fixed playing double speed, the playing double speed of the plot unit which is connected with the transition unit and is positioned in front of the transition unit, and the playing double speed obtained according to the attribute information of the transition unit.

In the foregoing solution, the speed doubling module is further configured to: acquiring the frequency of historical positive interaction operation and the frequency of historical negative interaction operation corresponding to the plot unit as attribute information corresponding to the current plot unit; and determining a playing double speed which is negatively correlated with the number of the historical positive interactive operations and positively correlated with the number of the historical negative interactive operations.

In the foregoing solution, the speed doubling module is further configured to: acquiring historical playing speed of a plurality of users having social relations with target users aiming at the current plot unit as attribute information corresponding to the current plot unit; wherein the target user is a user submitting the video playing operation; acquiring similarity between the portraits of the plurality of users and the portraits of the users; and taking the similarity corresponding to each of the plurality of users as a weight, carrying out weighting processing on the historical playing double speed of the plurality of users, and determining the weighting processing result as the playing double speed of the current plot unit.

In the foregoing solution, the speed doubling module is further configured to: acquiring a feature vector of the current plot unit as attribute information corresponding to the current plot unit; obtaining a historical playing double speed adopted by a historical plot unit watched by a target user from historical playing data of the target user; wherein the target user is a user submitting the video playing operation; determining the similarity between the feature vector of each historical plot unit and the feature vector of the current plot unit; and taking the historical playing double speed adopted by the historical plot unit with the maximum similarity as the playing double speed of the current plot unit.

In the foregoing solution, the speed doubling module is further configured to: in response to a multiple speed setting operation for the current episode unit, determining an updated playback multiple speed corresponding to the current episode unit to apply the updated playback multiple speed corresponding to the current episode unit before the playback time period of the current episode unit ends; updating the playing speed of the subsequent plot units in the video according to the updated playing speed; wherein the playing time period of the subsequent plot unit is after the playing time period of the current plot unit.

In the foregoing solution, the speed doubling module is further configured to: determining similarity between the feature vector of the subsequent plot unit and the feature vector of the current plot unit; and when the similarity is greater than a similarity threshold value, taking the updated playing speed adopted by the current plot unit as the playing speed of the subsequent plot unit.

In the above solution, before playing the current story unit according to the playing double speed, the apparatus further includes: a control module to: responding to the trigger operation of the speed-multiplying play function, and presenting a dynamic speed-multiplying control; and responding to the trigger operation aiming at the dynamic speed doubling control, and determining that the operation of playing the current plot unit according to the playing speed doubling is to be executed.

In the above scheme, when the dynamic speed doubling control is presented, the control module is further configured to: presenting a fixed speed-multiplying control; and responding to the triggering operation of the fixed speed doubling control, and playing the video based on the set fixed playing speed doubling control in the fixed speed doubling control.

An embodiment of the present application provides an electronic device, including:

a memory for storing executable instructions;

and the processor is used for realizing the video playing control method provided by the embodiment of the application when the executable instructions stored in the memory are executed.

The embodiment of the present application provides a computer-readable storage medium, which stores executable instructions and is used for implementing the video playing control method provided by the embodiment of the present application when being executed by a processor.

The embodiment of the application has the following beneficial effects:

the video is dynamically played at a double speed according to the attribute information of the plot units, so that the attention of a user to different plot units in the video is conformed, the manual intervention operation of the user for adjusting the playing double speed is saved, and the human-computer interaction efficiency is improved.

Drawings

Fig. 1 is a schematic structural diagram of a video playback control system according to an embodiment of the present application;

fig. 2 is a schematic structural diagram of a terminal 400 provided in an embodiment of the present application;

fig. 3 is a schematic flowchart of a video playing control method according to an embodiment of the present application;

fig. 4A to 4D are schematic flow charts of a video playing control method according to an embodiment of the present application;

fig. 5 is an overall flowchart of a video playing control method provided in an embodiment of the present application;

fig. 6 is a schematic speed decision diagram of a video playing control method according to an embodiment of the present application;

fig. 7 is an application diagram of a video play control method provided in an embodiment of the present application;

fig. 8 is a modified schematic view of a video playing control method according to an embodiment of the present application.

Detailed Description

In order to make the objectives, technical solutions and advantages of the present application clearer, the present application will be described in further detail with reference to the attached drawings, the described embodiments should not be considered as limiting the present application, and all other embodiments obtained by a person of ordinary skill in the art without creative efforts shall fall within the protection scope of the present application.

In the following description, reference is made to "some embodiments" which describe a subset of all possible embodiments, but it is understood that "some embodiments" may be the same subset or different subsets of all possible embodiments, and may be combined with each other without conflict.

In the following description, references to the terms "first \ second \ third" are only to distinguish similar objects and do not denote a particular order, but rather the terms "first \ second \ third" are used to interchange specific orders or sequences, where appropriate, so as to enable the embodiments of the application described herein to be practiced in other than the order shown or described herein.

Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs. The terminology used herein is for the purpose of describing embodiments of the present application only and is not intended to be limiting of the application.

Before further detailed description of the embodiments of the present application, terms and expressions referred to in the embodiments of the present application will be described, and the terms and expressions referred to in the embodiments of the present application will be used for the following explanation.

1) The terminal comprises a client and an application program running in the terminal and used for providing various services, such as an instant messaging client and a video playing client.

2) In response to the condition or state on which the performed operation depends, one or more of the performed operations may be in real-time or may have a set delay when the dependent condition or state is satisfied; there is no restriction on the order of execution of the operations performed unless otherwise specified.

3) The playing double speed is a multiple of a normal playing speed (i.e. a speed of playing according to a frame rate set in the video), and the video playing speed is proportionally increased or decreased, for example, the playing double speed is 2 times, so that the content played according to the normal playing speed of the video for 20 seconds can be played within 10 seconds, i.e. the content is equivalent to fast playing; for example, if the playback speed is 0.5 times, the content that can be played only 5 seconds after the normal playback speed of the video can be played within 10 seconds, that is, the playback speed is equivalent to slow playback.

In the related art, video playing is performed based on a fixed multiple speed selected manually by a user, if the user is not satisfied with the current playing speed in the playing process, the video is played according to the selected fixed multiple speed in response to the fixed multiple speed selection operation of the user, and an intelligent dynamic multiple speed function does not exist in the playing process.

Based on the above technical problems, embodiments of the present application provide a video playing control method, apparatus, electronic device, and computer-readable storage medium, which can recommend different playing speeds for each video in different playing time periods of plot units, thereby improving human-computer interaction efficiency and further improving viewing experience of users.

The method for controlling playing of a video provided in this embodiment may be implemented by a terminal device (hereinafter, simply referred to as a terminal) alone, for example, the terminal divides a video to obtain a plurality of story units, determines corresponding playing speeds corresponding to the story units one-to-one, where the determined playing speeds are negatively related to the interest level of a user in the story units, and applies the playing speeds to the corresponding story units in the process of playing the video, thereby implementing a dynamic speed-doubling playing function suitable for different story units, where the video played by the terminal is a local video in an offline scene or a video acquired from a server in an online scene.

The terminals may include various types of laptops, tablets, desktops, set-top boxes, mobile devices (e.g., mobile phones, portable music players, personal digital assistants, dedicated messaging devices, portable gaming devices), and so on.

The video playing control method provided by the embodiment of the application can be cooperatively implemented by the terminal and the server. For example, the terminal obtains the playing time period of the current plot unit in the video and the playing double speed corresponding to the current plot unit from the server, the playing double speed of the current plot unit is determined based on the attribute information of the current plot unit, for example, the attribute information includes data related to the current plot unit and data related to the user, the process of determining the playing double speed based on the attribute information is a process substantially depicting the interest level of the current plot unit, for example, the attribute information may also include the identifier of the current plot unit, that is, the server divides the video in advance to obtain a plurality of plot units and determines the playing double speed corresponding to the identifiers of the current plot unit one by one, the association relationship between the identifier of the plot unit and the playing double speed may be constructed based on the interest level of each plot unit, the determined playing double speed is related to the interest level of the user on the plot unit, the playing multiple speed is associated with the mark of the plot unit, so that when playing on line, the terminal directly acquires the attribute information (the mark of the current plot unit) according to the current playing time stamp, and then inquires according to the mark to obtain the corresponding playing multiple speed, so as to directly play the current plot unit according to the playing multiple speed, thereby realizing the dynamic multiple speed playing function suitable for different plot units.

Referring to fig. 1, fig. 1 is a schematic structural diagram of a video playback control system applied in an online scene according to an embodiment of the present application. The video playing data is live data or non-live data, and the video playing control system 100 includes: the server 200, the network 300, and the terminal 400 will be separately described.

The server 200 is a background server of the video client 410, and sends a video and corresponding video playing speed data to the video client 410, where the video playing speed data includes a playing time period of each episode unit in the video and a playing double speed corresponding to the interest degree of each episode unit, or stores the video and corresponding video playing speed data in the server 200, responds to a video playing request of the video client 410 (the video client receives a video playing operation of a user), reads the locally stored video and corresponding video playing speed data to play the video according to the video playing speed data, or obtains the video and corresponding video playing speed data from the server 200 to play the video according to the video playing speed data.

It is understood that the server 200 may default in an offline scene of a video stored locally by the terminal 400 in the video client 410.

As an example, in an offline scene, a terminal divides a locally stored video to obtain a plurality of plot units, and determines a playback speed corresponding to a current plot unit according to attribute information including data related to the current plot unit and data related to a user, or queries a playback speed corresponding to the current plot unit according to attribute information including an identifier related to the current plot unit, where the determined playback speed is negatively related to a degree of interest of the user in the plot unit, and applies the playback speed to the current plot unit in a process of playing the video, thereby implementing a dynamic speed-doubling playback function suitable for different plot units.

The network 300, which is used as a medium for communication between the server 200 and the terminal 400, may be a wide area network or a local area network, or a combination of both.

And the terminal 400 is used for operating the video client 410.

As an example, in an online scenario, the video client 410 running in the terminal 400 receives the video playing speed data sent by the server 200, and plays the video at the video playing double speed in the video playing interface of the terminal 400, wherein, the video playing speed data is generated and stored by the server, the server divides the video to obtain a plurality of plot units, and determines the playback multiple speeds corresponding to the current story unit one to one according to the attribute information including data related to the current story unit and data related to the user, or inquiring the playing double speed corresponding to the current plot unit according to the attribute information including the identification related to the current plot unit, wherein the determined playing double speed is negatively related to the interest degree of the user on the plot unit, and the server packages the playing time period of each plot unit in the video and the playing double speed corresponding to the interest degree of each plot unit into video playing speed data for storage.

As an example, in an online scene, a server sends a video to a video client 410, the video client 410 running in a terminal 400 is configured to receive the video sent by the server 200, and the terminal 400 divides the video into a plurality of plot units, determines a playback speed corresponding to a current plot unit according to attribute information including data related to the current plot unit and data related to a user, or queries the playback speed corresponding to the current plot unit according to attribute information including an identifier related to the current plot unit, where the determined playback speed is negatively related to a user's interest level in the current plot unit, and plays the video at the video playback speed in a video playback interface of the terminal 400.

Here, the video client 410 may be an Application (APP) with a video playing function, such as a video APP or a short video APP; the browser can also be a browser with video playing function; but also a video applet that can be embedded into any APP.

The embodiments of the present application may be implemented by means of Cloud Technology (Cloud Technology), which refers to a hosting Technology for unifying series resources such as hardware, software, and network in a wide area network or a local area network to implement data calculation, storage, processing, and sharing.

The cloud technology is based on the general names of network technology, information technology, integration technology, management platform technology, application technology and the like applied in the cloud computing business model, can form a resource pool, is used as required, and is flexible and convenient. Cloud computing technology will become an important support. Background services of technical network systems require a large amount of computing and storage resources, for example, video portals.

As an example, the server 200 may be an independent physical server, may be a server cluster or a distributed system formed by a plurality of physical servers, and may also be a cloud server providing basic cloud computing services such as a cloud service, a cloud database, cloud computing, a cloud function, cloud storage, a web service, cloud communication, a middleware service, a domain name service, a security service, a CDN, and a big data and artificial intelligence platform. The terminal 400 may be, but is not limited to, a smart phone, a tablet computer, a laptop computer, a desktop computer, a smart speaker, a smart television, a smart watch, and the like. The terminal 400 and the server 200 may be directly or indirectly connected through wired or wireless communication, and the embodiment of the present application is not limited thereto.

Next, a structure of the electronic device provided in the embodiment of the present application is described, and as described above, the electronic device may be implemented as a terminal, or may be implemented as a terminal and a server.

Taking an example that an electronic device is implemented as the terminal 400 shown in fig. 1 as an illustration, referring to fig. 2, fig. 2 is a schematic structural diagram of the terminal 400 provided in the embodiment of the present application, and the terminal 400 shown in fig. 2 includes: at least one processor 410, memory 450, at least one network interface 420, and a user interface 430. The various components in the terminal 400 are coupled together by a bus system 440. It is understood that the bus system 440 is used to enable communications among the components. The bus system 440 includes a power bus, a control bus, and a status signal bus in addition to a data bus. For clarity of illustration, however, the various buses are labeled as bus system 440 in fig. 2.

The Processor 410 may be an integrated circuit chip having Signal processing capabilities, such as a general purpose Processor, a Digital Signal Processor (DSP), or other programmable logic device, discrete gate or transistor logic device, discrete hardware components, or the like, wherein the general purpose Processor may be a microprocessor or any conventional Processor, or the like.

The user interface 430 includes one or more output devices 431, including one or more speakers and/or one or more visual displays, that enable the presentation of media content. The user interface 430 also includes one or more input devices 432, including user interface components that facilitate user input, such as a keyboard, mouse, microphone, touch screen display, camera, other input buttons and controls.

The memory 450 may be removable, non-removable, or a combination thereof. Exemplary hardware devices include solid state memory, hard disk drives, optical disk drives, and the like. Memory 450 optionally includes one or more storage devices physically located remote from processor 410.

The memory 450 includes either volatile memory or nonvolatile memory, and may include both volatile and nonvolatile memory. The nonvolatile Memory may be a Read Only Memory (ROM), and the volatile Memory may be a Random Access Memory (RAM). The memory 450 described in embodiments herein is intended to comprise any suitable type of memory.

In some embodiments, memory 450 is capable of storing data, examples of which include programs, modules, and data structures, or a subset or superset thereof, to support various operations, as exemplified below.

An operating system 451, including system programs for handling various basic system services and performing hardware-related tasks, such as a framework layer, a core library layer, a driver layer, etc., for implementing various basic services and handling hardware-based tasks;

a network communication module 452 for communicating to other computing devices via one or more (wired or wireless) network interfaces 420, exemplary network interfaces 420 including: bluetooth, wireless compatibility authentication (WiFi), and Universal Serial Bus (USB), etc.;

a presentation module 453 for enabling presentation of information (e.g., user interfaces for operating peripherals and displaying content and information) via one or more output devices 431 (e.g., display screens, speakers, etc.) associated with user interface 430;

an input processing module 454 for detecting one or more user inputs or interactions from one of the one or more input devices 432 and translating the detected inputs or interactions.

In some embodiments, the video playing control apparatus provided in this embodiment of the present application may be implemented in software, and fig. 2 illustrates the video playing control apparatus 455 stored in the memory 450, which may be software in the form of programs and plug-ins, and includes the following software modules: a playing module 4551, a speed doubling module 4552, an acquisition module 4553 and a control module 4554, which are logical and thus can be arbitrarily combined or further divided according to the functions implemented, and the functions of the respective modules will be described below.

Referring to fig. 3, fig. 3 is a schematic flowchart of a video playing control method provided in an embodiment of the present application, and will be described with reference to the steps shown in fig. 3. As described above, the steps of the control method for video playing described below may be implemented by the terminal, or may be implemented by the terminal and the server in cooperation.

In step 301, a video is played in response to a video play operation.

In some embodiments, the type of the video may be an online video or a video pre-stored locally by the terminal, and taking the online video as an example, the terminal sends a video acquisition request to the server in response to a video playing operation initiated by a user; the server responds to the video acquisition request and sends a corresponding video to the terminal; and the terminal plays the received video in the video playing interface.

Taking online video playing as an example for illustration, the server sends the video and corresponding video playing speed data to the terminal, and stores the video and corresponding video playing speed data locally at the terminal, that is, synchronizes data from the server in advance, for example, periodically synchronizes data to the terminal, or automatically synchronizes after the video client is started, the video playing speed data includes a playing time period of each plot unit in the video and a playing speed corresponding to the interest degree of each plot unit, wherein the video playing speed data sent by the server to the terminal is obtained through learning in advance, for example, the playing speed is determined for the current user, if the current user is a new user, the user data of a similar user (for example, a user having a social relationship with the current user, presents prompt information to prompt whether the current user applies the playing speed of the similar user) is used for learning the playing speed, the terminal receives a video playing request of the video client (the video client receives the video playing operation of the user), reads the video stored in the local and the corresponding video playing speed data, and plays the video according to the video playing speed data.

In step 302, the attribute information corresponding to the current story unit is obtained to obtain the playback multiple speed corresponding to the current story unit according to the attribute information.

In step 303, the current story unit is played according to the corresponding playback speed.

As an example, when the playing progress of the video is in the playing time period of any plot unit in the video, the plot unit corresponding to the playing time period in which the representation is located is the current plot unit, the attribute information corresponding to the current plot unit is obtained, so as to obtain the playing double speed corresponding to the current plot unit according to the attribute information, and thus, the current plot unit is played according to the corresponding playing double speed.

In some embodiments, before playing the current story unit according to the playing double speed, a dynamic double speed control is presented in response to a double speed playing function trigger operation; and in response to the triggering operation aiming at the dynamic double-speed control, determining that the operation of playing the current plot unit according to the playing double-speed is to be executed. For example, the playback double speed of the current story unit has been acquired, but it is determined that the operation of playing back the current story unit in accordance with the playback double speed will be performed in response to a trigger operation for the dynamic double speed control.

As an example, the process of acquiring the attribute information corresponding to the current story unit to acquire the playback multiple speed corresponding to the current story unit based on the attribute information may be a multiple speed query process based on the attribute information, or a process of performing real-time prediction based on the user behavior (attribute information).

As an example, the current episode unit is an episode unit in which the playing progress of the current video is located, or the current episode unit is an episode unit in which the playing progress of the current video is located and a subsequent episode unit.

As an example, the playback speed of the current story unit corresponds to a level of interest of the current story unit, the level of interest being used to characterize a level of attraction of the content of the current story unit to a user initiating a video playback operation. The playing speed may be determined in a continuous value space, that is, the playing speed may be proportional to the interest degree, or the playing speed may be determined in a discrete value space, that is, after determining a value proportional to the interest degree, a value closest to the directly proportional value is determined in the discrete space as the playing speed to be applied.

In some embodiments, the attribute information corresponding to the current episode unit is obtained to obtain the playback multiple speed corresponding to the current episode unit according to the attribute information, specifically, the playback multiple speed corresponding to the current episode unit may be determined according to the attribute information including data related to the current episode unit and data related to a user, or the playback multiple speed corresponding to the current episode unit is queried according to the attribute information including an identifier related to the current episode unit, if the playback multiple speed corresponding to the current episode unit is queried according to the attribute information including an identifier related to the current episode unit, a playback time period of each episode unit in the video and a playback multiple speed corresponding to a degree of interest of each episode unit need to be obtained in advance, so that the playback multiple speed corresponding to the current episode unit is subsequently and directly determined according to the attribute information of the current episode unit (for example, the identification of the current story unit) to inquire the play double speed corresponding to the current story unit.

In some embodiments, the attribute information further includes a character of the current story unit, the playback multiple speed corresponding to the current story unit is queried according to the attribute information of the character including the current story unit, if the playback multiple speed corresponding to the current story unit is queried according to the attribute information of the character including the current story unit, the character of each story unit in the video and the playback multiple speed corresponding to the degree of interest of the character need to be obtained in advance, for example, the degree of interest of the hero character is generally higher than that of the hero character, so that the playback multiple speed corresponding to the hero character is lower than that of the hero character, and so that the playback multiple speed corresponding to the current story unit is subsequently queried directly according to the attribute information of the current story unit (e.g., the character of the current story unit). And the implementation mode of obtaining the playing speed of the current plot unit by inquiring based on the attribute information is favorable for improving the video playing fluency.

As an example, the terminal may determine, by using its own computing power, a playing time period of the current episode unit in the video and a playing speed corresponding to the interest level of the current episode unit, and the terminal may also determine, by using the server computing power, the playing time period of the current episode unit in the video and the playing speed corresponding to the interest level of the current episode unit.

If the playing time period of the current plot unit in the video and the playing speed corresponding to the interest degree of the current plot unit are directly determined by the terminal, the video playing control method provided by the embodiment of the application can be applied in an offline scene, and the consumption of network communication resources is reduced when the method is implemented in an online scene; the server determines the playing time period of the current plot unit and the playing speed corresponding to the interest degree of the current plot unit, so that the storage resources and the calculation occupation of the terminal are reduced, the server has strong calculation capacity relative to the terminal, the calculation speed is high, the buffering time for playing the video by the terminal can be saved, and the occupation of the calculation resources of the terminal can be reduced.

In some embodiments, before obtaining the attribute information corresponding to the current episode unit, it is necessary to obtain the playing time period of each episode unit in the video, and the video may be divided into a plurality of episode units by one of the following methods: dividing the video according to the scene; dividing the video according to the conversation; the video is divided according to content sources, wherein the types of the content sources include the original content of the video and recommendation information inserted in the video, for example, the recommendation information may be an advertisement played before the video is played or an advertisement inserted when the video is paused.

As an example, the timestamps of all video frames included in each story unit are sorted, with the smallest timestamp being the start of the play period of the story unit and the largest timestamp being the end of the play period of the story unit.

In some embodiments, the above-mentioned dividing the video according to the scene may be implemented by the following technical solutions: carrying out scene recognition processing on each video frame in the video through a scene recognition model to obtain a scene to which each video frame belongs; determining a plurality of video frames which belong to the same scene and have continuous playing time as belonging to the same plot unit, and determining a time period between a minimum time stamp and a maximum time stamp of the plurality of video frames as a playing time period of the plot unit.

As an example, the scene recognition model may be a trained neural network model, the neural network model may be obtained based on a video frame sample and a labeled scene training, assuming that there are 120 video frames in a video, performing scene recognition processing on the 120 video frames to obtain a scene to which each video frame belongs, and if there are 30 video frames in the same scene and the playing time is continuous, determining that the 30 video frames belong to the same story unit. For example, the time period between the minimum timestamp and the maximum timestamp of the multiple video frames is determined as the playing time period of the plot unit corresponding to the plot unit of the indoor scene, and the content of each plot unit can be ensured to be in the same scene by dividing the video based on the scene to obtain the plot unit, so that the continuity of playing the content of the plot unit corresponding to each scene is ensured, and the stable viewing experience can be provided for the user.

In some embodiments, the above-mentioned dividing the video according to the conversation may be implemented by the following technical solutions: carrying out identity recognition processing on a sound production object of each audio frame in the video through a voice recognition model; determining a plurality of audio frames which belong to the same sound production object and have continuous playing time as belonging to the same plot unit, and determining a time period between a minimum time stamp and a maximum time stamp of the plurality of audio frames as a playing time period of the plot unit.

As an example, the speech recognition model may be a trained neural network model, the neural network model may be obtained by training identities of sound-emitting objects based on audio frame samples and labels, assuming that there are 120 audio frames in a video, performing speech recognition processing on the 120 audio frames to obtain an identity ID of the sound-emitting object to which each audio frame belongs, if there are 30 audio frames belonging to the same sound-emitting object and the playing time continues, determining the 30 audio frames as belonging to the same episode unit, for example, an episode unit corresponding to a certain time of a person a, and further determining a time period between a minimum time stamp and a maximum time stamp of the audio frames as a playing time period of the episode unit, and obtaining the episode unit by dividing the video based on the sound-emitting object can ensure that each episode unit belongs to the same sound-emitting object, so as to ensure consistency of playing of the content of the corresponding episode unit, it is also possible to provide the user with a stable listening experience from the listening dimension at the same time.

In some embodiments, the story unit obtained by dividing the video may be further updated based on the user behavior data, see fig. 8 and fig. 8, which are modified diagrams of the video playing control method provided in this embodiment of the present application, the story unit Q1 obtained by dividing exists on the video playing time slice T, the playing time period of the story unit Q1 is a time period between T1 and T2, it is counted that the user 1 and the user 2 have an interactive operation, such as a fast forward operation, on the story unit Q1, a two-way arrow in fig. 8 represents the playing time period of the video targeted by the interactive operation, the playing time periods targeted by the interactive operations from the two users are overlapped to obtain an interactive playing time period, such as a time period between T3 and T4 in fig. 8, the content in the video corresponding to the interactive playing time period may be referred to as an interactive unit, and therefore, the divided episode unit Q1 may be updated based on the interactive unit, the interactive playing time period may be directly used to replace the playing time period of the corresponding episode unit (e.g., episode unit Q1) during the updating, and the episode unit adjacent to the episode unit may be adaptively adjusted, the neutralizing playing time period obtained based on the interactive unit and the episode unit may also be used to replace the playing time period of the corresponding episode unit (e.g., episode unit Q1) during the updating, and the episode unit adjacent to the episode unit may be adaptively adjusted, the starting point of the neutralizing playing time period may be the middle point between the starting point of the interactive playing time period and the starting point of the playing time period of the episode unit, and the ending point of the neutralizing playing time period may be the middle point between the ending point of the interactive playing time period and the ending point of the playing time period of the episode unit. Because the plot unit is updated based on the user behavior data, the updated plot unit accords with the actual preference of the user, the watching experience of the user is improved, and the man-machine interaction efficiency is improved.

In some embodiments, transition units are also included in the video; the following technical scheme can be further implemented: determining a transition unit in the video by at least one of: determining the information quantity of each plot unit, and taking the plot units smaller than the threshold value of the information quantity as transition units; determining plot units used for connecting different scenes in the plurality of plot units as transition units; and determining the plot units used for connecting different conversations in the plurality of plot units as transition units.

As an example, a video may be divided into a plurality of story units in succession; alternatively, the video may be further divided into a plurality of plot units interspersed with transition units, and the introduction of the transition units makes the division of the plot units more reasonable, so that the content in the plot units more conforms to the user's expectations, for example, a video frame of a scene switching process between an indoor scene and an outdoor scene belongs to a transition unit.

As an example, when an episode unit for joining different scenes among a plurality of episode units is determined as a transition unit, for example, a third episode unit joining a first episode unit (the first episode unit includes a first scene) and a second episode unit (the second episode unit includes a second scene) may be determined as a transition unit, and the play periods of the first episode unit, the third episode unit, and the second episode unit are joined in sequence; the episode unit for joining different dialogs among the plurality of episode units is determined as a transition unit, and for example, a third episode unit joining a first episode unit (the first episode unit includes a first dialog) and a second episode unit (the second episode unit includes a second dialog) may be determined as a transition unit, and the play periods of the first episode unit, the third episode unit, and the second episode unit are joined in sequence.

In some embodiments, the following technical solutions may also be implemented: when the playing progress of the video is in the playing time period of any transition unit in the video, applying the playing double speed corresponding to the transition unit in the playing time period of the transition unit; wherein the playback speed corresponding to the transition unit is any one of the following playback speeds: fixed playing double speed, playing double speed of the plot unit connected with the transition unit and positioned in front of the transition unit, and playing double speed obtained according to the attribute information of the transition unit.

As an example, there may be a corresponding play double speed for the transition unit, where the corresponding play double speed may be a fixed play double speed, or may also be a play double speed of a previous story unit, and assuming that a first story unit is played first, then the transition unit is played, and then a second story unit is played, then the play double speed of the first story unit is taken as the play double speed of the transition unit, and the corresponding play double speed may also be determined according to the degree of interest of the user in the transition unit, that is, the play double speed of the transition unit is predicted by using the historical mass user data and the feature vector of the transition unit (attribute information of the transition unit), so that the play double speed of the transition unit matches the degree of interest of the user.

In some embodiments, obtaining the attribute information corresponding to the current episode unit may be implemented by the following technical solutions: acquiring the frequency of historical positive interaction operation and the frequency of historical negative interaction operation corresponding to the current plot unit as attribute information corresponding to the current plot unit; the playing speed corresponding to the current plot unit is obtained according to the attribute information, and the method can be realized by the following technical scheme: and determining the playing double speed which is negatively correlated with the historical active interactive operation times and positively correlated with the historical passive interactive operation times. The corresponding playing speed is predicted in real time through the attribute information, and the accuracy of the playing speed prediction is effectively improved.

In some embodiments, obtaining the attribute information corresponding to the current episode unit may be implemented by the following technical solutions: acquiring an identifier corresponding to the current plot unit as attribute information corresponding to the current plot unit; the playing speed corresponding to the current plot unit is obtained according to the attribute information, and the method can be realized by the following technical scheme: and determining the playing double speed corresponding to the identification of the current plot unit. Since the association relationship between the identifier of the story unit and the corresponding playback multiple speed is stored in advance, the multiple speed of the current story unit can be obtained directly by querying, and the process of obtaining the association relationship between the identifier of the story unit and the corresponding playback multiple speed can be realized by referring to steps 103A to 105A in fig. 4A, where the steps 103A to 105A can be referred to in an implementation manner of predicting the corresponding playback multiple speed in real time through attribute information (e.g., the number of operations), that is, replacing the story unit described below with the current story unit.

In some embodiments, referring to fig. 4A, fig. 4A is a schematic flowchart of a video playing control method provided in an embodiment of the present application.

In step 103A, the number of historical positive interactive operations and the number of historical negative interactive operations of the corresponding plot unit are obtained.

In step 104A, a level of interest that is positively correlated with the number of historical positive interactive operations and negatively correlated with the number of historical negative interactive operations is determined.

In step 105A, a playback multiple speed that is inversely related to the degree of interest is determined.

By way of example, the historical active interactive operation may be an interactive operation that characterizes a user's interest in the story unit, such as a send barrage operation, a screen capture operation, a comment operation, a like operation, a favorite operation, a rewind operation, and the like, and the historical passive interactive operation may be an interactive operation that characterizes a user's disinterest in the story unit, such as a fast forward operation, a jump to play other videos, and the like.

Taking the historical active interactive operation as an example, when the actual number of the multiple historical active interactive operations of the same user exceeds the threshold number of times, the influence of the deviation of the actual number of the multiple historical active interactive operations of the same user needs to be weakened, so the number of the historical active interactive operations can be merged and corrected according to the user, namely, the actual number of the historical active interactive operations of the same user for a certain plot unit is merged to be 1, for example, if the user a has 50 (actual number) historical active operations for the plot unit Q, the user B has 40 (actual number) historical active operations for the plot unit Q (exceeding the threshold number of times 30), the merging process is performed, the number of the historical active operations of the user a for the plot unit Q is recorded to be 1, the number of the historical active operations of the user B for the plot unit Q is recorded to be 1, the total number of the historical active interactive operations is 2, namely, the number statistics is carried out according to the number of the users.

As an alternative to the above counting the number of times according to the number of users, the number of users may be replaced by a user proportion, that is, a ratio of the number of users having historically active operations for the plot unit to the total number of users viewing the historically active plot unit, for example, 10 users viewing the plot unit Q in total, and if the number of users having historically active interactive operations for the plot unit Q is 2, the proportion is 0.2, and the number of times is replaced by the value of the proportion.

As an example, taking the historical active interactive operation as an example, when the actual number of times of the multiple historical active interactive operations of the same user does not exceed the number threshold, the influence of the deviation of the actual number of times of the multiple historical active interactive operations from the same user does not need to be attenuated, so the actual number can be directly counted as a basis to determine the playback multiple speed, assuming that the user a has 10 (actual number) historical active operations for the plot unit Q, the user B has 15 (actual number) historical active operations for the plot unit Q, the number of times of the historical active operations of the user a for the plot unit Q is recorded as 10, the number of times of the historical active operations of the user B for the plot unit Q is recorded as 15, and the total number of times of the historical active interactive operations is 25, that is, the counting is directly performed according to the number of operations.

As an example, the above-mentioned determination of the playing multiple speed negatively correlated to the interest level can be implemented by the following technical solutions: when the number of times of the active interaction operation is lower than a first time threshold value and the number of times of the passive interaction operation is higher than a second time threshold value, the value types of the playing speed comprise a slow speed and a fast speed, the slow speed corresponds to a decimal between 0 and 1, the fast speed corresponds to a multiple larger than or equal to 1, and the multiple is an integer or a decimal; when the number of times of the active interactive operation is not lower than the first time threshold or the number of times of the passive interactive operation is not higher than the second time threshold, the value type of the playing speed only comprises the fast speed.

In some embodiments, the attribute information corresponding to the current story unit may be obtained through the following technical solutions: acquiring historical playing speed of a plurality of users having social relations with the target user aiming at the current plot unit as attribute information corresponding to the current plot unit; the target user is a user submitting video playing operation; the playing speed corresponding to the current plot unit is obtained according to the attribute information, and the following technical scheme is adopted: acquiring similarity between the portrait of a plurality of users and the portrait of a target user; and taking the similarity corresponding to each of the plurality of users as a weight, carrying out weighting processing on the historical playing double speed of the plurality of users, and determining the weighting processing result as the playing double speed of the current plot unit. The corresponding playing speed is predicted in real time through the attribute information, and the accuracy of the playing speed prediction is effectively improved.

In some embodiments, obtaining the attribute information corresponding to the current episode unit may be implemented by the following technical solutions: acquiring an identifier corresponding to the current plot unit as attribute information corresponding to the current plot unit; the playing speed corresponding to the current plot unit is obtained according to the attribute information, and the method can be realized by the following technical scheme: and determining the playing double speed corresponding to the identification of the current plot unit. Since the association relationship between the logo of the story unit and the corresponding playback multiple speed is stored in advance, the multiple speed of the current story unit can be obtained directly by query, and the process of obtaining the association relationship between the logo of the story unit and the corresponding playback multiple speed can be realized by referring to steps 103B-105B in fig. 4B, wherein the step 103B-105B can be referred to in the implementation manner of predicting the corresponding playback multiple speed in real time through attribute information (e.g., historical playback multiple speed), that is, the story unit described below is replaced with the current story unit.

In some embodiments, referring to fig. 4B, fig. 4B is a schematic flowchart of a video playing control method provided in an embodiment of the present application.

In step 103B, historical playing double speeds of a plurality of users having social relations with target users for plot units are obtained, and the target users are users submitting video playing operations.

In step 104B, similarities between the representations of the plurality of users and the representation of the target user are obtained.

In step 105B, weighting processing is performed on the historical playback multiple speeds of the plurality of users with the similarity corresponding to each of the plurality of users as a weight, and the result of the weighting processing is determined as the playback multiple speed of the story unit.

As an example, a history playback multiple speed taken by a plurality of users having a social relationship with a target user for a plot unit is acquired, the target user is a user submitting a video playback operation, the target user is assumed to be user a, the plurality of users having a social relationship with the target user are respectively user B, user C and user D, similarities between figures of the plurality of users and figures of the target user are acquired, a similarity B between figures of user a and user B is acquired, a similarity C between figures of user a and user C is acquired, a similarity D between figures of user a and user D is acquired, the respective corresponding similarities of the plurality of users are taken as weights, the history playback multiple speeds of the plurality of users are weighted, the playback multiple speed of user B to plot unit Q is assumed to be 1-fold speed, the playback multiple speed of user C to plot unit Q is 2-fold speed, if the playing speed of the user D to the plot unit Q is 1.5 times, a weighting processing result (1 × +2 × + c +1.5 ×) is obtained, and the weighting processing result is determined as the playing speed of the plot unit, because the user who has a social relationship with the target user has similarity to the user image of the target user, the playing speed of the user who has a social relationship with the target user for a certain plot unit has a reference value, and if the playing speed of the user B for the corresponding interest degree of the plot unit is 1 time, and the similarity between the images of the user a and the user B is B, the reference value weight of the user B for the interest degree of the plot unit is B, and based on the weighting processing, the finally obtained weighting processing result can represent the interest degree of the user a for the plot unit.

In some embodiments, the attribute information corresponding to the current story unit may be obtained through the following technical solutions: acquiring a feature vector of a current plot unit as attribute information corresponding to the current plot unit; the playing speed corresponding to the current plot unit is obtained according to the attribute information, and the method can be realized by the following technical scheme: obtaining a historical playing double speed adopted by a historical plot unit watched by a target user from historical playing data of the target user; the target user is a user submitting video playing operation; determining the similarity between the feature vector of each historical plot unit and the feature vector of the current plot unit; and taking the historical playing double speed adopted by the historical plot unit with the maximum similarity as the playing double speed of the current plot unit. The corresponding playing speed is predicted in real time through the attribute information, and the accuracy of the playing speed prediction is effectively improved.

In some embodiments, obtaining the attribute information corresponding to the current episode unit may be implemented by the following technical solutions: acquiring an identifier corresponding to the current plot unit as attribute information corresponding to the current plot unit; the playing speed corresponding to the current plot unit is obtained according to the attribute information, and the method can be realized by the following technical scheme: and determining the playing double speed corresponding to the identification of the current plot unit. Because the association relationship between the logo of the plot unit and the corresponding playing speed is stored in advance, the speed of the current plot unit can be directly obtained through query, and the process of obtaining the association relationship between the logo of the plot unit and the corresponding playing speed can be realized through the following technical scheme: obtaining a historical playing double speed adopted by a historical plot unit watched by a target user from historical playing data of the target user, wherein the target user is a user submitting video playing operation; determining the similarity between the feature vector of each historical plot unit and the feature vector of the plot unit; and taking the historical playing double speed adopted by the historical plot unit with the maximum similarity as the playing double speed of the plot unit. The following embodiments can be referred to for the implementation of real-time prediction of the corresponding playback multiple speed by attribute information (e.g., feature vector of the current story unit).

As an example, the history playback double speed taken for the history episode unit viewed by the target user, which is the user submitting the video playback operation, is obtained from the history playback data of the target user, assuming that the target user a has viewed 3 history episode units (Q1, Q2, and Q3) before viewing the video, the similarity between the feature vector of each history episode unit and the feature vector of the episode unit, i.e., the similarity between the feature vectors of the episode unit Q and the history episode unit Q1, the similarity between the feature vectors of the episode unit Q and the history episode unit Q2, the similarity between the feature vectors of the episode unit Q and the history episode unit Q3, and the history playback double speed taken for the history episode unit Q3 assuming that the similarity between the feature vectors of the episode unit Q and the history episode unit Q3 is the maximum, as the playing double speed of the plot unit, the playing double speed of the historical plot unit can represent the interest degree of the target user A for the historical plot unit, the playing double speed of the historical plot unit with the maximum similarity is taken as the playing double speed of the plot unit Q, the playing double speed is in accordance with the user expectation, and the playing double speed corresponds to the interest degree of the target user A for the plot unit Q.

In some embodiments, obtaining the attribute information corresponding to the current episode unit may be implemented by the following technical solutions: acquiring zero operation time of a target user as attribute information corresponding to a current plot unit; the target user is a user submitting video playing operation; the playing speed corresponding to the current plot unit is obtained according to the attribute information, and the method can be realized by the following technical scheme: when the zero operation time exceeds a time threshold, a playback speed negatively correlated with the zero operation time is acquired.

As an example, the zero operation time is the time from the last time the terminal receives the interactive operation of the user to the current timestamp, the zero operation time is greater than the time threshold, which indicates that the user may not pay attention to the played video, and at this time, the playing double speed negatively correlated to the zero operation time is obtained as the playing double speed of the current episode unit, for example, the zero operation time reaches 10 minutes (exceeding the time threshold by 5 minutes), and needs to be played at 0.8 times, the zero operation time reaches 15 minutes, and needs to be played at 0.75 times, so as to ensure that the user does not miss too much content when paying attention to the video again.

In some embodiments, obtaining the attribute information corresponding to the current episode unit may be implemented by the following technical solutions: acquiring a subtitle vector, an audio vector and a video vector of a current plot unit as attribute information corresponding to the current plot unit; the playing speed corresponding to the current plot unit is obtained according to the attribute information, and the method can be realized by the following technical scheme: performing fusion processing on the subtitle vector, the audio vector and the video vector to obtain a fusion vector; and mapping the fusion vector into the probability corresponding to a plurality of candidate playing double speeds through a neural network model, and determining the candidate playing double speed corresponding to the maximum probability as the playing double speed corresponding to the current plot unit. The corresponding playing speed is predicted in real time through the attribute information, and the accuracy of the playing speed prediction is effectively improved.

In some embodiments, the following technical solutions may also be implemented: in response to a speed setting operation for the current story unit, determining an updated play speed corresponding to the current story unit to apply the updated play speed corresponding to the current story unit before the end of the play time period of the current story unit; updating the playing speed of the subsequent plot units in the video according to the updated playing speed; wherein the playing time period of the subsequent plot unit is after the playing time period of the current plot unit.

In some embodiments, the updating the playback speed of the subsequent story unit in the video according to the updated playback speed may be implemented by the following technical solutions: determining the similarity between the feature vector of the subsequent plot unit and the feature vector of the current plot unit; and when the similarity is greater than the similarity threshold, taking the updated playing speed adopted by the current plot unit as the playing speed of the subsequent plot unit.

As an example, it is assumed that when a certain story unit (current story unit) is played, the story unit is being played at the corresponding play double speed, but the play double speed of the story unit is not satisfied by the user, so the terminal receives a double speed setting operation for the story unit, the double speed setting operation carries an updated play double speed, so the terminal can determine the updated play double speed of the corresponding story unit and apply the updated play double speed before the end of the play time period of the story unit being played, and the user's double speed setting operation can correct the play double speed of the subsequent story unit (i.e. the unreplayed story unit).

As an example, assuming that the user has a double speed setting operation for the story unit Q being played, i.e., the play double speed related to the degree of interest corresponding to the story unit Q is not satisfied by the user, it may be determined that the similarity between the feature vectors of the subsequent story units (Q1, Q2, and Q3) and the feature vector of the story unit Q, respectively, when the similarity is greater than the similarity threshold, e.g., the similarity between the feature vectors of the story unit Q1 and the story unit Q is greater than the similarity threshold, and the updated play double speed assumed by the story unit Q is taken as the play double speed corresponding to the subsequent story unit Q1, thereby ensuring that the play double speed of the subsequent story unit corresponds to the latest degree of interest of the user for the story unit.

In some embodiments, referring to fig. 4C, fig. 4C is a flowchart illustrating a video playing control method provided in the embodiment of the present application, and step 106 and step 107 may be further performed before the current episode unit is played according to the corresponding playback speed in step 302.

In step 106, in response to the double speed play function triggering operation, the dynamic double speed control is presented.

In step 107, in response to the trigger operation for the dynamic double speed control, it is determined that an operation of applying the playback double speed corresponding to the story unit in the playback period of the story unit is to be performed.

In some embodiments, when the dynamic speed doubling control is presented, the following technical scheme can be further executed: presenting a fixed speed-multiplying control; and responding to the trigger operation aiming at the fixed double-speed control, and playing the video based on the set fixed playing double-speed in the fixed double-speed control.

As an example, step 106 and step 107 may be performed during video playback or between playing videos.

Referring to fig. 7, fig. 7 is an application diagram of a video playback control method provided in this embodiment of the present application, and in response to that the double-speed playback function triggering operation may be a triggering operation for the double-speed playback function control 602, a dynamic double-speed control 603 is then presented, when the dynamic speed doubling control 603 is presented, a fixed speed doubling control, such as a 1 speed doubling control, a 1.5 speed doubling control, or the like, is also presented, in response to a triggering operation for the dynamic speed doubling control 603, it is determined that an operation of applying a playback multiple speed corresponding to the story unit in the playback period of the story unit will be performed, in response to a trigger operation for the fixed multiple speed control, the video is played based on the fixed playback double speed set in the fixed double speed control, for example, assuming that a trigger operation for the fixed double speed control corresponding to 1.5 times speed is received, the video is played based on the fixed playback multiple speed (1.5 multiple speed) set in the fixed multiple speed control.

In some embodiments, the human-computer interaction interface of the terminal may present an advisory popup for consulting whether the user is satisfied with the current play double speed, and in response to receiving feedback information that the user is not satisfied with the play double speed of the plot unit, automatically present the fixed double speed control and the dynamic double speed control to provide an entry for the user to reset the play double speed, that is, the fixed double speed control and the dynamic double speed control are presented without receiving a trigger operation of the user for the double speed play function, which is beneficial to improving the human-computer interaction efficiency of the user, thereby improving the viewing experience of the user.

Next, a method for controlling playback of a video, which is provided in the embodiment of the present application, will be described by taking as an example that the terminal 400 and the server 200 in fig. 1 cooperate with each other. Referring to fig. 4D, fig. 4D is a schematic flowchart of a video playing control method according to an embodiment of the present application, and the steps shown in fig. 4D will be described.

In step 201, the terminal receives a video playing operation of a user.

In step 202, the terminal sends a video playing request corresponding to the video playing operation to the server.

In step 203, the server transmits the video to the terminal.

In step 204, the terminal plays the video.

In step 205, the terminal receives a trigger operation of the user for the dynamic speed doubling control.

As an example, step 205 may be performed at any time not earlier than step 201, that is, when the video is not played yet, that is, a user may receive a trigger operation for the dynamic speed doubling control to control the video to be played at the dynamic speed doubling manner.

In step 206, the terminal sends a request for acquiring video playing speed data to the server.

As an example, the execution timing of the terminal sending the acquisition request of the video playing speed data to the server in step 206 is determined completely according to the triggering operation of the user on the dynamic speed doubling control.

In step 207, the server transmits the playing time period of each story unit in the video and the playing speed corresponding to the interest level of each story unit to the terminal.

As an example, the playing time period of each story unit in the video and the playing double speed corresponding to the interest level of each story unit are stored in the server to avoid occupying the storage resources of the terminal, and the step of determining the playing time period of each story unit and the corresponding playing double speed may be completed at any time point before performing step 207.

In step 208, when the playing progress of the video is in the playing time period of any plot unit in the video, the playing double speed corresponding to the plot unit is applied in the playing time period of the plot unit.

It should be noted that the specific implementation manner of steps 201-204 is similar to that of step 101, and the specific implementation manner of step 208 is similar to that of steps 302-303, and will not be described herein again.

In the embodiment of the application, the server has strong computing capability and high computing speed relative to the terminal, and the server completes the processes of dividing the video into independent plot units and determining the speed of the corresponding plot units, so that the buffering time for playing the video by the terminal can be saved, and the computing resources of the terminal can be reduced.

Next, an exemplary application of the embodiment of the present application in a practical application scenario will be described.

Referring to fig. 5, fig. 5 is an overall flowchart of a video playing control method provided in this embodiment of the present application, first, in response to a click operation of a user on a certain video, enter a video playing page of a selected video corresponding to the click operation, and after entering the video playing page, default to play the video at a normal double speed (i.e., the double speed is 1), for example, if an original playing time of the video is 10 seconds, play the video using 10 seconds, if the user wishes to play at the double speed, a click double speed option may be selected, that is, in response to a trigger operation of the user on a double speed playing function, a dynamic double speed control and a fixed double speed control are presented, in response to a trigger operation on the fixed double speed control, for example, play at 1.5 times and play at 2 times, a fixed double speed adopted by playing the video is determined, the video is played at the fixed double speed set in the fixed double speed control based on the fixed playing speed control, the method comprises the steps of responding to a trigger operation aiming at a dynamic speed doubling control, determining to execute an operation of applying a playing speed doubling corresponding to a plot unit in a playing time period of the plot unit, acquiring dynamic speed doubling data from a server as video playing speed data, wherein the dynamic speed doubling data can be understood as adopting different playing speeds aiming at different playing time periods, the dynamic speed doubling data can be obtained through off-line calculation and stored in the server, responding to the operation of a user, generating video playing speed data, a video client running at a terminal carries out dynamic speed doubling playing based on the video playing speed data, and if the user is not satisfied with the current playing speed doubling, responding to the trigger operation aiming at the fixed speed doubling control by the user, and re-determining the fixed speed adopted by the playing video.

In some embodiments, the video may be divided based on different dimensions to obtain a plurality of independent episode units and a playing time period of each episode unit, where the playing speed of each episode unit is determined based on behavior data of a large number of users, and assuming that many users have a fast forward operation when watching a certain episode unit of the video, the playing speed corresponding to the episode unit may be determined, see fig. 6, where fig. 6 is a speed decision diagram of a playing control method of the video provided by the embodiment of the present application, for example, three users watch the video a, and all three users (user 1, user 2, and user 3) have a fast forward operation on the video a, users who do not generate a fast forward operation may be filtered in advance, a plurality of episode units exist in the video playing time axis T, such as the episode unit Q1 and the episode unit Q2, the number of times of fast forward operation generation of each plot unit in the video is determined, if the same user has multiple operations aiming at the plot unit, the number of times of the multiple operations can be objectively recorded, or only one operation can be recorded, namely, the number of the users generating the fast forward operation is equivalent to the number of the users generating the fast forward operation.

In some embodiments, the playing multiple speed may be divided into four steps (e.g., 3 times speed, 2 times speed, 1.5 times speed, 1 times speed), if the number of users selecting fast forward is greater than 80% of the total number of users, it may be determined that the plot needs to be played at 3 times speed, and the table of correspondence between the multiple speed and the number of users is as follows:

proportion of number of people	Video speed multiplier
		[80％,100％]	3 times of
[50％,80％)	2 times of
		[20％,50％)	1.5 times of
[0,20％)	1 times of

For example, the plot unit Q1 in FIG. 6 has a user count ratio of 2/3, 2/3 in the interval of [ 50%, 80%), thus determining that the plot unit Q1 will be played at 2 times speed, and the plot unit Q2 has a user count ratio of 1, 1 in the interval of [ 80%, 100% ], thus determining that the plot unit Q2 will be played at 3 times speed. Based on the above embodiment, the video playing speed data of the generated video is stored in the server, and in order to save data storage resources, only data with a speed greater than 1 time may be stored, where the storage format is as follows, video a: scenario unit Q1: 2-fold, plot unit Q2: 3 times.

Referring to fig. 7, fig. 7 is an application schematic diagram of a video playing control method provided in this embodiment, a double-speed playing function control 602 is presented in a video playing page 601, a dynamic double-speed control 603 is presented in response to a click operation on the double-speed playing function control 602, and a trigger operation on the dynamic double-speed control 603 is responded, so that a video can have different playing double speeds under different scenarios, for example, a plot unit corresponding to an advertisement stage can perform skip playing at a faster playing speed (the double speed is greater than 1), a plot unit corresponding to a highlight part of the video can play at an original speed (the double speed is 1), specifically, the playing double speed of each plot unit in the video is determined by using massive user behavior data, and a client (video client) can obtain double-speed data of different playing time periods through a network request to realize a dynamic double-speed playing function of the client, the dynamic speed-doubling playing function of the video can reduce the times of playing speed-doubling by manual control of a user, so that the man-machine interaction efficiency of watching the video by the user can be improved, and the watching experience of watching the video by the user is further improved.

According to the embodiment of the application, videos are divided according to plot units, different playing speeds are adopted for different plot units, therefore, in the playing process of the videos, different plots are played at different playing speeds without receiving any operation of a user, the playing control operation times of the user are reduced, the man-machine interaction efficiency is improved, and because the speeds are multiplied according to different plot units, the contents corresponding to the same plot unit are played at the same speed, the continuous watching experience of the user is ensured, and the video playing efficiency is improved.

Continuing with the exemplary structure of the video playback control device 455 provided in the embodiments of the present application implemented as software modules, in some embodiments, as shown in fig. 2, the software modules stored in the video playback control device 455 of the memory 450 may include: a playing module 4551, configured to play a video in response to a video playing operation; a speed doubling module 4552, configured to obtain attribute information corresponding to a current story unit, so as to obtain a playing speed doubling corresponding to the current story unit according to the attribute information; and the playing module 4551 is configured to play the current episode unit according to the playing double speed.

In some embodiments, the obtaining module 4553 is further configured to: before obtaining attribute information corresponding to a current story unit, dividing the video into a plurality of story units by one of: dividing the video according to the scene; dividing the video according to the conversation; the video is divided according to the content sources, wherein the types of the content sources comprise the original content of the video and recommendation information inserted in the video.

In some embodiments, the obtaining module 4553 is further configured to: carrying out scene identification processing on each video frame in the video to obtain a scene to which each video frame belongs; determining a plurality of video frames which belong to the same scene and have continuous playing time as belonging to the same plot unit, and determining a time period between a minimum time stamp and a maximum time stamp of the plurality of video frames as a playing time period of the plot unit.

In some embodiments, the obtaining module 4553 is further configured to: carrying out identity recognition processing on a sound production object of each audio frame in the video; determining a plurality of audio frames which belong to the same sound production object and have continuous playing time as belonging to the same plot unit, and determining a time period between a minimum time stamp and a maximum time stamp of the plurality of audio frames as a playing time period of the plot unit.

In some embodiments, transition units are also included in the video; the obtaining module 4553 is further configured to: determining a transition unit in the video by at least one of: determining the information quantity of each plot unit, and taking the plot units smaller than the threshold value of the information quantity as transition units; determining plot units used for connecting different scenes in the plurality of plot units as transition units; and determining the plot units used for connecting different conversations in the plurality of plot units as transition units.

In some embodiments, the obtaining module 4553 is further configured to: when the playing progress of the video is in the playing time period of any transition unit in the video, applying the playing double speed corresponding to the transition unit in the playing time period of the transition unit; wherein the playback speed corresponding to the transition unit is any one of the following playback speeds: fixed playing double speed, playing double speed of the plot unit connected with the transition unit and positioned in front of the transition unit, and playing double speed obtained according to the attribute information of the transition unit.

In some embodiments, the speed doubling module 4552 is further configured to: acquiring the frequency of historical positive interaction operation and the frequency of historical negative interaction operation of a corresponding plot unit as attribute information corresponding to the current plot unit; and determining the playing double speed which is negatively correlated with the number of the historical positive interactive operations and positively correlated with the number of the historical negative interactive operations.

In some embodiments, the speed doubling module 4552 is further configured to: acquiring historical playing speed of a plurality of users having social relations with the target user aiming at the current plot unit as attribute information corresponding to the current plot unit; the target user is a user submitting video playing operation; acquiring similarity between portraits of a plurality of users and portraits of the users; and taking the similarity corresponding to each of the plurality of users as a weight, carrying out weighting processing on the historical playing double speed of the plurality of users, and determining the weighting processing result as the playing double speed of the current plot unit.

In some embodiments, the speed doubling module 4552 is further configured to: acquiring a feature vector of a current plot unit as attribute information corresponding to the current plot unit; obtaining a historical playing double speed adopted by a historical plot unit watched by a target user from historical playing data of the target user; the target user is a user submitting video playing operation; determining the similarity between the feature vector of each historical plot unit and the feature vector of the current plot unit; and taking the historical playing double speed adopted by the historical plot unit with the maximum similarity as the playing double speed of the current plot unit.

In some embodiments, the speed doubling module 4552 is further configured to: in response to a multiple speed setting operation for the current story unit, determining an updated playback multiple speed corresponding to the current story unit to apply the updated playback multiple speed corresponding to the current story unit before the end of the playback time period of the current story unit; updating the playing speed of the subsequent plot units in the video according to the updated playing speed; wherein the playing time period of the subsequent plot unit is after the playing time period of the current plot unit.

In some embodiments, the speed doubling module 4552 is further configured to: determining the similarity between the feature vector of the subsequent plot unit and the feature vector of the current plot unit; and when the similarity is greater than the similarity threshold, taking the updated playing speed adopted by the current plot unit as the playing speed of the subsequent plot unit.

In some embodiments, before playing the current story unit according to the playback double speed, the apparatus further comprises: a control module 4554 configured to: responding to the trigger operation of the speed-multiplying play function, and presenting a dynamic speed-multiplying control; and in response to the triggering operation aiming at the dynamic double-speed control, determining that the operation of playing the current plot unit according to the playing double-speed is to be executed.

In some embodiments, when presenting the dynamic speed doubling control, the control module 4554 is further configured to: presenting a fixed speed-multiplying control; and responding to the trigger operation aiming at the fixed double-speed control, and playing the video based on the set fixed playing double-speed in the fixed double-speed control.

Embodiments of the present application provide a computer program product or computer program comprising computer instructions stored in a computer readable storage medium. The processor of the computer device reads the computer instructions from the computer-readable storage medium, and executes the computer instructions, so that the computer device executes the video playing control method according to the embodiment of the present application.

Embodiments of the present application provide a computer-readable storage medium storing executable instructions, which when executed by a processor, cause the processor to execute a playing control method for a video provided by embodiments of the present application, for example, a playing control method for a video as shown in fig. 3 or fig. 4A-4D.

In some embodiments, the computer-readable storage medium may be memory such as FRAM, ROM, PROM, EPROM, EEPROM, flash, magnetic surface memory, optical disk, or CD-ROM; or may be various devices including one or any combination of the above memories.

In some embodiments, executable instructions may be written in any form of programming language (including compiled or interpreted languages), in the form of programs, software modules, scripts or code, and may be deployed in any form, including as a stand-alone program or as a module, component, subroutine, or other unit suitable for use in a computing environment.

By way of example, executable instructions may correspond, but do not necessarily have to correspond, to files in a file system, and may be stored in a portion of a file that holds other programs or data, such as in one or more scripts in a hypertext Markup Language (HTML) document, in a single file dedicated to the program in question, or in multiple coordinated files (e.g., files that store one or more modules, sub-programs, or portions of code).

By way of example, executable instructions may be deployed to be executed on one computing device or on multiple computing devices at one site or distributed across multiple sites and interconnected by a communication network.

In summary, according to the embodiments of the present application, videos are divided according to story units, and different playback speeds are adopted for different story units, so that different stories are played at different playback speeds without receiving any operation of a user during the playback of the videos, and the number of playback control operations of the user is reduced, thereby improving the human-computer interaction efficiency.

The above description is only an example of the present application, and is not intended to limit the scope of the present application. Any modification, equivalent replacement, and improvement made within the spirit and scope of the present application are included in the protection scope of the present application.

Claims

1. A video playing control method is characterized by comprising the following steps:

responding to a video playing operation, and playing the video;

and playing the current plot unit according to the playing double speed.

2. The method of claim 1, wherein before obtaining the attribute information corresponding to the current story unit, the method further comprises:

dividing the video into a plurality of story units by one of:

dividing the video according to scenes;

dividing the video according to the conversation;

the video is divided according to content sources, wherein the types of the content sources comprise the original content of the video and recommendation information inserted in the video.

3. The method of claim 2, wherein the partitioning the video by scene comprises:

carrying out scene identification processing on each video frame in the video to obtain a scene to which each video frame belongs;

determining a plurality of video frames which belong to the same scene and have continuous playing time as belonging to the same plot unit, and determining a time period between a minimum time stamp and a maximum time stamp of the plurality of video frames as a playing time period of the plot unit.

4. The method of claim 2, wherein said partitioning said video by conversation comprises:

carrying out identity recognition processing on a sound production object of each audio frame in the video;

determining a plurality of audio frames which belong to the same sound production object and have continuous playing time as belonging to the same plot unit, and determining a time period between a minimum time stamp and a maximum time stamp of the plurality of audio frames as a playing time period of the plot unit.

5. The method of claim 2, wherein the video further comprises a transition unit;

the method further comprises the following steps:

determining a transition unit in the video by at least one of:

determining the information quantity of each plot unit, and taking the plot units smaller than the threshold value of the information quantity as transition units;

determining plot units used for connecting different scenes in the plurality of plot units as transition units;

determining an episode unit of the plurality of episode units for joining different conversations as a transition unit.

6. The method of claim 1, further comprising:

when the playing progress of the video is in the playing time period of any transition unit in the video, applying a playing double speed corresponding to the transition unit in the playing time period of the transition unit;

wherein the playback speed corresponding to the transition unit is any one of the following playback speeds: the fixed playing double speed, the playing double speed of the plot unit which is connected with the transition unit and is positioned in front of the transition unit, and the playing double speed obtained according to the attribute information of the transition unit.

7. The method of claim 1,

the acquiring of the attribute information corresponding to the current plot unit includes:

acquiring the frequency of historical positive interaction operation and the frequency of historical negative interaction operation corresponding to the current plot unit as attribute information corresponding to the current plot unit;

acquiring the playing double speed corresponding to the current plot unit according to the attribute information, wherein the method comprises the following steps:

and determining the playing double speed which is negatively correlated with the number of the historical positive interactive operations and positively correlated with the number of the historical negative interactive operations.

8. The method of claim 1,

acquiring historical playing speed of a plurality of users having social relations with target users aiming at the current plot unit as attribute information corresponding to the current plot unit;

wherein the target user is a user submitting the video playing operation;

the obtaining of the playing speed corresponding to the current plot unit according to the attribute information includes:

acquiring similarity between the portraits of the plurality of users and the portraits of the target user;

and taking the similarity corresponding to each of the plurality of users as a weight, carrying out weighting processing on the historical playing double speed of the plurality of users, and determining the weighting processing result as the playing double speed of the current plot unit.

9. The method of claim 1,

acquiring a feature vector of the current plot unit as attribute information corresponding to the current plot unit;

obtaining a historical playing double speed adopted by a historical plot unit watched by a target user from historical playing data of the target user;

wherein the target user is a user submitting the video playing operation;

determining the similarity between the feature vector of each historical plot unit and the feature vector of the current plot unit;

and taking the historical playing double speed adopted by the historical plot unit with the maximum similarity as the playing double speed of the current plot unit.

10. The method of claim 1, further comprising:

in response to a speed-doubling setting operation for the current story unit, determining an updated playback speed corresponding to the current story unit to apply the updated playback speed corresponding to the current story unit before the end of the playback period of the current story unit;

updating the playing speed of the subsequent plot units in the video according to the updated playing speed;

wherein the playing time period of the subsequent plot unit is after the playing time period of the current plot unit.

11. The method of claim 10, wherein updating the playback speed of the subsequent story unit in the video according to the updated playback speed comprises:

determining similarity between the feature vector of the subsequent plot unit and the feature vector of the current plot unit;

and when the similarity is greater than a similarity threshold value, taking the updated playing speed adopted by the current plot unit as the playing speed of the subsequent plot unit.

12. The method of claim 1, wherein before playing the current story unit according to the playback speed, the method further comprises:

responding to the trigger operation of the speed-multiplying play function, and presenting a dynamic speed-multiplying control;

and responding to the trigger operation aiming at the dynamic speed doubling control, and determining that the operation of playing the current plot unit according to the playing speed doubling is to be executed.

13. A video playback control apparatus, comprising:

14. An electronic device, comprising:

a memory for storing executable instructions;

a processor, configured to execute the executable instructions stored in the memory to implement the method for controlling playback of a video according to any one of claims 1 to 12.

15. A computer-readable storage medium storing executable instructions for implementing the method for controlling playback of a video according to any one of claims 1 to 12 when executed by a processor.