CN111787357A - Video processing method and electronic equipment - Google Patents

Video processing method and electronic equipment Download PDF

Info

Publication number
CN111787357A
CN111787357A CN202010740875.0A CN202010740875A CN111787357A CN 111787357 A CN111787357 A CN 111787357A CN 202010740875 A CN202010740875 A CN 202010740875A CN 111787357 A CN111787357 A CN 111787357A
Authority
CN
China
Prior art keywords
video
playing
target video
paragraph
speed
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202010740875.0A
Other languages
Chinese (zh)
Inventor
陶嘉明
罗应文
张晓平
李凯
张学荣
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Lenovo Beijing Ltd
Original Assignee
Lenovo Beijing Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Lenovo Beijing Ltd filed Critical Lenovo Beijing Ltd
Priority to CN202010740875.0A priority Critical patent/CN111787357A/en
Publication of CN111787357A publication Critical patent/CN111787357A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
    • H04N21/23418Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/238Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams
    • H04N21/2387Stream processing in response to a playback request from an end-user, e.g. for trick-play
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/433Content storage operation, e.g. storage operation in response to a pause request, caching operations
    • H04N21/4331Caching operations, e.g. of an advertisement for later insertion during playback
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
    • H04N21/44008Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream

Abstract

The application discloses a video processing method and electronic equipment, wherein the method comprises the following steps: intercepting a sub-video of which the audio information meets a preset condition from video data under the condition of receiving a preset trigger event; acquiring a target video section of which the difference between adjacent video frames in the sub-video is smaller than a first preset threshold; and processing the playing speed adapted to the target video paragraph. By adopting the method disclosed by the application, the quick playing of the part suitable for the double-speed playing can be realized through the automatic double-speed playing or the prompt of the user, so that the time of the user is saved, and the user experience is improved.

Description

Video processing method and electronic equipment
Technical Field
The present disclosure relates to the field of video playing, and in particular, to a video processing method and an electronic device.
Background
The 'double-speed playing' is a function newly added in the field of video playing in recent years, a user can use playing software to accelerate or decelerate the video playing speed, under the condition of accelerating the video playing speed, less time can be spent to finish video watching, and under a plurality of scenes, the user experience can be improved by selecting the 'double-speed playing'.
For example, in a teaching video, a teacher writes on a blackboard or ppt, the main content of the video is the teacher's writing operation, and in general, the teacher may not speak in the period of time; or the teacher presents a problem that people firstly have a few minutes of thinking time and then continue teaching, and in the period of time, the video picture possibly does not change and no sound exists. Such a scenario allows the student to play quickly without missing important information.
Therefore, how to provide a video processing method for prompting or playing at double speed for a portion suitable for playing at double speed to save time of a user and improve user experience is a technical problem to be solved urgently.
Disclosure of Invention
The embodiment of the application aims to provide a video processing method and electronic equipment.
In order to solve the technical problem, the embodiment of the application adopts the following technical scheme: a video processing method, comprising:
intercepting a sub-video of which the audio information meets a preset condition from video data under the condition of receiving a preset trigger event;
acquiring a target video section of which the difference between adjacent video frames in the sub-video is smaller than a first preset threshold;
and processing the playing speed adapted to the target video paragraph.
In one embodiment, the preset trigger event includes:
receiving an event of a complete video to be processed; or
An event is detected in which a pending video segment is present in the buffer.
In one embodiment, intercepting a sub-video whose audio information meets a preset condition from video data includes:
intercepting audio information of which the volume is smaller than a second preset threshold value in the audio information;
and determining the video paragraph corresponding to the audio information with the volume smaller than the second preset threshold as a sub-video meeting the preset condition.
The beneficial effect of this embodiment lies in: the video segment with small volume or without volume is used as the sub-video, so that the time of the user is saved through double-speed playing, the user is prevented from missing important audio information, and the user experience is further improved.
In one embodiment, acquiring a target video segment in the sub-video, where a difference between adjacent video frames in the sub-video is smaller than a first preset threshold, includes:
acquiring the starting time and the ending time of a target video section of which the difference of adjacent video frames is smaller than a first preset threshold;
and acquiring the target video paragraph according to the starting time and the ending time.
In one embodiment, the processing the playback speed adapted to the target video segment includes:
determining the playing double speed adapted to the target video paragraph under the condition that the current playing mode is the first mode;
and playing the target video paragraph based on the playing double speed adapted to the target video paragraph.
In one embodiment, the processing the playback speed adapted to the target video segment includes:
determining the type of the content played in the target video paragraph under the condition that the current playing mode is the second mode;
and determining the playing speed of the target video paragraph according to the type of the target video paragraph, and storing the playing speed of the target video paragraph.
In one embodiment, the processing the playback speed adapted to the target video segment includes:
under the condition that the current playing mode is the second mode, acquiring historical behavior data of a user;
and determining the playing speed of the target video paragraph based on the historical behavior data of the user, and storing the playing speed of the target video paragraph.
The beneficial effect of this embodiment lies in: the playing speed of the target video paragraph can be determined based on the historical behavior data of the user, so that the determined playing speed is more in line with the habit of the user.
In one embodiment, during the video playing process, the method further comprises:
under the condition of playing to the starting time of the target video paragraph, acquiring the playing speed of the stored target video paragraph;
and sending out prompt information based on the playing speed.
In one embodiment, the processing the playback speed adapted to the target video segment includes:
and marking the area corresponding to the target video paragraph on the video file playing progress bar according to a preset color.
The present application further provides an electronic device, comprising:
the intercepting module is used for intercepting the sub-video of which the audio information meets the preset conditions from the video data under the condition of receiving the preset trigger event;
the acquisition module is used for acquiring a target video section of which the difference between adjacent video frames in the sub-video is smaller than a first preset threshold;
and the processing module is used for processing the playing double speed adapted to the target video paragraph.
The present application also provides a video processing apparatus, including:
a processor;
a memory for storing processor-executable instructions;
wherein the processor is configured to:
intercepting a sub-video of which the audio information meets a preset condition from video data under the condition of receiving a preset trigger event;
acquiring a target video section of which the difference between adjacent video frames in the sub-video is smaller than a first preset threshold;
and processing the playing speed adapted to the target video paragraph.
The beneficial effect of this application lies in: the method comprises the steps that a sub-video with audio information meeting preset conditions can be intercepted from video data, and then a target video section with the difference of adjacent video frames in the sub-video smaller than a first preset threshold value is obtained; and processing the playing speed multiple adapted to the target video paragraph, and further realizing quick playing of a part suitable for playing at the speed multiple through automatic speed multiple playing or prompting a user, so that the time of the user is saved, and the user experience is improved.
Drawings
Fig. 1 is a flowchart of a video processing method according to an embodiment of the present application;
fig. 2A is a flowchart of a video processing method according to an embodiment of the present application;
FIG. 2B is an exemplary flowchart of an embodiment of obtaining a target video segment;
FIG. 2C is an exemplary diagram of adjacent video frames in an embodiment of the present application;
FIG. 3 is a block diagram of an electronic device according to an embodiment of the present application;
fig. 4 is a block diagram of an electronic device according to an embodiment of the present application.
Detailed Description
Various aspects and features of the present application are described herein with reference to the drawings.
It will be understood that various modifications may be made to the embodiments of the present application. Accordingly, the foregoing description should not be construed as limiting, but merely as exemplifications of embodiments. Those skilled in the art will envision other modifications within the scope and spirit of the application.
The accompanying drawings, which are incorporated in and constitute a part of the specification, illustrate embodiments of the application and, together with a general description of the application given above and the detailed description of the embodiments given below, serve to explain the principles of the application.
These and other characteristics of the present application will become apparent from the following description of preferred forms of embodiment, given as non-limiting examples, with reference to the attached drawings.
It should also be understood that, although the present application has been described with reference to some specific examples, a person of skill in the art shall certainly be able to achieve many other equivalent forms of application, having the characteristics as set forth in the claims and hence all coming within the field of protection defined thereby.
The above and other aspects, features and advantages of the present application will become more apparent in view of the following detailed description when taken in conjunction with the accompanying drawings.
Specific embodiments of the present application are described hereinafter with reference to the accompanying drawings; however, it is to be understood that the disclosed embodiments are merely exemplary of the application, which can be embodied in various forms. Well-known and/or repeated functions and constructions are not described in detail to avoid obscuring the application of unnecessary or unnecessary detail. Therefore, specific structural and functional details disclosed herein are not to be interpreted as limiting, but merely as a basis for the claims and as a representative basis for teaching one skilled in the art to variously employ the present application in virtually any appropriately detailed structure.
The specification may use the phrases "in one embodiment," "in another embodiment," "in yet another embodiment," or "in other embodiments," which may each refer to one or more of the same or different embodiments in accordance with the application.
Fig. 1 is a flowchart of a video processing method according to an embodiment of the present application, where the method includes the following steps S11-S13:
in step S11, in the case of receiving a preset trigger event, intercepting a sub-video whose audio information meets a preset condition from the video data;
in step S12, a target video segment in which the difference between adjacent video frames in the sub-video is smaller than a first preset threshold is obtained;
in step S13, the playback speed adapted to the target video segment is processed.
The execution subject of the present application may be a server providing an online on-demand service and/or a video download service, and such a server may process videos in the server in advance through the above-mentioned steps S11-S13.
The execution subject of the application can also be a computer or a terminal device for playing streaming media video or local video. For example, when a computer or a mobile terminal requests a video online, if the server does not adapt the playing double speed for the video segment suitable for double speed playing in the video, since the current streaming media data is pre-buffered during playing, that is, a video segment of tens of seconds to several minutes is pre-buffered to avoid pause during playing the streaming media video, the mobile terminal may process the video segment appearing in the buffer through the above steps S11-S13. For another example, when the computer or the mobile terminal detects that a complete video is locally stored, the locally stored complete video may also be processed through the above steps S11-S13.
In the embodiment, a sub-video with audio information meeting preset conditions is intercepted from video data under the condition of receiving a preset trigger event; specifically, the preset trigger event includes: receiving an event of a complete video to be processed; or detecting an event that a video clip to be processed appears in the cache, wherein the sub-video with the audio information meeting the preset condition is the sub-video with the audio volume smaller than a preset value. Acquiring a target video section of which the difference of adjacent video frames in the sub-video is smaller than a first preset threshold;
and the difference of the adjacent videos in the sub-video can be determined by the following method:
in a first mode
Converting adjacent video frames into corresponding gray-scale images;
acquiring a histogram corresponding to the gray-scale image to count the probability of each gray-scale value in the gray-scale image;
the comparison of the histograms determines the difference of adjacent video frames.
Mode two
Acquiring adjacent video frames in the sub-video;
comparing pixel values of the same position of adjacent video frames;
counting the number of the same pixel values of the same position of the adjacent video frames;
and determining the difference of the adjacent video frames in the sub-video according to the number of the same pixel values of the same positions of the adjacent video frames.
The difference between adjacent video frames is small, which indicates that the picture change amplitude is not large, and thus the plot advancing speed in the video is slow. Therefore, the target video segment with small adjacent frame difference is suitable for fast playing, and therefore, the corresponding playing double speed is adapted to the target video segment.
And processing the playing speed adapted to the target video paragraph, for example, when the video is played to the target video paragraph, playing the video at the adapted playing speed, or giving a prompt to the user to prompt the user that the video is suitable for playing at the multiple speed.
Taking a teaching video as an example, in the teaching video, when a teacher plays a blackboard writing on a blackboard, the main content of the video is the blackboard writing operation of the teacher, and the teacher may not speak in the period of time; or the teacher presents a problem that people firstly have a few minutes of thinking time and then continue teaching, and in the period of time, the video picture possibly does not change and no sound exists. Such a scenario allows the student to play quickly without missing important information.
In view of such circumstances, in the present application, when the video is processed, a sub-video with no audio information or low audio information volume is captured from the video, where no audio information indicates that the teacher does not speak, and low audio information volume may be a noise generated when the teacher performs writing or walks. Further analyzing the intercepted sub-video, and acquiring a target video section with the difference of adjacent video frames smaller than a first preset threshold value from the sub-video; for example, in a video paragraph of a blackboard-writing performed by a teacher, the change range of the posture and the position of the teacher is small, if the video paragraph is played at twice speed, important information cannot be missed, but the blackboard-writing process is smoother, so that the video paragraph can be adapted to the twice playing speed. For video paragraphs with almost unchanged pictures, for example, video paragraphs for which the teacher has left students to think about the problem time, the posture and position of the teacher hardly change, and the video paragraphs are played at triple or quadruple speed, so that the time of video viewers can be greatly saved. The beneficial effect of this application lies in: the method comprises the steps that a sub-video with audio information meeting preset conditions can be intercepted from video data, and then a target video section with the difference of adjacent video frames in the sub-video smaller than a first preset threshold value is obtained; the playing speed multiplication matched with the target video paragraph is processed, and then the part suitable for speed multiplication playing can be played quickly through automatic speed multiplication playing or prompting the user, so that the time of the user is saved, and the user experience is improved.
In one embodiment, the preset triggering event includes:
receiving an event of a complete video to be processed; or
An event is detected in which a pending video segment is present in the buffer.
In this embodiment, the preset trigger event may be an event of receiving a complete video to be processed; for example, the server receives an event of a complete video uploaded by the user, and for example, the terminal or computer device detects the time to download a complete video locally from a website or application.
In addition, the preset trigger event can also be an event that a video clip to be processed is detected to appear in the cache; for example, when a terminal or a computer device requests a streaming media video through a server providing a video-on-demand service, since current streaming media data is pre-buffered during playing, that is, when the streaming media video is played, a video clip of ten seconds to several minutes is pre-buffered into a local buffer to avoid blocking, the preset trigger time may also be an event that a to-be-processed video clip occurs in the buffer. Therefore, the method and the device can also be applied to processing the streaming media video clip in the video on demand process.
In one embodiment, the above step S11 can be implemented as the following steps A1-A2:
in step a1, intercepting audio information of which the volume is smaller than a second preset threshold value from the audio information;
in step a2, the video segment corresponding to the audio information with the volume less than the second preset threshold is determined as the sub-video meeting the preset condition.
In the teaching video, when a teacher plays a blackboard writing on a blackboard, the main content of the video is the blackboard writing operation of the teacher, and the teacher may not speak in the period of time; or the teacher presents a problem that people firstly have a few minutes of thinking time and then continue teaching, and in the period of time, the video picture possibly does not change and no sound exists. In view of such circumstances, in the present application, when the video is processed, a sub-video with no audio information or low audio information volume is captured from the video, where no audio information indicates that the teacher does not speak, and low audio information volume may be a noise generated when the teacher performs writing or walks. Therefore, in the present application, intercepting a sub-video whose audio information meets a preset condition from video data may be implemented as: intercepting audio information of which the volume is smaller than a second preset threshold value in the audio information; and determining the video paragraph corresponding to the audio information with the volume smaller than the second preset threshold value as the sub-video meeting the preset condition.
The beneficial effect of this embodiment lies in: the video segment with small volume or without volume is used as the sub-video, so that the time of the user is saved through double-speed playing, the user is prevented from missing important audio information, and the user experience is further improved.
In one embodiment, as shown in FIG. 2A, the above step S12 can be implemented as the following steps S21-S22:
in step S21, acquiring a start time and an end time of a target video segment whose difference between adjacent video frames is smaller than a first preset threshold;
in step S22, the target video segment is acquired according to the start time and the end time.
Taking a teaching video as an example, as shown in fig. 2B, adjacent video frames a and B are extracted from a sub-video, and the adjacent video frames a and B are compared, as can be seen from fig. 2C, both the video frame a and the video frame B are pictures of a teacher performing a blackboard-writing operation, and the position and the posture of the teacher hardly change, assuming that in the teaching video, the teacher is performing the blackboard-writing operation all the time from 00:05:35 to 00:08:50 of the video playing time, and in the video section, the teacher does not speak and has no obvious position change, then, in the video section, the start time and the end time of a target video section of the adjacent video frames, which are smaller than a first preset threshold, are 00:05:35 and 00:08:50 respectively. Therefore, the target video passage 00:05:35 to 00:08:50 is obtained according to the start time and the end time.
In one embodiment, the above step S13 can be implemented as the following steps B1-B2:
in step B1, in the case that the current play mode is the first mode, determining the play double speed adapted to the target video paragraph;
in step B2, the target video segment is played based on the playback speed adapted to the target video segment.
In this embodiment, when the play mode is the first mode, the play speed adapted to the target video segment is determined, and the first mode may be a mode for automatically playing according to the adapted play speed. In this mode, when the playing speed adapted to the target video paragraph is determined, the target video paragraph is directly played based on the playing speed adapted to the target video paragraph without manual operation of the user.
It should be noted that, in the first mode, the playback speed of the target video segment may also be determined based on the type of the target video segment.
In one embodiment, the above step S13 can also be implemented as the following steps C1-C2:
in step C1, in the case that the current play mode is the second mode, determining the type to which the content played in the target video paragraph belongs;
in step C2, the playback speed of the target video segment is determined according to the type of the target video segment, and the playback speed of the target video segment is stored.
In this embodiment, when the current play mode is the second mode, the type to which the content played in the target video paragraph belongs is determined; and determining the playing speed of the target video paragraph according to the type of the target video paragraph, and storing the playing speed of the target video paragraph.
The second mode may be a mode for reminding the video viewer according to the adapted playback speed, that is, whether the playback at the speed is required or not, and the user needs to manually confirm the playback speed.
Of course, it is understood that the first mode and the second mode are exemplified for better describing and introducing the present application, the first mode may be a mode for reminding a video viewer according to the adapted play double speed, and the second mode may be a mode for automatically playing according to the adapted play double speed. This is not a limitation of the present application.
For example, the video data is a complete teaching video, and the change range of the posture and the position of the teacher is small in the video paragraph of the blackboard writing performed by the teacher, so that if the video paragraph is played at twice speed, important information cannot be missed, and the blackboard writing process can be smoother. For a video paragraph with almost unchanged picture, for example, a teacher leaves a video paragraph for students to think about problem time, the posture and position of the teacher hardly change, and the video paragraph is played at triple or quadruple speed, so that the time of a video viewer can be greatly saved; and when the type of the content played by the target video paragraph is determined to be the video paragraph of which the teacher reserves the problem thinking time for students, determining the playing speed of the target video paragraph to be triple speed.
In one embodiment, the above step S13 can also be implemented as the following steps D1-D2:
in step D1, when the current play mode is the second mode, obtaining historical behavior data of the user;
in step D1, the playback speed of the target video segment is determined based on the historical behavior data of the user, and the playback speed of the target video segment is stored.
In this embodiment, when the current play mode is the second mode, historical behavior data of the user is acquired; the historical behavior data is the historical operation behavior for double-speed playing when the user plays the video normally. And determining the playing speed of the target video paragraph based on the historical behavior data of the user, and storing the playing speed of the target video paragraph.
For example, when the user is displayed in the historical behavior data of the user, the user only plays at twice speed, but does not play at triple speed and quadruple speed, which indicates that the double-speed play is the play double speed used by the user habit, so as long as the target video paragraph is determined, the target video paragraph only adapts to the double-speed play double speed, and does not need to adapt to other play double speeds based on the type of the target video paragraph.
The beneficial effect of this embodiment lies in: the playing speed of the target video paragraph can be determined based on the historical behavior data of the user, so that the determined playing speed is more in line with the habit of the user.
In one embodiment, during video playback, the method may also be implemented as the following steps E1-E2:
in step E1, in the case of playing to the start time of the target video paragraph, acquiring the playing speed of the stored target video paragraph;
in step E2, a cue is issued based on the playback speed.
In this embodiment, since the playing speed of the target video segment is stored, the stored playing speed of the target video segment can be obtained when the target video segment is played to the start time; and sending out prompt information based on the playing speed.
In one embodiment, the step S13 can be further implemented as the following steps:
and marking the area corresponding to the target video paragraph on the video file playing progress bar according to the preset color.
In this embodiment, for the analyzed target video segment, a special color marking is performed on an interval corresponding to the progress bar, and when the video is played to the beginning of the segment, the corresponding playing double speed is selected based on the corresponding color, or a prompt is given on the interface, so as to prompt the user that the playing effect of the video segment at a specific double speed is better, and the user can select whether to play the video segment at the adapted double speed.
Fig. 3 is a block diagram of an electronic device according to an embodiment of the present application, where the electronic device includes the following modules:
the intercepting module 31 intercepts a sub-video of which the audio information meets the preset conditions from the video data under the condition of receiving a preset trigger event;
an obtaining module 32, configured to obtain a target video segment in the sub-video, where a difference between adjacent video frames is smaller than a first preset threshold;
and the processing module 33 is configured to process the playback speed adapted to the target video segment.
In one embodiment, the preset triggering event includes:
receiving an event of a complete video to be processed; or
An event is detected in which a pending video segment is present in the buffer.
In one embodiment, as shown in fig. 4, the intercept module 31 comprises:
the intercepting submodule 41 is configured to intercept audio information of which the volume is smaller than a second preset threshold value in the audio information;
the first determining submodule 42 is configured to determine that a video segment corresponding to the audio information with the volume smaller than the second preset threshold is a sub-video meeting a preset condition.
In one embodiment, the obtaining module includes:
the first obtaining submodule is used for obtaining the starting time and the ending time of a target video section of which the difference of adjacent video frames is smaller than a first preset threshold;
and the second acquisition submodule is used for acquiring the target video paragraph according to the starting time and the ending time.
In one embodiment, a processing module, comprising:
the second determining submodule is used for determining the playing speed adapted to the target video paragraph under the condition that the current playing mode is the first mode;
and the playing sub-module is used for playing the target video paragraph based on the playing double speed adapted to the target video paragraph.
In one embodiment, a processing module, comprising:
a third determining submodule, configured to determine, when the current play mode is the second mode, a type to which content played in the target video paragraph belongs;
and the first storage submodule is used for determining the playing speed of the target video paragraph according to the type of the target video paragraph and storing the playing speed of the target video paragraph.
In one embodiment, a processing module, comprising:
the third obtaining submodule is used for obtaining the historical behavior data of the user under the condition that the current playing mode is the second mode;
and the second storage submodule is used for determining the playing speed of the target video paragraph based on the historical behavior data of the user and storing the playing speed of the target video paragraph.
In one embodiment, the electronic device further comprises:
the playing speed obtaining module is used for obtaining the playing speed of the stored target video paragraph under the condition that the target video paragraph is played to the starting time;
and the prompt module is used for sending out prompt information based on the playing speed.
In one embodiment, a processing module, comprising:
and the marking submodule is used for marking the area corresponding to the target video paragraph on the video file playing progress bar according to the preset color.
The present application also provides a video processing apparatus, including:
a processor;
a memory for storing processor-executable instructions;
wherein the processor is configured to:
intercepting a sub-video of which the audio information meets a preset condition from video data under the condition of receiving a preset trigger event;
acquiring a target video section of which the difference between adjacent video frames in the sub-video is smaller than a first preset threshold;
and processing the playing speed adapted to the target video paragraph.
In one embodiment, the processor is further configured to:
the preset trigger event comprises:
receiving an event of a complete video to be processed; or
An event is detected in which a pending video segment is present in the buffer.
In one embodiment, the processor is further configured to:
intercepting the sub-video of which the audio information meets the preset condition from the video data, wherein the method comprises the following steps:
intercepting audio information of which the volume is smaller than a second preset threshold value in the audio information;
and determining the video paragraph corresponding to the audio information with the volume smaller than the second preset threshold as a sub-video meeting the preset condition.
In one embodiment, the processor is further configured to:
acquiring a target video section of which the difference of adjacent video frames in the sub-video is smaller than a first preset threshold, wherein the acquiring comprises the following steps:
acquiring the starting time and the ending time of a target video section of which the difference of adjacent video frames is smaller than a first preset threshold;
and acquiring the target video paragraph according to the starting time and the ending time.
In one embodiment, the processor is further configured to:
processing the playing double speed adapted to the target video paragraph, including:
determining the playing double speed adapted to the target video paragraph under the condition that the current playing mode is the first mode;
and playing the target video paragraph based on the playing double speed adapted to the target video paragraph.
In one embodiment, the processor is further configured to:
processing the playing double speed adapted to the target video paragraph, including:
determining the type of the content played in the target video paragraph under the condition that the current playing mode is the second mode;
and determining the playing speed of the target video paragraph according to the type of the target video paragraph, and storing the playing speed of the target video paragraph.
In one embodiment, the processor is further configured to:
processing the playing double speed adapted to the target video paragraph, including:
under the condition that the current playing mode is the second mode, acquiring historical behavior data of a user;
and determining the playing speed of the target video paragraph based on the historical behavior data of the user, and storing the playing speed of the target video paragraph.
In one embodiment, the processor is further configured to:
under the condition of playing to the starting time of the target video paragraph, acquiring the playing speed of the stored target video paragraph;
and sending out prompt information based on the playing speed.
In one embodiment, the processor is further configured to:
processing the playing double speed adapted to the target video paragraph, including:
and marking the area corresponding to the target video paragraph on the video file playing progress bar according to a preset color.
The above embodiments are only exemplary embodiments of the present application, and are not intended to limit the present application, and the protection scope of the present application is defined by the claims. Various modifications and equivalents may be made by those skilled in the art within the spirit and scope of the present application and such modifications and equivalents should also be considered to be within the scope of the present application.

Claims (10)

1. A video processing method, comprising:
intercepting a sub-video of which the audio information meets a preset condition from video data under the condition of receiving a preset trigger event;
acquiring a target video section of which the difference between adjacent video frames in the sub-video is smaller than a first preset threshold;
and processing the playing speed adapted to the target video paragraph.
2. The method of claim 1, the preset trigger event comprising:
receiving an event of a complete video to be processed; or
An event is detected in which a pending video segment is present in the buffer.
3. The method of claim 1, wherein the step of intercepting the sub-video with audio information meeting the preset condition from the video data comprises:
intercepting audio information of which the volume is smaller than a second preset threshold value in the audio information;
and determining the video paragraph corresponding to the audio information with the volume smaller than the second preset threshold as a sub-video meeting the preset condition.
4. The method of claim 1, wherein obtaining target video segments of the sub-video having a difference between adjacent video frames smaller than a first preset threshold comprises:
acquiring the starting time and the ending time of a target video section of which the difference of adjacent video frames is smaller than a first preset threshold;
and acquiring the target video paragraph according to the starting time and the ending time.
5. The method of claim 1, processing the playback speed adapted to the target video segment, comprising:
determining the playing double speed adapted to the target video paragraph under the condition that the current playing mode is the first mode;
and playing the target video paragraph based on the playing double speed adapted to the target video paragraph.
6. The method of claim 1, processing the playback speed adapted to the target video segment, comprising:
determining the type of the content played in the target video paragraph under the condition that the current playing mode is the second mode;
and determining the playing speed of the target video paragraph according to the type of the target video paragraph, and storing the playing speed of the target video paragraph.
7. The method of claim 1, processing the playback speed adapted to the target video segment, comprising:
under the condition that the current playing mode is the second mode, acquiring historical behavior data of a user;
and determining the playing speed of the target video paragraph based on the historical behavior data of the user, and storing the playing speed of the target video paragraph.
8. The method of claim 6 or 7, during the video playback, the method further comprising:
under the condition of playing to the starting time of the target video paragraph, acquiring the playing speed of the stored target video paragraph;
and sending out prompt information based on the playing speed.
9. The method of claim 1, processing the playback speed adapted to the target video segment, comprising:
and marking the area corresponding to the target video paragraph on the video file playing progress bar according to a preset color.
10. An electronic device, comprising:
the intercepting module is used for intercepting the sub-video of which the audio information meets the preset conditions from the video data under the condition of receiving the preset trigger event;
the acquisition module is used for acquiring a target video section of which the difference between adjacent video frames in the sub-video is smaller than a first preset threshold;
and the processing module is used for processing the playing double speed adapted to the target video paragraph.
CN202010740875.0A 2020-07-28 2020-07-28 Video processing method and electronic equipment Pending CN111787357A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010740875.0A CN111787357A (en) 2020-07-28 2020-07-28 Video processing method and electronic equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010740875.0A CN111787357A (en) 2020-07-28 2020-07-28 Video processing method and electronic equipment

Publications (1)

Publication Number Publication Date
CN111787357A true CN111787357A (en) 2020-10-16

Family

ID=72766960

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010740875.0A Pending CN111787357A (en) 2020-07-28 2020-07-28 Video processing method and electronic equipment

Country Status (1)

Country Link
CN (1) CN111787357A (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112839256A (en) * 2020-12-30 2021-05-25 珠海极海半导体有限公司 Video playing method and device and electronic equipment
CN115190363A (en) * 2021-04-02 2022-10-14 花瓣云科技有限公司 Video playing method, device and storage medium
CN116320642A (en) * 2023-05-22 2023-06-23 北京达佳互联信息技术有限公司 Multimedia resource playing method, device, terminal and storage medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150125130A1 (en) * 2013-11-01 2015-05-07 Alpha Networks Inc. Method for network video recorder to accelerate history playback and event locking
CN105812853A (en) * 2016-03-16 2016-07-27 联想(北京)有限公司 Image processing method and electronic device
CN105956927A (en) * 2016-05-14 2016-09-21 陈廷 Social network establishment method, and course automatic recording method and system
CN110166845A (en) * 2019-05-13 2019-08-23 Oppo广东移动通信有限公司 Video broadcasting method and device
CN110856042A (en) * 2019-11-18 2020-02-28 腾讯科技(深圳)有限公司 Video playing method and device, computer readable storage medium and computer equipment

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150125130A1 (en) * 2013-11-01 2015-05-07 Alpha Networks Inc. Method for network video recorder to accelerate history playback and event locking
CN105812853A (en) * 2016-03-16 2016-07-27 联想(北京)有限公司 Image processing method and electronic device
CN105956927A (en) * 2016-05-14 2016-09-21 陈廷 Social network establishment method, and course automatic recording method and system
CN110166845A (en) * 2019-05-13 2019-08-23 Oppo广东移动通信有限公司 Video broadcasting method and device
CN110856042A (en) * 2019-11-18 2020-02-28 腾讯科技(深圳)有限公司 Video playing method and device, computer readable storage medium and computer equipment

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112839256A (en) * 2020-12-30 2021-05-25 珠海极海半导体有限公司 Video playing method and device and electronic equipment
CN115190363A (en) * 2021-04-02 2022-10-14 花瓣云科技有限公司 Video playing method, device and storage medium
CN116320642A (en) * 2023-05-22 2023-06-23 北京达佳互联信息技术有限公司 Multimedia resource playing method, device, terminal and storage medium
CN116320642B (en) * 2023-05-22 2024-01-19 北京达佳互联信息技术有限公司 Multimedia resource playing method, device, terminal and storage medium

Similar Documents

Publication Publication Date Title
CN111787357A (en) Video processing method and electronic equipment
CN108419141B (en) Subtitle position adjusting method and device, storage medium and electronic equipment
US9628837B2 (en) Systems and methods for providing synchronized content
TWI748836B (en) Method for muting media content during media content replacement event, non-transitory computer readable medium and computing system
US7614064B2 (en) Determining program boundaries through viewing behavior
CN109089131B (en) Screen recording live broadcast method, device, equipment and storage medium based on IOS system
US8661483B2 (en) Determination of receiving live versus time-shifted media content at a communication device
US20070074097A1 (en) System and method for dynamic transrating based on content
JP7157878B2 (en) Detection of media playback loudness level and corresponding audio adjustment during media replacement events
US11172266B2 (en) System to correct closed captioning display using context from audio/video
CN108737884B (en) Content recording method and equipment, storage medium and electronic equipment
CN111355977B (en) Optimized storage method and device for live webcast video
CN110166845B (en) Video playing method and device
CN108985244B (en) Television program type identification method and device
CN111050204A (en) Video clipping method and device, electronic equipment and storage medium
CN111698261B (en) Video playing method, device, equipment and storage medium based on streaming media
CN109922366B (en) Equipment parameter adjusting method, device, equipment and medium
CN110740378A (en) Method, system, device and storage medium for identifying notice in videos
CN112188221B (en) Play control method, play control device, computer equipment and storage medium
CN108156515B (en) Video playing method, smart television and computer readable storage medium
CN112328145A (en) Image display method, device, equipment and computer readable storage medium
CN111818338A (en) Abnormal display detection method, device, equipment and medium
CN112423059A (en) Gesture-based video control method, television and computer-readable storage medium
CN111343391A (en) Video capture method and electronic device using same
US11908340B2 (en) Magnification enhancement of video for visually impaired viewers

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20201016

RJ01 Rejection of invention patent application after publication