WO2017101510A1

WO2017101510A1 - Video processing method and apparatus

Info

Publication number: WO2017101510A1
Application number: PCT/CN2016/097217
Authority: WO
Inventors: 董春
Original assignee: 乐视控股（北京）有限公司; 乐视致新电子科技（天津）有限公司
Priority date: 2015-12-18
Filing date: 2016-08-29
Publication date: 2017-06-22
Also published as: CN105872749A

Abstract

Provided in the embodiments of the present invention are a video processing method and apparatus, the method of the present invention primarily comprising: determining whether advertising content is present in a video stream; if advertising content is present, then opening a local audio file when playing said advertising content, said local audio file being an audio file stored in the local storage system; adjusting the player to a silent mode, said player being used for playing the video stream. Compared to the prior art, the present invention can improve the flexibility of a user when watching videos.

Description

Video processing method and device

The present application is based on a Chinese patent application filed on Jan. 18, 2015, the entire disclosure of which is hereby incorporated by reference.

Technical field

The present invention relates to the field of Internet technologies, and in particular, to a video processing method and apparatus.

Background technique

With the development of Internet technology, more and more users are accustomed to watching videos through computers, mobile phones, etc., through a locally installed client player or a player embedded on a web page. The videos that general users watch are mainly divided into two categories: on-demand and live. For the video of the on-demand type, the user can perform fast-forward or fast-rewind operations on the viewed video according to his own needs during viewing, and for the live-type video, the user cannot perform any operation on the video while watching. Often for commercial purposes, some advertisements are inserted during video playback, such as insertion before the video is played or inserted during the video playback.

For on-demand video, users can filter out some of the ads in the video by fast-forwarding, or filter out all the ads in the video through some existing software that filters ads.

However, for live video, there is currently no way to process the ads. Therefore, when the user views, no operation can be performed on the viewed video, and the flexibility is poor, thereby affecting the user's viewing effect. Therefore, how to deal with the advertisement inserted in the live video and improve the flexibility of the user's viewing become an urgent problem to be solved.

Summary of the invention

The embodiments of the present invention provide a video processing method and device, which are used to solve the problem that the existing users have poor flexibility in watching video.

An embodiment of the present invention provides a video processing method, which is applied to a client, and includes:

Determining whether there is advertising content in the video stream;

If the advertisement content exists, opening a local audio file when the advertisement content is played, the local audio file being an audio file stored in a local storage system;

The player is tuned to a silent mode, and the player is used to play the video stream.

An embodiment of the present invention provides an apparatus for video processing, including:

a determining unit, configured to determine whether an advertisement content exists in the video stream;

An opening unit, configured to: when the advertisement content is present, open a local audio file when the advertisement content is played, where the local audio file is an audio file stored in a local storage system;

And an adjustment unit, configured to adjust the player to a silent mode, the player is configured to play the video stream.

Embodiments of the present invention also provide an electronic device, including: at least one processor; and a memory communicatively coupled to the at least one processor; wherein the memory stores instructions executable by the at least one processor The instructions are executed by the at least one processor to enable the at least one processor to perform the method of video processing described above herein.

Embodiments of the present invention also provide a non-transitory computer readable storage medium storing computer instructions for causing the computer to perform the above video processing method of the present application .

Embodiments of the present invention also provide a computer program product, the computer program product comprising a computing program stored on a non-transitory computer readable storage medium, the computer program comprising program instructions, when the program instructions are executed by a computer The computer is caused to perform the above-described video processing method of the present application.

The method and device for video processing provided by the embodiment of the present invention can first determine whether there is advertisement content in the currently played video stream, and if there is advertisement content, when the advertisement content is played, the local audio file is turned on, and the video is played. The streamed player is muted to silent mode. Compared with the prior art, the embodiment of the present invention can turn on a local audio file when playing an advertisement, and does not affect the normal display of the advertisement content, and realizes the effect of replacing the advertisement sound with the local audio sound. This method allows users to enjoy the content of their favorite audio files while watching an ad. This increases the flexibility of the user when watching the video.

DRAWINGS

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, a brief description of the drawings used in the embodiments or the prior art description will be briefly described below. Obviously, the drawings in the following description It is a certain embodiment of the present invention, and other drawings can be obtained from those skilled in the art without any creative work.

FIG. 1 is a flowchart of a method for video processing according to an embodiment of the present invention;

2 is a flowchart of another method for video processing according to an embodiment of the present invention;

FIG. 3 is a flowchart of still another method for video processing according to an embodiment of the present invention;

4 is a block diagram of a device for video processing according to an embodiment of the present invention;

FIG. 5 is a structural block diagram of another apparatus for video processing according to an embodiment of the present invention;

FIG. 6 is a schematic structural diagram of a physical structure of a video processing apparatus according to an embodiment of the present disclosure;

FIG. 7 is a schematic structural diagram of hardware of an electronic device for performing a video processing method according to an embodiment of the present invention.

detailed description

The technical solutions in the embodiments of the present invention will be clearly and completely described in conjunction with the drawings in the embodiments of the present invention. It is a partial embodiment of the invention, and not all of the embodiments. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative efforts are within the scope of the present invention.

The embodiment of the invention provides a method for video processing. As shown in FIG. 1 , the method includes:

101. Determine whether an advertisement content exists in the video stream.

The video stream in this embodiment refers to a live video stream that conforms to the HLS (HTTP Live Streaming, HLS) protocol. HLS is a dynamic rate adaptive technology, mainly used for audio and video services of computer PCs and Apple Apple terminals. The HLS mainly includes an M3U8 playlist file, the M3U8 file is an index file, and a TS (Transport Stream, TS) media slice file. TS is also a form of video encapsulation that is suitable for live broadcast.

In this embodiment, the advertisement in the live video stream is processed. Therefore, it is first determined whether there is an advertisement in the video stream, and preparation for the subsequent steps of processing the advertisement.

102. If there is advertising content, the local audio file is opened when the advertising content is played.

If it is determined that the advertisement content exists in the video stream, the local audio file is opened when the advertisement content is played, and the local audio file is opened to replace the sound of the advertisement content in the video stream, so that the user can enjoy the audio file that he likes. The local audio file is an audio file stored in a local storage system, wherein the recorded content is an audio file added by the user according to his or her favorite, and may be a song, a crosstalk, a recording, or the like.

It should be noted that when the local audio file is opened, the currently displayed advertisement content will not be deleted, but the sound of the advertisement is replaced, which is equivalent to the replacement of the background music, and the advertisement will continue to be displayed.

103. Turn the player to silent mode.

When the local audio file is turned on, the player's sound mode is muted, which is also a necessary step to replace the sound in the local audio file with the commercial sound. Otherwise it will affect the appreciation of the local audio file. Among them, the player is a player for playing a video stream. The player can be a network television, a mobile phone, or various video playing software installed on a computer.

The method for video processing provided by the embodiment of the present invention can first determine whether there is advertisement content in the currently played video stream, and if there is advertisement content, when the advertisement content is played, the local audio file is turned on, and the video stream is played. The player is muted to silent mode. Compared with the prior art, the embodiment of the present invention can turn on a local audio file when playing an advertisement, and does not affect the normal display of the advertisement content, and realizes the effect of replacing the advertisement sound with the local audio sound. This method allows users to enjoy the content of their favorite audio files while watching an ad. This increases the flexibility of the user when watching the video.

Further, as a refinement and expansion of the embodiment shown in FIG. 1, the present invention also provides another embodiment. As shown in FIG. 2, the method for video processing in this embodiment includes:

201. Monitor the coded discontinuity identifier in the updated playlist file.

In this embodiment, the playlist file is an M3U8 file, which is an index file when the video stream is played. The index of the video file to be played is recorded in the M3U8 file. Usually, only the index of three video files is allowed in the M3U8 file. After the current three video files are broadcast, the index of the new video file is reloaded until all the video files are played. As can be seen from the above, the content in the M3U8 file is dynamically changed, so it is necessary to monitor the updated M3U8 file. It should be noted that the video file therein refers to the TS fragment file.

When the coded discontinuity identifier EXT-X-DISCONTINUITY appears in the M3U8 file, the content before and after the EXT-X-DISCONTINUITY is discontinuous, so it can be guessed that EXT-X-DISCONTINUITY is followed by other content, possibly advertising content. , so monitor the EXT-X-DISCONTINUITY logo.

202. Extract a key frame in the first video file corresponding to the coded discontinuous identifier.

After monitoring the EXT-X-DISCONTINUITY flag, in order to verify whether the advertisement content is added after EXT-X-DISCONTINUITY, it is necessary to find out the corresponding first video file after the EXT-X-DISCONTINUITY, that is, the TS file, and then extract Keyframes in the TS file to facilitate comparison with frame data in the ad database.

It should be noted that in order to improve the accuracy of the subsequent comparison, it is necessary to filter the extracted key frames. The specific filtering principle is to remove the non-information frames in all key frames. The no-information frame refers to a frame without image content, such as a black frame.

203. Determine whether the advertisement content exists in the video stream by comparing the frame data in the key frame and the advertisement database.

The key frames obtained in step 202 are compared with the frame data in the advertisement database, and there are two ways to compare, as follows:

method one

The key frame is compared with the key frame in the advertisement database by one frame and one frame. First, a preset comparison number is set, and the preset comparison number is an experience value obtained after repeated experiments. Assume that the preset number of comparisons is N, and N is a positive integer greater than 0.

If there are consecutive M key frames corresponding to the frame data content in the advertisement database within the range of N times of comparison, it is determined that the advertisement content exists in the video stream, that is, the first TS file after EXT-X-DISCONTINUITY is Advertising content. Where M is a positive integer less than the preset number of comparisons, and the specific proportional relationship between N and M in actual application can be determined according to actual needs.

If the continuous M key frames are not the same as the frame data content after the N times, it is determined that there is no advertisement content in the video stream, that is, the first TS file after the EXT-X-DISCONTINUITY is the non-advertising content.

Way two

Design a model for frame alignment in advance, then input keyframe and frame data into the comparison In the model, the similarity is obtained. The similarity is used to describe the similarity between the key frame and the frame data. Then, according to the similarity, it is judged whether there is advertising content in the video stream. Specifically, a similarity judgment standard is set in the judgment. When the standard similarity result is reached, it can be determined that the extracted key frame is the same as the frame data in the advertisement database, and then it can be further determined that the advertisement content exists in the video stream, that is, the first TS after the EXT-X-DISCONTINUITY The file is the content of the advertisement.

The design principle of the comparison model is basically the same as the principle of the first method. The difference is that the comparison model dynamically acquires an N according to the input key frame and frame data, and the value of the N can be an artificial intelligence algorithm. Learned by training.

204. If the advertisement content exists, the local audio file is turned on when the first video file after the coded discontinuous identifier is played.

For the case where it is determined in step 203 that the first TS file after EXT-X-DISCONTINUITY is the advertisement content, the local audio file is opened when the first TS file after EXT-X-DISCONTINUITY is played.

The implementation manner of the local audio file is the same as that of the step 102 in FIG. 1 , and details are not described herein again.

205. Send a mute request to the player to adjust the player to the silent mode.

While the local audio file is being turned on, in order to ensure the playback effect of the local audio file, a silent request is sent to the player playing the video stream, and when the player receives the request for mute, the sound mode is actively muted. mode.

206. When the next coded discontinuity identifier in the playlist file is detected, the local audio file is closed.

After opening the local audio file, you need to continue to monitor the next EXT-X-DISCONTINUITY in the M3U8 file. When the next EXT-X-DISCONTINUITY is detected, it indicates that the advertisement has finished playing. In this case, you need to restore the player's sound. Let users continue to watch non-advertising content in the video stream.

Further, as a refinement and expansion of the embodiment shown in FIG. 2, the present invention also provides another embodiment. As shown in FIG. 3, the method for video processing in this embodiment includes:

301. Monitor the coded discontinuity identifier in the updated playlist file.

The implementation of this step is the same as the implementation of step 201 in FIG. 2, and details are not described herein again.

302. Obtain an identity (ID) corresponding to the video file after the coded discontinuity identifier.

The coded discontinuity identifier in this embodiment is EXT-X-DISCONTINUITY, and the ID corresponding to the video file after EXT-X-DISCONTINUITY is acquired. This ID is a unique identifier that distinguishes different video content.

303. Compare the identity ID with the preset identifier list.

The ID obtained by step 302 is compared with a preset identification list. The ID of all advertisements is recorded in the preset ID.

In the comparison, if the ID can be found in the preset identifier list, it is determined that the advertisement content exists in the video stream, that is, the video file after the EXT-X-DISCONTINUITY is the advertisement content;

In the comparison, if the ID cannot be found in the preset identifier list, it is determined that there is no advertisement content in the video stream, that is, the video file after EXT-X-DISCONTINUITY is non-advertising content.

In addition, the title of the advertisement is also recorded in the identification list, wherein the title and the ID are in a one-to-one correspondence, and the record of the title is for readability when the user modifies the identification list.

304. If the advertisement content exists, the local audio file is turned on when the first video file after the coded discontinuous identifier is played.

The implementation of this step is the same as the implementation of step 204 in FIG. 2, and details are not described herein again.

305. Send a mute request to the player to adjust the player to the silent mode.

The implementation of this step is the same as the implementation of step 205 in FIG. 2, and details are not described herein again.

306. After monitoring the next coded discontinuity identifier in the playlist file, close the local audio file.

The implementation of this step is the same as the implementation of step 206 in FIG. 2, and details are not described herein again.

Further, for the method of FIG. 3, not only the advertisement sound in the video stream may be replaced with the sound in the local audio file, but also the non-advertising video that the user does not like may be replaced by a sound. The specific replacement method is: Set the list of identifiers to update, that is, add videos that you don't like in the list of preset identifiers. The specific way of adding is: when the user is watching the video, if he encounters the video that he does not like, he can add the corresponding title and ID to the preset identification list by selecting the option added to the identification list in the menu. The options added to the list are provided by the system. In addition to the difference in the preset identification list, other implementations are the same as those of FIG. The implementation is the same and will not be described here.

Further, the preset identifier list in FIG. 3 is set by the user, so the user can add the non-advertising video or advertisement video that is not like to the preset identifier list, and can also use the favorite non-advertising video. Or the advertisement video is deleted from the preset identification list. The specific deletion method is to find the title of the favorite video in the identification list, and then delete it, and the deleted video will not be replaced by the local audio file when the next time the video is played. .

Further, as an implementation of the method shown in FIG. 1, FIG. 2 and FIG. 3, another embodiment of the present invention further provides a video processing apparatus. As shown in FIG. 4, the apparatus includes: determining The unit 41, the opening unit 42, and the adjusting unit 43.

The determining unit 41 is configured to determine whether the advertisement content exists in the video stream.

The video stream in this embodiment refers to a live video stream that conforms to the HLS protocol. HLS is a dynamic rate adaptive technology, mainly used for audio and video services of computer PCs and Apple Apple terminals. The HLS mainly includes an M3U8 playlist file, the M3U8 file is an index file, and a TS media slice file. TS is also a form of video encapsulation that is suitable for live broadcast.

The opening unit 42 is configured to open a local audio file when the advertisement content is played if the advertisement content exists, and the local audio file is an audio file stored in the local storage system.

The adjusting unit 43 is configured to adjust the player to the silent mode, and the player is used to play the video stream.

Further, as shown in FIG. 5, the determining unit 41 includes:

The monitoring module 411 is configured to monitor the coded discontinuity identifier in the updated playlist file. The audio file list is a playlist file corresponding to the video stream.

The content in the M3U8 file is dynamically changed, so the updated M3U8 file needs to be monitored. It should be noted that the video file therein refers to the TS fragment file.

The extracting module 412 is configured to extract key frames in the first video file corresponding to the encoded discontinuous identifier.

The determining module 413 is configured to determine whether the advertisement content exists in the video stream by comparing the frame data in the key frame and the advertisement database.

Further, the determining module 413 is configured to:

Within the preset number of comparisons, if there are consecutive M key frames corresponding to the frame data content, it is determined that there is advertising content in the video stream, where M is a positive integer smaller than the preset comparison number;

Within the preset number of comparisons, if there are no consecutive M key frames corresponding to the frame data content, it is determined that there is no advertisement content in the video stream.

Further, the determining module 413 is configured to:

The key frame and the frame data are input into the comparison model for comparison, and the similarity is obtained, and the similarity is used to describe the degree of similarity between the key frame and the frame data;

Whether the advertisement content exists in the video stream is judged according to the similarity.

Further, as shown in FIG. 5, the apparatus further includes:

The removing unit 44 is configured to remove the non-information frame in the key frame before determining whether the advertisement content exists in the video stream by comparing the frame data in the key frame and the advertisement database, and the no information frame is a frame without image content.

Further, as shown in FIG. 5, the determining unit 41 includes:

The obtaining module 414 is configured to obtain an ID corresponding to the video file after the coded discontinuity identifier.

The comparison module 415 is configured to compare the ID with a preset identifier list, and the preset identifier list is used to record IDs of all advertisements.

The determining module 416 is configured to determine that the advertisement content exists in the video stream if the ID is found in the preset identifier list; if the ID cannot be found in the preset identifier list, it is determined that the advertisement content does not exist in the video stream.

Further, the opening unit 42 is configured to: when playing the first video file after the coded discontinuous identifier, turn on the local audio file.

The local audio file is opened when the first TS file after EXT-X-DISCONTINUITY is played.

Further, the adjusting unit 43 is configured to: send a silence request to the player to adjust the player to the silent mode.

Further, as shown in FIG. 5, the apparatus further includes:

The closing unit 45 is configured to: after adjusting the player to the silent mode, after detecting the next coded discontinuity identifier in the playlist file, closing the local audio file;

The unit 46 is turned on for turning on the sound of the player.

After the local audio file is enabled, you need to continue to monitor the next EXT-X-DISCONTINUITY in the M3U8 file. When it is detected, it indicates that the advertisement has finished playing. At this time, you need to restore the player's sound, so that the user can continue watching the video stream. Non-advertising content in .

The device for video processing according to the embodiment of the present invention can first determine whether there is advertisement content in the currently played video stream, and if there is advertisement content, when the advertisement content is played, the local audio file is turned on, and the video stream is played. The player is muted to silent mode. Compared with the prior art, the embodiment of the present invention can turn on a local audio file when playing an advertisement, and does not affect the normal display of the advertisement content, and realizes the effect of replacing the advertisement sound with the local audio sound. This method allows users to enjoy the content of their favorite audio files while watching an ad. This increases the flexibility of the user when watching the video.

It should be noted that, for the above-mentioned video processing device, the functions of the respective unit modules used in the embodiments of the present invention can be implemented by a hardware processor.

Illustratively, as shown in FIG. 6, FIG. 6 is a schematic diagram showing the physical structure of a video processing apparatus according to an embodiment of the present invention. The physical structure may include a processor 61 and a communications interface. 62. A memory 63 and a bus 64, wherein the processor 61, the communication interface 62, and the memory 63 complete communication with each other via the bus 64. Communication interface 62 can be used for information transfer between the server and the client. The processor 61 may call the logic instructions in the memory 63 to perform a method of determining whether there is advertising content in the video stream; if the advertising content is present, turning on the local audio file when the advertising content is played, the local audio The file is an audio file stored in a local storage system; and the player is tuned to a silent mode, the player is for playing the video stream.

Furthermore, the logic instructions in the memory 63 described above may be implemented in the form of a software functional unit and sold or used as a stand-alone product, and may be stored in a computer readable storage medium. Based on such understanding, the part of the technical solution of the present invention that contributes in essence or to the prior art or the part of the technical solution can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, server, or network device, etc.) to perform all or part of the steps of the methods described in various embodiments of the present invention. The foregoing storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk, and the like. .

FIG. 7 is a schematic structural diagram of hardware of an electronic device for performing a video processing method according to an embodiment of the present disclosure. As shown in FIG. 7, the device includes:

One or more processors 71 and a memory 72 are exemplified by a processor 71 in FIG.

The apparatus that performs the method of video processing may further include: an input device 73 and an output device 74.

The processor 71, the memory 72, the input device 73, and the output device 74 may be connected by a bus or other means, as exemplified by a bus connection in FIG.

The memory 72 is a non-volatile computer readable storage medium, and can be used for storing a non-volatile software program, a non-volatile computer executable program, and a module, such as a program corresponding to the video processing method in the embodiment of the present application. An instruction/module (for example, the determination unit 41, the opening unit 42, and the adjustment unit 43 shown in FIG. 4). The processor 71 executes various functional applications of the server and data processing by executing non-volatile software programs, instructions, and modules stored in the memory 72, that is, a method of implementing video processing of the above-described method embodiments.

The memory 72 may include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application required for at least one function; the storage data area may store data created according to use of the video processing device, and the like. Moreover, memory 72 can include high speed random access memory, and can also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid state storage device. In some embodiments, memory 72 can optionally include memory remotely located relative to processor 71, which can be connected to the video processing device over a network. Examples of such networks include, but are not limited to, the Internet, intranets, local area networks, mobile communication networks, and combinations thereof.

Input device 73 can receive the input digital or character information and generate key signal inputs related to user settings and function control of the video processing device. Output device 74 can include a display device such as a display screen.

The one or more modules are stored in the memory 72, and when executed by the one or more processors 71, perform the method of video processing in any of the above method embodiments.

The above products can perform the methods provided by the embodiments of the present application, and have the corresponding functional modules and beneficial effects of the execution method. For technical details that are not described in detail in this embodiment, reference may be made to the method provided by the embodiments of the present application.

The electronic device of the embodiment of the present application exists in various forms, including but not limited to:

(1) Mobile communication devices: These devices are characterized by mobile communication functions and are mainly aimed at providing voice and data communication. Such terminals include: smart phones (such as iPhone), multimedia phones, functional phones, and low-end phones.

(2) Ultra-mobile personal computer equipment: This type of equipment belongs to the category of personal computers, has computing and processing functions, and generally has mobile Internet access. Such terminals include: PDAs, MIDs, and UMPC devices, such as the iPad.

(3) Portable entertainment devices: These devices can display and play multimedia content. Such devices include: audio, video processing devices (such as iPod), handheld game consoles, e-books, and smart toys and portable car navigation devices.

(4) Server: A device that provides computing services. The server consists of a processor, a hard disk, a memory, a system bus, etc. The server is similar to a general-purpose computer architecture, but because of the need to provide highly reliable services, processing power and stability High reliability in terms of reliability, security, scalability, and manageability.

(5) Other electronic devices with data interaction functions.

The embodiment of the present application further provides a non-transitory computer storage medium, where the computer storage medium stores computer executable instructions, which can perform the video processing method in any of the foregoing method embodiments.

Finally, it should be understood that those skilled in the art can understand that all or part of the process of implementing the above embodiments can be completed by a computer program to instruct related hardware, and the program can be stored in a computer readable. In the storage medium, the program, when executed, may include the flow of an embodiment of the methods as described above. The storage medium may be a magnetic disk, an optical disk, a read only memory (ROM), or a random access memory (RAM).

The device embodiments described above are merely illustrative, wherein the units described as separate components may or may not be physically separate, and the components displayed as units may or may not be physical units, ie may be located A place, or it can be distributed to multiple network units. Some or all of the modules can be selected according to actual needs. The purpose of the solution of this embodiment. Those of ordinary skill in the art can understand and implement without deliberate labor.

Through the description of the above embodiments, those skilled in the art can clearly understand that the various embodiments can be implemented by means of software plus a necessary general hardware platform, and of course, by hardware. Based on such understanding, the above-described technical solutions may be embodied in the form of software products in essence or in the form of software products, which may be stored in a computer readable storage medium such as ROM/RAM, magnetic Discs, optical discs, etc., include instructions for causing a computer device (which may be a personal computer, server, or network device, etc.) to perform the methods described in various embodiments or portions of the embodiments.

It should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, and are not limited thereto; although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that The technical solutions described in the foregoing embodiments are modified, or the equivalents of the technical features are replaced. The modifications and substitutions do not depart from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

A method for video processing, characterized in that it is applied to a client, and the method includes:

Determining whether there is advertising content in the video stream;

If the advertisement content exists, opening a local audio file when the advertisement content is played, the local audio file being an audio file stored in a local storage system;

The player is tuned to a silent mode, and the player is used to play the video stream.
The method according to claim 1, wherein the determining whether the advertisement content exists in the video stream comprises:

Monitoring a coded discontinuity identifier in the updated playlist file, where the playlist file is a playlist file corresponding to the video stream;

Extracting a key frame in the first video file corresponding to the coded discontinuous identifier;

The presence or absence of the advertisement content in the video stream is determined by comparing the frame data in the key frame and the advertisement database.
The method according to claim 2, wherein the determining whether the advertisement content exists in the video stream by comparing the frame data in the key frame and the advertisement database comprises:

In the preset number of comparisons, if there are consecutive M key frames corresponding to the frame data content, determining that the advertisement content exists in the video stream, where M is less than the preset comparison number Integer

Within the preset number of comparisons, if there are no consecutive M key frames corresponding to the frame data content, it is determined that the advertisement content does not exist in the video stream.
The method according to claim 2, wherein the determining whether the advertisement content exists in the video stream by comparing the frame data in the key frame and the advertisement database comprises:

Comparing the key frame and the frame data into a comparison model to obtain a similarity, wherein the similarity is used to describe a degree of similarity between the key frame and the frame data;

Determining whether the advertisement content exists in the video stream according to the similarity.
A method according to any one of claims 2 to 4, wherein said method further determines whether said advertisement content is present in said video stream by comparing frame data in said key frame with said advertisement database include:

The non-information frame in the key frame is removed, and the non-information frame is a frame without image content.
The method according to claim 1, wherein the determining whether the advertisement content exists in the video stream comprises:

Monitoring a coded discontinuity identifier in the updated playlist file, where the playlist file is a playlist file corresponding to the video stream;

Obtaining an identity identification ID corresponding to the video file after the coding discontinuity identifier;

Comparing the ID with a preset identifier list, where the preset identifier list is used to record IDs of all advertisements;

If the ID is found in the preset identifier list, determining that the advertisement content exists in the video stream;

If the ID cannot be found in the preset identifier list, it is determined that there is no advertisement content in the video stream.
The method according to claim 2, wherein the opening of the local audio file when the advertisement content is played comprises:

The local audio file is opened when the first video file after the encoding of the discontinuous identifier is played.
The method according to claim 1, wherein said adjusting said player to a silent mode comprises:

A mute request is sent to the player to cause the player to be in a silent mode.
The method of claim 2, wherein after the player is tuned to the silent mode, the method further comprises:

After monitoring the next coded discontinuity identifier in the playlist file, closing the local audio file; and,

Turn on the sound of the player.
A device for video processing, characterized in that the device comprises:

a determining unit, configured to determine whether an advertisement content exists in the video stream;

An opening unit, configured to: when the advertisement content is present, open a local audio file when the advertisement content is played, where the local audio file is an audio file stored in a local storage system;

And an adjustment unit, configured to adjust the player to a silent mode, the player is configured to play the video stream.
The device according to claim 10, wherein the determining unit comprises:

a monitoring module, configured to monitor an encoded discontinuity identifier in the updated playlist file, where the playlist file is a playlist file corresponding to the video stream;

An extraction module, configured to extract a key frame in the first video file corresponding to the coded discontinuous identifier;

The determining module is configured to determine whether the advertisement content exists in the video stream by comparing the frame data in the key frame and the advertisement database.
The device according to claim 11, wherein the determining module is configured to:

In the preset number of comparisons, if there are consecutive M key frames corresponding to the frame data content, determining that the advertisement content exists in the video stream, where M is less than the preset comparison number Integer

Within the preset number of comparisons, if there are no consecutive M key frames corresponding to the frame data content, it is determined that the advertisement content does not exist in the video stream.
The device according to claim 11, wherein the determining module is configured to:

Comparing the key frame and the frame data into a comparison model to obtain a similarity, wherein the similarity is used to describe a degree of similarity between the key frame and the frame data;

Determining whether the advertisement content exists in the video stream according to the similarity.
Apparatus according to any one of claims 11 to 13 wherein said apparatus further comprises:

a removing unit, configured to remove a non-information frame in the key frame before determining whether the advertisement content exists in the video stream by comparing the frame data in the key frame and the advertisement database, the none Information frames are frames with no image content.
The device according to claim 10, wherein the determining unit comprises:

a monitoring module, configured to monitor an encoded discontinuity identifier in the updated playlist file, where the playlist file is a playlist file corresponding to the video stream;

An obtaining module, configured to acquire an identity ID corresponding to the video file after the coded discontinuity identifier;

a comparison module, configured to compare the ID with a preset identifier list, where the preset identifier list is used to record IDs of all advertisements;

Determining a module, if the ID is found in the preset identifier list, determining that the advertisement content exists in the video stream; if the ID cannot be found in the preset identifier list, determining the There is no advertising content in the video stream.
The device according to claim 11, wherein the opening unit is configured to:

The local audio file is opened when the first video file after the encoding of the discontinuous identifier is played.
The device according to claim 10, wherein the adjusting unit is configured to:

A mute request is sent to the player to cause the player to be in a silent mode.
The device according to claim 11, wherein the device further comprises:

a closing unit, configured to close the local audio file after monitoring the next coded discontinuity identifier in the playlist file after the player is adjusted to the silent mode;

Open the unit to open the sound of the player.
An electronic device comprising:

At least one processor; and,

a memory communicatively coupled to the at least one processor; wherein

The memory stores instructions executable by the at least one processor, the instructions being executed by the at least one processor to enable the at least one processor to:

Determining whether there is advertising content in the video stream;

If the advertisement content exists, opening a local audio file when the advertisement content is played, the local audio file being an audio file stored in a local storage system;

The player is tuned to a silent mode, and the player is used to play the video stream.
A non-transitory computer readable storage medium storing computer instructions for causing the computer to perform any of claims 1-9 Methods.
A computer program product comprising a computing program stored on a non-transitory computer readable storage medium, the computer program comprising program instructions that, when executed by a computer, cause the computer to execute The method of any of claims 1-9.