CN111031384A

CN111031384A - Video content display method and device

Info

Publication number: CN111031384A
Application number: CN201911350427.3A
Authority: CN
Inventors: 赵习武; 许立强; 陈聪
Original assignee: Beijing Duoge Technology Co ltd
Current assignee: Beijing Duoge Technology Co ltd
Priority date: 2019-12-24
Filing date: 2019-12-24
Publication date: 2020-04-17

Abstract

The disclosure relates to a video content display method and device. A method for playing video content, obtain the video clip meeting the preset condition in the video; converting the video clip data format into an image interchange format GIF; the video contents converted into the image interchange format GIF are transmitted to the mobile terminal. The embodiment of the invention can help the mobile terminal user to watch the wonderful moment or important event of the match in time in a more complex environment or scene without worrying about the inconvenience of missing the live broadcast picture or being unable to watch the video rebroadcast due to poor network environment.

Description

Video content display method and device

Technical Field

The present disclosure relates to the field of video technologies, and in particular, to a method and a system for displaying video content.

Background

At present, with the popularization and development of mobile networks, it is more and more common to watch videos by using mobile terminals such as mobile phones, and the like, wherein the videos also include games. However, watching the live broadcast of the event by using the mobile network consumes the network traffic of the user; moreover, no matter a mobile network or a wifi network is used, the smoothness of playing the event is affected in public places with large pedestrian traffic, for example, because the bandwidth required by the video data is large. On the other hand, in a sports event, for example, a football game is about 100 minutes, and unlike a case where a user of a mobile terminal always focuses on a television screen while sitting in front of a television, since the environment in which the user of the mobile terminal watches a live video often changes, for example, in a subway, a bus, or the like, or performs other things while watching a mobile phone, it is difficult for the user to continuously focus on the live broadcast status of the entire event, and there is a possibility that a highlight moment in the game is missed.

Disclosure of Invention

The present disclosure provides a method for playing video content, which overcomes the above-mentioned deficiencies in the prior art.

A method for playing video content, obtain the video clip meeting the preset condition in the video; converting the video clip data format into an image interchange format GIF; the video contents converted into the image interchange format GIF are transmitted to the mobile terminal.

In the above method, the acquiring the video segments meeting the preset conditions specifically includes: identifying subtitles in a video image; and if the change of the subtitle content accords with a preset rule, acquiring a video clip between a first time length before the subtitle is changed and a second time length after the subtitle is changed.

In the above method, the acquiring the video segments meeting the preset conditions specifically includes: performing voice recognition on an audio signal corresponding to the video signal; matching the voice recognition result with a preset corpus; acquiring time point information of an audio signal corresponding to a voice recognition result matched with the corpus; and acquiring a video clip between a third time length before the time point and a fourth time length after the time point.

In the above method, before sending the video content converted into the image interchange format GIF to the mobile terminal, the associating of the video content files of the image interchange format GIF from the same video is further included.

In the method, the video content converted into the image interchange format GIF is sent to the mobile terminal according to the request of the mobile terminal; or sending the video content converted into the image interchange format GIF to the mobile terminal in an active push mode. The video clips are in motion picture experts group 4MPEG4 format.

An embodiment of the present invention further provides a multimedia content processing device, including: the video clip acquisition module is used for acquiring video clips meeting preset conditions in the video; the format conversion module is used for converting the video clip data format into an image interchange format GIF; and the communication module is used for transmitting the video content converted into the image interchange format GIF to the mobile terminal.

The above-mentioned device still includes: and the processing module is used for establishing association between the video content files of the image interchange format GIF from the same video.

In the above device, the communication module sends the video content to the mobile terminal through a wireless network or a mobile communication network.

In the above apparatus, the video clip acquired by the video clip acquiring module is in a MPEG4 format.

By using the technical scheme, the mobile terminal user can watch the wonderful moment or important events of the match in time under more complex environments or scenes, such as subways, buses and the like, and does not need to worry about the inconvenience that live pictures are missed or video rebroadcasts cannot be watched due to poor network environments. On the other hand, the user does not need to watch the normal game when wanting to watch the wonderful moment of other games, and the playing mode of the scheme of the invention has low requirement on the network environment, so the user can flexibly select and watch the interesting wonderful moment of the games in any scene.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.

Drawings

The above and other objects, features and advantages of the present disclosure will become more apparent by describing in greater detail exemplary embodiments thereof with reference to the attached drawings, in which like reference numerals generally represent like parts throughout.

FIG. 1 is a schematic flow chart diagram illustrating a method according to an exemplary embodiment of the present disclosure;

FIG. 2 is a schematic diagram illustrating an apparatus configuration according to an exemplary embodiment of the present disclosure;

fig. 3 is a schematic diagram illustrating an apparatus structure according to an exemplary embodiment of the present disclosure.

Detailed Description

Preferred embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While the preferred embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art.

The terminology used in the present disclosure is for the purpose of describing particular embodiments only and is not intended to be limiting of the disclosure. As used in this disclosure and the appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It should also be understood that the term "and/or" as used herein refers to and encompasses any and all possible combinations of one or more of the associated listed items.

It should be understood that although the terms "first," "second," "third," etc. may be used in this disclosure to describe various information, these information should not be limited to these terms. These terms are only used to distinguish one type of information from another. For example, first information may also be referred to as second information, and similarly, second information may also be referred to as first information, without departing from the scope of the present disclosure. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature. In the description of the present disclosure, "a plurality" means two or more unless specifically limited otherwise.

The embodiment of the invention provides a method for playing video content, which comprises the following three steps:

step 11, obtaining a video segment meeting preset conditions in the video, aiming at intercepting the moments or important events, such as goals in a football match, penalties by red and yellow cards, people changing, highlights and other moments and events, in the match video.

The video understanding technology adopted for obtaining the video clips is more suitable for identifying specific objects and intercepting corresponding videos based on the principle of image identification, and is more difficult to be suitable for identifying specific actions, such as in the field of sports with complex pictures. For example, in a football game, it is difficult for current video understanding techniques to identify the start and end times of an attack, the strength of the attack, which player is playing the ball, and the like.

In the embodiment of the present invention, one of the methods for acquiring a video clip is to perform frame extraction on a video image, and perform Optical Character Recognition (OCR) on the frame image, so as to find whether an event meeting a preset condition occurs. For example, for a game, a scoring board is generally available on a video stream of a conventional game, numbers of the scoring board are identified through real-time frame drawing and OCR, and whether scores of the scoring board change or not can be found through comparison, so that the occurrence of a goal event is identified. Therefore, the change of the number on the score board is used as a preset condition, when the score board is found to change by means of frame extraction and OCR, the preset condition is reached, and when the condition is met, the video clip is intercepted.

The video clip can be intercepted by adopting the following method, a first time length and a second time length are preset, when an OCR result meets a preset condition, a frame obtained by backing the video frame reaching the preset condition for the first time length is used as a starting point of the video clip to be intercepted, and a video frame obtained by forwarding the video frame reaching the preset condition for the second time length is used as an end point of the video clip to be intercepted.

The first and second duration values may be set empirically, and may be, for example, 0, or 1 second, or 5 seconds, etc.

For a game, such as a football game, there are a number of important events, such as a goal, e.g., a red and yellow card penalty, e.g., a trade change, etc. Different first and second duration values may be set for each type of significant event.

For example, for the event of goal, the first duration value may be set to 10 seconds, and the second duration value may be set to 0 seconds; for the red and yellow penalty category, a first duration value of 5 seconds and a second duration value of 1 second may be set. It is only explained here that different duration values can be set for each type of important event, and the value range of the duration value is not limited.

The interception of the video segment may also take another approach. The method utilizes the result of the voice recognition to position the occurrence time of the important event in the competition, and then intercepts the video clip. The specific process is as follows:

a plurality of important events are defined for a type of match, one or more keywords, keywords or phrases are defined for each important event and stored in a corpus, for example, the keyword "passer" is stored in the corpus to represent a person who has a wonderful match in a soccer match.

Presetting keywords, phrases and the like in a corpus, analyzing voice parts in a video stream through voice recognition, matching voice recognition results with the keywords, the phrases and the like in the corpus in real time, and when the matching results are obtained, indicating that important events corresponding to the keywords appear in a match.

For example, a comment of "beautiful, ball-broken, and start counterclicking" which contains the word "broken" already stored in the corpus indicates that a ball-broken has occurred in the game. And further, according to a third time length value and a fourth time length value corresponding to different preset events, acquiring a frame obtained by retreating the time point by the third time length value and a frame obtained by advancing the time point by the fourth time length value according to the time when the 'breaking' character appears in the game explanation to obtain a video clip of the important event.

Although this method will be less effective when the delay in the synchronization of voice and video is large during the game. However, compared with subtitles, the content of voice in the game is richer, so that the method makes up the defect that the capturing rate of the image OCR recognition on the shots such as wonderful passing, snapping and the like is low, because the video subtitles are less frequently generated in the key events.

The above two methods of video clip interception are provided by way of example, but the invention does not exclude that other methods may achieve the same object. And, the above two video clip intercepting methods can be used together, or in combination with other methods.

For example, the two methods are operated simultaneously, and any one method can implement the action of video clip interception when the preset condition is identified; if the two methods respectively identify that the respective preset conditions are reached, whether the respective preset conditions point to the same kind of important events can be searched according to the pre-stored data. For example, the above first method finds a score change by recognition of a score board, the second method "goals" by recognition of speech, and the "goals" are keywords preset in a corpus. Furthermore, according to the pre-established association relationship between the preset conditions in different methods, the relevance relationship between the score change and the goal in the corpus is found, namely the score change and the goal in the corpus represent the same important event. Further, the step of video clip truncation may be performed based on the time of the frame reaching the preset condition in any of the methods.

In the embodiment of the present invention, the video clips are preferably stored in the MP4 format, but other video formats can still achieve the object of the present invention. MP4(Moving Picture Experts Group 4) is a set of compression coding standards for audio and video information, and is established by the "Moving Picture Experts Group" (MPEG) under the international organization for standardization (ISO) and the International Electrotechnical Commission (IEC).

And step 12, converting the video segment data format into an image interchange format GIF.

The image Interchange format gif (graphics Interchange format) is a relatively common dynamic image format, and most of the dynamic image formats are gif animations formed by combining multiple frames of images, and of course, the format has a single frame. GIF files can be opened using GIF players of almost any format, such as the commonly used flash, graphics viewing software, GIF animation software, and the like.

A conversion method of converting a video file such as MP4 format into a GIF format file belongs to a technical means conventional in the art.

3) The video contents converted into the image interchange format GIF are transmitted to the mobile terminal. The video content converted into the image interchange format GIF may be transmitted to the mobile terminal according to a request of the mobile terminal; or sending the video content converted into the image interchange format GIF to the mobile terminal in an active push mode.

For example, in a chat room of a game, the video content converted into GIF format can be directly sent to the chat room, and the user in the chat room can directly see the game moment in the GIF picture; or loading the GIF picture in a news homepage of the event report; or sending the GIF picture to the user for display in a mode of sending the picture link and the news link to the user under the condition that the user clicks the link to request to link the related content.

As a more preferred embodiment, the video content files of the image interchange format GIF from the same video may also be associated before the video content is transmitted to the mobile terminal. For example, a syndicated article, which is a container of all GIF for a single game, each game having a game id, a syndicated article having an article id, each individual GIF picture also having its own article id; and establishing an association relation among the game id, the aggregation article id and the GIF picture id, so that the purpose of seeing all GIF of the game through one game is achieved. Then, the important events of the events can be acquired at the first time by using a device-based push technology, wherein the first time is faster, more traffic-saving and more intuitive. For example, in a football game, 10 game highlights are obtained, 10 pictures in the GIF format are obtained through video clip interception and format conversion, and by using the aggregated article, a user can load all 10 pictures through one connection and enjoy 10 highlights.

An embodiment of the present invention further provides a multimedia content processing device, including: the video clip acquiring module 21 is configured to acquire a video clip meeting a preset condition in a video; a format conversion module 22, configured to convert the video segment data format into an image interchange format GIF; and a communication module 23, configured to send the video content converted into the image interchange format GIF to the mobile terminal.

The apparatus may further include a processing module 24 configured to associate video content files in image interchange format GIF from the same video.

In the device, the communication module sends the video content to the mobile terminal through a wireless network or a mobile communication network. The video clip is in a moving Picture experts group 4MPEG4 format

With regard to the apparatus in the above-described embodiment, the specific manner in which each module performs the operation has been described in detail in the embodiment related to the method, and will not be elaborated here.

The aspects of the present disclosure have been described in detail above with reference to the accompanying drawings. In the above embodiments, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to related descriptions of other embodiments. Those skilled in the art should also appreciate that the acts and modules referred to in the specification are not necessarily required by the invention. In addition, it can be understood that the modules in the device of the embodiment of the present disclosure may be combined, divided, and deleted according to actual needs.

Furthermore, the method according to the present disclosure may also be implemented as a computer program or computer program product comprising computer program code instructions for performing some or all of the steps of the above-described method of the present disclosure.

Alternatively, the present disclosure may also be embodied as a non-transitory machine-readable storage medium (or computer-readable storage medium, or machine-readable storage medium) having stored thereon executable code (or a computer program, or computer instruction code) that, when executed by a processor of an electronic device (or computing device, server, or the like), causes the processor to perform some or all of the various steps of the above-described method according to the present disclosure.

Those of skill would further appreciate that the various illustrative logical blocks, modules, circuits, and algorithm steps described in connection with the disclosure herein may be implemented as electronic hardware, computer software, or combinations of both.

Having described embodiments of the present disclosure, the foregoing description is intended to be exemplary, not exhaustive, and not limited to the disclosed embodiments. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described embodiments. The terminology used herein is chosen in order to best explain the principles of the embodiments, the practical application, or improvements made to the technology in the marketplace, or to enable others of ordinary skill in the art to understand the embodiments disclosed herein.

Claims

1. A method of playing video content, characterized by:

acquiring video clips meeting preset conditions in a video;

converting the video clip data format into an image interchange format GIF;

the video contents converted into the image interchange format GIF are transmitted to the mobile terminal.

2. The method according to claim 1, wherein the obtaining of the video segments meeting the preset condition is specifically:

identifying subtitles in a video image;

and if the change of the subtitle content accords with a preset rule, acquiring a video clip between a first time length before the subtitle is changed and a second time length after the subtitle is changed.

3. The method according to claim 1 or 2, wherein the obtaining of the video segments meeting the preset condition is specifically:

performing voice recognition on an audio signal corresponding to the video signal;

matching the voice recognition result with a preset corpus;

acquiring time point information of an audio signal corresponding to a voice recognition result matched with the corpus;

and acquiring a video clip between a third time length before the time point and a fourth time length after the time point.

4. The method of claim 3, wherein the associating the video content files of the image interchange format GIF from the same video before transmitting the video content converted into the image interchange format GIF to the mobile terminal.

5. The method of claim 4, wherein the video contents converted into the image interchange format GIF are transmitted to the mobile terminal according to a request of the mobile terminal; or sending the video content converted into the image interchange format GIF to the mobile terminal in an active push mode.

6. The method of claim 5, wherein the video clips are in MPEG4 format.

7. A multimedia content processing apparatus, comprising:

the video clip acquisition module is used for acquiring video clips meeting preset conditions in the video;

the format conversion module is used for converting the video clip data format into an image interchange format GIF;

and the communication module is used for transmitting the video content converted into the image interchange format GIF to the mobile terminal.

8. The apparatus of claim 7, further comprising:

and the processing module is used for establishing association between the video content files of the image interchange format GIF from the same video.

9. The apparatus of claim 8, wherein the communication module transmits the video content to the mobile terminal through a wireless network or a mobile communication network.

10. The apparatus of claim 9, wherein:

the video clips are in motion picture experts group 4MPEG4 format.