CN110800310A

CN110800310A - Subtitle processing method and director system for sports game video

Info

Publication number: CN110800310A
Application number: CN201880041352.8A
Authority: CN
Inventors: 陈庭欣; 陈贤雨
Original assignee: SZ DJI Technology Co Ltd
Current assignee: SZ DJI Technology Co Ltd; Shenzhen DJ Innovation Industry Co Ltd
Priority date: 2018-12-29
Filing date: 2018-12-29
Publication date: 2020-02-14
Also published as: WO2020133371A1

Abstract

A subtitle processing method and a director system for an athletic competition video are disclosed, wherein the method comprises the following steps: acquiring competitive data in the competitive game process, wherein the competitive data comprises data sent by external equipment; rendering the competitive data on a first preset subtitle template in a display area of a preset application to generate a filling signal picture, wherein the display area also comprises a second preset subtitle template which is a key signal picture corresponding to the filling signal picture; and transmitting the filling signal picture to the broadcasting guide platform, and transmitting the key signal picture to the broadcasting guide platform, so that the broadcasting guide platform synthesizes the video stream to be displayed according to the filling signal picture and the key signal picture and obtains a new video stream. The preset application is adopted on the computer to realize the filling of the signal picture and the key signal picture, so that the online loading of the competition data in the competition process can be realized, a special caption machine does not need to be purchased, and the hardware cost is reduced.

Description

Subtitle processing method and director system for sports game video

Technical Field

The invention relates to the field of video subtitle processing, in particular to a subtitle processing method and a director system for sports game videos.

Background

When the competitive game is played directly, key information of the game is often presented on a screen in order to enable audiences to better understand the content of the game. When non-electronic competition is played directly, the information is usually displayed on site by workers by using a caption machine, but because the event information has a plurality of data items and the data is updated frequently, the traditional caption machine cannot effectively display the event information in real time. In the live broadcast of non-electronic competitive games, generally, a worker makes a caption template in advance, fills corresponding information content to generate a caption file, and a caption machine plays the caption file at a corresponding time. When the caption machine is concretely implemented, the caption machine and the broadcasting guide station establish communication connection based on a video signal transmission interface, the caption machine outputs filling signals and key signals of captions to the broadcasting guide station, and the broadcasting guide station synthesizes the superposition effect of the image-text captions in real time by using a back-removing synthesis technology. The subtitle file is manufactured off line, most subtitle machines cannot accept network data and modify subtitle content in real time, the defect of poor real-time performance exists, and the requirement of real-time performance of an OB (perspective of a third party) system of a competitive game cannot be met. The subtitle file is generated by subtitle template filling data, but the data volume carried by the subtitle template is very small, complex data logic cannot be executed, and the complex display logic of competitive competitions cannot be met. In addition, the caption generator usually needs a special caption software and a caption hardware card, which has a high hardware cost, and the caption software and the caption hardware card of different manufacturers do not form a unified standard and are closed, while the development cost for developing an OB system compatible with different captions is high.

In the electronic competition OB system, in order to present the event information, a third party is allowed to join the game and obtain the state information of the two parties of the competition in real time, such as a small map, blood volume, achievement and the like, so that the audience is greatly facilitated to know the progress of the event. The pictures and the role data of the electronic competition OB system are generated in the electronic competition system, so that the electronic competition OB system can flexibly render and display the pictures of the two competitors. However, for a real game, the data of the picture and the character come from different systems, the scene picture is shot by a camera, and the state and the data of the game object on the field need to be collected and processed by a specific system. The electronic sports OB system cannot meet the requirements of displaying data of real sports games and synthesizing and overlapping scene pictures.

Disclosure of Invention

The invention provides a video subtitle processing method and a director system.

Specifically, the invention is realized by the following technical scheme:

according to a first aspect of the present invention, there is provided a method for processing subtitles of a sports game video, the method comprising:

acquiring competitive data in a competitive game process, wherein the competitive data comprises data sent by external equipment;

rendering the athletic data on a first preset subtitle template in a display area of a preset application to generate a filling signal picture, wherein the display area further comprises a second preset subtitle template which is a key signal picture corresponding to the filling signal picture;

and transmitting the filling signal picture to a broadcasting guide platform, and transmitting the key signal picture to the broadcasting guide platform, so that the broadcasting guide platform synthesizes the video stream to be displayed according to the filling signal picture and the key signal picture and obtains a new video stream.

According to a second aspect of the present invention, there is provided a director system for an athletic game, the director system comprising: the system comprises external equipment, a computer and a broadcasting station, wherein the external equipment is in communication connection with the computer based on a network, and the computer is in communication connection with the broadcasting station;

the computer is used for acquiring competition data in a competition process, wherein the competition data comprises data sent by the external equipment; rendering the athletic data on a first preset subtitle template in a display area of a preset application to generate a filling signal picture, wherein the display area further comprises a second preset subtitle template which is a key signal picture corresponding to the filling signal picture;

the computer is also used for transmitting the filling signal picture to a broadcasting station and transmitting the key signal picture to the broadcasting station; and the director synthesizes the video stream to be displayed according to the filling signal picture and the key signal picture and obtains a new video stream.

According to the technical scheme provided by the embodiment of the invention, the filling signal picture and the key signal picture are realized by adopting the preset application on the computer, so that the online loading of the competitive data in the competitive game process can be realized, a special caption machine does not need to be purchased, the hardware cost is reduced, and by means of the flexibility of the preset application, the automation degree of caption processing is high, the real-time performance is strong, the degree of freedom is high, the application range is wide, the accuracy of caption loading is high, and the requirement of an OB system of the competitive game is met; meanwhile, a first preset subtitle template and a second preset subtitle template are designed in the same display area of a preset application, so that a filling signal picture and a key signal picture can be rendered simultaneously, and the synchronous rendering requirement of two pages is ensured; in addition, after the computer renders and obtains the filling signal picture and the key signal picture, the director adopts the back-off synthesis technology to synthesize the filling signal picture and the key signal picture into the video stream to be displayed, so as to meet the data display requirement of the real competitive game and ensure that the obtained video caption meets the broadcast-grade requirement.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without inventive labor.

Fig. 1 is a block diagram of a director system in one embodiment of the invention;

fig. 2 is a block diagram of a detailed structure of a director system in an embodiment of the present invention;

fig. 3 is a flowchart of a method of processing subtitles of a video according to an embodiment of the invention;

fig. 4 is a block diagram of a specific structure of a director system in an embodiment of the present invention;

FIG. 5 is a display diagram of a fill signal frame and a key signal frame in an embodiment of the present invention;

FIG. 6 is another illustration of a fill signal frame and a key signal frame in accordance with an embodiment of the present invention;

fig. 7 is a flowchart of a specific method of a video subtitle processing method according to an embodiment of the present invention;

FIG. 8A is a diagram of new video stream pictures resulting from the composition of a fill signal picture and a key signal picture into a video stream to be displayed in accordance with an embodiment of the present invention;

FIG. 8B is a diagram of new video stream pictures resulting from the composition of the filler signal pictures and the key signal pictures into a video stream to be displayed in accordance with another embodiment of the present invention;

fig. 9 is a flowchart of another specific method of processing subtitles of a video according to an embodiment of the present invention;

fig. 10 is a block diagram of another specific structure of the director system in an embodiment of the present invention.

Detailed Description

The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

The following describes the subtitle processing method and the director system for the sports game video in detail with reference to the accompanying drawings. The features of the following examples and embodiments may be combined with each other without conflict.

In the traditional caption machine, a worker manufactures a caption template in advance, then corresponding signal contents are filled in the caption template to generate a caption filling signal picture and a key signal picture, and the caption filling signal picture and the key signal picture are sent to a broadcasting guide station to be synthesized with a video stream to be displayed. The production of the caption template of the conventional caption machine and the filling of the corresponding signal content on the caption template are generally based on an off-line mode, and the caption machine has the disadvantages of low degree of freedom, low real-time performance and the like. In the competitive game, the data amount of the game is usually large, the game is updated quickly, and the traditional caption machine is difficult to meet the requirement of the competitive game on real-time data presentation.

However, for the conventional electronic sports OB system, it can only receive the caption data and the video stream from the same system, and then directly output the synthesized picture of the caption and the video stream of the specific electronic sports game. However, for the game, the video stream and the data of the game object are usually from different systems, the picture of the game scene is shot by the shooting device of the director station, and the data of the game object needs to be collected and processed by a specific system. Therefore, the conventional electronic sports OB system cannot synthesize data and video streams of sports objects in other sports competitions.

In order to overcome the defects that the information presented by the existing caption machine in the competitive game has low customization degree freedom and low real-time performance and the defects that the traditional electronic competitive OB system can not synthesize the data and video stream of competitive objects in other competitive games, the embodiment of the invention realizes the filling signal picture and the key signal picture based on the preset application on the computer, can realize the online loading of the competitive data in the competitive game process, and has the advantages of high automation degree, strong real-time performance, high freedom degree, wide application range and high precision of caption loading by means of the flexibility of the preset application; in addition, the director system makes caption files (a first preset caption template, a second preset caption template, a filling signal picture and a key signal picture) through a computer, obtains a video stream to be displayed through a shooting device of the director platform, and synthesizes the filling signal picture, the key signal picture and the video stream to be displayed through the director platform.

Fig. 1 is a block diagram of a director system in one embodiment of the invention. As shown in fig. 1, a director system according to an embodiment of the present invention may include an external device, a computer, and a director station, wherein the external device is communicatively connected (wired, wireless, or otherwise) to the computer, and the computer is communicatively connected to the director station.

The director system of the present embodiment is applied to an athletic game, wherein the athletic game may be a game in a real scene, such as a game with real athletic objects, real athletic players (controllable athletic objects), or a game without athletic objects, but including real athletic players (such as boxing). The athletic game may also be a virtual athletic game (e.g., a MOBA), where the athletic object is a virtual athletic object and the athletic player is a real athletic player.

Whether displaying a game in a scene or a virtual competitive game, an athletic game typically includes an referee system and/or an event system. The external device of the present embodiment may include a referee system and/or an event system.

In an athletic competition in a real scene, the referee system is used for determining an athletic result in the process of a real athletic player operating a real athletic object to play the competition, or determining an athletic result in the process of directly playing the competition among the real athletic players. In a virtual competitive game, an referee system is used to determine a competitive result in the process of a real competitive player operating a virtual competitive object to play the game.

Whether it is a realistic-scene competitive game or a virtual competitive game, the event system is generally used to determine the competitive rules during the competitive game.

In one embodiment, the functionality of the referee system and the event system may be integrated in a computer of the director system, and the competition data is processed by the computer of the director system.

In another embodiment, the referee system and/or the event system may be a server provided separately from the computer of the director system, see fig. 2, and in this embodiment, the external device may include the referee system and/or the event system. The referee system and/or the event system are respectively connected with the computer in a communication way.

Optionally, referring to fig. 2, the competitive object may include a robot in a real competitive game scene, the referee system is in communication connection with a sensing device on the robot, the sensing device on the robot may obtain identity data of the robot, and may also detect state data of the robot in a competition process, such as collected data of blood volume data, position information, operation information (such as that the robot is in an attack state or a defense state), and the like, and the sensing device on the robot may send the currently collected data to the referee system, and the field sensing device may collect data, such as shot quantity data of a shot replenishment mechanism that is replenished to the current robot, and collected data, such as current state information of the visual game mechanism, and send the currently collected data to the referee system. The referee system is in communication connection with field sensing equipment (such as a shot supply mechanism and a visual game mechanism) of the competitive field where the robot is located.

Optionally, the competitive object may include a virtual robot in a virtual competitive game scene, the virtual robot is operated by a real competitive player, and the referee system accesses a game server of the virtual competitive game, so as to directly obtain data information of the virtual robot, such as identity data, blood volume data, position data, and the like of the virtual robot, and then determine state data of the virtual robot based on the obtained data information of the virtual robot.

Optionally, the video output device of the computer is connected to the director.

Fig. 3 is a flowchart of a method for processing subtitles of a video according to an embodiment of the present invention. It should be noted that the main execution body of the video subtitle processing method of the present embodiment is a computer of the director system. As shown in fig. 3, a method for processing subtitles of a video according to an embodiment of the present invention may include the following steps:

step S301: acquiring competitive data in a competitive game process, wherein the competitive data comprises data sent by external equipment;

in this step, the athletic data may include offline data or online data. The athletic data may include text, pictures, and/or video, among others.

In this embodiment, the data sent by the external device includes real-time collected data of the referee system and/or the event system, and may also include data analyzed and determined by the referee system and/or the event system according to the real-time collected data. Optionally, the competitive data is data obtained by analyzing, by the referee system, the real-time data acquired by the referee system and/or the real-time data acquired by the referee system, such as state data of the confrontation object, data of a competitor for controlling the confrontation object, and data of a commentator during a competitive game. Optionally, the athletic data is athletic rules determined by the event system.

In this embodiment, the athletic data includes one or more of status data of the confrontation object, data of an athletic player for controlling the confrontation object, data of a commentator during an athletic game, and athletic rule data, and the athletic data may further include other data, which are not listed herein.

Optionally, the state data of the athletic object may include one or more of identity data of the athletic object, quantity data of the athletic object, blood volume data, position data, athletic score data, life state data, and trick trigger data, and it is understood that the state data of the athletic object may further include other data information for representing the state of the athletic object.

For example, the game object may comprise a robot in a real scene, and the referee system analyzes the received collected data of the sensor devices on the robot and/or the collected data of the field sensor devices to determine the state data of the game object. As another example, the game object may include a robot in a virtual scene, and the referee system may determine state data of the virtual robot based on data information of the virtual robot directly acquired from the virtual game server.

Optionally, the data of the competitor includes one or more of identification data of the competitor, historical competitive performance data of the competitor, and current competitive performance data of the competitor, and the data of the competitor is not limited to the above listed data types, and may also include other data types.

Optionally, the data of the commentator includes identity information of the commentator or others, such as the number of commentators in the current game.

Optionally, the competition rule data may include one or more of competition time data, competition number data, course data, battle data, and statistical data in the competition process of each competition.

In some embodiments, as shown in FIG. 4, the athletic data may also include local data and/or input data for the computer. Optionally, the athletic data includes one or more of local data, input data of the computer, and transmission data of the external device. It will be appreciated that the type of athletic data is not limited to the data types listed in the above embodiments, and may include other data types.

The local data is data stored in a magnetic disk of the computer, and the local data is usually offline data.

The input data of the computer can be contact input data, such as data input by a user through a keyboard, a mouse and the like, and can also be data stored in a U disk, a mobile hard disk and the like which are inserted into the computer and read by the computer; the input data of the computer can also be non-contact input data, such as data acquired by an identification module of the computer based on an induction mode (such as face identification, voice identification and the like), data acquired by the computer through an APP (application), and the like.

In some embodiments, the obtaining of the athletic data during the athletic competition may specifically include: the data sent by the external equipment is received, the currently received data is verified, the data passing the verification is used as the competitive data, and the data failing the verification is determined as invalid data, so that the accuracy and the safety of the data are ensured. When the currently received data is verified, specifically, if the data format of the currently received data meets the preset data structure, the currently received data is determined as the athletic data. And if the data format of the currently received data does not meet the preset data structure, determining the currently received data as invalid data.

As a feasible implementation manner, after receiving data sent by an external device, a computer analyzes and verifies the currently received data, and determines whether the currently received data meets a preset protobuf verification rule, if the currently received data meets the preset protobuf, the data format of the currently received data meets a preset data structure, and the currently received data is athletic data; if the currently received data does not meet the preset protobuf, the data format of the currently received data does not meet the preset data structure, and the currently received data is invalid data.

In some embodiments, after the athletic data in the athletic competition process is obtained, the athletic data is stored in the database, and the athletic data in the athletic competition process is stored through the database, so that the subsequent calling is facilitated.

Step S302: rendering the competitive data on a first preset caption template in a preset application display area to generate a filling signal picture (namely an RGB signal picture), wherein the display area also comprises a second preset caption template which is a key signal picture (namely an ALPHA signal picture) corresponding to the filling signal picture;

the preset application may include a Web application, such as various browser applications, and may also be a desktop word, a PPT, a photo editor, and the like.

As a feasible implementation manner, the preset application is a Web application, and relatively speaking, the Web application is easy to develop, can support the display of contents such as characters, pictures, videos and the like, and can implement user interactive operation and dynamic effect through a scripting language.

On the other hand, it is easier for the Web application to achieve online acquisition of the athletic data, for example, the referee system and/or the event system sends data to the Web application of the computer through a network communication protocol, such as hypertext Transfer protocol (http), etc., to achieve online loading of the athletic data and high real-time performance of athletic data transmission.

The resolution of the fill signal picture and the resolution of the key signal picture may or may not be equal. When the resolution of the filling signal picture and the resolution of the key signal picture are not equal, the subtitle effect such as subtitle redundancy or subtitle deletion can occur in the obtained new video stream after the filling signal picture and the key signal picture are synthesized into the video stream to be displayed. In order to avoid subtitle redundancy or subtitle deletion, in the present embodiment, the resolution of the fill signal picture and the resolution of the key signal picture are equal.

Alternatively, the resolution of the display area is twice the resolution of the fill signal picture or the resolution of the key signal picture. For example, in some of the embodiments, as shown in fig. 5, the width of the resolution of the display area is twice the width of the resolution of the fill signal picture or the key signal picture. In other embodiments, the height of the resolution of the display area is twice the height of the resolution of the fill signal picture or the key signal picture.

As a possible implementation manner, the resolution of the fill signal picture and the resolution of the key signal picture may be equal to the resolution of the display screen of the computer after being scaled by a preset scale, for example, the display area is a Web page. Optionally, the display area is designed in advance, and after the Web application is opened, the resolution of the Web page is directly twice that of the display screen. Optionally, the display area is obtained by stretching a Web page with a resolution equal to that of the display screen of the computer based on the Web application over the world wide Web, and the resolution of the stretched Web page is twice as large as that of the display screen of the computer. Optionally, the Web application stretches the width of the Web page with the resolution equal to the resolution of the display screen of the computer to twice the width of the display screen of the computer based on the world wide Web, so as to obtain the stretched Web page. Optionally, the Web application stretches the height of the Web page with the resolution equal to the resolution of the display screen of the computer to twice the height of the display screen of the computer, and obtains the stretched Web page.

Optionally, there is no menu bar and/or no virtual button on the display area of the preset application, so as to avoid the display area being blocked by the menu bar and/or the virtual button.

In this embodiment, the first preset subtitle template may include subtitle display information such as a subtitle display position and/or subtitle display content. The caption display position is a position where a caption is displayed in a new video stream, and referring to fig. 5, a region a and a region B of the new video stream are displayed with captions. The caption display content refers to caption information displayed in the new video stream, such as static information of characters, patterns, colors, shapes, and the like.

The second preset template is used for indicating the transparent effect of each pixel point in the filling picture in the new video stream, and specifically, the transparent effect of each pixel point in the filling signal picture in the new video stream is determined according to the brightness of the pixel point at the corresponding position in the key signal picture.

In this embodiment, the area of the first preset subtitle template corresponds to the area of the second preset subtitle template. For example, in fig. 5, the area a, the area B, and the area C of the first preset subtitle template need to be assisted by the second preset subtitle template to have a special effect, the position and the size of the area a of the first preset subtitle template are the same as the position and the size of the area a' of the second preset subtitle template, the position and the size of the area B of the first preset subtitle template are the same as the position and the size of the area B of the second preset subtitle template, and the position and the size of the area C of the first preset subtitle template are the same as the position and the size of the area C of the second preset subtitle template. Correspondingly, the region of the new video stream corresponds to the region of the first preset subtitle template, and the manner in which the region of the new video stream corresponds to the region of the first preset subtitle template is similar to the manner in which the region of the first preset subtitle template corresponds to the region of the second preset subtitle template, which is not described herein again.

The brightness of each pixel point in the key signal picture can be designed specifically according to needs, so that subtitles in different areas of a new video stream have different transparent effects. Optionally, the brightness of each pixel point in the key signal picture is determined according to a subtitle display position (i.e., a display position of the athletic data) of the first preset template subtitle template, and/or subtitle display content, and/or a preset subtitle effect corresponding to the athletic data, and the like. As shown in fig. 5, the first preset subtitle template includes a region a, a region B, and a region C, and finally, a portion corresponding to the region a in the new video stream and a portion corresponding to the region B in the new video stream need to be transparently displayed, a portion corresponding to the region C in the new video stream is non-transparently displayed, and a transparency of the portion corresponding to the region a in the new video stream is higher than a transparency of the portion corresponding to the region B in the new video stream, and then, the brightness of each pixel point of the regions a ', B ', and C ' in the key signal picture can be designed according to the above requirements, specifically, the greater the brightness of each pixel point in the key signal picture is, the greater the transparency of the filling signal picture at the position corresponding to the pixel point in the new video stream is.

Optionally, the brightness of each pixel point at the display position of the same athletic data in the key signal picture is the same. As a possible implementation manner, referring to fig. 5, the first preset subtitle template includes display positions of three pieces of athletic data, namely, an area a, an area B, and an area C, and sets the luminance of each pixel point of the area a ' of the key signal picture as a first luminance, the luminance of each pixel point of the area B ' of the key signal picture as a second luminance, and the luminance of each pixel point of the area C ' of the key signal picture as a third luminance. Finally, the transparency of the filling signal picture corresponding to each pixel point of the area A in the new video stream is the same, the transparency of the filling signal picture corresponding to each pixel point of the area B in the new video stream is the same, and the transparency of the filling signal picture corresponding to each pixel point of the area C in the new video stream is the same.

In some examples, the first brightness, the second brightness, and the third brightness are different from each other, and if the first brightness is 0, the second brightness is 50, and the third brightness is 255, the transparency of each pixel point of the part of the filling signal picture corresponding to the area a in the new video stream is the maximum and is completely transparent; filling each pixel point of the signal picture in the part corresponding to the area C in the new video stream, wherein the transparency is minimum and is opaque; the transparency of each pixel point of the part of the filling signal picture corresponding to the region B in the new video stream is between completely transparent and opaque.

In other examples, the first brightness, the second brightness, and the third brightness are partially or completely the same.

Optionally, the luminance of each pixel point at the display position of the same athletic data in the key signal picture is at least partially different, so that the filling signal picture can present different transparent effects at the corresponding position of the new video stream. As a feasible implementation manner, referring to fig. 6, the region D in the filling signal picture corresponds to the region D 'in the key signal picture, an effect of gradually changing the transparency of the filling signal picture in the portion of the new video stream corresponding to the region D is required, and if the transparency gradually decreases from left to right (arrow direction in fig. 6), the brightness of each pixel point of the region D' in the key signal picture may be set to a trend of gradually decreasing from left to right, that is, a gradual change effect of gradually increasing the transparency of the filling signal picture in the portion of the new video stream corresponding to the region D may be achieved.

In general, the positions of some of the pixel points filling the signal picture may be set as the display positions of the sports data, and the luminance of each pixel point at the position corresponding to the display position of the sports data in the key signal picture is set, so that the area picture corresponding to the display position of the sports data in the new video stream is covered by the sports data.

In some embodiments, the whole filling signal picture can be set as the display position of the sports data, and the video stream picture to be displayed is completely covered by setting the brightness of each pixel point in the whole area of the key signal picture, so that the new video stream picture becomes a hazy state.

In this embodiment, the first preset subtitle template and/or the second preset subtitle template may be dynamically adjusted according to one or more of the athletic data, the local data, and the input data of the computer, so as to generate different subtitle effects in the new video stream.

As a possible implementation manner, referring to fig. 7, the real-time dynamic adjustment process of the first preset subtitle template and the second preset subtitle template may include the following steps:

step S701: determining a preset subtitle effect corresponding to the athletic data;

as described in the above embodiment, the subtitle display content is static information, however, unlike the subtitle display content, the subtitle effect in this step may include static information and may also include dynamic information (e.g., a change process of the subtitle shape).

In this embodiment, the subtitle effect may include one or more of an animation effect, a display effect, and a hiding effect. Wherein the animation effect may include gradual change, fly-in, fly-out, blinds, bounce, zoom-in, zoom-out, etc.

The display effects may include fade, fly-in, fly-out, shutter, bounce, gradual increase in transparency of the athletic data at a specified location in the new video stream in a particular direction or gradual decrease in transparency in a particular direction, etc., duration of display of different athletic data, change in location of athletic data, shape of athletic data.

It should be noted that the display effect includes an animation effect and other data information for indicating a subtitle change. For example, in a specific implementation, the athletic data 1 needs to be synthesized in a fly-in manner in the upper left corner of the new video stream, and move from left to right to the upper right corner of the new video stream at a preset speed within 1s, and at 0.5s, the data format of the athletic data 1 is switched from "song cube" to "regular cube", in this implementation, the animation effect includes fly-in, the display effect includes fly-in, the athletic data 1 moves from the upper left corner of the new video stream to the upper right corner of the new video stream, and the data format of the athletic data 1 is switched from "song cube" to "regular cube", which is visible.

The hiding effect of the athletic data may include a mosaic overlay, a picture overlay, and the like.

Optionally, the subtitle effect corresponding to different sports data may be selected according to the need, for example, sports data 1 corresponds to the animation effect of flying in, and sports data 2 corresponds to the animation effect of blinds. Optionally, the subtitle effect corresponding to different subtitle display positions may be fixed, as shown in fig. 5, the subtitle effect in the region a is fly-in, and the subtitle effect in the region B is pop-up. Optionally, the subtitle effect corresponding to different subtitle display positions changes with time and/or subtitle display content, for example, the subtitle effect of the area a at the first time is fly-in, the subtitle effect at the second time is fly-out, and the subtitle effect at the third time is blind window and the like.

Step S702: and adjusting the display information of the content in the first preset subtitle template and/or the second preset subtitle template according to the subtitle effect so as to generate the subtitle effect in the new video stream.

In this step, the adjusted display information may include a change in the display position of the athletic data, a change in the shape of the athletic data, and/or the duration of time the athletic data is displayed, etc.

In a specific implementation manner, the display of the countdown of the competitive game needs to be performed, for example, "5", "4", "3", "2", "1" and "0" are sequentially displayed in the central area of the new video stream, the duration of each digit display is 1s, each digit is gradually reduced from a preset size (the preset size is determined according to the size of the central area) in the central area of the new video stream until the digit disappears, and the transparency of each digit in the new video stream is different, then the digits "5", "4", "3", "2", "1" and "0" can be sequentially loaded in the central area of the first preset caption template, the duration of the digits "5", "4", "3", "2", "1" and "0" displayed in the first preset template is adjusted to be 1s, and meanwhile, the digits "5" and "0" displayed in the central area of the first preset template are adjusted to be simultaneously, The animation effects of "4", "3", "2", "1", and "0" are "gradually reduced from a preset size until disappearing". Meanwhile, the brightness of each pixel in the central area of the second preset template is adjusted to be the brightness corresponding to the transparency required when each number is displayed.

In another specific implementation, the competitive game includes a red party team and a blue party team, and the red party team and the blue party team respectively include competitive objects of 3 infantry robots, 1 hero, 1 engineering robot and 1 unmanned aerial vehicle. The competitive game comprises a plurality of tasks, each robot can execute the corresponding task and attack the other robot, and the team which finishes all the tasks firstly wins. In the competition process, data information of a red party team needs to be displayed in the left area of a competition video picture, data information of a blue party team needs to be displayed in the right area of the competition video picture, and confrontation data, competition time statistical data, scores of two parties and the like in the competition process are displayed in the middle area of the competition video picture.

Referring to fig. 8A, it is necessary to display team information of the red party team and current operation information of the red party team in an area 1 of the competitive game video screen, to display identity information of a competitive object of the red party team in an area 11, for example, 111 for displaying identity information of one of infantry robots of the red party team, 112 for displaying identity information of hero of the red party team, 113 for displaying identity information of an engineering robot of the red party team to wait, to display a video stream of competitive players of the red party team in an area 12 of the competitive game video screen, and to display identity information of a competitive object of the red party currently performing a task, weapon information of performing a task, and the like in an area 13 of the competitive game video screen. Further, it is necessary to display team information of the blue team and current operation information of the blue team in the area 2 of the competition video screen, display identity information of a competition object of the blue team in the area 21, for example, 211 for displaying identity information of one of infantry robots of the blue team, 212 for displaying identity information of hero of the blue team, 213 for displaying identity information of an engineering robot of the blue team for waiting, display a video stream of a competition player of the blue team in the area 22 of the competition video screen, and display identity information of a competition object of a red team currently performing a task, weapon information of performing a task, and the like in the area 23 of the competition video screen. The statistical data of the competition time and the scores of the two parties are displayed in a region 3 of a video picture of the competitive competition, the special effect of the competition data in the competitive competition process is displayed in a region 4 of the video picture of the competitive competition (when a team completes any task, successfully attacks the opponent and the like, the special effect corresponding to the currently completed task needs to be displayed in the region 4, the presenting mode of the special effect is preset), the text data of the competition data in the competitive competition process is displayed in the region 4 of the video picture of the competitive competition, wherein the region 3 corresponds to the region 4, for example, the region 4 displays that "a basketball small energy mechanism is activated, the attack power of the whole team is 1.5", and the special effect displayed in the region 3 can be as shown in fig. 8A.

In this implementation, when one of the teams completes any task, successfully attacks the opponent, and the like, the whole filling signal picture can be set as the display position of the sports data, and the video stream picture to be displayed is completely covered by setting the brightness of each pixel point in the whole area of the key signal picture, so that the new video stream picture becomes a hazy state.

It will be appreciated that the game data displayed in each of the areas of the game video frames may include text, pictures and/or video streams.

As a possible implementation manner, as shown in fig. 8B, it is necessary to display the flying-in athletic data in the area E of the new video stream screen, and the animation display effect of the area E in the first preset subtitle template for displaying the athletic data may be set to fly-in, so that the area E in the new video stream displays the athletic data in a flying-in manner.

As another possible implementation manner, as shown in fig. 8B, it is required to display the athletic data with gradually increasing transparency along the direction of the arrow shown in fig. 8B in the region F of the new video stream picture, and the brightness of each pixel point in the second preset subtitle template corresponding to the position of the region F may be set to gradually increase along the direction of the arrow shown in fig. 8B, so that the transparency of the athletic data displayed in the region F in the new video stream picture gradually increases along the direction of the arrow shown in fig. 8B.

Step S303: and transmitting the filling signal picture to the broadcasting guide platform, and transmitting the key signal picture to the broadcasting guide platform, so that the broadcasting guide platform synthesizes the video stream to be displayed according to the filling signal picture and the key signal picture and obtains a new video stream.

The director of this embodiment includes a camera that is used to acquire the video stream to be displayed. For example, for an athletic game, a camera is used to capture an athletic game video. Optionally, the video stream to be displayed includes one or more of a competing video stream of a competing object, a video stream of an athletic player, a video stream of a commentator, a video stream of an audience during an athletic event, and may also include other video streams.

In this embodiment, the video output device of the computer is connected to the director, for example, the video output device of the computer and the director are connected through a signal line. In executing step S303, specifically, the computer-based video output device transmits the fill signal picture to the director, and transmits the key signal picture to the director. Compared with a caption machine, the system utilizes general equipment of a common computing system, and is low in development cost.

The video output device may include a video card or a non-woven card. In some embodiments, the computer projects the filling signal picture and the key signal picture in step S202 to the director through a video card of the computer, so as to achieve the purpose of real-time transmission of the filling signal picture and the key signal picture. In other embodiments, the computer transmits the filling signal picture and the key signal picture in step S302 to the director through a non-coded card of the computer, so as to achieve the purpose of real-time transmission of the filling signal picture and the key signal picture.

Further, in some embodiments, referring to fig. 9, after the computer obtains the athletic data during the athletic competition, the method further comprises:

step S901: calling a preset instruction corresponding to the athletic data;

step S902: and broadcasting a preset instruction.

It should be noted that, in the embodiment of the present invention, broadcasting the preset instruction means that the computer directly notifies the preset instruction to the director, the third-party website, the third-party device, and the like, and after obtaining the preset instruction, the director, the third-party website (i.e., the webcast system in fig. 10), and the like execute a corresponding operation according to the preset instruction.

In some embodiments, the preset instructions may include one or more of audio play instructions, network interface call instructions, and director instructions. Of course, the preset instructions are not limited to the above list, and may also include other instructions, such as a light display instruction. It should be noted that the network interface call instruction is mainly for the third-party website, and the network interface call instruction may trigger the director to push the new video stream to the cloud end, so that the third-party website may obtain the new video stream from the cloud end and play the new video stream, or the network interface call instruction instructs the third-party website to access the computer of the director system, and directly receive the broadcast message generated by the computer, thereby ensuring that the third-party website broadcasts the real-time event data in the process of live broadcasting the new video stream. In this embodiment, after obtaining the new video stream, the director can display the new video stream through a field screen (such as a competition field), or push the new video stream to the cloud through the video streaming server, and then play the new video stream obtained by the cloud through the third-party website.

For example, when a game object (e.g., a robot) loses blood, a first specific sound effect needs to be played in a new video stream, the computer can call a first sound effect playing instruction corresponding to the blood loss data of the game object and broadcast the first sound effect playing instruction, the broadcast message can be directly transmitted to a live audio playing device or a third-party website, and the live audio playing device or the third-party website can directly play the first specific sound effect after receiving the broadcast message. When the sports object dies, a second specific sound effect needs to be played in a new video stream, the computer can call a second sound effect playing instruction corresponding to the death life state of the sports object and broadcast the second sound effect playing instruction, the broadcast message can be directly transmitted to the on-site audio playing device (namely the on-site audio playing device) or a third-party website, and the on-site audio playing device or the third-party website can directly play the first specific sound effect after receiving the broadcast message.

When a game object is in a death life state, the director station is required to switch the display scene of the video stream to be displayed, for example, a part of video pictures of the game object in the current field game in which the current death life state occurs is replayed, or the pictures of the game object in the death life state are amplified, etc., the computer can call a director station instruction for instructing the director station to switch the display scene of the video stream to be displayed and broadcast the director station instruction to the director station so as to instruct the director station to switch the display scene of the video stream to be displayed.

When the competitive object defeats the competitive object of the opposite party and the light of the competition site needs to be controlled to be fully on, the computer can call the light display instruction and broadcast, the broadcast message is directly transmitted to the light control module on the site, and the light control module on the site can control the light of the site to be fully on after receiving the broadcast message.

The computer can trigger the third-party website to directly execute the event corresponding to the preset instruction in a mode of broadcasting the preset instruction, such as sound effect playing corresponding to the audio playing instruction, so that the third-party website can play sound effects in time, and real-time event data release in the process of live broadcasting of a new video stream by the third-party website is ensured.

In step S901, specifically, the computer receives a preset event signal corresponding to the athletic data, and invokes a preset instruction corresponding to the preset event signal.

The generation condition of the preset event signal can include one or more of generation based on input data of a computer, generation based on local control data and generation based on control data sent by an external device. Optionally, the preset event signal is an audio playing indication signal, a network interface calling indication signal, or a director indication signal.

Optionally, the video stream to be displayed is a video stream in a process of an athletic competition, and the control data includes athletic data. The local control data is competition data stored in the computer in advance locally, the control data sent by the external equipment is competition data in a competition process sent by the external equipment, and the competition data can comprise one or more of quantity data, blood volume data, position data, competition score data, life state data and the like of competition objects.

As a feasible implementation manner, the preset event signal is a director indicating signal generated based on local input data of the computer, for example, when a Ctrl key and an Enter key of the computer are simultaneously pressed, the computer generates a director indicating signal for instructing the director to perform scene switching of a video stream to be displayed. Of course, the director indication signal may also be generated based on local control data and/or based on control data sent by an external device.

As another feasible implementation manner, the preset event signal is a network interface call instruction signal generated based on local control data of the computer, for example, sound effect data corresponding to bleeding data of the sports object is locally and previously stored, and after determining that the sports object bleeds, the computer generates a network interface call instruction for instructing a third-party website to play the sound effect data corresponding to the bleeding data of the sports object. Of course, the network interface call instruction signal may also be generated based on input data of the computer and/or based on control data transmitted by an external device.

As another possible implementation manner, the preset event signal is an audio playing indication signal generated based on control data sent by an external device, for example, when the computer receives that a death life state of the sports object occurs, the computer generates an audio playing indication signal for indicating to play specific audio data. Of course, the audio playback indication signal may also be generated based on local control data and/or based on input data of the computer.

According to the subtitle processing method for the sports competition video, the preset application is adopted on the computer to realize the filling signal picture and the key signal picture, so that the online loading of the sports data in the process of the sports competition can be realized, a special subtitle generator does not need to be purchased, the hardware cost is reduced, and by means of the flexibility of the preset application, the subtitle processing automation degree is high, the real-time performance is strong, the degree of freedom is high, the application range is wide, the subtitle loading accuracy is high, and the requirements of an OB system of the sports competition are met; meanwhile, a first preset subtitle template and a second preset subtitle template are designed in the same display area of a preset application, so that a filling signal picture and a key signal picture can be rendered simultaneously, and the synchronous rendering requirement of the two pictures is ensured; in addition, after the computer renders and obtains the filling signal picture and the key signal picture, the director adopts the back-off synthesis technology to synthesize the filling signal picture and the key signal picture into the video stream to be displayed, so as to meet the data display requirement of the real competitive game and ensure that the obtained video caption meets the broadcast-grade requirement.

It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by a computer program, which can be stored in a computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. The storage medium may be a magnetic disk, an optical disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), or the like.

The above disclosure is intended to be illustrative of only some embodiments of the invention, and is not intended to limit the scope of the invention.

Claims

1. A subtitle processing method for a competitive game video is characterized by comprising the following steps:

2. A method according to claim 1, characterized in that the competition data further comprises local data and/or input data of the computer.

3. The method according to claim 1, characterized in that the external device comprises an referee system for determining the competitive result of an competitive object during the competitive game and/or an event system for determining the rules of the competitive during the competitive game.

4. The method of claim 3, wherein the transmitted data of the external device is determined by the external device based on real-time analysis of the collected data.

5. The method of claim 4, wherein the athletic object comprises a robot in a real-world scene, the referee system communicatively coupled to a plurality of the robots and to a venue sensory device of an athletic venue in which the robot is located;

the collected data comprises collected data of sensing equipment on the robot and/or collected data of the field sensing equipment.

6. The method according to claim 3, wherein the predetermined application comprises a Web application, and the data transmitted by the referee system and/or the event system is transmitted via a network communication protocol.

7. The method according to claim 6, wherein the data sent by the referee system and/or the event system is sent via the hypertext transfer protocol (HTTP).

8. The method of claim 6, wherein the obtaining athletic data during an athletic competition comprises:

receiving data sent by the external equipment;

and if the data format of the currently received data meets a preset data structure, determining the currently received data as the athletic data.

9. The method of claim 8, wherein after receiving the data transmitted by the external device, the method further comprises:

and if the data format of the currently received data does not meet the preset data structure, determining the currently received data as invalid data.

10. The method according to claim 1, wherein the transparency of each pixel in the fill signal picture in the new video stream is determined according to the brightness of the pixel at the corresponding position in the key signal picture.

11. The method of claim 1, wherein the first pre-defined caption template and/or the second pre-defined template are dynamically adjusted in real-time according to one or more of the athletic data, local data, and computer input data.

12. The method of claim 11, wherein the first preset subtitle template comprises a subtitle display position and/or subtitle display content.

13. The method of claim 11, wherein the real-time dynamic adjustment process of the first preset subtitle template and the second preset subtitle template comprises:

determining a preset subtitle effect corresponding to the athletic data;

and adjusting display information of contents in the first preset subtitle template and/or the second preset subtitle template according to the subtitle effect so as to generate the subtitle effect in the new video stream.

14. The method of claim 13, wherein the subtitle effect comprises one or more of an animation effect, a display effect, and a hiding effect.

15. The method of claim 14, wherein the athletic data includes one or more of status data of the counter object, data of an athletic player controlling the counter object, data of a commentator during an athletic game, and athletic rules data;

the video stream to be displayed comprises one or more of a competing video stream of the competing object, a video stream of the competitive player, a video stream of the commentator and a video stream of the audience in the process of the competitive game.

16. The method of claim 15, wherein the state data of the athletic object includes one or more of identity data of the athletic object, quantity data of the athletic object, blood volume data, location data, athletic score data, life state data, trick trigger data; and/or

The data of the competitive player comprises one or more of identity data of the competitive player, historical competitive combat performance data of the competitive player and current competitive combat performance data of the competitive player; and/or

The data of the commentator comprises identity information of the commentator; and/or

The competition rule data comprises one or more of competition time data, competition number data, competition process data, battle data and statistical data in the competition process of each competition.

17. The method according to claim 1, wherein the resolution of the fill signal picture and the resolution of the key signal picture are equal.

18. The method according to claim 17, wherein the width of the resolution of the display area is twice the width of the resolution of the fill signal picture or the key signal picture.

19. The method according to claim 17, wherein a height of a resolution of the display area is twice a height of a resolution of the fill signal picture or the key signal picture.

20. The method according to claim 1, wherein the display area of the preset application is free of menu bar and/or virtual button.

21. The method of claim 1, wherein transmitting the filler signal picture to a director station and the key signal picture to the director station comprises:

and the computer-based video output equipment transmits the filling signal picture to a broadcasting guide station and transmits the key signal picture to the broadcasting guide station.

22. The method of claim 21, wherein the video output device comprises a video card or a non-video card.

23. The method of claim 1, wherein after obtaining athletic data during an athletic competition, the method further comprises:

calling a preset instruction corresponding to the athletic data;

and broadcasting the preset instruction.

24. The method of claim 23, wherein invoking the preset instruction corresponding to the athletic data comprises:

receiving a preset event signal corresponding to the athletic data;

and calling a preset instruction corresponding to the preset event signal.

25. The method of claim 24, wherein the generation of the preset event signal comprises one or more of generation based on input data of a computer, generation based on local control data, and generation based on control data transmitted by an external device.

26. The method of claim 25, wherein the control data comprises the athletic data.

27. The method of claim 23, wherein the preset instructions comprise one or more of audio playing instructions, network interface calling instructions, and director instructions.

28. The method of claim 1, wherein after obtaining athletic data during an athletic competition, the method further comprises:

and storing the athletic data into a database.

29. A director system for an athletic game, the director system comprising: the system comprises external equipment, a computer and a broadcasting station, wherein the external equipment is in communication connection with the computer based on a network, and the computer is in communication connection with the broadcasting station;

30. The director system of claim 29, wherein the athletic data further comprises local data and/or input data for the computer.

31. The director system of claim 29, wherein said external devices comprise an umpire system for determining the outcome of a game of an athletic object during said athletic game and/or an event system for determining rules of said game during said athletic game.

32. The director system of claim 31, wherein the transmission data from said external device is determined by said external device based on real-time analysis of the collected data.

33. The director system according to claim 32, wherein the competitive objects comprise robots in a real scene, and the referee system is communicatively connected to a plurality of the robots and to a venue sensing device of an arena in which the robots are located;

34. The director system of claim 31, wherein said predetermined application comprises a Web application, and wherein said referee system and/or said event system transmits data via a Web communication protocol.

35. The director system of claim 34, wherein said referee system and/or said event system sends data via HTTP.

36. The director system of claim 34, wherein the computer is further configured to: receiving data sent by the external equipment; and if the data format of the currently received data meets a preset data structure, determining the currently received data as the athletic data.

37. The director system of claim 36, wherein after receiving the data sent by the external device, the computer determines the currently received data as invalid data if it is determined that the data format of the currently received data does not satisfy the preset data structure.

38. The director system of claim 29, wherein the transparency of each pixel in said filler signal field in said new video stream is determined based on the brightness of the pixel in the corresponding location in said key signal field.

39. The director system of claim 29, wherein the first predefined subtitle template and/or the second predefined template are dynamically adjusted in real-time according to one or more of the athletic data, local data, and computer input data.

40. The director system of claim 39, wherein the first pre-defined subtitle template comprises a subtitle display location and/or subtitle display content.

41. The director system of claim 39, wherein the dynamic real-time adjustment of the first pre-defined caption template and the second pre-defined template by the computer comprises:

determining a preset subtitle effect corresponding to the athletic data;

42. The director system of claim 41, wherein the subtitle effects comprise one or more of animation effects, display effects, and hiding effects.

43. The director system of claim 42, wherein said competitive data comprises one or more of status data for said counter object, data for an competitor controlling said counter object, data for a commentator during an athletic game, and athletic rules data;

44. The director system of claim 43, wherein the status data for the athletic object includes one or more of identity data for the athletic object, quantity data for the athletic object, blood volume data, location data, athletic score data, life status data, and trick trigger data; and/or

45. The director system of claim 29, wherein said fill signal picture has a resolution equal to a resolution of said key signal picture.

46. The director system of claim 45, wherein said display area has a resolution twice as wide as the resolution of said fill signal picture or said key signal picture.

47. The director system of claim 45, wherein the display area has a resolution twice as high as the resolution of the fill signal picture or the key signal picture.

48. The director system of claim 29, wherein said predetermined application has no menu bar and/or no virtual buttons on a display area thereof.

49. The director system of claim 29, wherein said computer includes a video output device, said video device being in communication with said director station; and the video output equipment transmits the filling signal picture to a broadcasting guide station and transmits the key signal picture to the broadcasting guide station.

50. The director system of claim 49, wherein said video output device comprises a video card or a non-video card.

51. The director system of claim 29, wherein the computer, after obtaining athletic data during the athletic competition, is further configured to: and calling a preset instruction corresponding to the competition data, and broadcasting the preset instruction.

52. The director system of claim 51, wherein said computer is further configured to: and receiving a preset event signal corresponding to the athletic data, and calling a preset instruction corresponding to the preset event signal.

53. The director system according to claim 52, wherein said predetermined event signal is generated based on one or more of input data from a computer, local control data, and control data transmitted from an external device.

54. The director system of claim 53, wherein the control data comprises the athletic data.

55. The director system of claim 51, wherein the preset instructions comprise one or more of audio play instructions, network interface call instructions, and director station instructions.

56. The director system of claim 29, wherein the computer, after obtaining athletic data for an athletic event, is further configured to store the athletic data in a database.