WO2020133371A1

WO2020133371A1 - Competition video subtitle processing method and broadcast guiding system

Info

Publication number: WO2020133371A1
Application number: PCT/CN2018/125395
Authority: WO
Inventors: 陈庭欣; 陈贤雨
Original assignee: 深圳市大疆创新科技有限公司
Priority date: 2018-12-29
Filing date: 2018-12-29
Publication date: 2020-07-02
Also published as: CN110800310A

Abstract

A competition video subtitle processing method and a broadcast guiding system, the method comprising: obtaining competition data during a competition process, the competition data comprising data sent by external equipment; rendering the competition data in a first preset subtitle template of a display area of a preset application to generate a fill signal image, the display area also comprising a second preset subtitle template, and the second preset subtitle template being a key signal image corresponding to the fill signal image; and transmitting the fill signal image to a broadcast guiding station, and transmitting the key signal image to the broadcast guiding station, so that the broadcast guiding station can synthesize a video stream to be displayed according to the fill signal image and the key signal image to obtain a new video stream. By means of using a preset application on a computer to implement a fill signal image and a key signal image, online loading of competition data during the competition process can be achieved, without requiring the purchase of a special subtitle machine, thus reducing the hardware costs.

Description

Caption processing method and guide system of competitive game video

Technical field

The invention relates to the field of video subtitle processing, in particular to a caption processing method and guide system for competitive game videos.

Background technique

During the live broadcast of competitive games, in order to let the audience better understand the content of the event, the key information of the event is often presented on the screen. When the non-e-sports game is broadcast live, the information is usually produced and played by the staff using a caption machine. However, due to the large number of event information data and frequent data updates, this makes the traditional caption machine unable to effectively display the game information in real time. In the live broadcast of non-e-sports games, the staff usually creates a subtitle template in advance, then fills in the corresponding information content to generate a subtitle file, and the subtitle machine plays the subtitle file at the corresponding time. In specific implementation, the caption machine and the guide station establish a communication connection based on the video signal transmission interface. The caption machine outputs the subtitle filling signal and the key signal to the guide station, and the guide station uses the back-synthesis technology to synthesize the overlay effect of the text and subtitles in real time. Subtitle files are produced offline, and most subtitle machines cannot accept network data and modify subtitle content in real time, which has the disadvantage of poor real-time performance and cannot meet the real-time requirements of the OB (third-party perspective) system of competitive games. The subtitle file is generated from the subtitle template filling data, but the subtitle template carries a very small amount of data, cannot perform complex data logic, and cannot meet the complex display logic of competitive games. In addition, captioning machines usually require special captioning software and captioning hardware cards, and the hardware cost is relatively high. The captioning software and captioning hardware cards of different manufacturers have not formed a unified standard and are closed-source. High development costs.

In the e-sports OB system, in order to present the event information, allow third parties to join the game and obtain real-time status information of the two parties, such as small maps, blood volume, achievements, etc., which greatly facilitates the audience to understand the progress of the event. The pictures and character data of the e-sports OB system are generated in the e-sports system, which allows the e-sports OB system to flexibly render and display the pictures of the two players. However, for the actual competitive games, the data of the pictures and characters come from different systems. The live pictures are taken by cameras. The state and data of the sports objects on the field need to be collected and processed by a specific system. The e-sports OB system can not meet the needs of the display of real sports competition data and the synthesis and superposition of the live pictures.

Summary of the invention

The invention provides a video subtitle processing method and a guide system.

Specifically, the present invention is achieved through the following technical solutions:

According to a first aspect of the present invention, there is provided a caption processing method for competitive game videos, the method including:

Obtain competitive data during the competitive game, the competitive data includes data sent by an external device;

Rendering the competitive data on a first preset subtitle template of a display area of a preset application to generate a fill signal picture, the display area further includes a second preset subtitle template, and the second preset subtitle template is the fill Key signal screen corresponding to the signal screen;

Transmitting the fill signal picture to the guide station, and transmitting the key signal picture to the guide station, so that the guide station synthesizes the video stream to be displayed according to the fill signal picture and the key signal picture And get a new video stream.

According to a second aspect of the present invention, there is provided a guide system for a competitive game. The guide system includes: an external device, a computer, and a guide station. The external device and the computer implement a communication connection based on a network, and the computer and all Describe the communication connection of the guide station;

Wherein, the computer is used to obtain competitive data during the competitive game, the competitive data includes data sent by the external device; and render the competitive data on the first preset subtitle template in the display area of the preset application Generating a fill signal picture, the display area further includes a second preset subtitle template, and the second preset subtitle template is a key signal picture corresponding to the fill signal picture;

The computer is also used to transmit the fill signal picture to the guide station and the key signal picture to the guide station; the guide station according to the fill signal picture and the key signal picture to be displayed The video stream is synthesized and a new video stream is obtained.

It can be seen from the technical solutions provided by the above embodiments of the present invention that by using a preset application on a computer to realize the filling of the signal screen and the key signal screen, the online loading of competitive data during the competitive game can be achieved without the need to purchase a dedicated captioning machine. In addition to the hardware cost, and with the help of the flexibility of the preset application, the subtitle processing has high automation, strong real-time, high degree of freedom, wide application range, high accuracy of subtitle loading, and meets the needs of competitive OB systems; at the same time, The first preset subtitle template and the second preset subtitle template are designed in the same display area of the preset application, and the fill signal screen and the key signal screen can be rendered at the same time to ensure the simultaneous rendering requirements of the two pages; in addition, the computer rendering After obtaining the fill signal screen and the key signal screen, the guide station uses the back-off synthesis technology to synthesize the fill signal screen and the key signal screen into the video stream to be displayed to meet the data display requirements of the actual competitive game and make the obtained video subtitles Meet broadcast-level requirements.

BRIEF DESCRIPTION

In order to more clearly explain the technical solutions in the embodiments of the present invention, the drawings required in the description of the embodiments will be briefly introduced below. Obviously, the drawings in the following description are only some embodiments of the present invention. For those of ordinary skill in the art, without paying any creative labor, other drawings can also be obtained based on these drawings.

1 is a structural block diagram of a guide system in an embodiment of the present invention;

2 is a block diagram of a specific structure of a guide system in an embodiment of the present invention;

FIG. 3 is a method flowchart of a video subtitle processing method in an embodiment of the present invention;

4 is a block diagram of a specific structure of a guide system in an embodiment of the present invention;

5 is a display diagram of a fill signal screen and a key signal screen in an embodiment of the invention;

6 is another display diagram of the fill signal screen and the key signal screen in an embodiment of the invention;

7 is a flowchart of a specific method of a video subtitle processing method according to an embodiment of the present invention;

8A is a diagram of a new video stream picture obtained by synthesizing a fill signal picture and a key signal picture into a video stream to be displayed in a specific embodiment of the present invention;

8B is a diagram of a new video stream screen obtained by synthesizing a fill signal screen and a key signal screen into a video stream to be displayed in another specific embodiment of the present invention;

9 is a flowchart of another specific method of a video subtitle processing method according to an embodiment of the present invention;

10 is a block diagram of another specific structure of a guide system in an embodiment of the present invention.

detailed description

The technical solutions in the embodiments of the present invention will be described clearly and completely in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, but not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by a person of ordinary skill in the art without creative work fall within the protection scope of the present invention.

The caption processing method and guide system of the competitive game video of the present invention will be described in detail below with reference to the drawings. The features in the following examples and implementations can be combined with each other without conflict.

In the traditional captioning machine, staff make caption templates in advance, and then fill the caption templates with corresponding signal content to generate caption filling signal pictures and key signal pictures, and then send them to the guide station for synthesis with the video stream to be displayed. The production of caption templates for traditional caption machines and the filling of corresponding signal content on the caption templates are usually based on the offline mode, which has the disadvantages of low freedom and low real-time performance of the caption machines. In competitive games, the amount of game data is usually large, and the update is relatively fast. It is difficult for traditional captioning machines to meet the real-time data presentation requirements of competitive games.

As for the traditional e-sports OB system, it can only receive subtitle data and video streams from the same system, and then directly output the combined picture of the subtitles and video streams of a specific e-sports game. However, for competitive games, the data of video streams and competitive objects usually come from different systems. The scene of the game is captured by the shooting device of the guide station. The data of the competitive objects needs to be collected and processed by a specific system. Therefore, the traditional e-sports OB system cannot synthesize the data and video streams of competitive objects in other competitive games.

In order to overcome the shortcomings of the existing caption machine presenting information in competitive games, such as low degree of freedom of customization and low real-time, and overcome the shortcomings of the traditional e-sports OB system unable to synthesize data and video streams of competitive objects in other competitive games, embodiments of the present invention Based on the preset application on the computer to realize the filling signal screen and the key signal screen, it can realize the online loading of competitive data during the competitive game, and with the flexibility of the preset application, the caption processing is highly automated and real-time. High degree of freedom, wide range of application, high accuracy of subtitle loading, meeting the needs of competitive OB system; In addition, the guide system uses the computer to perform subtitle files (first preset subtitle template, second preset subtitle template and fill signal screen) And key signal screen), the video stream to be displayed is obtained through the shooting device of the guide station, and then the guide station synthesizes the filled signal picture, the key signal picture and the video stream to be displayed. The guide system can be widely used in a variety of In the caption processing scene of competitive video.

FIG. 1 is a structural diagram of a guide system in an embodiment of the present invention. As shown in FIG. 1, the guidance system of an embodiment of the present invention may include an external device, a computer, and a guidance station, where the external device is connected to the computer in communication (wired, wireless, or other communication modes), and the computer is connected to the guidance station in communication.

The guide system of this embodiment is applied in competitive games, where the competitive game may be a game in a real scene, such as a game with real competitive objects, real competitive players (controllable competitive objects), or no competitive objects, but Including real competitive players (such as boxing). The competitive game may also be a virtual competitive game (such as MOBA), the competitive object is a virtual competitive object, and the competitive player is a real competitive player.

Whether displaying a game in a scene or a virtual competitive game, a competitive game usually includes a referee system and/or an event system. The external device in this embodiment may include a referee system and/or an event system.

In a competitive game in a real scene, the referee system is used to determine the competitive results of real competitive players operating real competitive objects in the game, or to determine the competitive results of real competitive players directly during the game. In a virtual competitive game, the referee system is used to determine the competitive results of real competitive players operating virtual competitive objects to conduct the game.

Whether it is a real-world competitive game or a virtual competitive game, the event system is usually used to determine the competitive rules in the course of the competitive game.

In one embodiment, the functions of the referee system and the event system can be integrated into the computer of the guidance system, and the competition data is processed by the computer of the guidance system.

In another embodiment, the referee system and/or the event system may be a server provided independently of the computer of the guide system. Referring to FIG. 2, in this embodiment, the external device may include the referee system and/or the event system. The referee system and/or event system are in communication with the computer.

Optionally, referring also to FIG. 2, the competitive object may include a robot in a real competitive game scene, the referee system is in communication with the sensor device on the robot, and the sensor device on the robot may obtain the identity data of the robot. Detect the state data of the robot during the game, such as blood volume data, position information, operation information (such as the robot is in an attacking state or defensive state, etc.) and collect data, and the sensor equipment on the robot will collect the current data The data is sent to the referee system, and the field sensing equipment can collect data such as the number of projectiles supplied to the current robot by the projectile supply mechanism, the current status information of the visual game mechanism, and send the current collected data to the referee system. The referee system is communicatively connected to the field sensing equipment (such as projectile replenishment mechanism and visual game mechanism) where the robot is located.

Optionally, the competitive object may include a virtual robot in a virtual competitive game scene, the virtual robot is operated by a real competitive player, and the referee system is connected to the game server of the virtual competitive game, thereby directly acquiring data information of the virtual robot, such as virtual The robot's identity data, blood volume data, position data, etc., and then determine the virtual robot's status data based on the acquired virtual robot's data information.

Optionally, the video output device of the computer is connected to the guide station.

FIG. 3 is a method flowchart of a video subtitle processing method in an embodiment of the present invention. It should be noted that the execution subject of the video subtitle processing method of this embodiment is the computer of the guidance system. As shown in FIG. 3, the video subtitle processing method according to an embodiment of the present invention may include the following steps:

Step S301: Obtain competitive data during the competitive game, the competitive data includes data sent by an external device;

In this step, the competition data may include offline data or online data. Among them, the competition data may include text, pictures, and/or videos.

In this embodiment, the data sent by the external device includes the real-time collected data of the referee system and/or the event system, and may also include data determined by analyzing the real-time collected data of the referee system and/or event system. Optionally, the competitive data is data obtained by analyzing the real-time collected data of the referee system by the referee system and/or based on the real-time collected data of the referee system, such as the status data of the opponent, and the data used to control the athletes of the opponent Data, data of commentators during competitive games. Optionally, the competition data is the competition rules determined by the competition system.

In this embodiment, the athletic data includes one or more of the status data of the opponent, the data of the athlete used to control the opponent, the data of the commentator during the athletic competition, and the data of the athletic rules. The athletic data may also be Including other data, not listed here.

Optionally, the status data of the competitive object may include one or more of the competitive object's identity data, the competitive object's number data, blood volume data, position data, competitive score data, life status data, and stunt trigger data. It is understood that the state data of the competitive object may also include other data information used to represent the state of the competitive object.

For example, the competitive object may include a robot in a real scene, and the referee system analyzes the collected data of the sensor device on the robot and/or the collected data of the field sensor device to determine the state data of the competitive object. For another example, the competitive object may include a robot in a virtual scene, and the referee system may determine the state data of the virtual robot based on the virtual robot data information directly obtained from the virtual competitive game server.

Optionally, the athlete data includes one or more of the athlete's identity data, the athlete's historical athletic record data, and the athlete's current athletic record data. The athlete data is not limited to the data types listed above , Can also include other data types.

Optionally, the data of the commentator includes the identity information of the commentator or others, such as the number of commentators in the current game.

Optionally, the competition rules data may include one or more of game time data, game round data, schedule data, match data, and statistical data during the competition of each round. Of course, the competition rules data may also include other data For information, you can choose the data type of the competition rules data according to your needs.

In some embodiments, as shown in FIG. 4, the athletic data may also include local data and/or computer input data. Optionally, the competition data includes one or more of local data, input data of a computer, and transmission data of an external device. It can be understood that the types of sports data are not limited to the data types listed in the above embodiments, but may include other data types.

Among them, the local data is data stored in the disk of the computer, and the local data is usually offline data.

The input data of the computer can be contact input data, such as the data input by the user through the keyboard, mouse, etc., or the data read by the computer and stored in the U disk and mobile hard disk inserted in the computer; the input of the computer The data can also be non-contact input data, such as the data obtained by the identification module of the computer based on the induction method (such as face recognition, voice recognition, etc.), the data obtained by the computer through the APP, etc.

In some embodiments, obtaining the competitive data during the competitive game may specifically include: receiving data sent by an external device, verifying the currently received data, and using the verified data as competitive data, and verifying the failed data It is determined to be invalid data to ensure the accuracy and safety of the data. When verifying the currently received data, specifically, if the data format of the currently received data satisfies the preset data structure, the currently received data is determined to be competitive data. If the data format of the currently received data does not satisfy the preset data structure, the currently received data is determined to be invalid data.

As a feasible implementation, after receiving the data sent by the external device, the computer analyzes and checks the currently received data to determine whether the currently received data meets the preset protobuf verification rules. The data meets the preset protobuf, the data format of the currently received data meets the preset data structure, and the currently received data is competitive data; if the currently received data does not meet the preset protobuf, the current receive The data format of the received data does not satisfy the preset data structure, and the currently received data is invalid data.

In some embodiments, after the competitive data during the competitive game is obtained, the competitive data is stored in a database, and the competitive data during the competitive game is stored in the database to facilitate subsequent calls.

Step S302: Rendering competitive data on the first preset subtitle template of the display area of the preset application to generate a filled signal screen (ie, RGB signal screen), the display area further includes a second preset subtitle template, and the second preset subtitle template is Fill the key signal picture corresponding to the signal picture (ie ALPHA signal picture);

Among them, the preset application may include a World Wide Web Web application, such as various browser applications, and the preset application may also be a desktop word, PPT, photo editor, and so on.

As a feasible implementation method, the preset application is the World Wide Web Web application. Relatively speaking, the Web application is easy to develop, and can support the display of text, pictures, videos and other content, and can implement user interactive operations and dynamics through the script language effect.

On the other hand, it is easier for web applications to achieve online acquisition of competitive data. For example, referee systems and/or event systems send data to computer web applications through network communication protocols such as Hypertext Transfer Protocol HTTP (HyperText Transfer Protocol). On-line loading of competitive data, real-time transmission of competitive data is strong.

The resolution of the filled signal screen and the resolution of the key signal screen may be equal or different. When the resolution of the fill signal picture and the key signal picture are not equal, after the fill signal picture and the key signal picture are combined into the video stream to be displayed, the new video stream obtained will have subtitle redundancy or missing subtitles And other subtitle effects. To avoid redundant subtitles or missing subtitles, in this embodiment, the resolution of the fill signal picture and the resolution of the key signal picture are equal.

Optionally, the resolution of the display area is twice the resolution of the filled signal picture or the resolution of the key signal picture. For example, in some of these embodiments, as shown in FIG. 5, the width of the resolution of the display area is twice the width of the resolution of the fill signal screen or the key signal screen. In other embodiments, the height of the resolution of the display area is twice the height of the resolution of the filled signal picture or the key signal picture.

As a feasible implementation, the resolution of the filled signal screen and the resolution of the key signal screen can be equal to the resolution of the display screen of the computer after being scaled by a preset ratio, for example, the display area is a Web page. Optionally, the display area is designed in advance. After opening the Web application, the Web page is directly twice the resolution of the display screen. Optionally, the display area is obtained by stretching a web page with a resolution equal to the resolution of the display screen of the computer based on the World Wide Web Web application, and the resolution of the stretched web page is that of the display screen of the computer The resolution is twice as large. Optionally, based on the World Wide Web Web application, the width of a Web page with a resolution equal to that of the display screen of the computer is stretched to twice the width of the display screen of the computer to obtain the stretched Web page. Optionally, based on the World Wide Web Web application, the height of a Web page with a resolution equal to that of the display screen of the computer is stretched to twice the height of the display screen of the computer to obtain the stretched Web page.

Optionally, there is no menu bar and/or no virtual button on the display area of the preset application, to avoid occlusion of the display area caused by the menu bar and/or virtual button.

In this embodiment, the first preset subtitle template may include subtitle display information such as a subtitle display position and/or subtitle display content. The subtitle display position refers to the position where the subtitles are displayed in the new video stream. Referring to FIG. 5, the subtitles are displayed in the areas A and B of the new video stream. The subtitle display content refers to the subtitle information displayed in the new video stream, such as text, patterns, colors, shapes and other static information.

The second preset template is used to indicate the transparency effect of each pixel in the fill picture in the new video stream. Specifically, the transparency effect of each pixel in the fill signal picture in the new video stream is based on the correspondence in the key signal picture. The brightness of the location pixel is determined.

In this embodiment, the area of the first preset subtitle template corresponds to the area of the second preset subtitle template. For example, in FIG. 5, the areas A, B, and C of the first preset subtitle template require the assistance of the second preset subtitle template and have a special effect, then the area A of the first preset subtitle template and the second preset The position and size of the area A'of the subtitle template are the same, the area B of the first preset subtitle template and the position B of the second preset subtitle template are the same, the area C of the first preset subtitle template and the second pre Let the position and size of C'of the subtitle template be the same. Correspondingly, the area of the new video stream corresponds to the area of the first preset subtitle template, and the manner in which the area of the new video stream and the area of the first preset subtitle template correspond to the area and the area of the first preset subtitle template The corresponding manner of the area of the second preset subtitle template is similar, and will not be repeated here.

Specifically, the brightness of each pixel in the key signal screen can be designed according to needs, so that the subtitles in different areas of the new video stream have different transparency effects. Optionally, the brightness of each pixel in the key signal screen is based on the subtitle display position of the subtitle template of the first preset template (that is, the display position of the competition data), and/or the subtitle display content, and/or the preset and competition The subtitle effect corresponding to the data is determined. As shown in FIG. 5, the first preset subtitle template includes an area A, an area B, and an area C. Finally, a portion corresponding to the area A in the new video stream and a portion corresponding to the area B in the new video stream need to be displayed transparently. The part of the new video stream corresponding to the region C is non-transparent, and the transparency of the part of the new video stream corresponding to the region A is higher than the transparency of the part of the new video stream corresponding to the region B. The brightness of each pixel in the area A', area B'and area C'in the screen is designed. Specifically, the greater the brightness of each pixel in the key signal screen, the fill signal screen corresponds to the pixel in the new video stream The greater the transparency of the location.

Optionally, the brightness of each pixel in the display position of the same competitive data in the key signal screen is the same. As a feasible implementation manner, referring to FIG. 5, the first preset subtitle template includes the display positions of three competitive data in area A, area B, and area C, and the brightness of each pixel in area A′ of the key signal screen is set to In the first brightness, the brightness of each pixel in the area B'of the key signal screen is set to the second brightness, and the brightness of each pixel in the area C'in the key signal screen is set to the third brightness. Finally, the transparency of the filled signal picture in the new video stream corresponding to the area A of each pixel is the same, and the transparency of the filled signal picture in the new video stream corresponding to the area B of each pixel is the same. The transparency of each pixel in the part corresponding to the region C in the video stream is also the same.

In some examples, the first brightness, the second brightness, and the third brightness are different. For example, if the first brightness is 0, the second brightness is 50, and the third brightness is 255, the filled signal picture corresponds to the new video stream. The transparency of each pixel in the part of area A is the largest and completely transparent; the transparency of each pixel in the part of area C corresponding to area C in the new video stream is the smallest and opaque; the signal of the fill signal is new in the new video stream The transparency of each pixel in the part corresponding to area B in is between completely transparent and opaque.

In other examples, the first brightness, the second brightness, and the third brightness are partially or completely the same.

Optionally, the brightness of each pixel of the display position of the same competitive data in the key signal picture is at least partially different, so that the filled signal picture can present different transparency effects at the corresponding position of the new video stream. As a feasible implementation manner, referring to FIG. 6, filling the area D in the signal picture corresponds to the area D′ in the key signal picture, it is necessary to fill the transparency gradient effect of the part of the signal picture in the corresponding area D of the new video stream, such as transparency From left to right (in the direction of the arrow in FIG. 6), the brightness of each pixel of the area D'in the key signal screen can be set to a gradually decreasing trend from left to right, and the fill signal can be achieved The transparency of the part of the picture corresponding to the area D in the new video stream is gradually increasing.

Normally, the position of some pixels filled in the signal screen can be set as the display position of the competitive data, and the brightness of each pixel in the position corresponding to the display position of the competitive data in the key signal screen can be set to make the new The area picture corresponding to the display position of the competitive data in the video stream is covered by the competitive data.

In some embodiments, the entire fill signal picture can be set as the display position of the competitive data, and by setting the brightness of each pixel of the entire area of the key signal picture, the video stream picture to be displayed is completely covered, so that the new Of the video stream becomes hazy.

In this embodiment, the first preset subtitle template and/or the second preset template can be dynamically adjusted according to one or more of the competition data, local data, and computer input data, so that a new video stream is generated Different subtitle effects.

As a feasible implementation manner, referring to FIG. 7, the real-time dynamic adjustment process of the first preset subtitle template and the second preset template may include the following steps:

Step S701: Determine the preset caption effect corresponding to the competitive data;

As described in the above embodiment, the subtitle display content is static information. However, unlike the subtitle display content, the subtitle effect in this step may include static information, and may also include dynamic information (such as the change process of the subtitle shape).

In this embodiment, the subtitle effect may include one or more of animation effects, display effects, and hidden effects. Among them, the animation effects may include gradient, fly in, fly out, blinds, bounce, zoom in, zoom out, etc.

Display effects can include gradients, fly-in, fly-out, blinds, bounces, the transparency of the sports data at the specified position in the new video stream gradually increases along a specific direction or the transparency gradually decreases along a specific direction, etc., different sports data displays The duration of the competition, the location of the competition data, and the shape of the competition data.

It should be noted that the display effects include animation effects and other data information used to indicate changes in subtitles. For example, in a specific implementation, competitive data 1 needs to be synthesized in the upper left corner of the new video stream in a fly-in manner and move from left to right to the upper right corner of the new video stream at a preset speed within 1 s. And, at 0.5s, the data format of the competitive data 1 is switched from "Song" to "Kai". In this implementation, the animation effect includes flying in, and the display effect includes flying in, and the competitive data 1 starts from a new video. The upper left corner of the stream is moved to the upper right corner of the new video stream and the data format of competitive data 1 is switched from "Song" to "Kai". It can be seen that the display effect in this implementation is richer than the animation effect.

Hidden effects of competitive data may include hidden effects such as mosaic overlays and picture overlays.

Optionally, the subtitle effects corresponding to different sports data can be selected according to needs, for example, sports data 1 corresponds to the animation effect of flying in, and sports data 2 corresponds to the animation effect of blinds. Optionally, the subtitle effects corresponding to different subtitle display positions can be fixed. As shown in FIG. 5, the subtitle effect in area A is flying in, and the subtitle effect in area B is bounce. Optionally, the subtitle effects corresponding to different subtitle display positions change with time and/or subtitle display content, for example, the subtitle effect of area A at the first moment is flying in, the subtitle effect at the second moment is flying out, and the third The subtitle effect at the moment is blinds and so on.

Step S702: Adjust the display information of the content in the first preset subtitle template and/or the second preset subtitle template according to the subtitle effect, so that a subtitle effect is generated in the new video stream.

In this step, the adjusted display information may include a change in the display position of the competitive data, a change in the shape of the competitive data, and/or a duration for displaying the competitive data, and so on.

In a specific implementation, a countdown display of competitive games is required, for example, "5", "4", "3", "2", "1", and "0" are displayed in sequence in the center area of the new video stream , The duration of each number display is 1s, each number in the center area of the new video stream is gradually reduced by the preset size (the preset size is determined according to the size of the center area) until it disappears, and each number is in the new The transparency of each video stream is different, you can load the numbers "5", "4", "3", "2", "1" and "0" in the center area of the first preset subtitle template, and Adjust the duration of the first preset template display number "5", "4", "3", "2", "1" and "0" are 1s, at the same time, adjust the center area display of the first preset template The animation effect of the numbers "5", "4", "3", "2", "1", and "0" is "gradual reduction from the preset size until disappearance". At the same time, the brightness of each pixel in the center area of the second preset template is adjusted to the brightness corresponding to the transparency required when displaying each number.

In another specific implementation manner, the competitive game includes a red team and a blue team. The red team and the blue team include three infantry robots, one hero, one engineering robot, and one drone. The competitive game includes multiple tasks. Each robot can perform the corresponding task and attack the other robot. The team that completes all tasks first wins. During the competition, the data of the red team needs to be displayed on the left side of the video screen of the competitive game, the data of the blue team is displayed on the right side of the video screen of the competitive game, and the process of the competitive game is displayed in the central area of the video screen of the competitive game Confrontation data, game time statistics, and scores of both parties.

Referring to FIG. 8A, it is necessary to display the team information of the red team and the current operation information of the red team in the area 1 of the video screen of the competitive game, and display the identity information of the competitive objects of the red team in the area 11, such as 111 for displaying the red The identity information of one of the infantry robots of the Fang team, 112 is used to display the identity information of the hero of the Red team, 113 is used to display the identity information of the engineering robot of the Red team. Waiting, the red is displayed in the area 12 of the competitive game video screen The video stream of the competitive players of the Fang team displays the identity information of the competitive object currently performing the task of the red team, the weapon information of the performing task, etc. in the area 13 of the video screen of the competitive game. In addition, it is necessary to display the team information of the blue team and the current operation information of the blue team in the area 2 of the competitive game video screen, and display the identity information of the blue team’s competitive objects in the area 21, such as 211 for displaying the blue team The identity information of one of the infantry robots, 212 is used to display the identity information of the blue team’s heroes, 213 is used to display the identity information of the blue team’s engineering robots, and the blue team is displayed in the area 22 of the competitive game video screen. The video stream of the competitive player of the player displays the identity information of the competitive object currently performing the task of the red team, the weapon information of the performing task, etc. in the area 23 of the video screen of the competitive game. Show the game time statistics and the scores of both parties in the area 3 of the competitive game video screen, and display the special effects of the confrontation data during the competition game in the area 4 of the competitive game video screen (when the team completes any task, successfully attacks the opponent, etc.) , The special effect corresponding to the currently completed task needs to be displayed in the area 4, and the presentation mode of the special effect is preset), and the text data of the confrontation data during the competitive game is displayed in the area 4 of the competitive game video screen, of which the area 3 Corresponding to the area 4, for example, the area 4 displays "Blue small energy mechanism is activated, the team's attack power *1.5", then the special effects displayed in the area 3 can be shown in Figure 8A.

In this implementation, when one of the teams completes any task, successfully attacks the opponent, etc., the entire fill signal screen can be set to the display position of the competitive data, and the brightness of each pixel in the entire area of the key signal screen can be set by , To cover all the video stream pictures to be displayed, so that the new video stream pictures become hazy.

It can be understood that the competitive data displayed in each area in the video screen of the competitive game may include text, pictures, and/or video streams.

As a feasible implementation method, as shown in FIG. 8B, it is necessary to display the flying competition data in the area E of the new video streaming screen, and the animation display effect of the area E displaying the competition data in the first preset subtitle template can be set A fly-in, so that the area E in the new video stream displays the competitive data through the fly-in.

As another feasible implementation method, as shown in FIG. 8B, the area F of the new video stream screen needs to display the gradually increasing transparency of the competition data in the direction of the arrow shown in FIG. 8B, and the second preset The brightness of each pixel in the position of the corresponding area F in the subtitle template is set to gradually increase in the direction of the arrow as shown in FIG. 8B, so that the transparency of the athletic data displayed in the area F in the new video stream is as shown in FIG. 8B The direction of the arrow shows gradually increasing.

Step S303: Transmit the fill signal picture to the guide station, and transmit the key signal picture to the guide station, so that the guide station synthesizes the video stream to be displayed according to the fill signal picture and the key signal picture and obtains a new video stream.

The guide station of this embodiment includes a shooting device, which is used to obtain a video stream to be displayed. For example, for competitive games, the shooting device is used for shooting competitive games videos. Optionally, the video stream to be displayed includes one or more of a confrontation video stream of an opponent, a video stream of an athlete, a video stream of a commentator, and a video stream of an audience during a competitive game, and may include other videos. flow.

In this embodiment, the video output device of the computer is connected to the guide station, for example, the video output device of the computer and the guide station are connected by a signal line. When step S303 is executed, specifically, the computer-based video output device transmits the fill signal picture to the guide station and the key signal picture to the guide station. Compared with the captioning machine, the general equipment of the common computing system is used, and the development cost is low.

Among them, the video output device may include a graphics card or a non-editing card. In some embodiments, the computer projects the fill signal screen and the key signal screen in step S202 to the guide station through the computer's graphics card to achieve the purpose of real-time transmission of the fill signal screen and the key signal screen. In other embodiments, the computer transmits the fill signal screen and the key signal screen in step S302 to the guide station through the non-editing card of the computer, so as to realize the purpose of real-time transmission of the fill signal screen and the key signal screen.

Further, in some embodiments, referring to FIG. 9, after the computer acquires competitive data during the competitive game, the method further includes:

Step S901: call a preset instruction corresponding to the athletic data;

Step S902: Broadcast a preset instruction.

It should be noted that in the embodiment of the present invention, the broadcast preset instruction refers to that the computer directly informs the guide station, the third-party website, and the third-party device of the preset instruction. The guide station and the third-party website (that is, the webcast in FIG. 10 (System) After obtaining the preset instruction, perform the corresponding operation according to the preset instruction.

In some embodiments, the preset instructions may include one or more of audio playback instructions, network interface calling instructions, and guide station instructions. Of course, the preset commands are not limited to the above listed ones, but may also include others, such as light display commands. It should be noted that the network interface call instruction is mainly directed to a third-party website, and the network interface call instruction can trigger the guide station to push a new video stream to the cloud, so that the third-party website can obtain the new video stream from the cloud and play it, or , The network interface call instruction instructs the third-party website to access the computer of the guidance system, and directly receives the broadcast message generated by the computer, to ensure that the third-party website broadcasts real-time event data during the live video streaming process. In this embodiment, after the guide station obtains a new video stream, it can display the new video stream through a live screen (such as a competitive game scene), or push the new video stream to the cloud through a video push streaming server, and then The third-party website plays the new video stream obtained from the cloud.

For example, when a competitive object (such as a robot) bleeds, a first specific sound effect needs to be played in a new video stream. The computer can call and broadcast the first sound effect playback instruction corresponding to the blood loss data of the competitive object, and the broadcast message can be Directly transmitted to the on-site audio playback device or third-party website. After receiving the broadcast message, the on-site audio playback device or third-party website will directly play with the first specific sound effect. When the competitive object dies, the second specific sound effect needs to be played in the new video stream. The computer can call and broadcast a second audio effect playback instruction corresponding to the death state of the competitive object and broadcast it. The broadcast message can be directly transmitted to the live After receiving the broadcast message, the audio playback device (that is, the audio playback device at the game site) or a third-party website will directly play the specific sound effect.

When a competitive object appears in a state of death and life, the guide station needs to switch the display scene of the video stream to be displayed, such as replaying a part of the video screen of the competitive object currently in the state of death in the current competitive game, or appearing to the competitive object The screen of the life-death state is enlarged, and the computer can call a guide station instruction for instructing the guide station to switch the display scene of the video stream to be displayed and broadcast to the guide station to instruct the guide station to switch the display scene of the video stream to be displayed.

When the competition object defeats the opponent's competition object and needs to control the lighting of the competition site to be all bright, the computer can call the light display instruction and broadcast, the broadcast message is directly transmitted to the scene lighting control module, and the scene lighting control module receives the After broadcasting the message, the scene lights will be controlled to be all bright.

The computer can trigger the third-party website to directly execute the event corresponding to the preset instruction by broadcasting the preset instruction, such as the audio effect playback corresponding to the audio playback instruction, so that the third-party website can play the sound effect in time, ensuring that the third-party website broadcasts a new video stream The release of real-time event data during the process.

When step S901 is executed, specifically, the computer receives the preset event signal corresponding to the competitive data, and calls the preset instruction corresponding to the preset event signal.

Wherein, the generation of the preset event signal may include one or more of generation based on input data of the computer, generation based on local control data, and generation based on control data sent by an external device. Optionally, the preset event signal is an audio playback indication signal, a network interface call indication signal or a guide station indication signal, etc.

Optionally, the video stream to be displayed is a video stream during a competitive game, and the control data includes competitive data. Among them, the local control data is the local pre-stored athletic data of the computer, and the control data sent by the external device is the athletic data during the athletic competition process sent by the external device, and the athletic data may include the quantity data, blood volume data, and location of the athletic objects One or more of data, competitive score data, life status data, etc.

As a feasible implementation, the preset event signal is a guide station instruction signal generated based on the local input data of the computer. For example, when the computer keyboard Ctrl key + Enter button is pressed at the same time, the computer generates a guide station to be displayed The guide signal indicating the scene switching of the video stream. Of course, the guide station indication signal may also be generated based on local control data and/or based on control data sent by an external device.

As another feasible implementation method, the preset event signal is a network interface call instruction signal generated based on the local control data of the computer. For example, the sound effect data corresponding to the blood loss data of the competitive object is pre-stored locally, and the computer determines the blood loss of the competitive object After that, a network interface call instruction instruction for instructing a third-party website to play the sound effect data corresponding to the bleeding data of the competitive object is generated. Of course, the network interface call instruction signal can also be generated based on the input data of the computer and/or based on the control data sent by the external device.

As another feasible implementation manner, the preset event signal is an audio playback instruction signal generated based on control data sent by an external device. For example, when the computer receives the death state of the competitive object, the computer generates an instruction to play specific audio data. Audio playback indicator. Of course, the audio playback instruction signal can also be generated based on local control data and/or based on computer input data.

The caption processing method of the competitive game video according to the embodiment of the present invention can realize the online loading of the competitive data during the competitive game by using a preset application on the computer to realize the filling of the signal picture and the key signal picture, without the need to purchase a dedicated caption machine. Reduced hardware cost, and by virtue of the flexibility of preset applications, the subtitle processing is highly automated, real-time, free, and has a wide range of applications. The accuracy of subtitle loading is high, which meets the needs of competitive OB systems; , The first preset subtitle template and the second preset subtitle template are designed in the same display area of the preset application, and the fill signal screen and the key signal screen can be rendered at the same time to ensure the simultaneous rendering requirements of the two screens; After the computer renders the fill signal picture and the key signal picture, the guide station adopts the back-synthesis technology to synthesize the fill signal picture and the key signal picture into the video stream to be displayed to meet the data display requirements of the actual competitive game, so that the obtained Video subtitles meet broadcast-level requirements.

A person of ordinary skill in the art may understand that all or part of the process in the method of the foregoing embodiments may be completed by instructing relevant hardware through a computer program, and the program may be stored in a computer-readable storage medium. During execution, the process of the above embodiments of the method may be included. Wherein, the storage medium may be a magnetic disk, an optical disk, a read-only memory (Read-Only Memory, ROM) or a random access memory (Random Access Memory, RAM), etc.

The above disclosure is only part of the embodiments of the present invention, and of course it cannot be used to limit the scope of the present invention. Therefore, equivalent changes made according to the claims of the present invention still fall within the scope of the present invention.

Claims

A method for processing subtitles in competitive games, characterized in that the method includes:

Obtain competitive data during the competitive game, the competitive data includes data sent by an external device;

Rendering the competitive data on a first preset subtitle template of a display area of a preset application to generate a fill signal picture, the display area further includes a second preset subtitle template, and the second preset subtitle template is the fill Key signal screen corresponding to the signal screen;

Transmitting the fill signal picture to the guide station, and transmitting the key signal picture to the guide station, so that the guide station synthesizes the video stream to be displayed according to the fill signal picture and the key signal picture And get a new video stream.
The method according to claim 1, wherein the competition data further includes local data and/or input data of the computer.
The method according to claim 1, wherein the external device includes a referee system for determining the competitive result of the competitive object during the competitive game and/or for determining the competitive rules during the competitive game Event system.
The method according to claim 3, wherein the transmission data of the external device is determined by the external device according to real-time collected data analysis.
The method according to claim 4, wherein the competitive object includes a robot in a real scene, and the referee system is in communication with a plurality of the robots and is connected to the venue of the competitive venue where the robot is located Device communication connection;

The collected data includes collected data of a sensing device on the robot and/or collected data of the field sensing device.
The method according to claim 3, wherein the preset application includes a World Wide Web application, and the sending data of the referee system and/or the event system is sent through a network communication protocol.
The method according to claim 6, wherein the sending data of the referee system and/or the competition system is sent by a hypertext transfer protocol HTTP.
The method according to claim 6, wherein the obtaining competitive data during a competitive game includes:

Receiving data sent by the external device;

If the data format of the currently received data satisfies the preset data structure, the currently received data is determined to be the competitive data.
The method according to claim 8, wherein after the receiving the data sent by the external device, the method further comprises:

If the data format of the currently received data does not satisfy the preset data structure, the currently received data is determined to be invalid data.
The method according to claim 1, wherein the transparency effect of each pixel in the filled signal picture in the new video stream is determined according to the brightness of the pixel at the corresponding position in the key signal picture.
The method according to claim 1, wherein the first preset subtitle template and/or the second preset template are based on one of the competitive data, local data, and input data of a computer or Various real-time dynamic adjustments.
The method according to claim 11, wherein the first preset subtitle template includes a subtitle display position and/or a subtitle display content.
The method according to claim 11, wherein the real-time dynamic adjustment process of the first preset subtitle template and the second preset template includes:

Determine the preset subtitle effect corresponding to the competitive data;

According to the subtitle effect, adjust the display information of the content in the first preset subtitle template and/or the second preset subtitle template, so that the subtitle effect is generated in the new video stream.
The method according to claim 13, wherein the subtitle effect includes one or more of an animation effect, a display effect, and a hidden effect.
The method according to claim 14, wherein the athletic data includes status data of the antagonistic object, data of athletes for controlling the antagonistic object, data of commentators during the athletic competition, athletic rules One or more of the data;

The video stream to be displayed includes one or more of a confrontation video stream of the opponent object, a video stream of the competitive player, a video stream of the commentator, and a video stream of the audience during the competitive game.
The method according to claim 15, wherein the state data of the competitive object includes identity data of the competitive object, data of the number of the competitive object, blood volume data, position data, competitive score data, and life status One or more of data and trick trigger data; and/or

The data of the competitive player includes one or more of identity data of the competitive player, historical competitive record data of the competitive player, and current competitive record data of the competitive player; and/or

The commentator's data includes the commentator's identity information; and/or

The competition rule data includes one or more of game time data, game round number data, schedule data, match data, and statistical data during the game of each round.
The method according to claim 1, wherein the resolution of the filling signal picture and the resolution of the key signal picture are equal.
The method according to claim 17, wherein the width of the resolution of the display area is twice the width of the resolution of the fill signal picture or the key signal picture.
The method according to claim 17, wherein the height of the resolution of the display area is twice the height of the resolution of the fill signal picture or the key signal picture.
The method according to claim 1, wherein there is no menu bar and/or no virtual button on the display area of the preset application.
The method according to claim 1, wherein the transmission of the fill signal picture to the guide station and the transmission of the key signal picture to the guide station include:

A computer-based video output device transmits the fill signal picture to the guide station, and transmits the key signal picture to the guide station.
The method according to claim 21, wherein the video output device comprises a graphics card or a non-editing card.
The method according to claim 1, wherein after acquiring the athletic data during the athletic competition, the method further comprises:

Call a preset instruction corresponding to the athletic data;

Broadcast the preset instruction.
The method according to claim 23, wherein the invoking the preset instruction corresponding to the athletic data includes:

Receiving a preset event signal corresponding to the competitive data;

Calling a preset instruction corresponding to the preset event signal.
The method according to claim 24, wherein the generation of the preset event signal includes one or more of computer-based input data generation, local control data generation, and control data generation sent by an external device. Species.
The method of claim 25, wherein the control data includes the competitive data.
The method according to claim 23, wherein the preset instruction includes one or more of an audio playback instruction, a network interface calling instruction, and a guide station instruction.
The method according to claim 1, wherein after acquiring the athletic data during the athletic competition, the method further comprises:

Store the athletic data into the database.
A guide system for competitive games, characterized in that the guide system includes: an external device, a computer, and a guide station, the external device and the computer implement a communication connection based on a network, and the computer and the guide station are in communication connection ;

Wherein, the computer is used to obtain competitive data during the competitive game, the competitive data includes data sent by the external device; and render the competitive data on the first preset subtitle template in the display area of the preset application Generating a fill signal picture, the display area further includes a second preset subtitle template, and the second preset subtitle template is a key signal picture corresponding to the fill signal picture;

The computer is also used to transmit the fill signal picture to the guide station and the key signal picture to the guide station; the guide station according to the fill signal picture and the key signal picture to be displayed The video stream is synthesized and a new video stream is obtained.
The guide system according to claim 29, wherein the competition data further includes local data and/or input data of the computer.
The guide system according to claim 29, wherein the external device includes a referee system for determining a competitive result of a competitive object during the competitive game and/or for determining a competitive rule during the competitive game Event system.
The guidance system of claim 31, wherein the transmission data of the external device is determined by the external device based on real-time collected data analysis.
The guide system according to claim 32, wherein the competitive object includes a robot in a real scene, and the referee system is in communication connection with a plurality of the robots and communicates with the venue of the competitive venue where the robot is located Sense device communication connection;

The collected data includes collected data of a sensing device on the robot and/or collected data of the field sensing device.
The guide system according to claim 31, wherein the preset application includes a World Wide Web application, and the sending data of the referee system and/or the event system is sent through a network communication protocol.
The guide system according to claim 34, characterized in that the sending data of the referee system and/or the competition system is sent through the hypertext transfer protocol HTTP.
The guide system according to claim 34, wherein the computer is specifically configured to: receive data sent by the external device; if the data format of the currently received data satisfies a preset data structure, then convert the The currently received data is determined to be the competition data.
The guide system according to claim 36, wherein after the computer receives the data sent by the external device, if it is determined that the data format of the currently received data does not satisfy the preset data structure, then the computer The currently received data is determined to be invalid data.
The guide system according to claim 29, wherein the transparency effect of each pixel in the filled signal picture in the new video stream is determined according to the brightness of the pixel at the corresponding position in the key signal picture .
The guide system according to claim 29, wherein the first preset subtitle template and/or the second preset template is one of the competition data, the local data, and the input data of the computer Or multiple real-time dynamic adjustments.
The guide system according to claim 39, wherein the first preset subtitle template includes a subtitle display position and/or a subtitle display content.
The guide system according to claim 39, wherein the real-time dynamic adjustment process of the first preset subtitle template and the second preset template by the computer includes:

Determine the preset subtitle effect corresponding to the competitive data;

According to the subtitle effect, adjust the display information of the content in the first preset subtitle template and/or the second preset subtitle template, so that the subtitle effect is generated in the new video stream.
The guide system according to claim 41, wherein the subtitle effect includes one or more of an animation effect, a display effect, and a hidden effect.
The guide system according to claim 42, wherein the competition data includes status data of the rival object, data of a competitive player for controlling the rival object, data of commentators during the competition, competition One or more of the rule data;

The video stream to be displayed includes one or more of a confrontation video stream of the opponent object, a video stream of the competitive player, a video stream of the commentator, and a video stream of the audience during the competitive game.
The guide system according to claim 43, wherein the state data of the competitive object includes identity data of the competitive object, data of the number of the competitive object, blood volume data, position data, competitive score data, life One or more of status data and trick trigger data; and/or

The data of the competitive player includes one or more of identity data of the competitive player, historical competitive record data of the competitive player, and current competitive record data of the competitive player; and/or

The commentator's data includes the commentator's identity information; and/or

The competition rule data includes one or more of game time data, game round number data, schedule data, match data, and statistical data during the game of each round.
The guide system according to claim 29, wherein the resolution of the filling signal picture and the resolution of the key signal picture are equal.
The guide system according to claim 45, wherein the width of the resolution of the display area is twice the width of the resolution of the fill signal screen or the key signal screen.
The guide system according to claim 45, wherein the height of the resolution of the display area is twice the height of the resolution of the fill signal picture or the key signal picture.
The guide system according to claim 29, wherein the preset application has no menu bar and/or no virtual buttons on the display area.
The guidance system of claim 29, wherein the computer includes a video output device, and the video device communicates with the guidance station; the video output device transmits the fill signal picture to the guidance station, and The key signal picture is transmitted to the guide station.
The guide system according to claim 49, wherein the video output device includes a graphics card or a non-editing card.
The guide system according to claim 29, characterized in that, after acquiring the athletic data during the athletic competition, the computer is further used to: call a preset instruction corresponding to the athletic data and broadcast the pre Set instructions.
The guide system according to claim 51, wherein the computer is specifically configured to: receive a preset event signal corresponding to the competitive data and call a preset instruction corresponding to the preset event signal .
The guide system according to claim 52, wherein the generation of the preset event signal includes one of generation based on computer input data, generation based on local control data, and generation based on control data sent by an external device or Multiple.
The guide system according to claim 53, wherein the control data includes the competition data.
The guidance system according to claim 51, wherein the preset instructions include one or more of audio playback instructions, network interface calling instructions, and guidance station instructions.
The guide system according to claim 29, wherein the computer is further used to store the competition data into a database after acquiring the competition data during the competition.