WO2020133371A1 - Procédé de traitement de sous-titres de vidéo de compétition et système de guidage de diffusion - Google Patents

Procédé de traitement de sous-titres de vidéo de compétition et système de guidage de diffusion Download PDF

Info

Publication number
WO2020133371A1
WO2020133371A1 PCT/CN2018/125395 CN2018125395W WO2020133371A1 WO 2020133371 A1 WO2020133371 A1 WO 2020133371A1 CN 2018125395 W CN2018125395 W CN 2018125395W WO 2020133371 A1 WO2020133371 A1 WO 2020133371A1
Authority
WO
WIPO (PCT)
Prior art keywords
data
competitive
preset
subtitle
video stream
Prior art date
Application number
PCT/CN2018/125395
Other languages
English (en)
Chinese (zh)
Inventor
陈庭欣
陈贤雨
Original Assignee
深圳市大疆创新科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳市大疆创新科技有限公司 filed Critical 深圳市大疆创新科技有限公司
Priority to CN201880041352.8A priority Critical patent/CN110800310A/zh
Priority to PCT/CN2018/125395 priority patent/WO2020133371A1/fr
Publication of WO2020133371A1 publication Critical patent/WO2020133371A1/fr

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/488—Data services, e.g. news ticker
    • H04N21/4884—Data services, e.g. news ticker for displaying subtitles
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21—Server components or server architectures
    • H04N21/218—Source of audio or video content, e.g. local disk arrays
    • H04N21/2187—Live feed
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
    • H04N21/23424—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving splicing one content stream with another content stream, e.g. for inserting or substituting an advertisement
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81—Monomedia components thereof
    • H04N21/8126—Monomedia components thereof involving additional data, e.g. news, sports, stocks, weather forecasts
    • H04N21/8133—Monomedia components thereof involving additional data, e.g. news, sports, stocks, weather forecasts specifically related to the content, e.g. biography of the actors in a movie, detailed information about an article seen in a video program
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/278—Subtitling

Definitions

  • the invention relates to the field of video subtitle processing, in particular to a caption processing method and guide system for competitive game videos.
  • the key information of the event is often presented on the screen.
  • the information is usually produced and played by the staff using a caption machine.
  • the staff usually creates a subtitle template in advance, then fills in the corresponding information content to generate a subtitle file, and the subtitle machine plays the subtitle file at the corresponding time.
  • the caption machine and the guide station establish a communication connection based on the video signal transmission interface.
  • the caption machine outputs the subtitle filling signal and the key signal to the guide station, and the guide station uses the back-synthesis technology to synthesize the overlay effect of the text and subtitles in real time.
  • Subtitle files are produced offline, and most subtitle machines cannot accept network data and modify subtitle content in real time, which has the disadvantage of poor real-time performance and cannot meet the real-time requirements of the OB (third-party perspective) system of competitive games.
  • the subtitle file is generated from the subtitle template filling data, but the subtitle template carries a very small amount of data, cannot perform complex data logic, and cannot meet the complex display logic of competitive games.
  • captioning machines usually require special captioning software and captioning hardware cards, and the hardware cost is relatively high.
  • the captioning software and captioning hardware cards of different manufacturers have not formed a unified standard and are closed-source. High development costs.
  • the e-sports OB system in order to present the event information, allow third parties to join the game and obtain real-time status information of the two parties, such as small maps, blood volume, achievements, etc., which greatly facilitates the audience to understand the progress of the event.
  • the pictures and character data of the e-sports OB system are generated in the e-sports system, which allows the e-sports OB system to flexibly render and display the pictures of the two players.
  • the data of the pictures and characters come from different systems.
  • the live pictures are taken by cameras.
  • the state and data of the sports objects on the field need to be collected and processed by a specific system.
  • the e-sports OB system can not meet the needs of the display of real sports competition data and the synthesis and superposition of the live pictures.
  • the invention provides a video subtitle processing method and a guide system.
  • a caption processing method for competitive game videos including:
  • the competitive data includes data sent by an external device
  • the display area further includes a second preset subtitle template, and the second preset subtitle template is the fill Key signal screen corresponding to the signal screen;
  • a guide system for a competitive game includes: an external device, a computer, and a guide station.
  • the external device and the computer implement a communication connection based on a network, and the computer and all Describe the communication connection of the guide station;
  • the computer is used to obtain competitive data during the competitive game
  • the competitive data includes data sent by the external device; and render the competitive data on the first preset subtitle template in the display area of the preset application Generating a fill signal picture
  • the display area further includes a second preset subtitle template
  • the second preset subtitle template is a key signal picture corresponding to the fill signal picture
  • the computer is also used to transmit the fill signal picture to the guide station and the key signal picture to the guide station; the guide station according to the fill signal picture and the key signal picture to be displayed
  • the video stream is synthesized and a new video stream is obtained.
  • the subtitle processing has high automation, strong real-time, high degree of freedom, wide application range, high accuracy of subtitle loading, and meets the needs of competitive OB systems; at the same time, The first preset subtitle template and the second preset subtitle template are designed in the same display area of the preset application, and the fill signal screen and the key signal screen can be rendered at the same time to ensure the simultaneous rendering requirements of the two pages; in addition, the computer rendering After obtaining the fill signal screen and the key signal screen, the guide station uses the back-off synthesis technology to synthesize the fill signal screen and the key signal screen into the video stream to be displayed to meet the data display requirements of the actual competitive game and make the obtained video subtitles Meet broadcast-level requirements.
  • FIG. 1 is a structural block diagram of a guide system in an embodiment of the present invention.
  • FIG. 2 is a block diagram of a specific structure of a guide system in an embodiment of the present invention.
  • FIG. 3 is a method flowchart of a video subtitle processing method in an embodiment of the present invention.
  • FIG. 4 is a block diagram of a specific structure of a guide system in an embodiment of the present invention.
  • FIG. 5 is a display diagram of a fill signal screen and a key signal screen in an embodiment of the invention.
  • FIG. 6 is another display diagram of the fill signal screen and the key signal screen in an embodiment of the invention.
  • FIG. 7 is a flowchart of a specific method of a video subtitle processing method according to an embodiment of the present invention.
  • 8A is a diagram of a new video stream picture obtained by synthesizing a fill signal picture and a key signal picture into a video stream to be displayed in a specific embodiment of the present invention
  • 8B is a diagram of a new video stream screen obtained by synthesizing a fill signal screen and a key signal screen into a video stream to be displayed in another specific embodiment of the present invention.
  • FIG. 9 is a flowchart of another specific method of a video subtitle processing method according to an embodiment of the present invention.
  • FIG. 10 is a block diagram of another specific structure of a guide system in an embodiment of the present invention.
  • caption templates In the traditional captioning machine, staff make caption templates in advance, and then fill the caption templates with corresponding signal content to generate caption filling signal pictures and key signal pictures, and then send them to the guide station for synthesis with the video stream to be displayed.
  • the production of caption templates for traditional caption machines and the filling of corresponding signal content on the caption templates are usually based on the offline mode, which has the disadvantages of low freedom and low real-time performance of the caption machines.
  • the amount of game data In competitive games, the amount of game data is usually large, and the update is relatively fast. It is difficult for traditional captioning machines to meet the real-time data presentation requirements of competitive games.
  • the traditional e-sports OB system can only receive subtitle data and video streams from the same system, and then directly output the combined picture of the subtitles and video streams of a specific e-sports game.
  • the data of video streams and competitive objects usually come from different systems. The scene of the game is captured by the shooting device of the guide station. The data of the competitive objects needs to be collected and processed by a specific system. Therefore, the traditional e-sports OB system cannot synthesize the data and video streams of competitive objects in other competitive games.
  • embodiments of the present invention Based on the preset application on the computer to realize the filling signal screen and the key signal screen, it can realize the online loading of competitive data during the competitive game, and with the flexibility of the preset application, the caption processing is highly automated and real-time.
  • the guide system uses the computer to perform subtitle files (first preset subtitle template, second preset subtitle template and fill signal screen) And key signal screen), the video stream to be displayed is obtained through the shooting device of the guide station, and then the guide station synthesizes the filled signal picture, the key signal picture and the video stream to be displayed.
  • the guide system can be widely used in a variety of In the caption processing scene of competitive video.
  • FIG. 1 is a structural diagram of a guide system in an embodiment of the present invention.
  • the guidance system of an embodiment of the present invention may include an external device, a computer, and a guidance station, where the external device is connected to the computer in communication (wired, wireless, or other communication modes), and the computer is connected to the guidance station in communication.
  • the guide system of this embodiment is applied in competitive games, where the competitive game may be a game in a real scene, such as a game with real competitive objects, real competitive players (controllable competitive objects), or no competitive objects, but Including real competitive players (such as boxing).
  • the competitive game may also be a virtual competitive game (such as MOBA), the competitive object is a virtual competitive object, and the competitive player is a real competitive player.
  • a competitive game usually includes a referee system and/or an event system.
  • the external device in this embodiment may include a referee system and/or an event system.
  • the referee system In a competitive game in a real scene, the referee system is used to determine the competitive results of real competitive players operating real competitive objects in the game, or to determine the competitive results of real competitive players directly during the game. In a virtual competitive game, the referee system is used to determine the competitive results of real competitive players operating virtual competitive objects to conduct the game.
  • the event system is usually used to determine the competitive rules in the course of the competitive game.
  • the functions of the referee system and the event system can be integrated into the computer of the guidance system, and the competition data is processed by the computer of the guidance system.
  • the referee system and/or the event system may be a server provided independently of the computer of the guide system.
  • the external device may include the referee system and/or the event system.
  • the referee system and/or event system are in communication with the computer.
  • the competitive object may include a robot in a real competitive game scene
  • the referee system is in communication with the sensor device on the robot, and the sensor device on the robot may obtain the identity data of the robot.
  • Detect the state data of the robot during the game such as blood volume data, position information, operation information (such as the robot is in an attacking state or defensive state, etc.) and collect data
  • the sensor equipment on the robot will collect the current data
  • the data is sent to the referee system, and the field sensing equipment can collect data such as the number of projectiles supplied to the current robot by the projectile supply mechanism, the current status information of the visual game mechanism, and send the current collected data to the referee system.
  • the referee system is communicatively connected to the field sensing equipment (such as projectile replenishment mechanism and visual game mechanism) where the robot is located.
  • the competitive object may include a virtual robot in a virtual competitive game scene, the virtual robot is operated by a real competitive player, and the referee system is connected to the game server of the virtual competitive game, thereby directly acquiring data information of the virtual robot, such as virtual The robot's identity data, blood volume data, position data, etc., and then determine the virtual robot's status data based on the acquired virtual robot's data information.
  • data information of the virtual robot such as virtual The robot's identity data, blood volume data, position data, etc.
  • the video output device of the computer is connected to the guide station.
  • FIG. 3 is a method flowchart of a video subtitle processing method in an embodiment of the present invention. It should be noted that the execution subject of the video subtitle processing method of this embodiment is the computer of the guidance system. As shown in FIG. 3, the video subtitle processing method according to an embodiment of the present invention may include the following steps:
  • Step S301 Obtain competitive data during the competitive game, the competitive data includes data sent by an external device;
  • the competition data may include offline data or online data.
  • the competition data may include text, pictures, and/or videos.
  • the data sent by the external device includes the real-time collected data of the referee system and/or the event system, and may also include data determined by analyzing the real-time collected data of the referee system and/or event system.
  • the competitive data is data obtained by analyzing the real-time collected data of the referee system by the referee system and/or based on the real-time collected data of the referee system, such as the status data of the opponent, and the data used to control the athletes of the opponent Data, data of commentators during competitive games.
  • the competition data is the competition rules determined by the competition system.
  • the athletic data includes one or more of the status data of the opponent, the data of the athlete used to control the opponent, the data of the commentator during the athletic competition, and the data of the athletic rules.
  • the athletic data may also be Including other data, not listed here.
  • the status data of the competitive object may include one or more of the competitive object's identity data, the competitive object's number data, blood volume data, position data, competitive score data, life status data, and stunt trigger data. It is understood that the state data of the competitive object may also include other data information used to represent the state of the competitive object.
  • the competitive object may include a robot in a real scene, and the referee system analyzes the collected data of the sensor device on the robot and/or the collected data of the field sensor device to determine the state data of the competitive object.
  • the competitive object may include a robot in a virtual scene, and the referee system may determine the state data of the virtual robot based on the virtual robot data information directly obtained from the virtual competitive game server.
  • the athlete data includes one or more of the athlete's identity data, the athlete's historical athletic record data, and the athlete's current athletic record data.
  • the athlete data is not limited to the data types listed above , Can also include other data types.
  • the data of the commentator includes the identity information of the commentator or others, such as the number of commentators in the current game.
  • the competition rules data may include one or more of game time data, game round data, schedule data, match data, and statistical data during the competition of each round.
  • the competition rules data may also include other data For information, you can choose the data type of the competition rules data according to your needs.
  • the athletic data may also include local data and/or computer input data.
  • the competition data includes one or more of local data, input data of a computer, and transmission data of an external device. It can be understood that the types of sports data are not limited to the data types listed in the above embodiments, but may include other data types.
  • the local data is data stored in the disk of the computer, and the local data is usually offline data.
  • the input data of the computer can be contact input data, such as the data input by the user through the keyboard, mouse, etc., or the data read by the computer and stored in the U disk and mobile hard disk inserted in the computer; the input of the computer
  • the data can also be non-contact input data, such as the data obtained by the identification module of the computer based on the induction method (such as face recognition, voice recognition, etc.), the data obtained by the computer through the APP, etc.
  • obtaining the competitive data during the competitive game may specifically include: receiving data sent by an external device, verifying the currently received data, and using the verified data as competitive data, and verifying the failed data It is determined to be invalid data to ensure the accuracy and safety of the data.
  • verifying the currently received data specifically, if the data format of the currently received data satisfies the preset data structure, the currently received data is determined to be competitive data. If the data format of the currently received data does not satisfy the preset data structure, the currently received data is determined to be invalid data.
  • the computer after receiving the data sent by the external device, the computer analyzes and checks the currently received data to determine whether the currently received data meets the preset protobuf verification rules.
  • the data meets the preset protobuf, the data format of the currently received data meets the preset data structure, and the currently received data is competitive data; if the currently received data does not meet the preset protobuf, the current receive The data format of the received data does not satisfy the preset data structure, and the currently received data is invalid data.
  • the competitive data during the competitive game is obtained, the competitive data is stored in a database, and the competitive data during the competitive game is stored in the database to facilitate subsequent calls.
  • Step S302 Rendering competitive data on the first preset subtitle template of the display area of the preset application to generate a filled signal screen (ie, RGB signal screen), the display area further includes a second preset subtitle template, and the second preset subtitle template is Fill the key signal picture corresponding to the signal picture (ie ALPHA signal picture);
  • the preset application may include a World Wide Web Web application, such as various browser applications, and the preset application may also be a desktop word, PPT, photo editor, and so on.
  • the preset application is the World Wide Web Web application.
  • the Web application is easy to develop, and can support the display of text, pictures, videos and other content, and can implement user interactive operations and dynamics through the script language effect.
  • the resolution of the filled signal screen and the resolution of the key signal screen may be equal or different.
  • the resolution of the fill signal picture and the key signal picture are not equal, after the fill signal picture and the key signal picture are combined into the video stream to be displayed, the new video stream obtained will have subtitle redundancy or missing subtitles And other subtitle effects.
  • the resolution of the fill signal picture and the resolution of the key signal picture are equal.
  • the resolution of the display area is twice the resolution of the filled signal picture or the resolution of the key signal picture.
  • the width of the resolution of the display area is twice the width of the resolution of the fill signal screen or the key signal screen.
  • the height of the resolution of the display area is twice the height of the resolution of the filled signal picture or the key signal picture.
  • the resolution of the filled signal screen and the resolution of the key signal screen can be equal to the resolution of the display screen of the computer after being scaled by a preset ratio, for example, the display area is a Web page.
  • the display area is designed in advance. After opening the Web application, the Web page is directly twice the resolution of the display screen.
  • the display area is obtained by stretching a web page with a resolution equal to the resolution of the display screen of the computer based on the World Wide Web Web application, and the resolution of the stretched web page is that of the display screen of the computer The resolution is twice as large.
  • the width of a Web page with a resolution equal to that of the display screen of the computer is stretched to twice the width of the display screen of the computer to obtain the stretched Web page.
  • the height of a Web page with a resolution equal to that of the display screen of the computer is stretched to twice the height of the display screen of the computer to obtain the stretched Web page.
  • the first preset subtitle template may include subtitle display information such as a subtitle display position and/or subtitle display content.
  • the subtitle display position refers to the position where the subtitles are displayed in the new video stream. Referring to FIG. 5, the subtitles are displayed in the areas A and B of the new video stream.
  • the subtitle display content refers to the subtitle information displayed in the new video stream, such as text, patterns, colors, shapes and other static information.
  • the second preset template is used to indicate the transparency effect of each pixel in the fill picture in the new video stream. Specifically, the transparency effect of each pixel in the fill signal picture in the new video stream is based on the correspondence in the key signal picture. The brightness of the location pixel is determined.
  • the area of the first preset subtitle template corresponds to the area of the second preset subtitle template.
  • the areas A, B, and C of the first preset subtitle template require the assistance of the second preset subtitle template and have a special effect, then the area A of the first preset subtitle template and the second preset The position and size of the area A'of the subtitle template are the same, the area B of the first preset subtitle template and the position B of the second preset subtitle template are the same, the area C of the first preset subtitle template and the second pre Let the position and size of C'of the subtitle template be the same.
  • the area of the new video stream corresponds to the area of the first preset subtitle template
  • the manner in which the area of the new video stream and the area of the first preset subtitle template correspond to the area and the area of the first preset subtitle template The corresponding manner of the area of the second preset subtitle template is similar, and will not be repeated here.
  • the brightness of each pixel in the key signal screen can be designed according to needs, so that the subtitles in different areas of the new video stream have different transparency effects.
  • the brightness of each pixel in the key signal screen is based on the subtitle display position of the subtitle template of the first preset template (that is, the display position of the competition data), and/or the subtitle display content, and/or the preset and competition
  • the subtitle effect corresponding to the data is determined.
  • the first preset subtitle template includes an area A, an area B, and an area C.
  • a portion corresponding to the area A in the new video stream and a portion corresponding to the area B in the new video stream need to be displayed transparently.
  • the part of the new video stream corresponding to the region C is non-transparent, and the transparency of the part of the new video stream corresponding to the region A is higher than the transparency of the part of the new video stream corresponding to the region B.
  • the brightness of each pixel in the area A', area B'and area C'in the screen is designed. Specifically, the greater the brightness of each pixel in the key signal screen, the fill signal screen corresponds to the pixel in the new video stream The greater the transparency of the location.
  • the brightness of each pixel in the display position of the same competitive data in the key signal screen is the same.
  • the first preset subtitle template includes the display positions of three competitive data in area A, area B, and area C, and the brightness of each pixel in area A′ of the key signal screen is set to In the first brightness, the brightness of each pixel in the area B'of the key signal screen is set to the second brightness, and the brightness of each pixel in the area C'in the key signal screen is set to the third brightness.
  • the transparency of the filled signal picture in the new video stream corresponding to the area A of each pixel is the same, and the transparency of the filled signal picture in the new video stream corresponding to the area B of each pixel is the same.
  • the transparency of each pixel in the part corresponding to the region C in the video stream is also the same.
  • the first brightness, the second brightness, and the third brightness are different. For example, if the first brightness is 0, the second brightness is 50, and the third brightness is 255, the filled signal picture corresponds to the new video stream.
  • the transparency of each pixel in the part of area A is the largest and completely transparent; the transparency of each pixel in the part of area C corresponding to area C in the new video stream is the smallest and opaque; the signal of the fill signal is new in the new video stream
  • the transparency of each pixel in the part corresponding to area B in is between completely transparent and opaque.
  • the first brightness, the second brightness, and the third brightness are partially or completely the same.
  • the brightness of each pixel of the display position of the same competitive data in the key signal picture is at least partially different, so that the filled signal picture can present different transparency effects at the corresponding position of the new video stream.
  • the transparency gradient effect of the part of the signal picture in the corresponding area D of the new video stream such as transparency From left to right (in the direction of the arrow in FIG. 6)
  • the brightness of each pixel of the area D'in the key signal screen can be set to a gradually decreasing trend from left to right, and the fill signal can be achieved
  • the transparency of the part of the picture corresponding to the area D in the new video stream is gradually increasing.
  • the position of some pixels filled in the signal screen can be set as the display position of the competitive data, and the brightness of each pixel in the position corresponding to the display position of the competitive data in the key signal screen can be set to make the new
  • the area picture corresponding to the display position of the competitive data in the video stream is covered by the competitive data.
  • the entire fill signal picture can be set as the display position of the competitive data, and by setting the brightness of each pixel of the entire area of the key signal picture, the video stream picture to be displayed is completely covered, so that the new Of the video stream becomes hazy.
  • the first preset subtitle template and/or the second preset template can be dynamically adjusted according to one or more of the competition data, local data, and computer input data, so that a new video stream is generated Different subtitle effects.
  • the real-time dynamic adjustment process of the first preset subtitle template and the second preset template may include the following steps:
  • Step S701 Determine the preset caption effect corresponding to the competitive data
  • the subtitle display content is static information.
  • the subtitle effect in this step may include static information, and may also include dynamic information (such as the change process of the subtitle shape).
  • the subtitle effect may include one or more of animation effects, display effects, and hidden effects.
  • the animation effects may include gradient, fly in, fly out, blinds, bounce, zoom in, zoom out, etc.
  • Display effects can include gradients, fly-in, fly-out, blinds, bounces, the transparency of the sports data at the specified position in the new video stream gradually increases along a specific direction or the transparency gradually decreases along a specific direction, etc., different sports data displays The duration of the competition, the location of the competition data, and the shape of the competition data.
  • the display effects include animation effects and other data information used to indicate changes in subtitles.
  • competitive data 1 needs to be synthesized in the upper left corner of the new video stream in a fly-in manner and move from left to right to the upper right corner of the new video stream at a preset speed within 1 s.
  • the data format of the competitive data 1 is switched from "Song" to "Kai”.
  • the animation effect includes flying in, and the display effect includes flying in, and the competitive data 1 starts from a new video.
  • the upper left corner of the stream is moved to the upper right corner of the new video stream and the data format of competitive data 1 is switched from "Song" to "Kai”. It can be seen that the display effect in this implementation is richer than the animation effect.
  • Hidden effects of competitive data may include hidden effects such as mosaic overlays and picture overlays.
  • the subtitle effects corresponding to different sports data can be selected according to needs, for example, sports data 1 corresponds to the animation effect of flying in, and sports data 2 corresponds to the animation effect of blinds.
  • the subtitle effects corresponding to different subtitle display positions can be fixed. As shown in FIG. 5, the subtitle effect in area A is flying in, and the subtitle effect in area B is bounce.
  • the subtitle effects corresponding to different subtitle display positions change with time and/or subtitle display content, for example, the subtitle effect of area A at the first moment is flying in, the subtitle effect at the second moment is flying out, and the third The subtitle effect at the moment is blinds and so on.
  • Step S702 Adjust the display information of the content in the first preset subtitle template and/or the second preset subtitle template according to the subtitle effect, so that a subtitle effect is generated in the new video stream.
  • the adjusted display information may include a change in the display position of the competitive data, a change in the shape of the competitive data, and/or a duration for displaying the competitive data, and so on.
  • a countdown display of competitive games is required, for example, "5", “4", “3”, “2”, “1”, and “0” are displayed in sequence in the center area of the new video stream ,
  • the duration of each number display is 1s, each number in the center area of the new video stream is gradually reduced by the preset size (the preset size is determined according to the size of the center area) until it disappears, and each number is in the new
  • the transparency of each video stream is different, you can load the numbers “5", "4", “3”, “2”, “1” and “0” in the center area of the first preset subtitle template, and Adjust the duration of the first preset template display number "5", "4", “3", “2”, “1” and “0” are 1s, at the same time, adjust the center area display of the first preset template
  • the animation effect of the numbers "5", "4", “3", “2”, “1”, and “0” is “gradual reduction from the preset size until disappearance”.
  • the brightness of each number display
  • the competitive game includes a red team and a blue team.
  • the red team and the blue team include three infantry robots, one hero, one engineering robot, and one drone.
  • the competitive game includes multiple tasks. Each robot can perform the corresponding task and attack the other robot. The team that completes all tasks first wins.
  • the data of the red team needs to be displayed on the left side of the video screen of the competitive game
  • the data of the blue team is displayed on the right side of the video screen of the competitive game
  • the process of the competitive game is displayed in the central area of the video screen of the competitive game Confrontation data, game time statistics, and scores of both parties.
  • the team information of the red team and the current operation information of the red team in the area 1 of the video screen of the competitive game it is necessary to display the identity information of the competitive objects of the red team in the area 11, such as 111 for displaying the red
  • the identity information of one of the infantry robots of the Fang team, 112 is used to display the identity information of the hero of the Red team
  • 113 is used to display the identity information of the engineering robot of the Red team.
  • the red is displayed in the area 12 of the competitive game video screen
  • the video stream of the competitive players of the Fang team displays the identity information of the competitive object currently performing the task of the red team, the weapon information of the performing task, etc. in the area 13 of the video screen of the competitive game.
  • the team information of the blue team and the current operation information of the blue team in the area 2 of the competitive game video screen, and display the identity information of the blue team’s competitive objects in the area 21, such as 211 for displaying the blue team
  • the identity information of one of the infantry robots, 212 is used to display the identity information of the blue team’s heroes
  • 213 is used to display the identity information of the blue team’s engineering robots
  • the blue team is displayed in the area 22 of the competitive game video screen.
  • the video stream of the competitive player of the player displays the identity information of the competitive object currently performing the task of the red team, the weapon information of the performing task, etc. in the area 23 of the video screen of the competitive game.
  • the entire fill signal screen can be set to the display position of the competitive data, and the brightness of each pixel in the entire area of the key signal screen can be set by , To cover all the video stream pictures to be displayed, so that the new video stream pictures become hazy.
  • the competitive data displayed in each area in the video screen of the competitive game may include text, pictures, and/or video streams.
  • the animation display effect of the area E displaying the competition data in the first preset subtitle template can be set A fly-in, so that the area E in the new video stream displays the competitive data through the fly-in.
  • the area F of the new video stream screen needs to display the gradually increasing transparency of the competition data in the direction of the arrow shown in FIG. 8B, and the second preset
  • the brightness of each pixel in the position of the corresponding area F in the subtitle template is set to gradually increase in the direction of the arrow as shown in FIG. 8B, so that the transparency of the athletic data displayed in the area F in the new video stream is as shown in FIG. 8B
  • the direction of the arrow shows gradually increasing.
  • Step S303 Transmit the fill signal picture to the guide station, and transmit the key signal picture to the guide station, so that the guide station synthesizes the video stream to be displayed according to the fill signal picture and the key signal picture and obtains a new video stream.
  • the guide station of this embodiment includes a shooting device, which is used to obtain a video stream to be displayed.
  • the shooting device is used for shooting competitive games videos.
  • the video stream to be displayed includes one or more of a confrontation video stream of an opponent, a video stream of an athlete, a video stream of a commentator, and a video stream of an audience during a competitive game, and may include other videos. flow.
  • the video output device of the computer is connected to the guide station, for example, the video output device of the computer and the guide station are connected by a signal line.
  • the computer-based video output device transmits the fill signal picture to the guide station and the key signal picture to the guide station. Compared with the captioning machine, the general equipment of the common computing system is used, and the development cost is low.
  • the video output device may include a graphics card or a non-editing card.
  • the computer projects the fill signal screen and the key signal screen in step S202 to the guide station through the computer's graphics card to achieve the purpose of real-time transmission of the fill signal screen and the key signal screen.
  • the computer transmits the fill signal screen and the key signal screen in step S302 to the guide station through the non-editing card of the computer, so as to realize the purpose of real-time transmission of the fill signal screen and the key signal screen.
  • the method further includes:
  • Step S901 call a preset instruction corresponding to the athletic data
  • Step S902 Broadcast a preset instruction.
  • the broadcast preset instruction refers to that the computer directly informs the guide station, the third-party website, and the third-party device of the preset instruction.
  • the guide station and the third-party website that is, the webcast in FIG. 10 (System) After obtaining the preset instruction, perform the corresponding operation according to the preset instruction.
  • the preset instructions may include one or more of audio playback instructions, network interface calling instructions, and guide station instructions.
  • the preset commands are not limited to the above listed ones, but may also include others, such as light display commands.
  • the network interface call instruction is mainly directed to a third-party website, and the network interface call instruction can trigger the guide station to push a new video stream to the cloud, so that the third-party website can obtain the new video stream from the cloud and play it, or ,
  • the network interface call instruction instructs the third-party website to access the computer of the guidance system, and directly receives the broadcast message generated by the computer, to ensure that the third-party website broadcasts real-time event data during the live video streaming process.
  • the guide station after the guide station obtains a new video stream, it can display the new video stream through a live screen (such as a competitive game scene), or push the new video stream to the cloud through a video push streaming server, and then The third-party website plays the new video stream obtained from the cloud.
  • a live screen such as a competitive game scene
  • a video push streaming server a video push streaming server
  • a first specific sound effect needs to be played in a new video stream.
  • the computer can call and broadcast the first sound effect playback instruction corresponding to the blood loss data of the competitive object, and the broadcast message can be Directly transmitted to the on-site audio playback device or third-party website. After receiving the broadcast message, the on-site audio playback device or third-party website will directly play with the first specific sound effect.
  • the competitive object dies, the second specific sound effect needs to be played in the new video stream.
  • the computer can call and broadcast a second audio effect playback instruction corresponding to the death state of the competitive object and broadcast it.
  • the broadcast message can be directly transmitted to the live After receiving the broadcast message, the audio playback device (that is, the audio playback device at the game site) or a third-party website will directly play the specific sound effect.
  • the guide station When a competitive object appears in a state of death and life, the guide station needs to switch the display scene of the video stream to be displayed, such as replaying a part of the video screen of the competitive object currently in the state of death in the current competitive game, or appearing to the competitive object
  • the screen of the life-death state is enlarged, and the computer can call a guide station instruction for instructing the guide station to switch the display scene of the video stream to be displayed and broadcast to the guide station to instruct the guide station to switch the display scene of the video stream to be displayed.
  • the computer can call the light display instruction and broadcast, the broadcast message is directly transmitted to the scene lighting control module, and the scene lighting control module receives the After broadcasting the message, the scene lights will be controlled to be all bright.
  • the computer can trigger the third-party website to directly execute the event corresponding to the preset instruction by broadcasting the preset instruction, such as the audio effect playback corresponding to the audio playback instruction, so that the third-party website can play the sound effect in time, ensuring that the third-party website broadcasts a new video stream The release of real-time event data during the process.
  • the preset instruction such as the audio effect playback corresponding to the audio playback instruction
  • step S901 specifically, the computer receives the preset event signal corresponding to the competitive data, and calls the preset instruction corresponding to the preset event signal.
  • the generation of the preset event signal may include one or more of generation based on input data of the computer, generation based on local control data, and generation based on control data sent by an external device.
  • the preset event signal is an audio playback indication signal, a network interface call indication signal or a guide station indication signal, etc.
  • the video stream to be displayed is a video stream during a competitive game
  • the control data includes competitive data.
  • the local control data is the local pre-stored athletic data of the computer
  • the control data sent by the external device is the athletic data during the athletic competition process sent by the external device
  • the athletic data may include the quantity data, blood volume data, and location of the athletic objects One or more of data, competitive score data, life status data, etc.
  • the preset event signal is a guide station instruction signal generated based on the local input data of the computer. For example, when the computer keyboard Ctrl key + Enter button is pressed at the same time, the computer generates a guide station to be displayed The guide signal indicating the scene switching of the video stream.
  • the guide station indication signal may also be generated based on local control data and/or based on control data sent by an external device.
  • the preset event signal is a network interface call instruction signal generated based on the local control data of the computer.
  • the sound effect data corresponding to the blood loss data of the competitive object is pre-stored locally, and the computer determines the blood loss of the competitive object
  • a network interface call instruction instruction for instructing a third-party website to play the sound effect data corresponding to the bleeding data of the competitive object is generated.
  • the network interface call instruction signal can also be generated based on the input data of the computer and/or based on the control data sent by the external device.
  • the preset event signal is an audio playback instruction signal generated based on control data sent by an external device.
  • the computer receives the death state of the competitive object, the computer generates an instruction to play specific audio data. Audio playback indicator.
  • the audio playback instruction signal can also be generated based on local control data and/or based on computer input data.
  • the caption processing method of the competitive game video can realize the online loading of the competitive data during the competitive game by using a preset application on the computer to realize the filling of the signal picture and the key signal picture, without the need to purchase a dedicated caption machine.
  • Reduced hardware cost, and by virtue of the flexibility of preset applications, the subtitle processing is highly automated, real-time, free, and has a wide range of applications.
  • the accuracy of subtitle loading is high, which meets the needs of competitive OB systems;
  • the first preset subtitle template and the second preset subtitle template are designed in the same display area of the preset application, and the fill signal screen and the key signal screen can be rendered at the same time to ensure the simultaneous rendering requirements of the two screens;
  • the guide station adopts the back-synthesis technology to synthesize the fill signal picture and the key signal picture into the video stream to be displayed to meet the data display requirements of the actual competitive game, so that the obtained Video subtitles meet broadcast-level requirements.
  • the storage medium may be a magnetic disk, an optical disk, a read-only memory (Read-Only Memory, ROM) or a random access memory (Random Access Memory, RAM), etc.

Abstract

Procédé de traitement de sous-titres de vidéo de compétition et système de guidage de diffusion, le procédé consistant à : obtenir des données de compétition pendant un processus de compétition, les données de compétition comprenant des données envoyées par un équipement externe ; rendre les données de compétition dans un premier modèle de sous-titres prédéfini d'une zone d'affichage d'une application prédéfinie pour générer une image de signal de remplissage, la zone d'affichage comprenant également un second modèle de sous-titres prédéfini, et le second modèle de sous-titres prédéfini étant une image de signal clé correspondant à l'image de signal de remplissage ; et transmettre l'image de signal de remplissage à une station de guidage de diffusion, et transmettre l'image de signal clé à la station de guidage de diffusion, de sorte que la station de guidage de diffusion puisse synthétiser un flux vidéo à afficher en fonction de l'image de signal de remplissage et de l'image de signal clé pour obtenir un nouveau flux vidéo. L'utilisation d'une application prédéfinie sur un ordinateur pour implémenter une image de signal de remplissage et une image de signal clé, permet le chargement en ligne de données de compétition pendant le processus de compétition, sans qu'il soit nécessaire d'acheter une machine à sous-titres spéciale, ce qui réduit ainsi les coûts de matériel.
PCT/CN2018/125395 2018-12-29 2018-12-29 Procédé de traitement de sous-titres de vidéo de compétition et système de guidage de diffusion WO2020133371A1 (fr)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201880041352.8A CN110800310A (zh) 2018-12-29 2018-12-29 竞技比赛视频的字幕处理方法和导播系统
PCT/CN2018/125395 WO2020133371A1 (fr) 2018-12-29 2018-12-29 Procédé de traitement de sous-titres de vidéo de compétition et système de guidage de diffusion

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2018/125395 WO2020133371A1 (fr) 2018-12-29 2018-12-29 Procédé de traitement de sous-titres de vidéo de compétition et système de guidage de diffusion

Publications (1)

Publication Number Publication Date
WO2020133371A1 true WO2020133371A1 (fr) 2020-07-02

Family

ID=69438493

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2018/125395 WO2020133371A1 (fr) 2018-12-29 2018-12-29 Procédé de traitement de sous-titres de vidéo de compétition et système de guidage de diffusion

Country Status (2)

Country Link
CN (1) CN110800310A (fr)
WO (1) WO2020133371A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20230269418A1 (en) * 2022-02-21 2023-08-24 Beijing Bytedance Network Technology Co., Ltd. Video display method, apparatus and storage medium

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111773697A (zh) * 2020-07-13 2020-10-16 网易（杭州）网络有限公司 游戏赛事直播画面的生成方法及装置与系统、介质、设备
CN113950825A (zh) * 2020-08-24 2022-01-18 深圳市大疆创新科技有限公司 数据传输、处理方法、可移动平台、终端设备及芯片
CN113452935B (zh) * 2021-08-31 2021-11-09 成都索贝数码科技股份有限公司 横屏和竖屏直播视频生成系统及方法
CN113965766A (zh) * 2021-10-27 2022-01-21 腾竞体育文化发展(上海)有限公司 电竞赛事直播系统、方法、装置、计算机设备及存储介质
CN114283232A (zh) * 2021-11-19 2022-04-05 北京字跳网络技术有限公司 一种画面展示方法、装置、计算机设备以及存储介质
CN113923505B (zh) * 2021-12-14 2022-03-01 飞狐信息技术（天津）有限公司 弹幕处理方法、装置及电子设备和存储介质
CN114598936B (zh) * 2022-02-18 2023-12-01 深圳盛显科技有限公司 字幕批量生成和管理方法、系统、装置及存储介质
CN115134624B (zh) * 2022-06-30 2024-04-23 广州方硅信息技术有限公司 直播连麦匹配方法、系统、装置、电子设备及存储介质
CN115514990A (zh) * 2022-10-28 2022-12-23 上海乐不可言电竞信息科技有限公司 一种字幕机逻辑触发动画生成方法

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080084504A1 (en) * 2006-10-06 2008-04-10 Sensaburo Nakamura Image synthesizing apparatus
CN101742127A (zh) * 2009-10-20 2010-06-16 大连捷成实业发展有限公司 键混自动循环演示及pgm/pst同步输出控制
CN102098454A (zh) * 2009-12-09 2011-06-15 新奥特（北京）视频技术有限公司 一种实时字幕播出系统和方法
CN201887859U (zh) * 2010-11-24 2011-06-29 北京格非科技发展有限公司 高清台标键控一体机
CN103839221A (zh) * 2012-11-26 2014-06-04 索尼公司 图像处理装置和图像处理装置的控制方法

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3311834B2 (ja) * 1992-10-12 2002-08-05 エルジー電子株式会社 字幕表示制御装置及びその制御方法
CN100576902C (zh) * 2005-08-18 2009-12-30 北京德瑞塔时代网络技术有限公司 一种广播级宽带视频会议的声像传输系统及方法
CN102075698B (zh) * 2009-11-24 2015-02-18 新奥特（北京）视频技术有限公司 一种快捷制作特技的字幕播控机
CN102118581B (zh) * 2009-12-30 2015-04-29 新奥特（北京）视频技术有限公司 一种字幕播出系统的软件预监方法
CN108289159B (zh) * 2017-05-25 2020-12-04 广州华多网络科技有限公司 一种终端直播特效添加系统、方法及终端直播系统
CN108769822B (zh) * 2018-04-13 2021-01-08 维沃移动通信有限公司 一种视频显示方法及终端设备

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080084504A1 (en) * 2006-10-06 2008-04-10 Sensaburo Nakamura Image synthesizing apparatus
CN101742127A (zh) * 2009-10-20 2010-06-16 大连捷成实业发展有限公司 键混自动循环演示及pgm/pst同步输出控制
CN102098454A (zh) * 2009-12-09 2011-06-15 新奥特（北京）视频技术有限公司 一种实时字幕播出系统和方法
CN201887859U (zh) * 2010-11-24 2011-06-29 北京格非科技发展有限公司 高清台标键控一体机
CN103839221A (zh) * 2012-11-26 2014-06-04 索尼公司 图像处理装置和图像处理装置的控制方法

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20230269418A1 (en) * 2022-02-21 2023-08-24 Beijing Bytedance Network Technology Co., Ltd. Video display method, apparatus and storage medium

Also Published As

Publication number Publication date
CN110800310A (zh) 2020-02-14

Similar Documents

Publication Publication Date Title
WO2020133371A1 (fr) Procédé de traitement de sous-titres de vidéo de compétition et système de guidage de diffusion
WO2020133372A1 (fr) Procédé de traitement de sous-titres vidéo et système de direction de diffusion
US10532283B2 (en) Virtual playbook with user controls
US11514653B1 (en) Streaming mixed-reality environments between multiple devices
US20190030431A1 (en) Information Processing Method and Apparatus, Storage Medium and Electronic Device
JP5081964B2 (ja) ゲーム装置、ゲーム装置の制御方法、及びプログラム
CN111684393A (zh) 在虚拟、增强或混合现实环境中生成和显示3d视频的方法和系统
CN106730815B (zh) 一种易实现的体感互动方法及系统
JP2022002705A (ja) ゲーム動画編集プログラムならびにゲーム動画編集システム
US20080148165A1 (en) System and method of providing assistance over a network
JP2012090905A (ja) データ生成装置、データ生成装置の制御方法、及びプログラム
CN109391848B (zh) 一种互动广告系统
WO2022267729A1 (fr) Procédé et appareil d'interaction basée sur une scène virtuelle, dispositif, support et produit logiciel
CN113392690A (zh) 视频语义标注方法、装置、设备及存储介质
US20120244935A1 (en) Synchronizing game character display with game player viewing detection
CN114466213A (zh) 信息同步方法、装置、计算机设备、存储介质及程序产品
US20230368464A1 (en) Information processing system, information processing method, and information processing program
US20210385554A1 (en) Information processing device, information processing method, and information processing program
CN112843693A (zh) 拍摄图像的方法、装置、电子设备及存储介质
US7264547B1 (en) Game apparatus, game image preparation method and information storage medium
JP2018192272A (ja) ゲームプログラム及びゲーム装置
CN114832371A (zh) 控制虚拟角色移动的方法、装置、存储介质及电子装置
KR101022130B1 (ko) 게임 시나리오 제작 시스템 및 그 제작 방법
JP7358078B2 (ja) 情報処理装置、情報処理装置の制御方法、及び、プログラム
JP2022065051A (ja) 視点確認システム

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18944424

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 18944424

Country of ref document: EP

Kind code of ref document: A1