WO2020133372A1 - 视频的字幕处理方法和导播系统 - Google Patents

视频的字幕处理方法和导播系统 Download PDF

Info

Publication number
WO2020133372A1
WO2020133372A1 PCT/CN2018/125396 CN2018125396W WO2020133372A1 WO 2020133372 A1 WO2020133372 A1 WO 2020133372A1 CN 2018125396 W CN2018125396 W CN 2018125396W WO 2020133372 A1 WO2020133372 A1 WO 2020133372A1
Authority
WO
WIPO (PCT)
Prior art keywords
subtitle
preset
data
signal picture
computer
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2018/125396
Other languages
English (en)
French (fr)
Inventor
陈庭欣
陈贤雨
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
SZ DJI Technology Co Ltd
Original Assignee
SZ DJI Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by SZ DJI Technology Co Ltd filed Critical SZ DJI Technology Co Ltd
Priority to PCT/CN2018/125396 priority Critical patent/WO2020133372A1/zh
Priority to CN201880068929.4A priority patent/CN111279687A/zh
Publication of WO2020133372A1 publication Critical patent/WO2020133372A1/zh
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/278—Subtitling
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/265—Mixing

Definitions

  • the invention relates to the field of video subtitle processing, in particular to a video subtitle processing method and a guide system.
  • the widely used non-linear video editing equipment produces and arranges subtitles.
  • the non-linear video editing equipment uses offline methods to arrange the subtitle content and play it at a specified time. This method is costly and cannot meet real-time requirements.
  • the staff usually uses the subtitle machine system for on-site subtitle production, and then plays according to the guide instructions.
  • the manual production and on-site manual are error-prone and difficult to meet the data Scenarios where items are updated frequently and there are many data items.
  • the invention provides a video subtitle processing method and a guide system.
  • a video subtitle processing method comprising:
  • the display area further includes a second preset subtitle template, and the second preset subtitle template is the fill Key signal screen corresponding to the signal screen;
  • a guidance system includes a computer and a guidance station, and the computer and the guidance station are in communication connection; wherein, the computer is used to obtain subtitle data and preset
  • the first preset subtitle template of the display area of the application renders the subtitle data to generate a fill signal picture
  • the display area further includes a second preset subtitle template
  • the second preset subtitle template corresponds to the fill signal picture
  • the computer is also used to transmit the fill signal picture to the guide station and the key signal picture to the guide station; the guide station according to the fill signal picture and the key signal picture to be displayed
  • the video stream is synthesized and a new video stream is obtained.
  • the subtitle processing is highly automated, real-time, free, and has a wide range of applications.
  • the first preset subtitle template and the second preset are designed in the same display area using the preset application Set the subtitle template, which can render the fill signal screen and the key signal screen at the same time to ensure the simultaneous rendering requirements of the two screens.
  • the guide station uses the back-synthesis technology
  • the fill signal picture and the key signal picture are combined into the video stream to be displayed to meet the data display requirements of the real scene, and the obtained video subtitles meet the broadcast level requirements.
  • FIG. 1 is a structural block diagram of a guide system in an embodiment of the present invention.
  • FIG. 2 is a method flowchart of a video subtitle processing method according to an embodiment of the present invention
  • FIG. 3 is a block diagram of a specific structure of a guide system in an embodiment of the present invention.
  • FIG. 4 is a display diagram of a fill signal screen and a key signal screen in an embodiment of the invention.
  • FIG. 5 is another display diagram of the fill signal screen and the key signal screen in an embodiment of the invention.
  • FIG. 6 is a flowchart of a specific method of a video subtitle processing method according to an embodiment of the present invention.
  • FIG. 7 is a diagram of a new video stream picture obtained by synthesizing a fill signal picture and a key signal picture into a video stream to be displayed in an embodiment of the present invention
  • FIG. 8 is a flowchart of another specific method of a video subtitle processing method in an embodiment of the present invention.
  • the guide system includes a caption machine and a guide station.
  • the captioning machine and the guide station establish a communication connection based on the video signal transmission interface.
  • the captioning machine usually uses special captioning software and a captioning hardware card to cooperate to produce the filling signal picture and the key signal picture, and fills the signal picture and the key signal picture through the video signal transmission interface It is sent to the guide station, and the guide station synthesizes the fill signal and the key signal into the video stream to be displayed based on the back-synthesis technology.
  • subtitle hardware cards leads to higher investment in the hardware of the guide system.
  • the subtitle software and subtitle hardware cards of different manufacturers have not formed a unified standard and are closed source. If a subtitle software and subtitle hardware card compatible with different subtitle files are redeveloped, develop The cost will be relatively high.
  • subtitle files of subtitle machines are usually produced offline, and most subtitle machines cannot accept network data and modify subtitle content in real time, which has the disadvantage of poor real-time performance.
  • the guide system of the embodiment of the present invention uses a computer instead of a subtitle machine, obtains subtitle data through a computer, and renders the subtitle data based on a preset application on the computer to generate a fill signal picture and a key signal picture to realize online loading of subtitle data , Low hardware cost, high degree of automation, strong real-time, high degree of freedom, wide range of application.
  • FIG. 1 is a structural diagram of a guide system in an embodiment of the present invention.
  • the guidance system of the embodiment of the present invention may include a computer and a guidance station, where the computer and the guidance station are communicatively connected.
  • the video output device of the computer is connected to the guide station.
  • the video subtitle processing method according to an embodiment of the present invention may include the following steps:
  • Step S201 Obtain subtitle data
  • the subtitle data acquired by the computer may include offline data or online data.
  • the subtitle data may include text, pictures, and/or video.
  • the subtitle data may include one or more of local data, computer input data, and data sent by an external device. It can be understood that the type of subtitle data is not limited to the data types listed in the foregoing embodiments, and may include other data types.
  • the local data is data stored in the disk of the computer, and the local data is usually offline data.
  • the input data of the computer can be contact input data, such as the data input by the user through the keyboard, mouse, etc., or the data read by the computer and stored in the U disk and mobile hard disk inserted in the computer; the input of the computer
  • the data can also be non-contact input data, such as the data obtained by the identification module of the computer based on the induction method (such as face recognition, voice recognition, etc.), the data obtained by the computer through the APP, etc.
  • the external device is communicatively connected to the computer (wired, wireless, or other communication methods).
  • the data sent by the external device may be real-time collected data of the external device, or data determined by the external device based on real-time collected data analysis.
  • the caption processing method of the video uses the application in a competitive game as an example to illustrate the caption data in step S201.
  • the caption data may include competitive data during the competitive game and/or data determined based on competitive data analysis.
  • the subtitle data may also include non-sports data.
  • the competitive game may be a game in a real scene, such as a game with real competitive objects, real competitive players (controllable competitive objects), or a game without competitive objects, but including real competitive players (such as boxing).
  • the competitive game may also be a virtual competitive game (such as MOBA), the competitive object is a virtual competitive object, and the competitive player is a real competitive player.
  • a competitive game usually includes a referee system and/or an event system.
  • the referee system In a competitive game in a real scene, the referee system is used to determine the competitive results of real competitive players operating real competitive objects to conduct the game, or to determine the competitive results of real competitive players directly during the game . In a virtual competitive game, the referee system is used to determine the competitive results of real competitive players operating virtual competitive objects to perform the game.
  • the event system is usually used to determine the competitive rules in the course of the competitive game.
  • the functions of the referee system and the event system can be integrated in the computer of the guidance system, and the caption data is processed by the computer of the guidance system.
  • the referee system and/or event system may be a server provided independently of the computer of the guidance system.
  • the competition data is sent to the computer of the guidance system, thereby As subtitle data.
  • the competitive data is data obtained by analyzing the real-time collected data of the referee system by the referee system and/or based on the real-time collected data of the referee system, such as the status data of the opponent, and the data used to control the athletes of the opponent Data, data of commentators during competitive games.
  • the competition data is the competition rules determined by the competition system.
  • the athletic data includes one or more of the status data of the opponent, the data of the athlete used to control the opponent, the data of the commentator during the athletic competition, and the data of the athletic rules.
  • the athletic data may also be Including other data, not listed here.
  • Step S202 Render the subtitle data on the first preset subtitle template in the display area of the preset application to generate a filled signal picture (ie, RGB signal picture).
  • the display area further includes a second preset subtitle template, and the second preset subtitle template is Fill the key signal picture corresponding to the signal picture (ie ALPHA signal picture);
  • the preset application may include a World Wide Web Web application, such as various browser applications, and the preset application may also be a desktop word, PPT, photo editor, and so on.
  • the preset application is the World Wide Web Web application.
  • the Web application is easy to develop, and can support the display of text, pictures, videos and other content, and can implement user interactive operations and dynamics through the script language effect.
  • Web applications make it easier to obtain caption data online.
  • the referee system and/or event system can communicate with the computer through the network.
  • the referee system and/or event system can communicate via network communication protocols such as hypertext.
  • the transfer protocol HTTP HyperText, Transfer, Protocol
  • HTTP HyperText, Transfer, Protocol
  • the resolution of the filled signal screen and the resolution of the key signal screen may be equal or different.
  • the resolution of the fill signal picture and the key signal picture are not equal, after the fill signal picture and the key signal picture are combined into the video stream to be displayed, the new video stream obtained will have subtitle redundancy or missing subtitles And other subtitle effects.
  • the resolution of the fill signal picture and the resolution of the key signal picture are equal.
  • the resolution of the display area is twice the resolution of the filled signal picture or the resolution of the key signal picture.
  • the width of the resolution of the display area is twice the width of the resolution of the fill signal screen or the key signal screen.
  • the height of the resolution of the display area is twice the height of the resolution of the filled signal picture or the key signal picture.
  • the resolution of the filled signal screen and the resolution of the key signal screen can be equal to the resolution of the display screen of the computer after being scaled by a preset ratio, for example, the display area is a Web page.
  • the display area is designed in advance. After opening the Web application, the Web page is directly twice the resolution of the display screen.
  • the display area is obtained by stretching a web page with a resolution equal to the resolution of the display screen of the computer based on the World Wide Web Web application, and the resolution of the stretched web page is that of the display screen of the computer The resolution is twice as large.
  • the width of a Web page with a resolution equal to that of the display screen of the computer is stretched to twice the width of the display screen of the computer to obtain the stretched Web page.
  • the height of a Web page with a resolution equal to that of the display screen of the computer is stretched to twice the height of the display screen of the computer to obtain the stretched Web page.
  • the first preset subtitle template may include subtitle display information such as a subtitle display position and/or subtitle display content.
  • the subtitle display position refers to the position where the subtitles are displayed in the new video stream. Referring to FIG. 4, the subtitles are displayed in the areas A and B of the new video stream.
  • the subtitle display content refers to the subtitle information displayed in the new video stream, such as text, patterns, colors, shapes and other static information.
  • the second preset template is used to indicate the transparency effect of each pixel in the filled picture in the new video stream. Specifically, the transparency effect of each pixel in the filled signal picture in the new video stream is determined according to the brightness of the pixel at the corresponding position in the key signal picture.
  • the area of the first preset subtitle template corresponds to the area of the second subtitle preset template.
  • area A, area B, and area C of the first preset subtitle template require the assistance of the second preset subtitle template and have special effects, then area A and the second preset of the first preset subtitle template
  • the position and size of the area A'of the subtitle template are the same, the area B of the first preset subtitle template and the position B of the second preset subtitle template are the same, the area C of the first preset subtitle template and the second pre Let the position and size of C'of the subtitle template be the same.
  • the area of the new video stream corresponds to the area of the first preset subtitle template
  • the manner in which the area of the new video stream and the area of the first preset subtitle template correspond to the area and the area of the first preset subtitle template The corresponding manner of the area of the second preset subtitle template is similar, and will not be repeated here.
  • the brightness of each pixel in the key signal screen can be designed according to needs, so that the subtitles in different areas of the new video stream have different transparency effects.
  • the brightness of each pixel in the key signal screen is based on the subtitle display position of the subtitle template of the first preset template (that is, the display position of the subtitle data), and/or the subtitle display content, and/or the preset subtitle
  • the subtitle effect corresponding to the data is determined.
  • the first preset subtitle template includes an area A, an area B, and an area C.
  • a portion corresponding to the area A in the new video stream and a portion corresponding to the area B in the new video stream need to be displayed transparently.
  • the part of the new video stream corresponding to the region C is non-transparent, and the transparency of the part of the new video stream corresponding to the region A is higher than the transparency of the part of the new video stream corresponding to the region B.
  • the brightness of each pixel in area A', area B'and area C'in the screen is designed. Specifically, the greater the brightness of each pixel in the key signal picture, the greater the transparency of the position of the corresponding pixel in the new video stream.
  • the brightness of each pixel of the display position of the same caption data in the key signal screen is the same.
  • the first preset subtitle template includes three subtitle data display areas of area A, area B, and area C, and the brightness of each pixel of area A′ of the key signal screen is set to In the first brightness, the brightness of each pixel in the area B'of the key signal screen is set to the second brightness, and the brightness of each pixel in the area C'in the key signal screen is set to the third brightness.
  • the transparency of the filled signal picture in the new video stream corresponding to the area A of each pixel is the same, and the transparency of the filled signal picture in the new video stream corresponding to the area B of each pixel is the same.
  • the transparency of each pixel in the part corresponding to the region C in the video stream is also the same.
  • the first brightness, the second brightness, and the third brightness are different. For example, if the first brightness is 0, the second brightness is 50, and the third brightness is 255, the filled signal picture corresponds to the new video stream.
  • the transparency of each pixel in the part of area A is the largest and completely transparent; the transparency of each pixel in the part of area C corresponding to area C in the new video stream is the smallest and opaque; the signal of the fill signal is new in the new video stream
  • the transparency of each pixel in the part corresponding to area B in is between completely transparent and opaque.
  • the first brightness, the second brightness, and the third brightness are partially or completely the same.
  • the brightness of each pixel of the display position of the same caption data in the key signal picture is at least partially different, so that the filled signal picture can present different transparency effects at the corresponding position of the new video stream.
  • filling the area D in the signal picture corresponds to the area D′ in the key signal picture, and needs to fill the transparency gradient effect of the signal picture in the part corresponding to the area D of the new video stream, such as transparency From left to right (in the direction of the arrow in FIG. 5)
  • the brightness of each pixel of the area D'in the key signal screen can be set to a gradually decreasing trend from left to right, and the fill signal can be achieved
  • the transparency of the part of the picture corresponding to the area D in the new video stream is gradually increasing.
  • the position of some pixels filled in the signal screen can be set as the display position of the subtitle data, and the brightness of each pixel in the position corresponding to the display position of the subtitle data in the key signal screen can be set to make the new
  • the area picture corresponding to the display position of the subtitle data in the video stream is covered by the subtitle data.
  • the entire fill signal picture can be set to the display position of the subtitle data, and by setting the brightness of each pixel of the entire area of the key signal picture, the video stream picture to be displayed is completely covered, so that the new Of the video stream becomes hazy.
  • the first preset subtitle template and/or the second preset subtitle template can be adjusted according to one or more real dynamics of subtitle data, local data, and computer input data, so that new video streams are generated Different subtitle effects.
  • the real-time dynamic adjustment process of the first preset subtitle template and the second preset template may include the following steps:
  • Step S601 Determine the preset subtitle effect corresponding to the subtitle data
  • the subtitle display content is static information.
  • the subtitle effect in this step may include static information, and may also include dynamic information (such as the change process of the subtitle shape).
  • the subtitle effect may include one or more of animation effects, display effects, and hidden effects.
  • the animation effects may include gradient, fly in, fly out, blinds, bounce, zoom in, zoom out, etc.
  • Display effects can include gradients, fly-in, fly-out, blinds, bounces, the transparency of the subtitle data at the specified position in the new video stream gradually increases along the specific direction or the transparency gradually decreases along the specific direction, the display of different subtitle data Duration, position change of caption data, shape of caption data, etc.
  • the display effect may include an animation effect and other data information for indicating the change of subtitles.
  • the subtitle data 1 needs to be synthesized in the upper left corner of the new video stream in a fly-in manner and move from left to right to the upper right corner of the new video stream at a preset speed within 1 s.
  • the data format of the subtitle data 1 is switched from "Song" to "Kai”.
  • the animation effect includes fly-in, while the display effect includes fly-in, and the subtitle data 1 starts from the new video The upper left corner of the stream moves to the upper right corner of the new video stream and the data format of subtitle data 1 is switched from "Song" to "Kai”. It can be seen that the display effect in this implementation is richer than the animation effect.
  • the hidden effect of subtitle data may include hidden effects such as mosaic overlay and picture overlay.
  • the subtitle effects corresponding to different subtitle data can be selected according to needs, for example, subtitle data 1 corresponds to the animation effect of flying in, and subtitle data 2 corresponds to the animation effect of the blinds.
  • the subtitle effects corresponding to different display positions of the subtitle data may be fixed, as shown in FIG. 7, the subtitle effect of area A is flying in, and the subtitle effect of area B is bounce.
  • the subtitle effect corresponding to the display position of different subtitle data changes with time and/or subtitle display content. For example, the subtitle effect of area A at the first moment is flying in, and the subtitle effect at the second moment is flying out, The subtitle effect at the third moment is blinds and so on.
  • Step S602 Adjust the display information of the content in the first preset subtitle template and/or the second preset subtitle template according to the subtitle effect, so that a subtitle effect is generated in the new video stream.
  • the adjusted display information may include a change in the display position of the subtitle data, a change in the shape of the subtitle data, and/or a duration for displaying the subtitle data, and so on.
  • a countdown display of competitive games is required, for example, "5", “4", “3”, “2”, “1”, and “0” are displayed in sequence in the center area of the new video stream ,
  • the duration of each number display is 1s, each number in the center area of the new video stream is gradually reduced by the preset size (the preset size is determined according to the size of the center area) until it disappears, and each number is in the new
  • the transparency of each video stream is different, you can load the numbers “5", "4", “3”, “2”, “1” and “0” in the center area of the first preset subtitle template, and Adjust the duration of the first preset template display number "5", "4", “3", “2”, “1” and “0” are 1s, at the same time, adjust the center area display of the first preset template
  • the animation effect of the numbers "5", "4", “3", “2”, “1”, and “0” is “gradual reduction from the preset size until disappearance”.
  • the brightness of each number display
  • the animation effect of displaying the subtitle data in the area E in the first preset subtitle template can be set to Fly-in, so that the area E in the new video stream displays the subtitle data in the fly-in mode.
  • the area F of the new video stream screen needs to display subtitle data whose transparency gradually increases in the direction of the arrow shown in FIG. 7, and the second preset
  • the brightness of each pixel at the position of the corresponding area F in the subtitle template is set to gradually increase in the direction of the arrow as shown in FIG. 7, so that the transparency of the subtitle data displayed in the area F in the new video stream is as shown in FIG. 7.
  • the direction of the arrow shows gradually increasing.
  • Step S203 transmitting the fill signal picture to the guide station, and transmitting the key signal picture to the guide station, so that the guide station synthesizes the video stream to be displayed according to the fill signal picture and the key signal picture and obtains a new video stream.
  • the guide station of this embodiment includes a shooting device, which is used to obtain a video stream to be displayed.
  • the shooting device is used for shooting competitive games videos.
  • the video stream to be displayed includes one or more of a confrontation video stream of an opponent, a video stream of an athlete, a video stream of a commentator, and a video stream of an audience during a competitive game, and may include other videos. flow.
  • the video output device of the computer is connected to the guide station, for example, the video output device of the computer and the guide station are connected by a signal line.
  • the computer-based video output device transmits the fill signal picture to the guide station and the key signal picture to the guide station.
  • the general equipment of the common computing system is used, and the development cost is low.
  • the video output device may include a graphics card or a non-editing card.
  • the computer projects the fill signal screen and the key signal screen in step S202 to the guide station through the computer's graphics card to achieve the purpose of real-time transmission of the fill signal screen and the key signal screen.
  • the computer transmits the fill signal screen and the key signal screen in step S202 to the guide station through the non-editing card of the computer, so as to realize the purpose of real-time transmission of the fill signal screen and the key signal screen.
  • the computer after acquiring the subtitle data, the computer further includes the following steps:
  • Step S801 call a preset instruction corresponding to the subtitle data
  • Step S802 Broadcast a preset instruction.
  • the broadcast preset instruction refers to that the computer directly informs the guide station, the third-party website, etc. of the preset instruction. After obtaining the preset instruction, the guide station, the third-party website, etc., according to the preset instruction Take the appropriate action.
  • the preset instructions may include one or more of audio playback instructions, network interface calling instructions, and guide station instructions.
  • the preset commands are not limited to the above listed ones, but may also include others, such as light display commands.
  • the network interface call instruction is mainly directed to a third-party website, and the network interface call instruction can trigger the guide station to push a new video stream to the cloud, so that the third-party website can obtain the new video stream from the cloud and play it, or ,
  • the network interface call instruction instructs the third-party website to access the computer of the guidance system and directly receives the broadcast message generated by the computer, to ensure the release of real-time event data during the live streaming of the new video stream on the third-party website.
  • the guide station after the guide station obtains a new video stream, it can display the new video stream through a live screen (such as a competitive game scene), or push the new video stream to the cloud through a video push streaming server, and then The third-party website plays the new video stream obtained from the cloud.
  • a live screen such as a competitive game scene
  • a video push streaming server a video push streaming server
  • a competitive game when a competitive object (such as a robot) bleeds, a first specific sound effect needs to be played in a new video stream.
  • the computer can call the first sound effect playback instruction corresponding to the blood loss data of the competitive object and perform Broadcast, the broadcast message can be directly transmitted to the on-site audio playback device or third-party website, and after receiving the broadcast message, the on-site audio playback device or third-party website will directly play with the first specific sound effect.
  • the competitive object dies, the second specific sound effect needs to be played in the new video stream.
  • the computer can call and broadcast a second audio effect playback instruction corresponding to the death state of the competitive object and broadcast it.
  • the broadcast message can be directly transmitted to the live After receiving the broadcast message, the audio playback device (that is, the audio playback device at the game site) or a third-party website will directly play the specific sound effect.
  • the guide station needs to switch the display scene of the video stream to be displayed, such as replaying a part of the video screen of the competitive object currently in the state of death in the current competitive game, or appearing to the competitive object
  • the screen of the life-death state is enlarged, and the computer can call a guide station instruction for instructing the guide station to switch the display scene of the video stream to be displayed and broadcast to the guide station to instruct the guide station to switch the display scene of the video stream to be displayed.
  • the computer can call the light display instruction and broadcast, the broadcast message is directly transmitted to the scene lighting control module, and the scene lighting control module receives the After broadcasting the message, the scene lights will be controlled to be all bright.
  • the computer can trigger the third-party website to directly execute the event corresponding to the preset instruction by broadcasting the preset instruction, such as the audio effect playback corresponding to the audio playback instruction, so that the third-party website can play the sound effect in time, ensuring that the third-party website broadcasts a new video stream The release of real-time event data during the process.
  • the preset instruction such as the audio effect playback corresponding to the audio playback instruction
  • step S801 specifically, the computer receives the preset event signal corresponding to the subtitle data, and calls the preset instruction corresponding to the preset event signal.
  • the generation of the preset event signal may include one or more of generation based on input data of the computer, generation based on local control data, and generation based on control data sent by an external device.
  • the preset event signal is an audio playback indication signal, a network interface call indication signal or a guide station indication signal, etc.
  • the video stream to be displayed is a video stream during a competitive game
  • the control data includes competitive data.
  • the local control data is the local pre-stored athletic data of the computer
  • the control data sent by the external device is the athletic data during the athletic competition process sent by the external device
  • the athletic data may include the quantity data, blood volume data, and location of the athletic objects One or more of data, competitive score data, life status data, etc.
  • the preset event signal is a guide station instruction signal generated based on the local input data of the computer. For example, when the computer keyboard Ctrl key + Enter button is pressed at the same time, the computer generates a guide station to be displayed The guide signal indicating the scene switching of the video stream.
  • the guide station indication signal may also be generated based on local control data and/or based on control data sent by an external device.
  • the preset event signal is a network interface call instruction signal generated based on the local control data of the computer.
  • the sound effect data corresponding to the blood loss data of the competitive object is pre-stored locally, and the computer determines the blood loss of the competitive object
  • a network interface call instruction instruction for instructing a third-party website to play the sound effect data corresponding to the bleeding data of the competitive object is generated.
  • the network interface call instruction signal can also be generated based on the input data of the computer and/or based on the control data sent by the external device.
  • the preset event signal is an audio playback instruction signal generated based on control data sent by an external device.
  • the computer receives the death state of the competitive object, the computer generates an instruction to play specific audio data. Audio playback indicator.
  • the audio playback instruction signal can also be generated based on local control data and/or based on computer input data.
  • the video subtitle processing method of the embodiment of the present invention can realize the online loading of subtitle data by using a preset application on a computer to realize the filling signal screen and key signal screen, without the need to purchase a dedicated subtitle machine, which reduces the cost and
  • Design the first preset subtitle template and the second preset subtitle template which can render the fill signal screen and the key signal screen at the same time to ensure the synchronous rendering requirements of the two screens; in addition, the fill signal screen and the key signal are obtained by computer rendering
  • the guide station uses the back-synthesis technology to synthesize the fill signal picture and the key signal picture into the video stream to be displayed to meet the data display requirements of the real scene, so that the obtained video subtitles meet the broadcast level requirements.
  • the storage medium may be a magnetic disk, an optical disk, a read-only memory (Read-Only Memory, ROM) or a random access memory (Random Access Memory, RAM), etc.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Studio Circuits (AREA)

Abstract

一种视频的字幕处理方法和导播系统，所述方法包括：获取字幕数据；在预设应用的显示区域的第一预设字幕模板上渲染所述字幕数据生成填充信号画面，所述显示区域还包括第二预设字幕模板，所述第二预设字幕模板为所述填充信号画面对应的键信号画面；将所述填充信号画面传输至导播台，并将所述键信号画面传输至所述导播台，以使得所述导播台根据所述填充信号画面和所述键信号画面对待显示的视频流进行合成并得到新的视频流。通在计算机上采用预设应用实现填充信号画面和键信号画面，即可实现字幕数据的在线加载，无需购买专用字幕机，降低了硬件成本，且借助于预设应用的灵活性，字幕处理的自动化程度高、实时性强、自由度高、适用范围广泛。

Description

视频的字幕处理方法和导播系统 技术领域
本发明涉及视频字幕处理领域，尤其涉及一种视频的字幕处理方法和导播系统。
背景技术
在电视广播领域，广泛采用的非线性视频编辑设备对字幕进行制作和编排，非线性视频编辑设备采用离线方式编排字幕内容，并在指定时刻进行播放，这种方式成本高、无法满足实时性要求。面对实时性高的直播现场，当字幕内容只能临时提供时，通常工作人员采用字幕机系统进行现场字幕制作，再根据导播指令进行播放，然而，现场人工制作、播放易出错，难以满足数据项更新频繁、数据项多的场景。相关技术中，还存在一些网络直播软件，如OBS，直接将字幕和视频在不同层次窗口叠加，然后再对叠加结果进行捕捉，但这种字幕与视频的叠加效果比较简陋，输出质量无法满足广播级要求。此外，在一些字幕处理方案中，采用弹幕技术从服务器端获取新弹幕内容，将新弹幕内容显示在视屏上方，弹幕在播放端视频上方呈现，这种字幕处理方式并非在视频源端进行去背合成，无法满足广播级需求。
发明内容
本发明提供一种视频的字幕处理方法和导播系统。
具体地，本发明是通过如下技术方案实现的：
根据本发明的第一方面，提供一种视频的字幕处理方法，所述方法包括：
获取字幕数据；
在预设应用的显示区域的第一预设字幕模板上渲染所述字幕数据生成填充信号画面，所述显示区域还包括第二预设字幕模板，所述第二预设字幕模板为所述填充信号画面对应的键信号画面；
将所述填充信号画面传输至导播台，并将所述键信号画面传输至所述导播台，以使得所述导播台根据所述填充信号画面和所述键信号画面对待显示的视频流进行合成并得到新的视频流。
根据本发明的第二方面，提供一种导播系统，所述导播系统包括计算机和导播台，所述计算机和所述导播台通信连接；其中，所述计算机用于获取字幕数据，并在预设应用的显示区域的第一预设字幕模板上渲染所述字幕数据生成填充信号画面，所述显示区域还包括第二预设字幕模板，所述第二预设字幕模板为所述填充信号画面对应的键信号画面；
所述计算机还用于将所述填充信号画面传输至导播台，并将所述键信号画面传输至所述导播台；所述导播台根据所述填充信号画面和所述键信号画面对待显示的视频流进行合成并得到新的视频流。
由以上本发明实施例提供的技术方案可见，通在计算机上采用预设应用实现填充信号画面和键信号画面，即可实现字幕数据的在线加载，无需购买专用字幕机，降低了硬件成本，且借助于预设应用的灵活性，字幕处理的自动化程度高、实时性强、自由度高、适用范围广泛；同时，采用预设应用的同一显示区域中设计第一预设字幕模板和第二预设字幕模板，可以将填充信号画面和键信号画面同时进行渲染，确保两个画面的同步渲染要求；另外，在计算机渲染获得填充信号画面和键信号画面后，再由导播台采用去背合成技术将填充信号画面和键信号画面合成到待显示的视频流中，满足现实场景的数据显示需求，使获得的视频字幕满足广播级要求。
附图说明
为了更清楚地说明本发明实施例中的技术方案，下面将对实施例描述中所需要使用的附图作简单地介绍，显而易见地，下面描述中的附图仅仅是本发明的一些实施例，对于本领域普通技术人员来讲，在不付出创造性劳动性的前提下，还可以根据这些附图获得其他的附图。
图1是本发明一实施例中的导播系统的结构框图；
图2是本发明一实施例中的视频的字幕处理方法的方法流程图；
图3是本发明一实施例中的导播系统的一具体结构框图；
图4是本发明一实施例中的填充信号画面和键信号画面的显示图；
图5是本发明一实施例中的填充信号画面和键信号画面的另一显示图；
图6是本发明一实施例中的视频的字幕处理方法的一种具体方法流程图；
图7是本发明一实施例中的由填充信号画面和键信号画面合成至待显示的视频流所获得的新的视频流画面图；
图8是本发明一实施例中的视频的字幕处理方法的另一种具体方法流程图。
具体实施方式
下面将结合本发明实施例中的附图，对本发明实施例中的技术方案进行清楚、完整地描述，显然，所描述的实施例仅仅是本发明一部分实施例，而不是全部的实施例。基于本发明中的实施例，本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例，都属于本发明保护的范围。
下面结合附图，对本发明的视频的字幕处理方法和导播系统进行详细说明。在不冲突的情况下，下述的实施例及实施方式中的特征可以相互组合。
相关技术中，导播系统包括字幕机和导播台。其中，字幕机和导播台基于视频信号传输接口建立通信连接，字幕机通常采用专用字幕软件和字幕硬件卡配合生产填充信号画面和键信号画面，并通过视频信号传输接口填充信号画面和键信号画面发送至导播台，由导播台基于去背合成技术将填充信号和键信号合成到待显示的视频流中。
采用字幕硬件卡导致导播系统硬件花费投入较高，而不同厂商的字幕软件和字幕硬件卡并没有形成统一的标准并且闭源，若重新开发一个兼容不同字幕文件的字幕软件和字幕硬件卡，开发成本会比较高。另外，字幕机的字幕文件通常是离线制作，且大部分字幕机无法接受网络数据并实时修改字幕内容，存在实时性差的缺点。
基于此，本发明实施例的导播系统采用计算机替代字幕机，通过计算机获取字幕数据，并基于计算机上的预设应用对字幕数据进行渲染生成填充信号画面和键信号画面，实现字幕数据的在线加载，硬件成本低、自动化程度高、实时性强、自由度高、适用范围广泛。
图1是本发明一实施例中的导播系统的结构图。如图1所示，本发明实施例的导播系统可包括计算机和导播台，其中，计算机与导播台通信连接。可选的，计算机的视频输出设备与导播台相连。
图2是本发明一实施例中的视频的字幕处理方法的方法流程图。需要说明的是，本实施例的视频的字幕处理方法的执行主体为计算机(即导播系统的计算机)。如图2所示，本发明实施例的视频的字幕处理方法可包括如下步骤：
步骤S201：获取字幕数据；
该步骤中，计算机获取的字幕数据可包括离线数据，也可包括在线数据。其中，字幕数据可以包括文字、图片和/或视频等。
在一些实施例中，如图3所示，字幕数据可包括本地数据、计算机的输入数据、外部设备发送的数据中的一种或多种。可以理解的是，字幕数据的类型并不限于上述实施例所列举的数据类型，还可包括其他数据类型。
其中，本地数据为存储在计算机的磁盘中的数据，本地数据通常为离线数据。
计算机的输入数据可为接触式的输入数据，如用户通过键盘、鼠标等输入的数据，也可为计算机读取的插接在该计算机上的U盘、移动硬盘等存储的数据；计算机的输入数据还可为非接触式的输入数据，如计算机自带的识别模块基于感应方式(如人脸识别、声音识别等)获取的数据、计算机通过APP获取的数据等。
外部设备与计算机通信连接(有线、无线或其他通信方式)，外部设备发送的数据可为该外部设备实时的采集数据，也可为该外部设备根据实时的采集数据分析确定的数据。以视频的字幕处理方法以应用在竞技比赛为例来阐述步骤S201中的字幕数据，本实施例中，字幕数据可包括竞技比赛过程中的竞技数据和/或基于竞技数据分析 确定的数据。当然，字幕数据还可包括非竞技数据。
其中，竞技比赛可为现实场景中的比赛，如具有真实的竞技对象、真实的竞技选手(可控制竞技对象)的比赛，或者无竞技对象，但包括真实的竞技选手的比赛(如拳击)。竞技比赛还可为虚拟竞技比赛(如MOBA)，竞技对象为虚拟的竞技对象，竞技选手为真实的竞技选手。
无论是显示场景中的比赛，还是虚拟竞技比赛，竞技比赛通常包括裁判系统和/或赛事系统。
在现实场景中的竞技比赛中，裁判系统用于确定真实的竞技选手操作真实的竞技对象进行比赛的过程中的竞技结果，或者用于确定真实竞技选手之间直接进行比赛的过程中的竞技结果。在虚拟竞技比赛中，裁判系统用于确定真实的竞技选手操作虚拟的竞技对象进行比赛过程中的竞技结果。
无论是现实场景的竞技比赛，还是虚拟竞技比赛，赛事系统通常用于确定该竞技比赛过程中的竞技规则。
在一实施例中，在导播系统的计算机中可以集成该裁判系统和赛事系统的功能，字幕数据均由该导播系统的计算机进行处理。
在另一实施例中，裁判系统和/或赛事系统可以为独立于导播系统的计算机设置的服务器，裁判系统和/或赛事系统在获得竞技数据后，将竞技数据发送至导播系统的计算机，从而作为字幕数据。可选的，竞技数据为裁判系统将该裁判系统实时的采集数据和/或基于该裁判系统实时的采集数据进行分析获得的数据，如对抗对象的状态数据、用于控制对抗对象的竞技选手的数据、竞技比赛过程中评论员的数据。可选的，竞技数据为赛事系统确定的竞技规则。
本实施例中，该竞技数据包括对抗对象的状态数据、用于控制对抗对象的竞技选手的数据、竞技比赛过程中评论员的数据、竞技规则数据中的一种或多种，竞技数据还可包括其他数据，在此不一一列举。
步骤S202：在预设应用的显示区域的第一预设字幕模板上渲染字幕数据生成填充信号画面(即RGB信号画面)，显示区域还包括第二预设字幕模板，第二预设字幕模板为填充信号画面对应的键信号画面(即ALPHA信号画面)；
其中，预设应用可包括万维网Web应用，如各类浏览器应用，预设应用还可以是诸如桌面word、PPT、照片编辑器等。
作为一种可行的实现方式，预设应用为万维网Web应用，相对而言，Web应用易于开发，且能够支持文字、图片、视频等内容的展示，并可通过脚本语言实现用户交互式操作以及动态效果。
另一方面，Web应用实现字幕数据的在线获取更加容易，例如，在竞技比赛中， 裁判系统和/或赛事系统可与计算机进行网络通信，裁判系统和/或赛事系统通过网络通讯协议如超文本传输协议HTTP(HyperText Transfer Protocol)等直接发送数据至计算机的Web应用中，实现字幕数据的在线加载，数据传输的实时性强。
填充信号画面的分辨率和键信号画面的分辨率可相等，也可不相等。当填充信号画面的分辨率和键信号画面的分辨率不相等时，将填充信号画面和键信号画面合成至待显示的视频流中后，获得的新的视频流会出现字幕冗余或字幕缺失等字幕效果。为避免字幕冗余或字幕缺失，本实施例中，填充信号画面的分辨率和键信号画面的分辨率相等。
可选的，显示区域的分辨率是填充信号画面的分辨率或键信号画面的分辨率的两倍。例如，在其中一些实施例中，如图4所示，显示区域的分辨率的宽度是填充信号画面或键信号画面的分辨率的宽度的两倍。在另一些实施例中，显示区域的分辨率的高度是填充信号画面或键信号画面的分辨率的高度的两倍。
作为一种可行的实现方式，填充信号画面的分辨率和键信号画面的分辨率在通过预设比例缩放后，可以与该计算机的显示屏幕的分辨率大小相等，如显示区域为Web网页。可选的，显示区域预先设计，打开Web应用后，Web网页直接为显示屏幕的分辨率大小两倍。可选的，显示区域为基于万维网Web应用将一分辨率大小与计算机的显示屏幕的分辨率大小相等的Web网页进行拉伸获得，拉伸后的Web网页的分辨率大小为计算机的显示屏幕的分辨率大小两倍。可选的，基于万维网Web应用将一分辨率大小与计算机的显示屏幕的分辨率大小相等的Web网页的宽度拉伸成计算机的显示屏幕的宽度的两倍，获得拉伸后的Web网页。可选的，基于万维网Web应用将一分辨率大小与计算机的显示屏幕的分辨率大小相等的Web网页的高度拉伸成计算机的显示屏幕的高度的两倍，获得拉伸后的Web网页。
可选的，预设应用的显示区域上无菜单栏和/或无虚拟按钮，以避免菜单栏和/或虚拟按钮对显示区域造成的遮挡。
本实施例中，第一预设字幕模板可包括字幕显示位置和/或字幕显示内容等字幕显示信息。其中，字幕显示位置是指新的视频流中显示字幕的位置，参见图4，新的视频流的区域A和区域B进行字幕显示。字幕显示内容是指新的视频流中显示的字幕信息，如文字、图案、颜色、形状等静态信息。
第二预设模板用于指示填充画面中各个像素点在新的视频流中的透明效果。具体的，填充信号画面中各个像素点在新的视频流中的透明效果为根据键信号画面中对应位置的像素点的亮度确定。
本实施例中，第一预设字幕模板的区域和第二字幕预设模板的区域相对应。例如，图4中，第一预设字幕模板的区域A、区域B、区域C需要第二预设字幕模板的辅助而具有特殊效果，则第一预设字幕模板的区域A与第二预设字幕模板的区域A’ 的位置和大小相同，第一预设字幕模板的区域B与第二预设字幕模板的B’的位置和大小相同，第一预设字幕模板的区域C和第二预设字幕模板的C’的位置和大小相同。相应的，新的视频流的区域和第一预设字幕模板的区域也相对应，新的视频流的区域和第一预设字幕模板区域相对应的方式与第一预设字幕模板的区域和第二预设字幕模板的区域相对应方式相类似，此处不再赘述。
具体可根据需要设计键信号画面中各像素点的亮度，从而使得新的视频流的不同区域的字幕具有不同的透明效果。可选的，键信号画面中各像素点的亮度是根据第一预设模板字幕模板的字幕显示位置(即字幕数据的显示位置)、和/或字幕显示内容、和/或预设的与字幕数据对应的字幕效果等确定。如图4所示，第一预设字幕模板包括区域A、区域B和区域C，最终需要在新的视频流中对应区域A的部分和新的视频流中对应区域B的部分进行透明显示，新的视频流中对应区域C的部分非透明显示，且新的视频流中对应区域A的部分的透明度高于新的视频流中对应区域B的部分的透明度，则可根据上述需求对键信号画面中区域A’、区域B’和区域C’的各像素点的亮度进行设计。具体的，键信号画面中各像素点的亮度越大，填充信号画面在新的视频流中对应该像素点的位置的透明度越大。
可选的，键信号画面中同一字幕数据的显示位置的各个像素点的亮度相同。作为一可行的实现方式，参见图4，第一预设字幕模板包括区域A、区域B和区域C三个字幕数据的显示位置，将键信号画面的区域A’的各个像素点的亮度设置为第一亮度，键信号画面的区域B’的各个像素点的亮度设置为第二亮度，键信号画面中区域C’的各个像素点的亮度设置为第三亮度。最终，填充信号画面在新的视频流中对应区域A的部分各像素点的透明度相同，填充信号画面在新的视频流中对应区域B的部分各像素点的透明度相同，填充信号画面在新的视频流中对应区域C的部分各像素点的透明度也相同。
在一些例子中，第一亮度、第二亮度和第三亮度各不相同，如第一亮度为0，第二亮度为50，第三亮度为255，则填充信号画面在新的视频流中对应区域A的部分的各个像素点的透明度最大，为完全透明的；填充信号画面在新的视频流中对应区域C的部分的各个像素点的透明度最小，为不透明；填充信号画面在新的视频流中对应区域B的部分的各个像素点的透明度介于完全透明和不透明之间。
在另一些例子中，第一亮度、第二亮度和第三亮度部分或完全相同。可选的，键信号画面中同一字幕数据的显示位置的各个像素点的亮度至少部分不相同，从而使得填充信号画面在新的视频流的对应位置能够呈现不同的透明效果。作为一可行的实现方式，参见图5，填充信号画面中的区域D对应键信号画面中的区域D’，需要填充信号画面在新的视频流对应区域D的部分的透明度渐变的效果，如透明度从左至右(图5中箭头方向)逐渐减小，则可将键信号画面中的区域D’的各个像素点的亮度大小设置成从左至右逐渐减小的趋势，即可实现填充信号画面在新的视频流中对应区 域D的部分的透明度呈逐渐增大的渐变效果。
通常情况下，可以将填充信号画面的部分像素点的位置设置成字幕数据的显示位置，并通过设置键信号画面中与字幕数据的显示位置对应的位置的各像素点的亮度大小，使得新的视频流中与字幕数据的显示位置对应的区域画面被字幕数据所覆盖。
而在一些实施例中，可将整个填充信号画面设置成字幕数据的显示位置，并通过设置键信号画面的整个区域的各像素点的亮度大小，将待显示的视频流画面全部覆盖，使得新的视频流画面变成朦胧状态。
本实施例中，第一预设字幕模板和/或第二预设模板可根据字幕数据、本地数据、计算机的输入数据中的一种或多种实动态调整，从而使得新的视频流中产生不同的字幕效果。
作为一种可行的实现方式，参见图6，第一预设字幕模板和第二预设模板的实时动态调整过程可包括如下步骤：
步骤S601：确定预设的与字幕数据对应的字幕效果；
如上述实施例所述，字幕显示内容为静态信息，然而，与字幕显示内容不同的是，该步骤中的字幕效果可包括静态信息，还可包括动态信息(如字幕形状的变化过程)。
本实施例中，字幕效果可包括动画效果、显示效果、隐藏效果中的一种或多种。其中，动画效果可包括渐变、飞入、飞出、百叶窗、弹跳、放大、缩小等。
显示效果可包括渐变、飞入、飞出、百叶窗、弹跳、新的视频流中指定位置的字幕数据的透明度沿着特定方向逐渐增大或透明度沿着特定方向逐渐减小、不同字幕数据显示的持续时间、字幕数据的位置变化、字幕数据的形状等。
需要说明的是，显示效果可以包含动画效果和其他用于指示字幕变化的数据信息。例如，在一具体实现方式中，字幕数据1需要以飞入的方式合成在新的视频流的左上角，并在1s时间内以预设速度从左至右移动至新的视频流的右上角，并且，在0.5s时，将字幕数据1的数据格式由“宋体”切换成“楷体”，本实现方式中，动画效果包括飞入，而显示效果则包括飞入、字幕数据1从新的视频流的左上角移动至新的视频流的右上角以及字幕数据1的数据格式由“宋体”切换成“楷体”，可见，本实现方式中的显示效果相比动画效果的内容更加丰富。
字幕数据的隐藏效果可包括马赛克覆盖、图片覆盖等隐藏效果。可选的，不同的字幕数据对应的字幕效果可根据需要选择，例如，字幕数据1对应飞入的动画效果，字幕数据2对应百叶窗的动画效果。可选的，不同的字幕数据的显示位置对应的字幕效果可固定不变，如图7所示的区域A的字幕效果为飞入，区域B的字幕效果为弹跳。可选的，不同的字幕数据的显示位置对应的字幕效果随时间和/或字幕显示内容变化， 例如，区域A在第一时刻的字幕效果为飞入，第二时刻的字幕效果为飞出，第三时刻的字幕效果为百叶窗等等。
步骤S602：根据字幕效果，调整第一预设字幕模板和/或第二预设字幕模板中内容的显示信息，以使得在新的视频流中产生字幕效果。
该步骤中，调整的显示信息可以包括字幕数据的显示位置的变化、字幕数据的形状的变化和/或字幕数据进行显示的持续时间等等。
在一具体实现方式中，需要进行竞技比赛倒计时的显示，如，在新的视频流的中心区域依次显示“5”、“4”、“3”、“2”、“1”和“0”，每个数字显示持续的时长为1s，每个数字在新的视频流的中心区域由预设大小(根据中心区域的大小确定该预设大小)逐渐缩小直至消失，并且，每个数字在新的视频流中的透明度各不相同，则可在第一预设字幕模板的中心区域依次加载数字“5”、“4”、“3”、“2”、“1”和“0”，并调整第一预设模板显示数字“5”、“4”、“3”、“2”、“1”和“0”的持续时长分别为1s，同时，调整第一预设模板的中心区域显示数字“5”、“4”、“3”、“2”、“1”和“0”的动画效果为“由预设大小逐渐缩小直至消失”。与此同时，调整第二预设模板的中心区域的各个像素的亮度大小为与各个数字进行显示时所需的透明度对应的亮度大小。
作为一种可行的实现方式，如图7所示，需要在新的视频流画面的区域E显示飞入的字幕数据，可将第一预设字幕模板中区域E显示字幕数据的动画效果设置成飞入，从而使得新的视频流中区域E通过飞入方式显示字幕数据。
作为另一种可行的实现方式，又如图7所示，需实在新的视频流画面的区域F显示沿着如图7所示箭头方向透明度逐渐增大的字幕数据，可将第二预设字幕模板中对应区域F位置的各像素点的亮度大小设置成沿着如图7所示箭头方向逐渐增大，从而使得新的视频流中区域F显示的字幕数据的透明度沿着如图7所示箭头方向逐渐增大。
步骤S203：将填充信号画面传输至导播台，并将键信号画面传输至导播台，以使得导播台根据填充信号画面和键信号画面对待显示的视频流进行合成并得到新的视频流。
本实施例的导播台包括拍摄装置，该拍摄装置用于获取待显示的视频流。例如，对于竞技比赛，拍摄装置用于拍摄竞技比赛视频。可选的，待显示的视频流包括对抗对象的对抗视频流、竞技选手的视频流、评论员的视频流、竞技比赛过程中观众的视频流中的一种或多种，还可包括其他视频流。
本实施例中，计算机的视频输出设备与导播台相连接，例如，通过信号线连接计算机的视频输出设备和导播台。在执行步骤S203时，具体的，基于计算机的视频输出设备，将填充信号画面传输至导播台，并将键信号画面传输至导播台。相对字幕机 而言，利用了普通计算系统的通用设备，开发成本低。
其中，视频输出设备可包括显卡或非编卡。在一些实施例中，计算机将步骤S202中的填充信号画面和键信号画面通过该计算机的显卡投屏至导播台，实现填充信号画面和键信号画面实时传输的目的。在另一些实施例中，计算机将步骤S202中的填充信号画面和键信号画面通过该计算机的非编卡传输至导播台，实现填充信号画面和键信号画面实时传输的目的。
进一步的，在一些实施例中，参见图8，计算机在获取字幕数据之后，还包括如下步骤：
步骤S801：调用与字幕数据相对应的预设指令；
步骤S802：广播预设指令。
需要说明的是，本发明实施例中，广播预设指令是指计算机将预设指令直接告知导播台、第三方网站等，导播台、第三方网站等在获得预设指令后，根据预设指令执行相应的操作。
在一些实施例中，预设指令可包括音频播放指令、网络接口调用指令、导播台指令中的一种或多种。当然，预设指令并不限于上述列举几种，还可包括其他，如灯光显示指令。需要说明的是，网络接口调用指令主要针对第三方网站，网络接口调用指令可触发导播台将新的视频流推流至云端，使得第三方网站可从云端获取该新的视频流并播放，或者，网络接口调用指令指示第三方网站接入导播系统的计算机并直接接收计算机产生的广播消息，确保第三方网站直播新的视频流过程中的实时赛事数据的发布。本实施例中，导播台获得新的视频流后，可将新的视频流通过现场屏幕(如竞技比赛现场)显示，也可通过视频推流服务器将新的视频流推流至云端，再由第三方网站对云端获取的新的视频流进行播放。
以竞技比赛为例进行说明，在竞技对象(如机器人)掉血时，需在新的视频流中播放第一特定音效，计算机可调用与竞技对象掉血数据对应的第一音效播放指令并进行广播，该广播消息可直接传输到现场的音频播放设备或第三方网站，现场的音频播放设备或第三方网站在接收到该广播消息后，会直接播放与该第一特定音效。在竞技对象死掉时，需在新的视频流中播放第二特定音效，计算机可调用与竞技对象死亡生命状态相对应的第二音效播放指令并进行广播，该广播消息可直接传输到现场的音频播放设备(即比赛现场的音频播放设备)或第三方网站，现场的音频播放设备或第三方网站在接收到该广播消息后，会直接播放与该第而特定音效。在一个竞技对象出现死亡生命状态时，需导播台切换待显示的视频流的显示场景，如回播当前出现死亡生命状态的竞技对象在当前场竞技比赛中的部分视频画面，或者对竞技对象出现死亡生命状态的画面进行放大等，计算机可调用用于指示导播台切换待显示的视频流的显示场景的导播台指令并广播至导播台，以指示导播台切换待显示的视频流的显示场景。
在竞技对象战胜对方竞技对象，需控制比赛现场的灯光全亮时，计算机可调用灯光显示指令并进行广播，该广播消息直接传输至现场的灯光控制模块，而现场的灯光控制模块在接收到该广播消息后，会控制现场灯光全亮。
计算机可通过广播预设指令的方式触发第三方网站直接执行与预设指令对应的事件，如音频播放指令对应的音效播放，使得第三方网站能够及时播放音效，确保第三方网站直播新的视频流过程中的实时赛事数据的发布。
在执行步骤S801时，具体的，计算机接收与字幕数据相对应的预设事件信号，并调用与预设事件信号相对应的预设指令。
其中，预设事件信号的生成情况可包括基于计算机的输入数据生成、基于本地控制数据生成、基于外部设备发送的控制数据生成中的一种或多种。可选的，预设事件信号为音频播放指示信号、网络接口调用指示信号或导播台指示信号等。
可选的，待显示的视频流为竞技比赛过程中的视频流，控制数据包括竞技数据。其中，本地控制数据为该计算机的本地预先存储的竞技数据，外部设备发送的控制数据为外部设备发送的竞技比赛过程中的竞技数据，竞技数据可包括竞技对象的数量数据、血量数据、位置数据、竞技分数数据、生命状态数据等中的一种或多种。
作为一种可行的实现方式，预设事件信号为基于计算机的本地输入数据生成的导播台指示信号，如计算机的键盘Ctrl按键+Enter按键同时按下时，计算机生成用于指示导播台进行待显示的视频流的场景切换的导播台指示信号。当然，导播台指示信号还可以基于本地控制数据生成和/或基于外部设备发送的控制数据生成。
作为另一种可行的实现方式，预设事件信号为基于计算机的本地控制数据生成的网络接口调用指令信号，如本地预先存储有竞技对象掉血数据对应的音效数据，计算机在确定竞技对象掉血后，生成用于指示第三方网站播放竞技对象掉血数据对应的音效数据的网络接口调用指示指令。当然，网络接口调用指令信号还可以基于计算机的输入数据生成和/或基于外部设备发送的控制数据生成。
作为又一种可行的实现方式，预设事件信号为基于外部设备发送的控制数据生成的音频播放指示信号，如计算机在接收到竞技对象出现死亡生命状态时，生成用于指示播放特定音频数据的音频播放指示信号。当然，音频播放指示信号还可以基于本地控制数据生成和/或基于计算机的输入数据生成。
本发明实施例的视频的字幕处理方法，通过在计算机上采用预设应用实现填充信号画面和键信号画面，即可实现字幕数据的在线加载，无需购买专用字幕机，降低了成本，且借助于预设应用的灵活性，字幕处理的自动化程度高、实时性强、自由度高、适用范围广泛，尤其适用于字幕数据更新频繁、字幕数据多的场景；同时，采用预设应用的同一显示区域中设计第一预设字幕模板和第二预设字幕模板，可以将填充信号画面和键信号画面同时进行渲染，确保两个画面的同步渲染要求；另外，在计算 机渲染获得填充信号画面和键信号画面后，再由导播台采用去背合成技术将填充信号画面和键信号画面合成到待显示的视频流中，满足现实场景的数据显示需求，使获得的视频字幕满足广播级要求。
本领域普通技术人员可以理解实现上述实施例方法中的全部或部分流程，是可以通过计算机程序来指令相关的硬件来完成，所述的程序可存储于一计算机可读取存储介质中，该程序在执行时，可包括如上述各方法的实施例的流程。其中，所述的存储介质可为磁碟、光盘、只读存储记忆体(Read-Only Memory，ROM)或随机存储记忆体(Random Access Memory，RAM)等。
以上所揭露的仅为本发明部分实施例而已，当然不能以此来限定本发明之权利范围，因此依本发明权利要求所作的等同变化，仍属本发明所涵盖的范围。

Claims (40)

  1. 一种视频的字幕处理方法，其特征在于，所述方法包括：
    获取字幕数据；
    在预设应用的显示区域的第一预设字幕模板上渲染所述字幕数据生成填充信号画面，所述显示区域还包括第二预设字幕模板，所述第二预设字幕模板为所述填充信号画面对应的键信号画面；
    将所述填充信号画面传输至导播台，并将所述键信号画面传输至所述导播台，以使得所述导播台根据所述填充信号画面和所述键信号画面对待显示的视频流进行合成并得到新的视频流。
  2. 根据权利要求1所述的方法，其特征在于，所述填充信号画面中各个像素点在所述新的视频流中的透明效果为根据所述键信号画面中对应位置的像素点的亮度确定。
  3. 根据权利要求1所述的方法，其特征在于，所述第一预设字幕模板和/或所述第二预设模板为根据所述字幕数据、本地数据、计算机的输入数据中的一种或多种实时动态调整。
  4. 根据权利要求3所述的方法，其特征在于，所述第一预设字幕模板包括字幕显示位置和/或字幕显示内容。
  5. 根据权利要求3所述的方法，其特征在于，所述第一预设字幕模板和所述第二预设模板的实时动态调整过程，包括：
    确定预设的与所述字幕数据对应的字幕效果；
    根据所述字幕效果，调整所述第一预设字幕模板和/或所述第二预设字幕模板中内容的显示信息，以使得在所述新的视频流中产生所述字幕效果。
  6. 根据权利要求5所述的方法，其特征在于，所述字幕效果包括动画效果、显示效果、隐藏效果中的一种或多种。
  7. 根据权利要求1所述的方法，其特征在于，所述填充信号画面的分辨率和所述键信号画面的分辨率相等。
  8. 根据权利要求7所述的方法，其特征在于，所述显示区域的分辨率的宽度是所述填充信号画面或所述键信号画面的分辨率的宽度的两倍。
  9. 根据权利要求7所述的方法，其特征在于，所述显示区域的分辨率的高度是所述填充信号画面或所述键信号画面的分辨率的高度的两倍。
  10. 根据权利要求1所述的方法，其特征在于，所述预设应用的显示区域上无菜单栏和/或无虚拟按钮。
  11. 根据权利要求1所述的方法，其特征在于，所述将所述填充信号画面传输至导播台，并将所述键信号画面传输至所述导播台，包括：
    基于计算机的视频输出设备，将所述填充信号画面传输至导播台，并将所述键信号画面传输至所述导播台。
  12. 根据权利要求11所述的方法，其特征在于，所述视频输出设备包括显卡或非编卡。
  13. 根据权利要求1所述的方法，其特征在于，所述字幕数据包括本地数据、所述计算机的输入数据、外部设备发送的数据中的一种或多种。
  14. 根据权利要求13所述的方法，其特征在于，所述外部设备发送的数据包括所述外部设备根据实时的采集数据分析确定的数据。
  15. 根据权利要求1所述的方法，其特征在于，所述获取字幕数据之后，还包括：
    调用与所述字幕数据相对应的预设指令；
    广播所述预设指令。
  16. 根据权利要求15所述的方法，其特征在于，所述调用与所述字幕数据相对应的预设指令，包括：
    接收与所述字幕数据相对应的预设事件信号；
    调用与所述预设事件信号相对应的预设指令。
  17. 根据权利要求16所述的方法，其特征在于，所述预设事件信号的生成情况包括基于计算机的输入数据生成、基于本地控制数据生成、基于外部设备发送的控制数据生成中的一种或多种。
  18. 根据权利要求17所述的方法，其特征在于，所述待显示的视频流为竞技比赛过程中的视频流，所述控制数据包括竞技数据。
  19. 根据权利要求15所述的方法，其特征在于，所述预设指令包括音频播放指令、网络接口调用指令、导播台指令中的一种或多种。
  20. 根据权利要求1所述的方法，其特征在于，所述预设应用包括万维网Web应用。
  21. 一种导播系统，其特征在于，所述导播系统包括计算机和导播台，所述计算机和所述导播台通信连接；其中，所述计算机用于获取字幕数据，并在预设应用的显示区域的第一预设字幕模板上渲染所述字幕数据生成填充信号画面，所述显示区域还包括第二预设字幕模板，所述第二预设字幕模板为所述填充信号画面对应的键信号画面；
    所述计算机还用于将所述填充信号画面传输至导播台，并将所述键信号画面传输至所述导播台；所述导播台根据所述填充信号画面和所述键信号画面对待显示的视频流进行合成并得到新的视频流。
  22. 根据权利要求21所述的导播系统，其特征在于，所述填充信号画面中各个像素点在所述新的视频流中的透明效果为根据所述键信号画面中对应位置的像素点的亮度确定。
  23. 根据权利要求21所述的导播系统，其特征在于，所述第一预设字幕模板和/或所述第二预设模板为根据所述字幕数据、本地数据、计算机的输入数据中的一种或多种实时动态调整。
  24. 根据权利要求23所述的导播系统，其特征在于，所述第一预设字幕模板包括字幕显示位置和/或字幕显示内容。
  25. 根据权利要求23所述的导播系统，其特征在于，所述计算机对第一预设字幕模板和所述第二预设模板的实时动态调整过程，包括：
    确定预设的与所述字幕数据对应的字幕效果；
    根据所述字幕效果，调整所述第一预设字幕模板和/或所述第二预设字幕模板中内容的显示信息，以使得在所述新的视频流中产生所述字幕效果。
  26. 根据权利要求25所述的导播系统，其特征在于，所述字幕效果包括动画效果、显示效果、隐藏效果中的一种或多种。
  27. 根据权利要求21所述的导播系统，其特征在于，所述填充信号画面的分辨率和所述键信号画面的分辨率相等。
  28. 根据权利要求27所述的导播系统，其特征在于，所述显示区域的分辨率的宽度是所述填充信号画面或所述键信号画面的分辨率的宽度的两倍。
  29. 根据权利要求27所述的导播系统，其特征在于，所述显示区域的分辨率的高度是所述填充信号画面或所述键信号画面的分辨率的高度的两倍。
  30. 根据权利要求21所述的导播系统，其特征在于，所述预设应用的显示区域上无菜单栏和/或无虚拟按钮。
  31. 根据权利要求21所述的导播系统，其特征在于，所述计算机包括视频输出设备，所述视频设备与所述导播台通信；
    所述视频输出设备将所述填充信号画面传输至导播台，并将所述键信号画面传输至所述导播台。
  32. 根据权利要求31所述的导播系统，其特征在于，所述视频输出设备包括显卡或非编卡。
  33. 根据权利要求21所述的导播系统，其特征在于，所述字幕数据包括本地数据、所述计算机的输入数据、外部设备发送的数据中的一种或多种。
  34. 根据权利要求33所述的导播系统，其特征在于，所述外部设备发送的数据包括所述外部设备根据实时的采集数据分析确定的数据。
  35. 根据权利要求21所述的导播系统，其特征在于，所述计算机在获取字幕数据之后，还用于调用与所述字幕数据相对应的预设指令，并广播所述预设指令。
  36. 根据权利要求35所述的导播系统，其特征在于，所述计算机具体用于：
    接收与所述字幕数据相对应的预设事件信号，并调用与所述预设事件信号相对应的预设指令。
  37. 根据权利要求36所述的导播系统，其特征在于，所述预设事件信号的生成情况包括基于计算机的输入数据生成、基于本地控制数据生成、基于外部设备发送的控制数据生成中的一种或多种。
  38. 根据权利要求37所述的导播系统，其特征在于，所述待显示的视频流为竞技 比赛过程中的视频流，所述控制数据包括竞技数据。
  39. 根据权利要求35所述的导播系统，其特征在于，所述预设指令包括音频播放指令、网络接口调用指令、导播台指令中的一种或多种。
  40. 根据权利要求21所述的导播系统，其特征在于，所述预设应用包括万维网Web应用。
PCT/CN2018/125396 2018-12-29 2018-12-29 视频的字幕处理方法和导播系统 Ceased WO2020133372A1 (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
PCT/CN2018/125396 WO2020133372A1 (zh) 2018-12-29 2018-12-29 视频的字幕处理方法和导播系统
CN201880068929.4A CN111279687A (zh) 2018-12-29 2018-12-29 视频的字幕处理方法和导播系统

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2018/125396 WO2020133372A1 (zh) 2018-12-29 2018-12-29 视频的字幕处理方法和导播系统

Publications (1)

Publication Number Publication Date
WO2020133372A1 true WO2020133372A1 (zh) 2020-07-02

Family

ID=71002715

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2018/125396 Ceased WO2020133372A1 (zh) 2018-12-29 2018-12-29 视频的字幕处理方法和导播系统

Country Status (2)

Country Link
CN (1) CN111279687A (zh)
WO (1) WO2020133372A1 (zh)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113455012A (zh) * 2020-09-03 2021-09-28 深圳市大疆创新科技有限公司 渲染方法、装置、移动终端和存储介质
CN113573114B (zh) * 2021-07-28 2023-03-28 北京奇艺世纪科技有限公司 一种投屏方法、装置、电子设备及存储介质
WO2023029049A1 (zh) * 2021-09-06 2023-03-09 深圳市大疆创新科技有限公司 字幕切换方法、终端设备及存储介质
CN113873273B (zh) * 2021-09-09 2023-12-26 北京都是科技有限公司 一种生成直播视频的方法、装置以及存储介质
CN113923505B (zh) * 2021-12-14 2022-03-01 飞狐信息技术（天津）有限公司 弹幕处理方法、装置及电子设备和存储介质

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1417798A (zh) * 2002-12-02 2003-05-14 北京贝尔科技发展有限公司 非线性编辑系统中字幕使用方法
CN101674455A (zh) * 2008-09-10 2010-03-17 新奥特（北京）视频技术有限公司 总控播出线异构系统间基于web服务的信息交互方法
CN202444553U (zh) * 2012-02-15 2012-09-19 安徽工程大学 键混合放大器
WO2017010359A1 (ja) * 2015-07-16 2017-01-19 ソニー株式会社 送信装置、送信方法、受信装置および受信方法
CN107211169A (zh) * 2015-02-03 2017-09-26 索尼公司 发送装置、发送方法、接收装置以及接收方法

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101472094A (zh) * 2007-12-27 2009-07-01 新奥特（北京）视频技术有限公司 一种基于电视字幕系统的现场点评及手绘方法
CN101494741B (zh) * 2008-01-24 2012-05-23 新奥特（北京）视频技术有限公司 应用于斯诺克直播电视字幕系统的技术实现方法
CN101674421B (zh) * 2008-09-10 2013-01-02 新奥特（北京）视频技术有限公司 一种以禁播时段为驱动的字幕下游键控制方法
CN101692693B (zh) * 2009-09-29 2011-09-28 北京中科大洋科技发展股份有限公司 一种多功能一体化演播室系统和演播方法
CN102118581B (zh) * 2009-12-30 2015-04-29 新奥特（北京）视频技术有限公司 一种字幕播出系统的软件预监方法

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1417798A (zh) * 2002-12-02 2003-05-14 北京贝尔科技发展有限公司 非线性编辑系统中字幕使用方法
CN101674455A (zh) * 2008-09-10 2010-03-17 新奥特（北京）视频技术有限公司 总控播出线异构系统间基于web服务的信息交互方法
CN202444553U (zh) * 2012-02-15 2012-09-19 安徽工程大学 键混合放大器
CN107211169A (zh) * 2015-02-03 2017-09-26 索尼公司 发送装置、发送方法、接收装置以及接收方法
WO2017010359A1 (ja) * 2015-07-16 2017-01-19 ソニー株式会社 送信装置、送信方法、受信装置および受信方法

Also Published As

Publication number Publication date
CN111279687A (zh) 2020-06-12

Similar Documents

Publication Publication Date Title
WO2020133371A1 (zh) 竞技比赛视频的字幕处理方法和导播系统
US11707676B2 (en) Content presenting method, user equipment and system
US6561907B2 (en) Simultaneous or reciprocal image synthesis for a video game at different viewpoints
US10561932B2 (en) Positioning a camera video overlay on gameplay video
CN110465097B (zh) 游戏中的角色立绘显示方法及装置、电子设备、存储介质
US9808724B2 (en) Music game software and input device utilizing a video player
CN111279687A (zh) 视频的字幕处理方法和导播系统
JP6119570B2 (ja) 表示装置、表示方法およびプログラム
WO2020015334A1 (zh) 视频处理方法、装置、终端设备及存储介质
EP4621735A1 (en) Image processing method and apparatus, electronic device, and storage medium
CN112333495A (zh) 焦点切换方法、显示设备及系统
JP7358078B2 (ja) 情報処理装置、情報処理装置の制御方法、及び、プログラム
WO2025145909A1 (zh) 游戏中的多媒体内容显示方法、装置及电子设备
US20150162049A1 (en) Image processing device, image processing method, and program
US20110064384A1 (en) Reproduction control apparatus, reproduction control method, and program
KR20180108334A (ko) 콘텐츠 객체 이동 궤적의 표시를 위한 장치 및 방법
CN112017264A (zh) 虚拟演播厅的显示控制方法及装置、存储介质、电子设备
CN114632324A (zh) 一种沉浸式空间虚拟建立系统及方法
JP2008258929A (ja) 字幕表示領域決定装置及び字幕表示プログラム
WO2020248682A1 (zh) 一种显示设备及虚拟场景生成方法
CN116943158B (zh) 对象信息展示方法和相关装置
TWI789083B (zh) 擴增實境內容播放之控制方法、系統及其電腦可讀媒介
US9715900B2 (en) Methods, circuits, devices, systems and associated computer executable code for composing composite content
US20240412425A1 (en) Method, apparatus, device and readable storage medium for generating effect
KR101985627B1 (ko) 콘텐츠 객체 이동 궤적의 표시를 위한 장치 및 방법

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18944905

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 18944905

Country of ref document: EP

Kind code of ref document: A1