CN116886941B - Method and device for switching caption content in cloud broadcasting guide station - Google Patents

Method and device for switching caption content in cloud broadcasting guide station Download PDF

Info

Publication number
CN116886941B
CN116886941B CN202310685344.XA CN202310685344A CN116886941B CN 116886941 B CN116886941 B CN 116886941B CN 202310685344 A CN202310685344 A CN 202310685344A CN 116886941 B CN116886941 B CN 116886941B
Authority
CN
China
Prior art keywords
subtitle
platform
information
cloud
caption
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202310685344.XA
Other languages
Chinese (zh)
Other versions
CN116886941A (en
Inventor
郭鹿鸣
郭丽
范文新
王晓维
王幸
曲坛
高剑飞
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Jiangsu Yibaijuzhi Technology Co ltd
Beijing Yibai Technology Co ltd
Original Assignee
Jiangsu Yibaijuzhi Technology Co ltd
Beijing Yibai Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Jiangsu Yibaijuzhi Technology Co ltd, Beijing Yibai Technology Co ltd filed Critical Jiangsu Yibaijuzhi Technology Co ltd
Priority to CN202310685344.XA priority Critical patent/CN116886941B/en
Publication of CN116886941A publication Critical patent/CN116886941A/en
Application granted granted Critical
Publication of CN116886941B publication Critical patent/CN116886941B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21Server components or server architectures
    • H04N21/218Source of audio or video content, e.g. local disk arrays
    • H04N21/2187Live feed
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/478Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/4788Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/485End-user interface for client configuration
    • H04N21/4856End-user interface for client configuration for language selection, e.g. for the menu or subtitles

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

The application relates to a method and a device for switching caption content in a cloud broadcasting guide table, wherein the method comprises the following steps: responding to the operation of selecting any item information in a plurality of item information of an item list, and generating a subtitle switching command, wherein the item information in the item list corresponds to a current subtitle object; the subtitle switching command is sent to a cloud broadcasting guiding platform, so that the cloud broadcasting guiding platform updates the plain text item of the current subtitle object into the selected entry information according to the subtitle switching command, and a subtitle switched signal is formed and output to an RTC conference platform; and pulling the caption-switched signal from the RTC conference platform. According to the scheme, on one hand, the subtitle switching of the cloud broadcasting guide platform is faster; on the other hand, a plurality of caption entries forming the entry list correspond to the same caption object, so that a plurality of caption objects do not need to be created, a large amount of caption processing resources of a system are saved, and the performance is greatly improved.

Description

Method and device for switching caption content in cloud broadcasting guide station
Technical Field
The present invention relates to the field of live video streaming, and in particular, to a method and an apparatus for switching subtitle content in a cloud streaming platform.
Background
In the live video broadcasting guide broadcasting platform, live broadcasting, guide broadcasting and push stream software are core components. Existing multicast station software is broadly divided into two types: a hardware director and a cloud director (in the form of a Web-side). The platform belongs to the cloud broadcasting guide platform of the client, and the client comprises a Web end.
In general, the basic modules in the cloud director console mainly cover the following parts: the system comprises several modules including guide table list management, input signal sources, mixed stream layout, caption materials, transition switching, PVW (program, main monitor) main monitor, sound console, signal output (conference output and live broadcast output), program list and image matting. The application focuses on subtitle materials in a cloud broadcasting guide station and a PVW pre-monitoring module.
The layout scene (generally, the layer may be any input signal source or layout scene) is formed by mixing and overlaying one or more layers of pictures, the subtitle material (generally, the subtitle material is formed by text, pictures, animation and graphic special effects and is used for overlaying the subtitle material on the layout scene to make decoration), and the PVW pre-monitor is used for previewing the input signal source and the layout scene picture on which the subtitle material is overlaid in real time.
In the current cloud broadcasting guide table, when required subtitle entries are huge. For example, one scene is live broadcast, a plurality of (for example, 100) online interactive guests take turns to take online lectures, and all the online interactive guests need to be added with subtitle entries independently, subtitle objects with the same order of magnitude need to be added in the existing cloud broadcasting guide table, update and switching of the subtitle are very complex, and hand speed and field strain capacity of broadcasting guide execution personnel are very tested.
Disclosure of Invention
In the multicast table, some layout scenes can be reused, and some layers in the layout can frequently replace signal sources. The subtitle superimposed on this layout also requires multiple exchanges of subtitle entry content. According to the method and the device, the entry list is formed by presetting the contents of a plurality of caption entries, and the replaced caption entries can be seen in PVW pre-monitoring only by selecting the caption entries in the entry list every time the caption entries are replaced, so that the caption entries are faster. In addition, only one subtitle object can be added to realize the effect of alternately switching and superposing a plurality of subtitles.
According to a first aspect of the present application, there is provided a method for switching caption content in a cloud broadcasting guide, including:
responding to the operation of selecting any item information in a plurality of item information of an item list, and generating a subtitle switching command, wherein the item information in the item list corresponds to a current subtitle object;
the subtitle switching command is sent to a cloud broadcasting guiding platform, so that the cloud broadcasting guiding platform updates the plain text item of the current subtitle object into the selected entry information according to the subtitle switching command, and a subtitle switched signal is formed and output to an RTC conference platform;
And pulling the caption-switched signal from the RTC conference platform.
According to a second aspect of the present application, there is provided an apparatus for switching caption content in a cloud broadcasting guide, including:
the generating module is used for responding to the operation of selecting any item information in a plurality of item information of an item list, and generating a subtitle switching command, wherein the item information in the item list corresponds to a current subtitle object;
the first sending module is used for sending the subtitle switching command to a cloud broadcasting guide platform, so that the cloud broadcasting guide platform updates the plain text item of the current subtitle object into the selected entry information according to the subtitle switching command, and forms a subtitle switched signal to be output to an RTC conference platform;
and the pulling module is used for pulling the signal after subtitle switching from the RTC conference platform.
According to a third aspect of the present application, there is provided an electronic device comprising:
a processor; and
a memory storing computer instructions that, when executed by the processor, cause the processor to perform the method of the first aspect.
According to a fourth aspect of the present application there is provided a non-transitory computer storage medium storing a computer program which, when executed by a plurality of processors, causes the processors to perform the method of the first aspect.
According to the method and the device for switching the caption content in the cloud broadcasting guide platform, on one hand, a term list is formed by presetting a plurality of caption term contents, and a caption switching command can be triggered as long as the caption term in the term list is selected every time when the caption term is replaced, so that the cloud broadcasting guide platform can perform caption switching processing according to the switching command, a caption switched signal is formed and is output to an RTC (Real time communication, real-time communication) platform, and the cloud broadcasting guide platform can pull the caption switched signal to be checked in PVW pre-monitoring, so that the caption switching of the cloud broadcasting guide platform is faster; on the other hand, in the multicast table, some layout scenes can be reused, and some layers in the layout can frequently replace signal sources. When the caption overlapped by the layout needs to be replaced for a plurality of times, a plurality of caption entries forming the entry list correspond to the same caption object, a plurality of caption objects do not need to be created, a large amount of caption processing resources of a system are saved, and the performance is greatly improved.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are needed in the description of the embodiments will be briefly described below, and it is apparent that the drawings in the following description are only some embodiments of the present application, and that other drawings can be obtained by those skilled in the art from these drawings without departing from the scope of protection of the present application.
Fig. 1 is a schematic diagram of a system for switching subtitle content according to an embodiment of the present application.
Fig. 2 is a flowchart of a method for switching subtitle content in a cloud multicast station according to an embodiment of the present application.
Fig. 3 is a schematic diagram comparing a method for switching caption contents in a cloud broadcasting station according to the present application with a method for switching caption contents in the related art.
Fig. 4 is a schematic diagram of an apparatus for switching subtitle content in a cloud multicast platform according to an embodiment of the present application.
Fig. 5 is a block diagram of an electronic device provided in the present application.
Detailed Description
The following description of the embodiments of the present application will be made clearly and fully with reference to the accompanying drawings, in which it is evident that the embodiments described are some, but not all, of the embodiments of the present application. All other embodiments, which can be made by those skilled in the art based on the embodiments herein without making any inventive effort, are intended to be within the scope of the present application.
Fig. 1 is a schematic diagram of a system for switching subtitle content according to an embodiment of the present application. As shown in fig. 1, the system includes a cloud director client, an RTC conference platform and a cloud director platform, where the RTC conference platform may include a 100RTC conference platform, and the RTC conference platform includes a signaling server (RTC-signal-server) and a media server (RTC-media-server); the cloud director platform may be a 100mix cloud director platform, which includes a signaling server (switch-signal-server) and an underlying server (switch-engine-server). In the system shown in fig. 1, the client establishes long connections with the RTC conference platform, signaling servers of the client and the cloud director platform, and the cloud director platform establishes long connections with the RTC conference platform, respectively, where the long connections may include WebSocket connections.
As shown in fig. 1, according to some embodiments, the cloud director platform is a componentized platform for online audio and video production, and mainly processes signal input, mixed flow, subtitle superposition, transition and composite picture output of the cloud director platform. The RTC conference platform is a real-time audio and video communication platform, and after the cloud broadcasting platform processes the audio and video signals, the synthesized picture is pushed to the RTC conference platform, and the cloud broadcasting platform client subscribes RTC streams from the RTC conference platform, so that real-time preview of the synthesized picture is realized. The cloud director platform is a componentized system, and each input source (input), layout (me) or output (output) is a separate component, and components are connected through nodes, for example, a connection between a component a and a component B is established and may be represented as a connectinode (componentA, componentB), and a connection between a component a and a component B is released and may be represented as a disconnectonode (componentA, componentB), so as to form different pipelines. The input component is the head node of the pipeline and the output component is the tail node of the pipeline. Within a single multicast station, each component has a unique ID created by the multicast station signaling server.
According to some embodiments, in a layout scene, for example, the layout is divided into a left split screen and a right split screen, the two layers of the left split screen and the right split screen are respectively set as input sources inputA and inputB, a subtitle CG is superimposed on the layout ME, previewing is performed in a PVW window, and then the content of the subtitle is changed. Firstly, after the cloud director platform client is started, long connection is required to be established with the RTC conference platform and the cloud director platform. Under the condition that the RTC conference platform is a 100RTC conference platform, the cloud broadcasting guide platform client interacts with the 100RTC server through a 100RTC sdk (client), firstly joins an RTC preview room, inquires media stream information of a room user, and synchronously monitors a new media stream release notice. The cloud director client interacts with the signaling server through, for example, a switch-js-sdk, firstly sends a command (switcherStart) for starting the director, and after receiving the director starting command (switcherStart), the signaling server forwards a message to the bottom server to create a director instance object.
After the director is started, in combination with the application scenario, an input source InputA component switcherAddInput (inputAId), an input source InputB component switcherAddInput (inputBId), an ME layout component switcherAddME (meId), a CG subtitle component switcherAddCG (cgId), a PVW pre-monitor component switcherAddPVW (pvwId), and an Output component switcherAddOutput (outputId) need to be created. The ME layout component is provided with templates by the protocol for the layout component to set templates (e.g., switcherSetMETemplate (templateInfo)) in which component identification information IDs of InputA and InputB are configured into corresponding layers of the templates. After receiving the switchsetMETEMPLATE message, the cloud director platform binds the InputA and InputB components with the ME components, for example, through a switchConnectNode (inputAId, meId) interface, and updates the mixed-flow picture. After creating the CG component when adding subtitles to the layout, the ME component and the CG component need to be bound, for example, by switcherconnectinode (meId, cgId). The client switches the layout to PVW preview, sends an instruction (e.g. switcherCutToPVW message) to the cloud director platform to switch PVW preview, binds the caption CG component and PVW component corresponding to the ME component by switcherConnectNode (cgId), and thus passes the ME component signal to PVW component. The PVW component signal is then passed to the Output component Output via the switcherconnectinode (pvwId, outputId). The Output component Output outputs the signal encoding push stream to the RTC conference platform.
According to some embodiments, for the subtitle component, it is mainly responsible for receiving the audio and video stream of the previous node, superposing the subtitle object on the received video stream to perform mixed stream synthesis, and then transmitting the processed audio and video stream to the next node. One subtitle component CG may superimpose a plurality of subtitle objects cgObject. One subtitle object cgObject may contain a plurality of subtitle items cgItem, which may be plain text items cgTextItem, picture items cgPictureItem, video animation items cganimation item. According to some embodiments, a subtitle object cgObject of a plain text item consists of a plain text item cgTextItem; a dynamic graphic subtitle object cgObject is composed of a video animation item cganimation item and a plurality of plain text items cgTextItem; a static graphic subtitle object cgObject is composed of a picture item cgPictureItem and a plurality of plain text items cgTextItem; also somewhat complex subtitle objects may be composed of a plurality of video animation items cganimation items, cgpictureitetem, and a plurality of plain text items cgTextItem. The composition of the subtitle objects may be combined according to actual needs, which is not limited in any way in the present application.
According to some embodiments, the creation, updating, deleting, starting and stopping of the subtitle object cgObject of the subtitle component are initiated by the client, and the following protocols are generally involved: creating a protocol switcheradddcgobject, updating a protocol switcherupdatecgcgbject, deleting a protocol switcherDeleteCGObject, starting a protocol switcherstartccgobject and stopping a protocol switcherStopCGObject. After creating the protocol switcheradddcgobject, the server generates an ID (objectId) of a subtitle object to distinguish between different subtitle objects. In the operations of creating, updating, deleting, starting and stopping the subtitle objects, the objectId needs to be transferred to a cloud director platform, and the cloud director platform finds a specific subtitle object instance through the objectId for processing.
According to some embodiments, the creation and updating of the subtitle object is set by the template information cgobjectterplateinfo of the subtitle object in the switcheradddcgobject and switcherUpdateCGObject protocol. In the actual operation process, the client side sends the template information cgObjectTemplateInfo of the subtitle object to the cloud guide platform in the process of sending the subtitle object creation and update command. The template information cgObjectTemplateInfo of the subtitle object has detailed parameter information such as plain text information in a plain text item, the sizes and positions of a picture item and a video animation item, and the like.
According to some embodiments, according to different subtitle content requirements, the client side configures template information cgobjecttemplate info of subtitle objects of each subtitle object cgObject, which subtitle object is enabled, and calls a command switcherStartCGObject (cgObjectId) for enabling the subtitle object, and enables the corresponding subtitle object through the subtitle object ID. Which subtitle is stopped, a command switcherStopCGObject (cgObjectId) to stop the subtitle object is called, and the corresponding subtitle object is stopped by the subtitle object ID.
Typically, a text subtitle is added to a layout on the client, e.g. consisting of a background animation and two text boxes. A subtitle object cgObject may be created on the subtitle component by creating a subtitle component, and is composed of one video animation item and two plain text items textItemA, textItemB. The conventional practice in the prior art includes two when text content needs to be replaced for this subtitle object. The first way is: opening a caption editing window at a client, changing caption text content, clicking and determining, and then sequentially sending an instruction containing a stop protocol switchstopcgobject, an instruction containing an update protocol switchupdatecgobject and an instruction containing a start protocol switchstartcgobject, wherein corresponding to the three instructions, a client operator needs to execute an operation of stopping a current caption object, an operation of updating the caption object and an operation of starting the caption object respectively. The second way is: the client adds a new subtitle object switcherAddCGObject (objectIdNew) and edits the content in the new subtitle object. Before switching the new subtitle, the old subtitle object switcherStopCGObject (objectIdOld) is stopped, and the new subtitle switcherStartCGObject (objectIdNew) is started; corresponding to the second way, the operations that the client operator needs to perform are adding a new subtitle object, editing the new subtitle object, stopping the old subtitle object, and starting the new subtitle object.
If the subtitle content of one layout needs to be replaced many times, the operation process is complex and easy to make mistakes in the first mode or the second mode; in addition, in the second mode, new subtitle objects need to be added in the process of changing the subtitle content, so that more subtitle processing resources of the system are occupied.
In the scheme of the application, according to some embodiments, all text contents which are possibly used are edited to form individual text entries, a subtitle object is correspondingly formed into a vocabulary entry list, for example, a pull-down list, and text entry information in the vocabulary entry list is corresponding to plain text items of the subtitle object.
For the formation of text entries, according to some embodiments, the caption desk card protocol rules tablecard rule may be set, e.g., separating text 1 and text 2 of entry 1 by a semicolon (;). Entry 1 and entry 2 and subsequent entries are separated by a line-feed symbol. It will be appreciated by those skilled in the art that the caption desk card protocol rules may also be implemented in other ways, as long as the terms can be distinguished from terms, text from text, and the present application is not limited in any way. And each text in the entry corresponds to the plain text item of the subtitle object in turn.
According to the set caption desk card protocol rule, according to some embodiments, the user may copy the vocabulary entry to be switched after editing in the text editor in advance into the caption vocabulary entry editing frame, or directly edit the vocabulary entry in the caption desk card vocabulary entry editing frame. After editing, setting the configuration of the entry to be synchronized to a cloud broadcasting guide platform for storage through subtitle object configuration information switchsetcgobjectconfig; when the browser is refreshed or closed and re-opened, the client acquires detailed information switcherGetDetailInfo interfaces of the broadcasting guide table from the cloud broadcasting guide platform, and the returned detailed information detailInfo comprises information of a subtitle component, information of a subtitle object and all information of a table card entry, wherein the client uses the detailInfo as data display, namely data back display. The client analyzes the set vocabulary entry table card content according to the set subtitle table card protocol rule, and places the analyzed different vocabulary entries in a vocabulary entry selection vocabulary entry list.
According to some embodiments, when a user selects one term information in the displayed term list, the cloud broadcasting guide platform client sends a subtitle switching command to a signaling server of the cloud broadcasting guide platform, and the cloud broadcasting guide platform updates a plain text item of a current subtitle object to the selected term information according to the command to form a signal after subtitle switching and outputs the signal to the RTC conference platform.
According to some embodiments, the subtitle switching command includes an instruction to stop the current subtitle object, an instruction to update the current subtitle object, and an instruction to start the current subtitle object. When a user selects one term information, the cloud director client is automatically triggered to send an instruction containing a stop protocol switchstopCGobject, an instruction containing an update protocol switchupdateCGobject and an instruction containing a start protocol switchStartCGobject to a signaling server of the cloud director platform. And the cloud broadcasting guide platform sequentially executes the operations of stopping the current subtitle object, updating the current subtitle object and starting the current subtitle object according to the instructions.
According to some embodiments, after the cloud director platform outputs the subtitle switched signal to the RTC conference platform, the cloud director client may pull the subtitle switched signal from the RTC conference platform through a long connection with the RTC conference platform, and display the subtitle switched content in the PVW window.
In the case that the user selects the entry information, the client parses the entry information and places the parsed content in template information cgobjecttemplate info of the subtitle object. According to some embodiments, the client parses the selected term information to form one or more texts, e.g. according to a set subtitle desktop card protocol rule. Then, one or more texts formed by parsing are set in template information cgobjecttemplate info of the current subtitle object.
According to some embodiments, in the process that the client sends the subtitle switching command to the signaling server of the cloud broadcasting platform, template information cgobjecttemplate info of the subtitle object is sent to the cloud broadcasting platform. The template information cgobjecttemplate info of the subtitle object has entry information corresponding to the user selection of the plain text item. And the cloud broadcasting guide platform updates the content of the corresponding plain text item in the subtitle object into the entry information selected by the user according to the template information cgObjectTemplateInfo of the subtitle object.
Based on the system shown in fig. 1, according to one aspect of the present application, a method for switching caption content in a cloud broadcasting guide is provided. Fig. 2 is a flowchart of a method for switching subtitle content in a cloud multicast station according to an embodiment of the present application. As shown in fig. 2, the method includes the following steps.
Step S201, in response to an operation of selecting any one of a plurality of entry information of an entry list, generating a subtitle switching command, where the entry information in the entry list corresponds to a current subtitle object.
According to some embodiments, all text contents that may be used are edited to form individual text entries, and a subtitle object corresponds to a list of entries, for example, a drop-down list, where text entry information in the list of entries corresponds to plain text items of the subtitle object.
Step S202, the subtitle switching command is sent to a cloud broadcasting guide platform, so that the cloud broadcasting guide platform updates the plain text item of the current subtitle object into the selected entry information according to the subtitle switching command, and a subtitle switched signal is formed and output to an RTC conference platform.
According to some embodiments, when a user selects one term information in the displayed term list, the cloud broadcasting guide platform client sends a subtitle switching command to a signaling server of the cloud broadcasting guide platform, and the cloud broadcasting guide platform updates a plain text item of a current subtitle object to the selected term information according to the command to form a signal after subtitle switching and outputs the signal to the RTC conference platform.
According to some embodiments, the subtitle switching command includes an instruction to stop the current subtitle object, an instruction to update the current subtitle object, and an instruction to start the current subtitle object. When a user selects one term information, the cloud director client is automatically triggered to send an instruction containing a stop protocol switchstopCGobject, an instruction containing an update protocol switchupdateCGobject and an instruction containing a start protocol switchStartCGobject to a signaling server of the cloud director platform. And the cloud broadcasting guide platform sequentially executes the operations of stopping the current subtitle object, updating the current subtitle object and starting the current subtitle object according to the instructions.
Step S203, pull the signal after subtitle switching from the RTC conference platform.
According to some embodiments, after the cloud director platform outputs the subtitle switched signal to the RTC conference platform, the cloud director client may pull the subtitle switched signal from the RTC conference platform through a long connection with the RTC conference platform, and display the subtitle switched content in the PVW window.
In the case that the user selects the entry information, the client parses the entry information and places the parsed content in template information cgobjecttemplate info of the subtitle object. According to some embodiments, the client parses the selected term information to form one or more texts, e.g. according to a set subtitle desktop card protocol rule. Then, one or more texts formed by parsing are set in template information cgobjecttemplate info of the current subtitle object.
Thus, the method shown in FIG. 2 may further comprise the steps of:
step S204, in the case of selecting the entry information, analyzing the selected entry information to form one or more texts;
Step S205, setting the one or more texts in the template information of the current subtitle object.
According to some embodiments, in the process that the client sends the subtitle switching command to the signaling server of the cloud broadcasting platform, template information cgobjecttemplate info of the subtitle object is sent to the cloud broadcasting platform. The template information cgobjecttemplate info of the subtitle object has entry information corresponding to the user selection of the plain text item. And the cloud broadcasting guide platform updates the content of the corresponding plain text item in the subtitle object into the entry information selected by the user according to the template information cgObjectTemplateInfo of the subtitle object.
Thus, the method shown in FIG. 2 may further comprise the steps of:
step S206, in the process of sending the subtitle switching command to the cloud broadcasting platform, sending the template information of the current subtitle object to the cloud broadcasting platform, where the template information of the current subtitle object includes the selected entry information.
According to some embodiments, the user may edit the entries in the list of entries according to a set subtitle desktop rule. After editing, setting the configuration of the entry list to be synchronized to a cloud broadcasting guide platform for storage through subtitle object configuration information switchsetcgobjectconfig; when restarting the client, for example refreshing the browser or closing the browser and restarting, the client acquires the detailed information switchGetDetaInfo interface of the broadcasting guide table from the cloud broadcasting guide platform, and the returned detailed information detailInfo comprises the information of the caption component, the information of the caption object and all the information of the table card entry, and the client uses the detailInfo for data display, namely data back display. The client analyzes the set vocabulary entry table card content according to the set subtitle table card protocol rule, and places the analyzed different vocabulary entries in a vocabulary entry selection vocabulary entry list. The vocabulary entry list of the subtitle object is stored in the cloud broadcasting guide platform, the configured vocabulary entry list cannot be lost when the browser is closed or refreshed, and the vocabulary entry list can be displayed when the client is restarted.
Thus, the method shown in FIG. 2 may further comprise the steps of:
step S207, sending configuration information corresponding to the entry list to the cloud broadcasting platform; and
step S208, under the condition that the cloud director platform is restarted, acquiring the configuration information from the cloud director platform for display.
Fig. 3 is a schematic diagram comparing a method for switching caption contents in a cloud broadcasting station according to the present application with a method for switching caption contents in the related art. As shown in fig. 3, 100 experts take turns in lectures for the same lecture background; for each expert there is a corresponding term, the term information including: name, title, unit information, etc., and when the specialist is switched, the term of the specialist needs to be replaced at the same time, and the term information of the current specialist needs to be superimposed on the synthesized picture.
For the scheme in the prior art, a subtitle object is generated for a specialist, an entry of the specialist is added for the subtitle object, when the specialist needs to be switched, the subtitle object corresponding to the specialist needs to be found, and a broadcasting executor needs to execute operations of stopping the current subtitle object, updating the subtitle object and starting the subtitle object in sequence. In contrast, according to the scheme of the present application, only one subtitle object needs to be added to the 100 experts, where the subtitle object corresponds to 100 terms, when an expert needs to be switched, only a term corresponding to the expert needs to be selected, and a subtitle switching command is sent to the cloud director platform, for example, an instruction including a stop protocol switchstopcgobject, an instruction including an update protocol switchupdatecgcgobject, and an instruction including a start protocol switchstartcgobject are automatically triggered by the cloud director client to a signaling server of the cloud director platform. And the cloud broadcasting guide platform sequentially executes the operations of stopping the current subtitle object, updating the current subtitle object and starting the current subtitle object according to the instructions.
Compared with the prior art, on one hand, the method has the advantages that only the entry information is selected to trigger the subtitle switching command, the content after subtitle switching is displayed, the operation is simple, the subtitle switching is rapid, and the switching efficiency is improved; on the other hand, only one subtitle object needs to be added for a plurality of input sources, so that the processing resources of the system are greatly saved.
According to the method, various input sources, such as conference input sources, pictures, on-demand input sources and the like, are added after the cloud guide platform is created in the actual operation process. And adding mixed-stream layout, and setting the conference input source signal and the on-demand picture input source signal to a designated layer when the layout is configured. After creating and editing the layout, the layout is switched to the PVW window for real-time preview. And adding a graphic subtitle to the layout in the subtitle material area, and starting. At this time, a mixed-stream screen of subtitles is superimposed when displayed in a PVW window. Then click the edit button on the added subtitle material, pop up the subtitle desk card and set up the window. Editing of the caption desk card window is performed according to caption desk card protocol rules, for example, a plurality of components of the same term are separated by semicolon, and different term modes are separated by carriage return and line feed. The text file can be copied and pasted to the subtitle desk card setting window after all the entries are edited by the txt text editor in advance, or the txt text file is directly dragged to the subtitle desk card setting window to be set. After setting, the preview window of the subtitle can generate a term list, for example, a drop-down menu, clicking the menu can see all the set term information, and clicking the required term can immediately take effect in the layout. Other entries need to be switched and the operation is performed according to the same steps.
According to the method for switching the caption content in the cloud broadcasting guide platform, on one hand, a term list is formed by presetting a plurality of caption term contents, and a caption switching command can be triggered as long as the caption term in the term list is selected every time when the caption term is replaced, so that the cloud broadcasting guide platform can perform caption switching processing according to the switching command, form a caption switched signal and output the caption switched signal to the RTC platform, and the cloud broadcasting guide platform can pull the caption switched signal to be checked in PVW pre-monitoring, so that the caption switching of the cloud broadcasting guide platform is faster; on the other hand, in the multicast table, some layout scenes can be reused, and some layers in the layout can frequently replace signal sources. When the caption overlapped by the layout needs to be replaced for a plurality of times, a plurality of caption entries forming the entry list correspond to the same caption object, a plurality of caption objects do not need to be created, a large amount of caption processing resources of a system are saved, and the performance is greatly improved.
According to another aspect of the present application, an apparatus for switching caption content in a cloud carousel is provided. Fig. 4 is a schematic diagram of an apparatus for switching subtitle content in a cloud multicast platform according to an embodiment of the present application. As shown in fig. 4, the apparatus includes the following modules.
The generating module 401 is configured to generate a subtitle switching command in response to an operation of selecting any one of a plurality of entry information of an entry list, where the entry information in the entry list corresponds to a current subtitle object.
According to some embodiments, all text contents that may be used are edited to form individual text entries, and a subtitle object corresponds to a list of entries, for example, a drop-down list, where text entry information in the list of entries corresponds to plain text items of the subtitle object.
The first sending module 402 is configured to send the subtitle switching command to a cloud broadcasting guide platform, so that the cloud broadcasting guide platform updates the plain text item of the current subtitle object to the selected term information according to the subtitle switching command, and forms a subtitle switched signal and outputs the subtitle switched signal to the RTC conference platform.
According to some embodiments, when a user selects one term information in the displayed term list, the cloud broadcasting guide platform client sends a subtitle switching command to a signaling server of the cloud broadcasting guide platform, and the cloud broadcasting guide platform updates a plain text item of a current subtitle object to the selected term information according to the command to form a signal after subtitle switching and outputs the signal to the RTC conference platform.
According to some embodiments, the subtitle switching command includes an instruction to stop the current subtitle object, an instruction to update the current subtitle object, and an instruction to start the current subtitle object. When a user selects one term information, the cloud director client is automatically triggered to send an instruction containing a stop protocol switchstopCGobject, an instruction containing an update protocol switchupdateCGobject and an instruction containing a start protocol switchStartCGobject to a signaling server of the cloud director platform. And the cloud broadcasting guide platform sequentially executes the operations of stopping the current subtitle object, updating the current subtitle object and starting the current subtitle object according to the instructions.
And the pulling module 403 is configured to pull the subtitle switched signal from the RTC conference platform.
According to some embodiments, after the cloud director platform outputs the subtitle switched signal to the RTC conference platform, the cloud director client may pull the subtitle switched signal from the RTC conference platform through a long connection with the RTC conference platform, and display the subtitle switched content in the PVW window.
In the case that the user selects the entry information, the client parses the entry information and places the parsed content in template information cgobjecttemplate info of the subtitle object. According to some embodiments, the client parses the selected term information to form one or more texts, e.g. according to a set subtitle desktop card protocol rule. Then, one or more texts formed by parsing are set in template information cgobjecttemplate info of the current subtitle object.
Thus, the apparatus shown in fig. 4 may further comprise the following modules:
a parsing module 404, configured to parse the selected term information to form one or more texts if the term information is selected;
a setting module 405, configured to set the one or more texts in template information of the current subtitle object.
According to some embodiments, in the process that the client sends the subtitle switching command to the signaling server of the cloud broadcasting platform, template information cgobjecttemplate info of the subtitle object is sent to the cloud broadcasting platform. The template information cgobjecttemplate info of the subtitle object has entry information corresponding to the user selection of the plain text item. And the cloud broadcasting guide platform updates the content of the corresponding plain text item in the subtitle object into the entry information selected by the user according to the template information cgObjectTemplateInfo of the subtitle object.
Thus, the apparatus shown in fig. 4 may further comprise the following modules:
and a second sending module 406, configured to send, to the cloud broadcasting platform, the template information of the current subtitle object in the process of sending the subtitle switching command to the cloud broadcasting platform, where the template information of the current subtitle object includes the selected entry information.
According to some embodiments, the user may edit the entries in the list of entries according to a set subtitle desktop rule. After editing, setting the configuration of the entry list to be synchronized to a cloud broadcasting guide platform for storage through subtitle object configuration information switchsetcgobjectconfig; when restarting the client, for example refreshing the browser or closing the browser and restarting, the client acquires the detailed information switchGetDetaInfo interface of the broadcasting guide table from the cloud broadcasting guide platform, and the returned detailed information detailInfo comprises the information of the caption component, the information of the caption object and all the information of the table card entry, and the client uses the detailInfo for data display, namely data back display. The client analyzes the set vocabulary entry table card content according to the set subtitle table card protocol rule, and places the analyzed different vocabulary entries in a vocabulary entry selection vocabulary entry list. The vocabulary entry list of the subtitle object is stored in the cloud broadcasting guide platform, the configured vocabulary entry list cannot be lost when the browser is closed or refreshed, and the vocabulary entry list can be displayed when the client is restarted.
Thus, the apparatus shown in fig. 4 may further comprise the following modules:
A third sending module 407, configured to send configuration information corresponding to the entry list to the cloud broadcasting platform; and
and the obtaining module 408 is configured to obtain the configuration information from the cloud multicast platform for display when the cloud multicast platform is restarted.
According to the device for switching the caption content in the cloud broadcasting guide platform, on one hand, a term list is formed by presetting a plurality of caption term contents, and a caption switching command can be triggered as long as the caption term in the term list is selected every time when the caption term is replaced, so that the cloud broadcasting guide platform can perform caption switching processing according to the switching command, form a caption switched signal and output the caption switched signal to the RTC platform, and the cloud broadcasting guide platform can pull the caption switched signal to be checked in PVW pre-monitoring, so that the caption switching of the cloud broadcasting guide platform is faster; on the other hand, in the multicast table, some layout scenes can be reused, and some layers in the layout can frequently replace signal sources. When the caption overlapped by the layout needs to be replaced for a plurality of times, a plurality of caption entries forming the entry list correspond to the same caption object, a plurality of caption objects do not need to be created, a large amount of caption processing resources of a system are saved, and the performance is greatly improved.
In the foregoing embodiments, the descriptions of the embodiments are emphasized, and for parts of one embodiment that are not described in detail, reference may be made to related descriptions of other embodiments.
It should be noted that, for simplicity of description, the foregoing method embodiments are all expressed as a series of action combinations, but it should be understood by those skilled in the art that the present application is not limited by the order of actions described, as some steps may be performed in other order or simultaneously in accordance with the present application. Further, those skilled in the art will also appreciate that the embodiments described in the specification are all alternative embodiments, and that the acts and modules referred to are not necessarily required in the present application.
In the several embodiments provided in this application, it should be understood that the disclosed apparatus may be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative, such as the division of the units, merely a logical function division, and there may be additional manners of dividing the actual implementation, such as multiple units or components may be combined or integrated into another system, or some features may be omitted, or not performed. Alternatively, the coupling or direct coupling or communication connection shown or discussed with each other may be an indirect coupling or communication connection via some interfaces, devices or units, electrical connection, or other forms.
Referring to fig. 5, fig. 5 provides an electronic device including a processor and a memory. The memory stores computer instructions that, when executed by the processor, cause the processor to execute the computer instructions to implement the method and refinement as shown in fig. 2.
It should be understood that the above-described device embodiments are illustrative only and that the disclosed device may be implemented in other ways. For example, the division of the units/modules in the above embodiments is merely a logic function division, and there may be another division manner in actual implementation. For example, multiple units, modules, or components may be combined, or may be integrated into another system, or some features may be omitted or not performed.
In addition, unless specifically described, each functional unit/module in each embodiment of the present invention may be integrated into one unit/module, or each unit/module may exist alone physically, or two or more units/modules may be integrated together. The integrated units/modules described above may be implemented either in hardware or in software program modules.
The integrated units/modules, if implemented in hardware, may be digital circuits, analog circuits, etc. Physical implementations of hardware structures include, but are not limited to, transistors, memristors, and the like. The processor or chip may be any suitable hardware processor, such as CPU, GPU, FPGA, DSP and ASIC, etc., unless otherwise specified. The on-chip cache, off-chip Memory, memory may be any suitable magnetic or magneto-optical storage medium, such as resistive Random Access Memory RRAM (Resistive Random Access Memory), dynamic Random Access Memory DRAM (Dynamic Random Access Memory), static Random Access Memory SRAM (Static Random Access Memory), enhanced dynamic Random Access Memory EDRAM (Enhanced Dynamic Random Access Memory), high-Bandwidth Memory HBM (High-Bandwidth Memory), hybrid Memory cube HMC (Hybrid Memory Cube), and the like, unless otherwise indicated.
The integrated units/modules may be stored in a computer readable memory if implemented in the form of software program modules and sold or used as a stand-alone product. Based on such understanding, the technical solution of the present invention may be embodied in essence or a part contributing to the prior art or all or part of the technical solution in the form of a software product stored in a memory, comprising several instructions for causing a computer electronic device (which may be a personal computer, a server or a network electronic device, etc.) to perform all or part of the steps of the method described in the various embodiments of the disclosure. And the aforementioned memory includes: a U-disk, a Read-Only Memory (ROM), a random access Memory (RAM, random Access Memory), a removable hard disk, a magnetic disk, or an optical disk, or other various media capable of storing program codes.
Embodiments of the present application also provide a non-transitory computer storage medium storing a computer program that, when executed by a plurality of processors, causes the processors to perform the method and refinement as shown in fig. 2.
The foregoing has outlined rather broadly the more detailed description of embodiments of the present application, wherein specific examples have been provided herein to illustrate the principles and embodiments of the present application, and wherein the above examples are provided to assist in the understanding of the methods and concepts of the present application. Meanwhile, based on the ideas of the present application, those skilled in the art can make changes or modifications on the specific embodiments and application scope of the present application, which belong to the scope of the protection of the present application. In view of the foregoing, this description should not be construed as limiting the application.

Claims (12)

1. A method for switching caption content in a cloud director, comprising:
responding to the operation of selecting any item information in a plurality of item information of an item list, and generating a subtitle switching command, wherein the item information in the item list corresponds to a current subtitle object;
the subtitle switching command is sent to a cloud broadcasting guiding platform, so that the cloud broadcasting guiding platform updates the plain text item of the current subtitle object into the selected entry information according to the subtitle switching command, and a subtitle switched signal is formed and output to an RTC conference platform;
and pulling the caption-switched signal from the RTC conference platform.
2. The method of claim 1, wherein the subtitle switching command includes an instruction to stop the current subtitle object, an instruction to update the current subtitle object, and an instruction to start the current subtitle object.
3. The method as recited in claim 1, further comprising:
in the case of selecting the term information, parsing the selected term information to form one or more texts;
the one or more texts are set in template information of the current subtitle object.
4. A method as claimed in any one of claims 1 to 3, further comprising:
and in the process of sending the subtitle switching command to the cloud broadcasting guide platform, sending the template information of the current subtitle object to the cloud broadcasting guide platform, wherein the template information of the current subtitle object contains the selected entry information.
5. A method as claimed in any one of claims 1 to 3, further comprising:
transmitting configuration information corresponding to the entry list to the cloud broadcasting platform; and
and under the condition that the cloud guide platform is restarted, acquiring the configuration information from the cloud guide platform for display.
6. An apparatus for switching caption content in a cloud director, comprising:
the generating module is used for responding to the operation of selecting any item information in a plurality of item information of an item list, and generating a subtitle switching command, wherein the item information in the item list corresponds to a current subtitle object;
the first sending module is used for sending the subtitle switching command to a cloud broadcasting guide platform, so that the cloud broadcasting guide platform updates the plain text item of the current subtitle object into the selected entry information according to the subtitle switching command, and forms a subtitle switched signal to be output to an RTC conference platform;
and the pulling module is used for pulling the signal after subtitle switching from the RTC conference platform.
7. The apparatus of claim 6, wherein the subtitle switching command includes an instruction to stop the current subtitle object, an instruction to update the current subtitle object, and an instruction to start the current subtitle object.
8. The apparatus as recited in claim 6, further comprising:
the analysis module is used for analyzing the selected entry information to form one or more texts under the condition of selecting the entry information;
And the setting module is used for setting the one or more texts in the template information of the current subtitle object.
9. The apparatus of any one of claims 6 to 8, further comprising:
and the second sending module is used for sending the template information of the current subtitle object to the cloud broadcasting guide platform in the process of sending the subtitle switching command to the cloud broadcasting guide platform, wherein the template information of the current subtitle object comprises the selected entry information.
10. The apparatus of any one of claims 6 to 8, further comprising:
the third sending module is used for sending configuration information corresponding to the entry list to the cloud broadcasting guide platform; and
the acquisition module is used for acquiring the configuration information from the cloud broadcasting guide platform for display under the condition that the cloud broadcasting guide platform is restarted.
11. An electronic device comprising a memory having a computer program stored thereon and a processor that, when executing the computer program on the memory, implements the steps of the method of any of claims 1 to 5.
12. A computer-readable storage medium, characterized in that it stores a computer program which, when executed by a processor, implements the steps of the method according to any one of claims 1 to 5.
CN202310685344.XA 2023-06-09 2023-06-09 Method and device for switching caption content in cloud broadcasting guide station Active CN116886941B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202310685344.XA CN116886941B (en) 2023-06-09 2023-06-09 Method and device for switching caption content in cloud broadcasting guide station

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202310685344.XA CN116886941B (en) 2023-06-09 2023-06-09 Method and device for switching caption content in cloud broadcasting guide station

Publications (2)

Publication Number Publication Date
CN116886941A CN116886941A (en) 2023-10-13
CN116886941B true CN116886941B (en) 2024-03-26

Family

ID=88263233

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202310685344.XA Active CN116886941B (en) 2023-06-09 2023-06-09 Method and device for switching caption content in cloud broadcasting guide station

Country Status (1)

Country Link
CN (1) CN116886941B (en)

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2009038775A (en) * 2007-08-03 2009-02-19 Casio Hitachi Mobile Communications Co Ltd Captioned video playback terminal device, and program
JP2009130469A (en) * 2007-11-20 2009-06-11 Casio Hitachi Mobile Communications Co Ltd Captioned video playback apparatus, and program
CN102082934A (en) * 2009-11-30 2011-06-01 新奥特(北京)视频技术有限公司 Caption object updating method and device
CN105744346A (en) * 2014-12-12 2016-07-06 深圳Tcl数字技术有限公司 Caption switching method and device
CN106792114A (en) * 2016-12-06 2017-05-31 深圳Tcl数字技术有限公司 The changing method and device of captions
CN110798635A (en) * 2019-10-16 2020-02-14 重庆爱奇艺智能科技有限公司 Method and device for matching subtitle files for video
CN111327961A (en) * 2020-03-30 2020-06-23 上海句石智能科技有限公司 Video subtitle switching method and system
CN114095671A (en) * 2021-11-11 2022-02-25 北京有竹居网络技术有限公司 Cloud conference live broadcast system, method, device, equipment and medium

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4936570B2 (en) * 2009-09-30 2012-05-23 キヤノン株式会社 Digital broadcast receiving apparatus and control method thereof
CN115914768A (en) * 2021-08-11 2023-04-04 脸萌有限公司 Video playing method and device

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2009038775A (en) * 2007-08-03 2009-02-19 Casio Hitachi Mobile Communications Co Ltd Captioned video playback terminal device, and program
JP2009130469A (en) * 2007-11-20 2009-06-11 Casio Hitachi Mobile Communications Co Ltd Captioned video playback apparatus, and program
CN102082934A (en) * 2009-11-30 2011-06-01 新奥特(北京)视频技术有限公司 Caption object updating method and device
CN105744346A (en) * 2014-12-12 2016-07-06 深圳Tcl数字技术有限公司 Caption switching method and device
CN106792114A (en) * 2016-12-06 2017-05-31 深圳Tcl数字技术有限公司 The changing method and device of captions
CN110798635A (en) * 2019-10-16 2020-02-14 重庆爱奇艺智能科技有限公司 Method and device for matching subtitle files for video
CN111327961A (en) * 2020-03-30 2020-06-23 上海句石智能科技有限公司 Video subtitle switching method and system
CN114095671A (en) * 2021-11-11 2022-02-25 北京有竹居网络技术有限公司 Cloud conference live broadcast system, method, device, equipment and medium

Also Published As

Publication number Publication date
CN116886941A (en) 2023-10-13

Similar Documents

Publication Publication Date Title
US10348794B2 (en) Media production system with score-based display feature
US9269072B2 (en) Systems, methods, and devices for facilitating navigation of previously presented screen data in an ongoing online meeting
US9282289B2 (en) Systems, methods, and devices for generating a summary document of an online meeting
CN108476327A (en) Piece video is formed based on Media Stream
CN107636651A (en) Subject index is generated using natural language processing
US20120166545A1 (en) Systems, methods, and devices for communicating during an ongoing online meeting
KR101915786B1 (en) Service System and Method for Connect to Inserting Broadcasting Program Using an Avata
CN115767131A (en) Cloud director method, device, equipment and computer storage medium
CN116886941B (en) Method and device for switching caption content in cloud broadcasting guide station
CN106302725B (en) A kind of realization method and system of interactive data
CN116916051B (en) Method and device for updating layout scene in cloud director client
JP2008078864A (en) Content creating server, content presentation device, content creating program and content presentation program
CN101448095B (en) Method and system for reviewing film based on multi-stream
KR20180065432A (en) system and method for providing cloud based user interfaces
KR101301133B1 (en) Apparatus for construction social network by using multimedia contents and method thereof
JP4990718B2 (en) Media stream processing system, media stream processing method, component realization apparatus
CN116582696A (en) Method and system for switching program scene to preset monitoring window
CN117729188B (en) Water affair video acquisition system and method based on WebRTC
CN116980555B (en) Input signal source acquisition method and system
JP4796466B2 (en) Content management server, content presentation device, content management program, and content presentation program
KR100322609B1 (en) Digital Authoring System and Server System and Digital Authoring Method Using the same
CN115967824A (en) Video preview method, device, medium, equipment and computer program product
CN115119069A (en) Multimedia content processing method, electronic device and computer storage medium
JP2006086745A (en) Scene descriptive information preparation device, scene descriptive information preparation method and program
Hui Design of Multimedia Playback System Based on Computer Network and New Media Technology

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant