CN117119216B - Live broadcast explanation method and system and use method of live broadcast system - Google Patents

Live broadcast explanation method and system and use method of live broadcast system Download PDF

Info

Publication number
CN117119216B
CN117119216B CN202311389594.5A CN202311389594A CN117119216B CN 117119216 B CN117119216 B CN 117119216B CN 202311389594 A CN202311389594 A CN 202311389594A CN 117119216 B CN117119216 B CN 117119216B
Authority
CN
China
Prior art keywords
live broadcast
acquisition
stream
terminal
acquisition card
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202311389594.5A
Other languages
Chinese (zh)
Other versions
CN117119216A (en
Inventor
张克尘
蔡骁天
袁轶
祝建平
王笑林
李婷婷
张帅
韩纪云
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Qidian Zhibo Technology Co ltd
Original Assignee
Beijing Qidian Zhibo Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Qidian Zhibo Technology Co ltd filed Critical Beijing Qidian Zhibo Technology Co ltd
Priority to CN202311389594.5A priority Critical patent/CN117119216B/en
Publication of CN117119216A publication Critical patent/CN117119216A/en
Application granted granted Critical
Publication of CN117119216B publication Critical patent/CN117119216B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21—Server components or server architectures
    • H04N21/218—Source of audio or video content, e.g. local disk arrays
    • H04N21/2187—Live feed
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/1066—Session management
    • H04L65/1101—Session protocols
    • H04L65/1108—Web based protocols, e.g. webRTC
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60—Network streaming of media packets
    • H04L65/75—Media network packet handling
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/236—Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
    • H04N21/2368—Multiplexing of audio and video streams
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/434—Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream
    • H04N21/4341—Demultiplexing of audio and video streams
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
    • H04N21/4363—Adapting the video or multiplex stream to a specific local network, e.g. a IEEE 1394 or Bluetooth® network
    • H04N21/43632—Adapting the video or multiplex stream to a specific local network, e.g. a IEEE 1394 or Bluetooth® network involving a wired protocol, e.g. IEEE 1394
    • H04N21/43635—HDMI
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/4782—Web browsing, e.g. WebTV
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/61—Network physical structure; Signal processing
    • H04N21/6106—Network physical structure; Signal processing specially adapted to the downstream path of the transmission network
    • H04N21/6143—Network physical structure; Signal processing specially adapted to the downstream path of the transmission network involving transmission via a satellite
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/61—Network physical structure; Signal processing
    • H04N21/6156—Network physical structure; Signal processing specially adapted to the upstream path of the transmission network
    • H04N21/6193—Network physical structure; Signal processing specially adapted to the upstream path of the transmission network involving transmission via a satellite

Abstract

The invention discloses a live broadcast explanation method and system and a use method of a live broadcast system, and relates to the technical field of live broadcast. One embodiment of the method comprises the following steps: acquiring a video stream of a live broadcast picture; converting the video stream into a browsing page by using an acquisition card corresponding to the acquisition end, and transmitting the browsing page to the first terminal; receiving a composite stream returned by the first terminal in response to the browsing page by utilizing an acquisition card corresponding to the output end; the composite stream includes an audio stream illustrating the live view; and generating a live broadcast signal corresponding to the live broadcast picture according to the audio stream and the video stream so as to carry out live broadcast according to the live broadcast signal. According to the embodiment, different acquisition cards are respectively arranged at the acquisition end and the output end to transmit and receive data, so that hardware such as an encoder and a decoder is omitted. Meanwhile, the method and the system transmit in the form of browsing the web pages, realize low-delay transmission on the basis of guaranteeing the image quality requirements, and can be directly operated on the web pages without depending on open-source broadcasting software.

Description

Live broadcast explanation method and system and use method of live broadcast system
Technical Field
The invention relates to the technical field of live broadcasting, in particular to a live broadcasting explanation method and system and a use method of a live broadcasting system.
Background
In the existing live broadcast explanation process, a video stream of a live broadcast picture is required to be encoded by an encoder and then sent to an explanation member of a first terminal by the explanation system, then the explanation audio of the explanation member is collected by open broadcast software (Open Broadcaster Software, OBS) installed on the first terminal, the audio stream is returned to the explanation system by using a real-time message transmission protocol (Real Time Messaging Protocol, RTMP), the explanation system decodes by using a decoder to obtain audio, and finally the audio is embedded on the video stream to finish the production of the live broadcast picture. Because of the broadcast software of the open source and the specific transmission protocol, the video stream and the audio stream have the problems of high delay and high bandwidth occupation in the transmission process, and the hardware such as an encoder, a decoder and the like is needed, and the computer configuration requirement for installing the broadcast software is higher, so the cost is relatively higher.
Disclosure of Invention
In view of this, the embodiments of the present invention provide a method and a system for live broadcast and a method for using a live broadcast system, where different acquisition cards are respectively disposed at an acquisition end and an output end to transmit and receive data, so that hardware such as an encoder and a decoder can be omitted. Meanwhile, the method and the system transmit in the form of browsing the web page, can realize low-delay transmission on the basis of guaranteeing the image quality requirement, and can be directly operated on the web page without depending on open-source broadcasting software.
To achieve the above object, according to one aspect of an embodiment of the present invention, there is provided a method of live commentary.
The method for directly broadcasting the explanation of the embodiment of the invention is applied to an explanation system and comprises the following steps: acquiring a video stream of a live broadcast picture; converting the video stream into a browsing page by using an acquisition card corresponding to an acquisition end, and transmitting the browsing page to a first terminal; receiving a composite stream returned by the first terminal in response to the browsing page by using an acquisition card corresponding to an output end; the composite stream includes an audio stream illustrating the live view; and generating a live broadcast signal corresponding to the live broadcast picture according to the audio stream and the video stream so as to carry out live broadcast according to the live broadcast signal.
Optionally, the collection end and the first terminal, and the first terminal and the output end all adopt WebRTC protocol for communication.
Optionally, the acquisition card corresponding to the acquisition end is a USB-SDI acquisition card, and the converting the video stream into the browsing page by using the acquisition card corresponding to the acquisition end includes: and converting the baseband signal of the video stream by using a USB-SDI acquisition card to generate an H5 page.
Optionally, the acquisition card corresponding to the output end is an HDMI-SDI acquisition card.
Optionally, the generating, according to the audio stream and the video stream, a live broadcast signal corresponding to the live broadcast picture includes: and embedding the audio stream onto the video stream to generate a live broadcast signal comprising the audio stream and the video stream.
Optionally, in the case that the first terminal is plural, the method further includes: the browsing pages are respectively sent to a plurality of first terminals by utilizing the acquisition end; receiving the composite streams returned by the first terminals respectively by using the output terminals; and respectively acquiring corresponding audio streams from each composite stream, and embedding a plurality of audio streams onto the video stream to generate a live broadcast signal comprising the audio streams and the video streams.
To achieve the above object, according to still another aspect of an embodiment of the present invention, a system for live commentary is provided.
The system for live broadcast explanation of the embodiment of the invention comprises: the acquisition module is used for acquiring the video stream of the live broadcast picture; the first sending module is used for converting the video stream into a browsing page by utilizing a collection card corresponding to the collection end and sending the browsing page to the first terminal; the first receiving module is used for receiving the composite stream returned by the first terminal in response to the browsing page by utilizing the acquisition card corresponding to the output end; the composite stream includes an audio stream illustrating the live view; and the generation module is used for generating a live broadcast signal corresponding to the live broadcast picture according to the audio stream and the video stream so as to carry out live broadcast according to the live broadcast signal.
To achieve the above object, according to still another aspect of the embodiments of the present invention, there is provided a method for using an illustration system.
The application method of the explanation system of the embodiment of the invention is applied to the first terminal and comprises the following steps: receiving a browsing page sent by an acquisition end of an explanation system; receiving an audio stream of an commentator in the case of turning on a voice function; the audio stream is sent to an output of the commentary system.
Optionally, in the case that the first terminal is plural, the method further includes: for a first terminal in current use, receiving target video streams respectively corresponding to other first terminals sent by the explanation system; and responding to the view display mode selected by the commentator, displaying the target video streams corresponding to the other first terminals in the browsing page according to the view display mode.
To achieve the above object, according to still another aspect of an embodiment of the present invention, there is provided a first terminal of an illustration system.
A first terminal of an explanation system of an embodiment of the present invention includes: the second receiving module is used for receiving a browsing page sent by the acquisition end of the explanation system; receiving an audio stream of an commentator in the case of turning on a voice function; and the second sending module is used for sending the audio stream to the output end of the explanation system.
To achieve the above object, according to still another aspect of the embodiments of the present invention, there is provided an electronic device for live commentary.
The electronic device for live broadcast explanation of the embodiment of the invention comprises: one or more processors; and the storage device is used for storing one or more programs, and when the one or more programs are executed by the one or more processors, the one or more processors realize a live interpretation method of the embodiment of the invention or a use method of an interpretation system of the embodiment of the invention.
To achieve the above object, according to still another aspect of the embodiments of the present invention, there is provided a computer-readable storage medium.
A computer-readable storage medium of an embodiment of the present invention has stored thereon a computer program which, when executed by a processor, implements a method of live commentary of an embodiment of the present invention or a method of use of a commentary system of an embodiment of the present invention.
One embodiment of the above invention has the following advantages or benefits: different acquisition cards are respectively arranged at the acquisition end and the output end to transmit and receive data, so that hardware such as an encoder and a decoder can be omitted. Meanwhile, the method and the system transmit in the form of browsing the web page, can realize low-delay transmission on the basis of guaranteeing the image quality requirement, and can be directly operated on the web page without depending on open-source broadcasting software.
Further effects of the above-described non-conventional alternatives are described below in connection with the embodiments.
Drawings
The drawings are included to provide a better understanding of the invention and are not to be construed as unduly limiting the invention. Wherein:
fig. 1 is a flow diagram of a method of live commentary according to an embodiment of the invention;
fig. 2 is a flow diagram of a method of live multi-person narrative according to embodiments of the present invention;
fig. 3 is a schematic diagram of the main modules of a system for live commentary according to an embodiment of the present invention;
fig. 4 is a flow chart illustrating a method of using a system according to an embodiment of the present invention;
fig. 5 is a flow chart of a method of using a multiple-person interpretation system according to an embodiment of the invention;
fig. 6 is a schematic diagram of a view of a browse page Shan Gongge according to an embodiment of the invention;
fig. 7 is a schematic diagram of a two-grid view of a browsing page according to an embodiment of the present invention;
FIG. 8 is a schematic diagram of a view of a grid of browsing pages according to an embodiment of the present invention;
fig. 9 is a schematic diagram illustrating main modules of a first terminal of the system according to an embodiment of the present invention;
FIG. 10 is an exemplary system architecture diagram in which embodiments of the present invention may be applied;
fig. 11 is a schematic diagram of a computer system suitable for use in implementing an embodiment of the invention.
Detailed Description
Exemplary embodiments of the present invention will now be described with reference to the accompanying drawings, in which various details of the embodiments of the present invention are included to facilitate understanding, and are to be considered merely exemplary. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the invention. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.
It should be noted that the embodiments of the present invention and the technical features in the embodiments may be combined with each other without collision.
It should be noted that, in the technical solution of the present disclosure, the related aspects of collecting, updating, analyzing, processing, using, transmitting, storing, etc. of the personal information of the user all conform to the rules of the related laws and regulations, and are used for legal purposes without violating the public order colloquial. Necessary measures are taken for the personal information of the user, illegal access to the personal information data of the user is prevented, and the personal information security and network security of the user are maintained.
Fig. 1 is a schematic diagram of the main steps of a method of live commentary according to an embodiment of the present invention.
As shown in fig. 1, the method for live broadcast explanation of the embodiment of the present invention mainly includes the following steps:
step S101: acquiring a video stream of a live broadcast picture;
step S102: converting the video stream into a browsing page by using an acquisition card corresponding to the acquisition end, and transmitting the browsing page to the first terminal;
step S103: receiving a composite stream returned by the first terminal in response to the browsing page by utilizing an acquisition card corresponding to the output end; the composite stream includes an audio stream illustrating the live view;
step S104: and generating a live broadcast signal corresponding to the live broadcast picture according to the audio stream and the video stream so as to carry out live broadcast according to the live broadcast signal.
In the live broadcast process, the commentary system is required to acquire the commentary audio stream from the composite stream and embed the live commentary audio stream into the clear stream, so as to finally form the live broadcast picture with commentary. In general, the production process requires a certain time, so that a live picture with an explanation has a certain delay compared to an event picture. In the embodiment of the invention, the broadcasting software OBS with an open source is not needed, so that the limitation of the RTMP transmission protocol is not restricted, and other transmission protocols with higher transmission efficiency can be adopted. In an alternative embodiment, the WebRTC protocol is used for communication between the acquisition end and the first terminal, and between the first terminal and the output end. Compared with the RTMP transmission protocol, the Web Real-time communication protocol (Web Real-Time Communications, webRTC) allows network applications or sites to establish Peer-to-Peer (Peer-to-Peer) connection between browsers without intermediaries, so that transmission of video streams and/or audio streams or any other data is realized, and data sharing and teleconferencing of Peer-to-Peer (Peer-to-Peer) creation are possible without installing any plug-in or third party software.
In an optional embodiment, different acquisition cards are selected at the acquisition end and the output end for data acquisition, specifically, the acquisition card corresponding to the acquisition end is a USB-SDI acquisition card, that is, step S102 specifically includes: and converting the baseband signal of the video stream by using the USB-SDI acquisition card to generate an H5 page. The USB-SDI acquisition card can be conveniently used without installing a driver, the video input by HDMI can be directly input into the terminal equipment without encoding, the high definition original video is not compressed any more, the video is not compressed by an additional program while the time delay is low, encoding time is not wasted, and rapid transmission of the video is further realized. In a further alternative embodiment, the acquisition card corresponding to the output end is an HDMI-SDI acquisition card, where the HDMI-SDI acquisition card has a full digital video and audio transmission interface, and is capable of transmitting uncompressed audio and video signals. Therefore, according to the embodiment of the invention, different acquisition cards are selected at different acquisition ends, so that the audio and video can be rapidly transmitted on the basis of ensuring no compression, and the time delay is reduced. Meanwhile, the combination of the WebRTC protocol and the acquisition card is utilized to meet the requirements of light-weight and low-delay manufacturing, meanwhile, the equipment maintenance cost is reduced, and the operation and operation flows of an interpreter and a manufacturing person are optimized.
For the process of generating the live signal in step S104, in an alternative embodiment, the method specifically includes: an audio stream is embedded onto a video stream to generate a live signal comprising the audio stream and the video stream. The embedding process of the audio stream and the video stream can be realized by adopting the prior art means, and the invention is not repeated.
In the embodiment of the invention, the first terminal may be multiple, that is, multiple commentary is simultaneously performed on one live broadcast picture, and each commentary is interacted with a scene. In this case, in an alternative embodiment, as shown in fig. 2, further includes:
step S201: the method comprises the steps that a browsing page is respectively sent to a plurality of first terminals by utilizing an acquisition terminal;
step S202: the output end is used for receiving the composite streams returned by the first terminals respectively;
step S203: and respectively acquiring corresponding audio streams from each composite stream, and embedding a plurality of audio streams onto the video stream to generate a live broadcast signal comprising the audio streams and the video stream.
Therefore, according to the embodiment of the invention, the browsing page is sent to the plurality of first terminals, and the composite streams returned by the first terminals in response to the browsing page are respectively collected, so that the audio streams in the plurality of composite streams can be synchronously extracted and simultaneously embedded into the video stream, and the effect of synchronously explaining a plurality of comments is realized.
According to the live broadcast explanation method provided by the embodiment of the invention, different acquisition cards are respectively arranged at the acquisition end and the output end to transmit and receive data, so that hardware such as an encoder and a decoder can be omitted. Meanwhile, the method and the system transmit in the form of browsing the web page, can realize low-delay transmission on the basis of guaranteeing the image quality requirement, and can be directly operated on the web page without depending on open-source broadcasting software.
Fig. 3 is a schematic diagram of the main modules of a system for live commentary according to an embodiment of the present invention.
As shown in fig. 3, a system 300 for live commentary of an embodiment of the present invention includes:
an acquiring module 301, configured to acquire a video stream of a live broadcast picture;
the first sending module 302 is configured to convert the video stream into a browsing page by using an acquisition card corresponding to an acquisition end, and send the browsing page to a first terminal;
the first receiving module 303 is configured to receive, using an acquisition card corresponding to an output end, a composite stream returned by the first terminal in response to the browsing page; the composite stream includes an audio stream illustrating the live view;
and the generating module 304 is configured to generate a live broadcast signal corresponding to the live broadcast picture according to the audio stream and the video stream, so as to perform live broadcast according to the live broadcast signal.
In an alternative embodiment of the present invention, the collecting end and the first terminal, and the first terminal and the output end all use WebRTC protocol to communicate.
In an optional embodiment of the present invention, the acquisition card corresponding to the acquisition end is a USB-SDI acquisition card, and the first sending module 302 is further configured to convert a baseband signal of the video stream using the USB-SDI acquisition card to generate an H5 page.
In an optional embodiment of the present invention, the acquisition card corresponding to the output end is an HDMI-SDI acquisition card.
In an alternative embodiment of the present invention, the generating module 304 is further configured to embed the audio stream into the video stream, and generate a live signal that includes the audio stream and the video stream.
In an optional embodiment of the present invention, in a case that the first terminal is plural, the method further includes: the first sending module 302 is further configured to send the browsing pages to a plurality of first terminals by using the collecting end; the first receiving module 303 is further configured to receive, by using the output terminal, a composite stream returned by each of the first terminals; the generating module 304 is further configured to obtain corresponding audio streams from the composite streams, and embed the audio streams onto the video stream, so as to generate a live broadcast signal including the audio streams and the video stream.
According to the system for live broadcast explanation of the embodiment of the invention, different acquisition cards are respectively arranged at the acquisition end and the output end to transmit and receive data, so that hardware such as an encoder and a decoder can be omitted. Meanwhile, the method and the system transmit in the form of browsing the web page, can realize low-delay transmission on the basis of guaranteeing the image quality requirement, and can be directly operated on the web page without depending on open-source broadcasting software.
Fig. 4 is a schematic diagram of main steps of a method for using an explanation system applied to a first terminal according to an embodiment of the present invention.
As shown in fig. 4, the method for using the explanation system according to the embodiment of the present invention mainly includes the following steps:
step S401: receiving a browsing page sent by an acquisition end of an explanation system;
step S402: receiving an audio stream of an commentator in the case of turning on a voice function;
step S403: the audio stream is sent to the output of the narrative system.
It can be understood that the whole commentary process is completed through interaction between the first terminal and the commentary system, that is, through the commentary system provided in fig. 1 and the first terminal provided in fig. 4, the two users and the roles are different, respectively, the two users and the roles are different, the use is performed by the producer for synthesizing to obtain the live broadcast signal, and the use is performed by the commentator in fig. 4, for collecting the audio stream from the remote location of the commentary and transmitting the audio stream to the commentary system.
Corresponding to the illustration system, the browsing page in step S401 is also an H5 web page. Under the multi-commentator commentary scene provided by the invention, when the first terminal is used as the commentator, the pictures of other commentators can be seen, and compared with the prior art, each commentator can only be interpreted through a single room (namely, only a plurality of commentators under the line can sit together to carry out commentary, and the online synchronous commentary of the plurality of commentators cannot be realized), so that the interaction and communication among the plurality of commentators are increased. In an alternative embodiment, in a case that the first terminal is plural, the method is as shown in fig. 5, and further includes:
step S501: for a first terminal in current use, receiving target video streams respectively corresponding to other first terminals sent by an explanation system;
step S502: and responding to the view display mode selected by the commentator, displaying the target video streams corresponding to other first terminals in the browsing page according to the view display mode.
In an alternative embodiment, the target video stream may not only include the explanation pictures of other commentators, but also include the field control picture received by the explanation system and the working picture of the staff, where the choice of the pictures can be selected by the explanation system according to the actual requirement, which is not limited by the present invention.
Specifically, the view display manner in step S502 may be selected by the explanation of the first terminal according to the actual requirement, that is, different target video streams are displayed in different regions of the browsing page. As shown in fig. 6 to 8, fig. 6 is a view Shan Gongge, i.e., an event live screen is shown in the area 1, and a plurality of commentators and a live screen of a field control are shown in the area 2. Fig. 7 and 8 are two-grid view and four-grid view, respectively, i.e., two pictures and four pictures are shown in region 1 for two-person remote interpretation or four-person remote interpretation. It will be appreciated that fig. 6-8 are only schematic illustrations of views, and do not represent that the browsing page can only include Shan Gongge, two boxes, and four boxes, and that the user may select the browsing page in a customized manner according to the needs of the user and the number of commentators. In addition, for the content specifically displayed by the pictures, the control can be performed by dragging a mouse on the webpage, any one or more pictures in the area 2 are dragged into the area 1 for display, the interaction experience in the learning and speaking process is improved, and a plurality of commentators can see each other and perform remote dialogue.
In addition, for the display of the browsed page, as shown in fig. 6, the display device may further include an area 3, including a microphone setting button, a chat tool, and other functional buttons that may be used in the live broadcast process, so that the commentator can adjust in the commentary process. According to the embodiment of the invention, the functional buttons are arranged in the browsing page, so that the communication flow between the live broadcast and the commentator in the live broadcast process is facilitated, the commentator can feed back the live broadcast to the live broadcast under the condition that the live broadcast of the sports event is not influenced, and the live broadcast communication efficiency is improved.
According to the using method of the explanation system provided by the embodiment of the invention, different acquisition cards are respectively arranged at the acquisition end and the output end to transmit and receive data, so that hardware such as an encoder and a decoder can be omitted. Meanwhile, the method and the system transmit in the form of browsing the web page, can realize low-delay transmission on the basis of guaranteeing the image quality requirement, and can be directly operated on the web page without depending on open-source broadcasting software.
Fig. 9 is a schematic diagram illustrating main modules of a first terminal of a system according to an embodiment of the present invention.
As shown in fig. 9, a first terminal 900 of the explanation system of the embodiment of the present invention includes:
a second receiving module 901, configured to receive a browsing page sent by an acquisition end of the interpretation system; receiving an audio stream of an commentator in the case of turning on a voice function;
a second sending module 902 sends the audio stream to an output of the commentary system.
In an optional embodiment, in a case that the number of the first terminals is multiple, the second receiving module 901 is further configured to, for a currently used first terminal, receive target video streams respectively corresponding to other first terminals sent by the commentary system;
and the display module is used for responding to the view display mode selected by the commentator and displaying the target video streams corresponding to the other first terminals in the browsing page according to the view display mode.
According to the first terminal of the explanation system of the embodiment of the invention, different acquisition cards are respectively arranged at the acquisition end and the output end to transmit and receive data, so that hardware such as an encoder and a decoder can be omitted. Meanwhile, the method and the system transmit in the form of browsing the web page, can realize low-delay transmission on the basis of guaranteeing the image quality requirement, and can be directly operated on the web page without depending on open-source broadcasting software.
Fig. 10 shows an exemplary system architecture 1000 of a method of live commentary or an apparatus of live commentary to which embodiments of the present invention may be applied.
As shown in fig. 10, the system architecture 1000 may include terminal devices 1001, 1002, 1003 of a first terminal, a network 1004, and a server 1005 of an illustration system. The network 1004 serves as a medium for providing a communication link between the terminal apparatuses 1001, 1002, 1003 and the server 1005. The network 1004 may include various connection types, such as wired, wireless communication links, or fiber optic cables, among others.
A user can interact with the server 1005 via the network 1004 using the terminal apparatuses 1001, 1002, 1003 to receive or transmit data or the like. Various communication client applications such as shopping class applications, web browser applications, search class applications, instant messaging tools, mailbox clients, social platform software, etc., may be installed on the terminal devices 1001, 1002, 1003.
The terminal devices 1001, 1002, 1003 may be various electronic devices having a display screen and supporting web browsing, including but not limited to smartphones, tablets, laptop and desktop computers, and the like.
The server 1005 may be a server providing various services, such as a background management server providing support for the composite stream transmitted by the user using the terminal apparatuses 1001, 1002, 1003. The background management server may analyze the received composite stream and perform other processing, and live broadcast the processing result (e.g., live broadcast signal).
It should be noted that, the method for live broadcast explanation provided in the embodiment of the present invention is generally executed by the server 1005, and accordingly, the device for live broadcast explanation is generally disposed in the server 1005.
It should be understood that the number of terminal devices, networks and servers in fig. 10 is merely illustrative. There may be any number of terminal devices, networks, and servers, as desired for implementation.
Referring now to FIG. 11, there is illustrated a schematic diagram of a computer system 1100 suitable for use in implementing the terminal device of an embodiment of the present invention. The terminal device shown in fig. 11 is only an example, and should not impose any limitation on the functions and the scope of use of the embodiment of the present invention.
As shown in fig. 11, the computer system 1100 includes a Central Processing Unit (CPU) 1101, which can execute various appropriate actions and processes according to a program stored in a Read Only Memory (ROM) 1102 or a program loaded from a storage section 1108 into a Random Access Memory (RAM) 1103. In the RAM 1103, various programs and data required for the operation of the system 1100 are also stored. The CPU 1101, ROM 1102, and RAM 1103 are connected to each other by a bus 1104. An input/output (I/O) first interface 1105 is also connected to the bus 1104.
The following components are connected to the I/O first interface 1105: an input section 1106 including a keyboard, a mouse, and the like; an output portion 1107 including a Cathode Ray Tube (CRT), a Liquid Crystal Display (LCD), and the like, a speaker, and the like; a storage section 1108 including a hard disk or the like; and a communication section 1109 including a network first interface card such as a LAN card, a modem, or the like. The communication section 1109 performs communication processing via a network such as the internet. The driver 1110 is also connected to the I/O first interface 1105 as needed. Removable media 1111, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like, is installed as needed in drive 1110, so that a computer program read therefrom is installed as needed in storage section 1108.
In particular, according to embodiments of the present disclosure, the processes described above with reference to flowcharts may be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program product comprising a computer program embodied on a computer readable medium, the computer program comprising program code for performing the method shown in the flow chart. In such an embodiment, the computer program can be downloaded and installed from a network via the communication portion 1109, and/or installed from the removable media 1111. The above-described functions defined in the system of the present invention are performed when the computer program is executed by a Central Processing Unit (CPU) 1101.
The computer readable medium shown in the present invention may be a computer readable signal medium or a computer readable storage medium, or any combination of the two. The computer readable storage medium can be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or a combination of any of the foregoing. More specific examples of the computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this document, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In the present invention, however, the computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, with the computer-readable program code embodied therein. Such a propagated data signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination of the foregoing. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wire, fiber optic cable, RF, etc., or any suitable combination of the foregoing.
The flowcharts and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present invention. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams or flowchart illustration, and combinations of blocks in the block diagrams or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
The modules involved in the embodiments of the present invention may be implemented in software or in hardware. The described modules may also be provided in a processor, for example, as: a processor includes an acquisition module, a first transmission module, a first reception module, and a generation module. The names of these modules do not limit the module itself in some cases, and the acquisition module may also be described as a "module for acquiring a video stream of a live view", for example.
As another aspect, the present invention also provides a computer-readable medium that may be contained in the apparatus described in the above embodiments; or may be present alone without being fitted into the device. The computer readable medium carries one or more programs which, when executed by a device, cause the device to include: acquiring a video stream of a live broadcast picture; converting the video stream into a browsing page by using an acquisition card corresponding to an acquisition end, and transmitting the browsing page to a first terminal; receiving a composite stream returned by the first terminal in response to the browsing page by using an acquisition card corresponding to an output end; the composite stream includes an audio stream illustrating the live view; and generating a live broadcast signal corresponding to the live broadcast picture according to the audio stream and the video stream so as to carry out live broadcast according to the live broadcast signal.
According to the technical scheme of the embodiment of the invention, different acquisition cards are respectively arranged at the acquisition end and the output end to transmit and receive data, so that hardware such as an encoder and a decoder can be omitted. Meanwhile, the method and the system transmit in the form of browsing the web page, can realize low-delay transmission on the basis of guaranteeing the image quality requirement, and can be directly operated on the web page without depending on open-source broadcasting software.
The above embodiments do not limit the scope of the present invention. It will be apparent to those skilled in the art that various modifications, combinations, sub-combinations and alternatives can occur depending upon design requirements and other factors. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present invention should be included in the scope of the present invention.

Claims (9)

1. A method of live commentary, applied to a commentary system, comprising:
acquiring a video stream of a live broadcast picture;
converting the video stream into a browsing page by using an acquisition card corresponding to an acquisition end, and transmitting the browsing page to a first terminal; the acquisition card corresponding to the acquisition end is a USB-SDI acquisition card;
receiving a composite stream returned by the first terminal in response to the browsing page by using an acquisition card corresponding to an output end; the composite stream includes an audio stream illustrating the live view; the acquisition card corresponding to the output end is an HDMI-SDI acquisition card;
generating a live broadcast signal corresponding to the live broadcast picture according to the audio stream and the video stream so as to carry out live broadcast according to the live broadcast signal;
in the case that the first terminal is plural, the method further includes:
the browsing pages are respectively sent to a plurality of first terminals by utilizing the acquisition end;
receiving the composite streams returned by the first terminals respectively by using the output terminals;
and respectively acquiring corresponding audio streams from each composite stream, and embedding a plurality of audio streams onto the video stream to generate a live broadcast signal comprising the audio streams and the video streams.
2. The method of claim 1, wherein the acquisition side communicates with the first terminal and the first terminal communicates with the output side using WebRTC protocol.
3. The method of claim 1, wherein the converting the video stream into the browsing page by using the acquisition card corresponding to the acquisition end comprises:
and converting the baseband signal of the video stream by using a USB-SDI acquisition card to generate an H5 page.
4. The method of claim 1, wherein generating a live signal corresponding to the live view from the audio stream and the video stream comprises:
and embedding the audio stream onto the video stream to generate a live broadcast signal comprising the audio stream and the video stream.
5. A system for live commentary, comprising:
the acquisition module is used for acquiring the video stream of the live broadcast picture;
the first sending module is used for converting the video stream into a browsing page by utilizing a collection card corresponding to the collection end and sending the browsing page to the first terminal; the acquisition card corresponding to the acquisition end is a USB-SDI acquisition card;
the first receiving module is used for receiving the composite stream returned by the first terminal in response to the browsing page by utilizing the acquisition card corresponding to the output end; the composite stream includes an audio stream illustrating the live view; the acquisition card corresponding to the output end is an HDMI-SDI acquisition card;
the generation module is used for generating a live broadcast signal corresponding to the live broadcast picture according to the audio stream and the video stream so as to carry out live broadcast according to the live broadcast signal;
the first sending module is further configured to send the browsing page to a plurality of first terminals by using the acquisition end when the plurality of first terminals are provided; the first receiving module is further used for receiving the composite streams returned by the first terminals respectively by utilizing the output terminals; the generating module is further configured to obtain corresponding audio streams from the composite streams, and embed the audio streams onto the video stream, so as to generate a live broadcast signal including the audio streams and the video stream.
6. A method of using an illustration system, applied to a first terminal, comprising:
receiving a browsing page sent by an acquisition end of an explanation system; the acquisition card corresponding to the acquisition end is a USB-SDI acquisition card;
receiving an audio stream of an commentator in the case of turning on a voice function;
transmitting the audio stream to an output of the commentary system; the acquisition card corresponding to the output end is an HDMI-SDI acquisition card; in the case that the first terminal is plural, the method further includes:
for a first terminal in current use, receiving target video streams respectively corresponding to other first terminals sent by the explanation system;
responding to a view display mode selected by the commentator, displaying target video streams corresponding to other first terminals in the browsing page according to the view display mode; wherein the target video stream comprises: the method comprises the steps of displaying a comment picture of other commentators, a field control picture received by the comment system and a work picture of a worker.
7. A first terminal of an illustration system, comprising:
the second receiving module is used for receiving a browsing page sent by the acquisition end of the explanation system; receiving an audio stream of an commentator in the case of turning on a voice function; the acquisition card corresponding to the acquisition end is a USB-SDI acquisition card;
a second sending module, configured to send the audio stream to an output end of the commentary system; the acquisition card corresponding to the output end is an HDMI-SDI acquisition card; in the case that the first terminal is plural, the method further includes: for a first terminal in current use, receiving target video streams respectively corresponding to other first terminals sent by the explanation system;
the display module is used for responding to the view display mode selected by the commentator and displaying the target video streams corresponding to the other first terminals in the browsing page according to the view display mode; wherein the target video stream comprises: the method comprises the steps of displaying a comment picture of other commentators, a field control picture received by the comment system and a work picture of a worker.
8. An electronic device for live commentary, comprising:
one or more processors;
storage means for storing one or more programs,
when executed by the one or more processors, causes the one or more processors to implement the method of any of claims 1-4 or claim 6.
9. A computer readable medium on which a computer program is stored, characterized in that the program, when being executed by a processor, implements the method according to any one of claims 1-4 or 6.
CN202311389594.5A 2023-10-25 2023-10-25 Live broadcast explanation method and system and use method of live broadcast system Active CN117119216B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202311389594.5A CN117119216B (en) 2023-10-25 2023-10-25 Live broadcast explanation method and system and use method of live broadcast system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202311389594.5A CN117119216B (en) 2023-10-25 2023-10-25 Live broadcast explanation method and system and use method of live broadcast system

Publications (2)

Publication Number Publication Date
CN117119216A CN117119216A (en) 2023-11-24
CN117119216B true CN117119216B (en) 2024-01-26

Family

ID=88798788

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202311389594.5A Active CN117119216B (en) 2023-10-25 2023-10-25 Live broadcast explanation method and system and use method of live broadcast system

Country Status (1)

Country Link
CN (1) CN117119216B (en)

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102404607A (en) * 2010-09-11 2012-04-04 刘芳荣 Internet video-on-demand system
CN102710976A (en) * 2005-07-22 2012-10-03 袋鼠传媒股份有限公司 System and methods for enhancing the experience of spectators attending a live sporting event
CN104244108A (en) * 2014-09-24 2014-12-24 上海网达软件股份有限公司 Live method and system
KR20160093292A (en) * 2015-01-29 2016-08-08 한국전자통신연구원 Contents offer method and the method perfoming contents offer server, commentator apparatus
CN112073423A (en) * 2020-09-15 2020-12-11 杭州二更网络科技有限公司 Browser plug-flow method and system based on WebRTC
CN113364998A (en) * 2021-06-04 2021-09-07 广州虎牙科技有限公司 Live video playing method and device, electronic equipment and readable storage medium
CN114025244A (en) * 2021-10-08 2022-02-08 中移（杭州）信息技术有限公司 Audio and video pushing method, device, equipment and computer readable storage medium

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102710976A (en) * 2005-07-22 2012-10-03 袋鼠传媒股份有限公司 System and methods for enhancing the experience of spectators attending a live sporting event
CN102404607A (en) * 2010-09-11 2012-04-04 刘芳荣 Internet video-on-demand system
CN104244108A (en) * 2014-09-24 2014-12-24 上海网达软件股份有限公司 Live method and system
KR20160093292A (en) * 2015-01-29 2016-08-08 한국전자통신연구원 Contents offer method and the method perfoming contents offer server, commentator apparatus
CN112073423A (en) * 2020-09-15 2020-12-11 杭州二更网络科技有限公司 Browser plug-flow method and system based on WebRTC
CN113364998A (en) * 2021-06-04 2021-09-07 广州虎牙科技有限公司 Live video playing method and device, electronic equipment and readable storage medium
CN114025244A (en) * 2021-10-08 2022-02-08 中移（杭州）信息技术有限公司 Audio and video pushing method, device, equipment and computer readable storage medium

Also Published As

Publication number Publication date
CN117119216A (en) 2023-11-24

Similar Documents

Publication Publication Date Title
EP3800893B1 (en) Systems and methods for transmission of data streams
US9118729B2 (en) Method for sharing resource of a videoconference using a video conferencing system
EP3451657B1 (en) Video conference system, application server, device, video conference method, and non-transitory computer readable medium storing video conference program
EP2658232A1 (en) Method and system for an optimized multimedia communications system
EP2323048A1 (en) Method and system for providing complete internet anywhere with partial server processing
JP2006101522A (en) Video conference system, video conference system for enabling participant to customize cooperation work model, and method for controlling mixing of data stream for video conference session
CN102821134A (en) Gateway and operation method thereof
EP2779571B1 (en) Distribution control system, distribution system, distribution control method, and computer-readable storage medium
CN114584736B (en) Sharing method and device based on video conference, electronic equipment and computer medium
US9756096B1 (en) Methods for dynamically transmitting screen images to a remote device
WO2015192617A1 (en) Conference sharing method and device for document
JP2023515392A (en) Information processing method, system, device, electronic device and storage medium
CN104935952B (en) A kind of video transcoding method and system
CN113225577A (en) Live stream processing method, device and system, electronic equipment and storage medium
CN112291502B (en) Information interaction method, device and system and electronic equipment
CN106354462B (en) A kind of the document method of simultaneous display, equipment and system in multiple equipment
CN108337556B (en) Method and device for playing audio-video file
CN117119216B (en) Live broadcast explanation method and system and use method of live broadcast system
CN115766695A (en) Websocket-based remote browsing method and device for real-time image of industrial camera
CN107872683B (en) Video data processing method, device, equipment and storage medium
CN111857901A (en) Data processing method, method for generating session background, electronic device and medium
CN111404977B (en) Document remote demonstration and viewing method and terminal equipment
CN112269770A (en) Document sharing method, device and system and electronic equipment
CN113542335A (en) Information sharing method and device, electronic equipment and storage medium
CN113727183B (en) Live push method, apparatus, device, storage medium and computer program product

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant