CN111131847A - Live broadcast interaction method - Google Patents
Live broadcast interaction method Download PDFInfo
- Publication number
- CN111131847A CN111131847A CN201911341181.3A CN201911341181A CN111131847A CN 111131847 A CN111131847 A CN 111131847A CN 201911341181 A CN201911341181 A CN 201911341181A CN 111131847 A CN111131847 A CN 111131847A
- Authority
- CN
- China
- Prior art keywords
- interactive
- live broadcast
- message
- live
- written
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/21—Server components or server architectures
- H04N21/218—Source of audio or video content, e.g. local disk arrays
- H04N21/2187—Live feed
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
- H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/236—Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
- H04N21/23614—Multiplexing of additional data and video streams
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/236—Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
- H04N21/2362—Generation or processing of Service Information [SI]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
- H04N21/647—Control signaling between network components and server or clients; Network processes for video distribution between server and clients, e.g. controlling the quality of the video stream, by dropping packets, protecting content from unauthorised alteration within the network, monitoring of network load, bridging between two different networks, e.g. between IP and wireless
- H04N21/64784—Data processing by the network
- H04N21/64792—Controlling the complexity of the content stream, e.g. by dropping packets
Abstract
The invention discloses a live broadcast interaction method. The method specifically comprises the following steps: (1) when the live broadcast is carried out to the interactive moment, writing interactive messages into audio and video streams generated by an encoding server; (2) after receiving the audio and video stream, the live broadcast client analyzes the audio and video stream and also analyzes the interactive message written into the audio and video stream at the live broadcast client; (3) after the live broadcast client analyzes the interactive message, the interactive message is presented to the user in a preset interactive object mode; (4) the user clicks on the interactive object to trigger an interactive event. The invention has the beneficial effects that: the problems in the generation, storage, transmission, synchronization and presentation of interactive information in the live broadcast process are solved, and the audience rating and the participation degree of the user can be effectively improved according to the user interaction generated by the live broadcast content.
Description
Technical Field
The invention relates to the technical field of live broadcast, in particular to a live broadcast interaction method.
Background
Live broadcasting refers to a broadcasting mode in which the later synthesis and broadcasting of a broadcast television program are performed simultaneously. With the rise of network live broadcast, a lot of problems are often faced when interactive information is generated, stored, transmitted, synchronized and presented in the live broadcast process, resulting in lower audience rating and participation of users.
Disclosure of Invention
The invention provides a live broadcast interaction method with high audience rating and participation degree to overcome the defects in the prior art.
In order to achieve the purpose, the invention adopts the following technical scheme:
a live broadcast interaction method specifically comprises the following steps:
(1) when the live broadcast is carried out to the interactive moment, writing interactive messages into audio and video streams generated by an encoding server;
(2) after receiving the audio and video stream, the live broadcast client analyzes the audio and video stream and also analyzes the interactive message written into the audio and video stream at the live broadcast client;
(3) after the live broadcast client analyzes the interactive message, the interactive message is presented to the user in a preset interactive object mode;
(4) the user clicks on the interactive object to trigger an interactive event.
The method solves the problems of generation, storage, transmission, synchronization and presentation of interactive information in the live broadcast process, and the audience rating and the participation degree of the user can be effectively improved according to the user interaction generated by the live broadcast content.
Preferably, in the step (1), when the live broadcast is carried out to the time needing interaction, the broadcast control personnel sends the interactive message which is written in advance to the live broadcast coding server, and the live broadcast coding server writes the interactive message into the supplemental enhancement information SEI of the audio and video stream.
Preferably, when compressed in h.264/AVC video, the interactive message will be written in JSON string form into supplemental enhancement information SEI, where NAL unit type is set to 6 and SEI payload type is set to 5.
Preferably, when compressed in h.265/HEVC video, the interactive message will be written in the form of a JSON string into supplemental enhancement information SEI, where NAL unit type is set to 39 or 40 and SEI payload type is set to 5.
Preferably, 32-bit UUID is written in supplemental enhancement information SEI payload, then the information is written in the form of JSON character string as the interactive information, and the information is written in the supplemental enhancement information SEI of the continuous n-frame video data, so as to ensure that the live broadcast client can receive the interactive information even if network packet loss occurs.
Preferably, in step (2), when compressed in h.264/AVC video or compressed in h.265/HEVC video, the live broadcast client parses the content when the SEI payload type of the NAL unit is 5, and if the supplemental enhancement information SEI content starts with a written 32-bit UUID, it is considered that the interactive message needs to be parsed and the subsequent JSON string content is read.
Preferably, in step (3), after the live client parses the interaction message in JSON format, the options contained in the interaction message appear in the current window in the form of a floating menu, and the user clicks the menu to trigger the interaction event.
Preferably, in step (4), the live client sends the option content and the user information to the event server, and the event server processes the user-selected event and performs subsequent user-related processing.
The invention has the beneficial effects that: the problems in the generation, storage, transmission, synchronization and presentation of interactive information in the live broadcast process are solved, and the audience rating and the participation degree of the user can be effectively improved according to the user interaction generated by the live broadcast content.
Drawings
FIG. 1 is a flow chart of the method of the present invention.
Detailed Description
The invention is further described with reference to the following figures and detailed description.
In the embodiment shown in fig. 1, a live broadcast interaction method specifically includes the following steps:
(1) when the live broadcast is carried out to the interactive moment, writing interactive messages into audio and video streams generated by an encoding server; when the live broadcast is carried out to the time needing interaction, broadcast control personnel send a pre-compiled interaction message to a live broadcast coding server, and the live broadcast coding server writes the interaction message into supplemental enhancement information SEI of audio and video stream; the interactive message written in the audio and video stream needs to be continued for a period of time so as to avoid information loss caused by packet loss during network transmission.
When compressed in h.264/AVC video, the interactive message will be written in JSON string form into supplemental enhancement information SEI, where NAL unit type is set to 6 and SEI payload type is set to 5.
When compressed in h.265/HEVC video, the interactive message will be written in the form of JSON string into supplemental enhancement information SEI, where NAL unit type is set to 39 or 40 and SEI payload type is set to 5.
Firstly writing 32-bit UUID in supplemental enhancement information SEI payload, and then writing interactive information in a JSON character string form, for example: { "options [" YES "," NO "] }, a message is written in supplemental enhancement information SEI of the persistent n frames of video data to ensure that the live client can receive the interactive message even if network packet loss occurs.
(2) After receiving the audio and video stream, the live broadcast client analyzes the audio and video stream and also analyzes the interactive message written into the audio and video stream at the live broadcast client;
when compressing with H.264/AVC video or compressing with H.265/HEVC video, the live broadcast client parses the content when the SEI payload type of NALunit is 5, if the supplemental enhancement information SEI content starts with the written 32-bit UUID, the interaction message is deemed to need to be parsed, and the subsequent JSON character string content is read.
(3) After the live broadcast client analyzes the interactive message, the interactive message is presented to the user in a preset interactive object mode;
after the live broadcast client analyzes the JSON format interactive message, options contained in the JSON format interactive message appear in a current window in a floating menu mode, and a user clicks the menu to trigger an interactive event.
(4) The user clicks the interactive object to trigger an interactive event;
the live broadcast client sends the option content and the user information to the event server, and the event server processes the user selection event and performs subsequent user related processing, such as reward issuing and the like.
Specific examples are as follows:
(1) taking question-answer type live broadcast as an example, when the live broadcast is carried out to the moment that a host asks questions to answer the questions of a user, and after the host asks the questions, the broadcast control personnel send a plurality of alternative answers as interactive messages to the live broadcast coding server.
(2) The live encoding server writes the interactive message with the alternative answer to the SEI of the video for a sufficient time.
(3) And the SEI video stream with the alternative answer message is sent to the client, and the client analyzes the alternative answer message.
(4) The client presents the parsed alternative answers to the viewer in the form of floating buttons.
(5) The viewer clicks a button to select an answer triggering an answer event.
(6) The client-side sends the audience selection to the answer server to confirm the result, settles the income of the audience and completes one-time answer interaction.
Claims (8)
1. A live broadcast interaction method is characterized by comprising the following steps:
(1) when the live broadcast is carried out to the interactive moment, writing interactive messages into audio and video streams generated by an encoding server;
(2) after receiving the audio and video stream, the live broadcast client analyzes the audio and video stream and also analyzes the interactive message written into the audio and video stream at the live broadcast client;
(3) after the live broadcast client analyzes the interactive message, the interactive message is presented to the user in a preset interactive object mode;
(4) the user clicks on the interactive object to trigger an interactive event.
2. The live broadcast interaction method as claimed in claim 1, wherein in step (1), when the live broadcast is carried out to the time point that the interaction is needed, the broadcast control personnel sends the interactive message which is written in advance to the live broadcast coding server, and the live broadcast coding server writes the interactive message into the supplemental enhancement information SEI of the audio/video stream.
3. A live interactive method as claimed in claim 2, wherein when compressed in h.264/AVC video, the interactive message will be written in JSON string form into supplemental enhancement information SEI, when NAL unit type is set to 6 and SEIpayload type is set to 5.
4. A live interaction method as claimed in claim 2, wherein when compressed in h.265/HEVC video, the interaction message will be written in JSON string form into supplemental enhancement information SEI, where NAL unit type is set to 39 or 40 and SEI payload type is set to 5.
5. A live broadcast interaction method as claimed in claim 3 or 4, wherein 32-bit UUID is written in the supplemental enhancement information SEIpayload, and then the message is written in the form of JSON character string as the interaction message, and the message is written in the supplemental enhancement information SEI of the continuous n frames of video data, so as to ensure that the live broadcast client can receive the interaction message even if network packet loss occurs.
6. A live interaction method as claimed in claim 5, wherein in step (2), when compressed in H.264/AVC video or H.265/HEVC video, the live client parses the content with SEI payload type of NAL unit being 5, if the supplemental enhancement information SEI content starts with the written 32-bit UUID, it is considered necessary to parse the interaction message and read the subsequent JSON string content.
7. The live broadcast interactive method as claimed in claim 6, wherein in step (3), after the live broadcast client parses the JSON-formatted interactive message, the options contained therein appear in the form of a floating menu in the current window, and the user clicks the menu to trigger the interactive event.
8. A live interactive method as claimed in claim 7, wherein in step (4), the live client sends the option content and the user information to the event server, and the event server processes the user-selected event and performs the subsequent user-related processing.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911341181.3A CN111131847A (en) | 2019-12-23 | 2019-12-23 | Live broadcast interaction method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911341181.3A CN111131847A (en) | 2019-12-23 | 2019-12-23 | Live broadcast interaction method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111131847A true CN111131847A (en) | 2020-05-08 |
Family
ID=70501329
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911341181.3A Pending CN111131847A (en) | 2019-12-23 | 2019-12-23 | Live broadcast interaction method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111131847A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113596493A (en) * | 2021-07-26 | 2021-11-02 | 腾讯科技（深圳）有限公司 | Interactive special effect synchronization method and related device |
| CN114125501A (en) * | 2021-10-30 | 2022-03-01 | 杭州当虹科技股份有限公司 | Interactive video generation method and playing method and device thereof |
| CN114554229A (en) * | 2022-02-28 | 2022-05-27 | 广州点云科技有限公司 | Method, device, terminal equipment and medium for identifying voice state of user on microphone |
| CN114786022A (en) * | 2022-02-23 | 2022-07-22 | 南京小灿灿网络科技有限公司 | New media live broadcast and user online interaction method |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108924600A (en) * | 2018-06-28 | 2018-11-30 | 乐蜜有限公司 | Sending and receiving methods, device and the electronic equipment of live data |
| CN109714622A (en) * | 2018-11-15 | 2019-05-03 | 北京奇艺世纪科技有限公司 | A kind of video data handling procedure, device and electronic equipment |
| CN110545452A (en) * | 2018-05-28 | 2019-12-06 | 阿里巴巴集团控股有限公司 | Network live broadcast method, device, terminal and server |
-
2019
- 2019-12-23 CN CN201911341181.3A patent/CN111131847A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110545452A (en) * | 2018-05-28 | 2019-12-06 | 阿里巴巴集团控股有限公司 | Network live broadcast method, device, terminal and server |
| CN108924600A (en) * | 2018-06-28 | 2018-11-30 | 乐蜜有限公司 | Sending and receiving methods, device and the electronic equipment of live data |
| CN109714622A (en) * | 2018-11-15 | 2019-05-03 | 北京奇艺世纪科技有限公司 | A kind of video data handling procedure, device and electronic equipment |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113596493A (en) * | 2021-07-26 | 2021-11-02 | 腾讯科技（深圳）有限公司 | Interactive special effect synchronization method and related device |
| CN113596493B (en) * | 2021-07-26 | 2023-03-10 | 腾讯科技（深圳）有限公司 | Interactive special effect synchronization method and related device |
| CN114125501A (en) * | 2021-10-30 | 2022-03-01 | 杭州当虹科技股份有限公司 | Interactive video generation method and playing method and device thereof |
| CN114786022A (en) * | 2022-02-23 | 2022-07-22 | 南京小灿灿网络科技有限公司 | New media live broadcast and user online interaction method |
| CN114554229A (en) * | 2022-02-28 | 2022-05-27 | 广州点云科技有限公司 | Method, device, terminal equipment and medium for identifying voice state of user on microphone |
| CN114554229B (en) * | 2022-02-28 | 2023-08-29 | 广州点云科技有限公司 | Method, device, terminal equipment and medium for identifying voice state of microphone user |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111131847A (en) | Live broadcast interaction method | |
| KR102015150B1 (en) | Terminal apparatus, server apparatus, information processing method, program, and interlocked application feed system | |
| CN1127260C (en) | Video/audio in cooperation with video/audio broadcasting and graphic demonstrating system | |
| US10524019B2 (en) | Receiver, reception method, transmitter, transmission method, program and broadcasting system | |
| CN109327741B (en) | Game live broadcast method, device and system | |
| CN108495152B (en) | Video live broadcast method and device, electronic equipment and medium | |
| CN106060632B (en) | System and method for controlling bullet screen of program site | |
| US9131280B2 (en) | Customizing the display of information by parsing descriptive closed caption data | |
| EP3086561A1 (en) | Information pushing method, device, and system | |
| CN106331880B (en) | Information processing method and system | |
| CN111314720A (en) | Live broadcast and microphone connection control method and device, electronic equipment and computer readable medium | |
| CN105187926A (en) | Method and device for pushing interactive interface | |
| CN108521584B (en) | Interactive information processing method, device, anchor side equipment and medium | |
| US20150020099A1 (en) | Set top box interaction method and related set top box system | |
| US8661466B2 (en) | Representation of online discussion in conjunction with primary visual content | |
| US11800202B2 (en) | Systems and methods for generating supplemental content for a program content stream | |
| CN112291498B (en) | Audio and video data transmission method and device and storage medium | |
| CN105187927A (en) | Method and device for pushing interactive interface | |
| CN107231564B (en) | Video live broadcast method, live broadcast system and live broadcast server | |
| CN110139128B (en) | Information processing method, interceptor, electronic equipment and storage medium | |
| CN112492324A (en) | Data processing method and system | |
| CN112188241A (en) | Method and system for real-time subtitle generation of live stream | |
| CN109218772A (en) | Smart television information-pushing method and device | |
| CN114339284A (en) | Method, device, storage medium and program product for monitoring live broadcast delay | |
| CN114461423A (en) | Multimedia stream processing method, device, storage medium and program product |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200508 |