CN115052170B - Method and device for on-cloud broadcasting guide based on SEI time code information - Google Patents

Method and device for on-cloud broadcasting guide based on SEI time code information Download PDF

Info

Publication number
CN115052170B
CN115052170B CN202210445417.3A CN202210445417A CN115052170B CN 115052170 B CN115052170 B CN 115052170B CN 202210445417 A CN202210445417 A CN 202210445417A CN 115052170 B CN115052170 B CN 115052170B
Authority
CN
China
Prior art keywords
information
cloud
sei
broadcasting
frame
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202210445417.3A
Other languages
Chinese (zh)
Other versions
CN115052170A (en
Inventor
柴剑平
符洪涛
赵薇
孔祥森
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hangzhou Broadcast Cloud Network Technology Co ltd
Tianjin Deli Instrument Equipment Co ltd
Communication University of China
Original Assignee
Hangzhou Broadcast Cloud Network Technology Co ltd
Tianjin Deli Instrument Equipment Co ltd
Communication University of China
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hangzhou Broadcast Cloud Network Technology Co ltd, Tianjin Deli Instrument Equipment Co ltd, Communication University of China filed Critical Hangzhou Broadcast Cloud Network Technology Co ltd
Priority to CN202210445417.3A priority Critical patent/CN115052170B/en
Publication of CN115052170A publication Critical patent/CN115052170A/en
Application granted granted Critical
Publication of CN115052170B publication Critical patent/CN115052170B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21Server components or server architectures
    • H04N21/218Source of audio or video content, e.g. local disk arrays
    • H04N21/21805Source of audio or video content, e.g. local disk arrays enabling multiple viewpoints, e.g. using a plurality of cameras
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/235Processing of additional data, e.g. scrambling of additional data or processing content descriptors
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/242Synchronization processes, e.g. processing of PCR [Program Clock References]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/222Studio circuitry; Studio devices; Studio equipment
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/222Studio circuitry; Studio devices; Studio equipment
    • H04N5/262Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/222Studio circuitry; Studio devices; Studio equipment
    • H04N5/262Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/278Subtitling
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02DCLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D30/00Reducing energy consumption in communication networks
    • Y02D30/70Reducing energy consumption in communication networks in wireless communication networks

Abstract

An SEI time code information-based method and device for on-cloud broadcasting, wherein the method comprises the following steps: the cloud server receives the code stream and unpacks the code stream into TS streams, each TS stream is synthesized by an encoder together with the serial digital interface signal, the additional information forms an SEI frame which is inserted in front of the video frame, and the SEI frame contains time code information and video channel information; and reading TS stream, comparing time code information and video channel information in SEI frames with switching information provided by a cloud broadcasting guiding platform, if the information is consistent, decoding a picture group corresponding to the SEI frames into a baseband video signal, transmitting the baseband video signal to the cloud broadcasting guiding platform, and according to the time code information, enabling the cloud broadcasting guiding platform to conduct broadcasting guiding switching after aligning a pre-monitoring signal to be broadcasted and a program signal being broadcasted through the time code information, and if the information is inconsistent, not needing decoding, and discarding the picture group corresponding to the SEI frames. The invention can reduce the requirements on the interface bandwidth of the cloud server, the computing capacity and the memory of the server, and improve the operation efficiency of the server.

Description

Method and device for on-cloud broadcasting guide based on SEI time code information
Technical Field
The invention relates to the technical field of cloud broadcasting, in particular to a method and a device for broadcasting on the cloud based on SEI time code information.
Background
With the rapid development of 5G and cloud technologies, cloud broadcasting technologies are mature, and various network live broadcasting applications are endless. Aiming at the ultra-high definition video 4K and 8K technologies, the advantages of the cloud broadcasting guiding equipment in terms of clouding and software are more remarkable, the expensive hardware cost of the traditional rebroadcasting vehicle can be effectively reduced, the technology iteration updating speed is high, and broadcasting guiding staff can conveniently complete the broadcasting guiding task under the condition of not being in close contact with the scene.
In order to save transmission bandwidth and improve signal transmission speed, the rebroadcast signal is transmitted to the cloud for broadcasting, and compression coding is needed to be carried out for transmission. And (5) restoring the received cloud to be baseband signal broadcasting. Taking one path of 4k video as an example, the bandwidth of the baseband signal reaches 12G, the transmission code rate is about 40Mbps after video compression on the premise of ensuring high quality, and the baseband signal needs to be restored to 12G before the pilot broadcast switching.
The most prominent problem of cloud end director production is that the interface exchange bandwidth of a cloud end server is required to be high. Taking a general cloud 128-core CPU server as an example, the exchange bandwidth of a cloud interface of the server is about 30G, and each path of baseband signals occupies 12G bandwidth, so that the server can only input or output 2 paths of 4K baseband rebroadcast signals and cannot meet the multicast switching requirement of multiple paths of 4K baseband signals.
In summary, the on-cloud director can greatly reduce the director manufacturing cost, and meet the requirements of people on high-quality director videos, but a method for overcoming the problem of insufficient exchange bandwidth of cloud interfaces is needed.
Disclosure of Invention
In order to solve the above problems, the present invention provides a method for broadcasting on cloud based on SEI time code information, comprising:
the cloud server receives each code stream, and carries out network protocol deblocking on each code stream into TS streams, wherein each TS stream is synthesized by additional information and serial digital interface signals through an encoder, and the additional information forms an SEI frame which is inserted into the front of an encoded video frame, so that the SEI frame contains time code information and video channel information;
the cloud server reads TS stream, compares time code information and video channel information in SEI frame with switching information provided by the cloud broadcasting guiding platform, if the information is consistent, decodes the picture group corresponding to the SEI frame into serial digital interface signal and transmits the serial digital interface signal to the cloud broadcasting guiding platform, so that the cloud broadcasting guiding platform carries out broadcasting guiding switching after aligning the pre-monitoring signal to be broadcasted and the program signal being broadcasted through the time code information, the switching information is the time code information and the video channel information obtained from the pre-monitoring signal by the cloud broadcasting guiding platform, if the information is inconsistent, does not decode, discards the picture group corresponding to the SEI frame,
the cloud guide platform refers to a local cloud guide platform or other cloud guide platforms synchronous with the local cloud guide platform.
Optionally, the network protocol includes, but is not limited to, any of SRT, RTMP, RTSP, UDP, webRTC.
Optionally, the video frame refers to at least one frame of an I frame, a P frame, and a B frame.
Optionally, the time code information written in the SEI frame is time information of video capturing, from a clock generator.
Optionally, the clock of the clock generator is derived from a clock including, but not limited to, NTP, GPS, 5G clock timing.
Optionally, the information consistency refers to that the time code information is consistent, and the video channel information is consistent.
The invention also provides an electronic device, which comprises a memory and a processor, wherein the memory stores an on-cloud broadcasting program based on SEI time code information, and when the on-cloud broadcasting program based on SEI time code information runs in the processor, the on-cloud broadcasting method based on SEI time code information is executed.
The invention also provides a cloud-top broadcasting method based on SEI time code information, which comprises the following steps:
inputting a serial digital interface signal output by a camera and additional information into an encoder together, inserting an additional information forming SEI frame into the front of an encoded video frame, and outputting a TS stream after compression encoding, so that the SEI frame in the TS stream contains the additional information, wherein the additional information comprises time code information and video channel information;
transmitting the TS stream to a cloud server through a network transmission protocol, so that the cloud server compares time code information and video channel information in SEI frames with switching information provided by a cloud broadcasting guiding platform, if the information is consistent, decoding a picture group corresponding to the SEI frames into serial digital interface video signals to be transmitted to the cloud broadcasting guiding platform, enabling the cloud broadcasting guiding platform to conduct broadcasting switching after frame alignment of pre-monitoring signals to be broadcasted and broadcasting program signals through the time code information, wherein the switching information is the time code information and the video channel information acquired by the cloud broadcasting guiding platform from the pre-monitoring information,
if the information is inconsistent, the picture group corresponding to the SEI frame is not decoded, the picture group corresponding to the SEI frame is discarded,
the cloud guide platform refers to a local cloud guide platform or other cloud guide platforms synchronous with the local cloud guide platform.
The invention also provides a cloud-on-a-spot broadcasting device based on SEI time code information, which comprises:
the signal synthesis module is used for receiving each code stream, and carrying out network protocol deblocking on each code stream into TS streams, wherein each TS stream is synthesized by additional information and a serial digital interface signal through an encoder, the additional information forms an SEI frame which is inserted into the front of an encoded video frame, and the SEI frame contains time code information and video channel information;
the broadcasting guiding and switching module is used for reading TS stream, comparing time code information and video channel information in SEI frame with switching information provided by the broadcasting guiding and broadcasting station, if the information is consistent, decoding the picture group corresponding to the SEI frame into serial digital interface signal and transmitting the serial digital interface signal to the broadcasting guiding and broadcasting station, so that the broadcasting guiding and broadcasting station performs broadcasting guiding and switching after aligning the broadcasting pre-monitored signal and broadcasting program signal through time code information, the switching information is the time code information and video channel information obtained by the broadcasting guiding and broadcasting station from the pre-monitored signal,
if the information is inconsistent, the picture group corresponding to the SEI frame is not decoded, wherein the cloud broadcasting guide table refers to a local cloud broadcasting guide table or other cloud broadcasting guide tables synchronous with the local cloud broadcasting guide table.
The invention has the following beneficial effects:
(1) And (3) adding time code information and video channel information to the content part of the SEI signal, reading the time code information and the video channel information transmitted by the cloud broadcasting guide table before decoding, comparing with the additional information of the SEI of the current channel to determine whether to select the frame picture for switching, decoding the selected frame, and directly discarding the frame which is not selected without decoding. The method can greatly reduce the requirements on the interface bandwidth of the cloud server, the computing capacity and the memory of the server, improve the operation efficiency of the server, and only need to decode one path of compressed video corresponding to the time code and video channel information and the multicast switching information at the same time no matter how many paths of video are input.
(2) The bandwidth of one path of decoded SDI baseband signal is 12G, so that the transmission between cloud servers can be realized completely, the servers can perform operations such as subtitle adding and the like on the content, and even if 2 paths of videos are required for functions such as picture-in-picture and the like, the operations can be completed within the range of the existing 30G interconnection bandwidth.
(3) When the multi-channel video signal source is in pilot broadcast switching, the video frames of the PVW (pre-monitoring) signal need to be time-synchronized (i.e. aligned) with the PGM signal to be switched, and the time code information and the video channel information in the SEI signal can be used as the basis of time synchronization.
Drawings
The above-mentioned features and technical advantages of the present invention will become more apparent and readily appreciated from the following description of the embodiments thereof, taken in conjunction with the accompanying drawings.
Fig. 1 is a flowchart showing an on-cloud broadcasting method based on SEI time code information according to an embodiment of the present invention;
fig. 2 is a second flowchart showing an on-cloud broadcasting method based on SEI time code information according to an embodiment of the present invention.
Detailed Description
Embodiments of the present invention will be described below with reference to the accompanying drawings. Those skilled in the art will recognize that the described embodiments may be modified in various different ways, or combinations thereof, without departing from the spirit and scope of the invention. Accordingly, the drawings and description are to be regarded as illustrative in nature and not as restrictive in scope. Furthermore, in the present specification, the drawings are not drawn to scale, and like reference numerals denote like parts.
As shown in fig. 1 and 2, the method for broadcasting on-cloud based on SEI time code information according to the present embodiment includes the following steps:
in step S1, the cloud server receives the code stream, and performs network protocol decapsulation into TS streams, where each TS stream refers to a serial digital interface signal (SDI signal) output by the video camera, and when video encoding is performed on the SDI video signal, a Supplemental Enhancement Information (SEI) frame is inserted before each frame (or only an I frame) of the video signal, and the SEI frame contains additional information, where the additional information includes time code information and video channel information, and the SEI frame and the SDI video signal synthesize the TS stream. The TS stream may be encapsulated into an IP stream by a network protocol for network transmission, and the network protocol may be a protocol such as SRT, RTMP, RTSP, UDP, webRTC.
Writing of the key information in SEI frames is accomplished by a code such as ffmpeg (a set of open source computer programs that can be used to record, convert digital audio, video, and convert it into streams) and the like, which provides the writing methods and functions. Each camera is a video input channel, and can generate one SDI video signal. As in fig. 1, a plurality of cameras (camera 1, camera 2, …, camera n) take pictures from different angles, which may be different from the angle or/and distance of the shooting scene, for example, some cameras for panoramic lens shooting, some for near view shooting, some for far view shooting, some for left side shooting, some for right side shooting, some for person shooting. Each camera generates a path of SDI video signal for the cloud broadcasting guide platform to select.
The video coding can adopt coding modes of supporting SEI frames such as H.264, H.265, H.266, AVS, AVS+, AVS2, AVS3 and the like, the coded video coding comprises I frames, B frames and P frames, the coded forms such as SEI frames, I frames, SEI frames, P frames, SEI frames and B frames … …, and the time code information written in the SEI frames can be the time information of video shooting and can come from a clock generator, such as an NTP network clock, other special clock generators or 5G time service and the like.
Since SEI is a native support for video coding protocols (e.g., H.264, H.265, H.266, AVS, AVS+, AVS2, AVS3 video compression standards), for adding some extension information, the added custom information does not have compatibility issues. And the SEI does not depend on a specific network transmission protocol and a closed format, and has better universality, so that the SEI is very suitable for carrying auxiliary information such as time codes, channels and the like.
And S2, the cloud server reads the TS stream, and compares time code information and video channel information in an SEI frame with switching information provided by the cloud broadcasting guide platform, wherein the switching information is from a pre-monitoring signal and comprises the time code information and the video channel information.
The decoder receives switching information provided by a local cloud broadcasting guide table or other cloud broadcasting guide tables synchronous with the local, if the time code information is consistent and the video channel information is consistent, the image frames of a group of pictures (GOP) corresponding to the SEI frames are decoded into SDI video signals and transmitted to the corresponding cloud broadcasting guide table, and if the time code information is inconsistent or the video channel information is inconsistent, the GOP image frames are not required to be decoded and are directly discarded. The group of pictures refers to a picture combination of an I frame, a P frame, and a B frame, which are the first of the I frame.
The cloud broadcasting guide station performs frame alignment on a pre-monitoring signal (PVW) to be broadcasted and a program signal (PGM) being broadcasted through time code information in SEI additional information, and then performs switching, so that broadcasting guide switching of videos is completed, and program broadcasting is performed. For example, video signals of a plurality of cameras are combined into one video signal, and for example, video signals of close range, distant range and different angles at different times are combined into a continuous one video signal. In one embodiment, the production may also include insertion slow motion, caption, special effects, on-line packaging, etc. production.
The invention also provides a cloud-on-a-spot broadcasting device based on SEI time code information, which comprises:
the signal synthesis module is used for receiving each code stream, and carrying out network protocol deblocking on each code stream into TS streams, each TS stream is synthesized by an SEI frame inserted before each frame of a serial digital interface signal output by a camera and the SEI frame contains additional information, and the additional information comprises time code information and video channel information;
and the broadcasting guiding and switching module is used for reading the TS stream, comparing time code information and video channel information in the SEI frame with switching information provided by the cloud broadcasting guiding platform, decoding a picture group corresponding to the SEI frame into a serial digital interface signal and transmitting the serial digital interface signal to the cloud broadcasting guiding platform if the information is consistent, enabling the cloud broadcasting guiding platform to conduct broadcasting and switching after aligning a pre-monitored signal to be broadcasted and a program signal being broadcasted through the time code information, wherein the switching information is the time code information and the video channel information acquired by the cloud broadcasting guiding platform from the pre-monitored information, and if the information is inconsistent, decoding is not needed, and discarding the picture group corresponding to the SEI frame.
The invention also provides an electronic device which is equipment capable of automatically carrying out numerical calculation and/or information processing according to a preset or stored instruction. For example, it may be a smart phone, tablet, notebook, desktop, server, etc. The electronic device includes at least, but is not limited to, a memory, a processor, and the like communicatively coupled to each other. Wherein: the memory includes at least one type of computer-readable storage medium including flash memory, hard disk, multimedia card, card memory (e.g., SD or DX memory, etc.), random Access Memory (RAM), static Random Access Memory (SRAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), programmable read-only memory (PROM), magnetic memory, magnetic disk, optical disk, etc. In some embodiments, the memory may be an internal storage unit of the electronic device, such as a hard disk or a memory of the electronic device. In other embodiments, the memory may also be an external storage device of the electronic apparatus, for example, a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash Card (Flash Card) or the like. Of course, the memory may also comprise both an internal memory unit and an external memory device of the electronic apparatus. In this embodiment, the memory is generally used to store an operating system and various application software installed on the electronic device, for example, the cloud-oriented program code based on the SEI time code information. In addition, the memory may be used to temporarily store various types of data that have been output or are to be output.
The processor may be a central processing unit (Central Processing Unit, CPU), controller, microcontroller, microprocessor, or other data processing chip in some embodiments. The processor is typically used to control the overall operation of the electronic device, such as performing control and processing related to data interaction or communication with the electronic device. In this embodiment, the processor is configured to execute a program code stored in the memory or process data, for example, execute the cloud director based on the SEI time code information.
An operating system, an on-cloud bootstrap program based on SEI time code information, etc. may be included in the memory containing the readable storage medium. The steps S1 to S2 described above are implemented when the processor executes the on-cloud bootstrap program based on the SEI time code information in the memory, and are not described herein. In this embodiment, the on-cloud bootstrapping program based on the SEI time code information stored in the memory may be divided into one or more program modules, which are stored in the memory and executable by one or more processors to complete the present application. For example, the on-cloud multicast program based on the SEI time code information may be divided into a signal synthesis module and a multicast switching module. The program modules referred to in this application refer to a series of computer program instruction segments capable of performing specific functions, and the specific implementation manner of each module of the electronic device is substantially the same as the specific implementation manner of the steps of the above-mentioned cloud-top multicast method based on SEI time code information, and will not be described herein in detail.
The invention also provides a cloud-top broadcasting method based on SEI time code information, which comprises the following steps:
step S10, inserting SEI frame codes before each frame of a serial digital interface signal output by a video camera to compress the SEI frame codes to form TS stream, wherein the SEI frame contains additional information, and the additional information comprises time code information and video channel information;
step S20, the TS stream is sent to a cloud server, so that the cloud server compares time code information and video channel information in SEI frames with switching information provided by a cloud broadcasting guiding platform, if the information is consistent, a picture group corresponding to the SEI frames is decoded into serial digital interface signals and transmitted to the cloud broadcasting guiding platform, the cloud broadcasting guiding platform performs frame alignment on pre-monitoring signals to be broadcasted and broadcasting program signals through the time code information, then broadcasting guiding switching is performed, the switching information is the time code information and the video channel information acquired by the cloud broadcasting guiding platform from the pre-monitoring information, if the information is inconsistent, decoding is not needed, and a picture group corresponding to the SEI frames is discarded.
The above description is only of the preferred embodiments of the present invention and is not intended to limit the present invention, but various modifications and variations can be made to the present invention by those skilled in the art. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims (8)

1. An on-cloud broadcasting method based on SEI time code information is characterized by comprising the following steps:
the cloud server receives each code stream, and network protocol unpacks each code stream into TS streams, each TS stream is synthesized by additional information and serial digital interface signals through an encoder, the encoded video frame comprises an I frame, a P frame and a B frame, the additional information forms SEI frames to be inserted in front of at least each I frame,
enabling the SEI frame to contain time code information and video channel information;
the cloud server reads TS stream, compares time code information and video channel information in SEI frame with switching information provided by the cloud broadcasting guiding platform, if the information is consistent, decodes the picture group corresponding to the SEI frame into serial digital interface signal and transmits the serial digital interface signal to the cloud broadcasting guiding platform, so that the cloud broadcasting guiding platform carries out broadcasting guiding switching after aligning the pre-monitoring signal to be broadcasted and the program signal being broadcasted through the time code information, the switching information is the time code information and the video channel information obtained from the pre-monitoring signal by the cloud broadcasting guiding platform, if the information is inconsistent, does not decode, discards the picture group corresponding to the SEI frame,
the cloud guide platform refers to a local cloud guide platform or other cloud guide platforms synchronous with the local cloud guide platform.
2. The SEI time code information based on cloud multicasting method according to claim 1, wherein the network protocol includes, but is not limited to, any of SRT, RTMP, RTSP, UDP, webRTC.
3. The method of on-cloud broadcasting based on SEI time code information according to claim 1, wherein the time code information written in the SEI frame is time information of video capturing, from a clock generator.
4. A method of on-cloud multicasting based on SEI time code information according to claim 3, wherein the clock of the clock generator is derived from clock sources including but not limited to NTP, GPS, 5G clock timing.
5. The method for on-cloud multicasting based on SEI time code information according to claim 1, wherein the information coincidence refers to coincidence of time code information and coincidence of video channel information.
6. An electronic device, comprising a memory and a processor, wherein an on-cloud bootstrap program based on SEI time code information is stored in the memory, and the on-cloud bootstrap program based on SEI time code information performs the on-cloud bootstrap method based on SEI time code information according to any one of claims 1 to 5 when running in the processor.
7. An on-cloud broadcasting method based on SEI time code information is characterized by comprising the following steps:
inputting serial digital interface signals output by a video camera and additional information into an encoder together, wherein an encoded video frame comprises an I frame, a P frame and a B frame, the additional information forming SEI frame is inserted in front of at least each I frame, and a TS stream is output after compression encoding, so that the SEI frame in the TS stream contains the additional information, and the additional information comprises time code information and video channel information;
transmitting the TS stream to a cloud server through a network transmission protocol, so that the cloud server compares time code information and video channel information in SEI frames with switching information provided by a cloud broadcasting guiding platform, if the information is consistent, decoding a picture group corresponding to the SEI frames into serial digital interface video signals to be transmitted to the cloud broadcasting guiding platform, enabling the cloud broadcasting guiding platform to conduct broadcasting switching after frame alignment of pre-monitoring signals to be broadcasted and broadcasting program signals through the time code information, wherein the switching information is the time code information and the video channel information acquired by the cloud broadcasting guiding platform from the pre-monitoring information,
if the information is inconsistent, the picture group corresponding to the SEI frame is not decoded, the picture group corresponding to the SEI frame is discarded,
the cloud guide platform refers to a local cloud guide platform or other cloud guide platforms synchronous with the local cloud guide platform.
8. An on-cloud broadcasting guiding device based on SEI time code information is characterized by comprising:
the signal synthesis module is used for receiving each code stream and carrying out network protocol deblocking on each code stream into TS streams, each TS stream is synthesized by an encoder through additional information and a serial digital interface signal, an encoded video frame comprises an I frame, a P frame and a B frame, the additional information forms an SEI frame to be inserted in front of at least each I frame, and the SEI frame comprises time code information and video channel information;
the broadcasting guiding and switching module is used for reading TS stream, comparing time code information and video channel information in SEI frame with switching information provided by the broadcasting guiding and broadcasting station, if the information is consistent, decoding the picture group corresponding to the SEI frame into serial digital interface signal and transmitting the serial digital interface signal to the broadcasting guiding and broadcasting station, so that the broadcasting guiding and broadcasting station performs broadcasting guiding and switching after aligning the broadcasting pre-monitored signal and broadcasting program signal through time code information, the switching information is the time code information and video channel information obtained by the broadcasting guiding and broadcasting station from the pre-monitored signal,
if the information is inconsistent, the picture group corresponding to the SEI frame is not decoded, wherein the cloud broadcasting guide table refers to a local cloud broadcasting guide table or other cloud broadcasting guide tables synchronous with the local cloud broadcasting guide table.
CN202210445417.3A 2022-04-26 2022-04-26 Method and device for on-cloud broadcasting guide based on SEI time code information Active CN115052170B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210445417.3A CN115052170B (en) 2022-04-26 2022-04-26 Method and device for on-cloud broadcasting guide based on SEI time code information

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210445417.3A CN115052170B (en) 2022-04-26 2022-04-26 Method and device for on-cloud broadcasting guide based on SEI time code information

Publications (2)

Publication Number Publication Date
CN115052170A CN115052170A (en) 2022-09-13
CN115052170B true CN115052170B (en) 2023-06-23

Family

ID=83158138

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210445417.3A Active CN115052170B (en) 2022-04-26 2022-04-26 Method and device for on-cloud broadcasting guide based on SEI time code information

Country Status (1)

Country Link
CN (1) CN115052170B (en)

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112770122A (en) * 2020-12-31 2021-05-07 上海网达软件股份有限公司 Method and system for synchronizing videos on cloud director

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140079116A1 (en) * 2012-09-20 2014-03-20 Qualcomm Incorporated Indication of interlaced video data for video coding
CN112004102A (en) * 2020-08-03 2020-11-27 杭州当虹科技股份有限公司 Multi-camera picture synchronization method based on IP live stream
US11706450B2 (en) * 2020-09-18 2023-07-18 Samsung Electronics Co., Ltd. Partial decoding and reconstruction of a video-based point cloud compression bitstream
CN113163222A (en) * 2021-03-31 2021-07-23 杭州奥点科技股份有限公司 Video frame synchronization method, system, equipment and readable storage medium

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112770122A (en) * 2020-12-31 2021-05-07 上海网达软件股份有限公司 Method and system for synchronizing videos on cloud director

Also Published As

Publication number Publication date
CN115052170A (en) 2022-09-13

Similar Documents

Publication Publication Date Title
TWI423679B (en) Scalable video coding and decoding
US11412176B2 (en) Transmission device, transmission method, reception device, and reception method
US20220046291A1 (en) Method and device for generating live streaming video data and method and device for playing live streaming video
JP2009105902A (en) Method and apparatus for splicing compressed information signal
US11375232B2 (en) Sub picture signaling in video coding
CN110708597B (en) Live broadcast delay monitoring method and device, electronic equipment and readable storage medium
US10778995B2 (en) Transmission device, transmission method, reception device, and reception method
US11895352B2 (en) System and method for operating a transmission network
US20200228837A1 (en) Media information processing method and apparatus
CN114902673A (en) Indication of video slice height in video sub-pictures
CN110035331A (en) A kind of processing method and processing device of media information
CN109348309A (en) A kind of distributed video transcoding method suitable for frame rate up-conversion
CN103081488A (en) Signaling video samples for trick mode video representations
CN112087642B (en) Cloud guide playing method, cloud guide server and remote management terminal
CN114930829A (en) Sub-picture signaling in video coding
CN111182322A (en) Director control method and device, electronic equipment and storage medium
EP3734974A1 (en) Method and apparatus for processing video bitstream, network device, and readable storage medium
US9936266B2 (en) Video encoding method and apparatus
CN115052170B (en) Method and device for on-cloud broadcasting guide based on SEI time code information
CN112565799B (en) Video data processing method and device
EP4021001A1 (en) Code stream processing method and device, first terminal, second terminal and storage medium
CN100591140C (en) Method for displaying subtitling in video
CN115484476A (en) VR live video transmission method and device and storage medium
US20240137597A1 (en) System and method for operating a transmission network
WO2023078048A1 (en) Video bitstream encapsulation method and apparatus, video bitstream decoding method and apparatus, and video bitstream access method and apparatus

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant