CN112601097B - Double-coding cloud broadcasting method and system - Google Patents
Double-coding cloud broadcasting method and system Download PDFInfo
- Publication number
- CN112601097B CN112601097B CN202110227536.7A CN202110227536A CN112601097B CN 112601097 B CN112601097 B CN 112601097B CN 202110227536 A CN202110227536 A CN 202110227536A CN 112601097 B CN112601097 B CN 112601097B
- Authority
- CN
- China
- Prior art keywords
- type
- coded signals
- signals
- module
- shooting scene
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/21—Server components or server architectures
- H04N21/218—Source of audio or video content, e.g. local disk arrays
- H04N21/21805—Source of audio or video content, e.g. local disk arrays enabling multiple viewpoints, e.g. using a plurality of cameras
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/42—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation
- H04N19/436—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation using parallelised computational arrangements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/21—Server components or server architectures
- H04N21/218—Source of audio or video content, e.g. local disk arrays
- H04N21/2187—Live feed
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/67—Focus control based on electronic image sensor signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/695—Control of camera direction for changing a field of view, e.g. pan, tilt or based on tracking of objects
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/95—Computational photography systems, e.g. light-field imaging systems
- H04N23/951—Computational photography systems, e.g. light-field imaging systems by using two or more images to influence resolution, frame rate or aspect ratio
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/04—Synchronising
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/268—Signal distribution or switching
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computing Systems (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The present description provides a dual-coding cloud director method and system, including: acquiring video signals shot by a plurality of cameras in each shooting scene: respectively encoding the video signals shot by each camera in each shooting scene into a plurality of paths of encoded signals with different time delays and resolutions; screening out a first type of coded signals of each shooting scene with the time delay smaller than a time delay threshold value; screening out the second type of coded signals of each shooting scene with the resolution higher than the resolution threshold value: carrying out clock time service on the first type of coded signals and the second type of coded signals; the method comprises the steps that a broadcast guide makes a first type of coded signal of each shooting scene to obtain making information; according to the production information, conducting broadcast production on the second type of coded signals of each shooting scene; and releasing the second type of coded signals of each shooting scene after the director makes. The method and the system not only ensure the continuity of the lens switching of the camera, but also can guide the broadcasting with high quality.
Description
Technical Field
The present disclosure relates to the field of cloud director technologies, and in particular, to a dual-coding cloud director method and system.
Background
The rebroadcasting vehicle is manufactured by field broadcasting, and is used for directly inputting a plurality of paths of video baseband signals and switching or mixing the signals into a path of video stream to be output according to the requirements. The existing director scene is made by the video signal on site based on the baseband signal with no delay or very low delay (< 10 ms). And the director instructs the camera personnel to shoot (tune) according to the seen non-delay or extremely-low-delay (< 10 ms) video signals, and performs director switching to complete the production of rebroadcast signals. Therefore, the director must see the picture as a non-delayed or very low-delayed (< 10 ms) picture taken by the camera to direct the broadcast.
Along with the development of cloud technology, the cloud director technology is mature day by day, and the camera outputs baseband signals such as HDMI/SDI, and the 4K signal code rate is about 12G, and the high definition signal code rate is about 3G, and the signal code rate is too big, unable direct transmission, must pass through the code compression just can transmit the cloud, that is to say, rebroadcast signal transmission carries out the director preparation to the cloud, just must compress the code and can transmit. Only the baseband signal can be generated in the cloud, and therefore the transmitted signal must be decoded first to obtain the baseband signal. Encoding and decoding are indispensable steps in the cloud transmission process, but the encoding and decoding can generate time delay, the higher the quality of the video, the more complex the algorithm is, and the more serious the time delay generated by encoding and decoding is at the expense of calculation time. And the received signal is restored to be a baseband signal for broadcasting and manufacturing. Due to the codec and transmission process, the retransmitted signal will have a delay. At present, after 4K codes are transmitted to a cloud terminal for decoding, the basic delay is about 800 ms. If the signal delay is greater than 200ms, the picture to be shot by the director tuner may be lost, and the influence is larger if the delay is larger, so that the director cannot complete the production of the director signal according to the own idea.
The delay time is related to video quality coding, and the higher the quality of video, the more serious the delay generated by coding and decoding is at the cost of computation time. At present, 4K coding and decoding (including HDR, BT2020 color gamut coding, 40 Mbps) has the coding and decoding delay time of about 600-700 ms, and the video signal coded and transmitted to a cloud broadcasting guide station for decoding and manufacturing is delayed for 1-3 seconds.
In summary, to ensure the normal use of the cloud director, a method must be found that not only meets the requirement of low latency (< 200 ms) of the director tuner, but also ensures the quality of signal output (4K, >40 Mbps).
Disclosure of Invention
In view of the foregoing, it is an object of the present disclosure to provide a dual-coding cloud broadcasting method and system for high-quality broadcasting while ensuring consistency in camera shot switching.
According to an aspect of the present description, there is provided a dual encoding cloud director method including:
acquiring video signals shot by a plurality of cameras in each shooting scene:
respectively encoding the video signals shot by each camera of each shooting scene into a plurality of paths of encoded signals with different time delays and resolutions;
screening out one or more paths of coded signals of each shooting scene with the time delay smaller than a time delay threshold value as a first type of coded signals of each shooting scene;
screening out one or more paths of coding signals of each shooting scene with the resolution higher than a resolution threshold value as a second type of coding signal of each shooting scene:
carrying out clock time service on the first type of coded signals and the second type of coded signals to obtain frame synchronization information of the first type of coded signals and the second type of coded signals;
one or more paths of coded signals in the first type of coded signals of each shooting scene are subjected to broadcast guiding production to obtain production information of the first type of coded signals;
one or more paths of coded signals in the second type of coded signals of each shooting scene are subjected to broadcast guiding and manufacturing according to manufacturing information of the first type of coded signals of each shooting scene;
and releasing the second type of coded signals of each shooting scene after the director makes.
Optionally, the step of encoding the video signal captured by each camera of each scene into a plurality of encoded signals with different delays and resolutions respectively comprises:
respectively encoding the video signals shot by each camera into two paths of encoded signals with different time delays and resolutions;
wherein, one path of coding signal with lower time delay is used as a first type of coding signal; and taking the path of coded signal with higher resolution as a second path of coded signal.
Optionally, the first type of encoded signal and the second type of encoded signal are produced by a cloud director.
Optionally, the delay threshold is 200 ms.
Optionally, the step of performing director making on one or more encoded signals in the first type of encoded signal of each shooting scene includes:
and acquiring each frame of image of the corresponding camera, and performing inter-frame image switching connection on the video signals of the multiple cameras to form a video stream.
Optionally, the method further comprises: the first type of coded signals are produced through a local director, and the second type of coded signals are produced through a cloud director.
According to another aspect of the present invention, a dual-coding cloud broadcasting guide system is provided, including a plurality of cameras, an encoder, a first streaming module, a second streaming module, a synchronization module, a first cloud broadcasting guide station and a second cloud broadcasting guide station, where the first cloud broadcasting guide station includes a first production module and a first signal transceiver module, the second cloud broadcasting guide station includes a second production module, a second signal transceiver module and a second distribution module, the plurality of cameras are divided into a plurality of groups, and collect video signals of a plurality of shooting scenes; the encoder encodes the video signals shot by each camera of each shooting scene into a plurality of paths of encoded signals with different time delays and resolutions respectively; the first plug flow module screens out one or more paths of coded signals of each shooting scene with the time delay smaller than a time delay threshold value, the coded signals serve as first type coded signals of each shooting scene, and the coded signals are sent to the first signal transceiving module; the second plug-flow module screens out one or more paths of coded signals of each shooting scene with the resolution ratio higher than the resolution ratio threshold value, the coded signals serve as second type coded signals of each shooting scene, and the coded signals are sent to the second signal transceiving module: the synchronization module is used for carrying out clock time service on the first type of coded signals and the second type of coded signals and generating frame synchronization information of the first type of coded signals and the second type of coded signals; the first manufacturing module is used for performing broadcast guiding manufacturing on one or more paths of coded signals in the first type of coded signals of each shooting scene received by the first signal transceiver module to generate manufacturing information of the first type of coded signals; the first signal transceiver module sends the making information of the first type of coded signals to the second signal transceiver module; the second manufacturing module is used for conducting broadcast guiding manufacturing on one or more paths of coded signals in the second type of coded signals according to the manufacturing information of the first type of coded signals received by the second signal receiving and transmitting module; and the second distribution module is used for issuing the second type of coded signals after the director is manufactured.
Optionally, the encoder includes a first encoder and a second encoder, where the first encoder and the second encoder receive video signals of the same camera and encode the video signals respectively, the first encoder outputs one path of first-type encoded signals, and the second encoder outputs one path of second-type encoded signals.
Optionally, the synchronization module comprises one or more of a GPS, 5G and NTP server.
According to a third aspect of the present invention, a dual-coding cloud broadcasting guide system is provided, including a plurality of cameras, an encoder, a first streaming module, a second streaming module, a synchronization module, a local broadcasting guide station and a second cloud broadcasting guide station, where the local broadcasting guide station includes a first production module and a first signal transceiver module, the second cloud broadcasting guide station includes a second signal transceiver module, a second production module and a second distribution module, the plurality of cameras are divided into a plurality of groups, and collect video signals of a plurality of shooting scenes; the encoder encodes the video signals shot by each camera of each shooting scene into a plurality of paths of encoded signals with different time delays and resolutions respectively; the first plug flow module screens out one or more paths of coded signals of each shooting scene with the time delay smaller than a time delay threshold value, the coded signals serve as first type coded signals of each shooting scene, and the coded signals are sent to the first signal transceiving module; the second plug-flow module screens out one or more paths of coded signals of each shooting scene with the resolution ratio higher than the resolution ratio threshold value, the coded signals serve as second type coded signals of each shooting scene, and the coded signals are sent to the second signal transceiving module: the synchronization module is used for carrying out clock time service on the first type of coded signals and the second type of coded signals and generating frame synchronization information of the first type of coded signals and the second type of coded signals; the first manufacturing module is used for performing broadcast guiding manufacturing on one or more paths of coded signals in the first type of coded signals of each shooting scene received by the first signal transceiver module to generate manufacturing information of the first type of coded signals; the first signal transceiver module sends the making information of the first type of coded signals to the second signal transceiver module; the second manufacturing module is used for conducting broadcast guiding manufacturing on one or more paths of coded signals in the second type of coded signals according to the manufacturing information of the first type of coded signals received by the second signal receiving and transmitting module; and the second distribution module is used for issuing the second type of coded signals after the director is manufactured.
Optionally, the encoder includes a first encoder and a second encoder, where the first encoder and the second encoder receive video signals of the same camera and encode the video signals respectively, the first encoder outputs one path of first-type encoded signals, and the second encoder outputs one path of second-type encoded signals.
Optionally, the synchronization module comprises one or more of a GPS, 5G and NTP server.
According to the double-coding cloud broadcasting guide method and system, the video signals are coded in different delays and different resolutions, the first type of low-delay coded signals are output for broadcasting guide production, the continuity of switching of different paths of camera lenses can be guaranteed, the second type of high-quality coded signals are produced according to the production information of the first type of coded signals, and the broadcasting guide of the high-quality signals can be carried out.
Drawings
Other objects and results of the present description will become more apparent and readily appreciated by reference to the following description taken in conjunction with the accompanying drawings, and as the description becomes more fully understood. In the drawings:
fig. 1 is a schematic flow chart illustrating the dual-encoding cloud director method;
FIG. 2 is a schematic diagram illustrating a block diagram of one embodiment of a dual-coding cloud director system;
fig. 3 is a schematic diagram illustrating a block diagram of another embodiment of the dual-coding cloud director system according to the present disclosure.
The same reference numbers in all figures indicate similar or corresponding features or functions.
Detailed Description
The technical solutions in the embodiments of the present disclosure will be clearly and completely described below with reference to the drawings in the embodiments of the present disclosure, and it is obvious that the described embodiments are only a part of the embodiments of the present disclosure, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present description.
Fig. 1 is a schematic flowchart illustrating the dual-coding cloud director method, and as shown in fig. 1, the dual-coding cloud director method includes:
step S1, collecting video signals shot by a plurality of cameras of each shooting scene:
step S2, coding the video signal shot by each camera of each shooting scene into a plurality of paths of coding signals with different time delay and resolution;
step S3, screening out one or more paths of coded signals of each shooting scene with the time delay smaller than a time delay threshold value as first-class coded signals of each shooting scene;
step S4, screening out one or more encoded signals of each shooting scene with resolution higher than the resolution threshold as the second type of encoded signal of each shooting scene:
step S5, carrying out clock time service on the first type of coded signals and the second type of coded signals, and obtaining frame synchronization information of the first type of coded signals and the second type of coded signals;
step S6, performing director production on one or more paths of coded signals in the first type of coded signals of each shooting scene to obtain production information of the first type of coded signals;
step S7, according to the making information of the first type of coded signal of each shooting scene, conducting the broadcast making to one or more paths of coded signals in the second type of coded signals of each shooting scene;
in step S8, the second type coded signal of each shooting scene after the director is created is distributed.
In one embodiment, step S2 includes:
respectively encoding the video signals shot by each camera into two paths of encoded signals with different time delays and resolutions;
wherein, one path of coding signal with lower time delay is used as a first type of coding signal; and taking the path of coded signal with higher resolution as a second path of coded signal.
In one embodiment, in the steps S6-S8, the method further includes:
the first type of coded signal and the second type of coded signal are manufactured through a cloud broadcasting guide platform.
Optionally, the first type of encoded signal is produced by one cloud director and the second type of encoded signal is produced by another cloud director.
Optionally, the first type of encoded signal is produced by a local broadcaster, and the second type of encoded signal is produced by a cloud broadcaster.
In one embodiment, the dual-encoding cloud director method further comprises:
the two types of coded signals are transmitted to a cloud broadcasting guide platform in real time, and the first type of coded signals with low quality and low delay are transmitted to a first cloud broadcasting guide platform; transmitting the high-quality and high-delay second-type coded signals to a second cloud broadcasting guide platform;
wherein, one or more of the following steps can be further included:
the first type of encoded signals can be decoded and then encoded and transmitted to the PC-side broadcasting guide operation by the first cloud broadcasting guide.
The first type of coded signals can be subjected to director switching production through a first cloud director, for example, video signals of a plurality of cameras are combined into one video signal, and for example, video signals of a close shot, a far shot and different angles at different times are combined into a continuous video signal.
The first type of coded signal may also be produced by inserting slow motion, caption, special effect, on-line package, etc.
The second type of coded signals are completely the same as the first type of coded signals, and due to the low time delay of the first type of coded signals, the first cloud director can switch the lens in time, so that the continuity between lens switching is ensured. Due to the time synchronism of the second type of coded signals and the first type of coded signals, the second type of coded signals are high in quality and can be produced according to the production information of the first type of coded signals, so that the continuity of the lens can be guaranteed, and the broadcast guiding output of the high-quality signals can be realized.
Previews may be performed by displaying multiple pictures of the first type of encoded signal captured by multiple cameras on the local or first cloud podcast.
And sending an adjusting instruction to the camera through the first type of coded signals to adjust the angle or/and the focal length, wherein the lens of the scheduling camera can be the lens switching between different cameras, and also can be the distance or/and the angle adjustment between the camera and a shooting scene.
In one embodiment, between step S6, the method further includes:
the image quality of the second type coded signals before manufacture is monitored, and the situation that the image quality is poor due to the fact that the second type coded signals are not received and the second type coded signals are transmitted is prevented.
In one embodiment, the steps S6 and S7 further include:
and acquiring each frame of image of the corresponding camera, and performing inter-frame image switching connection on the video signals of the multiple cameras to form a video stream.
In one embodiment, the video camera shoots an output video signal source SDI/HDMI in real time, and the second encoder generates a high-quality signal (second type encoded signal) through the two-way encoder, for example, a high-quality code stream such as 4K (> 40 Mbps) or 8K (> 160 Mbps) is generated. The first encoder produces a very low delay (< 200 ms) code stream (first type of encoded signal) at the cost of low picture resolution (< 1080P rate, <8 Mbps). The double-path encoder simultaneously takes a synchronous signal (time service time of a GPS/5G/NTP server and the like) from the synchronizer as frame synchronization information, adds a time code on a Transport Stream (TS) and outputs two paths of encoded signals of the same information source (the same camera) carrying the frame synchronization information in a double-path mode in real time, namely one is a high-quality high-delay second-type encoded signal and the other is a low-quality low-delay first-type encoded signal.
In the foregoing embodiments, the delay threshold is determined according to a shooting scene of a video to be guided, for example, the shooting scene has more motion changes, and the delay threshold is small, such as a football game, or the shooting scene has less motion changes, and the delay threshold is large, such as a go game. Preferably, the delay threshold is 200 ms.
In the above embodiments, the resolution threshold is determined according to the resolution requirement of the video receiving terminal (studio, multimedia center, tv, mobile phone, etc.), the resolution thresholds of high definition, 4k and 8k are different, and the higher the resolution requirement of the video receiving terminal is, the larger the resolution threshold is.
The double-coding cloud broadcasting guide method adopts a cloud making mode, can make video signals of a plurality of shooting scenes simultaneously and release the video signals to different video receiving terminals for application, and can also make the signals of the plurality of shooting scenes simultaneously according to different shooting times. That is, the above-mentioned dual-encoding cloud director method further includes: the first type of coded signals of a plurality of shooting scenes are produced by broadcasting at the same time or different times.
In a specific embodiment, a cloud director method in the prior art (that is, a path of coded signals meeting resolution requirements is adopted for lens switching and production) and a double-coded cloud director method in the invention are adopted to direct a ball game, one path of camera shoots a goal, one path of camera shoots audiences, the cloud director in the prior art respectively carries out two types of coding compression on signals of two paths of cameras and then transmits the signals to carry out cloud production, the delay of the coded, transmitted, decoded and produced video signals is about 2 seconds, when the existing cloud director carries out lens switching on the two paths of cameras, the picture shot by one camera is a goal picture, and the picture shot by the other camera is a picture shot by the audience, so that the cheering picture of the audience is not captured, the next frame of shot cannot be accurately captured in the scene of action switching, and the shot switching is not coherent. The cloud broadcasting guiding method has the advantages that the cloud production delay of the first type of low-delay coded signals generated by coding the video signals of the two cameras is 150ms, when the lenses of the two cameras are switched, the picture shot by one camera is a goal picture, and the picture shot by the other camera is a cheering picture of audiences, so that the continuity of lens switching is ensured, the second type of coded signals are produced according to the production information of the first type of coded signals, 4k code streams are output, and the broadcasting guiding of high-quality signals is ensured.
Fig. 2 is a schematic diagram of a block diagram of a dual-coding cloud broadcasting system according to an embodiment of the present invention, and as shown in fig. 2, the dual-coding cloud broadcasting system includes a plurality of cameras (S1, S2.. Sn), an encoder 2, a first stream pushing module 3, a second stream pushing module 4, a synchronization module 5, a first cloud broadcasting desk 6, and a second cloud broadcasting desk 7, where the first cloud broadcasting desk 6 includes a first production module 62 and a first signal transceiver module 61, the second cloud broadcasting desk 7 includes a second production module 72, a second signal transceiver module 71, and a second signal transceiver module 73, the plurality of cameras are divided into a plurality of groups, and collect video signals of a plurality of shooting scenes; the encoder encodes the video signals shot by each camera of each shooting scene into a plurality of paths of encoded signals with different time delays and resolutions respectively; the first plug flow module screens out one or more paths of coded signals of each shooting scene with the time delay smaller than a time delay threshold value, the coded signals serve as first type coded signals of each shooting scene, and the coded signals are sent to the first signal transceiving module; the second plug-flow module screens out one or more paths of coded signals of each shooting scene with the resolution ratio higher than the resolution ratio threshold value, the coded signals serve as second type coded signals of each shooting scene, and the coded signals are sent to the second signal transceiving module: the synchronization module is used for carrying out clock time service on the first type of coded signals and the second type of coded signals and generating frame synchronization information of the first type of coded signals and the second type of coded signals; the first manufacturing module is used for performing broadcast guiding manufacturing on one or more paths of coded signals in the first type of coded signals of each shooting scene received by the first signal transceiver module to generate manufacturing information of the first type of coded signals; the first signal transceiver module sends the making information of the first type of coded signals to the second signal transceiver module; the second manufacturing module is used for conducting broadcast guiding manufacturing on one or more paths of coded signals in the second type of coded signals according to the manufacturing information of the first type of coded signals received by the second signal receiving and transmitting module; and the second distribution module is used for issuing the second type of coded signals after the director is manufactured.
Fig. 3 is a schematic diagram of a block diagram of another embodiment of the dual-coding cloud broadcasting system of the present invention, as shown in fig. 3, the dual-coding cloud broadcasting system includes a plurality of cameras (S1, S2.. Sn), an encoder 2, a first stream pushing module 3, a second stream pushing module 4, a synchronization module 5, a local broadcasting station 8, and a second cloud broadcasting station 7, where the local broadcasting station 8 includes a first production module 62, a first signal transceiver module 61, and a first distribution module 81, the second cloud broadcasting station 7 includes a second signal transceiver module 71, a second production module 72, and a second distribution module 73, the plurality of cameras are divided into a plurality of groups, and collect video signals of a plurality of shooting scenes; the encoder encodes the video signals shot by each camera of each shooting scene into a plurality of paths of encoded signals with different time delays and resolutions respectively; the first plug flow module screens out one or more paths of coded signals of each shooting scene with the time delay smaller than a time delay threshold value, the coded signals serve as first type coded signals of each shooting scene, and the coded signals are sent to the first signal transceiving module; the second plug-flow module screens out one or more paths of coded signals of each shooting scene with the resolution ratio higher than the resolution ratio threshold value, the coded signals serve as second type coded signals of each shooting scene, and the coded signals are sent to the second signal transceiving module: the synchronization module is used for carrying out clock time service on the first type of coded signals and the second type of coded signals and generating frame synchronization information of the first type of coded signals and the second type of coded signals; the first manufacturing module is used for performing broadcast guiding manufacturing on one or more paths of coded signals in the first type of coded signals of each shooting scene received by the first signal transceiver module to generate manufacturing information of the first type of coded signals; the first signal transceiver module sends the making information of the first type of coded signals to the second signal transceiver module; the first distribution module is used for issuing the first type of coded signals after the director is made; the second manufacturing module is used for conducting broadcast guiding manufacturing on one or more paths of coded signals in the second type of coded signals according to the manufacturing information of the first type of coded signals received by the second signal receiving and transmitting module; and the second distribution module is used for issuing the second type of coded signals after the director is manufactured.
In the above two embodiments, the encoder 2 includes a first encoder 21 and a second encoder 22, where the first encoder and the second encoder receive video signals of the same camera and encode the video signals respectively, the first encoder outputs a first type of encoded signal, and the second encoder outputs a second type of encoded signal.
In both embodiments, the synchronization module includes one or more of a GPS, 5G and NTP server.
In the two embodiments, one plug flow module may be used for the first plug flow module and the second plug flow module to perform two functions, the first plug flow module and the second plug flow module may also be integrally formed with the encoder, and the first plug flow module and the second plug flow module may be used as a constituent module of the first cloud broadcasting guide or the local broadcasting guide and the second cloud broadcasting guide.
In the above two embodiments, in the embodiment of the cloud broadcasting guide system shown in fig. 3, the high-quality code stream (the second type of encoded signal) is transmitted to the broadcasting guide station (the second cloud broadcasting guide station) in the cloud end, and is used as the actual output and monitoring. The low-quality code stream (first-class coded signal) is transmitted to a local broadcasting station through a network such as an optical fiber for operation, the manufacturing information is transmitted to a second cloud broadcasting station after the low-quality code stream is manufactured locally, and the second cloud broadcasting station controls the high-quality code stream to be switched and output according to the time code. Compared with the cloud director system shown in fig. 2, the cloud director system shown in fig. 3 omits one-time encoding and one-time decoding of the first cloud director station, and can better reduce the delay.
The foregoing embodiments show each constituent part of the dual-coding cloud broadcasting guide system, but the present invention is not limited thereto, and the dual-coding cloud broadcasting guide system may further include a stream pulling module and a monitoring module, where the stream pulling module obtains the coding signal received by the first cloud broadcasting guide station or/and the second cloud broadcasting guide station, or obtains the coding signal received by the local broadcasting guide station or/and the second cloud broadcasting guide station, and the monitoring module is configured to monitor whether the coding signal is received by the first cloud broadcasting guide station or/and the second cloud broadcasting guide station, the delay and the image quality of the received coding signal, or whether the coding signal is received by the local broadcasting guide station or/and the second cloud broadcasting guide station, the delay and the image quality of the received coding signal.
In the above embodiments, in order to output a synchronous, stable, reliable, and high-quality second-type encoded signal, the second cloud director may buffer the video signal for multiple frames and output the video signal.
In the above embodiments, the delay of the first type coded signal is less than <200ms, that is, the total link delay of the low-delay first type coded signal is less than 200ms, that is, the total delay output after the encoded first type coded signal is encoded to the first cloud broadcast guiding station or the local broadcast guiding station is decoded and manufactured is less than 200 ms.
The cloud directing and broadcasting system not only meets the requirement of low delay (< 200 ms) of a director tuner, but also can ensure the quality of signal output (4K, including HDR and BT2020 color gamut, is more than 40 Mbps).
The encoder of the cloud broadcasting guide system outputs high-quality and low-delay multi-path encoding signals, so that the timeliness and high efficiency of video real-time broadcasting guide production are ensured, and meanwhile, high-quality signal output is also ensured.
The low-delay coded signals output by the encoder are previewed in real time, the real-time broadcasting guide and the manufacture have low requirements on the quality of videos and extremely high requirements on delay time, the low-delay cloud manufacture of the first cloud broadcasting guide station can ensure the multi-machine-bit frame synchronization of the video manufacture, the on-site machine position can be commanded in real time according to low-delay pictures, and the delay influence in the manufacturing process is small.
The high-quality signal output by the encoder has large delay, but the video production quality of the second cloud director station meets the high standard, and the two paths of encoded signals of the encoder enable real-time production and high-quality video output to be possible.
The director and the like use the local director station or the first cloud director station without adding extra operation, and the second cloud director station can automatically direct and produce high-quality video signals according to the production information and the frame synchronization information of the first cloud director station or the local director station without manual intervention.
Claims (10)
1. A dual-coding cloud directing method is characterized by comprising the following steps:
acquiring video signals shot by a plurality of cameras in each shooting scene:
respectively encoding the video signals shot by each camera of each shooting scene into a plurality of paths of encoded signals with different time delays and resolutions;
screening out one or more paths of coded signals of each shooting scene with the time delay smaller than a time delay threshold value as a first type of coded signals of each shooting scene;
screening out one or more paths of coding signals of each shooting scene with the resolution ratio higher than a resolution ratio threshold value as a second type of coding signal of each shooting scene;
carrying out clock time service on the first type of coded signals and the second type of coded signals to obtain frame synchronization information of the first type of coded signals and the second type of coded signals;
one or more paths of coded signals in the first type of coded signals of each shooting scene are subjected to broadcast guiding production to obtain production information of the first type of coded signals;
one or more paths of coded signals in the second type of coded signals of each shooting scene are subjected to broadcast guiding and manufacturing according to manufacturing information of the first type of coded signals of each shooting scene;
and releasing the second type of coded signals of each shooting scene after the director makes.
2. The dual-coding cloud directing method according to claim 1, wherein the step of coding the video signal shot by each camera of each shooting scene into a plurality of paths of coded signals with different delays and resolutions respectively comprises:
respectively encoding the video signals shot by each camera into two paths of encoded signals with different time delays and resolutions;
wherein, one path of coding signal with lower time delay is used as a first type of coding signal; and taking the path of coded signal with higher resolution as a second path of coded signal.
3. The dual-coding cloud director method of claim 1, wherein the first type of coded signal and the second type of coded signal are produced by a cloud director.
4. The dual-coding cloud director method according to claim 1, wherein the delay threshold is 200 ms.
5. The dual-coding cloud broadcasting method according to claim 1, wherein the step of broadcasting one or more encoded signals of the first type of encoded signal for each shooting scene comprises:
and acquiring each frame of image of the corresponding camera, and performing inter-frame image switching connection on the video signals of the multiple cameras to form a video stream.
6. The dual-encoding cloud director method of claim 1, further comprising:
the first type of coded signals are produced through a local director, and the second type of coded signals are produced through a cloud director.
7. A double-coding cloud broadcasting guide system is characterized by comprising a plurality of cameras, encoders, a first streaming module, a second streaming module, a synchronization module, a first cloud broadcasting guide platform and a second cloud broadcasting guide platform, wherein the first cloud broadcasting guide platform comprises a first manufacturing module and a first signal receiving and transmitting module, the second cloud broadcasting guide platform comprises a second manufacturing module, a second signal receiving and transmitting module and a second distribution module, the plurality of cameras are divided into a plurality of groups, and video signals of a plurality of shooting scenes are collected; the encoder encodes the video signals shot by each camera of each shooting scene into a plurality of paths of encoded signals with different time delays and resolutions respectively; the first plug flow module screens out one or more paths of coded signals of each shooting scene with the time delay smaller than a time delay threshold value, the coded signals serve as first type coded signals of each shooting scene, and the coded signals are sent to the first signal transceiving module; the second plug-flow module screens out one or more paths of coded signals of each shooting scene with the resolution ratio higher than the resolution ratio threshold value, the coded signals serve as second type coded signals of each shooting scene, and the coded signals are sent to the second signal transceiving module: the synchronization module is used for carrying out clock time service on the first type of coded signals and the second type of coded signals and generating frame synchronization information of the first type of coded signals and the second type of coded signals; the first manufacturing module is used for performing broadcast guiding manufacturing on one or more paths of coded signals in the first type of coded signals of each shooting scene received by the first signal transceiver module to generate manufacturing information of the first type of coded signals; the first signal transceiver module sends the making information of the first type of coded signals to the second signal transceiver module; the second manufacturing module is used for conducting broadcast guiding manufacturing on one or more paths of coded signals in the second type of coded signals according to the manufacturing information of the first type of coded signals received by the second signal receiving and transmitting module; and the second distribution module is used for issuing the second type of coded signals after the director is manufactured.
8. A double-coding cloud broadcasting guide system is characterized by comprising a plurality of cameras, encoders, a first streaming module, a second streaming module, a synchronization module, a local broadcasting guide platform and a second cloud broadcasting guide platform, wherein the local broadcasting guide platform comprises a first manufacturing module, a first signal receiving and transmitting module and a first distribution module, the second cloud broadcasting guide platform comprises a second signal receiving and transmitting module, a second manufacturing module and a second distribution module, the plurality of cameras are divided into a plurality of groups, and video signals of a plurality of shooting scenes are collected; the encoder encodes the video signals shot by each camera of each shooting scene into a plurality of paths of encoded signals with different time delays and resolutions respectively; the first plug flow module screens out one or more paths of coded signals of each shooting scene with the time delay smaller than a time delay threshold value, the coded signals serve as first type coded signals of each shooting scene, and the coded signals are sent to the first signal transceiving module; the second plug-flow module screens out one or more paths of coded signals of each shooting scene with the resolution ratio higher than the resolution ratio threshold value, the coded signals serve as second type coded signals of each shooting scene, and the coded signals are sent to the second signal transceiving module: the synchronization module is used for carrying out clock time service on the first type of coded signals and the second type of coded signals and generating frame synchronization information of the first type of coded signals and the second type of coded signals; the first manufacturing module is used for performing broadcast guiding manufacturing on one or more paths of coded signals in the first type of coded signals of each shooting scene received by the first signal transceiver module to generate manufacturing information of the first type of coded signals; the first signal transceiver module sends the making information of the first type of coded signals to the second signal transceiver module; the first distribution module is used for issuing the first type of coded signals after the director is made; the second manufacturing module is used for conducting broadcast guiding manufacturing on one or more paths of coded signals in the second type of coded signals according to the manufacturing information of the first type of coded signals received by the second signal receiving and transmitting module; and the second distribution module is used for issuing the second type of coded signals after the director is manufactured.
9. The dual-coding cloud director system according to claim 7 or 8, wherein the encoder comprises a first encoder and a second encoder, the first encoder and the second encoder receive video signals of the same camera and encode the video signals respectively, the first encoder outputs a first type of encoded signal, and the second encoder outputs a second type of encoded signal.
10. The dual-encoding cloud director system according to claim 7 or 8, wherein the synchronization module comprises one or more of a GPS, 5G and NTP server.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110227536.7A CN112601097B (en) | 2021-03-02 | 2021-03-02 | Double-coding cloud broadcasting method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110227536.7A CN112601097B (en) | 2021-03-02 | 2021-03-02 | Double-coding cloud broadcasting method and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112601097A CN112601097A (en) | 2021-04-02 |
| CN112601097B true CN112601097B (en) | 2021-04-30 |
Family
ID=75207681
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110227536.7A Active CN112601097B (en) | 2021-03-02 | 2021-03-02 | Double-coding cloud broadcasting method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112601097B (en) |
Families Citing this family (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113411647A (en) * | 2021-04-20 | 2021-09-17 | 北京国际云转播科技有限公司 | Cloud director method, system, server and computer readable storage medium |
| CN113271313A (en) * | 2021-04-20 | 2021-08-17 | 北京国际云转播科技有限公司 | Cloud director system, scheduling method, storage medium and multimedia scheduling server |
| CN113411646B (en) * | 2021-04-21 | 2022-10-21 | 北京国际云转播科技有限公司 | Cloud rebroadcasting code rate adjusting method and device, readable storage medium and cloud rebroadcasting system |
| CN113411640A (en) * | 2021-04-21 | 2021-09-17 | 北京国际云转播科技有限公司 | Video encoder, cloud relay method, server, system and storage medium |
| CN113301270B (en) * | 2021-05-24 | 2023-03-21 | 北京壹思达惟信息技术有限公司 | System and method for synchronously transmitting cloud rebroadcast signals |
| CN114866786A (en) * | 2022-04-27 | 2022-08-05 | 中央广播电视总台 | Television signal manufacturing method, system, equipment, chip and storage medium |
| CN114793287B (en) * | 2022-06-22 | 2022-09-27 | 中国传媒大学 | Audio and video content monitoring and broadcasting method based on two-way broadcasting guide |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102957893A (en) * | 2011-08-11 | 2013-03-06 | 宝利通公司 | Method and system for switching between video streams in a continuous presence conference |
| CN110213598A (en) * | 2018-05-31 | 2019-09-06 | 腾讯科技（深圳）有限公司 | A kind of video code conversion system, method and Related product |
| CN110661751A (en) * | 2018-06-29 | 2020-01-07 | 杭州海康威视数字技术股份有限公司 | Image pickup apparatus and playback apparatus |
| CN111684777A (en) * | 2017-09-13 | 2020-09-18 | 亚马逊技术有限公司 | Distributed multi-data center video packaging system |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10080019B2 (en) * | 2014-09-19 | 2018-09-18 | Intel Corporation | Parallel encoding for wireless displays |
-
2021
- 2021-03-02 CN CN202110227536.7A patent/CN112601097B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102957893A (en) * | 2011-08-11 | 2013-03-06 | 宝利通公司 | Method and system for switching between video streams in a continuous presence conference |
| CN111684777A (en) * | 2017-09-13 | 2020-09-18 | 亚马逊技术有限公司 | Distributed multi-data center video packaging system |
| CN110213598A (en) * | 2018-05-31 | 2019-09-06 | 腾讯科技（深圳）有限公司 | A kind of video code conversion system, method and Related product |
| CN110661751A (en) * | 2018-06-29 | 2020-01-07 | 杭州海康威视数字技术股份有限公司 | Image pickup apparatus and playback apparatus |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112601097A (en) | 2021-04-02 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112601097B (en) | Double-coding cloud broadcasting method and system | |
| CN213094282U (en) | On-cloud director | |
| CN102342066B (en) | Real-time multi-media streaming processing bandwidth management | |
| CN112601033B (en) | Cloud rebroadcasting system and method | |
| CN101917389A (en) | Network television direct broadcasting system | |
| WO2011126586A1 (en) | Video content distribution | |
| US10931980B2 (en) | Method and apparatus for providing 360 degree virtual reality broadcasting service | |
| CN109089129B (en) | Stable multi-video binding live broadcasting system and method thereof | |
| US9871967B2 (en) | Video transmission based on independently encoded background updates | |
| CN101998116A (en) | Method, system and equipment for realizing multi-view video service | |
| US20230319371A1 (en) | Distribution of Multiple Signals of Video Content Independently over a Network | |
| CN113507574A (en) | System for processing and playing ultrahigh-definition video | |
| CN113411647A (en) | Cloud director method, system, server and computer readable storage medium | |
| CN113453086A (en) | Multi-machine-position synchronous cloud broadcasting guiding method, system, storage medium and video encoder | |
| CN110958466A (en) | SDI signal synchronous return method based on RTMP transmission | |
| CN114727126B (en) | Implementation method for applying image stitching to multi-machine-position VR (virtual reality) guide broadcasting station | |
| US9204123B2 (en) | Video content generation | |
| CN114710682A (en) | Virtual reality video processing method and device for event site and electronic equipment | |
| CN114793287B (en) | Audio and video content monitoring and broadcasting method based on two-way broadcasting guide | |
| CN114666610A (en) | Video processing method and device for event site and electronic equipment | |
| CN114422810A (en) | Multipath live broadcast synchronous calibration method based on mobile terminal director station | |
| Kawamoto et al. | Remote Production Experiments with Lightweight Compressed 8K UHDTV over IP Device | |
| KR20130122117A (en) | Method and apparatus for transmitting a moving image in a real time | |
| CN202374359U (en) | Multi-picture integrating and playing system | |
| CA2824708C (en) | Video content generation |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |