CN109275010B - 4K panoramic super-fusion video terminal adaptation method and device - Google Patents
4K panoramic super-fusion video terminal adaptation method and device Download PDFInfo
- Publication number
- CN109275010B CN109275010B CN201811390806.0A CN201811390806A CN109275010B CN 109275010 B CN109275010 B CN 109275010B CN 201811390806 A CN201811390806 A CN 201811390806A CN 109275010 B CN109275010 B CN 109275010B
- Authority
- CN
- China
- Prior art keywords
- signal
- signals
- panoramic
- stream
- switching
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 35
- 230000006978 adaptation Effects 0.000 title claims abstract description 17
- 238000012545 processing Methods 0.000 claims abstract description 39
- 230000001360 synchronised effect Effects 0.000 claims abstract description 38
- 238000006243 chemical reaction Methods 0.000 claims description 30
- 230000015572 biosynthetic process Effects 0.000 claims description 4
- 230000004927 fusion Effects 0.000 claims description 4
- 238000003786 synthesis reaction Methods 0.000 claims description 4
- 238000010586 diagram Methods 0.000 description 6
- 230000003044 adaptive effect Effects 0.000 description 5
- 238000012544 monitoring process Methods 0.000 description 4
- 230000005236 sound signal Effects 0.000 description 4
- 230000006870 function Effects 0.000 description 2
- 238000011065 in-situ storage Methods 0.000 description 2
- 238000005267 amalgamation Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 230000010365 information processing Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 238000003860 storage Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
- H04N21/4307—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/44008—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
- H04N21/440218—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by transcoding between formats or standards, e.g. from MPEG-2 to MPEG-4
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
- H04N21/440281—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the temporal resolution, e.g. by frame skipping
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
- H04N21/643—Communication protocols
- H04N21/64322—IP
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The application discloses a 4K panoramic super-fusion video terminal adaptation method and a device, wherein the method comprises the following steps: the method comprises the steps of collecting a panoramic stream signal and a 4K signal, processing the panoramic stream signal and the 4K signal respectively, outputting a program video signal, carrying out synchronous calibration processing on a program video signal, outputting an IP stream signal, and pushing the IP stream signal to a video playing terminal. The method and the device can realize that the user can randomly select the 4K plane high-definition picture signal source and the panoramic 360-degree signal source according to the live pictures at any time, and simultaneously ensure that the 4K pictures and the panoramic picture signals are synchronous in real time, so that the user can feel in the field and can clearly and finely taste the 4K live content.
Description
Technical Field
The application relates to the technical field of information processing, in particular to a 4K panoramic super-fusion video terminal adaptation method and device.
Background
At present, the experience of watching videos by market research users is comprehensively analyzed, the videos watched by the users are all single plane or panoramic watching video contents, the experience is only based on a single watching mode, and basically no plane video and panoramic video fusion watching case exists. With the increasing of video users in the future, the video watching requirements of the users are developed towards humanization, customization and selection, more users can watch video contents with stronger experience required by the interest of the users, and all the users are started from user experience.
Therefore, how to realize that the user can randomly select the 4K plane high-definition picture signal source and the panoramic 360-degree signal source according to the live broadcast picture at any time and ensure that the 4K picture and the panoramic picture signal are synchronous in real time simultaneously enables the user to have the sense of bringing in the scene and have clear and fine taste of the 4K live broadcast content, and the terminal is adapted to different terminals, which is a problem to be solved urgently.
Disclosure of Invention
In view of the above, the application provides a 4K panorama super-fusion video terminal adaptation method, which can enable a user to randomly select a 4K planar high-definition picture signal source and a panorama 360-degree signal source according to a live broadcast picture at any time, and simultaneously ensure real-time synchronization of a 4K picture and a panorama picture signal, so that the user can have on-site bring-in feeling, can have clear and fine 4K live broadcast contents, and can adapt to different terminals.
The application provides a 4K panoramic super-fusion video terminal adaptation method, which comprises the following steps:
collecting a panoramic flow signal and a 4K signal;
respectively processing the panoramic flow signal and the 4K signal and outputting a program video signal;
carrying out synchronous calibration processing on the program video signal and outputting an IP stream signal;
and pushing the IP stream signal to a video playing terminal.
Preferably, the acquiring the panoramic flow signal and the 4K signal includes:
acquiring a panoramic flow signal through a panoramic 360-degree virtual reality camera;
the 4K signal is acquired by a 4K camera.
Preferably, said separately processing said panoramic stream signal and said 4K signal, and outputting a program video signal includes:
performing frame rate conversion on the panoramic stream signal;
switching the panoramic flow signal after frame rate conversion into a program video signal through a switching station;
and switching the 4K signal into a program video signal through the switching station.
Preferably, the performing a synchronous calibration process on the program video signal and outputting an IP stream signal includes:
and synchronously calibrating the program video signals through a super-fusion information switching system, and synchronizing the program video signals into IP stream signals.
Preferably, the pushing the IP stream signal to the video playback terminal includes:
and pushing the IP stream signal to a video playing terminal through a switch.
The utility model provides a super amalgamation video terminal adapter device of 4K panorama, includes:
the acquisition module is used for acquiring panoramic flow signals and 4K signals;
the first processing module is used for respectively processing the panoramic stream signal and the 4K signal and outputting a program video signal;
the second processing module is used for carrying out synchronous calibration processing on the program video signal and outputting an IP stream signal;
and the pushing module is used for pushing the IP stream signal to a video playing terminal.
Preferably, the acquisition module comprises: a panoramic 360 ° virtual reality camera and a 4K camera, wherein:
the panoramic 360-degree virtual reality camera is used for collecting panoramic flow signals;
the 4K camera is used for collecting 4K signals.
Preferably, the first processing module comprises: a frame rate conversion device and a switching station; wherein:
the frame rate conversion device is configured to perform frame rate conversion on the panoramic stream signal;
the switching station is used for switching the panoramic flow signal after the frame rate conversion into a program video signal;
the switching station is also used for switching the 4K signal into a program video signal.
Preferably, the second processing module includes:
and the super-fusion information switching system is used for synchronously calibrating the program video signals and synchronizing the program video signal frames into IP stream signals.
Preferably, the pushing module comprises:
and the exchanger is used for pushing the IP stream signal to a video playing terminal.
In summary, the application discloses a 4K panorama super-fusion video terminal adaptation method, which includes collecting a panorama stream signal and a 4K signal, processing the panorama stream signal and the 4K signal respectively, outputting a program video signal, performing synchronous calibration processing on a program video signal, outputting an IP stream signal, and pushing the IP stream signal to a video playing terminal. The method and the device can realize that the user can randomly select the 4K plane high-definition picture signal source and the panoramic 360-degree signal source according to the live pictures at any time, and simultaneously ensure that the 4K pictures and the panoramic picture signals are synchronous in real time, so that the user can feel in the field, and the 4K live contents with clear and fine taste can be adapted to different terminals.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present application, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
Fig. 1 is a flowchart of an embodiment 1 of a 4K panorama super-fusion video terminal adaptation method disclosed in the present application;
fig. 2 is a flowchart of an embodiment 2 of a 4K panorama super-fusion video terminal adaptation method disclosed in the present application;
fig. 3 is a flowchart of an embodiment 3 of a 4K panorama super-fusion video terminal adaptation method disclosed in the present application;
fig. 4 is a schematic structural diagram of an embodiment 1 of a 4K panorama super-fusion video terminal adaptation device disclosed in the present application;
fig. 5 is a schematic structural diagram of an embodiment 2 of an adaptive device for a 4K panoramic super-fusion video terminal disclosed in the present application;
fig. 6 is a schematic structural diagram of an embodiment 3 of an adaptive device for a 4K panoramic super-fusion video terminal disclosed in the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
As shown in fig. 1, which is a flowchart of an embodiment 1 of a 4K panorama super-fusion video terminal adaptation method disclosed in the present application, the method may include the following steps:
s101, collecting a panoramic flow signal and a 4K signal;
when a user needs to randomly select a 4K plane high-definition picture signal source and a panoramic 360-degree signal source according to a live broadcast picture at any time, and simultaneously, the 4K picture and a panoramic picture signal are ensured to be synchronous in real time, so that the user can feel in-situ and can clearly and finely taste 4K live broadcast content, and firstly, live broadcast panoramic flow signals and 4K high-dynamic-range image signals are collected.
S102, respectively processing the panoramic flow signal and the 4K signal and outputting a program video signal;
and then processing the acquired panoramic flow signal to output a PGM signal, and processing the 4K high dynamic range image signal to output the PGM signal.
S103, synchronously calibrating the video-saving video signal and outputting an IP stream signal;
then, the obtained PGM signal is subjected to processing such as synchronous calibration, and finally an IP stream signal is output.
And S104, pushing the IP stream signal to a video playing terminal.
And finally, pushing the obtained IP stream signals to each video playing terminal, wherein the video playing terminals can be a mobile phone terminal, a PAD terminal, a PC and server terminal, a media receiver terminal, a television terminal and the like.
In summary, in the above embodiments, the panoramic stream signal and the 4K signal are collected first, then the panoramic stream signal and the 4K signal are processed respectively, the program video signal is output, the program video signal is subjected to synchronous calibration processing, the IP stream signal is output, and finally the IP stream signal is pushed to the video playing terminal. The method and the device can realize that the user can randomly select the 4K plane high-definition picture signal source and the panoramic 360-degree signal source according to the live pictures at any time, and simultaneously ensure that the 4K pictures and the panoramic picture signals are synchronous in real time, so that the user can feel in the field, and the 4K live contents with clear and fine taste can be adapted to different terminals.
As shown in fig. 2, which is a flowchart of an embodiment 1 of a 4K panorama super-fusion video terminal adaptation method disclosed in the present application, the method may include the following steps:
s201, collecting a panoramic flow signal through a panoramic 360-degree virtual reality camera;
when the user needs to randomly select a 4K plane high-definition picture signal source and a panoramic 360-degree signal source according to a live broadcast picture at any time, and simultaneously, the 4K picture and the panoramic picture signal are ensured to be synchronous in real time, so that the user can feel in the field and can acquire panoramic flow signals through a plurality of panoramic 360-degree virtual reality cameras erected on the field when the 4K live broadcast content is clear and fine.
S202, collecting 4K signals through a 4K camera;
meanwhile, 4K high dynamic range image signals are collected through a 4K camera erected on site.
S203, respectively processing the panoramic flow signal and the 4K signal and outputting a program video signal;
and then processing the acquired panoramic flow signal to output a PGM signal, and processing the 4K high dynamic range image signal to output the PGM signal.
S204, synchronously calibrating the video-on-demand signal and outputting an IP stream signal;
then, the obtained PGM signal is subjected to processing such as synchronous calibration, and finally an IP stream signal is output.
S205, the IP stream signal is pushed to the video playing terminal.
And finally, pushing the obtained IP stream signals to each video playing terminal, wherein the video playing terminals can be a mobile phone terminal, a PAD terminal, a PC and server terminal, a media receiver terminal, a television terminal and the like.
In summary, in the above embodiments, the panoramic 360 ° virtual reality camera collects a panoramic stream signal, the 4K camera collects a 4K signal, the panoramic stream signal and the 4K signal are processed respectively, a program video signal is output, a program video signal is synchronously calibrated, an IP stream signal is output, and finally the IP stream signal is pushed to the video playing terminal. The method and the device can realize that the user can randomly select the 4K plane high-definition picture signal source and the panoramic 360-degree signal source according to the live pictures at any time, and simultaneously ensure that the 4K pictures and the panoramic picture signals are synchronous in real time, so that the user can feel in the field, and the 4K live contents with clear and fine taste can be adapted to different terminals.
As shown in fig. 3, which is a flowchart of embodiment 3 of a 4K panorama super-fusion video terminal adaptation method disclosed in the present application, the method may include the following steps:
s301, collecting panoramic flow signals through a panoramic 360-degree virtual reality camera;
when the user needs to randomly select a 4K plane high-definition picture signal source and a panoramic 360-degree signal source according to a live broadcast picture at any time, and simultaneously, the 4K picture and the panoramic picture signal are ensured to be synchronous in real time, so that the user can feel in the field and can acquire panoramic flow signals through a plurality of panoramic 360-degree virtual reality cameras erected on the field when the 4K live broadcast content is clear and fine.
S302, collecting 4K signals through a 4K camera;
meanwhile, 4K high dynamic range image signals are collected through a 4K camera erected on site.
S303, performing frame rate conversion on the panoramic flow signal;
since the frame rate of the panoramic 360 ° virtual reality camera does not coincide with the 4K signal, frame rate conversion of the panoramic stream signal is required. The panoramic 60-degree virtual reality camera can provide an IP stream and an HDMI signal, the IP stream signal directly sends out a pure panoramic signal through an RTMP protocol, the HDMI signal generates a 12GSDI signal through a conversion box, and the HDMI signal is converted from a 30-frame signal into a 50-frame signal through frame conversion and enters a switching station.
S304, switching the panoramic flow signal after the frame rate conversion into a program video signal through a switching station;
the switching station is equipped with a function of simultaneously recording 20 channels of 4K signals.
S305, switching the 4K signal into a program video signal through a switching station;
the switching station is connected with the mixed audio output by the audio switching station, the synchronous generator provides a REF synchronous signal, and the synchronous signal is connected to the switcher, the up-conversion equipment, the real conversion equipment and the like to ensure the frame synchronization after the conversion of the equipment.
The switching station generates a total of 3 SDI signals. The first 4K signal of the output 50P is a PGM signal switched by the director and enters the super-fusion information switching system. And the second path outputs original pictures of a plurality of machine positions through a multi view port for a director to monitor a scene shooting picture. And the third signal outputs a high-definition signal of 3GSDI through an AUX SDI port and is accessed to the encoder.
The first path of signal output by the switching platform is a PGM signal after caption synthesis by a 4K caption system, and the signal enters a super-fusion information switching system.
And the second path of signals output by the switching station outputs original pictures of a plurality of machine positions through a multi view port for director and monitoring the scene shooting pictures.
And the third path of signal output by the switching station enters an encoder, and the encoder generates a high-definition IP stream signal of H.264 for high-definition stream live broadcast.
S306, synchronously calibrating the program video signals through the super-fusion information switching system, and synchronizing the program video signal frames into IP stream signals;
the super-fusion information switching system synchronously calibrates the 3G SDI, the 12G SDI and the panoramic stream signal, records switching information of the panoramic video and audio signal and the 4K video and audio signal, synchronizes frames into an IP stream signal, and codes the 4K IP stream into H.265.
S307, the IP stream signal is pushed to the video playing terminal through the exchanger.
And finally, pushing the obtained IP stream signals to each video playing terminal, wherein the video playing terminals can be a mobile phone terminal, a PAD terminal, a PC and server terminal, a media receiver terminal, a television terminal and the like.
To sum up, the method and the device can simultaneously access 3G SDI, 12G SDI, 360-degree VR panoramic stream signals and 4K HDR signals, realize synchronous calibration of low-delay 3G SDI, 12G SDI, 360-degree VR panoramic stream video-audio signals and 4K HDR video-audio signals, and can realize multi-terminal push stream release, multi-signal frame synchronous management, monitoring and browsing, and multi-protocol conversion of video stream frame rate and code rate; the system can realize signal recording, forwarding, conversion, management, preview, release, stream pushing and terminal adaptation calibration, so that a user can synchronously display and view various terminals when watching a live broadcast event, can also realize on-site bring-in feeling, and can clearly and finely broadcast the content with the taste.
As shown in fig. 4, a schematic structural diagram of an embodiment 1 of an adaptive device for a 4K panoramic super-fusion video terminal disclosed in the present application is shown, where the device may include:
an acquisition module 401, configured to acquire a panoramic flow signal and a 4K signal;
when a user needs to randomly select a 4K plane high-definition picture signal source and a panoramic 360-degree signal source according to a live broadcast picture at any time, and simultaneously, the 4K picture and a panoramic picture signal are ensured to be synchronous in real time, so that the user can feel in-situ and can clearly and finely taste 4K live broadcast content, and firstly, live broadcast panoramic flow signals and 4K high-dynamic-range image signals are collected.
A first processing module 402, configured to process the panoramic stream signal and the 4K signal, respectively, and output a program video signal;
and then processing the acquired panoramic flow signal to output a PGM signal, and processing the 4K high dynamic range image signal to output the PGM signal.
A second processing module 403, configured to perform synchronous calibration processing on the program video signal, and output an IP stream signal;
then, the obtained PGM signal is subjected to processing such as synchronous calibration, and finally an IP stream signal is output.
The pushing module 404 is configured to push the IP stream signal to the video playing terminal.
And finally, pushing the obtained IP stream signals to each video playing terminal, wherein the video playing terminals can be a mobile phone terminal, a PAD terminal, a PC and server terminal, a media receiver terminal, a television terminal and the like.
In summary, in the above embodiments, the panoramic stream signal and the 4K signal are collected first, then the panoramic stream signal and the 4K signal are processed respectively, the program video signal is output, the program video signal is subjected to synchronous calibration processing, the IP stream signal is output, and finally the IP stream signal is pushed to the video playing terminal. The method and the device can realize that the user can randomly select the 4K plane high-definition picture signal source and the panoramic 360-degree signal source according to the live pictures at any time, and simultaneously ensure that the 4K pictures and the panoramic picture signals are synchronous in real time, so that the user can feel in the field, and the 4K live contents with clear and fine taste can be adapted to different terminals.
As shown in fig. 5, which is a schematic structural diagram of an embodiment 2 of an adaptive device for a 4K panoramic super-fusion video terminal disclosed in the present application, the device may include:
a panoramic 360-degree virtual reality camera 501 for collecting panoramic flow signals;
when the user needs to randomly select a 4K plane high-definition picture signal source and a panoramic 360-degree signal source according to a live broadcast picture at any time, and simultaneously, the 4K picture and the panoramic picture signal are ensured to be synchronous in real time, so that the user can feel in the field and can acquire panoramic flow signals through a plurality of panoramic 360-degree virtual reality cameras erected on the field when the 4K live broadcast content is clear and fine.
A 4K camera 502 for acquiring 4K signals;
meanwhile, 4K high dynamic range image signals are collected through a 4K camera erected on site.
A first processing module 503, configured to process the panoramic stream signal and the 4K signal, respectively, and output a program video signal;
and then processing the acquired panoramic flow signal to output a PGM signal, and processing the 4K high dynamic range image signal to output the PGM signal.
A second processing module 504, configured to perform synchronous calibration processing on the program video signal and output an IP stream signal;
then, the obtained PGM signal is subjected to processing such as synchronous calibration, and finally an IP stream signal is output.
And a pushing module 505, configured to push the IP stream signal to the video playing terminal.
And finally, pushing the obtained IP stream signals to each video playing terminal, wherein the video playing terminals can be a mobile phone terminal, a PAD terminal, a PC and server terminal, a media receiver terminal, a television terminal and the like.
In summary, in the above embodiments, the panoramic 360 ° virtual reality camera collects a panoramic stream signal, the 4K camera collects a 4K signal, the panoramic stream signal and the 4K signal are processed respectively, a program video signal is output, a program video signal is synchronously calibrated, an IP stream signal is output, and finally the IP stream signal is pushed to the video playing terminal. The method and the device can realize that the user can randomly select the 4K plane high-definition picture signal source and the panoramic 360-degree signal source according to the live pictures at any time, and simultaneously ensure that the 4K pictures and the panoramic picture signals are synchronous in real time, so that the user can feel in the field, and the 4K live contents with clear and fine taste can be adapted to different terminals.
As shown in fig. 6, which is a schematic structural diagram of an embodiment 3 of an adaptive device for a 4K panoramic super-fusion video terminal disclosed in the present application, the device may include:
a panoramic 360 ° virtual reality camera 601 for acquiring panoramic flow signals;
when the user needs to randomly select a 4K plane high-definition picture signal source and a panoramic 360-degree signal source according to a live broadcast picture at any time, and simultaneously, the 4K picture and the panoramic picture signal are ensured to be synchronous in real time, so that the user can feel in the field and can acquire panoramic flow signals through a plurality of panoramic 360-degree virtual reality cameras erected on the field when the 4K live broadcast content is clear and fine.
A 4K camera 602 for acquiring 4K signals;
meanwhile, 4K high dynamic range image signals are collected through a 4K camera erected on site.
A frame rate conversion device 603 for performing frame rate conversion on the panoramic stream signal;
since the frame rate of the panoramic 360 ° virtual reality camera does not coincide with the 4K signal, frame rate conversion of the panoramic stream signal is required. The panoramic 60-degree virtual reality camera can provide an IP stream and an HDMI signal, the IP stream signal directly sends out a pure panoramic signal through an RTMP protocol, the HDMI signal generates a 12GSDI signal through a conversion box, and the HDMI signal is converted from a 30-frame signal into a 50-frame signal through frame conversion and enters a switching station.
A switching stage 604, configured to switch the frame rate converted panoramic stream signal into a program video signal;
the switching station is equipped with a function of simultaneously recording 20 channels of 4K signals.
A switching station 604 for switching the signal to a program video signal;
the switching station is connected with the mixed audio output by the audio switching station, the synchronous generator provides a REF synchronous signal, and the synchronous signal is connected to the switcher, the up-conversion equipment, the real conversion equipment and the like to ensure the frame synchronization after the conversion of the equipment.
The switching station generates a total of 3 SDI signals. The first 4K signal of the output 50P is a PGM signal switched by the director and enters the super-fusion information switching system. And the second path outputs original pictures of a plurality of machine positions through a multi view port for a director to monitor a scene shooting picture. And the third signal outputs a high-definition signal of 3GSDI through an AUX SDI port and is accessed to the encoder.
The first path of signal output by the switching platform is a PGM signal after caption synthesis by a 4K caption system, and the signal enters a super-fusion information switching system.
And the second path of signals output by the switching station outputs original pictures of a plurality of machine positions through a multi view port for director and monitoring the scene shooting pictures.
And the third path of signal output by the switching station enters an encoder, and the encoder generates a high-definition IP stream signal of H.264 for high-definition stream live broadcast.
A super-fusion information switching system 605, configured to perform synchronous calibration on the program video signals, and synchronize the program video signal frames into an IP stream signal;
the super-fusion information switching system synchronously calibrates the 3G SDI, the 12G SDI and the panoramic stream signal, records switching information of the panoramic video and audio signal and the 4K video and audio signal, synchronizes frames into an IP stream signal, and codes the 4K IP stream into H.265.
The switch 606 is configured to push the IP stream signal to the video playback terminal.
And finally, pushing the obtained IP stream signals to each video playing terminal, wherein the video playing terminals can be a mobile phone terminal, a PAD terminal, a PC and server terminal, a media receiver terminal, a television terminal and the like.
To sum up, the method and the device can simultaneously access 3G SDI, 12G SDI, 360-degree VR panoramic stream signals and 4K HDR signals, realize synchronous calibration of low-delay 3G SDI, 12G SDI, 360-degree VR panoramic stream video-audio signals and 4K HDR video-audio signals, and can realize multi-terminal push stream release, multi-signal frame synchronous management, monitoring and browsing, and multi-protocol conversion of video stream frame rate and code rate; the system can realize signal recording, forwarding, conversion, management, preview, release, stream pushing and terminal adaptation calibration, so that a user can synchronously display and view various terminals when watching a live broadcast event, can also realize on-site bring-in feeling, and can clearly and finely broadcast the content with the taste.
The embodiments in the present description are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other. The device disclosed by the embodiment corresponds to the method disclosed by the embodiment, so that the description is simple, and the relevant points can be referred to the method part for description.
Those of skill would further appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, computer software, or combinations of both, and that the various illustrative components and steps have been described above generally in terms of their functionality in order to clearly illustrate this interchangeability of hardware and software. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.
The steps of a method or algorithm described in connection with the embodiments disclosed herein may be embodied directly in hardware, in a software module executed by a processor, or in a combination of the two. A software module may reside in Random Access Memory (RAM), memory, Read Only Memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art.
The previous description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present application. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the application. Thus, the present application is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
Claims (6)
1. A4K panorama super fusion video terminal adaptation method is characterized by comprising the following steps:
collecting a panoramic flow signal and a 4K signal;
performing frame rate conversion on the panoramic stream signal;
switching the panoramic flow signal after frame rate conversion into a program video signal through a switching station;
switching the 4K signals into program video signals through the switching station, wherein the program video signals are PGM signals;
the switching platform generates three SDI signals, the first signal output by the switching platform is a PGM signal subjected to caption synthesis by a 4K caption system, and the PGM signal enters a super fusion information switching system; the second path of signals output by the switching station outputs original pictures of a plurality of machine positions through a multi view port; the third path of signals output by the switching station output 3G SDI high-definition signals through an AUX SDI port and are accessed to an encoder, and the encoder generates H.264 high-definition IP stream signals;
synchronously calibrating the program video signals through a super-fusion information switching system, and synchronizing the program video signals into IP stream signals, wherein the super-fusion information switching system synchronously calibrates 3G SDI, 12G SDI and panoramic stream signals, records switching information of the panoramic stream signals and 4K signals, and synchronizes the frames into the IP stream signals;
and pushing the IP stream signal to a video playing terminal.
2. The method of claim 1, wherein the acquiring the panoramic stream signal and the 4K signal comprises:
acquiring a panoramic flow signal through a panoramic 360-degree virtual reality camera;
the 4K signal is acquired by a 4K camera.
3. The method according to claim 1, wherein said pushing the IP stream signal to a video playback terminal comprises:
and pushing the IP stream signal to a video playing terminal through a switch.
4. The utility model provides a super video terminal adapter device that fuses of 4K panorama which characterized in that includes:
the acquisition module is used for acquiring panoramic flow signals and 4K signals;
the first processing module is used for performing frame rate conversion on the panoramic stream signals, switching the panoramic stream signals subjected to frame rate conversion into program video signals through a switching station, and switching the 4K signals into program video signals through the switching station, wherein the program video signals are PGM signals; the switching platform generates three SDI signals, the first signal output by the switching platform is a PGM signal subjected to caption synthesis by a 4K caption system, and the PGM signal enters a super fusion information switching system; the second path of signals output by the switching station outputs original pictures of a plurality of machine positions through a multi view port; the third path of signals output by the switching station output 3G SDI high-definition signals through an AUX SDI port and are accessed to an encoder, and the encoder generates H.264 high-definition IP stream signals;
the second processing module is used for carrying out synchronous calibration processing on the obtained program video signals and outputting IP stream signals;
the pushing module is used for pushing the IP stream signal to a video playing terminal;
the second processing module comprises:
and the super-fusion information switching system is used for synchronously calibrating the program video signals and synchronizing the program video signals into IP stream signals, wherein the super-fusion information switching system synchronously calibrates the 3G SDI, the 12G SDI and the panoramic stream signals, records the switching information of the panoramic stream signals and the 4K signals, and synchronizes the frames into the IP stream signals.
5. The apparatus of claim 4, wherein the acquisition module comprises: a panoramic 360 ° virtual reality camera and a 4K camera, wherein:
the panoramic 360-degree virtual reality camera is used for collecting panoramic flow signals;
the 4K camera is used for collecting 4K signals.
6. The apparatus of claim 4, wherein the push module comprises:
and the exchanger is used for pushing the IP stream signal to a video playing terminal.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811390806.0A CN109275010B (en) | 2018-11-21 | 2018-11-21 | 4K panoramic super-fusion video terminal adaptation method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811390806.0A CN109275010B (en) | 2018-11-21 | 2018-11-21 | 4K panoramic super-fusion video terminal adaptation method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109275010A CN109275010A (en) | 2019-01-25 |
| CN109275010B true CN109275010B (en) | 2021-10-22 |
Family
ID=65191207
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811390806.0A Active CN109275010B (en) | 2018-11-21 | 2018-11-21 | 4K panoramic super-fusion video terminal adaptation method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109275010B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111741237A (en) * | 2020-07-06 | 2020-10-02 | 中仪英斯泰克进出口有限公司 | Ultra-high definition digital signal relay system and ultra-high definition digital signal relay vehicle |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107231542A (en) * | 2017-05-04 | 2017-10-03 | 安徽庆睿实业有限责任公司 | Video conferencing system |
| CN108347557A (en) * | 2017-01-21 | 2018-07-31 | 盯盯拍（东莞）视觉设备有限公司 | Panorama image shooting apparatus, display device, image pickup method and display methods |
Family Cites Families (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9264782B2 (en) * | 2013-01-25 | 2016-02-16 | Electronics And Telecommunications Research Institute | Method and system for providing realistic broadcasting image |
| CN103905741B (en) * | 2014-03-19 | 2017-01-11 | 合肥安达创展科技股份有限公司 | Ultra-high-definition panoramic video real-time generation and multi-channel synchronous play system |
| CN106210703B (en) * | 2016-09-08 | 2018-06-08 | 北京美吉克科技发展有限公司 | The utilization of VR environment bust shot camera lenses and display methods and system |
| CN106572344A (en) * | 2016-09-29 | 2017-04-19 | 宇龙计算机通信科技(深圳)有限公司 | Virtual reality live broadcast method and system and cloud server |
| CN106993177A (en) * | 2016-10-12 | 2017-07-28 | 深圳市圆周率软件科技有限责任公司 | A kind of 720 degree of panorama acquisition systems of binocular |
| KR20180054377A (en) * | 2016-11-15 | 2018-05-24 | 주식회사 살린 | Interactive virtual reality system |
| CN108055472A (en) * | 2017-12-21 | 2018-05-18 | 长沙全度影像科技有限公司 | A kind of real time panoramic live broadcast system and method |
-
2018
- 2018-11-21 CN CN201811390806.0A patent/CN109275010B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108347557A (en) * | 2017-01-21 | 2018-07-31 | 盯盯拍（东莞）视觉设备有限公司 | Panorama image shooting apparatus, display device, image pickup method and display methods |
| CN107231542A (en) * | 2017-05-04 | 2017-10-03 | 安徽庆睿实业有限责任公司 | Video conferencing system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109275010A (en) | 2019-01-25 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106713945B (en) | Client live broadcast processing method and device, live broadcast server and live broadcast system | |
| US9271048B2 (en) | Systems and methods for immersive viewing experience | |
| US7623176B2 (en) | Meta-data display system, meta-data synthesis apparatus, video-signal recording/reproduction apparatus, imaging apparatus and meta-data display method | |
| US20080068458A1 (en) | Video Monitoring System | |
| WO2007057875A2 (en) | Digital video zooming system | |
| US20150256846A1 (en) | Image processing apparatus, image processing method and image processing system | |
| KR102025157B1 (en) | System and method for transmitting a plurality of video image | |
| KR101841313B1 (en) | Methods for processing multimedia flows and corresponding devices | |
| CN113452935B (en) | Horizontal screen and vertical screen live video generation system and method | |
| US9445085B2 (en) | Imaging apparatus, method for controlling imaging apparatus, and system therefor | |
| CN109275010B (en) | 4K panoramic super-fusion video terminal adaptation method and device | |
| US8873642B2 (en) | Video content analysis methods and systems | |
| KR20120019754A (en) | Receiving system for digital braoadcasting using ultrea high definition module | |
| KR20130044062A (en) | Remote video transmission system | |
| CN109348246B (en) | 4K panoramic super-fusion video live broadcast method and device | |
| KR102024437B1 (en) | System and method for transmitting a plurality of video image | |
| EP3522525B1 (en) | Method and apparatus for processing video playing | |
| Niamut et al. | Live event experiences-interactive UHDTV on mobile devices | |
| CN109348245B (en) | 4K panoramic super-fusion multi-channel monitoring method and device | |
| JP2012004991A (en) | Broadcast receiving apparatus and control method for the same | |
| KR20190083905A (en) | System and method for transmitting a plurality of video image | |
| KR101307974B1 (en) | All in one digital integrated broadcasting module and digital broadcasting system using the same | |
| KR102637147B1 (en) | Vertical mode streaming method, and portable vertical mode streaming system | |
| Miki et al. | Readying for UHDTV broadcasting in Japan | |
| Abe et al. | Development of Super Hi-Vision Compact Cameras and Recording System |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |