CN112261422A - Simulation remote live broadcast stream data processing method suitable for broadcasting and television field - Google Patents
Simulation remote live broadcast stream data processing method suitable for broadcasting and television field Download PDFInfo
- Publication number
- CN112261422A CN112261422A CN202011101505.9A CN202011101505A CN112261422A CN 112261422 A CN112261422 A CN 112261422A CN 202011101505 A CN202011101505 A CN 202011101505A CN 112261422 A CN112261422 A CN 112261422A
- Authority
- CN
- China
- Prior art keywords
- rendering
- rendering server
- master control
- control workstation
- remote live
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000004088 simulation Methods 0.000 title claims abstract description 23
- 238000003672 processing method Methods 0.000 title claims abstract description 10
- 238000009877 rendering Methods 0.000 claims abstract description 66
- 230000001360 synchronised effect Effects 0.000 claims abstract description 20
- 230000004044 response Effects 0.000 claims abstract description 10
- 238000002360 preparation method Methods 0.000 claims abstract description 4
- 238000000034 method Methods 0.000 claims description 7
- 238000012545 processing Methods 0.000 claims description 4
- 238000007781 pre-processing Methods 0.000 claims description 3
- 230000003993 interaction Effects 0.000 description 3
- 230000000694 effects Effects 0.000 description 2
- 238000012805 post-processing Methods 0.000 description 2
- 241000143060 Americamysis bahia Species 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 238000007654 immersion Methods 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 238000003786 synthesis reaction Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/21—Server components or server architectures
- H04N21/218—Source of audio or video content, e.g. local disk arrays
- H04N21/2187—Live feed
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/242—Synchronization processes, e.g. processing of PCR [Program Clock References]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
- H04N21/4307—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
- H04N21/643—Communication protocols
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/81—Monomedia components thereof
- H04N21/816—Monomedia components thereof involving special video data, e.g 3D video
Abstract
A simulation remote live broadcast stream data processing method suitable for the broadcasting and television field comprises the following steps: setting the large screens of the N LEDs to be in a vertical synchronous consistent mode through a hardware synchronous card; setting a display refreshing mode of a rendering server as a software refreshing rate; setting a master control workstation and a rendering server of a rendering channel into a complete frame locking mode, and controlling the stepping of the next frame by the master control workstation; setting the master control workstation and the rendering server to be in a complete frame locking mode, and controlling the stepping of each frame by the master control workstation; the main control workstation broadcasts the preprocessed remote live stream in a local area network through a UDP protocol so as to send the remote live stream to each rendering server; after receiving the preprocessed remote live broadcast stream through broadcasting, each rendering server feeds back a response message for indicating that rendering preparation is finished, and enters a standby state; and after confirming that the response message of each rendering server is received, the master control workstation controls each rendering server to synchronously output.
Description
Technical Field
The invention belongs to the technical field of virtual reality, and particularly relates to a simulation remote live broadcast stream data processing method suitable for the field of broadcasting and television.
Background
With the development of digital technology, more and more movies/television programs are recorded in virtual scenes. Taking a virtual studio widely applied in the field of broadcast television as an example, a three-dimensional virtual reality technology is used for making virtual scenes and virtual animation characters which enable people to be personally on the scene, and real actors and the virtual animation characters can interact with each other on the same station, so that the entertainment of programs is greatly increased; therefore, the program making cost can be greatly saved, and the program making efficiency is improved.
Most of current virtual studios adopt a green curtain mode, the green curtain mode can add virtual scenes and/or characters into an area of the green curtain through software during post-processing, and the virtual studios can be completed through a single machine, so that the cost is low. However, when recording, real actors can only see virtual scenes and/or characters through pointing or reverse-looking screens, which causes very difficult operation of program recording, very poor scene sense, and very long post-synthesis processing time, resulting in high actual recording cost.
Disclosure of Invention
Aiming at the problems existing in the prior art when a green curtain mode is adopted for recording, the embodiment of the invention provides a simulation remote live broadcast stream data processing method suitable for the field of broadcasting and television, which can better realize simulation remote live broadcast in the field of broadcasting and television and effectively and efficiently process data.
In order to solve the above problem, an embodiment of the present invention provides a method for processing simulation live streaming data in a remote broadcasting field, including:
connecting N LED large screens to N rendering servers, and connecting the N rendering servers to a master control workstation to form a CAVE simulation environment space; connecting a remote image capture hardware device to a master workstation;
setting the N LED large screens to be in a vertical synchronous consistent mode through a hardware synchronization card; setting a display refreshing mode of the rendering server as a software refreshing rate; setting the master control workstation and a rendering server of the rendering channel to be in a complete frame locking mode, and controlling the stepping of the next frame by the master control workstation;
setting the master control workstation and the rendering server to be in a complete frame locking mode, and controlling the stepping of each frame by the master control workstation;
after preprocessing the received remote live broadcast stream, the main control workstation broadcasts the preprocessed remote live broadcast stream in a local area network through a UDP (user Datagram protocol) protocol so as to send the preprocessed remote live broadcast stream to each rendering server; (ii) a
After receiving the preprocessed remote live broadcast stream through broadcasting, each rendering server feeds back a response message for indicating that rendering preparation is finished, and enters a standby state;
and after confirming that the response message of each rendering server is received, the master control workstation controls each rendering server to synchronously output.
In some embodiments, said controlling said each rendering server to synchronize output comprises:
and each rendering server calls a hardware synchronization card to match with the final picture output so as to realize the synchronous rendering of the live stream at the hardware display level.
In some embodiments, the amount of change in the virtual graphics corresponding to the target is sent to each of the rendering servers, including:
and the master control workstation generates an indication message according to the variable quantity of the virtual graph of the target and sends the indication message to each rendering server in a broadcasting mode.
In some embodiments, the master workstation generates a virtual simulation image from the received remote live stream through virtual reality AR simulation environment software, so as to perform cross-screen virtual reality AR synchronous display through the N LED large screens.
The technical scheme of the invention has the following beneficial effects: the technical scheme provides a simulation remote live broadcast stream data processing method suitable for the field of broadcasting and television, and remote live broadcast streams can be added into a panoramic simulation environment based on LEDs. The technical scheme can fuse a local real scene, a remote real scene and a local virtual three-dimensional background picture into a complete and synchronous picture, greatly reduces the shooting difficulty, enhances the program interaction effect and saves the program shooting cost.
Drawings
Fig. 1 is a schematic diagram of the mode of operation of the method of an embodiment of the present invention.
Detailed Description
In order to make the technical problems, technical solutions and advantages of the present invention more apparent, the following detailed description is given with reference to the accompanying drawings and specific embodiments.
The embodiment of the invention provides a simulation remote live streaming data processing method suitable for the field of broadcasting and television, which adopts a CAVE immersion environment consisting of a plurality of LED large screens, can add remote live streaming in a panoramic simulation environment based on LEDs to fuse a local real scene, a remote real scene and a local virtual three-dimensional background picture into a complete and synchronous picture, greatly reduces the shooting difficulty, enhances the program interaction effect and saves the program shooting cost. The technical scheme of the embodiment of the invention not only greatly increases the interest of interaction, but also greatly increases the efficiency of recording programs, and the recorded pictures basically do not need too much post-processing, thereby greatly reducing the cost of recording programs.
In the above technical solution, since each LED screen is configured with an independent computer, the virtual pictures on all the LEDs must be seamlessly connected and synchronized. According to the technical scheme of the embodiment of the invention, the remote live streaming data acquired from the image capturing hardware equipment of the third party can be merged into the final playing image together with the remote live streaming data, the local real scene, the remote real scene and the local virtual three-dimensional background picture. The technical scheme of the embodiment of the invention can smoothly and synchronously display the image on the complete display mechanism formed by splicing the N LED large screens.
The embodiment of the invention provides a simulation remote live broadcast stream data processing method suitable for the field of broadcasting and television, which comprises the following steps:
connecting N LED large screens to N rendering servers, and connecting the N rendering servers to a master control workstation to form a CAVE simulation environment space; connecting a remote image capture hardware device to a master workstation;
setting the N LED large screens to be in a vertical synchronous consistent mode through a hardware synchronization card; setting a display refreshing mode of the rendering server as a software refreshing rate; setting the master control workstation and a rendering server of the rendering channel to be in a complete frame locking mode, and controlling the stepping of the next frame by the master control workstation;
setting the master control workstation and the rendering server to be in a complete frame locking mode, and controlling the stepping of each frame by the master control workstation;
after preprocessing the received remote live broadcast stream, the main control workstation broadcasts the preprocessed remote live broadcast stream in a local area network through a UDP (user Datagram protocol) protocol so as to send the preprocessed remote live broadcast stream to each rendering server; (ii) a
After receiving the preprocessed remote live broadcast stream through broadcasting, each rendering server feeds back a response message for indicating that rendering preparation is finished, and enters a standby state;
and after confirming that the response message of each rendering server is received, the master control workstation controls each rendering server to synchronously output. Wherein the controlling the synchronous output of each rendering server comprises: and each rendering server calls a hardware synchronization card to match with the final picture output so as to realize the synchronous rendering of the live stream at the hardware display level.
Wherein, the sending the variation of the virtual graphics corresponding to the target to each rendering server includes: and the master control workstation generates an indication message according to the variable quantity of the virtual graph of the target and sends the indication message to each rendering server in a broadcasting mode.
In some embodiments, the master workstation generates a virtual simulation image from the received remote live stream through virtual reality AR simulation environment software, so as to perform cross-screen virtual reality AR synchronous display through the N LED large screens.
When the AR simulation environment software is started, the performer simulating the animated character enters an image capturing area of the device capturing the body movement, and starts simulating the animated character to perform various performances. At the moment, after the device for capturing the limb movement captures the movement of the performer, the captured image is sent to the main control workstation, and then the multi-channel system accurately displays the limb picture on N rendering servers in a hardware-level synchronous mode.
Specifically, the method comprises the following steps:
(1) setting a multi-surface LED screen into a vertical synchronous consistent mode by matching with a hardware synchronous card;
(2) setting the display refreshing mode of each rendering server as the vertical refreshing rate as the software refreshing rate;
(3) setting a master control workstation and a rendering server to be in a complete frame locking mode; the main control workstation controls the stepping of the next frame; namely: the stepping synchronization mode means that the display of all rendering servers advances synchronously, and the content of the next picture can be updated only after the current pictures of all LEDs are displayed;
(4) the method comprises the steps that a master control workstation receives a remote live stream acquired by a remote image capturing hardware device, and broadcasts the remote live stream in a local area in a UDP (user datagram protocol) mode;
(5) after receiving the broadcast remote live stream, the rendering server sends a response message to the master control workstation and enters a waiting state;
(6) after the master control workstation confirms that the response message of the rendering server is received and confirms that all the rendering servers are ready, the master control workstation broadcasts a display instruction to indicate all the rendering servers to output a final picture in cooperation with shrimps of the hardware synchronization card, so that synchronous rendering of live streaming at the hardware level is displayed.
While the foregoing is directed to the preferred embodiment of the present invention, it will be understood by those skilled in the art that various changes and modifications may be made without departing from the spirit and scope of the invention as defined in the appended claims.
Claims (4)
1. A simulation remote live broadcast stream data processing method suitable for the broadcasting and television field is characterized by comprising the following steps:
connecting N LED large screens to N rendering servers, and connecting the N rendering servers to a master control workstation to form a CAVE simulation environment space; connecting a remote image capture hardware device to a master workstation;
setting the N LED large screens to be in a vertical synchronous consistent mode through a hardware synchronization card; setting a display refreshing mode of the rendering server as a software refreshing rate; setting the master control workstation and a rendering server of the rendering channel to be in a complete frame locking mode, and controlling the stepping of the next frame by the master control workstation;
setting the master control workstation and the rendering server to be in a complete frame locking mode, and controlling the stepping of each frame by the master control workstation;
after preprocessing the received remote live broadcast stream, the main control workstation broadcasts the preprocessed remote live broadcast stream in a local area network through a UDP (user Datagram protocol) protocol so as to send the preprocessed remote live broadcast stream to each rendering server; (ii) a
After receiving the preprocessed remote live broadcast stream through broadcasting, each rendering server feeds back a response message for indicating that rendering preparation is finished, and enters a standby state;
and after confirming that the response message of each rendering server is received, the master control workstation controls each rendering server to synchronously output.
2. The method for processing the simulation remote live streaming data in the broadcasting and television field according to claim 1, wherein the controlling of the synchronous output of each rendering server comprises:
and each rendering server calls a hardware synchronization card to match with the final picture output so as to realize the synchronous rendering of the live stream at the hardware display level.
3. The method for processing the simulation remote live streaming data in the broadcasting and television field according to claim 1, wherein the sending the variation of the virtual graphics corresponding to the target to each rendering server includes:
and the master control workstation generates an indication message according to the variable quantity of the virtual graph of the target and sends the indication message to each rendering server in a broadcasting mode.
4. The simulation remote live streaming data processing method suitable for the field of broadcasting and television as claimed in claim 3, wherein the master control workstation generates a virtual simulation image from the received remote live streaming through virtual reality AR simulation environment software, so as to perform cross-screen virtual reality AR synchronous display through the N LED large screens.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011101505.9A CN112261422A (en) | 2020-10-15 | 2020-10-15 | Simulation remote live broadcast stream data processing method suitable for broadcasting and television field |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011101505.9A CN112261422A (en) | 2020-10-15 | 2020-10-15 | Simulation remote live broadcast stream data processing method suitable for broadcasting and television field |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112261422A true CN112261422A (en) | 2021-01-22 |
Family
ID=74243173
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011101505.9A Pending CN112261422A (en) | 2020-10-15 | 2020-10-15 | Simulation remote live broadcast stream data processing method suitable for broadcasting and television field |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112261422A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114501054A (en) * | 2022-02-11 | 2022-05-13 | 腾讯科技（深圳）有限公司 | Live broadcast interaction method, device, equipment and computer readable storage medium |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101197647A (en) * | 2006-12-13 | 2008-06-11 | 四川川大智胜软件股份有限公司 | Multi-channel real-time three-dimensional vision rendering indication method |
| CN103049926A (en) * | 2012-12-24 | 2013-04-17 | 广东威创视讯科技股份有限公司 | Distributed three-dimensional rendering system |
| CN103491317A (en) * | 2013-09-06 | 2014-01-01 | 北京东方艾迪普科技发展有限公司 | Three-dimensional figure and image multi-screen synchronous broadcasting method, device and system |
| CN205334369U (en) * | 2015-09-22 | 2016-06-22 | 深圳数虎图像股份有限公司 | Stage performance system based on motion capture |
| CN107783306A (en) * | 2017-11-28 | 2018-03-09 | 河南新汉普影视技术有限公司 | A kind of bore hole 3D immersions exchange method and system based on simulated teaching Training Room |
| CN110267028A (en) * | 2019-06-24 | 2019-09-20 | 中冶智诚(武汉)工程技术有限公司 | A kind of signal synchronous display system for five face LED-CAVE |
| CN111698391A (en) * | 2020-06-24 | 2020-09-22 | 南京广播电视集团 | Method for controlling real-time change of light parameters through simulated environment light parameters |
-
2020
- 2020-10-15 CN CN202011101505.9A patent/CN112261422A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101197647A (en) * | 2006-12-13 | 2008-06-11 | 四川川大智胜软件股份有限公司 | Multi-channel real-time three-dimensional vision rendering indication method |
| CN103049926A (en) * | 2012-12-24 | 2013-04-17 | 广东威创视讯科技股份有限公司 | Distributed three-dimensional rendering system |
| CN103491317A (en) * | 2013-09-06 | 2014-01-01 | 北京东方艾迪普科技发展有限公司 | Three-dimensional figure and image multi-screen synchronous broadcasting method, device and system |
| CN205334369U (en) * | 2015-09-22 | 2016-06-22 | 深圳数虎图像股份有限公司 | Stage performance system based on motion capture |
| CN107783306A (en) * | 2017-11-28 | 2018-03-09 | 河南新汉普影视技术有限公司 | A kind of bore hole 3D immersions exchange method and system based on simulated teaching Training Room |
| CN110267028A (en) * | 2019-06-24 | 2019-09-20 | 中冶智诚(武汉)工程技术有限公司 | A kind of signal synchronous display system for five face LED-CAVE |
| CN111698391A (en) * | 2020-06-24 | 2020-09-22 | 南京广播电视集团 | Method for controlling real-time change of light parameters through simulated environment light parameters |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114501054A (en) * | 2022-02-11 | 2022-05-13 | 腾讯科技（深圳）有限公司 | Live broadcast interaction method, device, equipment and computer readable storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2021179783A1 (en) | Free viewpoint-based video live broadcast processing method, device, system, chip and medium | |
| CN110213601B (en) | Live broadcast system and live broadcast method based on cloud game and live broadcast interaction method | |
| CN108566558B (en) | Video stream processing method and device, computer equipment and storage medium | |
| CN106789991B (en) | Multi-person interactive network live broadcast method and system based on virtual scene | |
| CN111447461A (en) | Synchronous switching method, device, equipment and medium for multi-view live video | |
| WO2018045927A1 (en) | Three-dimensional virtual technology based internet real-time interactive live broadcasting method and device | |
| CN101917391B (en) | Method for playing network video and system for playing network video | |
| CN108495152B (en) | Video live broadcast method and device, electronic equipment and medium | |
| CN108900857B (en) | Multi-view video stream processing method and device | |
| US11863801B2 (en) | Method and device for generating live streaming video data and method and device for playing live streaming video | |
| KR100889367B1 (en) | System and Method for Realizing Vertual Studio via Network | |
| CN113115110B (en) | Video synthesis method and device, storage medium and electronic equipment | |
| WO2021114708A1 (en) | Method and apparatus for implementing multi-person video live-streaming service, and computer device | |
| CN111818004A (en) | Cloud game live broadcasting method, cloud game server and computer readable storage medium | |
| CN114095744B (en) | Video live broadcast method and device, electronic equipment and readable storage medium | |
| WO2024001661A1 (en) | Video synthesis method and apparatus, device, and storage medium | |
| CN111970524A (en) | Control method, device, system, equipment and medium for interactive live broadcast and microphone connection | |
| CN114079813A (en) | Picture synchronization method, coding method, video playing device and video coding device | |
| CN113630614A (en) | Game live broadcast method, device, system, electronic equipment and readable storage medium | |
| CN112019921A (en) | Body motion data processing method applied to virtual studio | |
| CN112261422A (en) | Simulation remote live broadcast stream data processing method suitable for broadcasting and television field | |
| CN107888890A (en) | It is a kind of based on the scene packing device synthesized online and method | |
| CN112019922A (en) | Facial expression data processing method applied to virtual studio | |
| CN110602523A (en) | VR panoramic live multimedia processing and synthesizing system and method | |
| CN113099281B (en) | Video interaction method and device, storage medium and terminal |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210122 |