CN112087642A - Cloud director playing method, cloud director server and remote management terminal - Google Patents
Cloud director playing method, cloud director server and remote management terminal Download PDFInfo
- Publication number
- CN112087642A CN112087642A CN202010927155.5A CN202010927155A CN112087642A CN 112087642 A CN112087642 A CN 112087642A CN 202010927155 A CN202010927155 A CN 202010927155A CN 112087642 A CN112087642 A CN 112087642A
- Authority
- CN
- China
- Prior art keywords
- video frame
- replacement
- replacing
- video
- cloud director
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/21—Server components or server architectures
- H04N21/218—Source of audio or video content, e.g. local disk arrays
- H04N21/2187—Live feed
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/231—Content storage operation, e.g. caching movies for short term storage, replicating data over plural servers, prioritizing data for deletion
- H04N21/23106—Content storage operation, e.g. caching movies for short term storage, replicating data over plural servers, prioritizing data for deletion involving caching operations
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
- H04N21/262—Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists
- H04N21/26208—Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists the scheduling operation being performed under constraints
- H04N21/26233—Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists the scheduling operation being performed under constraints involving content or additional data duration or size, e.g. length of a movie, size of an executable file
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/433—Content storage operation, e.g. storage operation in response to a pause request, caching operations
- H04N21/4331—Caching operations, e.g. of an advertisement for later insertion during playback
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
- H04N21/44016—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving splicing one content stream with another content stream, e.g. for substituting a video clip
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D30/00—Reducing energy consumption in communication networks
- Y02D30/70—Reducing energy consumption in communication networks in wireless communication networks
Abstract
The application discloses a cloud director playing method, a cloud director server and a remote management terminal, wherein the method comprises the following steps: receiving a video frame transmitted by a camera terminal, and storing the video frame with preset duration into a buffer queue; when a video frame replacing instruction sent by a remote management terminal is received, replacing the video frame in the cache queue according to a replacing position and replacing content in the video frame replacing instruction; and transmitting the replaced video frame to a playing terminal for playing. According to the method and the device, the production time for producing the video content by the cloud director can be prolonged, the possibility of errors of the broadcast video is reduced, and the watching experience of a user is improved.
Description
Technical Field
The application relates to the technical field of audio and video live broadcast, in particular to a cloud director playing method, a cloud director server and a remote management terminal.
Background
This section is intended to provide a background or context to the embodiments of the invention that are recited in the claims. The description herein is not admitted to be prior art by inclusion in this section.
With the rise of mobile internet and the popularization of mobile terminals, mobile internet video live broadcast becomes more and more convenient. The live video broadcast of the mobile internet has high real-time requirements, which requires that the production speed of the live video content is increased so that viewers can obtain live pictures with rich content.
In recent years, cloud-based broadcasting has been adopted to realize live video broadcasting, and the cloud-based broadcasting is used to produce live programs, and usually a plurality of cameras or mobile phones and other camera terminals are used to perform internet streaming, and then the live programs are processed and produced in the cloud-based broadcasting, such as machine position switching, logo overlapping, subtitle overlapping, scene processing, background music adding or picture adding. In order to meet the playing requirement of live video, the cloud director needs to process and manufacture video content within a short time and then transmit the video content to a viewer.
Disclosure of Invention
In a first aspect, an embodiment of the present application provides a cloud director playing method, configured to prolong a time for making a video content by a cloud director, reduce a possibility of an error occurring in a played video, and improve viewing experience of a user, where the method is applied to a cloud director server, and the cloud director server is connected to a camera terminal and a remote management terminal, respectively, where the method includes:
receiving a video frame transmitted by a camera terminal, and storing the video frame with preset duration into a buffer queue; when a video frame replacing instruction sent by a remote management terminal is received, replacing the video frame in the cache queue according to a replacing position and replacing content in the video frame replacing instruction; and transmitting the replaced video frame to a playing terminal for playing.
In a second aspect, an embodiment of the present application provides a cloud director playing method, so as to prolong a time for making a video content by a cloud director, reduce a possibility of an error occurring in a played video, and improve a viewing experience of a user, where the method is applied to a remote management terminal, and the remote management terminal is connected to a cloud director server, and the method includes:
receiving a video frame with preset duration stored in a cache queue sent by a cloud director server; providing video frame preview in a cache queue for a user, and receiving a video frame replacement position and replacement content input by the user; generating a video frame replacement instruction according to the replacement position and the replacement content; and sending the video frame replacement instruction to a cloud directing server, so that the cloud directing server replaces the video frames in the cache queue according to the replacement position and the replacement content in the video frame replacement instruction, and transmits the replaced video frames to a playing terminal for playing.
In a third aspect, an embodiment of the present application provides a cloud director server, configured to prolong a production time for producing video content by a cloud director, reduce a possibility of an error occurring in a broadcast video, and improve viewing experience of a user, where the cloud director server includes:
the server communication module is used for receiving the video frames transmitted by the camera terminal; the cache module is used for storing the video frames with preset duration received by the server communication module into a cache queue; the replacing module is used for replacing the video frames in the cache queue according to the replacing position and the replacing content in the video frame replacing instruction when the server communication module receives the video frame replacing instruction sent by the remote management terminal; and the server communication module is also used for transmitting the video frame replaced by the replacement module to the playing terminal for playing.
In a fourth aspect, an embodiment of the present application provides a remote management terminal, configured to prolong a production time for producing video content by a cloud director, reduce a possibility of an error occurring in a broadcast video, and improve a viewing experience of a user, where the remote management terminal includes:
the terminal communication module is used for receiving video frames with preset duration stored in a cache queue sent by the cloud director server; the terminal communication module is also used for receiving a video frame replacing position and replacing content input by a user; the instruction generating module is used for generating a video frame replacing instruction according to the replacing position and the replacing content received by the terminal communication module; the terminal communication module is further configured to send the video frame replacement instruction generated by the instruction generation module to the cloud director server, so that the cloud director server replaces the video frames in the cache queue according to the replacement position and the replacement content in the video frame replacement instruction, and transmits the replaced video frames to the play terminal for playing.
In a fifth aspect, an embodiment of the present application provides a cloud director playing system, configured to prolong a production time of producing video content by a cloud director, reduce a possibility of an error occurring in a broadcast video, and improve a viewing experience of a user, where the cloud director playing system includes the cloud director server according to the third aspect and the remote management terminal according to the fourth aspect.
In a sixth aspect, an embodiment of the present application provides a computer device, configured to prolong a production time of producing video content by a cloud director, reduce a possibility of errors occurring in a broadcast video, and improve a viewing experience of a user, where the computer device includes a memory, a processor, and a computer program stored in the memory and executable on the processor, and the processor implements the method according to any one of the first aspect and the second aspect when executing the computer program.
In a seventh aspect, an embodiment of the present application provides a computer-readable storage medium, configured to prolong a production time for producing video content by a cloud director, reduce a possibility of errors occurring in a broadcast video, and improve a viewing experience of a user, where the computer-readable storage medium stores a computer program for executing the method according to any one of the first aspect and the second aspect.
In the embodiment of the application, the cache queue is arranged in the cloud director server, the video frames with preset duration can be stored in the cache queue, and when the video frames are stored in the cache queue, the video frames can be modified or replaced, so that the time for making video content by the cloud director is prolonged, managers have sufficient time to modify the video frames with problems, the possibility of errors of the played video is reduced, and the watching experience of users is improved.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present application, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts. In the drawings:
fig. 1 is a flowchart of a cloud director playing method in an embodiment of the present application;
fig. 2 is a flowchart of another cloud director playing method in the embodiment of the present application;
fig. 3 is a schematic structural diagram of a cloud director player in an embodiment of the present application;
fig. 4 is a schematic structural diagram of a remote management terminal in an embodiment of the present application;
fig. 5 is a schematic structural diagram of a cloud director playing system in an embodiment of the present application.
Detailed Description
To make the objects, technical solutions and advantages of the embodiments of the present application more apparent, the embodiments of the present application are further described in detail below with reference to the accompanying drawings. The exemplary embodiments and descriptions of the present application are provided herein to explain the present application and not to limit the present application.
The embodiment of the application provides a cloud director playing method, which is applied to a cloud director server, wherein the cloud director server is respectively connected with a camera terminal and a remote management terminal, and as shown in fig. 1, the method comprises the following steps of 101 to 103:
The set time period can be set by a manager according to requirements, for example, the preset time period can be set to 30 minutes or 1 hour, and the like.
It should be noted that, after the buffer queue is full of video frames, the video frames are transmitted to the playing terminal. Illustratively, if the preset time duration is 30 minutes, the video frame is transmitted to the playing terminal from the 1 st frame video frame to be played after the video frame of the 1 st frame is stored in the buffer queue and the video frame of the 30 minutes is stored.
The in-out of the video frames in the buffer queue follows a first-in first-out principle, the coded video frames are stored in the buffer queue, after the video frames are fully stored in the buffer queue, after the video frames at the head of the queue in the current buffer queue are transmitted to the playing terminal to be played, the received video frames transmitted by the camera terminal are coded, and the coded video frames are stored at the tail of the queue in the buffer queue.
If the manager sets a preset live content processing rule for superimposing logo, subtitle and the like in the video frame, before the video frame is coded and stored at the tail of the buffer queue, the video frame is further processed and manufactured according to the preset live content processing rule, then the processed and manufactured video frame is coded and stored in the buffer queue after being coded.
And 102, when a video frame replacing instruction sent by the remote management terminal is received, replacing the video frame in the cache queue according to the replacing position and the replacing content in the video frame replacing instruction.
The alternative content comprises materials such as on-demand videos, live video streams or pictures. The replacement content may also be empty, and when the replacement content is empty, the video frame at the replacement position is deleted.
If the preset live content processing rule is set in the cloud broadcasting guide server, processing and manufacturing the replacement content according to the preset live content processing rule after the cloud broadcasting guide server receives the replacement content; and then coding the processed and manufactured replacement content, and replacing the video frame codes of the positions indicated by the replacement positions in the video frame replacement command with the codes of the processed and manufactured replacement content.
In order to solve the problem of accurately positioning video frames, in the embodiment of the present application, an H264/H265Nal unit for describing an ID of a video frame is added to each video frame, ID information of a self-added video frame is stored in the Nal unit, a cloud director server or a remote management terminal may read the Nal unit to obtain the ID of the video frame, determine a replacement position of the video frame by using the ID information on the video frame, and replace the video frame with the same ID in an original buffer queue by using the video frame with the same ID in replacement content. And, the addition of the Nal unit does not affect the decoding of the video frame by the play terminal.
It should be noted that, after the original video frame is replaced by the replacement content, the video frame ID of the replacement content is modified to the ID of the original video frame, so that if the manager is not satisfied with the replacement content to be replaced for the first time, a video frame replacement instruction can be generated according to the same video frame ID and the new replacement content and sent to the cloud director server for replacement, thereby facilitating the realization of multiple replacement of video frames.
And 103, transmitting the replaced video frame to a playing terminal for playing.
And the cloud directing server transmits the video frames to the playing terminal for playing according to the storage sequence of the video frames in the cache queue. Illustratively, if the 5 th frame of the 1 st to 30 th frame video frames counted from the head of the queue is replaced, the 1 st, 2 nd, 3 th and 4 th frame video frames are transmitted in sequence, and then the 5 th frame video frame is transmitted to the play terminal.
It should be noted that the buffer queue judges whether the playing time of the queue head is up or not according to the timestamp of the video frame, and sends the video frame at the queue head to the playing terminal for push-streaming playing; and the video frame sent by the camera terminal is placed at the tail of the queue.
In the embodiment of the application, the cache queue is arranged in the cloud director server, the video frames with preset duration can be stored in the cache queue, and when the video frames are stored in the cache queue, the video frames can be modified or replaced, so that the time for making video content by the cloud director is prolonged, managers have sufficient time to modify the video frames with problems, the possibility of errors of the played video is reduced, and the watching experience of users is improved.
An embodiment of the present application further provides a cloud director playing method, where the method is applied to a remote management terminal, and the remote management terminal is connected to a cloud director server, as shown in fig. 2, the method includes steps 201 to 204:
Moreover, when the video frame in the cloud director server changes, for example, the video frame at the head of the queue is transmitted to the playing terminal, or the tail of the queue is stored in a new video frame, the video frame is updated to the video frame in the remote management terminal in real time, so that the video frame in the remote management terminal is synchronized with the video frame cached in the cloud director server, and a user can monitor the latest cached video frame.
Specifically, the cloud director server encapsulates the video frames encoded in the cache queue into a flv format, and sends the encoded video frames to the remote management terminal for previewing by adopting a flv over http streaming protocol, and the remote management terminal can drag and view the video frames at any time point in the cache queue.
And step 203, generating a video frame replacement instruction according to the replacement position and the replacement content.
And 204, sending a video frame replacement instruction to the cloud directing server so that the cloud directing server replaces the video frames in the cache queue according to the replacement position and the replacement content in the video frame replacement instruction, and transmitting the replaced video frames to the playing terminal for playing.
In the embodiment of the application, the cache queue is arranged in the cloud director server, the video frames with preset duration can be stored in the cache queue, and when the video frames are stored in the cache queue, the video frames can be modified or replaced, so that the time for making video content by the cloud director is prolonged, managers have sufficient time to modify the video frames with problems, the possibility of errors of the played video is reduced, and the watching experience of users is improved.
In an embodiment of the present application, a cloud director server is provided, and as shown in fig. 3, the cloud director server 300 includes a server communication module 301, a caching module 302, and a replacement module 303.
The server communication module 301 is configured to receive a video frame transmitted by the camera terminal.
The buffer module 302 is configured to store the video frames received by the server communication module 301 into a buffer queue.
And a replacing module 303, configured to replace the video frame in the buffer queue according to a replacement position and replacement content in the video frame replacement instruction when the server communication module 301 receives the video frame replacement instruction sent by the remote management terminal.
The server communication module 301 is further configured to transmit the video frame replaced by the replacing module 303 to the playing terminal for playing.
In an implementation manner of the embodiment of the present application, the cache module 302 is configured to:
after the buffer queue is full of video frames, after the video frames at the head of the queue in the current buffer queue are transmitted to the playing terminal for playing, the received video frames transmitted by the camera terminal are encoded, and the encoded video frames are stored at the tail of the queue in the buffer queue.
In an implementation manner of the embodiment of the present application, the cloud director server 300 further includes: and the video processing module 304 is configured to process and manufacture the substitute content received by the server communication module 301 according to a preset live content processing rule.
A replacement module 303 for: and coding the processed and manufactured replacement content, and replacing the video frame codes of the positions indicated by the replacement positions in the video frame replacement command with the codes of the processed and manufactured replacement content.
In one implementation manner of the embodiment of the application, an H264/H265Nal unit is added in each video frame, the H264/H265Nal unit is used for describing the ID of the video frame, and the replacement position of the video frame is determined by using the ID information on the video frame.
In the embodiment of the application, the cache queue is arranged in the cloud director server, the video frames with preset duration can be stored in the cache queue, and when the video frames are stored in the cache queue, the video frames can be modified or replaced, so that the time for making video content by the cloud director is prolonged, managers have sufficient time to modify the video frames with problems, the possibility of errors of the played video is reduced, and the watching experience of users is improved.
As shown in fig. 4, the remote management terminal 400 includes a terminal communication module 401 and an instruction generation module 402.
The terminal communication module 401 is configured to receive a video frame in a buffer queue sent by the cloud director server.
The terminal communication module 401 is further configured to receive a video frame replacement position and replacement content input by a user.
An instruction generating module 402, configured to generate a video frame replacement instruction according to the replacement position and the replacement content received by the terminal communication module 401.
The terminal communication module 401 is further configured to send a video frame replacement instruction generated by the instruction generation module 402 to the cloud director server, so that the cloud director server replaces the video frame in the cache queue according to a replacement position and replacement content in the video frame replacement instruction, and transmits the replaced video frame to the play terminal for playing.
In the embodiment of the application, the cache queue is arranged in the cloud director server, the video frames with preset duration can be stored in the cache queue, and when the video frames are stored in the cache queue, the video frames can be modified or replaced, so that the time for making video content by the cloud director is prolonged, managers have sufficient time to modify the video frames with problems, the possibility of errors of the played video is reduced, and the watching experience of users is improved.
An embodiment of the present application further provides a cloud director playing system, and as shown in fig. 5, the cloud director playing system 500 includes a cloud director server 300 and a remote management terminal 400.
Wherein, the cloud director server can realize the following functions: the method comprises the following steps of managing an input source (comprising an on-demand source, a live broadcast source and the like), switching multiple machine positions of the input source, and supporting PVM/PGM; the method supports multi-picture synthesis, arbitrary editing scenes, picture splicing, video transition special effects and the like; multi-element superposition of subtitles, corner marks, logo, clocks and the like can be carried out; the interactive connection, the remote interactive connection of multiple machine positions and the like can be realized; and video pre-monitoring, emergency cut-off, scene switching under emergency and the like can be performed.
The remote management terminal is developed in a B/S page mode and is easy to deploy and maintain.
The embodiment of the present application further provides a computer device, which includes a memory, a processor, and a computer program stored in the memory and executable on the processor, and when the processor executes the computer program, any one of the methods described in the various implementation manners of step 101 to step 103, step 201 to step 204 is implemented.
The embodiment of the present application further provides a computer-readable storage medium, where a computer program for executing any one of the methods described in steps 101 to 103, 201 to 204, and various implementations thereof is stored in the computer-readable storage medium.
As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
The above-mentioned embodiments are further described in detail for the purpose of illustrating the invention, and it should be understood that the above-mentioned embodiments are only illustrative of the present invention and are not intended to limit the scope of the present invention, and any modifications, equivalent substitutions, improvements, etc. made within the spirit and principle of the present invention should be included in the scope of the present invention.
Claims (13)
1. A cloud director playing method is applied to a cloud director server, the cloud director server is respectively connected with a camera terminal and a remote management terminal, and the method comprises the following steps:
receiving a video frame transmitted by a camera terminal, and storing the video frame with preset duration into a buffer queue;
when a video frame replacing instruction sent by a remote management terminal is received, replacing the video frame in the cache queue according to a replacing position and replacing content in the video frame replacing instruction;
and transmitting the replaced video frame to a playing terminal for playing.
2. The method of claim 1, wherein storing the video frames in a buffer queue comprises:
after the buffer queue is full of video frames, after the video frames at the head of the queue in the current buffer queue are transmitted to the playing terminal for playing, the received video frames transmitted by the camera terminal are encoded, and the encoded video frames are stored at the tail of the queue in the buffer queue.
3. The method of claim 2,
before replacing the video frame in the buffer queue according to the replacement position and the replacement content in the video frame replacement instruction, the method further comprises the following steps: processing and manufacturing the replacement content according to a preset live content processing rule;
the replacing the video frame in the buffer queue according to the replacement position and the replacement content in the video frame replacement instruction comprises: and coding the processed and manufactured replacement content, and replacing the video frame codes of the positions indicated by the replacement positions in the video frame replacement instruction with the codes of the processed and manufactured replacement content.
4. The method of claim 1, wherein each video frame is added with an H264/H265Nal unit, the H264/H265Nal unit is used for describing an ID of the video frame, and the replacement position of the video frame is determined by using ID information on the video frame.
5. A cloud director playing method is applied to a remote management terminal, the remote management terminal is connected with a cloud director server, and the method comprises the following steps:
receiving a video frame with preset duration stored in a cache queue sent by a cloud director server;
providing video frame preview in a cache queue for a user, and receiving a video frame replacement position and replacement content input by the user;
generating a video frame replacement instruction according to the replacement position and the replacement content;
and sending the video frame replacement instruction to a cloud directing server, so that the cloud directing server replaces the video frames in the cache queue according to the replacement position and the replacement content in the video frame replacement instruction, and transmits the replaced video frames to a playing terminal for playing.
6. A cloud director server, comprising:
the server communication module is used for receiving the video frames transmitted by the camera terminal;
the cache module is used for storing the video frames with preset duration received by the server communication module into a cache queue;
the replacing module is used for replacing the video frames in the cache queue according to the replacing position and the replacing content in the video frame replacing instruction when the server communication module receives the video frame replacing instruction sent by the remote management terminal;
and the server communication module is also used for transmitting the video frame replaced by the replacement module to the playing terminal for playing.
7. The cloud director server of claim 6, wherein the caching module is configured to:
after the buffer queue is full of video frames, after the video frames at the head of the queue in the current buffer queue are transmitted to the playing terminal for playing, the received video frames transmitted by the camera terminal are encoded, and the encoded video frames are stored at the tail of the queue in the buffer queue.
8. The cloud director server of claim 6, wherein the cloud director server further comprises: the video processing module is used for processing and manufacturing the replacement content received by the server communication module according to a preset live content processing rule;
the replacing the video frame in the buffer queue according to the replacement position and the replacement content in the video frame replacement instruction comprises: and coding the processed and manufactured replacement content, and replacing the video frame codes of the positions indicated by the replacement positions in the video frame replacement instruction with the codes of the processed and manufactured replacement content.
9. The cloud director server according to claim 6, wherein an H264/H265Nal unit is added to each video frame, the H264/H265Nal unit is used for describing an ID of the video frame, and the replacement position of the video frame is determined by using ID information on the video frame.
10. A remote management terminal, comprising:
the terminal communication module is used for receiving video frames with preset duration stored in a cache queue sent by the cloud director server;
the terminal communication module is also used for receiving a video frame replacing position and replacing content input by a user;
the instruction generating module is used for generating a video frame replacing instruction according to the replacing position and the replacing content received by the terminal communication module;
the terminal communication module is further configured to send the video frame replacement instruction generated by the instruction generation module to the cloud director server, so that the cloud director server replaces the video frames in the cache queue according to the replacement position and the replacement content in the video frame replacement instruction, and transmits the replaced video frames to the play terminal for playing.
11. A cloud director playing system comprising the cloud director server according to any one of claims 6 to 9 and the remote management terminal according to claim 10.
12. A computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the processor implements the method of any one of claims 1 to 5 when executing the computer program.
13. A computer-readable storage medium, characterized in that the computer-readable storage medium stores a computer program for executing the method of any one of claims 1 to 5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010927155.5A CN112087642B (en) | 2020-09-07 | 2020-09-07 | Cloud guide playing method, cloud guide server and remote management terminal |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010927155.5A CN112087642B (en) | 2020-09-07 | 2020-09-07 | Cloud guide playing method, cloud guide server and remote management terminal |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112087642A true CN112087642A (en) | 2020-12-15 |
| CN112087642B CN112087642B (en) | 2023-04-28 |
Family
ID=73732867
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010927155.5A Active CN112087642B (en) | 2020-09-07 | 2020-09-07 | Cloud guide playing method, cloud guide server and remote management terminal |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112087642B (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112702624A (en) * | 2020-12-22 | 2021-04-23 | 山东鲁能软件技术有限公司 | Method, system, medium and device for optimizing short video playing efficiency |
| CN113784210A (en) * | 2021-09-03 | 2021-12-10 | 上海哔哩哔哩科技有限公司 | Pre-monitoring frequency playing method and cloud director service system |
| WO2022217416A1 (en) * | 2021-04-12 | 2022-10-20 | 苏州思萃人工智能研究所有限公司 | Mobile phone multi-camera switchable virtual camera |
Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20140032987A1 (en) * | 2012-07-29 | 2014-01-30 | Thadi M. Nagaraj | Replacing lost media data for network streaming |
| CN203761520U (en) * | 2013-11-20 | 2014-08-06 | 韩巍 | Multimedia video data processing device |
| CN104519310A (en) * | 2013-09-29 | 2015-04-15 | 深圳锐取信息技术股份有限公司 | Remote program director control system |
| CN104869466A (en) * | 2015-05-14 | 2015-08-26 | 无锡天脉聚源传媒科技有限公司 | Video playing control method and device |
| CN104954633A (en) * | 2014-03-28 | 2015-09-30 | 北京中投视讯文化传媒有限公司 | Live broadcasting instruction method, client and system |
| US20150358654A1 (en) * | 2013-02-18 | 2015-12-10 | Huawei Technologies Co., Ltd. | Method and Apparatus for Synchronizing Video Live Broadcast |
| CN105847862A (en) * | 2016-03-30 | 2016-08-10 | 乐视控股（北京）有限公司 | Cloud program directing station and cutoff continued broadcasting method thereof |
| WO2017060423A1 (en) * | 2015-10-08 | 2017-04-13 | Koninklijke Kpn N.V. | Enhancing a region of interest in video frames of a video stream |
| CN108289159A (en) * | 2017-05-25 | 2018-07-17 | 广州华多网络科技有限公司 | A kind of terminal live streaming special efficacy add-on system, method and terminal live broadcast system |
| CN109561318A (en) * | 2017-09-26 | 2019-04-02 | 阿里巴巴集团控股有限公司 | A kind of method and apparatus of video playing |
| US20190182494A1 (en) * | 2017-12-08 | 2019-06-13 | Hulu, LLC | Accelerated Re-Encoding Of Video For Video Delivery |
| CN111182322A (en) * | 2019-12-31 | 2020-05-19 | 北京达佳互联信息技术有限公司 | Director control method and device, electronic equipment and storage medium |
| CN111246126A (en) * | 2020-03-11 | 2020-06-05 | 广州虎牙科技有限公司 | Direct broadcasting switching method, system, device, equipment and medium based on live broadcasting platform |
-
2020
- 2020-09-07 CN CN202010927155.5A patent/CN112087642B/en active Active
Patent Citations (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20140032987A1 (en) * | 2012-07-29 | 2014-01-30 | Thadi M. Nagaraj | Replacing lost media data for network streaming |
| CN104509064A (en) * | 2012-07-29 | 2015-04-08 | 高通股份有限公司 | Replacing lost media data for network streaming |
| US20150358654A1 (en) * | 2013-02-18 | 2015-12-10 | Huawei Technologies Co., Ltd. | Method and Apparatus for Synchronizing Video Live Broadcast |
| CN104519310A (en) * | 2013-09-29 | 2015-04-15 | 深圳锐取信息技术股份有限公司 | Remote program director control system |
| CN203761520U (en) * | 2013-11-20 | 2014-08-06 | 韩巍 | Multimedia video data processing device |
| CN104954633A (en) * | 2014-03-28 | 2015-09-30 | 北京中投视讯文化传媒有限公司 | Live broadcasting instruction method, client and system |
| CN104869466A (en) * | 2015-05-14 | 2015-08-26 | 无锡天脉聚源传媒科技有限公司 | Video playing control method and device |
| WO2017060423A1 (en) * | 2015-10-08 | 2017-04-13 | Koninklijke Kpn N.V. | Enhancing a region of interest in video frames of a video stream |
| CN105847862A (en) * | 2016-03-30 | 2016-08-10 | 乐视控股（北京）有限公司 | Cloud program directing station and cutoff continued broadcasting method thereof |
| CN108289159A (en) * | 2017-05-25 | 2018-07-17 | 广州华多网络科技有限公司 | A kind of terminal live streaming special efficacy add-on system, method and terminal live broadcast system |
| CN109561318A (en) * | 2017-09-26 | 2019-04-02 | 阿里巴巴集团控股有限公司 | A kind of method and apparatus of video playing |
| US20190182494A1 (en) * | 2017-12-08 | 2019-06-13 | Hulu, LLC | Accelerated Re-Encoding Of Video For Video Delivery |
| CN111182322A (en) * | 2019-12-31 | 2020-05-19 | 北京达佳互联信息技术有限公司 | Director control method and device, electronic equipment and storage medium |
| CN111246126A (en) * | 2020-03-11 | 2020-06-05 | 广州虎牙科技有限公司 | Direct broadcasting switching method, system, device, equipment and medium based on live broadcasting platform |
Non-Patent Citations (5)
| Title |
|---|
| 何伟: "电视直播过程中延时技术的应用策略分析", 《西部广播电视》 * |
| 吕国钧: "《一起镇江》移动轻直播的云导播台功能设计", 《西部广播电视》 * |
| 程乐等: "电视直播延时系统应用", 《现代电视技术》 * |
| 蒋菲: "延时技术在电视直播中的应用", 《黑龙江科技信息》 * |
| 金鑫: "吴江电视台微信直播系统设计与实现", 《视听界(广播电视技术)》 * |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112702624A (en) * | 2020-12-22 | 2021-04-23 | 山东鲁能软件技术有限公司 | Method, system, medium and device for optimizing short video playing efficiency |
| WO2022217416A1 (en) * | 2021-04-12 | 2022-10-20 | 苏州思萃人工智能研究所有限公司 | Mobile phone multi-camera switchable virtual camera |
| CN113784210A (en) * | 2021-09-03 | 2021-12-10 | 上海哔哩哔哩科技有限公司 | Pre-monitoring frequency playing method and cloud director service system |
| CN113784210B (en) * | 2021-09-03 | 2023-09-22 | 上海哔哩哔哩科技有限公司 | Pre-monitoring frequency playing method and cloud broadcasting guide table service system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112087642B (en) | 2023-04-28 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10123070B2 (en) | Method and system for central utilization of remotely generated large media data streams despite network bandwidth limitations | |
| US11330311B2 (en) | Transmission device, transmission method, receiving device, and receiving method for rendering a multi-image-arrangement distribution service | |
| CN112087642B (en) | Cloud guide playing method, cloud guide server and remote management terminal | |
| US9591361B2 (en) | Streaming of multimedia data from multiple sources | |
| US20080124052A1 (en) | Systems and methods to modify playout or playback | |
| CN103190092A (en) | A system and method for synchronized playback of streaming digital content | |
| US20140237536A1 (en) | Method of displaying contents, method of synchronizing contents, and method and device for displaying broadcast contents | |
| US11128897B2 (en) | Method for initiating a transmission of a streaming content delivered to a client device and access point for implementing this method | |
| EP2442581B1 (en) | Video assets having associated graphical descriptor data | |
| CN111182322B (en) | Director control method and device, electronic equipment and storage medium | |
| US11412272B2 (en) | System and method for converting adaptive stream to downloadable media | |
| CN111447503A (en) | Viewpoint switching method, server and system for multi-viewpoint video | |
| CN114245153A (en) | Slicing method, device, equipment and readable storage medium | |
| US20240107087A1 (en) | Server, terminal and non-transitory computer-readable medium | |
| JPWO2018173876A1 (en) | Content processing apparatus, content processing method, and program | |
| US11856242B1 (en) | Synchronization of content during live video stream | |
| CN114666565B (en) | Multi-view video playing method, device and storage medium | |
| WO2023236732A1 (en) | Media information processing method and device, media information playback method and device, and storage medium | |
| WO2023273675A1 (en) | Method for processing video scene of free visual angle, and client and server | |
| JP2020129734A (en) | Content generation device, reception device, and program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |