CN111372094A - Cloud live broadcast control system applicable to various scenes - Google Patents
Cloud live broadcast control system applicable to various scenes Download PDFInfo
- Publication number
- CN111372094A CN111372094A CN202010313864.4A CN202010313864A CN111372094A CN 111372094 A CN111372094 A CN 111372094A CN 202010313864 A CN202010313864 A CN 202010313864A CN 111372094 A CN111372094 A CN 111372094A
- Authority
- CN
- China
- Prior art keywords
- live broadcast
- value
- terminal
- preset
- image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 230000005540 biological transmission Effects 0.000 claims abstract description 35
- 238000011217 control strategy Methods 0.000 claims abstract description 9
- 238000012217 deletion Methods 0.000 claims description 46
- 230000037430 deletion Effects 0.000 claims description 46
- 238000004422 calculation algorithm Methods 0.000 claims description 36
- 238000004364 calculation method Methods 0.000 claims description 19
- 238000012545 processing Methods 0.000 claims description 9
- 230000007797 corrosion Effects 0.000 claims description 7
- 238000005260 corrosion Methods 0.000 claims description 7
- 238000012163 sequencing technique Methods 0.000 claims description 3
- 238000005516 engineering process Methods 0.000 description 6
- 238000000034 method Methods 0.000 description 4
- 238000011161 development Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000007613 environmental effect Effects 0.000 description 1
- 230000003628 erosive effect Effects 0.000 description 1
- 238000007654 immersion Methods 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000004088 simulation Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/21—Server components or server architectures
- H04N21/218—Source of audio or video content, e.g. local disk arrays
- H04N21/2187—Live feed
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/21—Server components or server architectures
- H04N21/218—Source of audio or video content, e.g. local disk arrays
- H04N21/21805—Source of audio or video content, e.g. local disk arrays enabling multiple viewpoints, e.g. using a plurality of cameras
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
- H04N21/4307—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/433—Content storage operation, e.g. storage operation in response to a pause request, caching operations
- H04N21/4335—Housekeeping operations, e.g. prioritizing content for deletion because of storage space restrictions
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/81—Monomedia components thereof
- H04N21/816—Monomedia components thereof involving special video data, e.g 3D video
Abstract
The invention discloses a cloud live broadcast control system applicable to various scenes, which adopts the technical scheme that the system comprises a recording terminal, a cloud server and a field terminal, wherein the recording terminal and the field terminal are respectively provided with a plurality of terminals, the recording terminal comprises a live broadcast acquisition uploading module, the live broadcast acquisition uploading module acquires live broadcast contents of live broadcast users and transmits the live broadcast contents to the cloud server, and the live broadcast contents comprise VR videos. The cloud server comprises a cloud transmission module and a cloud storage module. The on-site terminal comprises a terminal transmission module, a terminal storage module and a plurality of playing modules, wherein the terminal transmission module is used for receiving live broadcast contents sent by the cloud server and sending the live broadcast contents to each playing module, the terminal storage module is used for storing the live broadcast contents received by the terminal transmission module, the playing module is used for playing the live broadcast contents, the playing module is displayed through a VR head, and the terminal storage module is provided with a storage space control strategy. The system can synchronously carry out VR live broadcast in various scenes.
Description
Technical Field
The invention relates to the field of live broadcasting, in particular to a cloud live broadcasting control system applicable to various scenes.
Background
In recent years, along with the development of economy, product publicity modes show diversified development, enterprises pay more and more attention to exhibition marketing, and exhibitions in various industries are held more and more frequently.
In the exhibition, the enterprises and the products are generally publicized by playing publicity videos and the like, and in some exhibitions, live broadcast is arranged to improve publicity. However, there are usually multiple exhibition halls in an exhibition, and if live broadcast is to be realized in multiple exhibition halls synchronously, live broadcast personnel needs to be arranged additionally.
In recent years, virtual reality technology (VR) has rapidly developed. The virtual reality technology comprises a computer, electronic information and simulation technology, and the basic realization mode is that the computer simulates a virtual environment so as to provide people with environmental immersion. The virtual reality technology can provide users with real field experience. If carry out the product propaganda in a plurality of exhibitions or a plurality of exhibition halls in step through virtual reality technique, improvement publicity effect with very big. However, live broadcasting through the virtual reality technology will generate a larger data volume compared with the traditional live broadcasting method, and the requirement on the storage space of the playing terminal is higher, which results in that the playing terminal needs to provide a larger storage space for storing live broadcasting content.
Disclosure of Invention
Aiming at the defects in the prior art, the invention aims to provide a cloud live broadcast control system applicable to various scenes, the system can synchronously carry out VR live broadcast in various scenes, and a playing terminal can automatically compress stored resources.
In order to achieve the purpose, the invention provides the following technical scheme: a cloud live broadcast control system applicable to various scenes comprises a recording terminal, a plurality of cloud servers and field terminals, wherein the recording terminals and the field terminals are respectively provided with the plurality of cloud servers;
the recording terminal comprises a live broadcast acquisition and uploading module, the live broadcast acquisition and uploading module acquires live broadcast contents of a live broadcast user and sends the live broadcast contents to the cloud server, and the live broadcast contents comprise VR videos;
the cloud server comprises a cloud transmission module and a cloud storage module, the cloud transmission module is connected with the cloud storage module, the cloud transmission module is used for receiving live broadcast contents and sending the live broadcast contents to each field terminal, and the cloud storage module is used for storing the live broadcast contents received by the cloud transmission module;
the on-site terminal comprises a terminal transmission module, a terminal storage module and a plurality of playing modules, wherein the terminal transmission module and the terminal storage module are respectively connected with each playing module, the terminal transmission module is used for receiving live broadcast contents sent by the cloud server and sending the live broadcast contents to each playing module, the terminal storage module is used for storing the live broadcast contents received by the terminal transmission module, the playing modules are used for playing the live broadcast contents, and each playing module comprises a VR (virtual reality) head display;
the terminal storage module is configured with a storage space control strategy, and the storage space control strategy comprises a storage ratio calculation step, a deletion amount determination step, a live broadcast content demand calculation step and a deletion step;
the storage proportion calculation step comprises the steps of acquiring the maximum storage quantity of the terminal storage module, the existing storage quantity of the terminal storage module and the playing information of each live content at intervals of a preset calling interval, wherein the playing information comprises the playing times and the corresponding playing time of each live content, calculating the ratio of the existing storage quantity to the maximum storage quantity to obtain a storage proportion value, and entering a deletion quantity determination step;
the deletion amount determining step comprises the steps of comparing a storage proportion value with a preset critical proportion value, and stopping the deletion amount determining step when the storage proportion value is smaller than the critical proportion value; when the storage proportion value is larger than or equal to the critical proportion value, calculating by a preset deletion amount determination algorithm to obtain a theoretical deletion amount, wherein the theoretical deletion amount is the storage amount needing to be deleted theoretically, and entering a live content demand calculation step;
the live broadcast content demand calculation step comprises the steps of calculating all live broadcast contents stored before a preset safety interval time through a preset demand algorithm to obtain the demand value of each live broadcast content, and entering a deletion step:
the deleting step comprises the steps of sequencing all live contents stored before the preset safe interval time according to the required value, and deleting the live contents from the live contents with the lowest required value until the actual deletion amount is larger than or equal to the theoretical deletion amount, wherein the actual deletion amount is the size of the actually deleted storage amount.
As a further improvement of the present invention, the system is further configured with an image processing policy, the image processing policy includes an initial region acquisition sub-policy and a result image acquisition sub-policy, the initial region acquisition sub-policy configures an image registration algorithm, the image registration algorithm compares a previous frame image and a current frame image to obtain an initial background region and an initial target region, and an initial background image is obtained from the current frame image according to the initial background region;
the result graph obtaining sub-strategy comprises a basic target graph obtaining step, a difference value determining step, a comparing step and a splicing step, wherein the basic target graph obtaining step comprises the following steps: obtaining an undetermined target image from the next frame image according to the obtained target region, obtaining a basic target image of the current frame image, and entering the difference determining step, wherein the difference determining step comprises the following steps: comparing the difference between the undetermined target graph and the basic target graph and entering the comparing step, wherein the comparing step comprises the following steps: when the difference is larger than a first preset value, enlarging the target map area through a preset first corrosion value to obtain a new target map area and a background map area, entering the basic target map obtaining step according to the obtained new target map area, and when the difference is smaller than the first preset value, taking the undetermined target map as a result target map and entering the splicing step, wherein the splicing step comprises the following steps: and obtaining a new background image from the background image of the current frame according to the background image area as a result background image, and splicing the result background image and the result target image through a splicing algorithm to output as a result image frame.
As a further improvement of the present invention, the step of obtaining the basic target map further includes generating a preloaded map area in advance, where the preloaded map area has a second area difference with the initial target map area, and downloading the preloaded map area of the next frame of image from the field in advance to serve as the target for obtaining the undetermined target map in the step of obtaining the basic target map.
As a further improvement of the present invention, the comparing step further includes, before taking the undetermined target map as the result target map and entering the stitching step, comparing the difference value with a second preset value, when the difference value is smaller than the second preset value, narrowing the target map area by a preset second erosion value to obtain a new target map area and a background map area, and entering the basic target map obtaining step according to the obtained new target map area, and when the difference value is larger than the second preset value, taking the undetermined target map as the result target map and entering the stitching step.
As a further refinement of the present invention, the deletion amount determination algorithm is configured to:
N＝(U-Y)×G
wherein: n is theoretical deletion amount; u is a storage proportion value; y is a preset safety proportion value, and the safety proportion value is smaller than a critical proportion value; g is the maximum storage capacity of the terminal storage module.
As a further improvement of the present invention, the desirability algorithm is configured to:
P＝A×K+B×L+C×H+D×Z
wherein: p is a required value, K is the playing frequency of the live broadcast content in a preset first time period, and the first time period is a plurality of days before the safety interval time; a is a preset first weight value; l is the playing frequency of the live broadcast content in a preset second time period, and the second time period is a plurality of days before the first time period; b is a preset second weight value; h is the playing frequency of the live broadcast content in a preset third time period, wherein the third time period is a plurality of days before the second time period; c is a preset third weight value; z is the playing frequency of the live content in a preset fourth time period, and the fourth time period is the total time before the third time period; d is a preset fourth weight value; and K, L, H, Z is obtained by the playing information obtained by the terminal storage module through statistics.
As a further improvement of the present invention, the terminal storage module is further configured with a weight lookup table, the weight lookup table stores a plurality of preset play time intervals, and the first weight value, the second weight value, the third weight value and the fourth weight value corresponding to each play time interval, the live content demand calculation step further includes calling the corresponding first weight value, the second weight value, the third weight value and the fourth weight value in the weight lookup table according to the play times of the live content in a preset query time, so as to substitute the demand algorithm to calculate the demand value of the play content, where the query time is several days before the safety interval time.
As a further improvement of the present invention, the query time is calculated by a preset query time algorithm according to the first time period, the second time period and the third time period.
As a further improvement of the present invention, the safety ratio value is calculated by a preset safety ratio algorithm according to the critical ratio value.
As a further improvement of the present invention, the cloud server communicates with each recording terminal and each field terminal through 5G.
The invention has the beneficial effects that:
1. through recording terminal, cloud server and on-the-spot terminal's setting, live personnel's accessible arbitrary one records the terminal and sends live contents such as VR video to the cloud server, the cloud server sends live contents to each on-the-spot terminal, make each on-the-spot terminal can carry out the live broadcast in real time, user's accessible VR head shows and watches live contents, consequently this system can carry out VR live broadcast in step in multiple scene, apply to this system on the exhibition, the effect of publicity of improvement product that can be very big.
2. Through the storage space control strategy, the terminal storage module can automatically delete part of live broadcast contents with low user demand at intervals, so that the live broadcast contents are automatically compressed, and part of the free space in the storage space is used for receiving new live broadcast contents. By self-management of the terminal storage module, the high-capacity requirement on the storage space during live broadcasting through the virtual reality technology is made up and reduced.
Drawings
FIG. 1 is a schematic diagram of the system of the present invention;
FIG. 2 is a flow chart of a storage space control strategy;
FIG. 3 is a flow chart of an image processing strategy.
Reference numerals: 1. a recording terminal; 11. a live broadcast acquisition uploading module; 2. a cloud server; 21. a cloud transmission module; 22. a cloud storage module; 3. a field terminal; 31. a terminal transmission module; 32. a terminal storage module; 33. and a playing module.
Detailed Description
The present invention will be described in further detail with reference to the accompanying drawings and examples. In which like parts are designated by like reference numerals. It should be noted that the terms "front," "back," "left," "right," "upper" and "lower" used in the following description refer to directions in the drawings, and the terms "bottom" and "top," "inner" and "outer" refer to directions toward and away from, respectively, the geometric center of a particular component.
Referring to fig. 1 and fig. 2, the cloud live broadcast control system applicable to various scenes of this embodiment includes recording terminal 1, cloud server 2 and field terminal 3, recording terminal 1 and field terminal 3 all are provided with a plurality of, cloud server 2 is connected with recording terminal 1 and field terminal 3, cloud server 2 and each record terminal 1 and each field terminal 3 between all communicate through 5G, thereby promote communication efficiency, promote VR live broadcast's smoothness.
The recording terminal 1 comprises a live broadcast acquisition and uploading module 11, the live broadcast acquisition and uploading module 11 acquires live broadcast contents of live broadcast users and sends the live broadcast contents to the cloud server 2, the live broadcast contents comprise VR videos, and the live broadcast contents can also be ordinary video contents.
The cloud server 2 comprises a cloud transmission module 21 and a cloud storage module 22, the cloud transmission module 21 is connected with the cloud storage module 22, the cloud transmission module 21 is used for receiving live broadcast contents and sending the live broadcast contents to each field terminal 3, and the cloud storage module 22 is used for storing the live broadcast contents received by the cloud transmission module 21.
The on-site terminal 3 is including terminal transmission module 31, terminal storage module 32 and a plurality of play module 33, terminal transmission module 31, terminal storage module 32 is connected with each play module 33 respectively, terminal transmission module 31 is used for receiving the live broadcast content that cloud server 2 sent and sends to each play module 33, terminal storage module 32 is used for storing the live broadcast content that terminal transmission module 31 received, play module 33 is used for playing the live broadcast content, play module 33 is including the first demonstration of VR, the user can wear the first demonstration of VR to watch the VR video, play module 33 also can be ordinary display screen, ordinary display screen is used for playing ordinary video. Each exhibition hall can be provided with one field terminal 3, and each field terminal 3 is connected with a plurality of VR head displays and display screens.
For example, when a live broadcast user performs live VR live broadcast through the recording terminal 1 in any place suitable for live broadcast, the live broadcast acquisition uploading module 11 acquires live broadcast behavior of the live broadcast user and forms a VR video to be sent to the cloud server 2, the cloud transmission module 21 receives the VR video and sends the VR video to each live terminal 3, and the cloud storage module 22 stores the VR video. After each terminal transmission module 31 receives the VR video, the terminal storage module 32 stores the VR video. The viewing user can view the VR video by wearing the VR headset.
The on-site terminal 3 is configured with a live broadcast content calling strategy, the live broadcast content calling strategy comprises receiving a calling instruction of a user and generating calling information according to the calling instruction, the calling information comprises live broadcast content to be watched by the user, and the on-site terminal 3 calls the corresponding live broadcast content in the terminal storage module 32 according to the calling information to play; when the terminal storage module 32 does not have corresponding live broadcast content, the terminal transmission module 31 sends the calling information to the cloud server 2, the cloud server 2 calls the corresponding live broadcast content from the cloud storage module 22 according to the calling information and sends the live broadcast content to the field terminal 3, and the playing module 33 plays the live broadcast content.
For example, when the user selects to play a VR video that has been live previously through a button on the VR head display, the calling information of the VR video is generated in the field terminal 3, and the VR video is first called from the terminal storage module 32, and when the VR video exists in the terminal storage module 32, the VR video is directly played through the VR head display. When the VR video does not exist in the terminal storage module 32, the calling information is sent to the cloud server 2 through the terminal transmission module 31, the cloud server 2 calls the VR video from the cloud storage module 22 according to the calling information and sends the VR video to the field terminal 3, and the field terminal 3 plays the VR video through a VR head display.
The terminal storage module 32 is configured with a storage space control strategy, and the storage space control strategy comprises a storage ratio calculation step, a deletion amount determination step, a live content demand calculation step and a deletion step;
the storage proportion calculation step comprises the steps of acquiring the maximum storage capacity of the terminal storage module 32, the existing storage capacity of the terminal storage module 32 and the playing information of each live content at intervals of a preset calling interval, wherein the playing information comprises the playing times and the corresponding playing time of each live content, calculating the ratio of the existing storage capacity to the maximum storage capacity to obtain a storage proportion value, and entering a deletion quantity determination step;
the deletion amount determining step comprises the steps of comparing the storage proportion value with a preset critical proportion value, and stopping the deletion amount determining step when the storage proportion value is smaller than the critical proportion value; when the storage proportion value is larger than or equal to the critical proportion value, calculating by a preset deletion amount determining algorithm to obtain a theoretical deletion amount, wherein the theoretical deletion amount is the storage amount needing to be deleted theoretically, and entering a live content demand calculation step;
the deletion amount determination algorithm is configured to:
N＝(U-Y)×G
wherein: n is theoretical deletion amount; u is a storage proportion value; y is a preset safety proportion value, and the safety proportion value is smaller than a critical proportion value; g is the maximum storage capacity of the terminal storage module 32.
And the safety proportion value is calculated by a preset safety proportion algorithm according to the critical proportion value. The safety ratio algorithm is calculated and configured as follows:
Y＝a×P
wherein: y is a safe ratio value; a is a preset safety weight value, and a is less than 1; p is the critical ratio.
For example, when the maximum storage amount is 10T and the existing storage amount is 9.5T, the storage ratio value is 0.95. When the preset critical proportion value is 0.9 and the safety weight value is 0.5, the safety proportion value is 0.45T through calculation of a safety proportion algorithm. And when the storage proportion value is 0.95, the storage proportion value is larger than the critical proportion value and is calculated by a deletion amount determination algorithm, and the theoretical deletion amount is 5T.
The live broadcast content demand calculation step comprises the steps of calculating all live broadcast contents stored before a preset safety interval time through a preset demand algorithm to obtain the demand value of each live broadcast content, and entering a deletion step:
the desirability algorithm is configured to:
P＝A×K+B×L+C×H+D×Z
wherein: p is a required value, K is the playing frequency of the live broadcast content in a preset first time period, and the first time period is a plurality of days before the safety interval time; a is a preset first weight value; l is the playing frequency of the live broadcast content in a preset second time period, and the second time period is a plurality of days before the first time period; b is a preset second weight value; h is the playing frequency of the live broadcast content in a preset third time period, and the third time period is a plurality of days before the second time period; c is a preset third weight value; z is the playing frequency of the live broadcast content in a preset fourth time period, and the fourth time period is the total time before the third time period; d is a preset fourth weight value; K. l, H, Z are obtained by the terminal storage module 32 through statistics of the acquired playing information.
The terminal storage module 32 is further configured with a weight lookup table, the weight lookup table stores a plurality of preset play time intervals, and a first weight value, a second weight value, a third weight value and a fourth weight value corresponding to each play time interval, the live content demand calculation step further includes calling the corresponding first weight value, second weight value, third weight value and fourth weight value in the weight lookup table according to the play times of the live content in the preset query time, so as to calculate the demand value of the play content by substituting the demand algorithm, and the query time is several days before the safety interval time.
And the query time is calculated according to the first time period, the second time period and the third time period by a preset query time algorithm.
The query time algorithm is configured to:
T＝z×(t1+t2+t3)
wherein: t is the time length of the query time; z is a preset query weight value, and z is smaller than 1; t1 is the length of time of the first period of time; t2 is the length of time of the second time period; t3 is the time length of the third period.
For example, a safety interval time of 3 days is taken, the first time period is a time period from 3 days to 13 days ago, the second time period is a time period from 13 days to 33 days ago, the third time period is a time period from 33 days to 63 days ago, and the fourth time period is a time period from 63 days ago.
And taking the preset query weight value as 0.3, and calculating by a query time algorithm to obtain the time length of the query time as 18 days, namely the time period from 3 days to 21 days before the query time.
For example, the number of times of playing a certain VR video within the query time is 30, and the first weight value, the second weight value, the third weight value, and the fourth weight value in the weight lookup table corresponding to the number of times of playing are 8, 4, 2, and 1, respectively. And when the playing times of the VR video in the first time period, the second time period, the third time period and the fourth time period are 20, 30 and 20 respectively, the required value of the VR video is 360 calculated by a demand algorithm.
The deleting step comprises the steps of sequencing all live contents stored before the preset safe interval time according to the required value, and deleting the live contents from the live contents with the lowest required value until the actual deletion amount is larger than or equal to the theoretical deletion amount, wherein the actual deletion amount is the size of the actually deleted storage amount.
For example, the live contents are sorted according to the demand value, and deleted from the live content with the lowest demand value until the actual deletion amount reaches the theoretical deletion amount of 5T.
The system is also provided with a parameter adjusting strategy, wherein the parameter adjusting strategy comprises receiving the new input of the invoking interval time, the critical proportion value, the safety interval time, the first time period, the second time period, the third time period and the fourth time period from the user, and replacing the original corresponding parameters with the new invoking interval time, the critical proportion value, the safety interval time, the first time period, the second time period, the third time period and the fourth time period.
The user can input a new calling interval time, a critical proportion value, a safety interval time, a first time period, a second time period, a third time period and a fourth time period through interactive equipment (a keyboard, a button, voice input and the like) on the field terminal 3, and the field terminal 3 can replace the original parameters with the corresponding parameters newly input by the user through a parameter adjusting strategy, so that the user can adjust each parameter according to the actual situation.
The system is also provided with an image processing strategy, the image processing strategy comprises an initial image area acquisition sub-strategy and a result image acquisition sub-strategy, the initial image area acquisition sub-strategy is provided with an image superposition algorithm, the image superposition algorithm compares the previous frame image with the current frame image to obtain an initial background image area and an initial target image area, and the initial background image is obtained from the current frame image according to the initial background image area.
The result graph acquiring sub-strategy comprises a basic target graph acquiring step, a difference determining step, a comparing step and a splicing step, wherein the basic target graph acquiring step acquires a pending target graph from a next frame of image according to an acquired target graph area and acquires a basic target graph of a current frame of image, the difference determining step compares the difference between the pending target graph and the basic target graph, the comparing step enlarges the target graph area through a preset first corrosion value to acquire a new target graph area and a background graph area when the difference is larger than a first preset value and enters the basic target graph acquiring step according to the acquired new target graph area, the comparing step compares the difference with a second preset value when the difference is smaller than the first preset value, the target graph area is reduced through a preset second corrosion value to acquire the new target graph area and the background graph area when the difference is smaller than the second preset value and enters the basic graph acquiring step according to the acquired new target graph area, when the difference is larger than a second preset value, taking the undetermined target graph as a result target graph and entering a splicing step; and a splicing step, acquiring a new background image from the background image of the current frame according to the background image area as a result background image, and splicing the result background image and the result target image through a splicing algorithm to output as a result image frame.
For example, when VR is broadcast, the broadcast video is transmitted frame by frame, the first frame image and the second frame image are compared according to the initial region acquisition sub-policy, the same portion is set as the initial background region, and the different portion is set as the initial target region.
The method comprises the steps of starting from inputting a third frame, processing each frame through a result graph obtaining sub-strategy, obtaining a sub-strategy according to a result graph, obtaining a pending target graph from a next frame image according to a target graph area and obtaining a basic target graph from a current frame image, comparing a specific target graph with the basic target graph to obtain a difference value, comparing the difference value with a first preset value, if the difference value is larger than the first preset value, enlarging the target graph area through a first corrosion value to obtain a new target graph area and a new background graph area, and obtaining the sub-strategy again according to the new target graph area and the new background graph area. If the difference value is smaller than the first preset value, the difference value is compared with a second preset value, when the difference value is smaller than the second preset value, the target image area is reduced through a preset second corrosion value to obtain a new target image area and a new background image area, and the result image obtaining sub-strategy is carried out again according to the new target image area and the new background image area. And if the difference is larger than a second preset value, taking the undetermined target image as a result target image, obtaining a new background image from the background image of the current frame according to the background image area to be taken as a result background image, and splicing the result background image and the result target image to be taken as a result image frame for output.
And the basic target image acquisition step also comprises the step of generating a pre-loading map area in advance, wherein the pre-loading map area and the initial target map area have a second area difference, and the pre-loading map area of the next frame of image is downloaded from the site in advance to be used as a target for acquiring the undetermined target image in the basic target image acquisition step. The difference determination step compares the comparison difference of the edge region of the target region. And deleting intermediate data generated by the previous result graph acquisition sub-strategy before executing the result graph acquisition sub-strategy. And deleting the intermediate data generated in the previous step when the next step is executed. When a new result background map is generated, the previous result background map is deleted.
Through the image processing strategy, the background image data and the target image data are required to be transmitted simultaneously when live broadcasting starts, only the target image data is required to be transmitted subsequently, and the result background image is corrected through the target image, so that the data volume transmitted in the VR live broadcasting process is mainly changed result target image data, and the data transmission volume during VR live broadcasting can be reduced.
The above is only a preferred embodiment of the present invention, and the protection scope of the present invention is not limited to the above-mentioned embodiments, and all technical solutions belonging to the idea of the present invention belong to the protection scope of the present invention. It should be noted that modifications and embellishments within the scope of the invention may occur to those skilled in the art without departing from the principle of the invention, and are considered to be within the scope of the invention.
Claims (10)
1. The utility model provides a cloud live control system applicable in multiple scene, is including recording terminal (1), cloud server (2) and on-the-spot terminal (3), record terminal (1) with on-the-spot terminal (3) all are provided with a plurality of, cloud server (2) with record terminal (1) and on-the-spot terminal (3) are connected, its characterized in that:
the recording terminal (1) comprises a live broadcast acquisition and uploading module (11), the live broadcast acquisition and uploading module (11) acquires live broadcast contents of a live broadcast user and transmits the live broadcast contents to the cloud server (2), and the live broadcast contents comprise VR videos;
the cloud server (2) comprises a cloud transmission module (21) and a cloud storage module (22), the cloud transmission module (21) is connected with the cloud storage module (22), the cloud transmission module (21) is used for receiving live broadcast contents and sending the live broadcast contents to each field terminal (3), and the cloud storage module (22) is used for storing the live broadcast contents received by the cloud transmission module (21);
the on-site terminal (3) comprises a terminal transmission module (31), a terminal storage module (32) and a plurality of playing modules (33), wherein the terminal transmission module (31) and the terminal storage module (32) are respectively connected with the playing modules (33), the terminal transmission module (31) is used for receiving live broadcast contents sent by the cloud server (2) and sending the live broadcast contents to the playing modules (33), the terminal storage module (32) is used for storing the live broadcast contents received by the terminal transmission module (31), the playing modules (33) are used for playing the live broadcast contents, and the playing modules (33) comprise VR head displays;
the terminal storage module (32) is configured with a storage space control strategy, and the storage space control strategy comprises a storage ratio calculation step, a deletion amount determination step, a live broadcast content demand calculation step and a deletion step;
the storage proportion calculation step comprises the steps of acquiring the maximum storage capacity of the terminal storage module (32), the existing storage capacity of the terminal storage module (32) and the playing information of each live content at intervals of a preset calling interval, wherein the playing information comprises the playing times and the corresponding playing time of each live content, calculating the ratio of the existing storage capacity to the maximum storage capacity to obtain a storage proportion value, and entering a deletion amount determination step;
the deletion amount determining step comprises the steps of comparing a storage proportion value with a preset critical proportion value, and stopping the deletion amount determining step when the storage proportion value is smaller than the critical proportion value; when the storage proportion value is larger than or equal to the critical proportion value, calculating by a preset deletion amount determination algorithm to obtain a theoretical deletion amount, wherein the theoretical deletion amount is the storage amount needing to be deleted theoretically, and entering a live content demand calculation step;
the live broadcast content demand calculation step comprises the steps of calculating all live broadcast contents stored before a preset safety interval time through a preset demand algorithm to obtain the demand value of each live broadcast content, and entering a deletion step:
the deleting step comprises the steps of sequencing all live contents stored before the preset safe interval time according to the required value, and deleting the live contents from the live contents with the lowest required value until the actual deletion amount is larger than or equal to the theoretical deletion amount, wherein the actual deletion amount is the size of the actually deleted storage amount.
2. The system according to claim 1, wherein the system is applicable to a plurality of scenes, and comprises: the system is also provided with an image processing strategy, wherein the image processing strategy comprises an initial image area acquisition sub-strategy and a result image acquisition sub-strategy, the initial image area acquisition sub-strategy is provided with an image superposition algorithm, the image superposition algorithm compares a previous frame image with a current frame image to obtain an initial background image area and an initial target image area, and an initial background image is obtained from the current frame image according to the initial background image area;
the result graph obtaining sub-strategy comprises a basic target graph obtaining step, a difference value determining step, a comparing step and a splicing step, wherein the basic target graph obtaining step comprises the following steps: obtaining an undetermined target image from the next frame image according to the obtained target region, obtaining a basic target image of the current frame image, and entering the difference determining step, wherein the difference determining step comprises the following steps: comparing the difference between the undetermined target graph and the basic target graph and entering the comparing step, wherein the comparing step comprises the following steps: when the difference is larger than a first preset value, enlarging the target map area through a preset first corrosion value to obtain a new target map area and a background map area, entering the basic target map obtaining step according to the obtained new target map area, and when the difference is smaller than the first preset value, taking the undetermined target map as a result target map and entering the splicing step, wherein the splicing step comprises the following steps: and obtaining a new background image from the background image of the current frame according to the background image area as a result background image, and splicing the result background image and the result target image through a splicing algorithm to output as a result image frame.
3. The system according to claim 2, wherein the system is applicable to a plurality of scenes, and comprises: and the basic target image acquisition step also comprises the steps of generating a pre-loading map area in advance, wherein the pre-loading map area and the initial target map area have a second area difference value, and downloading the pre-loading map area of the next frame of image from the site in advance to be used as a target for acquiring the undetermined target image in the basic target image acquisition step.
4. The system according to claim 2, wherein the system is applicable to a plurality of scenes, and comprises: and the comparison step also comprises the steps of comparing the difference value with a second preset value before the undetermined target graph is taken as a result target graph and enters the splicing step, reducing the target graph area through a preset second corrosion value when the difference value is smaller than the second preset value to obtain a new target graph area and a background graph area, entering the basic target graph obtaining step according to the obtained new target graph area, and taking the undetermined target graph as a result target graph and entering the splicing step when the difference value is larger than the second preset value.
5. The system according to claim 1, wherein the system is applicable to a plurality of scenes, and comprises: the deletion amount determination algorithm is configured to:
N＝(U-Y)×G
wherein: n is theoretical deletion amount; u is a storage proportion value; y is a preset safety proportion value, and the safety proportion value is smaller than a critical proportion value; g is the maximum storage capacity of the terminal storage module (32).
6. The system according to claim 1, wherein the system is applicable to a plurality of scenes, and comprises: the desirability algorithm is configured to:
P＝A×K+B×L+C×H+D×Z
wherein: p is a required value, K is the playing frequency of the live broadcast content in a preset first time period, and the first time period is a plurality of days before the safety interval time; a is a preset first weight value; l is the playing frequency of the live broadcast content in a preset second time period, and the second time period is a plurality of days before the first time period; b is a preset second weight value; h is the playing frequency of the live broadcast content in a preset third time period, wherein the third time period is a plurality of days before the second time period; c is a preset third weight value; z is the playing frequency of the live content in a preset fourth time period, and the fourth time period is the total time before the third time period; d is a preset fourth weight value; the K, L, H, Z is obtained by the playing information obtained by statistics of the terminal storage module (32).
7. The system according to claim 6, wherein the system is applicable to a plurality of scenes, and comprises: the terminal storage module (32) is further configured with a weight lookup table, the weight lookup table stores a plurality of preset play time intervals, and the first weight value, the second weight value, the third weight value and the fourth weight value corresponding to each play time interval, the live content demand calculation step further includes calling the corresponding first weight value, the second weight value, the third weight value and the fourth weight value in the weight lookup table according to the play times of the live content in preset query time to substitute the demand algorithm to calculate the demand value of the play content, and the query time is several days before the safety interval time.
8. The system according to claim 7, wherein the system is applicable to a plurality of scenes, and comprises: and the query time is calculated according to the first time period, the second time period and the third time period by a preset query time algorithm.
9. The system according to claim 5, wherein the system is applicable to a plurality of scenes, and comprises: and the safety proportion value is calculated by a preset safety proportion algorithm according to the critical proportion value.
10. The system according to claim 1, wherein the system is applicable to a plurality of scenes, and comprises: the cloud server (2) is communicated with the recording terminals (1) and the field terminals (3) through 5G.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010313864.4A CN111372094B (en) | 2020-04-20 | 2020-04-20 | Cloud live broadcast control system applicable to various scenes |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010313864.4A CN111372094B (en) | 2020-04-20 | 2020-04-20 | Cloud live broadcast control system applicable to various scenes |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111372094A true CN111372094A (en) | 2020-07-03 |
| CN111372094B CN111372094B (en) | 2022-06-17 |
Family
ID=71210973
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010313864.4A Expired - Fee Related CN111372094B (en) | 2020-04-20 | 2020-04-20 | Cloud live broadcast control system applicable to various scenes |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111372094B (en) |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104967861A (en) * | 2015-05-27 | 2015-10-07 | 上海美琦浦悦通讯科技有限公司 | CDN video buffer system and method |
| US20170264936A1 (en) * | 2016-03-14 | 2017-09-14 | The Directv Group, Inc. | Method and system for viewing sports content within a virtual reality environment |
| CN107507221A (en) * | 2017-07-28 | 2017-12-22 | 天津大学 | With reference to frame difference method and the moving object detection and tracking method of mixed Gauss model |
| CN108259923A (en) * | 2017-09-27 | 2018-07-06 | 广州华多网络科技有限公司 | A kind of net cast method, system and equipment |
-
2020
- 2020-04-20 CN CN202010313864.4A patent/CN111372094B/en not_active Expired - Fee Related
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104967861A (en) * | 2015-05-27 | 2015-10-07 | 上海美琦浦悦通讯科技有限公司 | CDN video buffer system and method |
| US20170264936A1 (en) * | 2016-03-14 | 2017-09-14 | The Directv Group, Inc. | Method and system for viewing sports content within a virtual reality environment |
| CN107507221A (en) * | 2017-07-28 | 2017-12-22 | 天津大学 | With reference to frame difference method and the moving object detection and tracking method of mixed Gauss model |
| CN108259923A (en) * | 2017-09-27 | 2018-07-06 | 广州华多网络科技有限公司 | A kind of net cast method, system and equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111372094B (en) | 2022-06-17 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106878820B (en) | Live broadcast interaction method and device | |
| CN102905170B (en) | Screen popping method and system for video | |
| CN107633441A (en) | Commodity in track identification video image and the method and apparatus for showing merchandise news | |
| US20080268961A1 (en) | Method of creating video in a virtual world and method of distributing and using same | |
| CN107529091B (en) | Video editing method and device | |
| CN109168026A (en) | Instant video display methods, device, terminal device and storage medium | |
| GB2347332A (en) | Computer games apparatus | |
| CN113781660A (en) | Method and device for rendering and processing virtual scene on line in live broadcast room | |
| CN113660528B (en) | Video synthesis method and device, electronic equipment and storage medium | |
| CN113766296A (en) | Live broadcast picture display method and device | |
| CN111279687A (en) | Video subtitle processing method and director system | |
| CN104461420A (en) | Mobile screen system and method | |
| CN114095744A (en) | Video live broadcast method and device, electronic equipment and readable storage medium | |
| CN114466213B (en) | Information synchronization method, device, computer equipment, storage medium and program product | |
| CN115061617A (en) | Processing method and device of live broadcast picture, computer equipment and storage medium | |
| CN114025185A (en) | Video playback method and device, electronic equipment and storage medium | |
| CN111372094B (en) | Cloud live broadcast control system applicable to various scenes | |
| US10984836B2 (en) | Information processing apparatus, information processing method, and non-transitory computer readable medium | |
| CN109348241B (en) | Video playing method and device in multi-user video live broadcasting room and computer equipment | |
| CN111667313A (en) | Advertisement display method and device, client device and storage medium | |
| CN108876866B (en) | Media data processing method, device and storage medium | |
| CN113596493B (en) | Interactive special effect synchronization method and related device | |
| CN112383793B (en) | Picture synthesis method and device, electronic equipment and storage medium | |
| CN111158826B (en) | Interface skin generation method, device, equipment and storage medium | |
| KR20180118936A (en) | Method and server for providing sports game information |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20220617 |