CN113014940A - Live broadcast optimization method and device - Google Patents
Live broadcast optimization method and device Download PDFInfo
- Publication number
- CN113014940A CN113014940A CN202110222688.8A CN202110222688A CN113014940A CN 113014940 A CN113014940 A CN 113014940A CN 202110222688 A CN202110222688 A CN 202110222688A CN 113014940 A CN113014940 A CN 113014940A
- Authority
- CN
- China
- Prior art keywords
- live broadcast
- data
- uplink
- target
- uplink flow
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 69
- 238000005457 optimization Methods 0.000 title claims abstract description 38
- 238000011144 upstream manufacturing Methods 0.000 claims description 7
- 230000000694 effects Effects 0.000 abstract description 6
- 230000008569 process Effects 0.000 description 18
- 230000002829 reductive effect Effects 0.000 description 11
- 238000010586 diagram Methods 0.000 description 10
- 230000006835 compression Effects 0.000 description 9
- 238000007906 compression Methods 0.000 description 9
- 238000004590 computer program Methods 0.000 description 7
- 238000004891 communication Methods 0.000 description 6
- 230000006870 function Effects 0.000 description 6
- 230000005540 biological transmission Effects 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 4
- 230000004048 modification Effects 0.000 description 4
- 238000012986 modification Methods 0.000 description 4
- 230000009471 action Effects 0.000 description 3
- 238000012545 processing Methods 0.000 description 3
- 238000011161 development Methods 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 230000006978 adaptation Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 230000000670 limiting effect Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000036961 partial effect Effects 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 230000002441 reversible effect Effects 0.000 description 1
- 230000011664 signaling Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/21—Server components or server architectures
- H04N21/218—Source of audio or video content, e.g. local disk arrays
- H04N21/2187—Live feed
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/239—Interfacing the upstream path of the transmission network, e.g. prioritizing client content requests
- H04N21/2393—Interfacing the upstream path of the transmission network, e.g. prioritizing client content requests involving handling client requests
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/24—Monitoring of processes or resources, e.g. monitoring of server load, available bandwidth, upstream requests
- H04N21/2402—Monitoring of the downstream path of the transmission network, e.g. bandwidth available
Abstract
The embodiment of the application provides a live broadcast optimization method and a live broadcast optimization device, wherein the live broadcast optimization method comprises the following steps: acquiring a first uplink flow; determining a first target live broadcast strategy corresponding to the first uplink flow according to the first uplink flow, wherein the first target live broadcast strategy comprises a first coding parameter of live broadcast data; encoding the live broadcast data by using the first encoding parameter to obtain encoded live broadcast data; and sending the encoded live broadcast data to a server. According to the embodiment of the application, automatic optimization of various network live broadcasts can be realized, and the video live broadcast effect and the customer experience degree of products in different network environments are greatly improved.
Description
Technical Field
The application relates to the technical field of internet, in particular to a live broadcast optimization method and device.
Background
With the development of network technology, more and more people pay attention to live webcast, and live webcast technology also brings great influence to people's daily life.
At present, the network live broadcast is developed rapidly, from live broadcast of a computer terminal to live broadcast of mobile terminals such as mobile phones and the like, the single indoor live broadcast can not meet the requirements of audiences, and anchor broadcasters begin to move outdoors to explore live broadcast in more scenes.
In the process of implementing the invention, the inventor finds that the following problems exist in the prior art: the existing anchor method has the problem of poor adaptability. For example, when outdoor live broadcast is performed, live broadcast is performed according to fixed parameters, but since the outdoor network environment may be poor, if live broadcast is performed always using fixed live broadcast parameters, the problem of poor adaptability may arise.
Disclosure of Invention
An object of the embodiments of the present application is to provide a live broadcast optimization method and apparatus, so as to solve the problem of poor adaptability in the prior art.
In a first aspect, an embodiment of the present application provides a live broadcast optimization method, where the live broadcast optimization method includes: acquiring a first uplink flow; determining a first target live broadcast strategy corresponding to the first uplink flow according to the first uplink flow, wherein the first target live broadcast strategy comprises a first coding parameter of live broadcast data; encoding the live broadcast data by using the first encoding parameter to obtain encoded live broadcast data; and sending the encoded live broadcast data to a server.
Therefore, the first target live broadcast strategy corresponding to the first uplink flow can be determined according to the first uplink flow, the live broadcast data can be encoded by utilizing the first encoding parameter in the first target live broadcast strategy, and the encoded live broadcast data can be sent to the server.
In a possible embodiment, determining, according to the first uplink traffic, a first target live broadcast policy corresponding to the first uplink traffic includes: detecting a network type of an accessed network; and determining a first target live broadcast strategy according to the first uplink flow and the network type.
Therefore, the first target live broadcast strategy can be accurately determined through the first uplink flow and the network type.
In one possible embodiment, the live broadcast optimization method further includes: acquiring a second uplink flow, wherein the second uplink flow is acquired after the first uplink flow; determining a second target live broadcast strategy corresponding to the second uplink flow according to the second uplink flow, wherein the second target live broadcast strategy comprises a second coding parameter of live broadcast data; and updating the current encoding parameter of the live data from the first encoding parameter to the second encoding parameter.
Therefore, after the network types are switched, the live broadcast data can be switched through the technical scheme.
In one possible embodiment, the live data is live data acquired by the drone.
In one possible embodiment, the live broadcast optimization method further includes: and sending a first target live broadcast strategy to the server so that the server can send the first target live broadcast strategy to the unmanned aerial vehicle, and the unmanned aerial vehicle can encode the acquired video data according to a first encoding parameter in the first target live broadcast strategy.
Therefore, besides modifying the upstream live data, the embodiment of the application can also realize the downstream live data.
In a second aspect, an embodiment of the present application provides a live broadcast optimization apparatus, where the live broadcast optimization apparatus includes: the acquisition module is used for acquiring a first uplink flow; the determining module is used for determining a first target live broadcast strategy corresponding to the first uplink flow according to the first uplink flow, wherein the first target live broadcast strategy comprises a first coding parameter of live broadcast data; the encoding module is used for encoding the live broadcast data by utilizing the first encoding parameter to obtain encoded live broadcast data; and the sending module is used for sending the encoded live broadcast data to the server.
In a possible embodiment, the determining module is specifically configured to: detecting a network type of an accessed network; and determining a first target live broadcast strategy according to the first uplink flow and the network type.
In a possible embodiment, the obtaining module is further configured to obtain a second uplink flow, where the second uplink flow is obtained after the first uplink flow; the determining module is further configured to determine a second target live broadcast strategy corresponding to the second uplink flow according to the second uplink flow, where the second target live broadcast strategy includes a second encoding parameter of live broadcast data; and the updating module is used for updating the current encoding parameter of the live data from the first encoding parameter to the second encoding parameter.
In one possible embodiment, the live data is live data acquired by the drone.
In a possible embodiment, the sending module is further configured to send the first target live broadcast policy to the server, so that the server sends the first target live broadcast policy to the unmanned aerial vehicle, and the unmanned aerial vehicle encodes the acquired video data according to a first encoding parameter in the first target live broadcast policy.
In a third aspect, an embodiment of the present application provides a storage medium, where a computer program is stored on the storage medium, and when the computer program is executed by a processor, the computer program performs the method according to the first aspect or any optional implementation manner of the first aspect.
In a fourth aspect, an embodiment of the present application provides an electronic device, including: a processor, a memory and a bus, the memory storing machine-readable instructions executable by the processor, the processor and the memory communicating via the bus when the electronic device is running, the machine-readable instructions when executed by the processor performing the method of the first aspect or any of the alternative implementations of the first aspect.
In a fifth aspect, the present application provides a computer program product which, when run on a computer, causes the computer to perform the method of the first aspect or any possible implementation manner of the first aspect.
In order to make the aforementioned and other objects, features and advantages of the present invention comprehensible, preferred embodiments accompanied with figures are described in detail below.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are required to be used in the embodiments of the present application will be briefly described below, it should be understood that the following drawings only illustrate some embodiments of the present application and therefore should not be considered as limiting the scope, and that those skilled in the art can also obtain other related drawings based on the drawings without inventive efforts.
Fig. 1 is a schematic diagram illustrating an application scenario provided in an embodiment of the present application;
fig. 2 is a flowchart illustrating a live broadcast optimization method provided in an embodiment of the present application;
fig. 3 shows a specific flowchart of a live broadcast optimization method provided in an embodiment of the present application;
fig. 4 shows a block diagram of a live broadcast optimization apparatus provided in an embodiment of the present application;
fig. 5 shows a block diagram of an electronic device according to an embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be described below with reference to the drawings in the embodiments of the present application.
It should be noted that: like reference numbers and letters refer to like items in the following figures, and thus, once an item is defined in one figure, it need not be further defined and explained in subsequent figures. Meanwhile, in the description of the present application, the terms "first", "second", and the like are used only for distinguishing the description, and are not to be construed as indicating or implying relative importance.
With the rapid development of intelligent hardware and internet streaming media technologies, better combination of the intelligent hardware and the internet streaming media technologies brings about a tendency of better updated experience for users, and is expected by the users.
At present, the network live broadcast is rapidly developed, from live broadcast of a computer terminal to live broadcast of mobile terminals such as mobile phones, the single indoor live broadcast can not meet the requirements of audiences, and anchor broadcasters begin to move outdoors to explore live broadcast in more scenes. For example, live outdoor broadcast is performed by a drone.
In addition, most live broadcast platforms all live according to fixed parameter, need manual selection circuit and set up live broadcast parameter to the live broadcast environment of various networks, relatively poor to the adaptability of network, especially unmanned aerial vehicle is live, faces the challenge of harsher network environment.
For example, when the outdoor network environment is 3G, 4G, 5G, or WIFF, the problems of network instability, disconnection reconnection, and the like are easily encountered, and when the bandwidth is not enough, the content with a higher frame rate or a higher bit rate is difficult to send out, and at this time, the fixed video data stream cannot satisfy the requirements of all environments certainly, thereby causing the problem of poor adaptability.
Based on this, an embodiment of the present application provides a live broadcast optimization scheme, where a first uplink flow is obtained, a first target live broadcast policy corresponding to the first uplink flow is determined according to the first uplink flow, the first target live broadcast policy includes a first coding parameter of live broadcast data, the live broadcast data is coded by using the first coding parameter, coded live broadcast data is obtained, and the coded live broadcast data is sent to a server.
Therefore, the first target live broadcast strategy corresponding to the first uplink flow can be determined according to the first uplink flow, the live broadcast data can be encoded by utilizing the first encoding parameter in the first target live broadcast strategy, and the encoded live broadcast data can be sent to the server.
Referring to fig. 1, fig. 1 is a schematic diagram illustrating an application scenario provided in an embodiment of the present application. The application scenario shown in fig. 1 includes a drone, a server, a first electronic device, and a second electronic device. Wherein, the server is connected with unmanned aerial vehicle, first electronic equipment and second electronic equipment respectively.
It should be understood that the specific device of the unmanned aerial vehicle, the specific device of the server, the specific device of the first electronic device, and the specific device of the second electronic device may all be set according to actual requirements, and the embodiment of the present application is not limited thereto.
For example, the server may be a single server, a server cluster, or the like.
For another example, the first electronic device may be a mobile phone, a notebook, or the like. The first electronic device can be used as a main broadcasting terminal.
For another example, the second electronic device may be a mobile phone, a notebook, a desktop computer, or the like. Wherein the second electronic device may act as a spectator.
It should be noted here that, although fig. 1 illustrates an application scenario, it should be understood by those skilled in the art that the application scenario may also be set according to actual needs, and the embodiment of the present application is not limited to this.
Referring to fig. 2, fig. 2 shows a flowchart of a live broadcast optimization method provided in an embodiment of the present application. The live broadcast optimization method shown in fig. 2 includes:
step S210, the first electronic device obtains a first uplink traffic. The first uplink traffic is traffic sent by the first electronic device to the server.
It should be understood that the determination process of the first uplink traffic may be set according to actual requirements, and the embodiment of the present application is not limited thereto.
For example, the first electronic device may detect a network uplink bandwidth state through a network uplink detection module, and send a test packet each time according to a current type of the maximum uplink traffic reference value by simulating a method of requesting the fixed server to send an uplink data packet. When sending, the network data is read to calculate the total traffic T1 sent for the nth time (or the total size of the uplink traffic from the 1 st time to the nth time), and the total traffic T2 sent for the (n + 1) th time (or the total size of the uplink traffic from the 1 st time to the n +1 th time), so that T2-T1 are the uplink traffic corresponding to the (n + 1) th time. And obtaining uplink flow corresponding to m continuous sending processes according to the process, calculating a weighted average value of the m uplink flows, and taking the weighted average value as a first uplink flow. And n and m are positive integers, and the value of n and the value of m can be set according to actual requirements.
It should also be understood that the process of acquiring the first uplink traffic by the first electronic device may be set according to actual needs, and the embodiment of the present application is not limited thereto.
For example, the first electronic device may obtain the size of the first uplink traffic by reading the network card data through a software algorithm.
Step S220, the first electronic device determines, according to the first uplink traffic, a first target live broadcast policy corresponding to the first uplink traffic. The first target live broadcast strategy comprises a first coding parameter of live broadcast data.
It should be understood that the specific parameters included in the first encoding parameters may be set according to actual requirements, and the embodiments of the present application are not limited thereto.
For example, the first encoding parameter may include an encoding type, a video encoding resolution, a Frame Per Second (FPS) and a code rate, etc.
It should also be understood that the number of transmission frames per second may also be referred to as a frame rate.
It should be noted that, although the first target live broadcast policy is described above by taking as an example that the first target live broadcast policy includes the first encoding parameter, it should be understood by those skilled in the art that the first target live broadcast policy may also include other data, and the embodiment of the present application is not limited thereto.
It should also be understood that, according to the first uplink traffic, the specific process of determining the first target live broadcast policy corresponding to the first uplink traffic by the first electronic device may be set according to an actual requirement, and the embodiment of the application is not limited thereto.
Optionally, under the condition that the first electronic device stores at least one uplink flow range and a live broadcast policy corresponding to each uplink flow range in the at least one uplink flow range, the first electronic device obtains a size of the first uplink flow, determines a target uplink flow range where the first uplink flow is located according to the size of the first uplink flow (that is, the first uplink flow is within the target uplink flow range), and finally determines a first target live broadcast policy corresponding to the target uplink flow range according to the target uplink flow range.
It should be understood that the two upstream flow boundary values (or the maximum value and the minimum value of each upstream flow range) corresponding to each upstream flow range may be set according to actual requirements, and the embodiment of the present application is not limited thereto.
It should also be understood that the live broadcast policy corresponding to each uplink traffic range may also be set according to actual requirements, and the embodiment of the present application is not limited to this.
Optionally, the first electronic device detects a network type of an access network, determines a target network state according to the first uplink traffic and the network type, and determines a first target live broadcast policy according to the target network state.
It should be understood that the specific type of the network type may be set according to actual requirements, and the embodiments of the present application are not limited thereto.
For example, the network type may be 3G, 4G, 5G, WIFF, or the like.
It should also be understood that the specific process of the first electronic device detecting the network type of the access network may be set according to actual requirements, and the embodiment of the present application is not limited thereto.
For example, in the case that the first electronic device is a smart device installed with an IOS mobile operating system, the first electronic device may perform network monitoring using the accessibility of the smart device package to determine the network type of the currently accessed network.
It should also be understood that the states included in the network state may be set according to actual requirements, and the embodiments of the present application are not limited thereto.
For example, the network status may include a poor network status, a general network status, and a good network status. The network state difference means that the network is poor, and live broadcast is not suggested; network status generally means that the network quality is not too good, but can be live; the network state is better, which means that the network quality is better and the live broadcast can be well carried out. The target network state may be one of a poor network state, a general network state and a better network state.
It should be noted that, the specific process of determining the target network state by the first electronic device according to the first uplink traffic and the network type may be set according to actual requirements, and the embodiment of the present application is not limited to this.
For example, when the network type is 3G, since the size of the uplink bandwidth corresponding to the 3G network is 1.8 to 5.7 million per second (or referred to as M per second), if the uplink traffic (for example, the first uplink traffic) is lower than 1.8 million per second, it is determined that the current network state is a poor network state, and a prompt message is sent, so as to prompt a user that the current network is poor, and it is not recommended to perform live broadcast; if the uplink flow is between 1.8 and 4 million per second, determining that the network state at the moment is a common network state, and the network quality is not good at the moment but live broadcast can be carried out; if the uplink flow is between 4M and 5.7M million per second, the network state is determined to be the better network state, the network quality is better, and live broadcast can be carried out.
For another example, under the condition that the network type is 4G, if the uplink flow is lower than 1.8 million per second, the current network state is determined to be poor, and prompt information is sent so as to prompt a user that the current network is poor and live broadcast is not recommended; if the uplink flow is between 1.8 and 4 million per second, determining that the network state at the moment is a common network state, and the network quality is not good at the moment but live broadcast can be carried out; if the uplink flow is between 4M and 5.7M million per second, the network state is determined to be the better network state, and the network quality is better and the live broadcast can be realized; if the uplink flow is 50M-100 Mbps, the network state is determined to be very excellent, the network quality is very high, and live broadcasting can be carried out.
For another example, under the condition that the network type is 5G, if the uplink flow is lower than 1.8 million per second, the current network state is determined to be poor, and prompt information is sent so as to prompt a user that the current network is poor and live broadcast is not recommended; if the uplink flow is between 1.8 and 4 million per second, determining that the network state at the moment is a common network state, and the network quality is not good at the moment but live broadcast can be carried out; at the moment, the network quality is better, and live broadcasting can be realized; if the uplink flow is 50M-350 Mbps, the network state is determined to be very excellent, the network quality is very high, and live broadcast can be performed.
For another example, under the condition that the network type is WIFI, if the uplink flow is lower than 1.8 million per second, the current network state is determined to be a poor network state, and prompt information is sent so as to prompt the user that the network is poor at the moment and live broadcast is not recommended; if the uplink flow is between 1.8 and 4 million per second, determining that the network state at the moment is a common network state, and the network quality is not good at the moment but live broadcast can be carried out; if the uplink flow is 4 Mmega per second, the network state at the moment is determined to be the better network state, and the network quality is better and the live broadcast can be realized.
In step S230, the first electronic device encodes the live broadcast data by using the first encoding parameter, so as to obtain encoded live broadcast data.
It should be understood that the live data may be live data collected by the first electronic device, or may be live data acquired by the unmanned aerial vehicle, so that the unmanned aerial vehicle may send the live data to the first electronic device (for example, the unmanned aerial vehicle may directly send the live data to the first electronic device, or send the live data to the server, and then send the live data to the first electronic device by the server).
It should be noted here that the original video data source collected by the drone is 1080p, the resolution is 1920 × 1080, the FPS is 30, and the bitrate is about 5 Mb/s.
It should also be understood that, the first electronic device encodes the live broadcast data by using the first encoding parameter, and a specific process of obtaining the encoded live broadcast data may be set according to an actual requirement, and the embodiment of the present application is not limited to this.
For example, under the condition that the network type is 3G, if the uplink flow is between 1.8 and 4 million per second, it is determined that the network state at this time is general, at this time, the uplink bandwidth cannot meet the maximum uplink requirement of video live broadcast, and it is necessary to reduce the quality of live broadcast video and the size of a data packet to reduce the network uplink load pressure, at this time, it may be necessary to reduce the video definition to ensure the fluency of live broadcast, and a live broadcast strategy is selected adaptively through condition call-back, a video encoding mode is set as H265 encoding, the encoding compression rate is improved, the bandwidth occupancy of the H265 encoding can be reduced by about 40%, the video encoding resolution is set as 640 x 480, the FPS is 15, the bit rate is 1Mb/s, and the video live broadcast effect can be greatly improved; if the uplink flow is between 4M and 5.7M million per second, the network state at the moment is determined to be better, a live broadcast strategy is selected in a self-adaptive mode through condition callback, a video coding mode is set to be H265 coding, the coding compression rate is improved, the broadband ratio of the H265 coding can be reduced by about 40%, the video coding resolution is set to be 1280 x 720, FPS is 25, and the code rate is 3 Mb/s. The live video image quality and the live broadcast fluency can be greatly improved.
For another example, under the condition that the network type is 4G, if the uplink flow is between 1.8 to 4 million per second, it is determined that the network state at this time is general, at this time, the uplink bandwidth cannot meet the maximum uplink requirement of video live broadcast, and it is necessary to reduce the quality of live broadcast video and the size of a data packet to reduce the network uplink load pressure, at this time, it may be necessary to reduce the video definition to ensure the fluency of live broadcast, and a live broadcast strategy is selected adaptively through condition call-back, a video encoding mode is set as H265 encoding, the encoding compression rate is improved, the H265 encoding can reduce the broadband ratio by about 40%, the video encoding resolution is set as 640 x 480, the FPS is 15, and the code rate is 1 Mb/s; if the uplink flow is between 4M and 5.7M million per second, the network state at the moment is determined to be better, a live broadcast strategy is selected in a self-adaptive mode through condition callback, a video coding mode is set to be H265 coding, the coding compression rate is improved, the bandwidth occupation ratio of the H265 coding can be reduced by about 40%, the video coding resolution is set to be 1280 x 720, FPS is 25, and the code rate is 3Mb/s, so that the live broadcast image quality and the live broadcast fluency can be greatly improved; if the uplink flow is 50M-100 Mbps, the network state at the moment is determined to be very excellent, in this time, the uplink bandwidth can meet the maximum uplink requirement of video live broadcast, the quality of live broadcast video and the size of a live broadcast sending data packet need to be improved, and a network uplink load suitable for adaptation is set.
For another example, under the condition that the network type is 5G, if the uplink flow is between 1.8 to 4 million per second, it is determined that the network state at this time is general, at this time, the uplink bandwidth cannot meet the maximum uplink requirement of video live broadcast, and it is necessary to reduce the quality of live broadcast video and the size of a data packet to reduce the network uplink load pressure, at this time, it is necessary to reduce the video definition to ensure the fluency of live broadcast, a live broadcast strategy is selected adaptively through condition call-back, a video coding mode is set to be H265 coding, the coding compression rate is improved, the bandwidth ratio of the H265 coding can be reduced by about 40%, the video coding resolution is set to be 640 x 480, the FPS is 15, and the code rate is 1Mb/s, so that the video live broadcast effect can be greatly improved; if the uplink flow is between 4M and 5.7M million per second, the network state at the moment is determined to be better, a live broadcast strategy is selected in a self-adaptive mode through condition callback, a video coding mode is set to be H265 coding, the coding compression rate is improved, the bandwidth occupation ratio of the H265 coding can be reduced by about 40%, the video coding resolution is set to be 1280 x 720, FPS is 25, and the code rate is 3Mb/s, so that the live broadcast image quality and the live broadcast fluency can be greatly improved; if the uplink flow is 50M-350 Mbps, the network state at the moment is determined to be very excellent, in this time, the uplink bandwidth can meet the maximum uplink requirement of video live broadcast, the quality of live broadcast video and the size of a live broadcast sending data packet need to be improved, and a suitable network uplink load is set, in this time, the video definition can be improved under the existing bandwidth, the optimization of a live broadcast picture is ensured, a live broadcast strategy is selected through callback, a video coding mode is set to be H265 coding, the coding compression ratio is improved, the broadband ratio of the H265 coding can be reduced by about 40%, the video coding resolution is set to 1280 x 1080, the FPS is 30, and the code rate is 5Mb/s, so that the picture transmission with the best quality of the live broadcast is ensured, and high-definition can be enjoyed smoothly.
For another example, under the condition that the network type is WIFI, if the uplink flow is between 1.8-4 million per second, it is determined that the network state at this time is general, at this time, the uplink bandwidth cannot meet the maximum uplink requirement of video live broadcast, it needs to reduce the quality of live broadcast video and the size of a data packet to reduce the network uplink load pressure, at this time, it needs to reduce the video definition to ensure the smoothness of live broadcast, a live broadcast strategy is selected adaptively through condition callback, a video coding mode is set as H265 coding, the coding compression ratio is improved, the bandwidth ratio of about 40% can be reduced by H265 coding, the video coding resolution is set as 640 x 480, the FPS is 15, and the code rate is 1Mb/s, so that the video live broadcast effect can be greatly improved; if the uplink flow is 4 Mmega per second, the network state at the moment is determined to be better, in this time, the uplink bandwidth possibly cannot meet the maximum uplink requirement of live video, the quality of live video and the size of a live broadcast sending data packet need to be reduced, the network uplink load pressure is reduced, in this time, the definition of a live broadcast picture can be properly reduced under the existing bandwidth, a live broadcast strategy is selected through callback, a video coding mode is set to be H265 coding, the coding compression rate is improved, the bandwidth ratio of the H265 coding which can be reduced by about 40%, the video coding resolution is set to be 1280 x 720, the FPS is 20, and the code rate is 2Mb/s, so that the video quality live broadcast and the live broadcast fluency can be optimized and guaranteed.
Step S240, the first electronic device sends the encoded live data to the server.
Specifically, since the first electronic device can serve as a main broadcasting end, the first electronic device can send encoded live broadcast data to the server, so that the second electronic device and the like can serve as a viewer end, and can see a live broadcast picture of the first electronic device.
In addition, considering that the anchor moves in real time when the anchor is live outdoors, and thus the first electronic device may be switched to the network (for example, the first electronic device may be switched to the 3G network by the WIFI network), the first electronic equipment acquires second uplink flow which is acquired after the first uplink flow, then the first electronic equipment can determine a second target live broadcast strategy corresponding to the second uplink flow according to the second uplink flow, the second target live broadcast strategy comprises a second coding parameter of live broadcast data, then the first electronic equipment can update the current coding parameter of the live broadcast data from the first coding parameter to the second coding parameter, then the first electronic equipment can utilize the second coding parameter, and finally, the first electronic equipment sends the encoded live broadcast data to the server.
It should be noted that, a specific process of the first electronic device acquiring the second uplink traffic is similar to that in step S210, and reference may be made to the related description in step S210; the specific process of the first electronic device determining the second target live broadcast policy corresponding to the second uplink traffic according to the second uplink traffic is similar to that in step S220, and reference may be made to the related description in step S220.
It should be further noted that the above contents are all related descriptions about the uplink procedure, and in the embodiment of the present application, in addition to the uplink procedure, the case of the downlink procedure also needs to be considered.
Optionally, under the condition that the first electronic device obtains the first target live broadcast policy, the first electronic device sends the first target live broadcast policy to the server, so that the server sends the first target live broadcast policy to the unmanned aerial vehicle. Subsequently, after the unmanned aerial vehicle receives the first target live broadcast strategy, the unmanned aerial vehicle can encode the acquired video data according to a first encoding parameter in the first target live broadcast strategy. The video data is used for live broadcasting. Subsequently, the drone may send the encoded video data to the first electronic device.
Therefore, the live broadcast optimization method for automatically detecting the network environment and adaptively selecting the live broadcast strategy can be used in the embodiment of the application, so that the automatic optimization of various common network live broadcasts is realized, and the video live broadcast effect and the customer experience degree of products in different network environments are greatly improved.
That is to say, the embodiment of the present application selects a suitable live broadcast coding strategy according to the network state, and adaptively adjusts coding parameters such as a coding mode, a code rate, an FPS, a resolution, and the like, so as to adjust the push stream image quality under the current network, increase or decrease the size of a network push stream data packet, and reduce the network load pressure under the weak network condition on the basis of ensuring the live broadcast quality to the maximum extent under the existing conditions, thereby ensuring the quality and the fluency of a live broadcast picture.
In order to facilitate understanding of the embodiments of the present application, the following description will be given by way of specific examples.
Referring to fig. 3, fig. 3 is a specific flowchart illustrating a live broadcast optimization method according to an embodiment of the present application. The live broadcast optimization method shown in fig. 3 includes:
in step S310, the first electronic device starts live broadcast software.
In step S320, the first electronic device detects a network type.
In step S330, the first electronic device detects a first uplink traffic.
Step S340, the first electronic device selects a live broadcast policy according to the network type and the first uplink traffic, and adjusts the encoding parameter and the size of the live broadcast transmission data packet according to the live broadcast policy.
In step S350, the first electronic device starts live broadcasting.
Step S360, the first electronic equipment closes the live broadcast.
Therefore, by means of the technical scheme, the embodiment of the application can ensure that the best live broadcast effect can be obtained in the current environment, and the live broadcast quality and the client experience degree are optimized and improved.
It should be understood that the above-described live broadcast optimization method is only exemplary, and those skilled in the art can make various modifications, modifications or variations according to the above-described method and also fall within the scope of the present application.
Referring to fig. 4, fig. 4 shows a structural block diagram of a live broadcast optimizing device 400 provided in an embodiment of the present application, it should be understood that the live broadcast optimizing device 400 corresponds to the above method embodiment and can perform the steps related to the above method embodiment, and specific functions of the live broadcast optimizing device 400 may be referred to the above description, and detailed descriptions are appropriately omitted herein to avoid repetition. The live optimization device 400 includes at least one software function module that can be stored in a memory in the form of software or firmware (firmware) or solidified in an Operating System (OS) of the live optimization device 400. Specifically, the live broadcast optimizing apparatus 400 includes:
an obtaining module 410, configured to obtain a first uplink traffic; a determining module 420, configured to determine, according to the first uplink traffic, a first target live broadcast policy corresponding to the first uplink traffic, where the first target live broadcast policy includes a first encoding parameter of live broadcast data; the encoding module 430 is configured to encode the live broadcast data by using the first encoding parameter to obtain encoded live broadcast data; a sending module 440, configured to send the encoded live data to a server.
In a possible embodiment, the determining module 420 is specifically configured to: detecting a network type of an accessed network; and determining a first target live broadcast strategy according to the first uplink flow and the network type.
In a possible embodiment, the obtaining module 410 is further configured to obtain a second uplink flow, where the second uplink flow is obtained after the first uplink flow; the determining module 420 is further configured to determine, according to the second uplink traffic, a second target live broadcast policy corresponding to the second uplink traffic, where the second target live broadcast policy includes a second encoding parameter of the live broadcast data; and an updating module (not shown) for updating the current encoding parameter of the live data from the first encoding parameter to the second encoding parameter.
In one possible embodiment, the live data is live data acquired by the drone.
In a possible embodiment, the sending module 440 is further configured to send the first target live broadcast policy to the server, so that the server sends the first target live broadcast policy to the drone, so that the drone encodes the acquired video data according to a first encoding parameter in the first target live broadcast policy.
It is clear to those skilled in the art that, for convenience and brevity of description, the specific working process of the apparatus described above may refer to the corresponding process in the foregoing method, and will not be described in too much detail herein.
Referring to fig. 5, fig. 5 is a block diagram illustrating an electronic device 500 according to an embodiment of the present disclosure. Electronic device 500 may include a processor 510, a communication interface 520, a memory 530, and at least one communication bus 540. Wherein the communication bus 540 is used for realizing direct connection communication of these components. The communication interface 520 in the embodiment of the present application is used for communicating signaling or data with other devices. Processor 510 may be an integrated circuit chip having signal processing capabilities. The Processor 510 may be a general-purpose Processor, and includes a Central Processing Unit (CPU), a Network Processor (NP), and the like; but may also be a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), an off-the-shelf programmable gate array (FPGA) or other programmable logic device, discrete gate or transistor logic, discrete hardware components. The various methods, steps, and logic blocks disclosed in the embodiments of the present application may be implemented or performed. A general purpose processor may be a microprocessor or the processor 510 may be any conventional processor or the like.
The Memory 530 may be, but is not limited to, a Random Access Memory (RAM), a Read Only Memory (ROM), a Programmable Read-Only Memory (PROM), an Erasable Read-Only Memory (EPROM), an electrically Erasable Read-Only Memory (EEPROM), and the like. The memory 530 stores computer readable instructions, which when executed by the processor 510, the electronic device 500 may perform the steps of the above-described method embodiments.
The electronic device 500 may further include a memory controller, an input-output unit, an audio unit, and a display unit.
The memory 530, the memory controller, the processor 510, the peripheral interface, the input/output unit, the audio unit, and the display unit are electrically connected to each other directly or indirectly to realize data transmission or interaction. For example, these elements may be electrically coupled to each other via one or more communication buses 540. Processor 510 is used to execute executable modules stored in memory 530. Also, the electronic device 500 is configured to perform the following method: acquiring a first uplink flow; determining a first target live broadcast strategy corresponding to the first uplink flow according to the first uplink flow, wherein the first target live broadcast strategy comprises a first coding parameter of live broadcast data; encoding the live broadcast data by using the first encoding parameter to obtain encoded live broadcast data; and sending the encoded live broadcast data to a server.
The input and output unit is used for providing input data for a user to realize the interaction of the user and the server (or the local terminal). The input/output unit may be, but is not limited to, a mouse, a keyboard, and the like.
The audio unit provides an audio interface to the user, which may include one or more microphones, one or more speakers, and audio circuitry.
The display unit provides an interactive interface (e.g. a user interface) between the electronic device and a user or for displaying image data to a user reference. In this embodiment, the display unit may be a liquid crystal display or a touch display. In the case of a touch display, the display can be a capacitive touch screen or a resistive touch screen, which supports single-point and multi-point touch operations. The support of single-point and multi-point touch operations means that the touch display can sense touch operations simultaneously generated from one or more positions on the touch display, and the sensed touch operations are sent to the processor for calculation and processing.
It will be appreciated that the configuration shown in FIG. 5 is merely illustrative and that the electronic device 500 may include more or fewer components than shown in FIG. 5 or may have a different configuration than shown in FIG. 5. The components shown in fig. 5 may be implemented in hardware, software, or a combination thereof.
The present application also provides a storage medium having a computer program stored thereon, which, when executed by a processor, performs the method of the method embodiments.
The present application also provides a computer program product which, when run on a computer, causes the computer to perform the method of the method embodiments.
It can be clearly understood by those skilled in the art that, for convenience and brevity of description, the specific working process of the system described above may refer to the corresponding process in the foregoing method, and will not be described in too much detail herein.
It should be noted that, in the present specification, the embodiments are all described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments may be referred to each other. For the device-like embodiment, since it is basically similar to the method embodiment, the description is simple, and for the relevant points, reference may be made to the partial description of the method embodiment.
In the embodiments provided in the present application, it should be understood that the disclosed apparatus and method can be implemented in other ways. The apparatus embodiments described above are merely illustrative, and for example, the flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of apparatus, methods and computer program products according to various embodiments of the present application. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
In addition, functional modules in the embodiments of the present application may be integrated together to form an independent part, or each module may exist separately, or two or more modules may be integrated to form an independent part.
The functions, if implemented in the form of software functional modules and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present application or portions thereof that substantially contribute to the prior art may be embodied in the form of a software product stored in a storage medium and including instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present application. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes. It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
The above description is only a preferred embodiment of the present application and is not intended to limit the present application, and various modifications and changes may be made by those skilled in the art. Any modification, equivalent replacement, improvement and the like made within the spirit and principle of the present application shall be included in the protection scope of the present application. It should be noted that: like reference numbers and letters refer to like items in the following figures, and thus, once an item is defined in one figure, it need not be further defined and explained in subsequent figures.
The above description is only for the specific embodiments of the present application, but the scope of the present application is not limited thereto, and any person skilled in the art can easily conceive of the changes or substitutions within the technical scope of the present application, and shall be covered by the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.
Claims (10)
1. A live broadcast optimization method, comprising:
acquiring a first uplink flow;
determining a first target live broadcast strategy corresponding to the first uplink flow according to the first uplink flow, wherein the first target live broadcast strategy comprises a first coding parameter of live broadcast data;
encoding the live broadcast data by using the first encoding parameter to obtain encoded live broadcast data;
and sending the encoded live broadcast data to a server.
2. The live broadcast optimization method according to claim 1, wherein the determining, according to the first uplink traffic, a first target live broadcast policy corresponding to the first uplink traffic includes:
detecting a network type of an accessed network;
and determining the first target live broadcast strategy according to the first uplink flow and the network type.
3. The live optimization method of claim 1, further comprising:
acquiring a second uplink flow, wherein the second uplink flow is acquired after the first uplink flow;
determining a second target live broadcast strategy corresponding to the second uplink flow according to the second uplink flow, wherein the second target live broadcast strategy comprises a second coding parameter of live broadcast data;
and updating the current encoding parameter of the live data from the first encoding parameter to the second encoding parameter.
4. The live broadcast optimization method according to claim 1, wherein the live broadcast data is live broadcast data acquired by an unmanned aerial vehicle.
5. The live optimization method of claim 1, further comprising:
and sending the first target live broadcast strategy to the server so that the server sends the first target live broadcast strategy to the unmanned aerial vehicle, and the unmanned aerial vehicle encodes the acquired video data according to a first encoding parameter in the first target live broadcast strategy.
6. A live optimization apparatus, comprising:
the acquisition module is used for acquiring a first uplink flow;
a determining module, configured to determine, according to the first uplink traffic, a first target live broadcast policy corresponding to the first uplink traffic, where the first target live broadcast policy includes a first encoding parameter of live broadcast data;
the encoding module is used for encoding the live broadcast data by using the first encoding parameter to obtain encoded live broadcast data;
and the sending module is used for sending the coded live broadcast data to a server.
7. The live broadcast optimization device according to claim 6, wherein the determining module is specifically configured to: detecting a network type of an accessed network; and determining the first target live broadcast strategy according to the first uplink flow and the network type.
8. The live broadcast optimization device according to claim 6, wherein the obtaining module is further configured to obtain a second upstream traffic, where the second upstream traffic is obtained after the first upstream traffic;
the determining module is further configured to determine a second target live broadcast policy corresponding to the second uplink traffic according to the second uplink traffic, where the second target live broadcast policy includes a second encoding parameter of live broadcast data;
and the updating module is used for updating the current encoding parameter of the live data from the first encoding parameter to the second encoding parameter.
9. The live optimization device according to claim 6, wherein the live data is live data obtained by an unmanned aerial vehicle.
10. The live broadcast optimization device according to claim 6, wherein the sending module is further configured to send the first target live broadcast policy to the server, so that the server sends the first target live broadcast policy to the drone, so that the drone encodes the captured video data according to a first encoding parameter in the first target live broadcast policy.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110222688.8A CN113014940A (en) | 2021-02-26 | 2021-02-26 | Live broadcast optimization method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110222688.8A CN113014940A (en) | 2021-02-26 | 2021-02-26 | Live broadcast optimization method and device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113014940A true CN113014940A (en) | 2021-06-22 |
Family
ID=76386766
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110222688.8A Pending CN113014940A (en) | 2021-02-26 | 2021-02-26 | Live broadcast optimization method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113014940A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113938684A (en) * | 2021-09-26 | 2022-01-14 | 中国科学院计算技术研究所 | Lightweight-end cloud-collaborative image coding transmission method and system |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20170295368A1 (en) * | 2016-04-07 | 2017-10-12 | Mstar Semiconductor, Inc. | Bit rate controlling method and video encoding device |
| CN107533792A (en) * | 2015-03-02 | 2018-01-02 | 瓦威亚无人机公司 | System for transmitting order and video flowing between remote control of machine and ground station in such as unmanned plane etc. |
| CN109076194A (en) * | 2017-11-21 | 2018-12-21 | 深圳市大疆创新科技有限公司 | A kind of method for processing video frequency, equipment, aircraft, system and storage medium |
-
2021
- 2021-02-26 CN CN202110222688.8A patent/CN113014940A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107533792A (en) * | 2015-03-02 | 2018-01-02 | 瓦威亚无人机公司 | System for transmitting order and video flowing between remote control of machine and ground station in such as unmanned plane etc. |
| US20170295368A1 (en) * | 2016-04-07 | 2017-10-12 | Mstar Semiconductor, Inc. | Bit rate controlling method and video encoding device |
| CN109076194A (en) * | 2017-11-21 | 2018-12-21 | 深圳市大疆创新科技有限公司 | A kind of method for processing video frequency, equipment, aircraft, system and storage medium |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113938684A (en) * | 2021-09-26 | 2022-01-14 | 中国科学院计算技术研究所 | Lightweight-end cloud-collaborative image coding transmission method and system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10187668B2 (en) | Method, system and server for live streaming audio-video file | |
| CN106791956B (en) | Network live broadcast card pause processing method and device | |
| CN104010232A (en) | Method and system for intelligently playing online videos, player and mobile terminal | |
| CN110460871B (en) | Live video generation method, device, system and equipment | |
| CN110149555B (en) | Video processing method and video receiving device | |
| CN105359479A (en) | Apparatus and method for controlling adaptive streaming of media | |
| US20150156557A1 (en) | Display apparatus, method of displaying image thereof, and computer-readable recording medium | |
| WO2022057789A1 (en) | Video definition identification method, electronic device, and storage medium | |
| CN112399123B (en) | Video definition adjusting method and device, electronic equipment and storage medium | |
| CN102348117A (en) | System of transmitting digital high definition signal with low bandwidth, method thereof and network multimedia television | |
| US9013540B2 (en) | Method for switching shared content in a video conference and a video conference system | |
| CN111263192A (en) | Video processing method and related equipment | |
| CN110996035B (en) | Information sending method and device | |
| US10708667B1 (en) | Combining fragments with different encodings | |
| CN113014940A (en) | Live broadcast optimization method and device | |
| US20130007206A1 (en) | Transmission apparatus, control method for transmission apparatus, and storage medium | |
| CN114257572B (en) | Data processing method, device, computer readable medium and electronic equipment | |
| CN113194276A (en) | Method, system and storage device for generating dynamic layout in video conference system | |
| CN112468883A (en) | Video stream playing method and video stream playing equipment | |
| US9357170B2 (en) | Device and method for managing bandwidth of video conference | |
| CN112995668A (en) | Video processing method, device and terminal, and computer readable storage medium | |
| US20170249120A1 (en) | Sharing of Multimedia Content | |
| Song et al. | Acceptability-based QoE management for user-centric mobile video delivery: A field study evaluation | |
| CN110636372B (en) | Video decoding method, video playing device, electronic equipment and storage medium | |
| CN110062003B (en) | Video data transmitting method, video data transmitting device, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210622 |
|
| RJ01 | Rejection of invention patent application after publication |