CN116260801A - Stream media audio and video push stream parameter control method and related device - Google Patents
Stream media audio and video push stream parameter control method and related device Download PDFInfo
- Publication number
- CN116260801A CN116260801A CN202310290525.2A CN202310290525A CN116260801A CN 116260801 A CN116260801 A CN 116260801A CN 202310290525 A CN202310290525 A CN 202310290525A CN 116260801 A CN116260801 A CN 116260801A
- Authority
- CN
- China
- Prior art keywords
- audio
- terminal
- video data
- push
- state
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/80—Responding to QoS
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/40—Support for services or applications
- H04L65/403—Arrangements for multi-party communication, e.g. for conferences
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/15—Conference systems
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D30/00—Reducing energy consumption in communication networks
- Y02D30/70—Reducing energy consumption in communication networks in wireless communication networks
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The application discloses a method for controlling push parameters of streaming media audio and video push and a related device, wherein the method comprises the following steps: the method comprises the steps of obtaining first signal intensity and first channel bandwidth of a plug-in terminal wireless connection, sending frame rate of audio and video data, second signal intensity and second channel bandwidth of a pull-in terminal wireless connection, and rendering frame rate of pull-in of the rendering audio and video data, determining the state of a current network according to plug-in terminal parameters and pull-in terminal parameters, determining acquisition coding resolution and coding rate based on the state corresponding to the current network, and sending to the plug-in terminal. Therefore, the network parameters of the push terminal and the pull terminal are acquired, so that the state of the current network is evaluated, the acquisition coding resolution and the coding rate which are suitable for the network state can be determined under the condition of network fluctuation, and after the acquisition coding resolution and the coding rate are applied to the push terminal, the push terminal and the pull terminal can still be performed with low delay, and the user experience of paperless conferences is ensured.
Description
Technical Field
The present invention relates to the technical field of streaming media, and more particularly, to a method and an apparatus for controlling a push parameter of streaming media audio/video push.
Background
Along with the development of information technology and the deep folk of environmental protection concepts, the form of the conference has been developed from a note paper form to a paperless form, so that the paperless conference becomes an important office mode of various industries. In paperless conferences, the announcer can announce the content to the terminal of the participant through the local terminal, the announcer does not need to issue paper announcement content to the participant, the participant can quickly know and store the announcement content without note recording, automation and informatization of conference office are realized, and convenient functional experience is brought to users.
At present, the paperless conference has the working mode that a plug-flow terminal pushes flow to a streaming media server through a wireless network, and a pull-flow terminal pulls flow from the streaming media server through the wireless network, and due to instability of the wireless network, pictures of the pull-flow terminal are blocked, a screen is jumped, video pictures are unsmooth and larger time delay is caused, so that user experience is low.
Disclosure of Invention
In view of the above problems, the present application is provided to provide a method and related device for controlling push parameters of streaming media audio/video push, so that when a network fluctuates or is congested, push-pull can still be performed with low delay, and user experience is ensured.
In order to achieve the above object, the following specific solutions are proposed:
a push stream parameter control method for push stream media audio and video is applied to a coordination director and comprises the following steps:
when a push terminal continuously pushes audio and video data, acquiring first signal intensity of wireless connection of the push terminal, first channel bandwidth allocated to wireless connection of the push terminal, transmission frame rate of the push terminal for transmitting the audio and video data, second signal intensity of wireless connection of a pull terminal, second channel bandwidth allocated to wireless connection of the pull terminal, and rendering frame rate of pull of the pull terminal for rendering the audio and video data;
determining a current network state according to the first signal strength, the first channel bandwidth, the transmission frame rate, the second signal strength, the second channel bandwidth and the rendering frame rate;
based on the state corresponding to the current network, determining to adjust the acquisition coding resolution of the audio and video data and the coding rate of the audio and video data;
and sending the acquisition coding resolution and the coding code rate to the push terminal so that the push terminal can push the audio and video data to a streaming media server after setting the acquisition coding resolution and the coding code rate.
Optionally, the acquisition coding resolution is a single-step adjustment acquisition coding resolution, and the coding rate is a single-step adjustment coding rate;
after the acquisition coding resolution and the coding rate are sent to the push terminal, the method further comprises the following steps:
after the streaming terminal pulls the streaming of the audio and video data from the streaming media server and renders the streaming, detecting the definition and time delay of the audio and video information which is currently rendered;
if the first condition and the second condition are not met, determining the latest single-step acquisition coding resolution and the latest single-step coding code rate, wherein the first condition is that the definition is higher than a definition threshold, and the second condition is that the time delay is lower than a time delay threshold;
the single-step acquisition coding resolution and the single-step coding code rate are sent to the streaming terminal, so that the streaming terminal can push the audio and video data to the streaming media server after setting the single-step acquisition coding resolution and the single-step coding code rate, and the step of detecting the definition and the time delay of the audio and video information which are currently rendered after the streaming terminal pulls the streaming of the streaming media server from the streaming media server and renders the streaming is performed;
If the first condition and the second condition are met at the same time, the latest single-step acquisition coding resolution and the latest single-step coding rate are paused to be determined.
Optionally, determining the current network state according to the first signal strength, the first channel bandwidth, the transmission frame rate, the second signal strength, the two-channel bandwidth, and the rendering frame rate includes:
when the first signal strength is lower than a first signal strength threshold, the first channel bandwidth is lower than a first channel bandwidth threshold, the transmission frame rate is lower than an effective transmission frame rate threshold, the second signal strength is lower than a second channel strength threshold, the second channel bandwidth is lower than a second channel bandwidth threshold, and the rendering frame rate is lower than a rendering frame rate threshold, determining that the current network state is a first state;
determining that the current network state is a second state when the first signal strength is not lower than the first signal strength threshold, the first channel bandwidth is not lower than the first channel bandwidth threshold, the transmission frame rate is not lower than the effective transmission frame rate threshold, the second signal strength is not lower than the second channel strength threshold, the second channel bandwidth is not lower than the second channel bandwidth threshold, and the rendering frame rate is not lower than the rendering frame rate threshold;
And if the state of the current network is not the first state and is not the second state, determining that the state of the current network is a third state.
Optionally, determining to adjust the acquisition coding resolution of the audio and video data and adjust the coding rate of the audio and video data based on the state corresponding to the current network includes:
and when the state corresponding to the current network is a first state, determining that the acquisition coding resolution of the audio and video data is smaller than the value of the current streaming terminal for acquiring and coding the audio and video data, and determining that the coding rate of the audio and video data is smaller than the value of the current streaming terminal for coding the audio and video data.
Optionally, determining to adjust the acquisition coding resolution of the audio and video data and adjust the coding rate of the audio and video data based on the state corresponding to the current network includes:
and when the state corresponding to the current network is a second state, determining that the acquisition coding resolution of the audio and video data is adjusted to be larger than the value of the current resolution of the push terminal for acquiring and coding the audio and video data, and determining that the coding rate of the audio and video data is adjusted to be larger than the value of the coding rate of the current push terminal for pushing the audio and video data.
A push stream parameter control device for push stream media audio and video is applied to a coordination director and comprises:
the parameter acquisition unit is used for acquiring first signal intensity of wireless connection of the push terminal, first channel bandwidth allocated to wireless connection of the push terminal, transmission frame rate of the push terminal for transmitting the audio and video data, second signal intensity of wireless connection of the pull terminal, second channel bandwidth allocated to wireless connection of the pull terminal, and rendering frame rate of pull of the pull terminal for rendering the audio and video data when the push terminal continuously pushes the audio and video data;
a network state determining unit, configured to determine a current state of a network according to the first signal strength, the first channel bandwidth, the transmission frame rate, the second signal strength, the second channel bandwidth, and the rendering frame rate;
the plug flow parameter determining unit is used for determining and adjusting the acquisition coding resolution of the audio and video data and adjusting the coding rate of the audio and video data based on the state corresponding to the current network;
and the pushing parameter sending unit is used for sending the acquisition coding resolution and the coding rate to the pushing terminal so that the pushing terminal can push the audio and video data to a streaming media server after setting the acquisition coding resolution and the coding rate.
Optionally, the acquisition coding resolution is a single-step adjustment acquisition coding resolution, and the coding rate is a single-step adjustment coding rate;
the apparatus further comprises:
the definition time delay detection unit is used for detecting the definition and time delay of the audio and video information currently rendered after the streaming terminal pulls the streaming of the audio and video data from the streaming media server and renders the streaming;
the single step adjustment parameter determining unit is used for determining the latest single step acquisition coding resolution and the latest single step coding code rate if a first condition and a second condition are not met, wherein the first condition is that the definition is higher than a definition threshold value, and the second condition is that the time delay is lower than a time delay threshold value;
a single step adjustment parameter sending unit, configured to send the single step acquisition encoding resolution and the single step encoding code rate to the push terminal, so that the push terminal, after setting the single step acquisition encoding resolution and the single step encoding code rate, pushes the audio/video data to the streaming media server, and returns to execute the sharpness delay detection unit;
and the pause determining unit is used for pausing and determining the latest single-step acquisition coding resolution and the latest single-step coding code rate if the first condition and the second condition are met at the same time.
Optionally, the network state determining unit includes:
a first state determining unit, configured to determine, when the first signal strength is lower than a first signal strength threshold, the first channel bandwidth is lower than a first channel bandwidth threshold, the transmission frame rate is lower than an effective transmission frame rate threshold, the second signal strength is lower than a second channel strength threshold, the second channel bandwidth is lower than a second channel bandwidth threshold, and the rendering frame rate is lower than a rendering frame rate threshold, that a state of a current network is a first state;
a second state determining unit configured to determine, when the first signal strength is not lower than the first signal strength threshold, the first channel bandwidth is not lower than the first channel bandwidth threshold, the transmission frame rate is not lower than the effective transmission frame rate threshold, the second signal strength is not lower than the second channel strength threshold, the second channel bandwidth is not lower than the second channel bandwidth threshold, and the rendering frame rate is not lower than the rendering frame rate threshold, that a state of a current network is a second state;
and the third state determining unit is used for determining that the current network state is a third state if the current network state is not the first state and is not the second state.
Optionally, the plug-flow parameter determining unit includes:
and the first state parameter determining unit is used for determining that the acquisition encoding resolution of the audio and video data is smaller than the current value of the resolution of the push terminal for acquiring and encoding the audio and video data when the state corresponding to the current network is the first state, and determining that the encoding code rate of the audio and video data is smaller than the current value of the code rate of the push terminal for encoding the audio and video data when the push terminal pushes the audio and video data.
Optionally, the plug-flow parameter determining unit includes:
and the second state parameter determining unit is used for determining that the acquisition coding resolution of the audio and video data is larger than the current value of the resolution of the push terminal for acquiring and coding the audio and video data when the state corresponding to the current network is the second state, and determining that the coding rate of the audio and video data is larger than the current value of the coding rate of the push terminal for pushing the audio and video data.
A push stream parameter control device for push stream media audio and video includes a memory and a processor;
the memory is used for storing programs;
The processor is used for executing the program and realizing the steps of the push stream parameter control method for pushing the streaming media audio and video.
A storage medium having a computer program stored thereon, wherein the computer program, when executed by a processor, implements the steps of a push stream parameter control method for streaming audio and video push as described above.
By means of the technical scheme, when the push terminal continuously pushes audio and video data, the state of the current network is determined according to the first signal strength, the sending frame rate, the second signal strength, the second channel bandwidth and the rendering frame rate of the push terminal, the state corresponding to the current network is determined, the acquisition and coding resolution of the audio and video data is adjusted, the coding rate of the audio and video data is adjusted, and the acquisition and coding resolution and the coding rate are sent to the push terminal for the push terminal to push the audio and video data to the streaming media server after the acquisition and coding resolution and the coding rate are set. Therefore, the network parameters of the push terminal and the pull terminal are obtained, so that the state of the current network is evaluated, the acquisition coding resolution and the coding rate which are suitable for the network state can be determined under the condition of network fluctuation, and after the acquisition coding resolution and the coding rate are applied to the push terminal, the push terminal and the pull terminal can still be performed with low delay, and the user experience of paperless conferences is ensured.
Drawings
Various other advantages and benefits will become apparent to those of ordinary skill in the art upon reading the following detailed description of the preferred embodiments. The drawings are only for purposes of illustrating the preferred embodiments and are not to be construed as limiting the application. Also, like reference numerals are used to designate like parts throughout the figures. In the drawings:
fig. 1 is a schematic flow chart of a push parameter control for streaming media audio/video push provided in an embodiment of the present application;
fig. 2 is a schematic structural diagram of a device for controlling a push parameter of streaming media audio/video push according to an embodiment of the present application;
fig. 3 is a schematic structural diagram of a device for controlling a push parameter of streaming media audio/video push according to an embodiment of the present application.
Detailed Description
The following description of the embodiments of the present application will be made clearly and fully with reference to the accompanying drawings, in which it is evident that the embodiments described are only some, but not all, of the embodiments of the present application. All other embodiments, which can be made by one of ordinary skill in the art without undue burden from the present disclosure, are within the scope of the present disclosure.
The scheme of the application can be realized based on the terminal with the data processing capability, the terminal can be a coordinated director, the coordinated director can be in communication connection with the plug-flow terminal and the pull-flow terminal, and the adjustment information of the plug-flow parameters can be provided for the plug-flow terminal.
Next, as described in connection with fig. 1, the method for controlling a push parameter of streaming media audio/video push in the present application may include the following steps:
and step S110, when the push terminal continuously pushes the audio and video data, acquiring push terminal parameters and pull terminal parameters.
The parameters of the push terminal may include a first signal strength of the push terminal performing wireless connection, a first channel bandwidth allocated to the push terminal performing wireless connection, and a transmission frame rate of the push terminal transmitting audio and video data. The pull terminal parameters may include a second signal strength of the pull terminal performing the wireless connection, a second channel bandwidth allocated to the pull terminal performing the wireless connection, and a render frame rate of the pull terminal rendering the pull of the audio and video data.
Specifically, the push terminal may represent a terminal used by a speaker of the paperless conference, and the push terminal may push audio and video data to the streaming media server. The streaming terminal can represent a terminal used by a speaker of the paperless conference, and can pull streaming of audio and video data from the streaming media server. The first signal strength of the wireless connection of the push terminal may represent the strength of a wireless network signal when the push terminal shares audio and video data. The first channel bandwidth allocated to the push terminal for wireless connection may represent a bandwidth of a wireless network signal when the push terminal shares audio and video data. The transmission frame rate of the audio and video data transmitted by the push terminal can be represented by the frame rate of the push terminal pushing the audio and video data to the streaming media server. The second signal strength of the wireless connection of the streaming terminal may represent the strength of a wireless network signal when the streaming terminal pulls the streaming of the audio and video data from the streaming server. The second channel bandwidth allocated to the streaming terminal for wireless connection may represent a bandwidth of a wireless network signal when the streaming terminal pulls streaming of the audio and video data from the streaming server. The frame rate of the streaming terminal for rendering the streaming of the audio and video data may be represented by the frame rate of the streaming terminal when rendering the streaming data after pulling the streaming of the audio and video data from the streaming server.
In addition, the plug-in terminal and the pull-in terminal can automatically report terminal network parameters to the coordination director according to the change of the network state of the plug-in terminal and the pull-in terminal.
Step S120, determining the current network state according to the first signal intensity, the first channel bandwidth and the sending frame rate in the push terminal parameter, and the second signal intensity, the second channel bandwidth and the rendering frame rate in the pull terminal parameter.
It can be understood that the first signal strength of the wireless connection of the push terminal, the first channel bandwidth allocated to the wireless connection of the push terminal, and the transmission frame rate of the push terminal for transmitting the audio and video data all belong to network parameters of the push terminal when pushing the audio and video data. The second signal strength of the wireless connection of the streaming terminal, the second channel bandwidth allocated by the wireless connection of the streaming terminal, and the rendering frame rate of the streaming terminal for rendering the audio and video data are all network parameters when the streaming terminal pulls the streaming of the audio and video data from the streaming media server, so that the state of the current network can be determined based on the streaming terminal parameters and the streaming terminal parameters.
And step S130, determining to adjust the acquisition coding resolution of the audio and video data and the coding rate of the audio and video data based on the state corresponding to the current network.
Specifically, the current network state may be divided into multiple levels, such as a good level, a general level, a congestion level, and the like, and for each level of the current network, there is a corresponding acquisition encoding resolution for adjusting the audio/video data, and a corresponding encoding rate for adjusting the audio/video data.
And step 140, the acquisition coding resolution and the coding code rate are sent to the push terminal, so that the push terminal can push the audio and video data to the streaming media server after setting the acquisition coding resolution and the coding code rate.
It can be understood that the terminal for executing the push of the audio and video data is a push terminal, so that the coordination director can send the data to be adjusted to the push terminal, and the push terminal can adjust the push parameters after receiving the acquired coding resolution and the coding code rate sent by the coordination director, so that the push terminal pushes the audio and video data to the streaming media server under the adjusted push parameters.
According to the push parameter control method for pushing the streaming media audio and video, when the push terminal continuously pushes the audio and video data, the state of the current network is determined according to the first signal strength, the first channel bandwidth allocated for the push terminal to wirelessly connect, the transmission frame rate of the push terminal for transmitting the audio and video data, the second signal strength allocated for the pull terminal to wirelessly connect, the second channel bandwidth allocated for the pull terminal, the rendering frame rate of the pull terminal for rendering the pull stream of the audio and video data, the acquisition coding resolution and the coding rate are determined and adjusted based on the state corresponding to the current network, and the push terminal is transmitted to the push terminal for pushing the audio and video data to the streaming media server after the acquisition coding resolution and the coding rate are set. Therefore, the network parameters of the push terminal and the pull terminal are obtained, so that the state of the current network is evaluated, the acquisition coding resolution and the coding rate which are suitable for the network state can be determined under the condition of network fluctuation, and after the acquisition coding resolution and the coding rate are applied to the push terminal, the push terminal and the pull terminal can still be performed with low delay, and the user experience of paperless conferences is ensured.
Considering that the method of gradually adjusting the acquisition coding resolution and the coding rate is more beneficial to the accurate control of the push stream parameters, in some embodiments of the present application, the acquisition coding resolution and the coding rate mentioned in the foregoing embodiments are described, the acquisition coding resolution may be a single-step adjustment acquisition coding resolution, the coding rate may be a single-step adjustment coding rate, and after the acquisition coding resolution and the coding rate are sent to the push stream terminal, the following procedure may be further included:
s1, after a streaming terminal pulls streaming of audio and video data from a streaming media server and renders the streaming, detecting definition and time delay of the audio and video information which is rendered currently.
It can be understood that the definition and time delay of the audio and video information rendered by the streaming terminal are related to the network parameters of the streaming terminal and the network parameters of the streaming terminal.
Specifically, the definition and the time delay of the audio and video information obtained by rendering can reflect the quality of the audio and video information displayed on the streaming terminal, and the definition is not higher than a definition threshold, or the time delay is not lower than a time delay threshold, which can indicate that the quality of the audio and video information displayed on the streaming terminal is low.
S2, judging whether the first condition and the second condition are met at the same time, if not, executing S3, and if so, executing S5.
The first condition is that the definition is higher than a definition threshold, and the second condition is that the time delay is lower than a time delay threshold.
Specifically, the definition threshold may represent that the definition of the basic viewing of the picture of the streaming terminal can be ensured under the current resource limitation condition. The delay threshold may represent a delay time that can ensure basic viewing of the pictures of the pull-stream terminal under the current resource limitation.
S3, determining the latest single-step acquisition coding resolution and the latest single-step coding code rate.
Specifically, the single-step acquisition encoding resolution may be custom or determined based on the difference between the sharpness and the sharpness threshold, and the difference between the time delay and the time delay threshold. The single step code rate may be custom or determined based on the difference between the sharpness and the sharpness threshold, and the difference between the delay and the delay threshold. When the definition is not higher than the definition threshold or the time delay is not lower than the time delay threshold, the single-step acquisition coding resolution and the single-step coding code rate which need to be adjusted can be determined.
And S4, transmitting the single-step acquisition coding resolution and the single-step coding code rate to the streaming terminal, so that the streaming terminal can stream the audio and video data to the streaming server after setting the single-step acquisition coding resolution and the single-step coding code rate, and returning to execute the step S1.
It can be appreciated that, since there may be a situation that the definition is higher than the definition threshold or the time delay is lower than the time delay threshold, that is, the quality of the audio/video information displayed on the pull-stream terminal may still be low, it is necessary to return to detecting the definition and the time delay again to determine whether the first condition and the second condition are satisfied simultaneously.
S5, suspending to determine the latest single-step acquisition coding resolution and the latest single-step coding rate.
Specifically, when the definition is higher than the definition threshold and the time delay is lower than the time delay threshold, the quality of the audio and video information displayed on the streaming terminal is qualified, and then the latest single-step acquisition coding resolution and the latest single-step coding code rate can be paused to be determined, so that paperless conferences can be carried out under the current push parameters.
In some embodiments of the present application, the process of determining the state of the current network in step S120 according to the first signal strength, the first channel bandwidth and the transmission frame rate in the push terminal parameter, and the second signal strength, the second channel bandwidth and the rendering frame rate in the pull terminal parameter is described, where the process may include the following three cases:
the method comprises the steps of firstly, determining the current network state as a first state when the first signal strength is lower than a first signal strength threshold, the first channel bandwidth is lower than a first channel bandwidth threshold, the transmission frame rate is lower than an effective transmission frame rate threshold, the second signal strength is lower than a second channel strength threshold, the second channel bandwidth is lower than a second channel bandwidth threshold and the rendering frame rate is lower than a rendering frame rate threshold.
Specifically, the first signal strength threshold may represent a standard that the wireless network signal strength of the push terminal can enable the audio and video data to be smoothly transmitted, the first channel bandwidth threshold may represent a normal bandwidth value allocated by the wireless network of the push terminal, the effective transmission frame rate threshold may represent a minimum standard value of a frame rate at which the push terminal transmits the audio and video data, the second channel strength threshold may represent a standard that the wireless network signal strength of the pull terminal can smoothly receive the audio and video data, the second channel bandwidth threshold may represent a normal bandwidth value allocated by the wireless network of the pull terminal, and the rendering frame rate threshold may represent a minimum standard value of a frame rate at which the pull terminal renders the pull stream of the audio and video data.
It will be appreciated that the first state may represent a state in which the current network is poor, since none of the first signal strength, the first channel bandwidth, the transmission frame rate, the second signal strength, the second channel bandwidth, and the rendering frame rate meet the respective defined criteria.
Based on the condition that the state corresponding to the current network is the first state, the process of determining to adjust the acquisition coding resolution of the audio and video data and adjust the coding rate of the audio and video data mentioned in the foregoing embodiment is described, where the process may include:
And determining that the acquisition encoding resolution of the adjusted audio and video data is smaller than the value of the current streaming terminal for acquiring and encoding the audio and video data, and determining that the encoding code rate of the adjusted audio and video data is smaller than the value of the encoding code rate of the current streaming terminal for streaming the audio and video data.
It can be understood that the current network state is poor, the acquisition encoding resolution needs to be adjusted downwards, so that the acquisition encoding resolution of the adjusted audio and video data can be determined to be smaller than the value of the resolution of the current push-stream terminal for acquiring and encoding the audio and video data, and meanwhile, the encoding code rate can be also adjusted downwards, namely, the encoding code rate of the adjusted audio and video data can be determined to be smaller than the value of the code rate of the current push-stream terminal for encoding the audio and video data in the push-stream process, so that the push-stream mode after the parameters are adjusted can adapt to the current network.
And secondly, when the first signal strength is not lower than the first signal strength threshold, the first channel bandwidth is not lower than the first channel bandwidth threshold, the transmission frame rate is not lower than the effective transmission frame rate threshold, the second signal strength is not lower than the second channel strength threshold, the second channel bandwidth is not lower than the second channel bandwidth threshold, and the rendering frame rate is not lower than the rendering frame rate threshold, determining that the state of the current network is the second state.
It will be appreciated that the second state may represent a better state for the current network, since the first signal strength, the first channel bandwidth, the transmission frame rate, the second signal strength, the second channel bandwidth, and the rendering frame rate all have reached the respective defined criteria.
Based on the fact that the state corresponding to the current network is the second state, the process of determining to adjust the acquisition coding resolution of the audio and video data and adjust the coding rate of the audio and video data, which are mentioned in the foregoing embodiment, is described, and the process may include:
and determining that the acquisition encoding resolution of the adjusted audio and video data is larger than the value of the current streaming terminal for acquiring and encoding the audio and video data, and determining that the encoding code rate of the adjusted audio and video data is larger than the value of the encoding code rate of the current streaming terminal for streaming the audio and video data.
It can be understood that the current network state is better, the acquisition and coding resolution can be adjusted to be higher, so that the acquisition and coding resolution of the adjusted audio and video data can be determined to be larger than the value of the current push terminal for acquiring and coding the audio and video data, and meanwhile, the coding code rate can be also adjusted to be higher, namely, the value of the coding code rate of the adjusted audio and video data can be determined to be larger than the value of the coding code rate of the current push terminal for pushing the audio and video data, so that the definition and the time delay are balanced.
Third, if the current network state is not the first state and is not the second state, determining that the current network state is the third state.
Specifically, when the first signal strength, the first channel bandwidth, the transmission frame rate, the second signal strength, the second channel bandwidth, and the rendering frame rate do not all fail to meet the respective defined criteria, and do not all meet the respective defined criteria, it may indicate that the current network state is not good or bad, and thus the third state may be general to the current network state.
Further, under the condition that the state corresponding to the current network is the third state, the differences among the first signal strength, the first channel bandwidth, the sending frame rate, the second signal strength, the second channel bandwidth and the rendering frame rate and the respective standard values can be analyzed to determine the acquisition coding resolution and the coding code rate of the audio and video data to be adjusted.
The description of the device for controlling the push parameters for implementing the push of the streaming media audio and video provided in the embodiment of the present application is provided below, and the device for controlling the push parameters for implementing the push of the streaming media audio and video described below and the method for controlling the push parameters for implementing the push of the streaming media audio and video described above may be referred to correspondingly with each other.
Referring to fig. 2, fig. 2 is a schematic structural diagram of a push parameter control device for implementing streaming media audio/video push according to an embodiment of the present application.
As shown in fig. 2, the apparatus may include:
a parameter obtaining unit 11, configured to obtain, when a push terminal continuously pushes audio and video data, a first signal strength of a wireless connection of the push terminal, a first channel bandwidth allocated to the wireless connection of the push terminal, a transmission frame rate of the push terminal for transmitting the audio and video data, a second signal strength of a wireless connection of a pull terminal, a second channel bandwidth allocated to the wireless connection of the pull terminal, and a rendering frame rate of a pull of the pull terminal for rendering the audio and video data;
a network state determining unit 12, configured to determine a current network state according to the first signal strength, the first channel bandwidth, the transmission frame rate, the second signal strength, the second channel bandwidth, and the rendering frame rate;
a push parameter determining unit 13, configured to determine to adjust a capture encoding resolution of the audio and video data and adjust an encoding rate of the audio and video data based on a state corresponding to the current network;
And the push parameter sending unit 14 is configured to send the acquisition coding resolution and the coding rate to the push terminal, so that the push terminal pushes the audio and video data to a streaming media server after setting the acquisition coding resolution and the coding rate.
Optionally, the acquisition coding resolution is a single-step adjustment acquisition coding resolution, and the coding rate is a single-step adjustment coding rate;
the apparatus further comprises:
the definition time delay detection unit is used for detecting the definition and time delay of the audio and video information currently rendered after the streaming terminal pulls the streaming of the audio and video data from the streaming media server and renders the streaming;
the single step adjustment parameter determining unit is used for determining the latest single step acquisition coding resolution and the latest single step coding code rate if a first condition and a second condition are not met, wherein the first condition is that the definition is higher than a definition threshold value, and the second condition is that the time delay is lower than a time delay threshold value;
a single step adjustment parameter sending unit, configured to send the single step acquisition encoding resolution and the single step encoding code rate to the push terminal, so that the push terminal, after setting the single step acquisition encoding resolution and the single step encoding code rate, pushes the audio/video data to the streaming media server, and returns to execute the sharpness delay detection unit;
And the pause determining unit is used for pausing and determining the latest single-step acquisition coding resolution and the latest single-step coding code rate if the first condition and the second condition are met at the same time.
Optionally, the network state determining unit includes:
a first state determining unit, configured to determine, when the first signal strength is lower than a first signal strength threshold, the first channel bandwidth is lower than a first channel bandwidth threshold, the transmission frame rate is lower than an effective transmission frame rate threshold, the second signal strength is lower than a second channel strength threshold, the second channel bandwidth is lower than a second channel bandwidth threshold, and the rendering frame rate is lower than a rendering frame rate threshold, that a state of a current network is a first state;
a second state determining unit configured to determine, when the first signal strength is not lower than the first signal strength threshold, the first channel bandwidth is not lower than the first channel bandwidth threshold, the transmission frame rate is not lower than the effective transmission frame rate threshold, the second signal strength is not lower than the second channel strength threshold, the second channel bandwidth is not lower than the second channel bandwidth threshold, and the rendering frame rate is not lower than the rendering frame rate threshold, that a state of a current network is a second state;
And the third state determining unit is used for determining that the current network state is a third state if the current network state is not the first state and is not the second state.
Optionally, the plug-flow parameter determining unit includes:
and the first state parameter determining unit is used for determining that the acquisition encoding resolution of the audio and video data is smaller than the current value of the resolution of the push terminal for acquiring and encoding the audio and video data when the state corresponding to the current network is the first state, and determining that the encoding code rate of the audio and video data is smaller than the current value of the code rate of the push terminal for encoding the audio and video data when the push terminal pushes the audio and video data.
Optionally, the plug-flow parameter determining unit includes:
and the second state parameter determining unit is used for determining that the acquisition coding resolution of the audio and video data is larger than the current value of the resolution of the push terminal for acquiring and coding the audio and video data when the state corresponding to the current network is the second state, and determining that the coding rate of the audio and video data is larger than the current value of the coding rate of the push terminal for pushing the audio and video data.
The device for controlling the push flow parameters of the streaming media audio and video push can be applied to push flow parameter control equipment of the streaming media audio and video push, such as a coordination director. Optionally, fig. 3 shows a hardware structure block diagram of a push parameter control device for streaming media audio/video push, and referring to fig. 3, the hardware structure of the push parameter control device for streaming media audio/video push may include: at least one processor 1, at least one communication interface 2, at least one memory 3 and at least one communication bus 4;
in the embodiment of the application, the number of the processor 1, the communication interface 2, the memory 3 and the communication bus 4 is at least one, and the processor 1, the communication interface 2 and the memory 3 complete communication with each other through the communication bus 4;
the memory 3 may comprise a high-speed RAM memory, and may further comprise a non-volatile memory (non-volatile memory) or the like, such as at least one magnetic disk memory;
wherein the memory stores a program, the processor is operable to invoke the program stored in the memory, the program operable to:
When a push terminal continuously pushes audio and video data, acquiring first signal intensity of wireless connection of the push terminal, first channel bandwidth allocated to wireless connection of the push terminal, transmission frame rate of the push terminal for transmitting the audio and video data, second signal intensity of wireless connection of a pull terminal, second channel bandwidth allocated to wireless connection of the pull terminal, and rendering frame rate of pull of the pull terminal for rendering the audio and video data;
determining a current network state according to the first signal strength, the first channel bandwidth, the transmission frame rate, the second signal strength, the second channel bandwidth and the rendering frame rate;
based on the state corresponding to the current network, determining to adjust the acquisition coding resolution of the audio and video data and the coding rate of the audio and video data;
and sending the acquisition coding resolution and the coding code rate to the push terminal so that the push terminal can push the audio and video data to a streaming media server after setting the acquisition coding resolution and the coding code rate.
Alternatively, the refinement function and the extension function of the program may be described with reference to the above.
The embodiment of the application also provides a storage medium, which may store a program adapted to be executed by a processor, the program being configured to:
when a push terminal continuously pushes audio and video data, acquiring first signal intensity of wireless connection of the push terminal, first channel bandwidth allocated to wireless connection of the push terminal, transmission frame rate of the push terminal for transmitting the audio and video data, second signal intensity of wireless connection of a pull terminal, second channel bandwidth allocated to wireless connection of the pull terminal, and rendering frame rate of pull of the pull terminal for rendering the audio and video data;
determining a current network state according to the first signal strength, the first channel bandwidth, the transmission frame rate, the second signal strength, the second channel bandwidth and the rendering frame rate;
based on the state corresponding to the current network, determining to adjust the acquisition coding resolution of the audio and video data and the coding rate of the audio and video data;
And sending the acquisition coding resolution and the coding code rate to the push terminal so that the push terminal can push the audio and video data to a streaming media server after setting the acquisition coding resolution and the coding code rate.
Alternatively, the refinement function and the extension function of the program may be described with reference to the above.
Finally, it is further noted that relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Moreover, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
In the present specification, each embodiment is described in a progressive manner, and each embodiment focuses on the difference from other embodiments, and may be combined according to needs, and the same similar parts may be referred to each other.
The previous description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present application. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the application. Thus, the present application is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
Claims (10)
1. A method for controlling push parameters of streaming media audio and video push is characterized by being applied to a coordination director and comprising the following steps:
when a push terminal continuously pushes audio and video data, acquiring first signal intensity of wireless connection of the push terminal, first channel bandwidth allocated to wireless connection of the push terminal, transmission frame rate of the push terminal for transmitting the audio and video data, second signal intensity of wireless connection of a pull terminal, second channel bandwidth allocated to wireless connection of the pull terminal, and rendering frame rate of pull of the pull terminal for rendering the audio and video data;
Determining a current network state according to the first signal strength, the first channel bandwidth, the transmission frame rate, the second signal strength, the second channel bandwidth and the rendering frame rate;
based on the state corresponding to the current network, determining to adjust the acquisition coding resolution of the audio and video data and the coding rate of the audio and video data;
and sending the acquisition coding resolution and the coding code rate to the push terminal so that the push terminal can push the audio and video data to a streaming media server after setting the acquisition coding resolution and the coding code rate.
2. The method of claim 1, wherein the acquisition encoding resolution is a single step adjusted acquisition encoding resolution and the encoding rate is a single step adjusted encoding rate;
after the acquisition coding resolution and the coding rate are sent to the push terminal, the method further comprises the following steps:
after the streaming terminal pulls the streaming of the audio and video data from the streaming media server and renders the streaming, detecting the definition and time delay of the audio and video information which is currently rendered;
if the first condition and the second condition are not met, determining the latest single-step acquisition coding resolution and the latest single-step coding code rate, wherein the first condition is that the definition is higher than a definition threshold, and the second condition is that the time delay is lower than a time delay threshold;
The single-step acquisition coding resolution and the single-step coding code rate are sent to the streaming terminal, so that the streaming terminal can push the audio and video data to the streaming media server after setting the single-step acquisition coding resolution and the single-step coding code rate, and the step of detecting the definition and the time delay of the audio and video information which are currently rendered after the streaming terminal pulls the streaming of the streaming media server from the streaming media server and renders the streaming is performed;
if the first condition and the second condition are met at the same time, the latest single-step acquisition coding resolution and the latest single-step coding rate are paused to be determined.
3. The method of claim 1, wherein determining the current network state based on the first signal strength, the first channel bandwidth, the transmit frame rate, the second signal strength, the two-channel bandwidth, and the render frame rate comprises:
when the first signal strength is lower than a first signal strength threshold, the first channel bandwidth is lower than a first channel bandwidth threshold, the transmission frame rate is lower than an effective transmission frame rate threshold, the second signal strength is lower than a second channel strength threshold, the second channel bandwidth is lower than a second channel bandwidth threshold, and the rendering frame rate is lower than a rendering frame rate threshold, determining that the current network state is a first state;
Determining that the current network state is a second state when the first signal strength is not lower than the first signal strength threshold, the first channel bandwidth is not lower than the first channel bandwidth threshold, the transmission frame rate is not lower than the effective transmission frame rate threshold, the second signal strength is not lower than the second channel strength threshold, the second channel bandwidth is not lower than the second channel bandwidth threshold, and the rendering frame rate is not lower than the rendering frame rate threshold;
and if the state of the current network is not the first state and is not the second state, determining that the state of the current network is a third state.
4. The method of claim 3, wherein determining to adjust the acquisition encoding resolution of the audio-video data and adjusting the encoding rate of the audio-video data based on the state corresponding to the current network comprises:
and when the state corresponding to the current network is a first state, determining that the acquisition coding resolution of the audio and video data is smaller than the value of the current streaming terminal for acquiring and coding the audio and video data, and determining that the coding rate of the audio and video data is smaller than the value of the current streaming terminal for coding the audio and video data.
5. The method of claim 3, wherein determining to adjust the acquisition encoding resolution of the audio-video data and adjusting the encoding rate of the audio-video data based on the state corresponding to the current network comprises:
and when the state corresponding to the current network is a second state, determining that the acquisition coding resolution of the audio and video data is adjusted to be larger than the value of the current resolution of the push terminal for acquiring and coding the audio and video data, and determining that the coding rate of the audio and video data is adjusted to be larger than the value of the coding rate of the current push terminal for pushing the audio and video data.
6. The device is characterized by being applied to a coordination director and comprising the following components:
the parameter acquisition unit is used for acquiring first signal intensity of wireless connection of the push terminal, first channel bandwidth allocated to wireless connection of the push terminal, transmission frame rate of the push terminal for transmitting the audio and video data, second signal intensity of wireless connection of the pull terminal, second channel bandwidth allocated to wireless connection of the pull terminal, and rendering frame rate of pull of the pull terminal for rendering the audio and video data when the push terminal continuously pushes the audio and video data;
A network state determining unit, configured to determine a current state of a network according to the first signal strength, the first channel bandwidth, the transmission frame rate, the second signal strength, the second channel bandwidth, and the rendering frame rate;
the plug flow parameter determining unit is used for determining and adjusting the acquisition coding resolution of the audio and video data and adjusting the coding rate of the audio and video data based on the state corresponding to the current network;
and the pushing parameter sending unit is used for sending the acquisition coding resolution and the coding rate to the pushing terminal so that the pushing terminal can push the audio and video data to a streaming media server after setting the acquisition coding resolution and the coding rate.
7. The apparatus of claim 6, wherein the acquisition encoding resolution is a single step adjusted acquisition encoding resolution and the encoding rate is a single step adjusted encoding rate;
the apparatus further comprises:
the definition time delay detection unit is used for detecting the definition and time delay of the audio and video information currently rendered after the streaming terminal pulls the streaming of the audio and video data from the streaming media server and renders the streaming;
The single step adjustment parameter determining unit is used for determining the latest single step acquisition coding resolution and the latest single step coding code rate if a first condition and a second condition are not met, wherein the first condition is that the definition is higher than a definition threshold value, and the second condition is that the time delay is lower than a time delay threshold value;
a single step adjustment parameter sending unit, configured to send the single step acquisition encoding resolution and the single step encoding code rate to the push terminal, so that the push terminal, after setting the single step acquisition encoding resolution and the single step encoding code rate, pushes the audio/video data to the streaming media server, and returns to execute the sharpness delay detection unit;
and the pause determining unit is used for pausing and determining the latest single-step acquisition coding resolution and the latest single-step coding code rate if the first condition and the second condition are met at the same time.
8. The apparatus according to claim 6, wherein the network status determining unit comprises:
a first state determining unit, configured to determine, when the first signal strength is lower than a first signal strength threshold, the first channel bandwidth is lower than a first channel bandwidth threshold, the transmission frame rate is lower than an effective transmission frame rate threshold, the second signal strength is lower than a second channel bandwidth threshold, the second channel bandwidth is lower than a second channel bandwidth threshold, and the rendering frame rate is lower than a rendering frame rate threshold, that a state of a current network is a first state;
A second state determining unit, configured to determine, when the first signal strength is not lower than a first signal strength threshold, the first channel bandwidth is not lower than a first channel bandwidth threshold, the transmission frame rate is not lower than an effective transmission frame rate threshold, the second signal strength is not lower than a second channel bandwidth threshold, the second channel bandwidth is not lower than a second channel bandwidth threshold, and the rendering frame rate is not lower than a rendering frame rate threshold, that a state of a current network is a second state;
and the third state determining unit is used for determining that the current network state is a third state if the current network state is not the first state and is not the second state.
9. The device for controlling the push stream parameters of the streaming media audio and video push is characterized by comprising a memory and a processor;
the memory is used for storing programs;
the processor is configured to execute the program, and implement the steps of the method for controlling a push parameter for pushing streaming media audio and video according to any one of claims 1 to 5.
10. A storage medium having stored thereon a computer program, which, when executed by a processor, implements the steps of the push stream parameter control method for streaming audio video push according to any of claims 1-5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310290525.2A CN116260801A (en) | 2023-03-22 | 2023-03-22 | Stream media audio and video push stream parameter control method and related device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310290525.2A CN116260801A (en) | 2023-03-22 | 2023-03-22 | Stream media audio and video push stream parameter control method and related device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN116260801A true CN116260801A (en) | 2023-06-13 |
Family
ID=86682538
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310290525.2A Pending CN116260801A (en) | 2023-03-22 | 2023-03-22 | Stream media audio and video push stream parameter control method and related device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116260801A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116528375A (en) * | 2023-06-28 | 2023-08-01 | 浙江大华技术股份有限公司 | Bandwidth prediction method, bandwidth prediction device, and computer-readable storage medium |
-
2023
- 2023-03-22 CN CN202310290525.2A patent/CN116260801A/en active Pending
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116528375A (en) * | 2023-06-28 | 2023-08-01 | 浙江大华技术股份有限公司 | Bandwidth prediction method, bandwidth prediction device, and computer-readable storage medium |
| CN116528375B (en) * | 2023-06-28 | 2023-09-29 | 浙江大华技术股份有限公司 | Bandwidth prediction method, bandwidth prediction device, and computer-readable storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP4486130B2 (en) | Video communication quality estimation apparatus, method, and program | |
| CN104756099B (en) | Add content and associated client device | |
| CN110149555B (en) | Video processing method and video receiving device | |
| CN108881972B (en) | Code rate allocation method, device, equipment and storage medium | |
| US10032475B2 (en) | Enhancing an audio recording | |
| TW201026064A (en) | Method for audio and video control response and bandwidth adaptation based on network streaming application and server using the same | |
| EP2879379A1 (en) | Method, device and system for media negotiation in multi-stream meeting | |
| WO2012103820A2 (en) | Method, device, and system for highlighting party of interest | |
| EP3070935B1 (en) | Apparatus, system, and method of controlling output of content data, and carrier means | |
| US20140157294A1 (en) | Content providing apparatus, content providing method, image displaying apparatus, and computer-readable recording medium | |
| CN116260801A (en) | Stream media audio and video push stream parameter control method and related device | |
| CN110300278A (en) | Video transmission method and equipment | |
| CN104581340A (en) | Client-side, streaming media data receiving method and streaming media data transmission system | |
| CN110602425A (en) | Video definition adjusting method, system, computer readable storage medium and terminal | |
| US20200106821A1 (en) | Video processing apparatus, video conference system, and video processing method | |
| CN111314738A (en) | Data transmission method and device | |
| KR101879439B1 (en) | Method for video service using adaptive bitrate | |
| JP7157194B2 (en) | Mediation method and computer readable recording medium | |
| CN116962613A (en) | Data transmission method and device, computer equipment and storage medium | |
| US10182207B2 (en) | Handling nuisance in teleconference system | |
| CN114866763A (en) | Video quality evaluation method and device, terminal equipment and storage medium | |
| CN113014940A (en) | Live broadcast optimization method and device | |
| JP2013030852A (en) | Scalable video encoding device and method and program | |
| CN110913235A (en) | Access control method and device for large-scale live broadcast and electronic equipment | |
| CN115119010B (en) | Wheat connecting method, device, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |