CN115118636A - Method and device for determining network jitter state, electronic equipment and storage medium - Google Patents
Method and device for determining network jitter state, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN115118636A CN115118636A CN202210667054.8A CN202210667054A CN115118636A CN 115118636 A CN115118636 A CN 115118636A CN 202210667054 A CN202210667054 A CN 202210667054A CN 115118636 A CN115118636 A CN 115118636A
- Authority
- CN
- China
- Prior art keywords
- jitter
- network
- media data
- determining
- preset
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 43
- 230000005540 biological transmission Effects 0.000 claims abstract description 97
- 230000001934 delay Effects 0.000 claims abstract description 19
- 238000004590 computer program Methods 0.000 claims description 8
- 230000006870 function Effects 0.000 description 8
- 238000004891 communication Methods 0.000 description 7
- 238000010586 diagram Methods 0.000 description 7
- 238000012545 processing Methods 0.000 description 6
- 238000005516 engineering process Methods 0.000 description 5
- 230000008569 process Effects 0.000 description 4
- 230000009286 beneficial effect Effects 0.000 description 3
- 238000001514 detection method Methods 0.000 description 3
- 230000007704 transition Effects 0.000 description 3
- 230000001133 acceleration Effects 0.000 description 2
- 238000004422 calculation algorithm Methods 0.000 description 2
- 230000005484 gravity Effects 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 238000007726 management method Methods 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000005236 sound signal Effects 0.000 description 2
- 238000012896 Statistical algorithm Methods 0.000 description 1
- 230000006978 adaptation Effects 0.000 description 1
- 238000013473 artificial intelligence Methods 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000007599 discharging Methods 0.000 description 1
- 230000002349 favourable effect Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 230000007774 longterm Effects 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 238000010079 rubber tapping Methods 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 238000010897 surface acoustic wave method Methods 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/08—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
- H04L43/0852—Delays
- H04L43/087—Jitter
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/16—Threshold monitoring
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/50—Testing arrangements
Abstract
The present disclosure relates to a method, an apparatus, an electronic device and a storage medium for determining a network jitter state, wherein the method comprises: determining the network transmission delay of each media data packet in a preset time period before the current time; determining a first jitter state of network jitter based on a difference value of network transmission time delays between target adjacent media data packets; the target adjacent media data packets refer to two media data packets closest to the current time within a preset time period; when the first jitter state indicates that the network jitter degree does not exceed the preset jitter degree, determining a second jitter state of the network jitter according to the target statistical time delay; the target statistical delay is determined based on the network transmission delay of each media data packet in a preset time period. The method and the device have the advantages that the convergence speed of large jitter (namely exceeding the preset jitter degree) judgment is improved, and meanwhile, the more accurate indication is made on the network jitter degree, so that the real-time streaming media system can respond to the network jitter more quickly and accurately.
Description
Technical Field
The present disclosure relates to the field of internet technologies, and in particular, to a method and an apparatus for determining a network jitter state, an electronic device, and a storage medium.
Background
With the development of internet technology, communication is increasingly performed by using real-time streaming media applications in terminals, such as video conference applications, and in real-time streaming media applications such as video conferences, a transmission system often judges the current network condition by using acquired end-to-end transmission delay in order to control end-to-end transmission delay, so as to avoid congestion during data transmission and ensure timeliness of data. In practical application, the network jitter directly affects the end-to-end transmission delay acquired by the transmission system, so that the judgment of the transmission system on the network condition is affected, and the accurate judgment of the network jitter is one of the important preconditions that the transmission system can operate well.
In the related art, the transmission system uses a Congestion Control algorithm (GCC) proposed by Google to Control the code rate of the transmitting end, but the GCC directly uses a kalman filter to filter the network jitter in the network delay, i.e., filters the network jitter by a moving average, and cannot quickly and accurately determine the degree of the network jitter, so that the network jitter cannot be quickly and accurately handled.
Disclosure of Invention
The present disclosure provides a method and an apparatus for determining a network jitter state, an electronic device, and a storage medium, so as to at least solve the problem in the related art that a network jitter state cannot be determined quickly and accurately. The technical scheme of the disclosure is as follows:
according to a first aspect of the embodiments of the present disclosure, there is provided a method for determining a network jitter state, including:
determining the network transmission delay of each media data packet in a preset time period before the current time;
determining a first jitter state of network jitter based on a difference value of network transmission time delays between target adjacent media data packets; the target adjacent media data packets refer to two media data packets closest to the current time within the preset time period;
when the first jitter state indicates that the network jitter degree does not exceed the preset jitter degree, determining a second jitter state of the network jitter according to target statistical time delay; and the target statistical time delay is determined based on the network transmission time delay of each media data packet in the preset time period.
In an exemplary embodiment, the determining a first jitter state of the network jitter based on a difference in network transmission delay between target adjacent media data packets includes:
acquiring a first preset threshold;
when the difference value of the network transmission time delay between the target adjacent media data packets is larger than the first preset threshold value, determining that the first jitter state is a jitter state in which the network jitter degree exceeds the preset jitter degree;
and when the difference value of the network transmission time delay between the target adjacent media data packets is smaller than or equal to the first preset threshold value, determining that the first jitter state is a jitter state in which the network jitter degree does not exceed the preset jitter degree.
In an exemplary embodiment, the determining the second jitter state of the network jitter according to the target statistical delay includes:
acquiring a second preset threshold; the second preset threshold is smaller than the first preset threshold;
and when the target statistical time delay is greater than the second preset threshold, determining that the second jitter state is a jitter state with network jitter and the network jitter degree is less than the preset jitter degree.
In an exemplary embodiment, the method further comprises:
and when the target statistical time delay is smaller than or equal to the second preset threshold, determining that the second jitter state is a state without network jitter.
In an exemplary embodiment, the determining the network transmission delay of each media data packet in a preset time period before the current time includes:
determining a media data packet in a preset packet window; the media data packets in the preset packet window comprise the current media data packet;
and acquiring the network transmission delay of each media data packet in the preset packet window.
In an exemplary embodiment, before determining the second jitter state of the network jitter according to the target statistical delay, the method further includes:
determining the average value of the network transmission time delay of each media data packet in the preset time period to obtain the average network transmission time delay;
obtaining a deviation time delay corresponding to each media data packet based on the difference between the network transmission time delay of each media data packet and the average network transmission time delay;
and determining the target statistical time delay based on the deviation time delay corresponding to each media data packet.
According to a second aspect of the embodiments of the present disclosure, there is provided an apparatus for determining a network jitter state, including:
the time delay determining unit is configured to determine the network transmission time delay of each media data packet in a preset time period before the current time;
a first jitter state determination unit configured to perform determining a first jitter state of a network jitter based on a difference in network transmission delay between target adjacent media data packets; the target adjacent media data packets refer to two media data packets closest to the current time within the preset time period;
a second jitter state determination unit configured to determine a second jitter state of the network jitter according to a target statistical delay when the first jitter state indicates that the network jitter degree does not exceed a preset jitter degree; and the target statistical time delay is determined based on the network transmission time delay of each media data packet in the preset time period.
In one exemplary embodiment, the first jitter state determining unit includes:
a first threshold acquisition unit configured to perform acquisition of a first preset threshold;
a first determining unit, configured to determine that the first jitter state is a jitter state in which a network jitter degree exceeds a preset jitter degree when a difference value of network transmission delays between the target adjacent media data packets is greater than a first preset threshold;
a second determining unit, configured to determine that the first jitter state is a jitter state in which the network jitter degree does not exceed the preset jitter degree when a difference value of network transmission delays between the target adjacent media data packets is smaller than or equal to the first preset threshold.
In one exemplary embodiment, the second jitter state determining unit includes:
a second threshold acquisition unit configured to perform acquisition of a second preset threshold; the second preset threshold is smaller than the first preset threshold;
and the third determining unit is configured to determine that the second jitter state is a jitter state in which network jitter exists and the network jitter degree is smaller than the preset jitter degree when the target statistical time delay is greater than the second preset threshold.
In an exemplary embodiment, the second jitter state determining unit further includes:
a fourth determining unit, configured to determine that the second jitter state is a state in which network jitter does not exist when the target statistical time delay is less than or equal to the second preset threshold.
In an exemplary embodiment, the time delay determining unit is specifically configured to perform: determining a media data packet in a preset packet window; the media data packets in the preset packet window comprise the current media data packet; and acquiring the network transmission delay of each media data packet in the preset packet window.
In an exemplary embodiment, the apparatus further comprises:
the average network transmission delay determining unit is configured to determine an average value of the network transmission delays of the media data packets in the preset time period to obtain an average network transmission delay;
a deviation delay determining unit configured to perform a difference between the network transmission delay of each media data packet and the average network transmission delay to obtain a deviation delay corresponding to each media data packet;
and the target statistical time delay determining unit is configured to determine the target statistical time delay based on the deviation time delay corresponding to each media data packet.
According to a third aspect of the embodiments of the present disclosure, there is provided an electronic apparatus including:
a processor;
a memory for storing the processor-executable instructions;
wherein the processor is configured to execute the instructions to implement the method for determining a network jitter status of the first aspect.
According to a fourth aspect of embodiments of the present disclosure, there is provided a computer-readable storage medium, wherein instructions of the computer-readable storage medium, when executed by a processor of an electronic device, enable the electronic device to perform the method for determining a network jitter status of the first aspect.
According to a fifth aspect of embodiments of the present disclosure, there is provided a computer program product comprising a computer program/instructions which, when executed by a processor, implement the method for determining a network jitter status of the first aspect described above.
The technical scheme provided by the embodiment of the disclosure at least brings the following beneficial effects:
the network transmission delay of each media data packet in a preset time period before the current time is determined, a first jitter state of the network jitter is determined based on the difference value of the network transmission delays between two media data packets closest to the current time, when the first jitter state indicates that the network jitter degree does not exceed the preset jitter degree, a target statistical delay is determined according to the network transmission delays of the media data packets in the preset time period, and a second jitter state of the network jitter is determined according to the target statistical delay, so that the convergence rate of large jitter (namely, the convergence rate of large jitter exceeding the preset jitter degree) determination is improved, and meanwhile, a more accurate indication is made on the network jitter degree, and a real-time streaming media system can respond to the network jitter more quickly and accurately.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the disclosure and are not to be construed as limiting the disclosure.
FIG. 1 is a schematic diagram illustrating an application environment in accordance with an illustrative embodiment;
FIG. 2 is a flow chart illustrating a method of network jitter status determination in accordance with an exemplary embodiment;
FIG. 3 is a flow chart illustrating another method of network jitter status determination in accordance with an exemplary embodiment;
FIG. 4 is a schematic diagram illustrating network jitter state transitions in accordance with an exemplary embodiment;
FIG. 5 is a block diagram illustrating an apparatus for determining a network jitter condition in accordance with an exemplary embodiment;
FIG. 6 is a block diagram illustrating an electronic device in accordance with an example embodiment.
Detailed Description
In order to make the technical solutions of the present disclosure better understood by those of ordinary skill in the art, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below with reference to the accompanying drawings.
It should be noted that the terms "first," "second," and the like in the description and claims of the present disclosure and in the above-described drawings are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the disclosure described herein are capable of operation in sequences other than those illustrated or otherwise described herein. The implementations described in the exemplary embodiments below do not represent all implementations consistent with the present disclosure. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present disclosure, as detailed in the appended claims.
It should also be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data for presentation, analyzed data, etc.) referred to in the present disclosure are both information and data that are authorized by the user or sufficiently authorized by various parties.
In the related technology, real-time streaming media application such as real-time audio and video application adopts a congestion control algorithm GCC to control the code rate of a sending end when real-time audio and video transmission is carried out, but the GCC filters network jitter in a sliding average mode, and the network jitter has certain burstiness due to the fact that the convergence speed of the sliding average is not fast enough, so that the related technology mistakenly considers that congestion exists in a network and mistakenly carries out backoff when dealing with the bursty network jitter; in addition, the related art cannot accurately determine the degree of network jitter, and thus cannot accurately cope with the network jitter.
Based on this, the embodiment of the present disclosure provides a method for determining a network jitter state, where the method determines a first jitter state of a network jitter by using a difference between network transmission delays of two media data packets closest to a current time within a preset time period before the current time, and determines a second jitter state of the network jitter according to a target statistical delay when the first jitter state indicates that a network jitter degree does not exceed a preset jitter degree, so as to improve accuracy of determining the network jitter degree while accelerating determination of the network jitter degree, and further enable a real-time audio/video system to respond to the network jitter more quickly and accurately.
Referring to fig. 1, a schematic diagram of an application environment of a method for determining a network jitter state according to an exemplary embodiment is shown, where the application environment may include a first terminal 110, a second terminal 120, and a server 130, where the first terminal 110 and the server 130, and the second terminal 120 and the server 130 may be connected through a wired network or a wireless network.
The first terminal 110 and the second terminal 120 may be, but are not limited to, a smart phone, a tablet computer, a notebook computer, a desktop computer, and the like. The first terminal 110 and the second terminal 120 run a real-time streaming media Application (App), which may be an independent Application or a sub-program in the Application. Illustratively, the real-time streaming media-like application may include a real-time audio-video application as shown in fig. 1, such as a video conferencing application or the like. A user of a terminal (110, 120) may log into an application through pre-registered user information, which may include an account number and a password.
The first terminal 110 and the second terminal 120 interact based on a real-time streaming media application, in a real-time streaming media interaction process, the first terminal 110 may serve as a sending end to send a media data packet to the second terminal 120, and at this time, the second terminal 120 serves as a receiving end of the media data packet, it can be understood that the second terminal 120 may also serve as a sending end to send a media data packet to the first terminal 110, and at this time, the first terminal 110 serves as a receiving end of the media data packet.
The server 130 may be a server that provides a background service for an application in the terminal (110, 120), and the server 130 may be an independent physical server, a server cluster or a distributed system formed by a plurality of physical servers, an edge computing node, or a cloud server that provides basic cloud computing services such as a cloud service, a cloud database, cloud computing, a cloud function, cloud storage, a Network service, cloud communication, a middleware service, a domain name service, a security service, a CDN (Content Delivery Network), a big data and an artificial intelligence platform.
It should be noted that the method for determining a network jitter state according to the embodiment of the present disclosure may be executed by a device for determining a network jitter state, where the device for determining a network jitter state may be configured in an electronic device, and the electronic device may be a sending end of a media data packet in a real-time streaming media interaction process, a receiving end of the media data packet, or a server. The method for determining a network jitter state according to the embodiment of the present disclosure is described below by taking an example in which an execution subject is an electronic device.
Fig. 2 is a flowchart illustrating a method for determining a network jitter status according to an exemplary embodiment, which includes the following steps as shown in fig. 2.
In step S201, the network transmission delay of each media data packet in a preset time period before the current time is determined.
The media data may be audio data, video data, or audio-video data. In the embodiment of the present disclosure, a sending end of media data packages the media data into individual media data packages, and sends the packaged media data packages to a receiving end, and the receiving end decodes the received media data packages to obtain the media data. Media data transmission may be implemented based on Real-time Transport Protocol (RTP).
The network transmission delay may be a difference between a receiving time and a sending time of the media data packet, and represents an end-to-end delay of the media data packet. In the embodiment of the disclosure, the electronic device records the network transmission delay of each media data packet according to the transmission sequence of the media data packets.
The preset time period may be set according to actual needs, and may be, for example, 500 milliseconds, 1 minute, and the like.
Specifically, the electronic device may respond to a network jitter state determination instruction to trigger determining a network transmission delay of each media data packet within a preset time period before the current time and perform a network jitter state determination process, where the network jitter state determination instruction may be generated when the current media data packet completes network transmission.
In step S203, a first jitter state of the network jitter is determined based on a difference in network transmission delay between target adjacent media data packets.
The target adjacent media data packets refer to two media data packets closest to the current time within the preset time period.
The first jitter status indicates whether the network jitter degree exceeds a preset jitter degree, which is a minimum network jitter degree that may have a large impact on the estimation of the queuing delay. When the first jitter state indicates that the network jitter state exceeds the preset jitter degree, the current network jitter is indicated to have a large influence on the estimation of the queuing delay, and the current network jitter can be considered to be in a large jitter state; when the first jitter state indicates that the network jitter degree does not exceed the preset jitter degree, it indicates that the network jitter does not have a large influence on the estimation of the queuing delay, and it can be considered that the current network jitter is not in a large jitter state.
Suppose that two media data packets closest to the current time within a preset time period before the current time are a media data packet An and a media data packet A n-1 Then can be based on (D) An -D An-1 ) To determine a first jitter state of the network jitter, wherein D An Representing the network transmission delay of the media data packet An, D An-1 Representing media data packet a n-1 Network transmission delay.
In step S205, when the first jitter state indicates that the network jitter degree does not exceed the preset jitter degree, a second jitter state of the network jitter is determined according to the target statistical delay.
The target statistical time delay is a statistical value obtained by performing statistical processing on the network transmission time delay of each media data packet in a preset time period before the current time based on a preset statistical algorithm.
Based on this, in an exemplary embodiment, before determining the second jitter state of the network jitter according to the target statistical delay, the method may further include determining the target statistical delay, and the determining the target statistical delay may include the steps of:
determining the average value of the network transmission time delay of each media data packet in the preset time period to obtain the average network transmission time delay;
obtaining the deviation time delay corresponding to each media data packet based on the difference between the network transmission time delay of each media data packet and the average network transmission time delay;
and determining the target statistical time delay based on the deviation time delay corresponding to each media data packet.
Specifically, when the target statistical time delay is determined based on the deviation time delays corresponding to the media data packets, the average of the squares of the deviation time delays can be calculated to obtain a variance, and the variance is used as the target statistical time delay; and further calculating a standard deviation after calculating the variance, and taking the standard deviation as a target statistical time delay.
In the above embodiment, by determining the average network transmission delay, obtaining each deviation delay based on the difference between the network transmission delay of each media data packet and the average network transmission delay, and further determining the target statistical delay based on each deviation delay, the stability of the network transmission delay in the preset time period can be accurately measured, which is favorable for improving the accuracy of determining the second jitter state.
Specifically, if the first jitter state indicates that the network jitter degree does not exceed the preset jitter degree, it indicates that the current network jitter degree does not have a large influence on the estimation of the queuing delay, that is, the current network jitter is not in a large jitter state.
It is understood that the second jitter status indicates a network jitter degree smaller than the preset jitter degree, and for example, the second jitter status may indicate that no network jitter exists and may also indicate that network jitter exists and the network jitter degree is smaller than the preset jitter degree.
According to the technical scheme of the embodiment of the disclosure, the first jitter state of the network jitter is determined according to the difference value of the network transmission time delay between the target adjacent data packets in the preset time period before the current time, so that the convergence speed of jitter, especially large jitter judgment can be increased, and a real-time audio/video system can respond to the network jitter more quickly; and when the first jitter state indicates that the network jitter degree does not exceed the preset jitter degree, a second jitter state of the network jitter is further determined by combining target statistics of transmission delay of each network in a preset time period, so that the network jitter state is more accurately indicated, and a real-time audio/video system can make more accurate response to the network jitter.
In an exemplary embodiment, in order to improve the accuracy of determining the network jitter status, the step S201 may include:
determining a media data packet in a preset packet window; the media data packet in the preset packet window comprises a current media data packet;
and acquiring the network transmission delay of each media data packet in the preset packet window.
The preset packet window indicates a preset number of media data packets, the preset number of media data packets includes a current media data packet, that is, the preset packet window may frame n media data packets, the n media data packets include the current media data packet and n-1 historical media data packets before the current media data packet, the current media data packet may refer to a currently transmitted media data packet or a currently received media data packet, that is, the current media data packet is a last media data packet transmitted in a network before a current time.
In the above embodiment, the network transmission delay of each media data packet in the preset time period before the current time is determined based on the preset packet window, so that the network jitter state can be more conveniently determined and the accuracy can be ensured.
In an exemplary embodiment, a first preset threshold for determining may be designed for the first jitter state, where the first preset threshold represents a preset network jitter degree, where the preset jitter degree refers to a minimum network jitter degree that may have a large influence on the estimation of the queuing delay, and the first preset threshold may be set according to practical experience, for example, the first preset threshold may be 200 milliseconds. Based on this, as shown in the flowchart of another method for determining a network jitter state provided in fig. 3, in step S203, determining a first jitter state of the network jitter based on a difference between network transmission delays of target adjacent media data packets may include:
in step S301, a first preset threshold is acquired.
In step S303, it is determined whether the difference between the network transmission delays of the target adjacent media data packets is greater than a first preset threshold.
Specifically, if the difference between the network transmission delays of the target adjacent media data packets is greater than the first preset threshold, step S305 is executed to determine that the first jitter state is a jitter state in which the network jitter degree exceeds the preset jitter degree, that is, the current network jitter is in a large jitter state.
Otherwise, if the difference between the network transmission delays of the target adjacent media data packets is smaller than or equal to the first preset threshold, step S307 is executed to determine that the first jitter state is a jitter state in which the network jitter degree does not exceed the preset jitter degree, that is, the current network jitter is not in a large jitter state.
In the above embodiment, the first preset threshold for determination is designed for the first jitter state, which is beneficial to improving the speed and accuracy of determination for the first jitter state.
Similarly, in an exemplary embodiment, a second preset threshold for determining the second jitter state may be set for the second jitter state, and since the second jitter state is determined when the first jitter state indicates that the network jitter degree does not exceed the preset jitter degree, that is, the determination of the second jitter state is triggered when it is determined that the network jitter is not in a large jitter state, the second preset threshold for determining the second jitter state is obviously smaller than the first preset threshold for determining the first jitter state. Taking the first preset threshold as 200 ms as an example, the second preset threshold may be set to 13 ms. Based on this, with continuing reference to fig. 3, the step S205 may include, when determining the second jitter status of the network jitter according to the target statistical delay:
in step S309, a second preset threshold is acquired.
Wherein the second preset threshold is smaller than the first preset threshold. The second preset threshold represents that network jitter exists and the network jitter degree is smaller than the preset jitter degree, that is, the second preset threshold can represent the minimum network jitter degree which has less influence on the estimation of the queuing delay.
In step S311, it is determined whether the target statistical time delay is greater than a second preset threshold.
Specifically, if the target statistical delay is greater than the second preset threshold, step S313 is executed to determine that the second jitter state is a jitter state in which network jitter exists and the network jitter degree is less than the preset jitter degree, that is, the current network jitter is in a small jitter state.
Otherwise, if the target statistical delay is less than or equal to the second preset threshold, step S315 is executed to determine that the second jitter state is a state without network jitter, that is, the current network jitter is in a state without jitter.
In the above embodiment, the second preset threshold for determination is set for the second shake state, which is beneficial to improving the speed and accuracy of determination for the second shake state. And the second jitter state is subdivided into two states of small jitter and no jitter by combining with a second preset threshold value, so that the real-time audio and video system can more accurately respond to the network jitter.
In order to facilitate understanding of the technical solutions of the embodiments of the present disclosure, the technical solutions of the embodiments of the present disclosure are described below with reference to fig. 4.
As shown in fig. 4, the first preset threshold is represented as large _ jitter _ threshold, the second preset threshold is represented as small _ jitter _ threshold, the difference of network transmission delays between target adjacent media data packets (referred to as network transmission delay difference in fig. 4 for short) is represented as delta _ delay, and the target statistical delay is represented as var _ delay by taking variance as an example, when determining the network jitter state, it is determined whether the network jitter state satisfies:
delta_delay＞large_jitter_threshold
if the judgment condition is met, determining that the current network jitter state is large jitter, namely the current network jitter degree exceeds the preset jitter degree; otherwise, if the above-mentioned judgment condition is not satisfied, further judging whether:
var_delay＞small_jitter_threshold
if the judgment condition is met, determining that the network jitter exists when the current network jitter state is small jitter and the network jitter degree is smaller than the preset jitter degree; otherwise, if the judgment condition is not met, the current network jitter state is determined to be no jitter, namely no network jitter exists.
As can be seen from the above, 1) the network jitter state transition between the no-jitter state and the small-jitter state is mainly based on var _ delay, and once: if var _ delay is greater than small _ jitter _ threshold, the network jitter state enters a small jitter state; otherwise, if var _ delay is less than or equal to small _ jitter _ threshold, the network jitter state enters a jitter-free state. 2) The state transition between the large jitter state and the other two states is mainly based on delta _ delay, once: if delta _ delay is greater than large _ jitter _ threshold, the network jitter state enters a large jitter state; if delta _ delay is less than or equal to large _ jitter _ threshold and var _ delay is greater than small _ jitter _ threshold, the network jitter state enters a small jitter state; if the following conditions are met:
and delta _ delay is less than or equal to large _ jitter _ threshold and more than or equal to small _ jitter _ threshold, the network jitter state enters a jitter-free state. The network jitter degree is classified to make different indications, the accuracy of the real-time audio and video system in judging the network state is improved, and meanwhile, the convergence speed of large jitter judgment is increased by the time delay difference value between target adjacent media data packets, so that the real-time audio and video system can respond to the network jitter more quickly.
Fig. 5 is a block diagram illustrating an apparatus for determining a network jitter status according to an example embodiment. Referring to fig. 5, the network jitter state determining apparatus 500 includes:
a delay determining unit 510 configured to determine a network transmission delay of each media data packet in a preset time period before the current time;
a first jitter status determining unit 520 configured to perform determining a first jitter status of a network jitter based on a difference in network transmission delay between target adjacent media data packets; the target adjacent media data packets refer to two media data packets closest to the current time within the preset time period;
a second jitter state determining unit 530 configured to determine a second jitter state of the network jitter according to a target statistical delay when the first jitter state indicates that the network jitter degree does not exceed a preset jitter degree; and the target statistical time delay is determined based on the network transmission time delay of each media data packet in the preset time period.
In an exemplary embodiment, the first jitter state determining unit 520 includes:
a first threshold acquisition unit configured to perform acquisition of a first preset threshold;
a first determining unit, configured to determine that the first jitter state is a jitter state in which a network jitter degree exceeds a preset jitter degree when a difference value of network transmission delays between the target adjacent media data packets is greater than a first preset threshold;
a second determining unit, configured to determine that the first jitter state is a jitter state in which the network jitter degree does not exceed the preset jitter degree when a difference value of network transmission delays between the target adjacent media data packets is smaller than or equal to the first preset threshold.
In an exemplary embodiment, the second jitter state determining unit 530 includes:
a second threshold acquisition unit configured to perform acquisition of a second preset threshold; the second preset threshold is smaller than the first preset threshold;
a third determining unit, configured to determine that the second jitter state is a jitter state in which network jitter exists and a network jitter degree is smaller than the preset jitter degree when the target statistical delay is greater than the second preset threshold.
In an exemplary embodiment, the second jitter state determining unit 530 further includes:
a fourth determining unit, configured to determine that the second jitter state is a state without network jitter when the target statistical delay is less than or equal to the second preset threshold.
In an exemplary embodiment, the time delay determining unit 510 is specifically configured to perform: determining a media data packet in a preset packet window; the media data packets in the preset packet window comprise the current media data packet; and acquiring the network transmission delay of each media data packet in the preset packet window.
In an exemplary embodiment, the apparatus further comprises:
the average network transmission delay determining unit is configured to determine an average value of the network transmission delays of the media data packets in the preset time period to obtain an average network transmission delay;
a deviation delay determining unit configured to perform a difference between the network transmission delay of each media data packet and the average network transmission delay to obtain a deviation delay corresponding to each media data packet;
and the target statistical time delay determining unit is configured to determine the target statistical time delay based on the deviation time delay corresponding to each media data packet.
With regard to the apparatus in the above-described embodiment, the specific manner in which each module performs the operation has been described in detail in the embodiment related to the method, and will not be elaborated here.
In one exemplary embodiment, there is also provided an electronic device, comprising a processor; a memory for storing processor-executable instructions; wherein the processor is configured to execute the instructions stored in the memory to implement any one of the methods for determining network jitter status provided in the embodiments of the present disclosure.
The electronic device may be a terminal, a server, or a similar computing device, taking the electronic device as a terminal as an example, fig. 6 is a block diagram of an electronic device for network jitter status determination shown according to an exemplary embodiment, and specifically:
the terminal may include RF (Radio Frequency) circuitry 610, memory 620 including one or more computer-readable storage media, input unit 630, display unit 640, sensor 650, audio circuitry 660, WiFi (wireless fidelity) module 670, processor 680 including one or more processing cores, and power supply 690. Those skilled in the art will appreciate that the terminal structure shown in fig. 6 is not intended to be limiting and may include more or fewer components than those shown, or some components may be combined, or a different arrangement of components. Wherein:
the RF circuit 610 may be used for receiving and transmitting signals during information transmission and reception or during a call, and in particular, for receiving downlink information from a base station and then processing the received downlink information by the one or more processors 680; in addition, data relating to uplink is transmitted to the base station. In general, RF circuitry 610 includes, but is not limited to, an antenna, at least one Amplifier, a tuner, one or more oscillators, a Subscriber Identity Module (SIM) card, a transceiver, a coupler, an LNA (Low Noise Amplifier), a duplexer, and the like. In addition, the RF circuit 610 may also communicate with networks and other terminals through wireless communication. The wireless communication may use any communication standard or protocol, including but not limited to GSM (Global System for Mobile communications), GPRS (General Packet Radio Service), CDMA (Code Division Multiple Access), WCDMA (Wideband Code Division Multiple Access), LTE (Long Term Evolution), email, SMS (Short Messaging Service), and the like.
The memory 620 may be used to store software programs and modules, and the processor 680 may execute various functional applications and data processing by operating the software programs and modules stored in the memory 620. The memory 620 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, application programs required for functions, and the like; the storage data area may store data created according to the use of the terminal, and the like. Further, the memory 620 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device. Accordingly, the memory 620 may also include a memory controller to provide the processor 680 and the input unit 630 access to the memory 620.
The input unit 630 may be used to receive input numeric or character information and generate keyboard, mouse, joystick, optical or trackball signal inputs related to user settings and function control. In particular, the input unit 630 may include a touch sensitive surface 631 as well as other input devices 632. The touch sensitive surface 631, also referred to as a touch display screen or a touch pad, may collect touch operations by a user (e.g., operations by a user on the touch sensitive surface 631 or near the touch sensitive surface 631 using any suitable object or attachment such as a finger, a stylus, etc.) on or near the touch sensitive surface 631 and drive the corresponding connection device according to a predetermined program. Alternatively, the touch sensitive surface 631 may comprise two parts, a touch detection means and a touch controller. The touch detection device detects the touch direction of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch sensing device, converts the touch information into touch point coordinates, sends the touch point coordinates to the processor 680, and can receive and execute commands sent by the processor 680. In addition, the touch sensitive surface 631 may be implemented using various types of resistive, capacitive, infrared, and surface acoustic waves. The input unit 630 may include other input devices 632 in addition to the touch-sensitive surface 631. In particular, other input devices 632 may include, but are not limited to, one or more of a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, a joystick, and the like.
The display unit 640 may be used to display information input by or provided to a user and various graphical user interfaces of the terminal, which may be made up of graphics, text, icons, video, and any combination thereof. The Display unit 640 may include a Display panel 641, and optionally, the Display panel 641 may be configured in the form of an LCD (Liquid Crystal Display), an OLED (Organic Light-Emitting Diode), or the like. Further, the touch-sensitive surface 631 may overlay the display panel 641, and when the touch-sensitive surface 631 detects a touch operation thereon or nearby, the touch operation is transmitted to the processor 680 to determine the type of the touch event, and then the processor 680 provides a corresponding visual output on the display panel 641 according to the type of the touch event. Where the touch sensitive surface 631 and the display panel 641 may implement input and output functions as two separate components, in some embodiments the touch sensitive surface 631 and the display panel 641 may be integrated to implement input and output functions.
The terminal may also include at least one sensor 650, such as a light sensor, motion sensor, and other sensors. Specifically, the light sensor may include an ambient light sensor that adjusts the brightness of the display panel 641 according to the brightness of ambient light, and a proximity sensor that turns off the display panel 641 and/or a backlight when the terminal is moved to the ear. As one of the motion sensors, the gravity acceleration sensor can detect the magnitude of acceleration in each direction (generally, three axes), detect the magnitude and direction of gravity when the terminal is stationary, and can be used for applications of recognizing terminal gestures (such as horizontal and vertical screen switching, related games, magnetometer gesture calibration), vibration recognition related functions (such as pedometer and tapping), and the like; as for other sensors such as a gyroscope, a barometer, a hygrometer, a thermometer, and an infrared sensor, which can be configured in the terminal, detailed description is omitted here.
WiFi belongs to a short-distance wireless transmission technology, and the terminal can help a user to send and receive e-mails, browse webpages, access streaming media and the like through the WiFi module 670, and provides wireless broadband internet access for the user. Although fig. 6 shows the WiFi module 670, it is understood that it does not belong to the essential constitution of the terminal, and can be omitted entirely as needed within the scope not changing the essence of the invention.
The processor 680 is a control center of the terminal, connects various parts of the entire terminal using various interfaces and lines, and performs various functions of the terminal and processes data by operating or executing software programs and/or modules stored in the memory 620 and calling data stored in the memory 620, thereby integrally monitoring the terminal. Optionally, processor 680 may include one or more processing cores; preferably, the processor 680 may integrate an application processor, which mainly handles operating systems, user interfaces, application programs, etc., and a modem processor, which mainly handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into processor 680.
The terminal also includes a power supply 690 (e.g., a battery) for powering the various components, which may be logically coupled to the processor 680 via a power management system to manage charging, discharging, and power consumption via the power management system. The power supply 690 may also include any component including one or more dc or ac power sources, recharging systems, power failure detection circuitry, power converters or inverters, power status indicators, and the like.
Although not shown, the terminal may further include a camera, a bluetooth module, and the like, which are not described herein again. In this embodiment, the terminal further includes a memory and one or more programs, where the one or more programs are stored in the memory and configured to be executed by the one or more processors. The one or more programs include instructions for performing the method for determining network jitter status provided by the method embodiments described above.
In an exemplary embodiment, a computer-readable storage medium comprising instructions, such as the memory 620 comprising instructions, executable by the processor 680 of the apparatus 600 to perform the method described above is also provided. Alternatively, the computer readable storage medium may be a ROM, a Random Access Memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.
In an exemplary embodiment, a computer program product is also provided, which includes a computer program/instruction, and the computer program/instruction is executed by a processor to implement any one of the network jitter status determination methods provided in the embodiments of the present disclosure.
Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This disclosure is intended to cover any variations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.
It will be understood that the present disclosure is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.
Claims (10)
1. A method for determining a network jitter status, comprising:
determining the network transmission delay of each media data packet in a preset time period before the current time;
determining a first jitter state of network jitter based on a difference value of network transmission time delays between target adjacent media data packets; the target adjacent media data packets refer to two media data packets closest to the current time within the preset time period;
when the first jitter state indicates that the network jitter degree does not exceed the preset jitter degree, determining a second jitter state of the network jitter according to target statistical time delay; and the target statistical time delay is determined based on the network transmission time delay of each media data packet in the preset time period.
2. The method of claim 1, wherein determining the first jitter state of the network jitter based on the difference in network transmission delay between the target adjacent media data packets comprises:
acquiring a first preset threshold;
when the difference value of the network transmission time delay between the target adjacent media data packets is larger than the first preset threshold value, determining that the first jitter state is a jitter state in which the network jitter degree exceeds the preset jitter degree;
and when the difference value of the network transmission time delay between the target adjacent media data packets is smaller than or equal to the first preset threshold value, determining that the first jitter state is a jitter state in which the network jitter degree does not exceed the preset jitter degree.
3. The method of claim 2, wherein the determining the second jitter state of the network jitter according to the target statistical delay comprises:
acquiring a second preset threshold; the second preset threshold is smaller than the first preset threshold;
and when the target statistical time delay is greater than the second preset threshold, determining that the second jitter state is a jitter state with network jitter and the network jitter degree is less than the preset jitter degree.
4. The method of claim 3, further comprising:
and when the target statistical time delay is smaller than or equal to the second preset threshold, determining that the second jitter state is a state without network jitter.
5. The method of claim 1, wherein the determining the network transmission delay of each media data packet in a preset time period before the current time comprises:
determining a media data packet in a preset packet window; the media data packets in the preset packet window comprise the current media data packet;
and acquiring the network transmission delay of each media data packet in the preset packet window.
6. The method according to any of claims 1-5, further comprising, before determining the second jitter state of the network jitter according to a target statistical delay:
determining the average value of the network transmission time delay of each media data packet in the preset time period to obtain the average network transmission time delay;
obtaining the deviation time delay corresponding to each media data packet based on the difference between the network transmission time delay of each media data packet and the average network transmission time delay;
and determining the target statistical time delay based on the deviation time delay corresponding to each media data packet.
7. An apparatus for determining a jitter status of a network, comprising:
the time delay determining unit is configured to determine the network transmission time delay of each media data packet in a preset time period before the current time;
a first jitter state determination unit configured to perform determining a first jitter state of a network jitter based on a difference in network transmission delay between target adjacent media data packets; the target adjacent media data packets refer to two media data packets closest to the current time within the preset time period;
a second jitter state determination unit configured to determine a second jitter state of the network jitter according to a target statistical delay when the first jitter state indicates that the network jitter degree does not exceed a preset jitter degree; and the target statistical time delay is determined based on the network transmission time delay of each media data packet in the preset time period.
8. An electronic device, comprising:
a processor;
a memory for storing the processor-executable instructions;
wherein the processor is configured to execute the instructions to implement the method of determining a network jitter status as claimed in any one of claims 1 to 6.
9. A computer-readable storage medium, wherein instructions in the computer-readable storage medium, when executed by a processor of an electronic device, enable the electronic device to perform the method for determining a network jitter status of any of claims 1-6.
10. A computer program product comprising computer programs/instructions, characterized in that the computer programs/instructions, when executed by a processor, implement the method of determining a network jitter status of any of claims 1 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210667054.8A CN115118636A (en) | 2022-06-13 | 2022-06-13 | Method and device for determining network jitter state, electronic equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210667054.8A CN115118636A (en) | 2022-06-13 | 2022-06-13 | Method and device for determining network jitter state, electronic equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115118636A true CN115118636A (en) | 2022-09-27 |
Family
ID=83328429
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210667054.8A Pending CN115118636A (en) | 2022-06-13 | 2022-06-13 | Method and device for determining network jitter state, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115118636A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116781975A (en) * | 2023-08-17 | 2023-09-19 | 中仪英斯泰克科技有限公司 | Media stream detection method, device, terminal equipment and storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103139070A (en) * | 2013-01-29 | 2013-06-05 | 大唐移动通信设备有限公司 | Method and device for routine selection of data sending |
| CN105939289A (en) * | 2015-12-21 | 2016-09-14 | 小米科技有限责任公司 | Network jitter processing method, network jitter processing device and terminal equipment |
| CN110366003A (en) * | 2019-06-24 | 2019-10-22 | 北京大米科技有限公司 | Anti-jitter processing method, device, electronic equipment and the storage medium of video data |
| CN113747253A (en) * | 2021-08-17 | 2021-12-03 | 中移（杭州）信息技术有限公司 | Method for determining network bandwidth, video RTP receiving end and storage medium |
| CN114339294A (en) * | 2022-01-04 | 2022-04-12 | 腾讯科技（深圳）有限公司 | Network jitter confirmation method, device, equipment and storage medium |
-
2022
- 2022-06-13 CN CN202210667054.8A patent/CN115118636A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103139070A (en) * | 2013-01-29 | 2013-06-05 | 大唐移动通信设备有限公司 | Method and device for routine selection of data sending |
| CN105939289A (en) * | 2015-12-21 | 2016-09-14 | 小米科技有限责任公司 | Network jitter processing method, network jitter processing device and terminal equipment |
| CN110366003A (en) * | 2019-06-24 | 2019-10-22 | 北京大米科技有限公司 | Anti-jitter processing method, device, electronic equipment and the storage medium of video data |
| CN113747253A (en) * | 2021-08-17 | 2021-12-03 | 中移（杭州）信息技术有限公司 | Method for determining network bandwidth, video RTP receiving end and storage medium |
| CN114339294A (en) * | 2022-01-04 | 2022-04-12 | 腾讯科技（深圳）有限公司 | Network jitter confirmation method, device, equipment and storage medium |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116781975A (en) * | 2023-08-17 | 2023-09-19 | 中仪英斯泰克科技有限公司 | Media stream detection method, device, terminal equipment and storage medium |
| CN116781975B (en) * | 2023-08-17 | 2024-02-06 | 中仪英斯泰克科技有限公司 | Media stream detection method, device, terminal equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108430101B (en) | Antenna closing method and device, storage medium and electronic equipment | |
| US10304461B2 (en) | Remote electronic service requesting and processing method, server, and terminal | |
| US10261988B2 (en) | Method, apparatus and terminal for matching expression image | |
| EP3525417A1 (en) | Data processing method, device, storage medium, electronic device and server | |
| WO2015090248A1 (en) | Server overload protection method and device | |
| CN108958606B (en) | Split screen display method and device, storage medium and electronic equipment | |
| US20170109756A1 (en) | User Unsubscription Prediction Method and Apparatus | |
| CN107786424B (en) | Audio and video communication method, terminal and server | |
| CN108668328B (en) | Network switching method and mobile terminal | |
| CN106940997B (en) | Method and device for sending voice signal to voice recognition system | |
| CN108492837B (en) | Method, device and storage medium for detecting audio burst white noise | |
| CN110022405B (en) | Radio frequency parameter adjusting method, device and storage medium | |
| CN107122036B (en) | Method and device for adjusting frequency of central processing unit | |
| CN109688611B (en) | Frequency band parameter configuration method, device, terminal and storage medium | |
| CN115174418A (en) | Communication environment safety early warning method and device, electronic equipment and storage medium | |
| CN112749074A (en) | Test case recommendation method and device | |
| CN110198560B (en) | Power configuration method and terminal | |
| CN107622234B (en) | Method and device for displaying budding face gift | |
| CN105306244B (en) | Router management method, system and equipment | |
| CN115118636A (en) | Method and device for determining network jitter state, electronic equipment and storage medium | |
| CN108391288B (en) | Method for optimizing communication service quality and mobile terminal | |
| CN106209601B (en) | State update message pushing method and device | |
| CN113852450A (en) | Message push feedback method and device, electronic equipment and storage medium | |
| CN111818657B (en) | Uplink transmission discarding method, uplink transmission discarding configuration method and related equipment | |
| CN107315623B (en) | Method and device for reporting statistical data |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |