CN110943932B - Information processing method and device - Google Patents
Information processing method and device Download PDFInfo
- Publication number
- CN110943932B CN110943932B CN201911114669.2A CN201911114669A CN110943932B CN 110943932 B CN110943932 B CN 110943932B CN 201911114669 A CN201911114669 A CN 201911114669A CN 110943932 B CN110943932 B CN 110943932B
- Authority
- CN
- China
- Prior art keywords
- data stream
- determining
- stream
- packet
- messages
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L47/00—Traffic control in data switching networks
- H04L47/10—Flow control; Congestion control
- H04L47/24—Traffic characterised by specific attributes, e.g. priority or QoS
- H04L47/2441—Traffic characterised by specific attributes, e.g. priority or QoS relying on flow classification, e.g. using integrated services [IntServ]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L47/00—Traffic control in data switching networks
- H04L47/10—Flow control; Congestion control
- H04L47/29—Flow control; Congestion control using a combination of thresholds
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/65—Network streaming protocols, e.g. real-time transport protocol [RTP] or real-time control protocol [RTCP]
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Multimedia (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
- Signal Processing For Digital Recording And Reproducing (AREA)
Abstract
The embodiment of the invention discloses an information processing method and device, which are used for improving the efficiency of distinguishing audio streams from control streams. The information processing method comprises the following steps: determining a plurality of first characteristic values of a first data stream, wherein the first data stream comprises a plurality of first messages, and the first characteristic values are used for representing the change rate of the time interval of any two first messages; determining a first number, wherein the first number is the number of the same first characteristic values in the plurality of first characteristic values; a type of the first data stream is determined based on the first number, the type including an audio stream or a control stream.
Description
Technical Field
The present invention relates to the field of data stream distinguishing technologies, and in particular, to an information processing method and apparatus.
Background
An audio and video conference system refers to a system in which individuals or groups in two or more different places transmit audio, video and the like to each other through multimedia equipment to achieve the purpose of a conference.
An existing audio/video conference system usually has three data streams, i.e., a video stream, an audio stream, and a control stream, in the same transmission direction. In order to evaluate the quality of audio and video transmitted in an audio-video conferencing system, the three streams need to be identified and classified. For a video stream, since the amount of video stream data is large, the length of a message generated based on a real-time transport protocol (RTP) tends to be close to the maximum transmission unit, and thus the video stream is easily distinguished from an audio stream (control stream) by the message length. For the audio stream and the control stream, the lengths of the messages generated by the audio stream and the control stream based on RTP are relatively close, so that the audio stream and the control stream cannot be distinguished through the lengths of the messages. The audio stream comprises media messages and non-media messages, and the control stream only comprises non-media messages; and the change of the timestamp in the media message and the change of the sequence number meet the linear relation, but the change of the timestamp of the non-media message and the change of the sequence number do not meet the linear relation. Therefore, at present, a state machine determines whether a data stream is an audio stream or a control stream according to whether a timestamp change and a sequence number change of a packet corresponding to the data stream satisfy a linear growth relationship.
But the media message and the non-media message in the audio stream may exist in a cross way, and the computational logic of the state machine becomes more complicated due to the influence of the non-media message. In addition, when the network condition is poor, packet loss or disorder of data stream may occur, which makes the computational logic of the state machine more complicated, and thus requires more resource consumption.
Disclosure of Invention
The embodiment of the invention provides an information processing method and device, which are used for improving the efficiency of distinguishing audio streams from control streams.
In a first aspect, an embodiment of the present invention provides an information processing method, where the method includes:
determining a plurality of first characteristic values of a first data stream, wherein the first data stream comprises a plurality of first messages, and the first characteristic values are used for representing the change rate of the time interval of any two first messages;
determining a first number, wherein the first number is the number of the same first characteristic values in the plurality of first characteristic values;
determining a type of the first data stream based on the first number, the type including an audio stream or a control stream.
In the embodiment of the present invention, the first characteristic value may be used to characterize a change rate of a time interval of any two packets. The messages of the data stream may include media messages and/or non-media messages, and the rate of change of the time interval between any two media files is constant and the same, and the rate of change of the time interval between any two non-media messages or non-media messages and the media messages is different. Since the audio stream includes more media files, but the audio stream does not include media files, if the number of the same first feature values in a data stream is greater, it can be considered that the data stream includes more media files. Therefore, the embodiment of the present invention may determine that the first data stream or the second data stream is an audio stream by comparing the number of the same first feature values in the first data stream and the second data stream. By adopting the scheme, whether a data stream comprises more media files or more non-media files is determined, in the determination process, the judgment of the media files is not influenced by the non-media files, the judgment algorithm is simpler, the calculation resources can be better saved, and therefore the method and the device are suitable for application scenes with limited software and hardware resources, namely the application range is wider.
Optionally, determining a plurality of first characteristic values of the first data stream includes:
and determining the plurality of first characteristic values according to the difference value between the timestamps of any two first messages in the plurality of first messages and the difference value between the serial numbers of any two first messages.
Optionally, each of the first feature values satisfies the following formula:
wherein w 1 A first characteristic value, x, representing said first data stream 1k A timestamp, x, representing a kth first packet in the first data stream 1j A timestamp, y, representing a jth first packet in the first data stream 1k Indicating the sequence number, y, of the kth first packet in the first data stream 1j Indicating a sequence number of a jth first packet in the first data stream. The kth first packet and the jth first packet are any two packets located at different positions in the first data stream.
In this embodiment, a plurality of first characteristic values of the first data stream are determined, for example, each first characteristic value is a ratio of a difference between timestamps and a difference between sequence numbers of any two packets in the first data stream. The method is simple, saves computing resources and improves efficiency.
Optionally, determining the type of the first data stream according to the first number includes:
if the first number is greater than or equal to a first threshold value, determining that the first data stream is an audio stream; alternatively, the first and second electrodes may be,
and if the first number is smaller than a first threshold value, determining that the first data flow is a control flow.
The audio stream includes media messages and non-media messages, and the non-audio stream includes only non-media messages. The first number is the number of equal first feature values in the plurality of first feature values, and if the number of the same feature values in the first data stream is more, for example, greater than a first threshold value, it indicates that the data stream includes more media messages, and thus the data stream may be determined to be an audio stream.
Optionally, the method further includes:
determining a plurality of second characteristic values of a second data stream, wherein the second data stream comprises a plurality of second messages, and the second characteristic values are used for representing the change rate of the time interval of any two second messages;
determining a second number, wherein the second number is the number of the same second characteristic values in the plurality of second characteristic values;
determining the type of the first data stream according to the first number and the second number.
In the embodiment of the present invention, since the audio stream includes more media files, but does not include media files in the audio stream, if the number of the same feature values in one data stream is greater, it can be considered that the number of the media files included in the data stream is greater. Therefore, the type of the first data stream can be judged by comparing the number of the same characteristic values in the first data stream and the second data stream, so that the problem of misjudgment possibly occurring when the judgment is carried out only through the first data stream can be avoided as much as possible, and the judgment accuracy is improved.
Optionally, determining the type of the first data stream according to the first quantity and the second quantity includes:
if the difference value between the first quantity and the second quantity is larger than or equal to a second threshold value, determining that the first data stream is an audio stream; alternatively, the first and second electrodes may be,
and if the difference value between the first quantity and the second quantity is smaller than a second threshold value, determining that the first data stream is a control stream.
In an embodiment of the invention, the type of the first data stream is determined based on the difference in the number of identical eigenvalues in the two data streams. For example, when the difference between the numbers of the same feature values in the two data streams is greater than the second threshold, for example, the data streams with more same feature values include more media packets, and it may be determined that the data stream is an audio stream.
Optionally, the method further includes:
the plurality of timestamps is stored, and the sequence number corresponding to each of the plurality of timestamps is stored.
In the embodiment of the present invention, a plurality of timestamps and sequence numbers corresponding to each timestamp may be stored and further used when the first characteristic value needs to be determined.
In a second aspect, an embodiment of the present invention provides an information processing apparatus, including:
a first determining module, configured to determine a plurality of first feature values of a first data stream, where the first data stream includes a plurality of first packets, and the first feature values are used to represent a change rate of a time interval between any two first packets;
a second determining module, configured to determine a first number, where the first number is the number of identical first feature values in the plurality of first feature values;
a third determining module, configured to determine a type of the first data stream or the second data stream according to the first number, where the type includes an audio stream or a control stream.
Optionally, the first determining module is specifically configured to:
and determining the plurality of first characteristic values according to the difference value between the timestamps of any two first messages in the plurality of first messages and the difference value between the serial numbers of any two first messages.
Optionally, each of the first feature values satisfies the following formula:
wherein w 1 A first characteristic value, x, representing said first data stream 1k Representing said first numberTimestamp, x, of the kth first packet in the stream 1j A timestamp, y, representing a jth first packet in the first data stream 1k Indicating the sequence number, y, of the kth first packet in the first data stream 1j Indicating a sequence number of a jth first packet in the first data stream. The kth first packet and the jth first packet are any two packets located at different positions in the first data stream.
Optionally, the third determining module is specifically configured to:
if the first number is greater than or equal to a first threshold value, determining that the first data stream is an audio stream; alternatively, the first and second electrodes may be,
and if the first number is smaller than a first threshold value, determining that the first data flow is a control flow.
Optionally, the first determining module is configured to determine a plurality of second feature values of a second data stream, where the second data stream includes a plurality of second packets, and the second feature values are used to represent a change rate of a time interval between any two second packets;
a second determining module, configured to determine a second number, where the second number is the number of identical second feature values in the plurality of second feature values;
a third determining module, configured to determine a type of the first data stream according to the first quantity and the second quantity.
Optionally, the third determining module is specifically configured to:
if the difference value between the first quantity and the second quantity is larger than or equal to a second threshold value, determining that the first data stream is an audio stream; alternatively, the first and second liquid crystal display panels may be,
and if the difference value between the first quantity and the second quantity is smaller than a second threshold value, determining that the first data flow is a control flow.
Optionally, the storage module is specifically configured to:
the method further includes storing the plurality of timestamps and storing the sequence number corresponding to each of the plurality of timestamps.
For technical effects of the second aspect or any embodiment of the second aspect, reference may be made to technical effects of any embodiment of the first aspect, which are not described herein again.
In a third aspect, an embodiment of the present invention provides an information processing apparatus, where the information processing apparatus includes a processor and a memory, and the processor is configured to execute a computer program stored in the memory to implement the steps of the method according to the embodiment of the first aspect.
In a fourth aspect, embodiments of the present invention provide a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements the steps of the method as described in the embodiments of the first aspect.
Because the audio stream contains more media files, but not the audio stream contains no media files, the embodiment of the invention judges whether a data stream is an audio stream or a control stream according to the number of the same characteristic values of the data stream. In the judgment process, the judgment of the media files is not influenced by the non-media files, the judgment algorithm is simple, and calculation resources can be better saved, so that the method and the device are suitable for application scenes with limited software and hardware resources, and the application range is wider.
Drawings
Fig. 1 is a schematic architecture diagram of an audio and video conference system according to an embodiment of the present invention;
fig. 2 is a schematic flowchart of an information processing method according to an embodiment of the present invention;
fig. 3 is a schematic diagram of a calculation process of an information processing method according to an embodiment of the present invention;
fig. 4 is a schematic structural diagram of an information processing apparatus according to an embodiment of the present invention;
fig. 5 is another schematic structural diagram of an information processing apparatus according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present disclosure more clear, the technical solutions of the embodiments of the present disclosure will be described below clearly and completely with reference to the drawings of the embodiments of the present disclosure.
For ease of understanding, an application scenario of the embodiment of the present invention is first described. Please refer to fig. 1, which is a schematic diagram of an architecture of an audio/video conference system. Fig. 1 includes a first terminal 101, a second terminal 102, a first access switch 103, a second access switch 104, an aggregation switch 105, a core switch 106, and a server 107. The first terminal 101 and the second terminal 102 may be a voice terminal and/or a video terminal in an audio and video conference system. The first access switch 103 is used for accessing the first terminal 101 to the network or sending data information from the network to the first terminal 101; similarly, the second access switch 104 is used to access the second terminal 102 to the network or to transmit data information from the network to the second terminal 102. The aggregation switch 105 is configured to aggregate the communication data of the first access switch 103 and the second access switch 104, and forward the communication data to the core switch 106. The core switch 106 is configured to forward the communication data in the aggregation switch 105 to the server 107. The server 107 may be a Voice Over Internet Protocol (VOIP) server for digitizing analog signals to enable transmission of audio and/or video.
When the first terminal 101 needs to communicate with the second terminal 102, for example, the first terminal 101 is an initiator, the second terminal 102 is a responder, the communication data of the first terminal 101 sequentially passes through the first access switch 103, the aggregation switch 105, the core switch 106 and the server 107, the server 107 receives the communication data from the first terminal 101, converts the communication data, and then sequentially passes through the core switch 106, the aggregation switch 105 and the second access switch 104 to be transmitted to the second terminal 102, thereby implementing communication between the first terminal 101 and the second terminal 102.
Assuming that the first terminal 101 is an initiator and the second terminal 102 is a responder, it may be considered that an Internet Protocol (IP) address of the first terminal 101 is a source IP address and an IP address of the second terminal 102 is a destination IP address in a communication link between the first terminal 101 and the second terminal 102. On this communication link, i.e. the communication link from the source IP address to the destination IP address, there may be a video stream, an audio stream and a control stream, respectively, which are mainly transmitted by a real-time transport protocol (RTP). Similarly, when the second terminal 102 needs to communicate with the first terminal 101, at this time, the second terminal 102 is equivalent to the initiator, the first terminal 101 is equivalent to the responder, and it can be considered that the IP address of the second terminal 102 is the source IP address and the IP address of the first terminal 101 is the destination IP address. There may also be video, audio, and control streams on the communication link from the destination IP address to the source IP address.
In order to evaluate the transmission quality of data streams in an av conference system, the data streams are usually collected and analyzed by an intermediate network device in the system, such as the aggregation switch 105 in fig. 1. The aggregation switch 105 receives video streams, audio streams, and control streams only through different ports and cannot distinguish them.
For a video stream, since the amount of video stream data is large, the length of a packet generated based on RTP tends to be close to the maximum transmission unit, and thus the video stream is easily distinguished from an audio stream (control stream) by the packet length. For the audio stream and the control stream, the lengths of the messages generated by the audio stream and the control stream based on the RTP are relatively close, so that the audio stream and the control stream cannot be distinguished through the lengths of the messages.
The audio stream comprises media messages and non-media messages, while the control stream only comprises the non-media messages, and the change of the timestamp in the media messages and the change of the serial number satisfy the linear relation, but the change of the timestamp in the non-media messages and the change of the serial number do not satisfy the linear relation. In one way to distinguish audio streams from control streams, the audio streams are distinguished from the control streams by building a state machine. That is, for the audio stream and the control stream, the time stamp and the sequence number of the packet corresponding to the audio stream and the control stream are cached in sequence, and whether the time stamp and the sequence number of the packet satisfy the linear growth relationship is judged. If the increase of the timestamp of the message and the increase of the serial number satisfy the linear relation, the message can be determined as a media message, otherwise, the message is a non-media message, and therefore the audio stream and the control stream are distinguished.
However, the media packets and the non-media packets in the audio stream may cross, and when the state machine determines whether the timestamp and the sequence number of the media packet satisfy the linear relationship, the state machine is affected by the timestamp and the sequence number in the non-media packet, so that the logical operation of the state machine becomes more complicated. In consideration of poor network conditions, when the audio/video conference system shown in fig. 1 transmits data streams, packet loss or disorder of the data streams may occur, so that the determination of the time stamps or sequence numbers of the messages is more complicated, and the accuracy is lower, that is, the accuracy for distinguishing the audio streams from the control streams is lower.
In view of this, an embodiment of the present invention provides an information processing method, where feature values of any two media packets in an audio stream are constant, and feature values of any two packets in a plurality of packets in a first data stream are calculated, so as to obtain a plurality of first feature values. And comparing the number of the same characteristic values in the plurality of first characteristic values with a preset threshold value so as to determine whether the first data stream is an audio stream. The judgment process is simple in algorithm, easy to implement, capable of saving computing resources well, and suitable for application scenes with limited software and hardware resources, namely, the application range is wider.
The technical solution provided by the embodiment of the present invention is described below with reference to the accompanying drawings. In the following description, the audio stream and the control stream flowing through the aggregation switch 105 are identified and classified by taking the application scenario described in fig. 1 as an example. Referring to fig. 2, a flow of an information processing method according to an embodiment of the present invention is described as follows.
Step 201: aggregation switch 105 determines a plurality of first characteristic values for the first data flow.
The first data stream, which may be an audio stream or a control stream, may be considered to be a data stream received by aggregation switch 105 through an input port, such as port a. The first data stream is transmitted on the basis of RTP, i.e. the transmission of messages is generated on the basis of RTP. The first data stream includes a plurality of packets, which may be media packets and/or non-media packets. The first characteristic value can be used for representing the change rate of the time interval of any two messages. Hereinafter, the packet included in the first data stream is referred to as a first packet.
In a possible implementation manner, in the embodiment of the present invention, a feature value may be determined according to a difference between timestamps of any two first packets in the plurality of first packets and a difference between sequence numbers of any two first packets, so as to obtain a plurality of first feature values.
For example, when the audio/video conference system shown in fig. 1 is in an operating state, a plurality of first messages in the first data stream may sequentially enter the aggregation switch 105 through the input port a. After receiving the first message, the aggregation switch 105 obtains and stores a timestamp and a sequence number corresponding to the first message. When a second first message arrives, the aggregation switch 105 also obtains and stores a timestamp and a sequence number corresponding to the second first message. After the timestamp and the sequence number of the first packet and the timestamp and the sequence number of the second first packet are stored in the aggregation switch 105, a difference between the timestamp corresponding to the first packet and the timestamp corresponding to the second first packet and a difference between the sequence number corresponding to the first packet and the sequence number corresponding to the second first packet may be determined, so as to determine a first characteristic value corresponding to the first packet and the second first packet according to the two differences.
Similarly, when the third first packet in the first data stream arrives, the aggregation switch 105 also obtains and stores the timestamp and the sequence number corresponding to the third first packet. A difference value between a timestamp corresponding to the third first packet and a timestamp corresponding to the first packet, and a difference value between a sequence number corresponding to the third first packet and a sequence number corresponding to the first packet may be determined, so that the first characteristic value corresponding to the third first packet and the first packet is determined according to the two difference values. Moreover, a difference value between a timestamp corresponding to the third first packet and a timestamp corresponding to the second first packet and a difference value between a sequence number corresponding to the third first packet and a sequence number corresponding to the second first packet may be determined, so that the first characteristic value corresponding to the third first packet and the first characteristic value corresponding to the second first packet are determined according to the two difference values. By analogy, a plurality of first characteristic values of the first data stream may be obtained.
For example, the following formula (1) may be used to calculate the first characteristic value between any two first packets.
Wherein, w 1 A first characteristic value, x, representing a first data stream 1k Time stamp, x, representing the kth first packet in the first data stream 1j Time stamp, y, representing the jth first packet in the first data stream 1k Indicating the sequence number, y, of the kth first packet in the first data stream 1j Indicating the sequence number of the jth first packet in the first data stream. The kth first packet and the jth first packet are any two packets located at different positions in the first data stream.
Referring to fig. 3, as a specific example, a first eigenvalue corresponding to a first message located in the first 7 positions in the first data stream entering the input port a of the aggregation switch 105 is calculated.
For example, in the first data stream, the non-media packet 1 and the media packet 1 may obtain a first characteristic value, and the non-media packet 1 and the non-media packet 2 may also obtain a first characteristic value. By analogy, any two messages located in the first 7 positions in the first data stream have a first characteristic value, and 21 first characteristic values can be obtained.
As can be seen from the above, one first characteristic value can be determined for any two packets by obtaining and storing timestamps and sequence numbers corresponding to packets at different positions in the first data stream, so as to obtain multiple first characteristic values.
Step 202: the aggregation switch 105 determines a first number that is the number of identical first characteristic values of the plurality of first characteristic values.
The audio stream contains media messages and non-media messages, the control stream does not contain media files, the characteristic values of any two media files are constant and same, and the characteristic values of any two non-media messages or non-media messages and the media messages are different. Therefore, the embodiment of the invention can judge whether a data stream is an audio stream or a control stream according to the number of the same characteristic values of the data stream.
For example, the aggregation switch 105 obtains a plurality of first feature values, may look up the first feature values having the same value for the plurality of first feature values, and may count the same first feature values to obtain the first number.
For example, referring to fig. 3, of the 21 first characteristic values corresponding to the first data stream, 6 first characteristic values have equal values, and the remaining 15 first characteristic values have different values, that is, the first number is 6.
Step 203: aggregation switch 105 determines the type of the first data flow from the first number.
The audio stream includes media messages and non-media messages, and the non-audio stream includes only non-media messages. The feature values corresponding to any two media files are constant and the same, and the feature values corresponding to any two non-media messages or non-media messages and media messages are different, it can be considered that the number of equal feature values included in the audio stream is relatively large, and the number of equal feature values included in the non-audio stream is relatively small. The embodiment of the present invention may compare the number of equal first characteristic values in the plurality of first characteristic values with a preset threshold value, so as to determine the type of the first data stream. The type of the first data stream may be an audio stream or a control stream.
In a possible implementation manner, the embodiment of the present invention may set a first threshold, and compare the first number with the first threshold. For example, if the first number is greater than or equal to a first threshold, the first data stream may be considered an audio stream. If the first number is less than a first threshold, the first data flow may be considered a control flow.
It should be noted that the first threshold may be a possible value set empirically. Illustratively, the first threshold is, for example, 5. With continued reference to fig. 2, if the first data stream includes 4 media packets, the number of equal first characteristic values is 6, that is, the first number is greater than the first threshold value, it may be determined that the first data stream is an audio stream, and the second data stream is a control stream. If the number of the media packets included in the first data stream is 0, the number of the equal first eigenvalues is 0, that is, the first number is smaller than the first threshold, it may be determined that the first data stream is a control stream, and the second data stream is an audio stream.
In the above embodiment, it is assumed in advance that the feature values corresponding to any two non-media packets are different, and the feature values corresponding to any non-media packet and the media packet are also different. However, in an actual scenario, a situation may occur in which the feature values corresponding to any two non-media packets and/or the feature values corresponding to any non-media packet and media packet are exactly the same as the feature values corresponding to any two media packets. Therefore, in the embodiment of the present invention, on the basis of determining the plurality of first feature values corresponding to the first data stream, the plurality of second feature values corresponding to the second data stream may be determined by referring to the same method, and then the number of the same second feature values in the plurality of second feature values, that is, the second number, may be determined, so that the type of the first data stream may be determined according to the first number and the second number.
In another possible implementation, the embodiment of the present invention may compare the difference between the first number and the second number. For example, if the difference between the first number and the second number is greater than or equal to the second threshold, the first number may be considered to be relatively large, and the second number may be considered to be relatively small, so that it may be known that the first data stream includes more media packets, and the second data stream includes fewer or all media packets, which are non-media packets, so that it may be determined that the first data stream is an audio stream and the second data stream is a control stream. If the difference between the first number and the second number is smaller than the second threshold, the second number may be considered to be relatively large, and the first number may be considered to be relatively small, so that it may be known that the second data stream includes more media packets, and the first data stream includes less or all of the media packets as non-media packets, so that it may be determined that the second data stream is an audio stream and the first data stream is a control stream.
It should be noted that the second threshold may be a possible value set empirically. Illustratively, the second threshold is, for example, 3. With continued reference to fig. 2, if the first data stream includes 4 media packets, the number of equal first characteristic values is 6. And the messages in the second data stream are all non-media messages, then the number of equal second eigenvalues is 0. Since the difference between the first number and the second number is 6, which is larger than the second threshold, the first data stream can be determined to be an audio stream.
It should be understood that in the coincidence situation described above, that is, the feature values corresponding to any two non-media messages and any two media files are the same, or the feature values corresponding to any non-media messages and any media messages are the same as the feature values corresponding to any two media files. In order to be able to improve the accuracy of distinguishing between audio and control streams, the first threshold value or the second threshold value may be adjusted, for example, may be increased.
According to the embodiment of the invention, the number of the same characteristic values in the first data stream and/or the second data stream is compared, so that the first data stream or the second data stream is judged to be the audio stream. By adopting the scheme, whether a data stream comprises more media files or more non-media files is determined, in the determination process, the judgment of the media files is not influenced by the non-media files, the judgment algorithm is simpler, the calculation resources can be better saved, and therefore the method and the device are suitable for application scenes with limited software and hardware resources, namely the application range is wider.
Moreover, when the audio/video conference system is in a working state, the network condition may be poor, and then the first data stream received by the aggregation switch 105 through the input port a and/or the second data stream received through the input port B may have a disorder or packet loss phenomenon. Therefore, at present, for judging whether the data stream is an audio stream or a control stream according to whether the timestamp change and the sequence number change of the message corresponding to the data stream satisfy the linear growth relation through the state machine, the determination of determining the timestamp or the sequence number of the message is more complicated, and the accuracy is lower. In the embodiment of the present invention, a ratio of a difference between timestamps of any two packets to a difference between serial numbers corresponding to the timestamps is obtained by calculating a feature value, for example, a first feature value or a second feature value, where the feature value represents a change rate of a time interval between any two packets, and for a media packet, the change rate of the time interval is constant, that is, a result of the feature value between any two media packets is not affected by disorder or packet loss. For non-media messages, the rate of change of the time interval is variable. Therefore, the present algorithm still has strong robustness for distinguishing audio streams when the network condition is poor, and the apparatus provided by the embodiment of the present invention is described below with reference to the accompanying drawings.
Referring to fig. 4, based on the same inventive concept, an embodiment of the present invention provides an information processing apparatus, which may be the aggregation switch 105 described above, and the information processing apparatus includes a first determining module 401, a second determining module 402, and a third determining module 403. Wherein:
the first determining module 401 is configured to determine a plurality of first feature values of a first data stream, where the first data stream includes a plurality of first packets, and the first feature values are used to represent a change rate of a time interval between any two first packets;
the second determining module 402 is configured to determine a first number, where the first number is the number of the same first feature values in the plurality of first feature values;
the third determining module 403 is configured to determine a type of the first data stream according to the first amount, where the type includes an audio stream or a control stream.
Optionally, the first determining module 401 is specifically configured to:
determining a plurality of first characteristic values according to the difference value between the timestamps of any two first messages in the plurality of first messages and the difference value between the timestamps of any two first messages and the sequence numbers of any two first messages;
optionally, each first feature value satisfies the following formula:
wherein, w 1 A first characteristic value, x, representing a first data stream 1k Time stamp, x, representing the kth first packet in the first data stream 1j Time stamp, y, representing the jth first packet in the first data stream 1k Indicating the sequence number, y, of the kth first packet in the first data stream 1j Indicating the sequence number of the jth first packet in the first data stream. The kth first packet and the jth first packet are any two packets located at different positions in the first data stream.
Optionally, the third determining module 403 is specifically configured to:
if the first number is larger than or equal to a first threshold value, determining that the first data stream is an audio stream; alternatively, the first and second liquid crystal display panels may be,
if the first number is less than a first threshold, the first data flow is determined to be a control flow.
Optionally, the first determining module 401 is configured to determine a plurality of second feature values of a second data stream, where the second data stream includes a plurality of second packets, and the second feature values are used to represent a change rate of a time interval between any two second packets;
the second determining module 402 is configured to determine a second number, where the second number is the number of the same second feature values in the plurality of second feature values;
the third determining module 403 is configured to determine the type of the first data stream according to the first number and the second number.
Optionally, the third determining module 403 is specifically configured to:
if the difference value between the first quantity and the second quantity is larger than or equal to a second threshold value, determining that the first data stream is an audio stream; alternatively, the first and second liquid crystal display panels may be,
and if the difference value between the first quantity and the second quantity is smaller than a second threshold value, determining the first data stream as a control stream.
Optionally, the storage module is specifically configured to:
storing a plurality of timestamps and storing a sequence number corresponding to each of the plurality of timestamps;
referring to fig. 5, based on the same inventive concept, an embodiment of the present invention provides an information processing apparatus, which may be the aggregation switch 105 described above, where the aggregation switch 105 includes at least one processor 501, and the processor 501 is configured to execute a computer program stored in a memory, so as to implement the steps of the information processing method shown in fig. 2 provided by the embodiment of the present invention.
Optionally, the processor 501 may be specifically a central processing unit, a specific ASIC, and may be one or more integrated circuits for controlling the execution of programs.
Optionally, the aggregation switch 105 may further comprise a memory 502 connected to the at least one processor 501, and the memory 502 may comprise ROM, RAM, and disk memory. The memory 502 is used for storing data required by the processors 501 during operation, that is, storing instructions executable by at least one of the processors 501, and the at least one of the processors 501 executes the instructions stored in the memory 502 to perform the method shown in fig. 2. The number of the memories 502 is one or more. The memory 502 is shown in fig. 5, but it should be understood that the memory 502 is not an optional functional block, and is shown in fig. 5 by a dotted line.
The physical devices corresponding to the first determining module 401, the second determining module 402, and the third determining module 403 may be the processor 501. The aggregation switch 105 may be used to perform the method provided by the embodiment shown in fig. 2. Therefore, regarding the functions that can be realized by each functional module in the device, reference may be made to the corresponding description in the embodiment shown in fig. 2, which is not repeated herein.
It will be clear to those skilled in the art that, for convenience and simplicity of description, the foregoing division of the functional modules is merely used as an example, and in practical applications, the above function distribution may be performed by different functional modules according to needs, that is, the internal structure of the device is divided into different functional modules to perform all or part of the above described functions. For the specific working processes of the system, the apparatus and the unit described above, reference may be made to the corresponding processes in the foregoing method embodiments, and details are not described here again.
Claims (4)
1. An information processing method, characterized in that the method comprises:
determining a plurality of first characteristic values of a first data stream, wherein the first data stream comprises a plurality of first messages, and the first characteristic values are used for representing the change rate of the time interval of any two first messages;
determining a first number, wherein the first number is the number of the same first characteristic values in the plurality of first characteristic values;
determining a type of the first data stream according to the first number, wherein the type comprises an audio stream or a control stream;
the determining a plurality of first characteristic values of the first data stream comprises:
determining the plurality of first characteristic values according to the difference value between the timestamps of any two first messages in the plurality of first messages and the difference value between the serial numbers of any two first messages;
each of the first feature values satisfies the following formula:
wherein, w 1 A first characteristic value, x, representing said first data stream 1k A timestamp, x, representing a kth first packet in the first data stream 1j A timestamp, y, representing a jth first packet in the first data stream 1k Indicating the sequence number, y, of the kth first packet in the first data stream 1j Indicating a sequence number of a jth first packet in the first data stream, where the kth first packet and the jth first packet are any two packets located at different positions in the first data stream;
the determining the type of the first data stream according to the first number includes:
if the first number is greater than or equal to a first threshold value, determining that the first data stream is an audio stream; alternatively, the first and second liquid crystal display panels may be,
if the first number is smaller than a first threshold value, determining that the first data flow is a control flow;
the method further comprises the following steps:
determining a plurality of second characteristic values of a second data stream, wherein the second data stream comprises a plurality of second messages, and the second characteristic values are used for representing the change rate of the time interval of any two second messages;
determining a second number, wherein the second number is the number of the same second characteristic values in the plurality of second characteristic values;
determining the type of the first data stream according to the first quantity and the second quantity;
the determining the type of the first data stream according to the first number and the second number comprises:
if the difference value between the first quantity and the second quantity is larger than or equal to a second threshold value, determining that the first data stream is an audio stream; alternatively, the first and second electrodes may be,
and if the difference value between the first quantity and the second quantity is smaller than a second threshold value, determining that the first data flow is a control flow.
2. The method of claim 1, wherein the method comprises:
the method further includes storing the plurality of timestamps and storing the sequence number corresponding to each of the plurality of timestamps.
3. An information processing apparatus, characterized in that the apparatus comprises at least one processor and a memory connected to the at least one processor, the at least one processor being adapted to carry out the steps of the method according to any of claims 1-2 when executing a computer program stored in the memory.
4. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the steps of the method according to any one of claims 1-2.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911114669.2A CN110943932B (en) | 2019-11-14 | 2019-11-14 | Information processing method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911114669.2A CN110943932B (en) | 2019-11-14 | 2019-11-14 | Information processing method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110943932A CN110943932A (en) | 2020-03-31 |
| CN110943932B true CN110943932B (en) | 2022-11-11 |
Family
ID=69906805
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911114669.2A Active CN110943932B (en) | 2019-11-14 | 2019-11-14 | Information processing method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110943932B (en) |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2004254186A (en) * | 2003-02-21 | 2004-09-09 | Fujitsu Ltd | Audio/video synchronous control method and device |
| CN101056245A (en) * | 2006-04-13 | 2007-10-17 | 日本电气株式会社 | Media stream relay device and method |
| CN101854533A (en) * | 2010-06-10 | 2010-10-06 | 华为技术有限公司 | Frequency channel switching method, device and system |
| CN108880938A (en) * | 2018-06-19 | 2018-11-23 | 成都网丁科技有限公司 | A kind of end-to-end TCP session speed-measuring method |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| DE102005039192A1 (en) * | 2005-08-18 | 2007-03-01 | Siemens Ag | Method for fault analysis of a data stream, in particular a real-time data stream, in a data network, communication system and monitoring computer |
| US8301982B2 (en) * | 2009-11-18 | 2012-10-30 | Cisco Technology, Inc. | RTP-based loss recovery and quality monitoring for non-IP and raw-IP MPEG transport flows |
| US9871808B2 (en) * | 2014-04-15 | 2018-01-16 | Nuance Communications, Inc. | System and method for handling rogue data packets |
-
2019
- 2019-11-14 CN CN201911114669.2A patent/CN110943932B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2004254186A (en) * | 2003-02-21 | 2004-09-09 | Fujitsu Ltd | Audio/video synchronous control method and device |
| CN101056245A (en) * | 2006-04-13 | 2007-10-17 | 日本电气株式会社 | Media stream relay device and method |
| CN101854533A (en) * | 2010-06-10 | 2010-10-06 | 华为技术有限公司 | Frequency channel switching method, device and system |
| CN108880938A (en) * | 2018-06-19 | 2018-11-23 | 成都网丁科技有限公司 | A kind of end-to-end TCP session speed-measuring method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110943932A (en) | 2020-03-31 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107360032B (en) | Network flow identification method and electronic equipment | |
| US11582146B2 (en) | High-quality adaptive bitrate video through multiple links | |
| US9271055B2 (en) | System and method for variable video degradation counter-measures | |
| US8761179B2 (en) | System and method for detecting sources of rogue non-audio traffic marked as audio traffic | |
| CN112583715B (en) | Equipment node connection adjustment method and device | |
| CN111414386B (en) | Method and device for inquiring flow data based on distributed architecture | |
| WO2021098730A1 (en) | Switching network congestion management method and apparatus, device, and storage medium | |
| US6691167B2 (en) | Method and apparatus for network problem segment isolation | |
| WO2020026018A1 (en) | Method for downloading file, device, apparatus/terminal/ server, and storage medium | |
| WO2015161409A1 (en) | Load balance implementation method, device and system | |
| CN111741249A (en) | Network congestion detection method and device | |
| CN112449252B (en) | Method and device for maintaining video streaming system, wireless network bridge equipment and storage medium | |
| CN102714652B (en) | Monitoring Data network comprises the conversational communication of multiple data flow | |
| CN104734905A (en) | Data flow detection method and device | |
| CN110943932B (en) | Information processing method and device | |
| CN112543145A (en) | Method and device for selecting communication path of equipment node for sending data | |
| CN112600753B (en) | Equipment node communication path selection method and device according to equipment access amount | |
| CN106603426A (en) | Message discarding method and device | |
| CN115801639A (en) | Bandwidth detection method and device, electronic equipment and storage medium | |
| CN110661731B (en) | Message processing method and device | |
| CN112688824B (en) | RTP packet loss detection method, device, equipment and computer readable storage medium | |
| CN110336759B (en) | RDMA (remote direct memory Access) -based protocol message forwarding method and device | |
| CN111106977B (en) | Data stream detection method, device and storage medium | |
| CN106027405B (en) | Data stream shunting method and device | |
| CN117395178B (en) | Quality monitoring method based on network division |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |