CN111326176A - Detection method, device and medium of RTP packet based on OPUS coding - Google Patents
Detection method, device and medium of RTP packet based on OPUS coding Download PDFInfo
- Publication number
- CN111326176A CN111326176A CN201811533681.2A CN201811533681A CN111326176A CN 111326176 A CN111326176 A CN 111326176A CN 201811533681 A CN201811533681 A CN 201811533681A CN 111326176 A CN111326176 A CN 111326176A
- Authority
- CN
- China
- Prior art keywords
- rtp
- packet
- audio
- opus
- data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000001514 detection method Methods 0.000 title claims abstract description 36
- 238000000034 method Methods 0.000 claims abstract description 33
- 230000008030 elimination Effects 0.000 claims description 6
- 238000003379 elimination reaction Methods 0.000 claims description 6
- 230000005540 biological transmission Effects 0.000 claims description 4
- 230000003247 decreasing effect Effects 0.000 claims description 4
- 238000012360 testing method Methods 0.000 abstract description 22
- 238000010586 diagram Methods 0.000 description 10
- 230000006870 function Effects 0.000 description 8
- 238000004590 computer program Methods 0.000 description 7
- 208000037265 diseases, disorders, signs and symptoms Diseases 0.000 description 6
- 238000012986 modification Methods 0.000 description 5
- 230000004048 modification Effects 0.000 description 5
- 230000003287 optical effect Effects 0.000 description 4
- 238000012545 processing Methods 0.000 description 4
- 230000006798 recombination Effects 0.000 description 3
- 238000005215 recombination Methods 0.000 description 3
- 230000008859 change Effects 0.000 description 2
- 239000013307 optical fiber Substances 0.000 description 2
- 229920002776 polycyclohexyl methacrylate Polymers 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 230000000644 propagated effect Effects 0.000 description 2
- 238000005070 sampling Methods 0.000 description 2
- 206010029216 Nervousness Diseases 0.000 description 1
- 230000004075 alteration Effects 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 230000001788 irregular Effects 0.000 description 1
- 230000009191 jumping Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L25/00—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
- G10L25/48—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use
- G10L25/51—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use for comparison or discrimination
- G10L25/60—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use for comparison or discrimination for measuring the quality of voice signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/50—Testing arrangements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/65—Network streaming protocols, e.g. real-time transport protocol [RTP] or real-time control protocol [RTCP]
Abstract
The application discloses a detection method, a device and a medium of an RTP packet based on OPUS coding, relates to the field of audio testing, and aims to solve the problem that the RTP packet based on the OPUS audio coding cannot be decoded into an audio file capable of being played. The method comprises the following steps: acquiring an RTP data packet based on OPUS coding; removing bytes of the packet head part of each RTP packet in the RTP data packet to obtain the residual bytes of each RTP packet; splicing the residual bytes of each RTP packet to obtain an original data file; and calling a pre-compiled decoding tool to decode the original data file to obtain a playable audio file, and then carrying out audio detection. Therefore, the RTP data packets are removed and recombined, so that the RTP packets based on the OPUS coding can be decoded into a playable audio file through a special tool and a decoding tool, and the audio test of the audio file based on the OPUS coding is simpler.
Description
Technical Field
The present application relates to the field of audio testing, and in particular, to a method, an apparatus, and a medium for detecting an RTP packet based on an OPUS code.
Background
With the increase of network bandwidth and network quality, many companies have no longer adopted PCMU or PCMA to encode audio in the field of audio coding, but more OPUS coding with higher flexibility and better fidelity is adopted. In the prior art, only an RTP (real Transport Protocol) packet encoded by PCMA and PCMU can be decompressed into an audio file that can be played through a wireshak tool. However, in the prior art, there is no function of decoding the audio coding RTP packet based on the OPUS into an audio file that can be played, so that the audio testing cannot be performed on the audio coding RTP packet based on the OPUS.
Disclosure of Invention
The embodiment of the application provides a detection method, a detection device and a storage medium of an RTP packet based on OPUS coding. Calling a pre-configured executable script file through an LUA interface of a wireshark tool to obtain an RTP data packet based on OPUS coding, and removing bytes of a packet header part in the RTP data packet. Splicing the residual bytes of each RTP packet to obtain an original data file, and decoding the original data file by a pre-compiled decoding tool to obtain a playable audio file. Therefore, the RTP packets based on the OPUS coding can be decoded into a playable audio file through a wireshark tool and a decoding tool through the elimination and recombination of the RTP data packets, and the audio test of the audio file based on the OPUS coding is simpler.
In a first aspect, an embodiment of the present application provides a method for detecting an RTP packet based on OPUS coding, where the method includes:
acquiring an RTP data packet based on OPUS coding;
removing bytes of the packet head part of each RTP packet in the RTP data packet to obtain the residual bytes of each RTP packet;
splicing the residual bytes of each RTP packet to obtain an original data file;
and calling a pre-compiled decoding tool to decode the original data file to obtain a playable audio file, and then carrying out audio detection.
In a second aspect, an embodiment of the present application provides an apparatus for detecting an RTP packet based on OPUS coding, where the apparatus includes:
the acquisition module is used for acquiring an RTP data packet based on the OPUS code;
the elimination module is used for eliminating the bytes of the packet head part of each RTP packet in the RTP data packet to obtain the residual bytes of each RTP packet;
the splicing module is used for splicing the residual bytes of each RTP packet to obtain an original data file;
and the decoding module is used for calling a pre-compiled decoding tool to decode the original data file to obtain a playable audio file and then carrying out audio detection.
In a third aspect, another embodiment of the present application further provides a computing device comprising at least one processor; and;
a memory communicatively coupled to the at least one processor; the storage stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to execute a method for detecting an RTP packet based on OPUS coding according to an embodiment of the present application.
In a fourth aspect, another embodiment of the present application further provides a computer storage medium, where the computer storage medium stores computer-executable instructions, and the computer-executable instructions are configured to cause a computer to execute a method for detecting an RTP packet based on OPUS coding in an embodiment of the present application.
Additional features and advantages of the application will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by the practice of the application. The objectives and other advantages of the application may be realized and attained by the structure particularly pointed out in the written description and claims hereof as well as the appended drawings.
Drawings
The accompanying drawings, which are included to provide a further understanding of the application and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the application and together with the description serve to explain the application and not to limit the application. In the drawings:
fig. 1 is a schematic flowchart of a detection method for RTP packets based on OPUS coding in an embodiment of the present application;
fig. 2 is a schematic diagram of a detection structure of an RTP packet based on OPUS coding in an embodiment of the present application;
fig. 3 is a schematic structural diagram of a computing device according to an embodiment of the present application.
Detailed Description
In order to enable an RTP packet based on the OPUS coding to be decoded into a playable audio file by a wireshark tool and enable audio testing of the audio file based on the OPUS coding to be simpler, embodiments of the present application provide a method and an apparatus for detecting an RTP packet based on the OPUS coding, and a storage medium. In order to better understand the technical solution provided by the embodiments of the present application, the following brief description is made on the basic principle of the solution:
calling a pre-configured executable script file through a LUA interface of a wireshark tool to obtain an RTP data packet based on OPUS coding, and performing elimination and recombination on the RTP data packet to obtain an original data file. And decoding the original data file by a decoding tool compiled in advance to obtain a playable audio file. Thereby enabling audio testing of audio files based on OPUS coding and still be implemented based on the wireshark tool.
The following describes problems encountered in audio testing of audio files based on OPUS coding in the prior art:
in the prior art, audio tests of audio files based on the OPUS codes are divided into subjective tests and objective tests, and subjective tests are often used as the main tests in actual tests. When a test engineer finds quality problems during subjective testing, the test engineer can only passively record the problems by recording or describe the problems occurring in the audio to the developer. And the developer reproduces and records the bottom layer audio file according to the problem fed back by the test engineer to position and solve the problem. The process has a lot of uncertainties, and also consumes a lot of time and labor cost, which affects the normal working efficiency.
The existing wireshark tool does not have the function of decoding the audio file based on the OPUS coding. There is also a little bit of RTP packet parsing data for OPUS coding on the network. Therefore, the application provides a detection method, a detection device and a storage medium of an RTP packet based on OPUS coding.
The detection method of RTP packets based on OPUS coding is further described below by specific embodiments. Fig. 1 is a schematic flow chart of a detection method of an RTP packet based on OPUS coding, which includes the following steps:
step 101: RTP data packets based on OPUS coding are obtained.
Wherein, the RTP data packet comprises a plurality of RTP packets.
Step 102: and eliminating the bytes of the packet head part of each RTP packet in the RTP data packet to obtain the residual bytes of each RTP packet.
Step 103: and splicing the rest bytes of each RTP packet to obtain an original data file.
Step 104: and calling a pre-compiled decoding tool to decode the original data file to obtain a playable audio file, and then carrying out audio detection.
Thus, through the elimination and recombination of the RTP data packets, the RTP packets based on the OPUS coding can be decoded into a playable audio file through a wireshark tool and a decoding tool, so that the audio test of the audio file based on the OPUS coding is possible and easy to realize.
In one embodiment, the RTP data packets are obtained and then analyzed, the bytes of each RTP packet are determined, the bytes of the header part of each RTP packet are removed, and the remaining bytes are saved to form a new data file.
Preferably, in an embodiment, after the RTP packets are obtained, the Length (byte size) values of the RTP packets in the RTP packets may be traversed and stored in an array. Reading the RTP data packet, reading the bytes of the RTP packet where the array subscript in the Length array is located each time, removing the first 56 bytes of the RTP packet bytes read each time, and rewriting the RTP packet bytes into a new data file. It should be noted that the first 56 bytes are bytes of the header portion of each RTP packet, and the bytes of the header portion can be removed according to actual situations, and are not limited to the first 56 bytes.
For example: if the size of the header part byte of each RTP packet in the RTP data packet is 32 bytes, the method may be: reading the bytes of the size of each RTP packet in the Length array each time, removing the first 32 bytes read to the bytes each time, and rewriting the bytes to a new data file.
In this embodiment of the present application, before removing the bytes of the header portion of each RTP packet in the RTP data packet, whether the RTP data packet is out of order and/or lost may be determined according to the sequence number value in each RTP packet, which may be specifically implemented as steps a1-a 2:
step A1: and acquiring the sequence number value of each RTP packet in the RTP data packet based on the OPUS coding.
Step A2: and if the sequence number value is determined not to be sequentially increased or decreased according to the preset step value, determining that the RTP data packet has disorder and/or packet loss.
Therefore, whether the audio file has problems during network transmission is judged by determining whether the RTP data packet has disorder and/or packet loss, and convenience is provided for subsequent audio test.
It should be noted that the sequential increment or decrement of the sequence number value according to the preset step value can be divided into three cases:
1. if the sequence number value of each RTP packet is increased progressively according to the step 1, the jumping sequence number change occurs, which is the packet loss condition. For example: the sequence number value of each RTP packet is as follows: 1,2,3,4,6,7 (where the number 5 is missing) … … or 1,2,3,7,8,9,11,14,15,16 (where the numbers 4, 5, 6, 10, 12, 13 are missing) … …, the case is a packet loss.
2. If the sequence number of each RTP packet is irregularly arranged, the situation is a disorder situation. For example: the sequence number value of each RTP packet is as follows: 3,8, 9,5,23,4 … … (wherein the number 9 precedes the number 5), etc., this is out of order.
3. If the sequence number value of each RTP packet is increased progressively according to the step value of 1, the sequence number not only has jumpiness change, but also has the condition of irregular arrangement, namely disorder and packet loss. For example: the sequence number value of each RTP packet is as follows: 1,2,3,8, 7,11,9,6,14,15,17,18,19 … …, etc., this is out of order and lost.
In one embodiment, the RTP data packets are obtained and then analyzed, the sequence number value of each RTP packet is determined, the sequence number value of each RTP packet in the RTP data packets is judged, and whether the RTP data packets are out of order and/or lost is determined.
Preferably, in an embodiment, after the RTP data packets are obtained, the seq (sequence number) values of each RTP packet in the RTP data packets may be stored in an array, and whether the RTP data packets are out of order and/or lost is determined according to the array subscript and the sequence number value of the array.
In this embodiment of the present application, if it is determined that the RTP data packet is out of order and/or has lost, the user should be prompted that the RTP data packet has the problem of out of order and/or has lost, which may be specifically implemented as: and popping up a pop-up prompt of the RTP data packet out of order and/or packet loss.
Therefore, according to the pop-up box prompt, the audio file can be determined to have a problem during network transmission, and convenience is provided for subsequent audio testing.
In the embodiment of the present application, the obtained RTP data packet is a filtered RTP data packet of a single-channel audio call. The data packet usually has only one data source, and sometimes is affected by streaming or network switching equipment, and the RTP data packet may be interspersed with RTP packets of other data sources, and at this time, the RTP packets of other data sources need to be removed, which may be specifically implemented as steps B1-B5:
step B1: and reading the information which is used for representing the data source identification of each RTP packet in the RTP data packets based on the OPUS coding into an array to obtain the data source identification array.
Step B2: and traversing the data source identification array, and determining the data source identification with the maximum quantity in the data source identification array.
Step B3: and recording an array subscript of the data source identification different from the data source identification with the maximum quantity in the data source identification array.
Step B4: and eliminating the RTP packets corresponding to the data source identification in the recorded array subscript to obtain the eliminated RTP data packets.
The foregoing removing bytes of the header portion of each RTP packet in the RTP data packet to obtain the remaining bytes of each RTP packet may be performed as: and eliminating the bytes of the header part in the RTP data packet after the elimination to obtain the residual bytes of each RTP packet.
Therefore, only one data source is in the data packets by eliminating RTP packets of different data sources, so that the error interference of the audio test is reduced.
It should be noted that the operation of removing RTP packets of different data sources should be performed before determining whether RTP packets are out of order and/or lost.
In the prior art, the operations cannot be directly performed by the wireshark tool, and therefore, in the embodiment of the present application, the operations are implemented by a pre-configured executable script file. The method can be specifically implemented as follows: and calling a pre-configured executable script file through an LUA interface of a wireshark tool to acquire an RTP data packet based on the OPUS coding.
Therefore, the method is integrated into a wireshark tool by utilizing the characteristic of strong embeddability of the LUA script, and is practical and convenient.
The method of obtaining the original data file by the wireshark tool is described above, and the method of decoding the original data file into a playable audio file is further described below.
The decoder of the OPUS audio coding can download the source code in the source code repository of the OPUS official network and compile it into an exe file. The OPUS file is decoded by executing the exe file and passing in different parameters.
The OPUS Source code downloaded by the OPUS official network is compiled into OPUS. And (4) putting the original data file obtained previously into a compiled opus. And importing the obtained audio file into Cool-Edit software for playing. Wherein, the necessary parameters required for decoding are also required during decoding, which comprises: channel and audio sampling rate. The sound channel and the audio sampling rate are preset parameters and can be modified according to actual conditions.
It should be noted that, when decoding, the audio file with the required format can be obtained according to the actual situation.
Based on the same inventive concept, the embodiment of the present application further provides a detection apparatus for an RTP packet based on the OPUS coding. As shown in fig. 2, the apparatus includes:
a first obtaining module 201, configured to obtain an RTP packet based on the OPUS coding;
a first removing module 202, configured to remove bytes of a header portion of each RTP packet in the RTP data packet to obtain remaining bytes of each RTP packet;
the splicing module 203 is configured to splice the remaining bytes of each RTP packet to obtain an original data file;
and the decoding module 204 is configured to invoke a pre-compiled decoding tool to decode the original data file, so as to perform audio detection after obtaining a playable audio file.
Further, the apparatus further comprises:
the second acquisition module is used for acquiring the serial number value of each RTP packet in the RTP data packet based on the OPUS code after the acquisition module acquires the RTP data packet based on the OPUS code;
and the disorder and/or packet loss module is used for determining that the RTP data packet has disorder and/or packet loss if the sequence number value is determined not to be sequentially increased or decreased according to the preset step value.
Further, the apparatus further comprises:
and the frame popping module is used for popping a frame popping prompt of the RTP data packet out of order and/or packet loss after determining that the RTP data packet is out of order and/or packet loss.
Further, the apparatus further comprises:
the reading module is used for reading the information which is used for expressing the data source identification of each RTP packet in the RTP data packets based on the OPUS coding into an array before the bytes of the packet head part of each RTP packet in the RTP data packets are removed by the removing module to obtain the residual bytes of each RTP packet, so as to obtain a data source identification array;
the traversal module is used for traversing the data source identification array and determining the data source identification with the largest quantity in the data source identification array;
the recording module is used for recording an array subscript where a data source identifier different from the data source identifier with the largest quantity is located in the data source identifier array;
the second eliminating module is used for eliminating the RTP packet corresponding to the data source identifier in the recorded array subscript to obtain an eliminated RTP data packet;
the first culling module 202 includes:
and the removing unit is used for removing the bytes of the packet header part in the removed RTP data packet to obtain the residual bytes of each RTP packet.
Further, the first obtaining module 201 includes:
the first acquiring unit is used for calling a pre-configured executable script file through a LUA interface of a wireshark tool to acquire the RTP data packet based on the OPUS coding.
Further, the first obtaining module 202 includes:
a second obtaining unit, configured to obtain RTP data packets based on the OPUS code at the receiving end and the sending end;
further, the device also comprises:
the first problem module is used for calling a pre-compiled decoding tool to decode the original data file by the decoding module, carrying out audio detection after obtaining a playable audio file, and determining that the audio coding has a problem if the audio detection result of the audio file obtained by decoding the RTP data packet obtained by the sending end is that the audio file is abnormally played;
a second problem module, configured to determine that a problem occurs in network transmission if a result of performing audio detection on the audio file decoded from the RTP packet acquired by the sending end is that the audio file is normally played, and a result of performing audio detection on the audio file decoded from the RTP packet acquired by the receiving end is that the audio file is abnormally played;
and the third problem module is used for determining that the audio decoding is in a problem if the audio file playing is normal as a result of audio detection on the audio file decoded by the RTP data packet acquired by the transmitting end and the audio file playing is normal as a result of audio detection on the audio file decoded by the RTP data packet acquired by the receiving end.
Having described the method and apparatus for detection of RTP packets based on OPUS coding according to exemplary embodiments of the present application, a computing apparatus according to another exemplary embodiment of the present application is described next.
As will be appreciated by one skilled in the art, aspects of the present application may be embodied as a system, method or program product. Accordingly, various aspects of the present application may be embodied in the form of: an entirely hardware embodiment, an entirely software embodiment (including firmware, microcode, etc.) or an embodiment combining hardware and software aspects that may all generally be referred to herein as a "circuit," module "or" system.
In some possible implementations, a computing device may include at least one processor, and at least one memory, according to embodiments of the application. Wherein the memory stores program code which, when executed by the processor, causes the processor to execute the steps 101 and 104 of the detection method for RTP packets based on OPUS coding according to various exemplary embodiments of the present application described above in the present specification.
The computing device 30 according to this embodiment of the present application is described below with reference to fig. 3. The computing device 30 shown in fig. 3 is only an example and should not bring any limitations to the functionality or scope of use of the embodiments of the present application. The computing device may be, for example, a cell phone, a tablet computer, or the like.
As shown in FIG. 3, computing device 30 is embodied in the form of a general purpose computing device. Components of computing device 30 may include, but are not limited to: the at least one processor 31, the at least one memory 32, and a bus 33 connecting the various system components (including the memory 32 and the processor 31).
The memory 32 may include readable media in the form of volatile memory, such as Random Access Memory (RAM)321 and/or cache memory 322, and may further include Read Only Memory (ROM) 323.
In some possible embodiments, the various aspects of the detection method of RTP packets based on OPUS coding provided in this application may also be implemented in the form of a program product, which includes program code for causing a computer device to execute the steps in the method of detection of RTP packets based on OPUS coding according to various exemplary embodiments of this application described above in this specification, when the program product runs on the computer device, execute step 101 and step 104 shown in fig. 1.
The program product may employ any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. A readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples (a non-exhaustive list) of the readable storage medium include: an electrical connection having one or more wires, a portable disk, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
The detection method of the RTP packet based on the OPUS coding according to the embodiment of the present application may use a portable compact disc read only memory (CD-ROM) and include program codes, and may be executed on a computing device. However, the program product of the present application is not limited thereto, and in this document, a readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.
A readable signal medium may include a propagated data signal with readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A readable signal medium may also be any readable medium that is not a readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.
Program code embodied on a readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
Program code for carrying out operations of the present application may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user computing device, partly on the user equipment, as a stand-alone software package, partly on the user computing device and partly on a remote computing device, or entirely on the remote computing device or server. In the case of remote computing devices, the remote computing device may be connected to the user computing device through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computing device (e.g., through the internet using an internet service provider).
It should be noted that although several units or sub-units of the apparatus are mentioned in the above detailed description, such division is merely exemplary and not mandatory. Indeed, the features and functions of two or more units described above may be embodied in one unit, according to embodiments of the application. Conversely, the features and functions of one unit described above may be further divided into embodiments by a plurality of units.
Moreover, although the operations of the methods of the present application are depicted in the drawings in a sequential order, this does not require or imply that these operations must be performed in this order, or that all of the illustrated operations must be performed, to achieve desirable results. Additionally or alternatively, certain steps may be omitted, multiple steps combined into one step execution, and/or one step broken down into multiple step executions.
As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a manner that causes the instructions stored in the computer-readable memory to produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
While the preferred embodiments of the present application have been described, additional variations and modifications in those embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including preferred embodiments and all alterations and modifications as fall within the scope of the application.
It will be apparent to those skilled in the art that various changes and modifications may be made in the present application without departing from the spirit and scope of the application. Thus, if such modifications and variations of the present application fall within the scope of the claims of the present application and their equivalents, the present application is intended to include such modifications and variations as well.
Claims (10)
1. A method for detecting RTP packets based on OPUS coding, the method comprising:
acquiring an RTP (real-time transport protocol) data packet based on OPUS coding;
removing bytes of the packet head part of each RTP packet in the RTP data packet to obtain the residual bytes of each RTP packet;
splicing the residual bytes of each RTP packet to obtain an original data file;
and calling a pre-compiled decoding tool to decode the original data file to obtain a playable audio file, and then carrying out audio detection.
2. The method of claim 1, wherein after retrieving the OPUS coding based RTP packet, the method further comprises:
acquiring a sequence number value of each RTP packet in an RTP data packet based on an OPUS code;
and if the sequence number value is determined not to be sequentially increased or decreased according to the preset step value, determining that the RTP data packet has disorder and/or packet loss.
3. The method according to claim 2, wherein if it is determined that the obtained sequence number value is not sequentially incremented or decremented according to a preset step value, after it is determined that the RTP packet is out of order and/or has a packet loss, the method further comprises:
and popping up a pop-up prompt of the RTP data packet out of order and/or packet loss.
4. The method of claim 1, wherein before the removing the bytes in the header portion of each RTP packet in the RTP data packet and obtaining the remaining bytes of each RTP packet, the method further comprises:
reading information, which is used for representing data source identification, of each RTP packet in RTP data packets based on OPUS coding into an array to obtain a data source identification array;
traversing the data source identification array, and determining the data source identification with the largest quantity in the data source identification array;
recording an array subscript where a data source identifier different from the most data source identifiers is located in the data source identifier array;
removing the RTP packets corresponding to the data source identification in the recorded array subscript to obtain removed RTP data packets;
removing bytes of the packet head part of each RTP packet in the RTP data packet to obtain the remaining bytes of each RTP packet, which specifically comprises the following steps:
and eliminating the bytes of the header part in the RTP data packet after the elimination to obtain the residual bytes of each RTP packet.
5. The method according to claim 1, wherein the obtaining the RTP packet based on the OPUS coding specifically includes:
and calling a pre-configured executable script file through an LUA interface of a wireshark tool to acquire an RTP data packet based on the OPUS coding.
6. The method according to claim 1, wherein the obtaining the RTP packet based on the OPUS coding specifically includes:
acquiring RTP data packets based on OPUS coding of a receiving end and a transmitting end;
and calling a pre-compiled decoding tool to decode the original data file to obtain a playable audio file, and then carrying out audio detection, wherein the method further comprises the following steps:
if the audio detection result of the audio file obtained by the sending end and subjected to the decoding of the RTP data packet is that the audio file is abnormally played, determining that the audio coding has a problem;
if the audio detection result of the audio file obtained by decoding the RTP data packet obtained by the sending end is that the audio file is normally played, and the audio detection result of the audio file obtained by decoding the RTP data packet obtained by the receiving end is that the audio file is abnormally played, determining that the network transmission has a problem;
and if the audio detection result of the audio file obtained by decoding the RTP data packet obtained by the sending end is that the audio file is normally played, and the audio detection result of the audio file obtained by decoding the RTP data packet obtained by the receiving end is that the audio file is normally played, determining that the audio decoding has a problem.
7. An apparatus for detecting RTP packets based on OPUS coding, the apparatus comprising:
the first acquisition module is used for acquiring an RTP data packet based on OPUS coding;
the first removing module is used for removing bytes of the packet head part of each RTP packet in the RTP data packet to obtain the residual bytes of each RTP packet;
the splicing module is used for splicing the residual bytes of each RTP packet to obtain an original data file;
and the decoding module is used for calling a pre-compiled decoding tool to decode the original data file to obtain a playable audio file and then carrying out audio detection.
8. The apparatus of claim 7, wherein after the obtaining module obtains the RTP packet based on the OPUS coding, the apparatus further comprises:
the second acquisition module is used for acquiring the serial number value of each RTP packet in the RTP data packet based on the OPUS coding;
and the disorder and/or packet loss module is used for determining that the RTP data packet has disorder and/or packet loss if the sequence number value is determined not to be sequentially increased or decreased according to the preset step value.
9. A computer-readable medium having stored thereon computer-executable instructions for performing the method of any one of claims 1-6.
10. A computing device, comprising:
at least one processor; and a memory communicatively coupled to the at least one processor; wherein the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of any one of claims 1-6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811533681.2A CN111326176A (en) | 2018-12-14 | 2018-12-14 | Detection method, device and medium of RTP packet based on OPUS coding |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811533681.2A CN111326176A (en) | 2018-12-14 | 2018-12-14 | Detection method, device and medium of RTP packet based on OPUS coding |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111326176A true CN111326176A (en) | 2020-06-23 |
Family
ID=71166526
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811533681.2A Pending CN111326176A (en) | 2018-12-14 | 2018-12-14 | Detection method, device and medium of RTP packet based on OPUS coding |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111326176A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110827838A (en) * | 2019-10-16 | 2020-02-21 | 云知声智能科技股份有限公司 | Opus-based voice coding method and apparatus |
| CN113542032A (en) * | 2021-07-21 | 2021-10-22 | 中电海康无锡科技有限公司 | Method and device for rapidly verifying GB/T28181 protocol |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102254560A (en) * | 2010-05-19 | 2011-11-23 | 安凯(广州)微电子技术有限公司 | Audio processing method in mobile digital television recording |
| CN102572585A (en) * | 2010-12-08 | 2012-07-11 | 中国科学院声学研究所 | Method and system for high speed and parallel data reception and processing |
| WO2014055329A1 (en) * | 2012-10-01 | 2014-04-10 | Internet Services, Llc | System and method for synchronization of haptic data and media data |
| US20150200993A1 (en) * | 2014-01-15 | 2015-07-16 | International Business Machines Corporation | Optimizing the quality of audio within a teleconferencing session via an adaptive codec switching |
| CN105099897A (en) * | 2014-05-13 | 2015-11-25 | 中兴通讯股份有限公司 | Method of communication between browser and telecommunication network and gateway |
| CN105872849A (en) * | 2016-03-30 | 2016-08-17 | 成都凯腾四方数字广播电视设备有限公司 | Network transmission real-time audio-video error correction method and system based on FPGA |
| CN105898555A (en) * | 2015-12-28 | 2016-08-24 | 乐视致新电子科技（天津）有限公司 | Audio abnormity positioning method and device |
| CN107231328A (en) * | 2016-03-23 | 2017-10-03 | 福建星网锐捷通讯股份有限公司 | Method for real-time video transmission, device, equipment and system |
| CN108337545A (en) * | 2017-01-20 | 2018-07-27 | 韩华泰科株式会社 | Media playback and media serving device for reproduced in synchronization video and audio |
| CN108650550A (en) * | 2018-07-05 | 2018-10-12 | 平安科技（深圳）有限公司 | Network transmission quality analysis method, device, computer equipment and storage medium |
-
2018
- 2018-12-14 CN CN201811533681.2A patent/CN111326176A/en active Pending
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102254560A (en) * | 2010-05-19 | 2011-11-23 | 安凯(广州)微电子技术有限公司 | Audio processing method in mobile digital television recording |
| CN102572585A (en) * | 2010-12-08 | 2012-07-11 | 中国科学院声学研究所 | Method and system for high speed and parallel data reception and processing |
| WO2014055329A1 (en) * | 2012-10-01 | 2014-04-10 | Internet Services, Llc | System and method for synchronization of haptic data and media data |
| US20150200993A1 (en) * | 2014-01-15 | 2015-07-16 | International Business Machines Corporation | Optimizing the quality of audio within a teleconferencing session via an adaptive codec switching |
| CN105099897A (en) * | 2014-05-13 | 2015-11-25 | 中兴通讯股份有限公司 | Method of communication between browser and telecommunication network and gateway |
| CN105898555A (en) * | 2015-12-28 | 2016-08-24 | 乐视致新电子科技（天津）有限公司 | Audio abnormity positioning method and device |
| CN107231328A (en) * | 2016-03-23 | 2017-10-03 | 福建星网锐捷通讯股份有限公司 | Method for real-time video transmission, device, equipment and system |
| CN105872849A (en) * | 2016-03-30 | 2016-08-17 | 成都凯腾四方数字广播电视设备有限公司 | Network transmission real-time audio-video error correction method and system based on FPGA |
| CN108337545A (en) * | 2017-01-20 | 2018-07-27 | 韩华泰科株式会社 | Media playback and media serving device for reproduced in synchronization video and audio |
| CN108650550A (en) * | 2018-07-05 | 2018-10-12 | 平安科技（深圳）有限公司 | Network transmission quality analysis method, device, computer equipment and storage medium |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110827838A (en) * | 2019-10-16 | 2020-02-21 | 云知声智能科技股份有限公司 | Opus-based voice coding method and apparatus |
| CN113542032A (en) * | 2021-07-21 | 2021-10-22 | 中电海康无锡科技有限公司 | Method and device for rapidly verifying GB/T28181 protocol |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110764945B (en) | Crash log processing method, device, equipment and storage medium | |
| US8275586B2 (en) | Enabling end-to-end testing of applications across networks | |
| CN110147240B (en) | Cloud storage-based application program installation method, system and storage medium | |
| CN109388556B (en) | Method and device for analyzing test process | |
| JP6314252B2 (en) | Network video playback method and apparatus | |
| CN106649342A (en) | Data processing method and apparatus in data acquisition platform | |
| CN111326176A (en) | Detection method, device and medium of RTP packet based on OPUS coding | |
| CN103544095A (en) | Server program monitoring method and system of server program | |
| EP3251019A1 (en) | Multiple protocol media streaming | |
| CN108874825B (en) | Abnormal data verification method and device | |
| EP4087266A1 (en) | Playback mode determining method and apparatus | |
| CN109492181A (en) | Method for page jump, device, computer equipment and storage medium | |
| CN106210032A (en) | The method and device reported based on terminal data batch | |
| CN105357229B (en) | Video processing method and device | |
| WO2023065749A1 (en) | Distributed database embedding method and apparatus, and device and storage medium | |
| CN103237215B (en) | Player method and playback equipment | |
| CN108647284B (en) | Method and device for recording user behavior, medium and computing equipment | |
| CN112491421A (en) | Analysis method, device, equipment and medium for log file compression package | |
| CN106648912B (en) | Modularization method and device for data processing in data acquisition platform | |
| CN114500348B (en) | CDN gateway testing method and system | |
| US9263092B2 (en) | Extended diagnostic overlay control for tape storage devices | |
| CN114090514A (en) | Log retrieval method and device for distributed system | |
| US10922249B2 (en) | Input/output control code filter | |
| CN114138633A (en) | Method, device and equipment for testing software based on data driving and readable medium | |
| CN114936185A (en) | Method and device for establishing dependency relationship between pod libraries and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200623 |