CN117615036A - Multi-channel audio transmission method and device - Google Patents

Multi-channel audio transmission method and device Download PDF

Info

Publication number
CN117615036A
CN117615036A CN202311602104.5A CN202311602104A CN117615036A CN 117615036 A CN117615036 A CN 117615036A CN 202311602104 A CN202311602104 A CN 202311602104A CN 117615036 A CN117615036 A CN 117615036A
Authority
CN
China
Prior art keywords
audio
transmitted
audio data
data
path
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202311602104.5A
Other languages
Chinese (zh)
Inventor
刘文昌
王兆奎
康丽丽
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Thunisoft Information Technology Co ltd
Original Assignee
Beijing Thunisoft Information Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Thunisoft Information Technology Co ltd filed Critical Beijing Thunisoft Information Technology Co ltd
Priority to CN202311602104.5A priority Critical patent/CN117615036A/en
Publication of CN117615036A publication Critical patent/CN117615036A/en
Pending legal-status Critical Current

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
    • H04L69/14—Multichannel or multilink protocols
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
    • H04L69/16—Implementation or adaptation of Internet protocol [IP], of transmission control protocol [TCP] or of user datagram protocol [UDP]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
    • H04L69/22—Parsing or analysis of headers

Abstract

The application discloses a method and a device for transmitting multipath audio, wherein the method comprises the following steps: the method comprises the steps that a sending end obtains multipath audio data to be transmitted; packaging the multipath audio data to be transmitted based on a preset TCP protocol to obtain a plurality of data packets to be transmitted of each path corresponding to the multipath audio data, wherein the preset TCP protocol comprises: the method comprises the steps of audio data length, audio path number, audio format and time stamp, wherein the audio data length, the audio path number, the audio format and the time stamp form a protocol head; and simultaneously multiplexing each path of multiple data packets to be transmitted corresponding to the multiple paths of audio data based on the preset audio path number of the TCP protocol, wherein each path of multiple data packets to be transmitted corresponding to the multiple paths of audio data are transmitted to a receiving end through a network.

Description

Multi-channel audio transmission method and device
Technical Field
The present disclosure relates to the field of audio transmission technologies, and in particular, to a method and an apparatus for transmitting multiple channels of audio.
Background
Audio transmission is an important transmission content, and in some special application scenarios, such as conference scenarios, court scenarios, etc., there are cases where multiple audio channels are simultaneously transmitted. In the prior art, a general streaming media protocol only supports single-channel audio transmission, cannot realize multi-channel audio transmission, and is complex and unfavorable for application.
Based on this, a new audio transmission method is needed to realize the transmission of multiple audio channels.
Disclosure of Invention
The embodiment of the application provides a transmission method of multipath audio, which is used for solving the following problems: in the prior art, a general streaming media protocol only supports single-channel audio transmission, cannot realize multi-channel audio transmission, and is complex and unfavorable for application.
In particular, the method comprises the steps of,
an embodiment of the present disclosure provides a method for transmitting multiple audio frequencies, which is applied to a transmitting end, where the method includes:
acquiring multiple paths of audio data to be transmitted;
packaging the multipath audio data to be transmitted based on a preset TCP protocol to obtain a plurality of data packets to be transmitted of each path corresponding to the multipath audio data, wherein the preset TCP protocol comprises: the method comprises the steps of audio data length, audio path number, audio format and time stamp, wherein the audio data length, the audio path number, the audio format and the time stamp form a protocol head;
and simultaneously multiplexing each path of multiple data packets to be transmitted corresponding to the multiple paths of audio data based on the preset audio path number of the TCP protocol, wherein each path of multiple data packets to be transmitted corresponding to the multiple paths of audio data are transmitted to a receiving end through a network.
The embodiment of the specification provides a transmission method of multipath audio, which is applied to a receiving end, and the transmission method comprises the following steps of
Receiving a plurality of data packets to be transmitted of each channel corresponding to the multi-channel audio data in the claims of the application;
analyzing each path of a plurality of data packets to be transmitted corresponding to the multipath audio data based on a preset TCP (transmission control protocol) timestamp to obtain an analysis result, and performing voice recognition or playing on the analysis result.
The embodiment of the present disclosure further provides a transmission device for multi-channel audio, which is applied to a transmitting end, and the transmission device includes:
the acquisition module acquires multipath audio data to be transmitted;
the packaging module is used for packaging the multipath audio data to be transmitted based on a preset TCP protocol to obtain a plurality of data packets to be transmitted of each path corresponding to the multipath audio data, wherein the preset TCP protocol comprises: the method comprises the steps of audio data length, audio path number, audio format and time stamp, wherein the audio data length, the audio path number, the audio format and the time stamp form a protocol head;
and the transmission module is used for simultaneously multiplexing the multiple paths of data packets to be transmitted corresponding to the multiple paths of audio data based on the preset audio path number of the TCP protocol, and transmitting the multiple paths of data packets to be transmitted corresponding to the multiple paths of audio data to a receiving end through a network.
The embodiment of the present disclosure further provides a transmission device for multi-channel audio, which is applied to a receiving end, and the transmission device includes:
the receiving module is used for receiving a plurality of data packets to be transmitted of each channel corresponding to the multi-channel audio data;
and the analysis module is used for analyzing a plurality of data packets to be transmitted in each path corresponding to the multipath audio data based on a preset TCP (transmission control protocol) timestamp to obtain an analysis result, so as to perform voice recognition or play on the analysis result.
The technical scheme provided by the embodiment of the application has at least the following beneficial effects: the simultaneous transmission of multiple paths of audio data can be realized through the preset TCP protocol, and the method has the characteristics of low delay and simple protocol format.
Drawings
The accompanying drawings, which are included to provide a further understanding of the application and are incorporated in and constitute a part of this application, illustrate embodiments of the application and together with the description serve to explain the application and do not constitute an undue limitation to the application. In the drawings:
fig. 1 is a schematic system architecture diagram of a method for transmitting multiple audio signals according to an embodiment of the present disclosure;
fig. 2 is a flow chart of a method for transmitting multi-channel audio applied to a transmitting end according to an embodiment of the present disclosure;
fig. 3 is a schematic structural diagram of a preset TCP protocol provided in the embodiment of the disclosure;
fig. 4 is a schematic structural diagram of a data packet to be transmitted according to an embodiment of the present disclosure;
fig. 5 is a flowchart of a method for transmitting multi-channel audio applied to a receiving end according to an embodiment of the present disclosure;
fig. 6 is a schematic diagram of a transmission device of multi-channel audio applied to a transmitting end according to an embodiment of the present disclosure;
fig. 7 is a schematic diagram of a multi-channel audio transmission device applied to a receiving end according to an embodiment of the present disclosure.
Detailed Description
For the purposes, technical solutions and advantages of the present application, the technical solutions of the present application will be clearly and completely described below with reference to specific embodiments of the present application and corresponding drawings. It will be apparent that the described embodiments are only some, but not all, of the embodiments of the present application. All other embodiments, which can be made by one of ordinary skill in the art without undue burden from the present disclosure, are within the scope of the present disclosure.
Most of the existing general streaming media protocols are complex, the scenes to be considered are relatively many, the existing general streaming media protocols comprise control information and video parts, and only 1-channel audio transmission can be supported.
Based on this, the embodiment of the present disclosure provides a method for transmitting multiple paths of audio, which simplifies the existing TCP protocol to realize a function of simultaneously transmitting the audio with a specified number of paths.
Fig. 1 is a schematic diagram of an application scenario of a method for transmitting multi-channel audio according to an embodiment of the present disclosure. The multi-channel audio transmission method is applied to the transmitting end 100, the transmitting end is connected with the receiving end 200, the transmitting end is used for collecting audio data or audio data from video, the collected audio data or the audio data from video are transmitted to the receiving end 200, and after being analyzed by the receiving end 200, the processing such as voice recognition or playing is further carried out. The transmitting terminal 100 may be an audio device with a network function, and the transmitting terminal 100 is preferably a network sound card or a network microphone. The application scenario of the transmitting end 100 and the receiving end 200 may be, but not limited to, a conference scenario or a court scenario, where the transmitting end 100 collects multiple paths of audio or audio data from video at the same time, and sends the multiple paths of audio or audio data from video to the receiving end 200 for processing. The number of the transmitting terminals 100 is plural, and the number of the receiving terminals 200 is 1.
Fig. 2 is a flow chart of a method for transmitting multi-channel audio applied to a transmitting end according to an embodiment of the present disclosure. From the program perspective, the execution subject of the flow may be a program installed on an application server or an application terminal. It is understood that the method may be performed by any apparatus, device, platform, cluster of devices having computing, processing capabilities. As shown in fig. 2, the transmission method of the multi-channel audio includes:
step S201, acquiring multiple paths of audio data to be transmitted.
In the embodiment of the present disclosure, the transmitting end is an audio device with a network function, the transmitting end is preferably a network sound card or a network microphone, the number of transmitting ends is multiple, and the number of receiving ends for receiving is 1.
In the embodiment of the present disclosure, the audio data may be audio data, or may be audio data from video. The format of the audio data is WAV, PCM, MP3, AAC, MIDI, FLAC, AIFF, etc., and the specific type of the format of the audio data is not limited to the present application.
In this embodiment of the present disclosure, the acquiring multiple paths of audio data to be transmitted further includes the following steps:
and the sending end and the receiving end finish handshake operation.
The sending end and the receiving end complete handshake operation, namely a handshake process based on TCP. The sending end sends a connection establishment request to the receiving end, the receiving end returns data to the sending end after receiving the connection establishment request, and after receiving the data sent by the receiving end, the sending end proves that the data transmission from the sending end to the receiving end is normal, and the sending end and the receiving end finish handshake operation.
Step S203, packaging the multiple paths of audio data to be transmitted based on a preset TCP protocol, to obtain multiple paths of data packets to be transmitted corresponding to the multiple paths of audio data, where the preset TCP protocol includes: the method comprises the steps of audio data length, audio path number, audio format and time stamp, wherein the audio data length, the audio path number, the audio format and the time stamp form a protocol head.
The TCP (Transmission Control Protocol) protocol is a connection-oriented, reliable, byte stream based transport layer communication protocol specifically designed to provide reliable end-to-end byte streams over unreliable internetworks.
In the embodiment of the present specification, the byte number of the protocol header is 20.
In the embodiment of the present specification, the audio data length is of the UInt type, and the number of bytes of the audio data length is 4;
the audio path number is of the UInt type, and the byte number of the audio path number is 4;
the audio format is of the Char type, and the number of bytes of the audio format is 4;
the time stamp is of the UInt type, and the byte number of the time stamp is 4.
UInt type, in WINDOWS API, corresponds to a 32-bit unsigned integer, whose value is: the value is 2 31 -1, namely: 0 to 4294967295.
The Char type is a basic data type that can accommodate a single character, and string is used for storing character strings.
Since the preset TCP protocol specifies the following key fields: the audio data length, the audio path number, the audio format and the time stamp, so that each path of audio data of the multipath audio data to be processed can be subjected to data segmentation based on a preset TCP protocol, and each path of audio data of the multipath audio data to be processed is divided into a plurality of data segments. Based on the preset audio path number of the TCP protocol, the path number of the multipath audio data which can be transmitted simultaneously can be determined. Meanwhile, according to the audio data length and the audio path number, the audio length of each piece of audio data can be determined when each piece of audio data is segmented. I.e. audio length of each piece of audio data = audio data length/number of audio tracks. For example, when the audio data length is 2000 bits and the audio path number is 2, when the audio data to be processed is packaged, the audio data to be processed is segmented according to 1000 bits and then packaged.
Because the preset TCP protocol prescribes the time stamp, the multipath audio data to be transmitted is packaged based on the preset TCP protocol, and the time for the transmitting end to transmit the audio data is carried in the data packets to be transmitted in the process of obtaining the multiple paths of data packets to be transmitted corresponding to the multipath audio data.
In this embodiment of the present disclosure, the encapsulating, based on a preset TCP protocol, the multiple paths of audio data to be transmitted to obtain multiple paths of data packets to be transmitted corresponding to the multiple paths of audio data specifically includes:
determining the data length of the data packet to be transmitted based on the preset audio data length and audio path number of the TCP;
and respectively packaging each path of audio data of the multipath audio data to be transmitted based on the data length of the data packet to be transmitted and the preset TCP protocol, and obtaining a plurality of data packets to be transmitted of each path corresponding to the multipath audio data.
Fig. 3 is a schematic structural diagram of a preset TCP protocol according to an embodiment of the present disclosure. As shown in fig. 3, the preset TCP protocol includes: audio data length, number of audio passes, audio format, and time stamp.
In this embodiment of the present disclosure, the multiple paths of audio data to be transmitted are encapsulated based on a preset TCP protocol, so as to obtain multiple paths of data packets to be transmitted corresponding to the multiple paths of audio data. The packaging process is to segment each path of audio data of the multipath audio data according to the audio length to obtain segmented audio data; the segmented audio data is combined with a protocol header of the TCP protocol as a data packet to be transmitted. For further understanding of the data packet to be transmitted, fig. 4 is a schematic structural diagram of the data packet to be transmitted according to the embodiment of the present disclosure. As shown in fig. 4, the data packet to be transmitted includes: audio data length, number of audio passes, audio format, time stamp, and audio data.
Step S205, based on the preset number of audio paths of the TCP protocol, performing multiplexing on each path of multiple data packets to be transmitted corresponding to the multiple paths of audio data, where each path of multiple data packets to be transmitted corresponding to the multiple paths of audio data is transmitted to a receiving end through a network.
In this embodiment of the present disclosure, the multiplexing, based on the preset number of audio paths of the TCP protocol, of each path of multiple data packets to be transmitted corresponding to the multiple paths of audio data includes:
multiplexing the first data packet to be transmitted of each path corresponding to the multipath audio data simultaneously based on the preset audio path number of the TCP protocol;
after multiplexing transmission of each first data packet to be transmitted corresponding to the multiplexed audio data is completed, multiplexing transmission is performed on all other data packets to be transmitted except for each first data packet to be transmitted corresponding to the multiplexed audio data based on a received instruction from the receiving end;
and (3) circularly operating until the transmission of each path of a plurality of data packets to be transmitted corresponding to the multipath audio data is completed.
Specifically, if the multiple paths of audio data are 4 paths, the first data packets to be transmitted corresponding to the 4 paths of audio data are transmitted simultaneously, after the first data packets to be transmitted of the 4 paths of audio data are transmitted to the receiving end, the receiving end sends an instruction to the sending end, after the receiving end receives the instruction from the receiving end, the sending end continues to perform multiple paths of transmission on the other data packets to be transmitted corresponding to the 4 paths of audio data simultaneously, the data packets to be transmitted are transmitted to the receiving end, and the transmission of the multiple paths of audio data to be transmitted is completed through cyclic operation.
In the process of multi-channel audio data transmission, network failure and the like may exist, so that the transmitting end needs to retransmit the audio data.
Based on this, in the embodiment of the present specification, the instruction of the receiving end includes an acknowledgement instruction, a retransmission instruction;
after the multiplexing of the first data packet to be transmitted corresponding to the multiplexed audio data is completed, multiplexing other data packets to be transmitted except for the first data packet to be transmitted of each channel corresponding to the multiplexed audio data based on the received instruction from the receiving end, specifically including:
after multiplexing the first data packet to be transmitted corresponding to the multi-path audio data, if the received instruction from the receiving end is a confirmation instruction, multiplexing the second data packet to be transmitted corresponding to the multi-path audio data at the same time;
and if the received instruction from the receiving end is a retransmission instruction, multiplexing the first data packet to be transmitted of each path corresponding to the multipath audio based on the retransmission instruction.
Specifically, after receiving the data packet to be transmitted from the transmitting end, the receiving end confirms the received data packet to be transmitted, the receiving end sends a confirmation instruction to the transmitting end, and the transmitting end continues to transmit the next data packet to be transmitted after receiving the receiving instruction within a preset time. The determination of the preset time is dependent on the traffic scenario.
In one embodiment of the present disclosure, when the transmitting end sends a data packet to be transmitted to the receiving end, a timer is set, and if an acknowledgement command returned by the receiving end is not received within a preset time of the timer, the data needs to be retransmitted, and a retransmission command is started.
After the retransmission command is started, the receiving end starts retransmission based on the received retransmission command, and the retransmission method can adopt overtime retransmission or quick retransmission.
Fig. 5 is a flowchart of a method for transmitting multi-channel audio applied to a receiving end according to an embodiment of the present disclosure. From the program perspective, the execution subject of the flow may be a program installed on an application server or an application terminal. It is understood that the method may be performed by any apparatus, device, platform, cluster of devices having computing, processing capabilities.
In step S501, a plurality of packets to be transmitted corresponding to the plurality of channels of audio data are received.
In this embodiment of the present disclosure, a plurality of packets to be transmitted corresponding to a plurality of audio data are transmitted from a transmitting end to a receiving end. Each channel of multiple data packets to be transmitted corresponding to multiple channels of audio data is formed by packaging the multiple channels of audio data to be transmitted based on a preset TCP protocol, and each channel of multiple data packets to be transmitted corresponding to the multiple channels of audio data is obtained, wherein the preset TCP protocol comprises: the method comprises the steps of audio data length, audio path number, audio format and time stamp, wherein the audio data length, the audio path number, the audio format and the time stamp form a protocol head.
Step S503, analyzing each path of multiple data packets to be transmitted corresponding to the multiple paths of audio data based on a preset time stamp of the TCP protocol, to obtain an analysis result, so as to perform voice recognition or play on the analysis result.
In this embodiment of the present disclosure, the parsing result is obtained by parsing each path of multiple data packets to be transmitted corresponding to multiple paths of audio data based on a preset timestamp of a TCP protocol, and determining a sequence of each audio data received by a receiving end based on a timestamp carried by the preset TCP protocol, so as to perform audio parsing based on each path of multiple data packets to be transmitted corresponding to multiple paths of audio data, thereby obtaining the parsing result. Generally, audio data with the same time stamp is considered to belong to different paths of audio data transmitted simultaneously at the same time.
In the embodiment of the present disclosure, the receiving end parses the data packet to be transmitted, and after obtaining the parsing result, further performs voice recognition on the parsing result, or plays the parsing result. Before playing, the protocol performs operations such as noise reduction processing on the analysis result, and a specific method for playing the analysis result after processing is not limited to the application, and is not repeated here.
The multi-channel audio transmission method provided by the embodiment of the specification can be applied to court scenes when being implemented, and can be used for carrying out voice recognition on the speech among a plurality of parties in real time so as to facilitate the writing record of a writer. The method can also be suitable for meeting room scenes, and realizes simultaneous transmission of multiple paths of audios in a local area network access mode.
The connection between the receiving end and the transmitting end is typically implemented by a network connection. The network connection may be a wired network connection or a wireless network connection, and the network connection is not limited to the present application.
According to the embodiment of the specification, the simultaneous transmission of multiple paths of audio data can be realized through the preset TCP protocol, and the method has the characteristics of low delay and simple protocol format.
The foregoing details a method for transmitting multiple audio frequencies, which is applied to a transmitting end, and correspondingly, the present disclosure also provides a device for transmitting multiple audio frequencies, which is applied to a transmitting end, as shown in fig. 6. Fig. 6 is a schematic diagram of a transmission device of multi-channel audio applied to a transmitting end according to an embodiment of the present disclosure, where the transmission device includes:
the acquisition module 601 acquires multi-channel audio data to be transmitted;
the encapsulating module 603 encapsulates the multiple paths of audio data to be transmitted based on a preset TCP protocol, to obtain multiple paths of data packets to be transmitted corresponding to the multiple paths of audio data, where the preset TCP protocol includes: the method comprises the steps of audio data length, audio path number, audio format and time stamp, wherein the audio data length, the audio path number, the audio format and the time stamp form a protocol head;
and the transmission module 605 is configured to simultaneously perform multiplexing on each path of multiple data packets to be transmitted corresponding to the multiple paths of audio data based on the preset number of audio paths of the TCP protocol, where each path of multiple data packets to be transmitted corresponding to the multiple paths of audio data is transmitted to the receiving end through the network.
In this embodiment of the present disclosure, the acquiring multiple paths of audio data to be transmitted further includes the following steps:
and the sending end and the receiving end finish handshake operation.
In the embodiment of the present specification, the byte number of the protocol header is 20.
In the embodiment of the present specification, the audio data length is of the UInt type, and the number of bytes of the audio data length is 4;
the audio path number is of the UInt type, and the byte number of the audio path number is 4;
the audio format is of the Char type, and the number of bytes of the audio format is 4;
the time stamp is of the UInt type, and the byte number of the time stamp is 4.
In this embodiment of the present disclosure, the encapsulating, based on a preset TCP protocol, the multiple paths of audio data to be transmitted to obtain multiple paths of data packets to be transmitted corresponding to the multiple paths of audio data specifically includes:
determining the data length of the data packet to be transmitted based on the preset audio data length and audio path number of the TCP;
and respectively packaging each path of audio data of the multipath audio data to be transmitted based on the data length of the data packet to be transmitted and the preset TCP protocol, and obtaining a plurality of data packets to be transmitted of each path corresponding to the multipath audio data.
In this embodiment of the present disclosure, the multiplexing, based on the preset number of audio paths of the TCP protocol, of each path of multiple data packets to be transmitted corresponding to the multiple paths of audio data includes:
multiplexing the first data packet to be transmitted of each path corresponding to the multipath audio data simultaneously based on the preset audio path number of the TCP protocol;
after multiplexing transmission of each first data packet to be transmitted corresponding to the multiplexed audio data is completed, multiplexing transmission is performed on all other data packets to be transmitted except for each first data packet to be transmitted corresponding to the multiplexed audio data based on a received instruction from the receiving end;
and (3) circularly operating until the transmission of each path of a plurality of data packets to be transmitted corresponding to the multipath audio data is completed.
In the embodiment of the present specification, the instruction of the receiving end includes an acknowledgement instruction and a retransmission instruction;
after the multiplexing of the first data packet to be transmitted corresponding to the multiplexed audio data is completed, multiplexing other data packets to be transmitted except for the first data packet to be transmitted of each channel corresponding to the multiplexed audio data based on the received instruction from the receiving end, specifically including:
after multiplexing the first data packet to be transmitted corresponding to the multi-path audio data, if the received instruction from the receiving end is a confirmation instruction, multiplexing the second data packet to be transmitted corresponding to the multi-path audio data at the same time;
and if the received instruction from the receiving end is a retransmission instruction, multiplexing the first data packet to be transmitted of each path corresponding to the multipath audio based on the retransmission instruction.
The foregoing details a method for transmitting multiple audio frequencies, which is applied to a receiving end, and correspondingly, the present disclosure also provides a device for transmitting multiple audio frequencies, which is applied to a receiving end, as shown in fig. 7. Fig. 7 is a schematic diagram of a transmission device of multi-channel audio applied to a receiving end according to an embodiment of the present disclosure, where the transmission device includes:
the receiving module 701 receives a plurality of data packets to be transmitted corresponding to the plurality of paths of audio data according to the claims of the application;
the parsing module 703 parses each path of multiple data packets to be transmitted corresponding to the multiple paths of audio data based on a preset timestamp of the TCP protocol, so as to obtain a parsing result, and perform voice recognition or play on the parsing result.
In this embodiment of the present disclosure, a plurality of packets to be transmitted corresponding to a plurality of audio data are transmitted from a transmitting end to a receiving end. Each channel of multiple data packets to be transmitted corresponding to multiple channels of audio data is formed by packaging the multiple channels of audio data to be transmitted based on a preset TCP protocol, and each channel of multiple data packets to be transmitted corresponding to the multiple channels of audio data is obtained, wherein the preset TCP protocol comprises: the method comprises the steps of audio data length, audio path number, audio format and time stamp, wherein the audio data length, the audio path number, the audio format and the time stamp form a protocol head.
In this embodiment of the present disclosure, the parsing result is obtained by parsing each path of multiple data packets to be transmitted corresponding to multiple paths of audio data based on a preset timestamp of a TCP protocol, and determining a sequence of each audio data received by a receiving end based on a timestamp carried by the preset TCP protocol, so as to perform audio parsing based on each path of multiple data packets to be transmitted corresponding to multiple paths of audio data, thereby obtaining the parsing result.
It should be noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, the statement "comprises" or "comprising" an element defined by … … does not exclude the presence of other identical elements in a process, method, article or apparatus that comprises the element.
It will be appreciated by those skilled in the art that embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The foregoing is merely exemplary of the present application and is not intended to limit the present application. Various modifications and changes may be made to the present application by those skilled in the art. Any modifications, equivalent substitutions, improvements, etc. which are within the spirit and principles of the present application are intended to be included within the scope of the claims of the present application.

Claims (10)

1. The transmission method of the multipath audio is applied to a transmitting end and is characterized by comprising the following steps:
acquiring multiple paths of audio data to be transmitted;
packaging the multipath audio data to be transmitted based on a preset TCP protocol to obtain a plurality of data packets to be transmitted of each path corresponding to the multipath audio data, wherein the preset TCP protocol comprises: the method comprises the steps of audio data length, audio path number, audio format and time stamp, wherein the audio data length, the audio path number, the audio format and the time stamp form a protocol head;
and simultaneously multiplexing each path of multiple data packets to be transmitted corresponding to the multiple paths of audio data based on the preset audio path number of the TCP protocol, wherein each path of multiple data packets to be transmitted corresponding to the multiple paths of audio data are transmitted to a receiving end through a network.
2. The transmission method according to claim 1, wherein the acquiring the plurality of channels of audio data to be transmitted further comprises the steps of:
and the sending end and the receiving end finish handshake operation.
3. The transmission method of claim 1, wherein the number of bytes of the protocol header is 20.
4. The transmission method according to claim 1, wherein the audio data length is of the UInt type, and the number of bytes of the audio data length is 4;
the audio path number is of the UInt type, and the byte number of the audio path number is 4;
the audio format is of the Char type, and the number of bytes of the audio format is 4;
the time stamp is of the UInt type, and the byte number of the time stamp is 4.
5. The transmission method of claim 1, wherein the encapsulating the multiple paths of audio data to be transmitted based on a preset TCP protocol to obtain multiple paths of data packets to be transmitted corresponding to the multiple paths of audio data specifically includes:
determining the data length of the data packet to be transmitted based on the preset audio data length and audio path number of the TCP;
and respectively packaging each path of audio data of the multipath audio data to be transmitted based on the data length of the data packet to be transmitted and the preset TCP protocol, and obtaining a plurality of data packets to be transmitted of each path corresponding to the multipath audio data.
6. The transmission method according to claim 1, wherein the multiplexing of the multiple packets to be transmitted corresponding to the multiple paths of audio data based on the preset number of audio paths of TCP protocol includes:
multiplexing the first data packet to be transmitted of each path corresponding to the multipath audio data simultaneously based on the preset audio path number of the TCP protocol;
after multiplexing transmission of each first data packet to be transmitted corresponding to the multiplexed audio data is completed, multiplexing transmission is performed on all other data packets to be transmitted except for each first data packet to be transmitted corresponding to the multiplexed audio data based on a received instruction from the receiving end;
and (3) circularly operating until the transmission of each path of a plurality of data packets to be transmitted corresponding to the multipath audio data is completed.
7. The transmission method according to claim 6, wherein the instruction of the receiving end includes an acknowledgement instruction, a retransmission instruction;
after the multiplexing of the first data packet to be transmitted corresponding to the multiplexed audio data is completed, multiplexing other data packets to be transmitted except for the first data packet to be transmitted of each channel corresponding to the multiplexed audio data based on the received instruction from the receiving end, specifically including:
after multiplexing the first data packet to be transmitted corresponding to the multi-path audio data, if the received instruction from the receiving end is a confirmation instruction, multiplexing the second data packet to be transmitted corresponding to the multi-path audio data at the same time;
and if the received instruction from the receiving end is a retransmission instruction, multiplexing the first data packet to be transmitted of each path corresponding to the multipath audio based on the retransmission instruction.
8. A transmission method of multipath audio is applied to a receiving end, and is characterized in that the transmission method comprises the following steps of
Receiving a plurality of data packets to be transmitted of each channel corresponding to the multi-channel audio data of any one of claims 1 to 7;
analyzing each path of a plurality of data packets to be transmitted corresponding to the multipath audio data based on a preset TCP (transmission control protocol) timestamp to obtain an analysis result, and performing voice recognition or playing on the analysis result.
9. A multi-channel audio transmission device applied to a transmitting end, characterized in that the transmission device comprises:
the acquisition module acquires multipath audio data to be transmitted;
the packaging module is used for packaging the multipath audio data to be transmitted based on a preset TCP protocol to obtain a plurality of data packets to be transmitted of each path corresponding to the multipath audio data, wherein the preset TCP protocol comprises: the method comprises the steps of audio data length, audio path number, audio format and time stamp, wherein the audio data length, the audio path number, the audio format and the time stamp form a protocol head;
and the transmission module is used for simultaneously multiplexing the multiple paths of data packets to be transmitted corresponding to the multiple paths of audio data based on the preset audio path number of the TCP protocol, and transmitting the multiple paths of data packets to be transmitted corresponding to the multiple paths of audio data to a receiving end through a network.
10. A multi-channel audio transmission device applied to a receiving end, wherein the transmission device comprises:
a receiving module for receiving a plurality of data packets to be transmitted in each channel corresponding to the plurality of channels of audio data according to any one of claims 1 to 7;
and the analysis module is used for analyzing a plurality of data packets to be transmitted in each path corresponding to the multipath audio data based on a preset TCP (transmission control protocol) timestamp to obtain an analysis result, so as to perform voice recognition or play on the analysis result.
CN202311602104.5A 2023-11-28 2023-11-28 Multi-channel audio transmission method and device Pending CN117615036A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202311602104.5A CN117615036A (en) 2023-11-28 2023-11-28 Multi-channel audio transmission method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202311602104.5A CN117615036A (en) 2023-11-28 2023-11-28 Multi-channel audio transmission method and device

Publications (1)

Publication Number Publication Date
CN117615036A true CN117615036A (en) 2024-02-27

Family

ID=89943778

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202311602104.5A Pending CN117615036A (en) 2023-11-28 2023-11-28 Multi-channel audio transmission method and device

Country Status (1)

Country Link
CN (1) CN117615036A (en)

Similar Documents

Publication Publication Date Title
CN1267886C (en) Method and apparatus for encoding and decoding pause information
US8583269B2 (en) Isochronous audio network software interface
WO2001048980A1 (en) Packet communication apparatus, packet communication method, and storage medium
EP1624448B1 (en) Packet multiplexing multi-channel audio
CN104301802B (en) For the digital device of Streaming audio or video data, network and method
CN108877820B (en) Audio data mixing method and device
KR20030011312A (en) Data streaming system substituting local content for unicasts
CN100571190C (en) The apparatus and method of compression title and multiplexing grouping in network environment
CN108847248B (en) Bluetooth device audio processing method, system, readable storage medium and Bluetooth device
US11445049B2 (en) Broadcast signal transmission apparatus, broadcast signal transmission method, broadcast signal reception apparatus and broadcast signal reception method
KR100838900B1 (en) Reproduction system and reproduction method, data transmission device and data transmission method, and remote control device and remote control method
CN107613409A (en) The processing method and processing device of multi-medium data
EP2051476A1 (en) Method and system for transmission of digital audio in SPDIF format to one or more receivers
CN117615036A (en) Multi-channel audio transmission method and device
US6615173B1 (en) Real time audio transmission system supporting asynchronous input from a text-to-speech (TTS) engine
EP2733701A1 (en) Recording medium, data recording device, and method, data reproducing device and method, program, and recording medium
KR100919216B1 (en) Method and apparatus for transmitting and receiving data
US7113906B2 (en) Transmission-reception system, transmission apparatus, reception apparatus and transmission-reception method
CN114448955B (en) Digital audio network transmission method, device, equipment and storage medium
CN115278857A (en) Anti-interference audio data transmission method and device
WO2008030499A2 (en) Apparatus and methods of sip via field compression in session initiation protocol signaling for 3g wireless networks
CN115240369A (en) Internet of things loudspeaker voice broadcasting system based on earthquake early warning
JPH10285213A (en) Device for exchanging silence compression voice packet
GB2433394A (en) Frame storage using a frame type indicator
US20050226255A1 (en) Method, system and apparatuses for transferring audio and/or video signals between synchronous and asynchronous network and for minimizing delay time in such networks

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination