CN113838470A - Audio processing method, device, electronic equipment, computer readable medium and product - Google Patents

Audio processing method, device, electronic equipment, computer readable medium and product Download PDF

Info

Publication number
CN113838470A
CN113838470A CN202111081197.2A CN202111081197A CN113838470A CN 113838470 A CN113838470 A CN 113838470A CN 202111081197 A CN202111081197 A CN 202111081197A CN 113838470 A CN113838470 A CN 113838470A
Authority
CN
China
Prior art keywords
audio data
audio
transmitted
data
type
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202111081197.2A
Other languages
Chinese (zh)
Other versions
CN113838470B (en
Inventor
林贻鸿
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangdong Oppo Mobile Telecommunications Corp Ltd
Original Assignee
Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangdong Oppo Mobile Telecommunications Corp Ltd filed Critical Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority to CN202111081197.2A priority Critical patent/CN113838470B/en
Publication of CN113838470A publication Critical patent/CN113838470A/en
Application granted granted Critical
Publication of CN113838470B publication Critical patent/CN113838470B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/04Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using predictive techniques
    • G10L19/16Vocoder architecture
    • G10L19/18Vocoders using multiple modes
    • G10L19/20Vocoders using multiple modes using sound class specific coding, hybrid encoders or object based coding

Abstract

The application discloses an audio processing method, an audio processing device, electronic equipment, a computer readable medium and a product, which relate to the technical field of audio, wherein the method is applied to a sending end of an audio coding system, the audio coding system also comprises a receiving end, the sending end is connected with the receiving end, and the method comprises the following steps: acquiring audio data to be transmitted; determining the audio type of the audio data to be transmitted; if the audio type of the audio data to be transmitted is a designated type, reducing the data volume of the audio data to be transmitted to obtain target audio data; and sending the target audio data to the receiving end.

Description

Audio processing method, device, electronic equipment, computer readable medium and product
Technical Field
The present application relates to the field of audio technologies, and in particular, to an audio processing method, an audio processing apparatus, an electronic device, a computer-readable medium, and a computer-readable product.
Background
At present, when an external audio device is used for playing audio, no matter a wired or wireless transmission mode is adopted, the problem of audio data transmission delay caused by lack of bandwidth resources exists.
Disclosure of Invention
The present application provides an audio processing method, apparatus, electronic device, computer readable medium and product, so as to overcome the above-mentioned drawbacks.
In a first aspect, an embodiment of the present application provides an audio processing method, which is applied to a sending end of an audio coding system, where the audio coding system further includes a receiving end, and the sending end is connected to the receiving end, where the method includes: acquiring audio data to be transmitted; determining the audio type of the audio data to be transmitted; if the audio type of the audio data to be transmitted is a designated type, reducing the data volume of the audio data to be transmitted to obtain target audio data; and sending the target audio data to the receiving end.
In a second aspect, an embodiment of the present application further provides another audio processing method, which is applied to a receiving end of an audio coding system, where the audio coding system further includes a sending end, and the sending end is connected to the receiving end, and the method includes: acquiring the target audio data, wherein the target audio data is transmitted by a transmitting end based on any one of the methods; and playing the target audio data.
In a third aspect, an embodiment of the present application further provides an audio processing apparatus, which is applied to a sending end of an audio coding system, where the audio coding system further includes a receiving end, the sending end is connected to the receiving end, and the apparatus includes: the first acquisition unit is used for acquiring audio data to be transmitted; the determining unit is used for determining the audio type of the audio data to be transmitted; the processing unit is used for reducing the data volume of the audio data to be transmitted to obtain target audio data if the audio type of the audio data to be transmitted is a specified type; and the sending unit is used for sending the target audio data to the receiving end.
In a fourth aspect, an embodiment of the present application further provides another audio processing apparatus, which is applied to a receiving end of an audio coding system, where the audio coding system further includes a sending end, and the sending end is connected to the receiving end, and the apparatus includes: a second obtaining unit, configured to obtain target audio data sent by the sending end based on any one of the methods; and the playing unit is used for playing the target audio data.
In a fifth aspect, an embodiment of the present application further provides an electronic device, including: one or more first processors; a first memory; one or more applications, wherein the one or more applications are stored in the first memory and configured to be executed by the one or more first processors, the one or more programs configured to perform any of the methods.
In a sixth aspect, an embodiment of the present application further provides an audio playing device, including: one or more second processors; a second memory; one or more applications, wherein the one or more applications are stored in the second memory and configured to be executed by the one or more second processors, the one or more programs configured to perform any of the methods.
In a seventh aspect, an embodiment of the present application further provides a computer-readable storage medium, where a first program code is stored in the computer-readable storage medium, and the first program code may be called by a first processor to execute any one of the methods.
In an eighth aspect, this application provides another computer-readable storage medium, where a second program code is stored in the second computer-readable storage medium, and the second program code can be called by a second processor to execute any one of the methods.
In a ninth aspect, the present application further provides a computer program product, which includes computer programs/instructions, and is characterized in that when the computer programs/instructions are executed by the first processor, the steps of the method are implemented.
In a tenth aspect, the present application provides another computer program product, which includes computer programs/instructions, and is characterized in that when executed by the first processor, the computer programs/instructions implement the steps of the method.
According to the audio processing method, the audio processing device, the electronic equipment, the computer readable medium and the computer product, firstly, audio data to be transmitted are obtained; then determining the audio type of the audio data to be transmitted; if the audio type of the audio data to be transmitted is a designated type, reducing the data volume of the audio data to be transmitted to obtain target audio data; then sending the target audio data to the receiving end; and the receiving end decodes the target audio data after receiving the target audio data, and finally, the playing is realized. The data volume of the type of data is reduced by processing the audio data of the designated type, so that the playing delay and the pause phenomenon are reduced, and the user experience is improved.
Additional features and advantages of embodiments of the present application will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by the practice of embodiments of the present application. The objectives and other advantages of the embodiments of the application may be realized and attained by the structure particularly pointed out in the written description and claims hereof as well as the appended drawings.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
FIG. 1 illustrates an audio processing system provided by an embodiment of the present application;
FIG. 2 is a flow chart illustrating an audio processing method provided by an embodiment of the present application;
FIG. 3 is a flow chart illustrating an audio processing method provided by another embodiment of the present application;
FIG. 4 is a flow chart illustrating an audio processing method provided by yet another embodiment of the present application;
FIG. 5 is a flow chart illustrating an audio processing method according to a further embodiment of the present application;
FIG. 6 is a flow chart illustrating an audio processing method provided by yet another embodiment of the present application;
FIG. 7 is a flow chart illustrating an audio processing method provided by yet another embodiment of the present application;
FIG. 8 is a flow chart illustrating an audio processing method provided by yet another embodiment of the present application;
fig. 9 shows a block diagram of an audio processing apparatus according to an embodiment of the present application;
FIG. 10 shows a block diagram of an audio processing device according to another embodiment of the present application;
FIG. 11 is a schematic diagram of an electronic device provided by an embodiment of the application;
fig. 12 is a schematic diagram of an audio playback device provided in an embodiment of the present application;
FIG. 13 is a block diagram of a computer-readable storage medium provided by an embodiment of the present application;
FIG. 14 is a block diagram of a computer-readable storage medium according to another embodiment of the present application;
FIG. 15 is a block diagram of a computer program product provided by an embodiment of the present application;
fig. 16 is a block diagram of a computer program product according to another embodiment of the present application.
Detailed Description
In order to make the technical solutions of the present application better understood, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it should be apparent that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. The components of the embodiments of the present application, as generally described and illustrated in the figures herein, may be arranged and designed in a wide variety of different configurations. Thus, the following detailed description of the embodiments of the present application, presented in the accompanying drawings, is not intended to limit the scope of the claimed application, but is merely representative of selected embodiments of the application. All other embodiments, which can be derived by a person skilled in the art from the embodiments of the present application without making any creative effort, shall fall within the protection scope of the present application.
It should be noted that: like reference numbers and letters refer to like items in the following figures, and thus, once an item is defined in one figure, it need not be further defined and explained in subsequent figures. Meanwhile, in the description of the present application, the terms "first", "second", and the like are used only for distinguishing the description, and are not to be construed as indicating or implying relative importance.
The current augmented reality application scope is wider and wider, and along with the richness of the display content and the improvement of the display effect, the audio data also need to be optimized and improved. For the optimization promotion of audio data, the method mainly comprises the following steps: the method improves the audio playing quality and optimizes the audio playing pause.
At present, in a mode of playing audio through an earphone, an audio file and current position parameters of the earphone are subjected to algorithm fusion and then played through the earphone, so that the sound source position of a virtual scene simulated by the audio file in the brain of a user is fixed, the auditory mode of the user in a real situation is met, the listening experience of the user is more comfortable, and the playing quality of the audio file is improved.
However, the inventor finds in research that, for audio data playing, all audio data are transmitted in a stereo or multi-channel manner, and the transmission manner occupies a large bandwidth no matter in a wired or wireless transmission manner, which causes a shortage of transmission bandwidth resources, and finally causes audio data transmission delay and playing jam.
Therefore, in order to overcome the above-mentioned drawbacks, embodiments of the present application provide an audio processing method, an apparatus, an electronic device, a computer storage medium, and a computer product.
Referring to fig. 1, fig. 1 illustrates an audio encoding system 100 according to an embodiment of the present application, where the audio encoding system 100 includes: a transmitting end 110 and a receiving end 120, wherein the transmitting end 110 and the receiving end 120 are connected. The sending end 110 is configured to generate audio data to be sent, determine a source of the audio data to be sent, process the audio data to be sent that needs to be compressed to obtain target audio data, and finally send the compressed audio data to the receiving end 120, where the receiving end 120 plays the audio data based on the target audio data after obtaining the target audio data. The sending end is an electronic device capable of communicating with the receiving end, and the electronic device may be a computer, a notebook computer, a mobile phone, a tablet computer, a vehicle-mounted mobile device, a server, and the like. The receiving end may be an audio playing device, for example, an earphone, a sound box, or an audio player in an electronic device, for example, the electronic device may be an Augmented Reality (AR) device or a Virtual Reality (VR) device, and then the audio player of the electronic device may be a speaker of the electronic device or an earphone installed in the electronic device, and the like.
Referring to fig. 2, fig. 2 provides an embodiment describing the audio processing method, which can be applied to the audio coding system 100, and specifically, the execution subject of the method can be a transmitting end, and the method includes steps S210 to S240.
Step S210: and acquiring audio data to be transmitted.
In this embodiment, the audio data to be transmitted is audio data that needs to be sent by a sending end, the audio data to be transmitted may be obtained by different application programs, and the audio data to be transmitted may have different encoding formats, different time lengths, and the like. For example, the data to be transmitted may come from a music application using mp3 encoded format for a duration of 4 minutes.
Further, the audio data to be transmitted may be obtained by the sending end, specifically, the sending end obtains an audio playing request sent by an audio playing application, determines, based on the audio playing request, the audio data to be played corresponding to the request, and uses the audio data to be played as the audio data to be transmitted, where the audio playing request may correspond to an audio file or an audio stream in a video file.
Step S220: and determining the audio type of the audio data to be transmitted.
In this embodiment, the audio type of the audio data to be transmitted may be determined according to an application program corresponding to each audio data to be transmitted. For example, the audio data to be transmitted corresponding to the system application program is of a system audio type, the audio data to be transmitted corresponding to the music application program is of a music audio type, the audio data to be transmitted corresponding to the video application program is of a video audio type, and the audio data to be transmitted corresponding to the game application program is of a game audio type.
Furthermore, in order to determine the audio type of the audio data to be transmitted, a packet header of the audio data to be transmitted may be preset to indicate a program source of each audio data to be transmitted, then, before each audio data to be transmitted, a packet header corresponding to the audio to be transmitted is attached, wherein the packet header can be a string of character strings, different character strings are used for representing different programs, for example, a character string "001" may be preset for a system application, a character string "002" for a music application, a character string "003" for a video application, a character string "004" for a game application, and so on, and each application program which can possibly generate the audio data is corresponded by using the character string, and the sending end can obtain the application program corresponding to each audio data to be transmitted by analyzing the packet header. For example, in this embodiment, if the packet header of the audio data to be transmitted received by the transmitting end is "001", it indicates that the audio type of the audio data to be transmitted is the system audio type, if the packet header of the audio data to be transmitted received by the transmitting end is "002", it indicates that the audio type of the audio data to be transmitted is the music audio type, if the packet header of the audio data to be transmitted received by the transmitting end is "003", it indicates that the audio type of the audio data to be transmitted is the video audio type, and if the packet header of the audio data to be transmitted received by the transmitting end is "004", it indicates that the audio type of the audio data to be transmitted is the game audio type.
It is to be understood that the above data types and the manner of determining the data types are only for illustration, and the specific data types and the manner of determining the data types are not limited in the embodiments of the present application.
Further, in the present embodiment, the audio types can be further divided into system audio and non-system audio, wherein the non-system audio can include a music audio type, a video audio type, a game audio type, and the like. If the type of the application program corresponding to the audio data to be transmitted belongs to system class application, determining that the audio type of the audio data to be transmitted is system audio, wherein the system class application refers to an application program for generating system prompt audio, the system prompt audio can be key feedback sound, operation confirmation sound, warning information sound and the like, and otherwise, determining that the audio type of the audio data to be transmitted is non-system audio. Specifically, it may be set that if audio data is generated through a system application program, the type of the application program corresponding to the audio data to be transmitted belongs to a system type application, and if audio data is generated through a non-system application program, the type of the application program corresponding to the audio data to be transmitted belongs to a non-system type, where the non-system application program may be a music application program, a video application program, a game application program, and the like. For example, in this embodiment, if the audio data to be transmitted is generated by a system application, the application program type corresponding to the audio data to be transmitted is a system type application, the audio type of the audio data to be transmitted is a system audio, and if the audio data to be transmitted is generated by a music application, the application program type corresponding to the audio data to be transmitted belongs to a non-system type application, and the audio type of the audio data to be transmitted is a non-system audio.
Step S230: and reducing the data volume of the audio data to be transmitted to obtain target audio data.
And if the audio type of the audio data to be transmitted is the designated type, reducing the data volume of the audio data to be transmitted to obtain the target audio data. Further, in this embodiment, the specified type may be a type with low content attention, where the content attention refers to the attention of the user to the quality of the audio data, specifically, when the attention of the user to the quality of the audio data is high, it represents that the user wants to acquire high-quality audio data more, and when the attention of the user to the quality of the audio data is low, it represents that the user is not interested in the quality of the audio data. Further, in the present embodiment, a type with low content attention may be used as the specified type, for example, the user attention is generally low for system audio, and the user attention is generally high for sound played by a program such as music, video, game, etc., so that the audio data type with low content attention may include a system audio type, and the audio data type with high content attention may include a music audio type, a video audio type, a game audio type, etc., so that the specified type may be system audio.
Further, the audio data to be transmitted can be classified according to the size of the data volume. Further, it is understood that the amount of audio data may be referred to as the length of the duration of the audio data, the type of audio data having a long duration, the amount of which is generally large, and the type of audio data having a short duration, the amount of which is generally small. Further, in this embodiment, an audio data type with a short duration may be designated as the designated type, specifically, the duration of the system prompt audio is generally short, while the duration of the sound played by the program such as music, video, game, etc. is generally long, so the type with a small data amount may include the system audio type, and the type with a large data amount may include the music audio type, the video audio type, the game audio type, etc., so the designated type may be the system audio type.
Further, in this embodiment, the data amount of the audio data to be transmitted is reduced, and the audio data to be transmitted may be compressed in a compression coding manner, so as to reduce the space occupied by the data; the space occupied by the data can be reduced by extracting one or more sound channels of the audio data to be transmitted; the space occupied by the data can be reduced by combining the two ways, please refer to the following embodiments. Therefore, the target audio data can be obtained by reducing the data amount of the audio to be transmitted.
Step S240: and sending the target audio data to the receiving end.
In this embodiment, the sending end is connected to the receiving end, and the sending end sends the obtained target audio data to the receiving end. The sending end and the receiving end can be connected through a wired connection or a wireless connection, wherein the wired connection mode can adopt a network cable or an optical fiber cable with a communication leading-out end (Registered Jack45, RJ45) connector, a wire with a High Definition Multimedia Interface (HDMI) and the like, and the wireless connection mode can adopt a WiFi mode, a bluetooth mode and the like.
According to the audio processing method, the audio processing device, the electronic equipment, the computer readable medium and the computer product, firstly, audio data to be transmitted are obtained; then determining the audio type of the audio data to be transmitted; if the audio type of the audio data to be transmitted is a designated type, reducing the data volume of the audio data to be transmitted to obtain target audio data; then sending the target audio data to the receiving end; and the receiving end decodes the target audio data after receiving the target audio data, and finally, the playing is realized. By processing the audio data of the designated type, the occupation of the data space of the type is reduced, so that the playing delay and the pause phenomenon are reduced, and the user experience is improved.
Referring to fig. 3, fig. 3 illustrates an embodiment of the audio processing method, which can be applied to the audio encoding system 100, and in particular, the execution subject of the audio processing method can be a transmitting end, and the audio processing method includes steps S310 to S340.
Step S310: and acquiring audio data to be transmitted.
Step S320: and determining the audio type of the audio data to be transmitted.
In this embodiment, the sending end obtains the audio data to be transmitted, and then determines the audio type of the audio data to be transmitted, and step S310 and step S320 may refer to the foregoing embodiments, which are not repeated herein.
Step S330: and performing at least one of sound channel extraction operation and data compression operation on the audio data to be transmitted to obtain target audio data.
And performing at least one of a channel extraction operation and a data compression operation on the audio data to be transmitted to obtain target audio data, wherein the channel extraction operation is used for reducing the number of channels of the audio data to be transmitted.
Further, since the audio data to be transmitted are all composed of multiple channels, the multiple channels may generally be two-channel or five-channel audio, where the two channels include a left channel and a right channel, and the five channels include a left channel, a center channel, a right surround channel, and a left surround channel. Therefore, the compression of the audio data to be transmitted can be realized by reducing the number of audio channels of the audio data to be transmitted. Specifically, the channels of the two channels of audio data to be transmitted may be extracted, and one channel may be selected to retain the audio data and discard the audio data of the other channel, for example, the left channel of the two channels of audio data to be transmitted is extracted as the target audio data, and the right channel thereof is discarded; the right channel of the audio data to be transmitted with two channels can also be extracted as the target audio data, and the left channel can be discarded. Further, the number of channels which are arbitrarily smaller than the number of the channels of the audio data to be transmitted and exceed two channels can be extracted, specifically, four channels of the audio data to be transmitted of five channels can be extracted, the remaining channel can be omitted, one channel of the audio data to be transmitted of five channels can be extracted, the remaining four channels can be omitted, for example, a left channel, a center channel, a right channel and a left surround channel which are of a non-system audio data type and have five channels can be extracted, the right surround channel can be omitted, a center channel of the audio data to be transmitted of five channels can be extracted, and the left channel, the right channel, the left surround channel and the right surround channel can be omitted.
Further, in order to reduce the file volume of the audio to be transmitted, in addition to extracting a certain number of channels, it is conceivable to obtain target audio data with a smaller volume by compression. The compression mode may include two modes of lossy compression and Lossless compression, wherein the lossy compression may include Coding modes such as motion Picture Experts Group Audio Layer III (MP 3), Advanced Audio Coding (AAC), Windows Media Audio (WMA), and the Lossless compression may include Coding modes such as Lossless Audio compression Coding (FLAC), Apple Lossless Audio Codec (ALAC). For example, in this embodiment, after acquiring audio data to be transmitted, a transmitting end performs advanced audio coding AAC on the audio data to be transmitted, thereby acquiring target audio data.
Further, in order to reduce the file volume of the audio to be transmitted, in addition to the above method, the operations of reducing the sampling rate and the sampling bit number of the audio signal to be transmitted may be performed, and then the channel extraction or the encoding compression may be performed. Specifically, a typical two-channel audio file may have a sampling rate of 44.1KHz and a sampling bit number of 16 bits, where KHz is kilohertz and bit is bit, and the sampling rate and the sampling bit number may be reduced, for example, the sampling rate may be reduced to 16KHz and the sampling bit number may be reduced to 8 bits.
It is to be understood that the above-mentioned method for reducing the volume of the audio data to be transmitted is only for illustration, and the specific method for reducing the volume of the audio data to be transmitted is not limited in the embodiments of the present application.
Step S340: and sending the target audio data to the receiving end.
In this embodiment, the sending end is connected to the receiving end, and the sending end sends the obtained target audio data to the receiving end. This step has been described in detail in the previous embodiments and will not be described again here.
According to the audio processing method, the audio processing device, the electronic equipment, the computer readable medium and the computer product, firstly, audio data to be transmitted are obtained; then determining the audio type of the audio data to be transmitted; if the audio type of the audio data to be transmitted is a designated type, reducing the data volume of the audio data to be transmitted to obtain target audio data; then sending the target audio data to the receiving end; and the receiving end decodes the target audio data after receiving the target audio data, and finally, the playing is realized. By processing the audio data of the designated type, the occupation of the data space of the type is reduced, so that the playing delay and the pause phenomenon are reduced, and the user experience is improved.
Referring to fig. 4, fig. 4 illustrates an embodiment of the audio processing method, which can be applied to the audio coding system 100, and in particular, the execution subject of the audio processing method can be a transmitting end, and the audio processing method includes steps S410 to S460.
Step S410: and acquiring audio data to be transmitted.
Step S420: and determining the audio type of the audio data to be transmitted.
In this embodiment, the sending end obtains the audio data to be transmitted, and then determines the audio type of the audio data to be transmitted, and step S410 and step S420 are described in detail in the foregoing embodiment, and are not described herein again.
Step S430: and extracting one sound channel from the plurality of sound channels of the audio data to be transmitted to obtain single-channel audio data.
Step S440: and compressing the single-channel audio data to obtain the target audio data.
In this embodiment, since the audio data to be transmitted are all composed of multiple channels, the multiple channels may be generally two-channel or five-channel audio, and thus the compression of the audio data to be transmitted can be realized by reducing the number of channels of the audio data to be transmitted. Specifically, one channel of multi-channel audio data to be transmitted may be extracted, for example, a left channel of two channels of audio data to be transmitted is extracted as target audio data, and a right channel thereof is discarded; the right channel of the audio data to be transmitted with two channels may be extracted as the target audio data, and the left channel may be discarded. For another example, a center channel of audio data to be transmitted having five channels is extracted, and a left channel, a right channel, a left surround channel, and a right surround channel are cut off, so that single-channel audio data can be obtained by the method.
Further, in order to continuously reduce the volume of the audio file to be transmitted, the above-mentioned monaural audio data may be compression-encoded to obtain a target audio file with a smaller occupied space. The compression method may include a lossy compression method and a lossless compression method, and the specific encoding method has been described in detail in the foregoing embodiments and is not described herein again. For example, in the present embodiment, the obtained monaural audio data may be encoded using advanced audio coding AAC, thereby obtaining target audio data.
Further, in this embodiment, the audio data to be transmitted may be compressed first, and then one piece of channel data is extracted. Specifically, for example, advanced audio coding AAC may be used for the audio data to be transmitted in the two channels to obtain compressed audio data to be transmitted in the two channels, and then the left channels of the compressed audio data to be transmitted in the two channels are extracted to obtain target audio data, or advanced audio coding AAC may be used for the audio data to be transmitted in the two channels to obtain compressed audio data to be transmitted in the two channels, and then the right channels of the compressed audio data to be transmitted in the two channels are extracted to obtain target audio data.
It should be noted that, when the volume of the audio data to be transmitted is reduced by simultaneously adopting the channel extraction and compression, the implementation order of the two ways does not constitute a limitation to the present application, and therefore, the implementation order of the step S430 and the step S440 cannot be taken as a limitation to the present application, and a relevant person may adjust the relative order of the step S430 and the step S440 according to needs.
Step S450: and sending the target audio data to the receiving end.
In this embodiment, the sending end is connected to the receiving end, and the sending end sends the obtained target audio data to the receiving end. This step has been described in detail in the previous embodiments and will not be described again here.
According to the audio processing method, the audio processing device, the electronic equipment, the computer readable medium and the computer product, firstly, audio data to be transmitted are obtained; then determining the audio type of the audio data to be transmitted; if the audio type of the audio data to be transmitted is a designated type, reducing the data volume of the audio data to be transmitted to obtain target audio data; then sending the target audio data to the receiving end; and the receiving end decodes the target audio data after receiving the target audio data, and finally, the playing is realized. By processing the audio data of the designated type, the occupation of the data space of the type is reduced, so that the playing delay and the pause phenomenon are reduced, and the user experience is improved.
Referring to fig. 5, fig. 5 illustrates an embodiment of the audio processing method, which can be applied to the audio encoding system 100, and in particular, the execution subject of the audio processing method can be a transmitting end, and the audio processing method includes steps S510 to S540.
Step S510: and acquiring audio data to be transmitted.
Step S520: and determining the audio type of the audio data to be transmitted.
In this embodiment, the sending end obtains the audio data to be transmitted, and then determines the audio type of the audio data to be transmitted, and step S510 and step S520 are described in detail in the foregoing embodiment, and are not described herein again.
Step S530: and carrying out data compression operation on the audio data to be transmitted to obtain target audio data.
In this embodiment, if the type of the audio data to be transmitted is not the designated type, that is, is the non-system type data, only the audio data to be transmitted is compressed without extracting a channel from the multiple channels. It is easy to understand that, the user has higher content attention for the non-system type data, and more desires to obtain better sound quality and more sound information, so the original channel number is reserved for the type of audio data to be transmitted, and the volume reduction is realized only by the compression coding.
Specifically, in this embodiment, advanced audio coding AAC compression may be used for multi-channel audio data to be transmitted to obtain target audio data.
It should be understood that the compression encoding manner is only an example, and the specific encoding manner is not limited in this embodiment.
Step S540: and sending the target audio data to the receiving end.
In this embodiment, the sending end is connected to the receiving end, and the sending end sends the obtained target audio data to the receiving end. This step has been described in detail in the previous embodiments and will not be described again here.
According to the audio processing method, the audio processing device, the electronic equipment, the computer readable medium and the computer product, firstly, audio data to be transmitted are obtained; then determining the audio type of the audio data to be transmitted; if the audio type of the audio data to be transmitted is a designated type, reducing the data volume of the audio data to be transmitted to obtain target audio data; then sending the target audio data to the receiving end; and the receiving end decodes the target audio data after receiving the target audio data, and finally, the playing is realized. By processing the audio data of the designated type, the occupation of the data space of the type is reduced, so that the playing delay and the pause phenomenon are reduced, and the user experience is improved.
Referring to fig. 6, fig. 6 illustrates an embodiment of the audio processing method, which can be applied to the audio encoding system 100, and specifically, the execution subject of the method can be a receiving end, and the method includes steps S610 to S620.
Step S610: and acquiring the target audio data.
In this embodiment, the receiving end acquires the target audio data, where the target audio data is the audio data that is acquired by the sending end through the method in the foregoing embodiment and then sent to the receiving end. The receiving end is connected with the transmitting end, the connection mode can be wired connection or wireless connection, the wired connection mode can adopt a network cable or an optical fiber cable with a communication leading-out end RJ45 connector and a wire with a high-definition multimedia interface HDMI and the like, and the wireless connection mode can adopt WiFi, Bluetooth and the like. The receiving end is the electronic equipment that can communicate with the sending end, and this electronic equipment can also be used for playing the audio frequency, and this electronic equipment can be for augmented reality's glasses, wireless earphone, wireless speaker etc..
Step S620: and playing the target audio data.
In this embodiment, after the receiving end acquires the target audio data, the target audio data is played through an earphone or a speaker of the receiving end.
Further, as can be seen from the foregoing embodiments, the target audio data acquired by the receiving end may be uncompressed mono audio data, compressed multi-channel audio data, and uncompressed multi-channel audio data.
Furthermore, each target audio data can be processed in a corresponding manner and then played. Specifically, for audio data of a single channel, the single channel can be copied to other channels for playing; the compressed audio data can be decoded by a corresponding decoder and then played.
Referring to fig. 7, fig. 7 illustrates an embodiment of the audio processing method, which can be applied to the audio encoding system 100, and in particular, the execution subject of the method can be a receiving end, and the method includes steps S710 to S730.
Step S710: the target audio data is single-channel audio data extracted from a plurality of sound channels of the audio data to be transmitted by the sending end.
Step S720: and copying to obtain multi-channel audio data based on the single-channel audio data so as to obtain audio data to be played.
In this embodiment, the target audio data is single-channel audio data extracted by the sending end from multiple channels of the audio data to be transmitted, and is not subjected to compression encoding.
Further, the single-channel audio data is copied to obtain multi-channel audio data. Specifically, the monaural audio data may be used as a left channel, and then the obtained audio data is copied as a right channel, so as to obtain two-channel audio data to be played, or the monaural audio data may be used as a right channel, and then the obtained audio data is copied as a left channel, so as to obtain two-channel audio data to be played.
Furthermore, the single-channel audio data can be copied to obtain five-channel audio data. Specifically, the monaural audio data may be used as a left channel, and then the obtained audio data may be copied as other four channels, including: right channel, center channel, left surround channel, right surround channel.
It should be noted that, as is readily apparent, the contents of the received monaural audio data are the same for each channel, regardless of whether the received monaural audio data is copied to obtain a binaural audio or the received monaural data is copied to obtain a five-channel audio, so that the finally obtained audio data is not affected by using the received monaural audio as an arbitrary channel, and the present application is not limited thereto.
Step S730: and playing the audio data to be played.
Further, the obtained audio data with the playing function is played through a playing device at a receiving end. For example, in this embodiment, playing of audio data with playing may be implemented by headphones on augmented reality glasses.
Referring to fig. 8, fig. 8 illustrates an embodiment of the audio processing method, which can be applied to the audio encoding system 100, and specifically, the execution subject of the method can be a receiving end, and the method includes steps S810 to S830.
Step S810: the target audio data is audio data obtained by compressing the single-channel audio data by the sending end.
Step S820: and decompressing the target audio data to obtain decompressed single-channel audio data.
In this embodiment, the target audio data is audio data obtained by compressing audio data of a single channel by a sending end, so that the received audio data is decompressed first and then subjected to channel replication.
Further, according to a mode of implementing compression coding by the sending end, the received audio data may be decompressed, for example, when the sending end uses the advanced audio coding AAC to perform compression coding on the audio data to be sent, the receiving end may use a decoder corresponding to the advanced audio coding AAC to decompress the audio data to obtain monaural audio data.
Step S830: and copying to obtain multi-channel audio data based on the single-channel audio data so as to obtain the audio data to be played.
This step has been described in detail in the foregoing embodiments, and will not be described herein.
According to the audio processing method, the audio processing device, the electronic equipment, the computer readable medium and the computer product, firstly, audio data to be transmitted are obtained; then determining the audio type of the audio data to be transmitted; if the audio type of the audio data to be transmitted is a designated type, reducing the data volume of the audio data to be transmitted to obtain target audio data; then sending the target audio data to the receiving end; and the receiving end decodes the target audio data after receiving the target audio data, and finally, the playing is realized. By processing the audio data of the designated type, the occupation of the data space of the type is reduced, so that the playing delay and the pause phenomenon are reduced, and the user experience is improved.
Referring to fig. 9, a block diagram of an audio processing apparatus 900 according to an embodiment of the present application is shown, where the apparatus is applied to a transmitting end of an audio coding system, the audio coding system further includes a receiving end, and the transmitting end is connected to the receiving end, and the apparatus includes: a first obtaining unit 910, a determining unit 920, a processing unit 930, and a transmitting unit 940.
A first obtaining unit 910, configured to obtain audio data to be transmitted.
A determining unit 920, configured to determine an audio type of the audio data to be transmitted.
Further, the determining unit 920 is further configured to determine an application program requesting to play the audio data to be transmitted; and if the type of the application program belongs to system type application, determining that the audio type of the audio data to be transmitted is system audio, otherwise, determining that the audio type of the audio data to be transmitted is non-system audio.
The processing unit 930 is configured to reduce the data amount of the audio data to be transmitted to obtain target audio data if the audio type of the audio data to be transmitted is a designated type.
Further, the processing unit 930 is further configured to perform at least one of a channel extraction operation and a data compression operation on the audio data to be transmitted to obtain target audio data, where the channel extraction operation is used to reduce the number of channels of the audio data to be transmitted.
Further, the processing unit 930 is further configured to extract a channel from the multiple channels of the audio data to be transmitted, so as to obtain monaural audio data; obtaining the target audio data based on the mono audio data.
Further, the processing unit 930 is further configured to compress the mono audio data to obtain the target audio data.
A sending unit 940, configured to send the target audio data to the receiving end.
Referring to fig. 10, a block diagram of another audio processing apparatus 1000 according to an embodiment of the present application is shown, where the apparatus is applied to receiving of an audio coding system, where the audio coding system further includes a sending end, and the sending end is connected to the receiving end, and the apparatus includes: a second obtaining unit 1010, a playing unit 1020.
A second obtaining unit 1010, configured to obtain target audio data sent by the sending end based on the method of any one of claims 1 to 6.
A playing unit 1020, configured to play the target audio data.
Further, the playing unit 1020 is further configured to copy the mono audio data to obtain multi-channel audio data, so as to obtain audio data to be played; and playing the audio data to be played.
Further, the playing unit 1020 is further configured to decompress the target audio data to obtain decompressed mono audio data; obtaining multi-channel audio data based on the single-channel audio data copy to obtain the audio data to be played; and playing the audio data to be played.
Referring to fig. 11, a block diagram of an electronic device according to an embodiment of the present application is shown. The electronic device 1100 may be a smartphone, tablet, computer, or other electronic device capable of running applications. The electronic device 1100 in the present application may include one or more of the following components: a first processor 1100, a first memory 1120, and one or more applications, wherein the one or more applications may be stored in the first memory 1120 and configured to be executed by the one or more first processors 1110, the one or more programs configured to perform a method as described in the aforementioned method embodiments.
The first processor 1110 may include one or more processing cores. The first processor 1110 connects various parts within the entire electronic device 1100 using various interfaces and lines, performs various functions of the electronic device 1100 and processes data by executing or executing instructions, programs, code sets, or instruction sets stored in the first memory 1120 and calling data stored in the first memory 1120. Alternatively, the first processor 1110 may be implemented in hardware using at least one of Digital Signal Processing (DSP), Field-Programmable Gate Array (FPGA), and Programmable Logic Array (PLA). The first processor 1110 may integrate one or a combination of a first Central Processing Unit (CPU), a first Graphics Processing Unit (GPU), a modem, and the like. The CPU mainly processes an operating system, a user interface, an application program and the like; the GPU is used for rendering and drawing display content; the modem is used to process the wireless communication. It is understood that the modem may not be integrated into the first processor 1110, but may be implemented by a communication chip.
The first Memory 1120 may include a Random Access Memory (RAM) or a Read-Only Memory (Read-Only Memory). The first memory 1120 may be used to store instructions, programs, code, sets of codes, or sets of instructions. The first memory 1120 may include a stored program area and a stored data area, wherein the stored program area may store instructions for implementing an operating system, instructions for implementing at least one function (such as a touch function, a sound playing function, an image playing function, etc.), instructions for implementing various method embodiments described below, and the like. The stored data area may also store data created by terminal 1100 during use (e.g., phone book, audio-visual data, chat log data), etc.
Referring to fig. 12, a block diagram of an audio playing device according to an embodiment of the present application is shown. The audio playback device 1200 may be a smartphone, a tablet computer, a computer, or the like capable of running an application. The audio playback device 1200 in the present application may include one or more of the following components: a second processor 1210, a second memory 1220, an audio player 1230, and one or more applications, wherein the one or more applications may be stored in the second memory 1220 and configured to be executed by the one or more second processors 1210, the one or more programs configured to perform the methods as described in the aforementioned method embodiments. The audio player 1230 may be a headphone, for example, a headphone on the end of augmented reality glasses.
The second processor 1210 may include one or more processing cores. The second processor 1210 connects various parts within the entire audio playback device 1200 using various interfaces and lines, performs various functions of the audio playback device 1200 and processes data by executing or executing instructions, programs, code sets, or instruction sets stored in the second memory 1220, and calling data stored in the second memory 1220. Alternatively, the second processor 1210 may be implemented in at least one hardware form of a digital signal processing DSP, a field Programmable gate Array FPGA, and a Programmable Logic Array (PLA). The second processor 1210 may integrate one or a combination of a second central processing unit CPU, a second image processor GPU, a modem, and the like. Wherein, the CPU mainly processes an operating system, a user interface, an application program and the like; the GPU is used for rendering and drawing display content; the modem is used to handle wireless communications. It is understood that the modem may not be integrated into the second processor 1210, but may be implemented by a communication chip.
The second memory 1220 may include a random second memory RAM or may include a read-only second memory ROM. The second memory 1220 may be used to store instructions, programs, code, sets of codes, or sets of instructions. The second memory 1220 may include a stored program area and a stored data area, wherein the stored program area may store instructions for implementing an operating system, instructions for implementing at least one function (such as a touch function, a sound playing function, an image playing function, etc.), instructions for implementing various method embodiments described below, and the like. The storage data area may also store data created by the terminal 1200 during use (e.g., phone book, audio-video data, chat log data), etc.
Referring to fig. 13, a block diagram of a computer-readable storage medium according to an embodiment of the present application is shown. The computer-readable medium 1300 has stored therein a first program code that can be called by a first processor to execute the method described in the above method embodiments.
The computer-readable storage medium 1300 may be an electronic memory such as a flash memory, an EEPROM (electrically erasable programmable read only memory), an EPROM, a hard disk, or a ROM. Optionally, the computer-readable storage medium 1300 includes a non-volatile computer-readable storage medium. The computer readable storage medium 1300 has memory space for first program code 1310 for performing any of the method steps of the method described above. The program code can be read from or written to one or more computer program products. The first program code 1310 may be compressed in a suitable form.
Referring to fig. 14, a block diagram of a computer-readable storage medium according to an embodiment of the present application is shown. The computer readable medium 1400 has stored therein a first program code that can be called by a first processor to execute the method described in the above method embodiments.
The computer-readable storage medium 1400 may be an electronic memory such as flash memory, EEPROM, EPROM, a hard disk, or ROM. Optionally, computer-readable storage medium 1400 includes non-volatile computer-readable media. The computer readable storage medium 1400 has storage space for second program code 1410 for performing any of the method steps of the method described above. The program code can be read from or written to one or more computer program products. The second program code 1410 may be compressed in a suitable form.
Referring to fig. 15, a block diagram 1500 of a computer program product according to an embodiment of the present application is shown. Included in the computer program product 1500 is a first computer program/instructions 1510, the computer program/instructions 1510 realizing the steps of the above-described method when executed by a first processor.
Referring to fig. 16, a block diagram 1600 of a computer program product according to an embodiment of the present application is shown. Included in the computer program product 1600 is a second computer program/instructions 1610, which computer program/instructions 1610, when executed by a second processor, implement the steps of the method described above.
Finally, it should be noted that: the above embodiments are only used to illustrate the technical solutions of the present application, and not to limit the same; although the present application has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; such modifications and substitutions do not necessarily depart from the spirit and scope of the corresponding technical solutions in the embodiments of the present application.

Claims (17)

1. An audio processing method is applied to a transmitting end of an audio coding system, the audio coding system further comprises a receiving end, the transmitting end is connected with the receiving end, and the method comprises the following steps:
acquiring audio data to be transmitted;
determining the audio type of the audio data to be transmitted;
if the audio type of the audio data to be transmitted is a designated type, reducing the data volume of the audio data to be transmitted to obtain target audio data;
and sending the target audio data to the receiving end.
2. The method of claim 1, wherein the audio types include system audio and non-system audio, and wherein the determining the audio type of the audio data to be transmitted comprises:
determining an application program requesting to play the audio data to be transmitted;
and if the type of the application program belongs to system application, determining that the audio type of the audio data to be transmitted is system audio, otherwise, determining that the audio type of the audio data to be transmitted is non-system audio.
3. The method of claim 1, wherein the reducing the data amount of the audio data to be transmitted to obtain the target audio data comprises:
and performing at least one of a channel extraction operation and a data compression operation on the audio data to be transmitted to obtain target audio data, wherein the channel extraction operation is used for reducing the number of channels of the audio data to be transmitted.
4. The method of claim 3, wherein the performing at least one of a channel extraction operation and a data compression operation on the audio data to be transmitted to obtain target audio data comprises:
extracting a sound channel from the plurality of sound channels of the audio data to be transmitted to obtain single-channel audio data;
obtaining the target audio data based on the mono audio data.
5. The method of claim 4, wherein the obtaining the target audio data based on the mono audio data comprises:
and compressing the single-channel audio data to obtain the target audio data.
6. The method of any of claims 1-5, wherein the audio types include system audio and non-system audio, and the specified type is the system audio.
7. An audio processing method is applied to a receiving end of an audio coding system, the audio coding system further comprises a transmitting end, the transmitting end is connected with the receiving end, and the method comprises the following steps:
acquiring the target audio data, wherein the target audio data is transmitted by a transmitting end based on the method of any one of claims 1-6;
and playing the target audio data.
8. The method according to claim 7, wherein the target audio data is mono audio data extracted by the transmitting end from a plurality of channels of the audio data to be transmitted, and the playing the target audio data comprises:
obtaining multi-channel audio data based on the single-channel audio data copy so as to obtain audio data to be played;
and playing the audio data to be played.
9. The method according to claim 7, wherein the target audio data is audio data obtained by compressing mono audio data at the transmitting end, the mono audio data is mono audio data extracted by the transmitting end from multiple channels of the audio data to be transmitted, and the playing the target audio data includes:
decompressing the target audio data to obtain decompressed single-channel audio data;
obtaining multi-channel audio data based on the single-channel audio data copy so as to obtain audio data to be played;
and playing the audio data to be played.
10. An audio processing apparatus, characterized in that, applied to a transmitting end of an audio coding system, the audio coding system further includes a receiving end, the transmitting end is connected with the receiving end, the apparatus includes:
the first acquisition unit is used for acquiring audio data to be transmitted;
the determining unit is used for determining the audio type of the audio data to be transmitted;
the processing unit is used for reducing the data volume of the audio data to be transmitted to obtain target audio data if the audio type of the audio data to be transmitted is a specified type;
and the sending unit is used for sending the target audio data to the receiving end.
11. An audio processing apparatus, characterized in that, applied to a receiving end of an audio coding system, the audio coding system further includes a transmitting end, the transmitting end is connected to the receiving end, the apparatus includes:
a second obtaining unit, configured to obtain target audio data sent by the sending end based on the method of any one of claims 1 to 6;
and the playing unit is used for playing the target audio data.
12. An electronic device, comprising: one or more first processors;
a first memory;
one or more applications, wherein the one or more applications are stored in the first memory and configured to be executed by the one or more first processors, the one or more programs configured to perform the method of any of claims 1-6.
13. An audio playback device, comprising: one or more second processors;
a second memory;
one or more applications, wherein the one or more applications are stored in the second memory and configured to be executed by the one or more second processors, the one or more programs configured to perform the method of any of claims 7-9.
14. A computer-readable storage medium, having stored therein a first program code, which is invokable by a first processor to perform the method according to any of claims 1 to 6.
15. A computer-readable storage medium, having stored therein a second program code, which is invokable by a second processor to perform the method according to any of claims 7 to 9.
16. A computer program product comprising computer programs/instructions, characterized in that the computer programs/instructions, when executed by a first processor, implement the steps of the method of claims 1-6.
17. A computer program product comprising computer programs/instructions, characterized in that the computer programs/instructions, when executed by a second processor, implement the steps of the method of claims 7-9.
CN202111081197.2A 2021-09-15 2021-09-15 Audio processing method, device, electronic equipment, computer readable medium and product Active CN113838470B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111081197.2A CN113838470B (en) 2021-09-15 2021-09-15 Audio processing method, device, electronic equipment, computer readable medium and product

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111081197.2A CN113838470B (en) 2021-09-15 2021-09-15 Audio processing method, device, electronic equipment, computer readable medium and product

Publications (2)

Publication Number Publication Date
CN113838470A true CN113838470A (en) 2021-12-24
CN113838470B CN113838470B (en) 2023-10-03

Family

ID=78959435

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111081197.2A Active CN113838470B (en) 2021-09-15 2021-09-15 Audio processing method, device, electronic equipment, computer readable medium and product

Country Status (1)

Country Link
CN (1) CN113838470B (en)

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050165502A1 (en) * 2004-01-27 2005-07-28 Hanes David H. Method, system and computer-readable medium for generating a multi-channel audio signal from a monophonic audio signal
CN105808198A (en) * 2014-12-29 2016-07-27 乐视移动智能信息技术(北京)有限公司 Audio file processing method and apparatus applied to android system and terminal
CN105981411A (en) * 2013-11-27 2016-09-28 Dts(英属维尔京群岛)有限公司 Multiplet-based matrix mixing for high-channel count multichannel audio
CN108737658A (en) * 2018-05-22 2018-11-02 Oppo(重庆)智能科技有限公司 Mobile terminal and its switching method of Bluetooth audio frequency coding mode, storage medium
CN108738006A (en) * 2018-05-31 2018-11-02 出门问问信息科技有限公司 Data transmission method based on bluetooth and device
CN109150399A (en) * 2018-08-14 2019-01-04 Oppo广东移动通信有限公司 Data transmission method, device, electronic equipment and computer-readable medium
CN112313929A (en) * 2018-12-27 2021-02-02 华为技术有限公司 Method for automatically switching Bluetooth audio coding modes and electronic equipment
CN112492395A (en) * 2020-11-30 2021-03-12 维沃移动通信有限公司 Data processing method and device and electronic equipment

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050165502A1 (en) * 2004-01-27 2005-07-28 Hanes David H. Method, system and computer-readable medium for generating a multi-channel audio signal from a monophonic audio signal
CN105981411A (en) * 2013-11-27 2016-09-28 Dts(英属维尔京群岛)有限公司 Multiplet-based matrix mixing for high-channel count multichannel audio
CN105808198A (en) * 2014-12-29 2016-07-27 乐视移动智能信息技术(北京)有限公司 Audio file processing method and apparatus applied to android system and terminal
CN108737658A (en) * 2018-05-22 2018-11-02 Oppo(重庆)智能科技有限公司 Mobile terminal and its switching method of Bluetooth audio frequency coding mode, storage medium
CN108738006A (en) * 2018-05-31 2018-11-02 出门问问信息科技有限公司 Data transmission method based on bluetooth and device
CN109150399A (en) * 2018-08-14 2019-01-04 Oppo广东移动通信有限公司 Data transmission method, device, electronic equipment and computer-readable medium
CN112313929A (en) * 2018-12-27 2021-02-02 华为技术有限公司 Method for automatically switching Bluetooth audio coding modes and electronic equipment
CN112492395A (en) * 2020-11-30 2021-03-12 维沃移动通信有限公司 Data processing method and device and electronic equipment

Also Published As

Publication number Publication date
CN113838470B (en) 2023-10-03

Similar Documents

Publication Publication Date Title
US10224894B2 (en) Metadata for ducking control
JPH07143596A (en) Method to obtain multichannel decoder matrix
WO2008111773A1 (en) A method and an apparatus for processing an audio signal
WO2016150316A1 (en) Audio output control method and apparatus
EP1552723A1 (en) Apparatus and method for adapting audio signal according to user's preference
CN107277691B (en) Multi-channel audio playing method and system based on cloud and audio gateway device
KR20090053723A (en) A method and an apparatus for embedding data in a media stream
CN111510755A (en) Audio and video switching method and device, computer equipment and readable storage medium
CN112995730A (en) Sound and picture synchronous adjustment method and device, electronic equipment and medium
US20230232182A1 (en) Spatial Audio Capture, Transmission and Reproduction
US20220286799A1 (en) Apparatus and method for processing multi-channel audio signal
CN113838470B (en) Audio processing method, device, electronic equipment, computer readable medium and product
CN110503979B (en) Audio output effect monitoring method, device, medium and electronic equipment
CN110022510B (en) Sound vibration file generation method, sound vibration file analysis method and related device
CN114339297B (en) Audio processing method, device, electronic equipment and computer readable storage medium
CN115223577A (en) Audio processing method, chip, device, equipment and computer readable storage medium
CN111866542B (en) Audio signal processing method, multimedia information processing device and electronic equipment
CN109150400B (en) Data transmission method and device, electronic equipment and computer readable medium
CN115497485A (en) Three-dimensional audio signal coding method, device, coder and system
KR101114431B1 (en) Apparatus for generationg and reproducing audio data for real time audio stream and the method thereof
CN113747181A (en) Network live broadcast method, live broadcast system and electronic equipment based on remote desktop
EP2573728A1 (en) Sound-source distribution method for an electronic terminal, and system for same
EP4310839A1 (en) Apparatus and method for processing multi-channel audio signal
KR101040086B1 (en) Method and apparatus for generating audio and method and apparatus for reproducing audio
WO2023051367A1 (en) Decoding method and apparatus, and device, storage medium and computer program product

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant