WO2021004046A1 - Audio processing method and apparatus, and display device - Google Patents

Audio processing method and apparatus, and display device Download PDF

Info

Publication number
WO2021004046A1
WO2021004046A1 PCT/CN2020/070890 CN2020070890W WO2021004046A1 WO 2021004046 A1 WO2021004046 A1 WO 2021004046A1 CN 2020070890 W CN2020070890 W CN 2020070890W WO 2021004046 A1 WO2021004046 A1 WO 2021004046A1
Authority
WO
WIPO (PCT)
Prior art keywords
audio data
original audio
channel
data
16bit
Prior art date
Application number
PCT/CN2020/070890
Other languages
French (fr)
Chinese (zh)
Inventor
李见
黄飞
Original Assignee
海信视像科技股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from CN201910615836.5A external-priority patent/CN112218019B/en
Priority claimed from CN201910616404.6A external-priority patent/CN112218016B/en
Priority claimed from CN201910614701.7A external-priority patent/CN112216310B/en
Priority claimed from CN201910613254.3A external-priority patent/CN112216290A/en
Priority claimed from CN201910659488.1A external-priority patent/CN112218020B/en
Priority claimed from CN201910710346.3A external-priority patent/CN112218210B/en
Application filed by 海信视像科技股份有限公司 filed Critical 海信视像科技股份有限公司
Publication of WO2021004046A1 publication Critical patent/WO2021004046A1/en

Links

Images

Classifications

    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/008Multichannel audio signal coding or decoding using interchannel correlation to reduce redundancy, e.g. joint-stereo, intensity-coding or matrixing
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/44Receiver circuitry for the reception of television signals according to analogue transmission standards
    • H04N5/60Receiver circuitry for the reception of television signals according to analogue transmission standards for the sound signals
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/025Systems for the transmission of digital non-picture data, e.g. of text during the active part of a television frame
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R3/00Circuits for transducers, loudspeakers or microphones

Definitions

  • This application relates to the field of display technology, in particular to audio processing methods and devices, and display equipment.
  • the audio processing method and device and the display device provided by the embodiments of the present application are used to improve the playback effect.
  • the embodiment of the application provides an audio processing method, including:
  • the original audio data After re-encoding the original audio data according to a preset encoding rule, it is output through at least two first I2S bus interfaces; wherein the total number of channels is greater than the total number of channels of all the first I2S bus interfaces.
  • the original audio data is re-encoded according to a preset encoding rule, and then output through at least two first I2S bus interfaces, it includes:
  • the obtained target audio data is output through the corresponding channel of the first I2S bus interface.
  • the determining the target audio data corresponding to each channel of each of the first I2S bus interface includes:
  • the original audio data selected for splitting includes: blank original audio data.
  • the determining the target audio data corresponding to each channel of each of the first I2S bus interface includes:
  • the determining the target audio data corresponding to each channel of each of the first I2S bus interface includes:
  • the original audio data is a digital signal with K data bits
  • one of the split audio data is a digital signal with adjacent data bits; where K Is a positive integer.
  • the split audio data in the two target audio data corresponding to the same first I2S bus interface belong to the same original audio data.
  • the multiple channels include: left channel, right channel, left surround channel, right surround channel, left sky channel, right sky channel, middle channel Set channel, subwoofer channel;
  • the original audio data selected for splitting includes: original audio data corresponding to the center channel and original audio data corresponding to the subwoofer channel.
  • outputting the obtained target audio data through the corresponding channel of the first I2S bus interface includes:
  • the clock transmits data bits of a single channel, so that each of the first I2S bus interfaces transmits target audio data of two channels in one cycle of the first frame clock.
  • two data bits are transmitted in one cycle of the first bit clock; or, one data bit is transmitted in one cycle of the first bit clock.
  • the sampling bit number of the first bit clock is the same as the data bit of the target audio data.
  • the method further includes:
  • the receiving target audio data transmitted by each of the first I2S bus interfaces according to the second frame clock and the second bit clock includes:
  • An embodiment of the present application also provides an audio processing device, including:
  • a receiving circuit for receiving sound source data with multiple channels
  • a preliminary decoding circuit which is used to decode the sound source data to obtain original audio data corresponding to each of the channels;
  • the re-encoding circuit is electrically connected to the at least two first I2S bus interfaces, and is configured to re-encode the original audio data according to a preset encoding rule, and output it through at least two first I2S bus interfaces;
  • the total number of channels is greater than the total number of channels of all the first I2S bus interfaces.
  • it further includes: a re-decoding circuit electrically connected to the at least two first I2S bus interfaces;
  • the re-decoding circuit is used to receive the target audio data transmitted by each of the first I2S bus interfaces according to the second frame clock and the second bit clock, and to re-decode the received data according to the preset encoding rule to obtain each The original audio data; wherein the timing of the second frame clock is the same as the timing of the first frame clock, and the timing of the second bit clock is the same as the timing of the first bit clock.
  • An embodiment of the present application also provides a multi-channel system, including: a multi-channel device and the above audio processing device.
  • An embodiment of the present application also provides a display device, including a display screen, configured to present image data;
  • the speaker is configured to reproduce sound data
  • An audio processor configured to receive sound source data having multiple channels, and decode the sound source data to obtain original audio data corresponding to each of the channels;
  • a controller configured to re-encode the original audio data according to a preset encoding rule, and output to the speaker through at least two first I2S bus interfaces;
  • the total number of channels is greater than the total number of channels of all the first I2S bus interfaces.
  • the audio processing method and device and the display device decode the sound source data to obtain the original audio data corresponding to each channel. Since the total number of channels is greater than the total number of channels of all the first I2S bus interfaces, After the original audio data is re-encoded by the preset encoding rule, the original audio data of all channels can be output through at least two first I2S bus interfaces. In this way, the original audio data corresponding to all channels in the sound source file can be transmitted to the multi-channel device, thereby improving the playback effect of the multi-channel device.
  • FIG. 1 is a signal timing diagram of an I2S bus interface provided by an embodiment of the application
  • FIG. 3 is a schematic structural diagram of a multi-channel device provided by an embodiment of the application.
  • FIG. 4 is one of the schematic diagrams of original audio data provided by an embodiment of this application.
  • FIG. 5 is one of the timing diagrams when the first I2S bus interface provides data output according to an embodiment of the application
  • FIG. 6 is one of the timing diagrams when receiving data output by the first I2S bus interface according to an embodiment of the application
  • FIG. 7 is one of the schematic diagrams of time sequence when intercepting data in target audio data provided by an embodiment of the application.
  • FIG. 8 is the second schematic diagram of original audio data provided by an embodiment of this application.
  • FIG. 9 is the third schematic diagram of original audio data provided by an embodiment of this application.
  • FIG. 10 is the second schematic diagram of the time sequence when the first I2S bus interface provides data output according to an embodiment of the application
  • FIG. 11a is the second schematic diagram of the time sequence when receiving data output by the first I2S bus interface according to an embodiment of the application.
  • FIG. 11b is the third schematic diagram of the time sequence when receiving data output by the first I2S bus interface according to an embodiment of the application.
  • FIG. 11c is a fourth schematic diagram of a timing sequence when receiving data output by the first I2S bus interface according to an embodiment of the application.
  • FIG. 12 is a second schematic diagram of a time sequence when data in target audio data is intercepted according to an embodiment of the application.
  • FIG. 13a is the third schematic diagram of the time sequence when the first I2S bus interface provides data output according to an embodiment of the application;
  • FIG. 13b is a fourth schematic diagram of a timing sequence when the first I2S bus interface provides data output according to an embodiment of the application;
  • FIG. 13c is the fifth schematic diagram of the time sequence when the first I2S bus interface provides data output according to an embodiment of the application.
  • FIG. 14a is the fifth schematic diagram of the time sequence when receiving data output by the first I2S bus interface according to an embodiment of the application;
  • FIG. 14b is a sixth schematic diagram of the timing sequence when receiving data output by the first I2S bus interface according to an embodiment of the application;
  • FIG. 14c is the seventh schematic diagram of the time sequence when receiving data output by the first I2S bus interface according to an embodiment of the application.
  • 15 is the third schematic diagram of the time sequence when intercepting data in target audio data provided by an embodiment of the application.
  • 16 is the fourth schematic diagram of original audio data provided by an embodiment of this application.
  • FIG. 17 is a sixth schematic diagram of a time sequence when the first I2S bus interface provides data output according to an embodiment of the application;
  • FIG. 18 is the eighth schematic diagram of the time sequence when receiving data output by the first I2S bus interface provided by an embodiment of the application.
  • FIG. 19 is a fourth schematic diagram of a time sequence when data in target audio data is intercepted according to an embodiment of the application.
  • FIG. 20 is a schematic structural diagram of an audio processing device provided by an embodiment of the application.
  • FIG. 21 is a schematic diagram of a display device provided in Embodiment 1 of the present application.
  • FIG. 22 is a block diagram of the hardware configuration of the display device provided in Embodiment 1 of the present application.
  • liquid crystal display devices Liquid Crystal Display, LCD
  • organic light emitting diode Organic Light Emitting Diode, OLED
  • These display devices can receive video data and sound source data, and process these data to display images and output sounds.
  • the sound source data may have multiple channels, such as 8 channels, 9 channels, 12 channels, and so on.
  • 8 channels may include: left channel L, right channel R, left surround channel SL, right surround channel SR, left sky channel TOPL, right sky channel TOPR, center channel center, Subwoofer channel woofer.
  • the display device may be provided with multiple speakers, so that one speaker correspondingly plays one channel of audio.
  • the display device is provided with 8 speakers Y1 to Y8, wherein the speaker Y1 plays the audio data corresponding to the left channel L, the speaker Y2 plays the audio data corresponding to the right channel R, and the speaker Y3 plays the corresponding audio data.
  • the I2S bus interface is used to transmit audio data to the display device as a multi-channel device. No matter how many bits of valid data are in the signal of the I2S bus interface transmission format, the highest bit of the data always appears at the second bit clock BCLK pulse after the occurrence edge of the frame clock WS (that is, the beginning of a frame). In this way, the effective data bits of the receiving end and the transmitting end can be different. If the receiving end can handle less effective data bits than the sending end, it can give up the excess low data bits in the data frame; if the receiving end can handle more effective data bits than the sending end, it can make up the remaining bits by itself. This synchronization mechanism makes it more convenient to use the I2S bus interface to transmit audio data without causing data misalignment.
  • the main chip that processes sound source data in a multi-channel device generally uses 2 I2S bus interfaces or 3 I2S bus interfaces to output audio data. This makes it possible when the total number of I2S bus interfaces is less than the total number of audio data channels. This will cause the audio data corresponding to some channels to be missing during transmission, resulting in incomplete audio data transmitted to the multi-channel device, and reducing the playback effect of the multi-channel device.
  • the main signals involved in the transmission of the I2S bus interface are as follows:
  • the frame clock WS is used to switch the data of the left and right channels. For example, WS of "1" means that the data of the left channel is being transmitted, and WS of "0" means that the data of the right channel is being transmitted.
  • the frequency of WS is equal to the sampling frequency.
  • an I2S bus interface has two channels for transmitting audio data.
  • one channel of the I2S bus interface transmits audio data corresponding to the left channel, and the other channel transmits audio data corresponding to the right channel.
  • WS can change on the rising or falling edge of the serial clock BCLK, and the WS signal does not need to be symmetrical.
  • the highest bit of data always appears at the second bit clock BCLK pulse after the falling edge of the frame clock WS (that is, the start of a frame). That is, WS always changes one clock cycle before the highest bit transmission, so that the slave device can get the time synchronized with the serial data DATA being transmitted, and the receiving end can store the current command and clear space for the next command .
  • the embodiment of the present application provides an audio processing method, as shown in FIG. 2, which may include the following steps:
  • the audio processing method provided by the embodiment of the application first decodes the sound source data to obtain the original audio data corresponding to each channel. Since the total number of channels is greater than the total number of channels of all the first I2S bus interfaces, the original After the audio data is re-encoded, the original audio data of all channels can be output through at least two first I2S bus interfaces. In this way, the original audio data corresponding to all channels in the sound source file can be transmitted to the multi-channel device, thereby improving the playback effect of the multi-channel device.
  • the original audio data is re-encoded according to a preset encoding rule, and outputted through at least two first I2S bus interfaces, it may include:
  • the data bits of the target audio data are greater than the data bits of the original audio data
  • the obtained target audio data is output through the corresponding channel of the first I2S bus interface.
  • determining the target audio data corresponding to each channel of each first I2S bus interface may include:
  • the original audio data and the split audio data are combined into one target audio data.
  • the number of the first I2S bus interface can be designed and determined according to the actual application environment, which is not limited here.
  • the number of N can be designed and determined according to the actual application environment, and is not limited here.
  • Dolby Atmos 5.1.2 technology multi-channel equipment can achieve better sound effects.
  • multiple channels may include: left channel, right channel, left surround channel, right surround channel, left sky channel, right sky channel , Center channel, subwoofer channel.
  • the sound source file can be played using a multi-channel device with Dolby Atmos 5.1.2 technology.
  • the specific sound channels of the sound channels can be designed and determined according to the actual application environment, which is not limited here.
  • the original audio data selected for splitting includes: original audio data corresponding to the center channel and original audio data corresponding to the subwoofer channel.
  • the split data is spliced during subsequent decoding, so as to obtain the original audio data corresponding to the center channel and the original audio data corresponding to the subwoofer channel.
  • the center channel and the subwoofer channel have less influence on the playback effect.
  • the split data may be affected during the general transmission process, which is not conducive to subsequent decoding and splicing.
  • the embodiment of this application splits the original audio data corresponding to the center channel and the original audio data corresponding to the subwoofer channel.
  • the center channel may not be decoded later.
  • the original audio data corresponding to the sound channel and the original audio data corresponding to the subwoofer sound channel have little impact on the playback effect of the multi-channel device.
  • digital recording usually uses 16-bit (bit), 20-bit or 24-bit two's complement to make music sound source files.
  • the original audio data may be a digital signal with K data bits.
  • one piece of split audio data can be a digital signal with adjacent data bits; where K is a positive integer.
  • K is a positive integer.
  • the original audio data can be split according to the adjacent 8 data bits, thereby splitting into two Split audio data: One split audio data is 0100 0010, and the other split audio data is 0001 1101.
  • the original audio data ch6: 16bit is used to generate split audio data ch6: high 8bit, ch6: low 8bit; the original audio data ch7: 16bit is generated to generate split audio data ch7: high 8bit, ch7 :low 8bit; Use blank original audio data ch8:16bit to generate split audio data ch8:high 8bit, ch8:low 8bit.
  • the blank original audio data does not carry audio information of the sound source, and it may be data formed by using "0". For example, if the original audio data is a digital signal of 0100 0010 0001 1101, the blank original audio data can be a digital signal of 0000 0000 0000.
  • the split audio data in the two target audio data corresponding to the same first I2S bus interface can be used Belong to the same original audio data.
  • outputting the obtained target audio data through the corresponding channel of the first I2S bus interface may include:
  • one data bit is transmitted in one cycle of the first bit clock.
  • the first bit clock uses single edge sampling. For example, use the rising or falling edge of each cycle to sample one data bit.
  • two data bits are transmitted in one cycle of the first bit clock.
  • the first bit clock uses double-edge sampling. For example, use the rising and falling edges of each cycle to sample one data bit.
  • the sampling bit number of the first bit clock may be the same as the data bit of the target audio data.
  • the original audio data is re-encoded according to a preset encoding rule and then output through at least two first I2S bus interfaces, it may further include:
  • receiving the target audio data transmitted by each first I2S bus interface according to the second frame clock and the second bit clock may include: receiving each first frame clock according to a second frame clock and a second bit clock.
  • Target audio data transmitted by the I2S bus interface This can reduce the number of output signals of the second frame clock and the second bit clock.
  • receiving the target audio data transmitted by each first I2S bus interface according to the second frame clock and the second bit clock may also include: receiving each data according to multiple second frame clocks and multiple second bit clocks.
  • the target audio data transmitted by each first I2S bus interface can be received independently, thereby avoiding transmission interference and improving transmission stability.
  • the data bits of the target audio data may be at most the data bits that can be transmitted in one channel of the first I2S bus interface.
  • one channel of the first I2S bus interface can transmit 32 bits of data
  • the data bits of the target audio data can be at most 32 bits.
  • the interface is output to a multi-channel device; among them, the number of the second I2S bus interface is one-half of all channels. In other words, one second I2S bus interface corresponds to two original audio data.
  • FIG. 5 and FIG. 6 only take the transmission process of the target audio data SD1_0 and the target audio data SD2_0 as an example for description.
  • the sound source data may be stored in a USB storage medium, or directly obtained through the network.
  • the original audio data ch0: 16bit and the split audio data ch6: high 8bit are spliced into the target audio data SD1_0
  • the original audio data ch1: 16bit and the split audio data ch6: low 8bit is spliced into target audio data SD2_0
  • original audio data ch2:16bit and split audio data ch7:high 8bit are spliced into target audio data SD1_1
  • original audio data ch3:16bit and split audio data ch7:low 8bit are spliced into target Audio data SD2_1
  • the data bit of a target audio data is changed from 16bit of the original audio data to 24bit, so the number of sampling bits of the first clock BCLK1 can be changed, so that the sampling of the first clock BCLK1
  • the number of bits is the same as that of a target audio data.
  • one data bit is transmitted on the rising edge of each cycle of the first bit clock BCLK1.
  • the channel of the first I2S bus interface I2S_0 corresponding to the left channel is controlled to transmit the target audio data SD1_0.
  • the target audio data SD1_0 is transmitted according to the first bit clock BCLK1, so that the target audio data SD1_0 adopts the left sound of the first I2S bus interface I2S_0 Channel output corresponding to the channel.
  • the original audio data ch0: 16bit is transmitted sequentially from the highest bit
  • the split audio data ch6 high 16bit is sequentially transmitted from the highest bit.
  • the channel of the first I2S bus interface I2S_0 corresponding to the right channel is controlled to transmit the target audio data SD2_0.
  • the target audio data SD2_0 is transmitted according to the first bit clock BCLK1, so that the target audio data SD2_0 adopts the right sound of the first I2S bus interface I2S_0 Channel output corresponding to the channel.
  • the original audio data ch1: 16bit is transmitted sequentially from the highest bit
  • the split audio data ch6: low 16bit is sequentially transmitted from the highest bit.
  • the channel of the first I2S bus interface I2S_1 corresponding to the left channel is controlled to transmit the target audio data SD1_1.
  • the channel of the first I2S bus interface I2S_1 corresponding to the right channel is controlled to transmit the target audio data SD2_1.
  • the channel of the first I2S bus interface I2S_2 corresponding to the left channel is controlled to transmit the target audio data SD1_2.
  • the channel of the first I2S bus interface I2S_2 corresponding to the right channel is controlled to transmit the target audio data SD2_2.
  • the timing of controlling the second frame clock WS2 is the same as that of the first frame clock WS1, and the timing of the second bit clock BCLK2 is the same as that of the first bit clock BCLK1.
  • the preset clock signal YCLK is used to intercept the first 16bit data of the target audio data SD1_0, SD2_0, SD1_1, SD2_1, SD1_2, and SD2_2 respectively, that is, to intercept the original audio data ch0:16bit, ch1: 16bit, ch2:16bit, ch3:16bit, ch4:16bit, ch5:16bit, and store the original audio data ch0:16bit and ch1:16bit in the channel stack corresponding to the left channel of the first and second I2S bus interface respectively And in the channel stack corresponding to the right channel, the original audio data ch2:16bit and ch3:16bit are respectively stored in the channel stack corresponding to the left channel and the channel stack corresponding to the right channel of the second I2S bus interface , And store the original audio data ch4:16bit and ch5:16bit respectively in the channel stack corresponding to the left channel and the channel stack corresponding to the right
  • the restored original audio data can be output to the power amplifier device in the multi-channel device through these second I2S bus interfaces, so as to drive the speaker to sound through the power amplifier device.
  • the preset clock signal may be a preset stored clock signal.
  • the period of the preset clock signal may be the same as the period of the bit clock.
  • the frequency of the preset clock signal can be designed according to the actual application environment, which is not repeated here.
  • the last 8bit data in the target audio data SD1_2 and SD2_2 is obtained by splitting blank original audio data, it is not carried in the sound source data, so the last 8bit data in the target audio data SD1_2 and SD2_2 can be 8bit data is deleted directly.
  • the received target audio data SD1_0 to SD2_2 can also be buffered first, and then the preset clock signal YCLK is used for intercepting respectively according to the foregoing embodiment.
  • the preset clock signal YCLK is used for intercepting respectively according to the foregoing embodiment.
  • determining the target audio data corresponding to each channel of each first I2S bus interface may also include:
  • the original audio data and the split audio data are spliced into one target audio data.
  • the audio processing method provided by the present application will be described through specific embodiments. However, readers should know that the specific process is not limited to this. Among them, the three first I2S bus interfaces are I2S_0, I2S_1, and I2S_2 respectively.
  • Audio data ch0 16bit corresponding to the left channel
  • the 16bit original audio data ch1 16bit corresponding to the right channel
  • the 16bit original audio data corresponding to the left surround channel Audio data ch2: 16bit, 16bit original audio data corresponding to the right surround channel ch3: 16bit, 16bit original audio data corresponding to the left sky channel ch4: 16bit, 16bit original audio data corresponding to the right sky channel ch5: 16bit , 16bit original audio data ch6:16bit corresponding to the center channel, 16bit original audio data ch7:16bit corresponding to the subwoofer channel, and 16bit original audio data ch9:16bit corresponding to the ninth channel.
  • the 16-bit original audio data ch6:16bit corresponding to the center channel, the 16-bit original audio data ch7:16bit corresponding to the subwoofer channel, and the ninth channel can be directly selected from all the original audio data.
  • the corresponding original audio data ch9:16bit a total of 3 original audio data are split, so that the original audio data ch6:16bit generates split audio data ch6: high 8bit, ch6: low 8bit; the original audio data ch7: 16bit is generated and split Audio data ch7: high 8bit, ch7: low 8bit; make the original audio data ch9: 16bit generate split audio data ch9: high 8bit, ch9: low 8bit.
  • the original audio data ch0: 16bit and the split audio data ch6: high 8bit are spliced into the target audio data SD1_0
  • the original audio data ch1: 16bit and the split audio data ch6: low 8bit is spliced into target audio data SD2_0
  • original audio data ch2:16bit and split audio data ch7:high 8bit are spliced into target audio data SD1_1
  • original audio data ch3:16bit and split audio data ch7:low 8bit are spliced into target Audio data SD2_1
  • the data bit of a target audio data is changed from 16bit of the original audio data to 24bit, so the number of sampling bits of the first clock BCLK1 can be changed to make the first clock BCLK1 sample
  • the number of bits is the same as that of a target audio data.
  • one data bit is transmitted on the rising edge of each cycle of the first bit clock BCLK1.
  • the channel of the first I2S bus interface I2S_0 corresponding to the left channel is controlled to transmit the target audio data SD1_0.
  • the target audio data SD1_0 is transmitted according to the first bit clock BCLK1, so that the target audio data SD1_0 adopts the left sound of the first I2S bus interface I2S_0 Channel output corresponding to the channel.
  • the original audio data ch0: 16bit is transmitted sequentially from the highest bit
  • the split audio data ch6 high 16bit is sequentially transmitted from the highest bit.
  • the channel of the first I2S bus interface I2S_0 corresponding to the right channel is controlled to transmit the target audio data SD2_0.
  • the target audio data SD2_0 is transmitted according to the first bit clock BCLK1, so that the target audio data SD2_0 adopts the right sound of the first I2S bus interface I2S_0 Channel output corresponding to the channel.
  • the original audio data ch1: 16bit is transmitted sequentially from the highest bit
  • the split audio data ch6: low 16bit is sequentially transmitted from the highest bit.
  • the channel of the first I2S bus interface I2S_1 corresponding to the left channel is controlled to transmit the target audio data SD1_1.
  • the channel of the first I2S bus interface I2S_1 corresponding to the right channel is controlled to transmit the target audio data SD2_1.
  • the channel of the first I2S bus interface I2S_2 corresponding to the left channel is controlled to transmit the target audio data SD1_2.
  • the channel of the first I2S bus interface I2S_2 corresponding to the right channel is controlled to transmit the target audio data SD2_2.
  • the timing of controlling the second frame clock WS2 is the same as the timing of the first frame clock WS1
  • the timing of the second bit clock BCLK2 is the same as the timing of the first bit clock BCLK1.
  • the first 16bit data in the target audio data SD1_0, SD2_0, SD1_1, SD2_1, SD1_2, and SD2_2 are respectively intercepted, that is, the original audio data ch0:16bit, ch1:16bit, ch2:16bit, ch3:16bit, ch4:16bit, ch5:16bit, and store the original audio data ch0:16bit and ch1:16bit respectively in the channel stack corresponding to the left channel of the first and second I2S bus interface and the channel stack corresponding to the right channel
  • the original audio data ch2:16bit and ch3:16bit are respectively stored in the channel stack corresponding to the left channel and the channel stack corresponding to the right channel of the second I2S bus interface
  • the original audio data ch4:16bit and ch5:16bit are respectively stored in the channel stack corresponding to the left channel and the channel stack corresponding to the right channel of the third second I2S
  • the received target audio data SD1_0 to SD2_2 can also be buffered first, and then the preset clock signal YCLK is used for intercepting respectively according to the foregoing embodiment.
  • the preset clock signal YCLK is used for intercepting respectively according to the foregoing embodiment.
  • determining the target audio data corresponding to each channel of each first I2S bus interface may also include:
  • the original audio data are combined into one target audio data; where N is a positive even number, and M represents the total number of channels of all the first I2S bus interfaces.
  • the number of first I2S bus interfaces and the number of all original audio data can be designed and determined according to the actual application environment, which is not limited here.
  • two original audio data in the same target audio data can be set as original audio data corresponding to the same type of channel.
  • these channels include at least: a left channel, a right channel, a left surround channel, a right surround channel, a left sky channel, a right sky channel, a center channel, and a subwoofer channel.
  • the left and right channels can be used as the same type of main channel
  • the left and right surround channels can be used as the same type of surround channels
  • the left and right sky channels can be used as the same type of sky Channel
  • center channel and subwoofer channel can be used as the same type of booster channel. The rest is the same, so I won't repeat it here.
  • FIG. 10 only uses the transmission process of the target audio data SD1_0 and the target audio data SD2_0 as an example for description.
  • Receive sound source data with 12 channels include at least: left channel, right channel, left surround channel, right surround channel, left sky channel, right sky channel, center channel, and subwoofer channel.
  • the remaining channels can be designed and determined according to the actual application environment, which is not limited here.
  • the sound source data is decoded using any existing decoding method to decode the original audio data corresponding to the 12 channels: ch0:16bit, ch1:16bit, ch2:16bit, ch3:16bit, ch4:16bit, ch5:16bit, ch6:16bit, ch7:16bit, ch8:16bit, ch9:16bit, ch10:16bit, ch11:16bit.
  • ch0:16bit and ch1:16bit can be used as the original audio data corresponding to the same type of channel
  • ch2:16bit and ch3:16bit can be used as the original audio data corresponding to the same type of channel
  • ch4:16bit and ch5:16bit can be As the original audio data corresponding to the same type of channel
  • ch6:16bit and ch7:16bit can be used as the original audio data corresponding to the same type of channel
  • ch8:16bit and ch9:16bit can be used as the original audio corresponding to the same type of channel
  • ch10:16bit and ch11:16bit can be used as the original audio data corresponding to the same type of channel.
  • ch0:16bit and ch1:16bit are used as a target audio data SD1_0
  • ch2:16bit and ch3:16bit are used as a target audio data SD2_0
  • ch4:16bit and ch5:16bit are used as a target audio data SD1_1
  • ch10:16bit and ch11:16bit as a target audio data SD2_2.
  • the data bit of a target audio data is changed from 16bit of the original audio data to 32bit, so the number of sampling bits of the first bit clock BCLK1 can be changed without changing the first bit clock BCLK1
  • the sampling frequency is such that the sampling bits of the first clock BCLK1 are the same as the data bits of a target audio data.
  • one data bit is transmitted on the rising edge of each cycle of the first bit clock BCLK1.
  • the channel of the first I2S bus interface I2S_0 corresponding to the left channel is controlled to transmit the target audio data SD1_0.
  • the target audio data SD1_0 is transmitted according to the first bit clock BCLK1, so that the target audio data SD1_0 adopts the left sound of the first I2S bus interface I2S_0 Channel output corresponding to the channel.
  • the original audio data ch0:16bit is transmitted sequentially from the highest bit, and then the original audio data ch1:16bit is sequentially transmitted from the highest bit.
  • the channel of the first I2S bus interface I2S_0 corresponding to the right channel is controlled to transmit the target audio data SD2_0.
  • the target audio data SD2_0 is transmitted according to the first bit clock BCLK1, so that the target audio data SD2_0 adopts the right sound of the first I2S bus interface I2S_0 Channel output corresponding to the channel.
  • the target audio data SD2_0 is transmitted, the original audio data ch2:16bit is sequentially transmitted from the highest bit, and then the original audio data ch3:16bit is sequentially transmitted from the highest bit.
  • the channel of the first I2S bus interface I2S_1 corresponding to the left channel is controlled to transmit the target audio data SD1_1.
  • the channel of the first I2S bus interface I2S_1 corresponding to the right channel is controlled to transmit the target audio data SD2_1.
  • the channel of the first I2S bus interface I2S_2 corresponding to the left channel is controlled to transmit the target audio data SD1_2.
  • the channel of the first I2S bus interface I2S_2 corresponding to the right channel is controlled to transmit the target audio data SD2_2.
  • the first I2S bus interface I2S_0 corresponds to the second frame clock WS2_0 and the second bit clock BCLK2_0
  • the first I2S bus interface I2S_1 corresponds to the second frame clock WS2_1 and the second bit clock BCLK2_1
  • the first I2S bus interface I2S_2 corresponds to the second frame clock WS2_2 and the second bit clock BCLK2_2.
  • the timing of controlling the second frame clock WS2_0 to WS2_2 is the same as the timing of the first frame clock WS1
  • the timing of the second bit clock BCLK2_0 to BCLK2_2 is the same as the timing of the first bit clock BCLK1.
  • the target audio data SD1_0 and SD2_0 transmitted by the first I2S bus interface I2S_0 are controlled to be received.
  • the preset clock signal YCLK is used to intercept the first 16bit data of the target audio data SD1_0, SD2_0, SD1_1, SD2_1, SD1_2, and SD2_2 respectively, that is, to intercept the original audio data ch0:16bit, ch2: 16bit, ch4: 16bit, ch6: 16bit, ch8: 16bit, ch10: 16bit.
  • the preset clock signal YCLK is used to intercept the last 16bit data of the target audio data SD1_0, SD2_0, SD1_1, SD2_1, SD1_2, and SD2_2 respectively, that is, to intercept the original audio data ch1:16bit, ch3:16bit, ch5:16bit, ch7: 16bit, ch9: 16bit, ch11: 16bit.
  • the restored original audio data ch0:16bit ⁇ ch11:16bit can be output to the power amplifier device in the multi-channel device using these second I2S bus interfaces, so as to drive the speaker to sound through the power amplifier device.
  • the received target audio data SD1_0 to SD2_2 can also be buffered first, and then the preset clock signal YCLK is used for intercepting respectively according to the foregoing embodiment.
  • the preset clock signal YCLK is used for intercepting respectively according to the foregoing embodiment.
  • the audio processing method provided may also include the following steps in addition to the above steps (1) to (3):
  • the data bit of a target audio data is changed from 16bit of the original audio data to 32bit, so the sampling frequency of the first bit clock BCLK1 can be changed without changing the first bit clock
  • the sampling bits of BCLK1 make the sampling bits of the first clock BCLK1 the same as the data bits of a target audio data. Among them, one data bit is transmitted on the rising and falling edges of each cycle of the first bit clock BCLK1.
  • the channel of the first I2S bus interface I2S_0 corresponding to the left channel is controlled to transmit the target audio data SD1_0.
  • the target audio data SD1_0 is transmitted according to the first bit clock BCLK1, so that the target audio data SD1_0 adopts the left sound of the first I2S bus interface I2S_0 Channel output corresponding to the channel.
  • the original audio data ch0:16bit is transmitted sequentially from the highest bit, and then the original audio data ch1:16bit is sequentially transmitted from the highest bit.
  • the channel of the first I2S bus interface I2S_0 corresponding to the right channel is controlled to transmit the target audio data SD2_0.
  • the target audio data SD2_0 is transmitted according to the first bit clock BCLK1, so that the target audio data SD2_0 adopts the right sound of the first I2S bus interface I2S_0 Channel output corresponding to the channel.
  • the target audio data SD2_0 is transmitted, the original audio data ch2:16bit is sequentially transmitted from the highest bit, and then the original audio data ch3:16bit is sequentially transmitted from the highest bit.
  • the channel of the first I2S bus interface I2S_1 corresponding to the left channel is controlled to transmit the target audio data SD1_1.
  • the channel of the first I2S bus interface I2S_1 corresponding to the right channel is controlled to transmit the target audio data SD2_1.
  • the channel of the first I2S bus interface I2S_2 corresponding to the left channel is controlled to transmit the target audio data SD1_2.
  • the channel of the first I2S bus interface I2S_2 corresponding to the right channel is controlled to transmit the target audio data SD2_2.
  • the first I2S bus interface I2S_0 corresponds to the second frame clock WS2_0 and the second bit clock BCLK2_0
  • the first I2S bus interface I2S_1 corresponds to the second frame clock WS2_1 and the second frame clock.
  • the bit clock BCLK2_1 corresponds to the second frame clock WS2_2 and the second bit clock BCLK2_2.
  • the timing of controlling the second frame clock WS2_0 to WS2_2 is the same as the timing of the first frame clock WS1
  • the timing of the second bit clock BCLK2_0 to BCLK2_2 is the same as the timing of the first bit clock BCLK1.
  • the second frame clock WS2_0 and the second bit clock BCLK2_0 control to receive the target audio data SD1_0 and SD2_0 transmitted by the first I2S bus interface I2S_0.
  • the second frame clock WS2_1 and the second bit clock BCLK2_1 control to receive the target audio data SD1_1 and SD2_1 transmitted by the first I2S bus interface I2S_1.
  • the second frame clock WS2_2 and the second bit clock BCLK2_2 control to receive the target audio data SD1_2 and SD2_2 transmitted by the first I2S bus interface I2S_2.
  • the preset clock signal YCLK is used to intercept the first 16bit data of the target audio data SD1_0, SD2_0, SD1_1, SD2_1, SD1_2, and SD2_2 respectively, that is, to intercept the original audio data ch0:16bit, ch2: 16bit, ch4: 16bit, ch6: 16bit, ch8: 16bit, ch10: 16bit.
  • the preset clock signal YCLK is used to intercept the last 16bit data of the target audio data SD1_0, SD2_0, SD1_1, SD2_1, SD1_2, and SD2_2 respectively, that is, to intercept the original audio data ch1:16bit, ch3:16bit, ch5:16bit, ch7: 16bit, ch9: 16bit, ch11: 16bit.
  • the restored original audio data ch0:16bit ⁇ ch11:16bit can be output to the power amplifier device in the multi-channel device using these second I2S bus interfaces, so as to drive the speaker to sound through the power amplifier device.
  • the timing of the preset clock signal YCLK may be the same as the timing of the second bit clock.
  • determining the target audio data corresponding to each channel of each first I2S bus interface may also include:
  • the original audio data and the split audio data are combined into one target audio data.
  • the original audio data selected for splitting may include: blank original audio data.
  • the split data when the split data is affected during the transmission process, although the blank original audio data may not be decoded later, it has no effect on the playback effect of the multi-channel device.
  • the audio processing method may include the following steps:
  • the sound source data is decoded using any existing decoding method to decode the original 16bit audio data ch0:16bit corresponding to the left channel, and 16bit original audio data corresponding to the right channel ch1: 16bit, 16bit original audio data corresponding to the left surround channel ch2: 16bit, 16bit original audio data corresponding to the right surround channel ch3: 16bit, 16bit original audio data corresponding to the left sky channel ch4: 16bit, right 16bit original audio data ch5:16bit corresponding to the sky channel, 16bit original audio data ch6:16bit corresponding to the center channel, and 16bit original audio data ch7:16bit corresponding to the subwoofer channel.
  • the data bit of a target audio data is changed from 16bit of the original audio data to 48bit. Therefore, the sampling number and sampling frequency of the first clock BCLK1 can be changed to make the target audio data according to The first bit clock BCLK1 is transmitted. In addition, one data bit is transmitted on the rising edge and the falling edge of each cycle of the first bit clock BCLK1.
  • the channel of the first I2S bus interface I2S_0 corresponding to the left channel is controlled to transmit the target audio data SD1_0.
  • the target audio data SD1_0 is transmitted according to the first bit clock BCLK1, so that the target audio data SD1_0 adopts the left sound of the first I2S bus interface I2S_0 Channel output corresponding to the channel.
  • the target audio data SD1_0 when the target audio data SD1_0 is transmitted, the original audio data ch0: 16bit is transmitted sequentially from the highest bit, and then the split audio data ch01: high 16bit is transmitted sequentially from the highest bit, and then the original audio data ch01: high 16bit is transmitted sequentially from the highest bit.
  • the audio data ch1: 16bit, and then the split audio data ch01: low 16bit is transmitted sequentially starting from the highest bit.
  • the channel of the first I2S bus interface I2S_0 corresponding to the right channel is controlled to transmit the target audio data SD2_0.
  • the target audio data SD2_0 is transmitted according to the first bit clock BCLK1, so that the target audio data SD2_0 adopts the right sound of the first I2S bus interface I2S_0 Channel output corresponding to the channel.
  • the target audio data SD2_0 when the target audio data SD2_0 is transmitted, the original audio data ch2: 16bit is transmitted sequentially from the highest bit, and then the split audio data ch02: high 16bit is transmitted sequentially from the highest bit, and then the original audio data ch02: high 16bit is transmitted sequentially from the highest bit.
  • Audio data ch3 16bit, and then sequentially transmit the split audio data ch02: low 16bit from the highest bit.
  • the channel of the first I2S bus interface I2S_1 corresponding to the left channel is controlled to transmit the target audio data SD1_1.
  • the channel of the first I2S bus interface I2S_1 corresponding to the right channel is controlled to transmit the target audio data SD2_1.
  • the channel of the first I2S bus interface I2S_2 corresponding to the left channel is controlled to transmit the target audio data SD1_2.
  • the channel of the first I2S bus interface I2S_2 corresponding to the right channel is controlled to transmit the target audio data SD2_2.
  • the timing of controlling the second frame clock WS2 is the same as that of the first frame clock WS1
  • the timing of the second bit clock BCLK2 is the same as that of the first bit clock BCLK1.
  • the preset clock signal YCLK is used to intercept the first 16 bits of the target audio data SD1_0, SD2_0, SD1_1, and SD2_1 respectively, that is, to intercept the original audio data ch0: 16bit, ch2: 16bit, ch4: 16bit, ch6:16bit, and store the original audio data ch0:16bit in the channel stack corresponding to the left channel of the first second I2S bus interface, and store the original audio data ch2:16bit in the second second I2S bus In the channel stack corresponding to the left channel of the interface, store the original audio data ch4:16bit in the channel stack corresponding to the left channel of the third second I2S bus interface, and store the original audio data ch6:16bit in the fourth In the channel stack corresponding to the left channel of the second I2S bus interface.
  • the original audio data ch0:16bit, ch2:16bit, ch4:16bit, and ch6:16bit is used to intercept the first 16 bits of
  • the preset clock signal YCLK is used to intercept the next 8bit data of the target audio data SD1_0, SD2_0, SD1_1, SD2_1 respectively, that is, to intercept ch01: high 8bit, ch02: high 8bit, ch04: high 8bit, ch06: high 8bit. , You can delete the data directly.
  • the preset clock signal YCLK is used to intercept the subsequent 16bit data in the target audio data SD1_0, SD2_0, SD1_1, SD2_1, that is, the original audio data ch1:16bit, ch3:16bit, ch5:16bit, ch7:16bit are respectively intercepted , And store the original audio data ch1:16bit in the channel stack corresponding to the right channel of the first second I2S bus interface, and store the original audio data ch3:16bit in the corresponding right sound of the second second I2S bus interface In the channel stack of the channel, store the original audio data ch5:16bit in the channel stack of the third second I2S bus interface corresponding to the right channel, and store the original audio data ch7:16bit in the fourth second I2S bus interface Corresponding to the channel stack of the right channel.
  • the original audio data ch1:16bit, ch3:16bit, ch5:16bit, ch7:16bit are restored.
  • an embodiment of the present application also provides an audio processing device, as shown in FIG. 20, including:
  • the receiving circuit 120 is configured to receive sound source data with multiple channels
  • the initial decoding circuit 130 is used to decode the sound source data to obtain the original audio data corresponding to each channel;
  • the re-encoding circuit 140 is electrically connected to at least two first I2S bus interfaces, and is configured to re-encode the original audio data according to a preset encoding rule, and then output it through at least two first I2S bus interfaces; wherein, the total number of channels It is greater than the total number of channels of all the first I2S bus interfaces.
  • the audio processing device may further include: a re-decoding circuit 150 electrically connected to at least two first I2S bus interfaces 150.
  • the re-decoding circuit 150 is configured to receive the target audio data transmitted by each first I2S bus interface according to the second frame clock and the second bit clock, and re-decode the received data according to a preset encoding rule to obtain each original audio data;
  • the timing of the second frame clock is the same as the timing of the first frame clock
  • the timing of the second bit clock is the same as the timing of the first bit clock
  • the re-decoding circuit 150 transmits the re-decoded original audio data to the multi-channel device 160 through the multiple second I2S bus interfaces 170.
  • the re-decoding circuit 150 may be electrically connected to the multi-channel device 160 through a plurality of second I2S bus interfaces 170.
  • the working principle and specific implementation of the audio processing device are the same as the principles and implementations of the audio processing method in the foregoing embodiment. Therefore, the working method of the audio processing device can refer to the specific implementation of the audio processing method in the foregoing embodiment. Implementation, I will not repeat it here.
  • each of the foregoing circuits may adopt a form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware.
  • the primary decoding circuit may be a decoder capable of realizing its function.
  • the re-encoding circuit may be an encoder capable of realizing its function.
  • the re-decoding circuit can be a decoder or XMOS chip capable of realizing its function.
  • the above-mentioned first I2S bus interface, receiving circuit, initial decoding circuit and re-encoding circuit may form a main chip.
  • an embodiment of the present application also provides a multi-channel system, including a multi-channel device and the audio processing device provided in the embodiment of the present application.
  • the problem-solving principle of the multi-channel system is similar to that of the aforementioned audio processing device. Therefore, the implementation of the multi-channel system can refer to the implementation of the aforementioned audio processing device, and the repetition is not repeated here.
  • the multi-channel device may be any product or component with a display function, such as a television, a notebook computer, etc., which is not limited herein.
  • an embodiment of the application also provides a computer-readable storage medium on which a computer program is stored, and when the program is executed by a processor, it implements any of the audio processing methods provided in the embodiments of the application. step.
  • this application may adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, optical storage, etc.) containing computer-usable program codes.
  • an embodiment of the present application also provides a computer device, including a memory, a processor, and a computer program stored on the memory and running on the processor.
  • the processor executes the program to implement the Steps of any of the above audio processing methods.
  • FIG. 21 is a schematic diagram of a display device provided in Embodiment 1 of the present application.
  • the present application also provides a display device, which at least includes: a display screen 91 configured to present image data; and a speaker 92 configured to reproduce sound data .
  • the display device may further include: a backlight assembly 94 located below the display screen 91.
  • a backlight assembly 94 located below the display screen 91.
  • the backlight assembly may include an LED light bar or a light panel that automatically emits light.
  • the display device may further include: a back plate 95.
  • the back plate 95 is stamped to form some convex structures, and components such as speakers 92 are fixed on the convex structures by screws or hooks.
  • the display device may further include: a rear case 98, which is covered on the back of the display screen 91 to hide the backlight assembly 94, the speaker 92 and other display device components, which has a beautiful effect.
  • the display device may further include: a main board 96 and a power supply board 97, which can be arranged as two boards independently, or they can be combined on one board.
  • the display device further includes a remote control 93.
  • FIG. 22 is a block diagram of the hardware configuration of the display device provided in Embodiment 1 of the present application.
  • the display device 200 may include a tuner and demodulator 220, a communicator 230, a detector 240, an external device interface 250, a controller 210, a memory 290, a user input interface, a video processor 260-1, and audio processing 260-2, display screen 280, audio input interface 272, power supply.
  • the tuner and demodulator 220 which receives broadcast and television signals through wired or wireless means, can perform modulation and demodulation processing such as amplification, mixing and resonance, and is used to demodulate the television channel selected by the user from multiple wireless or cable broadcast and television signals
  • modulation and demodulation processing such as amplification, mixing and resonance
  • the audio and video signals carried in the frequency, and additional information (such as EPG data signals).
  • the tuner and demodulator 220 can be selected by the user and controlled by the controller 210 to respond to the TV channel frequency selected by the user and the TV signal carried by the frequency.
  • the tuner and demodulator 220 can receive signals in many ways according to different TV signal broadcasting systems, such as terrestrial broadcasting, cable broadcasting, satellite broadcasting, or Internet broadcasting; and according to different modulation types, it can be digital modulation or alternatively. Analog modulation method; and according to different types of received TV signals, analog and digital signals can be demodulated.
  • the tuner demodulator 220 may also be in an external device, such as an external set-top box.
  • the set-top box outputs TV audio and video signals through modulation and demodulation, and inputs them to the display device 200 through the input/output interface 250.
  • the communicator 230 is a component for communicating with external devices or external servers according to various communication protocol types.
  • the communicator 230 may include a WIFI module 231, a Bluetooth communication protocol module 232, a wired Ethernet communication protocol module 233 and other network communication protocol modules or near field communication protocol modules.
  • the display device 200 may establish a control signal and a data signal connection with an external control device or content providing device through the communicator 230.
  • the communicator may receive the control signal of the remote controller 100 according to the control of the controller.
  • the detector 240 is a component of the display device 200 for collecting signals from the external environment or interacting with the outside.
  • the detector 240 may include a light receiver 242, a sensor used to collect the intensity of ambient light, which can adaptively display parameter changes by collecting ambient light, etc.; it may also include an image collector 241, such as a camera, a camera, etc., which can be used to collect external Environmental scenes, as well as gestures used to collect user attributes or interact with users, can adaptively change display parameters, and can also recognize user gestures to achieve the function of interaction with users.
  • the detector 240 may further include a temperature sensor.
  • the display device 200 may adaptively adjust the display color temperature of the image.
  • the color temperature of the display device 200 when the temperature is relatively high, the color temperature of the display device 200 can be adjusted to be relatively cool; when the temperature is relatively low, the color temperature of the display device 200 can be adjusted to be relatively warm.
  • the detector 240 may also include a sound collector, such as a microphone, which may be used to receive the user's voice, including the voice signal of the user's control instruction for controlling the display device 200, or to collect environmental sound for Recognizing the environmental scene type, the display device 200 can adapt to the environmental noise.
  • a sound collector such as a microphone
  • the external device interface 250 provides a component for the controller 210 to control data transmission between the display device 200 and other external devices.
  • the external device interface can be connected to external devices such as set-top boxes, game devices, notebook computers, etc. in a wired/wireless manner, and can receive external devices such as video signals (such as moving images), audio signals (such as music), and additional information (such as EPG). ) And other data.
  • the external device interface 250 may include: a high-definition multimedia interface (HDMI) terminal 251, a composite video blanking synchronization (CVBS) terminal 252, an analog or digital component terminal 253, a universal serial bus (USB) terminal 254, red, green, and blue ( RGB) terminal (not shown in the figure) and any one or more.
  • HDMI high-definition multimedia interface
  • CVBS composite video blanking synchronization
  • USB universal serial bus
  • RGB red, green, and blue
  • the controller 210 controls the work of the display device 200 and responds to user operations by running various software control programs (such as an operating system and various application programs) stored on the memory 290.
  • various software control programs such as an operating system and various application programs
  • the controller 210 includes a random access memory RAM 213, a read only memory ROM 214, a graphics processor 216, a CPU processor 212, a communication interface 218, and a communication bus.
  • RAM213 and ROM214, graphics processor 216, CPU processor 212, and communication interface 218 are connected by a bus.
  • the graphics processor 216 is used to generate various graphics objects, such as icons, operation menus, and user input instructions to display graphics. Including an arithmetic unit, which performs operations by receiving various interactive commands input by the user, and displays various objects according to display attributes. As well as including a renderer, various objects obtained based on the arithmetic unit are generated, and the rendering result is displayed on the display screen 280.
  • the CPU processor 212 is configured to execute operating system and application program instructions stored in the memory 290. And according to receiving various interactive instructions input from the outside, to execute various applications, data and content, so as to finally display and play various audio and video content.
  • the CPU processor 212 may include multiple processors.
  • the multiple processors may include one main processor and multiple or one sub-processors.
  • the main processor is used to perform some operations of the display device 200 in the pre-power-on mode, and/or to display images in the normal mode.
  • the communication interface may include the first interface 218-1 to the nth interface 218-n. These interfaces may be network interfaces connected to external devices via a network.
  • the controller 210 may control the overall operation of the display device 200. For example, in response to receiving a user command for selecting a UI object to be displayed on the display screen 280, the controller 210 may perform an operation related to the object selected by the user command.
  • the object may be any one of the selectable objects, such as a hyperlink or an icon.
  • Operations related to the selected object for example: display operations connected to hyperlink pages, documents, images, etc., or perform operations corresponding to the icon.
  • the user command for selecting the UI object may be a command input through various input devices (for example, a mouse, a keyboard, a touch pad, etc.) connected to the display device 200 or a voice command corresponding to the voice spoken by the user.
  • the memory 290 includes storing various software modules for driving and controlling the display device 200.
  • various software modules stored in the memory 290 include: a basic module, a detection module, a communication module, a display control module, a browser module, and various service modules.
  • the basic module is the underlying software module used for signal communication between various hardware in the display device 200 and sending processing and control signals to the upper module.
  • the detection module is a management module used to collect various information from various sensors or user input interfaces, and perform digital-to-analog conversion and analysis management.
  • the voice recognition module includes a voice analysis module and a voice command database module.
  • the display control module is a module for controlling the display screen 280 to display image content, and can be used to play information such as multimedia image content and UI interfaces.
  • the communication module is a module used for control and data communication with external devices.
  • the browser module is a module used to perform data communication between browsing servers.
  • the service module is a module used to provide various services and various applications.
  • the memory 290 is also used to store and receive external data and user data, images of various items in various user interfaces, and visual effect diagrams of focus objects.
  • the user input interface 276 is used to send a user's input signal to the controller 210, or to transmit a signal output from the controller to the user.
  • the control device for example, a mobile terminal or a remote control
  • Controller or, the control device may receive output signals such as audio, video or data output from the user input interface processed by the controller, and display the received output signal or output the received output signal as audio or vibration.
  • the user may input a user command on a graphical user interface (GUI) displayed on the display screen 280, and the user input interface receives the user input command through the graphical user interface (GUI).
  • GUI graphical user interface
  • the user can input a user command by inputting a specific voice or gesture, and the user input interface recognizes the voice or gesture through the sensor to receive the user input command.
  • the video processor 260-1 is used to receive video signals, and perform video data processing such as decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, and image synthesis according to the standard codec protocol of the input signal.
  • the video signal directly displayed or played on the display screen 280.
  • the video processor 260-1 includes a demultiplexing module, a video decoding module, an image synthesis module, a frame rate conversion module, a display formatting module, and the like.
  • the demultiplexing module is used to demultiplex the input audio and video data stream. For example, if MPEG-2 is input, the demultiplexing module will demultiplex into a video signal and an audio signal.
  • the video decoding module is used to process the demultiplexed video signal, including decoding and scaling.
  • An image synthesis module such as an image synthesizer, is used to superimpose and mix the GUI signal generated by the graphics generator with the zoomed video image according to user input or itself to generate an image signal for display.
  • Frame rate conversion module used to convert the frame rate of the input video, such as converting the frame rate of the input 24Hz, 25Hz, 30Hz, 60Hz video to the frame rate of 60Hz, 120Hz or 240Hz, where the input frame rate can be compared with the source
  • the video stream is related, and the output frame rate can be related to the update rate of the display.
  • the input has a usual format, such as frame insertion.
  • the display formatting module is used to change the signal output by the frame rate conversion module into a signal that conforms to a display format such as a display, such as format conversion of the signal output by the frame rate conversion module to output RGB data signals.
  • the display screen 280 is used to receive image signals input from the video processor 260-1, to display video content and images, and a menu control interface.
  • the display screen 280 includes a display screen component for presenting a picture and a driving component for driving image display.
  • the displayed video content can be from the video in the broadcast signal received by the tuner and demodulator 220, or from the video content input by the communicator or the external device interface.
  • the display screen 280 simultaneously displays a user manipulation interface UI generated in the display device 200 and used to control the display device 200.
  • a driving component for driving the display is also included.
  • the display screen 280 is a projection display, it may also include a projection device and a projection screen.
  • the audio processor 260-2 is used to receive audio signals, and perform decompression and decoding according to the standard codec protocol of the input signal, as well as audio data processing such as noise reduction, digital-to-analog conversion, and amplification processing, and the result can be in the speaker 272 The audio signal to be played.
  • the audio output interface 270 is used to receive the audio signal output by the audio processor 260-2 under the control of the controller 210.
  • the audio output interface may include a speaker 272 or output to an external audio output terminal 274 of a generator of an external device, such as : External audio terminal or headphone output terminal, etc.
  • the video processor 260-1 may include one or more chips.
  • the audio processor 260-2 may also include one or more chips.
  • the video processor 260-1 and the audio processor 260-2 may be separate chips, or they may be integrated with the controller 210 in one or more chips.
  • the power supply 275 is used to provide power supply support for the display device 200 with power input from an external power supply under the control of the controller 210.
  • the power supply 275 may include a built-in power supply circuit installed inside the display device 200, or may be a power supply installed outside the display device 200, such as a power interface for providing an external power supply in the display device 200.
  • An embodiment of the present application also provides a display device, including:
  • the display screen is configured to present image data
  • the speaker is configured to reproduce sound data
  • An audio processor configured to receive sound source data having multiple channels, and decode the sound source data to obtain original audio data corresponding to each of the channels;
  • a controller configured to re-encode the original audio data according to a preset encoding rule, and output to the speaker through at least two first I2S bus interfaces;
  • the total number of channels is greater than the total number of channels of all the first I2S bus interfaces.
  • the controller is further configured to determine according to all the original audio data, the total number of channels of all the first I2S bus interfaces, and the communication rules of each channel of the first I2S bus interface The target audio data corresponding to each channel of each of the first I2S bus interface; wherein the data bits of the target audio data are larger than the data bits of the original audio data; the obtained target audio data is passed through the corresponding Channel output of the first I2S bus interface.
  • the controller is further configured to, when determining that the quantity Q of all the original audio data satisfies the formula:, combine the original audio data into one target audio data; where N is a positive even number, M represents the total number of channels of all the first I2S bus interfaces; or,
  • the original audio data selected for splitting includes: blank original audio data.
  • the quantity Q of all the original audio data satisfies the formula: and, then the same number of blank original audio data is added to all the original audio data, and all the original audio data And the generated blank original audio data, select one original audio data to split to generate split audio data; where N is a positive even number, M represents the total number of channels of all the first I2S bus interfaces, and the blank original The data bits of the audio data are the same as the data bits of the original audio data;
  • the original audio data is a digital signal with K data bits
  • one piece of the split audio data is a digital signal with adjacent data bits; where K is a positive integer.
  • changing the sampling number of the first bit clock and/or changing the sampling frequency of the first bit clock starts at the second pulse of the first bit clock after the edge change of the first frame clock
  • the data bits of a single channel are transmitted according to the first bit clock, so that each of the first I2S bus interfaces transmits two channels of target audio data in one cycle of the first frame clock.
  • one cycle of the first bit clock transmits two data bits; or, one cycle of the first bit clock transmits one data bit.

Abstract

Disclosed in the present application are an audio processing method and apparatus, and a display device; sound source data is decoded into original audio data corresponding to each audio channel, and as the total number of audio channels is greater than the total number of channels of all of the first I2S bus interfaces, after the original audio data is re-encoded according to a preset encoding rule, the original audio data of all of the audio channels can be outputted by means of at least two first I2S bus interfaces.

Description

音频处理方法与装置、以及显示设备Audio processing method and device, and display equipment
本专利申请要求于2019年7月9日提交的、申请号为201910614701.7;于2019年7月9日提交的、申请号为201910613160.6;于2019年7月9日提交的、申请号为201910613254.3;于2019年7月9日提交的、申请号为201910615836.5;于2019年7月9日提交的、申请号为201910616404.6;于2019年8月2日提交的、申请号为201910710346.3;于2019年7月9日提交的、申请号为2019106185413;于2019年7月22日提交的、申请号为201910659488.1的中国专利申请的优先权,该申请的全文以引用的方式并入本文中。This patent application requires the application number of 201910614701.7 filed on July 9, 2019; the application number of 201910613160.6 filed on July 9, 2019; the application number of 201910613254.3 filed on July 9, 2019; The application number submitted on July 9, 2019 is 201910615836.5; the application number submitted on July 9, 2019 is 201910616404.6; the application number submitted on August 2, 2019 is 201910710346.3; on July 9, 2019 The priority of the Chinese patent application filed on July 22, 2019 with application number 2019106185413; application number 201910659488.1 filed on July 22, 2019, the full text of which is incorporated herein by reference.
技术领域Technical field
本申请涉及显示技术领域,特别涉及音频处理方法与装置、以及显示设备。This application relates to the field of display technology, in particular to audio processing methods and devices, and display equipment.
背景技术Background technique
为了更好的达到音效的真实饱满,通常采用多声道录制声源文件。然而,在将具有多声道的声源文件进行传输播放时,由于传输条件的限制,导致传输时不能将声源文件中的所有声道传输到功放中,从而导致在播放时不能实现多个声道的输出,进而导致播放效果不佳等问题。In order to better achieve the fullness of sound effects, multi-channel recording of sound source files is usually used. However, when transmitting and playing a sound source file with multiple channels, due to the limitation of the transmission conditions, it is impossible to transmit all the channels in the sound source file to the power amplifier during transmission, which makes it impossible to realize multiple channels during playback. The output of the sound channel, which in turn leads to problems such as poor playback.
申请内容Application content
本申请实施例提供的音频处理方法与装置、以及显示设备,用以提高播放 效果。The audio processing method and device and the display device provided by the embodiments of the present application are used to improve the playback effect.
本申请实施例提供了一种音频处理方法,包括:The embodiment of the application provides an audio processing method, including:
接收具有多个声道的声源数据;Receive sound source data with multiple channels;
将所述声源数据解码出各所述声道对应的原始音频数据;Decoding the sound source data to obtain original audio data corresponding to each of the channels;
根据预设编码规则将所述原始音频数据进行重新编码后,通过至少2个第一I2S总线接口输出;其中,所述声道的总数大于所有所述第一I2S总线接口的通道总数。After re-encoding the original audio data according to a preset encoding rule, it is output through at least two first I2S bus interfaces; wherein the total number of channels is greater than the total number of channels of all the first I2S bus interfaces.
在一些实施例中,在本申请实施例中,所述根据预设编码规则将所述原始音频数据进行重新编码后,通过至少2个第一I2S总线接口输出,包括:In some embodiments, in the embodiments of the present application, after the original audio data is re-encoded according to a preset encoding rule, and then output through at least two first I2S bus interfaces, it includes:
根据所有所述原始音频数据、所有所述第一I2S总线接口的通道总数,以及所述第一I2S总线接口的每个通道的通信规则,确定每个所述第一I2S总线接口的每个通道对应的目标音频数据;其中,所述目标音频数据的数据位大于所述原始音频数据的数据位;Determine each channel of each first I2S bus interface according to all the original audio data, the total number of channels of all the first I2S bus interfaces, and the communication rules of each channel of the first I2S bus interface Corresponding target audio data; wherein the data bits of the target audio data are greater than the data bits of the original audio data;
将得到的所述目标音频数据通过对应的第一I2S总线接口的通道输出。The obtained target audio data is output through the corresponding channel of the first I2S bus interface.
在一些实施例中,在本申请实施例中,所述确定每个所述第一I2S总线接口的每个通道对应的目标音频数据,包括:In some embodiments, in the embodiments of the present application, the determining the target audio data corresponding to each channel of each of the first I2S bus interface includes:
在确定所有所述原始音频数据的数量Q满足公式:时,将个原始音频数据组合为一个所述目标音频数据;其中,N为正偶数,M代表所有所述第一I2S总线接口的通道总数;或者,When determining that the quantity Q of all the original audio data satisfies the formula:, combine the original audio data into one target audio data; where N is a positive even number, and M represents the total number of channels of all the first I2S bus interfaces ;or,
在确定所有所述原始音频数据的数量Q满足公式:时,在所有所述原始音频数据中增加与相同数量的空白原始音频数据,并在所有所述原始音频数据和生成的所述空白原始音频数据中选取个原始音频数据进行拆分,生成拆分音频 数据;其中,N为正偶数,M代表所有所述第一I2S总线接口的通道总数,所述空白原始音频数据的数据位与所述原始音频数据的数据位相同;When it is determined that the quantity Q of all the original audio data satisfies the formula:, add the same amount of blank original audio data to all the original audio data, and add the same amount of blank original audio data to all the original audio data and the generated blank original audio Select one piece of original audio data from the data to split to generate split audio data; where N is a positive even number, M represents the total number of channels of all the first I2S bus interface, and the data bits of the blank original audio data are the same as those of the The data bits of the original audio data are the same;
将个原始音频数据和个拆分音频数据组合为一个所述目标音频数据。Combine pieces of original audio data and pieces of split audio data into one target audio data.
在一些实施例中,在本申请实施例中,选取进行拆分的原始音频数据包括:空白原始音频数据。In some embodiments, in the embodiments of the present application, the original audio data selected for splitting includes: blank original audio data.
在一些实施例中,在本申请实施例中,所述确定每个所述第一I2S总线接口的每个通道对应的目标音频数据,包括:In some embodiments, in the embodiments of the present application, the determining the target audio data corresponding to each channel of each of the first I2S bus interface includes:
在确定所有所述原始音频数据的数量Q满足公式:且时,则在所有所述原始音频数据中增加与相同数量的空白原始音频数据,并在所有所述原始音频数据和生成的所述空白原始音频数据中选取个原始音频数据进行拆分,生成拆分音频数据;其中,N为正偶数,M代表所有所述第一I2S总线接口的通道总数,所述空白原始音频数据的数据位与所述原始音频数据的数据位相同;When it is determined that the quantity Q of all the original audio data satisfies the formula: and, the same number of blank original audio data is added to all the original audio data, and all the original audio data and the generated blank Select one piece of original audio data from the original audio data to split to generate split audio data; where N is a positive even number, M represents the total number of channels of all the first I2S bus interface, and the data bits of the blank original audio data are The data bits of the original audio data are the same;
将个原始音频数据和个拆分音频数据组合为一个所述目标音频数据。Combine pieces of original audio data and pieces of split audio data into one target audio data.
在一些实施例中,在本申请实施例中,所述确定每个所述第一I2S总线接口的每个通道对应的目标音频数据,包括:In some embodiments, in the embodiments of the present application, the determining the target audio data corresponding to each channel of each of the first I2S bus interface includes:
在确定所有所述原始音频数据的数量Q满足公式:时,则在所有所述原始音频数据中选取个原始音频数据进行拆分,生成拆分音频数据;其中,N为正偶数,M代表所有所述第一I2S总线接口的通道总数;When it is determined that the quantity Q of all the original audio data satisfies the formula:, select one original audio data from all the original audio data for splitting to generate split audio data; where N is a positive even number, and M represents all The total number of channels of the first I2S bus interface;
将个原始音频数据和个拆分音频数据拼接为一个所述目标音频数据。Splicing pieces of original audio data and pieces of split audio data into one target audio data.
在一些实施例中,在本申请实施例中,所述原始音频数据为具有K个数据位的数字信号,一个所述拆分音频数据为具有相邻的个数据位的数字信号;其中,K为正整数。In some embodiments, in the embodiments of the present application, the original audio data is a digital signal with K data bits, and one of the split audio data is a digital signal with adjacent data bits; where K Is a positive integer.
在一些实施例中,在本申请实施例中,同一所述第一I2S总线接口对应的两个目标音频数据中的拆分音频数据属于同一原始音频数据。In some embodiments, in the embodiments of the present application, the split audio data in the two target audio data corresponding to the same first I2S bus interface belong to the same original audio data.
在一些实施例中,在本申请实施例中,所述多个声道包括:左声道,右声道,左环绕声道,右环绕声道,左天空声道,右天空声道、中置声道、重低音声道;In some embodiments, in the embodiments of the present application, the multiple channels include: left channel, right channel, left surround channel, right surround channel, left sky channel, right sky channel, middle channel Set channel, subwoofer channel;
选取进行拆分的原始音频数据包括:所述中置声道对应的原始音频数据和所述重低音声道对应的原始音频数据。The original audio data selected for splitting includes: original audio data corresponding to the center channel and original audio data corresponding to the subwoofer channel.
在一些实施例中,在本申请实施例中,所述将得到的所述目标音频数据通过对应的第一I2S总线接口的通道输出,包括:In some embodiments, in the embodiments of the present application, outputting the obtained target audio data through the corresponding channel of the first I2S bus interface includes:
改变第一位时钟的采样位数和/或改变所述第一位时钟的采样频率,在第一帧时钟发生沿变化后的第2个第一位时钟的脉冲开始,按照所述第一位时钟传输单个声道的数据位,使每一个所述第一I2S总线接口在一个所述第一帧时钟的一个周期内传输两个声道的目标音频数据。Change the number of sampling bits of the first bit clock and/or change the sampling frequency of the first bit clock, starting from the second pulse of the first bit clock after the edge change of the first frame clock, according to the first bit clock The clock transmits data bits of a single channel, so that each of the first I2S bus interfaces transmits target audio data of two channels in one cycle of the first frame clock.
在一些实施例中,在本申请实施例中,所述第一位时钟的一个周期传输两个数据位;或者,所述第一位时钟的一个周期传输一个数据位。In some embodiments, in the embodiments of the present application, two data bits are transmitted in one cycle of the first bit clock; or, one data bit is transmitted in one cycle of the first bit clock.
在一些实施例中,在本申请实施例中,所述第一位时钟的采样位数与所述目标音频数据的数据位相同。In some embodiments, in the embodiments of the present application, the sampling bit number of the first bit clock is the same as the data bit of the target audio data.
在一些实施例中,在本申请实施例中,在所述根据预设编码规则将所述原始音频数据进行重新编码后通过至少2个第一I2S总线接口输出之后,还包括:In some embodiments, in the embodiments of the present application, after the original audio data is re-encoded according to a preset encoding rule and then output through at least two first I2S bus interfaces, the method further includes:
根据第二帧时钟和第二位时钟接收各所述第一I2S总线接口传输的目标音频数据,并根据所述预设编码规则将接收的数据进行重新解码,得到各所述原始音频数据;其中,所述第二帧时钟的时序与所述第一帧时钟的时序相同,所 述第二位时钟的时序与所述第一位时钟的时序相同。Receiving the target audio data transmitted by each of the first I2S bus interfaces according to the second frame clock and the second bit clock, and re-decoding the received data according to the preset encoding rule to obtain each of the original audio data; wherein , The timing of the second frame clock is the same as the timing of the first frame clock, and the timing of the second bit clock is the same as the timing of the first bit clock.
在一些实施例中,在本申请实施例中,所述根据第二帧时钟和第二位时钟接收各所述第一I2S总线接口传输的目标音频数据,包括:In some embodiments, in the embodiments of the present application, the receiving target audio data transmitted by each of the first I2S bus interfaces according to the second frame clock and the second bit clock includes:
根据一个所述第二帧时钟和一个所述第二位时钟接收各所述第一I2S总线接口传输的目标音频数据;或者,Receiving the target audio data transmitted by each of the first I2S bus interfaces according to the second frame clock and the second bit clock; or,
根据多个第二帧时钟和多个第二位时钟接收各所述第一I2S总线接口传输的目标音频数据;其中,一个第一I2S总线接口对应一个所述第二帧时钟和一个所述第二位时钟。Receive the target audio data transmitted by each of the first I2S bus interfaces according to multiple second frame clocks and multiple second bit clocks; wherein, one first I2S bus interface corresponds to one second frame clock and one first Two-bit clock.
本申请实施例还提供了一种音频处理装置,包括:An embodiment of the present application also provides an audio processing device, including:
至少2个第一I2S总线接口;At least 2 first I2S bus interfaces;
接收电路,用于接收具有多个声道的声源数据;A receiving circuit for receiving sound source data with multiple channels;
初解码电路,用于将所述声源数据解码出各所述声道对应的原始音频数据;A preliminary decoding circuit, which is used to decode the sound source data to obtain original audio data corresponding to each of the channels;
重编码电路,与所述至少2个第一I2S总线接口电连接,用于根据预设编码规则将所述原始音频数据进行重新编码后,通过至少2个第一I2S总线接口输出;其中,所述声道的总数大于所有所述第一I2S总线接口的通道总数。The re-encoding circuit is electrically connected to the at least two first I2S bus interfaces, and is configured to re-encode the original audio data according to a preset encoding rule, and output it through at least two first I2S bus interfaces; The total number of channels is greater than the total number of channels of all the first I2S bus interfaces.
在一些实施例中,在本申请实施例中,还包括:与所述至少2个第一I2S总线接口电连接的重解码电路;In some embodiments, in the embodiments of the present application, it further includes: a re-decoding circuit electrically connected to the at least two first I2S bus interfaces;
所述重解码电路用于根据第二帧时钟和第二位时钟接收各所述第一I2S总线接口传输的目标音频数据,并根据所述预设编码规则将接收的数据进行重新解码,得到各所述原始音频数据;其中,所述第二帧时钟的时序与所述第一帧时钟的时序相同,所述第二位时钟的时序与所述第一位时钟的时序相同。The re-decoding circuit is used to receive the target audio data transmitted by each of the first I2S bus interfaces according to the second frame clock and the second bit clock, and to re-decode the received data according to the preset encoding rule to obtain each The original audio data; wherein the timing of the second frame clock is the same as the timing of the first frame clock, and the timing of the second bit clock is the same as the timing of the first bit clock.
本申请实施例还提供了一种多声道系统,包括:多声道设备以及上述音频 处理装置。An embodiment of the present application also provides a multi-channel system, including: a multi-channel device and the above audio processing device.
本申请实施例还提供了一种显示设备,包括显示屏,被配置为呈现图像数据;An embodiment of the present application also provides a display device, including a display screen, configured to present image data;
扬声器,被配置为再现声音数据;The speaker is configured to reproduce sound data;
音频处理器,被配置为接收具有多个声道的声源数据,将所述声源数据解码出各所述声道对应的原始音频数据;An audio processor, configured to receive sound source data having multiple channels, and decode the sound source data to obtain original audio data corresponding to each of the channels;
控制器,被配置为根据预设编码规则将所述原始音频数据进行重新编码后,通过至少2个第一I2S总线接口输出给所述扬声器;A controller, configured to re-encode the original audio data according to a preset encoding rule, and output to the speaker through at least two first I2S bus interfaces;
其中,所述声道的总数大于所有所述第一I2S总线接口的通道总数。Wherein, the total number of channels is greater than the total number of channels of all the first I2S bus interfaces.
本申请有益效果如下:The beneficial effects of this application are as follows:
本申请实施例提供的音频处理方法与装置、以及显示设备,通过将声源数据解码出各声道对应的原始音频数据,由于声道的总数大于所有第一I2S总线接口的通道总数,从而根据预设编码规则将原始音频数据进行重新编码后,可以将所有声道的原始音频数据通过至少2个第一I2S总线接口进行输出。这样可以将声源文件中的所有声道对应的原始音频数据均传输到多声道设备中,进而提高多声道设备的播放效果。The audio processing method and device and the display device provided by the embodiments of the application decode the sound source data to obtain the original audio data corresponding to each channel. Since the total number of channels is greater than the total number of channels of all the first I2S bus interfaces, After the original audio data is re-encoded by the preset encoding rule, the original audio data of all channels can be output through at least two first I2S bus interfaces. In this way, the original audio data corresponding to all channels in the sound source file can be transmitted to the multi-channel device, thereby improving the playback effect of the multi-channel device.
附图说明Description of the drawings
图1为本申请实施例提供的I2S总线接口的信号时序图;FIG. 1 is a signal timing diagram of an I2S bus interface provided by an embodiment of the application;
图2为本申请实施例提供的音频处理方法的流程图;2 is a flowchart of an audio processing method provided by an embodiment of the application;
图3为本申请实施例提供的多声道设备的结构示意图;FIG. 3 is a schematic structural diagram of a multi-channel device provided by an embodiment of the application;
图4为本申请实施例提供的原始音频数据的示意图之一;FIG. 4 is one of the schematic diagrams of original audio data provided by an embodiment of this application;
图5为本申请实施例提供的第一I2S总线接口输出数据时的时序示意图之一;FIG. 5 is one of the timing diagrams when the first I2S bus interface provides data output according to an embodiment of the application;
图6为本申请实施例提供的接收第一I2S总线接口输出的数据时的时序示意图之一;FIG. 6 is one of the timing diagrams when receiving data output by the first I2S bus interface according to an embodiment of the application;
图7为本申请实施例提供的截取目标音频数据中的数据时的时序示意图之一;FIG. 7 is one of the schematic diagrams of time sequence when intercepting data in target audio data provided by an embodiment of the application;
图8为本申请实施例提供的原始音频数据的示意图之二;FIG. 8 is the second schematic diagram of original audio data provided by an embodiment of this application;
图9为本申请实施例提供的原始音频数据的示意图之三;FIG. 9 is the third schematic diagram of original audio data provided by an embodiment of this application;
图10为本申请实施例提供的第一I2S总线接口输出数据时的时序示意图之二;FIG. 10 is the second schematic diagram of the time sequence when the first I2S bus interface provides data output according to an embodiment of the application;
图11a为本申请实施例提供的接收第一I2S总线接口输出的数据时的时序示意图之二;FIG. 11a is the second schematic diagram of the time sequence when receiving data output by the first I2S bus interface according to an embodiment of the application; FIG.
图11b为本申请实施例提供的接收第一I2S总线接口输出的数据时的时序示意图之三;FIG. 11b is the third schematic diagram of the time sequence when receiving data output by the first I2S bus interface according to an embodiment of the application;
图11c为本申请实施例提供的接收第一I2S总线接口输出的数据时的时序示意图之四;FIG. 11c is a fourth schematic diagram of a timing sequence when receiving data output by the first I2S bus interface according to an embodiment of the application; FIG.
图12为本申请实施例提供的截取目标音频数据中的数据时的时序示意图之二;FIG. 12 is a second schematic diagram of a time sequence when data in target audio data is intercepted according to an embodiment of the application;
图13a为本申请实施例提供的第一I2S总线接口输出数据时的时序示意图之三;FIG. 13a is the third schematic diagram of the time sequence when the first I2S bus interface provides data output according to an embodiment of the application;
图13b为本申请实施例提供的第一I2S总线接口输出数据时的时序示意图之四;FIG. 13b is a fourth schematic diagram of a timing sequence when the first I2S bus interface provides data output according to an embodiment of the application;
图13c为本申请实施例提供的第一I2S总线接口输出数据时的时序示意图之五;FIG. 13c is the fifth schematic diagram of the time sequence when the first I2S bus interface provides data output according to an embodiment of the application;
图14a为本申请实施例提供的接收第一I2S总线接口输出的数据时的时序示意图之五;FIG. 14a is the fifth schematic diagram of the time sequence when receiving data output by the first I2S bus interface according to an embodiment of the application;
图14b为本申请实施例提供的接收第一I2S总线接口输出的数据时的时序示意图之六;FIG. 14b is a sixth schematic diagram of the timing sequence when receiving data output by the first I2S bus interface according to an embodiment of the application;
图14c为本申请实施例提供的接收第一I2S总线接口输出的数据时的时序示意图之七;FIG. 14c is the seventh schematic diagram of the time sequence when receiving data output by the first I2S bus interface according to an embodiment of the application; FIG.
图15为本申请实施例提供的截取目标音频数据中的数据时的时序示意图之三;15 is the third schematic diagram of the time sequence when intercepting data in target audio data provided by an embodiment of the application;
图16为本申请实施例提供的原始音频数据的示意图之四;16 is the fourth schematic diagram of original audio data provided by an embodiment of this application;
图17为本申请实施例提供的第一I2S总线接口输出数据时的时序示意图之六;FIG. 17 is a sixth schematic diagram of a time sequence when the first I2S bus interface provides data output according to an embodiment of the application;
图18为本申请实施例提供的接收第一I2S总线接口输出的数据时的时序示意图之八;FIG. 18 is the eighth schematic diagram of the time sequence when receiving data output by the first I2S bus interface provided by an embodiment of the application; FIG.
图19为本申请实施例提供的截取目标音频数据中的数据时的时序示意图之四;FIG. 19 is a fourth schematic diagram of a time sequence when data in target audio data is intercepted according to an embodiment of the application;
图20为本申请实施例提供的音频处理装置的结构示意图;FIG. 20 is a schematic structural diagram of an audio processing device provided by an embodiment of the application;
图21是本申请实施例一提供的显示设备示意图;FIG. 21 is a schematic diagram of a display device provided in Embodiment 1 of the present application;
图22是本申请实施例一提供的显示设备的硬件配置框图。FIG. 22 is a block diagram of the hardware configuration of the display device provided in Embodiment 1 of the present application.
具体实施方式Detailed ways
为使本申请实施例的目的、技术方案和优点更加清楚,下面将结合本申请实施例的附图,对本申请实施例的技术方案进行清楚、完整地描述。显然,所描述的实施例是本申请的一部分实施例,而不是全部的实施例。并且在不冲突的情况下,本申请中的实施例及实施例中的特征可以相互组合。基于所描述的本申请的实施例,本领域普通技术人员在无需创造性劳动的前提下所获得的所有其他实施例,都属于本申请保护的范围。In order to make the objectives, technical solutions, and advantages of the embodiments of the present application clearer, the technical solutions of the embodiments of the present application will be described clearly and completely in conjunction with the accompanying drawings of the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all of the embodiments. And if there is no conflict, the embodiments in the present application and the features in the embodiments can be combined with each other. Based on the described embodiments of the application, all other embodiments obtained by a person of ordinary skill in the art without creative labor are within the protection scope of the application.
除非另外定义,本申请使用的技术术语或者科学术语应当为本申请所属领域内具有一般技能的人士所理解的通常意义。本申请中使用的“第一”、“第二”以及类似的词语并不表示任何顺序、数量或者重要性,而只是用来区分不同的组成部分。“包括”或者“包含”等类似的词语意指出现该词前面的元件或者物件涵盖出现在该词后面列举的元件或者物件及其等同,而不排除其他元件或者物件。“连接”或者“相连”等类似的词语并非限定于物理的或者机械的连接,而是可以包括电性的连接,不管是直接的还是间接的。Unless otherwise defined, the technical or scientific terms used in this application shall have the usual meanings understood by those with ordinary skills in the field to which this application belongs. The "first", "second" and similar words used in this application do not denote any order, quantity or importance, but are only used to distinguish different components. "Include" or "include" and other similar words mean that the element or item appearing before the word encompasses the element or item listed after the word and its equivalents, but does not exclude other elements or items. Similar words such as "connected" or "connected" are not limited to physical or mechanical connections, but may include electrical connections, whether direct or indirect.
需要注意的是,附图中各图形的尺寸和形状不反映真实比例,目的只是示意说明本申请内容。并且自始至终相同或类似的标号表示相同或类似的元件或具有相同或类似功能的元件。It should be noted that the size and shape of each figure in the drawings do not reflect the true proportions, and the purpose is only to illustrate the content of this application. And the same or similar reference numerals indicate the same or similar elements or elements with the same or similar functions.
随着显示技术的飞速发展,液晶显示装置(Liquid Crystal Display,LCD)、有机发光二极管(Organic Light Emitting Diode,OLED)显示装置等已经应用于人们的生活中。这些显示装置可以接收视频数据和声源数据,并对这些数据进行处理,以显示图像并输出声音。With the rapid development of display technology, liquid crystal display devices (Liquid Crystal Display, LCD), organic light emitting diode (Organic Light Emitting Diode, OLED) display devices, etc. have been applied to people's lives. These display devices can receive video data and sound source data, and process these data to display images and output sounds.
一般,为了提高体验感,可以使声源数据具有多个声道,例如8声道、9声道、12声道等。示例性地,8声道可以包括:左声道L,右声道R,左环绕 声道SL,右环绕声道SR,左天空声道TOPL,右天空声道TOPR,中置声道center,重低音声道woofer。为了使上述声道可以输出,显示装置可以设置多个扬声器,以使一个扬声器对应播放一个声道的音频。Generally, in order to improve the sense of experience, the sound source data may have multiple channels, such as 8 channels, 9 channels, 12 channels, and so on. Exemplarily, 8 channels may include: left channel L, right channel R, left surround channel SL, right surround channel SR, left sky channel TOPL, right sky channel TOPR, center channel center, Subwoofer channel woofer. In order to enable the output of the aforementioned channels, the display device may be provided with multiple speakers, so that one speaker correspondingly plays one channel of audio.
例如,结合图3所示,显示装置中设置有8个扬声器Y1~Y8,其中,扬声器Y1播放对应左声道L的音频数据,扬声器Y2播放对应右声道R的音频数据,扬声器Y3播放对应左环绕声道SL的音频数据,扬声器Y4播放对应右环绕声道SR的音频数据,扬声器Y5播放对应左天空声道TOPL的音频数据,扬声器Y6播放对应右天空声道TOPR的音频数据,扬声器Y7播放对应中置声道center的音频数据,扬声器Y8播放对应重低音声道woofer的音频数据,以使显示装置作为多声道设备将声源数据的这些声道进行播放。For example, as shown in Figure 3, the display device is provided with 8 speakers Y1 to Y8, wherein the speaker Y1 plays the audio data corresponding to the left channel L, the speaker Y2 plays the audio data corresponding to the right channel R, and the speaker Y3 plays the corresponding audio data. The audio data of the left surround channel SL, the speaker Y4 plays the audio data corresponding to the right surround channel SR, the speaker Y5 plays the audio data corresponding to the left sky channel TOPL, the speaker Y6 plays the audio data corresponding to the right sky channel TOPR, and the speaker Y7 Play the audio data corresponding to the center channel center, and the speaker Y8 plays the audio data corresponding to the subwoofer channel woofer, so that the display device acts as a multi-channel device to play these channels of the sound source data.
一般采用I2S总线接口向作为多声道设备的显示装置传输音频数据。I2S总线接口传输格式的信号无论有多少位有效数据,数据的最高位总是出现在帧时钟WS的发生沿(也就是一帧开始)后的第2个位时钟BCLK脉冲处。这样使得接收端与发送端的有效数据位可以不同。如果接收端能处理的有效数据位少于发送端,可以放弃数据帧中多余的低数据位据;如果接收端能处理的有效数据位多于发送端,可以自行补足剩余的位。这种同步机制使得采用I2S总线接口传输音频数据更加方便,而且不会造成数据错位。Generally, the I2S bus interface is used to transmit audio data to the display device as a multi-channel device. No matter how many bits of valid data are in the signal of the I2S bus interface transmission format, the highest bit of the data always appears at the second bit clock BCLK pulse after the occurrence edge of the frame clock WS (that is, the beginning of a frame). In this way, the effective data bits of the receiving end and the transmitting end can be different. If the receiving end can handle less effective data bits than the sending end, it can give up the excess low data bits in the data frame; if the receiving end can handle more effective data bits than the sending end, it can make up the remaining bits by itself. This synchronization mechanism makes it more convenient to use the I2S bus interface to transmit audio data without causing data misalignment.
然而,多声道设备中处理声源数据的主芯片一般采用2个I2S总线接口或3个I2S总线接口输出音频数据,这样使得在I2S总线接口的通道总数小于音频数据的声道总数时,可能会导致部分声道对应的音频数据在传输时缺失,从而导致传输到多声道设备中的音频数据不完整,降低多声道设备的播放效果。However, the main chip that processes sound source data in a multi-channel device generally uses 2 I2S bus interfaces or 3 I2S bus interfaces to output audio data. This makes it possible when the total number of I2S bus interfaces is less than the total number of audio data channels. This will cause the audio data corresponding to some channels to be missing during transmission, resulting in incomplete audio data transmitted to the multi-channel device, and reducing the playback effect of the multi-channel device.
如图1所示,I2S总线接口的在传输时主要涉及的信号如下:As shown in Figure 1, the main signals involved in the transmission of the I2S bus interface are as follows:
(1)串行时钟BCLK,即位时钟,其对应数字音频信号的每一数据位,BCLK的频率=2×采样频率×采样位数。例如,BCLK的频率=2*48KHz*16bit=1.536MHz。(1) The serial clock BCLK, namely the bit clock, corresponds to each data bit of the digital audio signal, the frequency of BCLK=2×sampling frequency×sampling bits. For example, the frequency of BCLK=2*48KHz*16bit=1.536MHz.
(2)帧时钟WS,用于切换左右声道的数据。例如,WS为“1”表示正在传输的是左声道的数据,WS为“0”则表示正在传输的是右声道的数据。WS的频率等于采样频率。(2) The frame clock WS is used to switch the data of the left and right channels. For example, WS of "1" means that the data of the left channel is being transmitted, and WS of "0" means that the data of the right channel is being transmitted. The frequency of WS is equal to the sampling frequency.
(3)串行数据SDATA,用二进制补码表示的音频数据。(3) Serial data SDATA, audio data expressed in twos complement.
当然,在实际应用中,I2S总线接口在传输时涉及的信号还可以包括一些相关信号,例如:MCLK主时钟(即系统时钟),目的是为了使系统间能够更好地同步,MCLK的频率是采样频率的256倍或384倍,例如48KHz*256=12.288MHz。Of course, in practical applications, the signals involved in the transmission of the I2S bus interface can also include some related signals, for example: MCLK master clock (ie system clock), the purpose is to enable better synchronization between systems, the frequency of MCLK is The sampling frequency is 256 times or 384 times, for example, 48KHz*256=12.288MHz.
结合图1所示,I2S总线接口在传输时,WS=0(WS为低电平信号),表示正在传输的是左声道(Left Channel)的数据。WS=1(WS为高电平信号),表示正在传输的是右声道(Right Channel)的数据。也就是说,一个I2S总线接口具有两个传输音频数据的通道。或者,也可以使WS=1(WS为高电平信号),表示正在传输的是左声道(Left Channel)的数据。WS=0(WS为低电平信号),表示正在传输的是右声道(Right Channel)的数据。当然,在实际应用中,这需要根据实际应用环境来设计确定,在此不作限定。As shown in Figure 1, when the I2S bus interface is transmitting, WS=0 (WS is a low-level signal), indicating that the data of the left channel (Left Channel) is being transmitted. WS=1 (WS is a high-level signal), indicating that the right channel (Right Channel) data is being transmitted. In other words, an I2S bus interface has two channels for transmitting audio data. Alternatively, WS=1 (WS is a high-level signal), indicating that the data of the left channel (Left Channel) is being transmitted. WS=0 (WS is a low-level signal), indicating that the data of the right channel (Right Channel) is being transmitted. Of course, in actual applications, this needs to be designed and determined according to the actual application environment, which is not limited here.
结合图1所示,I2S总线接口的一个通道传输左声道对应的音频数据,另一个通道传输右声道对应的音频数据。并且,WS可以在串行时钟BCLK的上升沿或者下降沿发生改变,并且WS信号不需要一定是对称的。一般,在从属装置端,数据的最高位总是出现在帧时钟WS的下降沿(也就是一帧开始)后的 第2个位时钟BCLK的脉冲处。即WS总是在最高位传输前的一个时钟周期发生改变,这样可以使从属装置得到与被传输的串行数据DATA同步的时间,并且使接收端存储当前的命令以及为下次的命令清除空间。As shown in Figure 1, one channel of the I2S bus interface transmits audio data corresponding to the left channel, and the other channel transmits audio data corresponding to the right channel. Moreover, WS can change on the rising or falling edge of the serial clock BCLK, and the WS signal does not need to be symmetrical. Generally, on the slave device side, the highest bit of data always appears at the second bit clock BCLK pulse after the falling edge of the frame clock WS (that is, the start of a frame). That is, WS always changes one clock cycle before the highest bit transmission, so that the slave device can get the time synchronized with the serial data DATA being transmitted, and the receiving end can store the current command and clear space for the next command .
本申请实施例提供了一种音频处理方法,如图2所示,可以包括如下步骤:The embodiment of the present application provides an audio processing method, as shown in FIG. 2, which may include the following steps:
S100、接收具有多个声道的声源数据;S100. Receive sound source data with multiple channels;
S200、将声源数据解码出各声道对应的原始音频数据;S200: Decode the sound source data to obtain original audio data corresponding to each channel;
S300、根据预设编码规则将原始音频数据进行重新编码后,通过至少2个第一I2S总线接口输出;其中,声道的总数大于所有第一I2S总线接口的通道总数。S300. After re-encoding the original audio data according to a preset encoding rule, it is output through at least two first I2S bus interfaces; wherein the total number of channels is greater than the total number of channels of all first I2S bus interfaces.
本申请实施例提供的音频处理方法,先将声源数据解码出各声道对应的原始音频数据,由于声道的总数大于所有第一I2S总线接口的通道总数,从而根据预设编码规则将原始音频数据进行重新编码后,可以将所有声道的原始音频数据通过至少2个第一I2S总线接口进行输出。这样可以将声源文件中的所有声道对应的原始音频数据均传输到多声道设备中,进而提高多声道设备的播放效果。The audio processing method provided by the embodiment of the application first decodes the sound source data to obtain the original audio data corresponding to each channel. Since the total number of channels is greater than the total number of channels of all the first I2S bus interfaces, the original After the audio data is re-encoded, the original audio data of all channels can be output through at least two first I2S bus interfaces. In this way, the original audio data corresponding to all channels in the sound source file can be transmitted to the multi-channel device, thereby improving the playback effect of the multi-channel device.
下面结合具体实施例,对本申请进行详细说明。需要说明的是,本实施例中是为了更好的解释本申请,但不限制本申请。The application will be described in detail below in conjunction with specific embodiments. It should be noted that the purpose of this embodiment is to better explain the application, but does not limit the application.
在本申请实施例中,根据预设编码规则将原始音频数据进行重新编码后,通过至少2个第一I2S总线接口输出,可以包括:In the embodiment of the present application, after the original audio data is re-encoded according to a preset encoding rule, and outputted through at least two first I2S bus interfaces, it may include:
根据所有原始音频数据、所有第一I2S总线接口的通道总数,以及第一I2S总线接口的每个通道的通信规则,确定每个第一I2S总线接口的每个通道对应的目标音频数据;其中,目标音频数据的数据位大于原始音频数据的数据位;Determine the target audio data corresponding to each channel of each first I2S bus interface according to all the original audio data, the total number of channels of all the first I2S bus interfaces, and the communication rules of each channel of the first I2S bus interface; The data bits of the target audio data are greater than the data bits of the original audio data;
将得到的目标音频数据通过对应的第一I2S总线接口的通道输出。The obtained target audio data is output through the corresponding channel of the first I2S bus interface.
在本申请实施例中,确定每个第一I2S总线接口的每个通道对应的目标音频数据,可以包括:In the embodiment of the present application, determining the target audio data corresponding to each channel of each first I2S bus interface may include:
在确定所有原始音频数据的数量Q满足公式:且时,则在所有原始音频数据中增加与相同数量的空白原始音频数据,并在所有原始音频数据和生成的空白原始音频数据中选取个原始音频数据进行拆分,生成拆分音频数据;其中,N为正偶数,M代表所有第一I2S总线接口的通道总数,空白原始音频数据的数据位与原始音频数据的数据位相同;When it is determined that the quantity Q of all original audio data satisfies the formula: and, then add the same amount of blank original audio data to all original audio data, and select an original audio from all original audio data and the generated blank original audio data Data is split to generate split audio data; where N is a positive even number, M represents the total number of channels of all the first I2S bus interfaces, and the data bits of the blank original audio data are the same as those of the original audio data;
将个原始音频数据和个拆分音频数据组合为一个目标音频数据。The original audio data and the split audio data are combined into one target audio data.
示例性地,在本申请实施例中,可以使第一I2S总线接口为2个,则所有第一I2S总线接口的通道总数为4个,也就是说,M=4。由于声源数据的声道的总数可以大于所有第一I2S总线接口的通道总数,那么可以使声道的总数为5个、6个、8个、12个、16个等,在此不作限定。Exemplarily, in the embodiment of the present application, the number of first I2S bus interfaces may be 2, and the total number of channels of all the first I2S bus interfaces is 4, that is, M=4. Since the total number of channels of the sound source data can be greater than the total number of channels of all the first I2S bus interfaces, the total number of channels can be 5, 6, 8, 12, 16, etc., which are not limited here.
示例性地,在本申请实施例中,也可以使第一I2S总线接口为3个,则所有第一I2S总线接口的通道总数为6个,也就是说,M=6。由于声源数据的声道的总数可以大于所有第一I2S总线接口的通道总数,那么可以使声道的总数为7个、8个、9个、12个、16个、18个、24个等,在此不作限定。Exemplarily, in the embodiment of the present application, the number of first I2S bus interfaces may also be three, and the total number of channels of all the first I2S bus interfaces is 6, that is, M=6. Since the total number of sound source data channels can be greater than the total number of channels of all the first I2S bus interfaces, the total number of channels can be 7, 8, 9, 12, 16, 18, 24, etc. , It is not limited here.
当然,在实际应用中,第一I2S总线接口的数量可以根据实际应用环境来设计确定,在此不作限定。Of course, in actual applications, the number of the first I2S bus interface can be designed and determined according to the actual application environment, which is not limited here.
示例性地,在本申请实施例中,可以使N=2,或者,也可以使N=4,或者,也可以使N=6等。当然,在实际应用中,N的数量可以根据实际应用环境来设计确定,在此不作限定。Illustratively, in the embodiment of the present application, N=2 may be set, or N=4 may be set, or N=6 may also be set. Of course, in actual applications, the number of N can be designed and determined according to the actual application environment, and is not limited here.
一般杜比全景声(Dolby Atmos)5.1.2技术的多声道设备可以实现较佳的音效。示例性地,在具体实施时,在本申请实施例中,多个声道可以包括:左声道,右声道,左环绕声道,右环绕声道,左天空声道,右天空声道、中置声道、重低音声道。这样可以使该声源文件采用杜比全景声(Dolby Atmos)5.1.2技术的多声道设备进行播放。当然,在实际应用中,声道的具体声道可以根据实际应用环境来设计确定,在此不作限定。Generally, Dolby Atmos 5.1.2 technology multi-channel equipment can achieve better sound effects. Exemplarily, during specific implementation, in the embodiment of the present application, multiple channels may include: left channel, right channel, left surround channel, right surround channel, left sky channel, right sky channel , Center channel, subwoofer channel. In this way, the sound source file can be played using a multi-channel device with Dolby Atmos 5.1.2 technology. Of course, in actual applications, the specific sound channels of the sound channels can be designed and determined according to the actual application environment, which is not limited here.
示例性地,在本申请实施例中,选取进行拆分的原始音频数据包括:中置声道对应的原始音频数据和重低音声道对应的原始音频数据。这样在后续解码时再将拆分后的数据进行拼接,从而得到中置声道对应的原始音频数据和重低音声道对应的原始音频数据。Exemplarily, in the embodiment of the present application, the original audio data selected for splitting includes: original audio data corresponding to the center channel and original audio data corresponding to the subwoofer channel. In this way, the split data is spliced during subsequent decoding, so as to obtain the original audio data corresponding to the center channel and the original audio data corresponding to the subwoofer channel.
一般在多声道设备播放声音时,中置声道和重低音声道对播放效果的影响较小。并且一般传输过程中可能对拆分的数据造成影响,不利于后续的解码拼接。本申请实施例通过将中置声道对应的原始音频数据和重低音声道对应的原始音频数据进行拆分,在传输过程中对拆分的数据造成影响时,后续虽然可能解码不出中置声道对应的原始音频数据和重低音声道对应的原始音频数据,但是其对多声道设备的播放效果影响也较小。Generally, when playing sound on a multi-channel device, the center channel and the subwoofer channel have less influence on the playback effect. In addition, the split data may be affected during the general transmission process, which is not conducive to subsequent decoding and splicing. The embodiment of this application splits the original audio data corresponding to the center channel and the original audio data corresponding to the subwoofer channel. When the split data is affected during the transmission process, the center channel may not be decoded later. The original audio data corresponding to the sound channel and the original audio data corresponding to the subwoofer sound channel have little impact on the playback effect of the multi-channel device.
一般数码录音通常使用16比特(bit)、20bit或24bit的二进制补码制作音乐的声源文件。示例性地,在具体实施时,在本申请实施例中,可以使原始音频数据为具有K个数据位的数字信号。示例性地,可以使原始音频数据为16比特(即K=16)、20比特(即K=20)或24比特(即K=24)等数据位的二进制的数字信号。Generally, digital recording usually uses 16-bit (bit), 20-bit or 24-bit two's complement to make music sound source files. Exemplarily, during specific implementation, in the embodiment of the present application, the original audio data may be a digital signal with K data bits. Exemplarily, the original audio data may be a binary digital signal with data bits such as 16 bits (ie K=16), 20 bits (ie K=20), or 24 bits (ie K=24).
示例性地,在本申请实施例中,可以使一个拆分音频数据为具有相邻的个 数据位的数字信号;其中,K为正整数。示例性地,以K=16为例,例如为原始音频数据为0100 0010 0001 1101的数字信号,则可以将该原始音频数据按照相邻的8个数据位进行拆分,从而拆分为两个拆分音频数据:一个拆分音频数据为0100 0010,另一个拆分音频数据为0001 1101。Exemplarily, in the embodiment of the present application, one piece of split audio data can be a digital signal with adjacent data bits; where K is a positive integer. Exemplarily, taking K=16 as an example, for example, if the original audio data is a digital signal of 0100 0010 0001 1101, the original audio data can be split according to the adjacent 8 data bits, thereby splitting into two Split audio data: One split audio data is 0100 0010, and the other split audio data is 0001 1101.
示例性地,如图4所示,使原始音频数据ch6:16bit生成拆分音频数据ch6:high 8bit、ch6:low 8bit;使原始音频数据ch7:16bit生成拆分音频数据ch7:high 8bit、ch7:low 8bit;使空白原始音频数据ch8:16bit生成拆分音频数据ch8:high 8bit、ch8:low 8bit。Exemplarily, as shown in Figure 4, the original audio data ch6: 16bit is used to generate split audio data ch6: high 8bit, ch6: low 8bit; the original audio data ch7: 16bit is generated to generate split audio data ch7: high 8bit, ch7 :low 8bit; Use blank original audio data ch8:16bit to generate split audio data ch8:high 8bit, ch8:low 8bit.
需要说明的是,空白原始音频数据不携带声源的音频信息,其可以是采用“0”形成的数据。例如,原始音频数据为0100 0010 0001 1101的数字信号,则可以使空白原始音频数据为0000 0000 0000 0000的数字信号。It should be noted that the blank original audio data does not carry audio information of the sound source, and it may be data formed by using "0". For example, if the original audio data is a digital signal of 0100 0010 0001 1101, the blank original audio data can be a digital signal of 0000 0000 0000 0000.
为了提高传输的稳定性,以及降低后序解码的时间,提高后序解码的效率,在本申请实施例中,可以使同一第一I2S总线接口对应的两个目标音频数据中的拆分音频数据属于同一原始音频数据。In order to improve the stability of transmission, reduce the time of subsequent decoding, and improve the efficiency of subsequent decoding, in the embodiment of the present application, the split audio data in the two target audio data corresponding to the same first I2S bus interface can be used Belong to the same original audio data.
在本申请实施例中,将得到的目标音频数据通过对应的第一I2S总线接口的通道输出,可以包括:In the embodiment of the present application, outputting the obtained target audio data through the corresponding channel of the first I2S bus interface may include:
改变第一位时钟的采样位数,在第一帧时钟发生沿变化后的第2个第一位时钟的脉冲开始,按照第一位时钟传输单个声道的数据位,使每一个第一I2S总线接口在一个第一帧时钟的一个周期内传输两个声道的目标音频数据。Change the number of sampling bits of the first bit clock, start with the second pulse of the first bit clock after the edge change of the first frame clock, transmit the data bits of a single channel according to the first bit clock, so that each first I2S The bus interface transmits the target audio data of two channels in one cycle of a first frame clock.
示例性地,在本申请实施例中,第一位时钟的一个周期传输一个数据位。也就是说,第一位时钟采用单沿采样。例如,采用每一个周期的上升沿或下降沿采样一个数据位。Exemplarily, in the embodiment of the present application, one data bit is transmitted in one cycle of the first bit clock. In other words, the first bit clock uses single edge sampling. For example, use the rising or falling edge of each cycle to sample one data bit.
示例性地,在本申请实施例中,第一位时钟的一个周期传输两个数据位。也就是说,第一位时钟采用双沿采样。例如,采用每一个周期的上升沿和下降沿分别采样一个数据位。Exemplarily, in the embodiment of the present application, two data bits are transmitted in one cycle of the first bit clock. In other words, the first bit clock uses double-edge sampling. For example, use the rising and falling edges of each cycle to sample one data bit.
示例性地,在本申请实施例中,可以使第一位时钟的采样位数与目标音频数据的数据位相同。Exemplarily, in the embodiment of the present application, the sampling bit number of the first bit clock may be the same as the data bit of the target audio data.
在本申请实施例中,在根据预设编码规则将原始音频数据进行重新编码后通过至少2个第一I2S总线接口输出之后,还可以包括:In the embodiment of the present application, after the original audio data is re-encoded according to a preset encoding rule and then output through at least two first I2S bus interfaces, it may further include:
根据第二帧时钟和第二位时钟接收各第一I2S总线接口传输的目标音频数据,并根据预设编码规则将接收的数据进行重新解码,得到各原始音频数据;其中,第二帧时钟的时序与第一帧时钟的时序相同,第二位时钟的时序与第一位时钟的时序相同。这样可以稳定接收各第一I2S总线接口传输的目标音频数据。并还原出原始音频数据。Receive the target audio data transmitted by each first I2S bus interface according to the second frame clock and the second bit clock, and re-decode the received data according to the preset encoding rules to obtain the original audio data; among them, the second frame clock The timing is the same as the timing of the first frame clock, and the timing of the second bit clock is the same as the timing of the first bit clock. In this way, the target audio data transmitted by each first I2S bus interface can be stably received. And restore the original audio data.
在本申请实施例中,根据第二帧时钟和第二位时钟接收各第一I2S总线接口传输的目标音频数据,可以包括:可以根据一个第二帧时钟和一个第二位时钟接收各第一I2S总线接口传输的目标音频数据。这样可以降低输出的第二帧时钟和第二位时钟的信号数量。In the embodiment of the present application, receiving the target audio data transmitted by each first I2S bus interface according to the second frame clock and the second bit clock may include: receiving each first frame clock according to a second frame clock and a second bit clock. Target audio data transmitted by the I2S bus interface. This can reduce the number of output signals of the second frame clock and the second bit clock.
在本申请实施例中,根据第二帧时钟和第二位时钟接收各第一I2S总线接口传输的目标音频数据,也可以包括:根据多个第二帧时钟和多个第二位时钟接收各第一I2S总线接口传输的目标音频数据;其中,一个第一I2S总线接口对应一个第二帧时钟和一个第二位时钟。这样可以独立的接收每个第一I2S总线接口传输的目标音频数据,从而避免传输干扰,提高传输稳定性。In the embodiment of the present application, receiving the target audio data transmitted by each first I2S bus interface according to the second frame clock and the second bit clock may also include: receiving each data according to multiple second frame clocks and multiple second bit clocks. The target audio data transmitted by the first I2S bus interface; wherein, one first I2S bus interface corresponds to a second frame clock and a second bit clock. In this way, the target audio data transmitted by each first I2S bus interface can be received independently, thereby avoiding transmission interference and improving transmission stability.
示例性地,在本申请实施例中,可以使目标音频数据的数据位最多为第一 I2S总线接口的一个通道最多可传输的数据位。例如,一般第一I2S总线接口的一个通道可以传输32bit的数据,则可以使目标音频数据的数据位最多为32bit。Exemplarily, in the embodiment of the present application, the data bits of the target audio data may be at most the data bits that can be transmitted in one channel of the first I2S bus interface. For example, generally one channel of the first I2S bus interface can transmit 32 bits of data, and the data bits of the target audio data can be at most 32 bits.
示例性地,在本申请实施例中,在根据预设编码规则将接收的数据进行重新解码,得到各原始音频数据之后,还可以包括:将得到的各原始音频数据采用多个第二I2S总线接口输出给多声道设备;其中,第二I2S总线接口的数量为所有声道的二分之一。也就是说,一个第二I2S总线接口对应两个原始音频数据。Exemplarily, in the embodiment of the present application, after re-decoding the received data according to a preset encoding rule to obtain each original audio data, it may further include: using multiple second I2S buses for each obtained original audio data The interface is output to a multi-channel device; among them, the number of the second I2S bus interface is one-half of all channels. In other words, one second I2S bus interface corresponds to two original audio data.
下面结合图4至图7,以原始音频数据为16比特,以及第一I2S总线接口为3个为例,通过具体实施例对本申请提供的音频处理方法进行说明。但读者应知,其具体过程不局限于此。其中,这3个第一I2S总线接口分别为I2S_0、I2S_1、I2S_2。图5和图6仅是以目标音频数据SD1_0和目标音频数据SD2_0的传输过程为例进行说明的。In the following, with reference to FIG. 4 to FIG. 7, taking the original audio data of 16 bits and the first I2S bus interface as an example, the audio processing method provided by the present application will be described through specific embodiments. However, readers should know that the specific process is not limited to this. Among them, the three first I2S bus interfaces are I2S_0, I2S_1, and I2S_2 respectively. FIG. 5 and FIG. 6 only take the transmission process of the target audio data SD1_0 and the target audio data SD2_0 as an example for description.
本申请实施例提供的音频处理方法,可以包括如下步骤:The audio processing method provided by the embodiments of the present application may include the following steps:
(1)接收具有左声道,右声道,左环绕声道,右环绕声道,左天空声道,右天空声道、中置声道、重低音声道的声源数据。其中,该声源数据可以是USB存储介质中存储的,也可以为直接通过网络获取的。(1) Receive sound source data with left channel, right channel, left surround channel, right surround channel, left sky channel, right sky channel, center channel, and subwoofer channel. Wherein, the sound source data may be stored in a USB storage medium, or directly obtained through the network.
(2)将声源数据解码出各声道对应的原始音频数据。其中,可以采用现有的任意解码方式将声源数据进行解码,以解码出各声道对应的原始音频数据。(2) Decode the sound source data to obtain the original audio data corresponding to each channel. Among them, any existing decoding method can be used to decode the sound source data to decode the original audio data corresponding to each channel.
例如,结合图4所示,可以解码出左声道对应的16bit的原始音频数据ch0:16bit,右声道对应的16bit的原始音频数据ch1:16bit,左环绕声道对应的16bit的原始音频数据ch2:16bit,右环绕声道对应的16bit的原始音频数据ch3:16bit,左天空声道对应的16bit的原始音频数据ch4:16bit,右天空声道对 应的16bit的原始音频数据ch5:16bit、中置声道对应的16bit的原始音频数据ch6:16bit、以及重低音声道对应的16bit的原始音频数据ch7:16bit。For example, in conjunction with Figure 4, you can decode the 16bit original audio data ch0:16bit corresponding to the left channel, the 16bit original audio data ch1:16bit corresponding to the right channel, and the 16bit original audio data corresponding to the left surround channel. ch2:16bit, the 16bit original audio data corresponding to the right surround channel ch3:16bit, the 16bit original audio data corresponding to the left sky channel ch4:16bit, the 16bit original audio data corresponding to the right sky channel ch5:16bit, middle 16bit original audio data ch6:16bit corresponding to the set channel and 16bit original audio data ch7:16bit corresponding to the subwoofer channel.
(3)所有原始音频数据的数量为8个,即Q=8,所有第一I2S总线接口的通道总数为6,即M=6。则N=2。(3) The number of all original audio data is 8, that is, Q=8, and the total number of channels of all the first I2S bus interfaces is 6, that is, M=6. Then N=2.
结合图4所示,在所有原始音频数据中增加1个空白原始音频数据ch8:16bit,这样可以在所有原始音频数据和生成的空白原始音频数据中,选取中置声道对应的16bit的原始音频数据ch6:16bit、重低音声道对应的16bit的原始音频数据ch7:16bit、以及空白原始音频数据ch8:16bit共3个原始音频数据进行拆分,使原始音频数据ch6:16bit生成拆分音频数据ch6:high 8bit、ch6:low 8bit;使原始音频数据ch7:16bit生成拆分音频数据ch7:high 8bit、ch7:low 8bit;使空白原始音频数据ch8:16bit生成拆分音频数据ch8:high 8bit、ch8:low 8bit。As shown in Figure 4, add 1 blank original audio data ch8:16bit to all original audio data, so that the 16bit original audio corresponding to the center channel can be selected from all the original audio data and the generated blank original audio data The data ch6:16bit, the 16bit original audio data ch7:16bit corresponding to the subwoofer channel, and the blank original audio data ch8:16bit are divided into 3 original audio data, so that the original audio data ch6:16bit generates the split audio data ch6: high 8bit, ch6: low 8bit; make the original audio data ch7: 16bit generate split audio data ch7: high 8bit, ch7: low 8bit; make blank original audio data ch8: 16bit generate split audio data ch8: high 8bit, ch8:low 8bit.
(4)结合图4与图5所示,将原始音频数据ch0:16bit与拆分音频数据ch6:high 8bit拼接为目标音频数据SD1_0,将原始音频数据ch1:16bit与拆分音频数据ch6:low 8bit拼接为目标音频数据SD2_0,将原始音频数据ch2:16bit与拆分音频数据ch7:high 8bit拼接为目标音频数据SD1_1,将原始音频数据ch3:16bit与拆分音频数据ch7:low 8bit拼接为目标音频数据SD2_1,将原始音频数据ch4:16bit与拆分音频数据ch8:high 8bit拼接为目标音频数据SD1_2,将原始音频数据ch5:16bit与拆分音频数据ch8:low 8bit拼接为目标音频数据SD2_2。(4) As shown in Figure 4 and Figure 5, the original audio data ch0: 16bit and the split audio data ch6: high 8bit are spliced into the target audio data SD1_0, and the original audio data ch1: 16bit and the split audio data ch6: low 8bit is spliced into target audio data SD2_0, original audio data ch2:16bit and split audio data ch7:high 8bit are spliced into target audio data SD1_1, original audio data ch3:16bit and split audio data ch7:low 8bit are spliced into target Audio data SD2_1, splicing original audio data ch4:16bit and split audio data ch8:high 8bit into target audio data SD1_2, splicing original audio data ch5:16bit and split audio data ch8:low 8bit into target audio data SD2_2.
(5)结合图4与图5所示,一个目标音频数据的数据位由原始音频数据的16bit改变为24bit,因此可以改变第一位时钟BCLK1的采样位数,使第一位时钟BCLK1的采样位数与一个目标音频数据的数据位相同。并且,在第一位时钟 BCLK1的每一个周期内的上升沿传输一个数据位。(5) As shown in Figure 4 and Figure 5, the data bit of a target audio data is changed from 16bit of the original audio data to 24bit, so the number of sampling bits of the first clock BCLK1 can be changed, so that the sampling of the first clock BCLK1 The number of bits is the same as that of a target audio data. In addition, one data bit is transmitted on the rising edge of each cycle of the first bit clock BCLK1.
在WS1=0时,控制第一I2S总线接口I2S_0对应左声道的通道传输目标音频数据SD1_0。具体地,在第一帧时钟WS1下降沿后的第2个第一位时钟BCLK1开始,按照第一位时钟BCLK1传输目标音频数据SD1_0,使目标音频数据SD1_0采用第一I2S总线接口I2S_0的左声道对应的通道输出。其中,在传输目标音频数据SD1_0时,先从最高位开始依次传输原始音频数据ch0:16bit,之后再从最高位开始依次传输拆分音频数据ch6:high 16bit。When WS1=0, the channel of the first I2S bus interface I2S_0 corresponding to the left channel is controlled to transmit the target audio data SD1_0. Specifically, starting from the second first bit clock BCLK1 after the falling edge of the first frame clock WS1, the target audio data SD1_0 is transmitted according to the first bit clock BCLK1, so that the target audio data SD1_0 adopts the left sound of the first I2S bus interface I2S_0 Channel output corresponding to the channel. Among them, when transmitting the target audio data SD1_0, the original audio data ch0: 16bit is transmitted sequentially from the highest bit, and then the split audio data ch6: high 16bit is sequentially transmitted from the highest bit.
在WS1=1时,控制第一I2S总线接口I2S_0对应右声道的通道传输目标音频数据SD2_0。具体地,在第一帧时钟WS1上升沿后的第2个第一位时钟BCLK1开始,按照第一位时钟BCLK1传输目标音频数据SD2_0,使目标音频数据SD2_0采用第一I2S总线接口I2S_0的右声道对应的通道输出。其中,在传输目标音频数据SD2_0时,先从最高位开始依次传输原始音频数据ch1:16bit,之后再从最高位开始依次传输拆分音频数据ch6:low 16bit。When WS1=1, the channel of the first I2S bus interface I2S_0 corresponding to the right channel is controlled to transmit the target audio data SD2_0. Specifically, starting from the second first bit clock BCLK1 after the rising edge of the first frame clock WS1, the target audio data SD2_0 is transmitted according to the first bit clock BCLK1, so that the target audio data SD2_0 adopts the right sound of the first I2S bus interface I2S_0 Channel output corresponding to the channel. Among them, when transmitting the target audio data SD2_0, the original audio data ch1: 16bit is transmitted sequentially from the highest bit, and then the split audio data ch6: low 16bit is sequentially transmitted from the highest bit.
同理,在WS1=0时,控制第一I2S总线接口I2S_1对应左声道的通道传输目标音频数据SD1_1。在WS1=1时,控制第一I2S总线接口I2S_1对应右声道的通道传输目标音频数据SD2_1。Similarly, when WS1=0, the channel of the first I2S bus interface I2S_1 corresponding to the left channel is controlled to transmit the target audio data SD1_1. When WS1=1, the channel of the first I2S bus interface I2S_1 corresponding to the right channel is controlled to transmit the target audio data SD2_1.
并且,在WS1=0时,控制第一I2S总线接口I2S_2对应左声道的通道传输目标音频数据SD1_2。在WS1=1时,控制第一I2S总线接口I2S_2对应右声道的通道传输目标音频数据SD2_2。In addition, when WS1=0, the channel of the first I2S bus interface I2S_2 corresponding to the left channel is controlled to transmit the target audio data SD1_2. When WS1=1, the channel of the first I2S bus interface I2S_2 corresponding to the right channel is controlled to transmit the target audio data SD2_2.
(6)结合图4至图6所示,控制第二帧时钟WS2的时序与第一帧时钟WS1的时序相同,第二位时钟BCLK2的时序与第一位时钟BCLK1的时序相同。(6) As shown in FIG. 4 to FIG. 6, the timing of controlling the second frame clock WS2 is the same as that of the first frame clock WS1, and the timing of the second bit clock BCLK2 is the same as that of the first bit clock BCLK1.
根据第二帧时钟WS2和第二位时钟BCLK2,控制接收第一I2S总线接口 I2S_0传输的目标音频数据SD1_0和SD2_0,控制接收第一I2S总线接口I2S_1传输的目标音频数据SD1_1和SD2_1,以及控制接收第一I2S总线接口I2S_2传输的目标音频数据SD1_2和SD2_2。According to the second frame clock WS2 and the second bit clock BCLK2, control to receive the target audio data SD1_0 and SD2_0 transmitted by the first I2S bus interface I2S_0, control to receive the target audio data SD1_1 and SD2_1 transmitted by the first I2S bus interface I2S_1, and control the reception The target audio data SD1_2 and SD2_2 transmitted by the first I2S bus interface I2S_2.
并根据上述预设编码规则,采用预设时钟信号YCLK分别截取目标音频数据SD1_0、SD2_0、SD1_1、SD2_1、SD1_2以及SD2_2中的前16bit的数据,即分别截取到原始音频数据ch0:16bit、ch1:16bit、ch2:16bit、ch3:16bit、ch4:16bit、ch5:16bit,并将原始音频数据ch0:16bit和ch1:16bit分别存放在第一个第二I2S总线接口的对应左声道的通道堆栈中和对应右声道的通道堆栈中,将原始音频数据ch2:16bit和ch3:16bit分别存放在第二个第二I2S总线接口的对应左声道的通道堆栈中和对应右声道的通道堆栈中,以及将原始音频数据ch4:16bit和ch5:16bit分别存放在第三个第二I2S总线接口的对应左声道的通道堆栈中和对应右声道的通道堆栈中,从而还原出来原始音频数据ch0:16bit、ch1:16bit、ch2:16bit、ch3:16bit、ch4:16bit、ch5:16bit。And according to the above preset coding rules, the preset clock signal YCLK is used to intercept the first 16bit data of the target audio data SD1_0, SD2_0, SD1_1, SD2_1, SD1_2, and SD2_2 respectively, that is, to intercept the original audio data ch0:16bit, ch1: 16bit, ch2:16bit, ch3:16bit, ch4:16bit, ch5:16bit, and store the original audio data ch0:16bit and ch1:16bit in the channel stack corresponding to the left channel of the first and second I2S bus interface respectively And in the channel stack corresponding to the right channel, the original audio data ch2:16bit and ch3:16bit are respectively stored in the channel stack corresponding to the left channel and the channel stack corresponding to the right channel of the second I2S bus interface , And store the original audio data ch4:16bit and ch5:16bit respectively in the channel stack corresponding to the left channel and the channel stack corresponding to the right channel of the third second I2S bus interface, so as to restore the original audio data ch0 : 16bit, ch1: 16bit, ch2: 16bit, ch3: 16bit, ch4: 16bit, ch5: 16bit.
之后分别截取目标音频数据SD1_0、SD2_0、SD1_1以及SD2_1中的后8bit数据,在目标音频数据SD1_0中的后8bit数据之后拼接目标音频数据SD2_0中的后8bit数据,以拼接还原出原始音频数据ch6:16bit,并将还原出的原始音频数据ch6:16bit存放在第四个第二I2S总线接口的对应左声道的通道堆栈中。在目标音频数据SD1_1中的后8bit数据之后拼接目标音频数据SD2_1中的后8bit数据,以拼接还原出原始音频数据ch7:16bit,并将还原出的原始音频数据ch7:16bit存放在第四个第二I2S总线接口的对应右声道的通道堆栈中。从而还原出来原始音频数据ch6:16bit、ch7:16bit。Then intercept the last 8bit data in the target audio data SD1_0, SD2_0, SD1_1, and SD2_1 respectively, and splice the last 8bit data in the target audio data SD2_0 after the last 8bit data in the target audio data SD1_0 to restore the original audio data ch6 by splicing: 16bit, and store the restored original audio data ch6:16bit in the channel stack corresponding to the left channel of the fourth second I2S bus interface. Splice the last 8bit data in the target audio data SD2_1 after the last 8bit data in the target audio data SD1_1 to restore the original audio data ch7:16bit by splicing, and store the restored original audio data ch7:16bit in the fourth Two I2S bus interface corresponding to the channel stack of the right channel. Thereby, the original audio data ch6:16bit and ch7:16bit are restored.
之后,可以将还原出来的原始音频数据采用这些第二I2S总线接口输出给 多声道设备中的功放装置中,以通过功放装置驱动扬声器发声。After that, the restored original audio data can be output to the power amplifier device in the multi-channel device through these second I2S bus interfaces, so as to drive the speaker to sound through the power amplifier device.
需要说明的是,预设时钟信号可以为预设存储的时钟信号。并且,预设时钟信号的周期可以与位时钟的周期相同。在实际应用中,预设时钟信号可以根据实际应用环境来设计其频率,在此不作赘述。It should be noted that the preset clock signal may be a preset stored clock signal. Also, the period of the preset clock signal may be the same as the period of the bit clock. In actual applications, the frequency of the preset clock signal can be designed according to the actual application environment, which is not repeated here.
需要说明的是,由于目标音频数据SD1_2和SD2_2中的后8bit数据是采用空白原始音频数据进行拆分得到的,其不是声源数据中携带的,因此可以将目标音频数据SD1_2和SD2_2中的后8bit数据直接进行删除。It should be noted that since the last 8bit data in the target audio data SD1_2 and SD2_2 is obtained by splitting blank original audio data, it is not carried in the sound source data, so the last 8bit data in the target audio data SD1_2 and SD2_2 can be 8bit data is deleted directly.
通过上述实施例可以看出,在I2S总线接口为3个时,可以传输具有大于6个声道的声源数据,从而可以将声源文件中的所有声道对应的原始音频数据均传输到多声道设备中,进而提高多声道设备的播放效果。It can be seen from the above embodiment that when there are 3 I2S bus interfaces, sound source data with more than 6 channels can be transmitted, so that the original audio data corresponding to all channels in the sound source file can be transmitted to multiple In the channel device, the playback effect of the multi-channel device is further improved.
当然,也可以先将接收到的目标音频数据SD1_0~SD2_2先进行缓存,然后再根据上述实施方式,采用预设时钟信号YCLK分别进行截取。具体实施方式可以参照上述实施例,在此不作赘述。Of course, the received target audio data SD1_0 to SD2_2 can also be buffered first, and then the preset clock signal YCLK is used for intercepting respectively according to the foregoing embodiment. For specific implementation manners, reference may be made to the above-mentioned embodiments, which will not be repeated here.
在一些实施例中,确定每个第一I2S总线接口的每个通道对应的目标音频数据,也可以包括:In some embodiments, determining the target audio data corresponding to each channel of each first I2S bus interface may also include:
在确定所有原始音频数据的数量Q满足公式:时,则在所有原始音频数据中选取个原始音频数据进行拆分,生成拆分音频数据;其中,N为正偶数,M代表所有第一I2S总线接口的通道总数;When it is determined that the quantity Q of all original audio data satisfies the formula:, select one original audio data from all the original audio data to split to generate split audio data; where N is a positive even number, and M represents all first I2S buses The total number of channels of the interface;
将个原始音频数据和个拆分音频数据拼接为一个目标音频数据。The original audio data and the split audio data are spliced into one target audio data.
下面结合图5至图8,以原始音频数据为16比特,以及第一I2S总线接口为3个为例,通过具体实施例对本申请提供的音频处理方法进行说明。但读者应知,其具体过程不局限于此。其中,这3个第一I2S总线接口分别为I2S_0、 I2S_1、I2S_2。In the following, with reference to FIGS. 5 to 8, taking the original audio data of 16 bits and the first I2S bus interface as an example, the audio processing method provided by the present application will be described through specific embodiments. However, readers should know that the specific process is not limited to this. Among them, the three first I2S bus interfaces are I2S_0, I2S_1, and I2S_2 respectively.
本申请实施例提供的音频处理方法,可以包括如下步骤:The audio processing method provided by the embodiments of the present application may include the following steps:
(1)接收至少包括右声道,左环绕声道,右环绕声道,左天空声道,右天空声道、中置声道、重低音声道以及第九声道共9个声道的声源数据。(1) Receive at least 9 channels including right channel, left surround channel, right surround channel, left sky channel, right sky channel, center channel, subwoofer channel and ninth channel Sound source data.
(2)将声源数据进行解码,以解码出左声道对应的16bit的原始音频数据ch0:16bit,右声道对应的16bit的原始音频数据ch1:16bit,左环绕声道对应的16bit的原始音频数据ch2:16bit,右环绕声道对应的16bit的原始音频数据ch3:16bit,左天空声道对应的16bit的原始音频数据ch4:16bit,右天空声道对应的16bit的原始音频数据ch5:16bit、中置声道对应的16bit的原始音频数据ch6:16bit、重低音声道对应的16bit的原始音频数据ch7:16bit、以及第九声道对应的16bit的原始音频数据ch9:16bit。(2) Decode the sound source data to decode the 16bit original audio data ch0: 16bit corresponding to the left channel, the 16bit original audio data ch1: 16bit corresponding to the right channel, and the 16bit original audio data corresponding to the left surround channel. Audio data ch2: 16bit, 16bit original audio data corresponding to the right surround channel ch3: 16bit, 16bit original audio data corresponding to the left sky channel ch4: 16bit, 16bit original audio data corresponding to the right sky channel ch5: 16bit , 16bit original audio data ch6:16bit corresponding to the center channel, 16bit original audio data ch7:16bit corresponding to the subwoofer channel, and 16bit original audio data ch9:16bit corresponding to the ninth channel.
(3)所有原始音频数据的数量为9个,即Q=9,所有第一I2S总线接口的通道总数为6,即M=6。则N=2。结合图8所示,可以直接在所有原始音频数据中选取中置声道对应的16bit的原始音频数据ch6:16bit、重低音声道对应的16bit的原始音频数据ch7:16bit、以及第九声道对应的原始音频数据ch9:16bit共3个原始音频数据进行拆分,使原始音频数据ch6:16bit生成拆分音频数据ch6:high 8bit、ch6:low 8bit;使原始音频数据ch7:16bit生成拆分音频数据ch7:high 8bit、ch7:low 8bit;使原始音频数据ch9:16bit生成拆分音频数据ch9:high 8bit、ch9:low 8bit。(3) The number of all original audio data is 9, that is, Q=9, and the total number of channels of all the first I2S bus interfaces is 6, that is, M=6. Then N=2. As shown in Figure 8, the 16-bit original audio data ch6:16bit corresponding to the center channel, the 16-bit original audio data ch7:16bit corresponding to the subwoofer channel, and the ninth channel can be directly selected from all the original audio data. The corresponding original audio data ch9:16bit, a total of 3 original audio data are split, so that the original audio data ch6:16bit generates split audio data ch6: high 8bit, ch6: low 8bit; the original audio data ch7: 16bit is generated and split Audio data ch7: high 8bit, ch7: low 8bit; make the original audio data ch9: 16bit generate split audio data ch9: high 8bit, ch9: low 8bit.
(4)结合图8与图5所示,将原始音频数据ch0:16bit与拆分音频数据ch6:high 8bit拼接为目标音频数据SD1_0,将原始音频数据ch1:16bit与拆分音频数据ch6:low 8bit拼接为目标音频数据SD2_0,将原始音频数据ch2:16bit与 拆分音频数据ch7:high 8bit拼接为目标音频数据SD1_1,将原始音频数据ch3:16bit与拆分音频数据ch7:low 8bit拼接为目标音频数据SD2_1,将原始音频数据ch4:16bit与拆分音频数据ch9:high 8bit拼接为目标音频数据SD1_2,将原始音频数据ch5:16bit与拆分音频数据ch9:low 8bit拼接为目标音频数据SD2_2。(4) As shown in Figure 8 and Figure 5, the original audio data ch0: 16bit and the split audio data ch6: high 8bit are spliced into the target audio data SD1_0, and the original audio data ch1: 16bit and the split audio data ch6: low 8bit is spliced into target audio data SD2_0, original audio data ch2:16bit and split audio data ch7:high 8bit are spliced into target audio data SD1_1, original audio data ch3:16bit and split audio data ch7:low 8bit are spliced into target Audio data SD2_1, splicing original audio data ch4:16bit and split audio data ch9:high 8bit into target audio data SD1_2, splicing original audio data ch5:16bit and split audio data ch9:low 8bit into target audio data SD2_2.
(5)结合图8与图5所示,一个目标音频数据的数据位由原始音频数据的16bit改变为24bit,因此可以改变第一位时钟BCLK1的采样位数,使第一位时钟BCLK1的采样位数与一个目标音频数据的数据位相同。并且,在第一位时钟BCLK1的每一个周期内的上升沿传输一个数据位。(5) As shown in Figure 8 and Figure 5, the data bit of a target audio data is changed from 16bit of the original audio data to 24bit, so the number of sampling bits of the first clock BCLK1 can be changed to make the first clock BCLK1 sample The number of bits is the same as that of a target audio data. In addition, one data bit is transmitted on the rising edge of each cycle of the first bit clock BCLK1.
在WS1=0时,控制第一I2S总线接口I2S_0对应左声道的通道传输目标音频数据SD1_0。具体地,在第一帧时钟WS1下降沿后的第2个第一位时钟BCLK1开始,按照第一位时钟BCLK1传输目标音频数据SD1_0,使目标音频数据SD1_0采用第一I2S总线接口I2S_0的左声道对应的通道输出。其中,在传输目标音频数据SD1_0时,先从最高位开始依次传输原始音频数据ch0:16bit,之后再从最高位开始依次传输拆分音频数据ch6:high 16bit。When WS1=0, the channel of the first I2S bus interface I2S_0 corresponding to the left channel is controlled to transmit the target audio data SD1_0. Specifically, starting from the second first bit clock BCLK1 after the falling edge of the first frame clock WS1, the target audio data SD1_0 is transmitted according to the first bit clock BCLK1, so that the target audio data SD1_0 adopts the left sound of the first I2S bus interface I2S_0 Channel output corresponding to the channel. Among them, when transmitting the target audio data SD1_0, the original audio data ch0: 16bit is transmitted sequentially from the highest bit, and then the split audio data ch6: high 16bit is sequentially transmitted from the highest bit.
在WS1=1时,控制第一I2S总线接口I2S_0对应右声道的通道传输目标音频数据SD2_0。具体地,在第一帧时钟WS1上升沿后的第2个第一位时钟BCLK1开始,按照第一位时钟BCLK1传输目标音频数据SD2_0,使目标音频数据SD2_0采用第一I2S总线接口I2S_0的右声道对应的通道输出。其中,在传输目标音频数据SD2_0时,先从最高位开始依次传输原始音频数据ch1:16bit,之后再从最高位开始依次传输拆分音频数据ch6:low 16bit。When WS1=1, the channel of the first I2S bus interface I2S_0 corresponding to the right channel is controlled to transmit the target audio data SD2_0. Specifically, starting from the second first bit clock BCLK1 after the rising edge of the first frame clock WS1, the target audio data SD2_0 is transmitted according to the first bit clock BCLK1, so that the target audio data SD2_0 adopts the right sound of the first I2S bus interface I2S_0 Channel output corresponding to the channel. Among them, when transmitting the target audio data SD2_0, the original audio data ch1: 16bit is transmitted sequentially from the highest bit, and then the split audio data ch6: low 16bit is sequentially transmitted from the highest bit.
同理,在WS1=0时,控制第一I2S总线接口I2S_1对应左声道的通道传 输目标音频数据SD1_1。在WS1=1时,控制第一I2S总线接口I2S_1对应右声道的通道传输目标音频数据SD2_1。Similarly, when WS1=0, the channel of the first I2S bus interface I2S_1 corresponding to the left channel is controlled to transmit the target audio data SD1_1. When WS1=1, the channel of the first I2S bus interface I2S_1 corresponding to the right channel is controlled to transmit the target audio data SD2_1.
并且,在WS1=0时,控制第一I2S总线接口I2S_2对应左声道的通道传输目标音频数据SD1_2。在WS1=1时,控制第一I2S总线接口I2S_2对应右声道的通道传输目标音频数据SD2_2。In addition, when WS1=0, the channel of the first I2S bus interface I2S_2 corresponding to the left channel is controlled to transmit the target audio data SD1_2. When WS1=1, the channel of the first I2S bus interface I2S_2 corresponding to the right channel is controlled to transmit the target audio data SD2_2.
(6)结合图5至图8所示,控制第二帧时钟WS2的时序与第一帧时钟WS1的时序相同,第二位时钟BCLK2的时序与第一位时钟BCLK1的时序相同。(6) As shown in FIGS. 5 to 8, the timing of controlling the second frame clock WS2 is the same as the timing of the first frame clock WS1, and the timing of the second bit clock BCLK2 is the same as the timing of the first bit clock BCLK1.
根据第二帧时钟WS2和第二位时钟BCLK2,控制接收第一I2S总线接口I2S_0传输的目标音频数据SD1_0和SD2_0,控制接收第一I2S总线接口I2S_1传输的目标音频数据SD1_1和SD2_1,以及控制接收第一I2S总线接口I2S_2传输的目标音频数据SD1_2和SD2_2。According to the second frame clock WS2 and the second bit clock BCLK2, control to receive the target audio data SD1_0 and SD2_0 transmitted by the first I2S bus interface I2S_0, control to receive the target audio data SD1_1 and SD2_1 transmitted by the first I2S bus interface I2S_1, and control the reception The target audio data SD1_2 and SD2_2 transmitted by the first I2S bus interface I2S_2.
并根据上述预设编码规则,分别截取目标音频数据SD1_0、SD2_0、SD1_1、SD2_1、SD1_2以及SD2_2中的前16bit的数据,即分别截取到原始音频数据ch0:16bit、ch1:16bit、ch2:16bit、ch3:16bit、ch4:16bit、ch5:16bit,并将原始音频数据ch0:16bit和ch1:16bit分别存放在第一个第二I2S总线接口的对应左声道的通道堆栈中和对应右声道的通道堆栈中,将原始音频数据ch2:16bit和ch3:16bit分别存放在第二个第二I2S总线接口的对应左声道的通道堆栈中和对应右声道的通道堆栈中,以及将原始音频数据ch4:16bit和ch5:16bit分别存放在第三个第二I2S总线接口的对应左声道的通道堆栈中和对应右声道的通道堆栈中,从而还原出来原始音频数据ch0:16bit、ch1:16bit、ch2:16bit、ch3:16bit、ch4:16bit、ch5:16bit。And according to the above preset coding rules, the first 16bit data in the target audio data SD1_0, SD2_0, SD1_1, SD2_1, SD1_2, and SD2_2 are respectively intercepted, that is, the original audio data ch0:16bit, ch1:16bit, ch2:16bit, ch3:16bit, ch4:16bit, ch5:16bit, and store the original audio data ch0:16bit and ch1:16bit respectively in the channel stack corresponding to the left channel of the first and second I2S bus interface and the channel stack corresponding to the right channel In the channel stack, the original audio data ch2:16bit and ch3:16bit are respectively stored in the channel stack corresponding to the left channel and the channel stack corresponding to the right channel of the second I2S bus interface, and the original audio data ch4:16bit and ch5:16bit are respectively stored in the channel stack corresponding to the left channel and the channel stack corresponding to the right channel of the third second I2S bus interface, so as to restore the original audio data ch0:16bit, ch1:16bit , Ch2: 16bit, ch3: 16bit, ch4: 16bit, ch5: 16bit.
之后分别截取目标音频数据SD1_0、SD2_0、SD1_1以及SD2_1中的后 8bit数据,在目标音频数据SD1_0中的后8bit数据之后拼接目标音频数据SD2_0中的后8bit数据,以拼接还原出原始音频数据ch6:16bit,并将还原出的原始音频数据ch6:16bit存放在第四个第二I2S总线接口的对应左声道的通道堆栈中。在目标音频数据SD1_1中的后8bit数据之后拼接目标音频数据SD2_1中的后8bit数据,以拼接还原出原始音频数据ch7:16bit,并将还原出的原始音频数据ch7:16bit存放在第四个第二I2S总线接口的对应右声道的通道堆栈中。以及在目标音频数据SD1_2中的后8bit数据之后拼接目标音频数据SD2_2中的后8bit数据,以拼接还原出原始音频数据ch8:16bit,并将还原出的原始音频数据ch8:16bit存放在第五个第二I2S总线接口的对应左声道的通道堆栈中。从而还原出来原始音频数据ch6:16bit、ch7:16bit、ch8:16bit。Then intercept the last 8bit data in the target audio data SD1_0, SD2_0, SD1_1, and SD2_1 respectively, and splice the last 8bit data in the target audio data SD2_0 after the last 8bit data in the target audio data SD1_0 to restore the original audio data ch6 by splicing: 16bit, and store the restored original audio data ch6:16bit in the channel stack corresponding to the left channel of the fourth second I2S bus interface. Splice the last 8bit data in the target audio data SD2_1 after the last 8bit data in the target audio data SD1_1 to restore the original audio data ch7:16bit by splicing, and store the restored original audio data ch7:16bit in the fourth Two I2S bus interface corresponding to the channel stack of the right channel. And splicing the last 8bit data in the target audio data SD2_2 after the last 8bit data in the target audio data SD1_2 to restore the original audio data ch8:16bit by splicing, and store the restored original audio data ch8:16bit in the fifth In the channel stack corresponding to the left channel of the second I2S bus interface. Thereby, the original audio data ch6:16bit, ch7:16bit, and ch8:16bit are restored.
当然,也可以先将接收到的目标音频数据SD1_0~SD2_2先进行缓存,然后再根据上述实施方式,采用预设时钟信号YCLK分别进行截取。具体实施方式可以参照上述实施例,在此不作赘述。Of course, the received target audio data SD1_0 to SD2_2 can also be buffered first, and then the preset clock signal YCLK is used for intercepting respectively according to the foregoing embodiment. For specific implementation manners, reference may be made to the above-mentioned embodiments, which will not be repeated here.
在一些实施例中,确定每个第一I2S总线接口的每个通道对应的目标音频数据,也可以包括:In some embodiments, determining the target audio data corresponding to each channel of each first I2S bus interface may also include:
在确定所有原始音频数据的数量Q满足公式:时,将个原始音频数据组合为一个目标音频数据;其中,N为正偶数,M代表所有第一I2S总线接口的通道总数。When it is determined that the quantity Q of all original audio data satisfies the formula:, the original audio data are combined into one target audio data; where N is a positive even number, and M represents the total number of channels of all the first I2S bus interfaces.
示例性地,第一I2S总线接口的数量为2个时,所有第一I2S总线接口的通道的总数为4个,则所有原始音频数据的数量为8时,可以确定每一个目标音频数据包括2个原始音频数据,也就是说,N=4。Exemplarily, when the number of the first I2S bus interface is 2, and the total number of channels of all the first I2S bus interface is 4, when the number of all original audio data is 8, it can be determined that each target audio data includes 2 Pieces of original audio data, that is, N=4.
示例性地,第一I2S总线接口的数量为3个时,所有第一I2S总线接口的 通道的总数为6个,则所有原始音频数据的数量为12时,可以确定每一个目标音频数据包括2个原始音频数据,也就是说,N=4。Exemplarily, when the number of the first I2S bus interface is 3, the total number of channels of all the first I2S bus interface is 6, and when the number of all original audio data is 12, it can be determined that each target audio data includes 2 Pieces of original audio data, that is, N=4.
当然,在实际应用中,第一I2S总线接口的数量以及所有原始音频数据的数量可以根据实际应用环境来设计确定,在此不作限定。Of course, in actual applications, the number of first I2S bus interfaces and the number of all original audio data can be designed and determined according to the actual application environment, which is not limited here.
在本申请实施例中,在N=4时,可以使同一目标音频数据中的两个原始音频数据设置为同一类型声道对应的原始音频数据。示例性地,这些声道中至少包括:左声道,右声道,左环绕声道,右环绕声道,左天空声道,右天空声道、中置声道、重低音声道。则左声道和右声道可以作为同一类型的主声道,左环绕声道和右环绕声道可以作为同一类型的环绕声道,左天空声道和右天空声道可以作为同一类型的天空声道,中置声道和重低音声道可以作为同一类型的增效声道。其余同理,在此不作赘述。In the embodiment of the present application, when N=4, two original audio data in the same target audio data can be set as original audio data corresponding to the same type of channel. Exemplarily, these channels include at least: a left channel, a right channel, a left surround channel, a right surround channel, a left sky channel, a right sky channel, a center channel, and a subwoofer channel. Then the left and right channels can be used as the same type of main channel, the left and right surround channels can be used as the same type of surround channels, and the left and right sky channels can be used as the same type of sky Channel, center channel and subwoofer channel can be used as the same type of booster channel. The rest is the same, so I won't repeat it here.
下面结合图9至图12,以原始音频数据为16比特,以及第一I2S总线接口为3个为例,通过具体实施例对本申请提供的音频处理方法进行说明。但读者应知,其具体过程不局限于此。其中,这3个第一I2S总线接口分别为I2S_0、I2S_1、I2S_2。图10仅是以目标音频数据SD1_0和目标音频数据SD2_0的传输过程为例进行说明的。9 to 12, taking the original audio data of 16 bits and the first I2S bus interface as an example, the audio processing method provided by the present application will be described through specific embodiments. However, readers should know that the specific process is not limited to this. Among them, the three first I2S bus interfaces are I2S_0, I2S_1, and I2S_2 respectively. FIG. 10 only uses the transmission process of the target audio data SD1_0 and the target audio data SD2_0 as an example for description.
本申请实施例提供的音频处理方法,可以包括如下步骤:The audio processing method provided by the embodiments of the present application may include the following steps:
(1)接收具有12个声道的声源数据。例如,这些声道中至少包括:左声道,右声道,左环绕声道,右环绕声道,左天空声道,右天空声道、中置声道、重低音声道。其余声道可以根据实际应用环境来设计确定,在此不作限定。(1) Receive sound source data with 12 channels. For example, these channels include at least: left channel, right channel, left surround channel, right surround channel, left sky channel, right sky channel, center channel, and subwoofer channel. The remaining channels can be designed and determined according to the actual application environment, which is not limited here.
(2)结合图9所示,采用现有的任意解码方式将声源数据进行解码,以解码出这12个声道分别对应的原始音频数据:ch0:16bit、ch1:16bit、ch2:16bit、 ch3:16bit、ch4:16bit、ch5:16bit、ch6:16bit、ch7:16bit、ch8:16bit、ch9:16bit、ch10:16bit、ch11:16bit。其中,ch0:16bit和ch1:16bit可以作为同一类型的声道对应的原始音频数据,ch2:16bit和ch3:16bit可以作为同一类型的声道对应的原始音频数据,ch4:16bit和ch5:16bit可以作为同一类型的声道对应的原始音频数据,ch6:16bit和ch7:16bit可以作为同一类型的声道对应的原始音频数据,ch8:16bit和ch9:16bit可以作为同一类型的声道对应的原始音频数据,ch10:16bit和ch11:16bit可以作为同一类型的声道对应的原始音频数据。(2) As shown in Figure 9, the sound source data is decoded using any existing decoding method to decode the original audio data corresponding to the 12 channels: ch0:16bit, ch1:16bit, ch2:16bit, ch3:16bit, ch4:16bit, ch5:16bit, ch6:16bit, ch7:16bit, ch8:16bit, ch9:16bit, ch10:16bit, ch11:16bit. Among them, ch0:16bit and ch1:16bit can be used as the original audio data corresponding to the same type of channel, ch2:16bit and ch3:16bit can be used as the original audio data corresponding to the same type of channel, ch4:16bit and ch5:16bit can be As the original audio data corresponding to the same type of channel, ch6:16bit and ch7:16bit can be used as the original audio data corresponding to the same type of channel, and ch8:16bit and ch9:16bit can be used as the original audio corresponding to the same type of channel Data, ch10:16bit and ch11:16bit can be used as the original audio data corresponding to the same type of channel.
(3)由于第一I2S总线接口的数量为3个,则所有第一I2S总线接口的通道的总数为6个,即M=6。所有原始音频数据的数量为12,即Q=12。则可以使N=4,从而将两个原始音频数据组合为一个目标音频数据。例如,ch0:16bit和ch1:16bit作为一个目标音频数据SD1_0,使ch2:16bit和ch3:16bit作为一个目标音频数据SD2_0,使ch4:16bit和ch5:16bit作为一个目标音频数据SD1_1,使ch6:16bit和ch7:16bit作为一个目标音频数据SD2_1,使ch8:16bit和ch9:16bit作为一个目标音频数据SD1_2,使ch10:16bit和ch11:16bit作为一个目标音频数据SD2_2。(3) Since the number of first I2S bus interfaces is 3, the total number of channels of all first I2S bus interfaces is 6, that is, M=6. The number of all original audio data is 12, that is, Q=12. Then, N=4 can be used to combine two original audio data into one target audio data. For example, ch0:16bit and ch1:16bit are used as a target audio data SD1_0, ch2:16bit and ch3:16bit are used as a target audio data SD2_0, ch4:16bit and ch5:16bit are used as a target audio data SD1_1, and ch6:16bit And ch7:16bit as a target audio data SD2_1, ch8:16bit and ch9:16bit as a target audio data SD1_2, and ch10:16bit and ch11:16bit as a target audio data SD2_2.
(4)结合图9与图10所示,一个目标音频数据的数据位由原始音频数据的16bit改变为32bit,因此可以改变第一位时钟BCLK1的采样位数,不改变第一位时钟BCLK1的采样频率,使第一位时钟BCLK1的采样位数与一个目标音频数据的数据位相同。并且,在第一位时钟BCLK1的每一个周期内的上升沿传输一个数据位。(4) As shown in Figure 9 and Figure 10, the data bit of a target audio data is changed from 16bit of the original audio data to 32bit, so the number of sampling bits of the first bit clock BCLK1 can be changed without changing the first bit clock BCLK1 The sampling frequency is such that the sampling bits of the first clock BCLK1 are the same as the data bits of a target audio data. In addition, one data bit is transmitted on the rising edge of each cycle of the first bit clock BCLK1.
在WS1=0时,控制第一I2S总线接口I2S_0对应左声道的通道传输目标音频数据SD1_0。具体地,在第一帧时钟WS1下降沿后的第2个第一位时钟 BCLK1开始,按照第一位时钟BCLK1传输目标音频数据SD1_0,使目标音频数据SD1_0采用第一I2S总线接口I2S_0的左声道对应的通道输出。其中,在传输目标音频数据SD1_0时,先从最高位开始依次传输原始音频数据ch0:16bit,之后再从最高位开始依次传输原始音频数据ch1:16bit。When WS1=0, the channel of the first I2S bus interface I2S_0 corresponding to the left channel is controlled to transmit the target audio data SD1_0. Specifically, starting from the second first bit clock BCLK1 after the falling edge of the first frame clock WS1, the target audio data SD1_0 is transmitted according to the first bit clock BCLK1, so that the target audio data SD1_0 adopts the left sound of the first I2S bus interface I2S_0 Channel output corresponding to the channel. Among them, when transmitting the target audio data SD1_0, the original audio data ch0:16bit is transmitted sequentially from the highest bit, and then the original audio data ch1:16bit is sequentially transmitted from the highest bit.
在WS1=1时,控制第一I2S总线接口I2S_0对应右声道的通道传输目标音频数据SD2_0。具体地,在第一帧时钟WS1下降沿后的第2个第一位时钟BCLK1开始,按照第一位时钟BCLK1传输目标音频数据SD2_0,使目标音频数据SD2_0采用第一I2S总线接口I2S_0的右声道对应的通道输出。其中,在传输目标音频数据SD2_0时,先从最高位开始依次传输原始音频数据ch2:16bit,之后再从最高位开始依次传输原始音频数据ch3:16bit。When WS1=1, the channel of the first I2S bus interface I2S_0 corresponding to the right channel is controlled to transmit the target audio data SD2_0. Specifically, starting from the second first bit clock BCLK1 after the falling edge of the first frame clock WS1, the target audio data SD2_0 is transmitted according to the first bit clock BCLK1, so that the target audio data SD2_0 adopts the right sound of the first I2S bus interface I2S_0 Channel output corresponding to the channel. Among them, when the target audio data SD2_0 is transmitted, the original audio data ch2:16bit is sequentially transmitted from the highest bit, and then the original audio data ch3:16bit is sequentially transmitted from the highest bit.
同理,在WS1=0时,控制第一I2S总线接口I2S_1对应左声道的通道传输目标音频数据SD1_1。在WS1=1时,控制第一I2S总线接口I2S_1对应右声道的通道传输目标音频数据SD2_1。Similarly, when WS1=0, the channel of the first I2S bus interface I2S_1 corresponding to the left channel is controlled to transmit the target audio data SD1_1. When WS1=1, the channel of the first I2S bus interface I2S_1 corresponding to the right channel is controlled to transmit the target audio data SD2_1.
并且,在WS1=0时,控制第一I2S总线接口I2S_2对应左声道的通道传输目标音频数据SD1_2。在WS1=1时,控制第一I2S总线接口I2S_2对应右声道的通道传输目标音频数据SD2_2。In addition, when WS1=0, the channel of the first I2S bus interface I2S_2 corresponding to the left channel is controlled to transmit the target audio data SD1_2. When WS1=1, the channel of the first I2S bus interface I2S_2 corresponding to the right channel is controlled to transmit the target audio data SD2_2.
(5)结合图9至图12所示,第一I2S总线接口I2S_0对应第二帧时钟WS2_0和第二位时钟BCLK2_0,第一I2S总线接口I2S_1对应第二帧时钟WS2_1和第二位时钟BCLK2_1,第一I2S总线接口I2S_2对应第二帧时钟WS2_2和第二位时钟BCLK2_2。其中,控制第二帧时钟WS2_0~WS2_2的时序分别与第一帧时钟WS1的时序相同,第二位时钟BCLK2_0~BCLK2_2的时序分别与第一位时钟BCLK1的时序相同。(5) As shown in Figure 9 to Figure 12, the first I2S bus interface I2S_0 corresponds to the second frame clock WS2_0 and the second bit clock BCLK2_0, and the first I2S bus interface I2S_1 corresponds to the second frame clock WS2_1 and the second bit clock BCLK2_1, The first I2S bus interface I2S_2 corresponds to the second frame clock WS2_2 and the second bit clock BCLK2_2. The timing of controlling the second frame clock WS2_0 to WS2_2 is the same as the timing of the first frame clock WS1, and the timing of the second bit clock BCLK2_0 to BCLK2_2 is the same as the timing of the first bit clock BCLK1.
根据第二帧时钟WS2_0和第二位时钟BCLK2_0,控制接收第一I2S总线接口I2S_0传输的目标音频数据SD1_0和SD2_0。根据第二帧时钟WS2_1和第二位时钟BCLK2_1,控制接收第一I2S总线接口I2S_1传输的目标音频数据SD1_1和SD2_1。根据第二帧时钟WS2_2和第二位时钟BCLK2_2,控制接收第一I2S总线接口I2S_2传输的目标音频数据SD1_2和SD2_2。According to the second frame clock WS2_0 and the second bit clock BCLK2_0, the target audio data SD1_0 and SD2_0 transmitted by the first I2S bus interface I2S_0 are controlled to be received. According to the second frame clock WS2_1 and the second bit clock BCLK2_1, control to receive the target audio data SD1_1 and SD2_1 transmitted by the first I2S bus interface I2S_1. According to the second frame clock WS2_2 and the second bit clock BCLK2_2, control to receive the target audio data SD1_2 and SD2_2 transmitted by the first I2S bus interface I2S_2.
并根据上述预设编码规则,采用预设时钟信号YCLK分别截取目标音频数据SD1_0、SD2_0、SD1_1、SD2_1、SD1_2以及SD2_2中的前16bit的数据,即分别截取到原始音频数据ch0:16bit、ch2:16bit、ch4:16bit、ch6:16bit、ch8:16bit、ch10:16bit。And according to the above preset coding rules, the preset clock signal YCLK is used to intercept the first 16bit data of the target audio data SD1_0, SD2_0, SD1_1, SD2_1, SD1_2, and SD2_2 respectively, that is, to intercept the original audio data ch0:16bit, ch2: 16bit, ch4: 16bit, ch6: 16bit, ch8: 16bit, ch10: 16bit.
并将原始音频数据ch0:16bit存放在第一个第二I2S总线接口的对应左声道的通道堆栈中,将原始音频数据ch2:16bit存放在第二个第二I2S总线接口的对应左声道的通道堆栈中,将原始音频数据ch4:16bit存放在第三个第二I2S总线接口的对应左声道的通道堆栈中,将原始音频数据ch6:16bit存放在第四个第二I2S总线接口的对应左声道的通道堆栈中,将原始音频数据ch8:16bit存放在第五个第二I2S总线接口的对应左声道的通道堆栈中,以及将原始音频数据ch10:16bit存放在第六个第二I2S总线接口的对应左声道的通道堆栈中。从而还原出来原始音频数据ch0:16bit、ch2:16bit、ch4:16bit、ch6:16bit、ch8:16bit、ch10:16bit。And store the original audio data ch0:16bit in the channel stack corresponding to the left channel of the first second I2S bus interface, and store the original audio data ch2:16bit in the corresponding left channel of the second second I2S bus interface In the channel stack, store the original audio data ch4:16bit in the channel stack of the third second I2S bus interface corresponding to the left channel, and store the original audio data ch6:16bit in the fourth second I2S bus interface In the channel stack corresponding to the left channel, store the original audio data ch8:16bit in the channel stack corresponding to the left channel of the fifth second I2S bus interface, and store the original audio data ch10:16bit in the sixth Two I2S bus interface corresponding to the channel stack of the left channel. Thus, the original audio data ch0:16bit, ch2:16bit, ch4:16bit, ch6:16bit, ch8:16bit, and ch10:16bit are restored.
之后,采用预设时钟信号YCLK分别截取目标音频数据SD1_0、SD2_0、SD1_1、SD2_1、SD1_2以及SD2_2中的后16bit的数据,即分别截取到原始音频数据ch1:16bit、ch3:16bit、ch5:16bit、ch7:16bit、ch9:16bit、ch11:16bit。After that, the preset clock signal YCLK is used to intercept the last 16bit data of the target audio data SD1_0, SD2_0, SD1_1, SD2_1, SD1_2, and SD2_2 respectively, that is, to intercept the original audio data ch1:16bit, ch3:16bit, ch5:16bit, ch7: 16bit, ch9: 16bit, ch11: 16bit.
并将原始音频数据ch1:16bit存放在第一个第二I2S总线接口的对应右声道 的通道堆栈中,将原始音频数据ch3:16bit存放在第二个第二I2S总线接口的对应右声道的通道堆栈中,将原始音频数据ch5:16bit存放在第三个第二I2S总线接口的对应右声道的通道堆栈中,将原始音频数据ch7:16bit存放在第四个第二I2S总线接口的对应右声道的通道堆栈中,将原始音频数据ch9:16bit存放在第五个第二I2S总线接口的对应右声道的通道堆栈中,以及将原始音频数据ch11:16bit存放在第六个第二I2S总线接口的对应左声道的通道堆栈中。从而还原出来原始音频数据ch1:16bit、ch3:16bit、ch5:16bit、ch7:16bit、ch9:16bit、ch11:16bit。And store the original audio data ch1:16bit in the channel stack corresponding to the right channel of the first second I2S bus interface, and store the original audio data ch3:16bit in the corresponding right channel of the second second I2S bus interface In the channel stack, store the original audio data ch5:16bit in the channel stack of the third second I2S bus interface corresponding to the right channel, and store the original audio data ch7:16bit in the fourth second I2S bus interface In the channel stack corresponding to the right channel, store the original audio data ch9:16bit in the channel stack corresponding to the right channel of the fifth second I2S bus interface, and store the original audio data ch11:16bit in the sixth Two I2S bus interface corresponding to the channel stack of the left channel. Thereby, the original audio data ch1:16bit, ch3:16bit, ch5:16bit, ch7:16bit, ch9:16bit, ch11:16bit are restored.
之后,可以将还原出来的原始音频数据ch0:16bit~ch11:16bit采用这些第二I2S总线接口输出给多声道设备中的功放装置中,以通过功放装置驱动扬声器发声。After that, the restored original audio data ch0:16bit~ch11:16bit can be output to the power amplifier device in the multi-channel device using these second I2S bus interfaces, so as to drive the speaker to sound through the power amplifier device.
需要说明的是,在I2S总线接口为2个时,其传输声源数据的过程可以参照上述实施例,在此不作赘述。It should be noted that, when there are two I2S bus interfaces, the process of transmitting sound source data can refer to the above-mentioned embodiment, which is not repeated here.
当然,也可以先将接收到的目标音频数据SD1_0~SD2_2先进行缓存,然后再根据上述实施方式,采用预设时钟信号YCLK分别进行截取。具体实施方式可以参照上述实施例,在此不作赘述。Of course, the received target audio data SD1_0 to SD2_2 can also be buffered first, and then the preset clock signal YCLK is used for intercepting respectively according to the foregoing embodiment. For specific implementation manners, reference may be made to the above-mentioned embodiments, which will not be repeated here.
在一些实施例中,还提供的音频处理方法,除了包括上述步骤(1)~(3)还可以包括如下步骤:In some embodiments, the audio processing method provided may also include the following steps in addition to the above steps (1) to (3):
(4)结合图9以及图13a至图13c所示,一个目标音频数据的数据位由原始音频数据的16bit改变为32bit,因此可以改变第一位时钟BCLK1的采样频率,不改变第一位时钟BCLK1的采样位数,使第一位时钟BCLK1的采样位数与一个目标音频数据的数据位相同。其中,在第一位时钟BCLK1的每一个周期内的 上升沿和下降沿分别传输一个数据位。(4) As shown in Figure 9 and Figure 13a to Figure 13c, the data bit of a target audio data is changed from 16bit of the original audio data to 32bit, so the sampling frequency of the first bit clock BCLK1 can be changed without changing the first bit clock The sampling bits of BCLK1 make the sampling bits of the first clock BCLK1 the same as the data bits of a target audio data. Among them, one data bit is transmitted on the rising and falling edges of each cycle of the first bit clock BCLK1.
在WS1=0时,控制第一I2S总线接口I2S_0对应左声道的通道传输目标音频数据SD1_0。When WS1=0, the channel of the first I2S bus interface I2S_0 corresponding to the left channel is controlled to transmit the target audio data SD1_0.
具体地,在第一帧时钟WS1下降沿后的第2个第一位时钟BCLK1开始,按照第一位时钟BCLK1传输目标音频数据SD1_0,使目标音频数据SD1_0采用第一I2S总线接口I2S_0的左声道对应的通道输出。其中,在传输目标音频数据SD1_0时,先从最高位开始依次传输原始音频数据ch0:16bit,之后再从最高位开始依次传输原始音频数据ch1:16bit。Specifically, starting from the second first bit clock BCLK1 after the falling edge of the first frame clock WS1, the target audio data SD1_0 is transmitted according to the first bit clock BCLK1, so that the target audio data SD1_0 adopts the left sound of the first I2S bus interface I2S_0 Channel output corresponding to the channel. Among them, when transmitting the target audio data SD1_0, the original audio data ch0:16bit is transmitted sequentially from the highest bit, and then the original audio data ch1:16bit is sequentially transmitted from the highest bit.
在WS1=1时,控制第一I2S总线接口I2S_0对应右声道的通道传输目标音频数据SD2_0。具体地,在第一帧时钟WS1下降沿后的第2个第一位时钟BCLK1开始,按照第一位时钟BCLK1传输目标音频数据SD2_0,使目标音频数据SD2_0采用第一I2S总线接口I2S_0的右声道对应的通道输出。其中,在传输目标音频数据SD2_0时,先从最高位开始依次传输原始音频数据ch2:16bit,之后再从最高位开始依次传输原始音频数据ch3:16bit。When WS1=1, the channel of the first I2S bus interface I2S_0 corresponding to the right channel is controlled to transmit the target audio data SD2_0. Specifically, starting from the second first bit clock BCLK1 after the falling edge of the first frame clock WS1, the target audio data SD2_0 is transmitted according to the first bit clock BCLK1, so that the target audio data SD2_0 adopts the right sound of the first I2S bus interface I2S_0 Channel output corresponding to the channel. Among them, when the target audio data SD2_0 is transmitted, the original audio data ch2:16bit is sequentially transmitted from the highest bit, and then the original audio data ch3:16bit is sequentially transmitted from the highest bit.
同理,在WS1=0时,控制第一I2S总线接口I2S_1对应左声道的通道传输目标音频数据SD1_1。在WS1=1时,控制第一I2S总线接口I2S_1对应右声道的通道传输目标音频数据SD2_1。Similarly, when WS1=0, the channel of the first I2S bus interface I2S_1 corresponding to the left channel is controlled to transmit the target audio data SD1_1. When WS1=1, the channel of the first I2S bus interface I2S_1 corresponding to the right channel is controlled to transmit the target audio data SD2_1.
并且,在WS1=0时,控制第一I2S总线接口I2S_2对应左声道的通道传输目标音频数据SD1_2。在WS1=1时,控制第一I2S总线接口I2S_2对应右声道的通道传输目标音频数据SD2_2。In addition, when WS1=0, the channel of the first I2S bus interface I2S_2 corresponding to the left channel is controlled to transmit the target audio data SD1_2. When WS1=1, the channel of the first I2S bus interface I2S_2 corresponding to the right channel is controlled to transmit the target audio data SD2_2.
(5)结合图9,以及图14a至图15所示,第一I2S总线接口I2S_0对应第二帧时钟WS2_0和第二位时钟BCLK2_0,第一I2S总线接口I2S_1对应第 二帧时钟WS2_1和第二位时钟BCLK2_1,第一I2S总线接口I2S_2对应第二帧时钟WS2_2和第二位时钟BCLK2_2。其中,控制第二帧时钟WS2_0~WS2_2的时序分别与第一帧时钟WS1的时序相同,第二位时钟BCLK2_0~BCLK2_2的时序分别与第一位时钟BCLK1的时序相同。(5) With reference to Figure 9 and Figures 14a to 15, the first I2S bus interface I2S_0 corresponds to the second frame clock WS2_0 and the second bit clock BCLK2_0, and the first I2S bus interface I2S_1 corresponds to the second frame clock WS2_1 and the second frame clock. The bit clock BCLK2_1, the first I2S bus interface I2S_2 corresponds to the second frame clock WS2_2 and the second bit clock BCLK2_2. The timing of controlling the second frame clock WS2_0 to WS2_2 is the same as the timing of the first frame clock WS1, and the timing of the second bit clock BCLK2_0 to BCLK2_2 is the same as the timing of the first bit clock BCLK1.
根据第二帧时钟WS2_0和第二位时钟BCLK2_0,控制接收第一I2S总线接口I2S_0传输的目标音频数据SD1_0和SD2_0。根据第二帧时钟WS2_1和第二位时钟BCLK2_1,控制接收第一I2S总线接口I2S_1传输的目标音频数据SD1_1和SD2_1。根据第二帧时钟WS2_2和第二位时钟BCLK2_2,控制接收第一I2S总线接口I2S_2传输的目标音频数据SD1_2和SD2_2。According to the second frame clock WS2_0 and the second bit clock BCLK2_0, control to receive the target audio data SD1_0 and SD2_0 transmitted by the first I2S bus interface I2S_0. According to the second frame clock WS2_1 and the second bit clock BCLK2_1, control to receive the target audio data SD1_1 and SD2_1 transmitted by the first I2S bus interface I2S_1. According to the second frame clock WS2_2 and the second bit clock BCLK2_2, control to receive the target audio data SD1_2 and SD2_2 transmitted by the first I2S bus interface I2S_2.
并根据上述预设编码规则,采用预设时钟信号YCLK分别截取目标音频数据SD1_0、SD2_0、SD1_1、SD2_1、SD1_2以及SD2_2中的前16bit的数据,即分别截取到原始音频数据ch0:16bit、ch2:16bit、ch4:16bit、ch6:16bit、ch8:16bit、ch10:16bit。And according to the above preset coding rules, the preset clock signal YCLK is used to intercept the first 16bit data of the target audio data SD1_0, SD2_0, SD1_1, SD2_1, SD1_2, and SD2_2 respectively, that is, to intercept the original audio data ch0:16bit, ch2: 16bit, ch4: 16bit, ch6: 16bit, ch8: 16bit, ch10: 16bit.
并将原始音频数据ch0:16bit存放在第一个第二I2S总线接口的对应左声道的通道堆栈中,将原始音频数据ch2:16bit存放在第二个第二I2S总线接口的对应左声道的通道堆栈中,将原始音频数据ch4:16bit存放在第三个第二I2S总线接口的对应左声道的通道堆栈中,将原始音频数据ch6:16bit存放在第四个第二I2S总线接口的对应左声道的通道堆栈中,将原始音频数据ch8:16bit存放在第五个第二I2S总线接口的对应左声道的通道堆栈中,以及将原始音频数据ch10:16bit存放在第六个第二I2S总线接口的对应左声道的通道堆栈中。从而还原出来原始音频数据ch0:16bit、ch2:16bit、ch4:16bit、ch6:16bit、ch8:16bit、ch10:16bit。And store the original audio data ch0:16bit in the channel stack corresponding to the left channel of the first second I2S bus interface, and store the original audio data ch2:16bit in the corresponding left channel of the second second I2S bus interface In the channel stack, store the original audio data ch4:16bit in the channel stack of the third second I2S bus interface corresponding to the left channel, and store the original audio data ch6:16bit in the fourth second I2S bus interface In the channel stack corresponding to the left channel, store the original audio data ch8:16bit in the channel stack corresponding to the left channel of the fifth second I2S bus interface, and store the original audio data ch10:16bit in the sixth Two I2S bus interface corresponding to the channel stack of the left channel. Thus, the original audio data ch0:16bit, ch2:16bit, ch4:16bit, ch6:16bit, ch8:16bit, and ch10:16bit are restored.
之后,采用预设时钟信号YCLK分别截取目标音频数据SD1_0、SD2_0、SD1_1、SD2_1、SD1_2以及SD2_2中的后16bit的数据,即分别截取到原始音频数据ch1:16bit、ch3:16bit、ch5:16bit、ch7:16bit、ch9:16bit、ch11:16bit。After that, the preset clock signal YCLK is used to intercept the last 16bit data of the target audio data SD1_0, SD2_0, SD1_1, SD2_1, SD1_2, and SD2_2 respectively, that is, to intercept the original audio data ch1:16bit, ch3:16bit, ch5:16bit, ch7: 16bit, ch9: 16bit, ch11: 16bit.
并将原始音频数据ch1:16bit存放在第一个第二I2S总线接口的对应右声道的通道堆栈中,将原始音频数据ch3:16bit存放在第二个第二I2S总线接口的对应右声道的通道堆栈中,将原始音频数据ch5:16bit存放在第三个第二I2S总线接口的对应右声道的通道堆栈中,将原始音频数据ch7:16bit存放在第四个第二I2S总线接口的对应右声道的通道堆栈中,将原始音频数据ch9:16bit存放在第五个第二I2S总线接口的对应右声道的通道堆栈中,以及将原始音频数据ch11:16bit存放在第六个第二I2S总线接口的对应左声道的通道堆栈中。从而还原出来原始音频数据ch1:16bit、ch3:16bit、ch5:16bit、ch7:16bit、ch9:16bit、ch11:16bit。And store the original audio data ch1:16bit in the channel stack corresponding to the right channel of the first second I2S bus interface, and store the original audio data ch3:16bit in the corresponding right channel of the second second I2S bus interface In the channel stack, store the original audio data ch5:16bit in the channel stack of the third second I2S bus interface corresponding to the right channel, and store the original audio data ch7:16bit in the fourth second I2S bus interface In the channel stack corresponding to the right channel, store the original audio data ch9:16bit in the channel stack corresponding to the right channel of the fifth second I2S bus interface, and store the original audio data ch11:16bit in the sixth Two I2S bus interface corresponding to the channel stack of the left channel. Thereby, the original audio data ch1:16bit, ch3:16bit, ch5:16bit, ch7:16bit, ch9:16bit, ch11:16bit are restored.
之后,可以将还原出来的原始音频数据ch0:16bit~ch11:16bit采用这些第二I2S总线接口输出给多声道设备中的功放装置中,以通过功放装置驱动扬声器发声。After that, the restored original audio data ch0:16bit~ch11:16bit can be output to the power amplifier device in the multi-channel device using these second I2S bus interfaces, so as to drive the speaker to sound through the power amplifier device.
需要说明的是。预设时钟信号YCLK的时序可以与第二位时钟的时序相同。It should be noted. The timing of the preset clock signal YCLK may be the same as the timing of the second bit clock.
在一些实施例中,确定每个第一I2S总线接口的每个通道对应的目标音频数据,也可以包括:In some embodiments, determining the target audio data corresponding to each channel of each first I2S bus interface may also include:
在确定所有原始音频数据的数量Q满足公式:时,在所有原始音频数据中增加与相同数量的空白原始音频数据,并在所有原始音频数据和生成的空白原始音频数据中选取个原始音频数据进行拆分,生成拆分音频数据;其中,N为正偶数,M代表所有第一I2S总线接口的通道总数,空白原始音频数据的数据 位与原始音频数据的数据位相同;When determining that the quantity Q of all original audio data satisfies the formula:, add the same amount of blank original audio data to all original audio data, and select one original audio data from all original audio data and the generated blank original audio data. Split to generate split audio data; where N is a positive even number, M represents the total number of channels of all the first I2S bus interfaces, and the data bits of the blank original audio data are the same as those of the original audio data;
将个原始音频数据和个拆分音频数据组合为一个目标音频数据。The original audio data and the split audio data are combined into one target audio data.
在具体实施时,在本申请实施例中,选取进行拆分的原始音频数据可以包括:空白原始音频数据。这样在传输过程中对拆分的数据造成影响时,后续虽然可能解码不出空白原始音频数据,但是其对多声道设备的播放效果无影响。In specific implementation, in the embodiment of the present application, the original audio data selected for splitting may include: blank original audio data. In this way, when the split data is affected during the transmission process, although the blank original audio data may not be decoded later, it has no effect on the playback effect of the multi-channel device.
下面以第一I2S总线接口为2个为例,则M=4。本申请实施例提供的音频处理方法,可以包括如下步骤:Taking the first I2S bus interface as an example, M=4. The audio processing method provided by the embodiments of the present application may include the following steps:
(1)接收具有左声道,右声道,左环绕声道,右环绕声道,左天空声道,右天空声道、中置声道、重低音声道的声源数据。(1) Receive sound source data with left channel, right channel, left surround channel, right surround channel, left sky channel, right sky channel, center channel, and subwoofer channel.
(2)结合图16所示,采用现有的任意解码方式将声源数据进行解码,以解码出左声道对应的16bit的原始音频数据ch0:16bit,右声道对应的16bit的原始音频数据ch1:16bit,左环绕声道对应的16bit的原始音频数据ch2:16bit,右环绕声道对应的16bit的原始音频数据ch3:16bit,左天空声道对应的16bit的原始音频数据ch4:16bit,右天空声道对应的16bit的原始音频数据ch5:16bit、中置声道对应的16bit的原始音频数据ch6:16bit、以及重低音声道对应的16bit的原始音频数据ch7:16bit。(2) As shown in Figure 16, the sound source data is decoded using any existing decoding method to decode the original 16bit audio data ch0:16bit corresponding to the left channel, and 16bit original audio data corresponding to the right channel ch1: 16bit, 16bit original audio data corresponding to the left surround channel ch2: 16bit, 16bit original audio data corresponding to the right surround channel ch3: 16bit, 16bit original audio data corresponding to the left sky channel ch4: 16bit, right 16bit original audio data ch5:16bit corresponding to the sky channel, 16bit original audio data ch6:16bit corresponding to the center channel, and 16bit original audio data ch7:16bit corresponding to the subwoofer channel.
(3)所有原始音频数据的数量为8个,即Q=8,所有第一I2S总线接口的通道总数为4,即M=4。则N=4。结合图16所示,在所有原始音频数据中增加4个空白原始音频数据ch01:16bit、ch02:16bit、ch03:16bit、ch04:16bit,这样可以在所有原始音频数据和生成的空白原始音频数据中,选取空白原始音频数据ch01:16bit、ch02:16bit、ch03:16bit、ch04:16bit共4个原始音频数据进行拆分,使空白原始音频数据ch01:16bit生成拆分音频数据ch01:high 8bit、 ch01:low 8bit;使空白原始音频数据ch02:16bit生成拆分音频数据ch02:high8bit、ch02:low 8bit;使空白原始音频数据ch03:16bit生成拆分音频数据ch03:high 8bit、ch03:low 8bit,以及使空白原始音频数据ch04:16bit生成拆分音频数据ch04:high 8bit、ch04:low 8bit。(3) The number of all original audio data is 8, that is, Q=8, and the total number of channels of all the first I2S bus interfaces is 4, that is, M=4. Then N=4. As shown in Figure 16, add 4 blank original audio data ch01:16bit, ch02:16bit, ch03:16bit, ch04:16bit to all original audio data, so that it can be included in all original audio data and the generated blank original audio data , Select the blank original audio data ch01:16bit, ch02:16bit, ch03:16bit, ch04:16bit, and split the original audio data, and make the blank original audio data ch01:16bit generate split audio data ch01:high 8bit, ch01 :low 8bit; make blank original audio data ch02:16bit generate split audio data ch02:high8bit, ch02:low 8bit; make blank original audio data ch03:16bit generate split audio data ch03:high 8bit, ch03:low 8bit, and Let the blank original audio data ch04:16bit generate split audio data ch04:high 8bit and ch04:low 8bit.
(4)结合图16与图17所示,将原始音频数据ch0:16bit、ch1:16bit与拆分音频数据ch01:high 8bit、ch01:low 8bit拼接为目标音频数据SD1_0,将原始音频数据ch2:16bit、ch3:16bit与拆分音频数据ch02:high 8bit、ch02:low 8bit拼接为目标音频数据SD2_0,将原始音频数据ch4:16bit、ch5:16bit与拆分音频数据ch03:high 8bit、ch03:low 8bit拼接为目标音频数据SD1_1,将原始音频数据ch6:16bit、ch7:16bit与拆分音频数据ch04:high 8bit、ch04:low 8bit拼接为目标音频数据SD2_1。(4) As shown in Figure 16 and Figure 17, the original audio data ch0: 16bit, ch1: 16bit and the split audio data ch01: high 8bit, ch01: low 8bit are spliced into the target audio data SD1_0, and the original audio data ch2: 16bit, ch3: 16bit and split audio data ch02: high 8bit, ch02: low 8bit are spliced into the target audio data SD2_0, and the original audio data ch4: 16bit, ch5: 16bit and the split audio data ch03: high 8bit, ch03: low 8bit is spliced into the target audio data SD1_1, and the original audio data ch6:16bit, ch7:16bit and the split audio data ch04:high 8bit, ch04:low 8bit are spliced into the target audio data SD2_1.
以目标音频数据SD1_0为例,可以在ch0:16bit的最低位后面拼接ch01:high 8bit,并在ch01:high 8bit的最低位后面拼接ch1:16bit的最高位,在ch1:16bit的最低位后面拼接ch01:low 8bit的最低位。其他同理,依此类推,在此不作限定。Taking the target audio data SD1_0 as an example, you can splice ch01:high 8bit after the lowest bit of ch0:16bit, and splice the highest bit of ch1:16bit after the lowest bit of ch01:high 8bit, and splice after the lowest bit of ch1:16bit ch01:low The lowest bit of 8bit. Others are the same, and so on, without limitation here.
(5)结合图16与图17所示,一个目标音频数据的数据位由原始音频数据的16bit改变为48bit,因此可以改变第一位时钟BCLK1的采样位数与采样频率,使目标音频数据根据第一位时钟BCLK1传输。并且,在第一位时钟BCLK1的每一个周期内的上升沿和下降沿传输一个数据位。(5) As shown in Figure 16 and Figure 17, the data bit of a target audio data is changed from 16bit of the original audio data to 48bit. Therefore, the sampling number and sampling frequency of the first clock BCLK1 can be changed to make the target audio data according to The first bit clock BCLK1 is transmitted. In addition, one data bit is transmitted on the rising edge and the falling edge of each cycle of the first bit clock BCLK1.
在WS1=0时,控制第一I2S总线接口I2S_0对应左声道的通道传输目标音频数据SD1_0。具体地,在第一帧时钟WS1下降沿后的第2个第一位时钟BCLK1开始,按照第一位时钟BCLK1传输目标音频数据SD1_0,使目标音频 数据SD1_0采用第一I2S总线接口I2S_0的左声道对应的通道输出。其中,在传输目标音频数据SD1_0时,先从最高位开始依次传输原始音频数据ch0:16bit,之后再从最高位开始依次传输拆分音频数据ch01:high 16bit,之后再从最高位开始依次传输原始音频数据ch1:16bit,之后再从最高位开始依次传输拆分音频数据ch01:low 16bit。When WS1=0, the channel of the first I2S bus interface I2S_0 corresponding to the left channel is controlled to transmit the target audio data SD1_0. Specifically, starting from the second first bit clock BCLK1 after the falling edge of the first frame clock WS1, the target audio data SD1_0 is transmitted according to the first bit clock BCLK1, so that the target audio data SD1_0 adopts the left sound of the first I2S bus interface I2S_0 Channel output corresponding to the channel. Among them, when the target audio data SD1_0 is transmitted, the original audio data ch0: 16bit is transmitted sequentially from the highest bit, and then the split audio data ch01: high 16bit is transmitted sequentially from the highest bit, and then the original audio data ch01: high 16bit is transmitted sequentially from the highest bit. The audio data ch1: 16bit, and then the split audio data ch01: low 16bit is transmitted sequentially starting from the highest bit.
在WS1=1时,控制第一I2S总线接口I2S_0对应右声道的通道传输目标音频数据SD2_0。具体地,在第一帧时钟WS1上升沿后的第2个第一位时钟BCLK1开始,按照第一位时钟BCLK1传输目标音频数据SD2_0,使目标音频数据SD2_0采用第一I2S总线接口I2S_0的右声道对应的通道输出。其中,在传输目标音频数据SD2_0时,先从最高位开始依次传输原始音频数据ch2:16bit,之后再从最高位开始依次传输拆分音频数据ch02:high 16bit,之后再从最高位开始依次传输原始音频数据ch3:16bit,之后再从最高位开始依次传输拆分音频数据ch02:low 16bit。When WS1=1, the channel of the first I2S bus interface I2S_0 corresponding to the right channel is controlled to transmit the target audio data SD2_0. Specifically, starting from the second first bit clock BCLK1 after the rising edge of the first frame clock WS1, the target audio data SD2_0 is transmitted according to the first bit clock BCLK1, so that the target audio data SD2_0 adopts the right sound of the first I2S bus interface I2S_0 Channel output corresponding to the channel. Among them, when the target audio data SD2_0 is transmitted, the original audio data ch2: 16bit is transmitted sequentially from the highest bit, and then the split audio data ch02: high 16bit is transmitted sequentially from the highest bit, and then the original audio data ch02: high 16bit is transmitted sequentially from the highest bit. Audio data ch3: 16bit, and then sequentially transmit the split audio data ch02: low 16bit from the highest bit.
同理,在WS1=0时,控制第一I2S总线接口I2S_1对应左声道的通道传输目标音频数据SD1_1。在WS1=1时,控制第一I2S总线接口I2S_1对应右声道的通道传输目标音频数据SD2_1。Similarly, when WS1=0, the channel of the first I2S bus interface I2S_1 corresponding to the left channel is controlled to transmit the target audio data SD1_1. When WS1=1, the channel of the first I2S bus interface I2S_1 corresponding to the right channel is controlled to transmit the target audio data SD2_1.
并且,在WS1=0时,控制第一I2S总线接口I2S_2对应左声道的通道传输目标音频数据SD1_2。在WS1=1时,控制第一I2S总线接口I2S_2对应右声道的通道传输目标音频数据SD2_2。In addition, when WS1=0, the channel of the first I2S bus interface I2S_2 corresponding to the left channel is controlled to transmit the target audio data SD1_2. When WS1=1, the channel of the first I2S bus interface I2S_2 corresponding to the right channel is controlled to transmit the target audio data SD2_2.
(6)结合图16至图19所示,控制第二帧时钟WS2的时序与第一帧时钟WS1的时序相同,第二位时钟BCLK2的时序与第一位时钟BCLK1的时序相同。(6) As shown in FIGS. 16 to 19, the timing of controlling the second frame clock WS2 is the same as that of the first frame clock WS1, and the timing of the second bit clock BCLK2 is the same as that of the first bit clock BCLK1.
根据第二帧时钟WS2和第二位时钟BCLK2,控制接收第一I2S总线接口 I2S_0传输的目标音频数据SD1_0和SD2_0,控制接收第一I2S总线接口I2S_1传输的目标音频数据SD1_1和SD2_1,以及控制接收第一I2S总线接口I2S_2传输的目标音频数据SD1_2和SD2_2。According to the second frame clock WS2 and the second bit clock BCLK2, control to receive the target audio data SD1_0 and SD2_0 transmitted by the first I2S bus interface I2S_0, control to receive the target audio data SD1_1 and SD2_1 transmitted by the first I2S bus interface I2S_1, and control the reception The target audio data SD1_2 and SD2_2 transmitted by the first I2S bus interface I2S_2.
并根据上述预设编码规则,采用预设时钟信号YCLK分别截取目标音频数据SD1_0、SD2_0、SD1_1、SD2_1中的前16bit的数据,即分别截取到原始音频数据ch0:16bit、ch2:16bit、ch4:16bit、ch6:16bit,并将原始音频数据ch0:16bit存放在第一个第二I2S总线接口的对应左声道的通道堆栈中,将原始音频数据ch2:16bit存放在第二个第二I2S总线接口的对应左声道的通道堆栈中,将原始音频数据ch4:16bit存放在第三个第二I2S总线接口的对应左声道的通道堆栈中,将原始音频数据ch6:16bit存放在第四个第二I2S总线接口的对应左声道的通道堆栈中。从而还原出来原始音频数据ch0:16bit、ch2:16bit、ch4:16bit、ch6:16bit。And according to the above preset coding rules, the preset clock signal YCLK is used to intercept the first 16 bits of the target audio data SD1_0, SD2_0, SD1_1, and SD2_1 respectively, that is, to intercept the original audio data ch0: 16bit, ch2: 16bit, ch4: 16bit, ch6:16bit, and store the original audio data ch0:16bit in the channel stack corresponding to the left channel of the first second I2S bus interface, and store the original audio data ch2:16bit in the second second I2S bus In the channel stack corresponding to the left channel of the interface, store the original audio data ch4:16bit in the channel stack corresponding to the left channel of the third second I2S bus interface, and store the original audio data ch6:16bit in the fourth In the channel stack corresponding to the left channel of the second I2S bus interface. Thus, the original audio data ch0:16bit, ch2:16bit, ch4:16bit, and ch6:16bit are restored.
之后,采用预设时钟信号YCLK分别截取目标音频数据SD1_0、SD2_0、SD1_1、SD2_1中的之后的8bit的数据,即分别截取到ch01:high 8bit、ch02:high8bit、ch04:high 8bit、ch06:high 8bit,可以直接将该数据删除。After that, the preset clock signal YCLK is used to intercept the next 8bit data of the target audio data SD1_0, SD2_0, SD1_1, SD2_1 respectively, that is, to intercept ch01: high 8bit, ch02: high 8bit, ch04: high 8bit, ch06: high 8bit. , You can delete the data directly.
之后,采用预设时钟信号YCLK分别截取目标音频数据SD1_0、SD2_0、SD1_1、SD2_1中的之后的16bit的数据,即分别截取到原始音频数据ch1:16bit、ch3:16bit、ch5:16bit、ch7:16bit,并将原始音频数据ch1:16bit存放在第一个第二I2S总线接口的对应右声道的通道堆栈中,将原始音频数据ch3:16bit存放在第二个第二I2S总线接口的对应右声道的通道堆栈中,将原始音频数据ch5:16bit存放在第三个第二I2S总线接口的对应右声道的通道堆栈中,将原始音频数据ch7:16bit存放在第四个第二I2S总线接口的对应右声道的通道堆栈中。 从而还原出来原始音频数据ch1:16bit、ch3:16bit、ch5:16bit、ch7:16bit。After that, the preset clock signal YCLK is used to intercept the subsequent 16bit data in the target audio data SD1_0, SD2_0, SD1_1, SD2_1, that is, the original audio data ch1:16bit, ch3:16bit, ch5:16bit, ch7:16bit are respectively intercepted , And store the original audio data ch1:16bit in the channel stack corresponding to the right channel of the first second I2S bus interface, and store the original audio data ch3:16bit in the corresponding right sound of the second second I2S bus interface In the channel stack of the channel, store the original audio data ch5:16bit in the channel stack of the third second I2S bus interface corresponding to the right channel, and store the original audio data ch7:16bit in the fourth second I2S bus interface Corresponding to the channel stack of the right channel. Thereby, the original audio data ch1:16bit, ch3:16bit, ch5:16bit, ch7:16bit are restored.
之后可以直接将删除的SD1_0、SD2_0、SD1_1、SD2_1中的数据删除。You can directly delete the deleted data in SD1_0, SD2_0, SD1_1, and SD2_1 afterwards.
基于同一申请构思,本申请实施例还提供了一种音频处理装置,如图20所示,包括:Based on the same application concept, an embodiment of the present application also provides an audio processing device, as shown in FIG. 20, including:
至少2个第一I2S总线接口110;At least two first I2S bus interfaces 110;
接收电路120,用于接收具有多个声道的声源数据;The receiving circuit 120 is configured to receive sound source data with multiple channels;
初解码电路130,用于将声源数据解码出各声道对应的原始音频数据;The initial decoding circuit 130 is used to decode the sound source data to obtain the original audio data corresponding to each channel;
重编码电路140,与至少2个第一I2S总线接口电连接,用于根据预设编码规则将原始音频数据进行重新编码后,通过至少2个第一I2S总线接口输出;其中,声道的总数大于所有第一I2S总线接口的通道总数。The re-encoding circuit 140 is electrically connected to at least two first I2S bus interfaces, and is configured to re-encode the original audio data according to a preset encoding rule, and then output it through at least two first I2S bus interfaces; wherein, the total number of channels It is greater than the total number of channels of all the first I2S bus interfaces.
在本申请实施例中,如图20所示,音频处理装置还可以包括:与至少2个第一I2S总线接口150电连接的重解码电路150。该重解码电路150用于根据第二帧时钟和第二位时钟接收各第一I2S总线接口传输的目标音频数据,并根据预设编码规则将接收的数据进行重新解码,得到各原始音频数据;其中,第二帧时钟的时序与第一帧时钟的时序相同,第二位时钟的时序与第一位时钟的时序相同In the embodiment of the present application, as shown in FIG. 20, the audio processing device may further include: a re-decoding circuit 150 electrically connected to at least two first I2S bus interfaces 150. The re-decoding circuit 150 is configured to receive the target audio data transmitted by each first I2S bus interface according to the second frame clock and the second bit clock, and re-decode the received data according to a preset encoding rule to obtain each original audio data; Among them, the timing of the second frame clock is the same as the timing of the first frame clock, and the timing of the second bit clock is the same as the timing of the first bit clock
在本申请实施例中,如图20所示,重解码电路150通过多个第二I2S总线接口170将再次解码后的原始音频数据传输给多声道设备160。也就是说,重解码电路150可以通过多个第二I2S总线接口170与多声道设备160电连接。In the embodiment of the present application, as shown in FIG. 20, the re-decoding circuit 150 transmits the re-decoded original audio data to the multi-channel device 160 through the multiple second I2S bus interfaces 170. In other words, the re-decoding circuit 150 may be electrically connected to the multi-channel device 160 through a plurality of second I2S bus interfaces 170.
其中,该音频处理装置的工作原理和具体实施方式与上述实施例音频处理方法的原理和实施方式相同,因此,该音频处理装置的工作方法可参见上述实施例中音频处理方法的具体实施方式进行实施,在此不再赘述。The working principle and specific implementation of the audio processing device are the same as the principles and implementations of the audio processing method in the foregoing embodiment. Therefore, the working method of the audio processing device can refer to the specific implementation of the audio processing method in the foregoing embodiment. Implementation, I will not repeat it here.
在本申请实施例中,上述各电路可采用完全硬件实施例、完全软件实施例、或结合软件和硬件方面的实施例的形式。示例性地,初解码电路可以为能够实现其功能的解码器。重编码电路可以为能够实现其功能的编码器。重解码电路可以为能够实现其功能的解码器或XMOS芯片。进一步地,上述第一I2S总线接口、接收电路、初解码电路以及重编码电路可以形成主芯片。In the embodiments of the present application, each of the foregoing circuits may adopt a form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Exemplarily, the primary decoding circuit may be a decoder capable of realizing its function. The re-encoding circuit may be an encoder capable of realizing its function. The re-decoding circuit can be a decoder or XMOS chip capable of realizing its function. Further, the above-mentioned first I2S bus interface, receiving circuit, initial decoding circuit and re-encoding circuit may form a main chip.
基于同一申请构思,本申请实施例还提供了一种多声道系统,包括多声道设备以及本申请实施例提供的上述音频处理装置。该多声道系统解决问题的原理与前述音频处理装置相似,因此该多声道系统的实施可以参见前述音频处理装置的实施,重复之处在此不再赘述。Based on the same application concept, an embodiment of the present application also provides a multi-channel system, including a multi-channel device and the audio processing device provided in the embodiment of the present application. The problem-solving principle of the multi-channel system is similar to that of the aforementioned audio processing device. Therefore, the implementation of the multi-channel system can refer to the implementation of the aforementioned audio processing device, and the repetition is not repeated here.
在本申请实施例中,多声道设备可以为电视机、笔记本电脑等任何具有显示功能的产品或部件,在此不作限定。In the embodiment of the present application, the multi-channel device may be any product or component with a display function, such as a television, a notebook computer, etc., which is not limited herein.
基于同一申请构思,本申请实施例还提供了一种计算机可读存储介质,其上存储有计算机程序,并且该程序被处理器执行时实现本申请实施例提供的上述任一种音频处理方法的步骤。具体地,本申请可采用在一个或多个其中包含有计算机可用程序代码的计算机可用存储介质(包括但不限于磁盘存储器和光学存储器等)上实施的计算机程序产品的形式。Based on the same application concept, an embodiment of the application also provides a computer-readable storage medium on which a computer program is stored, and when the program is executed by a processor, it implements any of the audio processing methods provided in the embodiments of the application. step. Specifically, this application may adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, optical storage, etc.) containing computer-usable program codes.
基于同一申请构思,本申请实施例还提供了一种计算机设备,包括存储器、处理器及存储在存储器上并可在处理器上运行的计算机程序,处理器执行程序时实现本申请实施例提供的上述任一种音频处理方法的步骤。Based on the same application concept, an embodiment of the present application also provides a computer device, including a memory, a processor, and a computer program stored on the memory and running on the processor. The processor executes the program to implement the Steps of any of the above audio processing methods.
图21是本申请实施例一提供的显示设备示意图,参考图21,本申请还提供一种显示设备,至少包括:显示屏91,被配置为呈现图像数据;扬声器92,被配置为再现声音数据。FIG. 21 is a schematic diagram of a display device provided in Embodiment 1 of the present application. With reference to FIG. 21, the present application also provides a display device, which at least includes: a display screen 91 configured to present image data; and a speaker 92 configured to reproduce sound data .
在一些实施示例中,显示设备还可以包括:背光组件94,背光组件94位于显示屏91下方。通常是一些光学组件,用于供应充足的亮度与分布均匀的光源,使显示屏91能正常显示影像。在一些相关技术中,背光组件可以包括LED灯条,还可以包括自动发光的灯板。In some implementation examples, the display device may further include: a backlight assembly 94 located below the display screen 91. Usually some optical components are used to supply sufficient brightness and uniformly distributed light sources so that the display screen 91 can display images normally. In some related technologies, the backlight assembly may include an LED light bar or a light panel that automatically emits light.
在一些实施例中,显示设备还可以包括:背板95,通常背板95上面冲压形成一些凸包结构,扬声器92等器件,通过螺钉或者挂钩固定在凸包上。In some embodiments, the display device may further include: a back plate 95. Usually, the back plate 95 is stamped to form some convex structures, and components such as speakers 92 are fixed on the convex structures by screws or hooks.
在一些实施例中,显示设备还可以包括:后壳98,其盖设在显示屏91的背面上,以隐藏背光组件94,扬声器92等显示装置的零部件,起到美观的效果。In some embodiments, the display device may further include: a rear case 98, which is covered on the back of the display screen 91 to hide the backlight assembly 94, the speaker 92 and other display device components, which has a beautiful effect.
在一些实施例中,显示设备还可以包括:主板96和电源板97,他们可以独立成两块板子设置,也可以是合并在一块板子上。In some embodiments, the display device may further include: a main board 96 and a power supply board 97, which can be arranged as two boards independently, or they can be combined on one board.
在一些实施例中,显示设备还包括遥控器93。In some embodiments, the display device further includes a remote control 93.
图22是本申请实施例一提供的显示设备的硬件配置框图。如22所示,显示设备200中可以包括调谐解调器220、通信器230、检测器240、外部装置接口250、控制器210、存储器290、用户输入接口、视频处理器260-1、音频处理器260-2、显示屏280、音频输入接口272、供电电源。FIG. 22 is a block diagram of the hardware configuration of the display device provided in Embodiment 1 of the present application. As shown in 22, the display device 200 may include a tuner and demodulator 220, a communicator 230, a detector 240, an external device interface 250, a controller 210, a memory 290, a user input interface, a video processor 260-1, and audio processing 260-2, display screen 280, audio input interface 272, power supply.
调谐解调器220,通过有线或无线方式接收广播电视信号,可以进行放大、混频和谐振等调制解调处理,用于从多个无线或有线广播电视信号中解调出用户所选择电视频道的频率中所携带的音视频信号,以及附加信息(例如EPG数据信号)。The tuner and demodulator 220, which receives broadcast and television signals through wired or wireless means, can perform modulation and demodulation processing such as amplification, mixing and resonance, and is used to demodulate the television channel selected by the user from multiple wireless or cable broadcast and television signals The audio and video signals carried in the frequency, and additional information (such as EPG data signals).
调谐解调器220,可根据用户选择,以及由控制器210控制,响应用户选择的电视频道频率以及该频率所携带的电视信号。The tuner and demodulator 220 can be selected by the user and controlled by the controller 210 to respond to the TV channel frequency selected by the user and the TV signal carried by the frequency.
调谐解调器220,根据电视信号广播制式不同,可以接收信号的途径有很多种,诸如:地面广播、有线广播、卫星广播或互联网广播等;以及根据调制类型不同,可以数字调制方式,也可以模拟调制方式;以及根据接收电视信号种类不同,可以解调模拟信号和数字信号。The tuner and demodulator 220 can receive signals in many ways according to different TV signal broadcasting systems, such as terrestrial broadcasting, cable broadcasting, satellite broadcasting, or Internet broadcasting; and according to different modulation types, it can be digital modulation or alternatively. Analog modulation method; and according to different types of received TV signals, analog and digital signals can be demodulated.
在其他一些示例性实施例中,调谐解调器220也可在外置设备中,如外置机顶盒等。这样,机顶盒通过调制解调后输出电视音视频信号,经过输入/输出接口250输入至显示设备200中。In some other exemplary embodiments, the tuner demodulator 220 may also be in an external device, such as an external set-top box. In this way, the set-top box outputs TV audio and video signals through modulation and demodulation, and inputs them to the display device 200 through the input/output interface 250.
通信器230是用于根据各种通信协议类型与外部设备或外部服务器进行通信的组件。例如:通信器230可以包括WIFI模块231,蓝牙通信协议模块232,有线以太网通信协议模块233等其他网络通信协议模块或近场通信协议模块。The communicator 230 is a component for communicating with external devices or external servers according to various communication protocol types. For example, the communicator 230 may include a WIFI module 231, a Bluetooth communication protocol module 232, a wired Ethernet communication protocol module 233 and other network communication protocol modules or near field communication protocol modules.
显示设备200可以通过通信器230与外部控制设备或内容提供设备之间建立控制信号和数据信号的连接。例如,通信器可根据控制器的控制接收遥控器100的控制信号。The display device 200 may establish a control signal and a data signal connection with an external control device or content providing device through the communicator 230. For example, the communicator may receive the control signal of the remote controller 100 according to the control of the controller.
检测器240,是显示设备200用于采集外部环境或与外部交互的信号的组件。检测器240可以包括光接收器242,用于采集环境光线强度的传感器,可以通过采集环境光来自适应显示参数变化等;还可以包括图像采集器241,如相机、摄像头等,可以用于采集外部环境场景,以及用于采集用户的属性或与用户交互手势,可以自适应变化显示参数,也可以识别用户手势,以实现与用户之间互动的功能。The detector 240 is a component of the display device 200 for collecting signals from the external environment or interacting with the outside. The detector 240 may include a light receiver 242, a sensor used to collect the intensity of ambient light, which can adaptively display parameter changes by collecting ambient light, etc.; it may also include an image collector 241, such as a camera, a camera, etc., which can be used to collect external Environmental scenes, as well as gestures used to collect user attributes or interact with users, can adaptively change display parameters, and can also recognize user gestures to achieve the function of interaction with users.
在其他一些示例性实施例中,检测器240,还可包括温度传感器,如通过感测环境温度,显示设备200可自适应调整图像的显示色温。In some other exemplary embodiments, the detector 240 may further include a temperature sensor. For example, by sensing the ambient temperature, the display device 200 may adaptively adjust the display color temperature of the image.
在一些实施例中,当温度偏高的环境时,可调整显示设备200显示图像色 温偏冷色调;当温度偏低的环境时,可以调整显示设备200显示图像色温偏暖色调。In some embodiments, when the temperature is relatively high, the color temperature of the display device 200 can be adjusted to be relatively cool; when the temperature is relatively low, the color temperature of the display device 200 can be adjusted to be relatively warm.
在其他一些示例性实施例中,检测器240还可包括声音采集器,如麦克风,可以用于接收用户的声音,包括用户控制显示设备200的控制指令的语音信号,或采集环境声音,用于识别环境场景类型,显示设备200可以自适应环境噪声。In some other exemplary embodiments, the detector 240 may also include a sound collector, such as a microphone, which may be used to receive the user's voice, including the voice signal of the user's control instruction for controlling the display device 200, or to collect environmental sound for Recognizing the environmental scene type, the display device 200 can adapt to the environmental noise.
外部装置接口250,提供控制器210控制显示设备200与外部其他设备间数据传输的组件。外部装置接口可按照有线/无线方式与诸如机顶盒、游戏装置、笔记本电脑等的外部设备连接,可接收外部设备的诸如视频信号(例如运动图像)、音频信号(例如音乐)、附加信息(例如EPG)等数据。The external device interface 250 provides a component for the controller 210 to control data transmission between the display device 200 and other external devices. The external device interface can be connected to external devices such as set-top boxes, game devices, notebook computers, etc. in a wired/wireless manner, and can receive external devices such as video signals (such as moving images), audio signals (such as music), and additional information (such as EPG). ) And other data.
其中,外部装置接口250可以包括:高清多媒体接口(HDMI)端子251、复合视频消隐同步(CVBS)端子252、模拟或数字分量端子253、通用串行总线(USB)端子254、红绿蓝(RGB)端子(图中未示出)等任一个或多个。Among them, the external device interface 250 may include: a high-definition multimedia interface (HDMI) terminal 251, a composite video blanking synchronization (CVBS) terminal 252, an analog or digital component terminal 253, a universal serial bus (USB) terminal 254, red, green, and blue ( RGB) terminal (not shown in the figure) and any one or more.
控制器210,通过运行存储在存储器290上的各种软件控制程序(如操作系统和各种应用程序),来控制显示设备200的工作和响应用户的操作。The controller 210 controls the work of the display device 200 and responds to user operations by running various software control programs (such as an operating system and various application programs) stored on the memory 290.
如图22所示,控制器210包括随机存取存储器RAM213、只读存储器ROM214、图形处理器216、CPU处理器212、通信接口218、以及通信总线。其中,RAM213和ROM214以及图形处理器216、CPU处理器212、通信接口218通过总线相连接。As shown in FIG. 22, the controller 210 includes a random access memory RAM 213, a read only memory ROM 214, a graphics processor 216, a CPU processor 212, a communication interface 218, and a communication bus. Among them, RAM213 and ROM214, graphics processor 216, CPU processor 212, and communication interface 218 are connected by a bus.
ROM213,用于存储各种系统启动的指令。如在收到开机信号时,显示设备200电源开始启动,CPU处理器212运行ROM中系统启动指令,将存储在存储器290的操作系统拷贝至RAM214中,以开始运行启动操作系统。当操作系统启动完成后,CPU处理器212再将存储器290中各种应用程序拷贝至 RAM214中,然后,开始运行启动各种应用程序。ROM213, used to store various system startup instructions. For example, when the power-on signal is received, the power of the display device 200 starts to start, and the CPU processor 212 runs the system start-up instruction in the ROM, and copies the operating system stored in the memory 290 to the RAM 214 to start the start-up operating system. After the operating system is started up, the CPU processor 212 copies various application programs in the memory 290 to the RAM 214, and then starts to run and start various application programs.
图形处理器216,用于产生各种图形对象,如:图标、操作菜单、以及用户输入指令显示图形等。包括运算器,通过接收用户输入各种交互指令进行运算,根据显示属性显示各种对象。以及包括渲染器,产生基于运算器得到的各种对象,进行渲染的结果显示在显示屏280上。The graphics processor 216 is used to generate various graphics objects, such as icons, operation menus, and user input instructions to display graphics. Including an arithmetic unit, which performs operations by receiving various interactive commands input by the user, and displays various objects according to display attributes. As well as including a renderer, various objects obtained based on the arithmetic unit are generated, and the rendering result is displayed on the display screen 280.
CPU处理器212,用于执行存储在存储器290中操作系统和应用程序指令。以及根据接收外部输入的各种交互指令,来执行各种应用程序、数据和内容,以便最终显示和播放各种音视频内容。The CPU processor 212 is configured to execute operating system and application program instructions stored in the memory 290. And according to receiving various interactive instructions input from the outside, to execute various applications, data and content, so as to finally display and play various audio and video content.
在一些示例性实施例中,CPU处理器212,可以包括多个处理器。多个处理器可包括一个主处理器以及多个或一个子处理器。主处理器,用于在预加电模式中执行显示设备200一些操作,和/或在正常模式下显示画面的操作。多个或一个子处理器,用于执行在待机模式等状态下的一种操作。In some exemplary embodiments, the CPU processor 212 may include multiple processors. The multiple processors may include one main processor and multiple or one sub-processors. The main processor is used to perform some operations of the display device 200 in the pre-power-on mode, and/or to display images in the normal mode. Multiple or one sub-processor, used to perform an operation in the standby mode and other states.
通信接口,可包括第一接口218-1到第n接口218-n。这些接口可以是经由网络被连接到外部设备的网络接口。The communication interface may include the first interface 218-1 to the nth interface 218-n. These interfaces may be network interfaces connected to external devices via a network.
控制器210可以控制显示设备200的整体操作。例如:响应于接收到用于选择在显示屏280上显示UI对象的用户命令,控制器210便可以执行与由用户命令选择的对象有关的操作。The controller 210 may control the overall operation of the display device 200. For example, in response to receiving a user command for selecting a UI object to be displayed on the display screen 280, the controller 210 may perform an operation related to the object selected by the user command.
其中,所述对象可以是可选对象中的任何一个,例如超链接或图标。与所选择的对象有关操作,例如:显示连接到超链接页面、文档、图像等操作,或者执行与图标相对应程序的操作。用于选择UI对象用户命令,可以是通过连接到显示设备200的各种输入装置(例如,鼠标、键盘、触摸板等)输入命令或者与由用户说出语音相对应的语音命令。Wherein, the object may be any one of the selectable objects, such as a hyperlink or an icon. Operations related to the selected object, for example: display operations connected to hyperlink pages, documents, images, etc., or perform operations corresponding to the icon. The user command for selecting the UI object may be a command input through various input devices (for example, a mouse, a keyboard, a touch pad, etc.) connected to the display device 200 or a voice command corresponding to the voice spoken by the user.
存储器290,包括存储用于驱动和控制显示设备200的各种软件模块。如:存储器290中存储的各种软件模块,包括:基础模块、检测模块、通信模块、显示控制模块、浏览器模块、和各种服务模块等。The memory 290 includes storing various software modules for driving and controlling the display device 200. For example, various software modules stored in the memory 290 include: a basic module, a detection module, a communication module, a display control module, a browser module, and various service modules.
其中,基础模块是用于显示设备200中各个硬件之间信号通信、并向上层模块发送处理和控制信号的底层软件模块。检测模块是用于从各种传感器或用户输入接口中收集各种信息,并进行数模转换以及分析管理的管理模块。Among them, the basic module is the underlying software module used for signal communication between various hardware in the display device 200 and sending processing and control signals to the upper module. The detection module is a management module used to collect various information from various sensors or user input interfaces, and perform digital-to-analog conversion and analysis management.
例如:语音识别模块中包括语音解析模块和语音指令数据库模块。显示控制模块是用于控制显示屏280进行显示图像内容的模块,可以用于播放多媒体图像内容和UI界面等信息。通信模块,是用于与外部设备之间进行控制和数据通信的模块。浏览器模块,是用于执行浏览服务器之间数据通信的模块。服务模块,是用于提供各种服务以及各类应用程序在内的模块。For example: the voice recognition module includes a voice analysis module and a voice command database module. The display control module is a module for controlling the display screen 280 to display image content, and can be used to play information such as multimedia image content and UI interfaces. The communication module is a module used for control and data communication with external devices. The browser module is a module used to perform data communication between browsing servers. The service module is a module used to provide various services and various applications.
同时,存储器290还用于存储接收外部数据和用户数据、各种用户界面中各个项目的图像以及焦点对象的视觉效果图等。At the same time, the memory 290 is also used to store and receive external data and user data, images of various items in various user interfaces, and visual effect diagrams of focus objects.
用户输入接口276,用于将用户的输入信号发送给控制器210,或者,将从控制器输出的信号传送给用户。在一些实施例中,控制装置(例如移动终端或遥控器)可将用户输入的诸如电源开关信号、频道选择信号、音量调节信号等输入信号发送至用户输入接口,再由用户输入接口276转送至控制器;或者,控制装置可接收经控制器处理从用户输入接口输出的音频、视频或数据等输出信号,并且显示接收的输出信号或将接收的输出信号输出为音频或振动形式。The user input interface 276 is used to send a user's input signal to the controller 210, or to transmit a signal output from the controller to the user. In some embodiments, the control device (for example, a mobile terminal or a remote control) can send input signals input by the user, such as a power switch signal, a channel selection signal, and a volume adjustment signal, to the user input interface, and then the user input interface 276 forwards it to the user input interface. Controller; or, the control device may receive output signals such as audio, video or data output from the user input interface processed by the controller, and display the received output signal or output the received output signal as audio or vibration.
在一些实施例中,用户可在显示屏280上显示的图形用户界面(GUI)输入用户命令,则用户输入接口通过图形用户界面(GUI)接收用户输入命令。或者,用户可通过输入特定的声音或手势进行输入用户命令,则用户输入接口通 过传感器识别出声音或手势,来接收用户输入命令。In some embodiments, the user may input a user command on a graphical user interface (GUI) displayed on the display screen 280, and the user input interface receives the user input command through the graphical user interface (GUI). Alternatively, the user can input a user command by inputting a specific voice or gesture, and the user input interface recognizes the voice or gesture through the sensor to receive the user input command.
视频处理器260-1,用于接收视频信号,根据输入信号的标准编解码协议,进行解压缩、解码、缩放、降噪、帧率转换、分辨率转换、图像合成等视频数据处理,可得到直接在显示屏280上显示或播放的视频信号。The video processor 260-1 is used to receive video signals, and perform video data processing such as decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, and image synthesis according to the standard codec protocol of the input signal. The video signal directly displayed or played on the display screen 280.
在一些实施例中,视频处理器260-1,包括解复用模块、视频解码模块、图像合成模块、帧率转换模块、显示格式化模块等。In some embodiments, the video processor 260-1 includes a demultiplexing module, a video decoding module, an image synthesis module, a frame rate conversion module, a display formatting module, and the like.
其中,解复用模块,用于对输入音视频数据流进行解复用处理,如输入MPEG-2,则解复用模块进行解复用成视频信号和音频信号等。Among them, the demultiplexing module is used to demultiplex the input audio and video data stream. For example, if MPEG-2 is input, the demultiplexing module will demultiplex into a video signal and an audio signal.
视频解码模块,用于对解复用后的视频信号进行处理,包括解码和缩放处理等。The video decoding module is used to process the demultiplexed video signal, including decoding and scaling.
图像合成模块,如图像合成器,其用于将图形生成器根据用户输入或自身生成的GUI信号,与缩放处理后视频图像进行叠加混合处理,以生成可供显示的图像信号。An image synthesis module, such as an image synthesizer, is used to superimpose and mix the GUI signal generated by the graphics generator with the zoomed video image according to user input or itself to generate an image signal for display.
帧率转换模块,用于对输入视频的帧率进行转换,如将输入的24Hz、25Hz、30Hz、60Hz视频的帧率转换为60Hz、120Hz或240Hz的帧率,其中,输入帧率可以与源视频流有关,输出帧率可以与显示屏的更新率有关。输入有通常的格式采用如插帧方式实现。Frame rate conversion module, used to convert the frame rate of the input video, such as converting the frame rate of the input 24Hz, 25Hz, 30Hz, 60Hz video to the frame rate of 60Hz, 120Hz or 240Hz, where the input frame rate can be compared with the source The video stream is related, and the output frame rate can be related to the update rate of the display. The input has a usual format, such as frame insertion.
显示格式化模块,用于将帧率转换模块输出的信号,改变为符合诸如显示器显示格式的信号,如将帧率转换模块输出的信号进行格式转换以输出RGB数据信号。The display formatting module is used to change the signal output by the frame rate conversion module into a signal that conforms to a display format such as a display, such as format conversion of the signal output by the frame rate conversion module to output RGB data signals.
显示屏280,用于接收源自视频处理器260-1输入的图像信号,进行显示视频内容和图像以及菜单操控界面。显示屏280包括用于呈现画面的显示屏组 件以及驱动图像显示的驱动组件。显示视频内容,可以来自调谐解调器220接收的广播信号中的视频,也可以来自通信器或外部设备接口输入的视频内容。显示屏280,同时显示显示设备200中产生且用于控制显示设备200的用户操控界面UI。The display screen 280 is used to receive image signals input from the video processor 260-1, to display video content and images, and a menu control interface. The display screen 280 includes a display screen component for presenting a picture and a driving component for driving image display. The displayed video content can be from the video in the broadcast signal received by the tuner and demodulator 220, or from the video content input by the communicator or the external device interface. The display screen 280 simultaneously displays a user manipulation interface UI generated in the display device 200 and used to control the display device 200.
以及,根据显示屏280类型不同,还包括用于驱动显示的驱动组件。或者,倘若显示屏280为一种投影显示器,还可以包括一种投影装置和投影屏幕。And, depending on the type of the display screen 280, a driving component for driving the display is also included. Alternatively, if the display screen 280 is a projection display, it may also include a projection device and a projection screen.
音频处理器260-2,用于接收音频信号,根据输入信号的标准编解码协议,进行解压缩和解码,以及降噪、数模转换、和放大处理等音频数据处理,得到可以在扬声器272中播放的音频信号。The audio processor 260-2 is used to receive audio signals, and perform decompression and decoding according to the standard codec protocol of the input signal, as well as audio data processing such as noise reduction, digital-to-analog conversion, and amplification processing, and the result can be in the speaker 272 The audio signal to be played.
音频输出接口270,用于在控制器210的控制下接收音频处理器260-2输出的音频信号,音频输出接口可包括扬声器272,或输出至外接设备的发生装置的外接音响输出端子274,如:外接音响端子或耳机输出端子等。The audio output interface 270 is used to receive the audio signal output by the audio processor 260-2 under the control of the controller 210. The audio output interface may include a speaker 272 or output to an external audio output terminal 274 of a generator of an external device, such as : External audio terminal or headphone output terminal, etc.
在其他一些示例性实施例中,视频处理器260-1可以包括一个或多个芯片组成。音频处理器260-2,也可以包括一个或多个芯片组成。In some other exemplary embodiments, the video processor 260-1 may include one or more chips. The audio processor 260-2 may also include one or more chips.
以及,在其他一些示例性实施例中,视频处理器260-1和音频处理器260-2,可以为单独的芯片,也可以与控制器210一起集成在一个或多个芯片中。And, in some other exemplary embodiments, the video processor 260-1 and the audio processor 260-2 may be separate chips, or they may be integrated with the controller 210 in one or more chips.
供电电源275,用于在控制器210控制下,将外部电源输入的电力为显示设备200提供电源供电支持。供电电源275可以包括安装显示设备200内部的内置电源电路,也可以是安装在显示设备200外部的电源,如在显示设备200中提供外接电源的电源接口。The power supply 275 is used to provide power supply support for the display device 200 with power input from an external power supply under the control of the controller 210. The power supply 275 may include a built-in power supply circuit installed inside the display device 200, or may be a power supply installed outside the display device 200, such as a power interface for providing an external power supply in the display device 200.
本申请实施例还提供一种显示设备,包括:An embodiment of the present application also provides a display device, including:
显示屏,被配置为呈现图像数据;The display screen is configured to present image data;
扬声器,被配置为再现声音数据;The speaker is configured to reproduce sound data;
音频处理器,被配置为接收具有多个声道的声源数据,将所述声源数据解码出各所述声道对应的原始音频数据;An audio processor, configured to receive sound source data having multiple channels, and decode the sound source data to obtain original audio data corresponding to each of the channels;
控制器,被配置为根据预设编码规则将所述原始音频数据进行重新编码后,通过至少2个第一I2S总线接口输出给所述扬声器;A controller, configured to re-encode the original audio data according to a preset encoding rule, and output to the speaker through at least two first I2S bus interfaces;
其中,所述声道的总数大于所有所述第一I2S总线接口的通道总数。Wherein, the total number of channels is greater than the total number of channels of all the first I2S bus interfaces.
在一些实施例中,控制器还被配置为,根据所有所述原始音频数据、所有所述第一I2S总线接口的通道总数,以及所述第一I2S总线接口的每个通道的通信规则,确定每个所述第一I2S总线接口的每个通道对应的目标音频数据;其中,所述目标音频数据的数据位大于所述原始音频数据的数据位;将得到的所述目标音频数据通过对应的第一I2S总线接口的通道输出。In some embodiments, the controller is further configured to determine according to all the original audio data, the total number of channels of all the first I2S bus interfaces, and the communication rules of each channel of the first I2S bus interface The target audio data corresponding to each channel of each of the first I2S bus interface; wherein the data bits of the target audio data are larger than the data bits of the original audio data; the obtained target audio data is passed through the corresponding Channel output of the first I2S bus interface.
在一些实施例中,控制器还被配置为,在确定所有所述原始音频数据的数量Q满足公式:时,将个原始音频数据组合为一个所述目标音频数据;其中,N为正偶数,M代表所有所述第一I2S总线接口的通道总数;或者,In some embodiments, the controller is further configured to, when determining that the quantity Q of all the original audio data satisfies the formula:, combine the original audio data into one target audio data; where N is a positive even number, M represents the total number of channels of all the first I2S bus interfaces; or,
在确定所有所述原始音频数据的数量Q满足公式:时,在所有所述原始音频数据中增加与相同数量的空白原始音频数据,并在所有所述原始音频数据和生成的所述空白原始音频数据中选取个原始音频数据进行拆分,生成拆分音频数据;其中,N为正偶数,M代表所有所述第一I2S总线接口的通道总数,所述空白原始音频数据的数据位与所述原始音频数据的数据位相同;When it is determined that the quantity Q of all the original audio data satisfies the formula:, add the same amount of blank original audio data to all the original audio data, and add the same amount of blank original audio data to all the original audio data and the generated blank original audio Select one piece of original audio data from the data to split to generate split audio data; where N is a positive even number, M represents the total number of channels of all the first I2S bus interface, and the data bits of the blank original audio data are the same as those of the The data bits of the original audio data are the same;
将个原始音频数据和个拆分音频数据组合为一个所述目标音频数据。Combine pieces of original audio data and pieces of split audio data into one target audio data.
在一些实施例中,选取进行拆分的原始音频数据包括:空白原始音频数据。In some embodiments, the original audio data selected for splitting includes: blank original audio data.
在一些实施例中,在确定所有所述原始音频数据的数量Q满足公式:且时, 则在所有所述原始音频数据中增加与相同数量的空白原始音频数据,并在所有所述原始音频数据和生成的所述空白原始音频数据中选取个原始音频数据进行拆分,生成拆分音频数据;其中,N为正偶数,M代表所有所述第一I2S总线接口的通道总数,所述空白原始音频数据的数据位与所述原始音频数据的数据位相同;In some embodiments, when it is determined that the quantity Q of all the original audio data satisfies the formula: and, then the same number of blank original audio data is added to all the original audio data, and all the original audio data And the generated blank original audio data, select one original audio data to split to generate split audio data; where N is a positive even number, M represents the total number of channels of all the first I2S bus interfaces, and the blank original The data bits of the audio data are the same as the data bits of the original audio data;
将个原始音频数据和个拆分音频数据组合为一个所述目标音频数据。Combine pieces of original audio data and pieces of split audio data into one target audio data.
在一些实施例中,在确定所有所述原始音频数据的数量Q满足公式:时,则在所有所述原始音频数据中选取个原始音频数据进行拆分,生成拆分音频数据;其中,N为正偶数,M代表所有所述第一I2S总线接口的通道总数;In some embodiments, when it is determined that the quantity Q of all the original audio data satisfies the formula:, then select one original audio data from all the original audio data for splitting to generate split audio data; where N is A positive even number, M represents the total number of channels of all the first I2S bus interfaces;
将个原始音频数据和个拆分音频数据拼接为一个所述目标音频数据。Splicing pieces of original audio data and pieces of split audio data into one target audio data.
在一些实施例中,所述原始音频数据为具有K个数据位的数字信号,一个所述拆分音频数据为具有相邻的个数据位的数字信号;其中,K为正整数。In some embodiments, the original audio data is a digital signal with K data bits, and one piece of the split audio data is a digital signal with adjacent data bits; where K is a positive integer.
在一些实施例中,改变第一位时钟的采样位数和/或改变所述第一位时钟的采样频率,在第一帧时钟发生沿变化后的第2个第一位时钟的脉冲开始,按照所述第一位时钟传输单个声道的数据位,使每一个所述第一I2S总线接口在一个所述第一帧时钟的一个周期内传输两个声道的目标音频数据。In some embodiments, changing the sampling number of the first bit clock and/or changing the sampling frequency of the first bit clock starts at the second pulse of the first bit clock after the edge change of the first frame clock, The data bits of a single channel are transmitted according to the first bit clock, so that each of the first I2S bus interfaces transmits two channels of target audio data in one cycle of the first frame clock.
在一些实施例中,所述第一位时钟的一个周期传输两个数据位;或者,所述第一位时钟的一个周期传输一个数据位。In some embodiments, one cycle of the first bit clock transmits two data bits; or, one cycle of the first bit clock transmits one data bit.
上述具体实现方式可以参考前文的实施例的介绍,这里不再展开说明。For the foregoing specific implementation manner, reference may be made to the introduction of the foregoing embodiment, and no further description is provided here.
显然,本领域的技术人员可以对本申请进行各种改动和变型而不脱离本申请的精神和范围。这样,倘若本申请的这些修改和变型属于本申请权利要求及其等同技术的范围之内,则本申请也意图包含这些改动和变型在内。Obviously, those skilled in the art can make various changes and modifications to the application without departing from the spirit and scope of the application. In this way, if these modifications and variations of this application fall within the scope of the claims of this application and their equivalent technologies, this application also intends to include these modifications and variations.

Claims (19)

  1. 一种显示设备,其特征在于,包括:A display device, characterized by comprising:
    显示屏,被配置为呈现图像数据;The display screen is configured to present image data;
    扬声器,被配置为再现声音数据;The speaker is configured to reproduce sound data;
    音频处理器,被配置为接收具有多个声道的声源数据,将所述声源数据解码出各所述声道对应的原始音频数据;An audio processor, configured to receive sound source data having multiple channels, and decode the sound source data to obtain original audio data corresponding to each of the channels;
    控制器,被配置为根据预设编码规则将所述原始音频数据进行重新编码后,通过至少2个第一I2S总线接口输出给所述扬声器;A controller, configured to re-encode the original audio data according to a preset encoding rule, and output to the speaker through at least two first I2S bus interfaces;
    其中,所述声道的总数大于所有所述第一I2S总线接口的通道总数。Wherein, the total number of channels is greater than the total number of channels of all the first I2S bus interfaces.
  2. 如权利要求1所述的显示设备,其特征在于,所述控制器被配置为根据预设编码规则将所述原始音频数据进行重新编码后,通过至少2个第一I2S总线接口输出,包括:8. The display device of claim 1, wherein the controller is configured to re-encode the original audio data according to a preset encoding rule, and then output it through at least two first I2S bus interfaces, comprising:
    根据所有所述原始音频数据、所有所述第一I2S总线接口的通道总数,以及所述第一I2S总线接口的每个通道的通信规则,确定每个所述第一I2S总线接口的每个通道对应的目标音频数据;其中,所述目标音频数据的数据位大于所述原始音频数据的数据位;Determine each channel of each first I2S bus interface according to all the original audio data, the total number of channels of all the first I2S bus interfaces, and the communication rules of each channel of the first I2S bus interface Corresponding target audio data; wherein the data bits of the target audio data are greater than the data bits of the original audio data;
    将得到的所述目标音频数据通过对应的第一I2S总线接口的通道输出。The obtained target audio data is output through the corresponding channel of the first I2S bus interface.
  3. 如权利要求2所述的显示设备,其特征在于,所述控制器被配置为确定每个所述第一I2S总线接口的每个通道对应的目标音频数据,包括:3. The display device according to claim 2, wherein the controller is configured to determine the target audio data corresponding to each channel of each of the first I2S bus interface, comprising:
    在确定所有所述原始音频数据的数量Q满足公式:时,将个原始音频数据组合为一个所述目标音频数据;其中,N为正偶数,M代表所有所述第一I2S总线接口的通道总数;或者,When determining that the quantity Q of all the original audio data satisfies the formula:, combine the original audio data into one target audio data; where N is a positive even number, and M represents the total number of channels of all the first I2S bus interfaces ;or,
    在确定所有所述原始音频数据的数量Q满足公式:时,在所有所述原始音频数据中增加与相同数量的空白原始音频数据,并在所有所述原始音频数据和生成的所述空白原始音频数据中选取个原始音频数据进行拆分,生成拆分音频数据;其中,N为正偶数,M代表所有所述第一I2S总线接口的通道总数,所述空白原始音频数据的数据位与所述原始音频数据的数据位相同;When it is determined that the quantity Q of all the original audio data satisfies the formula:, add the same amount of blank original audio data to all the original audio data, and add the same amount of blank original audio data to all the original audio data and the generated blank original audio Select one piece of original audio data from the data to split to generate split audio data; where N is a positive even number, M represents the total number of channels of all the first I2S bus interface, and the data bits of the blank original audio data are the same as those of the The data bits of the original audio data are the same;
    将个原始音频数据和个拆分音频数据组合为一个所述目标音频数据。Combine pieces of original audio data and pieces of split audio data into one target audio data.
  4. 如权利要求2所述的显示设备,其特征在于,所述控制器被配置为选取进行拆分的原始音频数据包括:空白原始音频数据。3. The display device of claim 2, wherein the controller is configured to select the original audio data for splitting comprises: blank original audio data.
  5. 如权利要求2所述的显示设备,其特征在于,所述控制器被配置为确定每个所述第一I2S总线接口的每个通道对应的目标音频数据,包括:3. The display device according to claim 2, wherein the controller is configured to determine the target audio data corresponding to each channel of each of the first I2S bus interface, comprising:
    在确定所有所述原始音频数据的数量Q满足公式:且时,则在所有所述原始音频数据中增加与相同数量的空白原始音频数据,并在所有所述原始音频数据和生成的所述空白原始音频数据中选取个原始音频数据进行拆分,生成拆分音频数据;其中,N为正偶数,M代表所有所述第一I2S总线接口的通道总数,所述空白原始音频数据的数据位与所述原始音频数据的数据位相同;When it is determined that the quantity Q of all the original audio data satisfies the formula: and, the same number of blank original audio data is added to all the original audio data, and all the original audio data and the generated blank Select one piece of original audio data from the original audio data to split to generate split audio data; where N is a positive even number, M represents the total number of channels of all the first I2S bus interface, and the data bits of the blank original audio data are The data bits of the original audio data are the same;
    将个原始音频数据和个拆分音频数据组合为一个所述目标音频数据。Combine pieces of original audio data and pieces of split audio data into one target audio data.
  6. 如权利要求2所述的显示设备,其特征在于,所述控制器被配置为确定每个所述第一I2S总线接口的每个通道对应的目标音频数据,包括:3. The display device according to claim 2, wherein the controller is configured to determine the target audio data corresponding to each channel of each of the first I2S bus interface, comprising:
    在确定所有所述原始音频数据的数量Q满足公式:时,则在所有所述原始音频数据中选取个原始音频数据进行拆分,生成拆分音频数据;其中,N为正偶数,M代表所有所述第一I2S总线接口的通道总数;When it is determined that the quantity Q of all the original audio data satisfies the formula:, select one original audio data from all the original audio data for splitting to generate split audio data; where N is a positive even number, and M represents all The total number of channels of the first I2S bus interface;
    将个原始音频数据和个拆分音频数据拼接为一个所述目标音频数据。Splicing pieces of original audio data and pieces of split audio data into one target audio data.
  7. 如权利要求5或6所述的显示设备,其特征在于,所述控制器被配置为原始音频数据为具有K个数据位的数字信号,一个所述拆分音频数据为具有相邻的个数据位的数字信号;其中,K为正整数。The display device according to claim 5 or 6, wherein the controller is configured so that the original audio data is a digital signal with K data bits, and one of the split audio data has adjacent data bits. Bit digital signal; among them, K is a positive integer.
  8. 如权利要求2-6任一项所述的显示设备,其特征在于,所述控制器被配置为将得到的所述目标音频数据通过对应的第一I2S总线接口的通道输出,包括:7. The display device according to any one of claims 2-6, wherein the controller is configured to output the obtained target audio data through a channel of the corresponding first I2S bus interface, comprising:
    改变第一位时钟的采样位数和/或改变所述第一位时钟的采样频率,在第一帧时钟发生沿变化后的第2个第一位时钟的脉冲开始,按照所述第一位时钟传输单个声道的数据位,使每一个所述第一I2S总线接口在一个所述第一帧时钟的一个周期内传输两个声道的目标音频数据。Change the number of sampling bits of the first bit clock and/or change the sampling frequency of the first bit clock, starting from the second pulse of the first bit clock after the edge change of the first frame clock, according to the first bit clock The clock transmits data bits of a single channel, so that each of the first I2S bus interfaces transmits target audio data of two channels in one cycle of the first frame clock.
  9. 如权利要求8所述的显示设备,其特征在于,所述控制器被配置为所述第一位时钟的一个周期传输两个数据位;或者,所述第一位时钟的一个周期传输一个数据位。8. The display device of claim 8, wherein the controller is configured to transmit two data bits in one cycle of the first bit clock; or, to transmit one data in one cycle of the first bit clock Bit.
  10. 一种音频处理装置,其特征在于,包括:An audio processing device, characterized by comprising:
    至少2个第一I2S总线接口;At least 2 first I2S bus interfaces;
    接收电路,用于接收具有多个声道的声源数据;A receiving circuit for receiving sound source data with multiple channels;
    初解码电路,用于将所述声源数据解码出各所述声道对应的原始音频数据;A preliminary decoding circuit, which is used to decode the sound source data to obtain original audio data corresponding to each of the channels;
    重编码电路,与所述至少2个第一I2S总线接口电连接,用于根据预设编码规则将所述原始音频数据进行重新编码后,通过至少2个第一I2S总线接口输出;其中,所述声道的总数大于所有所述第一I2S总线接口的通道总数。The re-encoding circuit is electrically connected to the at least two first I2S bus interfaces, and is configured to re-encode the original audio data according to a preset encoding rule, and output it through at least two first I2S bus interfaces; The total number of channels is greater than the total number of channels of all the first I2S bus interfaces.
  11. 一种音频处理方法,其特征在于,包括:An audio processing method, characterized by comprising:
    接收具有多个声道的声源数据;Receive sound source data with multiple channels;
    将所述声源数据解码出各所述声道对应的原始音频数据;Decoding the sound source data to obtain original audio data corresponding to each of the channels;
    根据预设编码规则将所述原始音频数据进行重新编码后,通过至少2个第一I2S总线接口输出;其中,所述声道的总数大于所有所述第一I2S总线接口的通道总数。After re-encoding the original audio data according to a preset encoding rule, it is output through at least two first I2S bus interfaces; wherein the total number of channels is greater than the total number of channels of all the first I2S bus interfaces.
  12. 如权利要求11所述的音频处理方法,其特征在于,所述根据预设编码规则将所述原始音频数据进行重新编码后,通过至少2个第一I2S总线接口输出,包括:11. The audio processing method of claim 11, wherein the re-encoding of the original audio data according to a preset encoding rule and then outputting through at least two first I2S bus interfaces comprises:
    根据所有所述原始音频数据、所有所述第一I2S总线接口的通道总数,以及所述第一I2S总线接口的每个通道的通信规则,确定每个所述第一I2S总线接口的每个通道对应的目标音频数据;其中,所述目标音频数据的数据位大于所述原始音频数据的数据位;Determine each channel of each first I2S bus interface according to all the original audio data, the total number of channels of all the first I2S bus interfaces, and the communication rules of each channel of the first I2S bus interface Corresponding target audio data; wherein the data bits of the target audio data are greater than the data bits of the original audio data;
    将得到的所述目标音频数据通过对应的第一I2S总线接口的通道输出。The obtained target audio data is output through the corresponding channel of the first I2S bus interface.
  13. 如权利要求12所述的音频处理方法,其特征在于,所述确定每个所述第一I2S总线接口的每个通道对应的目标音频数据,包括:The audio processing method of claim 12, wherein the determining the target audio data corresponding to each channel of each of the first I2S bus interface comprises:
    在确定所有所述原始音频数据的数量Q满足公式:时,将个原始音频数据组合为一个所述目标音频数据;其中,N为正偶数,M代表所有所述第一I2S总线接口的通道总数;或者,When determining that the quantity Q of all the original audio data satisfies the formula:, combine the original audio data into one target audio data; where N is a positive even number, and M represents the total number of channels of all the first I2S bus interfaces ;or,
    在确定所有所述原始音频数据的数量Q满足公式:时,在所有所述原始音频数据中增加与相同数量的空白原始音频数据,并在所有所述原始音频数据和生成的所述空白原始音频数据中选取个原始音频数据进行拆分,生成拆分音频数据;其中,N为正偶数,M代表所有所述第一I2S总线接口的通道总数,所述空白原始音频数据的数据位与所述原始音频数据的数据位相同;When it is determined that the quantity Q of all the original audio data satisfies the formula:, add the same amount of blank original audio data to all the original audio data, and add the same amount of blank original audio data to all the original audio data and the generated blank original audio Select one piece of original audio data from the data to split to generate split audio data; where N is a positive even number, M represents the total number of channels of all the first I2S bus interface, and the data bits of the blank original audio data are the same as those of the The data bits of the original audio data are the same;
    将个原始音频数据和个拆分音频数据组合为一个所述目标音频数据。Combine pieces of original audio data and pieces of split audio data into one target audio data.
  14. 如权利要求12所述的音频处理方法,其特征在于,选取进行拆分的原始音频数据包括:空白原始音频数据。The audio processing method according to claim 12, wherein the original audio data selected for splitting comprises: blank original audio data.
  15. 如权利要求12所述的音频处理方法,其特征在于,所述确定每个所述第一I2S总线接口的每个通道对应的目标音频数据,包括:The audio processing method of claim 12, wherein the determining the target audio data corresponding to each channel of each of the first I2S bus interface comprises:
    在确定所有所述原始音频数据的数量Q满足公式:且时,则在所有所述原始音频数据中增加与相同数量的空白原始音频数据,并在所有所述原始音频数据和生成的所述空白原始音频数据中选取个原始音频数据进行拆分,生成拆分音频数据;其中,N为正偶数,M代表所有所述第一I2S总线接口的通道总数,所述空白原始音频数据的数据位与所述原始音频数据的数据位相同;When it is determined that the quantity Q of all the original audio data satisfies the formula: and, the same number of blank original audio data is added to all the original audio data, and all the original audio data and the generated blank Select one piece of original audio data from the original audio data to split to generate split audio data; where N is a positive even number, M represents the total number of channels of all the first I2S bus interface, and the data bits of the blank original audio data are The data bits of the original audio data are the same;
    将个原始音频数据和个拆分音频数据组合为一个所述目标音频数据。Combine pieces of original audio data and pieces of split audio data into one target audio data.
  16. 如权利要求12所述的音频处理方法,其特征在于,所述确定每个所述第一I2S总线接口的每个通道对应的目标音频数据,包括:The audio processing method of claim 12, wherein the determining the target audio data corresponding to each channel of each of the first I2S bus interface comprises:
    在确定所有所述原始音频数据的数量Q满足公式:时,则在所有所述原始音频数据中选取个原始音频数据进行拆分,生成拆分音频数据;其中,N为正偶数,M代表所有所述第一I2S总线接口的通道总数;When it is determined that the quantity Q of all the original audio data satisfies the formula:, select one original audio data from all the original audio data for splitting to generate split audio data; where N is a positive even number, and M represents all The total number of channels of the first I2S bus interface;
    将个原始音频数据和个拆分音频数据拼接为一个所述目标音频数据。Splicing pieces of original audio data and pieces of split audio data into one target audio data.
  17. 如权利要求15或16所述的音频处理方法,其特征在于,所述原始音频数据为具有K个数据位的数字信号,一个所述拆分音频数据为具有相邻的个数据位的数字信号;其中,K为正整数。The audio processing method according to claim 15 or 16, wherein the original audio data is a digital signal with K data bits, and one of the split audio data is a digital signal with adjacent data bits ; Among them, K is a positive integer.
  18. 如权利要求15或16所述的音频处理方法,其特征在于,同一所述第一I2S总线接口对应的两个目标音频数据中的拆分音频数据属于同一原始音频 数据。The audio processing method of claim 15 or 16, wherein the split audio data in the two target audio data corresponding to the same first I2S bus interface belong to the same original audio data.
  19. 如权利要求15或16所述的音频处理方法,其特征在于,所述多个声道包括:左声道,右声道,左环绕声道,右环绕声道,左天空声道,右天空声道、中置声道、重低音声道;The audio processing method of claim 15 or 16, wherein the multiple channels include: left channel, right channel, left surround channel, right surround channel, left sky channel, right sky Channel, center channel, subwoofer channel;
    选取进行拆分的原始音频数据包括:所述中置声道对应的原始音频数据和所述重低音声道对应的原始音频数据。The original audio data selected for splitting includes: original audio data corresponding to the center channel and original audio data corresponding to the subwoofer channel.
PCT/CN2020/070890 2019-07-09 2020-01-08 Audio processing method and apparatus, and display device WO2021004046A1 (en)

Applications Claiming Priority (16)

Application Number Priority Date Filing Date Title
CN201910616404.6 2019-07-09
CN201910615836.5A CN112218019B (en) 2019-07-09 2019-07-09 Audio data transmission method and device
CN201910613160.6 2019-07-09
CN201910613254.3 2019-07-09
CN201910616404.6A CN112218016B (en) 2019-07-09 2019-07-09 Display device
CN201910618541.3 2019-07-09
CN201910614701.7A CN112216310B (en) 2019-07-09 2019-07-09 Audio processing method and device and multi-channel system
CN201910614701.7 2019-07-09
CN201910613160 2019-07-09
CN201910618541 2019-07-09
CN201910613254.3A CN112216290A (en) 2019-07-09 2019-07-09 Audio data transmission method and device and playing equipment
CN201910615836.5 2019-07-09
CN201910659488.1 2019-07-22
CN201910659488.1A CN112218020B (en) 2019-07-09 2019-07-22 Audio data transmission method and device for multi-channel platform
CN201910710346.3 2019-08-02
CN201910710346.3A CN112218210B (en) 2019-07-09 2019-08-02 Display device, audio playing method and device

Publications (1)

Publication Number Publication Date
WO2021004046A1 true WO2021004046A1 (en) 2021-01-14

Family

ID=74114387

Family Applications (5)

Application Number Title Priority Date Filing Date
PCT/CN2020/070929 WO2021004049A1 (en) 2019-07-09 2020-01-08 Display device, and audio data transmission method and device
PCT/CN2020/070887 WO2021004045A1 (en) 2019-07-09 2020-01-08 Method for transmitting audio data of multichannel platform, apparatus thereof, and display device
PCT/CN2020/070890 WO2021004046A1 (en) 2019-07-09 2020-01-08 Audio processing method and apparatus, and display device
PCT/CN2020/070902 WO2021004048A1 (en) 2019-07-09 2020-01-08 Display device and audio data transmission method
PCT/CN2020/070891 WO2021004047A1 (en) 2019-07-09 2020-01-08 Display device and audio playing method

Family Applications Before (2)

Application Number Title Priority Date Filing Date
PCT/CN2020/070929 WO2021004049A1 (en) 2019-07-09 2020-01-08 Display device, and audio data transmission method and device
PCT/CN2020/070887 WO2021004045A1 (en) 2019-07-09 2020-01-08 Method for transmitting audio data of multichannel platform, apparatus thereof, and display device

Family Applications After (2)

Application Number Title Priority Date Filing Date
PCT/CN2020/070902 WO2021004048A1 (en) 2019-07-09 2020-01-08 Display device and audio data transmission method
PCT/CN2020/070891 WO2021004047A1 (en) 2019-07-09 2020-01-08 Display device and audio playing method

Country Status (1)

Country Link
WO (5) WO2021004049A1 (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113301494B (en) * 2021-05-25 2022-09-02 亿咖通(湖北)技术有限公司 Audio playing system, control equipment and power amplifier equipment

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN201063781Y (en) * 2007-07-24 2008-05-21 青岛海信电器股份有限公司 Audio/video coding and decoding device
CN103714847A (en) * 2013-12-31 2014-04-09 广州市花都区中山大学国光电子与通信研究院 DSP (digital signal processing)-based multi-channel digital audio processor
US20160372123A1 (en) * 2013-04-05 2016-12-22 Dolby International Ab Audio processing system
CN106911987A (en) * 2017-02-21 2017-06-30 珠海全志科技股份有限公司 Main control end, equipment end, the method and system of transmission multichannel audb data

Family Cites Families (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
RU2381571C2 (en) * 2004-03-12 2010-02-10 Нокиа Корпорейшн Synthesisation of monophonic sound signal based on encoded multichannel sound signal
JP2006005701A (en) * 2004-06-18 2006-01-05 D & M Holdings Inc Multichannel audio system
CN101079265B (en) * 2007-07-11 2011-06-08 无锡中星微电子有限公司 Voice signal processing system
US8355921B2 (en) * 2008-06-13 2013-01-15 Nokia Corporation Method, apparatus and computer program product for providing improved audio processing
US8199941B2 (en) * 2008-06-23 2012-06-12 Summit Semiconductor Llc Method of identifying speakers in a home theater system
US20100057471A1 (en) * 2008-08-26 2010-03-04 Hongwei Kong Method and system for processing audio signals via separate input and output processing paths
CN102572588A (en) * 2011-12-14 2012-07-11 中兴通讯股份有限公司 Method and device for realizing audio mixing of set-top box
CN103237259A (en) * 2013-03-29 2013-08-07 天脉聚源(北京)传媒科技有限公司 Audio-channel processing device and audio-channel processing method for video
CN104468915A (en) * 2013-09-24 2015-03-25 卓望数码技术(深圳)有限公司 Device for testing mobile terminal and system for testing mobile terminals
CN103945310B (en) * 2014-04-29 2017-01-11 华为终端有限公司 Transmission method, mobile terminal, multi-channel earphones and audio playing system
CN105992040A (en) * 2015-02-15 2016-10-05 深圳市民展科技开发有限公司 Multichannel audio data transmitting method, audio data synchronization playing method and devices
CN105578347A (en) * 2015-12-25 2016-05-11 数源科技股份有限公司 Audio system of integrated automotive electronic product
CN107135301A (en) * 2016-02-29 2017-09-05 宇龙计算机通信科技(深圳)有限公司 A kind of audio data processing method and device
CN105959438A (en) * 2016-07-06 2016-09-21 惠州Tcl移动通信有限公司 Processing method and system for audio multi-channel output loudspeaker and mobile phone
CN206117991U (en) * 2016-08-10 2017-04-19 深圳市米尔声学科技发展有限公司 Audio processing equipment
CN206879039U (en) * 2017-07-05 2018-01-12 珠海市杰理科技股份有限公司 Support the wireless microphone and intelligent terminal karaoke OK system of usb audio
CN108076306B (en) * 2017-12-29 2021-09-17 中兴通讯股份有限公司 Conference implementation method, device, equipment and system and computer readable storage medium
CN109996167B (en) * 2017-12-31 2020-09-11 华为技术有限公司 Method for cooperatively playing audio file by multiple terminals and terminal
CN108520763B (en) * 2018-04-13 2021-07-16 广州醇美电子有限公司 Data storage method, device, equipment and storage medium

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN201063781Y (en) * 2007-07-24 2008-05-21 青岛海信电器股份有限公司 Audio/video coding and decoding device
US20160372123A1 (en) * 2013-04-05 2016-12-22 Dolby International Ab Audio processing system
CN103714847A (en) * 2013-12-31 2014-04-09 广州市花都区中山大学国光电子与通信研究院 DSP (digital signal processing)-based multi-channel digital audio processor
CN106911987A (en) * 2017-02-21 2017-06-30 珠海全志科技股份有限公司 Main control end, equipment end, the method and system of transmission multichannel audb data

Also Published As

Publication number Publication date
WO2021004048A1 (en) 2021-01-14
WO2021004045A1 (en) 2021-01-14
WO2021004049A1 (en) 2021-01-14
WO2021004047A1 (en) 2021-01-14

Similar Documents

Publication Publication Date Title
WO2021109487A1 (en) Control method for audio data stream output and display device
CN113747232B (en) Method for pushing media file to display device by mobile terminal and display device
WO2021169141A1 (en) Method for displaying audio track language on display device and display device
WO2021042655A1 (en) Sound and picture synchronization processing method and display device
WO2020258711A1 (en) Backlight control method and device, and display device
WO2021109354A1 (en) Media stream data playback method and device
CN111405221B (en) Display device and display method of recording file list
CN111601134B (en) Time display method in display equipment and display equipment
CN111654743B (en) Audio playing method and display device
WO2021189708A1 (en) Method for turning on screen protection for display device, and display device
WO2021004046A1 (en) Audio processing method and apparatus, and display device
CN112272373B (en) Bluetooth device type switching method and display device
CN111093106B (en) Display device
CN111050197B (en) Display device
CN111885415B (en) Audio data rapid output method and display device
KR20150059483A (en) Apparatus for Displaying Image and Driving Method Thereof, Apparatus for Outputting Audio and Driving Method Thereof
CN111343498B (en) Mute control method and device and smart television
KR20210068953A (en) Electronic apparatus and method for controlling thereof
CN111107403B (en) Display device
CN112702549B (en) Sound output method and display device
WO2021253575A1 (en) Method for selecting audio output device, and display device
US20220188069A1 (en) Content-based voice output method and display apparatus
WO2021120483A1 (en) Display device
CN117939213A (en) Display device, multi-window display method, and storage medium
CN117812358A (en) Display device, display control method, and storage medium

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20837905

Country of ref document: EP

Kind code of ref document: A1

122 Ep: pct application non-entry in european phase

Ref document number: 20837905

Country of ref document: EP

Kind code of ref document: A1