WO2021004049A1 - Display device, and audio data transmission method and device - Google Patents

Display device, and audio data transmission method and device Download PDF

Info

Publication number
WO2021004049A1
WO2021004049A1 PCT/CN2020/070929 CN2020070929W WO2021004049A1 WO 2021004049 A1 WO2021004049 A1 WO 2021004049A1 CN 2020070929 W CN2020070929 W CN 2020070929W WO 2021004049 A1 WO2021004049 A1 WO 2021004049A1
Authority
WO
WIPO (PCT)
Prior art keywords
data
channels
channel
audio
channel sub
Prior art date
Application number
PCT/CN2020/070929
Other languages
French (fr)
Chinese (zh)
Inventor
李见
黄飞
Original Assignee
海信视像科技股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from CN201910616404.6A external-priority patent/CN112218016B/en
Priority claimed from CN201910614701.7A external-priority patent/CN112216310B/en
Priority claimed from CN201910613254.3A external-priority patent/CN112216290A/en
Priority claimed from CN201910615836.5A external-priority patent/CN112218019B/en
Priority claimed from CN201910659488.1A external-priority patent/CN112218020B/en
Priority claimed from CN201910710346.3A external-priority patent/CN112218210B/en
Application filed by 海信视像科技股份有限公司 filed Critical 海信视像科技股份有限公司
Publication of WO2021004049A1 publication Critical patent/WO2021004049A1/en

Links

Images

Classifications

    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/008Multichannel audio signal coding or decoding using interchannel correlation to reduce redundancy, e.g. joint-stereo, intensity-coding or matrixing
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/44Receiver circuitry for the reception of television signals according to analogue transmission standards
    • H04N5/60Receiver circuitry for the reception of television signals according to analogue transmission standards for the sound signals
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/025Systems for the transmission of digital non-picture data, e.g. of text during the active part of a television frame
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R3/00Circuits for transducers, loudspeakers or microphones

Definitions

  • This application relates to the field of audio data processing, and in particular to a method and device for transmitting audio data of a display device.
  • the televisions produced by various manufacturers mostly adopt the two-channel stereo standard, that is, the audio data that needs to be played is processed and transmitted to the two speakers of the television for output.
  • a television set usually uses a speaker on the left and right sides to output the audio data of the left channel and the right channel respectively.
  • the audio effect of the TV using this audio playback method is poor.
  • the TV needs to be able to play the front left channel, front right channel, center channel, surround left channel, surround right channel, top left channel, top right channel, and 8 channels of heavy bass.
  • one I2S bus in the I2S standard includes two I2S channels, so one I2S bus can only transmit data of two channels. If 7.1 channel data needs to be played, at least 4 I2S buses are required for data transmission between the master chip and the slave device (for example, between the master decoder chip and the power amplifier chip).
  • the TV main control board usually only supports 3 I2S buses or even less, which greatly limits the number of TV channels. If you want to achieve true multi-channel audio playback, you need to increase the number of I2S buses between the master chip and the slave devices. This requires a redesign of the TV main control board, which is costly.
  • the embodiments of the present application provide a display device, an audio data transmission method and device, which can utilize limited I2S channel resources to transmit more channel data.
  • the present application provides an audio data transmission method, including: obtaining audio data of m channels; using n I2S channels to send m channels of audio data to the data receiving end; where m >n.
  • the present application provides another audio data transmission method, including: receiving transmission data sent by n I2S channels; converting the transmission data sent by n I2S channels into audio data of m channels; wherein , M>n.
  • an embodiment of the present application provides an audio data transmission device, including: an acquisition unit for acquiring audio data of m channels; a sending unit for using n I2S channels to transfer m channels The audio data is sent to the data receiving end; where m>n.
  • the embodiments of the present application provide another audio data transmission device, including: a receiving unit for receiving transmission data sent by n I2S channels; a conversion unit for transferring transmission data sent by n I2S channels , Converted to audio data of m channels; where m>n.
  • the embodiments of the present application provide another audio data transmission device, including: a processor, a memory, a bus, and a communication interface; the memory is used to store computer execution instructions, and the processor and the memory are connected through the bus.
  • the processor executes the computer-executable instructions stored in the memory, so that the audio data transmission device executes the audio data transmission method provided in some embodiments.
  • the embodiments of the present application provide another audio data transmission device, including: a processor, a memory, a bus, and a communication interface; the memory is used to store computer execution instructions, and the processor and the memory are connected through the bus.
  • the processor executes the computer-executable instructions stored in the memory, so that the audio data transmission device executes the audio data transmission method provided in some embodiments.
  • the embodiments of the present application provide a computer storage medium, including instructions, which when run on an audio data transmission device, cause the audio data transmission device to execute the audio data transmission method provided in some embodiments. .
  • the embodiments of the present application provide a computer storage medium, including instructions, which when run on an audio data transmission device, cause the audio data transmission device to execute the audio data transmission method provided in some embodiments. .
  • the embodiments of the present application provide a TV.
  • the TV is made to execute the above-mentioned embodiments and any one of its implementations, and/or in some embodiments and any one of them.
  • An implementation of audio data transmission method is provided.
  • the display device, audio data transmission method and device provided in the embodiments of the application consider that when using the I2S channel for audio data transmission, it is not necessary to limit one I2S channel to only transmit one channel of audio without following the content of the I2S protocol. Data, but uses the application concept of decoupling the number of I2S channels and the number of channels. Furthermore, this application adopts the method of sending m channels of audio data to the data receiving end by using n I2S channels, which can avoid the inability to transmit due to the limitation of the I2S protocol itself on the number of channels in the transmission process The problem of audio data with more channels than I2S channels.
  • FIG. 1 is one of the signal timing diagrams of an I2S channel provided by an embodiment of the application
  • FIG. 2 is the second schematic diagram of signal timing of an I2S channel provided by an embodiment of the application.
  • FIG. 3 is one of the schematic diagrams of the appearance of a television provided by an embodiment of the application.
  • FIG. 4 is a second schematic diagram of the appearance of a television provided by an embodiment of the application.
  • FIG. 5 is one of the structural schematic diagrams of a television provided by an embodiment of the application.
  • FIG. 6 is one of the schematic flowcharts of an audio data transmission method provided by an embodiment of this application.
  • FIG. 7 is the third schematic diagram of a signal sequence of an I2S channel provided by an embodiment of this application.
  • FIG. 8 is one of the schematic diagrams of a data transmission structure provided by an embodiment of this application.
  • FIG. 9 is a second schematic flowchart of an audio data transmission method provided by an embodiment of this application.
  • FIG. 10 is the second schematic diagram of a data transmission structure provided by an embodiment of this application.
  • FIG. 11 is a fourth schematic diagram of signal timing of an I2S channel provided by an embodiment of this application.
  • FIG. 12 is the third schematic diagram of a data transmission structure provided by an embodiment of this application.
  • FIG. 13 is the third schematic flowchart of an audio data transmission method provided by an embodiment of this application.
  • FIG. 14 is a fourth schematic diagram of a data transmission structure provided by an embodiment of this application.
  • 15 is a fifth schematic diagram of a data transmission structure provided by an embodiment of this application.
  • FIG. 16 is the second structural diagram of a TV set provided by an embodiment of the application.
  • FIG. 17 is a schematic diagram of a protocol architecture of a device provided by an embodiment of this application.
  • FIG. 18 is the fourth schematic diagram of an audio data transmission method provided by an embodiment of this application.
  • 20 is a sixth schematic diagram of a data transmission structure provided by an embodiment of this application.
  • 21 is a seventh schematic diagram of a data transmission structure provided by an embodiment of this application.
  • FIG. 22 is one of the schematic structural diagrams of an audio data transmission device provided by an embodiment of this application.
  • FIG. 23 is the second structural diagram of an audio data transmission device provided by an embodiment of this application.
  • 25 is the fourth structural diagram of an audio data transmission device provided by an embodiment of this application.
  • FIG. 26 is the fifth structural diagram of an audio data transmission device provided by an embodiment of this application.
  • FIG. 27 is a sixth structural diagram of an audio data transmission device provided by an embodiment of this application.
  • FIG. 28 is a schematic diagram of a display device provided in Embodiment 1 of the present application.
  • FIG. 29 is a block diagram of the hardware configuration of the display device provided in Embodiment 1 of the present application.
  • I2S (Inter-IC Sound) bus also known as integrated circuit audio bus, is a bus standard developed by Philips for audio data transmission between digital audio devices.
  • one I2S bus can include two I2S channels for data transmission. Among them, when the frame clock signal WS is "0", data of one channel is transmitted, and when WS is "1", data of another channel is transmitted.
  • one I2S bus mainly includes: MCLK, BCLK, SDATA, WS and other main signals, of which:
  • BCLK the serial clock. Corresponding to each bit of digital audio data, BCLK has 1 pulse.
  • WS the frame clock.
  • WS is used to switch the left and right channel data.
  • WS is "1" it means that the data of the left channel is being transmitted, and "0" means that the data of the right channel is being transmitted.
  • the frequency of WS is equal to the sampling frequency of audio data. For example, when the sampling frequency of certain audio data is 48KHz, it means that 48K left channel sub-data and 48K right channel sub-data need to be played every second. Furthermore, the frequency of WS also needs to be 48KHz in order to transmit the audio data normally.
  • SDATA namely serial data. It is used to transmit audio data in the way of twos complement.
  • MCLK the master clock
  • I2S bus to transmit data. According to the different positions of SDATA relative to WS and BCLK, it is divided into I2S standard format (the format specified by Philips), left-justified and right-justified.
  • Figure 2 is a schematic diagram of the transmission of the I2S standard format.
  • the figure at the second BCLK pulse after the change of WS (as shown in the figure, take the second rising edge of BCLK as an example) to start data transmission.
  • the figure respectively shows schematic diagrams of the transmission process in 24bit mode, 20bit mode, and 16bit mode.
  • the embodiments of the present application are applied in a scenario where the aforementioned I2S bus is used for audio data transmission.
  • the televisions produced by various manufacturers mostly adopt the two-channel stereo standard, that is, the audio data to be played is processed and transmitted to the two speakers of the television for output.
  • the TV needs to be able to play the front left channel, the front right channel, the center channel, the surround left channel, the surround right channel, the top left channel, the top right channel, and the heavy bass (where the heavy bass is usually set On the back of the TV, not shown in the figure) 8-channel playback.
  • one I2S bus in the I2S standard includes two I2S channels, so one I2S bus can only transmit data of two channels. If 7.1 channel data needs to be played, at least 4 I2S buses are required for data transmission between the master chip and the slave device (for example, between the master decoder chip and the power amplifier chip).
  • the conventional TV main control board usually only supports 3 I2S buses or even less, which greatly limits the number of TV channels. If you want to achieve true multi-channel audio playback, you need to increase the number of I2S buses between the master chip and the slave devices. This requires a redesign of the TV main control board, which is costly.
  • an embodiment of the present application provides a data transmission method, which is applied to the main control board of a television.
  • FIG. 5 it is a schematic structural diagram of a television main control board provided by an embodiment of this application.
  • the TV main control board 01 includes a main chip 10 and a slave device 20.
  • the main chip 10 includes a decoder 101, a digital audio player (digital audio player, DAP) 102, and a re-encoder 103.
  • the slave device 20 includes an audio coprocessor 201 and multiple power amplifier units 202 (exemplarily, as shown in the figure, the power amplifier unit 202 specifically includes a power amplifier unit 202a, a power amplifier unit 202b, a power amplifier unit 202c, a power amplifier unit 202d, and a power amplifier unit 202e five power amplifier units).
  • the audio coprocessor 201 may specifically be an XMOS chip.
  • the main chip 10 reads the audio data to be played and uses the decoder 101 to decode it to generate various channels of channel data to be played. Taking 7.1 channels as an example, through the decoding of the decoder 101, the top right channel TopR, the top left channel TopL, the surround left channel SL, the surround right channel SR, the front left channel L, and the front right channel can be obtained.
  • R Woofer of subwoofer channel, Conter of center channel, original audio data of 8 channels.
  • the digital audio player 102 After the decoder 101 obtains each channel of original audio data that needs to be played, the digital audio player 102 performs AVI (audio video interleave, audio video interaction), DRC (dynamic range compress, dynamic range compression) and EQ on each channel of original audio data. (Equalizer, equalizer) Parameter setting and other processing to generate processed audio data of 8 channels.
  • the re-encoder 103 processes the processed 8-channel audio data according to the method provided in the embodiment of this application, using 6 I2S channels (specifically, 3 I2S channels in the figure, so Three I2S channels (including 6 I2S channels) send 8 channels of audio data to the slave device 20 side.
  • the audio coprocessor 201 On the side of the slave device 20, after the audio coprocessor 201 receives the data sent by the three I2S channels, it obtains 8-channel data according to the audio data transmission method provided in the embodiment of the present application, and transmits it to each power amplifier unit 202. In order to drive each speaker to play the corresponding channel data.
  • FIG. 5 only exemplarily shows an application scenario of the audio data transmission method provided by the embodiment of the present application.
  • those skilled in the art can also apply the embodiments of the present application to other scenarios, so as to solve the technical problems that can be solved by the embodiments of the present application and achieve the technical effects achieved by the embodiments of the present application.
  • the digital audio player 102 may not be provided in the main chip 10, and after the decoder 101 decodes and obtains multi-channel data, it is directly provided by the re-encoder 103 according to the embodiment of the present application.
  • the audio data transmission method re-encodes the channel data, and uses the I2S channel to send the re-encoded encoded data to the slave device 20 side.
  • those skilled in the art may also apply the audio data transmission method provided in the embodiments of the present application to other devices other than the television to solve the same technical problem. In this regard, this application may not be restricted.
  • an embodiment of the present application provides an audio data transmission method, which specifically includes:
  • S301 Decode audio data to be processed to generate m channels of original channel data.
  • step S301 may be performed by the decoder 101.
  • S302 Preprocess the m channels of original channel data respectively to generate m channels of audio data.
  • the preprocessing of m channels of original channel data specifically includes: respectively modulating parameters such as AVI, DRC, and EQ of the m channels of original channel data to generate m channels of audio data.
  • step S302 may be executed by the digital audio player 102.
  • the re-encoder 103 obtains audio data of m channels.
  • the method before performing S304, the method further includes: S305, comparing the size of m and n, and if m>n, then perform S304; otherwise, according to the prior art sending Send m channels of audio data in a way.
  • S305 can be used to determine whether the audio data needs to be re-encoded according to the content of S304.
  • S304 is not performed to directly send audio data in the existing manner. Thereby improving the efficiency of audio data transmission.
  • one I2S channel used in the prior art is not used to transmit only one channel of audio data.
  • one I2S channel it is possible to use one I2S channel to transmit more than one channel data for data transmission, that is, use a limited number of I2S channels to transmit audio data with a large number of channels. Therefore, the channel data with a larger number of channels can be transmitted without increasing the number of I2S channels, so as to realize the playback of stereo surround sound.
  • SDATA only has data transmission in the two BCLK cycles after WS switching (the shaded part in the figure), and other data bits have no data transmission. This leads to a waste of transmission resources of the I2S channel.
  • the sampling frequency of the original audio data is 48KHz, and the sampling bit width is 16bit;
  • the sampling bit width of the original audio data is only 16 bits, which results in 16 bits of data being wasted in each frame clock cycle.
  • S304 specifically includes:
  • each channel sub-data in the m channel sub-data includes channel data of one of the m channels in the audio sampling period.
  • Exemplarily take 7.1 channel original audio data as an example. As shown in Figure 8, if the original audio data uses 16bit@48KHz (that is, the audio sampling frequency is 48KHz, and the sampling bit width is 16bit). According to the existing transmission method, 5 I2S channels are required for transmission.
  • the channel sub-data of the six channels Ch0, Ch2, Ch3, Ch5, Ch6, and Ch8 in the same audio sampling period can be respectively placed in the six I2S channels included in the three I2S channels.
  • High bit split the channel sub-data of the remaining channels Ch1, Ch4, Ch7 and fill in the remaining bits of the six I2S channels. So as to achieve the effect of using three I2S channels to transmit 8-channel audio data without changing the clock frequency of the I2S channel.
  • S304a1 may specifically include: taking n channel sub-data of m channel sub-data as high-order data of n channels of coded data, and combining the data of the remaining channels in the m channel sub-data.
  • the channel sub-data is supplemented after the n channel sub-data to generate n-channel coded data.
  • supplementing the channel sub-data of the remaining channels in the m channel sub-data after the n channel sub-data specifically includes:
  • the m channel sub-data without increasing the number of I2S channels and without reducing the total amount of data of m channel sub-data, by changing the data structure of m channel sub-data, the m channel sub-data The data is sent out through one frame clock cycle of n I2S channels. In order to play more realistic stereo surround sound.
  • the n channel sub-data as high-order data of the n channels of coded data specifically include:
  • the top right channel TopR, the top left channel TopL, the surround left channel SL, the surround right channel SR, the front left channel L, and the front right channel R are included.
  • the channel sub-data of the most important n channels may include the top right channel TopR, the top left channel TopL, the surround left channel SL, the surround right channel SR, the front left channel L, and the front right channel.
  • Channel R 6 channels.
  • the sub-bass channel Woofer and the center channel Conter are supplemented with the channel sub-data of the upper 6 channels.
  • the remaining bits of the I2S channel are too few, even after the channel sub-data is split, the remaining bits cannot be completely filled. For example, taking 32bit@48KHz 7.1 channel original audio data as an example, if a frame clock cycle is used to transmit at most 3 I2S channels of about 32bit channels for transmission. At this time, the 6 I2S channels included in the 3 I2S channels can only accommodate 6 channel data transmissions, and there are no remaining bits. At this time, in order to transmit m channel sub-data through n I2S channels, the method of increasing the serial clock frequency BCLK of the I2S channel or changing the sampling method of BCLK can be used to expand the frame clock period. The maximum amount of data that can be transferred.
  • the embodiment of the present application further includes:
  • the original audio data is 12-channel audio data with a sampling frequency of 48KHz and a sampling bit width of 16bit (specifically including Ch0, Ch1, Ch2, Ch3, Ch4, Ch5, Ch6, Ch7, Ch8, Ch9, Ch10, Ch11).
  • a sampling frequency of 48KHz and a sampling bit width of 16bit (specifically including Ch0, Ch1, Ch2, Ch3, Ch4, Ch5, Ch6, Ch7, Ch8, Ch9, Ch10, Ch11).
  • 3 I2S channels that transmit at most 16bit left and right channels in one frame clock period T for transmission. Then in one frame clock period T, only channel sub-data of exactly 6 channels can be transmitted (as shown in Fig. 10, Ch0, Ch1, Ch4, Ch5, Ch8, Ch10).
  • the frequency of the serial clock BCLK of the n I2S channels can be increased, or the serial data SDATA of the n I2S channels can be increased
  • the sampling mode is switched from the BCLK single-edge collection mode to the BCLK double-edge collection mode to increase the amount of data transmitted in one frame clock cycle.
  • the sequence of the serial clock is as shown in the figure BCLK_1.
  • the corresponding sampling method of SDATA is sampling on the rising edge of BCLK.
  • the sequence of serial data is shown in SDATA_1 in the figure.
  • BCLK_1 has 8 rising edge triggers, corresponding to the transmission of 8bit data of SDATA_1.
  • the frequency of the serial clock BCLK_3 at this time does not change compared to BCLK_1, but the sampling mode of the transmission data SDATA is changed from sampling on the rising edge of BCLK to sampling on both edges of BCLK.
  • 16bit data of SDATA_3 can also be correspondingly transmitted.
  • the channel before changing the frequency of BCLK or changing the sampling method of SDATA, the channel can transmit channel sub-data of the two channels Ch0 and Ch1 within one frame clock period T; and then, Then the channel sub-data of the four channels Ch0, Ch1, Ch2, and Ch3 can be transmitted.
  • the method before executing S304a1 or executing S304a3, the method includes:
  • S304a4 Determine whether the data capacity included in the serial data can accommodate m channel sub-data in one frame clock cycle according to the current sampling mode of the serial clock BCLK and the serial data SDATA. If yes, execute S304a1 directly; if not, execute S304a3.
  • S304 may further include:
  • each channel sub-data in the m channel sub-data includes channel data of one of the m channels in the audio sampling period.
  • each I2S channel can be used to send two channels of sound in the first frame clock period T1.
  • Channel data (as shown in the figure, in the T1 period, use the I2S D0 channel to send the channel sub-data of the two channels Ch0 and Ch1, use the I2S D1 channel to send the channel sub-data of the Ch4 and Ch5 channels, use The I2S D2 channel sends the channel sub-data of the two channels Ch8 and Ch9), and then the channel sub-data of the remaining channels is sent in the next frame clock period T2 (as shown in the figure, in the T2 period, the I2S D0 channel is used)
  • Send the channel sub-data of the two channels Ch2 and Ch3 use the I2S D1 channel to send the channel sub-data of the Ch6 and Ch7 channels, and use the I2S D2 channel to send the channel sub-data of the Ch10 and Ch11 channels) .
  • the embodiments of the present application also provide a data transmission method, as shown in FIG. 13, which specifically includes:
  • S402 Encode the m channel sub-data to generate 4 channels of encoded data.
  • S403 In the preset frame clock period, use 4 I2S channels to send 4 channels of encoded data to the data receiving end through 4 channels of I2S channels.
  • the 4 channel sub-data in the m channel sub-data are respectively used as the high-order data of the 4 channels of coded data, and the channel sub-data of the remaining channels in the m channel sub-data are supplemented After 4 channels of sub-data, 4 channels of coded data are generated.
  • the channel sub-data of the remaining channels in the m channel sub-data may be sequentially supplemented after different channel sub-data in the 4 channel sub-data.
  • the channel sub-data of the four channels of L, C, Rs (or Rrs), and Lfh (or Lrh) are respectively placed in two I2S channels (in the figure, I2S D0 And the high bits of the four I2S channels of I2S D1). Then, the channel sub-data of the four channels of R, LFE, Ls (or Lrs), and Rfh are sequentially supplemented with the channel sub-data of the four channels of L, C, Rs (or Rrs), and Lfh (or Lrh). After the data.
  • the method further includes:
  • S404 Use multiple frame clock cycles of the 4 I2S channels to send m channel sub-data to the data receiving end.
  • Embodiment 1 The following describes the applications of Embodiment 1 and Embodiment 2 in combination with actual application scenarios:
  • the first processing chip uses the decoder (Decoder) in it to decode the sound source data (equivalent to step S301 in the first embodiment above), and then uses the digital audio player (DAP) in the second processing chip. ) Preprocessing the decoded audio data of each channel (equivalent to step S302 in the first embodiment above).
  • the functions of the above-mentioned first processing chip and the second processing chip may also be implemented by one or more DSP chips.
  • audio mixing (MIX) technology can be used to mix audio data of multiple channels into data of two channels, and then play it out through a device such as a power amplifier. But this will lose the quality of audio data.
  • MIX audio mixing
  • a third processing chip is used to process the audio data according to the above-mentioned first and second embodiments, and then use fewer I2S channels to achieve lossless transmission of audio data.
  • the upper layer opens the multi-channel APK application and communicates it to the middleware and Drive layer in a notified manner.
  • the protocol architecture of the device is shown in Figure 17.
  • the middleware After receiving the upper-level instruction, the middleware opens the relevant code of the multi-channel.
  • the driver layer will enumerate the Audio devices connected to the underlying hardware, such as enumerating to a USB device, and then turn on the USB.
  • Audio device inputs audio files, and the source data is at the bottom layer after the chip decodes the decoder.
  • the driver layer requests the middle layer to enumerate the USB device, whether the data needs to be sent.
  • the middleware requests the upper layer to receive the AUDIO data and whether to send it.
  • the upper layer responds to notify the data to be sent.
  • the response instruction informs the middle layer, and the middle layer sends the processing mode of multi-channel data (Dolby ATMOS, DRC, etc.) to the driver layer to perform data post-processing on the bottom layer.
  • multi-channel data Dolby ATMOS, DRC, etc.
  • the driver layer will receive the intermediate layer to compress the data, pack it into a USB data format for processing, and transmit it to the power amplifier through the USB channel after processing.
  • the middle layer sends the multi-channel data (Dolby ATMOS, DRC, etc.) processing method and the audio data transmission method provided in the above-mentioned embodiment of this application Give the driver layer to the bottom layer to split and combine the data according to the audio data transmission method provided in the above-mentioned embodiments of the application, and then directly transmit it through I2S.
  • the multi-channel data Dolby ATMOS, DRC, etc.
  • the 16bit 8ch audio data is split and arranged in the Drive layer, and the SW bass and center are split into SwH 8bit, SwL 8Bit, CH8bit, CL8bit.
  • the USB interface can be used to realize the transmission of audio data. But this method needs to pack the audio data according to the USB interface protocol and then transmit it. However, this method has a relatively large delay and is not suitable for the transmission process of audio data that is played synchronously.
  • the audio data transmission method provided by the embodiment of the present application has beneficial effects such as saving system cost and reducing delay time.
  • the embodiments of the present application also provide an audio data transmission method, specifically, as shown in FIG. 18.
  • the method includes:
  • S501 Receive transmission data sent by n I2S channels.
  • the content included in S501 is specifically used to execute after S304.
  • the audio coprocessor 201 executes the steps of S501 and the following S502.
  • S502 Convert the transmission data sent by the n channels of I2S channels into m channels of audio data. Among them, m>n.
  • the method further includes:
  • S503 Receive the encoding information sent by the data sending end. In order to separate the audio data of m channels from the transmission data sent by n I2S channels according to the decoding method corresponding to the encoded information.
  • S501 specifically includes: receiving n channels of encoded data sent by n channels of I2S channels within a preset frame clock period.
  • S502 specifically includes: decoding n channels of coded data to generate m channel sub-data.
  • each channel sub-data in the m channel sub-data includes channel data of one of the m channels in the audio sampling period.
  • S502 specifically includes:
  • the n channel sub-data specifically include: channel sub-data of the n channels with the highest importance among the m channels.
  • the above S502 can be used as the reverse decoding process of the steps S304a1, S304a2, etc. in the first embodiment, and the technical problems solved and the beneficial effects achieved are the same as those in the first embodiment. In this regard, I will not repeat it.
  • S502 specifically includes:
  • each channel sub-data in the m channel sub-data includes channel data of one of the m channels in the audio sampling period.
  • the above S502 can be used as the reverse process of the steps S304a1, S304a2, S304b, etc. in the first embodiment, and the technical problems solved and the beneficial effects achieved are the same as those in the first embodiment. In this regard, I will not repeat it.
  • n I2S channels have independent clock signals (including clocks such as BCLK, WS, MCLK, etc.)
  • the encoded data of n Decoding to generate m channel sub-data will occupy more system resources, thereby affecting the normal operation of the device.
  • n I2S channels have independent clock signals
  • n channels of encoded data are decoded to generate m channel sub-data, which specifically includes:
  • the data received from n I2S channels in the audio sampling period is stored in the buffer. After the audio sampling period ends, the encoded data in the buffer is decoded to generate m channel sub-data.
  • n I2S channels use a common clock signal, in order to increase the utilization rate of the CPU, it is used to decode the received data while receiving data from the n I2S channels.
  • decoding the received data includes: splitting and combining the received data to generate m channel sub-data.
  • the internal I2S architecture of different chip solution systems is different.
  • Different chip architectures have different forms of I2S transmission.
  • n I2S channels may use the same clock signal. At this time, when receiving the transmission data sent by the n-way I2S channel, the form of receiving and dismantling is adopted.
  • different chip I2S channel output channels are different, such as MSD858 as an example, the core end will support 2 I2S channel output, but the 2 I2S channels share one MCLK, BCLK, WS, which is so-called Single-channel CLK collection, a single-channel CLK is sent from the movement end to the external audio coprocessor 201, and the audio co-processor 201 collects the aforementioned movement end (specifically, the main chip 10 shown in Figure 5) according to the single-channel CLK.
  • the audio coprocessor 201 may specifically be an XMOS chip.
  • the XMOS platform driver software is disassembled according to the coding information provided by the movement end.
  • intercept the 16bit data of the front left and right channels from the 3 I2S channels ie intercept the first 16bit data of the two I2S channels included in one I2S channel
  • restore Ch0, Ch1, Ch2, and Ch3 , Ch4 channels correspond to 16bit data respectively.
  • the XMOS platform driver software is disassembled according to the multi-channel data encoding sequence provided by the movement end.
  • double-edge sampling of the data on I2S2 is also performed to extract 4ch 16bit data and put them into the output I2S_e and I2S_f respectively.
  • XMOS stores the received and split data in the I2S channel for output (specifically including I2S_a, I2S_b, I2S_c, I2S_d, I2S_e, I2S_f in Figure 21), it has a clock signal in itself, and generates a 48KHZ clock signal by itself. Under this clock signal, the multi-channel data is transmitted to the back-end power amplifier chip for sound conversion.
  • the internal I2S architecture of different chip scheme systems is different.
  • BCLK clock signal, WS channel selection, SDATA is channel data.
  • Different chip architectures have different forms of I2S transmission. Take Nova 72671 and its follow-up products as an example below.
  • the movement chip supports 3 channels of I2S output. If 3 channels of I2S share one CLK, there will be an error in the data transmission process. Once the I2S shared CLK error, it will cause 3 channels of I2S data transmission to receive data errors.
  • the source of CLK error software delay, peripheral signal interference, hardware circuit, etc.
  • the XMOS chip when the XMOS chip receives and splits the 24-bit data at the data sending end, if clk jitters abnormally, it will cause data errors. If the CLK is jittered in the lower 16 bits, which causes the number of bits to be read from 0 to 1, and then XMOS splits the 24bit data from 16bit, and the data is abnormal. The data is not the original multi-channel data and there is a total of CLK. At the same time, 3 channels of I2S data are affected, and abnormal noise occurs for multi-channels. Therefore, this kind of architecture has drawbacks, but its advantages are that it saves the cost of the chip.
  • the internal structure of the 3-channel I2S chip output by the NT72673 used in this application is that each group of I2S channels has a separate MCLK, WS, BCK, SDATA, but more importantly, it is necessary to ensure the MCLK of the 3-channel I2S channel Synchronize.
  • One method is to wait for transmission, which is to wait for the 3 I2S channel data to be processed at the same time.
  • the CLKs of the 3 I2S channels are shared, the CLKs of the 3 I2S channels are used to fetch the sending data respectively. This greatly reduces the data error caused by a clk abnormality.
  • the data sending end (which can be a SOC chip specifically) transmits all the 24bit data sent by each channel of the 3 I2S channels to the XMOS chip.
  • the XMOS chip does not receive and disassemble, and it buffers the 24bit data in the buffer.
  • the data sending end provides the XMOS chip with an encoding arrangement of 8ch data at the data sending end into 6ch data. Equivalent to the description in S503, the XMOS chip receives the encoded information sent by the data sender.
  • the first valid data of 24bit of the three I2S channels is collected as a valid MCLK signal, the last 8bit of the 24bit data is collected, and the data is recombined to obtain Ch6, Ch7, 2 channels Audio data.
  • the restored original multi-channel 5.1.2 data is sent to the power amplifier through 4 I2S channels (specifically, I2S_a, I2S_b, I2S_c, I2S_d in the figure) to achieve the purpose of multi-channel sound effects.
  • the sampling frequency is increased to 96KHz by increasing the frequency of BCLK or adopting double-edge sampling.
  • the data sending end (specifically, it can be a SOC chip) transmits all the data sent by each channel of the 3 I2S channels to the XMOS chip.
  • the XMOS chip does not receive and disassemble, but it buffers the data in the buffer.
  • the data sending end provides this encoding arrangement and double-edge sampling to the XMOS chip. Equivalent to the description in S503, the XMOS chip receives the encoded information sent by the data sender.
  • the XMOS chip uses the first valid data of 3 channels of I2S as the reference MCLK, and the sampling frequency is set to 48KHZ.
  • the sampling frequency is set to 48KHz, and the double-edge sampling method is adopted. Sampling out Ch0, Ch1...Ch11 respectively, the 16bit data corresponding to each channel in a total of 12 channels.
  • This 12ch 16bit data is distributed to 6 I2S channels (specifically, I2S_a, I2S_b, I2S_c, I2S_d in the figure) according to the original data distribution format.
  • the XMOS chip generates a wait tone spontaneously and adjusts the clock synchronization of the 6 I2S channels. After C is synchronized, the XMOS chip sends it to the power amplifier at the same time through 6 I2S channels.
  • this application provides an audio data transmission device for executing the audio data transmission methods provided in the first and second embodiments of this application.
  • the audio data provided in this embodiment A possible structure diagram of the data transmission device 60.
  • the device includes: an acquiring unit 601 and a sending unit 602.
  • the acquiring unit 601 is configured to acquire audio data of m channels.
  • the sending unit 602 is configured to use n I2S channels to send m channels of audio data to the data receiving end; where m>n.
  • the sending unit 602 specifically includes an encoding subunit 6021 and a sending subunit 6022. among them:
  • the encoding subunit 6021 is used to encode m channel sub-data to generate n channels of encoded data; wherein, each channel sub-data in the m channel sub-data includes one of the m channels in the Channel data in the audio sampling period;
  • the sending subunit 6022 is configured to use n I2S channels to send n encoded data to the data receiving end through n I2S channels within a preset frame clock period.
  • the sending subunit 6022 is specifically configured to use the n channel sub-data in the m channel sub-data as the high-order data of the n channels of coded data, and combine the remaining m channel sub-data The channel sub-data of the channel is supplemented after the n channel sub-data to generate n-channel coded data.
  • the n channel sub-data specifically includes: channel sub-data of the n channels with the highest importance among the m channels.
  • the audio data transmission device 60 further includes a sampling frequency adjustment unit 603.
  • the sampling frequency adjustment unit 603 is configured to increase the frequency of the serial clock of the n I2S channels before the sending unit 602 uses n I2S channels to send the n channels of encoded data to the data receiving end; or The sampling mode of the serial data of the channel is switched from the serial clock single-edge collection mode to the serial clock double-edge collection mode.
  • the sending subunit 6022 is specifically configured to use multiple frame clock cycles of n I2S channels to send m channel sub-data to the data receiving end; wherein, each sound channel in the m channel sub-data
  • the channel data respectively include channel data of one of the m channels in the audio sampling period.
  • the embodiment of the present application can divide the audio data transmission device 60 into functional modules or functional units according to the above method examples.
  • each functional module or functional unit can be divided corresponding to each function, or two or more functions can be integrated.
  • a processing module In a processing module.
  • the above-mentioned integrated modules can be implemented in the form of hardware, or in the form of software functional modules or functional units. Among them, the division of modules or units in the embodiments of the present application is illustrative, and is only a logical function division, and there may be other division methods in actual implementation.
  • Fig. 23 shows a possible structural schematic diagram of the audio data transmission device involved in the foregoing embodiment.
  • the audio data transmission device 70 includes a processing module 701, a communication module 702, and a storage module 703.
  • the processing module 701 is used to control and manage the actions of the audio data transmission device 70.
  • the processing module 701 is used to support the audio data transmission device 70 to execute the processes S301-S304 in FIG. 6 or FIG. 9.
  • the communication module 702 is used to support the communication between the audio data transmission device 70 and other entities.
  • the storage module 703 is used to store the program code and data of the audio data transmission device.
  • the processing module 701 may be a processor or a controller, for example, a central processing unit (CPU), a general-purpose processor, a digital signal processor (digital signal processor, DSP), and an application-specific integrated circuit (application-specific integrated circuit). integrated circuit, ASIC), field programmable gate array (FPGA) or other programmable logic devices, transistor logic devices, hardware components, or any combination thereof. It can implement or execute various exemplary logical blocks, modules and circuits described in conjunction with the disclosure of this application.
  • the processor may also be a combination of computing functions, for example, a combination of one or more microprocessors, a combination of a DSP and a microprocessor, and so on.
  • the communication module 702 may be a transceiver, a transceiver circuit, or a communication interface.
  • the storage module 703 may be a memory.
  • the audio data transmission device involved in the embodiment of the present application may be the following audio Data transmission device 80.
  • the audio data transmission device 80 includes a processor 801, a transceiver 802, a memory 803, and a bus 804.
  • the processor 801, the transceiver 802, and the memory 803 are connected to each other through a bus 804;
  • the bus 804 may be a peripheral component interconnect standard (PCI) bus or an extended industry standard architecture (EISA) bus Wait.
  • PCI peripheral component interconnect standard
  • EISA extended industry standard architecture
  • the bus can be divided into address bus, data bus, control bus, etc. For ease of representation, only one thick line is used in the figure, but it does not mean that there is only one bus or one type of bus.
  • the processor 801 may be a general-purpose central processing unit (Central Processing Unit, CPU), a microprocessor, an Application-Specific Integrated Circuit (ASIC), or one or more programs for controlling the execution of the program of this application. integrated circuit.
  • CPU Central Processing Unit
  • ASIC Application-Specific Integrated Circuit
  • the memory 803 can be a read-only memory (Read-Only Memory, ROM) or other types of static storage devices that can store static information and instructions, random access memory (Random Access Memory, RAM), or other types that can store information and instructions
  • the dynamic storage device can also be Electrically Erasable Programmable Read-only Memory (EEPROM), CD-ROM (Compact Disc Read-Only Memory, CD-ROM) or other optical disk storage, optical disc storage (Including compact discs, laser discs, optical discs, digital versatile discs, Blu-ray discs, etc.), magnetic disk storage media or other magnetic storage devices, or can be used to carry or store desired program codes in the form of instructions or data structures and can be used by a computer Any other media accessed, but not limited to this.
  • the memory can exist independently and is connected to the processor through a bus.
  • the memory can also be integrated with the processor.
  • the memory 802 is used to store application program codes for executing the solutions of the present application, and the processor 801 controls the execution.
  • the transceiver 802 is used to receive content input from an external device, and the processor 601 is used to execute application program codes stored in the memory 803, so as to implement an audio data transmission method provided in Embodiment 1 and Embodiment 2 of the present application.
  • this application provides an audio data transmission device for executing the audio data transmission method provided in the third embodiment of this application. As shown in FIG. 25, this is the audio data transmission device provided in this embodiment of the application.
  • the receiving unit 901 is configured to receive transmission data sent by n I2S channels.
  • the conversion unit 902 is configured to convert the transmission data sent by n I2S channels into m channels of audio data; where m>n.
  • the receiving unit 901 is specifically configured to receive n channels of encoded data sent by n channels of I2S channels within a preset frame clock period.
  • the conversion unit 902 is specifically configured to decode n channels of coded data to generate m channel sub-data; wherein, each channel sub-data in the m channel sub-data includes one of the m channels Channel data in the audio sampling period.
  • the conversion unit 902 is specifically configured to sequentially obtain n channel sub-data from the high-order data of the n-channel coded data; from the remaining data of the n-channel coded data, obtain the m channel sub-data Channel sub data except for n channel sub data.
  • the n channel sub-data specifically includes: channel sub-data of the n channels with the highest importance among the m channels.
  • the receiving unit 901 is specifically configured to receive transmission data of multiple frame clock cycles sent by n I2S channels.
  • the conversion unit 902 is specifically configured to generate m channel sub-data by using transmission data of multiple frame clock cycles; wherein, each channel sub-data in the m channel sub-data includes one sound of the m channels. Channel data in the audio sampling period.
  • the conversion unit 902 is specifically further configured to store the data received from the n I2S channels in the buffer in the buffer during the audio sampling period if the n I2S channels have independent clock signals. After the end, decode the encoded data in the buffer to generate m channel sub-data.
  • the embodiment of the present application may divide the audio data transmission device 90 into functional modules or functional units according to the foregoing method examples.
  • each functional module or functional unit may be divided corresponding to each function, or two or more functions may be integrated In a processing module.
  • the above-mentioned integrated modules can be implemented in the form of hardware, or in the form of software functional modules or functional units. Among them, the division of modules or units in the embodiments of the present application is illustrative, and is only a logical function division, and there may be other division methods in actual implementation.
  • FIG. 26 shows a possible structural schematic diagram of the audio data transmission device involved in the foregoing embodiment.
  • the audio data transmission device 100 includes a processing module 1001, a communication module 1002, and a storage module 1003.
  • the processing module 1001 is used to control and manage the actions of the audio data transmission device 100.
  • the processing module 1001 is used to support the audio data transmission device 100 to execute the processes S501-S503 in FIG. 18 or FIG. 19.
  • the communication module 1002 is used to support communication between the audio data transmission device 100 and other entities.
  • the storage module 1003 is used to store the program code and data of the audio data transmission device.
  • the processing module 1001 may be a processor or a controller, for example, a central processing unit (CPU), a general-purpose processor, a digital signal processor (digital signal processor, DSP), and an application-specific integrated circuit (application-specific integrated circuit). integrated circuit, ASIC), field programmable gate array (FPGA) or other programmable logic devices, transistor logic devices, hardware components, or any combination thereof. It can implement or execute various exemplary logical blocks, modules and circuits described in conjunction with the disclosure of this application.
  • the processor may also be a combination of computing functions, for example, a combination of one or more microprocessors, a combination of a DSP and a microprocessor, and so on.
  • the communication module 1002 may be a transceiver, a transceiver circuit, or a communication interface.
  • the storage module 1003 may be a memory.
  • the audio data transmission device involved in the embodiment of the present application may be the following audio Data transmission device 110.
  • the audio data transmission device 110 includes a processor 1101, a transceiver 1102, a memory 1103, and a bus 1104.
  • the processor 1101, the transceiver 1102, and the memory 1103 are connected to each other through a bus 1104;
  • the bus 1104 may be a peripheral component interconnect standard (PCI) bus or an extended industry standard architecture (EISA) bus Wait.
  • PCI peripheral component interconnect standard
  • EISA extended industry standard architecture
  • the bus can be divided into address bus, data bus, control bus, etc. For ease of representation, only one thick line is used in the figure, but it does not mean that there is only one bus or one type of bus.
  • the processor 1101 may be a general-purpose central processing unit (Central Processing Unit, CPU), a microprocessor, an Application-Specific Integrated Circuit (ASIC), or one or more for controlling the execution of the program of this application integrated circuit.
  • CPU Central Processing Unit
  • ASIC Application-Specific Integrated Circuit
  • the memory 1103 may be a read-only memory (Read-Only Memory, ROM) or other types of static storage devices that can store static information and instructions, random access memory (Random Access Memory, RAM), or other types that can store information and instructions
  • the dynamic storage device can also be electrically erasable programmable read-only memory (Electrically Erasable Programmable Read-only Memory, EEPROM), CD-ROM (Compact Disc Read-Only Memory, CD-ROM) or other optical storage (Including compact discs, laser discs, optical discs, digital versatile discs, Blu-ray discs, etc.), magnetic disk storage media or other magnetic storage devices, or can be used to carry or store desired program codes in the form of instructions or data structures and can be used by a computer Any other media accessed, but not limited to this.
  • the memory can exist independently and is connected to the processor through a bus.
  • the memory can also be integrated with the processor.
  • the memory 1103 is used to store application program codes for executing the solutions of the present application, and the processor 1101 controls the execution.
  • the transceiver 1102 is used to receive content input from an external device, and the processor 1101 is used to execute application program codes stored in the memory 1103, so as to implement the audio data transmission method provided in the third embodiment of the present application.
  • an embodiment of the present application further provides a television, including the audio data transmission device provided in the above-mentioned embodiment.
  • FIG. 28 is a schematic diagram of a display device provided in Embodiment 1 of the present application.
  • the present application also provides a display device, which at least includes: a display screen 91 configured to present image data; and a speaker 92 configured to reproduce sound data .
  • the display device may further include: a backlight assembly 94 located below the display screen 91.
  • a backlight assembly 94 located below the display screen 91.
  • the backlight assembly may include an LED light bar or a light panel that automatically emits light.
  • the display device may further include: a back plate 95.
  • the back plate 95 is stamped to form some convex structures, and components such as speakers 92 are fixed on the convex structures by screws or hooks.
  • the display device may further include: a rear case 98, which is covered on the back of the display screen 91 to hide the backlight assembly 94, the speaker 92 and other display device components, which has a beautiful effect.
  • the display device may further include: a main board 96 and a power supply board 97, which can be arranged as two boards independently, or they can be combined on one board.
  • the display device further includes a remote control 93.
  • FIG. 29 is a block diagram of the hardware configuration of the display device provided in Embodiment 1 of the present application.
  • the display device 200 may include a tuner and demodulator 220, a communicator 230, a detector 240, an external device interface 250, a controller 210, a memory 290, a user input interface, a video processor 260-1, and audio processing 260-2, display screen 280, audio input interface 272, power supply.
  • the tuner and demodulator 220 which receives broadcast and television signals through wired or wireless means, can perform modulation and demodulation processing such as amplification, mixing and resonance, and is used to demodulate the television channel selected by the user from multiple wireless or cable broadcast and television signals
  • modulation and demodulation processing such as amplification, mixing and resonance
  • the audio and video signals carried in the frequency, and additional information (such as EPG data signals).
  • the tuner and demodulator 220 can be selected by the user and controlled by the controller 210 to respond to the TV channel frequency selected by the user and the TV signal carried by the frequency.
  • the tuner and demodulator 220 can receive signals in many ways according to different TV signal broadcasting systems, such as terrestrial broadcasting, cable broadcasting, satellite broadcasting, or Internet broadcasting; and according to different modulation types, it can be digital modulation or alternatively. Analog modulation method; and according to different types of received TV signals, analog and digital signals can be demodulated.
  • the tuner demodulator 220 may also be in an external device, such as an external set-top box.
  • the set-top box outputs TV audio and video signals through modulation and demodulation, and inputs them to the display device 200 through the input/output interface 250.
  • the communicator 230 is a component for communicating with external devices or external servers according to various communication protocol types.
  • the communicator 230 may include a WIFI module 231, a Bluetooth communication protocol module 232, a wired Ethernet communication protocol module 233 and other network communication protocol modules or near field communication protocol modules.
  • the display device 200 may establish a control signal and a data signal connection with an external control device or content providing device through the communicator 230.
  • the communicator may receive the control signal of the remote controller 100 according to the control of the controller.
  • the detector 240 is a component of the display device 200 for collecting signals from the external environment or interacting with the outside.
  • the detector 240 may include a light receiver 242, a sensor used to collect the intensity of ambient light, which can adaptively display parameter changes by collecting ambient light, etc.; it may also include an image collector 241, such as a camera, a camera, etc., which can be used to collect external Environmental scenes, as well as gestures used to collect user attributes or interact with users, can adaptively change display parameters, and can also recognize user gestures to achieve the function of interaction with users.
  • the detector 240 may further include a temperature sensor.
  • the display device 200 may adaptively adjust the display color temperature of the image.
  • the color temperature of the display device 200 when the temperature is relatively high, the color temperature of the display device 200 can be adjusted to be relatively cool; when the temperature is relatively low, the color temperature of the display device 200 can be adjusted to be relatively warm.
  • the detector 240 may also include a sound collector, such as a microphone, which may be used to receive the user's voice, including the voice signal of the user's control instruction for controlling the display device 200, or to collect environmental sound for Recognizing the environmental scene type, the display device 200 can adapt to the environmental noise.
  • a sound collector such as a microphone
  • the external device interface 250 provides a component for the controller 210 to control data transmission between the display device 200 and other external devices.
  • the external device interface can be connected to external devices such as set-top boxes, game devices, notebook computers, etc. in a wired/wireless manner, and can receive external devices such as video signals (such as moving images), audio signals (such as music), and additional information (such as EPG). ) And other data.
  • the external device interface 250 may include: a high-definition multimedia interface (HDMI) terminal 251, a composite video blanking synchronization (CVBS) terminal 252, an analog or digital component terminal 253, a universal serial bus (USB) terminal 254, red, green, and blue ( RGB) terminal (not shown in the figure) and any one or more.
  • HDMI high-definition multimedia interface
  • CVBS composite video blanking synchronization
  • USB universal serial bus
  • RGB red, green, and blue
  • the controller 210 controls the work of the display device 200 and responds to user operations by running various software control programs (such as an operating system and various application programs) stored on the memory 290.
  • various software control programs such as an operating system and various application programs
  • the controller 210 includes a random access memory RAM 213, a read only memory ROM 214, a graphics processor 216, a CPU processor 212, a communication interface 218, and a communication bus.
  • RAM213 and ROM214, graphics processor 216, CPU processor 212, and communication interface 218 are connected by a bus.
  • the graphics processor 216 is used to generate various graphics objects, such as icons, operation menus, and user input instructions to display graphics. Including an arithmetic unit, which performs operations by receiving various interactive commands input by the user, and displays various objects according to display attributes. As well as including a renderer, various objects obtained based on the arithmetic unit are generated, and the rendering result is displayed on the display screen 280.
  • the CPU processor 212 is configured to execute operating system and application program instructions stored in the memory 290. And according to receiving various interactive instructions input from the outside, to execute various applications, data and content, so as to finally display and play various audio and video content.
  • the CPU processor 212 may include multiple processors.
  • the multiple processors may include one main processor and multiple or one sub-processors.
  • the main processor is used to perform some operations of the display device 200 in the pre-power-on mode, and/or to display images in the normal mode.
  • the communication interface may include the first interface 218-1 to the nth interface 218-n. These interfaces may be network interfaces connected to external devices via a network.
  • the controller 210 may control the overall operation of the display device 200. For example, in response to receiving a user command for selecting a UI object to be displayed on the display screen 280, the controller 210 may perform an operation related to the object selected by the user command.
  • the object may be any one of the selectable objects, such as a hyperlink or an icon.
  • Operations related to the selected object for example: display operations connected to hyperlink pages, documents, images, etc., or perform operations corresponding to the icon.
  • the user command for selecting the UI object may be a command input through various input devices (for example, a mouse, a keyboard, a touch pad, etc.) connected to the display device 200 or a voice command corresponding to the voice spoken by the user.
  • the memory 290 includes storing various software modules for driving and controlling the display device 200.
  • various software modules stored in the memory 290 include: a basic module, a detection module, a communication module, a display control module, a browser module, and various service modules.
  • the basic module is the underlying software module used for signal communication between various hardware in the display device 200 and sending processing and control signals to the upper module.
  • the detection module is a management module used to collect various information from various sensors or user input interfaces, and perform digital-to-analog conversion and analysis management.
  • the voice recognition module includes a voice analysis module and a voice command database module.
  • the display control module is a module for controlling the display screen 280 to display image content, and can be used to play information such as multimedia image content and UI interfaces.
  • the communication module is a module used for control and data communication with external devices.
  • the browser module is a module used to perform data communication between browsing servers.
  • the service module is a module used to provide various services and various applications.
  • the memory 290 is also used to store and receive external data and user data, images of various items in various user interfaces, and visual effect diagrams of focus objects.
  • the user input interface 276 is used to send a user's input signal to the controller 210, or to transmit a signal output from the controller to the user.
  • the control device for example, a mobile terminal or a remote control
  • Controller or, the control device may receive output signals such as audio, video or data output from the user input interface processed by the controller, and display the received output signal or output the received output signal as audio or vibration.
  • the user may input a user command on a graphical user interface (GUI) displayed on the display screen 280, and the user input interface receives the user input command through the graphical user interface (GUI).
  • GUI graphical user interface
  • the user can input a user command by inputting a specific sound or gesture, and the user input interface recognizes the sound or gesture through the sensor to receive the user input command.
  • the video processor 260-1 is used to receive video signals, and perform video data processing such as decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, and image synthesis according to the standard codec protocol of the input signal.
  • the video signal directly displayed or played on the display screen 280.
  • the video processor 260-1 includes a demultiplexing module, a video decoding module, an image synthesis module, a frame rate conversion module, a display formatting module, and the like.
  • the demultiplexing module is used to demultiplex the input audio and video data stream. For example, if MPEG-2 is input, the demultiplexing module will demultiplex into a video signal and an audio signal.
  • the video decoding module is used to process the demultiplexed video signal, including decoding and scaling.
  • An image synthesis module such as an image synthesizer, is used to superimpose and mix the GUI signal generated by the graphics generator with the zoomed video image according to user input or itself to generate a displayable image signal.
  • Frame rate conversion module used to convert the frame rate of the input video, such as converting the frame rate of the input 24Hz, 25Hz, 30Hz, 60Hz video to the frame rate of 60Hz, 120Hz or 240Hz, where the input frame rate can be compared with the source
  • the video stream is related, and the output frame rate can be related to the update rate of the display.
  • the input has a usual format, such as frame insertion.
  • the display formatting module is used to change the signal output by the frame rate conversion module into a signal that conforms to a display format such as a display, such as format conversion of the signal output by the frame rate conversion module to output RGB data signals.
  • the display screen 280 is used to receive image signals input from the video processor 260-1, to display video content and images, and a menu control interface.
  • the display screen 280 includes a display screen component for presenting a picture and a driving component for driving image display.
  • the displayed video content can be from the video in the broadcast signal received by the tuner and demodulator 220, or from the video content input by the communicator or the external device interface.
  • the display screen 280 simultaneously displays a user manipulation interface UI generated in the display device 200 and used to control the display device 200.
  • a driving component for driving the display is also included.
  • the display screen 280 is a projection display, it may also include a projection device and a projection screen.
  • the audio processor 260-2 is used to receive audio signals, and perform decompression and decoding according to the standard codec protocol of the input signal, as well as audio data processing such as noise reduction, digital-to-analog conversion, and amplification processing, and the result can be in the speaker 272 The audio signal to be played.
  • the audio output interface 270 is used to receive the audio signal output by the audio processor 260-2 under the control of the controller 210.
  • the audio output interface may include a speaker 272 or output to an external audio output terminal 274 of a generator of an external device, such as : External audio terminal or headphone output terminal, etc.
  • the video processor 260-1 may include one or more chips.
  • the audio processor 260-2 may also include one or more chips.
  • the video processor 260-1 and the audio processor 260-2 may be separate chips, or they may be integrated with the controller 210 in one or more chips.
  • the power supply 275 is used to provide power supply support for the display device 200 with power input from an external power supply under the control of the controller 210.
  • the power supply 275 may include a built-in power supply circuit installed inside the display device 200, or may be a power supply installed outside the display device 200, such as a power interface for providing an external power supply in the display device 200.
  • the present application provides a display device, including:
  • the display screen is configured to present an image screen
  • the speaker is configured to reproduce sound
  • the controller is configured to obtain audio data of m channels and send the audio data of m channels, where m>n.
  • the controller is further configured to encode m channels of channel sub-data to generate n channels of encoded data; wherein each channel sub-data in the m channels of channel sub-data includes Channel data of one of the m channels in the audio sampling period.
  • the controller is further configured to use n channel sub-data in the m channels of channel sub-data as high-order data of the n channels of encoded data, and set the m channel sub-data to The channel sub-data of the remaining channels is supplemented after the n-channel sub-data to generate the n-channel coded data.
  • the display device further includes n I2S channels, and the controller is further configured to increase the frequency of the serial clock of the n I2S channels.
  • the controller is further configured to switch the sampling mode of the serial data of the n I2S channels from the serial clock single-edge collection mode to the serial clock double-edge collection mode.
  • the controller is further configured to use multiple frame clock cycles of n I2S channels to send m channel sub-data; wherein, each sound channel in the m channel sub-data
  • the channel data respectively include channel data of one of the m channels in the audio sampling period.
  • the present application provides a display device, including:
  • the display screen is configured to present an image screen
  • the speaker is configured to reproduce sound
  • the controller is configured to receive transmission data sent by n I2S channels;
  • the display device includes n I2S channels,
  • the controller is configured to receive n channels of coded data sent by n channels of I2S channels within a preset frame clock period;
  • each channel sub-data in the m channels of channel sub-data includes one of the m channels in the audio sampling period Channel data within.
  • the controller is configured to sequentially obtain n channel sub-data from the high-order data of the n channels of encoded data
  • the controller is configured to receive transmission data of multiple frame clock cycles sent by the n I2S channels;
  • the conversion of the transmission data sent by the n I2S channels into m channels of audio data specifically includes:
  • each channel sub-data in the m channel sub-data includes one of the m channels.
  • the controller is configured to store the data received from the n I2S channels in the audio sampling period in a buffer, and after the audio sampling period ends, the buffer is The encoded data in is decoded to generate m channel sub-data.
  • the m channel sub-data is transmitted to the speaker.
  • the size of the sequence number of the above-mentioned processes does not mean the order of execution, and the execution order of each process should be determined by its function and internal logic, rather than corresponding to the embodiments of the present application.
  • the implementation process constitutes any limitation.
  • the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the objectives of the solutions of the embodiments.
  • the computer may be implemented in whole or in part by software, hardware, firmware or any combination thereof.
  • a software program it may be implemented in the form of a computer program product in whole or in part.
  • the computer program product includes one or more computer instructions.
  • the computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices.
  • the computer instructions may be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another computer-readable storage medium.
  • the computer instructions may be transmitted from a website, computer, server, or data center.
  • the computer-readable storage medium may be any available medium that can be accessed by a computer, or may include one or more data storage devices such as servers and data centers that can be integrated with the medium.
  • the usable medium may be a magnetic medium (for example, a floppy disk, a hard disk, and a magnetic tape), an optical medium (for example, a DVD), or a semiconductor medium (for example, a solid state disk (SSD)).

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Mathematical Physics (AREA)
  • Computational Linguistics (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Human Computer Interaction (AREA)
  • Stereophonic System (AREA)

Abstract

Provided in the embodiments of the present application are a display device and an audio data transmission method and device, which relate to the field of audio data processing. The embodiments of the present application can transmit more channels of data by means of limited I2S channel resources. The method comprises: acquiring m channels of audio data; and sending the m channels of audio data to a data receiving end by means of n I2S channels, wherein m>n. The present application is applied to audio data processing.

Description

显示装置、音频数据传输方法及装置Display device, audio data transmission method and device
本专利申请要求于2019年7月9日提交的、申请号为201910614701.7;于2019年7月9日提交的、申请号为201910613160.6;于2019年7月9日提交的、申请号为201910613254.3;于2019年7月9日提交的、申请号为201910615836.5;于2019年7月9日提交的、申请号为201910616404.6;于2019年8月2日提交的、申请号为201910710346.3;于2019年7月9日提交的、申请号为2019106185413;于2019年7月22日提交的、申请号为201910659488.1的中国专利申请的优先权,该申请的全文以引用的方式并入本文中。This patent application requires the application number of 201910614701.7 filed on July 9, 2019; the application number of 201910613160.6 filed on July 9, 2019; the application number of 201910613254.3 filed on July 9, 2019; The application number submitted on July 9, 2019 is 201910615836.5; the application number submitted on July 9, 2019 is 201910616404.6; the application number submitted on August 2, 2019 is 201910710346.3; on July 9, 2019 The priority of the Chinese patent application filed on July 22, 2019 with application number 2019106185413; application number 201910659488.1 filed on July 22, 2019, the full text of which is incorporated herein by reference.
技术领域Technical field
本申请涉及音频数据处理领域,尤其涉及一种显示装置音频数据传输方法及装置。This application relates to the field of audio data processing, and in particular to a method and device for transmitting audio data of a display device.
背景技术Background technique
目前各厂商生产的电视机多采用双声道立体声标准,即把需要播放的音频数据通过处理后,传输到电视机的两个扬声器进行输出。示例性的,相关技术中,电视机常采用在左右两侧分别设置一个扬声器来分别输出左声道和右声道的音频数据。采用这种音频播放方式的电视机的音频效果较差。此时,就需要通过增加电视机的扬声器个数,以及增加不同声道的播放通道,来实现更加逼真的立体声环绕效果。At present, the televisions produced by various manufacturers mostly adopt the two-channel stereo standard, that is, the audio data that needs to be played is processed and transmitted to the two speakers of the television for output. Exemplarily, in the related art, a television set usually uses a speaker on the left and right sides to output the audio data of the left channel and the right channel respectively. The audio effect of the TV using this audio playback method is poor. At this time, it is necessary to increase the number of speakers of the TV and increase the playback channels of different channels to achieve a more realistic stereo surround effect.
以7.1声道标准为例,为了实现7.1声道的环绕效果。则需要电视机能够播放前左声道、前右声道、中置声道,环绕左声道、环绕右声道,顶部左声道、顶部右声道,重低音8个声道的播放。Take the 7.1-channel standard as an example, in order to achieve a 7.1-channel surround effect. The TV needs to be able to play the front left channel, front right channel, center channel, surround left channel, surround right channel, top left channel, top right channel, and 8 channels of heavy bass.
由于相关技术中,I2S标准中一路I2S总线包括两个I2S通道,因此一路I2S总线只能够传输两个声道的数据。若需要播放7.1声道的数据,则主芯片与从属装置之间(例如,主解码芯片与功放端芯片之间)就至少需要4路I2S总线来进行数据传输。In the related art, one I2S bus in the I2S standard includes two I2S channels, so one I2S bus can only transmit data of two channels. If 7.1 channel data needs to be played, at least 4 I2S buses are required for data transmission between the master chip and the slave device (for example, between the master decoder chip and the power amplifier chip).
而目前相关技术中,电视机主控板通常仅支持3路I2S总线甚至更少,这就极大的限制了电视机的声道个数。若想实现真正意义上的多声道音频播放,就需要增加主芯片与从属装置之间的I2S总线个数。这就需要重新设计电视机主控板,成本巨大。In the current related technology, the TV main control board usually only supports 3 I2S buses or even less, which greatly limits the number of TV channels. If you want to achieve true multi-channel audio playback, you need to increase the number of I2S buses between the master chip and the slave devices. This requires a redesign of the TV main control board, which is costly.
申请内容Application content
本申请实施例提供一种显示装置、音频数据传输方法及装置,能够利用有限的I2S信道资源,传输更多的声道数据。The embodiments of the present application provide a display device, an audio data transmission method and device, which can utilize limited I2S channel resources to transmit more channel data.
在一些实施例中,本申请提供一种音频数据传输方法,包括:获取m路声道的音频数据;利用n路I2S通道,将m路声道的音频数据发送至数据接收端;其中,m>n。In some embodiments, the present application provides an audio data transmission method, including: obtaining audio data of m channels; using n I2S channels to send m channels of audio data to the data receiving end; where m >n.
在一些实施例中,本申请提供另一种音频数据传输方法,包括:接收n路I2S通道发送的传输数据;将n路I2S通道发送的传输数据,转换为m路声道的音频数据;其中,m>n。In some embodiments, the present application provides another audio data transmission method, including: receiving transmission data sent by n I2S channels; converting the transmission data sent by n I2S channels into audio data of m channels; wherein , M>n.
在一些实施例中,本申请实施例提供一种音频数据传输装置,包括:获取 单元,用于获取m路声道的音频数据;发送单元,用于利用n路I2S通道,将m路声道的音频数据发送至数据接收端;其中,m>n。In some embodiments, an embodiment of the present application provides an audio data transmission device, including: an acquisition unit for acquiring audio data of m channels; a sending unit for using n I2S channels to transfer m channels The audio data is sent to the data receiving end; where m>n.
在一些实施例中,本申请实施例提供另一种音频数据传输装置,包括:接收单元,用于接收n路I2S通道发送的传输数据;转换单元,用于将n路I2S通道发送的传输数据,转换为m路声道的音频数据;其中,m>n。In some embodiments, the embodiments of the present application provide another audio data transmission device, including: a receiving unit for receiving transmission data sent by n I2S channels; a conversion unit for transferring transmission data sent by n I2S channels , Converted to audio data of m channels; where m>n.
在一些实施例中,本申请实施例提供另一种音频数据传输装置,包括:处理器、存储器、总线和通信接口;存储器用于存储计算机执行指令,处理器与存储器通过总线连接,当音频数据传输装置运行时,处理器执行上述存储器存储的上述计算机执行指令,以使音频数据传输装置执行如上述在一些实施例中所提供的音频数据传输方法。In some embodiments, the embodiments of the present application provide another audio data transmission device, including: a processor, a memory, a bus, and a communication interface; the memory is used to store computer execution instructions, and the processor and the memory are connected through the bus. When the transmission device is running, the processor executes the computer-executable instructions stored in the memory, so that the audio data transmission device executes the audio data transmission method provided in some embodiments.
在一些实施例中,本申请实施例提供另一种音频数据传输装置,包括:处理器、存储器、总线和通信接口;存储器用于存储计算机执行指令,处理器与存储器通过总线连接,当音频数据传输装置运行时,处理器执行上述存储器存储的上述计算机执行指令,以使音频数据传输装置执行如上述在一些实施例中所提供的音频数据传输方法。In some embodiments, the embodiments of the present application provide another audio data transmission device, including: a processor, a memory, a bus, and a communication interface; the memory is used to store computer execution instructions, and the processor and the memory are connected through the bus. When the transmission device is running, the processor executes the computer-executable instructions stored in the memory, so that the audio data transmission device executes the audio data transmission method provided in some embodiments.
在一些实施例中,本申请实施例提供一种计算机存储介质,包括指令,当其在音频数据传输装置上运行时,使得音频数据传输装置执行上述在一些实施例中所提供的音频数据传输方法。In some embodiments, the embodiments of the present application provide a computer storage medium, including instructions, which when run on an audio data transmission device, cause the audio data transmission device to execute the audio data transmission method provided in some embodiments. .
在一些实施例中,本申请实施例提供一种计算机存储介质,包括指令,当其在音频数据传输装置上运行时,使得音频数据传输装置执行上述在一些实施例中所提供的音频数据传输方法。In some embodiments, the embodiments of the present application provide a computer storage medium, including instructions, which when run on an audio data transmission device, cause the audio data transmission device to execute the audio data transmission method provided in some embodiments. .
在一些实施例中,本申请实施例提供了一种电视,当电视运行时,使得电 视执行上述在一些实施例中及其任意一种实现方式,和/或在一些实施例中及其任意一种实现方式的音频数据传输方法。In some embodiments, the embodiments of the present application provide a TV. When the TV is running, the TV is made to execute the above-mentioned embodiments and any one of its implementations, and/or in some embodiments and any one of them. An implementation of audio data transmission method.
本申请实施例所提供的显示装置、音频数据传输方法及装置,考虑到在利用I2S信道进行音频数据传输时,可以不按照I2S协议的内容来限制一路I2S通道仅用于传输一个声道的音频数据,而是采用将I2S通道的个数与声道的个数解耦合的申请构思。进而本申请采用了通过利用n路I2S通道,将m路声道的音频数据发送至数据接收端的这种方式,能够避免由于I2S协议本身对传输过程中声道个数的限制,而导致无法传输声道个数大于I2S通道个数的音频数据的问题。The display device, audio data transmission method and device provided in the embodiments of the application consider that when using the I2S channel for audio data transmission, it is not necessary to limit one I2S channel to only transmit one channel of audio without following the content of the I2S protocol. Data, but uses the application concept of decoupling the number of I2S channels and the number of channels. Furthermore, this application adopts the method of sending m channels of audio data to the data receiving end by using n I2S channels, which can avoid the inability to transmit due to the limitation of the I2S protocol itself on the number of channels in the transmission process The problem of audio data with more channels than I2S channels.
附图说明Description of the drawings
为了更清楚地说明本申请实施例或现有技术中的技术方案,下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍。In order to more clearly describe the technical solutions in the embodiments of the present application or the prior art, the following will briefly introduce the drawings that need to be used in the description of the embodiments or the prior art.
图1为本申请实施例提供的一种I2S信道的信号时序示意图之一;FIG. 1 is one of the signal timing diagrams of an I2S channel provided by an embodiment of the application;
图2为本申请实施例提供的一种I2S信道的信号时序示意图之二;FIG. 2 is the second schematic diagram of signal timing of an I2S channel provided by an embodiment of the application;
图3为本申请实施例提供的一种电视机的外观示意图之一;FIG. 3 is one of the schematic diagrams of the appearance of a television provided by an embodiment of the application;
图4为本申请实施例提供的一种电视机的外观示意图之二;FIG. 4 is a second schematic diagram of the appearance of a television provided by an embodiment of the application;
图5为本申请实施例提供的一种电视机的结构示意图之一;FIG. 5 is one of the structural schematic diagrams of a television provided by an embodiment of the application;
图6为本申请实施例提供的一种音频数据传输方法的流程示意图之一;FIG. 6 is one of the schematic flowcharts of an audio data transmission method provided by an embodiment of this application;
图7为本申请实施例提供的一种I2S信道的信号时序示意图之三;FIG. 7 is the third schematic diagram of a signal sequence of an I2S channel provided by an embodiment of this application;
图8为本申请实施例提供的一种传输数据的结构示意图之一;FIG. 8 is one of the schematic diagrams of a data transmission structure provided by an embodiment of this application;
图9为本申请实施例提供的一种音频数据传输方法的流程示意图之二;9 is a second schematic flowchart of an audio data transmission method provided by an embodiment of this application;
图10为本申请实施例提供的一种传输数据的结构示意图之二;FIG. 10 is the second schematic diagram of a data transmission structure provided by an embodiment of this application;
图11为本申请实施例提供的一种I2S信道的信号时序示意图之四;FIG. 11 is a fourth schematic diagram of signal timing of an I2S channel provided by an embodiment of this application;
图12为本申请实施例提供的一种传输数据的结构示意图之三;FIG. 12 is the third schematic diagram of a data transmission structure provided by an embodiment of this application;
图13为本申请实施例提供的一种音频数据传输方法的流程示意图之三;FIG. 13 is the third schematic flowchart of an audio data transmission method provided by an embodiment of this application;
图14为本申请实施例提供的一种传输数据的结构示意图之四;FIG. 14 is a fourth schematic diagram of a data transmission structure provided by an embodiment of this application;
图15为本申请实施例提供的一种传输数据的结构示意图之五;15 is a fifth schematic diagram of a data transmission structure provided by an embodiment of this application;
图16为本申请实施例提供的一种电视机的结构示意图之二;FIG. 16 is the second structural diagram of a TV set provided by an embodiment of the application;
图17为本申请实施例提供的一种设备的协议架构示意图;FIG. 17 is a schematic diagram of a protocol architecture of a device provided by an embodiment of this application;
图18为本申请实施例提供的一种音频数据传输方法的六示意图之四;FIG. 18 is the fourth schematic diagram of an audio data transmission method provided by an embodiment of this application;
图19为本申请实施例提供的一种音频数据传输方法的六示意图之五;19 is the fifth of the sixth schematic diagrams of an audio data transmission method provided by an embodiment of this application;
图20为本申请实施例提供的一种传输数据的结构示意图之六;20 is a sixth schematic diagram of a data transmission structure provided by an embodiment of this application;
图21为本申请实施例提供的一种传输数据的结构示意图之七;21 is a seventh schematic diagram of a data transmission structure provided by an embodiment of this application;
图22为本申请实施例提供的一种音频数据传输装置的结构示意图之一;FIG. 22 is one of the schematic structural diagrams of an audio data transmission device provided by an embodiment of this application;
图23为本申请实施例提供的一种音频数据传输装置的结构示意图之二;FIG. 23 is the second structural diagram of an audio data transmission device provided by an embodiment of this application;
图24为本申请实施例提供的一种音频数据传输装置的结构示意图之三;24 is the third structural diagram of an audio data transmission device provided by an embodiment of this application;
图25为本申请实施例提供的一种音频数据传输装置的结构示意图之四;25 is the fourth structural diagram of an audio data transmission device provided by an embodiment of this application;
图26为本申请实施例提供的一种音频数据传输装置的结构示意图之五;FIG. 26 is the fifth structural diagram of an audio data transmission device provided by an embodiment of this application;
图27为本申请实施例提供的一种音频数据传输装置的结构示意图之六;FIG. 27 is a sixth structural diagram of an audio data transmission device provided by an embodiment of this application;
图28是本申请实施例一提供的显示设备示意图;FIG. 28 is a schematic diagram of a display device provided in Embodiment 1 of the present application;
图29是本申请实施例一提供的显示设备的硬件配置框图。FIG. 29 is a block diagram of the hardware configuration of the display device provided in Embodiment 1 of the present application.
具体实施方式Detailed ways
下面将结合附图对本申请的实施例进行详细的描述。The embodiments of the present application will be described in detail below in conjunction with the drawings.
本申请的说明书以及附图中的术语“第一”和“第二”等是用于区别不同的对象,而不是用于描述对象的特定顺序。The terms "first" and "second" in the description of the application and the drawings are used to distinguish different objects, rather than to describe the specific order of the objects.
此外,本申请的描述中所提到的术语“包括”和“具有”以及他们的任何变形,意图在于覆盖不排他的包含。例如包含了一系列步骤或单元的过程、方法、系统、产品或设备没有限定于已列出的步骤或单元,而是可选地还包括其他没有列出的步骤或单元,或可选地还包括对于这些过程、方法、产品或设备固有的其他步骤或单元。In addition, the terms "including" and "having" and any variations of them mentioned in the description of this application are intended to cover non-exclusive inclusions. For example, a process, method, system, product, or device that includes a series of steps or units is not limited to the listed steps or units, but optionally includes other steps or units that are not listed, or optionally also Including other steps or units inherent to these processes, methods, products or equipment.
需要说明的是,本申请实施例中,“示例性的”或者“例如”等词用于表示作例子、例证或说明。本申请实施例中被描述为“示例性的”或者“例如”的任何实施例或设计方案不应被解释为比其他实施例或设计方案更优选或更具优势。确切而言,使用“示例性的”或者“例如”等词旨在以具体方式呈现相关概念。It should be noted that in the embodiments of the present application, words such as "exemplary" or "for example" are used as examples, illustrations, or illustrations. Any embodiment or design solution described as "exemplary" or "for example" in the embodiments of the present application should not be construed as being more preferable or advantageous than other embodiments or design solutions. To be precise, words such as "exemplary" or "for example" are used to present related concepts in a specific manner.
本申请中所述“和/或”,包括用两种方法中的任意一种或者同时使用两种方法。The "and/or" mentioned in this application includes using any one of the two methods or using both methods at the same time.
在本申请的描述中,除非另有说明,“多个”的含义是指两个或两个以上。In the description of this application, unless otherwise specified, the meaning of "plurality" means two or more.
首先,对本申请实施例中涉及的技术术语进行解释:First, explain the technical terms involved in the embodiments of this application:
I2S(Inter-IC Sound)总线,又称集成电路内置音频总线,是飞利浦公司为数字音频设备之间的音频数据传输而制定的一种总线标准。在I2S总线所采用的I2S协议中,一路I2S总线能够包括两路I2S通道的数据传输。其中当帧时钟信号WS为“0”时传输一个通道的数据,当WS为“1”时传输另一个通道的数据。相关的I2S协议中,将一路I2S总线所包括的两路I2S通道用于分 别传输不同声道的数据(其中,当WS=0时,表示正在传输的数据为左声道的数据;当WS=1时,表示正在传输的数据为右声道的数据)。I2S (Inter-IC Sound) bus, also known as integrated circuit audio bus, is a bus standard developed by Philips for audio data transmission between digital audio devices. In the I2S protocol adopted by the I2S bus, one I2S bus can include two I2S channels for data transmission. Among them, when the frame clock signal WS is "0", data of one channel is transmitted, and when WS is "1", data of another channel is transmitted. In the related I2S protocol, the two I2S channels included in one I2S bus are used to transmit data of different channels respectively (where WS=0, it means that the data being transmitted is the data of the left channel; when WS= When 1, it means that the data being transmitted is the data of the right channel).
其中,一路I2S总线主要包括:MCLK、BCLK、SDATA、WS等主要信号,其中:Among them, one I2S bus mainly includes: MCLK, BCLK, SDATA, WS and other main signals, of which:
BCLK,即串行时钟。对应数字音频的每一位数据,BCLK都有1个脉冲。BCLK, the serial clock. Corresponding to each bit of digital audio data, BCLK has 1 pulse.
WS,即帧时钟。WS用于切换左右声道的数据。当WS为“1”表示正在传输的是左声道的数据,为“0”则表示正在传输的是右声道的数据。WS的频率等于音频数据的采样频率。例如,当某音频数据的采样频率为48KHz时,即说明每秒需要播放48K个左声道的子数据以及48K个右声道的子数据。进而WS的频率也需要为48KHz,以便正常传输该音频数据。WS, the frame clock. WS is used to switch the left and right channel data. When WS is "1", it means that the data of the left channel is being transmitted, and "0" means that the data of the right channel is being transmitted. The frequency of WS is equal to the sampling frequency of audio data. For example, when the sampling frequency of certain audio data is 48KHz, it means that 48K left channel sub-data and 48K right channel sub-data need to be played every second. Furthermore, the frequency of WS also needs to be 48KHz in order to transmit the audio data normally.
SDATA,即串行数据。用于利用二进制补码的方式,传输音频数据。SDATA, namely serial data. It is used to transmit audio data in the way of twos complement.
MCLK,即主时钟,又称系统时钟。用于给数据发送方系统和数据接收方系统能够更好地同步。通常情况下,MCLK的频率是采样频率的256倍或384倍。例如,若音频数据的采样频率为48KHz,则MCLK为48KHz*256=12.288MHz。MCLK, the master clock, is also called the system clock. Used to better synchronize the data sender system and the data receiver system. Under normal circumstances, the frequency of MCLK is 256 times or 384 times the sampling frequency. For example, if the sampling frequency of audio data is 48KHz, MCLK is 48KHz*256=12.288MHz.
随着技术的发展,在利用I2S总线传输数据时,存在有多种数据格式。根据SDATA相对于WS和BCLK位置的不同,分为I2S标准格式(飞利浦规定的格式),左对齐和右对齐。With the development of technology, there are multiple data formats when using the I2S bus to transmit data. According to the different positions of SDATA relative to WS and BCLK, it is divided into I2S standard format (the format specified by Philips), left-justified and right-justified.
示例性的,如图1所示,当I2S总线采用16bit的右对齐传输方式时,在一个采样周期T内,在WS从“0”变为“1”时,此时SDATA用于传输左声道数据,并且在WS所包括的最后16个BCLK周期内,按照BCLK上升沿采集的方式,利用SDATA从数据的高位至低位依次将16个bit数据进行传输。当I2S总线采用20bit的右对齐传输方式时,在一个采样周期T内,在WS从“0”变 为“1”后,在WS所包括的最后20个BCLK周期内,按照BCLK上升沿采集的方式,利用SDATA从数据的高位至低位依次将20bit数据进行传输。当I2S总线采用24bit的右对齐传输方式时,在一个采样周期T内,在WS从“0”变为“1”后,在WS所包括的最后24个BCLK周期内,按照BCLK上升沿采集的方式,利用SDATA从数据的高位至低位依次将24bit数据进行传输。Exemplarily, as shown in Figure 1, when the I2S bus adopts a 16-bit right-aligned transmission mode, within a sampling period T, when WS changes from "0" to "1", SDATA is used to transmit left sound Channel data, and in the last 16 BCLK cycles included in WS, the 16 bits of data are transmitted sequentially from the high bit to the low bit using SDATA according to the way of collecting the rising edge of BCLK. When the I2S bus adopts the 20bit right-aligned transmission mode, in a sampling period T, after WS changes from "0" to "1", in the last 20 BCLK cycles included in WS, the data collected according to the rising edge of BCLK Way, use SDATA to transmit 20bit data from high to low in sequence. When the I2S bus adopts the 24-bit right-aligned transmission mode, in a sampling period T, after WS changes from "0" to "1", in the last 24 BCLK cycles included in WS, the data collected according to the rising edge of BCLK In this way, 24bit data is transmitted sequentially from the high bit to the low bit using SDATA.
如图1中,当I2S总线采用24bit的左对齐传输方式时,在一个采样周期T内,在WS从“0”变为“1”后,则从WS变化后的第一个BCLK周期开始,按照BCLK上升沿采集的方式,利用SDATA从数据的高位至低位依次将24bit数据进行传输。As shown in Figure 1, when the I2S bus adopts a 24-bit left-aligned transmission mode, within a sampling period T, after WS changes from "0" to "1", it starts from the first BCLK cycle after WS changes. According to the way of collecting on the rising edge of BCLK, use SDATA to transmit 24bit data sequentially from the high bit to the low bit.
再例如图2所示,为I2S标准格式的传输示意图。其中,在WS发生变化后的第二个BCLK脉冲处(如图所示,以BCLK第二个上升沿为例)开始传输数据。具体的,图中分别示出了24bit模式、20bit模式、16bit模式下的传输过程示意图。Another example is shown in Figure 2, which is a schematic diagram of the transmission of the I2S standard format. Among them, at the second BCLK pulse after the change of WS (as shown in the figure, take the second rising edge of BCLK as an example) to start data transmission. Specifically, the figure respectively shows schematic diagrams of the transmission process in 24bit mode, 20bit mode, and 16bit mode.
本申请实施例应用于利用上述I2S总线进行音频数据传输的场景中。The embodiments of the present application are applied in a scenario where the aforementioned I2S bus is used for audio data transmission.
以下,介绍本申请的申请原理:目前各厂商生产的电视机多采用双声道立体声标准,即把需要播放的音频数据通过处理后,传输到电视机的两个扬声器进行输出。The following describes the application principle of this application: At present, the televisions produced by various manufacturers mostly adopt the two-channel stereo standard, that is, the audio data to be played is processed and transmitted to the two speakers of the television for output.
示例性的,如图3所示,目前的电视机常采用在左右两侧分别设置一个扬声器来分别输出左声道和右声道的音频数据。用这种音频播放方式的电视机的音频效果较差。而相关技术中音频数据标准越来越高,更多的影音资料采用5.1、7.1甚至更高标准的音频数据。这些高标准的音频数据在解码后会得到多个声道的数据,而相关技术中电视机而目前常用的音频数据标准越来越高,更多的音 频数据采用5.1、7.1甚至更高的声道标准仅有两个扬声器。此时,就需要通过增加电视机的扬声器个数,以及增加不同声道的播放通道,来实现更加逼真的立体声环绕效果。Exemplarily, as shown in FIG. 3, current televisions often use one speaker on the left and right sides to output the audio data of the left channel and the right channel respectively. The audio effect of TV sets using this audio playback method is poor. In related technologies, audio data standards are getting higher and higher, and more audio-visual materials use audio data of 5.1, 7.1 or even higher standards. These high-standard audio data will get multiple channels of data after being decoded. In the related technology, TV sets and currently commonly used audio data standards are getting higher and higher, and more audio data uses 5.1, 7.1 or even higher sound The road standard has only two speakers. At this time, it is necessary to increase the number of speakers of the TV and increase the playback channels of different channels to achieve a more realistic stereo surround effect.
以7.1声道标准为例,如图4所示,为了实现7.1声道的环绕效果。则需要电视机能够播放前左声道、前右声道、中置声道,环绕左声道、环绕右声道,顶部左声道、顶部右声道,重低音(其中,重低音通常设置在电视机背面,图中未示出)8个声道的播放。Take the 7.1-channel standard as an example, as shown in Figure 4, in order to achieve a 7.1-channel surround effect. The TV needs to be able to play the front left channel, the front right channel, the center channel, the surround left channel, the surround right channel, the top left channel, the top right channel, and the heavy bass (where the heavy bass is usually set On the back of the TV, not shown in the figure) 8-channel playback.
由于相关技术中,I2S标准中一路I2S总线包括两个I2S通道,因此一路I2S总线只能够传输两个声道的数据。若需要播放7.1声道的数据,则主芯片与从属装置之间(例如,主解码芯片与功放端芯片之间)就至少需要4路I2S总线来进行数据传输。In the related art, one I2S bus in the I2S standard includes two I2S channels, so one I2S bus can only transmit data of two channels. If 7.1 channel data needs to be played, at least 4 I2S buses are required for data transmission between the master chip and the slave device (for example, between the master decoder chip and the power amplifier chip).
而目前常规的电视机主控板通常仅支持3路I2S总线甚至更少,这就极大的限制了电视机的声道个数。若想实现真正意义上的多声道音频播放,就需要增加主芯片与从属装置之间的I2S总线个数。这就需要重新设计电视机主控板,成本巨大。At present, the conventional TV main control board usually only supports 3 I2S buses or even less, which greatly limits the number of TV channels. If you want to achieve true multi-channel audio playback, you need to increase the number of I2S buses between the master chip and the slave devices. This requires a redesign of the TV main control board, which is costly.
基于上述技术问题,本申请实施例中想到,若利用有限的I2S总线资源来传输更多的声道数据,则可以在不对现有电视机主控板的结构进行大幅改动的基础上,实现多声道立体声的播放。Based on the above technical problems, in the embodiments of the present application, it is thought that if the limited I2S bus resources are used to transmit more channel data, it is possible to achieve multiple channels without substantially changing the structure of the existing TV main control board. Channel stereo playback.
基于上述申请原理,本申请实施例提供一种数据传输方法,该方法应用于电视机的主控板中。如图5所示,为本申请实施例提供的一种电视机主控板的结构示意图。Based on the principle of the above application, an embodiment of the present application provides a data transmission method, which is applied to the main control board of a television. As shown in FIG. 5, it is a schematic structural diagram of a television main control board provided by an embodiment of this application.
其中,电视机主控板01包括主芯片10以及从属装置20。其中,主芯片10, 包括解码器101、数字音频播放器(digital audio player,DAP)102以及重编码器103。从属装置20,包括音频协处理器201以及多个功放单元202(示例性的,如图中所示,功放单元202具体包括功放单元202a、功放单元202b、功放单元202c、功放单元202d、功放单元202e五个功放单元)。其中,音频协处理器201具体可以为XMOS芯片。Among them, the TV main control board 01 includes a main chip 10 and a slave device 20. Among them, the main chip 10 includes a decoder 101, a digital audio player (digital audio player, DAP) 102, and a re-encoder 103. The slave device 20 includes an audio coprocessor 201 and multiple power amplifier units 202 (exemplarily, as shown in the figure, the power amplifier unit 202 specifically includes a power amplifier unit 202a, a power amplifier unit 202b, a power amplifier unit 202c, a power amplifier unit 202d, and a power amplifier unit 202e five power amplifier units). Among them, the audio coprocessor 201 may specifically be an XMOS chip.
其中,当需要播放音频数据时,主芯片10会读取待播放的音频数据并利用解码器101进行解码,生成需要播放的各路声道数据。以7.1声道为例,通过解码器101的解码,可以获得顶部右声道TopR、顶部左声道TopL、环绕左声道SL、环绕右声道SR、前左声道L、前右声道R、重低音声道Woofer、中置声道Conter,8个声道的原始音频数据。Among them, when the audio data needs to be played, the main chip 10 reads the audio data to be played and uses the decoder 101 to decode it to generate various channels of channel data to be played. Taking 7.1 channels as an example, through the decoding of the decoder 101, the top right channel TopR, the top left channel TopL, the surround left channel SL, the surround right channel SR, the front left channel L, and the front right channel can be obtained. R, Woofer of subwoofer channel, Conter of center channel, original audio data of 8 channels.
在解码器101获得需要播放的各路原始音频数据后,数字音频播放器102对各路原始音频数据进行AVI(audio video interleave,音频视频交互)、DRC(dynamic range compress,动态范围压缩)以及EQ(Equalizer,均衡器)参数设置等处理,生成处理后的8个声道的音频数据。After the decoder 101 obtains each channel of original audio data that needs to be played, the digital audio player 102 performs AVI (audio video interleave, audio video interaction), DRC (dynamic range compress, dynamic range compression) and EQ on each channel of original audio data. (Equalizer, equalizer) Parameter setting and other processing to generate processed audio data of 8 channels.
进而,再由重编码器103对处理后的8个声道的音频数据,按照本申请实施例提供的方法进行处理,利用6路的I2S通道(具体的,图中为3路I2S信道,因此3路I2S信道包括6个I2S通道)将8个声道的音频数据发送至从属装置20侧。Furthermore, the re-encoder 103 processes the processed 8-channel audio data according to the method provided in the embodiment of this application, using 6 I2S channels (specifically, 3 I2S channels in the figure, so Three I2S channels (including 6 I2S channels) send 8 channels of audio data to the slave device 20 side.
在从属装置20侧,音频协处理器201在接收到3路I2S信道发送的数据后,则按照本申请实施例提供的音频数据传输方法得到8路声道数据,并传输至各个功放单元202,以便驱动各扬声器播放相应的声道数据。On the side of the slave device 20, after the audio coprocessor 201 receives the data sent by the three I2S channels, it obtains 8-channel data according to the audio data transmission method provided in the embodiment of the present application, and transmits it to each power amplifier unit 202. In order to drive each speaker to play the corresponding channel data.
需要说明的是,图5仅示例性的示出了本申请实施例所提供音频数据传输 方法的一种应用场景。在实际应用中,本领域技术人员也可将本申请实施例应用于其他的场景中,从而解决本申请实施例所能够解决的技术问题、并实现本申请实施例所实现的技术效果。It should be noted that FIG. 5 only exemplarily shows an application scenario of the audio data transmission method provided by the embodiment of the present application. In practical applications, those skilled in the art can also apply the embodiments of the present application to other scenarios, so as to solve the technical problems that can be solved by the embodiments of the present application and achieve the technical effects achieved by the embodiments of the present application.
示例性的,在某些应用场景中,主芯片10内可不设置数字音频播放器102,进而在解码器101解码获取多路声道数据后,直接由重编码器103按照本申请实施例所提供的音频数据传输方法对声道数据进行重编码,并利用I2S信道将重编码后的编码数据发送至从属装置20侧。或者,本领域技术人员还将本申请实施例提供的音频数据传输方法应用在电视机之外的其他设备中,以解决相同的技术问题。对此,本申请可以不做限制。Exemplarily, in some application scenarios, the digital audio player 102 may not be provided in the main chip 10, and after the decoder 101 decodes and obtains multi-channel data, it is directly provided by the re-encoder 103 according to the embodiment of the present application. The audio data transmission method re-encodes the channel data, and uses the I2S channel to send the re-encoded encoded data to the slave device 20 side. Alternatively, those skilled in the art may also apply the audio data transmission method provided in the embodiments of the present application to other devices other than the television to solve the same technical problem. In this regard, this application may not be restricted.
在一些实施例中,如图6所示,本申请实施例提供一种音频数据传输方法,具体包括:In some embodiments, as shown in FIG. 6, an embodiment of the present application provides an audio data transmission method, which specifically includes:
S301、对待处理音频数据进行解码,生成m路原始声道数据。S301: Decode audio data to be processed to generate m channels of original channel data.
示例性的,在图5所示主控板中,步骤S301可由解码器101来执行。Exemplarily, in the main control board shown in FIG. 5, step S301 may be performed by the decoder 101.
S302、分别对m路原始声道数据进行预处理,生成m路声道的音频数据。S302: Preprocess the m channels of original channel data respectively to generate m channels of audio data.
其中,对m路原始声道数据进行预处理,具体包括:分别对m路原始声道数据的AVI、DRC以及EQ等参数进行调制,生成m路声道的音频数据。Among them, the preprocessing of m channels of original channel data specifically includes: respectively modulating parameters such as AVI, DRC, and EQ of the m channels of original channel data to generate m channels of audio data.
示例性的,在图5所示主控板中,步骤S302可由数字音频播放器102来执行。Exemplarily, in the main control board shown in FIG. 5, step S302 may be executed by the digital audio player 102.
需要说明的是,在一些应用场景中,当可以利用其它方式获取到m路声道的音频数据时,也可不执行上述S301以及S302的内容。对此,本申请实施例可以不做限制。It should be noted that, in some application scenarios, when the audio data of m channels can be acquired in other ways, the contents of S301 and S302 may not be executed. In this regard, the embodiments of the present application may not be limited.
S303、获取m路声道的音频数据。S303. Acquire audio data of m channels.
例如,在图5中,重编码器103获取m路声道的音频数据。For example, in FIG. 5, the re-encoder 103 obtains audio data of m channels.
S304、利用n路I2S通道,将m路声道的音频数据发送至数据接收端。其中,m>n。S304. Use n I2S channels to send audio data of m channels to the data receiving end. Among them, m>n.
在一种实现方式中,如图6所示,在执行S304之前,该方法还包括:S305、比较m与n的大小,若m>n,则执行S304;否则,按照现有技术中的发送方式发送m路声道的音频数据。本申请实施例中,考虑到当设备(如电视机)在播放、传输音频数据时,不同的音频数据,所包括的声道个数也有所不同。因此,本申请实施例中,在对音频数据进行发送之前,可以通过S305判断是否需要对音频数据按照S304的内容进行重编码。当不需要进行重编码时,则不执行S304直接利用现有方式发送音频数据。从而提高了音频数据发送的效率。In an implementation manner, as shown in FIG. 6, before performing S304, the method further includes: S305, comparing the size of m and n, and if m>n, then perform S304; otherwise, according to the prior art sending Send m channels of audio data in a way. In the embodiments of the present application, it is considered that when a device (such as a television) is playing and transmitting audio data, the number of channels included in different audio data is also different. Therefore, in this embodiment of the present application, before the audio data is sent, S305 can be used to determine whether the audio data needs to be re-encoded according to the content of S304. When re-encoding is not required, S304 is not performed to directly send audio data in the existing manner. Thereby improving the efficiency of audio data transmission.
本申请实施例中考虑到,若能够使I2S通道个数与待处理音频数据的声道个数解耦合,不采用现有技术所采用的一个I2S通道只传输一路声道的音频数据的这种方式,而可以利用一个I2S通道传输一个以上的声道数据的方式来进行数据传输,即利用有限的I2S通道个数来传输声道个数较多的音频数据。从而便可以在不增加I2S信道的个数的前提下,将声道个数较多的声道数据进行传输,实现立体环绕声的播放。In the embodiments of this application, it is considered that if the number of I2S channels can be decoupled from the number of channels of audio data to be processed, one I2S channel used in the prior art is not used to transmit only one channel of audio data. However, it is possible to use one I2S channel to transmit more than one channel data for data transmission, that is, use a limited number of I2S channels to transmit audio data with a large number of channels. Therefore, the channel data with a larger number of channels can be transmitted without increasing the number of I2S channels, so as to realize the playback of stereo surround sound.
在一种实现方式中,本申请实施例中考虑到,目前在利用I2S信道传输音频数据时,受到原始音频数据本身的数据量的限制,在原始音频数据中一个声道的音频数据并不能完全占满一个I2S通道的传输位,这就会导致I2S通道的传输资源浪费。In an implementation manner, it is considered in the embodiment of this application that currently when using the I2S channel to transmit audio data, it is limited by the data volume of the original audio data itself, and the audio data of one channel in the original audio data cannot be completely Occupy the transmission bit of an I2S channel, which will lead to a waste of transmission resources of the I2S channel.
示例性的,在图7所示的I2S信道的时序图中,SDATA仅在WS切换后的两个BCLK周期内有数据传输(如图中阴影部分),其他的数据位并没有数据的 传输,这就导致I2S通道的传输资源浪费。Exemplarily, in the timing diagram of the I2S channel shown in Figure 7, SDATA only has data transmission in the two BCLK cycles after WS switching (the shaded part in the figure), and other data bits have no data transmission. This leads to a waste of transmission resources of the I2S channel.
其中,例如假设原始音频数据的采样频率为48KHz,采样位宽为16bit;采用的I2S信道的WS为48KHz,BCLK=2*48KHz*32bit=3.072MHz。也就是说,在一个帧时钟周期内,WS=0时,可以传输32bit的左声道数据;WS=1时,可以传输32bit的右声道数据。而原始音频数据的采样位宽只有16bit,这就导致在每个帧时钟周期内有16bit的数据位被浪费。Among them, for example, assume that the sampling frequency of the original audio data is 48KHz, and the sampling bit width is 16bit; the WS of the I2S channel used is 48KHz, BCLK=2*48KHz*32bit=3.072MHz. In other words, in a frame clock period, when WS=0, 32bit left channel data can be transmitted; when WS=1, 32bit right channel data can be transmitted. The sampling bit width of the original audio data is only 16 bits, which results in 16 bits of data being wasted in each frame clock cycle.
针对上述情况,本申请实施例中想到可以将没有利用上的数据位进行利用,从而增加I2S信道的传输效率,这样就能够利用有限I2S信道传输更多的声道数据。进而在一种实现方式中,S304具体包括:In view of the above situation, in the embodiments of the present application, it is conceived that the unused data bits can be used to increase the transmission efficiency of the I2S channel, so that more channel data can be transmitted using the limited I2S channel. Furthermore, in an implementation manner, S304 specifically includes:
S304a1、将m个声道子数据进行编码,生成n路编码数据。S304a1, encode m channel sub-data to generate n channels of encoded data.
其中,m个声道子数据中各声道子数据,分别包括m个声道中的一个声道在音频采样周期内的声道数据。Wherein, each channel sub-data in the m channel sub-data includes channel data of one of the m channels in the audio sampling period.
S304a2、在预设帧时钟周期内,利用n路I2S通道,将n路编码数据通过n路I2S通道发送至数据接收端。S304a2, within the preset frame clock period, use n I2S channels to send n encoded data to the data receiving end through the n I2S channels.
示例性的,以7.1声道的原始音频数据为例。如图8所示,若原始音频数据采用16bit@48KHz(即音频采样频率为48KHz、采样位宽16bit)。按照现有的发送方式,则需要5个I2S信道进行传输。Exemplarily, take 7.1 channel original audio data as an example. As shown in Figure 8, if the original audio data uses 16bit@48KHz (that is, the audio sampling frequency is 48KHz, and the sampling bit width is 16bit). According to the existing transmission method, 5 I2S channels are required for transmission.
在一些实施例中,如图8所示,在第一路I2S信道的一个I2S通道(即WS为“0”或为“1”中的一个)中,传输Ch0声道的数据;在第一路I2S信道的另一个I2S通道(即WS为“0”或“1”中的另一值时)中,传输Ch1声道的数据;依次类推,直至在第五路I2S信道的一个I2S通道中,传输Ch8声道的数据,另一I2S通道则可以闲置。In some embodiments, as shown in Figure 8, in one I2S channel of the first I2S channel (that is, WS is one of "0" or "1"), data of the Ch0 channel is transmitted; In the other I2S channel of the I2S channel (that is, when WS is the other value of "0" or "1"), the data of the Ch1 channel is transmitted; and so on, until it is in one I2S channel of the fifth I2S channel , Transmit Ch8 channel data, and the other I2S channel can be idle.
而如果此时采用的I2S信道的WS为48KHz,BCLK=2*48KHz*32bit=3.072MHz。也就是说,在一个帧时钟周期内,最多可以传输32bit的左声道数据和32bit的右声道数据。And if the WS of the I2S channel used at this time is 48KHz, BCLK=2*48KHz*32bit=3.072MHz. In other words, in one frame clock cycle, up to 32 bits of left channel data and 32 bits of right channel data can be transmitted.
因此,如图8所示,可以通过将同一音频采样周期内Ch0、Ch2、Ch3、Ch5、Ch6、Ch8六个声道的声道子数据分别放置在三路I2S信道所包括的六路I2S通道的高位,将剩余声道Ch1、Ch4、Ch7的声道子数据进行拆分并填补至六路I2S通道的剩余位。从而实现在不改变I2S信道的时钟频率的前提下,利用三路I2S信道传输8路声道的音频数据的效果。Therefore, as shown in Figure 8, the channel sub-data of the six channels Ch0, Ch2, Ch3, Ch5, Ch6, and Ch8 in the same audio sampling period can be respectively placed in the six I2S channels included in the three I2S channels. High bit, split the channel sub-data of the remaining channels Ch1, Ch4, Ch7 and fill in the remaining bits of the six I2S channels. So as to achieve the effect of using three I2S channels to transmit 8-channel audio data without changing the clock frequency of the I2S channel.
本申请实施例中,S304a1具体可以包括:将m个声道子数据中的n个声道子数据,分别作为n路编码数据的高位数据,并将m个声道子数据中其余声道的声道子数据补充在n个声道子数据之后,以生成n路编码数据。In this embodiment of the application, S304a1 may specifically include: taking n channel sub-data of m channel sub-data as high-order data of n channels of coded data, and combining the data of the remaining channels in the m channel sub-data. The channel sub-data is supplemented after the n channel sub-data to generate n-channel coded data.
其中,将m个声道子数据中其余声道的声道子数据补充在n个声道子数据之后,具体包括:Wherein, supplementing the channel sub-data of the remaining channels in the m channel sub-data after the n channel sub-data specifically includes:
将其余声道中各声道的声道子数据拆分成至少一个数据段;然后,将至少一个数据段分别补充在n个声道子数据之后。Split the channel sub-data of each channel in the remaining channels into at least one data segment; then, supplement at least one data segment after the n channel sub-data respectively.
本申请实施例中,在不增加I2S信道的个数并且在不减少m个声道子数据的数据总量的前提下,通过改变m个声道子数据的数据结构,将m个声道子数据通过n个I2S通道的一个帧时钟周期发送出去。以便播放更为逼真的立体环绕声。In the embodiment of the present application, without increasing the number of I2S channels and without reducing the total amount of data of m channel sub-data, by changing the data structure of m channel sub-data, the m channel sub-data The data is sent out through one frame clock cycle of n I2S channels. In order to play more realistic stereo surround sound.
在一种实现方式中,考虑到在对数据进行拆分、组合的过程中,比较容易出现运算错误,进而导致数据损失。例如,图8中,将Ch1、Ch4、Ch7拆分分两个8bit的数据段,在数据接收侧则需要将两个8bit的数据段进行重新组合。 这一过程中,容易导致数据损坏。因此,在本申请实施例中,作为n路编码数据的高位数据的n个声道子数据,具体包括:In an implementation manner, it is considered that in the process of splitting and combining data, it is relatively easy to make calculation errors, which will lead to data loss. For example, in Figure 8, Ch1, Ch4, and Ch7 are split into two 8-bit data segments, and the two 8-bit data segments need to be recombined on the data receiving side. In this process, it is easy to cause data damage. Therefore, in the embodiment of the present application, the n channel sub-data as high-order data of the n channels of coded data specifically include:
m个声道中重要程度最高的n个声道的声道子数据。Channel sub-data of the n channels with the highest importance among the m channels.
在一些实施例中,例如,在7.1声道中,包括顶部右声道TopR、顶部左声道TopL、环绕左声道SL、环绕右声道SR、前左声道L、前右声道R、重低音声道Woofer、中置声道Conter。进而,重要程度最高的n个声道的声道子数据,可以包括顶部右声道TopR、顶部左声道TopL、环绕左声道SL、环绕右声道SR、前左声道L、前右声道R,6个声道。进而,将重低音声道Woofer和中置声道Conter补充在上面6个声道的声道子数据后。这样做的优点在于当时钟信号受到干扰或异常时,采集的主声道以及环绕音,天空音不至于丢失以及错误。当然其拆分方式以及接受组合方式不固定。In some embodiments, for example, in the 7.1 channel, the top right channel TopR, the top left channel TopL, the surround left channel SL, the surround right channel SR, the front left channel L, and the front right channel R are included. , Woofer, center channel Conter. Furthermore, the channel sub-data of the most important n channels may include the top right channel TopR, the top left channel TopL, the surround left channel SL, the surround right channel SR, the front left channel L, and the front right channel. Channel R, 6 channels. Furthermore, the sub-bass channel Woofer and the center channel Conter are supplemented with the channel sub-data of the upper 6 channels. The advantage of this is that when the clock signal is disturbed or abnormal, the collected main channel, surround sound, and sky sound will not be lost and wrong. Of course, the way of splitting and the way of accepting combinations are not fixed.
在一种实现方式中,考虑到在一些应用场景中,I2S通道的剩余位数过少,即使将声道子数据拆分后,依然无法完全填充至剩余位数中。例如,以32bit@48KHz的7.1声道的原始音频数据为例,若采用一个帧时钟周期内最多传输32bit左右声道的3路I2S信道进行传输。此时,3路I2S信道所包括的6路I2S通道恰好仅能容纳6路声道数据传输,没有剩余位数。此时,为了能够将m个声道子数据通过n路I2S通道传输出去,还可以通过提高I2S信道的串行时钟频率BCLK的方法或者改变BCLK的采样方式的方法,来扩大一个帧时钟周期内最多能够传输的数据量。In an implementation manner, considering that in some application scenarios, the remaining bits of the I2S channel are too few, even after the channel sub-data is split, the remaining bits cannot be completely filled. For example, taking 32bit@48KHz 7.1 channel original audio data as an example, if a frame clock cycle is used to transmit at most 3 I2S channels of about 32bit channels for transmission. At this time, the 6 I2S channels included in the 3 I2S channels can only accommodate 6 channel data transmissions, and there are no remaining bits. At this time, in order to transmit m channel sub-data through n I2S channels, the method of increasing the serial clock frequency BCLK of the I2S channel or changing the sampling method of BCLK can be used to expand the frame clock period. The maximum amount of data that can be transferred.
在本申请实施例中,如图9所示,在执行S304a1之前,本申请实施例还包括:In the embodiment of the present application, as shown in FIG. 9, before executing S304a1, the embodiment of the present application further includes:
S304a3、提高n路I2S通道的串行时钟的频率。或者,将n路I2S通道的 串行数据的采样方式从串行时钟单沿采集方式切换为串行时钟双沿采集方式。S304a3. Increase the frequency of the serial clock of n I2S channels. Or, switch the sampling mode of the serial data of the n-channel I2S channel from the serial clock single-edge collection mode to the serial clock double-edge collection mode.
在一些实施例中,如图10所示,假设原始音频数据为采样频率为48KHz,采样位宽为16bit的12声道音频数据(具体包括图中Ch0、Ch1、Ch2、Ch3、Ch4、Ch5、Ch6、Ch7、Ch8、Ch9、Ch10、Ch11)。若利用一个帧时钟周期T内最多传输16bit左右声道的3路I2S信道进行传输。则在一个帧时钟周期T内,仅恰好能够传输6个声道的声道子数据(如图10中,Ch0、Ch1、Ch4、Ch5、Ch8、Ch10)。此时,为了保证12个声道的声道子数据能够在按正常播放的速率进行传输,可以采用提高n路I2S通道的串行时钟BCLK的频率,或者将n路I2S通道的串行数据SDATA的采样方式从BCLK单沿采集方式切换为BCLK双沿采集方式,来增加一个帧时钟周期内的传输数据量。In some embodiments, as shown in FIG. 10, it is assumed that the original audio data is 12-channel audio data with a sampling frequency of 48KHz and a sampling bit width of 16bit (specifically including Ch0, Ch1, Ch2, Ch3, Ch4, Ch5, Ch6, Ch7, Ch8, Ch9, Ch10, Ch11). If using 3 I2S channels that transmit at most 16bit left and right channels in one frame clock period T for transmission. Then in one frame clock period T, only channel sub-data of exactly 6 channels can be transmitted (as shown in Fig. 10, Ch0, Ch1, Ch4, Ch5, Ch8, Ch10). At this time, in order to ensure that the channel sub-data of the 12 channels can be transmitted at the normal playback rate, the frequency of the serial clock BCLK of the n I2S channels can be increased, or the serial data SDATA of the n I2S channels can be increased The sampling mode is switched from the BCLK single-edge collection mode to the BCLK double-edge collection mode to increase the amount of data transmitted in one frame clock cycle.
在一些实施例中,以图11为例,假设在提高串行时钟的频率或者采样方式之前,串行时钟的时序如图中BCLK_1所示。对应的SDATA的采样方式为BCLK上升沿采样。此时,串行数据的时序如图中SDATA_1所示,此时一个帧时钟周期T内,BCLK_1有8次上升沿触发,对应传输SDATA_1的8bit数据。In some embodiments, taking FIG. 11 as an example, it is assumed that before the frequency or sampling mode of the serial clock is increased, the sequence of the serial clock is as shown in the figure BCLK_1. The corresponding sampling method of SDATA is sampling on the rising edge of BCLK. At this time, the sequence of serial data is shown in SDATA_1 in the figure. At this time, within a frame clock period T, BCLK_1 has 8 rising edge triggers, corresponding to the transmission of 8bit data of SDATA_1.
然后,若将串行时钟BCLK的信号频率提高一倍,此时,串行数据的时序如图中SDATA_2所示,此时一个帧时钟周期T内,BCLK_2有16次上升沿触发,对应传输SDATA_2的16bit数据。可以看出,在相同时间内,能够传输的数据量也增加了一倍。Then, if the signal frequency of the serial clock BCLK is doubled, at this time, the sequence of the serial data is shown in SDATA_2 in the figure. At this time, within a frame clock period T, BCLK_2 has 16 rising edge triggers, corresponding to the transmission of SDATA_2 16bit data. It can be seen that in the same time, the amount of data that can be transmitted has doubled.
另外,还可以通过改变串行数据SDATA的采样方式的方法,提高传输数据量。在一些实施例中,如图11中,此时的串行时钟BCLK_3的频率相比BCLK_1并没有变化,但传输数据SDATA的采样方式由BCLK上升沿采样,变为了BCLK双沿采样。此时,一个帧时钟周期T内,也能够对应传输SDATA_3的16bit数 据。In addition, you can also increase the amount of transmitted data by changing the sampling method of the serial data SDATA. In some embodiments, as shown in FIG. 11, the frequency of the serial clock BCLK_3 at this time does not change compared to BCLK_1, but the sampling mode of the transmission data SDATA is changed from sampling on the rising edge of BCLK to sampling on both edges of BCLK. At this time, within one frame clock period T, 16bit data of SDATA_3 can also be correspondingly transmitted.
继续图10所示为例,当将n路I2S通道的串行时钟BCLK的频率增加一倍,或者将串行数据SDATA的采样方式从串行时钟单沿采集方式切换为双沿采集方式时,此时一个帧时钟WS周期T’内,能够传输的数据量就可以增加一倍(此时,图中周期T与周期T’的时间长度相同)。以图中信道I2S D0为例,在改变BCLK的频率或者改变SDATA的采样方式之前,该信道在一个帧时钟周期T内,能够传输Ch0、Ch1两个声道的声道子数据;而之后,则可以传输Ch0、Ch1、Ch2、Ch3四个声道的声道子数据。Continuing the example shown in Figure 10, when the frequency of the serial clock BCLK of the n-way I2S channel is doubled, or the sampling mode of the serial data SDATA is switched from the serial clock single-edge collection mode to the double-edge collection mode, At this time, the amount of data that can be transmitted within a period T'of the frame clock WS can be doubled (at this time, the time length of the period T and the period T'in the figure is the same). Take the channel I2S D0 in the figure as an example, before changing the frequency of BCLK or changing the sampling method of SDATA, the channel can transmit channel sub-data of the two channels Ch0 and Ch1 within one frame clock period T; and then, Then the channel sub-data of the four channels Ch0, Ch1, Ch2, and Ch3 can be transmitted.
在一种实现方式中,如图9所示,在执行S304a1或者执行S304a3之前,该方法包括:In an implementation manner, as shown in FIG. 9, before executing S304a1 or executing S304a3, the method includes:
S304a4、判断按照当前的串行时钟BCLK以及串行数据SDATA的采样方式,在一个帧时钟周期内串行数据所包括的数据容量能否容纳m个声道子数据。若能,则直接执行S304a1;若否,则执行S304a3。S304a4: Determine whether the data capacity included in the serial data can accommodate m channel sub-data in one frame clock cycle according to the current sampling mode of the serial clock BCLK and the serial data SDATA. If yes, execute S304a1 directly; if not, execute S304a3.
在另一种实现方式中,如图9所示,本申请实施例中,S304还可以包括:In another implementation manner, as shown in FIG. 9, in this embodiment of the present application, S304 may further include:
S304b、利用n路I2S通道的多个帧时钟周期,将m个声道子数据发送至数据接收端。S304b, using multiple frame clock cycles of n I2S channels to send m channel sub-data to the data receiving end.
其中,m个声道子数据中各声道子数据,分别包括m个声道中的一个声道在音频采样周期内的声道数据。Wherein, each channel sub-data in the m channel sub-data includes channel data of one of the m channels in the audio sampling period.
示例性的,例如,如图12所示,当需要利用3个I2S信道传输12路声道数据时,可以在第一个帧时钟周期T1内利用每个I2S信道分别发送两个声道的声道子数据(如图中,在T1周期内,利用I2S D0信道发送Ch0和Ch1两个声道的声道子数据、利用I2S D1信道发送Ch4和Ch5两个声道的声道子数据、 利用I2S D2信道发送Ch8和Ch9两个声道的声道子数据),再在下一个帧时钟周期T2内,发送剩余声道的声道子数据(如图中,在T2周期内,利用I2S D0信道发送Ch2和Ch3两个声道的声道子数据、利用I2S D1信道发送Ch6和Ch7两个声道的声道子数据、利用I2S D2信道发送Ch10和Ch11两个声道的声道子数据)。Exemplarily, for example, as shown in FIG. 12, when three I2S channels need to be used to transmit 12 channels of channel data, each I2S channel can be used to send two channels of sound in the first frame clock period T1. Channel data (as shown in the figure, in the T1 period, use the I2S D0 channel to send the channel sub-data of the two channels Ch0 and Ch1, use the I2S D1 channel to send the channel sub-data of the Ch4 and Ch5 channels, use The I2S D2 channel sends the channel sub-data of the two channels Ch8 and Ch9), and then the channel sub-data of the remaining channels is sent in the next frame clock period T2 (as shown in the figure, in the T2 period, the I2S D0 channel is used) Send the channel sub-data of the two channels Ch2 and Ch3, use the I2S D1 channel to send the channel sub-data of the Ch6 and Ch7 channels, and use the I2S D2 channel to send the channel sub-data of the Ch10 and Ch11 channels) .
在一些实施例中,本申请实施例还提供一种数据传输方法,如图13所示,具体包括:In some embodiments, the embodiments of the present application also provide a data transmission method, as shown in FIG. 13, which specifically includes:
S401、获取m路声道的音频数据。其中,4<m≤8。S401. Acquire audio data of m channels. Among them, 4<m≤8.
关于S401的具体执行步骤以及所起到的效果,可参照上述实施例中S303的内容。Regarding the specific execution steps and effects of S401, refer to the content of S303 in the foregoing embodiment.
S402、将m个声道子数据进行编码,生成4路编码数据。S402: Encode the m channel sub-data to generate 4 channels of encoded data.
关于S402的具体执行步骤以及所起到的效果,可参照上述实施例中S304a1的内容。Regarding the specific execution steps and effects of S402, refer to the content of S304a1 in the foregoing embodiment.
S403、在预设帧时钟周期内,利用4路I2S通道,将4路编码数据通过4路I2S通道发送至数据接收端。S403: In the preset frame clock period, use 4 I2S channels to send 4 channels of encoded data to the data receiving end through 4 channels of I2S channels.
在一些实施例中,将m个声道子数据中的4个声道子数据,分别作为4路编码数据的高位数据,并将m个声道子数据中其余声道的声道子数据补充在4个声道子数据之后,以生成4路编码数据。In some embodiments, the 4 channel sub-data in the m channel sub-data are respectively used as the high-order data of the 4 channels of coded data, and the channel sub-data of the remaining channels in the m channel sub-data are supplemented After 4 channels of sub-data, 4 channels of coded data are generated.
在一些实施例中,可以将m个声道子数据中其余声道的声道子数据,依次补充在4个声道子数据中不同的声道子数据之后。In some embodiments, the channel sub-data of the remaining channels in the m channel sub-data may be sequentially supplemented after different channel sub-data in the 4 channel sub-data.
示例性的,如图14所示,将L、C、Rs(或Rrs)、Lfh(或Lrh)四个声道 的声道子数据,分别放置在两个I2S信道(如图中,I2S D0和I2S D1)的四个I2S通道的高位。然后,将R、LFE、Ls(或Lrs)、Rfh四个声道的声道子数据,依次补充在L、C、Rs(或Rrs)、Lfh(或Lrh)四个声道的声道子数据之后。Exemplarily, as shown in Figure 14, the channel sub-data of the four channels of L, C, Rs (or Rrs), and Lfh (or Lrh) are respectively placed in two I2S channels (in the figure, I2S D0 And the high bits of the four I2S channels of I2S D1). Then, the channel sub-data of the four channels of R, LFE, Ls (or Lrs), and Rfh are sequentially supplemented with the channel sub-data of the four channels of L, C, Rs (or Rrs), and Lfh (or Lrh). After the data.
关于S403的其他具体执行步骤以及所起到的效果,可参照上述实施例中S304a2的内容。For other specific execution steps and effects of S403, refer to the content of S304a2 in the foregoing embodiment.
在一种实现方式中,在S401获取m路声道的音频数据之后,该方法还包括:In an implementation manner, after acquiring audio data of m channels in S401, the method further includes:
S404、利用4路I2S通道的多个帧时钟周期,将m个声道子数据发送至数据接收端。S404: Use multiple frame clock cycles of the 4 I2S channels to send m channel sub-data to the data receiving end.
示例性的,如图15所示,在第一个帧时钟周期T1内,通过两个I2S信道(如图中,I2S D0和I2S D1)所包括的4路I2S通道,将L、R、Rs(或Rrs)、Ls(或Lrs)四个声道的声道子数据发送出去。然后,在第二个帧时钟周期T2内,将剩余的四个声道C、LFR、Rs(或Rrs)、Ls(或Lrs),发送出去。Exemplarily, as shown in Figure 15, in the first frame clock cycle T1, through the four I2S channels included in the two I2S channels (in the figure, I2S D0 and I2S D1), L, R, Rs (Or Rrs) and Ls (or Lrs) channel sub-data of four channels are sent out. Then, in the second frame clock period T2, the remaining four channels C, LFR, Rs (or Rrs), and Ls (or Lrs) are sent out.
关于S404的其他具体执行步骤以及所起到的效果,可参照上述实施例中S304b的内容。For other specific execution steps and effects of S404, please refer to the content of S304b in the foregoing embodiment.
以下结合实际应用场景,对实施例一和实施二的应用进行介绍:The following describes the applications of Embodiment 1 and Embodiment 2 in combination with actual application scenarios:
如图16所示,在电视机等设备需要播放音频数据时。首先,第一处理芯片会利用其中的解码器(Decoder)对声源数据进行解码(相当于上述实施例一步骤S301),然后利用第二处理芯片中的数字音频播放器(digital audio player,DAP)对解码后的各声道的音频数据进行预处理(相当于上述实施例一步骤S302)。其中,在一种实现方式中,上述第一处理芯片和第二处理芯片的功能也可由一个或者多个DSP芯片来实现。As shown in Figure 16, when TVs and other devices need to play audio data. First, the first processing chip uses the decoder (Decoder) in it to decode the sound source data (equivalent to step S301 in the first embodiment above), and then uses the digital audio player (DAP) in the second processing chip. ) Preprocessing the decoded audio data of each channel (equivalent to step S302 in the first embodiment above). Wherein, in an implementation manner, the functions of the above-mentioned first processing chip and the second processing chip may also be implemented by one or more DSP chips.
之后,需要将预处理后的音频数据发送至功放进行播放。在一种实现方式中,可以通过混音(Audio Mixing,MIX)技术,将多个声道的音频数据混合成两个声道的数据,然后通过功放等器件播放出去。但这样会损失音频数据的质量。在另一种实现方式中,如图中,利用第三处理芯片按照上述实施例一和实施例二的方式,对音频数据进行处理,然后再利用较少的I2S信道实现音频数据的无损传输。After that, the preprocessed audio data needs to be sent to the power amplifier for playback. In one implementation manner, audio mixing (MIX) technology can be used to mix audio data of multiple channels into data of two channels, and then play it out through a device such as a power amplifier. But this will lose the quality of audio data. In another implementation manner, as shown in the figure, a third processing chip is used to process the audio data according to the above-mentioned first and second embodiments, and then use fewer I2S channels to achieve lossless transmission of audio data.
当将本申请上述实施例应用在电视机等设备中时,以下结合设备的工作过程,对上述实施例的应用进行介绍:When the above-mentioned embodiments of this application are applied to televisions and other equipment, the following describes the application of the above-mentioned embodiments in conjunction with the working process of the equipment:
1、当需要播放目标音频数据时,上层打开多声道APK应用,已通知的方式传达给中间件和Drive层。具体的,设备的协议架构如图17所示。1. When the target audio data needs to be played, the upper layer opens the multi-channel APK application and communicates it to the middleware and Drive layer in a notified manner. Specifically, the protocol architecture of the device is shown in Figure 17.
2、中间件接到上层指令后,将多声道有关代码打开。2. After receiving the upper-level instruction, the middleware opens the relevant code of the multi-channel.
3、驱动层会枚举底层硬件连接的Audio设备,比如枚举到USB设备,就打开USB。3. The driver layer will enumerate the Audio devices connected to the underlying hardware, such as enumerating to a USB device, and then turn on the USB.
4、Audio设备输入音频文件,经过芯片进行Decoder解码后源数据在底层。4. Audio device inputs audio files, and the source data is at the bottom layer after the chip decodes the decoder.
5、驱动层向中间层请求已枚举到USB设备,数据是否需要进行发出。5. The driver layer requests the middle layer to enumerate the USB device, whether the data needs to be sent.
6、中间件请求上层,收到AUDIO数据,是否发送。6. The middleware requests the upper layer to receive the AUDIO data and whether to send it.
7、上层应答,通知数据发送。7. The upper layer responds to notify the data to be sent.
8、应答指令通知中间层,中间层将多声道数据(杜比ATMOS,DRC等)处理方式发给驱动层对底层进行数据的后处理。8. The response instruction informs the middle layer, and the middle layer sends the processing mode of multi-channel data (Dolby ATMOS, DRC, etc.) to the driver layer to perform data post-processing on the bottom layer.
9、音效后处理,驱动层将收到中间层对数据压缩,打包为USB数据格式方式进行处理,处理后在通过USB通道传输给功放。9. Audio effect post-processing, the driver layer will receive the intermediate layer to compress the data, pack it into a USB data format for processing, and transmit it to the power amplifier through the USB channel after processing.
10、如果是枚举到I2S设别,中间层接收到发送指令后,中间层将多声道 数据(杜比ATMOS,DRC等)处理方式以及本申请上述实施例所提供的音频数据传输方法发给驱动层,使其对底层按照本申请上述实施例所提供的音频数据传输方法对数据进行拆分、组合等处理,然后通过I2S直接传输出去。10. If it is enumerated to the I2S device, after the middle layer receives the sending instruction, the middle layer sends the multi-channel data (Dolby ATMOS, DRC, etc.) processing method and the audio data transmission method provided in the above-mentioned embodiment of this application Give the driver layer to the bottom layer to split and combine the data according to the audio data transmission method provided in the above-mentioned embodiments of the application, and then directly transmit it through I2S.
11、16bit 8ch音频数据在Drive层进行数据拆分排列,将SW低音以及中置将16bit拆成SwH 8bit,SwL 8Bit,CH8bit,CL8bit。11. The 16bit 8ch audio data is split and arranged in the Drive layer, and the SW bass and center are split into SwH 8bit, SwL 8Bit, CH8bit, CL8bit.
上述过程中,可以看出,在一种实现方式中,为了不重新设计主控板,可以利用USB接口实现对音频数据的传输。但这种方式需要将音频数据按照USB接口协议进行打包,然后传输。而这种方式的延时较大,并不适于同步播放的音频数据的传输过程。而本申请实施例所提供的音频数据传输方法,则具有节省系统成本,降低延时时间等有益效果。In the above process, it can be seen that in an implementation manner, in order not to redesign the main control board, the USB interface can be used to realize the transmission of audio data. But this method needs to pack the audio data according to the USB interface protocol and then transmit it. However, this method has a relatively large delay and is not suitable for the transmission process of audio data that is played synchronously. However, the audio data transmission method provided by the embodiment of the present application has beneficial effects such as saving system cost and reducing delay time.
在一些实施例中,本申请实施例还提供一种音频数据传输方法,具体的,如图18所示。该方法包括:In some embodiments, the embodiments of the present application also provide an audio data transmission method, specifically, as shown in FIG. 18. The method includes:
S501、接收n路I2S通道发送的传输数据。S501: Receive transmission data sent by n I2S channels.
在一种实现方式中,在先执行了实施例一或实施例二所提供的音频数据传输方法后,S501所包括的内容具体用于在S304之后执行。In an implementation manner, after the audio data transmission method provided in Embodiment 1 or Embodiment 2 is executed first, the content included in S501 is specifically used to execute after S304.
示例性的,在图5所示的从属装置20中,由音频协处理器201来执行S501以及下文S502的步骤内容。Exemplarily, in the slave device 20 shown in FIG. 5, the audio coprocessor 201 executes the steps of S501 and the following S502.
S502、将n路I2S通道发送的传输数据,转换为m路声道的音频数据。其中,m>n。S502: Convert the transmission data sent by the n channels of I2S channels into m channels of audio data. Among them, m>n.
在一些实施例中,为了使音频协处理器201能够将n路I2S通道发送的传输数据,转换为m路声道的音频数据,在执行S502之前,该方法还包括:In some embodiments, in order to enable the audio coprocessor 201 to convert the transmission data sent by n channels of I2S channels into m channels of audio data, before performing S502, the method further includes:
S503、接收数据发送端发送的编码信息。以便按照编码信息对应的解码方 式,从n路I2S通道发送的传输数据中,分别拆分出m路声道的音频数据。S503: Receive the encoding information sent by the data sending end. In order to separate the audio data of m channels from the transmission data sent by n I2S channels according to the decoding method corresponding to the encoded information.
在一种实现方式中,S501具体包括:接收预设帧时钟周期内,n路I2S通道发送的n路编码数据。S502具体包括:对n路编码数据进行解码,生成m个声道子数据。In an implementation manner, S501 specifically includes: receiving n channels of encoded data sent by n channels of I2S channels within a preset frame clock period. S502 specifically includes: decoding n channels of coded data to generate m channel sub-data.
其中,m个声道子数据中各声道子数据,分别包括m个声道中的一个声道在音频采样周期内的声道数据。Wherein, each channel sub-data in the m channel sub-data includes channel data of one of the m channels in the audio sampling period.
其中,在一种实现方式中,如图19所示,S502具体包括:Among them, in an implementation manner, as shown in FIG. 19, S502 specifically includes:
S502a1、从n路编码数据的高位数据中,依次获取n个声道子数据。S502a1. Obtain n channel sub-data in sequence from the high-order data of the n channels of encoded data.
S502a2、从n路编码数据的剩余数据中,获取m个声道子数据中除n个声道子数据之外的声道子数据。S502a2, from the remaining data of the n channels of coded data, obtain channel sub-data of the m channel sub-data except for the n channel sub-data.
其中,n个声道子数据,具体包括:m个声道中重要程度最高的n个声道的声道子数据。Among them, the n channel sub-data specifically include: channel sub-data of the n channels with the highest importance among the m channels.
在一些实施例中,上述S502可以作为上述实施例一中S304a1、S304a2等步骤的反向解码过程,其所解决的技术问题与实现的有益效果与上述实施例一相同。对此,不再赘述。In some embodiments, the above S502 can be used as the reverse decoding process of the steps S304a1, S304a2, etc. in the first embodiment, and the technical problems solved and the beneficial effects achieved are the same as those in the first embodiment. In this regard, I will not repeat it.
在另一种实现方式中,如图19所示,S502具体包括:In another implementation manner, as shown in FIG. 19, S502 specifically includes:
S502b1、接收n路I2S通道发送的多个帧时钟周期的传输数据;S502b1, receiving transmission data of multiple frame clock cycles sent by n I2S channels;
S502b2、将n路I2S通道发送的传输数据,转换为m路声道的音频数据,具体包括:S502b2. Convert the transmission data sent by n channels of I2S channels into m channels of audio data, which specifically includes:
S502b3、利用多个帧时钟周期的传输数据,生成m个声道子数据。S502b3. Generate m channel sub-data by using transmission data of multiple frame clock cycles.
其中,m个声道子数据中各声道子数据,分别包括m个声道中的一个声道在音频采样周期内的声道数据。Wherein, each channel sub-data in the m channel sub-data includes channel data of one of the m channels in the audio sampling period.
在一些实施例中,上述S502可以作为上述实施例一中S304a1、S304a2、S304b等步骤的反向过程,其所解决的技术问题与实现的有益效果与上述实施例一相同。对此,不再赘述。In some embodiments, the above S502 can be used as the reverse process of the steps S304a1, S304a2, S304b, etc. in the first embodiment, and the technical problems solved and the beneficial effects achieved are the same as those in the first embodiment. In this regard, I will not repeat it.
在一种实现方式中,考虑到当n路I2S通道具有独立的时钟信号(包括BCLK、WS、MCLK等时钟)时,若在接收n路I2S通道传输的数据的同时,对n路编码数据进行解码以生成m个声道子数据,则会占用较多的系统资源,从而影响设备的正常运行。In one implementation, considering that when n I2S channels have independent clock signals (including clocks such as BCLK, WS, MCLK, etc.), if the data transmitted by n I2S channels is received, the encoded data of n Decoding to generate m channel sub-data will occupy more system resources, thereby affecting the normal operation of the device.
在本申请实施例中,若n路I2S通道具有独立的时钟信号,则对n路编码数据进行解码,生成m个声道子数据,具体包括:In the embodiment of the present application, if n I2S channels have independent clock signals, then n channels of encoded data are decoded to generate m channel sub-data, which specifically includes:
将在音频采样周期中从n路I2S通道接收到的数据存储在缓存中,在音频采样周期结束后,对缓存中的编码数据进行解码,生成m个声道子数据。The data received from n I2S channels in the audio sampling period is stored in the buffer. After the audio sampling period ends, the encoded data in the buffer is decoded to generate m channel sub-data.
在一些实施例中,若n路I2S通道采用共同的时钟信号,则为了提高CPU的使用率,则采用在从n路I2S通道接收数据的同时,对接收到的数据进行解码。具体的,对接收到的数据进行解码,包括:将接收到的数据进行拆分、组合等步骤,以生成m个声道子数据。In some embodiments, if n I2S channels use a common clock signal, in order to increase the utilization rate of the CPU, it is used to decode the received data while receiving data from the n I2S channels. Specifically, decoding the received data includes: splitting and combining the received data to generate m channel sub-data.
以下结合实例,对上述实施例所提供的音频数据传输方法进行介绍:The following describes the audio data transmission method provided by the above embodiments in combination with examples:
在一些实施例中,不同芯片方案系统内部I2S架构方式不同,I2S协议中有MCLK,BCLK,WS,SDATA四组信号,其中MCLK为主时钟信号。BCLK时钟信号,WS声道选择,SDATA为声道数据。芯片架构不同,I2S传输的形式也不同。In some embodiments, the internal I2S architecture of different chip solution systems is different. There are four groups of signals MCLK, BCLK, WS, and SDATA in the I2S protocol, and MCLK is the main clock signal. BCLK clock signal, WS channel selection, SDATA is channel data. Different chip architectures have different forms of I2S transmission.
在一种方式中,n路I2S通道可能采用同一时钟信号。此时,接收n路I2S通道发送的传输数据时,采用边收边拆的形式。In one approach, n I2S channels may use the same clock signal. At this time, when receiving the transmission data sent by the n-way I2S channel, the form of receiving and dismantling is adopted.
在一些实施例中,不同芯片I2S信道输出通道不同,如MSD858为例,机芯端会支持2路I2S信道输出,但2路I2S信道是共用一路MCLK,BCLK,WS的,也就是所说的单路CLK采集,单路CLK由机芯端发出给外部音频协处理器201,音频协处理器201根据单路CLK,采集上述机芯端(具体可以为图5所示主芯片10)按照不同编码排列形式发送出的m个声道的音频数据。其中,音频协处理器201具体可以为XMOS芯片。In some embodiments, different chip I2S channel output channels are different, such as MSD858 as an example, the core end will support 2 I2S channel output, but the 2 I2S channels share one MCLK, BCLK, WS, which is so-called Single-channel CLK collection, a single-channel CLK is sent from the movement end to the external audio coprocessor 201, and the audio co-processor 201 collects the aforementioned movement end (specifically, the main chip 10 shown in Figure 5) according to the single-channel CLK. The audio data of m channels sent out in the form of encoding arrangement. Among them, the audio coprocessor 201 may specifically be an XMOS chip.
在一些实施例中,以16bit@48HKZ---24bit@48HKz为例,假使存在8个声道的音频数据在3路I2S信道中传输。以下介绍作为音频协处理器201的XMOS芯片的工作过程:In some embodiments, taking 16bit@48HKZ---24bit@48HKz as an example, suppose there are 8 channels of audio data to be transmitted in 3 I2S channels. The following describes the working process of the XMOS chip as the audio coprocessor 201:
1、数据发送后到达XMOS端,XMOS芯片接收到数据后开始进行数据重新排列。1. After the data is sent, it reaches the XMOS end, and the XMOS chip starts to rearrange the data after receiving the data.
2、由于3路I2S信道是同时发送到接收端,因此XMOS平台驱动软件根据机芯端提供的编码信息进行拆解。2. Since the 3 I2S channels are sent to the receiving end at the same time, the XMOS platform driver software is disassembled according to the coding information provided by the movement end.
3、如图20所示,将3路I2S信道中分别截取前左右声道16bit数据(即截取一个I2S信道所包括的两个I2S通道的前16bit数据),还原出Ch0、Ch1、Ch2、Ch3、Ch4、Ch5声道分别对应的16bit的数据。分别放到XMOS芯片的前3路I2S信道所包括的6路通道中。3. As shown in Figure 20, intercept the 16bit data of the front left and right channels from the 3 I2S channels (ie intercept the first 16bit data of the two I2S channels included in one I2S channel) to restore Ch0, Ch1, Ch2, and Ch3 , Ch4, Ch5 channels correspond to 16bit data respectively. Put them into the 6 channels included in the first 3 I2S channels of the XMOS chip.
4、如图20,将I2S_0信道中两个I2S通道接收到的后8bit数据合成Ch6的数据,放到XMOS第四路I2S信道所包括的一个通道中。4. As shown in Figure 20, combine the last 8bit data received by the two I2S channels in the I2S_0 channel into Ch6 data, and put them into one channel included in the fourth I2S channel of XMOS.
5、如图20,将I2S_1信道中两个I2S通道接收到的后8bit数据合成Ch7的数据,放到XMOS第四路I2S信道所包括的另一个通道中。5. As shown in Figure 20, combine the last 8bit data received by the two I2S channels in the I2S_1 channel into the Ch7 data, and put it into the other channel included in the fourth I2S channel of XMOS.
再例如,以16bit@48HKZ---16bit@96HKz为例,假使存在12个声道的音 频数据在3路I2S信道中传输。以下介绍作为音频协处理器201的XMOS芯片的工作过程:For another example, taking 16bit@48HKZ---16bit@96HKz as an example, suppose there are 12 channels of audio data to be transmitted in 3 I2S channels. The following describes the working process of the XMOS chip as the audio coprocessor 201:
首先,为了使采样频率提升为96KHz,一种方式是提高BCLK的频率,另一种方式是原采样频率不变,采用BCLK的双沿采样的方式进行数据的采集。具体的:First, in order to increase the sampling frequency to 96KHz, one way is to increase the frequency of BCLK, and the other way is to keep the original sampling frequency unchanged, and use the double-edge sampling of BCLK to collect data. specific:
1、数据发送后到达XMOS端,XMOS芯片接收到数据后开始进行数据重新排列。1. After the data is sent, it reaches the XMOS end, and the XMOS chip starts to rearrange the data after receiving the data.
2、由于3路I2S信道数据是同时发送到接收端,因此XMOS平台驱动软件根据机芯端提供的多声道数据编码序列进行拆解。2. Since the data of the 3 I2S channels are sent to the receiving end at the same time, the XMOS platform driver software is disassembled according to the multi-channel data encoding sequence provided by the movement end.
3、如图21所示,将每个通路上的I2S信道数据,通过数据发送端提供的时钟波形进行数据拆解。XMOS端同样采用双沿取样,将I2S_0数据提取成4ch16bit的数据,分别存放到输出I2S_a、I2S_b中。3. As shown in Figure 21, disassemble the I2S channel data on each channel through the clock waveform provided by the data transmitter. The XMOS end also uses double-edge sampling to extract the I2S_0 data into 4ch16bit data and store them in the output I2S_a and I2S_b respectively.
4、如图21所示,同样将I2S_1上的数据进行双沿采样,提取出4ch 16bit数据,分别放到输出I2S_c、I2S_d中。4. As shown in Figure 21, double-edge sampling of the data on I2S_1 is also performed to extract 4ch 16bit data and put them into the output I2S_c and I2S_d respectively.
5、如图21所示,同样将I2S2上的数据进行双沿采样,提取出4ch 16bit数据,分别放到输出I2S_e、I2S_f中。5. As shown in Figure 21, double-edge sampling of the data on I2S2 is also performed to extract 4ch 16bit data and put them into the output I2S_e and I2S_f respectively.
XMOS将接收并拆分后的数据存放到用于输出的I2S信道(具体包括图21中I2S_a、I2S_b、I2S_c、I2S_d、I2S_e、I2S_f)上,其本身存有时钟信号,自行产生48KHZ时钟信号,在此时钟信号下,将多声道数据传送给后端功放芯片,进行声音转换。XMOS stores the received and split data in the I2S channel for output (specifically including I2S_a, I2S_b, I2S_c, I2S_d, I2S_e, I2S_f in Figure 21), it has a clock signal in itself, and generates a 48KHZ clock signal by itself. Under this clock signal, the multi-channel data is transmitted to the back-end power amplifier chip for sound conversion.
再例如,不同芯片方案系统内部I2S架构方式不同,I2S协议中有MCLK,BCLK,WS,SDATA四组信号,其中MCLK为主时钟信号。BCLK时钟信号, WS声道选择,SDATA为声道数据。芯片架构不同,I2S传输的形式也不同。下面以nova 72671以及后续产品为例。机芯芯片支持3路I2S输出,如果3路I2S共用一路CLK的话,就会存在数据传输过程中,一旦I2S共用的CLK出错,就会造成3路I2S数据传输被接收到的数据出错,可能存在声音异常等情况发生,CLK出错来源:软件的延迟,外围信号的干扰,硬件电路等。For another example, the internal I2S architecture of different chip scheme systems is different. There are four groups of signals MCLK, BCLK, WS, and SDATA in the I2S protocol, of which MCLK is the main clock signal. BCLK clock signal, WS channel selection, SDATA is channel data. Different chip architectures have different forms of I2S transmission. Take Nova 72671 and its follow-up products as an example below. The movement chip supports 3 channels of I2S output. If 3 channels of I2S share one CLK, there will be an error in the data transmission process. Once the I2S shared CLK error, it will cause 3 channels of I2S data transmission to receive data errors. When abnormal sound occurs, the source of CLK error: software delay, peripheral signal interference, hardware circuit, etc.
例如,XMOS芯片在接收、拆分数据发送端的24bit数据时,如果clk出现异常抖动,就会造成数据出错。假使CLK在低16位时出现抖动,造成该位数由0读成1,后面XMOS进行拆分24bit数据从16bit后出现异常,数据不是原有多声道数据,而且共一路CLK的情况下,同时影响3路I2S数据,对多声道而言出现异响等情况,因此此种架构方式存在弊端,但其优点在与节省了芯片内部的成本需求。For example, when the XMOS chip receives and splits the 24-bit data at the data sending end, if clk jitters abnormally, it will cause data errors. If the CLK is jittered in the lower 16 bits, which causes the number of bits to be read from 0 to 1, and then XMOS splits the 24bit data from 16bit, and the data is abnormal. The data is not the original multi-channel data and there is a total of CLK. At the same time, 3 channels of I2S data are affected, and abnormal noise occurs for multi-channels. Therefore, this kind of architecture has drawbacks, but its advantages are that it saves the cost of the chip.
在一些实施例中,本申请采用的NT72673输出的3路I2S芯片内部架构是每一组I2S信道有单独的MCLK,WS,BCK,SDATA,但更为重要的是要保证3路I2S信道的MCLK同步。In some embodiments, the internal structure of the 3-channel I2S chip output by the NT72673 used in this application is that each group of I2S channels has a separate MCLK, WS, BCK, SDATA, but more importantly, it is necessary to ensure the MCLK of the 3-channel I2S channel Synchronize.
(1)一种方法就是等待发送,就是等待3路I2S信道数据全部处理好后,同时发送。(1) One method is to wait for transmission, which is to wait for the 3 I2S channel data to be processed at the same time.
(2)初始化发新声音,采集3路初始化音频数据的第一位,以第一位有效信号当做等待音的MCLK。(2) Initialize to send a new sound, collect the first bit of the 3 channels of initialized audio data, and use the first valid signal as the MCLK of the waiting tone.
由于3路I2S信道的CLK共用,因此用3路I2S信道的CLK分别取发送数据。这样就很大程度上降低因某一路clk异常导致其数据出错。Since the CLKs of the 3 I2S channels are shared, the CLKs of the 3 I2S channels are used to fetch the sending data respectively. This greatly reduces the data error caused by a clk abnormality.
以下,结合实例,对本申请实施例中,先将接收到的数据存储在缓存中,在采样周期结束后,对缓存中的编码数据进行编码的过程,进行介绍:In the following, in conjunction with examples, the process of storing the received data in the buffer in the embodiment of the present application, and encoding the encoded data in the buffer after the end of the sampling period is introduced:
以16bit@48HKZ---24bit@48HKz为例:Take 16bit@48HKZ---24bit@48HKz as an example:
1、数据发送端(具体可以为SOC芯片)将3路I2S信道中各通道发出的24bit数据全部传输给XMOS芯片,XMOS芯片不进行边收边拆,其将24bit数据进行缓存在buffer中。1. The data sending end (which can be a SOC chip specifically) transmits all the 24bit data sent by each channel of the 3 I2S channels to the XMOS chip. The XMOS chip does not receive and disassemble, and it buffers the 24bit data in the buffer.
2、数据发送端将数据发送端8ch数据变为6ch数据的编码排列方式提供给XMOS芯片。相当于S503所描述的,XMOS芯片接收数据发送端发送的编码信息。2. The data sending end provides the XMOS chip with an encoding arrangement of 8ch data at the data sending end into 6ch data. Equivalent to the description in S503, the XMOS chip receives the encoded information sent by the data sender.
3、待三组数据缓存后,由于XMOS端内部本身存在时钟信号,分别采集3路数据的第一位为有效MCLK信号,采集24bit数据的前16bit有效数据。以图20为例,将采集的16bit有效数据进行组合,得出Ch0、Ch1、Ch2、Ch3、Ch4、Ch5,6个声道的音频数据。3. After the three sets of data are buffered, because there is a clock signal inside the XMOS terminal, the first bit of the three data channels is collected as a valid MCLK signal, and the first 16 bits of the 24bit data are collected. Take Figure 20 as an example, combine the collected 16-bit effective data to get Ch0, Ch1, Ch2, Ch3, Ch4, Ch5, 6-channel audio data.
4、如图20中,在采集3路I2S信道的24bit第一位有效数据为有效的MCLK信号,采集24bit数据中的后8bit数据,重新进行数据组合,得出Ch6、Ch7,2个声道的音频数据。4. As shown in Figure 20, the first valid data of 24bit of the three I2S channels is collected as a valid MCLK signal, the last 8bit of the 24bit data is collected, and the data is recombined to obtain Ch6, Ch7, 2 channels Audio data.
5、将还原出的原有多声道5.1.2的数据通过4路I2S信道(具体包括图中,I2S_a、I2S_b、I2S_c、I2S_d)输送给功放端,实现多声道音效效果的目的。5. The restored original multi-channel 5.1.2 data is sent to the power amplifier through 4 I2S channels (specifically, I2S_a, I2S_b, I2S_c, I2S_d in the figure) to achieve the purpose of multi-channel sound effects.
以16bit@48HKZ---16bit@96HKz为例,即通过提高BCLK的频率或者采用双沿采样的方式,使采样频率提升为96KHz。具体的:Taking 16bit@48HKZ---16bit@96HKz as an example, the sampling frequency is increased to 96KHz by increasing the frequency of BCLK or adopting double-edge sampling. specific:
1、数据发送端(具体可以为SOC芯片)将3路I2S信道中各通道发出的数据全部传输给XMOS芯片,XMOS芯片不进行边收边拆,其将数据进行缓存在buffer中。1. The data sending end (specifically, it can be a SOC chip) transmits all the data sent by each channel of the 3 I2S channels to the XMOS chip. The XMOS chip does not receive and disassemble, but it buffers the data in the buffer.
2、数据发送端将此编码排列方式以及双沿采样方式提供给XMOS芯片。 相当于S503所描述的,XMOS芯片接收数据发送端发送的编码信息。2. The data sending end provides this encoding arrangement and double-edge sampling to the XMOS chip. Equivalent to the description in S503, the XMOS chip receives the encoded information sent by the data sender.
3、XMOS芯片将3路I2S第一位有效数据作为基准MCLK,采样频率设为48KHZ。3. The XMOS chip uses the first valid data of 3 channels of I2S as the reference MCLK, and the sampling frequency is set to 48KHZ.
4、如图21所示,将3路I2S信道传输过来的数据同时放入堆栈中,采样频率设为48KHz,采用双沿采样方式。分别采样出Ch0,Ch1…Ch11,共12个声道中各声道分别对应的16bit数据。4. As shown in Figure 21, put the data transmitted from the three I2S channels into the stack at the same time, the sampling frequency is set to 48KHz, and the double-edge sampling method is adopted. Sampling out Ch0, Ch1...Ch11 respectively, the 16bit data corresponding to each channel in a total of 12 channels.
5、将此12ch 16bit数据进行按照原有数据分配格式分别给6路I2S通道(具体包括图中,I2S_a、I2S_b、I2S_c、I2S_d)。5. This 12ch 16bit data is distributed to 6 I2S channels (specifically, I2S_a, I2S_b, I2S_c, I2S_d in the figure) according to the original data distribution format.
6、XMOS芯片内部自发等待音,调整6路I2S信道的时钟同步。C同步后,由XMOS芯片通过6路I2S信道同时发送给功放端。6. The XMOS chip generates a wait tone spontaneously and adjusts the clock synchronization of the 6 I2S channels. After C is synchronized, the XMOS chip sends it to the power amplifier at the same time through 6 I2S channels.
在一些实施例中本申请提供了一种音频数据传输装置,用于执行本申请实施例一、实施例二所提供的音频数据传输方法,如图22所示,为本申请实施例提供的音频数据传输装置60的一种可能的结构示意图。其中,该装置包括:获取单元601、发送单元602。In some embodiments, this application provides an audio data transmission device for executing the audio data transmission methods provided in the first and second embodiments of this application. As shown in FIG. 22, the audio data provided in this embodiment A possible structure diagram of the data transmission device 60. Wherein, the device includes: an acquiring unit 601 and a sending unit 602.
获取单元601,用于获取m路声道的音频数据。The acquiring unit 601 is configured to acquire audio data of m channels.
发送单元602,用于利用n路I2S通道,将m路声道的音频数据发送至数据接收端;其中,m>n。The sending unit 602 is configured to use n I2S channels to send m channels of audio data to the data receiving end; where m>n.
在一些实施例中,发送单元602,具体包括编码子单元6021以及发送子单元6022。其中:In some embodiments, the sending unit 602 specifically includes an encoding subunit 6021 and a sending subunit 6022. among them:
编码子单元6021,用于将m个声道子数据进行编码,生成n路编码数据;其中,m个声道子数据中各声道子数据,分别包括m个声道中的一个声道在音频采样周期内的声道数据;The encoding subunit 6021 is used to encode m channel sub-data to generate n channels of encoded data; wherein, each channel sub-data in the m channel sub-data includes one of the m channels in the Channel data in the audio sampling period;
发送子单元6022,用于在预设帧时钟周期内,利用n路I2S通道,将n路编码数据通过n路I2S通道发送至数据接收端。The sending subunit 6022 is configured to use n I2S channels to send n encoded data to the data receiving end through n I2S channels within a preset frame clock period.
在一些实施例中,发送子单元6022,具体用于将m个声道子数据中的n个声道子数据,分别作为n路编码数据的高位数据,并将m个声道子数据中其余声道的声道子数据补充在n个声道子数据之后,以生成n路编码数据。In some embodiments, the sending subunit 6022 is specifically configured to use the n channel sub-data in the m channel sub-data as the high-order data of the n channels of coded data, and combine the remaining m channel sub-data The channel sub-data of the channel is supplemented after the n channel sub-data to generate n-channel coded data.
在一些实施例中,n个声道子数据,具体包括:m个声道中重要程度最高的n个声道的声道子数据。In some embodiments, the n channel sub-data specifically includes: channel sub-data of the n channels with the highest importance among the m channels.
在一些实施例中,音频数据传输装置60,还包括:采样频率调节单元603。In some embodiments, the audio data transmission device 60 further includes a sampling frequency adjustment unit 603.
其中,采样频率调节单元603,用于在发送单元602利用n路I2S通道,将n路编码数据发送至数据接收端之前,提高n路I2S通道的串行时钟的频率;或者,将n路I2S通道的串行数据的采样方式从串行时钟单沿采集方式切换为串行时钟双沿采集方式。Among them, the sampling frequency adjustment unit 603 is configured to increase the frequency of the serial clock of the n I2S channels before the sending unit 602 uses n I2S channels to send the n channels of encoded data to the data receiving end; or The sampling mode of the serial data of the channel is switched from the serial clock single-edge collection mode to the serial clock double-edge collection mode.
在一些实施例中,发送子单元6022,具体用于利用n路I2S通道的多个帧时钟周期,将m个声道子数据发送至数据接收端;其中,m个声道子数据中各声道子数据,分别包括m个声道中的一个声道在音频采样周期内的声道数据。In some embodiments, the sending subunit 6022 is specifically configured to use multiple frame clock cycles of n I2S channels to send m channel sub-data to the data receiving end; wherein, each sound channel in the m channel sub-data The channel data respectively include channel data of one of the m channels in the audio sampling period.
本申请实施例可以根据上述方法示例对音频数据传输装置60进行功能模块或者功能单元的划分,例如,可以对应各个功能划分各个功能模块或者功能单元,也可以将两个或两个以上的功能集成在一个处理模块中。上述集成的模块既可以采用硬件的形式实现,也可以采用软件功能模块或者功能单元的形式实现。其中,本申请实施例中对模块或者单元的划分是示意性的,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式。The embodiment of the present application can divide the audio data transmission device 60 into functional modules or functional units according to the above method examples. For example, each functional module or functional unit can be divided corresponding to each function, or two or more functions can be integrated. In a processing module. The above-mentioned integrated modules can be implemented in the form of hardware, or in the form of software functional modules or functional units. Among them, the division of modules or units in the embodiments of the present application is illustrative, and is only a logical function division, and there may be other division methods in actual implementation.
在采用集成的单元的情况下,图23示出了上述实施例中所涉及的音频数据 传输装置的一种可能的结构示意图。音频数据传输装置70包括:处理模块701、通信模块702和存储模块703。处理模块701用于对音频数据传输装置70的动作进行控制管理,例如,处理模块701用于支持音频数据传输装置70执行图6或图9中的过程S301-S304。通信模块702用于支持音频数据传输装置70与其他实体的通信。存储模块703用于存储音频数据传输装置的程序代码和数据。In the case of using an integrated unit, Fig. 23 shows a possible structural schematic diagram of the audio data transmission device involved in the foregoing embodiment. The audio data transmission device 70 includes a processing module 701, a communication module 702, and a storage module 703. The processing module 701 is used to control and manage the actions of the audio data transmission device 70. For example, the processing module 701 is used to support the audio data transmission device 70 to execute the processes S301-S304 in FIG. 6 or FIG. 9. The communication module 702 is used to support the communication between the audio data transmission device 70 and other entities. The storage module 703 is used to store the program code and data of the audio data transmission device.
其中,处理模块701可以是处理器或控制器,例如可以是中央处理器(central processing unit,CPU),通用处理器,数字信号处理器(digital signal processor,DSP),专用集成电路(application-specific integrated circuit,ASIC),现场可编程门阵列(field programmable gate array,FPGA)或者其他可编程逻辑器件、晶体管逻辑器件、硬件部件或者其任意组合。其可以实现或执行结合本申请公开内容所描述的各种示例性的逻辑方框,模块和电路。处理器也可以是实现计算功能的组合,例如包含一个或多个微处理器组合,DSP和微处理器的组合等等。通信模块702可以是收发器、收发电路或通信接口等。存储模块703可以是存储器。The processing module 701 may be a processor or a controller, for example, a central processing unit (CPU), a general-purpose processor, a digital signal processor (digital signal processor, DSP), and an application-specific integrated circuit (application-specific integrated circuit). integrated circuit, ASIC), field programmable gate array (FPGA) or other programmable logic devices, transistor logic devices, hardware components, or any combination thereof. It can implement or execute various exemplary logical blocks, modules and circuits described in conjunction with the disclosure of this application. The processor may also be a combination of computing functions, for example, a combination of one or more microprocessors, a combination of a DSP and a microprocessor, and so on. The communication module 702 may be a transceiver, a transceiver circuit, or a communication interface. The storage module 703 may be a memory.
当处理模块701为如图24所示的处理器,通信模块702为图24的收发器,存储模块703为图24的存储器时,本申请实施例所涉及的音频数据传输装置可以为如下的音频数据传输装置80。When the processing module 701 is the processor shown in FIG. 24, the communication module 702 is the transceiver shown in FIG. 24, and the storage module 703 is the memory shown in FIG. 24, the audio data transmission device involved in the embodiment of the present application may be the following audio Data transmission device 80.
参照图24所示,该音频数据传输装置80包括:处理器801、收发器802、存储器803和总线804。Referring to FIG. 24, the audio data transmission device 80 includes a processor 801, a transceiver 802, a memory 803, and a bus 804.
其中,处理器801、收发器802、存储器803通过总线804相互连接;总线804可以是外设部件互连标准(peripheral component interconnect,PCI)总线或扩展工业标准结构(extended industry standard architecture,EISA)总 线等。总线可以分为地址总线、数据总线、控制总线等。为便于表示,图中仅用一条粗线表示,但并不表示仅有一根总线或一种类型的总线。Among them, the processor 801, the transceiver 802, and the memory 803 are connected to each other through a bus 804; the bus 804 may be a peripheral component interconnect standard (PCI) bus or an extended industry standard architecture (EISA) bus Wait. The bus can be divided into address bus, data bus, control bus, etc. For ease of representation, only one thick line is used in the figure, but it does not mean that there is only one bus or one type of bus.
处理器801可以是一个通用中央处理器(Central Processing Unit,CPU),微处理器,特定应用集成电路(Application-Specific Integrated Circuit,ASIC),或一个或多个用于控制本申请方案程序执行的集成电路。The processor 801 may be a general-purpose central processing unit (Central Processing Unit, CPU), a microprocessor, an Application-Specific Integrated Circuit (ASIC), or one or more programs for controlling the execution of the program of this application. integrated circuit.
存储器803可以是只读存储器(Read-Only Memory,ROM)或可存储静态信息和指令的其他类型的静态存储设备,随机存取存储器(Random Access Memory,RAM)或者可存储信息和指令的其他类型的动态存储设备,也可以是电可擦可编程只读存储器(Electrically Erasable Programmable Read-only Memory,EEPROM)、只读光盘(Compact Disc Read-Only Memory,CD-ROM)或其他光盘存储、光碟存储(包括压缩光碟、激光碟、光碟、数字通用光碟、蓝光光碟等)、磁盘存储介质或者其他磁存储设备、或者能够用于携带或存储具有指令或数据结构形式的期望的程序代码并能够由计算机存取的任何其他介质,但不限于此。存储器可以是独立存在,通过总线与处理器相连接。存储器也可以和处理器集成在一起。The memory 803 can be a read-only memory (Read-Only Memory, ROM) or other types of static storage devices that can store static information and instructions, random access memory (Random Access Memory, RAM), or other types that can store information and instructions The dynamic storage device can also be Electrically Erasable Programmable Read-only Memory (EEPROM), CD-ROM (Compact Disc Read-Only Memory, CD-ROM) or other optical disk storage, optical disc storage (Including compact discs, laser discs, optical discs, digital versatile discs, Blu-ray discs, etc.), magnetic disk storage media or other magnetic storage devices, or can be used to carry or store desired program codes in the form of instructions or data structures and can be used by a computer Any other media accessed, but not limited to this. The memory can exist independently and is connected to the processor through a bus. The memory can also be integrated with the processor.
其中,存储器802用于存储执行本申请方案的应用程序代码,并由处理器801来控制执行。收发器802用于接收外部设备输入的内容,处理器601用于执行存储器803中存储的应用程序代码,从而实现本申请实施例一和实施例二中提供的一种音频数据传输方法。The memory 802 is used to store application program codes for executing the solutions of the present application, and the processor 801 controls the execution. The transceiver 802 is used to receive content input from an external device, and the processor 601 is used to execute application program codes stored in the memory 803, so as to implement an audio data transmission method provided in Embodiment 1 and Embodiment 2 of the present application.
在一些实施例中,本申请提供了一种音频数据传输装置,用于执行本申请实施例三所提供的音频数据传输方法,如图25所示,为本申请实施例提供的音频数据传输装置90的一种可能的结构示意图。其中,该装置包括:接收单元 901、转换单元902。In some embodiments, this application provides an audio data transmission device for executing the audio data transmission method provided in the third embodiment of this application. As shown in FIG. 25, this is the audio data transmission device provided in this embodiment of the application. A possible structure diagram of 90. Wherein, the device includes: a receiving unit 901 and a conversion unit 902.
接收单元901,用于接收n路I2S通道发送的传输数据。The receiving unit 901 is configured to receive transmission data sent by n I2S channels.
转换单元902,用于将n路I2S通道发送的传输数据,转换为m路声道的音频数据;其中,m>n。The conversion unit 902 is configured to convert the transmission data sent by n I2S channels into m channels of audio data; where m>n.
在一些实施例中,接收单元901,具体用于接收预设帧时钟周期内,n路I2S通道发送的n路编码数据。In some embodiments, the receiving unit 901 is specifically configured to receive n channels of encoded data sent by n channels of I2S channels within a preset frame clock period.
转换单元902,具体用于对n路编码数据进行解码,生成m个声道子数据;其中,m个声道子数据中各声道子数据,分别包括m个声道中的一个声道在音频采样周期内的声道数据。The conversion unit 902 is specifically configured to decode n channels of coded data to generate m channel sub-data; wherein, each channel sub-data in the m channel sub-data includes one of the m channels Channel data in the audio sampling period.
在一些实施例中,转换单元902,具体用于从n路编码数据的高位数据中,依次获取n个声道子数据;从n路编码数据的剩余数据中,获取m个声道子数据中除n个声道子数据之外的声道子数据。In some embodiments, the conversion unit 902 is specifically configured to sequentially obtain n channel sub-data from the high-order data of the n-channel coded data; from the remaining data of the n-channel coded data, obtain the m channel sub-data Channel sub data except for n channel sub data.
在一些实施例中,n个声道子数据,具体包括:m个声道中重要程度最高的n个声道的声道子数据。In some embodiments, the n channel sub-data specifically includes: channel sub-data of the n channels with the highest importance among the m channels.
在一些实施例中,接收单元901,具体用于接收n路I2S通道发送的多个帧时钟周期的传输数据。In some embodiments, the receiving unit 901 is specifically configured to receive transmission data of multiple frame clock cycles sent by n I2S channels.
转换单元902,具体用于利用多个帧时钟周期的传输数据,生成m个声道子数据;其中,m个声道子数据中各声道子数据,分别包括m个声道中的一个声道在音频采样周期内的声道数据。The conversion unit 902 is specifically configured to generate m channel sub-data by using transmission data of multiple frame clock cycles; wherein, each channel sub-data in the m channel sub-data includes one sound of the m channels. Channel data in the audio sampling period.
在一些实施例中,转换单元902,具体还用于若n路I2S通道具有独立的时钟信号,则将在音频采样周期中从n路I2S通道接收到的数据存储在缓存中,在音频采样周期结束后,对缓存中的编码数据进行解码,生成m个声道子数据。In some embodiments, the conversion unit 902 is specifically further configured to store the data received from the n I2S channels in the buffer in the buffer during the audio sampling period if the n I2S channels have independent clock signals. After the end, decode the encoded data in the buffer to generate m channel sub-data.
本申请实施例可以根据上述方法示例对音频数据传输装置90进行功能模块或者功能单元的划分,例如,可以对应各个功能划分各个功能模块或者功能单元,也可以将两个或两个以上的功能集成在一个处理模块中。上述集成的模块既可以采用硬件的形式实现,也可以采用软件功能模块或者功能单元的形式实现。其中,本申请实施例中对模块或者单元的划分是示意性的,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式。The embodiment of the present application may divide the audio data transmission device 90 into functional modules or functional units according to the foregoing method examples. For example, each functional module or functional unit may be divided corresponding to each function, or two or more functions may be integrated In a processing module. The above-mentioned integrated modules can be implemented in the form of hardware, or in the form of software functional modules or functional units. Among them, the division of modules or units in the embodiments of the present application is illustrative, and is only a logical function division, and there may be other division methods in actual implementation.
在采用集成的单元的情况下,图26示出了上述实施例中所涉及的音频数据传输装置的一种可能的结构示意图。音频数据传输装置100包括:处理模块1001、通信模块1002和存储模块1003。处理模块1001用于对音频数据传输装置100的动作进行控制管理,例如,处理模块1001用于支持音频数据传输装置100执行图18或图19中的过程S501-S503。通信模块1002用于支持音频数据传输装置100与其他实体的通信。存储模块1003用于存储音频数据传输装置的程序代码和数据。In the case of using an integrated unit, FIG. 26 shows a possible structural schematic diagram of the audio data transmission device involved in the foregoing embodiment. The audio data transmission device 100 includes a processing module 1001, a communication module 1002, and a storage module 1003. The processing module 1001 is used to control and manage the actions of the audio data transmission device 100. For example, the processing module 1001 is used to support the audio data transmission device 100 to execute the processes S501-S503 in FIG. 18 or FIG. 19. The communication module 1002 is used to support communication between the audio data transmission device 100 and other entities. The storage module 1003 is used to store the program code and data of the audio data transmission device.
其中,处理模块1001可以是处理器或控制器,例如可以是中央处理器(central processing unit,CPU),通用处理器,数字信号处理器(digital signal processor,DSP),专用集成电路(application-specific integrated circuit,ASIC),现场可编程门阵列(field programmable gate array,FPGA)或者其他可编程逻辑器件、晶体管逻辑器件、硬件部件或者其任意组合。其可以实现或执行结合本申请公开内容所描述的各种示例性的逻辑方框,模块和电路。处理器也可以是实现计算功能的组合,例如包含一个或多个微处理器组合,DSP和微处理器的组合等等。通信模块1002可以是收发器、收发电路或通信接口等。存储模块1003可以是存储器。The processing module 1001 may be a processor or a controller, for example, a central processing unit (CPU), a general-purpose processor, a digital signal processor (digital signal processor, DSP), and an application-specific integrated circuit (application-specific integrated circuit). integrated circuit, ASIC), field programmable gate array (FPGA) or other programmable logic devices, transistor logic devices, hardware components, or any combination thereof. It can implement or execute various exemplary logical blocks, modules and circuits described in conjunction with the disclosure of this application. The processor may also be a combination of computing functions, for example, a combination of one or more microprocessors, a combination of a DSP and a microprocessor, and so on. The communication module 1002 may be a transceiver, a transceiver circuit, or a communication interface. The storage module 1003 may be a memory.
当处理模块1001为如图27所示的处理器,通信模块1002为图27的收发器,存储模块1003为图27的存储器时,本申请实施例所涉及的音频数据传输装置可以为如下的音频数据传输装置110。When the processing module 1001 is the processor shown in FIG. 27, the communication module 1002 is the transceiver shown in FIG. 27, and the storage module 1003 is the memory shown in FIG. 27, the audio data transmission device involved in the embodiment of the present application may be the following audio Data transmission device 110.
参照图27所示,该音频数据传输装置110包括:处理器1101、收发器1102、存储器1103和总线1104。Referring to FIG. 27, the audio data transmission device 110 includes a processor 1101, a transceiver 1102, a memory 1103, and a bus 1104.
其中,处理器1101、收发器1102、存储器1103通过总线1104相互连接;总线1104可以是外设部件互连标准(peripheral component interconnect,PCI)总线或扩展工业标准结构(extended industry standard architecture,EISA)总线等。总线可以分为地址总线、数据总线、控制总线等。为便于表示,图中仅用一条粗线表示,但并不表示仅有一根总线或一种类型的总线。Among them, the processor 1101, the transceiver 1102, and the memory 1103 are connected to each other through a bus 1104; the bus 1104 may be a peripheral component interconnect standard (PCI) bus or an extended industry standard architecture (EISA) bus Wait. The bus can be divided into address bus, data bus, control bus, etc. For ease of representation, only one thick line is used in the figure, but it does not mean that there is only one bus or one type of bus.
处理器1101可以是一个通用中央处理器(Central Processing Unit,CPU),微处理器,特定应用集成电路(Application-Specific Integrated Circuit,ASIC),或一个或多个用于控制本申请方案程序执行的集成电路。The processor 1101 may be a general-purpose central processing unit (Central Processing Unit, CPU), a microprocessor, an Application-Specific Integrated Circuit (ASIC), or one or more for controlling the execution of the program of this application integrated circuit.
存储器1103可以是只读存储器(Read-Only Memory,ROM)或可存储静态信息和指令的其他类型的静态存储设备,随机存取存储器(Random Access Memory,RAM)或者可存储信息和指令的其他类型的动态存储设备,也可以是电可擦可编程只读存储器(Electrically Erasable Programmable Read-only Memory,EEPROM)、只读光盘(Compact Disc Read-Only Memory,CD-ROM)或其他光盘存储、光碟存储(包括压缩光碟、激光碟、光碟、数字通用光碟、蓝光光碟等)、磁盘存储介质或者其他磁存储设备、或者能够用于携带或存储具有指令或数据结构形式的期望的程序代码并能够由计算机存取的任何其他介质,但不限于此。存储器可以是独立存在,通过总线与处理器相连接。存储器也可 以和处理器集成在一起。The memory 1103 may be a read-only memory (Read-Only Memory, ROM) or other types of static storage devices that can store static information and instructions, random access memory (Random Access Memory, RAM), or other types that can store information and instructions The dynamic storage device can also be electrically erasable programmable read-only memory (Electrically Erasable Programmable Read-only Memory, EEPROM), CD-ROM (Compact Disc Read-Only Memory, CD-ROM) or other optical storage (Including compact discs, laser discs, optical discs, digital versatile discs, Blu-ray discs, etc.), magnetic disk storage media or other magnetic storage devices, or can be used to carry or store desired program codes in the form of instructions or data structures and can be used by a computer Any other media accessed, but not limited to this. The memory can exist independently and is connected to the processor through a bus. The memory can also be integrated with the processor.
其中,存储器1103用于存储执行本申请方案的应用程序代码,并由处理器1101来控制执行。收发器1102用于接收外部设备输入的内容,处理器1101用于执行存储器1103中存储的应用程序代码,从而实现本申请实施例三中提供的音频数据传输方法。Among them, the memory 1103 is used to store application program codes for executing the solutions of the present application, and the processor 1101 controls the execution. The transceiver 1102 is used to receive content input from an external device, and the processor 1101 is used to execute application program codes stored in the memory 1103, so as to implement the audio data transmission method provided in the third embodiment of the present application.
在一些实施例中,本申请实施例还提供一种电视机,包括上述实施例所提供的音频数据传输装置。In some embodiments, an embodiment of the present application further provides a television, including the audio data transmission device provided in the above-mentioned embodiment.
图28是本申请实施例一提供的显示设备示意图,参考图28,本申请还提供一种显示设备,至少包括:显示屏91,被配置为呈现图像数据;扬声器92,被配置为再现声音数据。FIG. 28 is a schematic diagram of a display device provided in Embodiment 1 of the present application. Referring to FIG. 28, the present application also provides a display device, which at least includes: a display screen 91 configured to present image data; and a speaker 92 configured to reproduce sound data .
在一些实施示例中,显示设备还可以包括:背光组件94,背光组件94位于显示屏91下方。通常是一些光学组件,用于供应充足的亮度与分布均匀的光源,使显示屏91能正常显示影像。在一些相关技术中,背光组件可以包括LED灯条,还可以包括自动发光的灯板。In some implementation examples, the display device may further include: a backlight assembly 94 located below the display screen 91. Usually some optical components are used to supply sufficient brightness and uniformly distributed light sources so that the display screen 91 can display images normally. In some related technologies, the backlight assembly may include an LED light bar or a light panel that automatically emits light.
在一些实施例中,显示设备还可以包括:背板95,通常背板95上面冲压形成一些凸包结构,扬声器92等器件,通过螺钉或者挂钩固定在凸包上。In some embodiments, the display device may further include: a back plate 95. Usually, the back plate 95 is stamped to form some convex structures, and components such as speakers 92 are fixed on the convex structures by screws or hooks.
在一些实施例中,显示设备还可以包括:后壳98,其盖设在显示屏91的背面上,以隐藏背光组件94,扬声器92等显示装置的零部件,起到美观的效果。In some embodiments, the display device may further include: a rear case 98, which is covered on the back of the display screen 91 to hide the backlight assembly 94, the speaker 92 and other display device components, which has a beautiful effect.
在一些实施例中,显示设备还可以包括:主板96和电源板97,他们可以独立成两块板子设置,也可以是合并在一块板子上。In some embodiments, the display device may further include: a main board 96 and a power supply board 97, which can be arranged as two boards independently, or they can be combined on one board.
在一些实施例中,显示设备还包括遥控器93。In some embodiments, the display device further includes a remote control 93.
图29是本申请实施例一提供的显示设备的硬件配置框图。如29所示,显示设备200中可以包括调谐解调器220、通信器230、检测器240、外部装置接口250、控制器210、存储器290、用户输入接口、视频处理器260-1、音频处理器260-2、显示屏280、音频输入接口272、供电电源。FIG. 29 is a block diagram of the hardware configuration of the display device provided in Embodiment 1 of the present application. As shown in 29, the display device 200 may include a tuner and demodulator 220, a communicator 230, a detector 240, an external device interface 250, a controller 210, a memory 290, a user input interface, a video processor 260-1, and audio processing 260-2, display screen 280, audio input interface 272, power supply.
调谐解调器220,通过有线或无线方式接收广播电视信号,可以进行放大、混频和谐振等调制解调处理,用于从多个无线或有线广播电视信号中解调出用户所选择电视频道的频率中所携带的音视频信号,以及附加信息(例如EPG数据信号)。The tuner and demodulator 220, which receives broadcast and television signals through wired or wireless means, can perform modulation and demodulation processing such as amplification, mixing and resonance, and is used to demodulate the television channel selected by the user from multiple wireless or cable broadcast and television signals The audio and video signals carried in the frequency, and additional information (such as EPG data signals).
调谐解调器220,可根据用户选择,以及由控制器210控制,响应用户选择的电视频道频率以及该频率所携带的电视信号。The tuner and demodulator 220 can be selected by the user and controlled by the controller 210 to respond to the TV channel frequency selected by the user and the TV signal carried by the frequency.
调谐解调器220,根据电视信号广播制式不同,可以接收信号的途径有很多种,诸如:地面广播、有线广播、卫星广播或互联网广播等;以及根据调制类型不同,可以数字调制方式,也可以模拟调制方式;以及根据接收电视信号种类不同,可以解调模拟信号和数字信号。The tuner and demodulator 220 can receive signals in many ways according to different TV signal broadcasting systems, such as terrestrial broadcasting, cable broadcasting, satellite broadcasting, or Internet broadcasting; and according to different modulation types, it can be digital modulation or alternatively. Analog modulation method; and according to different types of received TV signals, analog and digital signals can be demodulated.
在其他一些示例性实施例中,调谐解调器220也可在外置设备中,如外置机顶盒等。这样,机顶盒通过调制解调后输出电视音视频信号,经过输入/输出接口250输入至显示设备200中。In some other exemplary embodiments, the tuner demodulator 220 may also be in an external device, such as an external set-top box. In this way, the set-top box outputs TV audio and video signals through modulation and demodulation, and inputs them to the display device 200 through the input/output interface 250.
通信器230是用于根据各种通信协议类型与外部设备或外部服务器进行通信的组件。例如:通信器230可以包括WIFI模块231,蓝牙通信协议模块232,有线以太网通信协议模块233等其他网络通信协议模块或近场通信协议模块。The communicator 230 is a component for communicating with external devices or external servers according to various communication protocol types. For example, the communicator 230 may include a WIFI module 231, a Bluetooth communication protocol module 232, a wired Ethernet communication protocol module 233 and other network communication protocol modules or near field communication protocol modules.
显示设备200可以通过通信器230与外部控制设备或内容提供设备之间建立控制信号和数据信号的连接。例如,通信器可根据控制器的控制接收遥控器 100的控制信号。The display device 200 may establish a control signal and a data signal connection with an external control device or content providing device through the communicator 230. For example, the communicator may receive the control signal of the remote controller 100 according to the control of the controller.
检测器240,是显示设备200用于采集外部环境或与外部交互的信号的组件。检测器240可以包括光接收器242,用于采集环境光线强度的传感器,可以通过采集环境光来自适应显示参数变化等;还可以包括图像采集器241,如相机、摄像头等,可以用于采集外部环境场景,以及用于采集用户的属性或与用户交互手势,可以自适应变化显示参数,也可以识别用户手势,以实现与用户之间互动的功能。The detector 240 is a component of the display device 200 for collecting signals from the external environment or interacting with the outside. The detector 240 may include a light receiver 242, a sensor used to collect the intensity of ambient light, which can adaptively display parameter changes by collecting ambient light, etc.; it may also include an image collector 241, such as a camera, a camera, etc., which can be used to collect external Environmental scenes, as well as gestures used to collect user attributes or interact with users, can adaptively change display parameters, and can also recognize user gestures to achieve the function of interaction with users.
在其他一些示例性实施例中,检测器240,还可包括温度传感器,如通过感测环境温度,显示设备200可自适应调整图像的显示色温。In some other exemplary embodiments, the detector 240 may further include a temperature sensor. For example, by sensing the ambient temperature, the display device 200 may adaptively adjust the display color temperature of the image.
在一些实施例中,当温度偏高的环境时,可调整显示设备200显示图像色温偏冷色调;当温度偏低的环境时,可以调整显示设备200显示图像色温偏暖色调。In some embodiments, when the temperature is relatively high, the color temperature of the display device 200 can be adjusted to be relatively cool; when the temperature is relatively low, the color temperature of the display device 200 can be adjusted to be relatively warm.
在其他一些示例性实施例中,检测器240还可包括声音采集器,如麦克风,可以用于接收用户的声音,包括用户控制显示设备200的控制指令的语音信号,或采集环境声音,用于识别环境场景类型,显示设备200可以自适应环境噪声。In some other exemplary embodiments, the detector 240 may also include a sound collector, such as a microphone, which may be used to receive the user's voice, including the voice signal of the user's control instruction for controlling the display device 200, or to collect environmental sound for Recognizing the environmental scene type, the display device 200 can adapt to the environmental noise.
外部装置接口250,提供控制器210控制显示设备200与外部其他设备间数据传输的组件。外部装置接口可按照有线/无线方式与诸如机顶盒、游戏装置、笔记本电脑等的外部设备连接,可接收外部设备的诸如视频信号(例如运动图像)、音频信号(例如音乐)、附加信息(例如EPG)等数据。The external device interface 250 provides a component for the controller 210 to control data transmission between the display device 200 and other external devices. The external device interface can be connected to external devices such as set-top boxes, game devices, notebook computers, etc. in a wired/wireless manner, and can receive external devices such as video signals (such as moving images), audio signals (such as music), and additional information (such as EPG). ) And other data.
其中,外部装置接口250可以包括:高清多媒体接口(HDMI)端子251、复合视频消隐同步(CVBS)端子252、模拟或数字分量端子253、通用串行总线(USB)端子254、红绿蓝(RGB)端子(图中未示出)等任一个或多个。Among them, the external device interface 250 may include: a high-definition multimedia interface (HDMI) terminal 251, a composite video blanking synchronization (CVBS) terminal 252, an analog or digital component terminal 253, a universal serial bus (USB) terminal 254, red, green, and blue ( RGB) terminal (not shown in the figure) and any one or more.
控制器210,通过运行存储在存储器290上的各种软件控制程序(如操作系统和各种应用程序),来控制显示设备200的工作和响应用户的操作。The controller 210 controls the work of the display device 200 and responds to user operations by running various software control programs (such as an operating system and various application programs) stored on the memory 290.
如图29所示,控制器210包括随机存取存储器RAM213、只读存储器ROM214、图形处理器216、CPU处理器212、通信接口218、以及通信总线。其中,RAM213和ROM214以及图形处理器216、CPU处理器212、通信接口218通过总线相连接。As shown in FIG. 29, the controller 210 includes a random access memory RAM 213, a read only memory ROM 214, a graphics processor 216, a CPU processor 212, a communication interface 218, and a communication bus. Among them, RAM213 and ROM214, graphics processor 216, CPU processor 212, and communication interface 218 are connected by a bus.
ROM213,用于存储各种系统启动的指令。如在收到开机信号时,显示设备200电源开始启动,CPU处理器212运行ROM中系统启动指令,将存储在存储器290的操作系统拷贝至RAM214中,以开始运行启动操作系统。当操作系统启动完成后,CPU处理器212再将存储器290中各种应用程序拷贝至RAM214中,然后,开始运行启动各种应用程序。ROM213, used to store various system startup instructions. For example, when the power-on signal is received, the power of the display device 200 starts to start, and the CPU processor 212 runs the system start-up instruction in the ROM, and copies the operating system stored in the memory 290 to the RAM 214 to start the start-up operating system. After the operating system is started up, the CPU processor 212 copies various application programs in the memory 290 to the RAM 214, and then starts to run and start various application programs.
图形处理器216,用于产生各种图形对象,如:图标、操作菜单、以及用户输入指令显示图形等。包括运算器,通过接收用户输入各种交互指令进行运算,根据显示属性显示各种对象。以及包括渲染器,产生基于运算器得到的各种对象,进行渲染的结果显示在显示屏280上。The graphics processor 216 is used to generate various graphics objects, such as icons, operation menus, and user input instructions to display graphics. Including an arithmetic unit, which performs operations by receiving various interactive commands input by the user, and displays various objects according to display attributes. As well as including a renderer, various objects obtained based on the arithmetic unit are generated, and the rendering result is displayed on the display screen 280.
CPU处理器212,用于执行存储在存储器290中操作系统和应用程序指令。以及根据接收外部输入的各种交互指令,来执行各种应用程序、数据和内容,以便最终显示和播放各种音视频内容。The CPU processor 212 is configured to execute operating system and application program instructions stored in the memory 290. And according to receiving various interactive instructions input from the outside, to execute various applications, data and content, so as to finally display and play various audio and video content.
在一些示例性实施例中,CPU处理器212,可以包括多个处理器。多个处理器可包括一个主处理器以及多个或一个子处理器。主处理器,用于在预加电模式中执行显示设备200一些操作,和/或在正常模式下显示画面的操作。多个或一个子处理器,用于执行在待机模式等状态下的一种操作。In some exemplary embodiments, the CPU processor 212 may include multiple processors. The multiple processors may include one main processor and multiple or one sub-processors. The main processor is used to perform some operations of the display device 200 in the pre-power-on mode, and/or to display images in the normal mode. Multiple or one sub-processor, used to perform an operation in the standby mode and other states.
通信接口,可包括第一接口218-1到第n接口218-n。这些接口可以是经由网络被连接到外部设备的网络接口。The communication interface may include the first interface 218-1 to the nth interface 218-n. These interfaces may be network interfaces connected to external devices via a network.
控制器210可以控制显示设备200的整体操作。例如:响应于接收到用于选择在显示屏280上显示UI对象的用户命令,控制器210便可以执行与由用户命令选择的对象有关的操作。The controller 210 may control the overall operation of the display device 200. For example, in response to receiving a user command for selecting a UI object to be displayed on the display screen 280, the controller 210 may perform an operation related to the object selected by the user command.
其中,所述对象可以是可选对象中的任何一个,例如超链接或图标。与所选择的对象有关操作,例如:显示连接到超链接页面、文档、图像等操作,或者执行与图标相对应程序的操作。用于选择UI对象用户命令,可以是通过连接到显示设备200的各种输入装置(例如,鼠标、键盘、触摸板等)输入命令或者与由用户说出语音相对应的语音命令。Wherein, the object may be any one of the selectable objects, such as a hyperlink or an icon. Operations related to the selected object, for example: display operations connected to hyperlink pages, documents, images, etc., or perform operations corresponding to the icon. The user command for selecting the UI object may be a command input through various input devices (for example, a mouse, a keyboard, a touch pad, etc.) connected to the display device 200 or a voice command corresponding to the voice spoken by the user.
存储器290,包括存储用于驱动和控制显示设备200的各种软件模块。如:存储器290中存储的各种软件模块,包括:基础模块、检测模块、通信模块、显示控制模块、浏览器模块、和各种服务模块等。The memory 290 includes storing various software modules for driving and controlling the display device 200. For example, various software modules stored in the memory 290 include: a basic module, a detection module, a communication module, a display control module, a browser module, and various service modules.
其中,基础模块是用于显示设备200中各个硬件之间信号通信、并向上层模块发送处理和控制信号的底层软件模块。检测模块是用于从各种传感器或用户输入接口中收集各种信息,并进行数模转换以及分析管理的管理模块。Among them, the basic module is the underlying software module used for signal communication between various hardware in the display device 200 and sending processing and control signals to the upper module. The detection module is a management module used to collect various information from various sensors or user input interfaces, and perform digital-to-analog conversion and analysis management.
例如:语音识别模块中包括语音解析模块和语音指令数据库模块。显示控制模块是用于控制显示屏280进行显示图像内容的模块,可以用于播放多媒体图像内容和UI界面等信息。通信模块,是用于与外部设备之间进行控制和数据通信的模块。浏览器模块,是用于执行浏览服务器之间数据通信的模块。服务模块,是用于提供各种服务以及各类应用程序在内的模块。For example: the voice recognition module includes a voice analysis module and a voice command database module. The display control module is a module for controlling the display screen 280 to display image content, and can be used to play information such as multimedia image content and UI interfaces. The communication module is a module used for control and data communication with external devices. The browser module is a module used to perform data communication between browsing servers. The service module is a module used to provide various services and various applications.
同时,存储器290还用于存储接收外部数据和用户数据、各种用户界面中 各个项目的图像以及焦点对象的视觉效果图等。At the same time, the memory 290 is also used to store and receive external data and user data, images of various items in various user interfaces, and visual effect diagrams of focus objects.
用户输入接口276,用于将用户的输入信号发送给控制器210,或者,将从控制器输出的信号传送给用户。在一些实施例中,控制装置(例如移动终端或遥控器)可将用户输入的诸如电源开关信号、频道选择信号、音量调节信号等输入信号发送至用户输入接口,再由用户输入接口276转送至控制器;或者,控制装置可接收经控制器处理从用户输入接口输出的音频、视频或数据等输出信号,并且显示接收的输出信号或将接收的输出信号输出为音频或振动形式。The user input interface 276 is used to send a user's input signal to the controller 210, or to transmit a signal output from the controller to the user. In some embodiments, the control device (for example, a mobile terminal or a remote control) can send input signals input by the user, such as a power switch signal, a channel selection signal, and a volume adjustment signal, to the user input interface, and then the user input interface 276 forwards it to the user input interface. Controller; or, the control device may receive output signals such as audio, video or data output from the user input interface processed by the controller, and display the received output signal or output the received output signal as audio or vibration.
在一些实施例中,用户可在显示屏280上显示的图形用户界面(GUI)输入用户命令,则用户输入接口通过图形用户界面(GUI)接收用户输入命令。或者,用户可通过输入特定的声音或手势进行输入用户命令,则用户输入接口通过传感器识别出声音或手势,来接收用户输入命令。In some embodiments, the user may input a user command on a graphical user interface (GUI) displayed on the display screen 280, and the user input interface receives the user input command through the graphical user interface (GUI). Alternatively, the user can input a user command by inputting a specific sound or gesture, and the user input interface recognizes the sound or gesture through the sensor to receive the user input command.
视频处理器260-1,用于接收视频信号,根据输入信号的标准编解码协议,进行解压缩、解码、缩放、降噪、帧率转换、分辨率转换、图像合成等视频数据处理,可得到直接在显示屏280上显示或播放的视频信号。The video processor 260-1 is used to receive video signals, and perform video data processing such as decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, and image synthesis according to the standard codec protocol of the input signal. The video signal directly displayed or played on the display screen 280.
在一些实施例中,视频处理器260-1,包括解复用模块、视频解码模块、图像合成模块、帧率转换模块、显示格式化模块等。In some embodiments, the video processor 260-1 includes a demultiplexing module, a video decoding module, an image synthesis module, a frame rate conversion module, a display formatting module, and the like.
其中,解复用模块,用于对输入音视频数据流进行解复用处理,如输入MPEG-2,则解复用模块进行解复用成视频信号和音频信号等。Among them, the demultiplexing module is used to demultiplex the input audio and video data stream. For example, if MPEG-2 is input, the demultiplexing module will demultiplex into a video signal and an audio signal.
视频解码模块,用于对解复用后的视频信号进行处理,包括解码和缩放处理等。The video decoding module is used to process the demultiplexed video signal, including decoding and scaling.
图像合成模块,如图像合成器,其用于将图形生成器根据用户输入或自身生成的GUI信号,与缩放处理后视频图像进行叠加混合处理,以生成可供显示 的图像信号。An image synthesis module, such as an image synthesizer, is used to superimpose and mix the GUI signal generated by the graphics generator with the zoomed video image according to user input or itself to generate a displayable image signal.
帧率转换模块,用于对输入视频的帧率进行转换,如将输入的24Hz、25Hz、30Hz、60Hz视频的帧率转换为60Hz、120Hz或240Hz的帧率,其中,输入帧率可以与源视频流有关,输出帧率可以与显示屏的更新率有关。输入有通常的格式采用如插帧方式实现。Frame rate conversion module, used to convert the frame rate of the input video, such as converting the frame rate of the input 24Hz, 25Hz, 30Hz, 60Hz video to the frame rate of 60Hz, 120Hz or 240Hz, where the input frame rate can be compared with the source The video stream is related, and the output frame rate can be related to the update rate of the display. The input has a usual format, such as frame insertion.
显示格式化模块,用于将帧率转换模块输出的信号,改变为符合诸如显示器显示格式的信号,如将帧率转换模块输出的信号进行格式转换以输出RGB数据信号。The display formatting module is used to change the signal output by the frame rate conversion module into a signal that conforms to a display format such as a display, such as format conversion of the signal output by the frame rate conversion module to output RGB data signals.
显示屏280,用于接收源自视频处理器260-1输入的图像信号,进行显示视频内容和图像以及菜单操控界面。显示屏280包括用于呈现画面的显示屏组件以及驱动图像显示的驱动组件。显示视频内容,可以来自调谐解调器220接收的广播信号中的视频,也可以来自通信器或外部设备接口输入的视频内容。显示屏280,同时显示显示设备200中产生且用于控制显示设备200的用户操控界面UI。The display screen 280 is used to receive image signals input from the video processor 260-1, to display video content and images, and a menu control interface. The display screen 280 includes a display screen component for presenting a picture and a driving component for driving image display. The displayed video content can be from the video in the broadcast signal received by the tuner and demodulator 220, or from the video content input by the communicator or the external device interface. The display screen 280 simultaneously displays a user manipulation interface UI generated in the display device 200 and used to control the display device 200.
以及,根据显示屏280类型不同,还包括用于驱动显示的驱动组件。或者,倘若显示屏280为一种投影显示器,还可以包括一种投影装置和投影屏幕。And, depending on the type of the display screen 280, a driving component for driving the display is also included. Alternatively, if the display screen 280 is a projection display, it may also include a projection device and a projection screen.
音频处理器260-2,用于接收音频信号,根据输入信号的标准编解码协议,进行解压缩和解码,以及降噪、数模转换、和放大处理等音频数据处理,得到可以在扬声器272中播放的音频信号。The audio processor 260-2 is used to receive audio signals, and perform decompression and decoding according to the standard codec protocol of the input signal, as well as audio data processing such as noise reduction, digital-to-analog conversion, and amplification processing, and the result can be in the speaker 272 The audio signal to be played.
音频输出接口270,用于在控制器210的控制下接收音频处理器260-2输出的音频信号,音频输出接口可包括扬声器272,或输出至外接设备的发生装置的外接音响输出端子274,如:外接音响端子或耳机输出端子等。The audio output interface 270 is used to receive the audio signal output by the audio processor 260-2 under the control of the controller 210. The audio output interface may include a speaker 272 or output to an external audio output terminal 274 of a generator of an external device, such as : External audio terminal or headphone output terminal, etc.
在其他一些示例性实施例中,视频处理器260-1可以包括一个或多个芯片组成。音频处理器260-2,也可以包括一个或多个芯片组成。In some other exemplary embodiments, the video processor 260-1 may include one or more chips. The audio processor 260-2 may also include one or more chips.
以及,在其他一些示例性实施例中,视频处理器260-1和音频处理器260-2,可以为单独的芯片,也可以与控制器210一起集成在一个或多个芯片中。And, in some other exemplary embodiments, the video processor 260-1 and the audio processor 260-2 may be separate chips, or they may be integrated with the controller 210 in one or more chips.
供电电源275,用于在控制器210控制下,将外部电源输入的电力为显示设备200提供电源供电支持。供电电源275可以包括安装显示设备200内部的内置电源电路,也可以是安装在显示设备200外部的电源,如在显示设备200中提供外接电源的电源接口。The power supply 275 is used to provide power supply support for the display device 200 with power input from an external power supply under the control of the controller 210. The power supply 275 may include a built-in power supply circuit installed inside the display device 200, or may be a power supply installed outside the display device 200, such as a power interface for providing an external power supply in the display device 200.
在一些实施例中,本申请提供一种显示装置,包括:In some embodiments, the present application provides a display device, including:
显示屏,被配置为呈现图像画面;The display screen is configured to present an image screen;
扬声器,被配置为再现声音;The speaker is configured to reproduce sound;
控制器,被配置为获取m路声道的音频数据,将所述m路声道的音频数据发送出去,其中,m>n。The controller is configured to obtain audio data of m channels and send the audio data of m channels, where m>n.
在一些实施例中,所述控制器还被配置为,将m路声道子数据进行编码,生成n路编码数据;其中,所述m路声道子数据中各声道子数据,分别包括所述m个声道中的一个声道在音频采样周期内的声道数据。In some embodiments, the controller is further configured to encode m channels of channel sub-data to generate n channels of encoded data; wherein each channel sub-data in the m channels of channel sub-data includes Channel data of one of the m channels in the audio sampling period.
在一些实施例中,所述控制器还被配置为,将m路声道子数据中的n个声道子数据,分别作为n路编码数据的高位数据,并将m路声道子数据中其余声道的声道子数据补充在n路声道子数据之后,以生成所述n路编码数据。In some embodiments, the controller is further configured to use n channel sub-data in the m channels of channel sub-data as high-order data of the n channels of encoded data, and set the m channel sub-data to The channel sub-data of the remaining channels is supplemented after the n-channel sub-data to generate the n-channel coded data.
在一些实施例中,所述显示装置还包括n路I2S通道,所述控制器还被配置为,提高所述n路I2S通道的串行时钟的频率。In some embodiments, the display device further includes n I2S channels, and the controller is further configured to increase the frequency of the serial clock of the n I2S channels.
在一些实施例中,所述控制器还被配置为,将所述n路I2S通道的串行数据的采样方式从串行时钟单沿采集方式切换为串行时钟双沿采集方式。In some embodiments, the controller is further configured to switch the sampling mode of the serial data of the n I2S channels from the serial clock single-edge collection mode to the serial clock double-edge collection mode.
在一些实施例中,所述控制器还被配置为,利用n路I2S通道的多个帧时钟周期,将m路声道子数据发送出去;其中,所述m个声道子数据中各声道子数据,分别包括所述m个声道中的一个声道在音频采样周期内的声道数据。In some embodiments, the controller is further configured to use multiple frame clock cycles of n I2S channels to send m channel sub-data; wherein, each sound channel in the m channel sub-data The channel data respectively include channel data of one of the m channels in the audio sampling period.
具体内容可以参考上述实施例的介绍,这里不展开说明。For the specific content, please refer to the introduction of the foregoing embodiment, and the description will not be expanded here.
在一些实施例中,本申请提供一种显示装置,包括:In some embodiments, the present application provides a display device, including:
显示屏,被配置为呈现图像画面;The display screen is configured to present an image screen;
扬声器,被配置为再现声音;The speaker is configured to reproduce sound;
控制器,被配置为接收n路I2S通道发送的传输数据;The controller is configured to receive transmission data sent by n I2S channels;
将所述n路I2S通道发送的传输数据,转换为m路声道的音频数据;其中,m>n。Convert the transmission data sent by the n-channel I2S channel into m-channel audio data; where m>n.
在一些实施例中,所述显示装置包括n路I2S通道,In some embodiments, the display device includes n I2S channels,
控制器被配置为接收预设帧时钟周期内,n路I2S通道发送的n路编码数据;The controller is configured to receive n channels of coded data sent by n channels of I2S channels within a preset frame clock period;
对n路编码数据进行解码,生成m路声道子数据;其中,所述m路声道子数据中各声道子数据,分别包括所述m路声道中的一个声道在音频采样周期内的声道数据。Decode n channels of coded data to generate m channels of channel sub-data; wherein, each channel sub-data in the m channels of channel sub-data includes one of the m channels in the audio sampling period Channel data within.
在一些实施例中,所述控制器被配置为从所述n路编码数据的高位数据中,依次获取n个声道子数据;In some embodiments, the controller is configured to sequentially obtain n channel sub-data from the high-order data of the n channels of encoded data;
从所述n路编码数据的剩余数据中,获取所述m个声道子数据中除所述n个声道子数据之外的声道子数据。From the remaining data of the n channels of coded data, obtain channel sub-data of the m channel sub-data except for the n channel sub-data.
在一些实施例中,所述控制器被配置为接收所述n路I2S通道发送的多个 帧时钟周期的传输数据;In some embodiments, the controller is configured to receive transmission data of multiple frame clock cycles sent by the n I2S channels;
所述将所述n路I2S通道发送的传输数据,转换为m路声道的音频数据,具体包括:The conversion of the transmission data sent by the n I2S channels into m channels of audio data specifically includes:
利用所述多个帧时钟周期的传输数据,生成m个声道子数据;其中,所述m个声道子数据中各声道子数据,分别包括所述m个声道中的一个声道在音频采样周期内的声道数据。Using the transmission data of the multiple frame clock periods to generate m channel sub-data; wherein, each channel sub-data in the m channel sub-data includes one of the m channels. Channel data in the audio sampling period.
在一些实施例中,所述控制器被配置为将在所述音频采样周期中从所述n路I2S通道接收到的数据存储在缓存中,在所述音频采样周期结束后,对所述缓存中的编码数据进行解码,生成m个声道子数据。In some embodiments, the controller is configured to store the data received from the n I2S channels in the audio sampling period in a buffer, and after the audio sampling period ends, the buffer is The encoded data in is decoded to generate m channel sub-data.
在一些实施例中,所述m个声道子数据传输给所述扬声器。In some embodiments, the m channel sub-data is transmitted to the speaker.
具体的接收数据过程请参考上述实施例的具体介绍,这里不再展开说明。For the specific data receiving process, please refer to the specific introduction of the above-mentioned embodiment, and the description is not repeated here.
应理解,在本申请的各种实施例中,上述各过程的序号的大小并不意味着执行顺序的先后,各过程的执行顺序应以其功能和内在逻辑确定,而不应对本申请实施例的实施过程构成任何限定。It should be understood that, in the various embodiments of the present application, the size of the sequence number of the above-mentioned processes does not mean the order of execution, and the execution order of each process should be determined by its function and internal logic, rather than corresponding to the embodiments of the present application. The implementation process constitutes any limitation.
本领域普通技术人员可以意识到,结合本文中所公开的实施例描述的各示例的单元及算法步骤,能够以电子硬件、或者计算机软件和电子硬件的结合来实现。这些功能究竟以硬件还是软件方式来执行,取决于技术方案的特定应用和设计约束条件。专业技术人员可以对每个特定的应用来使用不同方法来实现所描述的功能,但是这种实现不应认为超出本申请的范围。A person of ordinary skill in the art may be aware that the units and algorithm steps of the examples described in combination with the embodiments disclosed herein can be implemented by electronic hardware or a combination of computer software and electronic hardware. Whether these functions are executed by hardware or software depends on the specific application and design constraint conditions of the technical solution. Professionals and technicians can use different methods for each specific application to implement the described functions, but such implementation should not be considered beyond the scope of this application.
所属领域的技术人员可以清楚地了解到,为描述的方便和简洁,上述描述的系统、装置和单元的具体工作过程,可以参考前述方法实施例中的对应过程,在此不再赘述。Those skilled in the art can clearly understand that, for the convenience and conciseness of description, the specific working process of the above-described system, device, and unit can refer to the corresponding process in the foregoing method embodiment, which will not be repeated here.
所述作为分离部件说明的单元可以是或者也可以不是物理上分开的,作为单元显示的部件可以是或者也可以不是物理单元,即可以位于一个地方,或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的目的。The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the objectives of the solutions of the embodiments.
在上述实施例中,可以全部或部分地通过软件、硬件、固件或者其任意组合来实现。当使用软件程序实现时,可以全部或部分地以计算机程序产品的形式来实现。该计算机程序产品包括一个或多个计算机指令。在计算机上加载和执行计算机程序指令时,全部或部分地产生按照本申请实施例所述的流程或功能。所述计算机可以是通用计算机、专用计算机、计算机网络、或者其他可编程装置。所述计算机指令可以存储在计算机可读存储介质中,或者从一个计算机可读存储介质向另一个计算机可读存储介质传输,例如,所述计算机指令可以从一个网站站点、计算机、服务器或者数据中心通过有线(例如同轴电缆、光纤、数字用户终端线(Digital Subscriber Line,DSL))或无线(例如红外、无线、微波等)方式向另一个网站站点、计算机、服务器或数据中心进行传输。所述计算机可读存储介质可以是计算机能够存取的任何可用介质或者是包含一个或多个可以用介质集成的服务器、数据中心等数据存储设备。所述可用介质可以是磁性介质(例如,软盘、硬盘、磁带),光介质(例如,DVD)、或者半导体介质(例如固态硬盘(Solid State Disk,SSD))等。In the above embodiments, it may be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using a software program, it may be implemented in the form of a computer program product in whole or in part. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on the computer, the processes or functions described in the embodiments of the present application are generated in whole or in part. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions may be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions may be transmitted from a website, computer, server, or data center. Transmission to another website, computer, server, or data center via wired (such as coaxial cable, optical fiber, Digital Subscriber Line (DSL)) or wireless (such as infrared, wireless, microwave, etc.). The computer-readable storage medium may be any available medium that can be accessed by a computer, or may include one or more data storage devices such as servers and data centers that can be integrated with the medium. The usable medium may be a magnetic medium (for example, a floppy disk, a hard disk, and a magnetic tape), an optical medium (for example, a DVD), or a semiconductor medium (for example, a solid state disk (SSD)).
以上所述,仅为本申请的具体实施方式,但本申请的保护范围并不局限于此,任何熟悉本技术领域的技术人员在本申请揭露的技术范围内,可轻易想到变化或替换,都应涵盖在本申请的保护范围之内。因此,本申请的保护范围应所述以权利要求的保护范围为准。The above are only specific implementations of this application, but the protection scope of this application is not limited to this. Any person skilled in the art can easily think of changes or substitutions within the technical scope disclosed in this application. Should be covered within the scope of protection of this application. Therefore, the protection scope of this application shall be subject to the protection scope of the claims.

Claims (20)

  1. 一种音频数据传输方法,其特征在于,包括:An audio data transmission method, characterized by comprising:
    获取m路声道的音频数据;Acquire audio data of m channels;
    利用n路I2S通道,将所述m路声道的音频数据发送至数据接收端;其中,m>n。Use n I2S channels to send the m-channel audio data to the data receiving end; where m>n.
  2. 根据权利要求1所述音频数据传输方法,其特征在于,所述利用n路I2S通道,将所述m路声道的音频数据发送至数据接收端,具体包括:The audio data transmission method according to claim 1, wherein said using n I2S channels to send the m channels of audio data to the data receiving end specifically comprises:
    将m个声道子数据进行编码,生成n路编码数据;其中,所述m个声道子数据中各声道子数据,分别包括所述m个声道中的一个声道在音频采样周期内的声道数据;The m channel sub-data are encoded to generate n-channel coded data; wherein, each channel sub-data in the m channel sub-data includes one of the m channels in the audio sampling period Channel data within;
    在预设帧时钟周期内,利用所述n路I2S通道,将所述n路编码数据通过所述n路I2S通道发送至数据接收端。In a preset frame clock period, the n I2S channels are used to send the n encoded data to the data receiving end through the n I2S channels.
  3. 根据权利要求2所述音频数据传输方法,其特征在于,所述将m个声道子数据进行编码,生成n路编码数据,具体包括:The audio data transmission method according to claim 2, wherein the encoding of m channel sub-data to generate n channels of encoded data specifically includes:
    将所述m个声道子数据中的n个声道子数据,分别作为所述n路编码数据的高位数据,并将所述m个声道子数据中其余声道的声道子数据补充在所述n个声道子数据之后,以生成所述n路编码数据。Take the n channel sub-data of the m channel sub-data as high-order data of the n-channel coded data respectively, and supplement the channel sub-data of the remaining channels in the m channel sub-data After the n channel sub-data, the n channels of coded data are generated.
  4. 根据权利要求2所述音频数据传输方法,其特征在于,在所述利用所述n路I2S通道,将所述n路编码数据发送至数据接收端之前,所述方法还包括:The audio data transmission method according to claim 2, characterized in that, before said using said n channels of I2S to send said n channels of encoded data to a data receiving end, said method further comprises:
    提高所述n路I2S通道的串行时钟的频率;Increasing the frequency of the serial clock of the n I2S channels;
    或者,在利用所述n路I2S通道,将所述n路编码数据发送至数据接收端之前,所述方法还包括:Alternatively, before using the n I2S channels to send the n encoded data to the data receiving end, the method further includes:
    将所述n路I2S通道的串行数据的采样方式从串行时钟单沿采集方式切换为串行时钟双沿采集方式。The sampling mode of the serial data of the n I2S channels is switched from the serial clock single-edge collection mode to the serial clock double-edge collection mode.
  5. 根据权利要求2所述音频数据传输方法,其特征在于,所述利用n路I2S通道,将所述m路声道的音频数据发送至数据接收端,具体包括:The audio data transmission method according to claim 2, wherein said using n I2S channels to send the m channels of audio data to the data receiving end specifically comprises:
    利用n路I2S通道的多个帧时钟周期,将m个声道子数据发送至数据接收端;其中,所述m个声道子数据中各声道子数据,分别包括所述m个声道中的一个声道在音频采样周期内的声道数据。Using multiple frame clock cycles of n I2S channels to send m channel sub-data to the data receiving end; wherein, each channel sub-data in the m channel sub-data includes the m channel sub-data, respectively The channel data of one channel in the audio sampling period.
  6. 一种音频数据传输方法,其特征在于,An audio data transmission method, characterized in that:
    接收n路I2S通道发送的传输数据;Receive transmission data sent by n I2S channels;
    将所述n路I2S通道发送的传输数据,转换为m路声道的音频数据;其中,m>n。Convert the transmission data sent by the n-channel I2S channel into m-channel audio data; where m>n.
  7. 根据权利要求6所述音频数据传输方法,其特征在于,所述接收n路I2S通道发送的传输数据,具体包括:The audio data transmission method according to claim 6, wherein said receiving transmission data sent by n I2S channels specifically comprises:
    接收预设帧时钟周期内,n路I2S通道发送的n路编码数据;Receive n-channel coded data sent by n-channel I2S channel within the preset frame clock period;
    所述将所述n路I2S通道发送的传输数据,转换为m路声道的音频数据,具体包括:The conversion of the transmission data sent by the n I2S channels into m channels of audio data specifically includes:
    对n路编码数据进行解码,生成m个声道子数据;其中,所述m个声道子数据中各声道子数据,分别包括所述m个声道中的一个声道在音频采样周期内的声道数据。Decode n channels of coded data to generate m channel sub-data; wherein, each channel sub-data in the m channel sub-data includes one of the m channels in the audio sampling period Channel data within.
  8. 根据权利要求7所述音频数据传输方法,其特征在于,所述对n路编码数据进行解码,生成m个声道子数据,具体包括:The audio data transmission method according to claim 7, wherein said decoding n channels of coded data to generate m channel sub-data specifically comprises:
    从所述n路编码数据的高位数据中,依次获取n个声道子数据;Sequentially acquiring n channel sub-data from the high-bit data of the n channels of encoded data;
    从所述n路编码数据的剩余数据中,获取所述m个声道子数据中除所述n个声道子数据之外的声道子数据。From the remaining data of the n channels of coded data, obtain channel sub-data of the m channel sub-data except for the n channel sub-data.
  9. 根据权利要求6所述音频数据传输方法,其特征在于,所述接收n路I2S通道发送的传输数据,具体包括:The audio data transmission method according to claim 6, wherein said receiving transmission data sent by n I2S channels specifically comprises:
    接收所述n路I2S通道发送的多个帧时钟周期的传输数据;Receiving transmission data of multiple frame clock cycles sent by the n I2S channels;
    所述将所述n路I2S通道发送的传输数据,转换为m路声道的音频数据,具体包括:The conversion of the transmission data sent by the n I2S channels into m channels of audio data specifically includes:
    利用所述多个帧时钟周期的传输数据,生成m个声道子数据;其中,所述m个声道子数据中各声道子数据,分别包括所述m个声道中的一个声道在音频采样周期内的声道数据。Using the transmission data of the multiple frame clock periods to generate m channel sub-data; wherein, each channel sub-data in the m channel sub-data includes one of the m channels. Channel data in the audio sampling period.
  10. 根据权利要求7所述音频数据传输方法,其特征在于,若所述n路I2S通道具有独立的时钟信号,则对n路编码数据进行解码,生成m个声道子数据,具体包括:The audio data transmission method according to claim 7, wherein if the n I2S channels have independent clock signals, decoding the n channels of coded data to generate m channel sub-data, which specifically includes:
    将在所述音频采样周期中从所述n路I2S通道接收到的数据存储在缓存中,在所述音频采样周期结束后,对所述缓存中的编码数据进行解码,生成m个声道子数据。The data received from the n I2S channels during the audio sampling period is stored in a buffer, and after the audio sampling period is over, the encoded data in the buffer is decoded to generate m channels. data.
  11. 一种音频数据传输装置,其特征在于,包括处理器、存储器、总线和通信接口;其中,所述存储器用于存储计算机执行指令,所述处理器与所述存储器通过所述总线连接,当音频数据传输装置运行时,所述处理器执行所述计算机执行指令,以使音频数据传输装置执行如权利要求1-5任一项所提供的音频数据传输方法。An audio data transmission device, which is characterized by comprising a processor, a memory, a bus, and a communication interface; wherein the memory is used to store computer execution instructions, and the processor and the memory are connected through the bus. When the data transmission device is running, the processor executes the computer-executable instructions, so that the audio data transmission device executes the audio data transmission method provided in any one of claims 1-5.
  12. 一种音频数据传输装置,其特征在于,包括处理器、存储器、总线和 通信接口;其中,所述存储器用于存储计算机执行指令,所述处理器与所述存储器通过所述总线连接,当音频数据传输装置运行时,所述处理器执行所述计算机执行指令,以使音频数据传输装置执行如权利要求6-10任一项所提供的音频数据传输方法。An audio data transmission device, which is characterized by comprising a processor, a memory, a bus, and a communication interface; wherein the memory is used to store computer execution instructions, and the processor and the memory are connected through the bus. When the data transmission device is running, the processor executes the computer-executed instruction, so that the audio data transmission device executes the audio data transmission method provided in any one of claims 6-10.
  13. 一种显示装置,其特征在于,包括:A display device, characterized by comprising:
    本申请提供一种显示装置,包括:This application provides a display device, including:
    显示屏,被配置为呈现图像画面;The display screen is configured to present an image screen;
    扬声器,被配置为再现声音;The speaker is configured to reproduce sound;
    控制器,被配置为获取m路声道的音频数据,将所述m路声道的音频数据发送出去,其中,m>n。The controller is configured to obtain audio data of m channels and send the audio data of m channels, where m>n.
  14. 根据权利要求13所述的显示装置,其特征在于,所述控制器还被配置为,将m路声道子数据进行编码,生成n路编码数据;其中,所述m路声道子数据中各声道子数据,分别包括所述m个声道中的一个声道在音频采样周期内的声道数据。The display device according to claim 13, wherein the controller is further configured to encode m channels of channel sub-data to generate n channels of encoded data; wherein, among the m channels of channel sub-data Each channel sub-data includes channel data of one of the m channels in an audio sampling period.
  15. 根据权利要求14所述的显示装置,其特征在于,所述控制器还被配置为,将m路声道子数据中的n个声道子数据,分别作为n路编码数据的高位数据,并将m路声道子数据中其余声道的声道子数据补充在n路声道子数据之后,以生成所述n路编码数据。The display device according to claim 14, wherein the controller is further configured to use n channel sub-data in the m channels of channel sub-data as high-order data of the n channels of coded data, and The channel sub-data of the remaining channels in the m-channel sub-data is supplemented after the n-channel sub-data to generate the n-channel coded data.
  16. 根据权利要求15所述的显示装置,其特征在于,所述显示装置还包括n路I2S通道,所述控制器还被配置为,提高所述n路I2S通道的串行时钟的频率。The display device of claim 15, wherein the display device further comprises n I2S channels, and the controller is further configured to increase the frequency of the serial clock of the n I2S channels.
  17. 一种显示装置,其特征在于,包括:A display device, characterized by comprising:
    本申请提供一种显示装置,包括:This application provides a display device, including:
    显示屏,被配置为呈现图像画面;The display screen is configured to present an image screen;
    扬声器,被配置为再现声音;The speaker is configured to reproduce sound;
    控制器,被配置为接收n路I2S通道发送的传输数据;The controller is configured to receive transmission data sent by n I2S channels;
    将所述n路I2S通道发送的传输数据,转换为m路声道的音频数据;其中,m>n。Convert the transmission data sent by the n-channel I2S channel into m-channel audio data; where m>n.
  18. 根据权利要求17所述的显示装置,其特征在于:控制器被配置为接收预设帧时钟周期内,n路I2S通道发送的n路编码数据;18. The display device according to claim 17, wherein the controller is configured to receive n channels of coded data sent by n channels of I2S channels within a preset frame clock period;
    对n路编码数据进行解码,生成m路声道子数据;其中,所述m路声道子数据中各声道子数据,分别包括所述m路声道中的一个声道在音频采样周期内的声道数据。Decode n channels of coded data to generate m channels of channel sub-data; wherein, each channel sub-data in the m channels of channel sub-data includes one of the m channels in the audio sampling period Channel data within.
  19. 根据权利要求18所述的显示装置,其特征在于:所述控制器被配置为从所述n路编码数据的高位数据中,依次获取n个声道子数据;The display device according to claim 18, wherein the controller is configured to sequentially obtain n channel sub-data from the high-order data of the n channels of encoded data;
    从所述n路编码数据的剩余数据中,获取所述m个声道子数据中除所述n个声道子数据之外的声道子数据。From the remaining data of the n channels of coded data, obtain channel sub-data of the m channel sub-data except for the n channel sub-data.
  20. 根据权利要求19所述的显示装置,其特征在于:所述控制器被配置为接收所述n路I2S通道发送的多个帧时钟周期的传输数据;The display device according to claim 19, wherein: the controller is configured to receive transmission data of multiple frame clock cycles sent by the n I2S channels;
    所述将所述n路I2S通道发送的传输数据,转换为m路声道的音频数据,具体包括:The conversion of the transmission data sent by the n I2S channels into m channels of audio data specifically includes:
    利用所述多个帧时钟周期的传输数据,生成m个声道子数据;其中,所述m个声道子数据中各声道子数据,分别包括所述m个声道中的一个声道在音频采样周期内的声道数据。Using the transmission data of the multiple frame clock periods to generate m channel sub-data; wherein, each channel sub-data in the m channel sub-data includes one of the m channels. Channel data in the audio sampling period.
PCT/CN2020/070929 2019-07-09 2020-01-08 Display device, and audio data transmission method and device WO2021004049A1 (en)

Applications Claiming Priority (16)

Application Number Priority Date Filing Date Title
CN201910616404.6A CN112218016B (en) 2019-07-09 2019-07-09 Display device
CN201910614701.7A CN112216310B (en) 2019-07-09 2019-07-09 Audio processing method and device and multi-channel system
CN201910613254.3A CN112216290A (en) 2019-07-09 2019-07-09 Audio data transmission method and device and playing equipment
CN201910613160.6 2019-07-09
CN201910615836.5 2019-07-09
CN201910618541.3 2019-07-09
CN201910615836.5A CN112218019B (en) 2019-07-09 2019-07-09 Audio data transmission method and device
CN201910614701.7 2019-07-09
CN201910618541 2019-07-09
CN201910616404.6 2019-07-09
CN201910613160 2019-07-09
CN201910613254.3 2019-07-09
CN201910659488.1A CN112218020B (en) 2019-07-09 2019-07-22 Audio data transmission method and device for multi-channel platform
CN201910659488.1 2019-07-22
CN201910710346.3 2019-08-02
CN201910710346.3A CN112218210B (en) 2019-07-09 2019-08-02 Display device, audio playing method and device

Publications (1)

Publication Number Publication Date
WO2021004049A1 true WO2021004049A1 (en) 2021-01-14

Family

ID=74114387

Family Applications (5)

Application Number Title Priority Date Filing Date
PCT/CN2020/070902 WO2021004048A1 (en) 2019-07-09 2020-01-08 Display device and audio data transmission method
PCT/CN2020/070890 WO2021004046A1 (en) 2019-07-09 2020-01-08 Audio processing method and apparatus, and display device
PCT/CN2020/070891 WO2021004047A1 (en) 2019-07-09 2020-01-08 Display device and audio playing method
PCT/CN2020/070929 WO2021004049A1 (en) 2019-07-09 2020-01-08 Display device, and audio data transmission method and device
PCT/CN2020/070887 WO2021004045A1 (en) 2019-07-09 2020-01-08 Method for transmitting audio data of multichannel platform, apparatus thereof, and display device

Family Applications Before (3)

Application Number Title Priority Date Filing Date
PCT/CN2020/070902 WO2021004048A1 (en) 2019-07-09 2020-01-08 Display device and audio data transmission method
PCT/CN2020/070890 WO2021004046A1 (en) 2019-07-09 2020-01-08 Audio processing method and apparatus, and display device
PCT/CN2020/070891 WO2021004047A1 (en) 2019-07-09 2020-01-08 Display device and audio playing method

Family Applications After (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/070887 WO2021004045A1 (en) 2019-07-09 2020-01-08 Method for transmitting audio data of multichannel platform, apparatus thereof, and display device

Country Status (1)

Country Link
WO (5) WO2021004048A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115379358A (en) * 2022-08-22 2022-11-22 艾贝科技(深圳)有限公司 Vehicle-mounted multi-channel audio system and audio data processing method and device

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113301494B (en) * 2021-05-25 2022-09-02 亿咖通(湖北)技术有限公司 Audio playing system, control equipment and power amplifier equipment

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101079265A (en) * 2007-07-11 2007-11-28 北京中星微电子有限公司 Voice signal processing system
US20090323991A1 (en) * 2008-06-23 2009-12-31 Focus Enhancements, Inc. Method of identifying speakers in a home theater system
US20100057471A1 (en) * 2008-08-26 2010-03-04 Hongwei Kong Method and system for processing audio signals via separate input and output processing paths
CN104468915A (en) * 2013-09-24 2015-03-25 卓望数码技术(深圳)有限公司 Device for testing mobile terminal and system for testing mobile terminals
CN206117991U (en) * 2016-08-10 2017-04-19 深圳市米尔声学科技发展有限公司 Audio processing equipment
CN206879039U (en) * 2017-07-05 2018-01-12 珠海市杰理科技股份有限公司 Support the wireless microphone and intelligent terminal karaoke OK system of usb audio

Family Cites Families (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CA2555182C (en) * 2004-03-12 2011-01-04 Nokia Corporation Synthesizing a mono audio signal based on an encoded multichannel audio signal
JP2006005701A (en) * 2004-06-18 2006-01-05 D & M Holdings Inc Multichannel audio system
CN201063781Y (en) * 2007-07-24 2008-05-21 青岛海信电器股份有限公司 Audio/video coding and decoding device
US8355921B2 (en) * 2008-06-13 2013-01-15 Nokia Corporation Method, apparatus and computer program product for providing improved audio processing
CN102572588A (en) * 2011-12-14 2012-07-11 中兴通讯股份有限公司 Method and device for realizing audio mixing of set-top box
CN103237259A (en) * 2013-03-29 2013-08-07 天脉聚源(北京)传媒科技有限公司 Audio-channel processing device and audio-channel processing method for video
WO2014161996A2 (en) * 2013-04-05 2014-10-09 Dolby International Ab Audio processing system
CN103714847B (en) * 2013-12-31 2016-05-04 中山大学花都产业科技研究院 A kind of multichannel digital audio processing device based on DSP
CN103945310B (en) * 2014-04-29 2017-01-11 华为终端有限公司 Transmission method, mobile terminal, multi-channel earphones and audio playing system
CN105992040A (en) * 2015-02-15 2016-10-05 深圳市民展科技开发有限公司 Multichannel audio data transmitting method, audio data synchronization playing method and devices
CN105578347A (en) * 2015-12-25 2016-05-11 数源科技股份有限公司 Audio system of integrated automotive electronic product
CN107135301A (en) * 2016-02-29 2017-09-05 宇龙计算机通信科技(深圳)有限公司 A kind of audio data processing method and device
CN105959438A (en) * 2016-07-06 2016-09-21 惠州Tcl移动通信有限公司 Processing method and system for audio multi-channel output loudspeaker and mobile phone
CN106911987B (en) * 2017-02-21 2019-11-05 珠海全志科技股份有限公司 Main control end, equipment end, the method and system for transmitting multichannel audb data
CN108076306B (en) * 2017-12-29 2021-09-17 中兴通讯股份有限公司 Conference implementation method, device, equipment and system and computer readable storage medium
CN109996167B (en) * 2017-12-31 2020-09-11 华为技术有限公司 Method for cooperatively playing audio file by multiple terminals and terminal
CN108520763B (en) * 2018-04-13 2021-07-16 广州醇美电子有限公司 Data storage method, device, equipment and storage medium

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101079265A (en) * 2007-07-11 2007-11-28 北京中星微电子有限公司 Voice signal processing system
US20090323991A1 (en) * 2008-06-23 2009-12-31 Focus Enhancements, Inc. Method of identifying speakers in a home theater system
US20100057471A1 (en) * 2008-08-26 2010-03-04 Hongwei Kong Method and system for processing audio signals via separate input and output processing paths
CN104468915A (en) * 2013-09-24 2015-03-25 卓望数码技术(深圳)有限公司 Device for testing mobile terminal and system for testing mobile terminals
CN206117991U (en) * 2016-08-10 2017-04-19 深圳市米尔声学科技发展有限公司 Audio processing equipment
CN206879039U (en) * 2017-07-05 2018-01-12 珠海市杰理科技股份有限公司 Support the wireless microphone and intelligent terminal karaoke OK system of usb audio

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115379358A (en) * 2022-08-22 2022-11-22 艾贝科技(深圳)有限公司 Vehicle-mounted multi-channel audio system and audio data processing method and device

Also Published As

Publication number Publication date
WO2021004045A1 (en) 2021-01-14
WO2021004047A1 (en) 2021-01-14
WO2021004048A1 (en) 2021-01-14
WO2021004046A1 (en) 2021-01-14

Similar Documents

Publication Publication Date Title
US11895360B2 (en) Method for waking up audio device, and display apparatus
US10097787B2 (en) Content output apparatus, mobile apparatus, and controlling methods thereof
CN102314671B (en) Graphics processing unit and information processing apparatus
WO2015037826A1 (en) Apparatus and method for processing audio, method for setting initialization mode, and computer-readable recording medium
WO2005096168A1 (en) Integrated circuit for video/audio processing
US8396354B2 (en) Display apparatus, method, and computer system
WO2021004049A1 (en) Display device, and audio data transmission method and device
WO2021109354A1 (en) Media stream data playback method and device
CN112218019B (en) Audio data transmission method and device
US11284147B2 (en) Electronic apparatus, method of controlling the same and recording medium thereof
CN101325676A (en) Device for decoding audio and video
KR20110025367A (en) Method and device for multimedia transcoding client
US11375265B2 (en) Electronic apparatus and controlling method thereof
KR20150059483A (en) Apparatus for Displaying Image and Driving Method Thereof, Apparatus for Outputting Audio and Driving Method Thereof
CN101883228B (en) Equipment and method for reproducing captions
CN201733369U (en) Next generation broadcast network terminal access device control system
US11900007B2 (en) Display apparatus
US11523220B2 (en) Media processing device, media broadcasting system, and media processing method
JP5361962B2 (en) Graphics processing unit and information processing apparatus
US20230082685A1 (en) Integrated circuitry of speaker
CN102420955A (en) Television
JP2010157985A (en) Sound effect device and operating method thereof
JP2005110046A (en) Electronic apparatus
TWM413282U (en) Wireless video-audio transmission device

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20836087

Country of ref document: EP

Kind code of ref document: A1

122 Ep: pct application non-entry in european phase

Ref document number: 20836087

Country of ref document: EP

Kind code of ref document: A1