WO2017117916A1 - 音频数据推送方法及系统 - Google Patents

音频数据推送方法及系统 Download PDF

Info

Publication number
WO2017117916A1
WO2017117916A1 PCT/CN2016/084863 CN2016084863W WO2017117916A1 WO 2017117916 A1 WO2017117916 A1 WO 2017117916A1 CN 2016084863 W CN2016084863 W CN 2016084863W WO 2017117916 A1 WO2017117916 A1 WO 2017117916A1
Authority
WO
WIPO (PCT)
Prior art keywords
audio data
remaining amount
packet loss
loss rate
preset threshold
Prior art date
Application number
PCT/CN2016/084863
Other languages
English (en)
French (fr)
Inventor
康君平
刘卫方
高允沛
姜国定
Original Assignee
深圳Tcl数字技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳Tcl数字技术有限公司 filed Critical 深圳Tcl数字技术有限公司
Priority to US16/068,858 priority Critical patent/US20190020847A1/en
Priority to EP16883057.8A priority patent/EP3402212A4/en
Publication of WO2017117916A1 publication Critical patent/WO2017117916A1/zh

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/44—Receiver circuitry for the reception of television signals according to analogue transmission standards
    • H04N5/60—Receiver circuitry for the reception of television signals according to analogue transmission standards for the sound signals
    • H04N5/602—Receiver circuitry for the reception of television signals according to analogue transmission standards for the sound signals for digital sound signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/439—Processing of audio elementary streams
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/238—Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams
    • H04N21/23805—Controlling the feeding rate to the network, e.g. by controlling the video pump
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/24—Monitoring of processes or resources, e.g. monitoring of server load, available bandwidth, upstream requests
    • H04N21/2402—Monitoring of the downstream path of the transmission network, e.g. bandwidth available
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
    • H04N21/4363—Adapting the video stream to a specific local network, e.g. a Bluetooth® network
    • H04N21/43637—Adapting the video stream to a specific local network, e.g. a Bluetooth® network involving a wireless protocol, e.g. Bluetooth, RF or wireless LAN [IEEE 802.11]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/439—Processing of audio elementary streams
    • H04N21/4392—Processing of audio elementary streams involving audio buffer management
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/439—Processing of audio elementary streams
    • H04N21/4398—Processing of audio elementary streams involving reformatting operations of audio signals

Definitions

  • the present invention relates to the field of intelligent terminal technologies, and in particular, to an audio data pushing method and system.
  • the smart TV supports Bluetooth wireless audio, which is an audio signal decoded by the acquisition decoding module, then transmitted to the Bluetooth protocol stack, and wirelessly transmitted to the remote end through the Bluetooth module.
  • Bluetooth wireless audio is an audio signal decoded by the acquisition decoding module, then transmitted to the Bluetooth protocol stack, and wirelessly transmitted to the remote end through the Bluetooth module.
  • the current audio signal is collected into the Bluetooth protocol stack by periodically buffering the audio signal into the buffer, and then extracting the audio signal from the buffer cycle.
  • the speed at which the smart TV separates the audio data from the input source is different depending on the source type.
  • a large amount of audio data is accumulated in the buffer but cannot be transmitted because the extraction cycle is not reached, resulting in audio data transmission. The efficiency is lower.
  • the main object of the present invention is to provide an audio data pushing method and system, aiming at improving the efficiency of audio data transmission.
  • the present invention provides an audio data pushing method, and the audio data pushing method includes:
  • Step 1 The audio data pushing system extracts audio data from the buffer of the smart TV when the extraction cycle is reached, and performs compression operation on the extracted audio data, and pushes the compressed audio data to the wireless communication protocol stack. In order to send;
  • Step 2 The audio data pushing system acquires the remaining amount of current audio data of the buffer, and acquires a source type corresponding to the audio data in the buffer;
  • Step 3 The audio data pushing system updates the starting value of the extracted audio data based on the reference delay value corresponding to the source type, and corrects the updated starting value based on the preset tolerance error, according to the current Adjusting the extraction period by adjusting the remaining amount of the audio data and the size of the modified starting value, and transferring to the execution step 1, wherein
  • the extraction period is extended when the remaining amount of current audio data is less than the startup value.
  • the method before the step of acquiring the source type corresponding to the audio data in the buffer by the audio data pushing system, the method further includes:
  • the audio data pushing system records the acquired remaining amount of the current audio data
  • the audio data pushing system calculates an average of the remaining amount of recorded audio data, and updates the current audio data remaining amount to the calculated The average value is transferred to the step of executing the audio data pushing system to acquire the source type corresponding to the audio data in the buffer.
  • the method further includes:
  • step 1 When the number of remaining audio data records does not reach the first preset threshold, the process proceeds to step 1 .
  • the method further includes:
  • the audio data pushing system adjusts a compression ratio of the compression operation according to the size relationship between the packet loss rate and the second preset threshold, where
  • the compression ratio of the compression operation is reduced.
  • the present invention further provides an audio data pushing method, where the audio data pushing method includes:
  • Step 1 when the audio data push system reaches the extraction cycle, extract audio data from the buffer of the smart TV and push it to the wireless communication protocol stack for transmission;
  • Step two the audio data pushing system acquires the remaining amount of current audio data of the buffer, And obtaining a source type corresponding to the audio data in the buffer;
  • Step 3 The audio data pushing system updates the starting value of the extracted audio data based on the reference delay value corresponding to the source type, and adjusts according to the size relationship between the current audio data remaining amount and the updated starting value. Describe the extraction cycle and transfer to step one, where
  • the extraction period is extended when the remaining amount of current audio data is less than the startup value.
  • the method before the step of acquiring the source type corresponding to the audio data in the buffer by the audio data pushing system, the method further includes:
  • the audio data pushing system records the acquired remaining amount of the current audio data
  • the audio data pushing system calculates an average of the remaining amount of recorded audio data, and updates the current audio data remaining amount to the calculated And averaging, performing a step of performing a source type corresponding to the audio data in the buffer obtained by the audio data pushing system;
  • the method further includes:
  • step 1 When the number of remaining audio data records does not reach the first preset threshold, the process proceeds to step 1 .
  • the step of adjusting the extraction period according to the size relationship between the remaining amount of the current audio data and the updated startup value comprises:
  • the step of extracting audio data from the buffer of the smart TV and pushing it to the wireless communication protocol stack for transmission by the audio data pushing system when the extraction period is reached includes:
  • the audio data pushing system extracts audio data from the buffer of the smart TV when the extraction cycle is reached, and performs compression operation on the extracted audio data;
  • the audio data push system pushes the compressed audio data to the wireless communication protocol stack for transmission.
  • the audio data pushing system further includes:
  • the audio data pushing system adjusts a compression ratio of the compression operation according to the size relationship between the packet loss rate and the second preset threshold, where
  • the compression ratio of the compression operation is reduced.
  • the present invention further provides an audio data pushing system, where the audio data pushing system includes:
  • An extracting module configured to extract audio data from a buffer of the smart television and push it to the wireless communication protocol stack for transmission when the extraction cycle is reached;
  • An acquiring module configured to acquire a remaining amount of current audio data of the buffer, and obtain a source type corresponding to the audio data in the buffer;
  • a first adjustment module configured to update a startup value of the extracted audio data based on a reference delay value corresponding to the source type, and adjust the extraction according to a size relationship between the current audio data remaining amount and the updated startup value Cycle, where
  • the extraction period is extended when the remaining amount of current audio data is less than the startup value.
  • the audio data pushing system further includes:
  • a recording module configured to record the acquired remaining amount of the current audio data; and calculate an average value of the remaining amount of the recorded audio data when the number of the remaining amount of the recorded audio data reaches a first preset threshold, and The current audio data remaining amount is updated to the calculated average value.
  • the first adjustment module is further configured to: correct the updated startup value based on a preset tolerance error; and according to the current audio data remaining amount and the corrected startup value.
  • the size relationship adjusts the extraction period.
  • the extracting module is further configured to: extract audio data from a buffer of the smart TV when the extraction cycle is reached, and perform a compression operation on the extracted audio data; and push the compressed audio data Go to the wireless communication protocol stack for transmission.
  • the audio data pushing system further includes:
  • a second adjustment module configured to receive a packet loss rate returned by the target terminal of the audio data based on the received audio data, and adjust a compression ratio of the compression operation according to the size relationship between the packet loss rate and the second preset threshold. among them,
  • the compression ratio of the compression operation is reduced.
  • the audio data pushing method and system provided in this embodiment extracts the audio data in the buffer of the smart TV and pushes it into the wireless communication protocol stack for transmission, based on the preset extraction amount of the extracted audio data and the corresponding audio data.
  • the reference delay value is updated to start the start value of the audio data push, and dynamically adjusts the extraction period of the audio data according to the relationship between the remaining amount of the current audio data of the buffer and the updated start value after extracting the audio data, so that the extraction period and the smart TV
  • the speed at which the audio data is separated is adapted to improve the transmission efficiency of the audio data.
  • FIG. 1 is a schematic flow chart of a first embodiment of an audio data pushing method according to the present invention
  • FIG. 2 is a schematic diagram of functional modules of a first embodiment of an audio data push system according to the present invention.
  • the present invention provides an audio data push method, which is applied to a smart television.
  • the audio data push method includes the following steps:
  • Step S10 the audio data pushing system extracts audio data from the buffer of the smart TV and pushes it to the wireless communication protocol stack for transmission when the extraction cycle is reached;
  • the audio data pushing system described in this embodiment is based on a smart TV operation.
  • the audio data pushing system may also be operated based on a smart device such as a computer, a tablet computer, or a smart phone.
  • the audio data push system operates based on a smart TV.
  • the smart TV decodes the input source and separates the audio signal, and converts the separated audio signal into audio data buffered in the buffer and waits for transmission.
  • the format of the audio data includes, but is not limited to, PCM (Pulse-code modulation) and LPCM (Linear Pulse-code modulation).
  • the audio data push system When the audio data push system reaches the extraction cycle, the audio data is extracted from the buffer of the smart TV and pushed to the wireless communication protocol stack for transmission.
  • the extraction cycle is an initial extraction cycle of the audio data push system based on the hardware performance estimation of the smart television. In the image, if the hardware performance of the smart TV is high, a small initial extraction cycle is estimated, if the smart TV A low hardware performance predicts a large initial extraction cycle.
  • the preset extraction amount of the audio data pushing system for extracting the audio data is set in advance based on the wireless transmission capability of the smart TV. For example, the audio data pushing system extracts 512 bits from the buffer of the smart television every 50 ms. The audio data is pushed into the wireless communication protocol stack for transmission.
  • the wireless communication protocol stack includes, but is not limited to, a Bluetooth protocol stack and a Wi-Fi protocol stack, and the wireless data push system specifically pushes the wireless communication protocol after extracting the audio data from the buffer.
  • the stack depends on the wireless connection mode adopted by the target terminal of the smart TV and the audio data. For example, if the smart TV establishes a Bluetooth connection with the target terminal, the audio data push system pushes the extracted audio data to the Bluetooth protocol stack of the smart TV after extracting the audio data from the buffer of the smart TV.
  • the Bluetooth module of the smart TV Transmitting audio data to the target terminal by the Bluetooth module of the smart TV; for example, the smart TV establishes Wi-Fi with the target terminal Connected, the audio data push system extracts the extracted audio data to the Wi-Fi protocol stack of the smart TV after extracting the audio data from the buffer of the smart TV, and the audio is transmitted by the Wi-Fi module of the smart TV. The data is sent to the target terminal.
  • Step S20 the audio data pushing system acquires the remaining amount of the current audio data of the buffer, and acquires the source type corresponding to the audio data in the buffer;
  • the audio data pushing system acquires the remaining amount of the current audio data of the buffer, and acquires the audio data in the buffer.
  • the corresponding source type The type of the source corresponding to the audio data, that is, the type of the source of the input source of the audio data separated by the smart television.
  • the source type includes but is not limited to RMVB, MP4, MKV, AVI, FLV and WMV.
  • Step S30 the audio data pushing system updates the starting value of the extracted audio data based on the reference delay value corresponding to the source type, and adjusts the size according to the size relationship between the current audio data remaining amount and the updated starting value. Describe the extraction cycle, and proceed to step S10, where
  • the extraction period is extended when the remaining amount of current audio data is less than the startup value.
  • the main purpose of this embodiment is to dynamically adjust the extraction period of the extracted audio data according to the source type of the input source, maintain the low delay of the audio data transmission, and realize the continuous transmission of the audio data.
  • the size of the buffer is updated by using the following formula:
  • Buf represents the size of the buffer
  • Cap represents the preset extraction amount of the extracted audio data
  • k represents the reference delay value corresponding to the determined source type
  • N is the empirical value
  • the value range is [4, + ⁇ ).
  • N is 4.
  • the reference delay value is obtained by verification of a large number of experiments. As shown in Table 1, the mapping relationship between different source types and reference delay values is shown (the specific value is not shown).
  • the startup value is updated based on the updated size of the buffer, as follows:
  • Sta indicates the target value of the update start value, that is, the current initial start value is updated to the calculated value of Sta.
  • the image says that the startup value starts the audio data push system to extract the value of the audio data.
  • the audio data push system extracts the audio data from the buffer and pushes it. Go to the wireless communication protocol stack for transmission.
  • the audio data pushing system is configured according to the remaining amount of the current audio data and the size of the startup value.
  • the relationship adjusts the extraction cycle. Specifically, if the current audio data remaining amount is greater than the startup value, after the extraction period extracts the audio data, the remaining audio data is sufficient to start the audio data extraction in the next cycle, and the extraction period is shortened, that is, increased.
  • the extraction frequency of the audio data if the remaining amount of the current audio data is less than the startup value, it means that after the audio data is extracted in the extraction period, the remaining audio data is not enough to start the audio data extraction in the next cycle, and the extraction is extended at this time.
  • the period (so that the smart TV has enough time to separate the audio data from the input source), that is, to reduce the frequency of extraction of the audio data.
  • the remaining amount of the current audio data is equal to the startup value, it is indicated that after the audio data is extracted in the extraction period, the remaining audio data is just enough to start the audio data extraction in the next cycle, and the extraction period is not adjusted at this time, that is, Maintain the frequency of extraction of current audio data.
  • the adjustment amount of the extraction period is specifically set according to actual needs, and the embodiment does not limit the specific value of the adjustment amount, but the adjusted extraction period may not be greater than the human ear feels the sound intermittent.
  • the interval should not be less than the auditory response time of the human ear.
  • the audio data pushing method in this embodiment is based on extracting the audio data in the buffer of the smart TV and pushing it into the wireless communication protocol stack for transmission.
  • the extraction amount and the reference delay value corresponding to the audio data are updated to start the activation value of the audio data push, and the audio data extraction period is dynamically adjusted according to the size relationship between the current audio data remaining amount of the buffer and the updated startup value after extracting the audio data.
  • the extraction cycle is adapted to the speed at which the smart TV separates the audio data, thereby improving the transmission efficiency of the audio data.
  • a second embodiment of the audio data pushing method of the present invention is proposed.
  • Also before the step of acquiring the source type corresponding to the audio data in the buffer in the audio data pushing system ,Also includes:
  • the audio data pushing system records the acquired remaining amount of the current audio data
  • the audio data pushing system calculates an average of the remaining amount of recorded audio data, and updates the current audio data remaining amount to the calculated And averaging, performing a step of performing a source type corresponding to the audio data in the buffer obtained by the audio data pushing system;
  • the method further includes:
  • step S10 When the number of remaining audio data records does not reach the first preset threshold, the process proceeds to step S10.
  • the input source of the smart TV is usually unchanged within a certain period of time, and accordingly, the smart television decodes and separates the audio from the input source.
  • the speed of the data fluctuates little. That is, in the actual application, although the start value of the audio data push is updated once every extraction cycle, the adjustment of the extraction cycle is performed for a long time, and there is a waste of processing resources. Therefore, in the embodiment, setting the first preset threshold limits the adjustment of the extraction period.
  • the audio data pushing system extracts audio data from a buffer of the smart television in each extraction cycle and pushes it into the wireless communication protocol stack for transmission, and the audio data pushing system acquires After the remaining amount of the current audio data of the buffer, record the remaining amount of the audio data after the buffer is extracted; if the number i of the remaining amount of the recorded audio data reaches the first preset threshold, i is set to 0, and an average value of the remaining amount of the recorded audio data is calculated, and the calculated average value is used as the remaining amount of the current audio data (that is, the remaining amount of the current audio data is updated to the calculated average value), Further performing the extraction cycle
  • the first preset threshold may be set as needed, for example, it is set to 500 in this embodiment.
  • the process proceeds to the foregoing step S10 to continue the recording, and the adjustment of the extraction cycle is not performed temporarily.
  • a third embodiment of the audio data pushing method of the present invention is proposed.
  • the adjusting according to the relationship between the remaining amount of the current audio data and the starting value include:
  • the embodiment further corrects the updated startup value by using a preset tolerance error, and determines whether the extraction period needs to be adjusted by using the modified startup value, and How to adjust the extraction cycle.
  • the tolerance difference is an empirical value, which is verified by a large number of experiments.
  • the extraction period After acquiring the remaining amount of the current audio data of the buffer after extracting the audio data, and after updating the startup value, if the remaining amount of the current audio data is greater than or equal to Sta+Ft, shortening the extraction period; If the current audio data remaining amount is less than or equal to Sta-Ft, the extraction period is extended; if the current audio data remaining amount is less than Sta+Ft, and the current audio data remaining amount is greater than Sta-Ft, then the adjustment is not performed.
  • the step S10 includes:
  • the audio data pushing system extracts audio data from the buffer of the smart TV when the extraction cycle is reached, and performs compression operation on the extracted audio data;
  • the audio data push system pushes the compressed audio data to the wireless communication protocol stack for transmission.
  • the audio data pushed by the present invention is audio data after decoding, and the decoded audio data is relatively large before decoding, if directly performed.
  • Network transmission especially when transmitting over a wireless network, is prone to packet loss problems, which will result in the loss of part of the audio data during transmission, which in turn affects the playback quality of the target terminal of the audio data.
  • the audio data pushing system after extracting the audio data from the buffer of the smart TV, performs a compression operation on the extracted audio data, and then pushes the compressed audio data to the smart television.
  • the compressed audio data is sent to the target terminal by the relevant wireless communication module of the smart TV for decompression playback.
  • the compression algorithm used for performing the compression operation includes but is not limited to the SBC and the ALAC, and is specifically selected according to actual needs.
  • the compressed audio data since the audio data is compressed, in order to ensure that the target terminal of the audio data can be correctly played, the compressed audio data also carries compressed information, which is used to characterize which compression is used by the audio data push system. An algorithm for the target terminal to perform a corresponding decompression operation.
  • the delay of audio data transmission can be further reduced, and the transmission efficiency of the audio data can be improved.
  • the method further includes:
  • the audio data pushing system adjusts a compression ratio of the compression operation according to the size relationship between the packet loss rate and the second preset threshold, where
  • the compression ratio of the compression operation is reduced.
  • packet loss is an unavoidable reality.
  • the purpose of this embodiment is to control the packet loss rate within a reasonable range and reduce the impact of packet loss on audio data playback as much as possible.
  • the target terminal of the audio data after receiving the audio data, the target terminal of the audio data returns a packet loss rate to the smart TV according to the reception condition of the audio data, and the audio data pushing system receives the target terminal back based on the smart TV running thereon. Packet loss rate. After receiving the packet loss rate returned by the target terminal, the audio data pushing system determines whether the compression ratio of the compression operation needs to be adjusted according to the size relationship between the packet loss rate and the second preset threshold, and how to adjust the compression operation. Compression ratio.
  • the second preset threshold is set based on a packet loss rate that does not affect the playback quality of the target terminal.
  • the compression ratio of the compression operation is increased; if the packet loss rate is less than the second preset threshold, the compression ratio of the compression operation is decreased. If the packet loss rate is equal to the second preset threshold, the compression ratio of the compression operation is not adjusted, that is, the compression ratio of the current compression operation is maintained. For example, when the compression ratio is adjusted, if the compression ratio needs to be increased, the audio data pushing system may switch the current compression algorithm to a compression algorithm with a higher compression ratio; if the compression ratio needs to be reduced, the audio data pushing system may switch.
  • the current compression algorithm is a compression algorithm with a smaller compression ratio.
  • the compression ratio of the compression operation is dynamically adjusted, and the transmission efficiency of the audio data can be further improved on the basis of ensuring the audio data playback quality.
  • the present invention further provides an audio data push system, which is applied to a smart television.
  • the audio data push system includes:
  • the extracting module 10 is configured to extract audio data from a buffer of the smart television and push it to the wireless communication protocol stack for transmission when the extraction cycle is reached;
  • the obtaining module 20 is configured to acquire a remaining amount of current audio data of the buffer, and acquire a source type corresponding to the audio data in the buffer;
  • the first adjustment module 30 is configured to update a startup value of the extracted audio data based on the reference delay value corresponding to the source type, and adjust the size according to the size relationship between the current audio data remaining amount and the updated startup value. Extraction cycle, where
  • the extraction period is extended when the remaining amount of current audio data is less than the startup value.
  • the audio data pushing system further includes:
  • a recording module configured to record the acquired remaining amount of the current audio data; and calculate an average value of the remaining amount of the recorded audio data when the number of the remaining amount of the recorded audio data reaches a first preset threshold, and The current audio data remaining amount is updated to the calculated average value.
  • the first adjusting module 30 is further configured to perform a fault tolerance based on a preset tolerance.
  • the updated startup value is corrected; and the extraction period is adjusted according to the magnitude relationship between the current audio data remaining amount and the corrected startup value.
  • the extracting module 10 is further configured to: from the buffer of the smart television when the extraction cycle is reached. Extracting audio data and performing a compression operation on the extracted audio data; and pushing the compressed audio data into the wireless communication protocol stack for transmission.
  • the audio data pushing system further includes:
  • a second adjustment module configured to receive a packet loss rate returned by the target terminal of the audio data based on the received audio data, and adjust a compression ratio of the compression operation according to the size relationship between the packet loss rate and the second preset threshold. among them,
  • the compression ratio of the compression operation is reduced.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Health & Medical Sciences (AREA)
  • Computational Linguistics (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Communication Control (AREA)
  • Mobile Radio Communication Systems (AREA)

Abstract

本发明公开了一种音频数据推送方法，所述音频数据推送方法包括：步骤一，音频数据推送系统在到达提取周期时，从智能电视的缓冲区中提取音频数据并推送到无线通信协议栈中以进行发送；步骤二，所述音频数据推送系统获取所述缓冲区的当前音频数据剩余量，以及获取缓冲区中的音频数据所对应的信源类型；步骤三，所述音频数据推送系统基于所述信源类型对应的参考延迟值更新提取音频数据的启动值，并根据所述当前音频数据剩余量与更新后的所述启动值的大小关系调整所述提取周期，并转入执行步骤一。本发明还公开了一种音频数据推送系统。本发明能够提高音频数据的传输效率。

Description

音频数据推送方法及系统 技术领域
本发明涉及智能终端技术领域，尤其涉及一种音频数据推送方法及系统。
背景技术
目前，为摆脱音频线的束缚，提升音频播放的灵活性，现有技术提出了多种无线音频播放方案。以智能电视支持蓝牙无线音频为例，是通过采集解码模块解码后的音频信号，然后传输到蓝牙协议栈，通过蓝牙模块进行无线传输到远端。但是在采集音频信号并传输到蓝牙协议栈过程中存在较大延迟，当前音频信号采集到蓝牙协议栈的方式是：将音频信号周期性的缓存到缓冲区，再从缓冲区周期提取音频信号写入蓝牙协议栈，而智能电视从输入信源解码分离出音频数据的速度因信源类型不同而不同，通常存在缓冲区中堆积大量音频数据却因未达到提取周期而无法发送，导致音频数据传输的效率较低。
发明内容
本发明的主要目的在于提供一种音频数据推送方法及系统，旨在提高音频数据传输的效率。
为实现上述目的，本发明提供一种音频数据推送方法，该音频数据推送方法包括：
步骤一，音频数据推送系统在到达提取周期时，从智能电视的缓冲区中提取音频数据，并对提取的音频数据进行压缩操作，将压缩后的所述音频数据推送到所述无线通信协议栈中以进行发送；
步骤二，所述音频数据推送系统获取所述缓冲区的当前音频数据剩余量，以及获取缓冲区中的音频数据所对应的信源类型；
步骤三，所述音频数据推送系统基于所述信源类型对应的参考延迟值更新提取音频数据的启动值，并基于预设的容错差对更新后的所述启动值进行修正，根据所述当前音频数据剩余量与修正后的所述启动值的大小关系调整所述提取周期，并转入执行步骤一，其中，
当所述当前音频数据剩余量大于所述启动值时，缩短所述提取周期；
当所述当前音频数据剩余量小于所述启动值时，延长所述提取周期。
在一实施例中，所述音频数据推送系统获取缓冲区中的音频数据所对应的信源类型的步骤之前，还包括：
所述音频数据推送系统记录获取的所述当前音频数据剩余量；
在记录的音频数据剩余量的个数达到第一预设阈值时，所述音频数据推送系统计算记录的音频数据剩余量的平均值，并将所述当前音频数据剩余量更新为计算的所述平均值，转入执行所述音频数据推送系统获取缓冲区中的音频数据所对应的信源类型的步骤。
在一实施例中，所述音频数据推送系统记录获取的所述当前音频数据剩余量的步骤之后，还包括：
在记录的音频数据剩余量的个数未达到所述第一预设阈值时，转入执行所述步骤一。
在一实施例中，所述将压缩后的所述音频数据推送到所述无线通信协议栈中以进行发送的步骤之后，还包括：
所述音频数据推送系统接收所述音频数据的目标终端基于其接收的音频数据返回的丢包率；
所述音频数据推送系统根据所述丢包率与第二预设阈值的大小关系调整压缩操作的压缩比，其中，
当所述丢包率大于所述第二预设阈值时，增大压缩操作的压缩比；
当所述丢包率小于所述第二预设阈值时，减小压缩操作的压缩比。
进一步地，本发明还提供一种音频数据推送方法，该音频数据推送方法包括：
步骤一，音频数据推送系统在到达提取周期时，从智能电视的缓冲区中提取音频数据并推送到无线通信协议栈中以进行发送；
步骤二，所述音频数据推送系统获取所述缓冲区的当前音频数据剩余量， 以及获取缓冲区中的音频数据所对应的信源类型；
步骤三，所述音频数据推送系统基于所述信源类型对应的参考延迟值更新提取音频数据的启动值，并根据所述当前音频数据剩余量与更新后的所述启动值的大小关系调整所述提取周期，并转入执行步骤一，其中，
当所述当前音频数据剩余量大于所述启动值时，缩短所述提取周期；
当所述当前音频数据剩余量小于所述启动值时，延长所述提取周期。
在一实施例中，所述音频数据推送系统获取缓冲区中的音频数据所对应的信源类型的步骤之前，还包括：
所述音频数据推送系统记录获取的所述当前音频数据剩余量；
在记录的音频数据剩余量的个数达到第一预设阈值时，所述音频数据推送系统计算记录的音频数据剩余量的平均值，并将所述当前音频数据剩余量更新为计算的所述平均值，转入执行所述音频数据推送系统获取缓冲区中的音频数据所对应的信源类型的步骤；
所述音频数据推送系统记录获取的所述当前音频数据剩余量的步骤之后，还包括：
在记录的音频数据剩余量的个数未达到所述第一预设阈值时，转入执行所述步骤一。
在一实施例中，所述根据所述当前音频数据剩余量与更新后的所述启动值的大小关系调整所述提取周期的步骤包括：
基于预设的容错差对更新后的所述启动值进行修正；
根据所述当前音频数据剩余量与修正后的所述启动值的大小关系调整所述提取周期。
在一实施例中，所述音频数据推送系统在到达提取周期时，从智能电视的缓冲区中提取音频数据并推送到无线通信协议栈中以进行发送的步骤包括：
音频数据推送系统在到达提取周期时，从智能电视的缓冲区中提取音频数据，并对提取的音频数据进行压缩操作；
所述音频数据推送系统将压缩后的所述音频数据推送到所述无线通信协议栈中以进行发送。
在一实施例中，所述音频数据推送系统在到达提取周期时，从智能电视的缓冲区中提取音频数据并推送到无线通信协议栈中以进行发送的步骤之后，还包括：
所述音频数据推送系统接收所述音频数据的目标终端基于其接收的音频数据返回的丢包率；
所述音频数据推送系统根据所述丢包率与第二预设阈值的大小关系调整压缩操作的压缩比，其中，
当所述丢包率大于所述第二预设阈值时，增大压缩操作的压缩比；
当所述丢包率小于所述第二预设阈值时，减小压缩操作的压缩比。
此外，为实现上述目的，本发明还提供一种音频数据推送系统，所述音频数据推送系统包括：
提取模块，用于在到达提取周期时，从智能电视的缓冲区中提取音频数据并推送到无线通信协议栈中以进行发送；
获取模块，用于获取所述缓冲区的当前音频数据剩余量，以及获取缓冲区中的音频数据所对应的信源类型；
第一调整模块，用于基于所述信源类型对应的参考延迟值更新提取音频数据的启动值，并根据所述当前音频数据剩余量与更新后的所述启动值的大小关系调整所述提取周期，其中，
当所述当前音频数据剩余量大于所述启动值时，缩短所述提取周期；
当所述当前音频数据剩余量小于所述启动值时，延长所述提取周期。
在一实施例中，所述音频数据推送系统还包括：
记录模块，用于记录获取的所述当前音频数据剩余量；以及在记录的音频数据剩余量的个数达到第一预设阈值时，计算记录的音频数据剩余量的平均值，并将所述当前音频数据剩余量更新为计算的所述平均值。
在一实施例中，所述第一调整模块还用于基于预设的容错差对更新后的所述启动值进行修正；以及根据所述当前音频数据剩余量与修正后的所述启动值的大小关系调整所述提取周期。
在一实施例中，所述提取模块还用于在到达提取周期时，从智能电视的缓冲区中提取音频数据，并对提取的音频数据进行压缩操作；以及将压缩后的所述音频数据推送到所述无线通信协议栈中以进行发送。
在一实施例中，所述音频数据推送系统还包括：
第二调整模块，用于接收所述音频数据的目标终端基于其接收的音频数据返回的丢包率；以及根据所述丢包率与第二预设阈值的大小关系调整压缩操作的压缩比，其中，
当所述丢包率大于所述第二预设阈值时，增大压缩操作的压缩比；
当所述丢包率小于所述第二预设阈值时，减小压缩操作的压缩比。
本实施例提出的音频数据推送方法及系统，在提取智能电视的缓冲区中的音频数据并推送到无线通信协议栈中以进行发送之后，基于提取音频数据的预设提取量以及音频数据对应的参考延迟值更新启动音频数据推送的启动值，并根据提取音频数据后缓冲区的当前音频数据剩余量与更新后的启动值的大小关系，动态调整音频数据的提取周期，使得提取周期与智能电视分离出音频数据的速度相适应，从而提升音频数据的传输效率。
附图说明
图1为本发明音频数据推送方法第一实施例的流程示意图；
图2为本发明音频数据推送系统第一实施例的功能模块示意图。
本发明目的的实现、功能特点及优点将结合实施例，参照附图做进一步说明。
具体实施方式
应当理解，此处所描述的具体实施例仅仅用以解释本发明，并不用于限 定本发明。
本发明提供一种音频数据推送方法，应用于智能电视，参照图1，在本发明音频数据推送方法的第一实施例中，所述音频数据推送方法包括以下步骤：
步骤S10，音频数据推送系统在到达提取周期时，从智能电视的缓冲区中提取音频数据并推送到无线通信协议栈中以进行发送；
需要说明的是，本实施例所述的音频数据推送系统基于智能电视运行，当然，所述的音频数据推送系统也可以基于电脑、平板电脑、智能手机等智能设备运行。优选地，在本实施例中，所述音频数据推送系统基于智能电视运行。
本实施例中，智能电视在接收到外部信源输入之后，将输入的信源解码分离出音频信号，并将分离出的音频信号转换成音频数据缓存在缓冲区中，等待发送。其中，所述音频数据的格式包括但不限于PCM(Pulse-code modulation，脉冲编码调制)和LPCM(Linear Pulse-code modulation，线性脉冲编码调制)等。
音频数据推送系统在到达提取周期时，从智能电视的缓冲区中提取音频数据并推送到无线通信协议栈中以进行发送。其中，所述提取周期是音频数据推送系统基于智能电视的硬件性能估计的一个初始提取周期，形象的说，若智能电视的硬件性能高，则预估一个较小的初始提取周期，若智能电视的硬件性能低，则预估一个较大的初始提取周期。此外，所述音频数据推送系统提取音频数据的预设提取量为预先基于所述智能电视的无线传输能力设置的，例如，所述音频数据推送系统每50ms从智能电视的缓冲区中提取512bit的音频数据并推送到无线通信协议栈中以进行发送。
需要说明的是，所述无线通信协议栈包括但不限于蓝牙协议栈和Wi-Fi协议栈，所述音频数据推送系统在从缓冲区中提取到音频数据后，具体推送到何种无线通信协议栈，取决于所述智能电视与音频数据的目标终端采用的无线连接方式。例如，所述智能电视与所述目标终端建立有蓝牙连接，则所述音频数据推送系统在从智能电视的缓冲区中提取到音频数据之后，将提取的音频数据推送到智能电视的蓝牙协议栈中，由智能电视的蓝牙模块将音频数据发送至目标终端；又例如，所述智能电视与所述目标终端建立有Wi-Fi 连接，则所述音频数据推送系统在从智能电视的缓冲区中提取到音频数据之后，将提取的音频数据推送到智能电视的Wi-Fi协议栈中，由智能电视的Wi-Fi模块将音频数据发送至目标终端。
步骤S20，所述音频数据推送系统获取所述缓冲区的当前音频数据剩余量，以及获取缓冲区中的音频数据所对应的信源类型；
本实施例中，在从缓冲区中提取音频数据并推送到所述无线通信协议栈之后，所述音频数据推送系统获取所述缓冲区的当前音频数据剩余量，以及获取缓冲区中的音频数据所对应的信源类型。其中，所述音频数据所对应的信源类型，即智能电视分离出所述音频数据的输入信源的信源类型，通常的，该信源类型包括但不限于RMVB、MP4、MKV、AVI、FLV和WMV。
步骤S30，所述音频数据推送系统基于所述信源类型对应的参考延迟值更新提取音频数据的启动值，并根据所述当前音频数据剩余量与更新后的所述启动值的大小关系调整所述提取周期，并转入执行步骤S10，其中，
当所述当前音频数据剩余量大于所述启动值时，缩短所述提取周期；
当所述当前音频数据剩余量小于所述启动值时，延长所述提取周期。
需要说明的是，对于不同类型的输入信源，智能电视从信源中分离出音频数据需要消耗的时间不同，即分离出音频数据的速度不同，相应的，对音频数据发送至目标终端的延迟影响不同。因此，本实施例的主旨在于根据输入信源的信源类型动态调整提取音频数据的提取周期，保持音频数据传输的低延迟性，实现音频数据的连续传输。
具体的，在确定音频数据所对应的输入信源的信源类型之后，使用如下公式对所述缓冲区的大小进行更新：
Buf＝Cap*k*N；
其中，Buf表示缓冲区的大小，Cap表示提取音频数据的预设提取量，k表示确定的信源类型所对应的参考延迟值，N为经验值，取值范围为[4，+∞)，本实施例取N为4。
需要说明的是，所述参考延迟值为通过大量试验的验证所得，如表1所示，展示了不同信源类型和参考延迟值的映射关系(具体数值未示出)。
信源类型 参考延迟值
RMVB krmvb
MP4 kmp4
MKV kmkv
AVI kavi
FLV kflv
WMV kwmv
表1
在更新所述缓冲区的大小之后，基于更新后的所述缓冲区的大小更新所述启动值，如下所示：
Sta＝Buf/2；
其中，Sta表示更新启动值的目标值，即将当前的初始启动值更新为Sta的计算值。形象的说，启动值即启动音频数据推送系统提取音频数据的值，当缓冲区中的音频数据量达到启动值，且到达提取周期时，音频数据推送系统就从缓冲区中提取音频数据并推送到无线通信协议栈中以进行发送。
本实施例中，在获取到提取音频数据后所述缓冲区的当前音频数据剩余量，以及更新所述启动值之后，音频数据推送系统根据所述当前音频数据剩余量和所述启动值的大小关系对所述提取周期进行调整。具体的，若所述当前音频数据剩余量大于所述启动值，则说明本提取周期提取音频数据后，剩余的音频数据足够下一周期启动音频数据提取，此时缩短所述提取周期，即增加音频数据的提取频率；若所述当前音频数据剩余量小于所述启动值，则说明本提取周期提取音频数据后，剩余的音频数据不足够下一周期启动音频数据提取，此时延长所述提取周期(使得智能电视有足够的时间从输入信源中分离出音频数据)，即减小音频数据的提取频率。
此外，若所述当前音频数据剩余量等于所述启动值，则说明本提取周期提取音频数据后，剩余的音频数据刚好够下一周期启动音频数据提取，此时不调整所述提取周期，即维持当前的音频数据的提取频率。
需要说明的是，调整所述提取周期的调整量具体按实际需要设置，本实施例并不限制所述调整量的具体取值，但调整后的提取周期不得大于人耳感觉到声音断续的间隔时间，也不得小于人耳的听觉响应时间。
本实施例提出的音频数据推送方法，在提取智能电视的缓冲区中的音频数据并推送到无线通信协议栈中以进行发送之后，基于提取音频数据的预设 提取量以及音频数据对应的参考延迟值更新启动音频数据推送的启动值，并根据提取音频数据后缓冲区的当前音频数据剩余量与更新后的启动值的大小关系，动态调整音频数据的提取周期，使得提取周期与智能电视分离出音频数据的速度相适应，从而提升音频数据的传输效率。
进一步的，基于第一实施例，提出本发明音频数据推送方法的第二实施例，在本实施例中，所述音频数据推送系统获取缓冲区中的音频数据所对应的信源类型的步骤之前，还包括：
所述音频数据推送系统记录获取的所述当前音频数据剩余量；
在记录的音频数据剩余量的个数达到第一预设阈值时，所述音频数据推送系统计算记录的音频数据剩余量的平均值，并将所述当前音频数据剩余量更新为计算的所述平均值，转入执行所述音频数据推送系统获取缓冲区中的音频数据所对应的信源类型的步骤；
所述音频数据推送系统记录获取的所述当前音频数据剩余量的步骤之后，还包括：
在记录的音频数据剩余量的个数未达到所述第一预设阈值时，转入执行所述步骤S10。
本领域技术人员可以理解的是，在智能电视的实际使用过程中，在一定的时间内，智能电视的输入信源通常是不变的，相应的，智能电视从输入信源中解码分离出音频数据的速度波动不大，即在实际应用中，虽然每个提取周期均更新一次启动音频数据推送的启动值，但是较长时间才会进行一次提取周期的调整，存在一定处理资源的浪费。因此，在本实施例中，设置第一预设阈值对提取周期的调整进行限制。
具体的，在本实施例中，所述音频数据推送系统在各提取周期从智能电视的缓冲区中提取音频数据并推送到无线通信协议栈中以进行发送之后，且所述音频数据推送系统获取到所述缓冲区的当前音频数据剩余量之后，记录所述缓冲区在提取音频数据之后的音频数据剩余量；若在记录的音频数据剩余量的个数i达到第一预设阈值时，将i置为0，同时计算记录的音频数据剩余量的平均值，并将计算的平均值作为所述当前音频数据剩余量(即将所述当前音频数据剩余量更新为计算的所述平均值)，进而进行所述提取周期的 调整，具体可参照前述实施例，此处不再赘述。其中，所述第一预设阈值可按实际需要进行设置，例如，本实施例将其设置为500。
此外，前述在记录的音频数据剩余量的个数i未达到第一预设阈值时，则转入执行前述步骤S10，以继续记录，暂不进行提取周期的调整。
本实施例通过间隔一定时间判断是否需要进行提取周期的调整，以及如何调整，在保持音频数据传输的低延迟和连续性的基础上，降低了对处理资源的消耗。
进一步的，基于第一或第二实施例，提出本发明音频数据推送方法的第三实施例，在本实施例中，所述根据所述当前音频数据剩余量与所述启动值的大小关系调整所述提取周期的步骤包括：
基于预设的容错差对更新后的所述启动值进行修正；
根据所述当前音频数据剩余量与修正后的所述启动值的大小关系调整所述提取周期。
需要说明的是，为使得提取周期的调整更加平滑，本实施例还使用预设的容错差对更新后的所述启动值进行修正，并使用修正之后的启动值判定是否需要调整提取周期，以及如何调整提取周期。其中，所述容错差为经验值，通过大量试验验证得出。
以下记更新后的启动值为Sta，记容错差为Ft为例进行说明：
在获取到提取音频数据后所述缓冲区的当前音频数据剩余量，以及更新所述启动值之后，若所述当前音频数据剩余量大于等于Sta+Ft，则缩短所述提取周期；若所述当前音频数据剩余量小于等于Sta-Ft，则延长所述提取周期；若所述当前音频数据剩余量小于Sta+Ft，且所述当前音频数据剩余量大于Sta-Ft，则不调整。
形象的说，在所述当前音频数据剩余量位于更新后的启动值的一定正负区间(即修正区间)内时，判定所述当前音频数据剩余量与更新后的启动值相等，不进行提取周期的调整，从而使得提取周期的调整更加平滑。
进一步的，基于前述任一实施例，提出本发明音频数据推送方法的第四实施例，在本实施例中，所述步骤S10包括：
音频数据推送系统在到达提取周期时，从智能电视的缓冲区中提取音频数据，并对提取的音频数据进行压缩操作；
所述音频数据推送系统将压缩后的所述音频数据推送到所述无线通信协议栈中以进行发送。
基于前述实施例的描述，本领域技术人员可以理解的是，本发明推送的所述音频数据是解码之后的音频数据，相对于解码之前，解码过后的音频数据相对来说较大，若直接进行网络传输，尤其是通过无线网络进行传输时，容易引起丢包问题，将会导致部分音频数据在传输过程中丢失，进而影响音频数据的目标终端的播放质量。
因此，在本实施例中，所述音频数据推送系统在从智能电视的缓冲区中提取出音频数据之后，对提取的音频数据进行压缩操作，然后再将压缩后的音频数据推动到智能电视的无线通信协议栈中，由智能电视的相关无线通信模块将压缩后音频数据发送至目标终端，供其解压播放。其中，进行压缩操作采用的压缩算法包括但不限于SBC和ALAC，具体按实际需要进行选取。
此外，由于对音频数据进行了压缩操作，为了确保音频数据的目标终端能够正确播放，压缩后音频数据还携带有压缩信息，所述压缩信息用于表征所述音频数据推送系统采用的何种压缩算法，供所述目标终端进行相应的解压缩操作。
本实施例通过进行压缩操作，能够进一步减少音频数据传输的延迟，提升音频数据的传输效率。
基于第四实施例，提出本发明音频数据推送方法的第五实施例，在本实施例中，所述步骤S10之后，还包括：
所述音频数据推送系统接收所述音频数据的目标终端基于其接收的音频数据返回的丢包率；
所述音频数据推送系统根据所述丢包率与第二预设阈值的大小关系调整压缩操作的压缩比，其中，
当所述丢包率大于所述第二预设阈值时，增大压缩操作的压缩比；
当所述丢包率小于所述第二预设阈值时，减小压缩操作的压缩比。
本领域人员可以理解的是，任何数据在有线/无线网络中的传输均是以数 据包的形式传输的，丢包是不可避免的现实问题，有鉴于此，本实施例的目的在于将丢包率控制在合理的范围内，尽可能的降低丢包对音频数据播放的影响。
在本实施例中，音频数据的目标终端在接收到音频数据之后，根据音频数据的接收情况向智能电视返回丢包率，所述音频数据推送系统基于其运行的智能电视接收所述目标终端返回的丢包率。所述音频数据推送系统在接收到所述目标终端返回的丢包率之后，根据所述丢包率与第二预设阈值的大小关系判断是否需要调整压缩操作的压缩比，以及如何调整压缩操作的压缩比。其中，所述第二预设阈值基于不影响目标终端播放质量的丢包率进行设置。
具体的，若所述丢包率大于所述第二预设阈值，则增大压缩操作的压缩比；若所述丢包率小于所述第二预设阈值，则减小压缩操作的压缩比；若所述丢包率等于所述第二预设阈值，则不调整压缩操作的压缩比，即维持当前压缩操作的压缩比。例如，在调整压缩比时，若需要增大压缩比，所述音频数据推送系统可切换当前压缩算法为压缩比更高的压缩算法；若需要减小压缩比，所述音频数据推送系统可切换当前压缩算法为压缩比更小的压缩算法。
本实施例通过对压缩操作的压缩比进行动态调整，在保证音频数据播放质量的基础上，能够进一步提升音频数据的传输效率。
本发明进一步提供一种音频数据推送系统，应用于智能电视，参照图2，在本发明音频数据推送系统的第一实施例中，所述音频数据推送系统包括：
提取模块10，用于在到达提取周期时，从智能电视的缓冲区中提取音频数据并推送到无线通信协议栈中以进行发送；
获取模块20，用于获取所述缓冲区的当前音频数据剩余量，以及获取缓冲区中的音频数据所对应的信源类型；
第一调整模块30，用于基于所述信源类型对应的参考延迟值更新提取音频数据的启动值，并根据所述当前音频数据剩余量与更新后的所述启动值的大小关系调整所述提取周期，其中，
当所述当前音频数据剩余量大于所述启动值时，缩短所述提取周期；
当所述当前音频数据剩余量小于所述启动值时，延长所述提取周期。
进一步的，基于第一实施例，提出本发明音频数据推送系统的第二实施例，在本实施例中，所述音频数据推送系统还包括：
记录模块，用于记录获取的所述当前音频数据剩余量；以及在记录的音频数据剩余量的个数达到第一预设阈值时，计算记录的音频数据剩余量的平均值，并将所述当前音频数据剩余量更新为计算的所述平均值。
进一步的，基于第一实施例或第二实施例，提出本发明音频数据推送系统的第三实施例，在本实施例中，所述第一调整模块30还用于基于预设的容错差对更新后的所述启动值进行修正；以及根据所述当前音频数据剩余量与修正后的所述启动值的大小关系调整所述提取周期。
进一步的，基于前述任一实施例，提出本发明音频数据推送系统的第四实施例，在本实施例中，所述提取模块10还用于在到达提取周期时，从智能电视的缓冲区中提取音频数据，并对提取的音频数据进行压缩操作；以及将压缩后的所述音频数据推送到所述无线通信协议栈中以进行发送。
基于第四实施例，提出本发明音频数据推送系统的第五实施例，在本实施例中，所述音频数据推送系统还包括：
第二调整模块，用于接收所述音频数据的目标终端基于其接收的音频数据返回的丢包率；以及根据所述丢包率与第二预设阈值的大小关系调整压缩操作的压缩比，其中，
当所述丢包率大于所述第二预设阈值时，增大压缩操作的压缩比；
当所述丢包率小于所述第二预设阈值时，减小压缩操作的压缩比。
以上仅为本发明的优选实施例，并非因此限制本发明的专利范围，凡是利用本发明说明书及附图内容所作的等效结构或等效流程变换，或直接或间接运用在其他相关的技术领域，均同理包括在本发明的专利保护范围内。

Claims (20)

  1. 一种音频数据推送方法，应用于智能电视，其特征在于，所述音频数据推送方法包括以下步骤：
    步骤一，音频数据推送系统在到达提取周期时，从智能电视的缓冲区中提取音频数据，并对提取的音频数据进行压缩操作，将压缩后的所述音频数据推送到所述无线通信协议栈中以进行发送；
    步骤二，所述音频数据推送系统获取所述缓冲区的当前音频数据剩余量，以及获取缓冲区中的音频数据所对应的信源类型；
    步骤三，所述音频数据推送系统基于所述信源类型对应的参考延迟值更新提取音频数据的启动值，并基于预设的容错差对更新后的所述启动值进行修正，根据所述当前音频数据剩余量与修正后的所述启动值的大小关系调整所述提取周期，并转入执行步骤一，其中，
    当所述当前音频数据剩余量大于所述启动值时，缩短所述提取周期；
    当所述当前音频数据剩余量小于所述启动值时，延长所述提取周期。
  2. 如权利要求1所述的音频数据推送方法，其特征在于，所述音频数据推送系统获取缓冲区中的音频数据所对应的信源类型的步骤之前，还包括：
    所述音频数据推送系统记录获取的所述当前音频数据剩余量；
    在记录的音频数据剩余量的个数达到第一预设阈值时，所述音频数据推送系统计算记录的音频数据剩余量的平均值，并将所述当前音频数据剩余量更新为计算的所述平均值，转入执行所述音频数据推送系统获取缓冲区中的音频数据所对应的信源类型的步骤。
  3. 如权利要求2所述的音频数据处理方法，其特征在于，所述音频数据推送系统记录获取的所述当前音频数据剩余量的步骤之后，还包括：
    在记录的音频数据剩余量的个数未达到所述第一预设阈值时，转入执行所述步骤一。
  4. 如权利要求1所述的音频数据推送方法，其特征在于，所述将压缩后 的所述音频数据推送到所述无线通信协议栈中以进行发送的步骤之后，还包括：
    所述音频数据推送系统接收所述音频数据的目标终端基于其接收的音频数据返回的丢包率；
    所述音频数据推送系统根据所述丢包率与第二预设阈值的大小关系调整压缩操作的压缩比，其中，
    当所述丢包率大于所述第二预设阈值时，增大压缩操作的压缩比；
    当所述丢包率小于所述第二预设阈值时，减小压缩操作的压缩比。
  5. 如权利要求2所述的音频数据推送方法，其特征在于，所述将压缩后的所述音频数据推送到所述无线通信协议栈中以进行发送的步骤之后，还包括：
    所述音频数据推送系统接收所述音频数据的目标终端基于其接收的音频数据返回的丢包率；
    所述音频数据推送系统根据所述丢包率与第二预设阈值的大小关系调整压缩操作的压缩比，其中，
    当所述丢包率大于所述第二预设阈值时，增大压缩操作的压缩比；
    当所述丢包率小于所述第二预设阈值时，减小压缩操作的压缩比。
  6. 如权利要求3所述的音频数据推送方法，其特征在于，所述将压缩后的所述音频数据推送到所述无线通信协议栈中以进行发送的步骤之后，还包括：
    所述音频数据推送系统接收所述音频数据的目标终端基于其接收的音频数据返回的丢包率；
    所述音频数据推送系统根据所述丢包率与第二预设阈值的大小关系调整压缩操作的压缩比，其中，
    当所述丢包率大于所述第二预设阈值时，增大压缩操作的压缩比；
    当所述丢包率小于所述第二预设阈值时，减小压缩操作的压缩比。
  7. 一种音频数据推送方法，应用于智能电视，其特征在于，所述音频数 据推送方法包括以下步骤：
    步骤一，音频数据推送系统在到达提取周期时，从智能电视的缓冲区中提取音频数据并推送到无线通信协议栈中以进行发送；
    步骤二，所述音频数据推送系统获取所述缓冲区的当前音频数据剩余量，以及获取缓冲区中的音频数据所对应的信源类型；
    步骤三，所述音频数据推送系统基于所述信源类型对应的参考延迟值更新提取音频数据的启动值，并根据所述当前音频数据剩余量与更新后的所述启动值的大小关系调整所述提取周期，并转入执行步骤一，其中，
    当所述当前音频数据剩余量大于所述启动值时，缩短所述提取周期；
    当所述当前音频数据剩余量小于所述启动值时，延长所述提取周期。
  8. 如权利要求7所述的音频数据推送方法，其特征在于，所述音频数据推送系统获取缓冲区中的音频数据所对应的信源类型的步骤之前，还包括：
    所述音频数据推送系统记录获取的所述当前音频数据剩余量；
    在记录的音频数据剩余量的个数达到第一预设阈值时，所述音频数据推送系统计算记录的音频数据剩余量的平均值，并将所述当前音频数据剩余量更新为计算的所述平均值，转入执行所述音频数据推送系统获取缓冲区中的音频数据所对应的信源类型的步骤；
    所述音频数据推送系统记录获取的所述当前音频数据剩余量的步骤之后，还包括：
    在记录的音频数据剩余量的个数未达到所述第一预设阈值时，转入执行所述步骤一。
  9. 如权利要求7所述的音频数据推送方法，其特征在于，所述根据所述当前音频数据剩余量与更新后的所述启动值的大小关系调整所述提取周期的步骤包括：
    基于预设的容错差对更新后的所述启动值进行修正；
    根据所述当前音频数据剩余量与修正后的所述启动值的大小关系调整所述提取周期。
  10. 如权利要求7项所述的音频数据推送方法，其特征在于，所述音频数据推送系统在到达提取周期时，从智能电视的缓冲区中提取音频数据并推送到无线通信协议栈中以进行发送的步骤包括：
    音频数据推送系统在到达提取周期时，从智能电视的缓冲区中提取音频数据，并对提取的音频数据进行压缩操作；
    所述音频数据推送系统将压缩后的所述音频数据推送到所述无线通信协议栈中以进行发送。
  11. 如权利要求8所述的音频数据推送方法，其特征在于，所述音频数据推送系统在到达提取周期时，从智能电视的缓冲区中提取音频数据并推送到无线通信协议栈中以进行发送的步骤包括：
    音频数据推送系统在到达提取周期时，从智能电视的缓冲区中提取音频数据，并对提取的音频数据进行压缩操作；
    所述音频数据推送系统将压缩后的所述音频数据推送到所述无线通信协议栈中以进行发送。
  12. 如权利要求10所述的音频数据推送方法，其特征在于，所述音频数据推送系统在到达提取周期时，从智能电视的缓冲区中提取音频数据并推送到无线通信协议栈中以进行发送的步骤之后，还包括：
    所述音频数据推送系统接收所述音频数据的目标终端基于其接收的音频数据返回的丢包率；
    所述音频数据推送系统根据所述丢包率与第二预设阈值的大小关系调整压缩操作的压缩比，其中，
    当所述丢包率大于所述第二预设阈值时，增大压缩操作的压缩比；
    当所述丢包率小于所述第二预设阈值时，减小压缩操作的压缩比。
  13. 如权利要求11所述的音频数据推送方法，其特征在于，所述音频数据推送系统在到达提取周期时，从智能电视的缓冲区中提取音频数据并推送到无线通信协议栈中以进行发送的步骤之后，还包括：
    所述音频数据推送系统接收所述音频数据的目标终端基于其接收的音频 数据返回的丢包率；
    所述音频数据推送系统根据所述丢包率与第二预设阈值的大小关系调整压缩操作的压缩比，其中，
    当所述丢包率大于所述第二预设阈值时，增大压缩操作的压缩比；
    当所述丢包率小于所述第二预设阈值时，减小压缩操作的压缩比。
  14. 一种音频数据推送系统，应用于智能电视，其特征在于，所述音频数据推送系统包括：
    提取模块，用于在到达提取周期时，从智能电视的缓冲区中提取音频数据并推送到无线通信协议栈中以进行发送；
    获取模块，用于获取所述缓冲区的当前音频数据剩余量，以及获取缓冲区中的音频数据所对应的信源类型；
    第一调整模块，用于基于所述信源类型对应的参考延迟值更新提取音频数据的启动值，并根据所述当前音频数据剩余量与更新后的所述启动值的大小关系调整所述提取周期，其中，
    当所述当前音频数据剩余量大于所述启动值时，缩短所述提取周期；
    当所述当前音频数据剩余量小于所述启动值时，延长所述提取周期。
  15. 如权利要求14所述的音频数据推送系统，其特征在于，所述音频数据推送系统还包括：
    记录模块，用于记录获取的所述当前音频数据剩余量；以及在记录的音频数据剩余量的个数达到第一预设阈值时，计算记录的音频数据剩余量的平均值，并将所述当前音频数据剩余量更新为计算的所述平均值。
  16. 如权利要求14所述的音频数据推送系统，其特征在于，所述第一调整模块还用于基于预设的容错差对更新后的所述启动值进行修正；以及根据所述当前音频数据剩余量与修正后的所述启动值的大小关系调整所述提取周期。
  17. 如权利要求14所述的音频数据推送系统，其特征在于，所述提取模 块还用于在到达提取周期时，从智能电视的缓冲区中提取音频数据，并对提取的音频数据进行压缩操作；以及将压缩后的所述音频数据推送到所述无线通信协议栈中以进行发送。
  18. 如权利要求15所述的音频数据推送系统，其特征在于，所述提取模块还用于在到达提取周期时，从智能电视的缓冲区中提取音频数据，并对提取的音频数据进行压缩操作；以及将压缩后的所述音频数据推送到所述无线通信协议栈中以进行发送。
  19. 如权利要求17所述的音频数据推送系统，其特征在于，所述音频数据推送系统还包括：
    第二调整模块，用于接收所述音频数据的目标终端基于其接收的音频数据返回的丢包率；以及根据所述丢包率与第二预设阈值的大小关系调整压缩操作的压缩比，其中，
    当所述丢包率大于所述第二预设阈值时，增大压缩操作的压缩比；
    当所述丢包率小于所述第二预设阈值时，减小压缩操作的压缩比。
  20. 如权利要求18所述的音频数据推送系统，其特征在于，所述音频数据推送系统还包括：
    第二调整模块，用于接收所述音频数据的目标终端基于其接收的音频数据返回的丢包率；以及根据所述丢包率与第二预设阈值的大小关系调整压缩操作的压缩比，其中，
    当所述丢包率大于所述第二预设阈值时，增大压缩操作的压缩比；
    当所述丢包率小于所述第二预设阈值时，减小压缩操作的压缩比。
PCT/CN2016/084863 2016-01-07 2016-06-04 音频数据推送方法及系统 WO2017117916A1 (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
US16/068,858 US20190020847A1 (en) 2016-01-07 2016-06-04 Method and system for pushing audio data
EP16883057.8A EP3402212A4 (en) 2016-01-07 2016-06-04 PUSH METHOD AND SYSTEM FOR AUDIO DATA

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201610013640.5 2016-01-07
CN201610013640.5A CN105681883B (zh) 2016-01-07 2016-01-07 音频数据推送方法及系统

Publications (1)

Publication Number Publication Date
WO2017117916A1 true WO2017117916A1 (zh) 2017-07-13

Family

ID=56299762

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/084863 WO2017117916A1 (zh) 2016-01-07 2016-06-04 音频数据推送方法及系统

Country Status (4)

Country Link
US (1) US20190020847A1 (zh)
EP (1) EP3402212A4 (zh)
CN (1) CN105681883B (zh)
WO (1) WO2017117916A1 (zh)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108551358B (zh) * 2018-03-16 2021-01-19 恒玄科技(上海)股份有限公司 一种蓝牙耳机不同模型下音频数据的调整方法
CN110661992A (zh) * 2018-06-29 2020-01-07 视联动力信息技术股份有限公司 数据处理方法和装置
CN112771828B (zh) * 2018-12-25 2022-10-18 华为技术有限公司 一种音频数据的通信方法及电子设备
CN112735463A (zh) * 2020-12-16 2021-04-30 杭州小伴熊科技有限公司 一种音频播放延迟ai修正方法和装置
CN114401472B (zh) * 2021-12-02 2023-06-23 联想(北京)有限公司 一种电子设备及信息处理方法

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101466034A (zh) * 2008-12-25 2009-06-24 华为技术有限公司 发送、播放流媒体数据的方法和装置及流媒体点播系统
US20110205427A1 (en) * 2009-02-18 2011-08-25 Tencent Technology (Shenzhen) Company Limited Method and apparatus for controlling video-audio data playing
CN104244033A (zh) * 2014-09-03 2014-12-24 乐视致新电子科技（天津）有限公司 视频播放方法和装置、智能终端

Family Cites Families (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1233594B1 (en) * 2000-10-13 2011-12-07 Sony Corporation Data communication quality control system, transmitter system and receiver
TW200835303A (en) * 2006-09-07 2008-08-16 Avocent Huntsville Corp Point-to-multipoint high definition multimedia transmitter and receiver
JP4793247B2 (ja) * 2006-12-18 2011-10-12 株式会社日立製作所 記録装置、記録方法、再生装置及び再生方法
CN101964903A (zh) * 2010-10-11 2011-02-02 陕西赛瑞德科技发展有限责任公司 一种无线环境中的音视频流媒体同步播放方法
US9270718B2 (en) * 2011-11-25 2016-02-23 Harry E Emerson, III Internet streaming and the presentation of dynamic content
US9591098B2 (en) * 2012-02-01 2017-03-07 Cisco Technology, Inc. System and method to reduce stream start-up delay for adaptive streaming
US20140136643A1 (en) * 2012-11-13 2014-05-15 Motorola Mobility Llc Dynamic Buffer Management for a Multimedia Content Delivery System
CN104025524B (zh) * 2012-12-11 2017-06-20 华为技术有限公司 流媒体传输方法及装置、通信设备
CN103402136B (zh) * 2013-07-29 2016-05-11 重庆大学 自适应调整缓存的控制方法、装置及自适应播放器
CN103648058B (zh) * 2013-10-28 2017-01-11 南京邮电大学 基于信道测量的3g媒体流跨层速率控制方法
US20150208121A1 (en) * 2014-01-18 2015-07-23 Cameron Mason Farnum System and computer program for providing a/v output
CN104254007B (zh) * 2014-09-03 2017-11-03 海信集团有限公司 一种音频处理方法及装置
CN105100675B (zh) * 2015-09-11 2019-07-09 Tcl集团股份有限公司 一种终端视频通信的质量调节方法及系统

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101466034A (zh) * 2008-12-25 2009-06-24 华为技术有限公司 发送、播放流媒体数据的方法和装置及流媒体点播系统
US20110205427A1 (en) * 2009-02-18 2011-08-25 Tencent Technology (Shenzhen) Company Limited Method and apparatus for controlling video-audio data playing
CN104244033A (zh) * 2014-09-03 2014-12-24 乐视致新电子科技（天津）有限公司 视频播放方法和装置、智能终端

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP3402212A4 *

Also Published As

Publication number Publication date
EP3402212A1 (en) 2018-11-14
EP3402212A4 (en) 2019-06-26
CN105681883A (zh) 2016-06-15
CN105681883B (zh) 2019-05-31
US20190020847A1 (en) 2019-01-17

Similar Documents

Publication Publication Date Title
WO2017117916A1 (zh) 音频数据推送方法及系统
CN109906613B (zh) 音频和视频的多模式同步渲染
US9832507B2 (en) System and method for synchronizing media output devices connected on a network
US9817629B2 (en) Audio synchronization method for bluetooth speakers
CN104320843B (zh) 蓝牙发声装置的音频同步方法
US7620410B2 (en) Broadcast station synchronization method and mobile terminal
US8665370B2 (en) Method for synchronized playback of wireless audio and video and playback system using the same
WO2017166497A1 (zh) 一种多媒体数据的同步播放方法及装置
US11146611B2 (en) Lip synchronization of audio and video signals for broadcast transmission
CN204305260U (zh) 一种视频与无线音箱音频匹配的电视机
US9788140B2 (en) Time to play
US20170019870A1 (en) Method and apparatus for synchronization in a network
US11196899B1 (en) Synchronization of wireless-audio to video
US10171710B2 (en) Device and method for digital data distribution, device and method for digital data reproduction, synchronized reproduction system, program, and recording medium
US11170820B1 (en) Method and apparatus for recording audio information
JP2016126037A (ja) 信号処理装置、および信号処理方法、並びにプログラム
JP2015104072A (ja) 通信装置、信号処理プログラム及び記録媒体
US11438400B2 (en) Content data delivery system, server, and content data delivery method
WO2016203870A1 (ja) 送信装置、送信方法、及び通信システム
US10204635B1 (en) Device and method for processing media samples
JP2015198379A (ja) 復号装置、復号システムおよび復号方法
CN117459786A (zh) 基于星闪技术的互联影音系统

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16883057

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

WWE Wipo information: entry into national phase

Ref document number: 2016883057

Country of ref document: EP

ENP Entry into the national phase

Ref document number: 2016883057

Country of ref document: EP

Effective date: 20180807