WO2018120545A1

WO2018120545A1 - Method and device for testing latency of audio loop

Info

Publication number: WO2018120545A1
Application number: PCT/CN2017/082238
Authority: WO
Inventors: 曹海恒; 谭利文; 孙伟
Original assignee: 华为技术有限公司
Priority date: 2016-12-30
Filing date: 2017-04-27
Publication date: 2018-07-05
Also published as: CN108702568B; CN108702568A

Abstract

A method and a device for testing the latency of an audio loop. The method comprises: a terminal starting a preset playing thread, the playing thread being used for reading a preset audio file from a buffer of the terminal, and playing the preset audio file by means of the loudspeaker of the terminal; the terminal starting a preset sound recording thread, the sound recording thread being used for recording, by means of the microphone of the terminal, the preset audio file played by the loudspeaker; the terminal determining the latency of the audio loop of the terminal, according to first time information concerning the playing thread playing the preset audio file and second time information concerning the sound recording thread recording the preset audio file, the latency of the audio loop referring to the time from a sound being inputted into the microphone of the terminal to the sound being outputted from the loudspeaker of the terminal. The method and device of the present application can test the latency of the audio loop.

Description

Method and device for testing audio loop delay

This application claims the priority of the Chinese Patent Application filed on Dec. 30, 2016, the Chinese Patent Application No. 201611264801.4, entitled "A Test Method and Equipment for Delays of Audio Circuit Loops in Mobile Devices", the entire contents of which are hereby incorporated by reference. The citations are incorporated herein by reference.

Technical field

The present application relates to the field of testing technologies, and in particular, to a method and device for testing an audio loop delay.

Background technique

At present, the audio processing process of Android or IOS operating system is mainly composed of two parts: recording thread and playing thread. As shown in Figure 1, the flow of the recording thread is: first input the sound from the microphone, then The analog to digital converter (ADC) is converted into audio data, and then the audio data is transmitted to the system audio service unit via the bus and the hardware and software driver, and finally the audio data is transmitted to the user via the first audio transmission unit. The buffer of the application. The process of playing the thread is: the second audio transmission unit reads the audio data from the buffer of the user application, and transmits the read audio data to the system audio service unit, and the system audio service unit will be driven by the hardware and software and the Bus. The audio data is transmitted to a digital to analog converter (DAC), which converts the audio data into analog data, and the analog data is played through a speaker.

Among them, the audio loop delay refers to the time taken for the sound to input from the microphone of the smart terminal to the output of the speaker. With the development of intelligent terminals, more and more intelligent terminals support real-time sound effects scenes, such as k songs, DJs, and games. Because in real-time sound effects scenarios, smart terminals are required to have lower audio loop delays. How to test the audio loop delay of the intelligent terminal is an urgent problem to be solved.

In the prior art, there are two common delay test methods, namely software log and hardware measurement; wherein the software log is time stamped at the start position and the end position of the key operation, and the time stamp is obtained by comparing the time stamp. The build operation is time consuming; and the hardware test is generally applied to test the delay between the local terminal and the remote terminal. It can be seen from the above analysis that the starting position of the audio loop delay of the intelligent terminal is to input the sound into the intelligent terminal, and the end position is to output the sound to the intelligent terminal. Because the entire sound processing process, involving the underlying software and hardware, cannot record timestamps on the software, it cannot be used to test the audio loop delay inside the intelligent terminal; for hardware testing, it is essentially testing two devices in a certain space. The audio delay under distribution makes it impossible to test the audio loop delay inside the smart terminal.

Summary of the invention

The present application provides a method and apparatus for testing an audio loop delay to test an audio loop delay inside a terminal.

In a first aspect, the present application provides a method for testing an audio loop delay, including: a terminal opening a preset play thread, where the play thread is configured to read a preset audio file from a buffer of the terminal, and The speaker of the terminal plays the preset audio file; the terminal starts a preset recording thread, and the recording thread is used to record a preset audio file played by the speaker through a microphone of the terminal; Determining an audio loop delay of the terminal according to the first time information that the playing thread plays the preset audio file and the second time information that the recording thread records the preset audio file, where the audio loop Time delay means that the sound is input from the microphone of the terminal. Time consuming to output from the speaker of the terminal.

It can be seen that the delay of the internal audio loop of the terminal can be determined by adopting the preset audio file of the present application.

With reference to the first aspect, in a first possible implementation manner, the terminal, according to the first time information of playing the preset audio file by the playing thread, and the second time of recording, by the recording thread, the preset audio file, Determining, by the terminal, determining, by the terminal, the first time information of the target data in the preset audio file; the terminal determining, by the recording thread, the pre-recording The second time information of the target data in the audio file is set; the terminal determines the audio loop delay of the terminal according to the difference between the second time information and the first time information.

It can be seen that in the present application, the audio loop delay is calculated by using the target data of the preset audio file as a reference, which can make the calculation of the audio loop delay more efficient.

In conjunction with the first possible implementation, in a second possible implementation, the preset audio file is a sine wave pulse code modulation PCM file, and the sine wave PCM file is a sine wave and a second pass through the first amplitude The amplitude sine wave is obtained by PCM processing; the target data of the preset audio file is a sampling value corresponding to the first peak of the second amplitude sine wave.

In the present application, using the PCM file corresponding to the sine wave of the first amplitude and the sine wave of the second amplitude as the target data, it is convenient to calculate the first time information of the recording thread recording the target data and the playing thread playing the target The second time information of the data, thereby improving the efficiency of calculating the audio loop delay.

In conjunction with the second possible implementation, in a third possible implementation, the sample values corresponding to the sine wave of the first amplitude and the sine wave of the second amplitude respectively differ in play time by a first duration, and The playing time of the sampling value corresponding to the sine wave of the first amplitude is earlier than the playing time of the sampling value corresponding to the sine wave of the second amplitude;

Determining, by the terminal, that the playing thread plays the first time information of the target data in the preset audio file, including: the terminal recording time information that the playing thread starts playing the preset audio file; Determining, by the playing thread, the time information of playing the preset audio file, the sine wave of the first amplitude, and the sampling time corresponding to the sine wave of the second amplitude are different in the playing time, determining the terminal And starting to play time information of the sampling value corresponding to the sine wave of the second amplitude; the terminal starts to play the time information of the sampling value corresponding to the sine wave of the second amplitude according to the terminal, and the second amplitude sine a period of the wave, determining first time information of the sampling value corresponding to the first peak of the second amplitude sine wave played by the playing thread.

In combination with the second possible implementation manner or the third possible implementation manner, in a fourth possible implementation manner, the preset audio file includes multiple frames of audio data, and each frame of audio data includes multiple PCM samples, and each PCM sample Corresponding to a PCM sample value;

Determining, by the terminal, that the recording thread records the second time information of the target data in the preset audio file, the terminal: determining, by the terminal, the audio to which the PCM sample of the first peak of the second amplitude sine wave belongs a data frame; the terminal searches for a time from the audio data frame to which the PCM sample of the first peak belongs to the time that the audio data frame belongs to the recording thread, and the audio data frame Corresponding relationship with the time of reaching the recording thread is determined according to the time of each frame of the audio data in the preset audio file and the time of reaching the recording thread; the terminal corresponding to the first peak of the sine wave of the second amplitude a sample number of the PCM sample, a length of the audio data frame, and a frequency of PCM sampling the sine wave of the second amplitude, determining a PCM sample of the first peak of the second amplitude sine wave relative to the assigned audio The offset time of the data frame to the recording thread time; the terminal according to the time when the belonging audio data frame arrives at the recording thread and the offset time, The fixed sine wave recorded recording the second thread in the first peak amplitude of the second time information corresponding to the sampling values.

With reference to the fourth possible implementation manner, in a fifth possible implementation manner, the terminal determines, by the terminal, an audio data frame to which the PCM sample of the first peak of the second amplitude sine wave belongs, including: a left gradient and a right gradient of each PCM sample in the preset audio file, the left gradient being a difference between a sample value of a PCM sample and a sample value of an adjacent left PCM sample, the right gradient being a PCM a difference between the sampled value of the sample and the sampled value of the adjacent right PCM sample; the terminal searches for PCM samples whose left gradient and right gradient are both greater than zero from the PCM samples of the preset audio file, and establishes a peak PCM sample ???collecting, from the set of peak PCM samples, searching for a PCM sample of a first peak of a second amplitude sine wave, wherein the PCM sample of the first peak of the second amplitude sine wave corresponds to The sampled value is greater than the sampled value of the adjacent left peak PCM sample, equal to the sampled value of the adjacent right peak PCM sample; the terminal is based on the sample number of the PCM sample of the first peak of the second amplitude sine wave And preset The length of the audio data frame, the data frame is determined of audio PCM samples of said second sine amplitude of the first peak belongs.

In conjunction with the fourth possible implementation or the fifth possible implementation, in a sixth possible implementation, the terminal determines a PCM sample of the first peak of the second amplitude sine wave relative to the assigned audio recording arrival time of the data frame offset time thread, in line with requirements of the following _{equation: T = i j% FrameL *} 1 / samplerate;

Wherein the T represents an offset time of a PCM sample of the first peak of the second amplitude sine wave relative to a time at which the assigned audio data frame reaches a recording thread time; the i _j represents the second amplitude The sample number of the PCM sample of the first peak in the sine wave; the FrameL represents the length of the audio data frame, the % represents the remainder, and the Samplerate represents the terminal to perform PCM sampling on the second amplitude sine wave Frequency of.

In a second aspect, an apparatus for testing an audio loop delay is provided, the apparatus comprising a processor and a memory; the processor, configured to read code in the memory for execution: enabling a preset playback a thread, the play thread is configured to read a preset audio file from a buffer of the device, and play the preset audio file via a speaker of the device; enable a preset recording thread, and the recording thread uses Recording a preset audio file played by the speaker through a microphone of the device; playing first time information of the preset audio file according to the playing thread, and recording, by the recording thread, the preset audio file The second time information determines an audio loop delay of the device, the audio loop delay being a time consuming time from the microphone input of the device to the output of the speaker of the device.

With reference to the second aspect, in a first possible implementation, the processor is configured to play the first time information of the preset audio file according to the playing thread, and the recording thread records the preset audio file Determining, by the second time information, the delay time of the audio loop of the device, specifically, determining: determining, by the playing thread, the first time information of the target data in the preset audio file; determining that the recording thread records the preset Second time information of the target data in the audio file; determining an audio loop delay of the device according to a difference between the second time information and the first time information.

When determining, by the processor, the first time information of the target data in the preset audio file, the processor is specifically configured to: record time information that the playing thread starts playing the preset audio file; The playing thread starts time information for playing the preset audio file, the sine wave of the first amplitude, and the sine wave of the second amplitude a first time period in which the corresponding sampled value is different in the playing time, determining time information of the sampling value corresponding to the sine wave of the second amplitude that is started by the device; and starting to play the second amplitude according to the device The time information of the sampled value corresponding to the sine wave and the period of the second amplitude sine wave determine the first time information of the sampling value corresponding to the first peak of the second amplitude sine wave played by the playing thread.

In combination with the second or third possible implementation manner, in a fourth possible implementation manner, the preset audio file includes multi-frame audio data, each frame of audio data includes multiple PCM samples, and each PCM sample corresponds to one PCM sample value;

When determining, by the processor, the second time information of the target data in the preset audio file, the processor is specifically configured to: determine that the PCM sample of the first peak of the second amplitude sine wave belongs to Audio data frame; from the correspondence between the audio data frame and the time of reaching the recording thread, searching for the audio data frame to which the PCM sample of the first peak belongs to correspond to the time of reaching the recording thread, the audio data frame and Corresponding relationship of the time of reaching the recording thread is determined according to the audio data of each frame in the preset audio file and the time of reaching the recording thread; the sample of the PCM sample corresponding to the first peak of the sine wave of the second amplitude a number, a length of the audio data frame, and a frequency of PCM sampling the sine wave of the second amplitude, determining that the PCM sample of the first peak of the second amplitude sine wave arrives at the recording with respect to the assigned audio data frame The offset time of the thread time; determining the recording thread recording station according to the time when the belonging audio data frame arrives at the recording thread and the offset time The second sine amplitude of the first peak of the second time information corresponding to the sampling values.

With reference to the fourth possible implementation manner, in a fifth possible implementation manner, when the determining, by the processor, the audio data frame to which the PCM sample of the first peak in the second amplitude sine wave belongs, Calculating a left gradient and a right gradient of each PCM sample in the preset audio file, the left gradient being a difference between a sample value of a PCM sample and a sample value of an adjacent left PCM sample, the right gradient finger The difference between the sampled value of a PCM sample and the sampled value of the adjacent right PCM sample; from the PCM samples of the preset audio file, find a PCM sample whose left gradient and right gradient are both greater than zero, and establish a peak PCM sample set Obtaining, from the set of peak PCM samples, a PCM sample of a first peak of a second amplitude sine wave, wherein a sample value corresponding to a PCM sample of the first peak of the second amplitude sine wave is greater than The sampled value of the adjacent left peak PCM sample is equal to the sample value of the adjacent right peak PCM sample; the sample number of the PCM sample of the first peak in the sine wave of the second amplitude and the preset audio data frame Length, indeed PCM samples in the sine wave amplitude of the second peak of the first audio frame belongs.

In conjunction with the fourth or fifth possible implementation, in a sixth possible implementation, the processor determines a PCM sample of the first peak in the sine wave of the second amplitude relative to the assigned audio data The offset time of the frame arrival time of the recording thread meets the following formula:

T=i _j %FrameL*1/Samplerate;

Wherein the T represents an offset time of a PCM sample of the first peak of the second amplitude sine wave relative to a time at which the assigned audio data frame reaches a recording thread time; the i _j represents the second amplitude The sample number of the PCM sample of the first peak in the sine wave; the FrameL represents the length of the audio data frame, the % represents the remainder, and the Samplerate represents PCM sampling of the second amplitude sine wave by the device Frequency of.

In a third aspect, a computer readable storage medium is provided for storing software instructions for performing the functions of any of the above first aspect, the first aspect of the present application, comprising the first Aspect, the program designed by any of the methods of the first aspect.

As can be seen from the above, in the present application, the terminal first starts the playing thread and the recording thread, the playing thread will play the preset audio file, and the recording thread will record the preset audio file played by the playing thread, and the terminal records and plays the preset audio. The first time information of the file and the second time information of recording the preset audio file; finally, the terminal according to the first time letter The information and the second time information can determine the audio loop delay inside the terminal.

DRAWINGS

FIG. 1 is a flowchart of processing audio data according to an embodiment of the present application;

FIG. 2 is a schematic structural diagram of hardware of a terminal according to an embodiment of the present disclosure;

FIG. 3 is a schematic flowchart diagram of a method for testing an audio loop delay according to an embodiment of the present disclosure;

4 is a schematic flowchart of a test audio loop delay provided by an embodiment of the present application;

5 is a schematic diagram of a sine wave corresponding to a PCM file provided by the present application;

6 is another schematic diagram of a test audio loop delay provided by the present application;

7 is a schematic structural diagram of an apparatus for testing an audio loop delay provided by the present application;

FIG. 8 is a schematic structural diagram of an apparatus for testing an audio loop delay provided by the present application.

detailed description

For ease of understanding, the description of the concepts related to the present application is given by way of example, as follows:

Terminal: It can be a mobile terminal (such as a mobile phone, a portable computer, and a wearable device), or it can be a non-mobile terminal (for example, a fixed computer, a television, etc.). The terminal includes at least a microphone and a speaker for processing audio data, and mainly recording audio data (such as user sound) from a microphone input, and processing, and outputting by the speaker. The audio processing process is mainly composed of a recording thread and a playing thread.

Recording thread: Refer to Figure 1. The processing flow is to input analog audio data (such as user sound) from the microphone, convert it to digital audio data through analog to digital converter (ADC), via bus Bus and soft. The hardware driver transmits the digital audio data to the system audio service unit, and then transmits the digital audio data to the buffer through the first audio transmission unit.

Play thread: refer to FIG. 1 , the processing flow is: the second audio transmission unit reads the digital audio data from the buffer, and transmits the read digital audio data to the system audio service unit, and the system audio service unit is softened. The hardware driver and the Bus transfer the digital audio data to a Digital to Analog Converter (DAC), which converts the digital audio data into analog audio data for playback via the speaker.

It should be noted that, for the terminal of the Android operating system, in the recording thread and the playing thread, the driving may be ALSA, the system audio service unit may be AudioFinger, the first audio transmission unit may be Audio Record, and the second audio transmission unit may be For Audio Track or Media palyer. In order to facilitate communication between different processes, in the schematic diagram shown in FIG. 1, the system audio service unit and the first audio transmission unit may further include a Binder unit, and the system audio service unit and the second audio transmission unit may also be included. Includes a Binder unit.

Audio loop delay: refers to the delay of audio data input from the terminal's microphone to the speaker output from the terminal; the delay is mainly composed of the recording delay of the recording thread and the playback delay of the playback thread.

Sinusoidal Pulse Code Modulation (PCM) file: a file obtained by PCM processing a sine wave of a first amplitude and a sine wave of a second amplitude, the PCM processing comprising: sampling and quantizing a sine wave And encoding three processes; the PCM file includes multi-frame audio data, each frame of audio data includes a plurality of PCM samples (eg, one frame of audio data may include 640 PCM samples), and each PCM sample corresponds to a sine wave A sample value.

PCM sample: a sample point passing through a sine wave of a first amplitude or a sine wave of a second amplitude, quantized and The data obtained after encoding.

The technical solution of the present application is introduced below with reference to the accompanying drawings:

The method and device for testing the audio loop delay provided in the embodiment of the present application can be applied to the audio loop delay in the test terminal. First, the application scenario of the application is introduced. With the rapid development of the Internet, more and more terminals are provided. Support real-time audio scenes, such as K songs, DJs, and games. In these real-time audio scenarios, the audio data that the user wishes to input to the terminal can be output from the terminal as soon as possible. Based on this, the present application provides a method and apparatus for testing an audio loop delay to test an audio loop delay of a terminal.

In an example of the present application, FIG. 2 shows a hardware structure of the terminal 200, as shown in FIG. 2, which may include: a processor 201, a memory 202, a display device 203, an input device 204, an audio circuit 205, Microphone 206 and speaker 207.

The memory 202, the display device 203, and the input device 204 are all connected to the processor 201. The memory 202 is configured to store an executable program, including the program for testing the audio loop delay provided by the present application, the memory 202 includes a memory and an external memory, and the memory may be a random access memory (RAM), a read only memory (ROM), and Cache (CACHE), etc. The external storage can be a hard disk, a CD, a USB disk, a floppy disk or a tape drive. The executable program is usually stored on the external memory, and the processor 201 loads the executable program from the external memory into the memory before executing the program, for example, a program for performing the method for testing the audio loop delay provided by the present application.

The components of the terminal 200 will be specifically described below with reference to FIG. 1 :

The processor 201 is a control center of the terminal 200, which connects various parts of the terminal by various interfaces and lines, by running or executing a program (or "unit") stored in the memory 202, and calling the memory stored in the memory 202. The data, various functions and data processing of the terminal 200 are performed, thereby performing overall monitoring of the terminal 200.

Optionally, the processor 201 may include at least one processing unit that integrates processing and wireless communication functions. Alternatively, the processor 201 may also include an application processor and a modem. The application processor mainly processes the operating system. User interface and applications, etc. Modems are primarily used for wireless communication.

The memory 202 mainly includes a storage program area and a storage data area. The storage program area may store an operating system of the terminal (for example, an Android operating system, an IOS operating system, etc.), an application required for at least one function (such as an application of a sound playing function, an application of an image playing function, etc.), And an application program of the method for testing the audio loop delay involved in the embodiment of the present application. The storage data area may store data created according to the use of the terminal 200, including related setting information or usage information of the method of testing the audio loop delay involved in the present application.

The display device 203 is configured to display information input by the user, information provided to the user, and various menus of the terminal 200, including various information about a method for testing an audio loop delay involved in the embodiment of the present application, such as parameter configuration information. And test results display information and so on.

The input device 204 is configured to receive the input digits, the character information, and various input commands, such as the start test command and the stop test command of the method for testing the audio loop delay provided by the present application. Input device 204 can also include a touch panel and/or other type of input device. The touch panel may also be referred to as a touch screen, and may collect a touch operation on or near the user (for example, a touch operation on or near the user using a finger, a stylus, or the like). Other types of input devices may include, but are not limited to, one or more of a physical keyboard, function keys (such as volume control buttons and switch buttons, etc.), a mouse, a trackball, and a joystick.

The audio circuit 205 is configured to perform acoustic/electrical conversion on the microphone 206, amplify the obtained analog audio data, convert it into digital audio data, perform PCM encoding, and transmit the encoded digital audio data to the processor 201. Or, The digital audio data transmitted by the processor 201 is subjected to PCM decoding, the decoded digital audio data is converted into analog audio data, and then power amplification is performed, and the speaker 207 performs electrical/acoustic conversion to push the speaker to sound.

It will be understood by those skilled in the art that the internal structure of the terminal 200 shown in FIG. 2 does not constitute a limitation to the terminal, and may include more or less parts than those illustrated, or combine some components, or different component arrangements. For example, when the terminal 200 communicates with the outside world in a wireless manner, it may further include a radio frequency (RF) circuit and a connected antenna, a wireless fidelity (WIFI) module, and a connected antenna. In addition, the terminal 200 may further include a sensor and a power source for supplying power thereto, etc., and are not enumerated here.

As shown in FIG. 3, the present application provides a method for testing an audio loop delay. The terminal involved in the method may be specifically the terminal 200. The speaker may be specifically the speaker 207, and the microphone may be specifically the microphone 206. Through the introduction of the audio loop delay described above, the audio loop delay is composed of the recording delay of the recording thread and the playback delay of the playback thread. The main principle of the method is: preset audio file, the preset audio file is preset. In the terminal (such as placed in the buffer in Figure 1 above, or other storage area, and then load the preset audio file into the buffer when performing the test), start the playback thread, play the preset audio file, The first time information of playing the preset file is recorded; at the same time, the recording thread is started, and the recording thread records the preset audio file played by the playing thread to obtain the second time information of the recorded audio file. Then, based on the first time information and the second time information, the delay of the audio loop is determined, for example, the audio loop delay is set as the difference between the second time information and the first time information.

details as follows:

Step S31: The terminal starts a preset playing thread.

Specifically, as shown in FIG. 4, the processing process of the playing thread is: the second audio transmission unit reads the preset audio file from the buffer, and transmits the read preset audio file to the system audio service unit, the system audio. The service unit then transmits the preset audio file to the DAC via the hardware and software driver and the Bus, and the DAC converts the preset audio file into an analog file for electrical/audio conversion and plays through the speaker.

Step S32: The terminal starts a preset recording thread.

Specifically, still referring to FIG. 4, the processing process of the recording thread is: the sound played by the input speaker in the microphone is converted by sound/electricity, and the analog file can be obtained at this time, and the analog file can be converted into a digital file by ADC conversion. The digital file at this time is a preset audio file; the preset audio file is transmitted to the first audio transmission unit via the driving and system audio service unit, and the first audio transmission unit writes the preset audio file to the buffer. .

Step S33: The terminal determines the audio loop delay of the terminal according to the first time information of the preset audio file played by the playing thread and the second time information of the audio file recorded by the recording thread.

In the present application, a target data can be determined in a preset audio file, which can be used as a reference for calculating an audio loop delay. Then, determining a first time information that the playing thread starts playing the target data, and a second time information that the recording thread records the target data, and finally, a difference between the second time information and the first time information as the audio of the terminal Loop delay; for example, the second time information is 10:59:50,35 milliseconds, and the first time information is 10:59:50,40 milliseconds, then the audio loop delay of the terminal is 5 milliseconds.

It should be noted that the first time information and the second time information described above are merely for distinguishing different time information, and are not to be understood as indicating or implying relative importance, nor as indicating or suggesting order.

It should be noted that, in the embodiment of the present application, the step S31 to the step S33 do not limit the sequence before and after the terminal performs the steps of the present application, and the method provided by the present application may be performed in the order of step S31, step S32, and step S33. The method of the present application can be performed in the order of step S32, step S31, and step S33, all within the scope of protection of the present application. In order to avoid the missed recording, the recording thread may be first executed in step S32, and then the step S31 is executed to perform the playback. Thread.

As can be seen from the above, in the present application, the terminal first starts the playing thread and the recording thread, the playing thread will play the preset audio file, and the recording thread will record the preset audio file played by the playing thread, and the terminal records and plays the preset audio. The first time information of the file and the second time information of the preset audio file are recorded; finally, the terminal determines the audio loop delay inside the terminal according to the first time information and the second time information.

In another possible embodiment of the present application, the preset audio file may be a sine wave PCM file; wherein the sine wave PCM file performs PCM processing on a sine wave of a first amplitude and a sine wave of a second amplitude The obtained file, the PCM processing includes three processes of sampling, quantizing, and encoding a sine wave.

In the embodiment of the present application, as shown in FIG. 5, for example, the amplitude of the sine wave of the first amplitude may be A, the amplitude of the sine wave of the second amplitude may be 2A; and the sine wave and the second amplitude of the first amplitude The frequency of the sine wave may be the same or different, for example, the frequency of both may be 440HZ.

In the present application, the sampling value corresponding to the first peak of the second amplitude sine wave in the sine wave PCM file may be specifically used as the target data to calculate the audio loop delay, and the process is as follows:

First, the terminal determines that the playing thread plays the first time information of the sample value corresponding to the first peak of the sine wave of the second amplitude.

In the embodiment of the present application, more specifically, the sampling values corresponding to the sine wave of the first amplitude and the sine wave of the second amplitude respectively may be different in the playing time by the first time length Δt, and the sine wave corresponding to the first amplitude corresponds to The playing time of the sampled value is earlier than the playing time of the sampled value corresponding to the sine wave of the second amplitude. For example, the sample value of the sine wave of the first amplitude is played first, and after the sine wave 5S of the first amplitude is played, the sample value corresponding to the sine wave of the second amplitude is played.

In the present application, still referring to FIG. 5, the calculation process is as follows: recording the time information that the playing thread starts playing the preset audio file (for example, starting the playing of the preset audio file at time T1), and then according to the time T1, the first amplitude The first time duration (for example, Δt) of the sine wave and the sine wave of the second amplitude are different in the playing time, and time information (for example, T1+Δt) corresponding to the acquired value of the sine wave that starts playing the second amplitude is calculated; Determining, according to T1+Δt, and a period T of the sine wave of the second amplitude, the first time information of the sampling value corresponding to the first peak of the sine wave of the second amplitude played by the playing thread; as can be seen from FIG. Starting from the start of playing the second amplitude sine wave, the first peak of the sine wave played to the second amplitude passes through 1/4T, and the T is the period of the second amplitude sine wave, so finally, the playing thread can be determined. The first time information for playing the sample value corresponding to the first peak of the second amplitude sine wave is T1 + Δt + 1/4T.

In practical applications, for the case where the loop delay accuracy requirement is low, T1+Δt can also be directly used as the first time information of the sample value corresponding to the first peak of the second amplitude sine wave. Also within the scope of protection of this application.

Second, the terminal determines that the recording thread records the second time information of the sample value corresponding to the first peak of the sine wave of the second amplitude, as shown in FIG. 6.

Step S61: determining an audio data frame to which the PCM sample of the first peak of the second amplitude sine wave belongs;

Specifically, the preset audio file may include multi-frame audio data. In the present application, the terminal records the time when the audio data of each frame in the preset audio file reaches the recording thread, and forms a correspondence relationship between the frame index and the time, such as MAP. MAP={(1st frame audio data, Time1), (2nd frame audio data, Time2), (3rd frame audio data, Time3)......}. Among them, Timel, Time2.....TimeN is the corresponding audio data of each frame up to the recording thread. time.

And each frame of audio data may include a plurality of PCM samples (eg, typically one frame of audio data includes 640 PCM samples), each PCM sample corresponding to a PCM sample value. For each PCM sample within each frame of audio data, the left gradient GradientL[n] and the right gradient GradientR[n] for each PCM sample can be found.

Left gradient GradientL[n]=Sample[n]-Sample[n-1];

Right gradient GradientR[n]=Sample[n]-Sample[n+1];

Among them, Sample[n] represents the current PCM sample, Sample[n-1] represents the left adjacent PCM sample in the current PCM sample in one frame of audio data, and Sample[n+1] represents one frame of audio data. The PCM sample immediately adjacent to the current PCM sample.

Counting PCM samples whose left gradient and right gradient are greater than 0 in each audio data, and establishing a peak PCM sample set;

Wherein, if both the left gradient and the right gradient of one PCM sample are greater than 0, it indicates that the PCM sample is an acquisition value corresponding to a peak representing a sine wave;

The peak PCM sample set includes a peak set index set S _I and a wave peak set S _V ; wherein the peak set index set S _I represents the PCM number of each peak sample, and the wave peak set S _V represents the size of the sample value corresponding to the peak ;

S _I ={i ₁ ,i ₂ ,...i _m };

S _V ={v ₁ ,v ₂ ,...i _m };

From the set of peak PCM samples, searching for a PCM sample of the first peak of the second amplitude sine wave, wherein, as shown in FIG. 5, the PCM sample of the first peak of the second amplitude sine wave The corresponding sample value is greater than the sample value of the adjacent left peak PCM sample, and is equal to the sample value of the adjacent right peak PCM sample;

In the present application, a specific implementation may be: an iterative wave peak set S _V , and a peak gradient G[j].

G[j]=V[j]-V[j-1];

Where V[j] represents the sample value corresponding to the current peak, and V[j-1] represents the sample value corresponding to the left peak adjacent to the current peak; as seen in FIG. 5, only the second amplitude sine wave The first peak, whose left adjacent peak is A, will have a difference between 2A and A greater than zero.

After determining the peak corresponding to the first peak of the second amplitude sine wave, in the set of peak set index S _I = {i ₁ , i ₂ , ... i _m }, find the PCM sample number corresponding to the peak I _j ;

Finally, based on the PCM sample number I _j of the first peak of the second amplitude sine wave and the length of each audio data frame, the audio data frame to which the PCM sample of the first peak of the second amplitude sine wave belongs is determined. ;

For example, in the present application, the PCM sample number I _j of the first peak of the second amplitude sine wave is compared with the length FrameL of each frame of audio data, and the audio data frame to which I _j belongs can be determined; for example, I _j is 10014; and FrameL is 1000, then I _j /FrameL=10 can be determined, and it can be determined that I _j is located in the eleventh audio data frame. FrameL may specifically include the number of PCM samples per frame.

Step S62: Searching, from the correspondence relationship MAP between the audio data frame and the time of the recording thread, the time at which the audio data frame to which the PCM sample of the first peak belongs belongs to the recording thread;

For example, the above I _j is located in the eleventh audio data frame, and may be specifically in the above MAP={(first frame audio data, Time1), (second frame audio data, Time2), (third frame audio data, Time3)... ...} finds the time 11 of the 11th frame of audio data arriving at the recording thread.

Step S63: the sample number of PCM samples in the first peak amplitude of the second sine wave corresponds according to I _j, the audio data frame length FrameL PCM samples and the frequency of the second sinusoidal amplitude, determined An offset time of the PCM sample of the first peak of the second amplitude sine wave relative to the assigned audio data frame to the recording thread time;

The terminal determines the offset time of the PCM sample of the first peak of the second amplitude sine wave relative to the time at which the assigned audio data frame reaches the recording thread, which meets the following formula:

T=i _j %FrameL*1/Samplerate;

Wherein said T represents an offset time of a PCM sample of a first peak of said second amplitude sine wave relative to a time of arrival of said belonging audio data frame; said _Ij representing said second amplitude The sample number of the PCM sample of the first peak in the sine wave; the FrameL represents the length of the audio data frame, the % represents the remainder, and the Samplerate represents the terminal to perform PCM sampling on the second amplitude sine wave Frequency of.

Specifically, the above example is still used, I _j is 10014, and FrameL is 1000, then I _j and FrameL can be obtained as 14, and it can be seen that I _j is the 14th PCM sample in the belonging data frame, then, 14*1/Samplerate is the offset time of I _j in the audio data frame to which it belongs, Samplerate represents the frequency of PCM sampling, and 1/Samplerate represents the period of PCM sampling, ie, how long to collect a PCM per interval Sample; and 14*1/Samplerate is the time information for collecting the 14th PCM sample in the current audio data frame.

Step S64: Determine, according to the time when the belonging audio data frame arrives at the recording thread and the offset time, the recording time to record the second time information of the sample value corresponding to the first peak in the sine wave of the second amplitude.

In the present application, the time when the audio data frame to which the first peak of the second amplitude sine wave belongs to the recording thread and the calculated programming time may be specifically summed as the first peak in the second amplitude sine wave. The second time information that reaches the recording thread.

Finally, the delay Tloop of the entire audio loop conforms to the following formula:

Tloop=TimeFrameIndex+Ij%FrameL*1/Samplerate-(T1+Δt+1/4T);

Wherein, TimeFrameIndex+Ij%FrameL*1/Samplerate represents the second time information of the recording thread starting to record the first peak of the second amplitude sine wave, wherein TimeFrameIndex represents the first peak of the second amplitude sine wave belongs to When the audio data frame reaches the recording thread, Ij%FrameL*1/Samplerate represents the offset time of the first peak of the second amplitude amplitude sine wave within the frame of the belonging data; (T1+Δt+1/4T) Representing the first time when the playing thread starts playing the first peak of the second amplitude sine wave, T1 is the time to start playing the first amplitude sine wave, and Δt represents the second amplitude sine wave and the first amplitude sine wave in the playing time The time difference, 1/4T represents the time from the start of playing the second amplitude sine wave to the play to the peak.

In another possible embodiment of the present application, as shown in FIG. 7, an apparatus 700 for testing an audio loop delay is provided, including a processor 701 and a memory 702;

The memory 702 is used to store the program instructions of the method for testing the audio loop delay. The memory 702 may be a non-volatile memory, such as a hard disk drive (HDD) or a solid-state drive (SSD). It can also be a volatile memory such as a random-access memory (RAM). A memory is any other medium that can be used to carry or store desired program code in the form of an instruction or data structure and can be accessed by a computer, but is not limited thereto.

The processor 701 may be a central processing unit (CPU), or a digital processing module, etc., and the processor 701 is configured to read code in the memory for executing the test audio loop. The method of extending is specifically: opening a preset playing thread, wherein the playing thread is configured to read a preset audio file from a buffer of the device, and play the preset audio file via a speaker of the device; Opening a preset recording thread, the recording thread is configured to record a preset audio file played by the speaker through a microphone of the device Determining an audio loop delay of the device according to the first time information of the playback thread playing the preset audio file and the second time information of the recording thread recording the preset audio file, the audio Loop delay refers to the time it takes for sound to be input from the microphone of the device to the output from the speaker of the device.

Optionally, the processor 701 determines, according to the first time information that the preset audio file is played by the playing thread, and the second time information that the recording thread records the preset audio file, determining an audio loop of the device. The time delay is specifically configured to: determine that the playing thread plays the first time information of the target data in the preset audio file; and determine that the recording thread records the second time information of the target data in the preset audio file; Determining an audio loop delay of the device according to a difference between the second time information and the first time information.

Optionally, the preset audio file is a sine wave pulse code modulation PCM file, and the sine wave PCM file is obtained by performing PCM processing on a sine wave of a first amplitude and a sine wave of a second amplitude;

The target data of the preset audio file is a sample value corresponding to the first peak of the second amplitude sine wave.

Optionally, the sampling value corresponding to the sine wave of the first amplitude and the sine wave of the second amplitude respectively differ by a first time length in the playing time, and the sampling value corresponding to the sine wave of the first amplitude is played. The time is earlier than the playing time of the sample value corresponding to the sine wave of the second amplitude; when determining, by the processor 701, the first time information of the target data in the preset audio file, the processor 701 is specifically configured to: Recording, by the playing thread, time information for playing the preset audio file; starting time information for playing the preset audio file, the sine wave of the first amplitude, and a sine wave of the second amplitude according to the playing thread Determining, by the device, the time information of the sampling value corresponding to the sine wave of the second amplitude is started, and the sine of the second amplitude is started according to the device. Determining the time information of the sample value corresponding to the wave and the period of the second amplitude sine wave, determining that the playing thread plays the first peak of the second amplitude sine wave A first time information of the sampled values.

Optionally, the preset audio file includes multi-frame audio data, each frame of audio data includes a plurality of PCM samples, each PCM sample corresponds to one PCM sample value; and the processor 701 determines that the recording thread records the pre- The second time information of the target data in the audio file is specifically configured to: determine an audio data frame to which the PCM sample of the first peak of the second amplitude sine wave belongs; from the audio data frame to the time of reaching the recording thread Corresponding relationship, the audio data frame to which the PCM sample of the first peak is located corresponds to the time of reaching the recording thread, and the corresponding relationship between the audio data frame and the time of reaching the recording thread is according to the preset audio. The audio data of each frame in the file is determined by the time of arrival of the recording thread; the sample number of the PCM sample corresponding to the first peak of the sine wave of the second amplitude, the length of the audio data frame, and the second amplitude The sine wave is subjected to PCM sampling, and the PCM sample of the first peak of the sine wave of the second amplitude is determined to be recorded with respect to the belonging audio data frame. The offset time of the thread time; determining, according to the time when the belonging audio data frame arrives at the recording thread and the offset time, the recording thread to record the sample value corresponding to the first peak of the sine wave of the second amplitude Two time information.

Optionally, when determining, by the processor 701, the audio data frame to which the PCM sample of the first peak in the sine wave of the second amplitude belongs, the method is specifically configured to: calculate each PCM sample in the preset audio file. Left gradient and right gradient, the left gradient refers to the difference between the sampled value of a PCM sample and the sampled value of an adjacent left PCM sample, the right gradient refers to the sampled value of a PCM sample and the adjacent right PCM sample a difference between the sampled values; from the PCM samples of the preset audio file, finding PCM samples whose left gradient and right gradient are both greater than zero, establishing a peak PCM sample set; and searching for the second amplitude from the peak PCM sample set a PCM sample of a first peak in the sine wave, wherein a sample value corresponding to the PCM sample of the first peak of the second amplitude sine wave is greater than a sample value of the adjacent left peak PCM sample, equal to the adjacent a sample value of the right peak PCM sample; determining a sine wave of the second amplitude according to a sample number of the PCM sample of the first peak of the second amplitude sine wave and a length of the preset audio data frame a peak PCM sample The audio data frame to which it belongs.

Optionally, the processor 701 determines an offset time of the PCM sample of the first peak in the sine wave of the second amplitude relative to the time at which the belonging audio data frame reaches the recording thread, and meets the following formula:

T=i _j %FrameL*1/Samplerate;

Although not shown in the figures, device 700 can also include a communication interface for communicating with external devices.

The specific connection medium between the processor 701 and the memory 702 is not limited in the embodiment of the present application. The embodiment of the present application is connected by a bus between the processor 701 and the memory 702 in FIG. 7. FIG. 7 is represented by a hollow double arrow line, but does not mean that there is only one bus or one type of bus, and other components are The connection method is only for illustrative purposes and is not limited. The bus can be divided into an address bus, a data bus, a control bus, and the like. It should be noted that the device 700 may be a terminal as shown in FIG. 2, and the method of testing the audio loop delay as shown in FIG. 3 may be specifically performed.

The specific implementation and the beneficial effects of the device provided by the foregoing embodiments of the present application may be compared with the foregoing, and the method provided by the foregoing embodiments of the present application is similar to the method for solving the problem. The implementation of the method and the beneficial effects of the method provided by the foregoing embodiments can be referred to each other, and the details are not described again.

In another possible embodiment of the present application, as shown in FIG. 8, the present application further provides an apparatus 800 for testing an audio loop delay, including:

The opening unit 801 is configured to enable a preset playing thread and a recording thread, where the playing thread is configured to read a preset audio file from a buffer of the terminal, and play the preset through a speaker of the terminal An audio file; the recording thread is configured to record a preset audio file played by the speaker through a microphone of the terminal;

a determining unit 802, configured to determine, according to the first time information that the playing thread plays the preset audio file, and the second time information that the recording thread records the preset audio file, determine an audio loop of the terminal The audio loop delay refers to the time taken for the sound to be input from the microphone of the terminal to the speaker output from the terminal.

Optionally, the determining unit 802 is specifically configured to: determine that the playing thread plays the first time information of the target data in the preset audio file; and determine that the recording thread records the target data in the preset audio file. Second time information; determining an audio loop delay of the terminal according to a difference between the second time information and the first time information.

Optionally, the sampling value corresponding to the sine wave of the first amplitude and the sine wave of the second amplitude respectively differ by a first time length in the playing time, and the sampling value corresponding to the sine wave of the first amplitude is played. a play time of a sample value corresponding to a sine wave of the second amplitude earlier than the second amplitude;

The determining unit 802 is configured to: when the playing thread plays the first time information of the target data in the preset audio file, to record time information that the playing thread starts playing the preset audio file; The playing thread starts playing the time information of the preset audio file, the sine wave of the first amplitude and the sampling time corresponding to the sine wave of the second amplitude are different in the playing time, and determining that the terminal starts playing Positive of the second amplitude Time information of the sampled value corresponding to the sine wave; determining, according to the time information of the sampling value corresponding to the sine wave of the second amplitude and the period of the second amplitude sine wave, determining the play thread playing station The first time information of the sample value corresponding to the first peak of the second amplitude sine wave.

Optionally, the preset audio file includes multi-frame audio data, each frame of audio data includes a plurality of PCM samples, and each PCM sample corresponds to one PCM sample value;

The determining unit 802 is configured to: determine, by the recording thread, the second time information of the target data in the preset audio file, to determine that the PCM sample of the first peak of the second amplitude sine wave belongs to An audio data frame; in a correspondence between the audio data frame and the time of reaching the recording thread, searching for an audio data frame to which the PCM sample of the first peak belongs to correspond to a time of reaching the recording thread, the audio data frame and arrival Corresponding relationship of the recording thread time is determined according to the audio data of each frame in the preset audio file and the time of reaching the recording thread; the sample number of the PCM sample corresponding to the first peak of the sine wave according to the second amplitude a length of the audio data frame and a frequency of PCM sampling the sine wave of the second amplitude, determining that the PCM sample of the first peak of the second amplitude sine wave arrives at the recording thread with respect to the belonging audio data frame Time offset time; determining the recording thread recording station according to the time when the belonging audio data frame arrives at the recording thread and the offset time The second sine amplitude of the first peak of the second time information corresponding to the sampling values.

Optionally, when determining the audio data frame to which the PCM sample of the first peak in the second amplitude sine wave belongs, the determining unit 802 is specifically configured to: calculate each PCM sample in the preset audio file. Left gradient and right gradient, the left gradient refers to the difference between the sampled value of a PCM sample and the sampled value of an adjacent left PCM sample, the right gradient refers to the sampled value of a PCM sample and the adjacent right PCM sample a difference between the sampled values; from the PCM samples of the preset audio file, finding PCM samples whose left gradient and right gradient are both greater than zero, establishing a peak PCM sample set; and searching for the second amplitude from the peak PCM sample set a PCM sample of a first peak in the sine wave, wherein a sample value corresponding to the PCM sample of the first peak of the second amplitude sine wave is greater than a sample value of the adjacent left peak PCM sample, equal to the adjacent a sample value of the right peak PCM sample; determining a sine wave of the second amplitude according to a sample number of the PCM sample of the first peak of the second amplitude sine wave and a length of the preset audio data frame a peak of PCM Audio frame belongs.

Optionally, the determining unit 802 determines the offset time of the PCM sample of the first peak in the sine wave of the second amplitude relative to the time of the belonging audio data frame to the recording thread time, and meets the following formula:

T=i _j %FrameL*1/Samplerate;

The specific implementation and beneficial effects of the apparatus provided by the foregoing embodiments of the present application are similar to those of the foregoing embodiments of the present application. The implementation of the method and the beneficial effects of the method provided by the foregoing embodiments can be referred to each other, and the details are not described again.

The division of the modules in the embodiment of the present application is schematic, and is only a logical function division. In actual implementation, there may be another division manner. In addition, each functional module in each embodiment of the present application may be integrated into one processing. In the device, it can also be physically existed alone, or two or more modules can be integrated into one module. The above integrated modules can be implemented in the form of hardware or in the form of software functional modules. For example, Figure 7 or The device shown in Figure 2 can be a specific implementation of Figure 8. One implementation of the opening unit 801 and the determining unit 802 shown in FIG. 8 is implemented by calling the computer storage instruction in the memory 702 by the processor 701 shown in FIG.

In another possible embodiment of the present application, there is also provided a computer readable storage medium comprising instructions for causing a computer to perform a method of testing an audio loop delay when it is run on a computer.

Those skilled in the art will appreciate that embodiments of the present application can be provided as a method, system, or computer program product. Thus, the present application can take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment in combination of software and hardware. Moreover, the application can take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) including computer usable program code.

The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (system), and computer program products according to embodiments of the present application. It will be understood that each flow and/or block of the flowchart illustrations and/or FIG. These computer program instructions can be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing device to produce a machine for the execution of instructions for execution by a processor of a computer or other programmable data processing device. Means for implementing the functions specified in one or more of the flow or in a block or blocks of the flow chart.

The computer program instructions can also be stored in a computer readable memory that can direct a computer or other programmable data processing device to operate in a particular manner, such that the instructions stored in the computer readable memory produce an article of manufacture comprising the instruction device. The apparatus implements the functions specified in one or more blocks of a flow or a flow and/or block diagram of the flowchart.

These computer program instructions can also be loaded onto a computer or other programmable data processing device such that a series of operational steps are performed on a computer or other programmable device to produce computer-implemented processing for execution on a computer or other programmable device. The instructions provide steps for implementing the functions specified in one or more of the flow or in a block or blocks of a flow diagram.

It is apparent that those skilled in the art can make various changes and modifications to the embodiments of the present application without departing from the spirit and scope of the embodiments of the present application. Thus, it is intended that the present invention cover the modifications and variations of the embodiments of the present invention.

Claims

A method for testing an audio loop delay is characterized by comprising:

The terminal starts a preset playing thread, and the playing thread is configured to read a preset audio file from a buffer of the terminal, and play the preset audio file via a speaker of the terminal;

The terminal starts a preset recording thread, and the recording thread is configured to record a preset audio file played by the speaker through a microphone of the terminal;

Determining, by the terminal, the audio loop delay of the terminal according to the first time information that the playing thread plays the preset audio file and the second time information that the recording thread records the preset audio file, Audio loop delay refers to the time it takes for sound to be input from the microphone of the terminal to the output from the speaker of the terminal.
The method according to claim 1, wherein the terminal plays the first time information of the preset audio file according to the playing thread and the second time information of the recording thread recording the preset audio file. Determining the audio loop delay of the terminal, including:

Determining, by the terminal, that the playing thread plays the first time information of the target data in the preset audio file;

Determining, by the terminal, the second time information of the target data in the preset audio file by the recording thread;

The terminal determines an audio loop delay of the terminal according to a difference between the second time information and the first time information.
The method of claim 2 wherein said predetermined audio file is a sinusoidal pulse code modulated PCM file, said sinusoidal PCM file being a sine wave passing through a sine wave of a first amplitude and a second amplitude Obtained by PCM processing;

The target data of the preset audio file is a sample value corresponding to the first peak of the second amplitude sine wave.
The method according to claim 3, wherein the sampling values corresponding to the sine wave of the first amplitude and the sine wave of the second amplitude respectively differ in play time by a first duration, and the first amplitude The playing time of the sampling value corresponding to the sine wave is earlier than the playing time of the sampling value corresponding to the sine wave of the second amplitude;

Determining, by the terminal, that the playing thread plays the first time information of the target data in the preset audio file, including:

The terminal records time information that the playing thread starts playing the preset audio file;

The first time length of the playback time of the playback time by the playback thread, the sine wave of the first amplitude and the sine wave of the second amplitude are different in the play time, Determining, by the terminal, time information of a sampling value corresponding to the sine wave of the second amplitude being played;

Determining, by the terminal, the time information of the sampling value corresponding to the sine wave of the second amplitude and the period of the second amplitude sine wave, determining that the playing thread plays the second amplitude sine wave The first time information of the sample value corresponding to a peak.
The method according to claim 3 or 4, wherein the preset audio file comprises multi-frame audio data, each frame of audio data comprises a plurality of PCM samples, each PCM sample corresponding to one PCM sample value;

Determining, by the terminal, that the recording thread records the second time information of the target data in the preset audio file, including:

Determining, by the terminal, an audio data frame to which a PCM sample of a first peak of the second amplitude sine wave belongs;

The terminal searches for the time when the audio data frame to which the PCM sample of the first peak belongs belongs to the recording thread, and the audio data frame and the arrival recording, from the correspondence between the audio data frame and the time of the recording thread. The correspondence of the thread time is determined according to the audio data of each frame in the preset audio file and the time of reaching the recording thread;

Determining, by the terminal, the sample number of the PCM sample corresponding to the first peak of the second amplitude sine wave, the length of the audio data frame, and the frequency of PCM sampling the sine wave of the second amplitude The offset time of the PCM sample of the first peak of the two amplitude sine waves relative to the time at which the assigned audio data frame reaches the recording thread time;

And determining, by the terminal, the second time information of the sampling value corresponding to the first peak of the sine wave of the second amplitude by the recording thread according to the time when the belonging audio data frame reaches the recording thread and the offset time.
The method according to claim 5, wherein the terminal determines an audio data frame to which the PCM sample of the first peak of the second amplitude sine wave belongs, comprising:

The terminal calculates a left gradient and a right gradient of each PCM sample in the preset audio file, where the left gradient refers to a difference between a sample value of a PCM sample and a sample value of an adjacent left PCM sample, the right The gradient refers to the difference between the sampled value of a PCM sample and the sampled value of an adjacent right PCM sample;

The terminal searches for PCM samples whose left gradient and right gradient are greater than zero from the PCM samples of the preset audio file, and establishes a peak PCM sample set;

The terminal searches for a PCM sample of a first peak of a second amplitude sine wave from the set of peak PCM samples, wherein a sampling corresponding to a PCM sample of a first peak of the second amplitude sine wave The value is greater than the sample value of the adjacent left peak PCM sample, which is equal to the sample value of the adjacent right peak PCM sample;

Determining, by the terminal, the PCM sample of the first peak of the second amplitude sine wave according to the sample number of the PCM sample of the first peak of the second amplitude sine wave and the length of the preset audio data frame The audio data frame to which it belongs.
The method according to claim 5 or 6, wherein the terminal determines the offset of the PCM sample of the first peak of the second amplitude sine wave relative to the time of the assigned audio data frame to the recording thread time Time, in accordance with the following formula:

T=i j %FrameL*1/Samplerate;

Wherein the T represents an offset time of a PCM sample of the first peak of the second amplitude sine wave relative to a time at which the assigned audio data frame reaches a recording thread time; the i j represents the second amplitude The sample number of the PCM sample of the first peak in the sine wave; the FrameL represents the length of the audio data frame, the % represents the remainder, and the Samplerate represents the terminal to perform PCM sampling on the second amplitude sine wave Frequency of.
A device for testing an audio loop delay, characterized in that the device comprises a processor and a memory;

The processor is configured to read code in the memory for performing: starting a preset playing thread, the playing thread is configured to read a preset audio file from a buffer of the device, and Playing the preset audio file through a speaker of the device; opening a preset recording thread, wherein the recording thread is configured to record a preset audio file played by the speaker through a microphone of the device; Determining, by the thread, the first time information of the preset audio file and the second time information of the recording thread recording the preset audio file, determining an audio loop delay of the device, where the audio loop delay refers to sound from The microphone input of the device is time consuming to output from the speaker of the device.
The device according to claim 8, wherein the processor plays the first time information of the preset audio file according to the playing thread and the second recording of the preset audio file by the recording thread Time information, determining the time delay of the audio loop of the device, specifically for:

Determining, by the playing thread, the first time information of the target data in the preset audio file;

Determining, by the recording thread, second time information of the target data in the preset audio file;

Determining an audio loop delay of the device according to a difference between the second time information and the first time information.
The apparatus according to claim 9, wherein said predetermined audio file is a sine wave pulse code modulation PCM file, said sine wave PCM file being a sine wave passing through a sine wave of a first amplitude and a second amplitude Obtained by PCM processing;

The target data of the preset audio file is a sample value corresponding to the first peak of the second amplitude sine wave.
The apparatus according to claim 10, wherein the sampling values corresponding to the sine wave of the first amplitude and the sine wave of the second amplitude respectively differ in play time by a first duration, and the first amplitude The playing time of the sampling value corresponding to the sine wave is earlier than the playing time of the sampling value corresponding to the sine wave of the second amplitude;

When determining, by the processor, the first time information of the target data in the preset audio file, the processor is specifically configured to:

Recording time information that the playing thread starts playing the preset audio file;

Determining, according to the time period in which the playing thread starts playing the preset audio file, the sine wave of the first amplitude, and the sampling time corresponding to the sine wave of the second amplitude are different in the playing time. The device starts playing time information of the sample value corresponding to the sine wave of the second amplitude;

Determining, by the device, the time information of the sampling value corresponding to the sine wave of the second amplitude and the period of the second amplitude sine wave, determining that the playing thread plays the first peak of the second amplitude sine wave The first time information of the corresponding sampled value.
The device according to claim 10 or 11, wherein the preset audio file comprises multi-frame audio data, each frame of audio data comprises a plurality of PCM samples, each PCM sample corresponding to one PCM sample value;

When the processor determines that the recording thread records the second time information of the target data in the preset audio file, the processor is specifically configured to:

Determining an audio data frame to which the PCM sample of the first peak of the second amplitude sine wave belongs;

From the correspondence between the audio data frame and the time of reaching the recording thread, searching for the time when the audio data frame to which the PCM sample of the first peak belongs belongs to the recording thread, the audio data frame and the time of reaching the recording thread Corresponding relationship is determined according to each frame of audio data in the preset audio file and the time of reaching the recording thread;

Determining the second amplitude according to a sample number of the PCM sample corresponding to the first peak of the second amplitude sine wave, a length of the audio data frame, and a frequency of PCM sampling the sine wave of the second amplitude The offset time of the PCM sample of the first peak in the sine wave relative to the time at which the assigned audio data frame reaches the recording thread time;

And determining, according to the time when the belonging audio data frame arrives at the recording thread and the offset time, the recording thread to record the second time information of the sample value corresponding to the first peak of the sine wave of the second amplitude.
The apparatus according to claim 12, wherein the processor is configured to: when determining an audio data frame to which the PCM sample of the first peak of the second amplitude sine wave belongs;

Calculating a left gradient and a right gradient of each PCM sample in the preset audio file, the left gradient being a difference between a sample value of a PCM sample and a sample value of an adjacent left PCM sample, the right gradient being a The difference between the sampled value of the PCM sample and the sampled value of the adjacent right PCM sample;

From the PCM samples of the preset audio file, searching for PCM samples whose left gradient and right gradient are both greater than zero, and establishing a peak PCM sample set;

From the set of peak PCM samples, searching for a PCM sample of a first peak of a second amplitude sine wave, wherein a sample value corresponding to a PCM sample of the first peak of the second amplitude sine wave is greater than a phase Adjacent left peak PCM The sampled value is equal to the sampled value of the adjacent right peak PCM sample;

Determining, according to a sample number of the PCM sample of the first peak of the second amplitude sine wave and a length of the preset audio data frame, determining a PCM sample of the first peak of the second amplitude sine wave belongs to Audio data frame.
The apparatus according to claim 12 or 13, wherein said processor determines that the PCM sample of the first peak of said second amplitude sine wave arrives at the recording thread time with respect to the belonging audio data frame Offset time, in accordance with the following formula:

T=i j %FrameL*1/Samplerate;

Wherein the T represents an offset time of a PCM sample of the first peak of the second amplitude sine wave relative to a time at which the assigned audio data frame reaches a recording thread time; the i j represents the second amplitude The sample number of the PCM sample of the first peak in the sine wave; the FrameL represents the length of the audio data frame, the % represents the remainder, and the Samplerate represents PCM sampling of the second amplitude sine wave by the device Frequency of.
A computer readable storage medium, comprising instructions that, when run on a computer, cause the computer to perform the method of any one of claims 1 to 7.