CN114520946B

CN114520946B - Microphone array detection method, device and equipment

Info

Publication number: CN114520946B
Application number: CN202011303733.4A
Authority: CN
Inventors: 黄伟隆; 冯津伟
Original assignee: Alibaba Group Holding Ltd
Current assignee: Alibaba Group Holding Ltd
Priority date: 2020-11-19
Filing date: 2020-11-19
Publication date: 2024-11-15
Anticipated expiration: 2040-11-19
Also published as: CN114520946A

Abstract

The present application discloses a microphone array detection method, device and equipment. The method includes: for two microphone channels of the device under test that are combined in pairs, determine the first timing signal and the second timing signal according to the two audio signals output by the two channels, and the amplitude difference between the first timing signal and the second timing signal corresponds to the phase difference of the two audio signals; determine whether the two audio signals are consistent in phase according to whether the amplitudes of the first timing signal and the second timing signal are consistent; if the two-channel audio signals combined in pairs are consistent in phase, it is determined that the microphone array of the device under test is consistent in phase. This processing method is used to convert the detection of the microphone channel phase into a relatively simple amplitude detection, and the consistency of the phase of the microphone channel output signal is judged based on the relationship between the transformed analysis signal amplitudes; therefore, the detection cost can be effectively reduced while ensuring high detection accuracy, stability and efficiency.

Description

Microphone array detection method, device and equipment

Technical Field

The application relates to the technical field of equipment detection, in particular to a microphone array detection method and device, an equipment detection method and device and electronic equipment.

Background

In recent years, microphone arrays have been used in smart devices on a large scale, such as common smart speakers (heaven fairy). Whether the multichannel audio signals are synchronous or not directly influences the performance of the whole machine, and on the premise of inputting the same signals, the phase consistency and the amplitude consistency are ensured before the signals collected by the multichannel signals reach the processing of the processor algorithm. The detection of consistency in the hardware testing and production links is a necessary step for quality assurance.

A typical method for detecting the consistency of the audio channels of a microphone array is to input pulse signals or pure tone signals to a tested device, and to visually identify whether the phases of multiple output signals are consistent or not, or to use a phase meter capable of realizing quantitative detection. However, in the process of implementing the present invention, the inventors found that the above technical solutions all have at least the following problems: 1) The phase meter is used for detection, and higher detection accuracy, stability and efficiency can be ensured, but the detection cost is higher; 2) By manual visual inspection, the method cannot accurately detect, for example, under the condition of little phase difference, the eyes can not detect the phase difference; and the long-time stability detection cannot be performed, if a problem occurs at a certain moment in the one-hour test, the problem is determined; furthermore, manual detection is extremely time-consuming, especially in the case of a large number of channels.

In summary, how to combine lower detection cost with higher detection accuracy, stability and efficiency is an urgent problem for those skilled in the art.

Disclosure of Invention

The application provides a microphone array detection method, which solves the problems that the prior art cannot achieve lower detection cost and higher detection accuracy, stability and efficiency. The application further provides a microphone array detection device, a device detection method and device and an electronic device.

The application also provides a microphone array detection method, which comprises the following steps:

Aiming at two microphone channels of the tested equipment which are combined in pairs, performing first Hilbert transform on two audio signals output by the two channels to obtain a first timing signal; performing second Hilbert transform on the two audio signals to obtain a second time sequence signal; the conversion processing mode between the first Hilbert conversion and the second Hilbert conversion is opposite;

Determining whether the phases of the two audio signals are consistent according to whether the amplitudes of the first time sequence signal and the second time sequence signal are consistent;

And if the two channel audio signals combined in pairs are in phase coincidence, judging that the microphone arrays of the tested equipment are in phase coincidence.

For two microphone channels of the tested equipment in a pairwise combination mode, determining a first time sequence signal and a second time sequence signal according to two audio signals output by the two channels; wherein an amplitude difference between the first timing signal and the second timing signal corresponds to a phase difference of the two audio signals;

Optionally, the first timing signal includes an operation result of the timing signals with stable amplitudes of the two audio signals, and the second timing signal includes a timing signal with stable amplitudes of the operation result of the two audio signals.

Optionally, the second timing signal is determined in the following manner:

performing operation on the two audio signals to obtain a third time sequence signal;

transforming the third timing signal into a first complex signal;

Determining the second timing signal based on the real and imaginary parts of the first complex signal;

the first timing signal is determined as follows:

transforming the two audio signals into a second complex signal and a third complex signal;

Determining a fourth timing signal based on the real and imaginary parts of the second complex signal; and determining a fifth timing signal based on the real and imaginary parts of the third complex signal;

and performing operation on the fourth time sequence signal and the fifth time sequence signal to obtain a first time sequence signal.

Optionally, the converting the third timing signal into the first complex signal includes:

Performing 90-degree phase shift processing on the third time sequence signal, wherein the phase-shifted signal is a first complex signal;

the converting the two audio signals into a second complex signal and a third complex signal comprises:

a90 degree phase shift process is performed on the two audio signals, the phase shifted signals including a second complex signal and a third complex signal.

Optionally, the 90 degree phase shift process includes: hilbert transform;

said determining said second timing signal from real and imaginary parts of the first complex signal comprises:

and performing a normative processing on the first complex signal as the second timing signal.

Optionally, the operation includes: the two audio signals are summed.

Optionally, the method for judging whether the amplitudes of the first time sequence signal and the second time sequence signal are consistent is as follows:

if the statistical data of the amplitude differences of the first time sequence signal and the second time sequence signal at a plurality of moments is smaller than or equal to an amplitude difference threshold value, the amplitude consistency between the first time sequence signal and the second time sequence signal is judged.

Optionally, the statistical data includes:

the average value of the amplitude differences, the variance of the amplitude differences and the standard deviation of the amplitude differences.

Optionally, the method further comprises:

Determining a sixth time sequence signal and a seventh time sequence signal according to a plurality of audio signals output by a plurality of microphone channels of the tested equipment; wherein an amplitude difference between the sixth and seventh timing signals corresponds to a phase difference of the plurality of audio signals;

Judging whether the amplitude of the sixth time sequence signal is consistent with that of the seventh time sequence signal;

if the judgment result is negative, judging that the phases of the microphone arrays are inconsistent;

if the judgment result is yes, entering the two-channel microphone channels which are combined in pairs for the tested equipment, and determining a first time sequence signal and a second time sequence signal according to two audio signals output by the two channels.

Optionally, the sixth timing signal includes a timing signal with stable amplitude of the operation result of the plurality of audio signals, and the seventh timing signal includes an operation result of the timing signal with stable amplitude of the plurality of audio signals.

Optionally, the determining whether the sixth timing signal and the seventh timing signal are consistent in amplitude includes:

And if the statistical data of the amplitude differences of the sixth time sequence signal and the seventh time sequence signal at a plurality of moments is smaller than or equal to an amplitude difference threshold value, judging that the amplitudes of the sixth time sequence signal and the seventh time sequence signal are consistent.

Optionally, the method further comprises:

The analog electric signal output by the signal generator is used as an input signal of a microphone channel, and the audio signal output by the microphone channel is determined through the tested equipment.

Optionally, the analog electrical signal includes: the sine wave simulates an electrical signal.

Alternatively, the sine wave analog electric signals input by the plurality of times of detection are high-frequency signals which are mutually prime.

determining a first time sequence signal and a second time sequence signal according to a plurality of audio signals output by a plurality of microphone channels of the tested equipment; wherein the amplitude difference between the first timing signal and the second timing signal corresponds to the phase difference of the multi-channel output signal;

According to whether the amplitudes of the first time sequence signal and the second time sequence signal are consistent, whether the phases of the microphone channels are consistent is determined.

For two microphone channels of the tested equipment in a pairwise combination mode, determining a first time sequence signal and a second time sequence signal according to a first audio signal and a second audio signal output by the two channels; wherein the first timing signal includes a magnitude-stationary timing signal corresponding to the first audio signal, and the second timing signal includes a magnitude-stationary timing signal corresponding to the second audio signal;

if the statistical data of the amplitude differences of the first time sequence signal and the second time sequence signal at a plurality of moments is smaller than or equal to an amplitude difference threshold value, judging that the amplitudes of the two channels of audio signals are consistent;

And if the two-channel audio signals combined in pairs are consistent in amplitude, judging that the microphone arrays of the tested equipment are consistent in amplitude.

The application also provides a device detection method, which comprises the following steps:

Acquiring a first audio signal output by a microphone channel of the tested equipment and a second audio signal output by a stoping channel of the tested equipment;

Determining a first time sequence signal and a second time sequence signal according to the first audio signal and the second audio signal; wherein the amplitude difference between the first timing signal and the second timing signal corresponds to the phase difference of the two audio signals;

and determining whether the phases of the microphone channel and the stoping channel are consistent according to whether the amplitudes of the first time sequence signal and the second time sequence signal are consistent.

determining a first time sequence signal and a second time sequence signal according to the first audio signal and the second audio signal; wherein the first timing signal includes a magnitude-stationary timing signal corresponding to the first audio signal, and the second timing signal includes a magnitude-stationary timing signal corresponding to the second audio signal;

and if the statistical data of the amplitude differences of the first time sequence signal and the second time sequence signal at a plurality of moments is smaller than or equal to an amplitude difference threshold value, judging that the amplitudes of the microphone channel and the stoping channel are consistent.

The application also provides a microphone array detection device, which comprises:

the two-channel signal conversion unit is used for determining a first time sequence signal and a second time sequence signal according to two audio signals output by two channels aiming at two channels of microphone channels of the two-by-two combination of the tested equipment; wherein an amplitude difference between the first timing signal and the second timing signal corresponds to a phase difference of the two audio signals;

the two-channel amplitude consistency detection unit is used for determining whether the two audio signals are consistent in phase according to whether the first time sequence signal is consistent with the second time sequence signal in amplitude;

And the multi-channel detection result determining unit is used for determining that the phases of the microphone arrays of the tested equipment are consistent if the phases of the two-channel audio signals combined in pairs are consistent.

A multi-channel signal conversion unit for determining a first time sequence signal and a second time sequence signal according to a plurality of audio signals output by a plurality of microphone channels of the tested equipment; wherein the amplitude difference between the first timing signal and the second timing signal corresponds to the phase difference of the multi-channel output signal;

The multichannel amplitude consistency detection unit is used for determining whether the phases of the microphone channels are consistent according to whether the amplitudes of the first time sequence signal and the second time sequence signal are consistent.

The two-channel signal conversion unit is used for determining a first time sequence signal and a second time sequence signal according to a first audio signal and a second audio signal output by two channels for two-channel microphone channels combined in pairs of tested equipment; wherein the first timing signal includes a magnitude-stationary timing signal corresponding to the first audio signal, and the second timing signal includes a magnitude-stationary timing signal corresponding to the second audio signal;

The two-channel amplitude consistency detection unit is used for judging that the amplitudes of the two-channel audio signals are consistent if the statistical data of the amplitude differences of the first time sequence signal and the second time sequence signal at a plurality of moments is smaller than or equal to an amplitude difference threshold value;

And the multichannel detection result determining unit is used for determining that the microphone arrays of the tested equipment are consistent in amplitude if the two-channel audio signals combined in pairs are consistent in amplitude.

The application also provides a device detection apparatus, comprising:

The signal acquisition unit is used for acquiring a first audio signal output by a microphone channel of the tested equipment and a second audio signal output by a stoping channel of the tested equipment;

a signal conversion unit for determining a first timing signal and a second timing signal from the first audio signal and the second audio signal; wherein the amplitude difference between the first timing signal and the second timing signal corresponds to the phase difference of the two audio signals;

The phase consistency determining unit is used for determining whether the microphone channel is consistent with the stoping channel in phase according to whether the first time sequence signal is consistent with the second time sequence signal in amplitude.

The application also provides a device detection apparatus, comprising:

A signal conversion unit for determining a first timing signal and a second timing signal from the first audio signal and the second audio signal; wherein the first timing signal includes a magnitude-stationary timing signal corresponding to the first audio signal, and the second timing signal includes a magnitude-stationary timing signal corresponding to the second audio signal;

The amplitude consistency determining unit is used for determining that the amplitudes of the microphone channel and the stoping channel are consistent if the statistical data of the amplitude differences of the first time sequence signal and the second time sequence signal at a plurality of moments is smaller than or equal to an amplitude difference threshold value.

The present application also provides an electronic device including:

a processor and a memory;

A memory for storing a program for implementing the method according to any one of the preceding claims, the device being powered on and running the program of the method by the processor.

The application also provides an intelligent sound box, which comprises:

a processor and a memory;

The application also provides a user equipment comprising:

a processor and a memory;

The present application also provides a computer readable storage medium having instructions stored therein which, when run on a computer, cause the computer to perform the various methods described above.

The application also provides a computer program product comprising instructions which, when run on a computer, cause the computer to perform the various methods described above.

Compared with the prior art, the application has the following advantages:

According to the microphone array detection method provided by the embodiment of the application, two audio signals output by two channels are subjected to first Hilbert transformation aiming at the two-channel microphone channels combined by two of the tested equipment, so that a first time sequence signal is obtained; performing second Hilbert transform on the two audio signals to obtain a second time sequence signal; the conversion processing mode between the first Hilbert conversion and the second Hilbert conversion is opposite; determining whether the phases of the two audio signals are consistent according to whether the amplitudes of the first time sequence signal and the second time sequence signal are consistent; if the two-channel audio signals combined in pairs are identical in phase, judging that the microphone arrays of the tested equipment are identical in phase; the processing mode is that the Hilbert transformation is utilized to convert the detection of the phase into the relatively simple amplitude detection, and the consistency of the phase of the original signal is judged based on the relation of the amplitude of the analysis signal after the Hilbert transformation; therefore, the detection cost can be effectively reduced, and higher detection accuracy, stability and efficiency are ensured.

According to the microphone array detection method provided by the embodiment of the application, the first time sequence signal and the second time sequence signal are determined according to two audio signals output by two channels by aiming at two channels of microphone channels combined by two of tested equipment; wherein an amplitude difference between the first timing signal and the second timing signal corresponds to a phase difference of the two audio signals; determining whether the phases of the two audio signals are consistent according to whether the amplitudes of the first time sequence signal and the second time sequence signal are consistent; if the two-channel audio signals combined in pairs are identical in phase, judging that the microphone arrays of the tested equipment are identical in phase; the processing mode is that the detection of the phase of the microphone channels is converted into relatively simple amplitude detection by using signal conversion processing, and the consistency of the phases of the original signals output by the two paths of microphone channels is judged based on the relation of the amplitudes of the analysis signals by using the converted analysis signals; therefore, the detection cost can be effectively reduced, and higher detection accuracy, stability and efficiency are ensured.

According to the microphone array detection method provided by the embodiment of the application, the first time sequence signal and the second time sequence signal are determined according to a plurality of audio signals output by a plurality of microphone channels of the tested equipment; wherein the amplitude difference between the first timing signal and the second timing signal corresponds to the phase difference of the multi-channel output signal; determining whether the phases of the microphone channels are consistent according to whether the amplitudes of the first time sequence signal and the second time sequence signal are consistent; the processing mode is that the detection of the phase of the microphone channel is converted into relatively simple amplitude detection by using signal conversion processing, and the consistency of the phase of the original signal output by the multi-channel microphone channel is judged based on the relation of the amplitude of the analysis signal by using the converted analysis signal; therefore, the detection cost can be effectively reduced, and higher detection accuracy, stability and efficiency are ensured. In addition, the method directly detects the multiple paths of microphone channels, rather than detecting the two paths of microphone channels combined in pairs, so that the detection efficiency of the processing mode is higher than that of the method.

According to the microphone array detection method provided by the embodiment of the application, the first time sequence signal and the second time sequence signal are determined according to the first audio signal and the second audio signal output by the two channels by aiming at the two-channel microphone channels of the two-by-two combination of the tested equipment; wherein the first timing signal includes a magnitude-stationary timing signal corresponding to the first audio signal, and the second timing signal includes a magnitude-stationary timing signal corresponding to the second audio signal; if the statistical data of the amplitude differences of the first time sequence signal and the second time sequence signal at a plurality of moments is smaller than or equal to an amplitude difference threshold value, judging that the amplitudes of the two channels of audio signals are consistent; if the two-channel audio signals combined in pairs are consistent in amplitude, judging that the microphone arrays of the tested equipment are consistent in amplitude; the processing mode is that the original audio signals output by the microphone channels are converted into time sequence signals with stable amplitude by utilizing signal conversion processing, the converted time sequence signals with stable amplitude are used as analysis signals, and the consistency of the amplitudes of the original signals output by the two paths of microphone channels is judged based on the relation of the amplitudes of the analysis signals; therefore, the detection cost can be effectively reduced, and higher detection accuracy, stability and efficiency are ensured.

According to the device detection method provided by the embodiment of the application, the first audio signal which is output by the microphone channel of the tested device and comprises the first user voice and the second user voice echo is obtained, and the second audio signal which is output by the extraction channel of the tested device and comprises the second user voice is obtained; determining a first time sequence signal and a second time sequence signal according to the first audio signal and the second audio signal; wherein the amplitude difference between the first timing signal and the second timing signal corresponds to the phase difference of the two audio signals; determining whether the phases of the microphone channel and the stoping channel are consistent according to whether the amplitudes of the first time sequence signal and the second time sequence signal are consistent; the processing mode is that the detection of the phases of the microphone signal and the stope signal is converted into relatively simple amplitude detection by using signal conversion processing, and the consistency of the phases between the stope signal and the microphone signal is judged based on the relation of the amplitudes of the analytic signals after conversion; therefore, the detection cost can be effectively reduced, and higher detection accuracy, stability and efficiency are ensured.

According to the equipment detection method provided by the embodiment of the application, the first audio signal output by the microphone channel of the equipment to be detected and the second audio signal output by the stoping channel of the equipment to be detected are obtained; determining a first time sequence signal and a second time sequence signal according to the first audio signal and the second audio signal; wherein the first timing signal includes a magnitude-stationary timing signal corresponding to the first audio signal, and the second timing signal includes a magnitude-stationary timing signal corresponding to the second audio signal; if the statistical data of the amplitude differences of the first time sequence signal and the second time sequence signal at a plurality of moments is smaller than or equal to an amplitude difference threshold value, judging that the amplitudes of the microphone channel and the stoping channel are consistent; the processing mode is that the audio signals output by the microphone channel and the extraction channel are converted into time sequence signals with stable amplitude by utilizing signal conversion processing, the converted time sequence signals with stable amplitude are used as analysis signals, and the consistency of the amplitude between the extraction signals and the microphone signals is judged based on the relation of the amplitude of the analysis signals; therefore, the detection cost can be effectively reduced, and higher detection accuracy, stability and efficiency are ensured.

Drawings

Fig. 1 is a schematic diagram of an application scenario of an embodiment of a microphone array detection method provided by the present application;

FIG. 2 is a schematic flow chart of an embodiment of a method for detecting a microphone array according to the present application;

FIG. 3a is a schematic diagram of test signals of an embodiment of a method for detecting a microphone array according to the present application;

FIG. 3b is an enlarged view of test signals of an embodiment of a method for detecting a microphone array according to the present application;

FIG. 3c is a schematic diagram of a time sequence signal with stable amplitude according to an embodiment of a method for detecting a microphone array according to the present application;

FIG. 4 is a schematic diagram illustrating signal processing of an embodiment of a method for detecting a microphone array according to the present application;

FIG. 5 is a schematic diagram showing a comparison between a first timing signal and a second timing signal according to an embodiment of a method for detecting a microphone array according to the present application;

FIG. 6 is a schematic diagram of a specific flow chart of an embodiment of a method for detecting a microphone array according to the present application;

FIG. 7 is a schematic diagram illustrating another signal processing of an embodiment of a method for detecting a microphone array according to the present application;

FIG. 8 is a schematic flow chart of an embodiment of a method for detecting a microphone array according to the present application;

FIG. 9 is a schematic flow chart of an embodiment of a method for detecting a microphone array according to the present application;

FIG. 10 is a schematic diagram illustrating signal processing of an embodiment of a method for detecting a microphone array according to the present application;

fig. 11 is a schematic view of an application scenario of an embodiment of a device detection method provided by the present application;

FIG. 12 is a schematic flow chart diagram of an embodiment of a device detection method provided by the present application;

fig. 13 is a schematic flow chart of an embodiment of a device detection method according to the present application.

Detailed Description

In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present application. The present application may be embodied in many other forms than those herein described, and those skilled in the art will readily appreciate that the present application may be similarly embodied without departing from the spirit or essential characteristics thereof, and therefore the present application is not limited to the specific embodiments disclosed below.

The application provides a microphone array detection method and device, a device detection method and device and an electronic device. The various schemes are described in detail one by one in the examples below.

In order to more intuitively describe the method, a brief description of an application scenario of the method is provided below. Fig. 1 is a schematic diagram of an application scenario of an embodiment of a microphone array detection method of the present application. In this embodiment, the device under test is an audio hardware system "intelligent speaker" with multiple microphones, and the microphone array of the device under test is detected by the microphone array detection device. When the detection device is used for detecting the phase consistency of the microphone array of the tested equipment, the microphones can be taken down at the positions of the microphones in the figure, so that the tested equipment is not connected with the microphones, and the same test signals such as sine wave signals, cosine wave signals, pulse signals or pure tone signals are input at the original microphones through the signal generator. Then, the audio signals output by the microphone channels can be recorded for a long time (such as half an hour) by using a signal acquisition tool, so as to obtain the audio signals output by the channels, such as the audio signals 1 to n in fig. 1. Next, the audio signals 1 to n are input to the detection means, which outputs a phase coincidence detection result, such as coincidence or non-coincidence of phases. The phase coincidence may be the same phase or a fixed phase difference.

In one example, the tested device is a dual-microphone audio hardware system, the same test signals are input at the original two microphones, audio signals output by the two microphone channels are recorded, and the audio signals output by the two channels are obtained through the dual-channel audio hardware system to be tested and respectively stored as two files of File1.wav and File2.wav. And then inputting the file1.Wav and the file2.Wav into the detection device, detecting the microphone array phase consistency of the audio hardware system of the double microphones through the detection device, and outputting a detection result.

First embodiment

Fig. 2 is a flow chart of a microphone array detection method according to an embodiment of the application. The method is performed by a main body comprising a microphone array detection device. In this embodiment, the method may include the steps of:

step S101: for two microphone channels of the tested equipment in a pairwise combination mode, a first time sequence signal and a second time sequence signal are determined according to two audio signals output by the two channels.

The device under test refers to a device having a Microphone Array (Microphone Array), including but not limited to: audio hardware systems such as intelligent sound boxes. A microphone is an energy conversion device that converts sound signals into electrical signals. A microphone array is a system consisting of a number of microphones that are used to sample and process the spatial characteristics of a sound field.

The microphone channel, which is an analog to digital signal path, may include the microphone itself, analog circuitry interfacing the microphone, an analog to digital converter (ADC), and the like.

As shown in fig. 1, the method performs two-by-two combination on multi-channel output signals of the tested device, and performs phase consistency detection processing on the output signals of two microphone channels combined two by two. If the phases of the two-channel audio signals combined in pairs are detected to be consistent, the phases of the multi-channel audio signals of the tested device can be judged to be consistent. For example, the intelligent sound box is provided with 8 microphones, and the phase consistency detection of two channels is respectively carried out on the channel 1, the channel 2, the channel 3, the channel 4, the channel 5, the channel 6, the channel 7 and the channel 8, and the channel 2, the channel 3, the channel 4, the channel 5, the channel 6 and the channel 7, and if the detection results of the two channels are the same in phase or fixed in phase difference, the phase of the multi-channel audio signals of the tested device is judged to be the same in phase or fixed in phase difference. The amplitudes are consistent, and the amplitudes can be the same or the amplitude difference is fixed; the phases are identical, may be the same, the phase difference may be fixed.

In one example, the method further comprises the steps of: the analog electric signals output by the signal generator are used as input signals of two paths of microphone channels, and two paths of output signals are determined through tested equipment. For example, a sine wave analog electrical signal is used as an input signal to a circuit to which the microphone is connected.

In the specific implementation, the sine wave analog electric signals input by multiple detection are set as high-frequency signals which are mutually prime. For example, the sampling frequency fs=48 kHz, and the frequency of the input signal of the circuit to which the microphone is connected may be selected to be a high-frequency signal of which the signal is prime to each other, such as 11kHz,17kHz,20kHz, etc., so that information repetition can be avoided.

The amplitude difference between the first timing signal and the second timing signal corresponds to the phase difference of the two audio signals. The correspondence includes: the phase difference is zero, and the amplitude difference is zero; the larger the phase difference is, the larger the amplitude difference is; the smaller the phase difference, the smaller the amplitude difference. Thus, based on the amplitude consistency between the first time sequence signal and the second time sequence signal, the phase consistency between the two microphone channels can be determined. That is, the amplitude difference may reflect the phase difference of the two microphone channels.

The first timing signal includes, but is not limited to, an operation result of the amplitude-smoothed timing signal of the two audio signals, and the second timing signal includes, but is not limited to, an amplitude-smoothed timing signal of an operation result of the two audio signals. The audio signal output by the microphone channel is usually a time sequence signal with amplitude variation, such as a sine wave signal, the amplitude value of which has wave peaks and wave troughs, and the amplitude of the time sequence signal with stable amplitude is stable at different moments, and the amplitude value is the same or only slightly changed without larger amplitude variation.

In one example, the input signal of the microphone channel is a cosine signal 0.1×cos (2×pi×1000×t) at 1khz, and after the signal is processed by the microphone channel with the sampling rate fs of 48000, an audio signal output by the microphone channel as shown in fig. 3a is obtained, where the audio signal is a discrete signal of the cosine signal 0.1×cos (2×pi×1000×t), and the signal is a real signal. Since the sampling rate is 48khz and the frequency of the input signal is 1khz, one period is 48 sampling points, and fig. 3b shows the magnifying observation effect of fig. 3 a. As shown in fig. 3c, the audio signal output by the microphone channel is subjected to hilbert transform and the signal after L2 norm is obtained, and by comparing the waveforms in fig. 3b, it can be seen that the signal shown in fig. 3c is a time sequence signal with stable amplitude.

In this embodiment, the second timing signal may be determined as follows: performing operation on the two audio signals to obtain a third time sequence signal; transforming the third timing signal into a first complex signal; determining the second timing signal based on the real and imaginary parts of the first complex signal; accordingly, the first timing signal may be determined as follows: transforming the two audio signals into a second complex signal and a third complex signal; determining a fourth timing signal based on the real and imaginary parts of the second complex signal; and determining a fifth timing signal based on the real and imaginary parts of the third complex signal; and performing operation on the fourth time sequence signal and the fifth time sequence signal to obtain a first time sequence signal.

The operations include, but are not limited to: summing the two audio signals may be performed by, for example, differencing the two audio signals. In this embodiment, the operation is summing two audio signals; correspondingly, the first time sequence signal is a time sequence signal obtained by summing the time sequence signals with stable amplitudes of the two audio signals, and the second time sequence signal is a time sequence signal with stable amplitudes of the time sequence signals after summing the two audio signals.

The third timing signal is a real signal. In this embodiment, the third timing signal is a real signal obtained by summing the audio signals output by the two channels. The second timing signal may be determined by transforming the third timing signal into the first complex signal and based on the real and imaginary parts of the first complex signal.

In the implementation, to convert the third timing signal into the first complex signal, the following manner may be adopted: and performing 90-degree phase shift processing on the third time sequence signal, wherein the phase-shifted signal is a first complex signal, and the 90-degree phase shift processing can be realized through Hilbert transformation. The determining the second timing signal according to the real part and the imaginary part of the first complex signal may be implemented in the following manner: a norming process is performed on the first complex signal as the second timing signal, such as summing the real and imaginary squares of the first complex signal, root-ing the sum of squares, and the like. Common normative processing includes L-1 norms and L-2 norms.

Similarly, the conversion of the two audio signals into the second complex signal and the third complex signal may be implemented as follows: the 90-degree phase shift processing is performed on the two audio signals, respectively, and the phase-shifted signals include a second complex signal and a third complex signal. Correspondingly, the fourth time sequence signal and the fifth time sequence signal can be obtained by respectively executing the norming processing on the second complex signal and the third complex signal. The fourth time sequence signal and the fifth time sequence signal are time sequence signals with stable amplitude, and the first time sequence signal can be obtained by summing the two time sequence signals.

The audio signal output by the microphone channel is a real signal s (t) (real function), and the Hilbert transform (Hilbert transform) of a real function is to convolve the signal s (t) with 1/(pi t) to obtain s' (t). Thus, the Hilbert transform result s' (t) can be regarded as the output of a linear time-invariant system (LINEAR TIME INVARIANT SYSTEM) whose input is s (t), and whose impulse response is 1/(pi t). Therefore, the hilbert transformed signal is a complex signal, and the transformed signal is consistent with the time sequence length of the microphone channel output signal.

The physical meaning of the hilbert transform is to delay the phase of all frequency components of the signal by 90 degrees, the characteristic that the hilbert transform has a phase shift of 90 degrees on the signal is utilized in the embodiment, and then the real part and the imaginary part of an analysis signal obtained after the hilbert transform are exactly 90 degrees out of phase for a test signal of a standard sine wave through mathematical operation, so that a time sequence signal with relatively stable amplitude can be obtained for such a complex signal ranging, the stable amplitude can exactly reflect the amplitude of the original sine wave, and the amplitude of the sine signal can be described by the hilbert transform ranging. For a sine wave test signal of two channels, if the signals output by the two channels are completely synchronous, the amplitude relationship after summation of the two output signals is equal to the sum of the amplitude relationships of the respective signals, and if the two output signals are not synchronous, the amplitude after summation of the two output signals is no longer the sum of the amplitudes of the two output signals.

In this embodiment, in step S101, the original audio signals output by the two microphone channels are subjected to hilbert transformation to obtain analysis signals after hilbert transformation, namely, a second complex signal and a third complex signal, and then the two complex signals are respectively subjected to L-2 norms to obtain a fourth time sequence signal and a fifth time sequence signal, and the summation signals of the two time sequence signals are the first time sequence signal. Meanwhile, the summation operation is carried out on the original audio signals output by the two paths of microphone channels, so as to obtain a third time sequence signal; then, the analysis signal after the Hilbert transformation, namely the first complex signal, is obtained by carrying out the Hilbert transformation on the third time sequence signal, and then the L-2 norm is taken for the first complex signal, so as to obtain the second time sequence signal.

Fig. 4 is a schematic diagram illustrating signal processing according to an embodiment of the microphone array detection method of the present application. In the present embodiment, the file file1.Wav is represented by the time domain signal s_1, and the file file2.Wav is represented by s_2, respectively. As can be seen from fig. 4, the specific flow of step S101 is as follows:

1) The hilbert transform is performed on s_1 and s_2, respectively, to obtain a corresponding analysis signal (ANALYTICAL SIGNAL), which is the second complex signal a ₁ and the third complex signal a ₂.A₁、A₂, and s_1 and s_2, respectively, with the same time sequence length, but a ₁、A₂ will be the complex signal.

A₁＝HilbertTransform(S₁)；

A₂＝HilbertTransform(S₂)；

2) L-2 norms are calculated for A ₁、A₂ and summed to obtain a first timing signal Pattern_1 as a first test reference signal

Pattern₁＝‖A₁‖₂+‖A₂‖₂

3) After summing the S_1 and S_2 time domains, performing Hilbert transform to obtain corresponding analysis signals, which are first complex signals Asum

A_sum＝HilbertTransform(S₁+S₂)；

4) Then, the A _sum is subjected to L-2 norm to obtain a second time sequence signal Pattern_2 as a second test reference signal

Pattern₂＝‖A_sum‖₂

As can be seen from fig. 4, the first timing signal is determined in the opposite manner to the second timing signal. The first time sequence signal is determined by performing Hilbert transformation and then summing, and the second time sequence signal is determined by performing Hilbert transformation after summing.

After obtaining two analysis signals (a first time sequence signal and a second time sequence signal), the next step can be carried out, and the consistency of the phases of the audio signals output by the two channels is judged based on the relation of the amplitudes of the analysis signals by using the two analysis signals.

Step S103: and determining whether the two audio signals are consistent in phase according to whether the first time sequence signal is consistent with the second time sequence signal in amplitude.

The first time sequence signal and the second time sequence signal are obtained by adopting two Hilbert transformation modes with opposite processing sequences, and the inventor of the application discovers that if the amplitude difference between the two signals is large, the two signals represent that the phases of the original signals of the two channels are inconsistent; if the amplitude difference between the two signals is small, the phase difference between the two original signals of the two channels is fixed; if the two signals are identical in amplitude, it means that the two channel signals are identical in phase. In general, the phase is considered to be the same for both cases where the phase difference is fixed and where the phase is the same.

As shown in fig. 5, if the phases of two audio channels are not identical, it is assumed that one of the audio signals output from one of the channels and the audio signal output from the other channel drift by one sample, and the two audio signals are expressed mathematically as follows: sj1=0.1×cos (2×pi×1000×t), sj2= [0, x1 (1: dot number-1) ], then the first timing signal and the second timing signal determined from the two audio signals cannot be aligned. If the two audio signals are in phase, the first timing signal and the second timing signal will be coincident. Therefore, the method provided by the embodiment of the application is to change the phase detection problem into an amplitude detection problem.

In one example, step S103 may be implemented as follows: if the statistical data of the amplitude differences of the first time sequence signal and the second time sequence signal at a plurality of moments is smaller than or equal to an amplitude difference threshold value, the amplitude consistency between the first time sequence signal and the second time sequence signal is judged. The amplitude difference threshold value can be determined according to application requirements. The statistics include, but are not limited to: average value of amplitude differences, variance of amplitude differences, standard deviation of amplitude differences.

As shown in fig. 4, the method provided in the embodiment of the present application makes a comparison decision based on the first timing signal and the second timing signal obtained in step S101. In specific implementation, the first timing signal and the second timing signal may be subtracted to obtain a difference signal (timing sequence) between the first timing signal and the second timing signal:

bias＝Pattern₁-Pattern₂

in general theory, if there is no phase difference between the two microphone channel output signals of the tested device, pattern_1 and pattern_2 are substantially identical, bias (n) =0, n∈any time. However, in practice, bias is not exactly zero, but rather a sequence of very small values, such as (0.2 at time t ₁, 0.19 at time t ₂, … at time t _n-1, 0.21 at time t _n, 0.18), i.e., the phase difference is relatively fixed. Based on this theory, the statistical data may be an average value of the time series, a variance of the time series, a standard deviation of the time series, or the like.

The timing sequence bias includes amplitude differences between the first timing signal and the second timing signal at a plurality of times. For this timing sequence, the idea is to change the timing sequence to a value. In practice, each member of the time series bias may be firstly subjected to a range-finding, and the range-finding sequence may be obtained by taking absolute value abs (bias) or absolute value square abs (bias)/(2). For such a pattern sequence, a value may be obtained by determining a moment (motion), a first moment (average value), a second moment (variance/standard deviation), or a higher moment, and then comparing the value with a set empirical value (threshold value), and the phases are not identical when the value is greater than or equal to the empirical value, and the phases are identical when the value is less than the empirical value.

In one example, step S203 includes, but is not limited to, the following decision method:

a) Averaging the sequence bias, setting an average threshold thd_1

As can be seen from the formula, if the average value of the amplitude differences of the first time sequence signal and the second time sequence signal at a plurality of moments is smaller than the average value threshold value, the phases of the two channels are judged to be consistent; if the average value of the amplitude differences of the first time sequence signal and the second time sequence signal at a plurality of moments is larger than or equal to an average value threshold value, the phase disagreement of the two channels is judged.

B) For time sequence bias, variance or standard deviation is calculated, and a variance or standard deviation threshold value thd_2 is set

Or:

as can be seen from the formula, if the variance or standard deviation of the amplitude differences of the first time sequence signal and the second time sequence signal at a plurality of moments is smaller than the variance or standard deviation threshold, the phases of the two channels are judged to be consistent; and if the variance or standard deviation of the amplitude differences of the first time sequence signal and the second time sequence signal at a plurality of moments is larger than or equal to the variance or standard deviation threshold, judging that the phases of the two channels are inconsistent.

C) Set a thd_3

As can be seen from the formula, if the average value of the amplitude ratios of the first time sequence signal and the second time sequence signal at a plurality of moments is smaller than a logarithmic threshold value, the phases of the two channels are judged to be consistent; if the average value of the amplitude difference ratio of the first time sequence signal and the second time sequence signal at a plurality of moments is larger than or equal to a logarithmic threshold value, the two channels are judged to be inconsistent in phase.

Step S105: and if the two channel audio signals combined in pairs are in phase coincidence, judging that the microphone arrays of the tested equipment are in phase coincidence.

After phase consistency detection is carried out on the two-channel audio signals of the two-by-two combination of the tested equipment, if the two-channel audio signal detection results based on the two-by-two combination can determine that any two-channel audio signals of the tested equipment are in phase consistency, the phase consistency of the multi-channel audio signals of the tested equipment, namely the phase consistency of the microphone array, is determined.

For example, the intelligent sound box is provided with 8 microphones, and phase consistency detection is performed on the channel 1, the channel 2, the channel 3, the channel 4, the channel 5, the channel 6, the channel 7 and the channel 8, and the channel 2, the channel 3, the channel 4, the channel 5, the channel 6 and the channel 7 respectively, and if the detection results of the two channels are all in phase consistency, any two channels of audio signals of the tested device are all in phase consistency.

However, it has been found through experiments that the above-described processing methods of steps S101 to S105 have a problem of large detection amount and low detection efficiency.

Fig. 6 is a schematic flow chart of a microphone array detection method according to an embodiment of the application. To solve the above problem of low detection efficiency, in one example, before step S01, the method may further include the following steps:

step S601: and determining a sixth time sequence signal and a seventh time sequence signal according to a plurality of audio signals output by a plurality of microphone channels of the tested equipment.

The amplitude difference between the sixth and seventh timing signals corresponds to the phase difference of the plurality of audio signals, that is, the amplitude difference may reflect the phase difference of the plurality of microphone channels. The sixth timing signal includes a timing signal having a stable amplitude of the operation result of the plurality of audio signals, and the seventh timing signal includes an operation result of the timing signal having a stable amplitude of the plurality of audio signals. Since the sixth and seventh timing signals are similar to the first and second timing signals, they are not described herein.

Step S603: and judging whether the sixth time sequence signal and the seventh time sequence signal are consistent in amplitude.

Step S605: if the judgment result is negative, judging that the phases of the microphone arrays are inconsistent, and stopping detection, and executing step S101 and subsequent steps no longer, and detecting the phase consistency of two paths of microphone channels of the tested equipment in a pairwise combination mode; if the determination result is yes, the process proceeds to step S101.

In one example, step S603 may be implemented as follows: if the difference value of the amplitude statistical data of the sixth time sequence signal and the seventh time sequence signal is larger than or equal to the amplitude difference threshold value, the phase disagreement between the sixth time sequence signal and the seventh time sequence signal is judged.

Fig. 7 is a schematic diagram illustrating another signal processing method according to an embodiment of the application. In the present embodiment, the audio files file1.wav, file2.wav, … …, filem.wav of the multi-channel output are represented by the time domain signals s_1, s_2, … …, s_m, respectively. The phase consistency detection flow is as follows:

1) The Hilbert transform is performed on S_1 and S_ … … S_M to obtain corresponding analysis signals (ANALYTICAL SIGNAL) A ₁,A₂,……,A_M.

2) L-2 norms are calculated for A ₁,A₂ and summed to obtain a sixth timing signal Pattern_3 as a third test reference signal

Pattern₃＝‖A₁‖₂+‖A₂‖₂+…+‖A_M‖₂

3) And performing Hilbert transform on the S_1 and S_2 time domain alignment to obtain corresponding analysis signals:

A_sum＝HilbertTransform(S₁+S₂+…+S_M)；

4) Then, the A _sum is subjected to L-2 norm to obtain a seventh time sequence signal Pattern_4 as a fourth test reference signal

Pattern₄＝‖A_sum‖₂

5) Finally, comparing and judging based on the two calculated test reference signals Pattern_3 and Pattern_4, and firstly subtracting Pattern ₃ from Pattern ₂ to obtain the following signals

In general theory, if there is no phase difference in the hardware system, pattern_3 and pattern_4 are substantially identical, bias (n) =0, n∈any time. In practice, however, bias is not exactly equal to zero, but a sequence of very small values. Based on this theory, including but not limited to the following decision methods:

a) Averaging the time series bias, setting a threshold value thd_1

B) For the time sequence bias, a threshold value thd_2 is set

Or:

c) Set a thd_3

According to the method provided by the embodiment of the application, through executing the steps S601 to S605, whether the phases of the multi-channel output signals of the tested equipment are inconsistent or not can be detected by the multi-channel integrated audio signal phase consistency detection unit, and if the phases are inconsistent, the steps S101 to S105, which are processing steps for detecting the phase consistency of the two-channel audio signals, are not needed to be executed, and whether the phases of the tested equipment are consistent or not is detected. If the phase coincidence is determined in this way, steps S101 to S105 are further performed, and more accurate phase coincidence detection is performed. The detection mode of the multi-channel integration is simpler and more convenient, the detection speed is higher, and the detection speed of the detection mode of the two channels is slower, so that the detection speed of the phase inconsistency can be effectively improved.

As can be seen from the above embodiments, in the microphone array detection method provided by the embodiment of the present application, by two microphone channels combined two by two for a device under test, a first timing signal and a second timing signal are determined according to two audio signals output by the two channels; wherein an amplitude difference between the first timing signal and the second timing signal corresponds to a phase difference of the two audio signals; determining whether the phases of the two audio signals are consistent according to whether the amplitudes of the first time sequence signal and the second time sequence signal are consistent; if the two-channel audio signals combined in pairs are identical in phase, judging that the microphone arrays of the tested equipment are identical in phase; the processing mode is that the detection of the phase of the microphone channels is converted into relatively simple amplitude detection by using signal conversion processing, and the consistency of the phases of the original signals output by the two paths of microphone channels is judged based on the relation of the amplitudes of the analysis signals by using the converted analysis signals; therefore, the detection cost can be effectively reduced, and higher detection accuracy, stability and efficiency are ensured.

Second embodiment

In the above embodiment, a microphone array detection method is provided, and correspondingly, the application also provides a microphone array detection device. The device corresponds to the embodiment of the method described above. Since the apparatus embodiments are substantially similar to the method embodiments, the description is relatively simple, and reference is made to the description of the method embodiments for relevant points. The device embodiments described below are merely illustrative.

The present application further provides a microphone array detection apparatus including:

Third embodiment

In the above embodiment, a method for detecting a microphone array is provided, and correspondingly, the application also provides an electronic device. The device corresponds to the embodiment of the method described above. Since the apparatus embodiments are substantially similar to the method embodiments, the description is relatively simple, and reference is made to the description of the method embodiments for relevant points. The device embodiments described below are merely illustrative.

An electronic device of the present embodiment includes: a processor and a memory; a memory for storing a program for realizing the method for detecting the microphone array, the device being powered on and executing the program for the method by the processor, and performing the steps of: for two microphone channels of the tested equipment in a pairwise combination mode, determining a first time sequence signal and a second time sequence signal according to two audio signals output by the two channels; wherein an amplitude difference between the first timing signal and the second timing signal corresponds to a phase difference of the two audio signals; determining whether the phases of the two audio signals are consistent according to whether the amplitudes of the first time sequence signal and the second time sequence signal are consistent; and if the two channel audio signals combined in pairs are in phase coincidence, judging that the microphone arrays of the tested equipment are in phase coincidence.

Fourth embodiment

Corresponding to the microphone array detection method, the application also provides a microphone array detection method. The same parts of the present embodiment as those of the first embodiment will not be described again, please refer to the corresponding parts in the first embodiment.

Fig. 8 is a flow chart of a microphone array detection method according to an embodiment of the application. In this embodiment, the method may include the steps of:

step S801: and determining a first time sequence signal and a second time sequence signal according to a plurality of audio signals output by a plurality of microphone channels of the tested equipment.

Wherein an amplitude difference between the first timing signal and the second timing signal corresponds to a phase difference of the plurality of audio signals. That is, the amplitude difference may reflect the phase differences of the multiple microphone channels. The first timing signal includes a timing signal with stable amplitude of the operation result of the plurality of audio signals, and the second timing signal includes an operation result of the timing signal with stable amplitude of the plurality of audio signals. Since the first timing signal and the second timing signal are similar to the sixth timing signal and the seventh timing signal in the first embodiment, the details are not repeated here.

Step S803: according to whether the amplitudes of the first time sequence signal and the second time sequence signal are consistent, whether the phases of the microphone channels are consistent is determined.

In this embodiment, if the first timing signal and the second timing signal are identical in amplitude, it may be determined that the plurality of microphone channels are identical in phase; if the first and second timing signals are not of uniform amplitude, then a plurality of microphone channel phase inconsistencies may be determined.

In the implementation, if the statistical data of the amplitude differences of the first time sequence signal and the second time sequence signal at a plurality of moments is smaller than or equal to the amplitude difference threshold value, the amplitude consistency between the first time sequence signal and the second time sequence signal is judged.

The signal processing procedure of the present embodiment is the same as that of fig. 7 in the first embodiment, and the description of the signal processing procedure is given in the first embodiment, which is not repeated here.

As can be seen from the above embodiments, in the microphone array detection method provided by the embodiments of the present application, the first timing signal and the second timing signal are determined according to a plurality of audio signals output by a plurality of microphone channels of the device under test; wherein the amplitude difference between the first timing signal and the second timing signal corresponds to the phase difference of the multi-channel output signal; determining whether the phases of the microphone channels are consistent according to whether the amplitudes of the first time sequence signal and the second time sequence signal are consistent; the processing mode is that the detection of the phase of the microphone channel is converted into relatively simple amplitude detection by using signal conversion processing, and the consistency of the phase of the original signal output by the multi-channel microphone channel is judged based on the relation of the amplitude of the analysis signal by using the converted analysis signal; therefore, the detection cost can be effectively reduced, and higher detection accuracy, stability and efficiency are ensured. In addition, since the method directly detects multiple microphone channels, rather than detecting two microphone channels combined two by two multiple times, the detection efficiency of this processing method is higher than that of the method provided in the first embodiment.

Fifth embodiment

Sixth embodiment

An electronic device of the present embodiment includes: a processor and a memory; a memory for storing a program for realizing the method for detecting the microphone array, the device being powered on and executing the program for the method by the processor, and performing the steps of: determining a first time sequence signal and a second time sequence signal according to a plurality of audio signals output by a plurality of microphone channels of the tested equipment; wherein the amplitude difference between the first timing signal and the second timing signal corresponds to the phase difference of the multi-channel output signal; according to whether the amplitudes of the first time sequence signal and the second time sequence signal are consistent, whether the phases of the microphone channels are consistent is determined.

Seventh embodiment

Fig. 9 is a flow chart of a microphone array detection method according to an embodiment of the application. In this embodiment, the method may include the steps of:

Step S901: for two microphone channels of the tested device which are combined in pairs, a first time sequence signal and a second time sequence signal are determined according to a first audio signal and a second audio signal which are output by the two channels.

Wherein the first timing signal includes a magnitude-stationary timing signal corresponding to the first audio signal, and the second timing signal includes a magnitude-stationary timing signal corresponding to the second audio signal. The audio signal output by the microphone channel is usually a time sequence signal with amplitude variation, such as a sine wave signal, the amplitude value of which has wave peaks and wave troughs, and the amplitude of the time sequence signal with stable amplitude is stable at different moments, and the amplitude value is the same or only slightly changed without larger amplitude variation.

In the present embodiment, the timing signal of which the amplitude corresponding to one audio signal is stationary can be determined as follows: converting the audio signal into a complex signal; a timing signal having a stationary amplitude is determined based on the real and imaginary parts of the complex signal.

In the implementation, the audio signal is converted into a complex signal, which can be realized in the following manner: the 90-degree phase shift processing is performed on the audio signal, and the phase-shifted signal is a complex signal, for example, the 90-degree phase shift processing can be realized by Hilbert transform. The determination of the timing signal with stable amplitude according to the real part and the imaginary part of the complex signal can be realized in the following way: the complex signal is subjected to a norm taking process to obtain a timing signal with stable amplitude, such as summing the real square and imaginary square of the complex signal, root-marking the sum of squares, and so on. Common normative processing includes L-1 norms and L-2 norms.

In this embodiment, by using the characteristic that the hilbert transform has a 90 degree phase shift on the signal, for a test signal of a standard sine wave, the real part and the imaginary part of an analysis signal (complex signal) obtained after the hilbert transform are exactly 90 degrees phase-different, so that for such a complex signal, a timing signal with a relatively stable amplitude can be obtained, the stable amplitude exactly reflects the amplitude of the original sine wave, and the hilbert transform norms can describe the amplitude of a sine signal in time sequence.

Fig. 10 is a schematic diagram illustrating signal processing according to an embodiment of the microphone array detection method of the present application. In this embodiment, the time domain signal s_1 is used to represent the first audio signal output by one microphone channel, and the first audio signal is stored in file1. Wav; the second audio signal, which is output by the other microphone channel, is denoted s_2 and is stored in file file2. Wav. As can be seen from fig. 10, the specific flow of step S901 is as follows:

1) The hilbert transform is performed on s_1 and s_2 to obtain corresponding analysis signals (ANALYTICAL SIGNAL), respectively, for the first complex signal a ₁ and the second complex signal a ₂.A₁、A₂ and s_1, where the timing lengths of s_2 are identical, but a ₁、A₂ will be the complex signal.

2) L-2 norms are calculated for A ₁、A₂ to obtain a first timing signal Pattern_1 as a first test reference signal and a second timing signal Pattern_2 as a second test reference signal.

Step S903: if the statistical data of the amplitude differences of the first time sequence signal and the second time sequence signal at a plurality of moments is smaller than or equal to an amplitude difference threshold value, the amplitudes of the two channels of audio signals are judged to be consistent.

The method provided by the embodiment of the application carries out comparison judgment based on the first time sequence signal and the second time sequence signal obtained in the step S901. As shown in fig. 10, in the implementation, the first timing signal and the second timing signal may be subtracted first to obtain a difference signal (timing sequence) between the first timing signal and the second timing signal: bias = Pattern ₁-Pattern₂. It is generally theorized that pattern_1 and pattern_2 substantially coincide and are equal if there is no amplitude difference between the two microphone channels. In practice, however, bias is not exactly equal to zero, but a sequence of very small values. Based on this theory, the statistical data may be an average value of the time series, a variance of the time series, a standard deviation of the time series, or the like. Wherein the timing sequence comprises amplitude differences between the first timing signal and the second timing signal at a plurality of moments in time.

In one example, step S903 includes, but is not limited to, the following decision method:

a) Averaging the sequence bias, setting an average threshold thd_1

As can be seen from the formula, if the average value of the amplitude differences of the first time sequence signal and the second time sequence signal at a plurality of moments is smaller than the average value threshold value, the amplitudes of the two channels are judged to be consistent; if the average value of the amplitude differences of the first time sequence signal and the second time sequence signal at a plurality of moments is larger than or equal to an average value threshold value, the amplitude of the two channels is judged to be inconsistent.

Or:

As can be seen from the formula, if the variance or standard deviation of the amplitude differences of the first time sequence signal and the second time sequence signal at a plurality of moments is smaller than the variance or standard deviation threshold, the amplitudes of the two channels are judged to be consistent; if the variance or standard deviation of the amplitude differences of the first time sequence signal and the second time sequence signal at a plurality of moments is larger than or equal to the variance or standard deviation threshold, the amplitude of the two channels is judged to be inconsistent.

C) Set a thd_3

As can be seen from the formula, if the average value of the amplitude ratios of the first time sequence signal and the second time sequence signal at a plurality of moments is smaller than the logarithmic threshold value, the amplitudes of the two channels are judged to be consistent; if the average value of the amplitude ratios of the first time sequence signal and the second time sequence signal at a plurality of moments is larger than or equal to a logarithmic threshold value, the amplitude of the two channels is judged to be inconsistent.

Step S905: and if the two-channel audio signals combined in pairs are consistent in amplitude, judging that the microphone arrays of the tested equipment are consistent in amplitude.

After amplitude consistency detection is carried out on the two-channel audio signals of the two-by-two combination of the tested equipment, if the two-channel audio signal detection results based on the two-by-two combination can determine that any two-channel audio signals of the tested equipment are consistent in amplitude, the multi-channel audio signals of the tested equipment are consistent in amplitude, namely the microphone array is consistent in amplitude.

As can be seen from the above embodiments, in the microphone array detection method provided by the embodiment of the present application, by two microphone channels combined two by two for a device under test, a first time sequence signal and a second time sequence signal are determined according to a first audio signal and a second audio signal output by the two channels; wherein the first timing signal includes a magnitude-stationary timing signal corresponding to the first audio signal, and the second timing signal includes a magnitude-stationary timing signal corresponding to the second audio signal; if the statistical data of the amplitude differences of the first time sequence signal and the second time sequence signal at a plurality of moments is smaller than or equal to an amplitude difference threshold value, judging that the amplitudes of the two channels of audio signals are consistent; if the two-channel audio signals combined in pairs are consistent in amplitude, judging that the microphone arrays of the tested equipment are consistent in amplitude; the processing mode is that the original audio signals output by the microphone channels are converted into time sequence signals with stable amplitude by utilizing signal conversion processing, the converted time sequence signals with stable amplitude are used as analysis signals, and the consistency of the amplitudes of the original signals output by the two paths of microphone channels is judged based on the relation of the amplitudes of the analysis signals; therefore, the detection cost can be effectively reduced, and higher detection accuracy, stability and efficiency are ensured.

Eighth embodiment

Ninth embodiment

An electronic device of the present embodiment includes: a processor and a memory; a memory for storing a program for realizing the method for detecting the microphone array, the device being powered on and executing the program for the method by the processor, and performing the steps of: for two microphone channels of the tested equipment in a pairwise combination mode, determining a first time sequence signal and a second time sequence signal according to a first audio signal and a second audio signal output by the two channels; wherein the first timing signal includes a magnitude-stationary timing signal corresponding to the first audio signal, and the second timing signal includes a magnitude-stationary timing signal corresponding to the second audio signal; if the statistical data of the amplitude differences of the first time sequence signal and the second time sequence signal at a plurality of moments is smaller than or equal to an amplitude difference threshold value, judging that the amplitudes of the two channels of audio signals are consistent; and if the two-channel audio signals combined in pairs are consistent in amplitude, judging that the microphone arrays of the tested equipment are consistent in amplitude.

Tenth embodiment

Corresponding to the microphone array detection method, the application also provides a device detection method, and an execution main body of the method comprises a device detection device. The same parts of the present embodiment as those of the first embodiment will not be described again, please refer to the corresponding parts in the first embodiment.

In order to more intuitively describe the method, a brief description of an application scenario of the method is provided below. Fig. 11 is a schematic view of an application scenario of an embodiment of the device detection method of the present application. In this embodiment, the tested device includes terminal devices such as a smart phone and a tablet computer capable of performing communication, and the device detection device detects the signal phase consistency and the amplitude consistency of the microphone channel and the stoping channel of the tested device. When the detection device is used for detecting the phase consistency of the microphone channel and the extraction channel of the tested equipment, the microphone can be taken down at the position of the microphone in the figure, so that the tested equipment is not connected with the microphone, and meanwhile, the extraction channel is not connected with a hardware circuit in front of a loudspeaker, and the same test signals such as sine wave signals, cosine wave signals, pulse signals or pure tone signals are input at the microphone channel and the extraction channel through the signal generator. Then, the audio signals output by the microphone channel and the extraction channel can be recorded for a longer time (such as half an hour) by using the signal acquisition tool, so as to obtain the audio signals output by the microphone channel and the extraction channel, such as the first audio signal and the second audio signal in fig. 11. Next, the first audio signal and the second audio signal are input to the detection means, which outputs a phase coincidence detection result, such as coincidence or non-coincidence of phases. The phase coincidence may be the same phase or a fixed phase difference.

Please refer to fig. 12, which is a flowchart illustrating an embodiment of a device detection method of the present application. In this embodiment, the method may include the steps of:

Step S1201: and acquiring a first audio signal output by a microphone channel of the tested device and a second audio signal output by a stoping channel of the tested device.

The tested equipment comprises, but is not limited to, communication equipment such as smart phones, smart speakers and the like. The method detects the phase consistency of the microphone channel and the stoping channel of the tested equipment.

In telephone systems, in particular in hands-free situations, acoustic echoes are present. The sound emitted from the local speaker by the far-end signal (sound signal of the call object) is transmitted back to the microphone (microphone) after passing through the external acoustic system, and is transmitted back to the far-end user through the hybrid transducer together with the local user sound signal, thereby forming an acoustic echo. Such acoustic echoes, which are due to the acoustic coupling between the speaker and the microphone, are susceptible to a variety of environmental factors. Currently, echo cancellation is achieved using echo suppressors. The echo canceller (echo canceller) is an echo canceller that compares the signals of the forward and return channels to produce a "replica" of the echo signal, thereby achieving an echo cancellation effect. That is, the function of the echo canceller is to preserve local speech and cancel the sound of the speaker.

The first audio signal refers to an audio signal output through a microphone channel. The relevant descriptions of the microphone channels are referred to in the relevant parts of the first embodiment, and are not repeated here.

When the tested device is used for communication, the audio signal output by the microphone channel comprises a first user voice and a second user voice echo. The first user is referred to as a local speaker and the second user is referred to as a remote speaker. The second user voice echo included in the audio signal output by the microphone channel is sound emitted through the local loudspeaker, the second user voice is transmitted back to the microphone after passing through the external acoustic system, and the microphone also collects the sound signal of the first user, so that the audio signal output by the microphone channel comprises the first user voice and the second user voice echo.

The stope may include a sampling circuit and may also include an analog-to-digital converter (ADC). The sampling circuit can carry out data extraction on audio data played by a loudspeaker of the tested equipment, an audio signal output by the extraction channel is extraction data, and the echo canceller carries out echo cancellation processing by taking the extraction data as a reference signal.

When the method is used for detecting the phase consistency of the microphone channel and the stoping channel of the tested equipment, test signals such as sine wave signals and the like can be input to the microphone channel and the stoping channel through the signal generator. Thus, the first audio signal output by the microphone channel and the second audio signal output by the extraction channel are similar to the two audio signals output by the two microphone channels in the implementation one.

In practical applications, if the microphone signal (the first audio signal) and the reference signal of the echo canceller (the second audio signal fed to the speaker) are not sampled synchronously, or the buffer management (buffer management) in the microphone channel and the stopchannel link is mishandled, the delay (phase difference) of the first audio signal relative to the second audio signal may be time-varying, the performance of the echo canceller may be greatly affected, and in severe cases, the call may not be performed normally. Therefore, this scenario also requires detecting the phase synchronism of the signals, unlike the scenario of the above embodiment, in which the first audio signal and the second audio signal are to be detected whether or not they are sampled by the same clock, in the acoustic echo cancellation scenario, there may be a fixed delay between the first audio signal and the second audio signal.

Step S1203: determining a first time sequence signal and a second time sequence signal according to the first audio signal and the second audio signal; wherein the amplitude difference between the first timing signal and the second timing signal corresponds to the phase difference of the two audio signals.

The step corresponds to step S101 in the first embodiment, and will not be described here again.

Step S1205: and determining whether the phases of the microphone channel and the stoping channel are consistent according to whether the amplitudes of the first time sequence signal and the second time sequence signal are consistent.

The amplitudes are consistent, and the amplitudes can be the same or the amplitude difference is fixed; the phases are identical, may be the same, the phase difference may be fixed. If the phase of the audio signal between the microphone and the stoping channel is consistent, the tested equipment passes the test; otherwise, the device under test fails the test. The step corresponds to step S103 in the first embodiment, and will not be described here again.

As can be seen from the foregoing embodiments, in the device detection method provided by the embodiments of the present application, a first audio signal including a first user voice and a second user voice echo output by a microphone channel of a device under test is obtained, and a second audio signal including a second user voice is output by a extraction channel of the device under test; determining a first time sequence signal and a second time sequence signal according to the first audio signal and the second audio signal; wherein the amplitude difference between the first timing signal and the second timing signal corresponds to the phase difference of the two audio signals; determining whether the phases of the microphone channel and the stoping channel are consistent according to whether the amplitudes of the first time sequence signal and the second time sequence signal are consistent; the processing mode is that the detection of the phases of the microphone signal and the stope signal is converted into relatively simple amplitude detection by using signal conversion processing, and the consistency of the phases between the stope signal and the microphone signal is judged based on the relation of the amplitudes of the analytic signals after conversion; therefore, the detection cost can be effectively reduced, and higher detection accuracy, stability and efficiency are ensured.

Eleventh embodiment

In the above embodiment, a device detecting method is provided, and correspondingly, the application also provides a device detecting device. The device corresponds to the embodiment of the method described above. Since the apparatus embodiments are substantially similar to the method embodiments, the description is relatively simple, and reference is made to the description of the method embodiments for relevant points. The device embodiments described below are merely illustrative.

The present application further provides an apparatus detecting device including:

Twelfth embodiment

In the above embodiment, a device detection method is provided, and correspondingly, the application further provides an electronic device. The device corresponds to the embodiment of the method described above. Since the apparatus embodiments are substantially similar to the method embodiments, the description is relatively simple, and reference is made to the description of the method embodiments for relevant points. The device embodiments described below are merely illustrative.

An electronic device of the present embodiment includes: a processor and a memory; a memory for storing a program for realizing a device detection method, the device being powered on and executing the program of the method by the processor, the following steps being performed: acquiring a first audio signal output by a microphone channel of the tested equipment and a second audio signal output by a stoping channel of the tested equipment; determining a first time sequence signal and a second time sequence signal according to the first audio signal and the second audio signal; wherein the amplitude difference between the first timing signal and the second timing signal corresponds to the phase difference of the two audio signals; and determining whether the phases of the microphone channel and the stoping channel are consistent according to whether the amplitudes of the first time sequence signal and the second time sequence signal are consistent.

Thirteenth embodiment

Corresponding to the device detection method, the application also provides a device detection method, and an execution subject of the method comprises a device detection device. The parts of this embodiment, which are the same as those of the tenth embodiment, will not be described again, and please refer to the corresponding parts in the tenth embodiment.

Please refer to fig. 13, which is a flowchart illustrating an embodiment of a device detection method of the present application. In this embodiment, the method may include the steps of:

step S1301: and acquiring a first audio signal output by a microphone channel of the tested device and a second audio signal output by a stoping channel of the tested device.

In an acoustic echo cancellation scenario, it is also necessary to detect the amplitude synchronicity of the microphone channel and the extraction channel. This step corresponds to step S1001 in the above-described tenth embodiment, and will not be described here again.

Step S1303: the first timing signal and the second timing signal are determined based on the first audio signal and the second audio signal.

Wherein the first timing signal includes a magnitude-stationary timing signal corresponding to the first audio signal, and the second timing signal includes a magnitude-stationary timing signal corresponding to the second audio signal. This step corresponds to step S901 in the seventh embodiment, and will not be described here again.

Step S1305: and if the statistical data of the amplitude differences of the first time sequence signal and the second time sequence signal at a plurality of moments is smaller than or equal to an amplitude difference threshold value, judging that the amplitudes of the microphone channel and the stoping channel are consistent.

This step corresponds to step S903 in the seventh embodiment, and will not be described here.

As can be seen from the foregoing embodiments, in the device detection method provided by the embodiments of the present application, a first audio signal output by a microphone channel of a device under test and a second audio signal output by a stoping channel of the device under test are obtained; determining a first time sequence signal and a second time sequence signal according to the first audio signal and the second audio signal; wherein the first timing signal includes a magnitude-stationary timing signal corresponding to the first audio signal, and the second timing signal includes a magnitude-stationary timing signal corresponding to the second audio signal; if the statistical data of the amplitude differences of the first time sequence signal and the second time sequence signal at a plurality of moments is smaller than or equal to an amplitude difference threshold value, judging that the amplitudes of the microphone channel and the stoping channel are consistent; the processing mode is that the audio signals output by the microphone channel and the extraction channel are converted into time sequence signals with stable amplitude by utilizing signal conversion processing, the converted time sequence signals with stable amplitude are used as analysis signals, and the consistency of the amplitude between the extraction signals and the microphone signals is judged based on the relation of the amplitude of the analysis signals; therefore, the detection cost can be effectively reduced, and higher detection accuracy, stability and efficiency are ensured.

Fourteenth embodiment

Fifteenth embodiment

An electronic device of the present embodiment includes: a processor and a memory; a memory for storing a program for realizing a device detection method, the device being powered on and executing the program of the method by the processor, the following steps being performed: acquiring a first audio signal output by a microphone channel of the tested equipment and a second audio signal output by a stoping channel of the tested equipment; determining a first time sequence signal and a second time sequence signal according to the first audio signal and the second audio signal; wherein the first timing signal includes a magnitude-stationary timing signal corresponding to the first audio signal, and the second timing signal includes a magnitude-stationary timing signal corresponding to the second audio signal; and if the statistical data of the amplitude differences of the first time sequence signal and the second time sequence signal at a plurality of moments is smaller than or equal to an amplitude difference threshold value, judging that the amplitudes of the microphone channel and the stoping channel are consistent.

Sixteenth embodiment

Corresponding to the microphone array detection method, the application also provides a microphone array detection method, and an execution subject of the method comprises a microphone array detection device. The same parts of the present embodiment as those of the first embodiment will not be described again, please refer to the corresponding parts in the first embodiment.

In this embodiment, the method may include the steps of:

Step 1: aiming at two microphone channels of the tested equipment which are combined in pairs, performing first Hilbert transform on two audio signals output by the two channels to obtain a first timing signal; and performing a second Hilbert transform on the two audio signals to obtain a second timing signal.

This step corresponds to one implementation of step S101 in the above-described embodiment one. The first hilbert transform may comprise the steps of: respectively carrying out Hilbert transform on the two audio signals; respectively executing a normative process (such as L-2 normative) on two complex signals obtained after Hilbert transformation; the sum of the two norm signals is taken as a first timing signal. The second hilbert transform may comprise the steps of: performing a summation operation on the two audio signals; performing Hilbert transform on the summed signals; and performing a norm taking process on the complex signal obtained after the Hilbert transform, and taking the norm signal as a second time sequence signal.

The conversion processing modes between the first Hilbert conversion and the second Hilbert conversion are opposite, namely the first Hilbert conversion firstly carries out Hilbert conversion and norms taking and then summing, and the second Hilbert conversion is firstly summed and then carried out Hilbert conversion and norms taking. In specific implementation, the operation mode is not limited to summation, and other operation modes such as difference calculation and the like can be adopted, namely: the first Hilbert transform performs Hilbert transform and takes a norm and then obtains a difference, and the second Hilbert transform performs Hilbert transform and takes a norm after obtaining a difference.

The conversion processing manner between the first Hilbert transform and the second Hilbert transform is opposite, so that the amplitude difference between the first time sequence signal and the second time sequence signal corresponds to the phase difference of the two audio signals. The first timing signal includes the operation result of the timing signal with stable amplitude of the two audio signals, and the second timing signal includes the timing signal with stable amplitude of the operation result of the two audio signals.

Step 2: and determining whether the two audio signals are consistent in phase according to whether the first time sequence signal is consistent with the second time sequence signal in amplitude.

The step corresponds to step S103 in the first embodiment, and will not be described here again.

Step 3: and if the two channel audio signals combined in pairs are in phase coincidence, judging that the microphone arrays of the tested equipment are in phase coincidence.

The step corresponds to step S105 in the first embodiment, and will not be described here again.

As can be seen from the foregoing embodiments, in the microphone array detection method provided by the embodiments of the present application, two audio signals output by two channels are subjected to a first hilbert transform by aiming at two channels of microphone channels combined by two channels of a device under test, so as to obtain a first timing signal; performing second Hilbert transform on the two audio signals to obtain a second time sequence signal; the conversion processing mode between the first Hilbert conversion and the second Hilbert conversion is opposite; determining whether the phases of the two audio signals are consistent according to whether the amplitudes of the first time sequence signal and the second time sequence signal are consistent; if the two-channel audio signals combined in pairs are identical in phase, judging that the microphone arrays of the tested equipment are identical in phase; the processing mode is that the Hilbert transformation is utilized to convert the detection of the phase into the relatively simple amplitude detection, and the consistency of the phase of the original signal is judged based on the relation of the amplitude of the analysis signal after the Hilbert transformation; therefore, the detection cost can be effectively reduced, and higher detection accuracy, stability and efficiency are ensured.

The method provided by the various embodiments can be used for detecting the tested device. The device under test includes, but is not limited to: intelligent sound box, user equipment (such as smart phone), pickup, live broadcast equipment, conference call, video conference terminal, tablet computer, etc.

In one example, an embodiment of the present application provides an intelligent speaker detection system, which includes an intelligent speaker, and any of the above devices. The specific embodiment of the intelligent sound box system can be seen in fig. 1 and the description thereof, and will not be repeated here.

In one example, an embodiment of the present application provides a user equipment detection system, where the system includes a user equipment, and any one of the foregoing apparatuses. The specific embodiment of the ue system can be seen in fig. 11 and the description thereof, and will not be repeated here.

In one example, an embodiment of the present application provides a pickup detection system including a pickup, and any of the above devices. The pick-up is also called as a monitor head. The monitoring pick-up is a device for collecting the field environmental sound and transmitting the field environmental sound to the back-end equipment, and is composed of a microphone and an audio amplifying circuit. The specific implementation mode of the pickup system is similar to that of the intelligent sound box detection system, and only the tested equipment is replaced by a pickup, so that repeated description is omitted.

In one example, an embodiment of the present application provides a live device detection system that includes a live device (e.g., a honey live all-in-one) and any of the above-described apparatuses. The specific implementation mode of the live broadcast equipment system is similar to that of the intelligent sound box detection system, and only the tested equipment is replaced by live broadcast equipment, so that repeated description is omitted.

In one example, embodiments of the present application provide a conference call detection system that includes a conference call (e.g., a MIDI conference call that is cooperative with other vendors in Alice), and any of the above devices. The specific implementation of the conference phone system is similar to that of the intelligent sound box detection system, and only the tested equipment is replaced by the conference phone, so that the detailed description is omitted.

In one example, embodiments of the present application provide a videoconferencing endpoint detection system that includes a videoconferencing endpoint (e.g., a nailed videoconferencing all-in-one), and any of the above. The specific implementation mode of the video conference terminal system is similar to that of the intelligent sound box detection system, and only the tested equipment is replaced by a conference phone, so that the detailed description is omitted.

While the application has been described in terms of preferred embodiments, it is not intended to be limiting, but rather, it will be apparent to those skilled in the art that various changes and modifications can be made herein without departing from the spirit and scope of the application as defined by the appended claims.

In one typical configuration, a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.

The memory may include volatile memory in a computer-readable medium, random Access Memory (RAM) and/or nonvolatile memory, such as Read Only Memory (ROM) or flash memory (flash RAM). Memory is an example of computer-readable media.

1. Computer readable media, including both non-transitory and non-transitory, removable and non-removable media, may implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of storage media for a computer include, but are not limited to, phase change memory (PRAM), static Random Access Memory (SRAM), dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), read Only Memory (ROM), electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), digital Versatile Discs (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices, or any other non-transmission medium, which can be used to store information that can be accessed by a computing device. Computer readable media, as defined herein, does not include non-transitory computer readable media (transmission media), such as modulated data signals and carrier waves.

2. It will be appreciated by those skilled in the art that embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.

Claims

1. A method for detecting a microphone array, comprising:

2. A method for detecting a microphone array, comprising:

For two microphone channels of the tested equipment in a pairwise combination mode, determining a first time sequence signal and a second time sequence signal according to two audio signals output by the two channels; wherein an amplitude difference between the first timing signal and the second timing signal corresponds to a phase difference of the two audio signals; the first time sequence signal comprises the operation result of the time sequence signals with stable amplitude of the two audio signals, and the second time sequence signal comprises the time sequence signals with stable amplitude of the operation result of the two audio signals;

3. A method according to claim 2, characterized in that,

The second timing signal is determined as follows:

transforming the third timing signal into a first complex signal;

the first timing signal is determined as follows:

4. A method according to claim 3, wherein,

The converting the third timing signal into the first complex signal includes:

5. The method according to claim 4, wherein,

The 90 degree phase shift process includes: hilbert transform;

6. A method according to claim 3, wherein,

The operation includes: the two audio signals are summed.

7. A method according to claim 2, characterized in that,

Judging whether the amplitude of the first time sequence signal is consistent with that of the second time sequence signal, and adopting the following mode:

8. The method of claim 7, wherein the statistics comprise:

9. The method of claim 2, further comprising:

10. The method according to claim 9, wherein,

The sixth timing signal includes a timing signal having a stable amplitude of the operation result of the plurality of audio signals, and the seventh timing signal includes an operation result of the timing signal having a stable amplitude of the plurality of audio signals.

11. The method of claim 9, wherein determining whether the sixth timing signal is consistent with the seventh timing signal in magnitude comprises:

12. The method of claim 2, further comprising:

13. The method of claim 12, wherein the analog electrical signal comprises: the sine wave simulates an electrical signal.

14. The method of claim 13, wherein the multiple detection inputs of the sine wave analog electrical signal are high frequency signals of prime quality relative to each other.

15. A method for detecting a microphone array, comprising:

determining a first time sequence signal and a second time sequence signal according to a plurality of audio signals output by a plurality of microphone channels of the tested equipment; wherein the amplitude difference between the first timing signal and the second timing signal corresponds to the phase difference of the multi-channel output signal; the first time sequence signal comprises the operation results of the time sequence signals with stable amplitudes of the plurality of audio signals, and the second time sequence signal comprises the operation results of the time sequence signals with stable amplitudes of the plurality of audio signals;

16. A method for detecting a microphone array, comprising:

17. A device detection method, comprising:

Determining a first time sequence signal and a second time sequence signal according to the first audio signal and the second audio signal; wherein the amplitude difference between the first timing signal and the second timing signal corresponds to the phase difference of the two audio signals; the first timing signal comprises the operation result of the timing signal with stable amplitude of the first audio signal and the timing signal with stable amplitude of the second audio signal, and the second timing signal comprises the timing signal with stable amplitude of the operation result of the first audio signal and the second audio signal;

18. A device detection method, comprising:

19. A microphone array detection apparatus, comprising:

The two-channel signal conversion unit is used for determining a first time sequence signal and a second time sequence signal according to two audio signals output by two channels aiming at two channels of microphone channels of the two-by-two combination of the tested equipment; wherein an amplitude difference between the first timing signal and the second timing signal corresponds to a phase difference of the two audio signals; the first time sequence signal comprises the operation result of the time sequence signals with stable amplitude of the two audio signals, and the second time sequence signal comprises the time sequence signals with stable amplitude of the operation result of the two audio signals;

20. A microphone array detection apparatus, comprising:

a multi-channel signal conversion unit for determining a first time sequence signal and a second time sequence signal according to a plurality of audio signals output by a plurality of microphone channels of the tested equipment; wherein the amplitude difference between the first timing signal and the second timing signal corresponds to the phase difference of the multi-channel output signal; the first time sequence signal comprises the operation results of the time sequence signals with stable amplitudes of the plurality of audio signals, and the second time sequence signal comprises the operation results of the time sequence signals with stable amplitudes of the plurality of audio signals;

21. A microphone array detection apparatus, comprising:

22. A device detection apparatus, comprising:

A signal conversion unit for determining a first timing signal and a second timing signal from the first audio signal and the second audio signal; wherein the amplitude difference between the first timing signal and the second timing signal corresponds to the phase difference of the two audio signals; the first timing signal comprises the operation result of the timing signal with stable amplitude of the first audio signal and the timing signal with stable amplitude of the second audio signal, and the second timing signal comprises the timing signal with stable amplitude of the operation result of the first audio signal and the second audio signal;

23. A device detection apparatus, comprising:

24. An electronic device, comprising:

a processor and a memory;

memory for storing a program for implementing the method according to any one of claims 1-18, the device being powered on and running the program of the method by the processor.

25. An intelligent sound box detection system, characterized by comprising:

a smart sound box, an apparatus according to any one of claims 19-23.

26. A user equipment detection system, comprising:

User equipment, apparatus according to any of claims 19-23.

27. A pickup detection system, comprising:

pickup, apparatus according to any one of claims 19-23.

28. A live device detection system, comprising:

User equipment, apparatus according to any of claims 19-23.

29. A conference call detection system, comprising:

conference call, apparatus according to any of claims 19-23.

30. A videoconference terminal detection system, comprising:

A videoconference terminal, the apparatus according to any of claims 19-23.