CN114827866A

CN114827866A - Fault detection method, device, equipment and storage medium of audio equipment

Info

Publication number: CN114827866A
Application number: CN202210307533.9A
Authority: CN
Inventors: 杨洁; 王奉宝
Original assignee: Goertek Techology Co Ltd
Current assignee: Goertek Techology Co Ltd
Priority date: 2022-03-25
Filing date: 2022-03-25
Publication date: 2022-07-29

Abstract

The embodiment of the application provides a fault detection method, a fault detection device, equipment and a storage medium of audio equipment, and relates to the technical field of acoustics. The method comprises the following steps: acquiring a frequency response curve of the audio equipment; determining whether the audio equipment has faults or not according to a frequency response curve of the audio equipment and a preset fault detection model; and outputting fault prompt information when the audio equipment has faults. By the method, whether the audio equipment fails or not can be detected. And when the audio equipment fails, outputting failure prompt information to inform a user that the audio equipment has failure.

Description

Fault detection method, device, equipment and storage medium of audio equipment

Technical Field

The present disclosure relates to the field of acoustic technologies, and in particular, to a method for detecting a fault of an audio device, an apparatus for detecting a fault of an audio device, an electronic device, and a computer-readable storage medium.

Background

With the development of the intellectualization and miniaturization of the sound, the intelligent sound has been widely used.

In the use process of the intelligent sound box, the sound effect is changed due to the fact that faults such as hardware damage and the like exist frequently. Because the user cannot intuitively check whether the intelligent sound equipment fails, the user may misunderstand that the quality of the audio signal played by the audio equipment causes the sound effect of the audio equipment to be unsatisfactory.

Therefore, how to determine whether the intelligent sound equipment fails becomes a technical problem to be solved urgently.

Disclosure of Invention

It is an object of the present application to provide a new solution for fault detection of audio devices.

According to a first aspect of the present application, there is provided a failure detection method of an audio device, the method including:

acquiring a frequency response curve of the audio equipment;

determining whether the audio equipment has faults or not according to the frequency response curve of the audio equipment and a preset fault detection model;

and outputting fault prompt information under the condition that the audio equipment has faults.

Optionally, the audio device includes a speaker and a first microphone, and the acquiring a frequency response curve of the audio device includes:

controlling a loudspeaker to play an audio signal;

controlling the first microphone to acquire an audio signal played by the loudspeaker;

determining a frequency response curve of the first microphone according to the audio signal collected by the first microphone;

acquiring the transmission quantity of the first microphone to an external reference point;

and determining the frequency response curve of the first microphone at the external reference point according to the transmission quantity of the first microphone to the external reference point and the frequency response curve of the first microphone.

Optionally, the determining a frequency response curve of the first microphone according to the audio signal collected by the first microphone includes:

determining the sound pressure level of the audio signal collected by the first microphone according to the audio signal collected by the first microphone;

and determining a frequency response curve of the first microphone according to the sound pressure level.

Optionally, the method, in determining a frequency response curve of the first microphone according to the audio signal collected by the first microphone, includes:

filtering noise signals from the audio signals collected by the first microphone to obtain noise-reduced audio signals;

and determining a frequency response curve of the first microphone according to the noise-reduced audio signal.

Optionally, the audio device further comprises at least one second microphone, and the method further comprises:

acquiring a frequency response curve of each second microphone at an external reference point;

and determining a frequency response curve of a microphone array according to the frequency response curve of each second microphone at the external reference point and the frequency response curve of the first microphone at the external reference point, wherein the first microphone and the second microphone form the microphone array.

Optionally, the method further includes:

acquiring a training sample set, wherein the training sample set comprises a plurality of groups of training samples, and one group of training samples comprises a sample frequency response curve and a corresponding fault state;

and obtaining the preset fault detection model according to the training sample set.

Optionally, the method further includes:

and training the preset fault detection model according to the frequency response curve of the audio equipment.

Optionally, the method further includes:

under the condition that the audio equipment is in fault, determining a compensation value according to a frequency response curve and a standard frequency response curve of the audio equipment;

and adjusting the audio signal played by the audio equipment according to the compensation value.

According to a second aspect of the present application, there is provided a malfunction detection apparatus of an audio device, the apparatus including:

the acquisition module is used for acquiring a frequency response curve of the audio equipment;

the determining module is used for determining whether the audio equipment has faults or not according to the frequency response curve and a preset fault detection model;

and the output module is used for outputting fault prompt information under the condition that the audio equipment has faults.

According to a third aspect of the present application, there is provided an electronic device comprising the failure detection apparatus of the audio device according to the second aspect;

or, comprising the loudspeaker, the first microphone, and a memory for storing computer instructions and a processor for invoking the computer instructions from the memory to perform the method of fault detection of an audio device according to any of the first aspect.

According to a fourth aspect of the present application, there is provided a computer-readable storage medium having stored thereon a computer program which, when executed by a processor, implements the method of fault detection of an audio device according to any one of the first aspects.

In an embodiment of the present application, a method for detecting a failure of an audio device is provided, where the method includes: acquiring a frequency response curve of the audio equipment; determining whether the audio equipment has faults or not according to a frequency response curve of the audio equipment and a preset fault detection model; and outputting fault prompt information when the audio equipment has faults. Therefore, by the fault detection method of the audio equipment, whether the audio equipment has faults or not can be detected without disassembling and professional maintenance personnel. And when the audio equipment fails, failure prompt information can be output to inform a user that the audio equipment has failure. Based on this, the user can make a preliminary judgment on the malfunction of the audio apparatus.

Further features of the present application and advantages thereof will become apparent from the following detailed description of exemplary embodiments thereof, which is to be read in connection with the accompanying drawings.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of the specification, illustrate embodiments of the application and together with the description, serve to explain the principles of the application.

Fig. 1 is a schematic flowchart of a fault detection method for an audio device according to an embodiment of the present disclosure;

fig. 2 is a flowchart illustrating a method for obtaining a frequency response curve of an audio device according to an embodiment of the present application;

fig. 3 is a schematic structural diagram of a fault detection apparatus of an audio device according to an embodiment of the present application;

fig. 4 is a schematic structural diagram of an electronic device according to an embodiment of the present application.

Detailed Description

Various exemplary embodiments of the present application will now be described in detail with reference to the accompanying drawings. It should be noted that: the relative arrangement of the components and steps, the numerical expressions, and numerical values set forth in these embodiments do not limit the scope of the present application unless specifically stated otherwise.

The following description of at least one exemplary embodiment is merely illustrative in nature and is in no way intended to limit the application, its application, or uses.

Techniques, methods, and apparatus known to those of ordinary skill in the relevant art may not be discussed in detail but are intended to be part of the specification where appropriate.

In all examples shown and discussed herein, any particular value should be construed as merely illustrative, and not limiting. Thus, other examples of the exemplary embodiments may have different values.

It should be noted that: like reference numbers and letters refer to like items in the following figures, and thus, once an item is defined in one figure, further discussion thereof is not required in subsequent figures.

< method examples >

The embodiment of the application provides a fault detection method of audio equipment, and an execution main body of the method is electronic equipment. The electronic device can be the audio device itself, and the electronic device can also be an external electronic device connected with the audio device. The external electronic equipment can be a smart phone or a personal computer and the like.

As shown in fig. 1, the fault detection method provided in the embodiment of the present application includes the following steps S1100 to S1300:

and S1100, acquiring a frequency response curve of the audio equipment.

In an embodiment of the present application, in a case that the method for detecting a fault of an audio device provided in the embodiment of the present application is applied to an external electronic device connected to the audio device, the specific implementation of S1100 may be to obtain a frequency response curve of the audio device from the audio device.

In the case that the audio device failure method provided in the embodiment of the present application is applied to an audio device, the specific implementation of S1100 described above may also be implemented by the following S1110-S1114. Of course, other means may be adopted to implement the method, and the embodiment of the present application is not limited thereto.

It should be noted that the frequency response curve of the audio device in the embodiment of the present application refers to the frequency response curve of the microphone in the audio device, or the frequency response curve of the microphone array at an external reference point. And the external reference point is the point at which the user is typically listening.

In addition, in the case of a malfunction of the audio device, the frequency response curve of the audio device appears to change in individual frequency bands. Therefore, whether the audio equipment fails or not can be determined according to the frequency response curve of the audio equipment.

S1200, determining whether the audio equipment has faults or not according to the frequency response curve of the audio equipment and a preset fault detection model.

In this embodiment of the application, the input of the preset fault detection model is the frequency response curve of the audio device in S1100, and the output is the fault state of the audio device.

Wherein the fault condition may include a fault and a non-fault in one embodiment. On the basis, whether the audio equipment has faults or not can be determined according to the fault state of the audio equipment output by the preset fault detection model.

In another embodiment, the fault condition may also include a non-fault and a fault type at the time of the fault. On the basis, whether the audio equipment has faults or not can be determined according to the fault state of the audio equipment output by the preset fault detection model. And, when a fault exists, a particular fault type may be determined.

It should be noted that, in the embodiment of the present application, the fault refers to a fault that causes a change in the frequency response curve of the audio device. Additionally, in one example, the specific failure types may be: the connection of the vibrating diaphragm and the voice coil is loosened, the vibrating diaphragm is damaged, the rear cavity is sealed and failed, and the like.

In an embodiment of the present application, the method for detecting a fault of an audio device provided in the embodiment of the present application further includes a step of obtaining a preset fault detection model before the audio device leaves a factory, where the step specifically includes the following steps S1210 and S1211:

and S1210, obtaining a training sample set.

Wherein the training sample set comprises a plurality of groups of training samples, one group of training samples comprises a sample frequency response curve and a corresponding fault state,

in one embodiment, the fault conditions include fault and non-fault. Or the fault status includes non-fault, and the specific fault type at the time of the fault.

In one embodiment, the software and hardware of the audio device may first be checked to determine that the audio device is normally trouble-free. On the basis, the audio equipment is placed in different environments, and the frequency response curve of the audio equipment is detected. The specific detection method may be as follows S1100-S1114, or other ways of disassembling and combining test tools. After the frequency response curve of the audio device is obtained, the frequency response curve is marked as non-fault. A frequency response curve of the audio device and corresponding non-fault flags are taken as a sample.

In addition, in the case that the fault state comprises a fault state and a non-fault state, the software and the hardware of the audio equipment are modified so that the audio equipment is in the fault state. Further, the audio equipment is in a state of frequent failure. On the basis, the audio equipment is placed in different environments, and the frequency response curve of the audio equipment is detected. The specific detection method may be as follows S1100-S1114, or other ways of disassembling and combining test tools. After the frequency response curve of the audio device is obtained, the frequency response curve is marked as a fault. And taking a frequency response curve of the audio equipment and the corresponding fault mark as a sample.

And in the case that the fault state comprises a non-fault type and a fault type at the time of the fault, modifying the software and the hardware of the audio equipment so as to enable the audio equipment to be in the fault state. Further, the audio equipment is in a state of frequent failure. At which time the specific fault type is recorded. Further, the audio equipment is placed in different environments, and the frequency response curve of the audio equipment is detected. The specific detection method may be as follows S1100-S1114, or other ways of disassembling and combining test tools. . After the frequency response curve of the audio device is obtained, the frequency response curve is marked as a specific fault type. And taking a frequency response curve of the audio equipment and the mark of the corresponding specific fault type as a sample.

And repeating the steps to obtain a plurality of groups of training samples.

And S1211, obtaining a preset fault detection model according to the training sample set.

In the present embodiment, the preset fault detection model may be obtained by various fitting means. For example, the predetermined fault detection model may be obtained by using any multiple linear regression model, which is not limited herein.

It should be noted that the multiple linear regression model may be a simple polynomial function reflecting the predetermined fault detection model. The initial state of each order coefficient of the polynomial function is a default value, the specific value of each order coefficient of the polynomial function can be determined by training the polynomial function with a training sample, and then a preset fault detection model is obtained.

Of course, the multiple linear regression model may also be a neural network model for classification.

And S1300, outputting fault prompt information under the condition that the audio equipment has faults.

In the embodiment of the application, when the audio device has a fault, fault prompt information can be output to prompt a user that the audio device has a fault or a specific fault type.

In an embodiment of the present application, the fault notification information may be in a form of a text, and may also be in a form of an audio-visual format, which is not limited in the present application.

In an embodiment of the present application, the method for detecting a failure of an audio device provided in the embodiment of the present application further includes the following step S1400:

and S1400, training a preset fault detection model according to the frequency response curve of the audio equipment.

In this embodiment, after the frequency response curve of the audio device is obtained, the preset fault detection model may be trained continuously according to the frequency response curve of the audio device, that is, a process of semi-supervised classification learning of a label that does not require a sample. This allows the pre-set fault detection model to be optimized. On the basis, the frequency response curve of the audio equipment which is subjected to micro-change due to aging can be input into a preset fault detection model, and the audio equipment is output to be in a fault state or a non-fault state.

It will be appreciated that the micro-variations in sound effects of the audio device due to aging are acceptable.

In an embodiment of the present application, the method for detecting a failure of an audio device provided in the embodiment of the present application further includes the following steps S1500 and S1600:

s1500, under the condition that the audio equipment is determined to have faults, a compensation value is determined according to the frequency response curve and the standard frequency response curve of the audio equipment.

In the embodiment of the present application, the compensation value may specifically be an EQ compensation value. The EQ compensation value is specifically a combination of at least one of a type, a parameter value, and a number of the EQ equalizer.

In one embodiment of the present application, the types of EQ equalization filters may include: notch filters, peak filters, band pass filters, band reject filters, and the like.

Taking the EQ equalization filter type as a notch filter as an example, the parameter values of the notch filter may be specifically the valley and/or the frequency range. Taking the type of equalization filter as a peak filter as an example, the parameter values of the notch filter may be specified as peak and/or frequency ranges.

In the embodiment of the application, in the case that the audio equipment is determined to have a fault, the sound effect of the audio equipment is described to be changed. At this time, the sound effect of the audio device is adjusted through S1500 and S1600.

In the embodiment of the application, the standard frequency response curve is a frequency response curve of the audio equipment under the condition of no fault. The standard frequency response curve can be obtained by adopting any one of the above manners under the condition that the audio equipment is normal and has no fault. The specific implementation of S1500 may:

and aligning the frequency response curve of the audio equipment with the standard frequency response curve so that the frequency response curve of the audio equipment and the standard frequency response curve can be overlapped to the maximum extent. And for the non-coincident frequency bands, calculating the difference value between the amplitude corresponding to the frequency response curve of the audio equipment under the corresponding frequency and the amplitude corresponding to the standard frequency response curve. A compensation value is determined based on the difference. The specific way of determining the compensation value according to the difference is as follows: and determining a compensation value according to the difference value and a preset mapping relation. The preset mapping relationship reflects the corresponding relationship between different difference values and compensation values.

After the compensation value is obtained, the EQ equalizer is adjusted according to the compensation value, so that the frequency response curve of the audio equipment can be coincided with the standard frequency response curve.

And S1600, adjusting the audio signal played by the audio equipment according to the compensation value.

In an embodiment of the application, the specific implementation of S1600 may be: and adjusting an equalizing filter in the audio equipment according to the compensation value so that the frequency response curve of the audio equipment and the standard frequency response curve are repeated.

In the embodiment of the present application, negative effects caused by a failure of an audio device can be eliminated by using the software adjustment method through the foregoing S1500 and S1600. That is, it is possible through S1500 and S1600 that the sound effect heard by the user is not changed although there is some malfunction of the audio apparatus. This greatly improves the user experience.

It should be noted that, in order to prevent the compensation from being insufficient, the above S1100 to S1600 may be repeatedly performed after the above S1500 and S1600 are performed.

In an embodiment of the present application, the audio device includes as shown in fig. 2, the above S1100 may be specifically implemented by the following S1110-S1114:

and S1110, controlling a loudspeaker to play audio signals.

In one embodiment, the audio signal played by the speaker may be a swept frequency signal. Of course, it may be a music signal or the like.

It can be understood that, since the frequency sweep signal is a constant amplitude signal whose frequency varies periodically within a certain range, the frequency sweep signal can cover more frequency ranges, and the sound pressure level is stable. Thus, with this sweep signal, a more accurate frequency response curve of the first microphone can be obtained based on S1300 described below.

And S1111, controlling the first microphone to collect the audio signal played by the loudspeaker.

In the embodiment of the application, the first microphone is controlled to collect the audio signal played by the loudspeaker while the loudspeaker is controlled to play the audio signal.

In an embodiment of the present application, the method for detecting a failure of an audio device according to an embodiment of the present application further includes, before S1111: the first microphone is calibrated. This may provide a basis for the first microphone to pick up an accurate audio signal.

And S1112, determining a frequency response curve of the first microphone according to the audio signal collected by the first microphone.

In an embodiment of the present application, the specific implementation of S1112 may be: and performing Fourier transform or fast Fourier transform on the audio signal acquired by the first microphone to obtain a frequency response curve of the first microphone.

In another embodiment, the specific implementation of S1112 may also be as follows S1112-1 and S1112-2:

and S1112-1, determining the sound pressure level of the audio signal collected by the first microphone according to the audio signal collected by the first microphone.

And S1112-2, determining a frequency response curve of the first microphone according to the sound pressure level.

In this embodiment, the specific implementation of S1112-2 may be: according to the sound pressure level, a frequency response curve corresponding to the sound pressure level that is the same as or closest to the sound pressure level obtained according to the above step S1112-1 is searched in a preset frequency response curve database, and the searched frequency response curve is used as the frequency response curve of the first microphone in the above step S1112-2.

And the preset frequency response curve database stores frequency response curves corresponding to different sound pressure levels.

In one embodiment, the preset frequency response curve database is obtained by testing by an operator before the audio device leaves a factory. The specific test process may be: controlling a loudspeaker to play an audio signal with a sound pressure level a, and simultaneously controlling a first microphone to collect the audio signal with the sound pressure level a; testing a frequency response curve of an audio signal with a sound pressure level a collected by a first microphone; and repeating the steps to obtain the frequency response curves of the audio signals with different sound pressure levels.

It will be appreciated that the test may be performed in a noise-canceling environment in order to avoid the effect of noise on the test.

It should be noted that, the frequency response curves corresponding to the audio signals of the same sound pressure level are the same. Therefore, the above S1112-2 can be implemented according to the sound pressure level of the audio signal obtained based on the above S1112-1 and the above preset frequency response curve database.

In the embodiment of the present application, since the sound pressure level of the audio signal can be obtained quickly, the frequency response curve of the first microphone can be obtained quickly through the above-mentioned S1112-1 and S1112-2.

And S1113, acquiring the transmission quantity of the first microphone to an external reference point.

In this embodiment of the application, the transmission amount of the external reference point in S1113 is obtained by testing by an operator before shipping the audio device. That is to say, the method for detecting a failure of an audio device according to the embodiment of the present application further includes, before the above step S1110, the following steps:

and S1110-1, controlling a loudspeaker of the audio device to play an audio signal, and controlling a first microphone and a test microphone of the audio device to simultaneously acquire the audio signal.

Wherein the test microphone is arranged at an external reference point. And the performance, specification and the like of the test microphone and the first microphone are completely consistent.

S1110-2, calculating a frequency response curve of the audio signal collected by the first microphone, and calculating a frequency response curve of the audio signal collected by the test microphone.

And S1110-3, taking the difference value between the frequency response curve of the audio signal collected by the test microphone and the frequency response curve of the audio signal collected by the first microphone as the transmission quantity from the first microphone to an external reference point.

The specific calculation mode of the difference value between the frequency response curve of the audio signal collected by the test microphone and the frequency response curve of the audio signal collected by the first microphone is as follows: and (4) making difference between the amplitudes corresponding to the same frequency on the two frequency response curves.

It will be appreciated that the amount of transmission of the first microphone to the external reference point may reflect the change in the frequency response curve of the first microphone to the external reference point, where the first microphone is located, due to the distance. Therefore, the transmission amount of the first microphone to the external reference point is fixed when the environment of the audio device and the played audio signal change. In addition, to avoid the effect of noise on the test, the test may be performed in a noise-canceling environment.

And S1114, determining a frequency response curve of the first microphone at the external reference point according to the transmission quantity of the first microphone to the external reference point and the frequency response curve of the first microphone.

In this embodiment, the specific implementation of S1114 may be: and taking the sum of the transfer quantity of the first microphone to the reference point and the frequency response curve of the first microphone as the frequency response curve of the first microphone at the reference point.

The calculation mode of the sum of the transmission quantity from the first microphone to the reference point and the frequency response curve of the first microphone is as follows: and superposing the amplitude corresponding to the same frequency in the transmission quantity from the first microphone to the reference point on the amplitude corresponding to each frequency on the frequency response curve of the first microphone.

When the number of the external reference points is two or more, the above-mentioned S1113 and S1114 are repeated, and frequency response curves of the first microphone at the plurality of external reference points can be obtained.

It is understood that, the above-mentioned S1110 to S1114 may be implemented after the audio device is shipped, and therefore, the detection of the frequency response curve after the audio device is shipped may be implemented through the above-mentioned S1110 to S1114.

In an embodiment of the present application, the specific implementation of S1112 may be as follows S1112-1 and S1112-2:

s1112-1, filtering noise signals from the audio signals collected by the first microphone to obtain noise-reduced audio signals.

In this embodiment, since the external environment of the audio device usually has noise, the audio signal obtained in S1111 includes the noise of the external environment in addition to the audio signal played by the speaker. Meanwhile, since vibration noise is generated by both the vibration of the speaker and the vibration of the first microphone, the audio signal obtained based on S1111 also includes the vibration noise. On the basis, in order to enable the first microphone to acquire an accurate audio signal, a noise signal needs to be filtered from the audio signal acquired by the first microphone.

And S1112-2, determining the frequency response of the first microphone according to the noise-reduced audio signal.

With reference to the foregoing embodiment, the method for detecting a fault of an audio device according to the embodiment of the present application further includes, before the foregoing S1112-1, the following S1112-3:

and S1112-3, determining a noise signal according to the audio signal played by the loudspeaker and the audio signal collected by the first microphone.

In this embodiment, the specific implementation of S1112-3 may be: and determining the difference value between the audio signal collected by the first microphone and the audio signal played by the loudspeaker as a noise signal.

The audio signal played by the speaker is specifically an audio signal input to the speaker.

Of course, other ways of obtaining the noise signal in the audio signal collected by the first microphone may also be used. For example, a noise signal in the audio signal collected by the first microphone is tracked in a minimum mean recursion manner, so as to obtain a noise signal. Or estimating a noise signal in the audio signal collected by the first microphone by using the Bayesian statistical probability to obtain the noise signal.

In an embodiment of the present application, in a case that the audio device further includes at least one second microphone, the method for detecting a failure of the audio device according to the embodiment of the present application further includes the following S1115 and S1116:

and S1115, acquiring a frequency response curve of each second microphone at an external reference point.

And S1116, determining the frequency response curve of the microphone array according to the frequency response curve of each second microphone at the external reference point and the frequency response of the first microphone at the external reference point.

Wherein the first microphone and the second microphone form a microphone array.

In an embodiment of the present application, an audio device includes a microphone array including a first microphone and a second microphone.

In this embodiment, the specific implementation of the step S1115 may be that each second microphone is regarded as a first microphone, and the frequency response curve of each second microphone at the external reference point is obtained by referring to the steps S1115 to S1116.

In the embodiment of the present application, the detection of the frequency response curve of the microphone array at the external reference point can be realized through the above-mentioned S1115 and S1116.

In one embodiment, the above S1116 may be specifically implemented by the following S1116-1 and S1116-2:

and S1116-1, determining a frequency response curve of each second microphone at an external reference point and an average value curve among the frequency response curves of the first microphones at the external reference points.

In this embodiment, the foregoing S1116-1 is implemented as: determining the average value of the corresponding amplitude values of the same frequency on the frequency response curve of each second microphone at the reference point and the frequency response curve of the first microphone at the reference point; and recording a curve formed by coordinate points formed by each mean value and the corresponding frequency as a mean value curve.

And S1116-2, determining the average value curve as a frequency response curve of the microphone array at an external reference point.

Of course, the above-mentioned S1116 may also be implemented in other manners, for example, a frequency response curve of each second microphone at the reference point and a frequency response curve of the first microphone at an intermediate position between the frequency response curves of the reference points may also be used as the frequency response curves of the microphone array at the external reference points.

< apparatus embodiment >

As shown in fig. 3, an embodiment of the present application provides a fault detection apparatus 300 for an audio device, and as shown in fig. 3, the fault detection apparatus 300 for an audio device includes: an obtaining module 310, a determining module 320, and an outputting module 330, wherein:

an obtaining module 310, configured to obtain a frequency response curve of the audio device;

a determining module 320, configured to determine whether the audio device has a fault according to a frequency response curve of the audio device and a preset fault detection model;

the output module 330 is configured to output a failure prompt message when the audio device has a failure.

In one embodiment of the present application, the audio device includes a speaker and a first microphone, and the obtaining module 310 includes a first control unit, a second control unit, a first determining module, an obtaining module, and a second determining module, wherein:

the first control unit is used for controlling the loudspeaker to play the audio signal;

the second control unit is used for controlling the first microphone to collect the audio signals played by the loudspeaker;

the first determining unit is used for determining a frequency response curve of the first microphone according to the audio signal collected by the first microphone;

an acquisition unit that acquires a transmission amount of the first microphone to an external reference point;

and the second determining unit is used for determining the frequency response curve of the first microphone at the external reference point according to the transmission quantity of the first microphone to the external reference point and the frequency response curve of the first microphone.

In an embodiment of the present application, the first determining unit is specifically configured to determine, according to the audio signal collected by the first microphone, a sound pressure level of the audio signal collected by the first microphone;

In an embodiment of the present application, the first determining unit is specifically configured to filter a noise signal from an audio signal collected by the first microphone, so as to obtain an audio signal subjected to noise reduction;

In an embodiment of the application, the audio device further comprises at least one second microphone, and the obtaining module 310 further comprises a third determining unit, wherein:

the acquisition unit is used for acquiring a frequency response curve of each second microphone at an external reference point by a user;

and a third determining unit, configured to determine a frequency response curve of the microphone array according to a frequency response curve of each of the second microphones at the external reference point and a frequency response curve of the first microphone at the external reference point, where the first microphone and the second microphone form the microphone array.

In an embodiment of the present application, the obtaining module 310 is further configured to obtain a training sample set, where the training sample set includes multiple groups of training samples, and one group of training samples includes a sample frequency response curve and a corresponding fault state;

in this embodiment, the apparatus 300 for detecting a fault of an audio device provided in this embodiment of the present application further includes a training module,

and the training module is used for obtaining the preset fault detection model according to the training sample set.

In an embodiment of the application, the training module is further configured to train the preset fault detection model according to a frequency response curve of the audio device.

In an embodiment of the present application, the apparatus 300 for detecting a failure of an audio device further includes a compensation module, where:

the compensation module is used for determining a compensation value according to a frequency response curve and a standard frequency response curve of the audio equipment under the condition that the audio equipment is in fault;

< apparatus embodiment >

The embodiment of the application provides an electronic device 400, and the electronic device 400 comprises the fault detection device 300 of the audio device, which is provided by any one of the above device embodiments.

Alternatively, as shown in fig. 4, the audio device comprises a memory 410 and a processor 420, wherein the memory 410 is used for storing computer instructions, and the processor 420 is used for calling the computer instructions from the memory 410 to execute the fault detection method of the audio device according to any one of the above method embodiments.

In an embodiment of the present application, the electronic device 400 may be an audio device itself, or may be an external electronic device connected to the audio device, such as a smart phone or a notebook computer.

< storage Medium embodiment >

The present application provides a computer-readable storage medium, on which a computer program is stored, which, when executed by a processor, implements a fault detection method of an audio device according to any one of the above method embodiments.

The present application may be a system, method and/or computer program product. The computer program product may include a computer-readable storage medium having computer-readable program instructions embodied thereon for causing a processor to implement various aspects of the present application.

The computer readable storage medium may be a tangible device that can hold and store the instructions for use by the instruction execution device. The computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, semiconductor memory device, or any suitable combination of the foregoing. More specific examples (a non-exhaustive list) of the computer readable storage medium would include the following: a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a Static Random Access Memory (SRAM), a portable compact disc read-only memory (CD-ROM), a Digital Versatile Disc (DVD), a memory stick, a floppy disk, a mechanical coding device, such as punch cards or in-groove projection structures having instructions stored thereon, and any suitable combination of the foregoing. Computer-readable storage media as used herein is not to be construed as transitory signals per se, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through a waveguide or other transmission medium (e.g., optical pulses through a fiber optic cable), or electrical signals transmitted through electrical wires.

The computer-readable program instructions described herein may be downloaded from a computer-readable storage medium to a respective computing/processing device, or to an external computer or external storage device via a network, such as the internet, a local area network, a wide area network, and/or a wireless network. The network may include copper transmission cables, fiber optic transmission, wireless transmission, routers, firewalls, switches, gateway computers and/or edge servers. The network adapter card or network interface in each computing/processing device receives computer-readable program instructions from the network and forwards the computer-readable program instructions for storage in a computer-readable storage medium in the respective computing/processing device.

The computer program instructions for carrying out operations of the present application may be assembler instructions, Instruction Set Architecture (ISA) instructions, machine-related instructions, microcode, firmware instructions, state setting data, or source code or object code written in any combination of one or more programming languages, including an object oriented programming language such as Smalltalk, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The computer-readable program instructions may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider). In some embodiments, the electronic circuitry can execute computer-readable program instructions to implement aspects of the present application by utilizing state information of the computer-readable program instructions to personalize the electronic circuitry, such as a programmable logic circuit, a Field Programmable Gate Array (FPGA), or a Programmable Logic Array (PLA).

Various aspects of the present application are described herein with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the application. It will be understood that each block of the flowchart illustrations and/or block diagrams, and combinations of blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer-readable program instructions.

These computer-readable program instructions may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks. These computer-readable program instructions may also be stored in a computer-readable storage medium that can direct a computer, programmable data processing apparatus, and/or other devices to function in a particular manner, such that the computer-readable medium storing the instructions comprises an article of manufacture including instructions which implement the function/act specified in the flowchart and/or block diagram block or blocks.

The computer readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other devices to cause a series of operational steps to be performed on the computer, other programmable apparatus or other devices to produce a computer implemented process such that the instructions which execute on the computer, other programmable apparatus or other devices implement the functions/acts specified in the flowchart and/or block diagram block or blocks.

The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present application. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of instructions, which comprises one or more executable instructions for implementing the specified logical function(s). In some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions. It is well known to those skilled in the art that implementation by hardware, by software, and by a combination of software and hardware are equivalent.

Having described embodiments of the present application, the foregoing description is intended to be exemplary, not exhaustive, and not limited to the disclosed embodiments. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described embodiments. The terms used herein were chosen in order to best explain the principles of the embodiments, the practical application, or technical improvements to the techniques in the marketplace, or to enable others of ordinary skill in the art to understand the embodiments disclosed herein. The scope of the application is defined by the appended claims.

Claims

1. A method of fault detection for an audio device, the method comprising:

acquiring a frequency response curve of the audio equipment;

2. The method of claim 1, wherein the audio device comprises a speaker and a first microphone, and wherein obtaining the frequency response curve of the audio device comprises:

controlling a loudspeaker to play an audio signal;

3. The method of claim 2, wherein determining the frequency response curve of the first microphone from the audio signal captured by the first microphone comprises:

4. The method according to claim 2 or 3, wherein the determining the frequency response curve of the first microphone according to the audio signal collected by the first microphone comprises:

5. The method of claim 2, wherein the audio device further comprises at least one second microphone, the method further comprising:

6. The method of claim 1, further comprising:

7. The method of claim 6, further comprising:

8. The method of claim 1, further comprising:

9. A failure detection apparatus of an audio device, the apparatus comprising:

10. An electronic device characterized by comprising the failure detection apparatus of the audio device according to claim 9;

or, comprising a loudspeaker, a first microphone, and a memory for storing computer instructions, and a processor for retrieving the computer instructions from the memory to perform the method of fault detection of an audio device according to any of claims 1-8.

11. A computer-readable storage medium, characterized in that a computer program is stored thereon, which computer program, when being executed by a processor, realizes the method of fault detection of an audio device according to any one of claims 1-8.