CN109982228B - Microphone fault detection method and mobile terminal - Google Patents
Microphone fault detection method and mobile terminal Download PDFInfo
- Publication number
- CN109982228B CN109982228B CN201910147752.3A CN201910147752A CN109982228B CN 109982228 B CN109982228 B CN 109982228B CN 201910147752 A CN201910147752 A CN 201910147752A CN 109982228 B CN109982228 B CN 109982228B
- Authority
- CN
- China
- Prior art keywords
- microphone
- fault
- output signal
- condition
- preset
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L25/00—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
- G10L25/93—Discriminating between voiced and unvoiced parts of speech signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
- H04M1/724—User interfaces specially adapted for cordless or mobile telephones
- H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
- H04M1/7243—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R29/00—Monitoring arrangements; Testing arrangements
- H04R29/004—Monitoring arrangements; Testing arrangements for microphones
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- Health & Medical Sciences (AREA)
- Human Computer Interaction (AREA)
- Acoustics & Sound (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Computational Linguistics (AREA)
- Multimedia (AREA)
- General Health & Medical Sciences (AREA)
- Otolaryngology (AREA)
- Business, Economics & Management (AREA)
- General Business, Economics & Management (AREA)
- Computer Networks & Wireless Communication (AREA)
- Telephone Function (AREA)
Abstract
The embodiment of the invention provides a microphone fault detection method and a mobile terminal, wherein the method comprises the following steps: acquiring an output signal of a microphone under the condition that the microphone is started; and under the condition that the output signal meets a first preset condition, determining the microphone fault and reminding. In the embodiment of the invention, the mobile terminal can automatically execute the fault detection of the microphone according to the starting condition of the microphone and carry out the fault prompt, the detection process cannot be sensed by a user, and the fault prompt is carried out only when the fault of the microphone is detected, so that the user can know that the fault of the microphone occurs only according to the prompt, and the convenience of the fault detection of the microphone of the mobile terminal user is greatly improved.
Description
Technical Field
The present invention relates to the field of mobile communications, and in particular, to a microphone fault detection method and a mobile terminal.
Background
The microphone is an important device in the mobile terminal, and the microphone can convert a sound signal into an electric signal, so that functions of the mobile terminal such as conversation and recording are realized.
If the microphone fails, the call or recording function of the mobile terminal cannot be realized, and in the prior art, it is usually required that a mobile terminal user determines whether the microphone fails according to a use condition, for example, the user finds that the opposite side often cannot hear the user's own voice during the call, and finds that the microphone may fail after the call with multiple people or after multiple tests.
The applicant has found that the above technical solution has the following drawbacks: by means of microphone detection of a mobile terminal user, detection result accuracy is low, and inconvenience is brought to the user when the mobile terminal is used.
Disclosure of Invention
The embodiment of the invention provides a microphone fault detection method and a mobile terminal, and aims to solve the problem that microphone fault detection cannot meet the actual requirements of users.
In order to solve the above technical problem, the present invention provides a microphone fault detection method, which is applied to a mobile terminal, and the method includes:
acquiring an output signal of a microphone under the condition that the microphone is started;
and under the condition that the output signal meets a first preset condition, determining the microphone fault and reminding.
An embodiment of the present invention further provides a mobile terminal, including:
the output signal acquisition module is used for acquiring an output signal of the microphone under the condition that the microphone is started;
and the fault reminding module is used for determining the fault of the microphone and reminding the fault of the microphone under the condition that the output signal meets a first preset condition.
The embodiment of the present invention further provides a mobile terminal, which includes a processor, a memory, and a computer program stored in the memory and capable of running on the processor, and when the computer program is executed by the processor, the steps of the microphone failure detection method are implemented.
An embodiment of the present invention further provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements the steps of the foregoing microphone fault detection method.
In the embodiment of the invention, the starting condition of the microphone can be detected, the output signal of the microphone is obtained under the condition that the microphone is started, and the fault of the microphone is determined and reminded under the condition that the output signal meets the first preset condition.
Drawings
FIG. 1 is a flow chart of the steps of a microphone fault detection method according to an embodiment of the present invention;
fig. 2 is a schematic diagram of a dual-microphone terminal according to an embodiment of the present invention;
fig. 3 is a flowchart illustrating specific steps of a microphone fault detection method according to an embodiment of the present invention;
fig. 4 is a block diagram of a mobile terminal according to an embodiment of the present invention;
fig. 5 is a block diagram of a detailed structure of a mobile terminal according to an embodiment of the present invention;
fig. 6 is a block diagram of a mobile terminal according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Referring to fig. 1, a flow chart illustrating steps of a microphone fault detection method in an embodiment of the present invention is shown. The method is applied to the mobile terminal, and comprises the following specific steps:
step 101: in the case of a microphone activation, an output signal of the microphone is acquired.
In a specific application, the embodiment of the invention can be applied to a mobile terminal, and the mobile terminal includes but is not limited to a mobile phone, a tablet computer, a notebook computer, a palm computer, a vehicle-mounted terminal, a wearable device, a pedometer and the like.
In a specific application, the microphone may be a silicon microphone or other types of microphones, and the microphone is not particularly limited in the embodiment of the present invention.
In some scenarios, a plurality of microphones may be included in the mobile terminal, as shown in fig. 2, a main microphone 10 and a sub-microphone 20 may exist in the plurality of microphones, the main microphone may be used for regular conversation, recording, and the like, the sub-microphone may be used for mobile phone ambient noise to implement a conversation noise cancellation function, and the microphone in the embodiment of the present invention may be a main microphone used for conversation, recording, and the like. It can be understood that, if there are multiple microphones for call recording and other functions, any one of the microphones may be selected for fault detection according to the identifier of each microphone, and this is not particularly limited in the embodiment of the present invention. In a preferred embodiment, a microphone requiring fault detection may be defined in the mobile terminal, for example, a detection flag of the microphone requiring fault detection is set, and the output signal of the microphone is acquired only when the microphone requiring fault detection is defined to be activated.
In specific applications, there are many scenes in which the microphone is started, for example, the mobile terminal starts a call or recording function, or third-party software calls the microphone to complete some functions, such as a video or voice function of social software, and when the microphone is started, a mobile terminal user usually performs voice entry, so that an output signal of the microphone can be acquired.
Step 102: and under the condition that the output signal meets a first preset condition, determining the microphone fault and reminding.
In the embodiment of the invention, if the output signal meets the first preset condition, the fault of the microphone can be shown, and further the fault prompt of the microphone can be automatically carried out.
In a specific application, if the microphone is not faulty, the output signal may be a normal speech signal, or a speech signal mixed with a part of noise signal. If the microphone fails, the reason that the microphone may fail in the mobile terminal may be: the microphone has no signal output due to the fact that the microphone diaphragm is broken, and the amplitude of the waveform of the output signal is close to 0; due to the abnormality of the microphone, continuous random noise exists in an output signal, so that human voice is covered, and the voice is reflected that the recording can only hear the noise, and the human voice is weak or has no human voice; the abnormal microphone makes the output sound smaller, which affects the normal communication/recording effect; due to the fact that the microphone pickup hole is blocked, the input sound signal is weak, and the signal output by the microphone is very weak, which is similar to no signal output.
In the case of several of the above-mentioned microphone failures, the common feature is that the microphone has no output signal or less effective speech of the output signal in the case of recording a normal sound signal using the microphone. Therefore, it is possible to determine whether the microphone is malfunctioning by matching the output signal with the first preset condition.
In practical application, the first preset condition may be set according to an actual application scenario, for example, the first preset condition may be: the output signal does not have a voice signal, the output signal has an error, and the like, as long as the first preset condition can be used for determining whether the output signal is normal, which is not specifically limited in the embodiment of the present invention.
In specific application, the microphone fault reminding mode may be as follows: and popping up a prompt box on a user interface of the mobile terminal, and prompting the user that the microphone fails through characters, pictures, sound, videos and the like in the prompt box. The microphone failure prompt may be performed by: carrying out corresponding voice prompt, vibration prompt, flickering light-emitting device prompt and the like according to preset; it can be understood that a person skilled in the art may set an adaptive microphone failure prompting manner according to an actual application scenario, and the embodiment of the present invention is not limited in this respect.
In practical application, if the output signal does not satisfy the first preset condition, it may be indicated that no microphone fault is found in the preliminary determination, and no prompt may be performed to end the microphone fault detection.
In summary, in the embodiment of the present invention, the starting condition of the microphone may be detected, the output signal of the microphone is obtained when the microphone is started, and the microphone fault is determined and prompted when the output signal meets the first preset condition, that is, in the embodiment of the present invention, the mobile terminal may automatically perform fault detection on the microphone according to the starting condition of the microphone, and perform fault prompting, where the detection process is not sensed by the user, and only when the microphone fault is detected, the fault prompting is performed, so that the user can know that the microphone is faulty only according to the prompting, and convenience in microphone fault detection of the mobile terminal user is greatly improved.
Referring to fig. 3, a flowchart illustrating specific steps of a microphone failure detection method in an embodiment of the present invention is shown. The method comprises the following specific steps:
step 201: in the case of a microphone activation, an output signal of the microphone is acquired.
As a preferred implementation manner of the embodiment of the present invention, before step 201, the method may further include: a current environment is identified.
In the embodiment of the present invention, considering that if the microphone is in a noisy environment, a large number of noise signals may exist in an output signal of the microphone, which may cause large interference to fault detection of the microphone, and even cause erroneous judgment, at first, the current environment is identified at the beginning of fault detection of the microphone according to the embodiment of the present invention.
In particular applications, the current environment may include a quiet environment and a noisy environment; the quiet environment may specifically be an environment in which the sound noise value is lower than a preset threshold, and correspondingly, the noisy environment may be an environment in which the sound noise value is higher than the preset threshold; it can be understood that the preset threshold may be set according to an actual application scenario, and this is not specifically limited in the embodiment of the present invention.
In a specific application, step 201 may be performed when the current environment is a quiet environment, so as to improve the accuracy of microphone fault detection.
It can be understood that if the microphone is only occupied for a very short time, the obtained output signal may not be enough to analyze whether the microphone is faulty, and therefore, in order to obtain an output signal that can be used for accurately analyzing the microphone fault, in a preferred implementation of the embodiment of the present invention, the obtaining the output signal of the microphone in the case that the microphone is started includes: and acquiring an output signal of the microphone under the condition that the starting of the microphone exceeds a second preset time length.
In specific application, the starting condition of a microphone interface can be detected in a background of the mobile terminal, and if the starting time of the microphone exceeds a second preset time, an output signal of the microphone is acquired; the second preset time length may be set according to an actual application scenario, and the second preset time length is not specifically limited in the embodiment of the present invention.
Step 202: and comparing the actual signal time length of the detection signal with a first preset time length.
In the embodiment of the present invention, the first preset time duration may be set according to an actual application scenario, for example, if an output signal of a microphone is to be detected through an algorithm a in the mobile terminal, and an output signal of a time duration of T needs to be fixedly input in the algorithm a, the first preset time duration may be set to T.
In the embodiment of the invention, if the actual signal duration of the output signal is greater than or equal to the first preset duration T, the obtained effective output signal is indicated, and the output signal can be further detected; if the actual signal duration of the output signal is less than the preset duration, the microphone may not be subjected to fault detection through the output signal, and the obtained output signal may be considered as an invalid output signal.
Step 203: and detecting the output signal under the condition that the actual signal duration of the output signal is greater than or equal to the first preset duration.
In the embodiment of the present invention, when the actual signal duration of the output signal is greater than or equal to the first preset duration, it can be said that the valid output signal is obtained, and therefore the output signal can be detected.
In the embodiment of the invention, invalid output signals can be screened out through the step 202 and the step 203, only valid output signals are detected, invalid signal detection calculation is avoided, and further the calculation resources of the mobile terminal are saved.
In a specific application, if the actual signal duration of the output signal is less than the second preset duration, it may be indicated that an invalid output signal is obtained, and it may be detected whether the microphone is still running a call or recording function, and if the microphone is still occupied, the determining steps from step 201 to step 203 may be performed again.
As a preferable solution of the embodiment of the present invention, the step of detecting the output signal includes:
substep A1: and performing framing operation on the output signal to obtain a target signal.
Substep A2: and respectively extracting the voice characteristics of each frame of the target signal.
Substep A3: and analyzing the voice characteristics.
In the embodiment of the present invention, taking an output signal with an acquisition duration of T as an example, the output signal may be divided into N frames, where the frame length of each frame is T/N, where N may be set according to a detection algorithm for detecting the output signal, and N is not specifically limited in the embodiment of the present invention.
The output signal after framing is taken as a target signal, and the voice characteristics of each frame of signal of the target signal can be respectively extracted. In a specific application, the voice feature may be a feature indicating a sound signal or a noise signal, and whether the microphone is malfunctioning or not may be determined by analyzing the voice feature.
In the embodiment of the invention, a specific method for detecting the output signal is provided, and the detection method is used for performing framing operation on the output signal and extracting the voice characteristics of the output signal frame by frame for analysis, so that an accurate detection result can be obtained.
Step 204: and under the condition that the output signal meets a first preset condition, determining the microphone fault and reminding.
As a preferable solution of the embodiment of the present invention, the voice feature includes at least one of: short-time average energy, short-time average zero-crossing rate, information entropy and autocorrelation coefficient.
In a specific application, since the energy of a speech signal changes with time, the energy difference between unvoiced speech and voiced speech is quite significant, and therefore, the feature transformation condition of speech can be described by analyzing the short-time energy and the short-time average amplitude, the short-time average energy can represent the short-time energy, and the short-time average zero-crossing rate can represent the short-time average amplitude. In addition, in a normal voice signal, the repetition possibility is small, in a noise signal, the repetition possibility is large, in the concept of entropy, more information is needed to determine the uncertain content, and in the information theory, the output of a source is random quantity, so the uncertainty can be measured by probability distribution, so that the voice signal is usually noise with large information entropy and is usually voice signal with small information entropy; moreover, when a person pronounces, the vocal cords vibrate to sound, the voice usually shows a certain periodicity, and the noise has no periodicity, so that the voice signal with a large autocorrelation coefficient and the noise signal with a small autocorrelation coefficient of the voice feature in the output signal can be usually output.
Based on this, the step of determining the microphone fault and performing the warning when the output signal satisfies the first preset condition includes:
determining that the microphone fault is determined as follows under the condition that the short-time average energy of each frame of the target signal is smaller than a preset low energy threshold value and the short-time average zero crossing rate of each frame of the target signal is smaller than a preset low zero crossing rate threshold value: the microphone body fault or the microphone access fault is detected and reminded;
or the like, or, alternatively,
determining that the microphone fault is determined as follows under the condition that the short-time average energy of each frame of the target signal is between the preset low energy threshold and the preset high energy threshold and the short-time average zero crossing rate of each frame of the target signal is greater than the preset high zero crossing rate threshold: the microphone body fault or the microphone access fault is detected and reminded;
or the like, or, alternatively,
under the condition that the information entropy of each frame of the target signal is larger than a preset information entropy threshold value, determining that the microphone fault is: the microphone body fault or the microphone access fault is detected and reminded;
or the like, or, alternatively,
determining the microphone fault as follows under the condition that the autocorrelation coefficient of each frame of the target signal is smaller than a preset coefficient threshold value: and (4) the microphone body or the microphone access is failed, and reminding is carried out.
In the embodiment of the invention, firstly, taking short-time average energy and short-time average zero-crossing rate as examples, a specific method for judging microphone faults is explained, short-time average energy En and short-time average zero-crossing rate Zn of each frame of signal of a target signal are respectively obtained through calculation, and high and low two decision thresholds TEH and TEL are set for En, wherein TEH is greater than TEL; accordingly, Zn sets two high and low decision thresholds TZH and TZL, and TZH > TZL.
If En < TEL and Zn < TZL, indicating that the energy and zero-crossing rate of the frame are both very low, even equal to 0, the frame can be determined to be a silent segment; if TEL < En < TEH, and Zn > TZH, it can be determined as a noise segment because the energy of random noise is usually small and the zero-crossing rate is high; if En > TEH and Zn > TZL, then it is determined to be a speech segment.
After each frame of signal is marked, the signal is judged according to the actual failure scene. If the signal only has the silence segment, the microphone body or the microphone channel is possibly abnormal, and the microphone has no signal output or has small sound; if the signal only has a noise section or the voice section is far less than the noise section, it indicates that the microphone body may have abnormality, and the noise interferes with the normal conversation or recording effect. It can be understood that the above process of determining the microphone failure is based on several common user side failure modes, and actually there will be slight differences in each failure example, but these can be adapted by adjusting the detection algorithm, and the principle is based on analyzing whether the output signal of the microphone conforms to the characteristics of the normal voice signal.
Based on a similar principle, in the case that the information entropy of each frame of the target signal is greater than the preset information entropy threshold, the microphone fault can be determined as follows: a microphone body failure or a microphone path failure; and under the condition that the autocorrelation coefficient of each frame of the target signal is smaller than a preset coefficient threshold value, determining that the microphone fault is as follows: a microphone body failure or a microphone path failure.
In an embodiment, the speech segments of TZL < Zn < TZH may be defined as voiced and the speech segments of Zn > TZH may be defined as unvoiced according to the difference of the short-time average zero-crossing rate of each frame of the target signal, so as to reduce the probability of misinterpreting the noise segments as speech segments according to the distribution of unvoiced and voiced sounds, which is not specifically limited in the embodiments of the present invention.
In the embodiment of the invention, an inventor obtains a specific common fault situation of the microphone according to a large number of experiments, provides the extracted specific voice characteristic content according to the common fault situation and a specific method for judging whether the microphone is in fault, and verifies that the microphone fault with a larger proportion in an actual application scene can be determined by the judging method of the embodiment of the invention, so that the method for determining the microphone fault is high-efficiency and high-accuracy.
As a preferable solution of the embodiment of the present invention, after step 204, the method may further include: displaying after-market service information corresponding to the microphone.
In the embodiment of the invention, after the microphone is detected to have a fault, prompt information is displayed on a user interface of the mobile terminal to remind a user that the microphone may have the fault, the user is advised to further detect and confirm, and after-sale service information of the microphone is provided at the same time, wherein the after-sale service information can be address information, contact information and the like of after-sale points near the user; furthermore, the function of reserving after-sale service by one key can be provided, and a user can conveniently maintain the related after-sale places according to the after-sale service information or contact customer service and the like according to the after-sale service information, so that the user experience can be improved.
In summary, in the embodiment of the present invention, the starting condition of the microphone may be detected, the output signal of the microphone is obtained when the microphone is started, and the microphone fault is determined and prompted when the output signal meets the first preset condition, that is, in the embodiment of the present invention, the mobile terminal may automatically perform fault detection on the microphone according to the starting condition of the microphone, and perform fault prompting, where the detection process is not sensed by the user, and only when the microphone fault is detected, the fault prompting is performed, so that the user can know that the microphone has a fault only according to the prompting, and the convenience in detecting the microphone fault of the mobile terminal user is greatly improved.
It should be noted that the foregoing method embodiments are described as a series of acts or combinations for simplicity in explanation, but it should be understood by those skilled in the art that the present invention is not limited by the order of acts or acts described, as some steps may occur in other orders or concurrently in accordance with the invention. Further, those skilled in the art will appreciate that the embodiments described in the specification are presently preferred and that no particular act is required to implement the invention.
Referring to fig. 4, a block diagram of a mobile terminal 300 according to an embodiment of the present invention is shown. The method comprises the following steps:
an output signal acquiring module 310, configured to acquire an output signal of a microphone when the microphone is started;
and a fault reminding module 320, configured to determine that the microphone has a fault and remind the microphone when the output signal meets a first preset condition.
Preferably, referring to fig. 5, in addition to fig. 4, the mobile terminal further includes:
a comparing module 330, configured to compare an actual signal duration of the output signal with a first preset duration;
an output signal detection module 340, configured to detect the output signal when an actual signal duration of the output signal is greater than or equal to the first preset duration.
The output signal detection module 340 includes:
a framing submodule 3401, configured to perform framing operation on the output signal to obtain a target signal;
a voice feature extraction sub-module 3402, configured to extract a voice feature of each frame of the target signal respectively;
an analysis sub-module 3403 for analyzing the speech features.
The speech features include at least one of: short-time average energy, short-time average zero-crossing rate, information entropy and autocorrelation coefficient.
The fault notification module 320 includes:
a fault reminding sub-module, configured to determine that the microphone fault is: the microphone body fault or the microphone access fault is detected and reminded;
or the like, or, alternatively,
determining that the microphone fault is determined as follows under the condition that the short-time average energy of each frame of the target signal is between the preset low energy threshold and the preset high energy threshold and the short-time average zero crossing rate of each frame of the target signal is greater than the preset high zero crossing rate threshold: the microphone body fault or the microphone access fault is detected and reminded;
or the like, or, alternatively,
under the condition that the information entropy of each frame of the target signal is larger than a preset information entropy threshold value, determining that the microphone fault is: the microphone body fault or the microphone access fault is detected and reminded;
or the like, or, alternatively,
determining the microphone fault as follows under the condition that the autocorrelation coefficient of each frame of the target signal is smaller than a preset coefficient threshold value: and (4) the microphone body or the microphone access is failed, and reminding is carried out.
The output signal acquiring module 310 includes:
the output signal obtaining sub-module 3101 is configured to obtain an output signal of the microphone when the start time of the microphone exceeds a second preset time.
In the embodiment of the invention, the starting condition of the microphone can be detected, the output signal of the microphone is obtained under the condition that the microphone is started, and the fault of the microphone is determined and reminded under the condition that the output signal meets the first preset condition.
The mobile terminal can implement each process implemented by the mobile terminal in the method embodiments of fig. 1 to fig. 3, and details are not repeated here to avoid repetition.
Fig. 6 is a schematic diagram of a hardware structure of a mobile terminal implementing various embodiments of the present invention.
The mobile terminal 500 includes, but is not limited to: a radio frequency unit 501, a network module 502, an audio output unit 503, an input unit 504, a sensor 505, a display unit 506, a user input unit 507, an interface unit 508, a memory 509, a processor 510, and a power supply 511. Those skilled in the art will appreciate that the mobile terminal architecture shown in fig. 6 is not intended to be limiting of mobile terminals, and that a mobile terminal may include more or fewer components than shown, or some components may be combined, or a different arrangement of components. In the embodiment of the present invention, the mobile terminal includes, but is not limited to, a mobile phone, a tablet computer, a notebook computer, a palm computer, a vehicle-mounted terminal, a wearable device, a pedometer, and the like.
The processor 510 is configured to, in a case that a microphone is started, acquire an output signal of the microphone; and under the condition that the output signal meets a first preset condition, determining the microphone fault and reminding.
In the embodiment of the invention, the starting condition of the microphone can be detected, the output signal of the microphone is obtained under the condition that the microphone is started, and the fault of the microphone is determined and reminded under the condition that the output signal meets the first preset condition.
It should be understood that, in the embodiment of the present invention, the radio frequency unit 501 may be used for receiving and sending signals during a message sending and receiving process or a call process, and specifically, receives downlink data from a base station and then processes the received downlink data to the processor 510; in addition, the uplink data is transmitted to the base station. In general, radio frequency unit 501 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like. In addition, the radio frequency unit 501 can also communicate with a network and other devices through a wireless communication system.
The mobile terminal provides the user with wireless broadband internet access through the network module 502, such as helping the user send and receive e-mails, browse webpages, access streaming media, and the like.
The audio output unit 503 may convert audio data received by the radio frequency unit 501 or the network module 502 or stored in the memory 509 into an audio signal and output as sound. Also, the audio output unit 503 may also provide audio output related to a specific function performed by the mobile terminal 500 (e.g., a call signal reception sound, a message reception sound, etc.). The audio output unit 503 includes a speaker, a buzzer, a receiver, and the like.
The input unit 504 is used to receive an audio or video signal. The input Unit 504 may include a Graphics Processing Unit (GPU) 5041 and a microphone 5042, and the Graphics processor 5041 processes image data of a still picture or video obtained by an image capturing device (e.g., a camera) in a video capturing mode or an image capturing mode. The processed image frames may be displayed on the display unit 506. The image frames processed by the graphic processor 5041 may be stored in the memory 509 (or other storage medium) or transmitted via the radio frequency unit 501 or the network module 502. The microphone 5042 may receive sounds and may be capable of processing such sounds into audio data. The processed audio data may be converted into a format output transmittable to a mobile communication base station via the radio frequency unit 501 in case of the phone call mode.
The mobile terminal 500 also includes at least one sensor 505, such as a light sensor, motion sensor, and other sensors. Specifically, the light sensor includes an ambient light sensor that adjusts the brightness of the display panel 5061 according to the brightness of ambient light, and a proximity sensor that turns off the display panel 5061 and/or a backlight when the mobile terminal 500 is moved to the ear. As one of the motion sensors, the accelerometer sensor can detect the magnitude of acceleration in each direction (generally three axes), detect the magnitude and direction of gravity when stationary, and can be used to identify the posture of the mobile terminal (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), and vibration identification related functions (such as pedometer, tapping); the sensors 505 may also include fingerprint sensors, pressure sensors, iris sensors, molecular sensors, gyroscopes, barometers, hygrometers, thermometers, infrared sensors, etc., which are not described in detail herein.
The display unit 506 is used to display information input by the user or information provided to the user. The Display unit 506 may include a Display panel 5061, and the Display panel 5061 may be configured in the form of a Liquid Crystal Display (LCD), an Organic Light-Emitting Diode (OLED), or the like.
The user input unit 507 may be used to receive input numeric or character information and generate key signal inputs related to user settings and function control of the mobile terminal. Specifically, the user input unit 507 includes a touch panel 5071 and other input devices 5072. Touch panel 5071, also referred to as a touch screen, may collect touch operations by a user on or near it (e.g., operations by a user on or near touch panel 5071 using a finger, stylus, or any suitable object or attachment). The touch panel 5071 may include two parts of a touch detection device and a touch controller. The touch detection device detects the touch direction of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch sensing device, converts the touch information into touch point coordinates, sends the touch point coordinates to the processor 510, and receives and executes commands sent by the processor 510. In addition, the touch panel 5071 may be implemented in various types such as a resistive type, a capacitive type, an infrared ray, and a surface acoustic wave. In addition to the touch panel 5071, the user input unit 507 may include other input devices 5072. In particular, other input devices 5072 may include, but are not limited to, a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which are not described in detail herein.
Further, the touch panel 5071 may be overlaid on the display panel 5061, and when the touch panel 5071 detects a touch operation thereon or nearby, the touch operation is transmitted to the processor 510 to determine the type of the touch event, and then the processor 510 provides a corresponding visual output on the display panel 5061 according to the type of the touch event. Although in fig. 6, the touch panel 5071 and the display panel 5061 are two independent components to implement the input and output functions of the mobile terminal, in some embodiments, the touch panel 5071 and the display panel 5061 may be integrated to implement the input and output functions of the mobile terminal, and is not limited herein.
The interface unit 508 is an interface through which an external device is connected to the mobile terminal 500. For example, the external device may include a wired or wireless headset port, an external power supply (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device having an identification module, an audio input/output (I/O) port, a video I/O port, an earphone port, and the like. The interface unit 508 may be used to receive input (e.g., data information, power, etc.) from external devices and transmit the received input to one or more elements within the mobile terminal 500 or may be used to transmit data between the mobile terminal 500 and external devices.
The memory 509 may be used to store software programs as well as various data. The memory 509 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required by at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may store data (such as audio data, a phonebook, etc.) created according to the use of the cellular phone, and the like. Further, the memory 509 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid-state storage device.
The processor 510 is a control center of the mobile terminal, connects various parts of the entire mobile terminal using various interfaces and lines, and performs various functions of the mobile terminal and processes data by operating or executing software programs and/or modules stored in the memory 509 and calling data stored in the memory 509, thereby performing overall monitoring of the mobile terminal. Processor 510 may include one or more processing units; preferably, the processor 510 may integrate an application processor, which mainly handles operating systems, user interfaces, application programs, etc., and a modem processor, which mainly handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into processor 510. The mobile terminal 500 may further include a power supply 511 (e.g., a battery) for supplying power to various components, and preferably, the power supply 511 may be logically connected to the processor 510 via a power management system, so that functions of managing charging, discharging, and power consumption are performed via the power management system.
In addition, the mobile terminal 500 includes some functional modules that are not shown, and thus, are not described in detail herein.
Preferably, an embodiment of the present invention further provides a mobile terminal, which includes a processor 510, a memory 509, and a computer program that is stored in the memory 509 and can be run on the processor 510, and when the computer program is executed by the processor 510, the processes of the microphone failure detection method embodiment are implemented, and the same technical effects can be achieved, and no further description is provided here for avoiding repetition.
The embodiment of the present invention further provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the computer program implements each process of the above-mentioned microphone fault detection method embodiment, and can achieve the same technical effect, and in order to avoid repetition, details are not repeated here. The computer-readable storage medium may be a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present invention.
While the present invention has been described with reference to the embodiments shown in the drawings, the present invention is not limited to the embodiments, which are illustrative and not restrictive, and it will be apparent to those skilled in the art that various changes and modifications can be made therein without departing from the spirit and scope of the invention as defined in the appended claims.
Claims (4)
1. A microphone fault detection method, the method comprising:
acquiring an output signal of a microphone under the condition that the microphone is started;
determining the microphone fault and reminding under the condition that the output signal meets a first preset condition;
after the obtaining of the output signal of the microphone, the method further includes:
comparing the actual signal duration of the output signal with a first preset duration;
detecting the output signal under the condition that the actual signal duration of the output signal is greater than or equal to the first preset duration;
the step of detecting the output signal comprises:
performing framing operation on the output signal to obtain a target signal;
respectively extracting the voice characteristics of each frame of the target signal;
analyzing the voice features;
the speech features include at least one of: short-time average energy, short-time average zero-crossing rate, information entropy and autocorrelation coefficient;
under the condition that the output signal meets a first preset condition, determining the microphone fault and reminding the microphone fault, wherein the method comprises the following steps:
determining that the microphone fault is determined as follows under the condition that the short-time average energy of each frame of the target signal is smaller than a preset low energy threshold value and the short-time average zero crossing rate of each frame of the target signal is smaller than a preset low zero crossing rate threshold value: the microphone body fault or the microphone access fault is detected and reminded;
or the like, or, alternatively,
determining that the microphone fault is determined as follows under the condition that the short-time average energy of each frame of the target signal is between the preset low energy threshold and the preset high energy threshold and the short-time average zero crossing rate of each frame of the target signal is greater than the preset high zero crossing rate threshold: the microphone body fault or the microphone access fault is detected and reminded;
or the like, or, alternatively,
under the condition that the information entropy of each frame of the target signal is larger than a preset information entropy threshold value, determining that the microphone fault is: the microphone body fault or the microphone access fault is detected and reminded;
or the like, or, alternatively,
determining the microphone fault as follows under the condition that the autocorrelation coefficient of each frame of the target signal is smaller than a preset coefficient threshold value: and (4) the microphone body or the microphone access is failed, and reminding is carried out.
2. The method of claim 1, wherein acquiring the output signal of the microphone when the microphone is activated comprises:
and acquiring an output signal of the microphone under the condition that the starting time of the microphone exceeds a second preset time.
3. A mobile terminal, characterized in that the mobile terminal comprises:
the output signal acquisition module is used for acquiring an output signal of the microphone under the condition that the microphone is started;
the fault reminding module is used for determining the fault of the microphone and reminding the fault of the microphone under the condition that the output signal meets a first preset condition;
the comparison module is used for comparing the actual signal time length of the output signal with a first preset time length;
the output signal detection module is used for detecting the output signal under the condition that the actual signal duration of the output signal is greater than or equal to the first preset duration;
the output signal detection module includes:
the framing submodule is used for framing the output signal to obtain a target signal;
the voice feature extraction submodule is used for respectively extracting the voice feature of each frame of the target signal;
an analysis submodule for analyzing the speech features;
the speech features include at least one of: short-time average energy, short-time average zero-crossing rate, information entropy and autocorrelation coefficient;
the fault reminding module comprises:
a fault reminding sub-module, configured to determine that the microphone fault is: the microphone body fault or the microphone access fault is detected and reminded;
or the like, or, alternatively,
determining that the microphone fault is determined as follows under the condition that the short-time average energy of each frame of the target signal is between the preset low energy threshold and the preset high energy threshold and the short-time average zero crossing rate of each frame of the target signal is greater than the preset high zero crossing rate threshold: the microphone body fault or the microphone access fault is detected and reminded;
or the like, or, alternatively,
under the condition that the information entropy of each frame of the target signal is larger than a preset information entropy threshold value, determining that the microphone fault is: the microphone body fault or the microphone access fault is detected and reminded;
or the like, or, alternatively,
determining the microphone fault as follows under the condition that the autocorrelation coefficient of each frame of the target signal is smaller than a preset coefficient threshold value: and (4) the microphone body or the microphone access is failed, and reminding is carried out.
4. The mobile terminal of claim 3, wherein the output signal obtaining module comprises:
and the output signal acquisition submodule is used for acquiring the output signal of the microphone under the condition that the starting time length of the microphone exceeds a second preset time length.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910147752.3A CN109982228B (en) | 2019-02-27 | 2019-02-27 | Microphone fault detection method and mobile terminal |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910147752.3A CN109982228B (en) | 2019-02-27 | 2019-02-27 | Microphone fault detection method and mobile terminal |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109982228A CN109982228A (en) | 2019-07-05 |
| CN109982228B true CN109982228B (en) | 2020-11-03 |
Family
ID=67077530
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910147752.3A Active CN109982228B (en) | 2019-02-27 | 2019-02-27 | Microphone fault detection method and mobile terminal |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109982228B (en) |
Families Citing this family (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110445781B (en) * | 2019-08-06 | 2021-11-23 | 广州市百果园信息技术有限公司 | Voice detection method of chat room and related equipment |
| CN110677780B (en) * | 2019-09-26 | 2021-12-14 | 北京小米移动软件有限公司 | Detection method and device of audio input module and storage medium |
| CN111491247B (en) * | 2020-03-17 | 2022-05-31 | 广州视源电子科技股份有限公司 | Microphone hole plugging detection method and device, storage medium and related equipment |
| CN111601224B (en) * | 2020-04-10 | 2022-06-10 | 歌尔微电子有限公司 | Microphone performance testing method and device and electronic equipment |
| CN112866690B (en) * | 2021-01-08 | 2022-07-19 | 深圳创维－Rgb电子有限公司 | Microphone fault detection circuit, detection method and equipment thereof, and storage medium |
| CN113674758A (en) * | 2021-07-09 | 2021-11-19 | 南京航空航天大学 | Wind noise judgment method and device based on smart phone and electronic equipment |
| CN113891228A (en) * | 2021-09-24 | 2022-01-04 | 珠海格力电器股份有限公司 | Microphone fault detection method and device, control equipment, air conditioner and storage medium |
| CN114040312B (en) * | 2021-11-29 | 2023-08-22 | 四川虹美智能科技有限公司 | Microphone detection method and system of voice air conditioner |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5822718A (en) * | 1997-01-29 | 1998-10-13 | International Business Machines Corporation | Device and method for performing diagnostics on a microphone |
| JP2009151299A (en) * | 2007-12-20 | 2009-07-09 | Toshiba Corp | Method and device for detecting speech spectrum peak, and speech recognition method and speech recognition system |
| CN103929707A (en) * | 2014-04-08 | 2014-07-16 | 深圳市中兴移动通信有限公司 | Method for detecting conditions of microphone voice-grade channels and terminal |
| CN106197650A (en) * | 2016-08-30 | 2016-12-07 | 陕西千山航空电子有限责任公司 | A kind of method judging that audio signal is noiseless |
| CN108419200A (en) * | 2018-01-30 | 2018-08-17 | 海尔优家智能科技（北京）有限公司 | A kind of microphone array fault detection method and device |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111343558B (en) * | 2018-07-26 | 2022-02-15 | Oppo广东移动通信有限公司 | Microphone hole blockage detection method and related product |
| CN109195090B (en) * | 2018-09-05 | 2021-01-22 | 苏州思必驰信息科技有限公司 | Method and system for testing electroacoustic parameters of microphone in product |
-
2019
- 2019-02-27 CN CN201910147752.3A patent/CN109982228B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5822718A (en) * | 1997-01-29 | 1998-10-13 | International Business Machines Corporation | Device and method for performing diagnostics on a microphone |
| JP2009151299A (en) * | 2007-12-20 | 2009-07-09 | Toshiba Corp | Method and device for detecting speech spectrum peak, and speech recognition method and speech recognition system |
| CN103929707A (en) * | 2014-04-08 | 2014-07-16 | 深圳市中兴移动通信有限公司 | Method for detecting conditions of microphone voice-grade channels and terminal |
| CN106197650A (en) * | 2016-08-30 | 2016-12-07 | 陕西千山航空电子有限责任公司 | A kind of method judging that audio signal is noiseless |
| CN108419200A (en) * | 2018-01-30 | 2018-08-17 | 海尔优家智能科技（北京）有限公司 | A kind of microphone array fault detection method and device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109982228A (en) | 2019-07-05 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109982228B (en) | Microphone fault detection method and mobile terminal | |
| CN109215683B (en) | Prompting method and terminal | |
| CN107846516B (en) | Call scene prompting method and mobile terminal | |
| CN108319442B (en) | Audio playing control method and mobile terminal | |
| CN108551534B (en) | Method and device for multi-terminal voice call | |
| CN107835495B (en) | Message prompting method and device and mobile terminal | |
| CN107886969B (en) | Audio playing method and audio playing device | |
| CN108848267B (en) | Audio playing method and mobile terminal | |
| CN110225195B (en) | Voice communication method and terminal | |
| CN106940997B (en) | Method and device for sending voice signal to voice recognition system | |
| CN108521501B (en) | Voice input method, mobile terminal and computer readable storage medium | |
| CN108681413B (en) | Control method of display module and mobile terminal | |
| CN111182118B (en) | Volume adjusting method and electronic equipment | |
| CN108307048B (en) | Message output method and device and mobile terminal | |
| CN109982273B (en) | Information reply method and mobile terminal | |
| CN109451158B (en) | Reminding method and device | |
| CN108307075B (en) | Incoming call processing method and mobile terminal | |
| CN108093119B (en) | Strange incoming call number marking method and mobile terminal | |
| CN110784394A (en) | Prompting method and electronic equipment | |
| CN108597495B (en) | Method and device for processing voice data | |
| CN108319440B (en) | Audio output method and mobile terminal | |
| CN110913070B (en) | Call method and terminal equipment | |
| CN109348366B (en) | Method for adjusting volume by using electrical parameters and mobile terminal | |
| CN109274814B (en) | Message prompting method and device and terminal equipment | |
| CN109451143B (en) | Call method and mobile terminal |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |