CN108877837B - Audio signal abnormality identification method, device and storage medium - Google Patents
Audio signal abnormality identification method, device and storage medium Download PDFInfo
- Publication number
- CN108877837B CN108877837B CN201810601896.7A CN201810601896A CN108877837B CN 108877837 B CN108877837 B CN 108877837B CN 201810601896 A CN201810601896 A CN 201810601896A CN 108877837 B CN108877837 B CN 108877837B
- Authority
- CN
- China
- Prior art keywords
- audio
- signal
- processing module
- module
- output signal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L25/00—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
- G10L25/48—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L25/00—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
- G10L25/48—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use
- G10L25/51—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use for comparison or discrimination
Abstract
The present disclosure relates to an audio signal abnormity identification method, device and storage medium, relating to the field of terminal hardware maintenance, the method comprises: detecting an output signal of each designated audio processing module in the process of processing the audio signal; when detecting that the output signal of the first audio processing module is abnormal, generating log information according to the abnormal information of the output signal of the first audio processing module, wherein the first audio processing module is any one of the designated audio processing modules. The source and the type of the audio problem can be recorded when the audio is abnormal through the abnormal detection of the output signal of the appointed module in the audio signal processing process, the collection of information irrelevant to the audio abnormality is avoided, and the timeliness and the pertinence of the abnormal detection and identification of the audio signal are ensured.
Description
Technical Field
The present disclosure relates to the field of terminal hardware maintenance, and in particular, to a method and an apparatus for identifying an audio signal abnormality, and a storage medium.
Background
When audio is played and recorded by an audio device such as a mobile terminal, an audio player, or a recording device, there are often sound problems such as silence, noise, break, intermittent sound, and too small sound. For the maintenance of audio equipment, on one hand, a user cannot timely keep the field condition of the sound problem for an engineer to analyze and solve, and on the other hand, part of the sound problem is difficult to find in advance through the early-stage test of a test engineer. Therefore, in the related after-sales maintenance process, usually, after a user finds that a sound has a problem, the user notifies a tester, and then the tester records log (log) information of the audio device in the whole process when the audio device plays the audio, and finally analyzes a hardware fault causing the sound problem according to the log information, so as to perform maintenance and replacement.
Disclosure of Invention
To overcome the problems in the related art, the present disclosure provides an audio signal abnormality identification method, apparatus, and storage medium.
According to a first aspect of the embodiments of the present disclosure, there is provided an audio signal abnormality identification method, the method including:
detecting an output signal of each designated audio processing module in the process of processing the audio signal;
when detecting that the output signal of a first audio processing module is abnormal, generating log information according to the abnormal information of the output signal of the first audio processing module, wherein the first audio processing module is any one of the designated audio processing modules.
Optionally, in the process of playing audio through the audio output device or recording audio through the recording device, the specified audio processing module includes a coding module and a digital signal processing module; in the process of processing the audio signal, detecting the output signal of each designated audio processing module includes:
after the digital signal processing module finishes processing the digital signal of the audio frequency, carrying out signal abnormality detection processing on a first output signal output by the digital signal processing module;
and after the conversion between the digital signal and the analog signal of the audio is finished through the coding and decoding module, performing signal abnormity detection processing on a second output signal output by the coding and decoding module.
Optionally, in the process of uploading or downloading the audio, the designated audio processing module includes a coding and decoding module, a digital signal processing module and a modem, and in the process of processing the audio signal, detecting an output signal of each designated audio processing module includes:
after the digital signal processing module finishes processing the digital signal of the audio frequency, carrying out signal abnormality detection processing on a first output signal output by the digital signal processing module;
and after the conversion between the digital signal and the analog signal of the audio is finished through the coding and decoding module, performing signal abnormity detection processing on a second output signal output by the coding and decoding module.
And after the modem completes the conversion between the digital signal and the pulse signal of the audio frequency, carrying out signal abnormity detection processing on a third output signal output by the modem.
Optionally, the detecting an output signal of each designated audio processing module in the process of processing the audio signal includes:
performing volume abnormity detection on the output signal of each appointed audio processing module according to a preset signal intensity range to determine whether the volume abnormity problem exists in the output signal of each appointed audio processing module;
detecting the waveform interruption condition of the output signal of each appointed audio processing module so as to determine whether the output signal of each appointed audio processing module has a sound interruption problem or not; and/or the presence of a gas in the gas,
and detecting the clipping condition of the output signal of each appointed audio processing module to determine whether the output signal of each appointed audio processing module has a plosive problem.
Optionally, after the generating log information according to the abnormal information of the output signal of the first audio processing module, the method further includes:
capturing the log information;
and sharing the log information to a preset maintenance information collection platform.
According to a second aspect of the embodiments of the present disclosure, there is provided an audio signal abnormality recognition apparatus, the apparatus including:
an abnormality detection module configured to detect an output signal of each designated audio processing module in a signal processing process for audio;
the log generating module is configured to generate log information according to the abnormal information of the output signal of the first audio processing module when the output signal of the first audio processing module is detected to be abnormal, wherein the first audio processing module is any one of the designated audio processing modules.
Optionally, in the process of playing audio through the audio output device or recording audio through the recording device, the specified audio processing module includes a coding module and a digital signal processing module, and the anomaly detection module includes:
a first anomaly detection sub-module configured to perform signal anomaly detection processing on a first output signal output by the digital signal processing module after the digital signal processing module completes processing of the digital signal of the audio;
and the second abnormity detection sub-module is configured to perform signal abnormity detection processing on a second output signal output by the coding and decoding module after conversion between the digital signal and the analog signal of the audio is completed by the coding and decoding module.
Optionally, in the process of uploading or downloading the audio, the specified audio processing module includes a coding and decoding module, a digital signal processing module and a modem, and the anomaly detection module includes:
a first anomaly detection sub-module configured to perform signal anomaly detection processing on a first output signal output by the digital signal processing module after the digital signal processing module completes processing of the digital signal of the audio;
and the second abnormity detection sub-module is configured to perform signal abnormity detection processing on a second output signal output by the coding and decoding module after conversion between the digital signal and the analog signal of the audio is completed by the coding and decoding module.
A third anomaly detection sub-module configured to perform signal anomaly detection processing on a third output signal output by the modem after conversion between the digital signal and the pulse signal of the audio is completed by the modem.
Optionally, the anomaly detection module is configured to:
performing volume abnormity detection on the output signal of each appointed audio processing module according to a preset signal intensity range to determine whether the volume abnormity problem exists in the output signal of each appointed audio processing module;
detecting the waveform interruption condition of the output signal of each appointed audio processing module so as to determine whether the output signal of each appointed audio processing module has a sound interruption problem or not; and/or the presence of a gas in the gas,
and detecting the clipping condition of the output signal of each appointed audio processing module to determine whether the output signal of each appointed audio processing module has a plosive problem.
Optionally, the apparatus further comprises:
a log crawling module configured to crawl the log information;
and the log sharing module is configured to share the log information to a preset maintenance information collection platform.
According to a third aspect of the embodiments of the present disclosure, there is provided an audio signal abnormality recognition apparatus including:
a processor;
a memory for storing processor-executable instructions;
wherein the processor is configured to:
detecting an output signal of each designated audio processing module in the process of processing the audio signal;
when detecting that the output signal of a first audio processing module is abnormal, generating log information according to the abnormal information of the output signal of the first audio processing module, wherein the first audio processing module is any one of the designated audio processing modules.
According to a fourth aspect of embodiments of the present disclosure, there is provided a computer-readable storage medium having stored thereon computer program instructions, which when executed by a processor, implement the steps of the audio signal abnormality recognition method provided by the first aspect of the present disclosure.
The technical scheme provided by the embodiment of the disclosure can have the following beneficial effects: detecting an output signal of each designated audio processing module in the process of processing the audio signal; when detecting that the output signal of the first audio processing module is abnormal, generating log information according to the abnormal information of the output signal of the first audio processing module, wherein the first audio processing module is any one of the designated audio processing modules. The source and the type of the audio problem can be recorded when the audio is abnormal through the abnormal detection of the output signal of the appointed module in the audio signal processing process, the collection of information irrelevant to the audio abnormality is avoided, and the timeliness and the pertinence of the abnormal detection and identification of the audio signal are ensured.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and together with the description, serve to explain the principles of the disclosure.
FIG. 1 is a flow chart illustrating a method of audio signal anomaly identification according to an exemplary embodiment;
FIG. 2 is a flow chart of a method of audio signal detection according to the embodiment shown in FIG. 1;
FIG. 3 is a flow chart of another audio signal detection method according to the embodiment shown in FIG. 1;
FIG. 4 is a flow chart illustrating another method of audio signal anomaly identification according to the embodiment shown in FIG. 1;
fig. 5 is a block diagram illustrating an audio signal abnormality recognition apparatus according to an exemplary embodiment;
FIG. 6 is a block diagram of an anomaly detection module shown in the embodiment of FIG. 5;
FIG. 7 is a block diagram of another anomaly detection module shown in accordance with the embodiment shown in FIG. 5;
fig. 8 is a block diagram of another audio signal abnormality recognition apparatus according to the embodiment shown in fig. 5;
fig. 9 is a block diagram illustrating an audio signal abnormality recognition apparatus according to an exemplary embodiment.
Detailed Description
Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the exemplary embodiments below are not intended to represent all implementations consistent with the present disclosure. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present disclosure, as detailed in the appended claims.
Before introducing the audio signal abnormality identification method, apparatus, and storage medium provided by the present disclosure, an application scenario related to each embodiment in the present disclosure is first introduced, where the application scenario includes a terminal device, and the terminal device is a terminal device having an audio playing and recording function or at least capable of storing and outputting audio. The terminal device may be, for example, a mobile terminal such as a smart phone, a tablet computer, a smart television, a smart watch, a PDA (Personal Digital Assistant, chinese), a portable computer, or the like.
Fig. 1 is a flowchart illustrating an audio signal anomaly identification method according to an exemplary embodiment, and as shown in fig. 1, the method is applied to a terminal device described in the foregoing application scenario, and includes the following steps:
in step 101, during signal processing of audio, the output signal of each designated audio processing module is detected.
Wherein, the signal processing process of the audio comprises the following steps: the process of converting the audio from the analog signal into the pulse signal and uploading the pulse signal to the network through a plurality of designated modules, and the process of converting the downloaded audio from the pulse signal into the analog signal for playing or outputting, or the process of playing the stored audio through audio output equipment, and the process of recording the audio through recording equipment and storing.
Illustratively, when applying the signal strength detection mechanism, the waveform discontinuity detection mechanism, and/or the clipping detection mechanism to detect anomalies in the output signal of each of the designated audio processing modules, this step 101 may comprise: performing volume anomaly detection on the output signal of each designated audio processing module according to a preset signal intensity range to determine whether the output signal of each designated audio processing module has a volume anomaly problem, and determining that the volume of the audio corresponding to the output signal is too large, too small or silent when the output signal slightly exceeds the preset signal intensity range; detecting the waveform interruption condition of the output signal of each appointed audio processing module to determine whether the output signal of each appointed audio processing module has a sound interruption problem, and when the waveform of the output signal is abnormally interrupted, determining that the audio corresponding to the output signal has a sound discontinuity problem; and/or, detecting the clipping condition of the output signal of each appointed audio processing module to determine whether a POP noise (POP noise) problem exists in the output signal of each appointed audio processing module, wherein the POP noise is a POP noise generated by transient impact caused by various operations of an audio device at the moment of power-on and power-off and after the power-on is stable.
It should be noted that, for different application scenarios, the audio signal processing procedure may be different signal processing procedures including multiple types of conversion modules, and the corresponding anomaly detection mechanism includes multiple types of detection mechanisms for different audio problems, and this embodiment describes the audio signal anomaly identification method by taking the signal processing procedure and the anomaly detection mechanism as examples.
In step 102, when detecting that the output signal of the first audio processing module is abnormal, generating log information according to the abnormal information of the output signal of the first audio processing module.
The first audio processing module is any one of the designated audio processing modules.
Illustratively, when the output signal of any audio processing module is detected to be abnormal, the abnormal information of the output signal is recorded in the current log of the terminal equipment. Wherein, the abnormal information may include: the location where the signal anomaly occurred (i.e., after which audio processing module's conversion process), and the type of signal problem (which type includes silence, murmurs, breaks, or underscore), etc.
In summary, the present disclosure can detect the output signal of each designated audio processing module during the audio signal processing process; when detecting that the output signal of the first audio processing module is abnormal, generating log information according to the abnormal information of the output signal of the first audio processing module, wherein the first audio processing module is any one of the designated audio processing modules. The source and the type of the audio problem can be recorded when the audio is abnormal through the abnormal detection of the output signal of the appointed module in the audio signal processing process, the collection of information irrelevant to the audio abnormality is avoided, and the timeliness and the pertinence of the abnormal detection and identification of the audio signal are ensured.
Fig. 2 is a flowchart of an audio signal detection method according to the embodiment shown in fig. 1, in a process of playing audio through an audio output device or recording audio through a recording device, where the specified audio processing module includes a codec module and a digital signal processing module, as shown in fig. 2, the step 101 includes:
in step 1011, after the digital signal processing module completes the processing of the digital signal of the audio, the signal abnormality detection processing is performed on the first output signal output by the digital signal processing module.
In step 1012, after the codec module completes the conversion between the digital signal and the analog signal of the audio, the second output signal output by the codec module is processed for signal anomaly detection.
The Digital Signal processing module may be a DSP (Digital Signal Processor), and the Codec module may be a Codec. The audio output device may include an earphone, a speaker, etc., and the recording device may be a microphone. It will be appreciated that the audio is stored in the terminal device in the form of a digital signal.
Illustratively, in the process of playing audio through an audio output device, the above steps are performed in the sequence from step 1011 to step 1012, that is, firstly, the digital signal of the audio is processed by the DSP, at this time, the first output signal is a processed digital signal, then the processed digital signal is converted into a corresponding analog signal by Codec, at this time, the second output signal is an analog signal, and finally, the analog signal is converted into audio through a headphone or a speaker for playing. During the process, the output signals of the DSP and the Codec can be detected by corresponding signal abnormality detection mechanisms, and corresponding abnormality information is automatically recorded in log information when the output signals are abnormal. Before the digital signal of the audio is processed by the DSP, the audio may be PCM (Pulse Code Modulation) converted by an AP (Application processor), and the converted digital signal is transmitted to the DSP.
In contrast, in the process of recording audio by the recording device, the execution sequence of the above steps is steps 1012 to 1011, that is, firstly, the analog signal corresponding to the audio is converted into the corresponding digital signal by the Codec, at this time, the second output signal is a digital signal, then, the digital signal of the audio is processed by the DSP, at this time, the first output signal is a digital signal processed by the DSP, and finally, the first output signal is stored. During the process, the output signals of the Codec and the DSP can be detected by corresponding signal abnormality detection mechanisms, and corresponding abnormality information is automatically recorded in log information when the output signals are abnormal.
Fig. 3 is a flowchart of another audio signal detection method according to the embodiment shown in fig. 1, in the process of uploading or downloading audio, where the designated audio processing module includes a codec module, a digital signal processing module and a modem, as shown in fig. 3, step 101 includes:
in step 1013, after the digital signal processing module completes the processing of the digital signal of the audio, the signal abnormality detection processing is performed on the first output signal output by the digital signal processing module.
In step 1014, after the conversion between the digital signal and the analog signal of the audio is completed by the codec module, the second output signal output by the codec module is processed for signal abnormality detection.
In step 1015, after the modem completes the conversion between the digital signal and the pulse signal of the audio frequency, the third output signal output by the modem is processed for signal abnormality detection.
Illustratively, in the process of uploading the audio to the network, the above steps are performed in the sequence of steps 1014 to 1013 and 1015, that is, firstly, the analog signal corresponding to the audio is converted into a corresponding digital signal by Codec, at this time, the second output signal is a digital signal, then the digital signal of the audio is processed by DSP, at this time, the first output signal is a processed digital signal, and then the processed digital signal is converted into a pulse signal by modem for uploading, at this time, the third output signal is a pulse signal. During the process, the output signals of the Codec, the DSP and the modulator demodulator can be detected by corresponding signal abnormality detection mechanisms, and corresponding abnormality information is automatically recorded in log information when the output signals are abnormal.
In contrast, in the process of downloading audio from the network, the execution sequence of the above steps is steps 1015 to 1013 to 1014, and the pulse signal corresponding to the audio is first converted into a digital signal by the modem, at this time, the third output signal is a digital signal, then the digital signal is processed by the DSP, at this time, the first output signal is a processed digital signal, and finally, the processed digital signal is converted into a corresponding analog signal by the Codec to be stored or output by the audio output device, at this time, the second output signal is a digital signal. During the process, the output signals of the modem, the DSP and the Codec can be detected by corresponding signal abnormality detection mechanisms, and corresponding abnormality information is automatically recorded in log information when the output signals are abnormal.
Fig. 4 is a flowchart illustrating another audio signal abnormality identification method according to the embodiment shown in fig. 1, where as shown in fig. 4, the method may further include:
in step 103, the log information is captured.
In step 104, the log information is shared to a preset maintenance information collection platform.
For example, after the log information related to the audio signal abnormality is generated, the log information may be captured, and the log information may be classified and stored according to the source or type of the audio problem corresponding to the abnormality information in the log information, or the log information may be uploaded to a maintenance information collection platform for collecting maintenance information of the terminal device, so that an after-sales maintenance person may perform remote maintenance or after-sales consultation on the terminal device.
In summary, the present disclosure can detect the output signal of each designated audio processing module during the audio signal processing process; when detecting that the output signal of the first audio processing module is abnormal, generating log information according to the abnormal information of the output signal of the first audio processing module, wherein the first audio processing module is any one of the designated audio processing modules. The source and the type of the audio problem can be recorded when the audio is abnormal through abnormal detection of the output signal of the designated module in the audio signal processing process, and after-sale maintenance personnel can be remotely informed of the source and the type of the audio problem, so that the collection of information irrelevant to the audio abnormality is avoided, the timeliness and pertinence of the audio signal abnormal detection and identification are ensured, and the convenience of after-sale maintenance is improved.
Fig. 5 is a block diagram of an audio signal abnormality recognition apparatus according to an exemplary embodiment, as shown in fig. 5, applied to a terminal device described in the above application scenario, where the apparatus 200 includes:
an anomaly detection module 210 configured to detect an output signal of each designated audio processing module in a signal processing process for audio;
a log generating module 220 configured to generate log information according to the abnormality information of the output signal of the first audio processing module when detecting that the output signal of the first audio processing module is abnormal, the first audio processing module being any one of the designated audio processing modules.
Fig. 6 is a block diagram of an abnormality detection module according to the embodiment shown in fig. 5, wherein, as shown in fig. 6, in the process of playing audio through an audio output device or recording audio through a recording device, the specified audio processing module includes a coding module and a digital signal processing module, and the abnormality detection module 210 includes:
a first anomaly detection sub-module 211 configured to perform signal anomaly detection processing on a first output signal output by the digital signal processing module after the digital signal processing module completes processing of the digital signal of the audio;
and a second anomaly detection sub-module 212 configured to perform signal anomaly detection processing on a second output signal output by the codec module after conversion between the digital signal and the analog signal of the audio is completed by the codec module.
Fig. 7 is a block diagram of another anomaly detection module according to the embodiment shown in fig. 5, where, as shown in fig. 7, during the process of uploading or downloading audio, the specified audio processing module includes a codec module, a digital signal processing module and a modem, and the anomaly detection module 210 includes:
a first anomaly detection sub-module 211 configured to perform signal anomaly detection processing on a first output signal output by the digital signal processing module after the digital signal processing module completes processing of the digital signal of the audio;
and a second anomaly detection sub-module 212 configured to perform signal anomaly detection processing on a second output signal output by the codec module after conversion between the digital signal and the analog signal of the audio is completed by the codec module.
A third anomaly detection sub-module 213 configured to perform signal anomaly detection processing on a third output signal output by the modem after conversion between the digital signal and the pulse signal of the audio is completed by the modem.
Optionally, the anomaly detection module 210 is configured to:
carrying out volume abnormity detection on the output signal of each appointed audio processing module according to a preset signal intensity range so as to determine whether the volume abnormity problem exists in the output signal of each appointed audio processing module;
detecting the waveform interruption condition of the output signal of each appointed audio processing module so as to determine whether the output signal of each appointed audio processing module has a sound interruption problem or not; and/or the presence of a gas in the gas,
the clipping condition of the output signal of each designated audio processing module is detected to determine whether a plosive problem exists in the output signal of each designated audio processing module.
Fig. 8 is a block diagram illustrating another audio signal abnormality recognition apparatus according to the embodiment shown in fig. 5, and as shown in fig. 8, the apparatus 200 further includes:
a log crawling module 230 configured to crawl the log information;
and a log sharing module 240 configured to share the log information to a preset maintenance information collection platform.
With regard to the apparatus in the above-described embodiment, the specific manner in which each module performs the operation has been described in detail in the embodiment related to the method, and will not be elaborated here.
In summary, the present disclosure can detect the output signal of each designated audio processing module during the audio signal processing process; when detecting that the output signal of the first audio processing module is abnormal, generating log information according to the abnormal information of the output signal of the first audio processing module, wherein the first audio processing module is any one of the designated audio processing modules. The source and the type of the audio problem can be recorded when the audio is abnormal through abnormal detection of the output signal of the designated module in the audio signal processing process, and after-sale maintenance personnel can be remotely informed of the source and the type of the audio problem, so that the collection of information irrelevant to the audio abnormality is avoided, the timeliness and pertinence of the audio signal abnormal detection and identification are ensured, and the convenience of after-sale maintenance is improved.
The present disclosure also provides a computer readable storage medium having stored thereon computer program instructions which, when executed by a processor, implement the steps of the audio signal abnormality identification method provided by the present disclosure.
Fig. 9 is a block diagram illustrating an audio signal abnormality recognition apparatus 300 according to an exemplary embodiment. For example, the apparatus 300 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, an exercise device, a personal digital assistant, and the like.
Referring to fig. 9, the apparatus 300 may include one or more of the following components: a processing component 302, a memory 304, a power component 306, a multimedia component 308, an audio component 310, an input/output (I/O) interface 312, a sensor component 314, and a communication component 316.
The processing component 302 generally controls overall operation of the device 300, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. The processing component 302 may include one or more processors 320 to execute instructions to perform all or a portion of the steps of the audio signal anomaly identification method described above. Further, the processing component 302 can include one or more modules that facilitate interaction between the processing component 302 and other components. For example, the processing component 302 may include a multimedia module to facilitate interaction between the multimedia component 308 and the processing component 302.
The memory 304 is configured to store various types of data to support operations at the apparatus 300. Examples of such data include instructions for any application or method operating on device 300, contact data, phonebook data, messages, pictures, videos, and so forth. The memory 304 may be implemented by any type or combination of volatile or non-volatile memory devices, such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disks.
The multimedia component 308 includes a screen that provides an output interface between the device 300 and a user. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive an input signal from a user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 308 includes a front facing camera and/or a rear facing camera. The front camera and/or the rear camera may receive external multimedia data when the device 300 is in an operating mode, such as a shooting mode or a video mode. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.
The audio component 310 is configured to output and/or input audio signals. For example, audio component 310 includes a Microphone (MIC) configured to receive external audio signals when apparatus 300 is in an operating mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signals may further be stored in the memory 304 or transmitted via the communication component 316. In some embodiments, audio component 310 also includes a speaker for outputting audio signals.
The I/O interface 312 provides an interface between the processing component 302 and peripheral interface modules, which may be keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to: a home button, a volume button, a start button, and a lock button.
The sensor assembly 314 includes one or more sensors for providing various aspects of status assessment for the device 300. For example, sensor assembly 314 may detect an open/closed state of device 300, the relative positioning of components, such as a display and keypad of device 300, the change in position of device 300 or a component of device 300, the presence or absence of user contact with device 300, the orientation or acceleration/deceleration of device 300, and the change in temperature of device 300. Sensor assembly 314 may include a proximity sensor configured to detect the presence of a nearby object without any physical contact. The sensor assembly 314 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 314 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.
The communication component 316 is configured to facilitate wired or wireless communication between the apparatus 300 and other devices. The device 300 may access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 316 receives a broadcast signal or broadcast related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 316 further includes a Near Field Communication (NFC) module to facilitate short-range communications. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, Ultra Wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.
In an exemplary embodiment, the apparatus 300 may be implemented by one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), controllers, micro-controllers, microprocessors or other electronic components for performing the above-described audio signal abnormality recognition method.
In an exemplary embodiment, a non-transitory computer-readable storage medium comprising instructions, such as the memory 304 comprising instructions, executable by the processor 320 of the apparatus 300 to perform the audio signal anomaly identification method described above is also provided. For example, the non-transitory computer readable storage medium may be a ROM, a Random Access Memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like. The method and the device can reduce the dependence on the signal intensity of the WLAN equipment when the position of the WLAN equipment is positioned, enable the positioning error precision to be controllable, and improve the positioning accuracy.
Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure. This application is intended to cover any variations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.
It will be understood that the present disclosure is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.
Claims (12)
1. An audio signal abnormality recognition method, characterized in that the method comprises:
detecting an output signal of each designated audio processing module in the process of processing the audio signal;
when detecting that the output signal of a first audio processing module is abnormal, generating log information according to the abnormal information of the output signal of the first audio processing module, wherein the first audio processing module is any one of the specified audio processing modules, and the abnormal information comprises the position of the abnormal occurrence and the type of the problem.
2. The method of claim 1, wherein the designated audio processing modules comprise a codec module and a digital signal processing module during the audio playing process through an audio output device or the audio recording process through a recording device, and the detecting the output signal of each designated audio processing module during the audio signal processing comprises:
after the digital signal processing module finishes the digital signal processing of the audio frequency, carrying out signal abnormality detection processing on a first output signal output by the digital signal processing module;
and after the conversion between the digital signal and the analog signal of the audio is finished through the coding and decoding module, performing signal abnormity detection processing on a second output signal output by the coding and decoding module.
3. The method of claim 1, wherein the designated audio processing modules comprise a coding module, a digital signal processing module and a modem during the uploading or downloading process of the audio, and the detecting the output signal of each designated audio processing module during the signal processing of the audio comprises:
after the digital signal processing module finishes the digital signal processing of the audio frequency, carrying out signal abnormality detection processing on a first output signal output by the digital signal processing module;
after the conversion between the digital signal and the analog signal of the audio frequency is finished through the coding and decoding module, performing signal abnormity detection processing on a second output signal output by the coding and decoding module;
and after the modem completes the conversion between the digital signal and the pulse signal of the audio frequency, carrying out signal abnormity detection processing on a third output signal output by the modem.
4. The method according to any one of claims 1-3, wherein the detecting the output signal of each designated audio processing module during the signal processing of the audio comprises:
performing volume abnormity detection on the output signal of each appointed audio processing module according to a preset signal intensity range to determine whether the volume abnormity problem exists in the output signal of each appointed audio processing module;
detecting the waveform interruption condition of the output signal of each appointed audio processing module so as to determine whether the output signal of each appointed audio processing module has a sound interruption problem or not; and/or the presence of a gas in the gas,
and detecting the clipping condition of the output signal of each appointed audio processing module to determine whether the output signal of each appointed audio processing module has a plosive problem.
5. The method according to any one of claims 1-3, wherein after the generating log information from the abnormality information of the output signal of the first audio processing module, the method further comprises:
capturing the log information;
and sharing the log information to a preset maintenance information collection platform.
6. An apparatus for recognizing an abnormality in an audio signal, the apparatus comprising:
an abnormality detection module configured to detect an output signal of each designated audio processing module in a signal processing process for audio;
a log generating module configured to generate log information according to abnormality information of an output signal of a first audio processing module when detecting an abnormality of the output signal of the first audio processing module, the first audio processing module being any one of the specified audio processing modules, the abnormality information including a location where the abnormality occurs and a type of the problem.
7. The apparatus of claim 6, wherein the designated audio processing module comprises a codec module and a digital signal processing module during the process of playing audio through an audio output device or recording audio through a recording device, and the abnormality detection module comprises:
a first anomaly detection sub-module configured to perform signal anomaly detection processing on a first output signal output by the digital signal processing module after the digital signal processing on the audio is completed by the digital signal processing module;
and the second abnormity detection sub-module is configured to perform signal abnormity detection processing on a second output signal output by the coding and decoding module after conversion between the digital signal and the analog signal of the audio is completed by the coding and decoding module.
8. The apparatus of claim 6, wherein the designated audio processing module comprises a codec module, a digital signal processing module and a modem during the process of uploading or downloading audio, and the anomaly detection module comprises:
a first anomaly detection sub-module configured to perform signal anomaly detection processing on a first output signal output by the digital signal processing module after the digital signal processing on the audio is completed by the digital signal processing module;
a second anomaly detection sub-module configured to perform signal anomaly detection processing on a second output signal output by the codec module after conversion between the digital signal and the analog signal of the audio is completed by the codec module;
a third anomaly detection sub-module configured to perform signal anomaly detection processing on a third output signal output by the modem after conversion between the digital signal and the pulse signal of the audio is completed by the modem.
9. The apparatus of any of claims 6-8, wherein the anomaly detection module is configured to:
performing volume abnormity detection on the output signal of each appointed audio processing module according to a preset signal intensity range to determine whether the volume abnormity problem exists in the output signal of each appointed audio processing module;
detecting the waveform interruption condition of the output signal of each appointed audio processing module so as to determine whether the output signal of each appointed audio processing module has a sound interruption problem or not; and/or the presence of a gas in the gas,
and detecting the clipping condition of the output signal of each appointed audio processing module to determine whether the output signal of each appointed audio processing module has a plosive problem.
10. The apparatus according to any one of claims 6-8, further comprising:
a log crawling module configured to crawl the log information;
and the log sharing module is configured to share the log information to a preset maintenance information collection platform.
11. An audio signal abnormality recognition apparatus comprising:
a processor;
a memory for storing processor-executable instructions;
wherein the processor is configured to:
detecting an output signal of each designated audio processing module in the process of processing the audio signal;
when detecting that the output signal of a first audio processing module is abnormal, generating log information according to the abnormal information of the output signal of the first audio processing module, wherein the first audio processing module is any one of the specified audio processing modules, and the abnormal information comprises the position of the abnormal occurrence and the type of the problem.
12. A computer-readable storage medium, on which computer program instructions are stored, which program instructions, when executed by a processor, carry out the steps of the method according to any one of claims 1 to 5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810601896.7A CN108877837B (en) | 2018-06-12 | 2018-06-12 | Audio signal abnormality identification method, device and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810601896.7A CN108877837B (en) | 2018-06-12 | 2018-06-12 | Audio signal abnormality identification method, device and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108877837A CN108877837A (en) | 2018-11-23 |
| CN108877837B true CN108877837B (en) | 2021-01-15 |
Family
ID=64338130
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810601896.7A Active CN108877837B (en) | 2018-06-12 | 2018-06-12 | Audio signal abnormality identification method, device and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108877837B (en) |
Families Citing this family (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110677780B (en) * | 2019-09-26 | 2021-12-14 | 北京小米移动软件有限公司 | Detection method and device of audio input module and storage medium |
| CN110971760B (en) * | 2019-12-04 | 2021-02-26 | Tcl移动通信科技（宁波）有限公司 | Network communication content output control method and device, storage medium and terminal equipment |
| CN111263189B (en) * | 2020-02-26 | 2023-03-07 | 深圳壹账通智能科技有限公司 | Video quality detection method and device and computer equipment |
| CN111669576B (en) * | 2020-06-19 | 2021-11-19 | 海信视像科技股份有限公司 | Method and device for identifying volume output abnormality of smart television and electronic equipment |
| CN114420165A (en) * | 2022-03-11 | 2022-04-29 | 深圳创元智能软件科技有限公司 | Audio circuit testing method, device, equipment and storage medium |
| CN115243183A (en) * | 2022-06-29 | 2022-10-25 | 上海勤宽科技有限公司 | Audio detection method, device and storage medium |
| CN116721678A (en) * | 2022-09-29 | 2023-09-08 | 荣耀终端有限公司 | Audio data monitoring method, electronic equipment and medium |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101089641A (en) * | 2007-07-12 | 2007-12-19 | 北京中星微电子有限公司 | Method system for implementing investigating audio-frequency equipment and audio-frequency equipment |
| JP2009159020A (en) * | 2007-12-25 | 2009-07-16 | Sony Corp | Signal processing apparatus, signal processing method, and program |
| WO2015059782A1 (en) * | 2013-10-23 | 2015-04-30 | 株式会社Ｋ－Ｗｉｌｌ | Image inspection method and sound inspection method |
| CN105848052A (en) * | 2015-01-16 | 2016-08-10 | 宇龙计算机通信科技(深圳)有限公司 | Microphone switching method and terminal |
| CN106294646A (en) * | 2016-08-02 | 2017-01-04 | 乐视控股（北京）有限公司 | Data processing method based on audio frequency and device |
| CN107170465A (en) * | 2017-06-29 | 2017-09-15 | 数据堂（北京）科技股份有限公司 | A kind of audio quality detection method and audio quality detecting system |
| CN107346665A (en) * | 2017-06-29 | 2017-11-14 | 广州视源电子科技股份有限公司 | Method, apparatus, equipment and the storage medium of audio detection |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105898555A (en) * | 2015-12-28 | 2016-08-24 | 乐视致新电子科技（天津）有限公司 | Audio abnormity positioning method and device |
| CN106534980B (en) * | 2016-11-15 | 2019-12-06 | 广州华多网络科技有限公司 | abnormity detection method of audio processing system, log recording method and device |
-
2018
- 2018-06-12 CN CN201810601896.7A patent/CN108877837B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101089641A (en) * | 2007-07-12 | 2007-12-19 | 北京中星微电子有限公司 | Method system for implementing investigating audio-frequency equipment and audio-frequency equipment |
| JP2009159020A (en) * | 2007-12-25 | 2009-07-16 | Sony Corp | Signal processing apparatus, signal processing method, and program |
| WO2015059782A1 (en) * | 2013-10-23 | 2015-04-30 | 株式会社Ｋ－Ｗｉｌｌ | Image inspection method and sound inspection method |
| CN105848052A (en) * | 2015-01-16 | 2016-08-10 | 宇龙计算机通信科技(深圳)有限公司 | Microphone switching method and terminal |
| CN106294646A (en) * | 2016-08-02 | 2017-01-04 | 乐视控股（北京）有限公司 | Data processing method based on audio frequency and device |
| CN107170465A (en) * | 2017-06-29 | 2017-09-15 | 数据堂（北京）科技股份有限公司 | A kind of audio quality detection method and audio quality detecting system |
| CN107346665A (en) * | 2017-06-29 | 2017-11-14 | 广州视源电子科技股份有限公司 | Method, apparatus, equipment and the storage medium of audio detection |
Non-Patent Citations (1)
| Title |
|---|
| 《浅谈音频编码出现异常情况的处理方法_关洁》;关洁;《西部广播电视》;20160515;全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108877837A (en) | 2018-11-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108877837B (en) | Audio signal abnormality identification method, device and storage medium | |
| EP3188066B1 (en) | A method and an apparatus for managing an application | |
| EP3163748B1 (en) | Method, device and terminal for adjusting volume | |
| CN106911961B (en) | Multimedia data playing method and device | |
| US10123196B2 (en) | Method and device for alarm triggering | |
| EP3125530A1 (en) | Video recording method and device | |
| US20170034336A1 (en) | Event prompting method and device | |
| CN106792173B (en) | Video playing method and device and non-transitory computer readable storage medium | |
| CN109087650B (en) | Voice wake-up method and device | |
| EP3322227B1 (en) | Methods and apparatuses for controlling wireless connection, computer program and recording medium | |
| CN111031177A (en) | Screen recording method, device and readable storage medium | |
| CN105141758A (en) | Terminal control method and device | |
| CN107562500B (en) | Debugging device, method and equipment | |
| CN104702756A (en) | Detecting method and detecting device for soundless call | |
| EP3125514A1 (en) | Method and device for state notification | |
| CN107158685B (en) | Exercise verification method and apparatus | |
| EP3851876A1 (en) | Method and device for processing information based on radar waves, terminal, and storage medium | |
| CN105930266B (en) | Webpage adjustment method and device | |
| CN105338482A (en) | Method and device for emergency call | |
| CN107864263B (en) | Recording method and device of application layer audio data | |
| US20160142885A1 (en) | Voice call prompting method and device | |
| CN105554325A (en) | Blacklist number processing method and mobile terminal | |
| CN110868495A (en) | Message display method and device | |
| WO2018058598A1 (en) | Method and apparatus for prompting abnormal information | |
| CN109756615B (en) | Information prompting method, device, terminal and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |