CN106534980A - Anomaly detection method for audio processing system and logging method and device - Google Patents
Anomaly detection method for audio processing system and logging method and device Download PDFInfo
- Publication number
- CN106534980A CN106534980A CN201611014900.7A CN201611014900A CN106534980A CN 106534980 A CN106534980 A CN 106534980A CN 201611014900 A CN201611014900 A CN 201611014900A CN 106534980 A CN106534980 A CN 106534980A
- Authority
- CN
- China
- Prior art keywords
- data
- input
- audio
- voice data
- audio frequency
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
- H04N21/4424—Monitoring of the internal components or processes of the client device, e.g. CPU or memory load, processing speed, timer, counter or percentage of the hard disk space used
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N17/00—Diagnosis, testing or measuring for television systems or their details
- H04N17/004—Diagnosis, testing or measuring for television systems or their details for digital television systems
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Databases & Information Systems (AREA)
- Health & Medical Sciences (AREA)
- Biomedical Technology (AREA)
- General Health & Medical Sciences (AREA)
- Debugging And Monitoring (AREA)
- Telephonic Communication Services (AREA)
Abstract
The invention discloses an anomaly detection method and device for an audio processing system. The method comprises the steps that the log of an audio processing module is acquired; the log records the input audio parameter of input audio data and the output audio parameter of output audio data, and the input audio data and the output audio data are collected from input and output ends of the audio processing module according to preset time and preset sampling rate; and whether the audio processing module is abnormal is judged based on the input audio parameter and the output audio parameter. According to the embodiment provided by the invention, whether the audio processing system is abnormal is quickly detected.
Description
Technical field
The application is related to audio signal processing technique field, more particularly to method for detecting abnormality, the daily record note of audio frequency processing system
Recording method and device.
Background technology
In live scene, audio frequency and video chat scenario, can all be related to audio frequency processing system, audio frequency processing system generally can be with
Including audio processing modules such as collection, audio mixing, coding, transmission, decoding, broadcastings, audio frequency from the beginning of acquisition module, through each mould
Block process, is finally played by playing module.Due to the module passed through by audio frequency it is relatively more, finally play when, if user listens not
During to sound or cacophonia, it is difficult to it is which rank of module is there is a problem in processing procedure in audio frequency processing system to detect,
Investigation problem hard, efficiency are low.
The content of the invention
In view of this, it is to solve the technical problem in correlation technique, this application provides the abnormal inspection of audio frequency processing system
Survey method, log recording method and device.
According to the first aspect of the embodiment of the present application, there is provided a kind of method for detecting abnormality of audio frequency processing system, the side
Method includes：
Obtain the daily record of the audio processing modules；In the daily record, record has the input audio frequency parameter of input audio data
With the output audio frequency parameter of output voice data, the input audio data and output voice data are according to Preset Time and preset
Sample rate is collected from the input and outfan of the audio processing modules；
Based on the input audio frequency parameter and output audio frequency parameter, judge whether the audio processing modules are abnormal.
According to the second aspect of the embodiment of the present application, there is provided a kind of audio frequency processing system log recording method, methods described
Including：
The input audio data and output audio frequency of the audio processing modules are gathered according to Preset Time and default sample rate
Data；
The input audio frequency parameter and the output audio frequency parameter of the output voice data of the input audio data is recorded, is made
For the daily record of the audio processing modules.
According to the third aspect of the embodiment of the present application, there is provided a kind of abnormal detector of audio frequency processing system, the dress
Put including：
Acquisition module, is configured to obtain the daily record of the audio processing modules；In the daily record, record has input audio frequency
The output audio frequency parameter of the input audio frequency parameter and output voice data of data, the input audio data and output voice data
Collected from the input and outfan of the audio processing modules according to Preset Time and default sample rate；
Judge module, is configured to, based on the input audio frequency parameter and output audio frequency parameter, judge the Audio Processing
Whether module is abnormal.
According to the fourth aspect of the application, there is provided a kind of log recording apparatus of audio frequency processing system, described device include：
Acquisition module, is configured to gather the input sound of the audio processing modules according to Preset Time and default sample rate
Frequency evidence and output voice data；
Logging modle, is configured to record the input audio frequency parameter of the input audio data and the output voice data
Output audio frequency parameter, as the daily record of the audio processing modules.
The technical scheme that embodiments herein is provided can include following beneficial effect：
In the application, according to the input audio data and output of Preset Time and default sample rate collection audio processing modules
Voice data, using the audio frequency parameter of input audio data and the day for exporting the audio frequency parameter of voice data as audio processing modules
Will, and it is whether abnormal according to log recording content detection audio frequency processing system.Audio data samples are carried out by Preset Time, can
So that the information of too redundancy in daily record, need not be recorded, when audio frequency processing system occurs abnormal, it is possible to by being remembered in daily record
Whether the corresponding audio frequency parameter speed detection audio processing modules of each audio processing modules of record are abnormal, solve audio frequency processing system
The problem that positioning is difficult when occurring abnormal, investigation efficiency is low.
It should be appreciated that the general description of the above and detailed description hereinafter are only exemplary and explanatory, not
The application can be limited.
Description of the drawings
The network of the live scene that Figure 1A is suitable for by the application.
The network of the audio frequency processing system that Figure 1B is suitable for by the application.
Streams of the Fig. 2 for a kind of log recording method of audio frequency processing system of the application according to an exemplary embodiment
Cheng Tu.
Fig. 3 is a kind of schematic diagram to voice data sampled of the application according to an exemplary embodiment.
Streams of the Fig. 4 for a kind of method for detecting abnormality of audio frequency processing system of the application according to an exemplary embodiment
Cheng Tu.
Frames of the Fig. 5 for a kind of log recording apparatus of audio frequency processing system of the application according to an exemplary embodiment
Figure.
Frames of the Fig. 6 for a kind of abnormal detector of audio frequency processing system of the application according to an exemplary embodiment
Figure.
Specific embodiment
Here in detail exemplary embodiment will be illustrated, its example is illustrated in the accompanying drawings.Explained below is related to
During accompanying drawing, unless otherwise indicated, the same numbers in different accompanying drawings represent same or analogous key element.Following exemplary embodiment
Described in embodiment do not represent all embodiments consistent with the application.Conversely, they be only with as appended by
The example of consistent apparatus and method in terms of some described in detail in claims, the application.
It is the purpose only merely for description specific embodiment in term used in this application, and is not intended to be limiting the application.
" one kind ", " described " and " being somebody's turn to do " of singulative used in the application and appended claims is also intended to include majority
Form, unless context clearly shows that other implications.It is also understood that term "and/or" used herein is referred to and is wrapped
Containing one or more associated any or all possible combinations for listing project.
It will be appreciated that though various information, but this may be described using term first, second, third, etc. in the application
A little information should not necessarily be limited by these terms.These terms are only for same type of information is distinguished from each other out.For example, without departing from
In the case of the application scope, the first information can also be referred to as the second information, and similarly, the second information can also be referred to as
One information.Depending on linguistic context, word as used in this " if " can be construed to " ... when " or " when ...
When " or " in response to determining ".
In the scene such as common live scene or audio frequency and video chat, can all be related to audio frequency processing system, the present embodiment
Illustrate by taking live scene as an example.As shown in Figure 1A, Figure 1A is the network of a be suitable for live scene of the application, should
Live scene can be included：Main broadcaster's client 10, the direct broadcast server 20 that can be communicated with live client 10 and can be with
Spectator client 30a, 30b that direct broadcast server 20 is communicated.Wherein, above-mentioned main broadcaster's client can be main broadcaster using set
For (such as：Computer, mobile phone etc.), above-mentioned spectator client can be the equipment that uses of spectators (such as：Computer, mobile phone etc.).Wherein, it is main
Broadcasting client can include one or more signal collecting device (such as：Photographic head, mike etc.).During live, main broadcaster
Client 10 collects audio/video signal by corresponding signal collecting device, and uploads to live clothes as live source data
The live source data of upload and is standardized by direct broadcast server 20, and is encoded to stream medium data and is distributed to by business device 20
Play out on one or more spectator clients.
As shown in Figure 1B, Figure 1B is the network of a be suitable for audio frequency processing system of the application.Voice data is from master
Broadcast end to start, will typically pass through the process of six audio processing modules such as collection, audio mixing, coding, transmission, decoding and broadcasting, most
Play in viewer end eventually.Wherein, acquisition module, mix module, coding module are configured in main broadcaster's client, and transport module is configured in
Service end, decoder module, playing module are configured in spectator client.It is appreciated that involved by the present embodiment live scene
Six audio processing modules are only to illustrate, in actual applications, it is also possible to be related to various other audio processing modules.Due to
In audio frequency processing system, involved audio processing modules are numerous, finally when playing, if user can't hear sound or sound
When occurring abnormal, it is difficult to investigate, it is difficult in alignment system there is exception in which module.
For this purpose, the application proposes a kind of log recording method of audio frequency processing system and method for detecting abnormality.Can basis
Preset Time and sample rate collection audio processing modules enter voice data and output voice data, and by input audio data
Daily record of the output parameter of |input paramete and output voice data as audio processing modules；By obtain daily record in input/
Whether extremely output audio frequency parameter, can analyze corresponding audio processing modules, the exception of quick detection audio frequency processing system.Connect
To get off be described in detail the application.
As shown in Fig. 2 Fig. 2 is a kind of daily record note of audio frequency processing system of the application according to an exemplary embodiment
The flow chart of recording method, the method can be applicable to be configured with the server device of audio processing modules or client device, use
Arbitrary audio processing modules in audio frequency processing system carry out log recording, the method comprising the steps of S201 extremely
S202：
In step s 201, the input audio frequency number of the audio processing modules is gathered according to Preset Time and default sample rate
According to output voice data.
In step S202, record the input audio data input audio frequency parameter and the output voice data it is defeated
Go out audio frequency parameter, as the daily record of the audio processing modules.
Wherein, sample rate refers to sampling number of the audio collecting device to acoustical signal in one second, and sample rate is higher,
True nature is got in the reduction of sound.Sample rate can be divided into various grades such as 22.05kHz, 44.1kHz, 48kHz, 22.05kHz
The sound quality of FM broadcast is can only achieve, 44.1kHz is then theoretic CD Quality boundary, and 48kHz is then more accurately.Make
For an example, default sample rate can be 44.1kHz.
In actual applications, Preset Time for example can be set according to sample rate with flexible configuration.If sampling
Rate higher (such as sample rate is 192kHz), as the amount of audio data for being gathered is big, then can arrange larger time interval,
Can for example be to gather a voice data every 10 seconds；If sample rate relatively low (such as sample rate is 44.1kHz), due to institute
The amount of audio data of collection is little, then can arrange less time interval, for example, can be to gather a secondary audio program number every 2 seconds
According to.In the present embodiment, 10 seconds, 2 seconds is all empirical value, can also be other numerical value in practical application, such as 5 seconds, 8 seconds, 1
Second, 3 seconds etc., it will be understood that the data volume collected if time interval is short is big, and the information recorded in daily record is also more,
The difficulty of real time record and investigation problem can be increased；If time interval is larger, the data volume for being collected is little, is remembered in daily record
The information of record is also less, the problem that abnormality detection can be caused inaccurate, therefore flexibly can match somebody with somebody according to demand in actual applications
Put the Preset Time.As an example, corresponding to sample rate 44.1kHz, prefixed time interval can be 5 seconds.
The audio frequency parameter of voice data can include sample rate, sampling precision, bit rate, port number, data length, volume
Data of value and top n byte etc..In the present embodiment, obtain audio frequency parameter purpose be in order to subsequently carry out anomaly analysis,
Therefore in practical application, can be according to follow-up anomaly analysis demand, the audio frequency parameter needed for flexible configuration.Implement in the application
In example, the audio frequency parameter can include one or more of：
The data of data length, volume value and top n byte, the N are default positive integer.
Data length refers to the total bytes of input/output voice data.Usual audio processing modules are input into audio frequency number
According to data length and output voice data data length will not change during normal transmission, when audio processing modules go out
Loss of data is then likely to cause when now abnormal, causes the data length and input audio frequency of audio processing modules output voice data
The data length of data is different.Therefore, it can the data of the data length and output voice data according to input audio data
Length judges whether corresponding audio processing modules are abnormal, if the audio frequency of the data length of output voice data and input data
Length is different, it is determined that corresponding audio processing modules exception.
Whether volume value can represent certain voice data noiseless, if volume value is less than (such as -50 decibels of preset value
Or -60 decibels) just it is considered that gathered voice data is a quiet bag.The scene such as chat in live or audio frequency and video, normally
In the case of voice data should all have sound, if voice data is noiseless, it is believed that the voice data exception.
The data of top n byte can be used to judge whether input/output voice data is abnormal.The concrete numerical value of N can be with
Flexible configuration, typically takes the data of front 8 bytes, it is also possible to take the data of front 16 or 32 bytes, it is generally the case that take
Whether the data of front 8 bytes can obtain enough audio data informations, abnormal to analyze input/output voice data,
Take whether extremely more data can also analyze data, but it is understood that, fetched data more, analysis module exception
Difficulty it is bigger.
As shown in figure 3, Fig. 3 is a kind of signal sampled to voice data that the application is exemplified according to an enforcement
Figure.At the A moment, Preset Time is reached, and audio processing modules start to gather voice data (hypothesis sample rate is 44.1kHz), when
Between section AB be 1s, 44100 secondary data of audio processing modules gathered data in the 1s, 44100 sampled points of correspondence (i.e. Fig. 3 curves
On round dot, wherein, in order to example is convenient, in Fig. 3, merely illustrate fractional-sample point), in the present embodiment, can only take first 2
Data corresponding to sampled point, i.e., the data of front 8 bytes are analyzed.
The daily record of each audio processing modules in audio frequency processing system can be recorded by said method, record has sound in daily record
The output audio frequency parameter of the input audio frequency parameter and output voice data of frequency processing module input audio data.When system occurs
When abnormal, it is possible to obtain the input audio frequency parameter and output audio frequency parameter in daily record, according to log recording content detection correspondence
Whether audio processing modules are abnormal.Below the method for detecting abnormality of audio frequency processing system is described in detail.
As shown in figure 4, Fig. 4 is a kind of abnormal inspection of audio frequency processing system of the application according to an exemplary embodiment
The equipment of at least one audio processing modules can be applied in server device or be configured with to the flow chart of survey method, the method
In, the method comprising the steps of S401 to S402：
In step S401, the daily record of the audio processing modules is obtained；In the daily record, record has input audio data
Input audio frequency parameter and output voice data output audio frequency parameter, the input audio data and output voice data according to
Preset Time and default sample rate are collected from the input and outfan of the audio processing modules.
In step S402, based on the input audio frequency parameter and output audio frequency parameter, the audio processing modules are judged
It is whether abnormal.
Audio frequency processing system has six audio processing modules such as collection, audio mixing, coding, transmission, decoding and broadcasting, in reality
Using in, under different scenes, each audio processing modules possible configuration is in different equipment, it is also possible to be configured in same setting
In standby.
Such as, in live scene, different audio processing modules are configured in distinct device, wherein, acquisition module, audio mixing mould
Block, coding module are configured in main broadcaster's client device, and transport module is configured in server device, and decoder module, playing module are matched somebody with somebody
Put in spectator client equipment, therefore in such scene, the present embodiment method can be applied in server device, it is also possible to should
Used in being configured with the equipment of audio processing modules.For example, in live scene, can apply and (such as lead in a certain end equipment
Broadcast end, client or service end), for detecting whether the audio processing modules in local device are abnormal；Can also apply in clothes
Business end, for detecting that each audio processing modules is (including the sound in main broadcaster end and spectators' end equipment in whole audio frequency processing system
Frequency processing module) it is whether abnormal, in this case, the daily record for obtaining each audio processing modules can be audio processing modules master
Move prompting user after being uploaded to service end, or audio processing modules fault warning and be uploaded to service end manually.
An also class audio frequency processing equipment, this kind equipment can be recorded, and carry out denoising, music synthesis etc. to recording
Reason, such as the common equipment for being provided with singing software, be provided with recording and process equipment of software etc., each mould in this kind equipment
Block is all configured in same equipment.Under this kind of scene, equipment application the present embodiment of audio frequency processing system can be configured with by this
Method for detecting abnormality, or the abnormality detection side by service end application the present embodiment corresponding with the audio frequency processing system
Method.
In this application, the input/output audio frequency parameter includes one or more of parameter：
The data of data length, volume value and top n byte, the N are default positive integer.Wherein, data length, sound
The data of value and top n byte refer to the description in Fig. 2 embodiments, will not be described here.
In this application, it is described to be input into audio frequency parameter and output audio frequency parameter based on described, judge the Audio Processing mould
Whether block is abnormal, including：
If the data length of input audio data is different with the data length of output voice data, it is determined that Audio Processing
Module exception；Or,
The input audio data and output voice data are judged based on the input audio frequency parameter and output audio frequency parameter
It is whether abnormal, determine whether audio processing modules are abnormal by judged result.
In the present embodiment, data length refers to the total bytes of input/output voice data.A usual Audio Processing mould
The data length of the data length and output voice data of block input audio data will not change during normal transmission, work as sound
Frequency processing module is then likely to cause loss of data when occurring abnormal, causes the data of audio processing modules output voice data long
The data length of degree and input audio data is different.Therefore, it can the data length and output sound according to input audio data
The data length of frequency evidence judges that corresponding audio processing modules are whether abnormal, if the data length of output voice data and defeated
The audio frequency length for entering data is different, it is determined that corresponding audio processing modules exception.
In another embodiment, if voice data exception, needs determine whether the problem for being voice data itself
Or corresponding audio processing modules exception in audio frequency processing system.The present embodiment can judge in the following way：
If output voice data is normal, it is determined that correspondence audio processing modules are normal；
If output voice data exception, and input audio data is normal, it is determined that correspondence audio processing modules exception.
By may determine that a certain module of audio frequency processing system whether failure with upper type, typically from afterbody during judgement
Module starts up to investigate one by one, it is also possible to which several modules are investigated simultaneously, and what audio data gone out in which module and asked
Topic.
In the present embodiment, need audio data whether abnormal.As in daily record, record has audio processing modules
The audio frequency parameter of output voice data and output voice data, therefore may determine that whether voice data is different based on audio frequency parameter
Often, such as voice data is invalid, interim card occur or noise spot and quiet etc., in the present embodiment, judge input audio data or
Whether output voice data is abnormal, can be by one or more of mode：
If the data of the top n byte of the input/output voice data are entirely 0, it is determined that input/output audio frequency
Data invalid.
If the data of the top n byte of the input/output voice data are all identical, it is determined that input/output audio frequency
Data exception.
If the volume value of the input/output voice data is less than preset value, it is determined that the input/output audio frequency number
According to exception.
In the present embodiment, under normal circumstances, in voice data, the data of top n byte will not be full 0, even if mourning in silence
Under state, it will not also be full 0.Therefore, if above-mentioned byte is entirely 0, can determine as invalid voice data, i.e. audio frequency
Data exception.
In the present embodiment, under normal circumstances, in voice data, the data of top n byte will not repeat, if byte
Value repetition is identical, then can determine that interim card or noise spot, i.e. voice data exception occurs in sound.
Whether volume value can represent the voice data noiseless, if volume value is too little, such as less than -50 decibels or -60
Decibel, then can determine that the voice data is a quiet bag, i.e. voice data exception.
The output audio frequency parameter of certain audio processing modules output voice data in daily record is presented herein below, and (audio sample rate is
44.1kHz, prefixed time interval are 5 seconds, the number of the data length of recording audio evidence, corresponding volume value and front 8 bytes
According to), the daily record is related to 4 records：
2016-5-25 15:8:40 494ms Final loginex.dll YYDirector"Feed audiosdk
03 76 90 0E of 3528bytes 5A, 64 87 00...volume=-12dB " ChannelAudio::sendAudioData
ChannelAudio.cpp line:184
2016-5-25 15:8:45 784ms Final loginex.dll YYDirector"Feed audiosdk
78 87 23 41 65A3 of 3528bytes, 59 92...volume=-20dB " ChannelAudio::sendAudioData
ChannelAudio.cpp line:184
2016-5-25 15:8:50 760ms Final loginex.dll YYDirector"Feed audiosdk
23 45 84 45 23 12 E6 62...volume=-9dB " ChannelAudio of 3528bytes::sendAudioData
ChannelAudio.cpp line:184
2016-5-25 15:8:55 241ms Final loginex.dll YYDirector"Feed audiosdk
16 03 18 09 98 67 E2 02...volume=-33dB " ChannelAudio of 3528bytes::sendAudioData
ChannelAudio.cpp line:184
Wherein, 2016-5-25 15:8:40 times for representing log；
Loginex.dll represents the corresponding audio processing modules of voice data；
3528bytes represents that the data length of voice data is 3528bytes；
03 76 90 0E of 5A 64 87 00 represent the data of front 8 bytes of voice data；
Volume=-12dB represents that the volume value of voice data is -12dB.
As can be seen that the data of front 8 bytes are unsatisfactory for abnormal condition (front 8 words of voice data from above-mentioned daily record
The data of section are entirely 0, or front 8 bytes data are all identical or volume value is less than preset value), therefore output in this time
Voice data is normal, normal such that it is able to learn corresponding audio processing modules.
The output audio frequency parameter of certain audio processing modules output voice data in daily record is presented herein below, and (audio sample rate is
44.1kHz, prefixed time interval are 5 seconds, the length of voice data, corresponding volume value and front 8 bytes before record)：
2016-5-25 16:8:40 494ms Final loginex.dll YYDirector"Feed audiosdk
03 76 90 0E of 3528bytes 5A, 64 87 00...volume=-12dB " ChannelAudio::sendAudioData
ChannelAudio.cpp line:184
2016-5-25 16:8:45 784ms Final loginex.dll YYDirector"Feed audiosdk
03 76 90 0E of 3528bytes 5A, 64 87 00...volume=-20dB " ChannelAudio::sendAudioData
ChannelAudio.cpp line:184
2016-5-25 16:8:50 760ms Final loginex.dll YYDirector"Feed audiosdk
03 76 90 0E of 3528bytes 5A, 64 87 00...volume=-9dB " ChannelAudio::sendAudioData
ChannelAudio.cpp line:184
2016-5-25 16:8:55 241ms Final loginex.dll YYDirector"Feed audiosdk
03 76 90 0E of 3528bytes 5A, 64 87 00...volume=-33dB " ChannelAudio::sendAudioData
ChannelAudio.cpp line:184
The data of front 8 bytes are can be seen that from above-mentioned daily record, therefore may determine that the abnormal (voice data of audio frequency number
During this period of time there is interim card or noise spot), if now obtaining the corresponding input audio frequency parameter of this voice data again, if
Determine that input audio data is normal, then can determine this audio processing modules exception.
It is corresponding with the embodiment of aforementioned audio processing system method for detecting abnormality, present invention also provides Audio Processing system
The embodiment of the log recording apparatus and abnormal detector of system.
Fig. 5 is refer to, Fig. 5 is remembered for a kind of daily record of audio frequency processing system of the application according to an exemplary embodiment
The block diagram of recording device, described device 500 include：Acquisition module 501, logging modle 502.
Wherein, acquisition module 501, are configured to gather the audio processing modules according to Preset Time and default sample rate
Input audio data and output voice data.
Logging modle 502, is configured to record the input audio frequency parameter of the input audio data and the output audio frequency
The output audio frequency parameter of data, used as the daily record of the audio processing modules.
In an optional implementation, the audio frequency parameter includes one or more of：
The data of data length, volume value and top n byte, the N are default positive integer.
As shown in fig. 6, abnormal inspections of the Fig. 6 for a kind of audio frequency processing system of the application according to an exemplary embodiment
The block diagram of device is surveyed, described device includes：Acquisition module 601, judge module 602.
Wherein, acquisition module 601, are configured to obtain the daily record of the audio processing modules；In the daily record, record has
The output audio frequency parameter of the input audio frequency parameter and output voice data of input audio data, the input audio data and output
Voice data is collected from the input and outfan of the audio processing modules according to Preset Time and default sample rate.
Judge module 602, is configured to, based on the input audio frequency parameter and output audio frequency parameter, judge at the audio frequency
Whether reason module is abnormal.
In an optional implementation, the audio frequency parameter includes one or more of：
The data of data length, volume value and top n byte, the N are default positive integer.
In an optional implementation, the judge module specifically for：
If the data length of input audio data is different with the data length of output voice data, it is determined that Audio Processing
Module exception；Or,
The input audio data and output voice data are judged based on the input audio frequency parameter and output audio frequency parameter
It is whether abnormal, determine whether audio processing modules are abnormal by judged result.
In an optional implementation, the judge module specifically for：
If output voice data is normal, it is determined that corresponding audio processing modules are normal；
If input audio data is normal, and exports voice data exception, it is determined that correspondence audio processing modules exception.
In an optional implementation, the judge module specifically for：It is true by following one or more mode
Determine input/output voice data exception, otherwise determine that input/output voice data is normal：
If the data of the top n byte of the input/output voice data are entirely 0, it is determined that input/output audio frequency
Data exception；
If the data of the top n byte of the input/output voice data are all identical, it is determined that input/output audio frequency
Data exception；
If the volume value of the input/output voice data is less than preset value, it is determined that the input/output audio frequency number
According to exception.
In said apparatus, the function of modules and effect realizes that process specifically refers to correspondence step in said method
Process is realized, be will not be described here.
For device embodiment, as which corresponds essentially to embodiment of the method, so related part is referring to method reality
Apply the part explanation of example.Device embodiment described above is only schematic, wherein described as separating component
The module of explanation can be or may not be physically separate, as the part that module shows can be or can also
It is not physical module, you can local to be located at one, or can also be distributed on multiple mixed-media network modules mixed-medias.Can be according to reality
Need to select some or all of module therein to realize the purpose of application scheme.Those of ordinary skill in the art are not paying
In the case of going out creative work, you can to understand and implement.
The preferred embodiment of the application is the foregoing is only, not to limit the application, all essences in the application
Within god and principle, any modification, equivalent substitution and improvements done etc. are should be included within the scope of the application protection.
Claims (14)
1. a kind of method for detecting abnormality of audio frequency processing system, the audio frequency processing system include at least one Audio Processing mould
Block, it is characterised in that the method comprising the steps of：
Obtain the daily record of the audio processing modules；In the daily record, record has the input audio frequency parameter of input audio data and defeated
Go out the output audio frequency parameter of voice data, the input audio data and output voice data are according to Preset Time and default sampling
Rate is collected from the input and outfan of the audio processing modules；
Based on the input audio frequency parameter and output audio frequency parameter, judge whether the audio processing modules are abnormal.
2. the method for claim 1, it is characterised in that the input/output audio frequency parameter includes following a kind of or many
Plant parameter：
The data of data length, volume value and top n byte, the N are default positive integer.
3. method as claimed in claim 2, it is characterised in that described based on the input audio frequency parameter and output audio frequency ginseng
Number, judges whether the audio processing modules are abnormal, including：
If the data length of input audio data is different with the data length of output voice data, it is determined that audio processing modules
It is abnormal；Or,
The input audio data is judged based on the input audio frequency parameter and output audio frequency parameter and whether voice data is exported
It is abnormal, determine whether audio processing modules are abnormal by judged result.
4. method as claimed in claim 3, it is characterised in that described to determine whether audio processing modules are different by judged result
Often, including：
If output voice data is normal, it is determined that corresponding audio processing modules are normal；
If input audio data is normal, and exports voice data exception, it is determined that correspondence audio processing modules exception.
5. method as claimed in claim 4, it is characterised in that input/output sound is determined by following one or more mode
Frequency data exception, otherwise determines that input/output voice data is normal：
If the data of the top n byte of the input/output voice data are entirely 0, it is determined that input/output voice data
It is abnormal；
If the data of the top n byte of the input/output voice data are all identical, it is determined that input/output voice data
It is abnormal；
If the volume value of the input/output voice data is less than preset value, it is determined that the input/output voice data is different
Often.
6. a kind of log recording method of audio frequency processing system, the audio frequency processing system include at least one Audio Processing mould
Block, it is characterised in that the method comprising the steps of：
The input audio data and output voice data of the audio processing modules are gathered according to Preset Time and default sample rate；
The input audio frequency parameter and the output audio frequency parameter of the output voice data of the input audio data is recorded, as institute
State the daily record of audio processing modules.
7. method as claimed in claim 6, it is characterised in that the input/output audio frequency parameter includes following a kind of or many
Plant parameter：
The data of data length, volume value and top n byte, the N are default positive integer.
8. a kind of abnormal detector of audio frequency processing system, the audio frequency processing system include at least one Audio Processing mould
Block, it is characterised in that described device includes：
Acquisition module, is configured to obtain the daily record of the audio processing modules；In the daily record, record has input audio data
Input audio frequency parameter and output voice data output audio frequency parameter, the input audio data and output voice data according to
Preset Time and default sample rate are collected from the input and outfan of the audio processing modules；
Judge module, is configured to, based on the input audio frequency parameter and output audio frequency parameter, judge the audio processing modules
It is whether abnormal.
9. device as claimed in claim 8, it is characterised in that the audio frequency parameter includes one or more of：
The data of data length, volume value and top n byte, the N are default positive integer.
10. device as claimed in claim 9, it is characterised in that the judge module specifically for：
If the data length of input audio data is different with the data length of output voice data, it is determined that audio processing modules
It is abnormal；Or,
The input audio data is judged based on the input audio frequency parameter and output audio frequency parameter and whether voice data is exported
It is abnormal, determine whether audio processing modules are abnormal by judged result.
11. devices as claimed in claim 10, it is characterised in that the judge module specifically for：
If output voice data is normal, it is determined that corresponding audio processing modules are normal；
If input audio data is normal, and exports voice data exception, it is determined that correspondence audio processing modules exception.
12. devices as claimed in claim 11, it is characterised in that the judge module specifically for：By following a kind of or
Various ways determine input/output voice data exception, otherwise determine that input/output voice data is normal：
If the data of the top n byte of the input/output voice data are entirely 0, it is determined that input/output voice data
It is abnormal；
If the data of the top n byte of the input/output voice data are all identical, it is determined that input/output voice data
It is abnormal；
If the volume value of the input/output voice data is less than preset value, it is determined that the input/output voice data is different
Often.
A kind of 13. log recording apparatus of audio frequency processing system, the audio frequency processing system include at least one Audio Processing mould
Block, it is characterised in that described device includes：
Acquisition module, is configured to gather the input audio frequency number of the audio processing modules according to Preset Time and default sample rate
According to output voice data；
Logging modle, be configured to record the input audio data input audio frequency parameter and the output voice data it is defeated
Go out audio frequency parameter, as the daily record of the audio processing modules.
14. devices as claimed in claim 13, it is characterised in that the audio frequency parameter includes one or more of：
The data of data length, volume value and top n byte, the N are default positive integer.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611014900.7A CN106534980B (en) | 2016-11-15 | 2016-11-15 | abnormity detection method of audio processing system, log recording method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611014900.7A CN106534980B (en) | 2016-11-15 | 2016-11-15 | abnormity detection method of audio processing system, log recording method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106534980A true CN106534980A (en) | 2017-03-22 |
| CN106534980B CN106534980B (en) | 2019-12-06 |
Family
ID=58352310
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201611014900.7A Active CN106534980B (en) | 2016-11-15 | 2016-11-15 | abnormity detection method of audio processing system, log recording method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106534980B (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108416041A (en) * | 2018-03-14 | 2018-08-17 | 苏州思必驰信息科技有限公司 | Voice log analysis method and system |
| CN108877837A (en) * | 2018-06-12 | 2018-11-23 | 北京小米移动软件有限公司 | Audio signal abnormality recognition method, device and storage medium |
| CN109413492A (en) * | 2017-08-18 | 2019-03-01 | 武汉斗鱼网络科技有限公司 | Audio data reverberation processing method and system during a kind of live streaming |
| WO2019052474A1 (en) * | 2017-09-12 | 2019-03-21 | 中兴通讯股份有限公司 | Audio system management method, apparatus and device, and storage medium |
| WO2021169632A1 (en) * | 2020-02-26 | 2021-09-02 | 深圳壹账通智能科技有限公司 | Video quality detection method and apparatus, and computer device |
| CN114584481A (en) * | 2022-02-16 | 2022-06-03 | 广州市百果园信息技术有限公司 | Audio information acquisition method, device, equipment and storage medium |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20050249353A1 (en) * | 2004-05-05 | 2005-11-10 | Visteon Global Technologies, Inc. | System and method for detecting fault conditions on audio output channels |
| CN1926824A (en) * | 2004-05-26 | 2007-03-07 | 日本电信电话株式会社 | Sound packet reproducing method, sound packet reproducing apparatus, sound packet reproducing program, and recording medium |
| CN101089641A (en) * | 2007-07-12 | 2007-12-19 | 北京中星微电子有限公司 | Method system for implementing investigating audio-frequency equipment and audio-frequency equipment |
| CN101247622A (en) * | 2008-03-03 | 2008-08-20 | 中兴通讯股份有限公司 | Testing method and device of audio communication system |
| CN101383595A (en) * | 2007-09-07 | 2009-03-11 | 罗姆股份有限公司 | Electronic volume ajuster and audio device using thereof and abnormity detection method |
| CN102486795A (en) * | 2010-12-03 | 2012-06-06 | 中国移动通信集团陕西有限公司 | Method and device for inspecting balance of dynamic file |
| CN103164434A (en) * | 2011-12-13 | 2013-06-19 | 阿里巴巴集团控股有限公司 | Method, device and system for obtaining real-time data |
| CN104854635A (en) * | 2012-11-20 | 2015-08-19 | 庞巴迪运输有限公司 | Safe audio playback in a human-machine interface |
| CN105979255A (en) * | 2016-06-28 | 2016-09-28 | 青岛歌尔声学科技有限公司 | Audio acquisition tooling, method and cloud server |
-
2016
- 2016-11-15 CN CN201611014900.7A patent/CN106534980B/en active Active
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20050249353A1 (en) * | 2004-05-05 | 2005-11-10 | Visteon Global Technologies, Inc. | System and method for detecting fault conditions on audio output channels |
| CN1926824A (en) * | 2004-05-26 | 2007-03-07 | 日本电信电话株式会社 | Sound packet reproducing method, sound packet reproducing apparatus, sound packet reproducing program, and recording medium |
| CN101089641A (en) * | 2007-07-12 | 2007-12-19 | 北京中星微电子有限公司 | Method system for implementing investigating audio-frequency equipment and audio-frequency equipment |
| CN101383595A (en) * | 2007-09-07 | 2009-03-11 | 罗姆股份有限公司 | Electronic volume ajuster and audio device using thereof and abnormity detection method |
| CN101247622A (en) * | 2008-03-03 | 2008-08-20 | 中兴通讯股份有限公司 | Testing method and device of audio communication system |
| CN102486795A (en) * | 2010-12-03 | 2012-06-06 | 中国移动通信集团陕西有限公司 | Method and device for inspecting balance of dynamic file |
| CN103164434A (en) * | 2011-12-13 | 2013-06-19 | 阿里巴巴集团控股有限公司 | Method, device and system for obtaining real-time data |
| CN104854635A (en) * | 2012-11-20 | 2015-08-19 | 庞巴迪运输有限公司 | Safe audio playback in a human-machine interface |
| CN105979255A (en) * | 2016-06-28 | 2016-09-28 | 青岛歌尔声学科技有限公司 | Audio acquisition tooling, method and cloud server |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109413492A (en) * | 2017-08-18 | 2019-03-01 | 武汉斗鱼网络科技有限公司 | Audio data reverberation processing method and system during a kind of live streaming |
| CN109413492B (en) * | 2017-08-18 | 2021-05-28 | 武汉斗鱼网络科技有限公司 | Audio data reverberation processing method and system in live broadcast process |
| WO2019052474A1 (en) * | 2017-09-12 | 2019-03-21 | 中兴通讯股份有限公司 | Audio system management method, apparatus and device, and storage medium |
| CN108416041A (en) * | 2018-03-14 | 2018-08-17 | 苏州思必驰信息科技有限公司 | Voice log analysis method and system |
| CN108416041B (en) * | 2018-03-14 | 2019-05-03 | 苏州思必驰信息科技有限公司 | Voice log analysis method and system |
| CN108877837A (en) * | 2018-06-12 | 2018-11-23 | 北京小米移动软件有限公司 | Audio signal abnormality recognition method, device and storage medium |
| WO2021169632A1 (en) * | 2020-02-26 | 2021-09-02 | 深圳壹账通智能科技有限公司 | Video quality detection method and apparatus, and computer device |
| CN114584481A (en) * | 2022-02-16 | 2022-06-03 | 广州市百果园信息技术有限公司 | Audio information acquisition method, device, equipment and storage medium |
| CN114584481B (en) * | 2022-02-16 | 2024-05-17 | 广州市百果园信息技术有限公司 | Audio information acquisition method, device, equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106534980B (en) | 2019-12-06 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106534980A (en) | Anomaly detection method for audio processing system and logging method and device | |
| CN103077734A (en) | Time alignment of recorded audio signals | |
| WO2017148442A1 (en) | Audio and video processing method and apparatus, and computer storage medium | |
| WO2014188231A1 (en) | A shared audio scene apparatus | |
| CN112312167B (en) | Broadcast content monitoring method and device, storage medium and electronic equipment | |
| US8271113B2 (en) | Audio testing system and method | |
| CN107591167B (en) | Method and system for realizing automatic detection of vehicle-mounted multimedia audio compatibility | |
| CN105872611A (en) | Pressure-bearing test method and device of cloud live broadcast system | |
| US20140010379A1 (en) | System and Method for Transmitting Environmental Acoustical Information in Digital Audio Signals | |
| GB2550732B (en) | Distributed live performance scheduled audio recording, cloud-based audio content editing and distribution of audio tracks and associated metadata | |
| CN108111872B (en) | Audio live broadcasting system | |
| CN108124042A (en) | Device fault detection method and device and mobile terminal | |
| CN105808719B (en) | Audio-frequency information recommended method and device | |
| JP2005522744A (en) | How to identify audio content | |
| CN110324566B (en) | Method, device and equipment for testing sound delay in video conference | |
| US7966393B2 (en) | System and method for media stream monitoring | |
| US6839675B2 (en) | Real-time monitoring system for codec-effect sampling during digital processing of a sound source | |
| JP4219749B2 (en) | Audience rating survey system and audience rating survey method | |
| CN110808062B (en) | Mixed voice separation method and device | |
| CN103796062A (en) | Loudness log for recovery of gated loudness measurements and associated analyzer | |
| CN109218849A (en) | A kind of processing method of live data, device, equipment and storage medium | |
| JP3737614B2 (en) | Broadcast confirmation system using audio signal, and audio material production apparatus and broadcast confirmation apparatus used in this system | |
| FR2985357A1 (en) | CONTROL METHOD AND APPARATUS FOR DETERMINING AN IDENTIFICATION CODE OF AN AUDIO DATA PACKET | |
| US20180152739A1 (en) | Device-Based Audio-Format Selection | |
| KR102243124B1 (en) | User authentication methodo using ultrasonics wave |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| EE01 | Entry into force of recordation of patent licensing contract | ||
| EE01 | Entry into force of recordation of patent licensing contract |
Application publication date: 20170322 Assignee: GUANGZHOU CUBESILI INFORMATION TECHNOLOGY Co.,Ltd. Assignor: GUANGZHOU HUADUO NETWORK TECHNOLOGY Co.,Ltd. Contract record no.: X2021980000151 Denomination of invention: Abnormal detection method, log recording method and device of audio processing system Granted publication date: 20191206 License type: Common License Record date: 20210107 |