Specific embodiment
In order to make the object, technical scheme and advantages of the embodiment of the invention clearer, below in conjunction with the embodiment of the present invention
In attached drawing, technical scheme in the embodiment of the invention is clearly and completely described, it is clear that described embodiment is
A part of the embodiment of the present invention, instead of all the embodiments.Based on the embodiments of the present invention, those of ordinary skill in the art
Every other embodiment obtained without creative efforts, shall fall within the protection scope of the present invention.
It should be noted that in the absence of conflict, the features in the embodiments and the embodiments of the present application can phase
Mutually combination.
The present invention can describe in the general context of computer-executable instructions executed by a computer, such as program
Module.Generally, program module includes routines performing specific tasks or implementing specific abstract data types, programs, objects, member
Part, data structure etc..The present invention can also be practiced in a distributed computing environment, in these distributed computing environments, by
Task is executed by the connected remote processing devices of communication network.In a distributed computing environment, program module can be with
In the local and remote computer storage media including storage equipment.
In the present invention, " module ", " system " etc. refer to the related entities for being applied to computer, such as hardware, hardware and soft
Combination, software or software in execution of part etc..In detail, for example, element can with but be not limited to run on processor
Process, processor, object, executable element, execution thread, program and/or computer.In addition, running on answering on server
It can be element with program or shell script, server.One or more elements can in the process and/or thread of execution,
And element can be localized and/or be distributed between two or multiple stage computers on one computer, and can be by various
Computer-readable medium operation.Element can also be according to the signal with one or more data packets, for example, from one and this
Another element interacts in ground system, distributed system, and/or the network in internet passes through signal and other system interactions
The signal of data is communicated by locally and/or remotely process.
Finally, it is to be noted that, herein, the terms "include", "comprise" not only include those elements, but also
Further include other elements that are not explicitly listed, or further include for this process, method, article or equipment it is intrinsic
Element.In the absence of more restrictions, the element limited by sentence " including ... ", it is not excluded that including the element
Process, method, article or equipment in there is also other identical elements.
Referring to FIG. 1, it illustrates the flow chart of one embodiment of voice log analysis method of the invention, the present embodiment
Voice log analysis method can be adapted for voice log analysis platform voice Log Analysis System in other words.
As shown in Figure 1, in a step 101, collector journal is simultaneously stored in log warehouse;
In a step 102, extracting from log warehouse for the response time of audio user information is more than the first of threshold value
Log;
In step 103, the first log is determined as abnormal log, and the audio user information mark that will trigger log exception
It is denoted as anomalous audio information.
In the present embodiment, for step 101, log analysis platform is by acquiring log from user terminal and server
And it is stored in log warehouse, big data analysis is carried out convenient for subsequent log.Wherein, when user is from DUI (Dialog User
Interface, conversational user interface) corresponding product is downloaded on platform and in terminal in use, the product can be used in user
During generate log, while when user uses the product, can interact with DUI server, and DUI server can acquire use
The voice messaging at family, and feedback is made, server end can also generate log during this.Still due to either user journal
Server log, same dialogue will have identical recordId document code, therefore by compiling these logs just
Can also original subscriber and server entire dialog procedure, so as to according to log find there may be the problem of and there may be
The link of problem.For step 102, log analysis platform from the log of magnanimity by extracting the day that the response time is more than threshold value
Will, for example, from user issue audio-frequency information to the time that server end makes feedback be more than 1s, it may be considered that overtime, always not
Response it is also assumed that be a time out, i.e., the response time be more than threshold value may include the response time be more than threshold value and be more than threshold value not
Response.It is this to fail the case where timely responding to certainly and be of problems, these logs first can be classified as abnormal log, it is subsequent
It is uniformly processed again by special tester or commissioning staff.For step 103, the log of time-out is determined as by platform
Abnormal log, and the audio-frequency information that will trigger the user of response timeout is labeled as anomalous audio information, thus subsequent processes
In can unify that anomalous audio information is identified and trained, to promote the speech recognition capabilities of DUI platform and to identification
The feedback capability of content out.
Further, the first log that can also be more than threshold value to the response time is further analyzed, localization process
Which specific relatively more used time in stage in each stage, or to an each stage also all pre-defined processing time, when certain
When the processing time in one or more stages is more than pre-determined process-time, then it is assumed that the processing in this stage there may be problem,
Thus accurately where orientation problem, wherein each stage includes audio user being converted into text, according to characters matching technical ability
And it makes a response and response contents is returned into user.
Method through this embodiment can analyze log in response time dimension, later by the response time
Log more than threshold value is determined as abnormal log, consequently facilitating it is subsequent find the response time this block there may be the problem of, it is convenient
It is subsequent that the response time is optimized.
With further reference to Fig. 2, it illustrates another voice log analysis methods of one embodiment of the invention offer
The technical solution of flow chart, the present embodiment is suitable for voice log analysis platform or voice Log Analysis System.The present embodiment
Flow chart is the further process after the step 103 of Fig. 1.
As shown in Fig. 2, in step 201, being no more than in log warehouse for the response time of audio user information
Second log of threshold value, from any one or more extracted in the second log in each stage for lacking response audio user information
The third log in stage, wherein each stage includes that audio user is converted into text, according to characters matching technical ability and makes sound
It answers and response contents is returned into user;
In step 202, third log is determined as abnormal log, and the audio user information mark that will trigger log exception
It is denoted as anomalous audio information.
In the present embodiment, for step 201, log analysis platform by the response time is no more than the log of threshold value into
Row is analyzed again, although not overtime there may be the log of other problems so as to therefrom find out response, such as lacks certain
The log of a little necessary processing stage direct feedback results is also of problems, such as the audio due to not can recognize that user
Information, therefore can not carry out subsequent matching technical ability and returning the result, directly reply user it is similar " I do not understand you say it is assorted
", or even if identifying the audio-frequency information of user, it is subsequent when due to not finding necessary keyword in the result of identification
Step can not carry out, and can may also reply user " I does not understand what you are saying ", or it is also possible that identifying user
Audio-frequency information, also have found necessary keyword, but do not return the result normally, or be also possible to be that user passes through certain
Operation has waken up recognition mechanism, but it is subsequent do not speak again, therefore also can not provide service for user, also a lot of other feelings
Condition, those skilled in the art according to the above can be it is readily conceivable that details are not described herein.Although these log response times
Normally, it but could not also solve the problems, such as user, therefore be also abnormal log, by step 202 determining these logs
It is labeled as anomalous audio information for abnormal log and by the voice messaging for triggering log exception, it can be in order to subsequent to these logs
It conducts further analysis, where further orientation problem, such as is specifically the maloperation for identifying mistake or user, thus
It solves the problems, such as.
The voice log analysis method of the present embodiment from the log that the response time is no more than threshold value by further finding out
It not can solve the log of customer problem, and can further classify to the log for lacking the different disposal stage, so as to needle
The abnormal log for lacking different phase is handled respectively, improves treatment effeciency.
With further reference to Fig. 3, it illustrates another voice log analysis methods of one embodiment of the invention offer
The technical solution of flow chart, the present embodiment is suitable for voice log analysis platform or voice Log Analysis System.The present embodiment
Flow chart is the further process after the step 202 of Fig. 2.
As shown in figure 3, in step 301, it is complete for each stage for responding audio user information in the second log
The 4th log, extract user to the evaluation information of the 4th log;
In step 302, the bad log of user's evaluation in the 4th log is determined as abnormal log.
In the present embodiment, it acts normally, normally passes by each stage mainly for various aspects, but user feedback is still not
Good log.It is 4th day complete for each stage for responding audio user information in the second log for step 301
Will, i.e., it is normal to identify after the audio-frequency information for receiving user, normally find corresponding technical ability, and Normal Feedback is to user, these
Normal log should there is no problem for everyway, it is possible that the evaluation information of user is bad, it is therefore desirable to extract and use
The evaluation information at family, such as after technical ability Normal Feedback is to user, user passes through evaluation, marking or directly voice feedback expression
Oneself is discontented with, and at this time it is considered that user is discontented to this dialogue, it is too complicated, loud that cause of dissatisfaction is likely to be process
It is too long between seasonable, it is also possible to be the failure to the intention etc. of correct understanding user.Therefore, response normal for this response time
Process is complete, but the unsatisfied log of user, it is also desirable to abnormal log is determined it as by step 302, consequently facilitating after
It is continuous it to be further processed to promote user experience.
It in some alternative embodiments, include that technical ability is numbered in log, voice log analysis method can also include: pair
The frequency that each technical ability number occurs in log warehouse is counted, and is determined as the best technical ability number of the frequency of occurrences to pay close attention to skill
Can, preferentially abnormal log relevant to concern technical ability is handled.In the present embodiment, for including that technical ability is numbered in log
, it can further count in all logs comprising technical ability number, the frequency of occurrences of each technical ability number, so as to know use
The highest one or more technical ability of the frequency of occurrences and then can be determined as paying close attention to skill by family for the degree of concern of each technical ability
Can, so as to priority processing abnormal log relevant to concern technical ability, and then the skill that user compares concern can be optimized as early as possible
Can, promote user experience.
It include that technical ability is numbered in other optional embodiments, in log, voice log analysis method can also include:
The frequency occurred in abnormal log to each technical ability number counts, and the highest technical ability number of the frequency of occurrences is determined as exception
Rate highest technical ability is preferentially handled abnormal log corresponding to abnormal rate highest technical ability.In the present embodiment, when in log
When comprising technical ability number, the frequency occurred in all abnormal logs can also be numbered to technical ability and counted, to obtain
The highest one or more technical ability of the frequency of occurrences in abnormal log, and then it is corresponding to can prioritize processing these abnormal rate highest technical ability
Abnormal log, reduce the abnormal rate of the technical ability, optimize experience of the user to the abnormal rate highest technical ability.
In application scenes, log includes normal daily record data (normally running through whole flow process) and abnormal log data
(not running through certain processes or basic no race).In log, some mistakes are, appearance identified when writing code
Corresponding mistake number can be fed back when the mistake, referred to as dominant mistake is some not to be identified, referred to as recessive mistake.
Wherein, dominant mistake can appear in automatic log analysis, include errorID, and which tells malfunction,
Which mistake can also be fed back has, which wrong accounting is higher;
The object that the recessive wrong i.e. present invention studies, main includes missing understanding and false wake-up.Wherein, accidentally understand and refer to missing
Understand that user is intended to, such as identification there is not the demand of correct understanding user with semantic parsing, and false wake-up, which refers to waking up, to be entered later not
It speaks or does not say that intention directly exits.These can be learnt and then be further processed by weight analysis.Such as wake up it is very high,
It is very low into technical ability, illustrate to be much false wake-up, at this time it is contemplated that replacing the mode of wake-up to improve.
Voice log analysis scheme of the invention is a combination of big data technology and voice technology, in the big number in internet
Big data technology is relied on to analyze and excavate voice log according under background, while by the support of voice technology to data point
The result of analysis is efficiently used, and interactive voice experience is continued to optimize, while generating the amendment that new data carry out data model,
This is the process of a data closed loop.This needs to have deep understanding to big data technology and voice dialogue scene.
It should be noted that for the various method embodiments described above, for simple description, therefore, it is stated as a series of
Movement merge, but those skilled in the art should understand that, the present invention is not limited by the sequence of acts described because
According to the present invention, some steps may be performed in other sequences or simultaneously.Secondly, those skilled in the art should also know
It knows, the embodiments described in the specification are all preferred embodiments, and related actions and modules is not necessarily of the invention
It is necessary.
In the above-described embodiments, it all emphasizes particularly on different fields to the description of each embodiment, there is no the portion being described in detail in some embodiment
Point, reference can be made to the related descriptions of other embodiments.
As shown in figure 4, the embodiment of the present invention also provides a kind of voice Log Analysis System 400, including log collection module
410, response time analysis module 420 and abnormal log management module 430.
Wherein, log collection module 410 for collector journal and is stored in log warehouse;Response time analysis module
420, for from the log warehouse extract for audio user information response time be more than threshold value the first log;And
Abnormal log management module 430, first log for extracting the response time analysis module are determined as abnormal day
Will, and be anomalous audio information by the audio user information flag for triggering the log exception.
In some alternative embodiments, voice Log Analysis System 400 further includes that integrity analysis module (is not shown in figure
Out).Wherein, integrity analysis module does not surpass the response time of audio user information for being directed in the log warehouse
Any of each stage for lacking response audio user information is extracted in the second log for crossing threshold value from second log
Or the third log in multiple stages, wherein each stage includes audio user being converted into text, according to characters matching skill
It can and make a response and response contents are returned into user;And be also used to will be described for the abnormal log management module 430
The third log that integrity analysis module is extracted is determined as abnormal log, and the audio user that will trigger the log exception
Information flag is anomalous audio information.
In some alternative embodiments, voice Log Analysis System 400 further includes that log evaluates extraction module (in figure not
It shows).Wherein, extraction module is evaluated in log, is rung in second log for determining for the integrity analysis module
Using complete 4th log of each stage of family audio-frequency information, user is extracted to the evaluation information of the 4th log;With
And the abnormal log management module 430 is also used to the log evaluating user in the 4th log that extraction module extracts
It evaluates bad log and is determined as abnormal log.
It in some alternative embodiments, include that technical ability is numbered in log, 400 system of voice Log Analysis System further includes
Pay close attention to technical ability processing module (not shown).Wherein, technical ability processing module is paid close attention to, for each technical ability in the log warehouse
The frequency that number occurs is counted, and is determined as the frequency of occurrences highest technical ability number to pay close attention to technical ability, preferentially to the pass
The relevant abnormal log of note technical ability is handled.
It in some alternative embodiments, include that technical ability is numbered in log, 400 system of voice Log Analysis System further includes
Abnormal rate highest technical ability processing module (not shown).Wherein, abnormal rate highest technical ability processing module, for being compiled to each technical ability
Number frequency occurred in the abnormal log is counted, and the highest technical ability number of the frequency of occurrences is determined as abnormal rate highest
Technical ability is preferentially handled abnormal log corresponding to the abnormal rate highest technical ability.
It should be appreciated that each step in all modules recorded in Fig. 4 and the method with reference to described in Fig. 1, Fig. 2 and Fig. 3
It is corresponding.The operation above with respect to method description and feature and corresponding technical effect are equally applicable to all in Fig. 4 as a result,
Module, details are not described herein.
It is worth noting that, the module in embodiment of the disclosure is not limited to the scheme of the disclosure, such as log
Collection module can be described as collector journal and be stored in the module in log warehouse.Furthermore it is also possible to pass through hardware handles
Device realizes that related function module, such as log collection module can also realize that details are not described herein with processor.
In further embodiments, the embodiment of the invention also provides a kind of nonvolatile computer storage medias, calculate
Machine storage medium is stored with computer executable instructions, which can be performed in above-mentioned any means embodiment
Voice log analysis method;
As an implementation, nonvolatile computer storage media of the invention is stored with the executable finger of computer
It enables, computer executable instructions setting are as follows:
Collector journal is simultaneously stored in log warehouse;
Extraction is more than the first log of threshold value for the response time of audio user information from the log warehouse;
First log is determined as abnormal log, and is by the audio user information flag for triggering the log exception
Anomalous audio information.
As a kind of non-volatile computer readable storage medium storing program for executing, it can be used for storing non-volatile software program, non-volatile
Property computer executable program and module, as the corresponding program instruction of voice log analysis method in the embodiment of the present invention/
Module.One or more program instruction is stored in non-volatile computer readable storage medium storing program for executing, when being executed by a processor,
Execute the voice log analysis method in above-mentioned any means embodiment.
Non-volatile computer readable storage medium storing program for executing may include storing program area and storage data area, wherein storage journey
It sequence area can application program required for storage program area, at least one function;Storage data area can be stored according to voice log
Analytical equipment uses created data etc..In addition, non-volatile computer readable storage medium storing program for executing may include that high speed is random
Access memory, can also include nonvolatile memory, a for example, at least disk memory, flush memory device or other
Non-volatile solid state memory part.In some embodiments, non-volatile computer readable storage medium storing program for executing it is optional include relative to
The remotely located memory of processor, these remote memories can pass through network connection to voice log analysis device.It is above-mentioned
The example of network includes but is not limited to internet, intranet, local area network, mobile radio communication and combinations thereof.
The embodiment of the present invention also provides a kind of computer program product, and computer program product is non-volatile including being stored in
Computer program on computer readable storage medium, computer program include program instruction, when program instruction is held by computer
When row, computer is made to execute any of the above-described voice log analysis method.
Fig. 5 is the structural schematic diagram of electronic equipment provided in an embodiment of the present invention, as shown in figure 5, the equipment includes:
One or more processors 510 and memory 520, in Fig. 5 by taking a processor 510 as an example.
The equipment of voice log analysis method can also include: input unit 530 and output device 540.
Processor 510, memory 520, input unit 530 and output device 540 can pass through bus or other modes
It connects, in Fig. 5 for being connected by bus.
Memory 520 is above-mentioned non-volatile computer readable storage medium storing program for executing.
Non-volatile software program, instruction and the module that processor 510 is stored in memory 520 by operation, from
And the various function application and data processing of execute server, i.e. realization above method embodiment voice log analysis method.
Input unit 530 can receive the number or character information of input, and generates and set with the user of information delivery device
It sets and the related key signals of function control inputs.Output device 540 may include that display screen etc. shows equipment.
Method provided by the embodiment of the present invention can be performed in the said goods, has the corresponding functional module of execution method and has
Beneficial effect.The not technical detail of detailed description in the present embodiment, reference can be made to method provided by the embodiment of the present invention.
As an implementation, above-mentioned electronic apparatus application is in voice log analysis platform, comprising: at least one processing
Device;And the memory being connect at least one processor communication;Wherein, be stored with can be by least one processor for memory
The instruction of execution, instruction executed by least one processor so that at least one processor can:
Collector journal is simultaneously stored in log warehouse;
Extraction is more than the first log of threshold value for the response time of audio user information from the log warehouse;
First log is determined as abnormal log, and is by the audio user information flag for triggering the log exception
Anomalous audio information.
The electronic equipment of the embodiment of the present application exists in a variety of forms, including but not limited to:
(1) mobile communication equipment: the characteristics of this kind of equipment is that have mobile communication function, and to provide speech, data
Communication is main target.This Terminal Type includes: smart phone (such as iPhone), multimedia handset, functional mobile phone and low
Hold mobile phone etc..
(2) super mobile personal computer equipment: this kind of equipment belongs to the scope of personal computer, there is calculating and processing function
Can, generally also have mobile Internet access characteristic.This Terminal Type includes: PDA, MID and UMPC equipment etc., such as iPad.
(3) portable entertainment device: this kind of equipment can show and play multimedia content.Such equipment include: audio,
Video player (such as iPod), handheld device, e-book and intelligent toy and portable car-mounted navigation equipment.
(4) server: providing the equipment of the service of calculating, and the composition of server includes that processor, hard disk, memory, system are total
Line etc., server is similar with general computer architecture, but due to needing to provide highly reliable service, in processing energy
Power, stability, reliability, safety, scalability, manageability etc. are more demanding.
(5) other electronic devices with data interaction function.
The apparatus embodiments described above are merely exemplary, wherein described, unit can as illustrated by the separation member
It is physically separated with being or may not be, component shown as a unit may or may not be physics list
Member, it can it is in one place, or may be distributed over multiple network units.It can be selected according to the actual needs
In some or all of the modules achieve the purpose of the solution of this embodiment.
Through the above description of the embodiments, those skilled in the art can be understood that each embodiment can
It is realized by the mode of software plus general hardware platform, naturally it is also possible to pass through hardware.Based on this understanding, above-mentioned technology
Scheme substantially in other words can be embodied in the form of software products the part that the relevant technologies contribute, the computer
Software product may be stored in a computer readable storage medium, such as ROM/RAM, magnetic disk, CD, including some instructions to
So that computer equipment (can be personal computer, server or the network equipment etc.) execute each embodiment or
Method described in certain parts of embodiment.
Finally, it should be noted that above embodiments are only to illustrate the technical solution of the application, rather than its limitations;Although
The application is described in detail with reference to the foregoing embodiments, those skilled in the art should understand that: it still may be used
To modify the technical solutions described in the foregoing embodiments or equivalent replacement of some of the technical features;
And these are modified or replaceed, each embodiment technical solution of the application that it does not separate the essence of the corresponding technical solution spirit and
Range.