CN108920575A - Daily record data analysis method, device and readable storage medium storing program for executing based on dynamic sensing - Google Patents
Daily record data analysis method, device and readable storage medium storing program for executing based on dynamic sensing Download PDFInfo
- Publication number
- CN108920575A CN108920575A CN201810654937.9A CN201810654937A CN108920575A CN 108920575 A CN108920575 A CN 108920575A CN 201810654937 A CN201810654937 A CN 201810654937A CN 108920575 A CN108920575 A CN 108920575A
- Authority
- CN
- China
- Prior art keywords
- query statement
- user
- small
- inquiry
- streaming
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Landscapes
- Debugging And Monitoring (AREA)
Abstract
The present invention relates to a kind of daily record data analysis method, device and readable storage medium storing program for executing based on dynamic sensing, method therein include：Several small inquiries are parsed and obtain to the query statement of user's input, the query statement includes the combination of preset some instructions and/or function；Parallel search is carried out to each small inquiry, and the parallel search process of each small inquiry is made to form streaming order；Parallel parsing is carried out to each small inquiry according to the streaming order；Parallel parsing result is polymerize, accident analysis report is generated.Beneficial effects of the present invention are：Built-in instruction and function, each instruction and function can neatly combine with it is nested, query statement of the user in inquiry as needed is flexibly with the instruction and function taken out, it can include that the user of no programming basis provides resolving ideas when solving log failure to any user, realize the effect that the resolving ideas of easy-to-use, quick offer problem and flexible utilization resolving ideas solve the problems, such as.
Description
Technical field
The present embodiments relate to technical field of data processing more particularly to a kind of daily record datas based on dynamic sensing point
Analyse method, apparatus and readable storage medium storing program for executing.
Background technique
Daily record data is the basis of many enterprises' applications such as troubleshooting, monitoring, safety, conjunction rule, electronic evidence-collecting.Meanwhile
They have huge break-up value, and with the arriving of big data era, data generation speed is accelerated, the data scale of construction is huge, single
The speed that machine generates data can not be kept up with manpower.Most of contents in daily record data can not also transfer to artificial directly knowledge
Not.As the growth of amount and type is held in log, daily record data has exceeded the cognitive ability of the mankind, is analyzed simultaneously log content
It is more and more difficult to track potential problem.The general log processing system of industry use Hadoop distributed schemes, need using
Person writes complicated MapReduce program, could handle a data analysis requirements even more than MapReduce program.
User needs to write complicated MapReduce program, could handle a number even more than MapReduce program
According to analysis demand.And daily record data analyzes usual initial target and indefinite, needs to be formed by multiple trial and error, tradition side
The time cost of method and the learning cost of user are excessively high.
Summary of the invention
In order to overcome the problems, such as present in the relevant technologies, the present invention provides a kind of daily record data analysis based on dynamic sensing
Method, apparatus and readable storage medium storing program for executing, to realize that the daily record data analysis by the multiple common instructions and function that take out is thought
Road is for statistical analysis to daily record data.
In a first aspect, the embodiment of the invention provides a kind of daily record data analysis method based on dynamic sensing, the side
Method includes：
The query statement of user's input is parsed and obtains several small inquiries, if the query statement includes preset
Dry instruction and/or the combination of function；
Parallel search is carried out to each small inquiry, and the parallel search process of each small inquiry is made to form streaming life
It enables；
Parallel parsing is carried out to each small inquiry according to the streaming order；
Parallel parsing result is polymerize, accident analysis report is generated.
In conjunction with another aspect, in the feasible embodiment of another kind of the invention, according to the streaming order to each institute
When stating small inquiry progress parallel parsing, including：
Obtain each small type for inquiring corresponding instruction and/or function in the streaming order；
According to the type judge it is described to the streaming order parallel parsing when output non-stream subcommand and/or streaming
Subcommand；
Parallel parsing is carried out to each non-stream subcommand and/or the streaming subcommand.
In conjunction with another aspect, in another practicable embodiment of the invention, the method also includes：
Obtain several query statements of user's input；
By pipe to several query statements be combined with it is nested, wherein the pipe be one or two
It is a or more.
In conjunction on the other hand, in another practicable embodiment of the present invention, it is described according to the streaming order to each described
Small inquiry carries out：
The query statement of each pipe side is analyzed and obtains the first implementing result；
It is inputted first implementing result as the initial data of the query statement of the pipe other side, and to institute
The query statement for stating the pipe other side is analyzed and obtains the second implementing result；
To the streaming order in the process of processing, each parallel point of small inquiry in each described query statement
When analysis, the interim findings including the first implementing result and the second implementing result are shown.
In conjunction with another aspect, in another practicable embodiment of the invention, the method includes：
Obtain the preset time range of user's input；
Whether detection current time enters the preset time range；
When current time enters the preset time range, according to the default of user's input in the daily record data of acquisition
Query statement is analyzed in real time；
Export real-time analytical statement.
It is described that parallel parsing result is polymerize in another practicable embodiment of the invention in conjunction with another aspect, it is raw
At accident analysis report, further include：
Obtain the feedback information to the accident analysis report；
According to the feedback information to accident analysis report, the learning training between the query statement and accident analysis is established
Network；
The query statement is learnt with accident analysis by the learning training network；
When receiving the query statement of user's input, it is corresponding that the query statement is obtained from the learning training network
Accident analysis；
And the accident analysis is pushed to the user.
Second aspect, the present invention also provides a kind of daily record data inquiry unit based on dynamic sensing, described device include：
Syntax parsing engine modules, for several small inquiries, institute to be parsed and obtained to the query statement that user inputs
State the combination that query statement includes preset some instructions and/or function；
Parallel search engine modules, for carrying out parallel search to each small inquiry, and make each small inquiry and
Row retrieving forms streaming order；
Parallel parsing engine modules, for carrying out parallel parsing to each small inquiry according to the streaming order；
Report generation module generates accident analysis report for polymerizeing to parallel parsing result.
Above-mentioned device, the parallel parsing engine modules include：
Type acquisition submodule, for obtaining the corresponding instruction of each small inquiry and/or letter in the streaming order
Several types；
Order produce submodule, for according to the type judge it is described to the streaming order parallel parsing when export it is non-
Streaming subcommand and/or streaming subcommand；
Submodule is analyzed, for carrying out parallel parsing to each non-stream subcommand and/or the streaming subcommand.
Above-mentioned device, described device further include：
Module is obtained, for obtaining several query statements of user's input；
Sentence composite module, for by pipe to several query statements be combined with it is nested, wherein it is described
Pipe is one or two or more.
The third aspect, the present invention also provides a kind of readable storage medium storing program for executing, are stored thereon with computer instruction, which is located
The step of reason device realizes the above-mentioned daily record data analysis method based on dynamic sensing when executing.
The present invention forms a set by taking out the most common some instructions and function to log accident analysis, wherein
Instruction and function can neatly combine with it is nested, when user input query sentence calls according to the dismantling to query statement takes out
As the instruction gone out and function, the use of no programming basis personnel is greatly facilitated, can be provided to any user and solve log
Resolving ideas when failure solves the problems, such as that current user needs to write complicated MapReduce program, and realization facilitates easy
With, the resolving ideas and the effect that solves the problems, such as of flexible utilization resolving ideas of problem are quickly provided.
It should be understood that above general description and following detailed description be only it is exemplary and explanatory, not
It can the limitation present invention.
Detailed description of the invention
The drawings herein are incorporated into the specification and forms part of this specification, and shows and meets implementation of the invention
Example, and be used to explain the principle of the present invention together with specification.
Fig. 1 is a kind of process of daily record data analysis method based on dynamic sensing shown according to an exemplary embodiment
Figure.
Fig. 2 is flow chart when inquiry shown according to an exemplary embodiment is implemented.
Flow chart when Fig. 3 is sequential query shown according to an exemplary embodiment.
Flow chart when Fig. 4 is learning training shown according to an exemplary embodiment.
Fig. 5 is a kind of frame of daily record data analytical equipment based on dynamic sensing shown according to an exemplary embodiment
Figure.
Fig. 6 is the block diagram of the storage device of readable storage medium storing program for executing shown according to an exemplary embodiment.
Specific embodiment
The present invention is described in further detail with reference to the accompanying drawings and examples.It is understood that this place is retouched
The specific embodiment stated is used only for explaining the present invention rather than limiting the invention.It also should be noted that in order to just
Only the parts related to the present invention are shown in description, attached drawing rather than entire infrastructure.
It should be mentioned that some exemplary embodiments are described as before exemplary embodiment is discussed in greater detail
The processing or method described as flow chart.It is therein to be permitted although each step to be described as to the processing of sequence in flow chart
Multi-step can be implemented concurrently, concomitantly or simultaneously.In addition, the sequence of each step can be rearranged, when its operation
The processing can be terminated when completion, it is also possible to have the other steps being not included in attached drawing.Processing can correspond to
In method, function, regulation, subroutine, subprogram etc..
The present invention relates to a kind of daily record data analysis method, device and readable storage medium storing program for executing based on dynamic sensing, master
Apply to neatly use in the scene of resolving ideas of log failure, basic thought is：To log accident analysis
It takes out the most common some instructions and function and forms a set, may include common tens in the set, up to a hundred so that several
Hundred or more are common or summarize the combination of sets of instruction and function obtained, each instruction and function can neatly combine and
Nesting, query statement of the user in inquiry as needed, can be to any use flexibly with the instruction and function taken out
Family includes that the user of no programming basis provides resolving ideas when solving log failure, solves current user and needs to write complexity
MapReduce program the problem of, the resolving ideas and flexible utilization resolving ideas of easy-to-use, quick offer problem are provided
The effect solved the problems, such as.
The present embodiment is applicable in the terminal with central processing module to carry out the daily record data based on dynamic sensing
It analyzes in situation, this method can be executed by the self-contained unit of central processing, and wherein the device can be by software and/or hardware
It realizes, can generally be integrated in terminal, such as the storage device of canned program, after completing access with device to be analyzed
The i.e. executable above method, as shown in Figure 1, being a kind of process of daily record data analysis method based on dynamic sensing of the invention
Schematic diagram, the method specifically comprise the following steps：
In step 110, the query statement of user's input is parsed and obtains several small inquiries, the query statement
Combination including preset some instructions and/or function；
The executing subject of all steps of the embodiment of the present invention can specifically can be with for the central processing unit of encapsulation
For the independent log processing module provided, the query statement of user's input can receive and after dismantling according to built-in
Instruction and function provide a user the thinking solved the problems, such as.
The query statement of user's input is obtained, the query statement can be by pipe to several query statements
Be combined with it is nested, wherein the pipe be one or two or more, the query statement will be referred to by pipe " | "
It enables and function nesting combines；One query statement may include multiple pipes, i.e. the pipe of one or two or more；Instruction
And function is supported by log processing module preset configuration, and instruction and the function of the solution of log failure can be commonly used for according to
Abstract several instructions obtained and function, the instruction of built-in support and function can for by it is abstract obtain tens and on
The normal instruction and function of hundred or more numbers, according to specific Log Types or newfound log solution, this hair
In a kind of feasible implement scene of bright exemplary embodiment, instruction and function that can also be new to increase.
Query statement progress sequence parsing is obtained into small inquiry one by one, each small inquiry can correspond to instruction, one
A function or a function add the set of instruction, should correspond to instruction and the function of built-in (default) support first.
In the step 120, parallel search is carried out to each small inquiry, and makes the parallel search process of each small inquiry
Form streaming order；
Obtained each small inquiry is transmitted to parallel search module and carries out parallel search, after parallel search makes parsing
The recall precision of multiple small inquiries gets a promotion, when carrying out the code subbranch of instruction or function to each small inquiry, to its point
It is run with specific thread, each particular thread forms streaming order, the shape of this data flow in next processing
Formula, which is more advantageous to, reduces mutual inquiry bring influence, but also can more easily show user to check parallel inspection
The process of rope.
In step 130, parallel parsing is carried out to each small inquiry according to the streaming order；
In step 140, parallel parsing result is polymerize, generates accident analysis report.
In exemplary embodiments of the present invention, the streaming order judges processed and defeated according to the type of the small inquiry
Non-stream subcommand and/or streaming subcommand out；Each non-stream subcommand and/or the streaming subcommand are carried out simultaneously
Row analysis.
Method of the invention, the built-in instruction taken out and function in log analysis module, each instruction and function are supported
Freely nested and combination is carried out by pipe, when user inputs complicated query statement and inquires, complicated can be looked into
It askes sentence and resolves to small inquiry one by one, and handled by parallel search and parallel parsing, in instruction functions set
Instruction and function can neatly combine with it is nested, can reduce workload of the user when checking log failure, promote work
Make efficiency, but also have self-teaching function, new solution can be continuously added, easy-to-use, quick offer is provided
The effect that the resolving ideas and flexible utilization resolving ideas of problem solve the problems, such as.
As shown in Fig. 2, the query process of the query statement for the specific embodiment of the invention, one or more query statements are logical
It crosses syntax parsing engine modules and resolves to multiple small inquiries, multiple small inquiries are by parallel search engine modules with streaming order
Stream Processing mode carries out parallel parsing engine modules, and the corresponding query process of small inquiry can also form non-stream processing at this time
Process enters the statistics report that Medial Convergence engine modules carry out log failure resolving ideas after completing finally for parallel parsing
Table is formed, and according to the input of user can also terminate to inquire or force to refresh during this as a result, then terminating to inquire at this time or will
Current queries result returns to user, after data aggregate and ultimately forms log accident analysis report, user can be according to this
Log accident analysis report is to investigation log failure.
In a kind of feasible implement scene of exemplary embodiment of the present, it is described according to the streaming order to each described
Small inquiry carries out further including the steps that carrying out sequential query to query statement when parallel parsing, as shown in figure 3, this process can wrap
Include following steps：
In the step 310, the query statement of each pipe side is analyzed and obtains the first implementing result；
In step 320, using first implementing result as the starting number of the query statement of the pipe other side
According to input, and the query statement of the pipe other side is analyzed and obtains the second implementing result；
In a step 330, to the streaming order in the process of processing, it is each in each described query statement
When small inquiry parallel parsing, the interim findings including the first implementing result and the second implementing result are shown.
In exemplary embodiment of the present invention, using the pipe in query statement as boundary, pipe side is first carried out such as
The query statement and operation, the query result of pipe left side query statement or the operation result for executing sentence in left side, will
The input of query statement or execution sentence as the pipe other side such as right side, carries out in conjunction with the query statement on right side
Next step log data searching or operation.
During Stream Processing, user can also be showed to the operational process of query statement by stages.
Method of the invention, by being run using pipe as boundary's sequence to query statement, so that entire query process is more
Orderly, and more easily user can also be showed to check the operational process of query statement, is looked into order to which user understands
Sentence operational process is ask, the log accident analysis of user in the process is more advantageous to.
In a kind of feasible implement scene of exemplary embodiment of the present, the method includes in acquisition log number in real time
According to the query result and statistical analysis generated within the scope of seclected time, this process may include following steps：
Obtain the preset time range of user's input；
Whether detection current time enters the preset time range；
When current time enters the preset time range, according to the default of user's input in the daily record data of acquisition
Query statement is analyzed in real time；
Export real-time analytical statement.
Method of the invention, in the special time period that daily record data generates, such as when the work of daily record data on weekdays
Between 9:00~17:00 is the high concurrent phase of daily record data failure, then can choose the period is preset time range, is set
After preset time range, log analysis of the invention is run after entering the preset time range by time detection and is handled
To be quickly obtained resolving ideas, and real-time analytical statement is exported, and then not for the number of days data except preset time range
Running log analysis and processing module or the runing time for reducing log analysis processing module.
It is described that parallel parsing result is polymerize in a kind of feasible implement scene of exemplary embodiment of the present,
Generate accident analysis report, in log accident analysis each time obtain user feedback information to learn and improve,
As shown in figure 4, this process may include following steps：
In step 410, the feedback information to the accident analysis report is obtained；
The feedback information may include whether log failure cause, solution that this accident analysis report obtains are quasi-
Really, with the presence or absence of more excellent solution etc..
At step 420, according to the feedback information to accident analysis report, establish the query statement and accident analysis it
Between learning training network；
In step 430, the query statement is learnt with accident analysis by the learning training network；
In step 440, when receive user input query statement when, from the learning training network obtain described in look into
Ask the corresponding accident analysis of sentence；
In step 450, and to the user accident analysis is pushed.
Self-teaching and training are carried out by the learning training network of depth, so that the feedback information in conjunction with user is more acurrate
Ground is adjusted built-in instruction and the corresponding resolving ideas of function, greatly improves the accurate of log accident analysis report
Degree, but also user's stickiness can be increased, utilize the popularization and use of product.
Fig. 5 is a kind of structural representation of the daily record data inquiry unit based on dynamic sensing provided in an embodiment of the present invention
Figure, the device can be implemented by software and/or hardware, be generally integrated in terminal, can pass through the log number based on dynamic sensing
It is realized according to querying method.As shown, the present embodiment can be provided a kind of based on dynamic sense based on above-described embodiment
The daily record data inquiry unit known mainly includes syntax parsing engine modules 510, parallel search engine modules 520, mould
Block, parallel parsing engine modules 530 and report generation module 540.
Syntax parsing engine modules 510 therein, for parsing and obtaining several to the query statement that user inputs
Small inquiry, the query statement include the combination of preset some instructions and/or function；
Parallel search engine modules 520 therein for carrying out parallel search to each small inquiry, and make each described small
The parallel search process of inquiry forms streaming order；
Parallel parsing engine modules 530 therein, it is parallel for being carried out according to the streaming order to each small inquiry
Analysis；
Report generation module 540 therein generates accident analysis report for polymerizeing to parallel parsing result.
In a kind of feasible implement scene of exemplary embodiment of the present, the parallel parsing engine modules include：
Type acquisition submodule, for obtaining the corresponding instruction of each small inquiry and/or letter in the streaming order
Several types；
Order produce submodule, for according to the type judge it is described to the streaming order parallel parsing when export it is non-
Streaming subcommand and/or streaming subcommand；
Submodule is analyzed, for carrying out parallel parsing to each non-stream subcommand and/or the streaming subcommand.
In a kind of feasible implement scene of exemplary embodiment of the present, described device further includes：
Module is obtained, for obtaining several query statements of user's input；
Sentence composite module, for by pipe to several query statements be combined with it is nested, wherein it is described
Pipe is one or two or more.
In a kind of feasible implement scene of exemplary embodiment of the present, it is described according to the streaming order to each described
Small inquiry carries out：
First analysis module is analyzed for the query statement to each pipe side and obtains the first execution
As a result；
Second analysis module, for rising using first implementing result as the query statement of the pipe other side
The input of beginning data, and the query statement of the pipe other side is analyzed and obtains the second implementing result；
Real-time exhibition module, for the streaming order in the process of processing, each described query statement
In each small inquiry parallel parsing when, show include the first implementing result and the second implementing result interim findings.
In a kind of feasible implement scene of exemplary embodiment of the present, described device includes：
Time-obtaining module, for obtaining the preset time range of user's input；
Detection module, for detecting whether current time enters the preset time range；
Real time analysis module is used for when current time enters the preset time range, in the daily record data of acquisition
It is analyzed in real time according to the default query statement that user inputs；
Output module, for exporting real-time analytical statement.
In a kind of feasible implement scene of exemplary embodiment of the present, the report generation module 540 further includes：
Acquisition submodule is fed back, for obtaining the feedback information to the accident analysis report；
Network setting up submodule, for establishing the query statement and event according to the feedback information to accident analysis report
Learning training network between barrier analysis；
Learn submodule, for learning to the query statement with accident analysis by the learning training network；
Accident analysis submodule, for being obtained from the learning training network when receiving the query statement of user's input
Take the corresponding accident analysis of the query statement；
Submodule is pushed, be used for and pushes the accident analysis to the user.
There is provided in above-described embodiment each module between any two can be achieved communication connection, and each module can in platform
This hair can be performed in heart control device communication connection, the daily record data inquiry unit based on dynamic sensing provided in above-described embodiment
Daily record data querying method provided in bright middle any embodiment based on dynamic sensing has and executes the corresponding function of this method
Energy module and beneficial effect, the technical detail not being described in detail in the above-described embodiments, reference can be made in any embodiment of that present invention
The provided daily record data querying method based on dynamic sensing.
Fig. 6 is a kind of block diagram of computer equipment 1900 shown according to an exemplary embodiment.For example, device 1900 can
To be provided as a server.Referring to Fig. 6, it further comprises one or more places that device 1900, which includes processing component 1922,
Manage device and memory resource represented by a memory 1932, for store can by the instruction of the execution of processing component 1922,
Such as application program.The application program stored in memory 1932 may include it is one or more each correspond to one
The module of group instruction.In addition, processing component 1922 is configured as executing instruction, with execute above-described embodiment based on dynamic sensing
Daily record data querying method.
The memory 1932 can be by any kind of volatile or non-volatile memory devices or their combination
It realizes, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable
Read-only memory (EPROM), programmable read only memory (PROM), read-only memory (ROM), magnetic memory, flash memory,
Disk or CD.
Device 1900 can also include that a power supply module 1926 be configured as the power management of executive device 1900, and one
Wired or wireless network interface 1950 is configured as device 1900 being connected to network and input/output (I/O) interface
1958.Device 1900 can be operated based on the operating system for being stored in memory 1932, such as WindowsServerTM,
MacOSXTM, UnixTM, LinuxTM,
FreeBSDTM or similar.
In another implement scene of exemplary embodiment of the present, the present embodiment also provides a kind of including the non-of instruction
Provisional computer readable storage medium, if flash memory, hard disk, multimedia card, card-type memory are (for example, SD or DX memory
Deng), random access storage device (RAM), static random-access memory (SRAM), read-only memory (ROM), electric erasable can compile
Journey read-only memory (EEPROM), programmable read only memory (PROM), magnetic storage, disk, CD, server, App are answered
With store etc., it is stored thereon with computer program, corresponding function is realized when program is executed by processor, for example including instruction
Memory 1932.The non-transitorycomputer readable storage medium of the present embodiment is held for storing financial small routine by processor
The daily record data querying method based on dynamic sensing of above-described embodiment is realized when row.
Another embodiment for being related to computer program product includes corresponding in illustrated system and/or product at least
The computer executable instructions of each device in one device.These instructions can be subdivided into subroutine and/or be stored
In one or more possible static or dynamic link file.
The carrier of computer program can be any entity or device that can deliver program.For example, carrier can wrap
Containing storage medium, such as (ROM such as CDROM or semiconductor ROM) either magnetic recording media (such as floppy disk or hard disk).Into
One step, carrier can be the carrier that can be transmitted, such as electricity perhaps optical signalling its can via cable or optical cable, or
Person is transmitted by radio or other means.When program is embodied as such signal, carrier can be by such cable
Or device composition.Alternatively, carrier can be the integrated circuit for being wherein embedded with program, and the integrated circuit is suitable for holding
Row correlation technique, or used in execution for correlation technique.
Should be noted that embodiment mentioned above be illustrate the present invention, rather than limit the present invention, and this
The technical staff in field will design many alternate embodiments, without departing from scope of the appended claims.It is weighing
During benefit requires, the reference symbol of any placement between round parentheses is not to be read as being limitations on claims.Verb " packet
Include " and its paradigmatic depositing using the element being not excluded for other than those of recording in the claims or step
?.The article " one " before element or "one" be not excluded for the presence of a plurality of such elements.The present invention can pass through
Hardware including several visibly different components, and realized by properly programmed computer.Enumerating several devices
In device claim, several in these devices can be embodied by the same item of hardware.In mutually different appurtenance
Benefit states that the simple fact of certain measures does not indicate that the combination of these measures cannot be used to benefit in requiring.
If desired, different function discussed herein can be executed with different order and/or be executed simultaneously with one another.
In addition, if one or more functions described above can be optional or can be combined if expectation.
If desired, each step is not limited to the sequence that executes in each embodiment, different step as discussed above
It can be executed with different order and/or be executed simultaneously with one another.In addition, in other embodiments, described above one or more
A step can be optional or can be combined.
Although various aspects of the invention provide in the independent claim, other aspects of the invention include coming from
The combination of the dependent claims of the feature of described embodiment and/or the feature with independent claims, and not only
It is the combination clearly provided in claim.
It is to be noted here that although these descriptions are not the foregoing describe example embodiment of the invention
It should be understood in a limiting sense.It is wanted on the contrary, several change and modification can be carried out without departing from such as appended right
The scope of the present invention defined in asking.
Will be appreciated by those skilled in the art that each module in the device of the embodiment of the present invention can use general meter
Device is calculated to realize, each module can concentrate in the group of networks of single computing device or computing device composition, and the present invention is real
The method that the device in example corresponds in previous embodiment is applied, can be realized, can also be led to by executable program code
The mode of integrated circuit combination is crossed to realize, therefore the invention is not limited to specific hardware or software and its combinations.
Will be appreciated by those skilled in the art that each module in the device of the embodiment of the present invention can use general shifting
Dynamic terminal realizes that each module can concentrate in the device combination of single mobile terminal or mobile terminal composition, the present invention
Device in embodiment corresponds to the method in previous embodiment, can be realized by editing executable program code,
It can be realized by way of integrated circuit combination, therefore the invention is not limited to specific hardware or softwares and its knot
It closes.
Note that above are only exemplary embodiment of the present invention and institute's application technology principle.Those skilled in the art can manage
Solution, the invention is not limited to the specific embodiments described herein, is able to carry out various apparent changes for a person skilled in the art
Change, readjust and substitutes without departing from protection scope of the present invention.Therefore, although by above embodiments to the present invention into
It has gone and has been described in further detail, but the present invention is not limited to the above embodiments only, without departing from the inventive concept,
It can also include more other equivalent embodiments, and the scope of the invention is determined by the scope of the appended claims.
Claims (10)
1. a kind of daily record data analysis method based on dynamic sensing, which is characterized in that the method includes：
Several small inquiries are parsed and obtain to the query statement of user's input, the query statement includes preset several fingers
Order and/or the combination of function；
Parallel search is carried out to each small inquiry, and the parallel search process of each small inquiry is made to form streaming order；
Parallel parsing is carried out to each small inquiry according to the streaming order；
Parallel parsing result is polymerize, accident analysis report is generated.
2. the method according to claim 1, wherein being carried out simultaneously according to the streaming order to each small inquiry
When row analysis, including：
Obtain each small type for inquiring corresponding instruction and/or function in the streaming order；
According to the type judge it is described to the streaming order parallel parsing when output non-stream subcommand and/or streaming life
It enables；
Parallel parsing is carried out to each non-stream subcommand and/or the streaming subcommand.
3. the method according to claim 1, wherein the method also includes：
Obtain several query statements of user's input；
By pipe to several query statements be combined with it is nested, wherein the pipe be one or two and
More than.
4. according to the method described in claim 3, it is characterized in that, it is described according to the streaming order to it is each it is described it is small inquire into
Further include when row parallel parsing：
The query statement of each pipe side is analyzed and obtains the first implementing result；
It is inputted first implementing result as the initial data of the query statement of the pipe other side, and to the pipe
The query statement of the road symbol other side is analyzed and obtains the second implementing result；
To the streaming order in the process of processing, each small inquiry parallel parsing in each described query statement
When, show the interim findings including the first implementing result and the second implementing result.
5. the method according to claim 1, wherein the method includes：
Obtain the preset time range of user's input；
Whether detection current time enters the preset time range；
When current time enters the preset time range, according to the default inquiry of user's input in the daily record data of acquisition
Sentence is analyzed in real time；
Export real-time analytical statement.
6. generating failure the method according to claim 1, wherein described polymerize parallel parsing result
Analytical statement further includes：
Obtain the feedback information to the accident analysis report；
According to the feedback information to accident analysis report, the learning training net between the query statement and accident analysis is established
Network；
The query statement is learnt with accident analysis by the learning training network；
When receiving the query statement of user's input, the corresponding failure of the query statement is obtained from the learning training network
Analysis；
And the accident analysis is pushed to the user.
7. a kind of daily record data inquiry unit based on dynamic sensing, which is characterized in that described device includes：
Syntax parsing engine modules, it is described to look into for several small inquiries to be parsed and obtained to the query statement that user inputs
Ask the combination that sentence includes preset some instructions and/or function；
Parallel search engine modules for carrying out parallel search to each small inquiry, and make the parallel inspection of each small inquiry
Rope process forms streaming order；
Parallel parsing engine modules, for carrying out parallel parsing to each small inquiry according to the streaming order；
Report generation module generates accident analysis report for polymerizeing to parallel parsing result.
8. device according to claim 7, which is characterized in that the parallel parsing engine modules include：
Type acquisition submodule, for obtaining the corresponding instruction of each small inquiry in the streaming order and/or function
Type；
Order produce submodule, for according to the type judge it is described to the streaming order parallel parsing when export non-stream
Subcommand and/or streaming subcommand；
Submodule is analyzed, for carrying out parallel parsing to each non-stream subcommand and/or the streaming subcommand.
9. device according to claim 7, which is characterized in that described device further includes：
Module is obtained, for obtaining several query statements of user's input；
Sentence composite module, for by pipe to several query statements be combined with it is nested, wherein the pipeline
Symbol is one or two or more.
10. a kind of readable storage medium storing program for executing, is stored thereon with computer instruction, which is characterized in that when the instruction is executed by processor
The step of realizing claim 1~6 the method.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810654937.9A CN108920575A (en) | 2018-06-22 | 2018-06-22 | Daily record data analysis method, device and readable storage medium storing program for executing based on dynamic sensing |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810654937.9A CN108920575A (en) | 2018-06-22 | 2018-06-22 | Daily record data analysis method, device and readable storage medium storing program for executing based on dynamic sensing |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108920575A true CN108920575A (en) | 2018-11-30 |
Family
ID=64420875
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810654937.9A Pending CN108920575A (en) | 2018-06-22 | 2018-06-22 | Daily record data analysis method, device and readable storage medium storing program for executing based on dynamic sensing |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108920575A (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110083624A (en) * | 2019-03-18 | 2019-08-02 | 北京奇艺世纪科技有限公司 | Stream data processing method, equipment, data processing equipment, computer media |
| CN110134659A (en) * | 2019-05-08 | 2019-08-16 | 厦门欢乐逛科技股份有限公司 | Run log monitoring system, method, medium and the equipment of program |
| CN110718216A (en) * | 2019-03-25 | 2020-01-21 | 广东省信息安全测评中心 | Network intelligent scheduling system and method |
| CN111797618A (en) * | 2020-06-10 | 2020-10-20 | 云南电网有限责任公司 | Log analysis method and device based on syntax tree analysis |
| CN113360521A (en) * | 2021-07-08 | 2021-09-07 | 北京优特捷信息技术有限公司 | Log query method, device, equipment and storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103136364A (en) * | 2013-03-14 | 2013-06-05 | 曙光信息产业(北京)有限公司 | Cluster database system and data query processing method thereof |
| US20160253229A1 (en) * | 2013-10-30 | 2016-09-01 | Hewlett Packard Enterprise Development Lp | Event log analysis |
| CN105975617A (en) * | 2016-05-20 | 2016-09-28 | 北京京东尚科信息技术有限公司 | Multi-partition-table inquiring and processing method and device |
| CN106610999A (en) * | 2015-10-26 | 2017-05-03 | 北大方正集团有限公司 | Query processing method and device |
| CN107609040A (en) * | 2017-08-16 | 2018-01-19 | 深信服科技股份有限公司 | Data analysing method, data processing equipment and computer-readable recording medium |
-
2018
- 2018-06-22 CN CN201810654937.9A patent/CN108920575A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103136364A (en) * | 2013-03-14 | 2013-06-05 | 曙光信息产业(北京)有限公司 | Cluster database system and data query processing method thereof |
| US20160253229A1 (en) * | 2013-10-30 | 2016-09-01 | Hewlett Packard Enterprise Development Lp | Event log analysis |
| CN106610999A (en) * | 2015-10-26 | 2017-05-03 | 北大方正集团有限公司 | Query processing method and device |
| CN105975617A (en) * | 2016-05-20 | 2016-09-28 | 北京京东尚科信息技术有限公司 | Multi-partition-table inquiring and processing method and device |
| CN107609040A (en) * | 2017-08-16 | 2018-01-19 | 深信服科技股份有限公司 | Data analysing method, data processing equipment and computer-readable recording medium |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110083624A (en) * | 2019-03-18 | 2019-08-02 | 北京奇艺世纪科技有限公司 | Stream data processing method, equipment, data processing equipment, computer media |
| CN110718216A (en) * | 2019-03-25 | 2020-01-21 | 广东省信息安全测评中心 | Network intelligent scheduling system and method |
| CN110134659A (en) * | 2019-05-08 | 2019-08-16 | 厦门欢乐逛科技股份有限公司 | Run log monitoring system, method, medium and the equipment of program |
| CN111797618A (en) * | 2020-06-10 | 2020-10-20 | 云南电网有限责任公司 | Log analysis method and device based on syntax tree analysis |
| CN113360521A (en) * | 2021-07-08 | 2021-09-07 | 北京优特捷信息技术有限公司 | Log query method, device, equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108920575A (en) | Daily record data analysis method, device and readable storage medium storing program for executing based on dynamic sensing | |
| CN108628947B (en) | Business rule matching processing method, device and processing equipment | |
| CN104885078B (en) | For the method for the Two-phrase query optimization in MPP data-base cluster | |
| US20130290554A1 (en) | Open station as a stream analysis operator container | |
| CN109324793A (en) | Support the processing system and method for algorithm assembly | |
| US20190324834A1 (en) | Implementing a post error analysis system that includes log creation facilities associated with instances of software applications | |
| US11645108B2 (en) | Automated semantic tagging | |
| JP2010524060A (en) | Data merging in distributed computing | |
| CN110507986B (en) | Animation information processing method and device | |
| US20220004547A1 (en) | Method, apparatus, system, device, and storage medium for answering knowledge questions | |
| CN109684319A (en) | Data clean system, method, apparatus and storage medium | |
| CN107015841A (en) | The preprocess method and program compiling equipment of a kind of program compiling | |
| CN109977175A (en) | Data configuration querying method and device | |
| EP3474158A1 (en) | Method and device for executing distributed computing task | |
| CN100407663C (en) | Universal testing system and method for telecommunication intelligent service | |
| Yang et al. | Wholegraph: A fast graph neural network training framework with multi-gpu distributed shared memory architecture | |
| CN113806429A (en) | Canvas type log analysis method based on large data stream processing framework | |
| CN106681781A (en) | Implementation method and system for real-time computing service | |
| CN110297748A (en) | The method, apparatus and computer readable storage medium of error are called in a kind of positioning | |
| CN111797618A (en) | Log analysis method and device based on syntax tree analysis | |
| CN114466047B (en) | Method, platform, equipment and medium for conveniently accessing Internet of things equipment to Internet of things platform | |
| CN104090895B (en) | Obtain the method for radix, device, server and system | |
| WO2011160359A1 (en) | Method and device of script-driven software construction | |
| CN113495723B (en) | Method, device and storage medium for calling functional component | |
| CN109408577A (en) | ORACLE database JSON analytic method, system, device and can storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20181130 |
|
| RJ01 | Rejection of invention patent application after publication |