CN109408541A - Report decomposes statistical method, system, computer equipment and storage medium - Google Patents
Report decomposes statistical method, system, computer equipment and storage medium Download PDFInfo
- Publication number
- CN109408541A CN109408541A CN201811018807.2A CN201811018807A CN109408541A CN 109408541 A CN109408541 A CN 109408541A CN 201811018807 A CN201811018807 A CN 201811018807A CN 109408541 A CN109408541 A CN 109408541A
- Authority
- CN
- China
- Prior art keywords
- statistics
- sentence
- field
- time
- operation result
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000007619 statistical method Methods 0.000 title claims abstract description 21
- 238000000605 extraction Methods 0.000 claims abstract description 9
- 229920002755 poly(epichlorohydrin) Polymers 0.000 claims abstract description 9
- 238000000034 method Methods 0.000 claims description 11
- 238000006116 polymerization reaction Methods 0.000 claims description 11
- 230000006870 function Effects 0.000 claims description 9
- 238000012935 Averaging Methods 0.000 claims description 3
- 235000013399 edible fruits Nutrition 0.000 claims description 3
- 238000012545 processing Methods 0.000 abstract description 13
- 239000000284 extract Substances 0.000 abstract description 4
- 238000000354 decomposition reaction Methods 0.000 description 7
- 230000008569 process Effects 0.000 description 4
- 230000008901 benefit Effects 0.000 description 3
- 230000001186 cumulative effect Effects 0.000 description 3
- 230000009467 reduction Effects 0.000 description 2
- 239000002699 waste material Substances 0.000 description 2
- 230000003542 behavioural effect Effects 0.000 description 1
- 239000012141 concentrate Substances 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 238000013499 data model Methods 0.000 description 1
- 230000002708 enhancing effect Effects 0.000 description 1
- 230000008140 language development Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
Abstract
The present invention relates to technical field of data processing more particularly to a kind of report to decompose statistical method, system, computer equipment and storage medium.It obtains the daily record data report being preset in storage medium and inquiry request searches corresponding business type field in daily record data report, operation is carried out by Intermediate Statistics sentence, operation result is obtained and is stored in subreport；Object time range and object statistics sentence are obtained, corresponding operation result is searched in subreport, extracts the operation result within the scope of the object time；Aminated polyepichlorohydrin is carried out by operation result of the aggregate statistics sentence to extraction, generates query statistic result.The present invention when needing final result, polymerize operation result, the purpose for greatly improving statistical efficiency, reducing system loading by the way that the statistics sentence of original inquiry is decomposed into Intermediate Statistics sentence.
Description
Technical field
Statistical method, system, computer is decomposed the present invention relates to technical field of data processing more particularly to a kind of report to set
Standby and storage medium.
Background technique
Client user can generate a large amount of user journal, such as behavioural information, exception information daily, need to store user
The log of generation, and log is counted, analyzed and is inquired, this kind of work generally passes through log processing software and executes.Currently
Log processing system have this function of report form statistics, by timed task come the query statistic of property planning horizon, and raw
At query statistic result.
But the report bigger for query time range, then it needs to consume a large amount of computing resources.Such as, it is assumed that statistics
One month data, data strip mesh number are 100000, need to calculate 100000 directly to execute query statistic by timed task
The statistical function of a data causes execution speed slow, and generates in report set, and system load pressure is big.And it be easy to cause report
Table query time has overlapping, and the query result of history does not efficiently use, and causes the waste of resource.
Summary of the invention
In view of this, it is necessary to which, consumption system long for report query time range largely provides calculating and storage
Source and the waste problem for causing resource provide a kind of report and decompose statistical method, system, computer equipment and storage medium.
A kind of report decomposition statistical method, includes the following steps:
Obtain the daily record data report that is preset in storage medium, the daily record data report include time started field,
End time field, business type field corresponding with the time started field and the end time field obtain default
Inquiry request in the storage medium, the inquiry request include query time range, one or more Intermediate Statistics languages
Sentence；
In the daily record data report, the time started field within the scope of the query time and described is searched
The corresponding all business type fields of end time field, by the Intermediate Statistics sentence to the business type field one by one
Operation is carried out, one or more operation results are obtained, respectively by the Intermediate Statistics sentence, the query time range and described
Operation result is stored in one or more subreports；
Object time range and object statistics sentence are obtained, is searched from the statistics list being preset in the storage medium
Target Intermediate Statistics sentence corresponding with the object statistics sentence, contains in the statistics list and the object statistics sentence
Corresponding aggregate statistics sentence, one or more target Intermediate Statistics sentences, in the subreport in lookup and the target
Between the corresponding operation result of the identical Intermediate Statistics language of statistics sentence, extract the operation within the scope of the object time
As a result；
Aggregate statistics sentence corresponding with the object statistics sentence is searched from the statistics list, passes through the polymerization
It counts sentence and aminated polyepichlorohydrin is carried out to the operation result of extraction, generate query statistic result.
Before the daily record data report that the acquisition is preset in storage medium in one of the embodiments, comprising:
Pass through the journal file in log data acquisition device capturing service system；
The journal file is parsed into multiple effective field information by extractor, the effective field information includes opening
Begin time field, end time field and business type field；
Multiple effective field information are stored in the daily record data report.
It is described in one of the embodiments, to obtain the inquiry request being preset in the storage medium, comprising:
Inquiry timed task is preset in the storage medium, the inquiry timed task is the wheel of mesh multiple queries request
List is ask, inquiry timing script, inquiry request described in timing acquisition are called.
The object statistics sentence is statistical function in one of the embodiments, and the statistical function includes asking maximum
Be worth, minimize, summing, averaging, ask in the number of number, standard deviation or non-duplicate result at least one of；
When the object statistics sentence is maximizing, the Intermediate Statistics sentence that is found in the subreport
It is described poly- for all business type field maximizings within the scope of the query time, the operation result is maximum value
Closing statistics sentence is to the maximizing again of the operation result within the scope of the object time；
When the object statistics sentence is to minimize, the Intermediate Statistics sentence that is found in the subreport
To minimize to all business type fields within the scope of the query time, the operation result is minimum value, described poly-
Closing statistics sentence is to minimize again to the operation result within the scope of the object time；
When the object statistics sentence is summation, the Intermediate Statistics sentence found in the subreport is pair
All business type fields within the scope of the query time seek summation, and the operation result is summation, the aggregate statistics language
Sentence is to seek summation again to the operation result within the scope of the object time；
When the object statistics sentence is to seek number, the Intermediate Statistics sentence found in the subreport is
Number is asked to all business type fields within the scope of the query time, the operation result is number, the aggregate statistics
Sentence is to add up to the operation result within the scope of the object time；
When the object statistics sentence is to average, the Intermediate Statistics sentence that is found in the subreport
To ask summation and number to all business type fields within the scope of the query time, the operation result is summation sum number
Mesh, the aggregate statistics sentence is the a1 that sums again to obtain to the summation within the scope of the object time, to the object time range
Interior number is summed to obtain b1, is finally averaged as a1/b1；
When the object statistics sentence is to seek standard deviation, the Intermediate Statistics sentence that is found in the subreport
For to all business type fields within the scope of the query time are squared and number and seek summation, the operation result is
Quadratic sum, number and summation, the aggregate statistics sentence be it is cumulative to the summation within the scope of the object time to obtain a2, to square
With the b2 that adds up to obtain, cumulative to number to obtain c2, finally seeking standard deviation is sqrt (b2/c2- (a2/c2) ^2)；
When the object statistics sentence is to seek the number of non-duplicate result, found in the subreport it is described in
Between statistics sentence be field value and number, the operation result are asked to all business type fields within the scope of the query time
For field value and number, the aggregate statistics sentence is to merge to the field value within the scope of the object time, merges rule
It is then added for the number of same word segment value, generates the number that result is non-duplicate result.
The acquisition object time range and object statistics sentence in one of the embodiments, comprising:
Statistics timed task is preset in storage medium, the statistics timed task is object time range and corresponding mesh
The polling list of mark statistics sentence calls statistics timing script, object time range and object statistics sentence described in timing acquisition.
The acquisition object time range and object statistics sentence in one of the embodiments, comprising:
User input interface is set, the user input interface is equipped with time range field and object statistics statement field,
The object time range is obtained by the time range field, the target is obtained by the object statistics statement field
Count sentence.
A kind of report decomposition statistical system, including such as lower unit:
Information unit is obtained, for obtaining the daily record data report being preset in storage medium, the daily record data report
Including time started field, end time field, business corresponding with the time started field and the end time field
Type field obtains the inquiry request being preset in the storage medium, and the inquiry request includes query time range, one
Or multinomial Intermediate Statistics sentence；
Operation result unit is generated, for searching within the scope of the query time in the daily record data report
The time started field and the corresponding all business type fields of the end time field, pass through the Intermediate Statistics sentence
Operation is carried out to the business type field one by one, obtains one or more operation results, respectively by the Intermediate Statistics sentence,
The query time range and the operation result are stored in one or more subreports；
Operation result unit is extracted, for obtaining object time range and object statistics sentence, from being preset in the storage
Corresponding with object statistics sentence target Intermediate Statistics sentence is searched in statistics list in medium, in the statistics list
Containing aggregate statistics sentence corresponding with the object statistics sentence, one or more target Intermediate Statistics sentences, in the son
The corresponding operation result of identical with the target Intermediate Statistics sentence Intermediate Statistics language is searched in report, extracts the mesh
Mark the operation result in time range；
Query statistic result unit is generated, it is corresponding with the object statistics sentence for being searched from the statistics list
Aggregate statistics sentence carries out aminated polyepichlorohydrin by the operation result of the aggregate statistics sentence to extraction, generates inquiry system
Count result.
It in one of the embodiments, further include acquisition unit, for passing through log data acquisition device capturing service system
In journal file, the journal file is parsed into multiple effective field information, the effective field information by extractor
Including time started field, end time field and business type field, multiple effective field information are stored in described
In daily record data report.
A kind of computer equipment, including memory and processor are stored with computer-readable instruction in the memory, institute
When stating computer-readable instruction and being executed by the processor, so that the processor executes the step that above-mentioned report decomposes statistical method
Suddenly.
A kind of storage medium being stored with computer-readable instruction, the computer-readable instruction are handled by one or more
When device executes, so that one or more processors execute the step of above-mentioned report decomposes statistical method.
Above-mentioned report decomposes statistical method, device, computer equipment and storage medium, including obtains and be preset in storage medium
In daily record data report, daily record data report include time started field, end time field, with time started field and knot
The corresponding business type field of beam time field, obtains the inquiry request being preset in storage medium, and inquiry request includes inquiry
Time range, one or more Intermediate Statistics sentences；In daily record data report, at the beginning of lookup within the scope of query time
Between field and the corresponding all business type fields of end time field, by Intermediate Statistics sentence to business type field one by one
Operation is carried out, one or more operation results are obtained, respectively saves Intermediate Statistics sentence, query time range and operation result
In one or more subreports；Object time range and object statistics sentence are obtained, from the statistics being preset in storage medium
Target Intermediate Statistics sentence corresponding with object statistics sentence is searched in list, is counted in list and is contained and object statistics sentence pair
Aggregate statistics sentence, the one or more target Intermediate Statistics sentences answered are searched and target Intermediate Statistics sentence in subreport
The corresponding operation result of identical Intermediate Statistics language, extracts the operation result within the scope of the object time；It is searched from statistics list
Aggregate statistics sentence corresponding with object statistics sentence carries out polymerization fortune by operation result of the aggregate statistics sentence to extraction
It calculates, generates query statistic result.The present invention concentrates a certain moment to carry out by the function of the data statistics to daily record data report
Inquiry calculates, final in needs by the way that the statistics sentence of original inquiry is decomposed into Intermediate Statistics sentence when inquiring calculating
When as a result, the operation result in subreport that Intermediate Statistics sentence is calculated polymerize, and greatly improves search efficiency,
Heavy inquiry computation burden is evenly spread in the subreport that timing is completed and is carried out.Simultaneously as each subreport is only protected
Identical Intermediate Statistics sentence and corresponding operation result are deposited, when different object statistics sentences polymerize, as long as in having the same
Between count sentence, can directly reuse the corresponding operation result of Intermediate Statistics sentence, reach operation result multiplexing, reduction system
The purpose of load.
Detailed description of the invention
By reading the following detailed description of the preferred embodiment, various other advantages and benefits are common for this field
Technical staff will become clear.The drawings are only for the purpose of illustrating a preferred embodiment, and is not considered as to the present invention
Limitation.
Fig. 1 is the flow chart of the report decomposition statistical method in one embodiment of the invention；
Fig. 2 is the structure chart of the report decomposition statistical system in one embodiment of the invention.
Specific embodiment
In order to make the objectives, technical solutions, and advantages of the present invention clearer, with reference to the accompanying drawings and embodiments, right
The present invention is further elaborated.It should be appreciated that the specific embodiments described herein are merely illustrative of the present invention, and
It is not used in the restriction present invention.
Those skilled in the art of the present technique are appreciated that unless expressly stated, singular " one " used herein, " one
It is a ", " described " and "the" may also comprise plural form.It is to be further understood that being arranged used in specification of the invention
Diction " comprising " refer to that there are the feature, integer, step, operation, element and/or component, but it is not excluded that in the presence of or addition
Other one or more features, integer, step, operation, element, component and/or their group.
Fig. 1 is the flow chart of the report decomposition statistical method in one embodiment of the invention, as shown in Figure 1, report decomposes
Statistical method includes the following steps:
Step S1 obtains information: obtaining the daily record data report being preset in storage medium, daily record data report includes opening
Begin time field, end time field, business type field corresponding with time started field and end time field, obtains pre-
The inquiry request being located in storage medium, inquiry request include query time range, one or more Intermediate Statistics sentences.
In one embodiment, the daily record data report in this step obtains by the following method: being adopted by daily record data
Journal file in storage capturing service system；Journal file is parsed into multiple effective field information by extractor, effectively
Field information includes time started field, end time field and business type field；Multiple effective field information are stored in
In daily record data report.
Operation system such as fund business site etc. can generate journal file, this step is acquired by log data acquisition device
Journal file generally includes date, time and corresponding many types of service in journal file, as amount of access, button click volume,
User stops the information such as average duration, parses journal file by extractor, these business type fields are parsed and deposited
Chu Hou obtains the daily record data report of this step needs.When acquiring journal file, it can periodically or regularly pass through log number
Journal file is acquired according to collector, log can be obtained into operation system by filebeat collector.Filebeat is one
Filebeat collector is mounted in operation system to come as agency by the file collector of a open source using go language development
It monitors the Log Directory or specific journal file in operation system, and journal file can be sent to log processing platform
In, journal file is further processed.When parsing to journal file, Json can be selected according to the format of journal file
Extractor, gork extractor or canonical parsing, if the content in journal file is the log of particular structured type, then using just
It then parses, if the content in journal file is the log of Json type, then Json extractor is used, such as the content in journal file
It is the log of unstructured complicated type, then uses gork extractor.
The present embodiment acquires journal file by log data acquisition device, journal file is parsed by extractor, using this
The mode of embodiment obtains daily record data report, can obtain in real time newest daily record data report automatically according to operation system.
In one embodiment, the inquiry request being preset in storage medium is obtained, comprising: preset and look into storage medium
Timed task is ask, inquiry timed task is the polling list of mesh multiple queries request, calls inquiry timing script, timing acquisition is looked into
Ask request.
Storage medium in the present embodiment can be database.Database is to come tissue, storage and pipe according to data structure
The warehouse of data is managed, user, which can increase the data in database newly, intercept, update, delete etc., to be operated.In database
Data are to carry out tissue, description and storage by certain data model from overall point of view foundation.Its structure is based on data
Between associate naturally, to can provide all necessary access paths, and data are no longer directed to a certain application, but towards complete group
It knits, there are whole structured features.Based on this, subquery results information is stored in the database, guarantees data stable storage.
Storage medium in the present embodiment is also possible to text file.Text file is a kind of computer documents, it is one
The typical sequential file of kind, the logical construction of file belong to stream-oriented file.In addition to storage file significant character in text file
Information (including that can use the information such as carriage return, the line feed of ASCII character character representation) outside, cannot store other any information.Due to knot
Structure is simple, and text file is widely used in recording information, it can be avoided some problems that other file formats encounter.In addition,
When the partial information in text file when the error occurs, tend to be relatively easy to and recovered from mistake, and continue to locate
Manage remaining content.Although text files memory space is smaller, since the storage content of this step is small, this step
Storage medium preferably uses text file, and subquery results information is stored in text file, convenient for quickly reading.
Inquiry timing script in the present embodiment can use the job timing perform script of oracle, it is that one kind is based on
The timed task of storing process, using the storing process of oracle, can greatly reduce java program code writes workload,
And storing process executes on database or text file, and the superperformance that can use oracle in this way is supported, greatly
Improve executing efficiency and stability.Timing executes storing process, executes task using the job timing of oracle.It is setting
After good polling parameter and timed task, inquiry timing script in job timing perform script and the present embodiment can be specified
Time point or some daily time point voluntarily execute timed task.For example, night, weekend or the end of month, log processing platform is negative
Load is smaller, at this time timing acquisition inquiry request, reduces the log processing plateau pressure for the time that works by day, and enhancing log processing is flat
The stability of platform.
Step S2 generates subreport: in daily record data report, searching field at the beginning of within the scope of query time
All business type fields corresponding with end time field transport business type field by Intermediate Statistics sentence one by one
It calculates, obtains one or more operation results, Intermediate Statistics sentence, query time range and operation result are stored in one respectively
Or in multinomial subreport.
When counting to business type field, the statistics sentence of traditional inquiry has been split at least one by the present invention
Item Intermediate Statistics sentence, it is therefore desirable to business type field be transported respectively using at least one Intermediate Statistics sentence one by one
It calculates, obtains at least one operation result, there are several operation results then just to have several subreports.For example, including looking into inquiry request
Ask time range to be one day time range of unit, Intermediate Statistics sentence hour is to seek business type field number, to industry
Service type field seeks summation, and for this step in order to inquire the accuracys of data, the integral point time does not cover inquiry, such as query time model
When enclosing for 7:00-8:00, to business type field inquiry be 07:00.000-07:59:59.999 time range.In
Between statistics sentence ask number to obtain an operation result business type field to be stored in subreport 1, pass through Intermediate Statistics language
Sentence pair asks summation to obtain another operation result business type field and is stored in subreport 2, chooses the fortune of two periods
It calculates as a result, shown in table specific as follows 1:
Table 1
Step S3 generates operation result: object time range and object statistics sentence is obtained, from being preset in storage medium
Statistics list in search corresponding with object statistics sentence target Intermediate Statistics sentence, contain in statistics list and object statistics
The corresponding aggregate statistics sentence of sentence, one or more target Intermediate Statistics sentences are searched in subreport and are united among target
The corresponding operation result of the identical Intermediate Statistics language of sentence is counted, the operation result within the scope of the object time is extracted.
In one embodiment, object statistics sentence is statistical function, statistical function includes maximizing, minimize,
Sum, average, ask in the number of number, standard deviation or non-duplicate result at least one of.Object statistics sentence and centre
It is as shown in table 2 below to count sentence, the corresponding relationship of aggregate statistics sentence:
Table 2
Specifically, the Intermediate Statistics sentence found in subreport is pair when object statistics sentence is maximizing
All business type field maximizings within the scope of query time, operation result are maximum value, and aggregate statistics sentence is to mesh
Mark the operation result maximizing again in time range；
When object statistics sentence is to minimize, the Intermediate Statistics sentence found in subreport is to query time
All business type fields in range are minimized, and operation result is minimum value, and aggregate statistics sentence is to object time model
Operation result in enclosing is minimized again；
When object statistics sentence is summation, the Intermediate Statistics sentence found in subreport is to query time range
Interior all business type fields seek summation, and operation result is summation, and aggregate statistics sentence is to the fortune within the scope of the object time
It calculates result and seeks summation again；
When object statistics sentence is to seek number, the Intermediate Statistics sentence found in subreport is to query time model
All business type fields in enclosing seek number, and operation result is number, and aggregate statistics sentence is within the scope of the object time
Operation result adds up；
When object statistics sentence is to average, the Intermediate Statistics sentence found in subreport is to query time
All business type fields in range ask summation and number, and operation result is summation and number, and aggregate statistics sentence is to mesh
Summation in mark time range is summed to obtain a1 again, is summed to obtain b1, is finally averaged as a1/ to the number within the scope of the object time
b1；
When object statistics sentence is to seek standard deviation, the Intermediate Statistics sentence found in subreport is to query time
All business type fields in range are squared and number and seek summation, and operation result is quadratic sum, number and summation, is gathered
Conjunction statistics sentence is to add up to obtain a2 to the summation within the scope of the object time, cumulative to quadratic sum to obtain b2, adds up to obtain c2 to number, most
After ask standard deviation be sqrt (b2/c2- (a2/c2) ^2)；
When object statistics sentence is to seek the number of non-duplicate result, the Intermediate Statistics sentence found in subreport is
Field value and number are asked to all business type fields within the scope of query time, operation result is field value and number, polymerization
Statistics sentence is to merge to the field value within the scope of the object time, merges the number that rule is same word segment value and carries out phase
Add, generates the number that result is non-duplicate result.
The present embodiment is by object statistics sentence, the corresponding relationship of aggregate statistics sentence and Intermediate Statistics sentence, to decomposition
The operation result obtained afterwards is extracted according to object time range, when object statistics sentence has identical Intermediate Statistics sentence
When, the operation result that Intermediate Statistics sentence obtains can be reused, bring system load pressure when greatly reducing statistics.
In one embodiment, object time range and object statistics sentence are obtained, comprising: system is preset in storage medium
Timed task is counted, statistics timed task is the polling list of object time range and corresponding object statistics sentence, calls statistics
Timing script, timing acquisition object time range and object statistics sentence.
Statistics timed task and statistics timing script in the present embodiment can be using fixed with inquiry timed task and inquiry
When the identical method of script.Operation result is extracted by setting timed task, greatly reduces the time that works by day
Log processing plateau pressure, enhance log processing platform stability.
In one embodiment, object time range and object statistics sentence are obtained, comprising: setting user input interface,
User input interface is equipped with time range field and object statistics statement field, obtains object time model by time range field
It encloses, object statistics sentence is obtained by object statistics statement field.
When generating query statistic result without timing polymerization, user input interface, user's input can be pre-set
Interface can also be equipped with trigger button other than setting time range field and object statistics statement field, and user's clicking trigger is pressed
Button is for query statistic result corresponding with object statistics statement field in statistical time range field.The user of this step inputs
Interface can be set in log processing platform, and main body of the invention is log processing platform, and log processing platform receives
After the trigger signal of trigger button, after obtaining object time range and object statistics sentence, by aminated polyepichlorohydrin, inquiry system is generated
Count result.
Step S4 generates query statistic result: searching aggregate statistics corresponding with object statistics sentence from statistics list
Sentence carries out aminated polyepichlorohydrin by operation result of the aggregate statistics sentence to extraction, generates query statistic result.
After step S3 obtains the operation result within the scope of the object time, since the operation result of extraction is the knot after decomposing
Fruit, therefore this step by operation result of the aggregate statistics sentence to decomposition re-starts polymerization and can just obtain final inquiry and unites
Count result.The query statistic result that this step obtains can store in storage medium.For example, object statistics sentence is to be averaging
Value, object time range is 7 points to 9 points of XXXX XX day month XX, is subreport 1 by the operation result that step S3 is extracted
In number 1, number 2, summation 1, summation 2 in subreport 2.Then aggregate statistics sentence is to sum to summation 1 and summation 2 at this time
A1 is obtained, b1 is obtained to number 1 and the summation of number 2, query statistic result is average value a1/b1.
Report of the invention decomposes statistical method, by inquiry request is decomposed into the statistics sentence of traditional inquiry
Between count sentence, periodically generate multinomial subreport, by save subreport as intermediate result, needing to polymerize data
When, then the polymerization of more intermediate results, the calculating cost of subsequent polymerization can be reduced, but also calculated result may be implemented and repeat to make
With the load of reduction log processing platform.
Such as one month data of statistics, and entry number is 100000, directly executes inquiry by timed task
Statistics sentence needs to calculate the statistical function of 100000 data, and uses the aminated polyepichlorohydrin of this step, it is assumed that Intermediate Statistics language
It executes once within sentence one hour, obtains the operation result of 24*30=720 data, and operation result is stored in subreport, this
Invention only needs the statistics for executing 720 data according to polymerization demand to calculate, and greatly accelerates the biggish report of time range
The generation of table.
In one embodiment it is proposed that a kind of report decomposes statistical system, as shown in Fig. 2, including such as lower unit:
Information unit is obtained, for obtaining the daily record data report being preset in storage medium, daily record data report includes
Time started field, end time field, business type field corresponding with time started field and end time field obtain
The inquiry request being preset in storage medium, inquiry request include query time range, one or more Intermediate Statistics sentences；
Operation result unit is generated, is used in daily record data report, at the beginning of lookup within the scope of query time
Field and the corresponding all business type fields of end time field, by Intermediate Statistics sentence to business type field one by one into
Row operation obtains one or more operation results, is respectively stored in Intermediate Statistics sentence, query time range and operation result
In one or more subreports；
Operation result unit is extracted, for obtaining object time range and object statistics sentence, from being preset in storage medium
In statistics list in search corresponding with object statistics sentence target Intermediate Statistics sentence, count and contain in list and target system
Count the corresponding aggregate statistics sentence of sentence, one or more target Intermediate Statistics sentences, searched in subreport among target
The corresponding operation result of the identical Intermediate Statistics language of sentence is counted, the operation result within the scope of the object time is extracted；
Query statistic result unit is generated, for searching aggregate statistics corresponding with object statistics sentence from statistics list
Sentence carries out aminated polyepichlorohydrin by operation result of the aggregate statistics sentence to extraction, generates query statistic result.
It in one embodiment, further include acquisition unit, for by log data acquisition device capturing service system
Journal file is parsed into multiple effective field information by extractor by journal file, and effective field information includes the time started
Multiple effective field information are stored in daily record data report by field, end time field and business type field.
In one embodiment it is proposed that a kind of computer equipment, including memory and processor, it is stored in memory
Computer-readable instruction, when computer-readable instruction is executed by processor, so that processor executes the report of the various embodiments described above
Decompose the step in statistical method.
In one embodiment it is proposed that a kind of storage medium for being stored with computer-readable instruction, computer-readable finger
When order is executed by one or more processors, so that the report that one or more processors execute the various embodiments described above decomposes statistics
Step in method.
Those of ordinary skill in the art will appreciate that all or part of the steps in the various methods of above-described embodiment is can
It is completed with instructing relevant hardware by program, which can be stored in a computer readable storage medium, storage
Medium may include: read-only memory (ROM, Read Only Memory), random access memory (RAM, Random
Access Memory), disk or CD etc..
Each technical characteristic of embodiment described above can be combined arbitrarily, for simplicity of description, not to above-mentioned reality
It applies all possible combination of each technical characteristic in example to be all described, as long as however, the combination of these technical characteristics is not deposited
In contradiction, all should be considered as described in this specification.
Some exemplary embodiments of the invention above described embodiment only expresses, the description thereof is more specific and detailed, but
It cannot be construed as a limitation to the scope of the present invention.It should be pointed out that for the ordinary skill people of this field
For member, without departing from the inventive concept of the premise, various modifications and improvements can be made, these belong to of the invention
Protection scope.Therefore, the scope of protection of the patent of the invention shall be subject to the appended claims.
Claims (10)
1. a kind of report decomposes statistical method, which comprises the steps of:
The daily record data report being preset in storage medium is obtained, the daily record data report includes time started field, terminates
Time field, business type field corresponding with the time started field and the end time field, acquisition are preset in institute
The inquiry request in storage medium is stated, the inquiry request includes query time range, one or more Intermediate Statistics sentences；
In the daily record data report, the time started field and the end within the scope of the query time are searched
The corresponding all business type fields of time field carry out the business type field by the Intermediate Statistics sentence one by one
Operation obtains one or more operation results, respectively by the Intermediate Statistics sentence, the query time range and the operation
As a result it is stored in one or more subreports；
Object time range and object statistics sentence are obtained, lookup and institute from the statistics list being preset in the storage medium
The corresponding target Intermediate Statistics sentence of object statistics sentence is stated, is contained in the statistics list corresponding with the object statistics sentence
Aggregate statistics sentence, one or more target Intermediate Statistics sentences, in the subreport search and unite among the target
The corresponding operation result of the identical Intermediate Statistics language of sentence is counted, the operation knot within the scope of the object time is extracted
Fruit；
Aggregate statistics sentence corresponding with the object statistics sentence is searched from the statistics list, passes through the aggregate statistics
Sentence carries out aminated polyepichlorohydrin to the operation result of extraction, generates query statistic result.
2. report according to claim 1 decomposes statistical method, which is characterized in that the acquisition is preset in storage medium
Daily record data report before, comprising:
Pass through the journal file in log data acquisition device capturing service system；
The journal file is parsed into multiple effective field information by extractor, the effective field information includes when starting
Between field, end time field and business type field；
Multiple effective field information are stored in the daily record data report.
3. report according to claim 1 decomposes statistical method, which is characterized in that the acquisition is preset in the storage and is situated between
Inquiry request in matter, comprising:
Inquiry timed task is preset in the storage medium, the inquiry timed task is the poll column of mesh multiple queries request
Table calls inquiry timing script, inquiry request described in timing acquisition.
4. report according to claim 1 decomposes statistical method, which is characterized in that the object statistics sentence is statistics letter
Number, the statistical function include maximizing, minimize, sum, averaging, ask number, standard deviation or non-duplicate result
Number at least one of；
When the object statistics sentence is maximizing, the Intermediate Statistics sentence found in the subreport is pair
All business type field maximizings within the scope of the query time, the operation result are maximum value, the polymerization system
Counting sentence is to the maximizing again of the operation result within the scope of the object time；
When the object statistics sentence is to minimize, the Intermediate Statistics sentence found in the subreport is pair
All business type fields within the scope of the query time are minimized, and the operation result is minimum value, the polymerization system
Meter sentence is to minimize again to the operation result within the scope of the object time；
When the object statistics sentence is summation, the Intermediate Statistics sentence found in the subreport is to described
All business type fields within the scope of query time seek summation, and the operation result is summation, and the aggregate statistics sentence is
Summation is asked again to the operation result within the scope of the object time；
When the object statistics sentence is to seek number, the Intermediate Statistics sentence found in the subreport is to institute
It states all business type fields within the scope of query time and seeks number, the operation result is number, the aggregate statistics sentence
To add up to the operation result within the scope of the object time；
When the object statistics sentence is to average, the Intermediate Statistics sentence found in the subreport is pair
All business type fields within the scope of the query time ask summation and number, and the operation result is summation and number, institute
Stating aggregate statistics sentence is the a1 that sums again to obtain to the summation within the scope of the object time, to the number within the scope of the object time
Mesh is summed to obtain b1, is finally averaged as a1/b1；
When the object statistics sentence is to seek standard deviation, the Intermediate Statistics sentence found in the subreport is pair
All business type fields within the scope of the query time are squared and number and seek summation, and the operation result is square
With number and summation, the aggregate statistics sentence is the a2 that adds up to obtain to the summation within the scope of the object time, tired to quadratic sum
Add to obtain b2, add up to obtain c2 to number, finally asks standard deviation for sqrt (b2/c2- (a2/c2) ^2)；
When the object statistics sentence is to seek the number of non-duplicate result, the centre found in the subreport is united
Meter sentence is that all business type fields within the scope of the query time are asked with field value and number, and the operation result is word
Segment value and number, the aggregate statistics sentence are to merge to the field value within the scope of the object time, merge rule and are
The number of same word segment value is added, and the number that result is non-duplicate result is generated.
5. report according to claim 1 decomposes statistical method, which is characterized in that the acquisition object time range and mesh
Mark statistics sentence, comprising:
Statistics timed task is preset in storage medium, the statistics timed task is that object time range and corresponding target are united
The polling list of sentence is counted, statistics timing script, object time range and object statistics sentence described in timing acquisition are called.
6. report according to claim 1 decomposes statistical method, which is characterized in that the acquisition object time range and mesh
Mark statistics sentence, comprising:
User input interface is set, and the user input interface is equipped with time range field and object statistics statement field, passes through
The time range field obtains the object time range, obtains the object statistics by the object statistics statement field
Sentence.
7. a kind of report decomposes statistical system characterized by comprising
Information unit is obtained, for obtaining the daily record data report being preset in storage medium, the daily record data report includes
Time started field, end time field, type of service corresponding with the time started field and the end time field
Field obtains the inquiry request being preset in the storage medium, and the inquiry request includes query time range, one or more
Item Intermediate Statistics sentence；
Operation result unit is generated, described in the daily record data report, searching within the scope of the query time
Time started field and the corresponding all business type fields of the end time field, by the Intermediate Statistics sentence to institute
It states business type field and carries out operation one by one, obtain one or more operation results, respectively by the Intermediate Statistics sentence, described
Query time range and the operation result are stored in one or more subreports；
Operation result unit is extracted, for obtaining object time range and object statistics sentence, from being preset in the storage medium
In statistics list in search corresponding with object statistics sentence target Intermediate Statistics sentence, contain in the statistics list
Aggregate statistics sentence corresponding with the object statistics sentence, one or more target Intermediate Statistics sentences, in the subreport
The corresponding operation result of the middle lookup Intermediate Statistics language identical with the target Intermediate Statistics sentence, when extracting the target
Between the operation result in range；
Query statistic result unit is generated, for searching polymerization corresponding with the object statistics sentence from the statistics list
Sentence is counted, aminated polyepichlorohydrin is carried out by the operation result of the aggregate statistics sentence to extraction, generates query statistic knot
Fruit.
8. report according to claim 7 decomposes statistical system, which is characterized in that further include acquisition unit, for passing through
Journal file in log data acquisition device capturing service system, by the journal file by extractor be parsed into it is multiple effectively
Field information, the effective field information includes time started field, end time field and business type field, by multiple institutes
Effective field information is stated to be stored in the daily record data report.
9. a kind of computer equipment, including memory and processor, it is stored with computer-readable instruction in the memory, it is described
When computer-readable instruction is executed by the processor, so that the processor executes such as any one of claims 1 to 6 right
It is required that the report decomposes the step of statistical method.
10. a kind of storage medium for being stored with computer-readable instruction, the computer-readable instruction is handled by one or more
When device executes, so that one or more processors execute the report as described in any one of claims 1 to 6 claim and decompose system
The step of meter method.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811018807.2A CN109408541A (en) | 2018-09-03 | 2018-09-03 | Report decomposes statistical method, system, computer equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811018807.2A CN109408541A (en) | 2018-09-03 | 2018-09-03 | Report decomposes statistical method, system, computer equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109408541A true CN109408541A (en) | 2019-03-01 |
Family
ID=65463751
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811018807.2A Pending CN109408541A (en) | 2018-09-03 | 2018-09-03 | Report decomposes statistical method, system, computer equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109408541A (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110704454A (en) * | 2019-10-15 | 2020-01-17 | 重庆远见信息产业集团有限公司 | Report data acquisition system and method |
| CN110730109A (en) * | 2019-10-12 | 2020-01-24 | 北京百度网讯科技有限公司 | Method and apparatus for generating information |
| CN111159129A (en) * | 2019-12-31 | 2020-05-15 | 北京神州绿盟信息安全科技股份有限公司 | Statistical method and device for log report |
| CN111881094A (en) * | 2020-07-28 | 2020-11-03 | 平安科技（深圳）有限公司 | Method, device, terminal and storage medium for extracting key information in log |
| CN114611478A (en) * | 2022-03-22 | 2022-06-10 | 孙向军 | Information processing method and system based on artificial intelligence and cloud platform |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20030131215A1 (en) * | 2001-10-25 | 2003-07-10 | Bellew Matthew A. | Multi-part looked-up table fields and its use in data processing operations involving multiple tables of a relational database |
| CN102479223A (en) * | 2010-11-25 | 2012-05-30 | 中国移动通信集团浙江有限公司 | Data query method and system |
| CN102521405A (en) * | 2011-12-26 | 2012-06-27 | 中国科学院计算技术研究所 | Massive structured data storage and query methods and systems supporting high-speed loading |
| US20140095469A1 (en) * | 2012-09-28 | 2014-04-03 | Sap Ag | Optimization of database query |
| CN103729479A (en) * | 2014-01-26 | 2014-04-16 | 北京北纬通信科技股份有限公司 | Web page content statistical method and system based on distributed file storage |
| CN106874247A (en) * | 2017-01-03 | 2017-06-20 | 北京神州绿盟信息安全科技股份有限公司 | A kind of report form generation method and device |
-
2018
- 2018-09-03 CN CN201811018807.2A patent/CN109408541A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20030131215A1 (en) * | 2001-10-25 | 2003-07-10 | Bellew Matthew A. | Multi-part looked-up table fields and its use in data processing operations involving multiple tables of a relational database |
| CN102479223A (en) * | 2010-11-25 | 2012-05-30 | 中国移动通信集团浙江有限公司 | Data query method and system |
| CN102521405A (en) * | 2011-12-26 | 2012-06-27 | 中国科学院计算技术研究所 | Massive structured data storage and query methods and systems supporting high-speed loading |
| US20140095469A1 (en) * | 2012-09-28 | 2014-04-03 | Sap Ag | Optimization of database query |
| CN103729479A (en) * | 2014-01-26 | 2014-04-16 | 北京北纬通信科技股份有限公司 | Web page content statistical method and system based on distributed file storage |
| CN106874247A (en) * | 2017-01-03 | 2017-06-20 | 北京神州绿盟信息安全科技股份有限公司 | A kind of report form generation method and device |
Non-Patent Citations (1)
| Title |
|---|
| 李涛等: "《事件挖掘的理论算法及应用》", 31 March 2016 * |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110730109A (en) * | 2019-10-12 | 2020-01-24 | 北京百度网讯科技有限公司 | Method and apparatus for generating information |
| CN110704454A (en) * | 2019-10-15 | 2020-01-17 | 重庆远见信息产业集团有限公司 | Report data acquisition system and method |
| CN110704454B (en) * | 2019-10-15 | 2023-03-31 | 重庆远见信息产业集团股份有限公司 | Report data acquisition system and method |
| CN111159129A (en) * | 2019-12-31 | 2020-05-15 | 北京神州绿盟信息安全科技股份有限公司 | Statistical method and device for log report |
| CN111881094A (en) * | 2020-07-28 | 2020-11-03 | 平安科技（深圳）有限公司 | Method, device, terminal and storage medium for extracting key information in log |
| CN111881094B (en) * | 2020-07-28 | 2023-07-18 | 平安科技（深圳）有限公司 | Method, device, terminal and storage medium for extracting key information in log |
| CN114611478A (en) * | 2022-03-22 | 2022-06-10 | 孙向军 | Information processing method and system based on artificial intelligence and cloud platform |
| CN114611478B (en) * | 2022-03-22 | 2022-11-11 | 广西电网有限责任公司 | Information processing method and system based on artificial intelligence and cloud platform |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109408541A (en) | Report decomposes statistical method, system, computer equipment and storage medium | |
| JP6617117B2 (en) | Scalable analysis platform for semi-structured data | |
| CN110908997B (en) | Data blood relationship construction method and device, server and readable storage medium | |
| US7711704B2 (en) | System and method of providing date, arithmetic and other relational functions for OLAP sources | |
| US7139779B1 (en) | Method and system for developing extract transform load systems for data warehouses | |
| CN107451149B (en) | Monitoring method and device for flow data query task | |
| US7424470B2 (en) | Local data repository generation | |
| CN110795455A (en) | Dependency relationship analysis method, electronic device, computer device and readable storage medium | |
| JP2017515180A (en) | Processing data sets in big data repositories | |
| CN110362593B (en) | Data query method, device, equipment and storage medium | |
| CN113268500B (en) | Service processing method and device and electronic equipment | |
| JP2006318146A (en) | Information management system | |
| US7970757B2 (en) | Computer program product for database query optimization | |
| CN112365157A (en) | Intelligent dispatching method, device, equipment and storage medium | |
| US20220222268A1 (en) | Recommendation system for data assets in federation business data lake environments | |
| EP3480693A1 (en) | Distributed computing framework and distributed computing method | |
| CN110704472A (en) | Data query statistical method and device | |
| CN113010539A (en) | Data processing method and device | |
| Radeschütz et al. | Business impact analysis—a framework for a comprehensive analysis and optimization of business processes | |
| EP3227794A1 (en) | Unstructured search query generation from a set of structured data terms | |
| CN111125204A (en) | Analysis report obtaining method and device, electronic equipment and storage medium | |
| US11681721B2 (en) | Systems and methods for spark lineage data capture | |
| CN116126950A (en) | Real-time materialized view system and method | |
| US10311049B2 (en) | Pattern-based query result enhancement | |
| CN112765200A (en) | Data query method and device based on Elasticissearch |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190301 |