CN101388045A - Method and device for data statistics - Google Patents
Method and device for data statistics Download PDFInfo
- Publication number
- CN101388045A CN101388045A CNA200810226078XA CN200810226078A CN101388045A CN 101388045 A CN101388045 A CN 101388045A CN A200810226078X A CNA200810226078X A CN A200810226078XA CN 200810226078 A CN200810226078 A CN 200810226078A CN 101388045 A CN101388045 A CN 101388045A
- Authority
- CN
- China
- Prior art keywords
- configuration
- internal memory
- data type
- conventional data
- field
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Abstract
The invention discloses a data statistical method and a device thereof. The method comprises steps of inputting a first configuration, a second configuration and a third configuration, wherein the first configuration is used to describe attribute of the original record, the second configuration is used to describe attribute of the statistical table, and the third configuration is used to describe the generation rule of the statistical record, further, converting the original record to a general data type of the memory via the first configuration, and initiating the statistical record into the general data type of the memory via the second configuration, converting original fields of the original record which is converted into the general data type of the memory into dimension fields and index fields meeting requirements of the second configuration by applying the third configuration, furthermore, performing the index aggregate calculation on the statistical record which is initiated into the general data type of the memory according to the dimensionality to generate index fields, wherein the dimension fields and the index fields are used to form the statistical record.
Description
Technical field
The present invention relates to the data statistics technical field, relate in particular to a kind of method and device that carries out data statistics.
Background technology
When magnanimity level data were added up, existing implementation is: dependency database was handled raw readings, generated statistic record, and statistic record is shown, the user can analyze according to the statistic record that shows.
For example, if will add up, at first need to define a call detail record CDR list structure and a statistical form structure to the office direction call loss of voice telephone traffic:
table?upCDR{
……
String caller; // calling number
String called; // called number
Datetime stime; // the start time
Int opc; // OPC Origination Point Code
Int dpc; // Destination Point Code
Int cf; // call loss reason
……
}
table?upcfstat{
Datetime stime; // the start time
Int opc; // OPC Origination Point Code
Int dpc; // Destination Point Code
Int wjflag; // network utility whether
Int tsflag; // long-distance service whether
Int cf; // call loss reason
Int cfnum; // call loss number of times
}
Can add up with Structured Query Language (SQL) SQL then, concrete execution in step can may further comprise the steps:
1, from the CDR list structure, reads all raw readings, the time is converted to the integral point one hour value;
2, raw readings is divided into groups according to mark, long-distance mark, call loss reason 6 dimensions between 1 hour, source switch, purpose switch, net;
3, every group of raw readings counted, generated desired value and dimension values, dimension values is represented the dimension attribute, and desired value and dimension values have constituted statistic record jointly;
4, output statistic record;
5, the statistical form structure is inserted in the statistic record of output, for interface display.
The inventor finds that above-mentioned existing implementation comprises following shortcoming at least in research process: the versatility of existing implementation is restricted.
Particularly, the user may use the several data storehouse on same operating system, perhaps, the user may use same database on different operating system, and depend on several operation systems and database all familiar technician when the user carries out data statistics this moment.And, if the technician adds up according to user's demand, revise source code always, compile again, program is not reusable substantially, also will consider to write on the several data storehouse difference of SQL or storing process, or cross-platform compiling.
Below from following 3 aspects to describing with above-mentioned example:
(1) the timing statistics granularity is the unit interval, for example 1 hour, if customer requirements 0.5 hour, SQL can't realize, the data of express time will be read in internal memory usually, do further processing with other program language again, making like this needs to revise source code, compiles again.
(2) if customer requirements merges cf=8 and cf=9, allow the cf all be 8, then will increase SQL statement or storing process usually.But the literary style difference of the storing process of disparate databases, for different databases, it is not reusable that only user's this point requires program yet.
(3) if the user wishes to increase attribute and long-distance attribute between net in CDR, mark wjflag or long-distance mark tsflag existed in CDR between promptly the user wished to net, but in above-mentioned example, wjflag and tsflag do not exist.Need generate according to other field among the CDR.For example, whether judge whether it is tsflag, whether belong to same operator according to numbers of calling and called parties or calling and called switch address and judge whether to be wjflag in same region according to numbers of calling and called parties or calling and called switch address.Generate wjflag or the same needs modification of tsflag source code according to other field, compile again.
Summary of the invention
In view of this, the invention provides a kind of method and device that carries out data statistics, to solve the problem that existing implementation versatility is restricted.
A kind of method of carrying out data statistics, described method comprises:
Input first configuration, second configuration and the 3rd configuration, described first configuration is used to describe the attribute of raw readings, and described second configuration is used for the descriptive statistics Table Properties, and described the 3rd configuration is used for the create-rule of descriptive statistics record;
Convert described raw readings to internal memory conventional data type according to described first configuration, and statistic record is initialized to described internal memory conventional data type according to described second configuration;
Use described the 3rd configuration, the specific fields that converts the raw readings of internal memory conventional data type to is converted to dimension field and the index field that satisfies described second configuration requirement;
According to described second configuration, described dimension field and described index field, the statistic record that is initialized to internal memory conventional data type is carried out the index aggregate operation by dimension, generate the index field, described dimension field and described index field are used to constitute statistic record.
Alternatively, described the 3rd configuration also is used to describe the filtering rule of described raw readings.
Alternatively, described according to described second configuration statistic record is initialized to described internal memory conventional data type after, described method also comprises:
According to described the 3rd configuration the raw readings that converts internal memory conventional data type to is filtered;
Described the 3rd configuration of described application converts the specific fields that converts the raw readings of internal memory conventional data type to satisfy described second configuration requirement dimension field and index field and replaces with:
Use described the 3rd configuration, convert the specific fields of filtering the raw readings that converts internal memory conventional data type to afterwards to satisfy described second configuration requirement dimension field and index field.
Preferably, described the 3rd configuration of described application converts the specific fields of filtering the raw readings that converts internal memory conventional data type to afterwards to satisfy described second configuration requirement dimension field and index field and comprises:
According to described the 3rd configuration the raw readings that converts internal memory conventional data type to after filtering is carried out indirect assignment, arithmetic or logical operation, to convert dimension field and the index field that satisfies described second configuration requirement to.
Preferably, describedly convert raw readings to internal memory conventional data type and comprise according to described first configuration:
According to described first configuration described raw readings is kept in the internal memory, the data type of preservation is an internal memory conventional data type.
Alternatively, described method also comprises:
The statistic record that constitutes is kept in the internal memory, is used for dividing into groups to gather with newly-generated statistic record.
Alternatively, described method also comprises:
According to described second configuration statistic record that constitutes is exported.
Alternatively, described according to described second configuration described statistic record exported after, described method also comprises:
Set up statistical form, be used to preserve the statistic record of output.
Alternatively, described described according to described second configuration described statistic record exported after, described method also comprises:
According to described second configuration statistic record of output is put in storage.
Alternatively, described described according to described second configuration described statistic record exported after, described method also comprises:
Carrying out interface display or secondary gathers.
A kind of device that carries out data statistics, described device comprises:
Input block is used to import first configuration, second configuration and the 3rd configuration, and described first configuration is used to describe the attribute of raw readings, and described second configuration is used for the descriptive statistics Table Properties, and described the 3rd configuration is used for the create-rule of descriptive statistics record;
Conversion and initialization unit, be used for converting described raw readings to internal memory conventional data type, and statistic record be initialized to described internal memory conventional data type according to described second configuration of described input block input according to described first configuration of described input block input;
Converting unit, be used to use described the 3rd configuration of described input block input, the specific fields that described conversion and initialization unit is converted to the raw readings of internal memory conventional data type converts dimension field and the index field that satisfies described second configuration requirement to;
Generation unit, be used for described second configuration according to described input block input, the described dimension field and the described index field of described converting unit conversion, the statistic record that described conversion and initialization unit is initialized to internal memory conventional data type is carried out the index aggregate operation by dimension, generate the index field, described dimension field and described index field are used to constitute statistic record.
Alternatively, described the 3rd configuration also is used to describe the filtering rule of raw readings.
Alternatively, described device also comprises:
Filter element filters the raw readings that described conversion and initialization unit convert internal memory conventional data type to according to described the 3rd configuration of described input block input;
Described converting unit also is used to use described the 3rd configuration, converts the specific fields of filtering the raw readings that converts internal memory conventional data type to afterwards to satisfy described second configuration requirement dimension field and index field.
Alternatively, described device also comprises:
Preserve the unit, the statistic record that is used for constituting is kept at internal memory, is used for dividing into groups to gather with newly-generated statistic record.
Alternatively, described device also comprises:
Output unit is used for according to described second configuration of described input block input the statistic record that constitutes being exported.
As can be seen, the present invention by the configuration actual figure that obtains according to statistics, thereby the user is no longer dependent on the technician when carrying out data statistics, and can add up according to the needs of oneself, when the technician carries out data statistics, need not revise source code again, compile again, need not consider on the several data storehouse, to write the difference of SQL or storing process, also need not consider cross-platform compiling.
Description of drawings
Fig. 1 is the inventive method process flow diagram;
Fig. 2 is the inventive method embodiment process flow diagram;
Fig. 3 is apparatus of the present invention structural drawing;
Fig. 4 is apparatus of the present invention example structure figure.
Embodiment
For above-mentioned feature of the present invention, advantage are become apparent more, the present invention is described in detail below in conjunction with embodiment.
Please refer to Fig. 1, be the inventive method process flow diagram, can may further comprise the steps:
Step 101: input first configuration, second configuration and the 3rd configuration, described first configuration is used to describe the attribute of raw readings, and described second configuration is used for the descriptive statistics Table Properties, and described the 3rd configuration is used for the create-rule of descriptive statistics record;
Step 102: convert described raw readings to internal memory conventional data type according to described first configuration, and statistic record is initialized to described internal memory conventional data type according to described second configuration;
Step 103: use described the 3rd configuration, the specific fields that converts the raw readings of internal memory conventional data type to is converted to dimension field and the index field that satisfies described second configuration requirement;
Step 104: according to described second configuration, described dimension field and described index field, the statistic record that is initialized to internal memory conventional data type is carried out the index aggregate operation by dimension, generate the index field, described dimension field and described index field are used to constitute statistic record.
Below in conjunction with a method embodiment step shown in Figure 1 is elaborated.
In an embodiment, can may further comprise the steps:
Step 201: the user imports first configuration, second configuration and the 3rd configuration;
First configuration is used to describe the attribute of raw readings; Second configuration is used for the descriptive statistics Table Properties; The 3rd configuration is used for the create-rule of descriptive statistics record.
Step 202: receive raw readings according to first configuration; Raw readings can be from file, network SOCKET etc.
Step 203: the raw readings list structure according to first configuration converts raw readings to internal memory conventional data type;
In embodiments of the present invention, can raw readings be kept in the internal memory according to the raw readings list structure of first configuration, the data type of preservation is an internal memory conventional data type.Internal memory conventional data type is a kind of abstract of data type and encapsulation, represents all basic data types with abstract type, is convenient to common treatment.The type has also encapsulated types such as time, IP address.
Step 204: the statistical form structure according to second configuration is the statistic record storage allocation, is about to statistic record and is initialized to internal memory conventional data type;
Step 205:, the raw readings that converts internal memory conventional data type to is filtered according to the 3rd statistics syntax that dispose of user's input;
At this moment, the 3rd configuration also is used to describe the filtering rule of raw readings.Filter and be used to filter out unwanted raw readings, stay required raw readings.It is pointed out that step 205 is option.
Step 206: use the 3rd configuration the specific fields of the raw readings that converts internal memory conventional data type to that stays is handled, to convert the dimension field and the index field of second configuration requirement that satisfies user's input to;
Handle and comprise indirect assignment, arithmetic, logical operation, perhaps other complex calculation, for example: order, branch, loop structure according to similar C language carry out complex calculation.The result who handles will convert the field of the raw readings that converts internal memory conventional data type to that stays to the dimension field of the 3rd configuration requirement that satisfies user's input, be convenient to subsequent treatment.
Because step 205 is an option, when execution in step 205 not, step 206 replaces with: use the 3rd configuration the specific fields of the raw readings that converts internal memory conventional data type to is handled, to convert the dimension field and the index field of second configuration requirement that satisfies user's input to.
Step 207: according to described second configuration, described dimension field and described index field, the statistic record that is initialized to internal memory conventional data type is carried out the index aggregate operation by dimension, generate the index field.
Dimension field and index field have constituted statistic record.
Further, present embodiment can also may further comprise the steps:
Step 208: the statistic record that constitutes is kept in the internal memory, is used for when re-executing step 202 and newly-generated statistic record divides into groups to gather GROUP BY to step 207;
Step 209: second configuration according to user's input is exported the statistic record that constitutes;
For example, can count thresholding according to output timer or statistic record exports statistic record.Can output to file or SOCKET to statistic record according to output parameter, file will be distinguished scale-of-two or text.
Step 210: set up statistical form, be used to preserve the statistic record of output;
Step 211: the statistic record of output is put in storage according to second configuration;
Warehouse-in has been realized the storage method to all precognition databases, then according to the configuration of statistical form data load in data designated storehouse and statistical form.
Step 212: carry out that the interface presents or secondary gathers etc.
When facing the statistics of mass data, only need reinstate one is used for the process that secondary gathers, and receives statistics of concurrent multi-process, carries out the secondary statistics according to configuration and gets final product.Like this, just increase or revised configuration, from disposing the problem that mass data is added up that solved.
Based on step shown in Figure 2, be raw readings below, first configuration, second configuration and the 3rd configuration are given an example with CDR.
First configuration can be with reference to following example:
【upCDR】
[common]
The attribute of # definition CDR: table name, list structure, Data Source etc.
prefix?of?the?table ＝bdrforstat
suffix?of?the?table ＝YYMMDDHH
number?of?field ＝76
file?directory ＝/gspdata/gstatbdr
database?type ＝ORACLE
database?server?name ＝zcoral
database?name ＝zcdynadb
[field_n]
field?name ＝caller
field?type ＝string
length?of?type ＝18
[field_n+1]
field?name ＝called
field?type ＝string
length?of?type ＝22
[field_n+2]
field?name ＝stime
field?type ＝datetime
length?of?type ＝8
[field_n+3]
field?name ＝opc
field?type ＝int
length?of?type ＝4
[field_n+4]
field?name ＝dpc
field?type ＝int
length?of?type ＝4
[field_n+5]
field?name ＝cf
field?type ＝int
length?of?type ＝1
Here CDR is from file, file is kept at/the gspdata/gstatbdr catalogue under, the filename prefix is bdrforstat.If from SOCKET, can cancel file directory configuration, increase configuration args="-r 0-d 127.0.0.1-p 9001-t 11-f 1-a0000206D0000206D00002199000021990000000000000000 ", receive data from SOCKET.
Second configuration can be with reference to following example:
【upcfstat】
[common?option]
# describes below the attribute of statistical form, comprises information such as table name, dimension, index, external storage location.
number?of?field ＝7
Stat expression file=/configuration of usr/zc/gsp/etc/statexpr_cf.conf // statistics
primary?key?fields ＝0，1，2，3，4，5
hash?key?fields ＝0，1，2，3
file?directory ＝/gspdata/gstatfile
flag?of?whether?output?once ＝0
Time interval of output=60 # export timer
Quantity limit of output=100 # are by the output of statistic record thresholding
database?type ＝ORACLE
database?server?name ＝zcoral
database?name ＝any
database?user ＝zcss7db
database?passwd ＝zcss7db
prefix?of?the?table ＝upcfstat
suffix?of?the?table ＝YYMMDDHH
It below the # statistical form structure
[field_1]
field?name ＝stime
field?type ＝datetime
length?of?type ＝8
[field_2]
field?name ＝opc
field?type ＝int
length?of?type ＝4
[field_3]
field?name ＝dpc
field?type ＝int
length?of?type ＝4
[field_4]
field?name ＝wjflag
field?type ＝int
length?of?type ＝1
[field_5]
field?name ＝tsflag
field?type ＝int
length?of?type ＝1
[field_6]
field?name ＝cf
field?type ＝int
length?of?type ＝1
[field_7]
fieldname ＝cfnum
field?type ＝int
length?of?type ＝4
how?to?count?the?value?of?the?field＝count
The 3rd configuration can be with reference to following example:
DECLARE
String cfgTableName=" ZcSp "; // signalling point allocation list
String timeFormat=＂ YYMMDDHH ＂; The indication of // timing statistics granularity
Intz interval=1; The value of // certain granularity
VALUE_BEGIN
time_convert(DETAIL_REC[n+2]，STAT_REC[0]，timeFormat，interval)；
STAT_REC[1]＝DETAIL_REC[n+3]；
STAT_REC[2]＝DETAIL_REC[n+4]；
STAT_REC[3]＝judge_if_wj(STAT_REC[1]，STAT_REC[2]，ZcSp)；
STAT_REC[3]＝judge_if_ts(STAT_REC[1]，STAT_REC[2]，ZcSp)；
STAT_REC[4]＝DETAIL_REC[n+4]；
STAT_REC[5]＝DETAIL_REC[n+5]；
If (STAT_REC[5]==9) # is cf=9 and merging cf=8, allows their cf all be 8.
STAT_REC[5]＝8；
Each calling of # (bdr) all has one non-0 call loss value.
STAT_REC[6]＝1；
VALUE_END；
COND_BEGIN # condition: call loss result less than 0 or greater than 256 do not participate in the statistics.
STAT_REC[5]<0‖STAT_REC[5]>255；
COND_END
Use 3 functions in the configuration that step 205 to step 207 can be used, comprised time_convert, judge_if_wj and judge_if_ts.
During time_convert converted to the time granularity of statistics the datetime time,, convert to hour herein.Because time format is " YYMMDDHH ", granularity is 1 hour, if need the statistic record of 3 hours or 8 hours, only need with interval=3 or=8 get final product.If need time granularity to be minute, only need make timeFormat=" YYMMDDHHMM ", at this moment,, only need interval=5 or 10 is got final product if need the statistic record of 5 minutes or 10 minutes.
Judge_if_wj and judge_if_ts are used for according to the static data extended field.To having expanded several types abstract, can contain 90% application, indivedual special expansions can realize by loading kinematic function.Expansion can be divided into multistep, only need increase a few row configurations and get final product.
STAT_REC represents statistic record, and DETAIL_REC represents CDR,
As can be seen, no matter the user still is the technician all can be configured voluntarily, the present invention by the configuration actual figure that obtains according to statistics, thereby the user is no longer dependent on the technician when carrying out data statistics, and can add up according to the needs of oneself, when the technician carries out data statistics, need not revise source code again, compile again.
Please refer to Fig. 3, be structure drawing of device provided by the invention, can comprise:
Conversion and initialization unit 302, be used for converting described raw readings to internal memory conventional data type, and statistic record be initialized to described internal memory conventional data type according to described second configuration of described input block 301 inputs according to described first configuration of described input block 301 inputs;
Converting unit 303, be used to use described the 3rd configuration of described input block 301 inputs, the specific fields that described conversion and initialization unit 302 is converted to the raw readings of internal memory conventional data type converts dimension field and the index field that satisfies described second configuration requirement to;
Associated methods embodiment, described the 3rd configuration also is used to describe the filtering rule of raw readings.
Please refer to Fig. 4,, on the basis of Fig. 3, can also comprise for apparatus of the present invention example structure figure:
Filter element 305 filters the raw readings that described conversion and initialization unit 302 convert internal memory conventional data type to according to described the 3rd configuration of described input block 301 inputs;
Described converting unit 303 also is used to use described the 3rd configuration, converts the specific fields of filtering the raw readings that converts internal memory conventional data type to afterwards to satisfy described second configuration requirement dimension field and index field.
Preserve unit 306, the statistic record that is used for constituting is kept at internal memory, is used for dividing into groups to gather with newly-generated statistic record.
Output unit 307 is used for according to described second configuration of described input block 301 inputs the statistic record that constitutes being exported.
Be that the operation that example is carried out above-mentioned each unit is elaborated below with Fig. 4.
The user is by input block 301 inputs first configuration, second configuration and the 3rd configuration.Conversion is disposed according to first of input block 301 inputs with initialization unit 302 and is converted raw readings to internal memory conventional data type, and according to second configuration of input block 301 inputs statistic record is initialized to internal memory conventional data type.Filter element 305 filters the raw readings that converts internal memory conventional data type to according to the 3rd configuration of input block 301 inputs.Converting unit 303 is used the 3rd configuration, the specific fields of the raw readings that converts internal memory conventional data type to after filtering is converted to the dimension field of satisfied second configuration requirement.The 3rd configuration of the dimension field that generation unit 304 obtains according to converting unit 303, index field and input block 301 inputs is carried out aggregate operation to the statistic record that is initialized to internal memory conventional data type, generate the index field, dimension field and index field are used to constitute statistic record.
In addition, preserving unit 306 can be kept at the statistic record that constitutes in the internal memory, is used for dividing into groups to gather with newly-generated statistic record.Output unit 307 can be exported the statistic record that constitutes according to second configuration of input block 301 inputs.
As can be seen, no matter the user still is the technician all can be configured voluntarily, the present invention by the configuration actual figure that obtains according to statistics, thereby the user is no longer dependent on the technician when carrying out data statistics, and can add up according to the needs of oneself, when the technician carries out data statistics, need not revise source code again, compile again.
At last, also need to prove, in this article, relational terms such as first and second grades only is used for an entity or operation are made a distinction with another entity or operation, and not necessarily requires or hint and have the relation of any this reality or in proper order between these entities or the operation.And, term " comprises ", " comprising " or its any other variant are intended to contain comprising of nonexcludability, thereby make and comprise that process, method, article or the equipment of a series of key elements not only comprise those key elements, but also comprise other key elements of clearly not listing, or also be included as this process, method, article or equipment intrinsic key element.Do not having under the situation of more restrictions, the key element that limits by statement " comprising ... ", and be not precluded within process, method, article or the equipment that comprises described key element and also have other identical element.
Through the above description of the embodiments, those skilled in the art can be well understood to the present invention and can realize by the mode that software adds essential hardware platform, can certainly all implement, but the former is better embodiment under a lot of situation by hardware.Based on such understanding, all or part of can the embodying that technical scheme of the present invention contributes to background technology with the form of software product, this computer software product can be stored in the storage medium, as ROM/RAM, magnetic disc, CD etc., comprise that some instructions are with so that a computer equipment (can be a personal computer, server, the perhaps network equipment etc.) carry out the described method of some part of each embodiment of the present invention or embodiment.
More than a kind of method and device that carries out data statistics provided by the present invention is described in detail, used specific case herein principle of the present invention and embodiment are set forth, the explanation of above embodiment just is used for helping to understand method of the present invention and core concept thereof; Simultaneously, for one of ordinary skill in the art, according to thought of the present invention, the part that all can change in specific embodiments and applications, in sum, this description should not be construed as limitation of the present invention.
Claims (15)
1, a kind of method of carrying out data statistics is characterized in that, described method comprises:
Input first configuration, second configuration and the 3rd configuration, described first configuration is used to describe the attribute of raw readings, and described second configuration is used for the descriptive statistics Table Properties, and described the 3rd configuration is used for the create-rule of descriptive statistics record;
Convert described raw readings to internal memory conventional data type according to described first configuration, and statistic record is initialized to described internal memory conventional data type according to described second configuration;
Use described the 3rd configuration, the specific fields that converts the raw readings of internal memory conventional data type to is converted to dimension field and the index field that satisfies described second configuration requirement;
According to described second configuration, described dimension field and described index field, the statistic record that is initialized to internal memory conventional data type is carried out the index aggregate operation by dimension, generate the index field, described dimension field and described index field are used to constitute statistic record.
2, method according to claim 1 is characterized in that, described the 3rd configuration also is used to describe the filtering rule of described raw readings.
3, method according to claim 2 is characterized in that, described according to described second configuration statistic record is initialized to described internal memory conventional data type after, described method also comprises:
According to described the 3rd configuration the raw readings that converts internal memory conventional data type to is filtered;
Described the 3rd configuration of described application converts the specific fields that converts the raw readings of internal memory conventional data type to satisfy described second configuration requirement dimension field and index field and replaces with:
Use described the 3rd configuration, convert the specific fields of filtering the raw readings that converts internal memory conventional data type to afterwards to satisfy described second configuration requirement dimension field and index field.
4, method according to claim 3, it is characterized in that, described the 3rd configuration of described application converts the specific fields of filtering the raw readings that converts internal memory conventional data type to afterwards to satisfy described second configuration requirement dimension field and index field and comprises:
According to described the 3rd configuration the raw readings that converts internal memory conventional data type to after filtering is carried out indirect assignment, arithmetic or logical operation, to convert dimension field and the index field that satisfies described second configuration requirement to.
5, method according to claim 1 is characterized in that, describedly converts raw readings to internal memory conventional data type and comprises according to described first configuration:
According to described first configuration described raw readings is kept in the internal memory, the data type of preservation is an internal memory conventional data type.
6, method according to claim 1 is characterized in that, described method also comprises:
The statistic record that constitutes is kept in the internal memory, is used for dividing into groups to gather with newly-generated statistic record.
7, method according to claim 1 is characterized in that, described method also comprises:
According to described second configuration statistic record that constitutes is exported.
8, method according to claim 7 is characterized in that, described according to described second configuration described statistic record exported after, described method also comprises:
Set up statistical form, be used to preserve the statistic record of output.
9, method according to claim 7 is characterized in that, described described according to described second configuration described statistic record exported after, described method also comprises:
According to described second configuration statistic record of output is put in storage.
10, method according to claim 7 is characterized in that, described described according to described second configuration described statistic record exported after, described method also comprises:
Carrying out interface display or secondary gathers.
11, a kind of device that carries out data statistics is characterized in that, described device comprises:
Input block is used to import first configuration, second configuration and the 3rd configuration, and described first configuration is used to describe the attribute of raw readings, and described second configuration is used for the descriptive statistics Table Properties, and described the 3rd configuration is used for the create-rule of descriptive statistics record;
Conversion and initialization unit, be used for converting described raw readings to internal memory conventional data type, and statistic record be initialized to described internal memory conventional data type according to described second configuration of described input block input according to described first configuration of described input block input;
Converting unit, be used to use described the 3rd configuration of described input block input, the specific fields that described conversion and initialization unit is converted to the raw readings of internal memory conventional data type converts dimension field and the index field that satisfies described second configuration requirement to;
Generation unit, be used for described second configuration according to described input block input, the described dimension field and the described index field of described converting unit conversion, the statistic record that described conversion and initialization unit is initialized to internal memory conventional data type is carried out the index aggregate operation by dimension, generate the index field, described dimension field and described index field are used to constitute statistic record.
12, device according to claim 11 is characterized in that, described the 3rd configuration also is used to describe the filtering rule of raw readings.
13, device according to claim 12 is characterized in that, described device also comprises:
Filter element filters the raw readings that described conversion and initialization unit convert internal memory conventional data type to according to described the 3rd configuration of described input block input;
Described converting unit also is used to use described the 3rd configuration, converts the specific fields of filtering the raw readings that converts internal memory conventional data type to afterwards to satisfy described second configuration requirement dimension field and index field.
14, device according to claim 11 is characterized in that, described device also comprises:
Preserve the unit, the statistic record that is used for constituting is kept at internal memory, is used for dividing into groups to gather with newly-generated statistic record.
15, device according to claim 11 is characterized in that, described device also comprises:
Output unit is used for according to described second configuration of described input block input the statistic record that constitutes being exported.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN200810226078XA CN101388045B (en) | 2008-11-05 | 2008-11-05 | Method and device for data statistics |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN200810226078XA CN101388045B (en) | 2008-11-05 | 2008-11-05 | Method and device for data statistics |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN101388045A true CN101388045A (en) | 2009-03-18 |
| CN101388045B CN101388045B (en) | 2010-12-22 |
Family
ID=40477464
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN200810226078XA Expired - Fee Related CN101388045B (en) | 2008-11-05 | 2008-11-05 | Method and device for data statistics |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101388045B (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102236657A (en) * | 2010-04-28 | 2011-11-09 | 阿里巴巴集团控股有限公司 | Method and server for processing reported data |
| CN104408180A (en) * | 2014-12-15 | 2015-03-11 | 北京国双科技有限公司 | Stored data inquiring method and device |
| CN105373472A (en) * | 2015-10-10 | 2016-03-02 | 北京中创信测信息技术有限公司 | Database statistical accuracy-based test method and system |
| CN108829578A (en) * | 2018-04-27 | 2018-11-16 | 北京中创信测科技股份有限公司 | A kind of CDR association backfill accuracy automated testing method and system |
| CN108845926A (en) * | 2018-04-27 | 2018-11-20 | 北京中创信测科技股份有限公司 | A kind of BDR extension accuracy automated testing method and test macro |
-
2008
- 2008-11-05 CN CN200810226078XA patent/CN101388045B/en not_active Expired - Fee Related
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102236657A (en) * | 2010-04-28 | 2011-11-09 | 阿里巴巴集团控股有限公司 | Method and server for processing reported data |
| CN102236657B (en) * | 2010-04-28 | 2013-07-31 | 阿里巴巴集团控股有限公司 | Method and server for processing reported data |
| CN104408180A (en) * | 2014-12-15 | 2015-03-11 | 北京国双科技有限公司 | Stored data inquiring method and device |
| CN105373472A (en) * | 2015-10-10 | 2016-03-02 | 北京中创信测信息技术有限公司 | Database statistical accuracy-based test method and system |
| CN105373472B (en) * | 2015-10-10 | 2017-11-28 | 北京中创信测信息技术有限公司 | A kind of method of testing and test system of the statistical accuracy based on database |
| CN108829578A (en) * | 2018-04-27 | 2018-11-16 | 北京中创信测科技股份有限公司 | A kind of CDR association backfill accuracy automated testing method and system |
| CN108845926A (en) * | 2018-04-27 | 2018-11-20 | 北京中创信测科技股份有限公司 | A kind of BDR extension accuracy automated testing method and test macro |
Also Published As
| Publication number | Publication date |
|---|---|
| CN101388045B (en) | 2010-12-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101388045B (en) | Method and device for data statistics | |
| CN105260403B (en) | General integration across database access method | |
| CA2518902C (en) | System and method for query planning and execution | |
| CN102542007A (en) | Method and system for synchronization of relational databases | |
| CN100578498C (en) | Data integral service system and method | |
| US9367619B2 (en) | Large scale real-time multistaged analytic system using data contracts | |
| US9374475B1 (en) | System for processing customer records | |
| CN107506383B (en) | Audit data processing method and computer equipment | |
| CN104424018A (en) | Distributed calculating transaction processing method and device | |
| CN111443901B (en) | Java reflection-based service expansion method and device | |
| CN111367975A (en) | Multi-protocol data conversion processing method and device | |
| CN108009296A (en) | A kind of SQL query method, system and relevant apparatus based on Hbase | |
| US20110196856A1 (en) | Processing a data stream | |
| CN102214235A (en) | Method for integrating enterprise management software with search engine based on real-time authority control | |
| CN103020318A (en) | Method for maintenance of database tables in database | |
| CN111984643A (en) | Knowledge graph construction method and device, knowledge graph system and equipment | |
| CN102142007B (en) | General statistical method and device | |
| KR20120078908A (en) | Method for data modelling using nosql | |
| CN101141318A (en) | Event integrated method and device thereof | |
| CN110297843B (en) | Data query method and system for B/S system and terminal | |
| CN111078728A (en) | Cross-database query method and device in database filing mode | |
| CN102799645B (en) | Safe searcher and safe searching method | |
| CN116049193A (en) | Data storage method and device | |
| CN112749157A (en) | Data table processing method and device, storage medium and equipment | |
| CN103559586B (en) | A kind of report document management, system and method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20101222 Termination date: 20171105 |