CN104077282A

CN104077282A - Method and device for processing data

Info

Publication number: CN104077282A
Application number: CN201310097049.9A
Authority: CN
Inventors: 徐志节
Original assignee: Huawei Technologies Co Ltd
Current assignee: Huawei Technologies Co Ltd
Priority date: 2013-03-25
Filing date: 2013-03-25
Publication date: 2014-10-01
Anticipated expiration: 2033-03-25
Also published as: CN104077282B

Abstract

The embodiment of the invention provides a method and a device for processing data. The method comprises the following steps that: in a preset first index table, a first initial reference position of a value of a measuring index in a data file is obtained according to the first position information of the measuring index of a measuring object in a target measuring period; a position offset of the value of the measuring index in the data file is obtained according to the second position information of the measuring object and the number of occupied bytes of the value of the measuring index in the data file; and the value of the measuring index in the target measuring period is obtained in the data file according to the first initial reference position and the position offset. The method and the device for processing data according to the embodiment of the invention have the advantages that through setting the first index table, the value of the measuring index to be obtained in the data file can be fast positioned, so thatthe goal of fast obtaining the value of the measuring index can be achieved.

Description

The method and apparatus of deal with data

Technical field

The embodiment of the present invention relates to data processing technique, relates in particular to a kind of method and apparatus of deal with data.

Background technology

Performance statistics daily record be network element device (Network Element, NE) in order to add up the numerical value of the specific indexes of special object, Counter numerical value in Performance Measurement has clear and definite definition in 3GPP32.432 agreement.

The content of performance statistics daily record generally comprises three aspects: measurement index (Measurement counters, MC), measuring object (Measurement object, MO) and measuring period (Measurement period).Wherein, measurement index represents: the counter in performance management, for statistical flowsheet or occupation condition, as the RRC(Radio Resource Control of statistics community, Radio Resource is controlled) and setting up number of attempt, RRC is successfully established number of times etc.Measuring object represents: in performance management for representing the entity of certain physics or logical resource, for example community (Cell).Represent measuring period: in performance management, for periodically providing measurement result, periodically provide the measured value of all measurement measurement indexes of all measuring objects.Can be 5 minutes measuring period, 15 minutes, 30 minutes or 60 minutes, specifically sets according to actual needs.

In prior art, as shown in Figure 1, it is to take measuring object class (Measurement object classes, MOC), as unit stores, j is integer to the storage mode of performance statistics daily record.Measuring object class comprises at least one measurement index and at least one measuring object, for example, certain measuring object class can comprise that the RRC of community 1 sets up number of attempt and RRC is successfully established number of times, while can also comprise that the RRC of community 2 sets up number of attempt and RRC is successfully established number of times, wherein, community 1 and community 2 are respectively measuring object, and RRC sets up number of attempt and RRC and is successfully established number of times and is respectively measurement index.As shown in Figure 1, the measuring object class of MOCWei Mou community, the number of supposing measuring object is 100, the number of measurement index is 1000.User, when obtaining certain measurement index, first will search measuring object one by one, then according to measuring object, gets measurement index, last value of searching again the measurement index in corresponding measuring period of searching at need according to measurement index.

But user is in having the performance statistics journal file of very many measuring objects or measurement index, the value that adopts above-mentioned traditional traversal mode of searching to obtain measurement index is very consuming time, and this greatly reduces the efficiency that user inquires about the value of measurement index.

Summary of the invention

The embodiment of the present invention provides a kind of method and apparatus of deal with data, inquires about the inefficient problem of the value of measurement index to solve user in prior art.

First aspect of the embodiment of the present invention provides a kind of method of deal with data, comprising:

In the first default concordance list, according to the measurement index of measuring object at described target measurement under the cycle primary importance acquisition of information described in the value of measurement index the first initial reference position in data file;

The byte number taking in described data file according to the value of the second place information of described measuring object and described measurement index obtains value position offset in described data file of described measurement index, and described position offset is the position of value in described data file and the side-play amount of described the first initial reference position of described measurement index;

According to described the first initial reference position and described position offset, in described data file, obtain the value of the described measurement index under the cycle at described target measurement;

Wherein, described the first concordance list comprises: the first subitem unit and the second subitem unit, described the first subitem unit comprises: the byte number that take of the value of primary importance information under each measuring period of each measuring period, each measurement index, described measurement index and the measurement index in described data file under each measuring period, described the second subitem unit comprises: each measuring object and the second place information corresponding with described measuring object.

In the first mode in the cards, according to first aspect, described the first subitem unit specifically comprises: each measuring period, each measurement index of arranging according to identification information, each primary importance information that the sequencing according to described measuring period of described measurement index is arranged, the byte number that take of the value of the measurement index in described data file under each measuring period, or described the first subitem unit specifically comprises: each measuring period, each measurement index of arranging according to described identification information under each measuring period, the byte number that take of the value of the primary importance information of described measurement index under each measuring period and the measurement index in described data file under each measuring period,

Described the second subitem unit specifically comprises: according to ascending or descending each measuring object arranged of string length, the second place information corresponding with described measuring object.

In the possible implementation of the second, according to first aspect, value position offset in described data file that the byte number taking in described data file according to the value of the second place information of described measuring object and described measurement index obtains described measurement index comprises:

The arrangement sequence number generating according to the measuring sequence of described measuring object and the value of described measurement index shared byte number in described data file, described in obtaining, state value position offset in described data file of measurement index, described in each, the value of measurement index shared byte number in described data file is identical.

In the third possible implementation, the implementation possible according to the second, described the first concordance list also comprises: in the number of described target measurement measuring object corresponding to described measurement index under the cycle;

Described, according to the measurement index of measuring object, at target measurement, described in the primary importance acquisition of information under the cycle before the first initial reference position of the value of measurement index in data file, also comprise:

According to the number of described measuring object and described arrangement sequence number, judge the value that whether has described measurement index in described data file, when judgment result is that while being, carry out according to the measurement index of measuring object at target measurement the step of the first initial reference position of the value of measurement index in data file described in the primary importance acquisition of information under the cycle.

In the 4th kind of possible implementation, the implementation possible according to the third, the value of byte number+arrangement sequence number * measurement index that the number of described position offset=measuring object is shared shared byte number in described data file.

In the 5th kind of possible implementation, in conjunction with first aspect or the possible four kinds of methods in the cards of implementation to the of the first, according to the measurement index of measuring object at described target measurement under the cycle primary importance acquisition of information described in before the value of measurement index the first initial reference position in data file, also comprise:

In default cycle length section, the value of the measurement index getting is stored in internal storage;

Obtain the maximum byte in the byte that the value of measurement index need take described in each;

According to described maximum byte, the value of described measurement index is stored in the data file of external storage, and generate described the first concordance list.

In the 6th kind of possible implementation, according to the 5th kind of possible implementation, described according to described maximum byte, the value of described measurement index is stored in the data file of external storage, comprising:

The value of measurement index described in each is all stored in the data file of described external storage according to maximum byte.

In the 7th kind of possible implementation, according to the 6th kind of possible implementation, describedly all according to maximum byte, store the value of described measurement index into described external storage and comprise:

The measurement index that is 0 except value in described measurement index is all stored in the data file of described external storage according to maximum byte.

Second aspect present invention provides a kind of method of deal with data, comprising:

In the second default concordance list, according to measuring object at described target measurement under the cycle the 3rd positional information the second initial reference position in data file of the value of measurement index of obtaining described measuring object;

The byte number taking in described data file according to the value of the 4th positional information of described measurement index and described measurement index obtains value position offset in described data file of described measurement index, and described position offset is the position of value in described data file and the side-play amount of described the second initial reference position of described measurement index;

According to described the second initial reference position and described position offset, in described data file, obtain the value of the described measurement index under the cycle at described target measurement;

Wherein, described the second concordance list comprises: the 3rd subitem unit and the 4th subitem unit, described the 3rd subitem unit comprises: the byte number that take of the value of each measuring period, each measuring object, the 3rd positional information at target measurement under the cycle and the measurement index in data file under each measuring period, described the 4th subitem unit comprises: each measurement index and four positional information corresponding with described measurement index.

In the possible implementation of the first, according to second aspect, described the 3rd subitem unit specifically comprises: each measuring period, each measuring object of arranging according to identification information, each the 3rd positional information that the sequencing according to described measuring period of described measuring object is arranged, the byte number that take of the value of the measurement index in described data file under each measuring period, or described the 3rd subitem unit specifically comprises: each measuring period, each measuring object of arranging according to described identification information under each measuring period, the byte number that take of the value of three positional information of described measuring object under each measuring period and the measurement index in described data file under each measuring period,

Described the 4th subitem unit specifically comprises: according to ascending or descending each measurement index of arranging of string length, four positional information corresponding with described measurement index.

In the possible implementation of the second, according to second aspect, state the second concordance list and also comprise: in the number of described target measurement measuring object corresponding to described measurement index under the cycle;

Before the second initial reference position of the value of measurement index of obtaining described measuring object in described the 3rd positional information according to measuring object in data file, also comprise:

According to the number of measuring object and described arrangement sequence number, judge the value that whether has described measurement index in described data file, when judgment result is that while being, carry out the step of the second initial reference position in data file according to the value of measurement index described in the second place acquisition of information of the measurement index of measuring object.

In the third possible implementation, the implementation possible according to the second, the value of byte number+arrangement sequence number * measurement index that the number of described position offset=measuring object is shared shared byte number in described data file.

Third aspect present invention provides a kind of device of deal with data, comprising:

The first acquiring unit, for the first concordance list default, according to the measurement index of measuring object at target measurement under the cycle primary importance acquisition of information described in the value of measurement index the first initial reference position in data file, described the first concordance list comprises: the first subitem unit and the second subitem unit, described the first subitem unit comprises: each measuring period, each measurement index, the byte number that take of the value of the primary importance information of described measurement index under each measuring period and the measurement index in described data file under each measuring period, described the second subitem unit comprises: each measuring object and the second place information corresponding with described measuring object,

First obtains position offset unit, the value position offset in described data file that obtains described measurement index for the byte number taking in described data file according to the value of the second place information of described measuring object and described measurement index, described position offset is the position of value in described data file and the side-play amount of described the first initial reference position of described measurement index;

Second acquisition unit for according to described the first initial reference position and described position offset, obtains the value of the described measurement index under the cycle at described target measurement in described data file.

In the possible implementation of the first, according to the third aspect, described first obtain position offset unit specifically for:

In the possible implementation of the second, the implementation possible according to the first, also comprises:

The first judging unit, for judging according to number and described arrangement sequence number at described target measurement measuring object corresponding to described measurement index under the cycle whether described data file exists the value of described measurement index, when judgment result is that while being, trigger described the first acquiring unit, the number of described measuring object is arranged in described the first concordance list.

In the third possible implementation, according to the third aspect or the first mode in the cards or the possible implementation of the second, also comprise:

Storage unit,, was stored in the value of the measurement index getting in internal storage in section for the cycle length default;

The 3rd acquiring unit, for obtaining the maximum byte of the byte that the value of measurement index need take described in each;

Generation unit, for according to described maximum byte, stores the value of described measurement index in the data file of external storage, and generates described the first concordance list.

In the third possible implementation, the implementation possible according to the second, described generation unit comprises:

Storing sub-units, for all storing the value of measurement index described in each data file of described external storage into according to maximum byte;

Generate subelement, for generating described the first concordance list.

In the 4th kind of possible implementation, the implementation possible according to the third, described storing sub-units specifically for:

Fourth aspect present invention provides a kind of device of deal with data, comprising:

The 4th acquiring unit, for the second concordance list default, according to measuring object at target measurement under the cycle the 3rd positional information the second initial reference position in data file of the value of measurement index of obtaining described measuring object, described the second concordance list comprises: the 3rd subitem unit and the 4th subitem unit, described the 3rd subitem unit comprises: each measuring period, each measuring object, the 3rd positional information at target measurement under the cycle and the byte number that take of the value of the measurement index in data file under each measuring period, described the 4th subitem unit comprises: each measurement index and four positional information corresponding with described measurement index,

Second obtains position offset unit, the value position offset in described data file that obtains described measurement index for the byte number taking in described data file according to the value of the 4th positional information of described measurement index and described measurement index, described position offset is the position of value in described data file and the side-play amount of described the second initial reference position of described measurement index;

The 5th acquiring unit for according to described the second initial reference position and described position offset, obtains the value of the described measurement index under the cycle at described target measurement in described data file.

In the possible implementation of the first, according to fourth aspect, also comprise:

The second judging unit, for judging according to number and described arrangement sequence number at described target measurement measuring object corresponding to described measurement index under the cycle whether described data file exists the value of described measurement index, when judgment result is that while being, trigger described the 4th acquiring unit, the number of described measuring object is arranged in described the second concordance list.

As shown from the above technical solution, the method and apparatus of the deal with data that the embodiment of the present invention provides, according to the method for the deal with data of the present embodiment, by the first concordance list is set, can in data file, to the value of the measurement index that will obtain, locate fast, thereby reach the object of the value of quick obtaining measurement index.

Accompanying drawing explanation

In order to be illustrated more clearly in the embodiment of the present invention or technical scheme of the prior art, to the accompanying drawing of required use in embodiment or description of the Prior Art be briefly described below, apparently, accompanying drawing in the following describes is some embodiments of the present invention, for those of ordinary skills, do not paying under the prerequisite of creative work, can also obtain according to these accompanying drawings other accompanying drawing.

Fig. 1 is the storage mode of the performance statistics daily record of prior art;

Fig. 2 is the schematic flow sheet of the method for deal with data according to an embodiment of the invention;

Fig. 3 A is the schematic flow sheet of the method for deal with data according to another embodiment of the present invention;

Fig. 3 B is according to the schematic diagram of first concordance list of further embodiment of this invention;

As shown in Figure 3 C, be the first concordance list of forming according to the method for the storage data of the present embodiment and a specific implementation of data file;

Fig. 4 is that the byte number that the content in pCacheSrc according to yet another embodiment of the invention takies according to new need is mapped to the schematic diagram in pCacheDsc;

Fig. 5 is the instantiation figure of the first concordance list according to another embodiment of the present invention;

Fig. 6 A is according to the schematic flow sheet of the method for the deal with data of further embodiment of this invention;

Fig. 6 B is the concrete exemplary plot of the second concordance list according to an embodiment of the invention;

Fig. 7 is the structural representation of the device of deal with data according to yet another embodiment of the invention;

Fig. 8 is the structural representation of the device of deal with data according to another embodiment of the present invention;

Fig. 9 is according to the structural representation of the device of the deal with data of further embodiment of this invention;

Figure 10 is the structural representation of the device of deal with data according to yet another embodiment of the invention;

Figure 11 is the structural representation of the device of deal with data according to another embodiment of the present invention;

Figure 12 is according to the structural representation of the device of the deal with data of further embodiment of this invention.

Embodiment

For making object, technical scheme and the advantage of the embodiment of the present invention clearer, below in conjunction with the accompanying drawing in the embodiment of the present invention, technical scheme in the embodiment of the present invention is clearly and completely described, obviously, described embodiment is the present invention's part embodiment, rather than whole embodiment.Embodiment based in the present invention, those of ordinary skills, not making the every other embodiment obtaining under creative work prerequisite, belong to the scope of protection of the invention.

Embodiment mono-

The present embodiment provides a kind of method of deal with data, the device that the executive agent of the present embodiment is deal with data, and the device of this deal with data can be specifically common PC or server etc.The device of this deal with data can have monokaryon CPU(Central Processing Unit, central processing unit) or multi-core CPU.

As shown in Figure 2, for according to the schematic flow sheet of the method for the deal with data of the present embodiment.

Step 201, in the first default concordance list, according to the measurement index of measuring object at target measurement the primary importance information under the cycle, the first initial reference position of the value of obtaining measurement index in data file.

The first concordance list can be arranged in the internal storage of the device of deal with data, also can be arranged in the external storage of the device of deal with data.This first concordance list comprises: the first subitem unit and the second subitem unit, the first subitem unit comprises: the byte number that take of the value of primary importance information under each measuring period of each measuring period, each measurement index, measurement index and the measurement index in data file under each measuring period, the second subitem unit comprises: each measuring object and the second place information corresponding with measuring object.

More specifically, wherein the first subitem unit can specifically comprise: each measuring period, each measurement index of arranging according to identification information, each primary importance information that the sequencing according to measuring period of measurement index is arranged, the byte number that take of the value of the measurement index in data file under each measuring period, or the first subitem unit specifically comprises: each measuring period, each measurement index of arranging according to identification information under each measuring period, the byte number that take of the value of the primary importance information of measurement index under each measuring period and the measurement index in data file under each measuring period, wherein the second subitem unit specifically comprises: according to ascending or descending each measuring object arranged of string length, the second place information corresponding with measuring object.

While there is a plurality of measurement index under same measuring period, can to measurement index, sort according to the identification information of each measurement index, for example, the predefined identification information of each measurement index is respectively ID(Identify, identify label) 1, ID2, ID3 ..., can arrange from small to large or from big to small according to this identification information.

Because the space that data file is shared is larger, be generally arranged in external storage.Data file comprises the value of each measurement index.The first initial reference position of the value of measurement index in data file is a reference position, can get the position of the value of measurement index by this reference position.

Measuring object can comprise community, RNC(Radio Network Controller, radio network controller) etc., the measurement index of measuring object can comprise that connection number of attempt, the RRC of RRC are successfully established number of times, when connection number of attempt that measurement index is RRC, the value of measurement index refers to the value of the number of attempt of RRC, when measurement index is RRC while being successfully established number of times, the value of measurement index refers to the value that RRC is successfully established number of times.

Step 202, the byte number taking in data file according to the value of the second place information of measuring object and measurement index obtains value position offset in data file of measurement index, and this position offset is the position of value in data file and the side-play amount of the first initial reference position of measurement index.

It is pointed out that this position offset is the value of this measurement index under the cycle at the target measurement position offset in data file.

Step 203 according to the first initial reference position and position offset, is obtained the value of the measurement index under the cycle at target measurement in data file.

The device of deal with data is according to first of the value of measurement index the initial reference position and position offset, the position of the value of obtaining the measurement index of target measurement under the cycle in data file, and according to this position, in data file, inquire about and obtain the value of the measurement index of target measurement under the cycle.That is, the position offset by each measurement index under a certain measuring period and initial reference position, just can obtain the value of each measurement index under this measuring period.

According to the method for the deal with data of the present embodiment, by the first concordance list is set, can in data file, to the value of the measurement index that will obtain, locate fast, thereby reach the object of the value of quick obtaining measurement index.

Concordance list can be stored with measuring object Lei Wei unit, and each class measuring object class generates a concordance list, and each concordance list all can have corresponding title, for example, using the classification of measuring object as title.

Like this, before step 201, can also comprise:

When there is a plurality of concordance list, according to measuring object, from a plurality of concordance lists, obtain the first concordance list.While searching for required concordance list, the title by search index table just can find out.Can also preset the mapping table of a measuring object and concordance list ID, according to this correspondence pass table, search the concordance list at measuring object place.It is to be noted, for a measuring object, when all measurement indexes of its correspondence are stored in to same concordance list, the number of the first concordance list is 1, when the corresponding all measurement indexes of this measuring object are stored in a plurality of concordance list respectively, for example in a plurality of concordance lists, all there is the measurement index of same names, the measuring object that each measurement index is corresponding all, the number of the first concordance list can be for a plurality of.

Embodiment bis-

The present embodiment is done further supplementary notes to the method for the deal with data in embodiment mono-.

As shown in Figure 3A, for according to the schematic flow sheet of the method for the deal with data of the present embodiment.

Step 301, in default cycle length section, is stored in the value of the measurement index getting in internal storage.

Default cycle length in the present embodiment, it can be each measuring period of recording in performance statistics daily record, detect the cycle that measuring object obtains each measurement index operation, also it can be the cycle that generates a performance statistics daily record, wherein, performance statistics daily record can be according to storing with measuring object Lei Wei unit, particularly, can set according to actual needs default cycle length, do not repeat them here.The data that get in the present embodiment can comprise: the byte that the measurement index of measuring object, measuring object, the value of measurement index need take.

Due to the direct data in invoke memory reservoir of the device of deal with data, therefore process while getting the data in internal storage without carrying out I/O(Input/Output, I/O) operation, alleviated the burden of the device of deal with data.

Step 302, obtains the maximum byte in the byte that the value of each measurement index need take.

Maximum one of the device of deal with data value of selecting from the byte that the value of each measurement index need take is as maximum byte.

Step 303, according to maximum byte, stores the value of measurement index in the data file of external storage, and generates the first concordance list.

The device of deal with data can select the value of all measurement indexes to store in external storage according to maximum byte.Suppose, the value of the current measurement index getting has 3, the value of the first measurement index is 32, the value of the second measurement index is 101, the value of the 3rd measurement index is 258, the value of the first measurement index needs 1 bytes store, the value of the second measurement index needs 1 bytes store, the value of the 3rd measurement index needs 2 bytes store, therefrom can find out, maximum byte is 2, by the value of the value of the value of the first measurement index, the second measurement index and the 3rd measurement index respectively according to 2 bytes store in external storage.The device of deal with data can also be selected than the slightly larger byte of maximum byte as all data of storage byte used, be about to maximum byte and default surplus threshold value and as maximum byte.For example, when default surplus threshold value is 1, above-described embodiment can be selected the value of the value of the value of the first measurement index, the second measurement index and the 3rd measurement index respectively according to 3 bytes store in external storage.

The first concordance list that this step generates, as shown in Figure 3 B, this first concordance list comprises first concordance list of the present embodiment: according to ascending or descending each measuring object arranged of string length, the second place information corresponding with measuring object, each primary importance information of measurement index of arranging according to the sequencing of measuring period and the shared byte number of the value of measurement index under each measuring period.Such arrangement mode is conducive to expansion and the change of data.While there is a plurality of measurement index under same measuring period, according to the identification information of measurement index, each measurement index is sorted, as shown in Figure 3 B, for the identification information coupling ID of measurement index generally can sort with the sequencing of the measurement of measurement index, inverted order that can also measuring sequence is arranged, for example, when the identification information of measurement index is ID1, the measurement index that its this measurement index is last measurement.It should be noted that, in Fig. 3 B, the measuring sequence of listed measuring object is the putting in order of title of measuring object, if it is different that the measuring sequence of measuring object and the title of measuring object put in order, the order of the value of the measurement index in data file is difference, in Fig. 3 B and not shown.Measuring period in Fig. 3 B and the position of measurement index can exchange, and form another arrangement mode of the first subitem unit, below repeat no more.

The structure that Fig. 3 B adopts is STRU_MAPPING_OBJ, wherein preserve the title of measuring object and the positional information of measuring object, all according to measuring sequence (pObjname), arrange, dichotomy fast finding easy to use can object index information, wherein pObjName has definition in STRU_MAPPING_OBJ, and user preserves the name of measuring object.

From Fig. 3 B, can find out, in MOCp concordance list, according to measuring object, get the positional information corresponding with it, according to measurement index, obtain it in a certain measurement period T _iin position offset, wherein p is more than or equal to 1 and be less than or equal to the integer of m, m is the number of MOC concordance list, i is more than or equal to 1 and be less than or equal to the integer of n, the number that n is measuring period.According to primary importance information and target measurement, the position offset under the cycle just can find the value in target measurement this measurement index under the cycle in data file.In data file, can, according to mode as shown in Figure 3 B, according to different measuring periods, different MOC concordance lists, generate form, so that user searches.Wherein, because the space that concordance list is shared is less, can be stored in internal memory, can certainly be stored in external storage.User is according to the concordance list of the present embodiment, and the value of the measurement index that can search need is located fast, and acquisition speed is very fast.

Alternatively, can preset a table to be filled, in this default table to be filled, the name location of pre-set the first concordance list is, the position of the position of the position of the position of each measuring object, each measurement index, each primary importance information, the position of each second place information and the value of each measurement index shared byte number in data file.That is to say, this default table to be filled has been stipulated the position at each data place, and the device of deal with data adds each obtained data in this table to be filled, forms the first concordance list.The device of deal with data can add each data this table to be filled after getting the total data of same measuring period, or after getting data, data is added in this default table to be filled at every turn.Alternatively, the data that are 0 all can be stored in external storage according to maximum byte in measurement index except value, in the data file of external storage, there is no storing value is 0 data, and the data that further value of avoiding is 0 of take take storage space.When user search is during less than certain measurement index, just illustrate that the value of this measurement index is 0.Or, when the measurement index of certain measuring object value under a certain measuring period is 0, the measurement index of this measuring object corresponding primary importance information under this measuring period is specific symbol, and for example FFF, represents that the value of this measurement index under this measuring period is 0.When the primary importance information of the measurement index that identifies certain measuring object when the device of deal with data under certain measuring period is special symbol, judge that the value of this measurement index under this measuring period is 0.

As shown in Figure 3 C, be the first concordance list of forming according to the method for the storage data of the present embodiment and a specific implementation of data file.

Fig. 3 C is all stored in the index information of same measuring object measurement index under the cycle at different measuring in same MOC1 table.Measuring object is ascending or descending arrangement according to the string length of its title, second place index information is the measuring sequence sequence number of measuring object, can be respectively 1,2,3,4 ... etc., each arrow position pointed is the value of corresponding measurement index the first initial reference position in data file.This first initial reference position is not the position of really storing the value of measurement index, but can find by this first initial reference position the position of the value of measurement index.Primary importance information can be specifically index information, directly points to this first initial reference position.

Under different measuring periods, the number of the measuring object that same measurement index is corresponding may be not identical, adopt the first concordance list shown in Fig. 3 B, only need to insert its relevant position according to the length of the character string of the title of measuring object, without changing other content.When if the insufficient memory of default table to be filled is large, can continuation application storage space.

Above-mentioned steps 301～303, is the method that generates the first concordance list and data file, is also the method for storage data.Can imagine, can also generate in the manner described above other concordance list, the value of all measurement indexes is stored in same data file, each concordance list has unique name information or ID.

Step 304, in the first default concordance list, the first initial reference position according to the value of the measurement index of measuring object primary importance acquisition of information measurement index under the cycle at target measurement in data file.

Primary importance information can be specifically index, and the device of deal with data can directly find the first initial reference position according to this primary importance information.

Step 305, the arrangement sequence number generating according to the measuring sequence of measuring object and the value of measurement index shared byte number in data file, obtain value position offset in data file of measurement index, the value of each measurement index shared byte number in data file is identical.

The position offset that this step is obtained is value in target measurement measurement index under the cycle position offset in data file.

In the present embodiment, the length of the measurement index in the first concordance list, the byte number that measurement index need take.Due to the value of all measurement indexes all according to the storage of same word joint number, therefore, position offset=arrangement sequence number * byte number.What can imagine is, if the value of measurement index is not stored according to identical bytes, be for example to store according to the actual byte that need take separately, just need to arrange the corresponding byte of value of each measurement index that sequence number is less than the value of the measurement index that need obtain and add up to calculate side-play amount.

In the present embodiment, measuring object put in order be can be according to the string length of title ascending or descending arrangement, the corresponding second place information of measuring object is the arrangement sequence number of arranging according to measuring sequence.

Alternatively, as shown in Figure 3 C, in the first concordance list, can also be included in the number of target measurement measuring object corresponding to measurement index under the cycle.Suppose, the number of measurement index 1 corresponding measuring object in measurement period T 1 is 100, if need inquire about the value of the measurement index 1 of certain measuring object in measurement period T 1, the corresponding second place information of this measuring object, arranging sequence number is 101 o'clock, just explanation in 1 moment, did not detect the value of the measurement index 1 of this measuring object in measurement period T, and the device of deal with data can directly return to the response without this Query Result to client.When the number of measuring object exists, the value of byte number+arrangement sequence number * measurement index that the number of position offset=measuring object is shared shared byte number in data file.

Step 306 according to the first initial reference position and position offset, is obtained the value in target measurement measurement index under the cycle in data file.

Initial reference position+the position offset of position=the first of the value of measurement index in data file.The device of deal with data, after the actual location of value that gets measurement index, can get the value of the measurement index of storing on this position.

In addition, the method for the deal with data of the present embodiment can adopt monokaryon to realize, and also can adopt multinuclear to realize.

Step 304～step 306 is the detailed process of the first concordance list of generating according to step 301～step 303 and the data file value of inquiring about needed measurement index.

Alternatively, before the step 304 of the present embodiment, also comprise:

According to measuring object, inquire about first concordance list at this measuring object place.

When there is a plurality of concordance list, can inquire about its corresponding the first concordance list according to measuring object, then perform step 304～306, to obtain the value of certain measurement index of measuring object.The mode of inquiring about the first concordance list can be traversal mode.According to the present embodiment, when storage data, first in cycle length section, the data that get are temporarily stored in interior storage, then when arriving the end point of cycle length, the maximum byte that need take according to data stores in external memory all data are disposable, not only can avoid so often obtaining data in prior art and just store the I/O frequent operation causing in external storage into, and the required maximum byte taking by obtaining dynamically each data, can either guarantee the storage space of data, can reach again and reduce the object that data take up room.Like this, while inquiring about the value of measurement index in the data file that adopts above-mentioned storage mode storage, the memory location of the value of obtaining measurement index by the concordance list generating in advance in data file, thereby obtain storage, refer to target value, can reach the object of the value of measurement index under the quick obtaining target measurement cycle.

Particularly, in the present embodiment, can realize the service software production method providing in the embodiment of the present invention by C language, its implementation example is as follows:

The mode of generating indexes table is as follows:

struct?STRU_MAPPING_OBJ

{

CHAR*pObjName; // for preserving the title of measuring object

DWORD dwObjNameLen; // for preserving the length of the title of measuring object

DWORD dwPosInd; // for preserving the positional information of this measuring object.The positional information of measuring object is the sequencing numbering while adding measuring object, from 0,1, and 2 .....

}

The positional information of above-mentioned measuring object is the second place information in the present embodiment, can measuring object be added in table to be filled according to the sequencing of measuring object.

In order to improve the seek rate of measuring object, can use the data structure of Hash dictionary, i.e. STRU_MAPPING_OBJ_DIC, is implemented as follows:

struct?STRU_MAPPING_OBJ_DIC

{

DWORD dwKey; Key in //hash algorithm

DWORD dwObjMaxNum; The maximum number of // preservation measuring object.When adding measuring object, if dwObjNum is more than or equal to dwObjMaxNum, this parameter is pressed to fixed step size increases, and pObjHeader need to apply for internal memory again.

DWORD dwObjNum; The actual number of // current measuring object.When adding measuring object, if measuring object not in pObjHeader structure, dwObjNum increases by 1.While adding measuring object, need to the information of measuring object be left in pObjHeader structure according to the sequencing of measuring object title.

STRU_MAPPING_OBJ*pObjHeader; //STRU_MAPPING_OBJ structured fingers, for storing measuring object index information.Initial size is dwObjMaxNum*sizeof (STRU_MAPPING_OBJ).The index information of measuring object is according to the name order storage of measuring object.

}

Measuring object is not in pObjHeader structure, show that default table to be filled does not have to reserve for this measuring object the position of storage, the device of deal with data can apply for that new storage space stores the value of the title of this measuring object, second place information and relative each measurement index.

Each measurement index needs to set up the index information of measurement index in different measuring periods, specifically can the comprising of the index information of measurement index: the byte that the value that the index information of measurement index comprises position offset and this measurement index need take.Same measurement index is under different measuring periods, and the byte that need take can be identical, also can be different.The byte that the value of measurement index need take can be 0 byte, 1 byte, 2 bytes, 4 bytes or 8 bytes.In same measuring period or same Preset Time section, the byte that the value of the measurement index of each measuring object need take is dwMappingLen, and this dwMappingLen is the organization definition in STRU_MAPPING_VALUE_INFO.If dwMappingLen is 0, that is to say that, under this measuring period, the value of the measurement index of all measuring objects is 0, can select the measurement index that is not 0 by each value to be kept in data file, be implemented as follows:

struct?STRU_MAPPING_VALUE_INFO

{

UINT64ui64Offset; // this measurement index is within given measuring period, in the primary importance information of data file, with 64 storages.If this primary importance information is full FF, 0 * FF, represents this measurement index countless certificates in data file.

DWORD dwMappingLen; // within given measuring period, the size of the measurement index value of storing in data file, can be 0, identifies this measurement index countless certificates in this data file.

};

In existing performance statistics daily record, the measured value of its measurement index is all used 8 bytes store.In the present embodiment, if dwMappingLen equals 1, ratio of compression equals 8:1.According to historical statistics, in performance statistics daily record, the value of the measurement index of more than 40% measuring object is that the value of the measurement index of more than 0,50% measuring object only need take 2 bytes and stores, and can make like this to store the shared space of data than original few 3/4 to 5/6.Use the dynamic compression algorithm of the present embodiment, do not affect the speed of inquiry measurement index.The position offset of the measurement index of measuring object can equal ui64Offset+4+dwPosInd*dwMappingLen.Wherein, the location index information that dwPosInd is measuring object, 4 are illustrated in the needed byte number of maximum position information (location index) of measuring object under this cycle.

In concordance list, the structure of the concordance list of measurement index can adopt STRU_MAPPING_COUNTER_INFO structure, the ID(Identify that can comprise measurement index, Identity Code), the type of measurement index is, the measuring period of measurement index and STRU_MAPPING_VALUE_INFO structure type pointer.Specific implementation is as follows:

struct?STRU_MAPPING_COUNTER_INFO

{

DWORD dwCounterId; The ID of // measurement index

DWORD dwType; The type of // measurement index, as 32 integer types, 64 integer types, 64 floating point types etc.

DWORD dwMaxTimeNum; The number of // measuring period.If append measuring period, dwMaxTimeNum can revise, and the internal memory of pMappingValueHeader need to be applied for again

STRU_MAPPING_VALUE_INFO*pMapping ValueHeader; //STRU_MAPPING_VALUE_INFO structured fingers, for storing the index information of measurement index.Initial size is dwMaxTimeNum*sizeof (STRU_MAPPING_VALUE_INFO).The index information of the measurement index of different measuring periods is stored in this structure.

}

In order to improve the seek rate of the index information of measurement index, the index information of measurement index can adopt the data structure of Hash dictionary, i.e. STRU_MAPPING_COUNTER_INFO_DIC, and specific implementation can be as follows:

struct?STRU_MAPPING_COUNTER_INFO_DIC

{

DWORD dwKey; Key in //hash algorithm

DWORD dwCounterMaxNum; The maximum number of // measurement index.When adding measurement index, if dwCounterNum is more than or equal to dwCounterMaxNum, this parameter is pressed to fixed step size increases, and pCounterInfoHeader need to apply for internal memory again

DWORD dwCounterNum; The actual number of measurement index in // current this structure.When adding measurement index, if measurement index not in pCounterInfoHeader structure, dwCounterNum increases by 1.When adding the corresponding information of measurement index, need to leave in pCounterInfoHeader structure according to the sequencing of the ID of measurement index

DWORD dwMaxTimeNum; The number of // measuring period, with the dwMaxTimeNum in STRU_MAPPING_COUNTER_INFO structure;

STRU_MAPPING_COUNTER_INFO*pCounterInfoHeader; //STRU_MAPPING_COUNTER_INFO structured fingers, for storing the index information of measurement index.Initial size is dwCounterMaxNum*sizeof (STRU_MAPPING_COUNTER_INFO).The index information of measurement index is according to the ID sequential storage of measurement index.

}

The ID of above-mentioned measurement index can be specifically the measuring sequence of measurement index, and ID is for example 1,2 ... s, represents respectively the measurement index of the 1st measurement, the measurement index of the 2nd measurement ... s the measurement index of measuring, s is integer.

For same performance statistics journal file, can comprise a plurality of MOC tables, every MOC table all can comprise the index information of measuring object and the index information of measurement index, and specific implementation is as follows:

struct?STRU_MAPPING_CLASS

{

DWORD?dwClassId;//MOC?ID

DWORD dwObjPosInd; The positional information ID of // measuring object, initial value equals 0.If add a new measuring object, the dwPosInd of this measuring object equals dwObjPosInd, and dwObjPosInd+1.The dwPosInd value of the different measuring object under same MOC is different

DWORD dwMaxTimeNum; The number of // measuring period

STRU_MAPPING_COUNTER_INFO_DIC*pCounterInfoDicHeader; // for storing the pointer of dictionary of the index information of measurement index

STRU_MAPPING_OBJ_DIC*pObjDicHeader; // for storing the pointer of measuring object index dictionary

CRITICAL_SECTION criticalSection; // PV operation while processing for multinuclear.When adding Counter and Obj, need to protect with this variable.Wherein, PV operation is semaphore operations method, is a typical synchronization mechanism, and P represents to pass through, and V represents to discharge

}

Performance statistics daily record comprises a plurality of MOC tables, needs the STRU_MAPPING_CLASS of a plurality of MOC to organize, and its specific implementation is:

struct?STRU_MAPPING_MRF

{

DWORD dwClassMaxNum; The maximum number of measuring object in //MOC table.When adding MOC table, if dwClassNum is more than or equal to dwClassMaxNum, this parameter is pressed to fixed step size increases, but pClassHeader need to apply for internal memory again

DWORD dwClassNum; //DWORD dwClassNum represents the actual number of MOC table in current this structure.When resolution data, if find that MOC table is not in pClassHeader structure, dwClassNum increases by 1, and this kind of situation represents that this MOC table is for new MOC table, this MOC table need to be added in pClassHeader structure, while adding MOC table, according to the order of the ID of MOC table, leave in pClassHeader structure

DWORD dwMaxTimeNum; The number of // measuring period

DWORD dwPeriod; // measuring period, as 15,30,60 etc.

CHAR szNEName[64]; The title of // network element device

CHAR szNEVersion[64]; The version number of // network element device operation

STRU_MAPPING_CLASS*pClassHeader; //STRU_MAPPING_CLASS structured fingers, initial size is dwClassMaxNum*sizeof (STRU_MAPPING_CLASS)

}

In the present embodiment, relevant false code during analysis feature statistical log is implemented as follows:

The object that creates a STRU_MAPPING_MRF structure, is designated as pMrfObj

On hard disk, apply for a data file, size is 1/5 of the big or small sum of all properties accounting log file (unpacked format).If application, less than hard drive space, is directly returned and is resolved unsuccessfully.In the process of analysis feature statistical log, if find the insufficient space of storage, can dynamically apply for hard drive space.If dynamically apply for hard drive space failure, return and resolve unsuccessfully.

Create CRITICAL_SECTION object, i.e. a classSection.

Traversal all properties accounting log file, some index of corresponding start time of performance statistics journal file is designated as T, and time point index is from 0,1,2 ... open numbering

{

1. this performance statistics journal file is distributed to an idle CPU

2. an independent memory of application, remembers DataBuff, for depositing the value of the measurement index after parsing.Due to ratio of compression that can not accurate Calculation dynamic compression algorithm, this internal memory can only be used dynamic application way, the data of self-adaptation store M OC table.The initial size of DataBuff is 1/5 of single performance statistics journal file (non-compression).

Traversal measurement period T performance statistics daily record in all MOC data

{

1) for multinuclear, process and need to start (EnterCriticalSection) classSection object

2) create STRU_MAPPING_CLASS object, if the object of this STRU_MAPPING_CLASS structure exists, obtain the pointer of the object object of this STRU_MAPPING_CLASS structure, note pMapClassObj

3) for multinuclear, process and need to cancel (LeaveCriticalSection) classSection object

4) for multinuclear, process and need to start (EnterCriticalSection) pMapClassObj->criticalSection.

5) information of all measuring objects in MOC (title, length and location information) is added in pMapClassObj->pObjDicHeader.Positional information in measuring object is the sequencing numbering while adding measuring object, is numbered 0,1,2 .....Obtain the index number of the maximum position of all measuring objects in this MOC table, note maxPosInd.Internal memory of new application is for preserving the lower measured positional information information that has object of this MOC table) positional information of measuring object can be provided.

6) information (ID of measurement index and the type of measurement index) of all measurement indexes in MOC table is added in pMapClassObj->pCounterInfoDicHeader.

8) for multinuclear, process and need to cancel (LeaveCriticalSection) pMapClassObj->criticalSection

8) application the interim buffer memory of initialization, i.e. pCacheSrc and pCacheDsc, the size of two buffer memory is 8* (maxPosInd+1)

9) all measurement indexes in traversal MOC table

{

A), according to measurement index ID, obtain STRU_MAPPING_COUNTER_INFO object (using the inquiry of Hash+ dichotomy), note pMapCounterObj

B), according to time T, obtain pMapCounterObj->pMappingValueHeader[T], note pMapValObj

C) use dynamic compression algorithm, all measuring objects corresponding to this measurement index will be obtained, and measurement index value corresponding to these all measuring objects is stored in pCacheSrc to (the measurement index value of measuring object store position offset be Len*dwPosInd) in pCacheSrc, and the byte Len that the need that obtain the value of measurement index take, Len can be 0,1,2,4,8.Len assignment is to pMapValObj->dwMappingLen.If dwMappingLen is not equal to 0, perform step d)

D) maxPosInd(is used to 4 bytes store) and pCacheSrc in data (size is dwMappingLen*(maxPosInd+1)) be stored in successively in the internal memory of DataBuff, simultaneously by maxPosInd in position offset (maxPosInd is to the distance of the DataBuff first address) assignment of DataBuff to pMapValObj->ui64Offset

}

4. according to the data of DataBuff, be kept in data file, return to DataBuff datum number storage according to the position offset of file, note uiOffset

5. revise the index information of all measurement indexes under the constantly all MOC tables of T, i.e. pMapValObj.Modification formula is pMapValObj->ui64Offset+=uiOffset

}

The index information pMrfObj of measurement index is saved in fixed disk file.

The specific implementation of the relevant false code in the present embodiment during query performance statistical log can be as follows:

Input: MOC ID, measurement index ID, the title of measuring object, query time section (T0～Tn)

Output: the value of all measurement indexes of T0～Tn time period

Wherein, n is greater than 0 integer.

By MOCID, obtain STRU_MAPPING_CLASS object (by binary search), note pMapClassObj.If pMapClassObj does not exist, return to NULL.

By measurement index ID, under pMapClassObj, obtain STRU_MAPPING_COUNTER_INFO object (by Hash and binary search), note pMapCounterObj.If pMapCounterObj does not exist, return to NULL

By measuring object title, under pMapClassObj, obtain STRU_MAPPING_OBJ object (by Hash and binary search), note pMapObj.If pMapObj does not exist, return to NULL.Obtain the positional information of this measuring object, note dwPosInd

The traversal time period (T0～Tn)

{

1. according to time T, obtain T pMapValObj constantly

2. by pMapValObj->ui64Offset and pMapValObj->dwMappingLen, if dwMappingLen equals 0, or ui64Offset equals full FF, the value of this T measurement index is constantly 0, otherwise execution step 3

3. by pMapValObj->ui64Offset, in data file, obtain data maxPosInd value, the position offset of maxPosInd in data file is pMapValObj->ui64Offset, and length equals 4.If maxPosInd<dwPosInd, T measurement index value is constantly 0, otherwise execution step 4

4. in data file, obtain measurement index value, measurement index value in data file position offset be pMapValObj->ui64Offset+4+dwPosInd*pMapValO bj->dwMappingLen.The value of T measurement index constantly also needs to change according to pMapCounterObj->dwType.In data file, what obtain is the byte number that need take, and by pMapCounterObj->dwType, changes integer or floating number.

}

The specific implementation of the relevant false code of employing dynamic compression algorithm is as follows:

Apply for two interim buffer memorys, note pCacheSrc and pCacheDsc, two cache size is 8* (maxPosInd+1), and initialization sets to 0

Travel through all measuring objects of this measurement index

{

1. obtain the value of measurement index and the dwPosInd of measuring object of this measuring object

2. if find first that the value of measurement index of measuring object is non-zero, and obtain maximum byte (as 1,2,4,8).This maximum byte assignment is given and is measured this index at this T moment pMapValObj->dwMappingLen.By the value of the measurement index of this measuring object, according to dwMappingLen*dwPosInd, be that position offset is stored in pCacheSrc, and shared byte number is dwMappingLen

3., if the value of the non-measurement index of finding first measuring object is non-zero, obtain maximum number of byte (as 1,2,4,8), note dwSize.If dwSize is less than and equals dwMappingLen, the value of measurement index is stored in pCacheSrc, the byte that need take is dwMappingLen.If dwSize is greater than dwMappingLen, the byte number that the content in pCacheSrc takies according to new need (dwSize) is mapped in pCacheDsc, as shown in Figure 4 (number of times that this scene occurs compares less).By pCacheDsc content replication, in pCacheSrc, then the measurement index value of this object is pressed in New Set length (dwSize) storage pCacheSrc, and dwSize assignment is to pMapValObj->dwMappingLen.PCacheDsc is initialized as 0.

As shown in table 1, for user inquires about performance statistics journal file of the prior art and inquires about according to the contrast table of the performance statistics journal file of the present embodiment generation.

Table 1

As can be seen from Table 1, the parsing time of the performance statistics journal file that user's inquiry generates according to the present embodiment is far smaller than the parsing time of prior art, hard disk take up room be prior art take up room approximately 1/6, the inquiry velocity of measurement index is also far away faster than prior art.

Embodiment tri-

The present embodiment provides a kind of method of deal with data.

As shown in Figure 5, be the concordance list that adopts in the present embodiment and the structural representation of data file.

Wherein, the name of the first concordance list is called MOC1 table, and each measuring object is arranged according to the length of the character string of title, the arrangement sequence number that the corresponding second place information of each measuring object is its measuring sequence.For example, the corresponding second place information of measuring object 1 is 2, represent this measuring object 1 be the 2nd measured, the corresponding second place information of measuring object 2 is 1, represent this measuring object 2 be the 1st measured, the corresponding second place information of measuring object 3 is 3, represent this measuring object 3 be the 3rd measured.

Each measurement index is arranged according to measuring sequence, the corresponding primary importance information of each measurement index is according to arranging measuring period, 2 measurement indexes and 2 measuring periods have been shown in Fig. 5, this MOC1 also comprises the byte number that the value of each measurement index need take in showing simultaneously, be the length of measurement index, in Fig. 5, be 2 bytes, in Fig. 5, also comprise in addition in MOC1 table the number at target measurement measuring object corresponding to measurement index under the cycle.

As shown in Figure 5, in data file the value of each measurement index according to arranging measuring period.In same measuring period, a plurality of measuring objects are all to should have a certain measurement index time, and the value of this measurement index is arranged according to measuring sequence in data file.

While adopting the value of the measurement index 2 that the index structure shown in Fig. 5 and data file search object name 1, first according to the primary importance information searching of measurement index 2 to the value of this measurement index 2 the first initial reference position in data file, position 501.Then, according to the shared byte number of value of the second place information of object name 1 correspondence and measurement index, i.e. sequence number 2 and byte number 2, obtain the position of value and the side-play amount of the first initial reference position of measurement index 2.Be specially, 2 * 2=4, side-play amount is 4 bytes, the first initial reference position adds that the side-play amount of 4 bytes is exactly the value of the measurement index 2 under target measurement cycle T 1 actual location in data file.The device of deal with data directly obtains the value of the measurement index 2 of target measurement T1 under the cycle according to this position.

Embodiment tetra-

The present embodiment provides a kind of method of deal with data, the device that the executive agent of the present embodiment is another deal with data, and the device of this deal with data can be specifically common PC or server etc.The device of this deal with data can have monokaryon CPU(Central Processing Unit, central processing unit) or multi-core CPU.

As shown in Figure 6A, for according to the schematic flow sheet of the method for the deal with data of the present embodiment.

Step 601, in the second default concordance list, the second initial reference position according to the measuring object value of measurement index that the 3rd positional information under the cycle is obtained measuring object at target measurement in data file.

The second concordance list can be arranged in the internal storage of the device of deal with data, also can be arranged in the external storage of the device of deal with data.Wherein, the second concordance list comprises: the 3rd subitem unit and the 4th subitem unit, the 3rd subitem unit comprises: the byte number that take of the value of each measuring period, each measuring object, the 3rd positional information at target measurement under the cycle and the measurement index in data file under each measuring period, the 4th subitem unit comprises: each measurement index and four positional information corresponding with measurement index.

More specifically, the 3rd subitem unit specifically comprises: each measuring period, each measuring object of arranging according to identification information, each the 3rd positional information that the sequencing according to measuring period of measuring object is arranged, the byte number that take of the value of the measurement index in data file under each measuring period, or the 3rd subitem unit specifically comprises: each measuring period, each measuring object of arranging according to identification information under each measuring period, the byte number that take of the value of three positional information of measuring object under each measuring period and the measurement index in data file under each measuring period, the 4th subitem unit specifically comprises: according to ascending or descending each measurement index of arranging of string length, four positional information corresponding with measurement index.

Data file, because its shared space is larger, is generally arranged in external storage.Data file comprises the value of each measurement index.The first initial reference position of the value of measurement index in data file is a reference position, can get the position of the value of measurement index by this reference position.

Step 602, the byte number taking in data file according to the value of the 4th positional information of measurement index and measurement index obtains value position offset in data file of measurement index, and position offset is the position of value in data file and the side-play amount of the second initial reference position of measurement index.

Step 603 according to the second initial reference position and position offset, is obtained the value in target measurement measurement index under the cycle in data file.

The second concordance list in the present embodiment is different from the first concordance list in embodiment mono-.Particularly, as shown in Figure 6B, be an instantiation schematic diagram of the second concordance list.The second initial reference position of the value that the 3rd positional information that in the second concordance list, measuring object is corresponding is used to indicate measurement index in data file, the 4th location index corresponding to measurement index is used to indicate position offset.

Alternatively, second concordance list of the present embodiment is also included in the number of target measurement measuring object corresponding to measurement index under the cycle, as shown in Figure 6B.Like this, before the second initial reference position in the value of measurement index of obtaining measuring object according to the 3rd positional information of measuring object in data file, also comprise:

According to the number of measuring object and arrangement sequence number, judge the value that whether has measurement index in data file, when judgment result is that while being, carry out the step of the second initial reference position in data file according to the value of the second place acquisition of information measurement index of the measurement index of measuring object.

Wherein, the value of the shared byte number+arrangement sequence number * measurement index of the number of position offset=measuring object shared byte number in data file.

Concrete value of how searching measurement index by second concordance list of the present embodiment in data file, similar to embodiment mono-to embodiment tri-, do not repeat them here.

According to the method for the deal with data of the present embodiment, by the second concordance list is set, can in data file, to the value of the measurement index that will obtain, locate fast, thereby reach the object of the value of quick obtaining measurement index.

One of ordinary skill in the art will appreciate that: all or part of step that realizes said method embodiment can complete by the relevant hardware of programmed instruction, aforesaid program can be stored in a computer read/write memory medium, this program, when carrying out, is carried out the step that comprises said method embodiment; And aforesaid storage medium comprises: various media that can be program code stored such as ROM, RAM, magnetic disc or CDs.

Embodiment five

The present embodiment provides a kind of device of deal with data, for carrying out the method for the deal with data of embodiment mono-.Body can be common PC or server etc.The device of this deal with data can have monokaryon CPU(Central Processing Unit, central processing unit) or multi-core CPU.

As shown in Figure 7, for according to the structural representation of the device of the deal with data of the present embodiment.The device of this deal with data comprises that the first acquiring unit 701, first obtains position offset unit 702 and second acquisition unit 703.

Wherein, the first acquiring unit 701 is for the first concordance list default, the first initial reference position according to the value of the measurement index of measuring object primary importance acquisition of information measurement index under the cycle at target measurement in data file, the first concordance list comprises: the first subitem unit and the second subitem unit, the first subitem unit comprises: each measuring period, each measurement index, the byte number that take of the value of the primary importance information of measurement index under each measuring period and the measurement index in data file under each measuring period, the second subitem unit comprises: each measuring object and the second place information corresponding with measuring object, first obtains position offset unit 702 obtains value position offset in data file of measurement index for the byte number taking in data file according to the value of the second place information of measuring object and measurement index, position offset is the position of value in data file and the side-play amount of the first initial reference position of measurement index, second acquisition unit 703 obtains for the first initial reference position and first obtaining according to the first acquiring unit 701 position offset that position offset unit 702 obtains, and obtains the value in target measurement measurement index under the cycle in data file.

Wherein, the first subitem unit specifically comprises: each measuring period, each measurement index of arranging according to identification information, each primary importance information that the sequencing according to measuring period of measurement index is arranged, the byte number that take of the value of the measurement index in data file under each measuring period, or the first subitem unit specifically comprises: each measuring period, each measurement index of arranging according to identification information under each measuring period, the byte number that take of the value of the primary importance information of measurement index under each measuring period and the measurement index in data file under each measuring period, the second subitem unit specifically comprises: according to ascending or descending each measuring object arranged of string length, the second place information corresponding with measuring object.

The concrete operation method of the device of this deal with data is consistent with embodiment mono-, does not repeat them here.

According to the device of the deal with data of the present embodiment, by inquiring about the first concordance list, can in data file, to the value of the measurement index that will obtain, locate fast, thereby reach the object of the value of quick obtaining measurement index.

Embodiment six

The present embodiment is done further supplementary notes to the device of the deal with data of embodiment five.

In the present embodiment, first obtain position offset unit 702 specifically for:

The arrangement sequence number generating according to the measuring sequence of measuring object and the value of measurement index shared byte number in data file, obtain value position offset in data file of stating measurement index, the value of each measurement index shared byte number in data file is identical.

Alternatively, as shown in Figure 8, the device of the deal with data of the present embodiment also comprises the first judging unit 801, this first judging unit 801 is for according to the number at target measurement measuring object corresponding to measurement index under the cycle with arrange sequence number and judge whether data file exists the value of measurement index, when judgment result is that while being, trigger the first acquiring unit 701, wherein, the number of measuring object is arranged in the first concordance list.

Alternatively, the device of the deal with data of the present embodiment also comprises storage unit 802, the 3rd acquiring unit 803 and generation unit 804.Wherein, storage unit 802, was stored in the value of the measurement index getting in internal storage in section for the cycle length default; The 3rd acquiring unit 803 is for the maximum byte of the byte obtaining the value of each accessed measurement index of storage unit 802 and need take; Generation unit 804, for according to the accessed maximum byte of the 3rd acquiring unit 803, stores the value of measurement index in the data file of external storage, and generates the first concordance list.

More specifically, the generation unit in the present embodiment 804 can comprise storing sub-units and generate subelement (not shown).Wherein, storing sub-units is for all storing the value of each measurement index the data file of external storage into according to maximum byte; Generate subelement and be used for generating the first concordance list.

More specifically, storing sub-units specifically for:

The measurement index that is 0 except value in measurement index is all stored in the data file of external storage according to maximum byte.

The concrete operation method of the device of the deal with data of the present embodiment is consistent with embodiment bis-, does not repeat them here.

The device of the deal with data of the present embodiment is when storage data, first in cycle length section, the data that get are temporarily stored in interior storage, then when arriving the end point of cycle length, the maximum byte that need take according to data stores in external memory all data are disposable, not only can avoid so often obtaining data in prior art and just store the I/O frequent operation causing in external storage into, and the required maximum byte taking by obtaining dynamically each data, can either guarantee the storage space of data, can reach again and reduce the object that data take up room.Like this, when the device of the deal with data of the present embodiment is inquired about the value of measurement index in the data file that adopts above-mentioned storage mode storage, the memory location of the value of obtaining measurement index by the concordance list generating in advance in data file, thereby obtain storage, refer to target value, can reach the object of the value of quick obtaining measurement index.

Embodiment seven

The present embodiment provides a kind of device of deal with data, for carrying out the method for the deal with data of embodiment tetra-.

As shown in Figure 9, for according to the structural representation of the device of the deal with data of the present embodiment.The device of this deal with data comprises that the 4th acquiring unit 901, second obtains position offset unit 902 and the 5th acquiring unit 903.

Wherein, the 4th acquiring unit 901 is for the second concordance list default, the second initial reference position according to the measuring object value of measurement index that the 3rd positional information under the cycle is obtained measuring object at target measurement in data file, the second concordance list comprises: the 3rd subitem unit and the 4th subitem unit, the 3rd subitem unit comprises: each measuring period, each measuring object, the 3rd positional information at target measurement under the cycle and the byte number that take of the value of the measurement index in data file under each measuring period, the 4th subitem unit comprises: each measurement index and four positional information corresponding with measurement index, second obtains position offset unit 902 obtains value position offset in data file of measurement index for the byte number taking in data file according to the value of the 4th positional information of measurement index and measurement index, position offset is the position of value in data file and the side-play amount of the second initial reference position of measurement index, the 5th acquiring unit 903 obtains for the second initial reference position and second obtaining according to the 4th acquiring unit 901 position offset that position offset unit 902 obtains, and obtains the value in target measurement measurement index under the cycle in data file.

Wherein, the 3rd subitem unit specifically comprises: each measuring period, each measuring object of arranging according to identification information, each the 3rd positional information that the sequencing according to measuring period of measuring object is arranged, the byte number that take of the value of the measurement index in data file under each measuring period, or the 3rd subitem unit specifically comprises: each measuring period, each measuring object of arranging according to identification information under each measuring period, the byte number that take of the value of three positional information of measuring object under each measuring period and the measurement index in data file under each measuring period, the 4th subitem unit specifically comprises: according to ascending or descending each measurement index of arranging of string length, four positional information corresponding with measurement index.

Alternatively, as shown in figure 10, the device of the deal with data of the present embodiment also comprises the second judging unit 1001, this second judging unit 1001 is for according to the number at target measurement measuring object corresponding to measurement index under the cycle with arrange sequence number and judge whether data file exists the value of measurement index, when judgment result is that while being, trigger the 4th acquiring unit 901, the number of measuring object is arranged in the second concordance list.

The concrete operation method of the device of the deal with data of the present embodiment is consistent with embodiment tetra-, does not repeat them here.

According to the device of the deal with data of the present embodiment, by inquiring about the second concordance list, can in data file, to the value of the measurement index that will obtain, locate fast, thereby reach the object of the value of quick obtaining measurement index.

Embodiment eight

The present embodiment provides the device of another kind of deal with data, for carrying out the method for the deal with data of embodiment mono-to embodiment tri-.

As shown in figure 11, for according to the structural representation of the device of the deal with data of the present embodiment.The device 1100 of this deal with data comprises at least one first processor 1101, the first communication bus 1102, first memory 1103 and at least one the first communication interface 1104.

Wherein, the first communication bus 1102 is for realizing connection the communication between said modules, and the first communication interface 1104 is for being connected with the network equipment and communicating by letter.This bus can be ISA(Industry Standard Architecture, industry standard architecture) bus, PCI(Peripheral Component, peripheral component interconnect) bus or EISA(Extended Industry Standard Architecture, extended industry-standard architecture) bus etc.Bus can be one or more physical circuit, when being many physical circuits, can be divided into address bus, data bus, control bus etc.

Wherein, first memory 1103 is for stores executable programs code, and wherein, first processor 1101 moves the program corresponding with executable program code by reading the executable program code of storage in first memory 1103, for:

In the first default concordance list, the first initial reference position according to the value of the measurement index of measuring object primary importance acquisition of information measurement index under the cycle at target measurement in data file;

The byte number taking in data file according to the value of the second place information of measuring object and measurement index obtains value position offset in data file of measurement index, and position offset is the position of value in data file and the side-play amount of the first initial reference position of measurement index;

According to the first initial reference position and position offset, in data file, obtain the value of the measurement index under the cycle at target measurement;

Wherein, the first concordance list comprises: the first subitem unit and the second subitem unit, the first subitem unit comprises: the byte number that take of the value of primary importance information under each measuring period of each measuring period, each measurement index, measurement index and the measurement index in data file under each measuring period, the second subitem unit comprises: each measuring object and the second place information corresponding with measuring object.

More specifically, the first subitem unit specifically comprises: each measuring period, each measurement index of arranging according to identification information, each primary importance information that the sequencing according to measuring period of measurement index is arranged, the byte number that take of the value of the measurement index in data file under each measuring period, or the first subitem unit specifically comprises: each measuring period, each measurement index of arranging according to identification information under each measuring period, the byte number that take of the value of the primary importance information of measurement index under each measuring period and the measurement index in data file under each measuring period,

The second subitem unit specifically comprises: according to ascending or descending each measuring object arranged of string length, the second place information corresponding with measuring object.

Alternatively, wherein, first processor 1101 moves the program corresponding with executable program code by reading the executable program code of storage in first memory 1103, the value of obtaining measurement index for the byte number taking according to the value of the second place information of measuring object and measurement index in data file during position offset, can be specifically in data file:

Alternatively, the first concordance list is also included in the number of target measurement measuring object corresponding to measurement index under the cycle, wherein, at first processor 1101, by the executable program code of storing in reading first memory 1103, move the program corresponding with executable program code, before the first initial reference position in data file according to the value of the measurement index of measuring object primary importance acquisition of information measurement index under the cycle at target measurement, first processor 1101 can also move the program corresponding with executable program code by reading the executable program code of storage in first memory 1103, for:

According to the number of measuring object and arrangement sequence number, judge the value that whether has measurement index in data file, when judgment result is that while being, carry out the step of the first initial reference position in data file according to the value of the measurement index of measuring object primary importance acquisition of information measurement index under the cycle at target measurement.

Alternatively, at first processor 1101, by the executable program code of storing in reading first memory 1103, move the program corresponding with executable program code, before the first initial reference position in data file according to the value of the measurement index of measuring object primary importance acquisition of information measurement index under the cycle at target measurement, first processor 1101 can also move the program corresponding with executable program code by reading the executable program code of storage in first memory 1103, for:

Obtain the maximum byte in the byte that the value of each measurement index need take;

According to maximum byte, the value of measurement index is stored in the data file of external storage, and generate the first concordance list.

Alternatively, first processor 1101 moves the program corresponding with executable program code by reading the executable program code of storage in first memory 1103, for according to maximum byte, the value of measurement index is stored in the data file of external storage, can be specifically:

The value of each measurement index is all stored in the data file of external storage according to maximum byte.

Alternatively, first processor 1101 moves the program corresponding with executable program code by reading the executable program code of storage in first memory 1103, for the value of each measurement index is all stored in the data file of external storage according to maximum byte, can be specifically:

The measurement index that is 0 except value in measurement index is all stored in the data file of external storage according to maximum byte.The concrete operation method of the device 1100 of the deal with data of the present embodiment and embodiment mono-or embodiment bis-or embodiment tri-are consistent, do not repeat them here.

The device 1100 of the deal with data of the present embodiment, by searching the first concordance list, can be located fast the value of the measurement index that will obtain in data file, thereby reaches the object of the value of quick obtaining measurement index.

Embodiment nine

The present embodiment provides the device of another kind of deal with data, for carrying out the method for the deal with data of embodiment tetra-.

As shown in figure 12, for according to the structural representation of the device of the deal with data of the present embodiment.The device 1200 of this deal with data comprises at least one second processor 1201, second communication bus 1202, second memory 1203 and at least one second communication interface 1204.

Wherein, second communication bus 1202 is for realizing connection the communication between said modules, and second communication interface 1204 is for being connected with the network equipment and communicating by letter.This bus can be ISA(Industry Standard Architecture, industry standard architecture) bus, PCI(Peripheral Component, peripheral component interconnect) bus or EISA(Extended Industry Standard Architecture, extended industry-standard architecture) bus etc.Bus can be one or more physical circuit, when being many physical circuits, can be divided into address bus, data bus, control bus etc.

Wherein, second memory 1203 is for stores executable programs code, and wherein, the second processor 1201 moves the program corresponding with executable program code by reading the executable program code of storage in second memory 1203, for:

In the second default concordance list, the second initial reference position according to the measuring object value of measurement index that the 3rd positional information under the cycle is obtained measuring object at target measurement in data file;

The byte number taking in data file according to the value of the 4th positional information of measurement index and measurement index obtains value position offset in data file of measurement index, and position offset is the position of value in data file and the side-play amount of the second initial reference position of measurement index;

According to the second initial reference position and position offset, in data file, obtain the value of the measurement index under the cycle at target measurement;

Wherein, the second concordance list comprises: the 3rd subitem unit and the 4th subitem unit, the 3rd subitem unit comprises: the byte number that take of the value of each measuring period, each measuring object, the 3rd positional information at target measurement under the cycle and the measurement index in data file under each measuring period, the 4th subitem unit comprises: each measurement index and four positional information corresponding with measurement index.

Alternatively, the second concordance list also comprises: in the number of target measurement measuring object corresponding to measurement index under the cycle; At the second processor 1201, by the executable program code of storing in reading second memory 1203, move the program corresponding with executable program code, before the second initial reference position for the value of measurement index of obtaining measuring object according to the 3rd positional information of measuring object in data file, can also move the program corresponding with executable program code by reading the executable program code of storage in second memory 1203, for:

According to the device 1200 of the deal with data of the present embodiment, by inquiring about the second concordance list, can in data file, to the value of the measurement index that will obtain, locate fast, thereby reach the object of the value of quick obtaining measurement index.

Finally it should be noted that: above embodiment only, in order to technical scheme of the present invention to be described, is not intended to limit; Although the present invention is had been described in detail with reference to previous embodiment, those of ordinary skill in the art is to be understood that: its technical scheme that still can record aforementioned each embodiment is modified, or part technical characterictic is wherein equal to replacement; And these modifications or replacement do not make the essence of appropriate technical solution depart from the scope of various embodiments of the present invention technical scheme.

Claims

1. a method for deal with data, is characterized in that, comprising:

In the first default concordance list, according to the measurement index of measuring object at target measurement the primary importance information under the cycle, the first initial reference position of the value of obtaining described measurement index in data file;

2. the method for deal with data according to claim 1, it is characterized in that, described the first subitem unit specifically comprises: each measuring period, each measurement index of arranging according to identification information, each primary importance information that the sequencing according to described measuring period of described measurement index is arranged, the byte number that take of the value of the measurement index in described data file under each measuring period, or described the first subitem unit specifically comprises: each measuring period, each measurement index of arranging according to described identification information under each measuring period, the byte number that take of the value of the primary importance information of described measurement index under each measuring period and the measurement index in described data file under each measuring period,

3. the method for deal with data according to claim 1, it is characterized in that, value position offset in described data file that the byte number taking in described data file according to the value of the second place information of described measuring object and described measurement index obtains described measurement index comprises:

4. the method for deal with data according to claim 3, is characterized in that, described the first concordance list also comprises: in the number of described target measurement measuring object corresponding to described measurement index under the cycle;

According to the number of described measuring object and described arrangement sequence number, judge the value that whether has described measurement index in described data file, when judgment result is that while being, carry out according to the measurement index of measuring object at described target measurement the step of the first initial reference position of the value of measurement index in data file described in the primary importance acquisition of information under the cycle.

5. the method for deal with data according to claim 4, is characterized in that, the value of byte number+arrangement sequence number * measurement index that the number of described position offset=measuring object is shared shared byte number in described data file.

6. according to the method for the deal with data described in any one in claim 1～5, it is characterized in that, according to the measurement index of measuring object, at target measurement, described in the primary importance acquisition of information under the cycle before the first initial reference position of the value of measurement index in data file, also comprising:

7. the method for deal with data according to claim 6, is characterized in that, described according to described maximum byte, the value of described measurement index is stored in the data file of external storage, comprising:

8. the method for deal with data according to claim 7, is characterized in that, describedly all according to maximum byte, stores the value of described measurement index into described external storage and comprises:

9. a method for deal with data, is characterized in that, comprising:

In the second default concordance list, the second initial reference position according to the measuring object value of measurement index that the 3rd positional information under the cycle is obtained described measuring object at target measurement in data file;

10. the method for deal with data according to claim 9, it is characterized in that, described the 3rd subitem unit specifically comprises: each measuring period, each measuring object of arranging according to identification information, each the 3rd positional information that the sequencing according to described measuring period of described measuring object is arranged, the byte number that take of the value of the measurement index in described data file under each measuring period, or described the 3rd subitem unit specifically comprises: each measuring period, each measuring object of arranging according to described identification information under each measuring period, the byte number that take of the value of three positional information of described measuring object under each measuring period and the measurement index in described data file under each measuring period,

11. according to the method for the deal with data described in claim 9 or 10, it is characterized in that, described the second concordance list also comprises: in the number of described target measurement measuring object corresponding to described measurement index under the cycle;

The method of 12. deal with data according to claim 11, is characterized in that, the value of byte number+arrangement sequence number * measurement index that the number of described position offset=measuring object is shared shared byte number in described data file.

The device of 13. 1 kinds of deal with data, is characterized in that, comprising:

The first acquiring unit, for the first concordance list default, according to the measurement index of measuring object at target measurement the first initial reference position of the value of measurement index in data file described in the primary importance acquisition of information under the cycle, described the first concordance list comprises: the first subitem unit and the second subitem unit, described the first subitem unit comprises: each measuring period, each measurement index, the byte number that take of the value of the primary importance information of described measurement index under each measuring period and the measurement index in described data file under each measuring period, described the second subitem unit comprises: each measuring object and the second place information corresponding with described measuring object,

The device of 14. deal with data according to claim 13, is characterized in that, described first obtain position offset unit specifically for:

The device of 15. deal with data according to claim 14, is characterized in that, also comprises:

16. according to the device of the deal with data described in any one in claim 13～15, it is characterized in that, also comprises:

The device of 17. deal with data according to claim 16, is characterized in that, described generation unit comprises:

Generate subelement, for generating described the first concordance list.

The device of 18. deal with data according to claim 17, is characterized in that, described storing sub-units specifically for:

The device of 19. 1 kinds of deal with data, is characterized in that, comprising:

The 4th acquiring unit, for the second concordance list default, the second initial reference position according to the measuring object value of measurement index that the 3rd positional information under the cycle is obtained described measuring object at target measurement in data file, described the second concordance list comprises: the 3rd subitem unit and the 4th subitem unit, described the 3rd subitem unit comprises: each measuring period, each measuring object, the 3rd positional information at target measurement under the cycle and the byte number that take of the value of the measurement index in data file under each measuring period, described the 4th subitem unit comprises: each measurement index and four positional information corresponding with described measurement index,

The device of 20. deal with data according to claim 19, is characterized in that, also comprises: