CN104077282B - The method and apparatus of processing data - Google Patents

The method and apparatus of processing data Download PDF

Info

Publication number
CN104077282B
CN104077282B CN201310097049.9A CN201310097049A CN104077282B CN 104077282 B CN104077282 B CN 104077282B CN 201310097049 A CN201310097049 A CN 201310097049A CN 104077282 B CN104077282 B CN 104077282B
Authority
CN
China
Prior art keywords
measurement
value
index
data file
measurement index
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201310097049.9A
Other languages
Chinese (zh)
Other versions
CN104077282A (en
Inventor
徐志节
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huawei Technologies Co Ltd
Original Assignee
Huawei Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co Ltd filed Critical Huawei Technologies Co Ltd
Priority to CN201310097049.9A priority Critical patent/CN104077282B/en
Publication of CN104077282A publication Critical patent/CN104077282A/en
Application granted granted Critical
Publication of CN104077282B publication Critical patent/CN104077282B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/22Indexing; Data structures therefor; Storage structures
    • G06F16/2228Indexing structures

Abstract

The embodiment of the present invention provides a kind of method and apparatus of processing data, and method includes:In default first concordance list, according to the first starting reference position of the value of first position acquisition of information measurement index of the measurement index of measurement object under the target measurement cycle in the data file;The byte number taken in the data file according to the value of the second place information of measurement object and measurement index obtains the value of measurement index position offset in the data file;Reference position and position offset are originated according to first, obtains the value of the measurement index under the target measurement cycle in the data file.The method and apparatus of processing data according to embodiments of the present invention, by setting the first concordance list, fast positioning can be carried out to the value for the measurement index to be obtained in the data file, so as to reach the purpose of the value of quick obtaining measurement index.

Description

The method and apparatus of processing data
Technical field
The present embodiments relate to data processing technique, more particularly to a kind of method and apparatus of processing data.
Background technology
Performance statistics daily record is network element device(Network Element,NE)In order to count the specific indexes of special object Numerical value, i.e. Counter numerical value in Performance Measurement, there is clear and definite definition in 3GPP32.432 agreements.
The content of performance statistics daily record generally comprises three aspects:Measurement index(Measurement counters, MC)、 Measurement object(Measurement object, MO)And measurement period(Measurement period).Wherein, measurement index table Show:Counter in performance management, the RRC for statistical flowsheet or occupation condition, such as statistics cell(Radio Resource Control, wireless heterogeneous networks)Number of attempt is established, RRC is successfully established number etc..Measurement object represents: It is used to represent the necessarily physically or logically entity of resource, such as cell in performance management(Cell).Measurement period represents:In performance It is used to periodically provide measurement result in management, i.e., periodically provides the measurement of all measurement measurement indexes of all measurement objects Value.Measurement period can be 5 minutes, 15 minutes, 30 minutes or 60 minutes, be set with specific reference to being actually needed.
In the prior art, the storage mode of performance statistics daily record is as shown in figure 1, it is with measurement object class (Measurement object classes, MOC)Stored for unit, j is integer.Measurement object class includes at least one Individual measurement index and at least one measurement object, for example, the RRC that certain measurement object class can include cell 1 establishes number of attempt Number is successfully established with RRC, while the RRC that can also include cell 2 establishes number of attempt and RRC is successfully established number, wherein, Cell 1 and cell 2 are respectively measurement object, RRC establish number of attempt and RRC to be successfully established number be respectively measurement index.Such as Shown in Fig. 1, MOC is the measurement object class of certain cell, it is assumed that the number of measurement object is 100, and the number of measurement index is 1000. User first has to search measurement object one by one, then gets survey according to measurement object when some measurement index is obtained Figureofmerit, the value of the corresponding measurement index in the measurement period that need to be searched finally is searched further according to measurement index.
But user is in the performance statistics journal file with very more measurement object or measurement index, in use State traditional traversal lookup mode obtain measurement index value be it is very time-consuming, this greatly reduce user inquire about measurement index Value efficiency.
The content of the invention
The embodiment of the present invention provides a kind of method and apparatus of processing data, and measurement is inquired about to solve user in the prior art The problem of efficiency of finger target value is low.
The embodiment of the present invention provides a kind of method of processing data on one side, including:
In default first concordance list, according to the measurement index of measurement object under the target measurement cycle One positional information obtains the first starting reference position of the value of the measurement index in the data file;
Taken according to the value of the second place information of the measurement object and the measurement index in the data file Byte number to obtain the value of the measurement index position offset, the position offset in the data file be the survey The offset of position of the value of figureofmerit in the data file and the described first starting reference position;
According to the described first starting reference position and the position offset, obtained in the data file in the mesh Mark the value of the measurement index under measurement period;
Wherein, first concordance list includes:First subitem unit and the second subitem unit, the first subitem unit bag Include:The first position information and data text of each measurement period, each measurement index, the measurement index under each measurement period The byte number of occupancy of the value of measurement index in part under each measurement period, the second subitem unit include:Each measurement pair As the corresponding second place information with the measurement object.
In the first mode in the cards, according in a first aspect, the first subitem unit specifically includes:Each measurement Cycle, each measurement index arranged according to identification information, the sequencing according to the measurement period of the measurement index enter The byte of the occupancy of each first position information of row arrangement, the value of the measurement index in the data file under each measurement period Number, or the first subitem unit specifically include:Carried out under each measurement period, each measurement period according to the identification information Survey in first position information and the data file of each measurement index, the measurement index of arrangement under each measurement period The byte number of occupancy of the value of figureofmerit under each measurement period;
The second subitem unit specifically includes:According to string length it is ascending or it is descending arranged it is each Measurement object, the second place corresponding with measurement object information.
In second of possible implementation, according in a first aspect, second place information according to the measurement object The value of the measurement index is obtained in the data with the byte number that the value of the measurement index takes in the data file Position offset includes in file:
The arrangement sequence number and the value of the measurement index generated according to the measuring sequence of the measurement object is in the number According to byte number shared in file, the value of measurement index position offset, each institute in the data file are stated described in acquisition It is identical to state byte number of the value of measurement index shared by the data file.
In the third possible implementation, according to second of possible implementation, first concordance list also wraps Include:The number of measurement object corresponding to the measurement index under the target measurement cycle;
In survey described in first position acquisition of information of the measurement index according to measurement object under the target measurement cycle Before the first starting reference position of the value of figureofmerit in the data file, in addition to:
Judge to whether there is the survey in the data file according to the number of the measurement object and the arrangement sequence number The value of figureofmerit, when judged result for be when, perform according to the measurement index of measurement object under the target measurement cycle first Positional information obtains the step of the first starting reference position of the value of the measurement index in the data file.
In the 4th kind of possible implementation, according to the third possible implementation, the position offset=measurement The value of byte number+arrangement sequence number × measurement index shared by the number of object byte shared in the data file Number.
In the 5th kind of possible implementation, with reference to first aspect or the first possible implementation to the 4th kind can The method that can be realized, in first position acquisition of information of the measurement index according to measurement object under the target measurement cycle Before the first starting reference position of the value of the measurement index in the data file, in addition to:
In default cycle time section, the value of the measurement index got is stored in built-in storage;
Obtain the maximum byte in the byte that the value of each measurement index need to take;
According to the maximum byte, the value of the measurement index is stored into the data file of external memory, and is generated First concordance list.
It is described according to the maximum word according to the 5th kind of possible implementation in the 6th kind of possible implementation Section, the value of the measurement index is stored into the data file of external memory, including:
The value of each measurement index is stored into the data file of the external memory according to maximum byte.
It is described by the measurement index according to the 6th kind of possible implementation in the 7th kind of possible implementation Value store according to maximum byte and include to the external memory:
In the measurement index the external memory will be arrived except being worth according to maximum byte storage for 0 measurement index In data file.
Second aspect of the present invention provides a kind of method of processing data, including:
In default second concordance list, according to threeth positional information of the measurement object under the target measurement cycle Obtain the second start reference position of the value of the measurement index of the measurement object in the data file;
Taken according to the value of the 4th positional information of the measurement index and the measurement index in the data file Byte number to obtain the value of the measurement index position offset, the position offset in the data file be the survey The offset of position of the value of figureofmerit in the data file and the second start reference position;
According to the second start reference position and the position offset, obtained in the data file in the mesh Mark the value of the measurement index under measurement period;
Wherein, second concordance list includes:3rd subitem unit and the 4th subitem unit, the 3rd subitem unit bag Include:Measurement index in each measurement period, each measurement object, the 3rd positional information and data file under the target measurement cycle Occupancy of the value under each measurement period byte number, the 4th subitem unit includes:Each measurement index and with the measurement 4th positional information corresponding to index.
In the first possible implementation, according to second aspect, the 3rd subitem unit specifically includes:Each measurement Cycle, each measurement object arranged according to identification information, the sequencing according to the measurement period of the measurement object enter The byte of the occupancy of each 3rd positional information of row arrangement, the value of the measurement index in the data file under each measurement period Number, or the 3rd subitem unit specifically include:Carried out under each measurement period, each measurement period according to the identification information Survey in the 3rd positional information and the data file of each measurement object, the measurement object of arrangement under each measurement period The byte number of occupancy of the value of figureofmerit under each measurement period;
The 4th subitem unit specifically includes:According to string length it is ascending or it is descending arranged it is each Measurement index, the 4th positional information corresponding with the measurement index.
In second of possible implementation, according to second aspect, stating the second concordance list also includes:Surveyed in the target Measure the number of measurement object corresponding to the measurement index under the cycle;
The measurement index that the measurement object is obtained according to the 3rd positional information of measurement object value in data Before the second start reference position in file, in addition to:
Judge with the presence or absence of the measurement to refer in the data file according to the number of measurement object and the arrangement sequence number Target value, measured when judged result when being, to perform described in the second place acquisition of information of the measurement index according to measurement object The step of referring to the second start reference position of target value in the data file.
In the third possible implementation, according to second of possible implementation, the position offset=measurement The value of byte number+arrangement sequence number × measurement index shared by the number of object byte shared in the data file Number.
Third aspect present invention provides a kind of device of processing data, including:
First acquisition unit, in default first concordance list, being surveyed according to the measurement index of measurement object in target Measure the first starting reference position of the value of measurement index described in the first position acquisition of information under the cycle in the data file, institute Stating the first concordance list includes:First subitem unit and the second subitem unit, the first subitem unit include:Each measurement period, Measurement index in the first position information and the data file of each measurement index, the measurement index under each measurement period Occupancy of the value under each measurement period byte number, the second subitem unit includes:Each measurement object and with the measurement Second place information corresponding to object;
First obtains position offset unit, refers to for the second place information according to the measurement object and the measurement The value for the byte number acquisition measurement index that target value takes in data file position in the data file is inclined Shifting amount, the position offset are position of the value of the measurement index in the data file and first start reference The offset of position;
Second acquisition unit, for originating reference position and the position offset according to described first, in the data The value of the measurement index under the target measurement cycle is obtained in file.
In the first possible implementation, according to the third aspect, the first acquisition position offset unit is specific For:
The arrangement sequence number and the value of the measurement index generated according to the measuring sequence of the measurement object is in the number According to byte number shared in file, the value of measurement index position offset, each institute in the data file are stated described in acquisition It is identical to state byte number of the value of measurement index shared by the data file.
In second of possible implementation, according to the first possible implementation, in addition to:
First judging unit, for according to the measurement object corresponding to the measurement index under the target measurement cycle Number and the arrangement sequence number judge to whether there is the value of the measurement index in the data file, when judged result is yes When, the first acquisition unit is triggered, the number of the measurement object is located in first concordance list.
In the third possible implementation, according to the third aspect or the first mode in the cards or second can The implementation of energy, in addition to:
Memory cell, in default cycle time section, the value of the measurement index got to be stored in into memory storage In device;
3rd acquiring unit, the maximum byte in the byte that the value for obtaining each measurement index need to take;
Generation unit, for according to the maximum byte, the value storage of the measurement index to be arrived into the data of external memory In file, and generate first concordance list.
In the third possible implementation, according to second of possible implementation, the generation unit includes:
Storing sub-units, for the value of each measurement index to be arrived into the external memory according to maximum byte storage In data file;
Subelement is generated, for generating first concordance list.
It is specific according to the third possible implementation, the storing sub-units in the 4th kind of possible implementation For:
In the measurement index the external memory will be arrived except being worth according to maximum byte storage for 0 measurement index In data file.
Fourth aspect present invention provides a kind of device of processing data, including:
4th acquiring unit, in default second concordance list, according to measurement object under the target measurement cycle The 3rd positional information obtain the measurement object measurement index value the second start reference position in the data file, institute Stating the second concordance list includes:3rd subitem unit and the 4th subitem unit, the 3rd subitem unit include:Each measurement period, The value of each measurement object, the 3rd positional information under the target measurement cycle and the measurement index in data file is in each measurement week The byte number of occupancy under phase, the 4th subitem unit include:Each measurement index and the corresponding with the measurement index the 4th Positional information;
Second obtains position offset unit, refers to for the 4th positional information according to the measurement index and the measurement The value for the byte number acquisition measurement index that target value takes in data file position in the data file is inclined Shifting amount, the position offset are position of the value of the measurement index in the data file and second start reference The offset of position;
5th acquiring unit, for according to the second start reference position and the position offset, in the data The value of the measurement index under the target measurement cycle is obtained in file.
In the first possible implementation, according to fourth aspect, in addition to:
Second judging unit, for according to the measurement object corresponding to the measurement index under the target measurement cycle Number and the arrangement sequence number judge to whether there is the value of the measurement index in the data file, when judged result is yes When, the 4th acquiring unit is triggered, the number of the measurement object is located in second concordance list.
As shown from the above technical solution, the method and apparatus of processing data provided in an embodiment of the present invention, according to this implementation The method of the processing data of example, can be in the data file to the measurement index to be obtained by setting the first concordance list Value carries out fast positioning, so as to reach the purpose of the value of quick obtaining measurement index.
Brief description of the drawings
In order to illustrate more clearly about the embodiment of the present invention or technical scheme of the prior art, below will be to embodiment or existing There is the required accompanying drawing used in technology description to be briefly described, it should be apparent that, drawings in the following description are this hairs Some bright embodiments, for those of ordinary skill in the art, without having to pay creative labor, can be with Other accompanying drawings are obtained according to these accompanying drawings.
Fig. 1 is the storage mode of the performance statistics daily record of prior art;
Fig. 2 is the schematic flow sheet according to the method for the processing data of one embodiment of the invention;
Fig. 3 A are the schematic flow sheet according to the method for the processing data of another embodiment of the present invention;
Fig. 3 B are the schematic diagram according to first concordance list of further embodiment of this invention;
As shown in Figure 3 C, it is the first concordance list and the data file that are formed according to the method for the data storage of the present embodiment One specific implementation;
Fig. 4 is that the byte number that the content in the pCacheSrc according to yet another embodiment of the invention takes according to new need reflects The schematic diagram being mapped in pCacheDsc;
Fig. 5 is the instantiation figure according to first concordance list of another embodiment of the present invention;
Fig. 6 A are the schematic flow sheet according to the method for the processing data of further embodiment of this invention;
Fig. 6 B are the specific example figure according to second concordance list of one embodiment of the invention;
Fig. 7 is the structural representation according to the device of the processing data of yet another embodiment of the invention;
Fig. 8 is the structural representation according to the device of the processing data of another embodiment of the present invention;
Fig. 9 is the structural representation according to the device of the processing data of further embodiment of this invention;
Figure 10 is the structural representation according to the device of the processing data of yet another embodiment of the invention;
Figure 11 is the structural representation according to the device of the processing data of another embodiment of the present invention;
Figure 12 is the structural representation according to the device of the processing data of further embodiment of this invention.
Embodiment
To make the purpose, technical scheme and advantage of the embodiment of the present invention clearer, below in conjunction with the embodiment of the present invention In accompanying drawing, the technical scheme in the embodiment of the present invention is clearly and completely described, it is clear that described embodiment is Part of the embodiment of the present invention, rather than whole embodiments.Based on the embodiment in the present invention, those of ordinary skill in the art The every other embodiment obtained under the premise of creative work is not made, belongs to the scope of protection of the invention.
Embodiment one
The present embodiment provides a kind of method of processing data, and the executive agent of the present embodiment is the device of processing data, should The device of processing data can be specifically common PC or server etc..The device of the processing data can have single Core CPU(Central Processing Unit, central processing unit)Or multi-core CPU.
As shown in Fig. 2 the schematic flow sheet of the method for the processing data according to the present embodiment.
Step 201, in default first concordance list, according to the measurement index of measurement object under the target measurement cycle First position information, obtain the first starting reference position of the value of measurement index in the data file.
In the built-in storage for the device that first concordance list can be located at processing data, the device of processing data can also be located at External memory in.First concordance list includes:First subitem unit and the second subitem unit, the first subitem unit include: Measurement in the first position information and data file of each measurement period, each measurement index, measurement index under each measurement period Refer to the byte number of occupancy of the target value under each measurement period, the second subitem unit includes:Each measurement object and and measurement object Corresponding second place information.
More specifically, wherein the first subitem unit can specifically include:Each measurement period, according to identification information arrangement Each first position information, the data file that each measurement index, the sequencing according to measurement period of measurement index are arranged In measurement index occupancy of the value under each measurement period byte number, or the first subitem unit specifically includes:Each measurement Each measurement index for being arranged under cycle, each measurement period according to identification information, measurement index are under each measurement period The byte number of occupancy of the value of measurement index in first position information and data file under each measurement period;Wherein second son Item unit specifically includes:According to string length is ascending or the descending each measurement object arranged, with measurement pair As corresponding second place information.
When multiple measurement indexes be present under same measurement period, can be measured according to the identification information pair of each measurement index Index is ranked up, for example, each measurement index identification information set in advance is respectively ID(Identify, identity)1、 ID2, ID3 ..., then it can be arranged from small to large or from big to small according to the identification information.
Because the space shared by data file is larger, it is normally in external memory.Data file includes each measurement Refer to target value.The the first starting reference position of the value of measurement index in the data file is a reference position, passes through the reference position Put the position for the value that can get measurement index.
Measurement object can include cell, RNC(Radio Network Controller, radio network controller)Deng, The measurement index of measurement object can be successfully established number including RRC connection number of attempt, RRC, when measurement index is RRC's When connecting number of attempt, the value of measurement index refers to the value of RRC number of attempt, when measurement index is that RRC is successfully established time During number, the value of measurement index refers to that RRC is successfully established the value of number.
Step 202, the word taken in the data file according to the value of the second place information of measurement object and measurement index Position offset, the position offset are the values of measurement index in data text to the value of joint number acquisition measurement index in the data file The offset of position and the first starting reference position in part.
It is pointed out that the position offset is the value of the measurement index under the target measurement cycle in data file In position offset.
Step 203, according to the first starting reference position and position offset, obtain in the data file in target measurement week The value of measurement index under phase.
The device of processing data obtains target according to the first of the value of measurement index the starting reference position and position offset The position of the value of measurement index under measurement period in the data file, and inquire about and obtain in the data file according to the position The value of measurement index under the target measurement cycle.That is, by position offset of each measurement index under a certain measurement period with And start reference position, it becomes possible to obtain value of each measurement index under the measurement period.
, can be in the data file to institute by setting the first concordance list according to the method for the processing data of the present embodiment The value for the measurement index to be obtained carries out fast positioning, so as to reach the purpose of the value of quick obtaining measurement index.
What concordance list can be stored in units of measurement object class, an index is generated per a kind of measurement object class Table, each concordance list can have corresponding title, such as be used as title using the classification of measurement object.
So, before step 201, can also include:
When multiple concordance lists be present, the first concordance list is obtained from multiple concordance lists according to measurement object.Search for institute During the concordance list needed, found out by the title can for searching for concordance list.A measurement object and concordance list can also be preset ID mapping table, according to the concordance list where the corresponding pass table search measurement object.It is pointed out that for a survey Object is measured, when all measurement indexes corresponding to it are stored in into same concordance list, the number of the first concordance list is 1, when this Have when all measurement indexes corresponding to measurement object are respectively stored in multiple concordance lists, such as in multiple concordance lists mutually of the same name The measurement index of title, each measurement index correspond to all measurement objects, then the number of the first concordance list can be multiple.
Embodiment two
The present embodiment does further supplementary notes to the method for the processing data in embodiment one.
As shown in Figure 3A, it is schematic flow sheet according to the method for the processing data of the present embodiment.
Step 301, in default cycle time section, the value of the measurement index got is stored in built-in storage.
Default cycle time in the present embodiment, it can be each measurement period recorded in performance statistics daily record, that is, enter Row detection measurement object obtains the cycle of each measurement index operation or generates the cycle of a performance statistics daily record, wherein, Performance statistics daily record can be stored according in units of measurement object class, and specifically, default cycle time can basis It is actually needed and is set, is will not be repeated here.The data got in the present embodiment can include:Measurement object, measurement pair The byte that the measurement index of elephant, the value of measurement index need to take.
The data in built-in storage can be directly invoked due to the device of processing data, therefore processing is taken in built-in storage I/O need not be carried out during data(Input/Output, input/output)Operation, alleviate the burden of the device of processing data.
Step 302, the maximum byte in the byte that the value of each measurement index need to take is obtained.
One that value maximum is selected in the byte that the device of processing data need to take from the value of each measurement index is used as maximum Byte.
Step 303, according to maximum byte, the value of measurement index is stored into the data file of external memory, and is generated First concordance list.
The device of processing data can select according to maximum byte to store the value of all measurement indexes into external memory. It is assumed that the value of the measurement index currently got has 3, the value of the first measurement index is 32, and the value of the second measurement index is 101, the value of the 3rd measurement index is 258, and the value of the first measurement index needs 1 byte storage, and the value of the second measurement index needs 1 Individual byte storage, the value of the 3rd measurement index need 2 byte storages, there it can be seen that maximum byte is 2, then surveyed first The value of the value of figureofmerit, the value of the second measurement index and the 3rd measurement index is respectively according to 2 byte storages into external memory. The device of processing data is also an option that byte of the byte more somewhat larger than maximum byte used in as all data of storage, i.e., Using maximum byte and default Margin threshold and as maximum byte.For example, when default Margin threshold is 1, above-described embodiment It can select the value of the value of the first measurement index, the value of the second measurement index and the 3rd measurement index respectively according to 3 bytes Store in external memory.
The first concordance list that the step is generated, first concordance list of the present embodiment as shown in Figure 3 B, first concordance list Include:According to string length is ascending or the descending each measurement object arranged, corresponding with measurement object Second place information, each first position information of the measurement index arranged according to the sequencing of measurement period and measurement Refer to shared byte number of the target value under each measurement period.Such arrangement mode is advantageous to the extension and change of data. When multiple measurement indexes be present under same measurement period, arranged according to each measurement index of the identification information pair of measurement index Sequence, as shown in Figure 3 B, it can typically be entered for the identification information match ID of measurement index with the sequencing of the measurement of measurement index Row sequence, can be arranged with the inverted order of measuring sequence, such as when the identification information of measurement index is ID1, its measurement Index is the measurement index of last measurement.It should be noted that the measuring sequence of measurement object listed in Fig. 3 B is Put in order for the title of measurement object, if the measuring sequence of measurement object and the title of measurement object put in order not Together, the order of the value of the measurement index in data file does not show that difference in Fig. 3 B.Measurement period and measurement in Fig. 3 B The position of index can exchange, and form another arrangement mode of the first subitem unit, repeat no more below.
Structure is STRU_MAPPING_OBJ used by Fig. 3 B, wherein preserving the title and measurement object of measurement object Positional information, according to measuring sequence(pObjname)Arranged, be easy to use dichotomy quickly to search and be capable of object Index information, wherein pObjName are defined in STRU_MAPPING_OBJ, i.e., user preserves the name of measurement object.
From Fig. 3 B as can be seen that in MOCp concordance lists, corresponding positional information is got according to measurement object, It is obtained in a certain measurement period T according to measurement indexiIn position offset, wherein p is more than or equal to 1 and to be less than or wait In m integer, m is the number of MOC concordance lists, and i is the integer more than or equal to 1 and less than or equal to n, and n is measurement period Number.It can just be found in the data file in target according to the position offset under first position information and target measurement cycle The value of the measurement index under measurement period.In the data file, can be in the way of as shown in Figure 3 B, according to different measurements Cycle, different MOC concordance lists generation form, in order to which user searches.Wherein, because the space shared by concordance list is less, It can be stored in internal memory, naturally it is also possible to be stored in external memory.User, can be right according to the concordance list of the present embodiment The value for the measurement index that need to be searched carries out fast positioning, and acquisition speed is very fast.
It is alternatively possible to a default table to be filled, this presets the title of pre-set first concordance list in table to be filled Position, the position of each measurement object, the position of each measurement index, the position of each first position information, each second place information The position of the value of position and each measurement index shared byte number in the data file.That is, this presets table to be filled The position where each data is defined, the device of processing data adds acquired each data in the table to be filled, forms the One concordance list.Each data can be added this after the total data of same measurement period is got and treated by the device of processing data Table is filled, or after data are got every time, data is added this and preset in table to be filled.It is alternatively possible to will measurement Store into external memory, i.e., do not have in the data file of external memory according to maximum byte for 0 data except being worth in index There are the data that storage value is 0, further to avoid value from taking memory space as 0 data.Refer to when user searches for less than certain measurement Timestamp, the value for just illustrating the measurement index are 0.Either, when the measurement index of certain measurement object is under a certain measurement period Be worth for 0 when, the measurement index of the measurement object corresponding first position information under the measurement period is specific symbol, such as FFF, then it represents that value of the measurement index under the measurement period is 0.When the device of processing data identifies certain measurement object When first position information of the measurement index under certain measurement period is special symbol, then judge the measurement index in the measurement period Under value be 0.
As shown in Figure 3 C, it is the first concordance list and the data file that are formed according to the method for the data storage of the present embodiment One specific implementation.
The index information of measurement indexes of Fig. 3 C by same measurement object under different measurement periods is stored in same In MOC1 tables.Measurement object according to the string length of its title it is ascending or it is descending arranged, second place rope Fuse breath is the measuring sequence sequence number of measurement object, can be 1,2,3,4 ... etc. respectively, the position pointed by each arrow is It is the first starting reference position of the value of corresponding measurement index in the data file.The first starting reference position is not true The position of the value of positive storage measurement index, but the position of the value of measurement index can be found by the first starting reference position Put.First position information can be specifically index information, be pointing directly at the first starting reference position.
Because under different measurement periods, the number of measurement object may differ corresponding to same measurement index, use The first concordance list shown in Fig. 3 B, it is only necessary to which its relevant position is inserted i.e. according to the length of the character string of the title of measurement object Can, without changing other contents., can be with continuation application memory space if the insufficient memory for presetting table to be filled is big.
Above-mentioned steps 301~303, are the method for generating the first concordance list and data file, and the side of data storage Method.It is envisioned that to can also generate other concordance lists in the manner described above, the value of all measurement indexes is stored in together In one data file, each concordance list has unique name information or ID.
Step 304, in default first concordance list, according to the measurement index of measurement object under the target measurement cycle The the first starting reference position of the value of first position acquisition of information measurement index in the data file.
First position information can be specifically index, and the device of processing data can be looked for directly according to the first position information To the first starting reference position.
Step 305, the arrangement sequence number and the value of measurement index generated according to the measuring sequence of measurement object is in data text Shared byte number in part, the value of measurement index position offset in the data file is obtained, the value of each measurement index is in number It is identical according to byte number shared in file.
Position offset acquired in the step be the value of the measurement index under the target measurement cycle in the data file Position offset.
In the present embodiment, byte number that the length of the measurement index in the first concordance list, i.e. measurement index need to take.Due to The value of all measurement indexes is according to same word joint number storage, therefore, position offset=arrangement sequence number × byte number.Can It is envisioned that, if what the value of measurement index stored not in accordance with identical bytes, it need to e.g. be taken according to respective reality What byte was stored, it is necessary to arrange sequence number less than corresponding to the value of each measurement index of the value for the measurement index that need to be obtained Byte all add up to calculate offset.
In the present embodiment, measurement object put in order be can be ascending or by big according to the string length of title Arranged to small, the second place information corresponding to measurement object is the arrangement sequence number arranged according to measuring sequence.
Alternatively, as shown in Figure 3 C, it is corresponding that measurement index under the target measurement cycle is additionally may included in the first concordance list Measurement object number.It is assumed that the number of the corresponding measurement object in measurement period T1 of measurement index 1 is 100, if It need to inquire about the value of the measurement index 1 of certain measurement object in measurement period T1, the corresponding second place information of the measurement object, When arranging serial number 101, just explanation did not detect the measurement index 1 of the measurement object in the measurement period T1 moment Value, the device of processing data directly can return to the response without the Query Result to client.In the presence of the number of measurement object, The value of byte number+arrangement sequence number × measurement index shared by the number of position offset=measurement object institute in the data file The byte number of occupancy.
Step 306, according to the first starting reference position and position offset, obtain in the data file in target measurement week The value of measurement index under phase.
Position=first of the value of measurement index in the data file originates reference position+position offset.Processing data Device is after the actual location of value of measurement index is got, you can to get the measurement index stored on the position Value.
In addition, the method for the processing data of the present embodiment can use monokaryon to realize, multinuclear can also be used to realize.
Step 304~step 306 is to be looked into according to the first concordance list and data file of step 301~step 303 generation The detailed process of the value of measurement index required for asking.
Alternatively, before the step 304 of the present embodiment, in addition to:
The first concordance list according to where measurement object inquires about the measurement object.
When multiple concordance lists being present, its corresponding first concordance list can be inquired about according to measurement object, then performs step Rapid 304~306, to obtain the value of some measurement index of measurement object.The mode for inquiring about the first concordance list can be traversal side Formula.According to the present embodiment, in data storage, first in cycle time section, the data got are stored temporarily in internal memory Chu Zhong, it is according to the maximum byte that data need to take that all data are disposable then when reaching the end point of cycle time Store in outer storage, can not only so avoid often obtaining a data in the prior art just storing in external memory and cause I/O operation required maximum byte that is frequent, and being taken by dynamically obtaining each data, the storage of data can either be ensured Space, and can enough reach the purpose for reducing data space-consuming.So, in the data file using the storage of above-mentioned storage mode When inquiring about the value of measurement index, the storage position of the value of measurement index in the data file is obtained by the concordance list previously generated Put, refer to target value so as to obtain storage, the purpose of the value of measurement index under the quick obtaining target measurement cycle can be reached.
Specifically, in the present embodiment, the service software life provided in the embodiment of the present invention can be provided by C language Production method, its implementation example are as follows:
The mode for generating concordance list is as follows:
struct STRU_MAPPING_OBJ
{
CHAR*pObjName;// be used to preserve the title of measurement object
DWORD dwObjNameLen;// for the length for the title for preserving measurement object
DWORD dwPosInd;// be used to preserve the positional information of the measurement object.The positional information of measurement object is to add Add sequencing numbering during measurement object, the from 0,1,2 ....
}
The positional information of above-mentioned measurement object is the second place information in the present embodiment, can be according to measurement object Measurement object is added in table to be filled by sequencing.
In order to improve the lookup speed of measurement object, the data structure of Hash dictionaries, i.e. STRU_MAPPING_ can be used OBJ_DIC, it is implemented as follows:
struct STRU_MAPPING_OBJ_DIC
{
DWORD dwKey;Key in //hash algorithm
DWORD dwObjMaxNum;The maximum number of // preservation measurement object.When adding measurement object, if DwObjNum is more than or equal to dwObjMaxNum, then the parameter is by giving fixed step size increase, and in pObjHeader needs to apply again Deposit.
DWORD dwObjNum;The actual number of // current measurement object.When adding measurement object, if measurement object Not in pObjHeader structures, then dwObjNum increases by 1.The priority according to measurement object title is needed when adding measurement object The information of measurement object is stored in pObjHeader structures by order.
STRU_MAPPING_OBJ*pObjHeader;//STRU_MAPPING_OBJ structured fingers, for storing measurement pair As index information.Initial size is dwObjMaxNum*sizeof (STRU_MAPPING_OBJ).The index information of measurement object Stored according to the name order of measurement object.
}
Measurement object shows that preset table to be filled does not reserve storage for the measurement object not in pObjHeader structures Position, the device of processing data can apply for new memory space to store the title of the measurement object, second place information And the value of relative each measurement index.
Each measurement index is required for establishing the index information of measurement index, measurement index in different measurement periods The specific of index information may include:The index information of measurement index includes position offset and the value of the measurement index and needs to take Byte.For same measurement index under different measurement periods, the byte that need to be taken can be with identical, can also be different.Measurement The byte that referring to target value need to take can be 0 byte, 1 byte, 2 bytes, 4 bytes or 8 bytes.Same measurement week In phase or same preset time period, the byte that the value of the measurement index of each measurement object need to take is dwMappingLen, The dwMappingLen is the structure definition in STRU_MAPPING_VALUE_INFO.If dwMappingLen is 0, also To say under the measurement period, the value of the measurement index of all measurement objects is 0, can select not by each value for 0 measurement Index preserves in the data file, is implemented as follows:
struct STRU_MAPPING_VALUE_INFO
{
UINT64ui64Offset;// the measurement index is believed in given measurement period in the first position of data file Breath, with 64 storages.If the first position information is full FF, i.e. 0 × FF, then it represents that the measurement index in the data file without Data.
DWORD dwMappingLen;// giving in measurement period, the measurement index value stored in the data file It size, can be 0, identify measurement index no data in the data file.
};
In existing performance statistics daily record, the measured value of its measurement index is stored using 8 bytes.The present embodiment In, if dwMappingLen is equal to 1, compression ratio is equal to 8:1.According to historical statistics, in performance statistics daily record, 40% with On the value of measurement index of measurement object be 0, the value of the measurement index of more than 50% measurement object need to only take 2 bytes Stored, can so make the space shared by data storage fewer by 3/4 to 5/6 than original.Use the dynamic pressure of the present embodiment Compression algorithm, do not influence to inquire about the speed of measurement index.The position offset of the measurement index of measurement object can be equal to ui64Offset+4+dwPosInd*dwMappingLen.Wherein, dwPosInd be measurement object location index information, 4 tables Show the maximum position information of the measurement object under the cycle(Location index)Required byte number.
The structure of the concordance list of measurement index can use STRU_MAPPING_COUNTER_INFO structures in concordance list, The ID of measurement index can be included(Identify, Identity Code), the type of measurement index, the measurement period of measurement index and STRU_MAPPING_VALUE_INFO structure type pointers.Specific implementation is as follows:
struct STRU_MAPPING_COUNTER_INFO
{
DWORD dwCounterId;The ID of // measurement index
DWORD dwType;The type of // measurement index, such as 32 integer types, 64 integer types, 64 floating-point classes Type etc.
DWORD dwMaxTimeNum;The number of // measurement period.If adding measurement period, dwMaxTimeNum It can change, and pMappingValueHeader internal memory needs to apply again
STRU_MAPPING_VALUE_INFO*pMapping ValueHeader;//STRU_MAPPING_VALUE_ INFO structure pointer, for storing the index information of measurement index.Initial size is dwMaxTimeNum*sizeof (STRU_ MAPPING_VALUE_INFO).The index information of the measurement index of different measurement periods stores in the structure shown here.
}
In order to improve the lookup speed of the index information of measurement index, the index information of measurement index can use Hash words The data structure of allusion quotation, i.e. STRU_MAPPING_COUNTER_INFO_DIC, specific implementation can be as follows:
struct STRU_MAPPING_COUNTER_INFO_DIC
{
DWORD dwKey;Key in //hash algorithm
DWORD dwCounterMaxNum;The maximum number of // measurement index.When adding measurement index, if DwCounterNum is more than or equal to dwCounterMaxNum, then the parameter, which is pressed, gives fixed step size increase, and PCounterInfoHeader needs to apply for internal memory again
DWORD dwCounterNum;The actual number of measurement index in the // current structure.When adding measurement index, If measurement index is not in pCounterInfoHeader structures, dwCounterNum increases by 1.In addition measurement index , it is necessary to be stored according to the ID of measurement index sequencing in pCounterInfoHeader structures during corresponding information
DWORD dwMaxTimeNum;The number of // measurement period, with STRU_MAPPING_COUNTER_INFO structures DwMaxTimeNum;
STRU_MAPPING_COUNTER_INFO*pCounterInfoHeader;//STRU_MAPPING_COUNTER_ INFO structure pointer, for storing the index information of measurement index.Initial size is dwCounterMaxNum*sizeof (STRU_MAPPING_COUNTER_INFO).The index information of measurement index according to measurement index ID sequential storages.
}
The ID of above-mentioned measurement index can be specifically the measuring sequence of measurement index, and ID is, for example, 1,2 ... s, represents respectively The measurement index of 1st measurement, the measurement index of s-th of measurement of measurement index ... of the 2nd measurement, s is integer.
For same performance statistics journal file, multiple MOC tables can be included, can include and survey per MOC tables The index information of object and the index information of measurement index are measured, specific implementation is as follows:
struct STRU_MAPPING_CLASS
{
DWORD dwClassId;//MOC ID
DWORD dwObjPosInd;The positional information ID of // measurement object, initial value are equal to 0.If addition one is new Measurement object, then the dwPosInd of the measurement object be equal to dwObjPosInd, and dwObjPosInd+1.Under same MOC The dwPosInd values of different measurement objects are different
DWORD dwMaxTimeNum;The number of // measurement period
STRU_MAPPING_COUNTER_INFO_DIC*pCounterInfoDicHeader;// refer to for storing measurement The pointer of the dictionary of target index information
STRU_MAPPING_OBJ_DIC*pObjDicHeader;// be used to store the pointer that measurement object indexes dictionary
CRITICAL_SECTION criticalSection;// PV the operations being used for when multinuclear is handled.Adding , it is necessary to be protected using the variable during Counter and Obj.Wherein, PV operations are semaphore operations methods, are an allusion quotations The synchronization mechanism of type, P represent to pass through, and V represents release
}
Performance statistics daily record includes multiple MOC tables, that is, needs the STRU_MAPPING_CLASS by multiple MOC to organize Come, its specific implementation is:
struct STRU_MAPPING_MRF
{
DWORD dwClassMaxNum;The maximum number of measurement object in //MOC tables.When adding MOC tables, if DwClassNum is more than or equal to dwClassMaxNum, then the parameter, which is pressed, gives fixed step size increase, but pClassHeader needs again Apply for internal memory
DWORD dwClassNum;//DWORD dwClassNum represent the actual number of MOC tables in the current structure. When parsing data, if it find that MOC tables not in pClassHeader structures, then dwClassNum increases by 1, and this kind of situation table Show the MOC tables for new MOC tables, it is necessary to which the MOC tables are added in pClassHeader structures, according to MOC when adding MOC tables The ID's of table is sequentially stored in pClassHeader structures
DWORD dwMaxTimeNum;The number of // measurement period
DWORD dwPeriod;// measurement period, such as 15,30,60 etc.
CHAR szNEName[64];The title of // network element device
CHAR szNEVersion[64];The version number of // network element device operation
STRU_MAPPING_CLASS*pClassHeader;//STRU_MAPPING_CLASS structured fingers, initial size For dwClassMaxNum*sizeof (STRU_MAPPING_CLASS)
}
In the present embodiment, related false code during analysis feature statistical log is implemented as follows:
The object of a STRU_MAPPING_MRF structure is created, is designated as pMrfObj
Apply for a data file on hard disk, size is all properties accounting log file(Unpacked format)Size it The 1/5 of sum.If application directly returns to parsing failure less than hard drive space.During analysis feature statistical log, such as Fruit finds the insufficient space of storage, then can dynamically apply for hard drive space.If dynamic application hard drive space failure, returns to solution Analysis failure.
Create a CRITICAL_SECTION object, i.e. classSection.
Travel through all properties accounting log file, at the beginning of performance statistics journal file is corresponding between point index be designated as T, Time point, which is indexed from 0,1,2 ... is numbered
{
1. the performance statistics journal file is distributed into an idle CPU
2. applying for one piece of independent memory, DataBuff is remembered, for depositing the value of the measurement index after parsing.Due to can not essence The compression ratio of dynamic compression algorithm is really calculated, then the internal memory can only use dynamic application way, the adaptive number for storing MOC tables According to.DataBuff initial size is single performance statistics journal file(It is uncompressed)1/5.
3. travel through all MOC data in measurement period T performance statistics daily record
{
1)Need to start for multinuclear processing(EnterCriticalSection)ClassSection objects
2)STRU_MAPPING_CLASS objects are created, if the object of the STRU_MAPPING_CLASS structures has been deposited The pointer of the object of the STRU_MAPPING_CLASS structures is then being obtained, is remembering pMapClassObj
3)Need to cancel for multinuclear processing(LeaveCriticalSection)ClassSection objects
4)Need to start for multinuclear processing(EnterCriticalSection)pMapClassObj-> criticalSection。
5)By the information of all measurement objects in MOC(Title, length and positional information)It is added to pMapClassObj- >In pObjDicHeader.Sequencing numbering when positional information in measurement object is addition measurement object, numbering 0, 1,2…..The index number of the maximum position of all measurement objects in the MOC tables is obtained, remembers maxPosInd.In new application one Deposit for preserving the measured positional information information for having object under the MOC tables)In the positional information of measurement object can be provided.
6)By the information of all measurement indexes in MOC tables(The ID of measurement index and the type of measurement index)It is added to pMapClassObj->In pCounterInfoDicHeader.
8)Need to cancel for multinuclear processing(LeaveCriticalSection)pMapClassObj-> criticalSection
8)Apply and initialize temporal cache, be i.e. pCacheSrc and pCacheDsc, the size of two caching is 8* (maxPosInd+1)
9)Travel through measurement index all in MOC tables
{
A) according to measurement index ID, STRU_MAPPING_COUNTER_INFO objects are obtained(Looked into using Hash+ dichotomies Ask), remember pMapCounterObj
B) according to time T, pMapCounterObj- is obtained>PMappingValueHeader [T], remember pMapValObj
C) dynamic compression algorithm is used, will obtain all measurement objects corresponding to the measurement index, and by all measurements Measurement index value corresponding to object is stored in pCacheSrc that (the measurement index value of measurement object stores in pCacheSrc Position offset is Len*dwPosInd), and byte Len, Len that the need for obtaining the value of measurement index take can be 0,1,2, 4、8.Len is assigned to pMapValObj->dwMappingLen.If dwMappingLen is not equal to 0, step d) is performed
D) by maxPosInd(Stored using 4 bytes)With the data in pCacheSrc(Size is dwMappingLen* (maxPosInd+1))It is sequentially stored in DataBuff internal memory, while maxPosInd is offset in DataBuff position Amount(The distance of maxPosInd to DataBuff first address)It is assigned to pMapValObj->ui64Offset
}
}
4. the position for returning to DataBuff data storage data files in the data file is preserved according to DataBuff data Offset is put, remembers uiOffset
5. change the index information of all measurement indexes under T moment all MOC tables, i.e. pMapValObj.Change formula For pMapValObj->ui64Offset+=uiOffset
}
The index information pMrfObj of measurement index is saved in fixed disk file.
The specific implementation of related false code in the present embodiment during query performance statistical log can be as follows:
Input:MOC ID, measurement index ID, the title of measurement object, query time section(T0~Tn)
Output:The value of all measurement indexes of T0~Tn periods
Wherein, n is the integer more than 0.
STRU_MAPPING_CLASS objects are obtained by MOCID(Pass through binary search), remember pMapClassObj.Such as Fruit pMapClassObj is not present, then returns to NULL.
By measurement index ID, STRU_MAPPING_COUNTER_INFO objects are obtained under pMapClassObj(Pass through Hash and binary search), remember pMapCounterObj.If pMapCounterObj is not present, NULL is returned
By measurement object title, STRU_MAPPING_OBJ objects are obtained under pMapClassObj(By Hash and Binary search), remember pMapObj.If pMapObj is not present, NULL is returned.The positional information of the measurement object is obtained, Remember dwPosInd
Travel time section(T0~Tn)
{
1. according to time T, the pMapValObj at acquisition T moment
2. pass through pMapValObj->Ui64Offset and pMapValObj->DwMappingLen, if DwMappingLen is equal to 0, or ui64Offset is equal to full FF, and the value of the measurement index at the T moment is 0, otherwise performs step Rapid 3
3. pass through pMapValObj->Ui64Offset obtains data maxPosInd values, maxPosInd in the data file Position offset in the data file is pMapValObj->Ui64Offset, length are equal to 4.If maxPosInd< DwPosInd, then the measurement index value at T moment is 0, otherwise performs step 4
4. obtaining measurement index value in the data file, the position offset of measurement index value in the data file is pMapValObj->ui64Offset+4+dwPosInd*pMapValObj->dwMappingLen.The measurement index at T moment Value is also needed to according to pMapCounterObj->DwType is changed.In the data file, acquisition is the byte number that need to be taken, Pass through pMapCounterObj->DwType comes convert integer or floating number.
}
Specific implementation using the related false code of dynamic compression algorithm is as follows:
Apply for two temporal caches, remember pCacheSrc and pCacheDsc, two cache size is 8* (maxPosInd+1), and initialization is set to 0
Travel through all measurement objects of the measurement index
{
1. obtain the value of measurement index and the dwPosInd of measurement object of the measurement object
2. if find that the value of the measurement index of measurement object is non-zero first, and obtain maximum byte (such as 1,2,4,8).Should Maximum byte, which is assigned to, measures the index in T moment pMapValObj->dwMappingLen.By the measurement of the measurement object It is that position offset is stored in pCacheSrc to refer to target value according to dwMappingLen*dwPosInd, and shared byte Number is dwMappingLen
If 3. it is non-first find measurement object measurement index value it is non-zero, obtain maximum number of byte (such as 1,2,4, 8) dwSize, is remembered.If dwSize is less than and is equal to dwMappingLen, the value of measurement index is stored in pCacheSrc In, the byte that need to be taken is dwMappingLen.If dwSize is more than dwMappingLen, the content in pCacheSrc is pressed The byte number taken according to new need(dwSize)It is mapped in pCacheDsc, as shown in Figure 4(The number phase that this scene occurs To fewer).PCacheDsc contents are copied in pCacheSrc, then the measurement index value of the object presses New Set length (dwSize) store in pCacheSrc, dwSize is assigned to pMapValObj->dwMappingLen.PCacheDsc is initialized For 0.
As shown in table 1, performance statistics journal file of the prior art and inquiry are inquired about according to the present embodiment for user The contrast table of the performance statistics journal file of generation.
Table 1
From table 1 it follows that the parsing time for the performance statistics journal file that user's inquiry generates according to the present embodiment The far smaller than parsing time of prior art, hard disk space-consuming are about the 1/6 of prior art space-consuming, and measurement index is looked into Ask speed and be also significantly faster than prior art.
Embodiment three
The present embodiment provides a kind of method of processing data.
As shown in figure 5, it is concordance list and the structural representation of data file employed in the present embodiment.
Wherein, the entitled MOC1 tables of the first concordance list, each measurement object are arranged according to the length of the character string of title Row, the corresponding second place information of each measurement object are the arrangement sequence number of its measuring sequence.For example, the institute of measurement object 1 Corresponding second place information is 2, and it is the 2nd measured, the second corresponding to measurement object 2 to represent the measurement object 1 Confidence breath is 1, and it is the 1st measured to represent the measurement object 2, and the second place information corresponding to measurement object 3 is 3, table It is the 3rd measured to show the measurement object 3.
Each measurement index is arranged according to measuring sequence, and the first position information corresponding to each measurement index is according to survey The amount cycle is arranged, and 2 measurement indexes and 2 measurement periods is shown in Fig. 5, while also include each measurement in the MOC1 tables Refer to the length of byte number, i.e. measurement index that target value need to take, be 2 bytes in Fig. 5, also include in addition in Fig. 5 in MOC1 tables The number of measurement object corresponding to measurement index under the target measurement cycle.
As shown in figure 5, the value of each measurement index is arranged according to measurement period in data file.When same measurement period In, when multiple measurement objects are corresponding with a certain measurement index, the value of the measurement index is in the data file according to measuring sequence Arranged.
During using the value of the index structure shown in Fig. 5 and the measurement index 2 of data ff object name 1, first according to survey The first position information searching of figureofmerit 2 to the measurement index 2 value in the data file first starting reference position, ascend the throne Put 501.Then, the byte number according to corresponding to object name 1 shared by the value of second place information and measurement index, i.e. sequence Numbers 2 and byte number 2, obtain the offset of the position and the first starting reference position of the value of measurement index 2.Specifically, 2 × 2=4, I.e. offset is 4 bytes, and the first starting reference position is plus the survey that the offset of 4 bytes is exactly under target measurement cycle T 1 The actual location of the value of figureofmerit 2 in the data file.The device of processing data directly obtains target measurement week according to the position The value of T1 measurement index 2 under phase.
Example IV
The present embodiment provides a kind of method of processing data, and the executive agent of the present embodiment is the dress of another processing data Put, the device of the processing data can be specifically common PC or server etc..The device of the processing data can be with With monokaryon CPU(Central Processing Unit, central processing unit)Or multi-core CPU.
As shown in Figure 6A, it is schematic flow sheet according to the method for the processing data of the present embodiment.
Step 601, in default second concordance list, believed according to threeth position of the measurement object under the target measurement cycle Breath obtains the second start reference position of the value of the measurement index of measurement object in the data file.
In the built-in storage for the device that second concordance list can be located at processing data, the device of processing data can also be located at External memory in.Wherein, the second concordance list includes:3rd subitem unit and the 4th subitem unit, the 3rd subitem unit include: Each measurement period, each measurement object, the 3rd positional information under the target measurement cycle and the measurement index in data file It is worth the byte number of the occupancy under each measurement period, the 4th subitem unit includes:Each measurement index and corresponding with measurement index 4th positional information.
More specifically, the 3rd subitem unit specifically includes:Each measurement period, each measurement pair arranged according to identification information Measurement in each 3rd positional information for being arranged as the sequencing according to measurement period of, measurement object, data file Refer to the byte number of occupancy of the target value under each measurement period, or the 3rd subitem unit specifically includes:It is each measurement period, each Threeth position letter of each measurement object, measurement object arranged under measurement period according to identification information under each measurement period The byte number of occupancy of the value of measurement index in breath and data file under each measurement period;4th subitem unit specifically wraps Include:According to string length is ascending or the descending each measurement index arranged, the corresponding with measurement index the 4th Positional information.
Data file is normally in external memory because the space shared by it is larger.Data file includes each survey The value of figureofmerit.The the first starting reference position of the value of measurement index in the data file is a reference position, passes through the reference Position can get the position of the value of measurement index.
Measurement object can include cell, RNC(Radio Network Controller, radio network controller)Deng, The measurement index of measurement object can be successfully established number including RRC connection number of attempt, RRC, when measurement index is RRC's When connecting number of attempt, the value of measurement index refers to the value of RRC number of attempt, when measurement index is that RRC is successfully established time During number, the value of measurement index refers to that RRC is successfully established the value of number.
Step 602, the word taken in the data file according to the value of the 4th positional information of measurement index and measurement index Position offset, position offset are the values of measurement index in data file to the value of joint number acquisition measurement index in the data file In position and the second start reference position offset.
Step 603, according to the second start reference position and position offset, obtain in the data file in target measurement week The value of measurement index under phase.
The second concordance list in the present embodiment is different from the first concordance list in embodiment one.Specifically, as shown in Figure 6B, For an instantiation schematic diagram of the second concordance list.The 3rd positional information corresponding to measurement object is used to indicate in second concordance list The the second start reference position of the value of measurement index in the data file, the 4th location index corresponding to measurement index are used to indicate Position offset.
Alternatively, second concordance list of the present embodiment is additionally included under the target measurement cycle measurement pair corresponding to measurement index The number of elephant, as shown in Figure 6B.So, the measurement index of measurement object is being obtained according to the 3rd positional information of measurement object Before the second start reference position of value in the data file, in addition to:
Judged to whether there is the value of measurement index in data file according to the number of measurement object and arrangement sequence number, work as judgement As a result it is when being, to perform the value according to the second place acquisition of information measurement index of the measurement index of measurement object in data file In the second start reference position the step of.
Wherein, the value of the byte number shared by the number of position offset=measurement object+arrangement sequence number × measurement index exists Shared byte number in data file.
The specific value for how searching measurement index in the data file by second concordance list of the present embodiment, with embodiment One is similar to embodiment three, will not be repeated here.
, can be in the data file to institute by setting the second concordance list according to the method for the processing data of the present embodiment The value for the measurement index to be obtained carries out fast positioning, so as to reach the purpose of the value of quick obtaining measurement index.
One of ordinary skill in the art will appreciate that:Realizing all or part of step of above method embodiment can pass through Programmed instruction related hardware is completed, and foregoing program can be stored in a computer read/write memory medium, the program Upon execution, the step of execution includes above method embodiment;And foregoing storage medium includes:ROM, RAM, magnetic disc or light Disk etc. is various can be with the medium of store program codes.
Embodiment five
The present embodiment provides a kind of device of processing data, the method for the processing data for performing embodiment one.Body can To be common PC or server etc..The device of the processing data can have monokaryon CPU(Central Processing Unit, central processing unit)Or multi-core CPU.
As shown in fig. 7, the structural representation of the device for the processing data according to the present embodiment.The device of the processing data Position offset unit 702 and second acquisition unit 703 are obtained including first acquisition unit 701, first.
Wherein, first acquisition unit 701 is used in default first concordance list, is existed according to the measurement index of measurement object The the first starting reference position of the value of first position acquisition of information measurement index under the target measurement cycle in the data file, the One concordance list includes:First subitem unit and the second subitem unit, the first subitem unit include:Each measurement period, each measurement refer to The value of mark, first position information of the measurement index under each measurement period and the measurement index in data file is in each measurement period Under occupancy byte number, the second subitem unit includes:Each measurement object and the second place corresponding with measurement object information;The One, which obtains position offset unit 702, is used for according to the second place information of measurement object and the value of measurement index in data file Position offset, position offset are the values of measurement index to the value of the byte number acquisition measurement index of middle occupancy in the data file The offset of position in the data file and the first starting reference position;Second acquisition unit 703 is used to obtain according to first The first starting reference position and first acquired in unit 701 obtain the position offset acquired in position offset unit 702, The value of the measurement index under the target measurement cycle is obtained in the data file.
Wherein, the first subitem unit specifically includes:Each measurement period, each measurement index according to identification information arrangement, survey Each first position information that the sequencing according to measurement period of figureofmerit is arranged, the measurement index in data file It is worth the byte number of the occupancy under each measurement period, or the first subitem unit specifically includes:Each measurement period, each measurement week First position information sum of each measurement index, measurement index arranged under phase according to identification information under each measurement period According to the byte number of occupancy of the value of the measurement index in file under each measurement period;Second subitem unit specifically includes:According to String length is ascending or the descending each measurement object arranged, second confidence corresponding with measurement object Breath.
The concrete operation method of the device of the processing data is consistent with embodiment one, will not be repeated here.
, can be in the data file to institute by inquiring about the first concordance list according to the device of the processing data of the present embodiment The value for the measurement index to be obtained carries out fast positioning, so as to reach the purpose of the value of quick obtaining measurement index.
Embodiment six
The present embodiment does further supplementary notes to the device of the processing data of embodiment five.
In the present embodiment, the first acquisition position offset unit 702 is specifically used for:
The arrangement sequence number and the value of measurement index generated according to the measuring sequence of measurement object is shared in the data file Byte number, obtain and state the value of measurement index position offset in the data file, the value of each measurement index is in data file In shared byte number it is identical.
Alternatively, as shown in figure 8, the device of the processing data of the present embodiment also includes the first judging unit 801, this first Judging unit 801 is used to be judged according to the number of measurement object corresponding to measurement index under the target measurement cycle and arrangement sequence number It whether there is the value of measurement index in data file, when judged result when being, to trigger first acquisition unit 701, wherein, measurement The number of object is located in the first concordance list.
Alternatively, the device of the processing data of the present embodiment also includes memory cell 802, the 3rd acquiring unit 803 and life Into unit 804.Wherein, memory cell 802 is used in default cycle time section, and the value of the measurement index got is stored In built-in storage;The value that 3rd acquiring unit 803 is used to obtain each measurement index accessed by memory cell 802 needs to take Byte in maximum byte;Generation unit 804 is used for the maximum byte according to accessed by the 3rd acquiring unit 803, will survey The value of figureofmerit is stored into the data file of external memory, and generates the first concordance list.
More specifically, the generation unit 804 in the present embodiment can include storing sub-units and generation subelement(In figure It is not shown).Wherein, storing sub-units are used for the value of each measurement index according to the data of maximum byte storage to external memory In file;Subelement is generated to be used to generate the first concordance list.
More specifically, storing sub-units are specifically used for:
In measurement index the data file to external memory will be stored except being worth according to maximum byte for 0 measurement index In.
The concrete operation method of the device of the processing data of the present embodiment is consistent with embodiment two, will not be repeated here.
The device of the processing data of the present embodiment is in data storage, first in cycle time section, the number that will get According to being stored temporarily in memory storage, then when reaching the end point of cycle time, the maximum byte that need to be taken according to data will All data are disposably stored into outer storage, can not only so be avoided often obtaining a data in the prior art and are just stored I/O operation is frequent caused by into external memory, and the required maximum byte taken by dynamically obtaining each data, can Enough ensure the memory space of data, and can enough reaches the purpose for reducing data space-consuming.So, the processing data of the present embodiment Device using above-mentioned storage mode storage data file in inquire about measurement index value when, pass through the index previously generated Table obtains the storage location of the value of measurement index in the data file, refers to target value so as to obtain storage, can reach and quickly obtain Take the purpose of the value of measurement index.
Embodiment seven
The present embodiment provides a kind of device of processing data, the method for the processing data for performing example IV.
As shown in figure 9, the structural representation of the device for the processing data according to the present embodiment.The device of the processing data Position offset unit 902 and the 5th acquiring unit 903 are obtained including the 4th acquiring unit 901, second.
Wherein, the 4th acquiring unit 901 is used in default second concordance list, according to measurement object in target measurement week The 3rd positional information under phase obtains the second start reference position of the value of the measurement index of measurement object in the data file, the Two concordance lists include:3rd subitem unit and the 4th subitem unit, the 3rd subitem unit include:Each measurement period, each measurement pair As value the accounting under each measurement period of, measurement index in the 3rd positional information and data file under the target measurement cycle Byte number, the 4th subitem unit include:Each measurement index and the 4th positional information corresponding with measurement index;Second obtains Position offset unit 902 is used to be taken in the data file according to the 4th positional information of measurement index and the value of measurement index Byte number obtain measurement index value position offset, position offset are the values of measurement index in data in the data file The offset of position and the second start reference position in file;5th acquiring unit 903 is used for according to the 4th acquiring unit 901 Position offset acquired in the second acquired start reference position and the second acquisition position offset unit 902, in data The value of the measurement index under the target measurement cycle is obtained in file.
Wherein, the 3rd subitem unit specifically includes:Each measurement period, each measurement object according to identification information arrangement, survey Each 3rd positional information that the sequencing according to measurement period of amount object is arranged, measurement index in data file It is worth the byte number of the occupancy under each measurement period, or the 3rd subitem unit specifically includes:Each measurement period, each measurement week Threeth positional information sum of each measurement object, measurement object arranged under phase according to identification information under each measurement period According to the byte number of occupancy of the value of the measurement index in file under each measurement period;4th subitem unit specifically includes:According to String length is ascending or the descending each measurement index arranged, the 4th position corresponding with measurement index letter Breath.
Alternatively, as shown in Figure 10, the device of the processing data of the present embodiment also includes the second judging unit 1001, and this Two judging units 1001 are used for according to the number of measurement object corresponding to measurement index under the target measurement cycle and arrangement sequence number Judge, when judged result when being, to trigger the 4th acquiring unit 901, to measure with the presence or absence of the value of measurement index in data file The number of object is located in the second concordance list.
Wherein, the value of the byte number shared by the number of position offset=measurement object+arrangement sequence number × measurement index exists Shared byte number in data file.
The concrete operation method of the device of the processing data of the present embodiment is consistent with example IV, will not be repeated here.
, can be in the data file to institute by inquiring about the second concordance list according to the device of the processing data of the present embodiment The value for the measurement index to be obtained carries out fast positioning, so as to reach the purpose of the value of quick obtaining measurement index.
Embodiment eight
The present embodiment provides the device of another processing data, for performing embodiment one to the processing data of embodiment three Method.
As shown in figure 11, it is structural representation according to the device of the processing data of the present embodiment.The dress of the processing data Putting 1100 includes at least one first processor 1101, the first communication bus 1102, first memory 1103 and at least one First communication interface 1104.
Wherein, the first communication bus 1102 is used to realize connection and the communication between said modules, the first communication interface 1104 are used to be connected and communicate with the network equipment.The bus can be ISA(Industry Standard Architecture, Industry standard architecture)Bus, PCI(Peripheral Component, external equipment interconnection)Bus or EISA (Extended Industry Standard Architecture, extended industry-standard architecture)Bus etc..Bus can be with It is one or more physical circuit, address bus, data/address bus, controlling bus etc. can be divided into when being a plurality of physical circuit.
Wherein, first memory 1103 is used to store executable program code, wherein, first processor 1101 passes through reading The executable program code stored in first memory 1103 runs program corresponding with executable program code, for:
In default first concordance list, according to first position of the measurement index of measurement object under the target measurement cycle The the first starting reference position of the value of acquisition of information measurement index in the data file;
The byte number taken in the data file according to the value of the second place information of measurement object and measurement index obtains Position offset, position offset are the position of the value of measurement index in the data file to the value of measurement index in the data file With the offset of the first starting reference position;
According to the first starting reference position and position offset, the survey under the target measurement cycle is obtained in the data file The value of figureofmerit;
Wherein, the first concordance list includes:First subitem unit and the second subitem unit, the first subitem unit include:It is each to survey Measure the measurement index in the first position information and data file of cycle, each measurement index, measurement index under each measurement period Occupancy of the value under each measurement period byte number, the second subitem unit includes:Each measurement object and corresponding with measurement object Second place information.
More specifically, the first subitem unit specifically includes:Each measurement period, each measurement arranged according to identification information refer to Mark, the measurement in each first position information that the sequencing according to measurement period of measurement index is arranged, data file Refer to the byte number of occupancy of the target value under each measurement period, or the first subitem unit specifically includes:It is each measurement period, each First position letter of each measurement index, measurement index arranged under measurement period according to identification information under each measurement period The byte number of occupancy of the value of measurement index in breath and data file under each measurement period;
Second subitem unit specifically includes:According to string length is ascending or the descending each measurement arranged Object, the second place corresponding with measurement object information.
Alternatively, wherein, the executable program generation that first processor 1101 is stored by reading in first memory 1103 Code runs program corresponding with executable program code, for the second place information and measurement index according to measurement object The byte number that takes in the data file of value obtain the value of measurement index in the data file position offset when, specifically can be with It is:
The arrangement sequence number and the value of measurement index generated according to the measuring sequence of measurement object is shared in the data file Byte number, obtain and state the value of measurement index position offset in the data file, the value of each measurement index is in data file In shared byte number it is identical.
Alternatively, the first concordance list is additionally included in the number of measurement object corresponding to measurement index under the target measurement cycle, Wherein, run in first processor 1101 by reading the executable program code stored in first memory 1103 with that can hold Program corresponding to line program code, for first position letter of the measurement index according to measurement object under the target measurement cycle Before breath obtains the first starting reference position of the value of measurement index in the data file, first processor 1101 can also pass through The executable program code that stores is read in first memory 1103 to run program corresponding with executable program code, with In:
Judged to whether there is the value of measurement index in data file according to the number of measurement object and arrangement sequence number, work as judgement As a result it is when being, to perform and referred to according to first position acquisition of information measurement of the measurement index of measurement object under the target measurement cycle Target value in the data file first starting reference position the step of.
Wherein, the value of the byte number shared by the number of position offset=measurement object+arrangement sequence number × measurement index exists Shared byte number in data file.
Alternatively, first processor 1101 by read the executable program code stored in first memory 1103 come Operation program corresponding with executable program code, for the measurement index according to measurement object under the target measurement cycle Before the first starting reference position of the value of first position acquisition of information measurement index in the data file, first processor 1101 Can also be corresponding with executable program code to run by reading the executable program code stored in first memory 1103 Program, for:
In default cycle time section, the value of the measurement index got is stored in built-in storage;
Obtain the maximum byte in the byte that the value of each measurement index need to take;
According to maximum byte, the value of measurement index is stored into the data file of external memory, and generates the first index Table.
Alternatively, first processor 1101 is transported by reading the executable program code stored in first memory 1103 Row program corresponding with executable program code, for according to maximum byte, the value storage of measurement index is arrived into external memory Data file in, can be specifically:
The value of each measurement index is stored into the data file of external memory according to maximum byte.
Alternatively, first processor 1101 is transported by reading the executable program code stored in first memory 1103 Row program corresponding with executable program code, for the value of each measurement index is arrived into outer storage according to maximum byte storage In the data file of device, can be specifically:
In measurement index the data file to external memory will be stored except being worth according to maximum byte for 0 measurement index In.The concrete operation method of the device 1100 of the processing data of the present embodiment and embodiment one or embodiment two or embodiment 31 Cause, will not be repeated here.
The device 1100 of the processing data of the present embodiment, can be in the data file to wanting by searching the first concordance list The value of the measurement index of acquisition carries out fast positioning, so as to reach the purpose of the value of quick obtaining measurement index.
Embodiment nine
The present embodiment provides the device of another processing data, the method for the processing data for performing example IV.
As shown in figure 12, it is structural representation according to the device of the processing data of the present embodiment.The dress of the processing data Putting 1200 includes at least one second processor 1201, the second communication bus 1202, second memory 1203 and at least one Second communication interface 1204.
Wherein, the second communication bus 1202 is used to realize connection and the communication between said modules, the second communication interface 1204 are used to be connected and communicate with the network equipment.The bus can be ISA(Industry Standard Architecture, Industry standard architecture)Bus, PCI(Peripheral Component, external equipment interconnection)Bus or EISA (Extended Industry Standard Architecture, extended industry-standard architecture)Bus etc..Bus can be with It is one or more physical circuit, address bus, data/address bus, controlling bus etc. can be divided into when being a plurality of physical circuit.
Wherein, second memory 1203 is used to store executable program code, wherein, second processor 1201 passes through reading The executable program code stored in second memory 1203 runs program corresponding with executable program code, for:
In default second concordance list, obtained and surveyed according to the 3rd positional information of the measurement object under the target measurement cycle Measure the second start reference position of the value of the measurement index of object in the data file;
The byte number taken in the data file according to the value of the 4th positional information of measurement index and measurement index obtains Position offset, position offset are the position of the value of measurement index in the data file to the value of measurement index in the data file With the offset of the second start reference position;
According to the second start reference position and position offset, the survey under the target measurement cycle is obtained in the data file The value of figureofmerit;
Wherein, the second concordance list includes:3rd subitem unit and the 4th subitem unit, the 3rd subitem unit include:It is each to survey The value for measuring cycle, each measurement object, the 3rd positional information under the target measurement cycle and the measurement index in data file exists The byte number of occupancy under each measurement period, the 4th subitem unit include:Each measurement index and the corresponding with measurement index the 4th Positional information.
Wherein, the 3rd subitem unit specifically includes:Each measurement period, each measurement object according to identification information arrangement, survey Each 3rd positional information that the sequencing according to measurement period of amount object is arranged, measurement index in data file It is worth the byte number of the occupancy under each measurement period, or the 3rd subitem unit specifically includes:Each measurement period, each measurement week Threeth positional information sum of each measurement object, measurement object arranged under phase according to identification information under each measurement period According to the byte number of occupancy of the value of the measurement index in file under each measurement period;4th subitem unit specifically includes:According to String length is ascending or the descending each measurement index arranged, the 4th position corresponding with measurement index letter Breath.
Alternatively, the second concordance list also includes:The number of measurement object corresponding to measurement index under the target measurement cycle; Run and executable journey in second processor 1201 by reading the executable program code stored in second memory 1203 Program corresponding to sequence code, exist for obtaining the value of the measurement index of measurement object according to the 3rd positional information of measurement object , can also be by reading the executable journey stored in second memory 1203 before the second start reference position in data file Sequence code runs program corresponding with executable program code, for:
Judged to whether there is the value of measurement index in data file according to the number of measurement object and arrangement sequence number, work as judgement As a result it is when being, to perform the value according to the second place acquisition of information measurement index of the measurement index of measurement object in data file In the second start reference position the step of.
Wherein, the value of the byte number shared by the number of position offset=measurement object+arrangement sequence number × measurement index exists Shared byte number in data file.
, can be in the data file by inquiring about the second concordance list according to the device 1200 of the processing data of the present embodiment Fast positioning is carried out to the value for the measurement index to be obtained, so as to reach the purpose of the value of quick obtaining measurement index.
Finally it should be noted that:The above embodiments are merely illustrative of the technical solutions of the present invention, rather than its limitations;Although The present invention is described in detail with reference to the foregoing embodiments, it will be understood by those within the art that:It still may be used To be modified to the technical scheme described in foregoing embodiments, or equivalent substitution is carried out to which part technical characteristic; And these modifications or replacement, the essence of appropriate technical solution is departed from the scope of various embodiments of the present invention technical scheme.

Claims (20)

  1. A kind of 1. method of processing data, it is characterised in that including:
    In default first concordance list, believed according to first position of the measurement index of measurement object under the target measurement cycle Breath, obtain the first starting reference position of the value of the measurement index in the data file;
    The word taken according to the value of the second place information of the measurement object and the measurement index in the data file The value of joint number acquisition measurement index position offset in the data file, the position offset are that the measurement refers to The offset of position of the target value in the data file and the described first starting reference position;
    According to the described first starting reference position and the position offset, obtain in the data file and surveyed in the target Measure the value of the measurement index under the cycle;
    Wherein, first concordance list includes:First subitem unit and the second subitem unit, the first subitem unit include: The first position information and the data file of each measurement period, each measurement index, the measurement index under each measurement period In measurement index occupancy of the value under each measurement period byte number, the second subitem unit includes:Each measurement object The corresponding second place information with the measurement object.
  2. 2. the method for processing data according to claim 1, it is characterised in that the first subitem unit specifically includes: Each measurement period, each measurement index according to identification information arrangement, the priority according to the measurement period of the measurement index The occupancy of each first position information that order is arranged, the value of the measurement index in the data file under each measurement period Byte number, or the first subitem unit specifically includes:Enter under each measurement period, each measurement period according to identification information In first position information and the data file of each measurement index, the measurement index of row arrangement under each measurement period The byte number of occupancy of the value of measurement index under each measurement period;
    The second subitem unit specifically includes:According to string length is ascending or the descending each measurement arranged Object, the second place corresponding with measurement object information.
  3. 3. the method for processing data according to claim 1, it is characterised in that according to the second place of the measurement object The byte number that the value of information and the measurement index takes in the data file obtains the value of the measurement index described Position offset includes in data file:
    The arrangement sequence number and the value of the measurement index generated according to the measuring sequence of the measurement object is in data text Shared byte number, obtains value position offset, each measurement in the data file of the measurement index in part It is identical to refer to target value byte number shared in the data file.
  4. 4. the method for processing data according to claim 3, it is characterised in that first concordance list also includes:Institute State the number of measurement object corresponding to the measurement index under the target measurement cycle;
    Refer to being measured described in first position acquisition of information of the measurement index according to measurement object under the target measurement cycle Before the first starting reference position of target value in the data file, in addition to:
    Judge with the presence or absence of the measurement to refer in the data file according to the number of the measurement object and the arrangement sequence number Target value, when judged result for be when, perform according to the measurement index of measurement object under the target measurement cycle first Positional information obtains the step of the first starting reference position of the value of the measurement index in the data file.
  5. 5. the method for processing data according to claim 4, it is characterised in that the position offset=measurement object The value of byte number+arrangement sequence number × measurement index shared by number byte number shared in the data file.
  6. 6. according to the method for processing data according to any one of claims 1 to 5, it is characterised in that according to measurement object First position acquisition of information of the measurement index under the target measurement cycle described in measurement index value in the data file Before one starting reference position, in addition to:
    In default cycle time section, the value of the measurement index got is stored in built-in storage;
    Obtain the maximum byte in the byte that the value of each measurement index need to take;
    According to the maximum byte, the value of the measurement index is stored into the data file of external memory, and described in generation First concordance list.
  7. 7. the method for processing data according to claim 6, it is characterised in that it is described according to the maximum byte, by institute The value for stating measurement index is stored into the data file of external memory, including:
    The value of each measurement index is stored into the data file of the external memory according to maximum byte.
  8. 8. the method for processing data according to claim 7, it is characterised in that the value by the measurement index is pressed Being stored according to maximum byte to the external memory includes:
    In the measurement index the data to the external memory will be stored except being worth according to maximum byte for 0 measurement index In file.
  9. A kind of 9. method of processing data, it is characterised in that including:
    In default second concordance list, the survey is obtained according to threeth positional information of the measurement object under the target measurement cycle Measure the second start reference position of the value of the measurement index of object in the data file;
    The word taken according to the value of the 4th positional information of the measurement index and the measurement index in the data file The value of joint number acquisition measurement index position offset in the data file, the position offset are that the measurement refers to The offset of position of the target value in the data file and the second start reference position;
    According to the second start reference position and the position offset, obtain in the data file and surveyed in the target Measure the value of the measurement index under the cycle;
    Wherein, second concordance list includes:3rd subitem unit and the 4th subitem unit, the 3rd subitem unit include: Each measurement period, each measurement object, the 3rd positional information under the target measurement cycle and the measurement index in data file It is worth the byte number of the occupancy under each measurement period, the 4th subitem unit includes:Each measurement index and with it is described measurement refer to 4th positional information corresponding to mark.
  10. 10. the method for processing data according to claim 9, it is characterised in that the 3rd subitem unit specifically includes: Each measurement period, each measurement object according to identification information arrangement, the priority according to the measurement period of the measurement object The occupancy of each 3rd positional information that order is arranged, the value of the measurement index in the data file under each measurement period Byte number, or the 3rd subitem unit specifically includes:Enter under each measurement period, each measurement period according to identification information In the 3rd positional information and the data file of each measurement object, the measurement object of row arrangement under each measurement period The byte number of occupancy of the value of measurement index under each measurement period;
    The 4th subitem unit specifically includes:According to string length is ascending or the descending each measurement arranged Index, the 4th positional information corresponding with the measurement index.
  11. 11. the method for the processing data according to claim 9 or 10, it is characterised in that second concordance list also includes: The number of measurement object corresponding to the measurement index under the target measurement cycle;
    Refer in the measurement that the 3rd positional information according to measurement object under the target measurement cycle obtains the measurement object Before the second start reference position of target value in the data file, in addition to:
    Judged to whether there is the value of the measurement index in the data file according to the number of measurement object and arrangement sequence number, when Judged result is when being, the value for performing measurement index described in the second place acquisition of information of the measurement index according to measurement object exists The step of the second start reference position in data file;Wherein, the arrangement sequence number is the measurement according to the measurement object It is sequentially generated.
  12. 12. the method for processing data according to claim 11, it is characterised in that the position offset=measurement object Number shared by byte number+arrangement sequence number × measurement index value byte number shared in the data file.
  13. A kind of 13. device of processing data, it is characterised in that including:
    First acquisition unit, in default first concordance list, according to the measurement index of measurement object in target measurement week The the first starting reference position of the value of measurement index described in first position acquisition of information under phase in the data file, described first Concordance list includes:First subitem unit and the second subitem unit, the first subitem unit include:Each measurement period, each measurement The value of index, first position information of the measurement index under each measurement period and the measurement index in the data file exists The byte number of occupancy under each measurement period, the second subitem unit include:Each measurement object and with the measurement object pair The second place information answered;
    First obtains position offset unit, for the second place information according to the measurement object and the measurement index The value for the byte number acquisition measurement index that value takes in data file position offset in the data file, The position offset is position of the value of the measurement index in the data file and the described first starting reference position Offset;
    Second acquisition unit, for originating reference position and the position offset according to described first, in the data file The value of the measurement index of the middle acquisition under the target measurement cycle.
  14. 14. the device of processing data according to claim 13, it is characterised in that described first obtains position offset list Member is specifically used for:
    The arrangement sequence number and the value of the measurement index generated according to the measuring sequence of the measurement object is in data text Shared byte number, obtains value position offset, each measurement in the data file of the measurement index in part It is identical to refer to target value byte number shared in the data file.
  15. 15. the device of processing data according to claim 14, it is characterised in that also include:
    First judging unit, for the number according to the measurement object corresponding to the measurement index under the target measurement cycle Judge to whether there is the value of the measurement index in the data file with the arrangement sequence number, when judged result is to be, touch Send out first acquisition unit described, the number of the measurement object is located in first concordance list.
  16. 16. the device of the processing data according to any one of claim 13~15, it is characterised in that also include:
    Memory cell, in default cycle time section, the value of the measurement index got to be stored in built-in storage;
    3rd acquiring unit, the maximum byte in the byte that the value for obtaining each measurement index need to take;
    Generation unit, for according to the maximum byte, the value storage of the measurement index to be arrived into the data file of external memory In, and generate first concordance list.
  17. 17. the device of processing data according to claim 16, it is characterised in that the generation unit includes:
    Storing sub-units, for the value of each measurement index to be arrived to the data of the external memory according to maximum byte storage In file;
    Subelement is generated, for generating first concordance list.
  18. 18. the device of processing data according to claim 17, it is characterised in that the storing sub-units are specifically used for:
    In the measurement index the data to the external memory will be stored except being worth according to maximum byte for 0 measurement index In file.
  19. A kind of 19. device of processing data, it is characterised in that including:
    4th acquiring unit, in default second concordance list, according to measurement object under the target measurement cycle the 3rd The the second start reference position of the value of the measurement index of the positional information acquisition measurement object in the data file, described second Concordance list includes:3rd subitem unit and the 4th subitem unit, the 3rd subitem unit include:Each measurement period, each measurement The value of object, the 3rd positional information under the target measurement cycle and the measurement index in data file is under each measurement period The byte number of occupancy, the 4th subitem unit include:Each measurement index and the 4th position corresponding with measurement index letter Breath;
    Second obtains position offset unit, for the 4th positional information according to the measurement index and the measurement index The value for the byte number acquisition measurement index that value takes in data file position offset in the data file, The position offset is position of the value of the measurement index in the data file and the second start reference position Offset;
    5th acquiring unit, for according to the second start reference position and the position offset, in the data file The value of the measurement index of the middle acquisition under the target measurement cycle.
  20. 20. the device of processing data according to claim 19, it is characterised in that also include:
    Second judging unit, for the number according to the measurement object corresponding to the measurement index under the target measurement cycle Judge to whether there is the value of the measurement index in the data file with arrangement sequence number, when judged result is to be, trigger institute The 4th acquiring unit is stated, the number of the measurement object is located in second concordance list;Wherein, the arrangement sequence number is basis The measuring sequence generation of the measurement object.
CN201310097049.9A 2013-03-25 2013-03-25 The method and apparatus of processing data Active CN104077282B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201310097049.9A CN104077282B (en) 2013-03-25 2013-03-25 The method and apparatus of processing data

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201310097049.9A CN104077282B (en) 2013-03-25 2013-03-25 The method and apparatus of processing data

Publications (2)

Publication Number Publication Date
CN104077282A CN104077282A (en) 2014-10-01
CN104077282B true CN104077282B (en) 2018-02-06

Family

ID=51598542

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201310097049.9A Active CN104077282B (en) 2013-03-25 2013-03-25 The method and apparatus of processing data

Country Status (1)

Country Link
CN (1) CN104077282B (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106681995B (en) * 2015-11-05 2020-08-18 菜鸟智能物流控股有限公司 Data caching method, data query method and device
CN109936427B (en) * 2017-12-15 2021-05-11 电信科学技术研究院 Communication method, device and terminal equipment
CN109358809B (en) * 2018-09-28 2020-07-24 方一信息科技(上海)有限公司 RAID data storage system and method

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1399742A (en) * 1999-06-30 2003-02-26 倾向探测公司 Method and apparatus for monitoring traffic in network
CN101291508A (en) * 2008-06-10 2008-10-22 重庆重邮信科(集团)股份有限公司 Storing and invoking method for drive test data of mobile communication system
CN101459918A (en) * 2007-12-11 2009-06-17 中兴通讯股份有限公司 Distributed performance data management implementation method for base station controller
CN102025546A (en) * 2010-12-16 2011-04-20 大唐移动通信设备有限公司 Method and equipment for generating, transmitting and reading network equipment performance files

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1399742A (en) * 1999-06-30 2003-02-26 倾向探测公司 Method and apparatus for monitoring traffic in network
CN101459918A (en) * 2007-12-11 2009-06-17 中兴通讯股份有限公司 Distributed performance data management implementation method for base station controller
CN101291508A (en) * 2008-06-10 2008-10-22 重庆重邮信科(集团)股份有限公司 Storing and invoking method for drive test data of mobile communication system
CN102025546A (en) * 2010-12-16 2011-04-20 大唐移动通信设备有限公司 Method and equipment for generating, transmitting and reading network equipment performance files

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
中国移动话务网管四期资源子系统汇总功能的设计及实现;丛联义;《中国优秀硕士学位论文全文数据库 信息科技辑》;20110315;第2011年卷(第03期);全文 *

Also Published As

Publication number Publication date
CN104077282A (en) 2014-10-01

Similar Documents

Publication Publication Date Title
JP6716727B2 (en) Streaming data distributed processing method and apparatus
CN111767143A (en) Transaction data processing method, device, equipment and system
CN107368527B (en) Multi-attribute index method based on data stream
US9852180B2 (en) Systems and methods of accessing distributed data
CN106708956B (en) A kind of HTTP data matching method based on more URL rule sets
CN106407201A (en) Data processing method and apparatus
CN110309336A (en) Image search method, device, system, server and storage medium
CN105515997B (en) The higher efficiency range matching process of zero scope expansion is realized based on BF_TCAM
CN107766529A (en) A kind of mass data storage means for sewage treatment industry
CN104077282B (en) The method and apparatus of processing data
CN112148217B (en) Method, device and medium for caching deduplication metadata of full flash memory system
CN108763536A (en) Data bank access method and device
CN114327857A (en) Operation data processing method and device, computer equipment and storage medium
CN104636368A (en) Data retrieval method and device and server
CN109377383A (en) Product data synchronous method, device, computer equipment and storage medium
CN101022370A (en) Automatic clustering method for multi-particle size network under G bit flow rate
US10303687B2 (en) Concurrent processing of data sources
CN107463578B (en) Application download amount statistical data deduplication method and device and terminal equipment
US20090171651A1 (en) Sdram-based tcam emulator for implementing multiway branch capabilities in an xml processor
CN107330031A (en) A kind of method of data storage, device and electronic equipment
CN107643906A (en) Data processing method and device
CN110221778A (en) Processing method, system, storage medium and the electronic equipment of hotel&#39;s data
CN116049180A (en) Tenant data processing method and device for Paas platform
US20230138113A1 (en) System for retrieval of large datasets in cloud environments
CN115269654A (en) Data cache supplementing method, device, equipment and medium

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant