CN1553375A - Collecting and processing method for apparatus performance accounting data - Google Patents
Collecting and processing method for apparatus performance accounting data Download PDFInfo
- Publication number
- CN1553375A CN1553375A CNA031380875A CN03138087A CN1553375A CN 1553375 A CN1553375 A CN 1553375A CN A031380875 A CNA031380875 A CN A031380875A CN 03138087 A CN03138087 A CN 03138087A CN 1553375 A CN1553375 A CN 1553375A
- Authority
- CN
- China
- Prior art keywords
- data
- raw data
- state
- collection
- opening flag
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Landscapes
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
In the present invention, start up marks for two states are set; start up mark state is judged first, original data is not refreshed if it is 'closed' state; otherwise current data is refreshed into buffer area D; counting up period is started and start up mark of original data is set at 'turn on' state; original data buffer area D is fetched as per sampling interval t to obtain original data current value a (k) at k time of sampling point for forming data item set A; start up mark of originaldata is setat 'closed' state after counting up period is over; obtained data item set A is processed according to method or different type of data and data processing flow is finished.
Description
Technical field
The invention belongs to technical field of data processing, particularly the data statistical approach of equipment performance aspect.
Background technology
Performance statistics (PERF:Performance) technology is a certain fixedly period of initialization system, is captured in the data of some the equipment performance aspect in this period.By these data of statistical study, but the operation conditions of each equipment in the supervisory system.The minimum time section that produces the performance statistics result is called a performance measurement period, obtains a performance statistics by the multinomial data of acquisition process.
Data item generally can be divided into discharge pattern according to its processing mode, the maximal value measurement type, the minimum value measurement type, the average measurement type, flow maximal value measurement type and the time long type.Discharge pattern is the increment of data during with respect to beginning when calculating one-period and finishing; The maximal value measurement type is the maximal value that obtains a plurality of sampled point raw data in the one-period; The minimum value measurement type is the minimum value that obtains a plurality of sampled point raw data in the one-period; The average measurement type is the mean value that obtains a plurality of sampled point raw data in the one-period; Flow maximal value measurement type is the maximal value that obtains flow increment in the neighbouring sample interval; The time long type mainly obtain in one-period state value in each sampled point, and will be worth statistical value as the sampled point number of required state.According to the monitoring needs of concrete equipment, the processing mode of data item can also define some other private type.
The collection of equipment performance statistics and disposal route are mainly finished the collection of raw data associated, the processing of data item, and the result data after will handling at last offers the user.The collection of general performance statistics and disposal route can be divided into the collection of raw data, processing two parts of data item.The collection of raw data reflects the operation conditions of each equipment in real time; The processing of data item is in the cycle of performance statistics, and according to the raw data of gathering, sampling obtains data item, handles respectively according to the good processing mode of each data item predefined then, finally obtains needed result data.
The collection of existing a kind of equipment performance statistics and disposal route comprise as shown in Figure 1: set up a buffer zone that is used to preserve data item, a plurality of counters are set in this buffer zone, the currency of the corresponding raw data of each counter; Detailed process comprises the collection of raw data of separate operation and processing two parts of data item; Wherein:
The collection of raw data may further comprise the steps:
1) addressing: be meant from cushioning the zone and find the counter of certain data item of reflection, thereby obtain the pairing counter address of data item of concrete configuration;
2) data are preserved: after obtaining counter address, corresponding raw data is put into this counter;
3) Data Update: when raw data changed, repeating step 1 was with the raw data of new raw data replacement preservation last time;
The processing of data item may further comprise the steps:
1) the performance statistics period T of initialization system equipment and sampling interval t comprise n sampled point, n=T/t in each cycle;
2) in a statistic period T, read raw data buffer zone D according to sampling interval t, obtain sampled point k raw data currency a (k) constantly as data item; In this cycle, all data item that will obtain from raw data buffer zone D form collection of data items A={a (0), a (1) ... a (n-1) };
3) after measurement period finishes, according to the disposal route of different types of data item, the collection of data items A that is obtained is handled, for example processing mode is the maximizing type, and the maximal value of promptly getting each data item in the set A is final result data; The processing mode of other data item types no longer repeats as previously mentioned.
Measurement data item with discharge pattern is that example illustrates above-mentioned data item treatment step 2 below) in the specific implementation method.
In a measurement period, need to obtain for twice the data of buffer zone, the data that obtain when promptly data that obtain during end cycle and cycle begin, step is as follows:
1, measurement period begins;
2, when satisfying: time==time of beginning in cycle, the cycle, read the counter buffer data, obtain a (0);
3, when satisfying: time==time of end cycle, end cycle reads the counter buffer data, obtains a (n), calculation result data F=a (n)-a (0).
4, measurement period finishes.
The collection of above-mentioned existing device performance statistic and disposal route are the collection of raw data and the separate operation of processing of data item.Adopt shared buffer, in order to preserve and to revise data.The least unit of each store data of shared buffer is called counter.Counter is finished exchanges data as intermediary.Data in the buffer zone are to accept modification passively, only need in these buffer areas, sample and just can obtain required collection of data items, because this buffer area is used for preserving current raw data, raw data changes at every turn, all need to be reflected in the buffer zone in real time, no matter whether carry out data sampling, all need to change counter at any time, keep the value of current raw data.Because configuration is more like the system class, every needed data item kind of configuration is also more, so the counter buffer zone that takies is bigger.
In sum, adopt this method, when raw data changes, all will these be changed synchronous reaction in the counter buffer zone, and no matter whether carrying out performance statistics, this counter is all wanted real-time update by counter.Raw data changes frequent, causes the counter frequent updating; In addition,, cause addressing slower,, be not suitable for the frequent situation of statistics variations so this method efficient is lower because the counter buffer area is bigger.
Summary of the invention
The objective of the invention is for solving prior art efficient lowlyer, be not suitable for the problem of the frequent raw data of statistics variations, propose a kind of collection and disposal route of new equipment performance statistics, have the efficient height, the characteristics of wide accommodation.
The collection and the disposal route of a kind of equipment performance statistics that the present invention proposes comprise the collection of raw data and two flow processs of processing of data item; It is characterized in that:
One opening flag with " closing " and " unlatching " two states is set;
Upgrading raw data when the collecting flowchart of described raw data is in " unlatching " state at opening flag becomes current raw data, does not upgrade raw data when being in " closing " state at opening flag;
The treatment scheme of described data item opening flag when measurement period begins is set to " unlatching " state, in measurement period, obtain raw data at that time, after measurement period finishes, the opening flag of raw data is changed to " closing " state, handles the raw data of being obtained and obtain the final data statistics.
The inventive method also can comprise a plurality of fixing raw data buffer zones are set, and the performance statistics period T of initialization system and sampling interval t comprise n sampled point in each cycle, n=T/t, and n rounds.
The collecting flowchart of described raw data specifically can may further comprise the steps:
When raw data changes, judge earlier the state of opening flag, if during " closing " state, raw data is not upgraded;
If opening flag is " unlatching " state, the raw data of upgrading in the raw data buffer zone becomes current raw data.
The treatment scheme of described data item specifically can may further comprise the steps:
1) measurement period begins, and opening flag is set to " unlatching " state, obtains current raw data simultaneously from described raw data buffer zone;
2) generate data item;
3) measurement period finishes;
4) described opening flag is set to " closing " state;
5) calculate the acquisition result data according to the disposal route of different types of data item.
The processing procedure of described generation data item can be: in a statistic period T, read current raw data according to sampling interval t from the raw data buffer zone, obtain sampled point k raw data currency a (k) constantly as data item; In this cycle, all data item that will obtain from the raw data buffer zone form collection of data items A={a (0), a (1) ... a (n-1) }.
Characteristics of the present invention are: fixing primary data cache district is set, has avoided data addressing process consuming time.Flow chart of data processing adopts opening flag, and the raw data acquisition flow process has enlarged the scope of the data item that can add up simultaneously for the taking of cpu resource when having avoided not carrying out performance statistic.
Description of drawings
Fig. 1 is the performance statistic collection and the disposal route overall procedure block diagram of prior art;
Fig. 2 is performance statistic collection of the present invention and disposal route overall procedure block diagram.
Embodiment
The collection and the disposal route embodiment of a kind of equipment performance statistics that the present invention proposes are described in detail as follows in conjunction with Fig. 2:
The present embodiment method comprises 3 raw data A of acquisition process, B, and the data item of C, the data item of raw data A are discharge pattern, and the data item of raw data B is the maximal value type, and the data item of raw data C is a flow maximal value type.Raw data A changed once in average 0.1 second, and raw data B changed once in average 0.2 second, and raw data C changed once in average 0.3 second, A, and B, the data item of C is uncorrelated.
Raw data A is set, B, the corresponding buffer zone D of C (a), D (b), D (c); One opening flag with " closing " and " unlatching " two states is set.The performance statistics period T of initialization system is that 1 minute and sampling interval t are 1 second, comprises n sampled point in each cycle, n=60;
The idiographic flow of present embodiment comprises the collection of raw data and processing two parts of data item, as shown in Figure 2; Wherein, the collecting flowchart of raw data specifically may further comprise the steps:
1) when raw data changes, judge earlier the state of opening flag, if during " closing " state, raw data is not upgraded;
2) if opening flag is " unlatching " state, real-time update buffer zone D (a), D (b), the raw data among the D (c) becomes the lonely raw data of current time.
The data item treatment scheme specifically may further comprise the steps:
1) measurement period begins, and opening flag is set to " unlatching " state, promptly starts opening flag; Read buffer zone D (a) simultaneously, D (b), the current data among the D (c), according to data A, B, the difference of the statistics type of C, record data items a (0), b (0), c (0);
2) generate data item: in 1 minute measurement period, obtain sampled point k raw data currency constantly;
For data item A, because discharge pattern only needs two values in one-period, so in 1 minute,, obtain sampled data A={a (0), a (59) during 59} } at k={0; For data item B, in 1 minute, need to obtain 60 sampled data B={b (0), b (1) ... b (59) }, and at k={0,1 ... ask Max (b)=Max{b (0) during 59}, b (1) ... b (59) }; For data item C, need to obtain 61 sampling numbers according to C={c (0), c (1) ..., c (60) and at k={1,2 ... 60 the time ask Max (c (k)-c (k-1))=Max{c (1)-c (0), c (2)-c (1) ... c (60)-c (59);
3) measurement period finishes,
4) opening flag of raw data is set to " closing " state, promptly closes and opens sign;
5) calculation result data: according to the disposal route of data item, the collection of data items that is obtained is handled, for A, E (a)=a (59)-a (0); For B, E (b)=Max (b); For C, E (c)=Max (c (k)-c (k-1));
6) flow chart of data processing finishes, and obtains the final data statistics.
In present embodiment whole " unlatching " state, A has upgraded 600 times, and B has upgraded 300 times, and C has upgraded 200 times.Tentation data A, B, the shared CPU time of C Data Update is that (for different data refresh modes, upgrading shared time span had difference, in the present embodiment in 0.0005 second, the needed time average of Data Update is 0.0005), the time that judgement symbol spent is ignored, A then, B, shared CPU T.T. of C is (600+300+200) * 0.0005=0.55 second, because the ratio of the shared CPU time resource of Data Update is 0.55/60=0.92%;
And in the prior art flow process, except the time that Data Update spent, the shared CPU time of data addressing of upgrading each data in addition and being spent is 0.001, then shared CPU T.T. of data addressing is (600+300+200) * 0.001=1.1 second, then shared T.T. of prior art is (0.55+1.1)=1.65, and shared CPU time resource ratio is 1.65/60=2.75%; When the state of opening flag is " closing " state, finish to upgrade buffer zone D (a), D (b), the data among the D (c) take CPU time this moment hardly; And in prior art because raw data upgrades and also to need to continue, think that the cpu resource ratio of flow chart of data processing institute expense still is 2.75%.
From above embodiment original data acquisition flow as can be seen, when carrying out performance statistic, data acquisition flow has reduced 1.83% for taking of CPU; Do not carrying out in the time of performance statistics, data acquisition flow has reduced 2.75% for taking of CPU; Because performance statistic provides to data test and uses, the time of not carrying out performance statistic is much larger than the time of carrying out performance statistic.The present invention has reduced the consumption of data statistics to cpu resource, makes the efficient of performance statistic obtain great raising.
By the raw data acquisition flow process in the present embodiment, performance statistic collection of the present invention and disposal route can enlarge the scope of performance statistics.If have raw data D, average 0.002 second Data Update once, Data Update institute's time spent is 0.0001 second.So in a sampling period (1 second), Data Update 500 times, in one-period (60 seconds), need to upgrade 30000 times, in prior art, the time that takies CPU owing to Data Update is required is (0.001+0.0001) * 30000=33 second, and the one-period time is 60 seconds, so such statistics, system are inefficient.But be to use the present invention, the needed time of raw data acquisition flow process is long to be 0.0001*30000=3 second, and these data, system are acceptables.
Claims (5)
1, a kind of collection of equipment performance statistics and disposal route comprise the collection of raw data and two flow processs of processing of data item; It is characterized in that,
One opening flag with " closing " and " unlatching " two states is set;
Upgrading raw data when the collecting flowchart of described raw data is in " unlatching " state at opening flag becomes current raw data, does not upgrade raw data when being in " closing " state at opening flag;
The treatment scheme of described data item opening flag when measurement period begins is set to " unlatching " state, in measurement period, obtain raw data at that time, after measurement period finishes, the opening flag of raw data is changed to " closing " state, handles the raw data of being obtained and obtain the final data statistics.
2, the collection of equipment performance statistics as claimed in claim 1 and disposal route is characterized in that, also comprise a plurality of fixing raw data buffer zones are set, the performance statistics period T of initialization system and sampling interval t, comprise n sampled point in each cycle, n=T/t, n rounds.
3, the collection of equipment performance statistics as claimed in claim 2 and disposal route is characterized in that, the collecting flowchart of described raw data specifically may further comprise the steps:
When raw data changes, judge earlier the state of opening flag, if during " closing " state, raw data is not upgraded;
If opening flag is " unlatching " state, the raw data of upgrading in the raw data buffer zone becomes current raw data.
4, the collection of equipment performance statistics as claimed in claim 2 and disposal route is characterized in that, the treatment scheme of described data item specifically may further comprise the steps:
1) measurement period begins, and opening flag is set to " unlatching " state, obtains current raw data simultaneously from described raw data buffer zone;
2) generate data item;
3) measurement period finishes;
4) described opening flag is set to " closing " state;
5) calculate the acquisition result data according to the disposal route of different types of data item.
5, as the collection and the disposal route of claim 2 or 4 described equipment performance statisticss, it is characterized in that, the processing procedure of described generation data item is: in a statistic period T, read current raw data according to sampling interval t from the raw data buffer zone, obtain sampled point k raw data currency a (k) constantly as data item; In this cycle, all data item that will obtain from the raw data buffer zone form collection of data items A={a (0), a (1) ... a (n-1) }.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNB031380875A CN100373379C (en) | 2003-05-29 | 2003-05-29 | Collecting and processing method for apparatus performance accounting data |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNB031380875A CN100373379C (en) | 2003-05-29 | 2003-05-29 | Collecting and processing method for apparatus performance accounting data |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN1553375A true CN1553375A (en) | 2004-12-08 |
| CN100373379C CN100373379C (en) | 2008-03-05 |
Family
ID=34323649
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CNB031380875A Expired - Fee Related CN100373379C (en) | 2003-05-29 | 2003-05-29 | Collecting and processing method for apparatus performance accounting data |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN100373379C (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2010020164A1 (en) * | 2008-08-22 | 2010-02-25 | 中兴通讯股份有限公司 | Routing method for realizing next generation call center hierarchical service |
| CN102149012A (en) * | 2010-11-30 | 2011-08-10 | 广东星海数字家庭产业技术研究院有限公司 | Data statistical method of multi-compatible hardware drive of digital television |
| CN105843724A (en) * | 2016-03-17 | 2016-08-10 | 杭州优云软件有限公司 | Monitoring state index compression analysis method of IT (Information Technology) system |
| CN105867852A (en) * | 2016-04-22 | 2016-08-17 | 安徽江淮汽车股份有限公司 | Method and system for managing data in nonvolatile memory of automatic transmission |
| CN114756287A (en) * | 2022-06-14 | 2022-07-15 | 飞腾信息技术有限公司 | Data processing method and device for reorder buffer and storage medium |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1018296B (en) * | 1989-05-30 | 1992-09-16 | 山东省煤炭科学研究所 | Power system harmonic surveying method and instrument |
| US5751766A (en) * | 1995-04-27 | 1998-05-12 | Applied Signal Technology, Inc. | Non-invasive digital communications test system |
| US6389430B1 (en) * | 1999-07-07 | 2002-05-14 | Computer Associates Think, Inc. | Real-time database object statistics collection |
| CN1168316C (en) * | 2000-11-06 | 2004-09-22 | 北京它山石科技有限公司 | Method based on network for controlling automatical video-audio broadcast transmission |
| US7274731B2 (en) * | 2001-11-09 | 2007-09-25 | Adc Dsl Systems, Inc. | Non-chronological system statistics |
-
2003
- 2003-05-29 CN CNB031380875A patent/CN100373379C/en not_active Expired - Fee Related
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2010020164A1 (en) * | 2008-08-22 | 2010-02-25 | 中兴通讯股份有限公司 | Routing method for realizing next generation call center hierarchical service |
| CN101656805B (en) * | 2008-08-22 | 2012-09-26 | 中兴通讯股份有限公司 | Routing method for realizing hierarchical service of next generation calling center |
| CN102149012A (en) * | 2010-11-30 | 2011-08-10 | 广东星海数字家庭产业技术研究院有限公司 | Data statistical method of multi-compatible hardware drive of digital television |
| CN105843724A (en) * | 2016-03-17 | 2016-08-10 | 杭州优云软件有限公司 | Monitoring state index compression analysis method of IT (Information Technology) system |
| CN105843724B (en) * | 2016-03-17 | 2019-03-15 | 杭州优云软件有限公司 | A kind of IT system monitoring state index compression analysis method |
| CN105867852A (en) * | 2016-04-22 | 2016-08-17 | 安徽江淮汽车股份有限公司 | Method and system for managing data in nonvolatile memory of automatic transmission |
| CN105867852B (en) * | 2016-04-22 | 2018-10-16 | 安徽江淮汽车集团股份有限公司 | A kind of the data in non-volatile memory management method and system of automatic gear-box |
| CN114756287A (en) * | 2022-06-14 | 2022-07-15 | 飞腾信息技术有限公司 | Data processing method and device for reorder buffer and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN100373379C (en) | 2008-03-05 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101655860B (en) | Video aided analytical method for criminal investigation and case detection and system | |
| CN1684040A (en) | Information processor capable of using past processing space | |
| CN1783092A (en) | Data analysis device and data analysis method | |
| CN1553375A (en) | Collecting and processing method for apparatus performance accounting data | |
| CN109450452A (en) | A kind of compression method and system of the sampling dictionary tree index for gene data | |
| CN116702708B (en) | Road pavement construction data management system | |
| CN1866251A (en) | Method and apparatus for reducing paging data retrieve time | |
| CN114647684A (en) | Traffic prediction method and device based on stacking algorithm and related equipment | |
| CN1821755A (en) | Realtime detecting method for flocculate fractal artery image | |
| CN110765074B (en) | Method and system for quickly accessing electric load curve data of acquisition terminal | |
| CN110851450B (en) | Incremental calculation-based companion vehicle instant discovery method | |
| CN1201589C (en) | Motion estimation | |
| CN114339266B (en) | Video stream queue processing method based on domestic CPU and operating system | |
| CN1436426A (en) | Adaptive early exit techniques for image correlation minimum distortion calculation | |
| CN1852182A (en) | Method and apparatus for detecting number of mobile host computers | |
| CN101031125A (en) | Method for accounting base-station performance data | |
| CN1790345A (en) | Urban rainwater pipeline design method | |
| Firtina et al. | RawHash2: Accurate and Fast Mapping of Raw Nanopore Signals using a Hash-based Seeding Mechanism | |
| CN1787642A (en) | Method for fast searching between frame of image unit module based on H.264 | |
| CN1588824A (en) | Method and device for channel evaluation using training sequence | |
| JP2000067362A (en) | Traffic condition prediction method, device therefor and recording medium having recorded traffic condition prediction program thereon | |
| CN116671867B (en) | Sleep quality evaluation method and system for underwater operators | |
| CN112925689B (en) | Multi-channel monitoring data transmission optimization method | |
| CN117216022B (en) | Digital engineering consultation data management system | |
| CN1893616A (en) | Format changing apparatus and method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20080305 Termination date: 20180529 |