CN101661385A - Data processing device and data processing method - Google Patents
Data processing device and data processing method Download PDFInfo
- Publication number
- CN101661385A CN101661385A CN200810198113A CN200810198113A CN101661385A CN 101661385 A CN101661385 A CN 101661385A CN 200810198113 A CN200810198113 A CN 200810198113A CN 200810198113 A CN200810198113 A CN 200810198113A CN 101661385 A CN101661385 A CN 101661385A
- Authority
- CN
- China
- Prior art keywords
- unit
- data processing
- dynamic dataflow
- detecting
- storage unit
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Abstract
The invention provides a data processing device and a data processing method for analyzing a data group, wherein the data processing device comprises a grouping unit, a calculating unit, a storing unit, a detecting unit and a comparing unit. The data processing method is realized through the data processing device and comprises the following steps: dividing the data group into a plurality of ordered groups and transmitting the groups to the calculating unit by the grouping unit; sequentially and respectively calculating each group, obtaining ordered dynamic data streams and storing the ordereddynamic data streams to the storing unit by the calculating unit; detecting whether a last group is calculated and stored or not by the detecting unit; if so, judging whether the number of the dynamic data streams is larger than a default value or not by the comparing unit; and if not, taking out the dynamic data streams by the calculating unit from the storing unit and calculating to obtain a final result by the calculating unit. The invention can divide the data group into the groups and sequentially calculate the groups so as to ensure that a data volume processed by a computer device at asingle time is limited within a certain range, thereby improving the calculating efficiency.
Description
[technical field]
The present invention is a kind of data processing equipment and data processing method, particularly a kind of data processing equipment and data processing method that improves counting yield.
[background technology]
Available data disposal route: according to the nonidentity operation rule data importing is arrived in our the self-made Excel formula, utilize the Excel function to carry out operational analysis.The defective of available data disposal route: it is slow that the Excel function is handled the speed of big data, and this province of function formula file capacity is also big, example: 10000 line data of 24 Channel that collect, corresponding function formula file itself just has 59MB.Copy data to the function formula the inside, because the drawback of EXCEL is not for controlling the function of order of operation, so once obtaining a result through own experiment calculating on the counter of a CPU who is configured to Cerelon2.93G and 512MB internal memory needs 6 minutes at least, because CPU is with the data of 10000 24Channels of one-time calculation, CPU usage will reach 100% in the short time causes program seemingly-dead.Once test has comprised the several times data analysis, and the slip-stick artist carries out next step debugging after need waiting for test result analysis, has a strong impact on efficient.
[summary of the invention]
Fundamental purpose of the present invention is to provide a kind of data processing equipment and data processing method that improves counting yield.
For reaching above-mentioned purpose, the invention provides a kind of data processing equipment, is arranged in the computer apparatus and is used to analyze data group, and described data processing equipment comprises grouped element that described grouped element is in order to be divided into orderly some groupings with data group by pre-defined rule; Described grouped element connects computing unit, and described computing unit calculates respectively in regular turn and respectively divides into groups and obtain orderly dynamic dataflow; Described computing unit connects storage unit, and described storage unit is in order to store orderly dynamic dataflow; Described computing unit and described storage unit connect detecting unit, and whether described detecting unit calculates and store and finish in last grouping in order to the detecting ordering; Described grouped element, storage unit and detecting unit connect comparing unit, and described comparing unit receive judge the dynamic dataflow that storage unit is interior behind the detecting result number whether greater than default value, and judged result transferred to grouped element.
The present invention also provides a kind of data processing method, it analyzes data group by data processing equipment, wherein, described data processing equipment is arranged in the computer apparatus and comprises grouped element, computing unit, storage unit, detecting unit and comparing unit, and described data processing method may further comprise the steps: grouped element is divided into data group orderly some groupings and transfers to computing unit by pre-defined rule; Computing unit calculates respectively in regular turn and respectively divides into groups and obtain orderly dynamic dataflow, and orderly dynamic dataflow is stored to storage unit; Whether detecting unit detecting ordering is calculated and is stored and finish in last grouping; When detecting unit detect finish after, by comparing unit to storage unit dynamic dataflow is taken out, and whether the number of judging dynamic dataflow greater than default value; When the number of dynamic dataflow is not more than default value, dynamic dataflow taking-up and calculating are obtained net result by computing unit to storage unit.
Compared with prior art, data processing equipment of the present invention and data processing method can be calculated the data group grouping in regular turn, and make the data volume of computer apparatus single treatment be limited in the certain limit, program to occur seemingly-dead in order to avoid computer apparatus is because of CPU reaches 100% in the short time, thereby improved counting yield.
[description of drawings]
Fig. 1 is the functional-block diagram of data processing equipment of the present invention.
Fig. 2 is the process flow diagram of data processing method of the present invention.
[embodiment]
See also shown in Figure 1, data processing equipment of the present invention is arranged in the computer apparatus and is used to analyze data group and (can be two-dimensional array, and with the sampling time ordering), and described data processing equipment comprises grouped element 10, and described grouped element 10 is in order to be divided into orderly some groupings with data group by pre-defined rule; Described grouped element 10 connects computing units 20, and described computing unit 20 calculates respectively in regular turn and respectively divides into groups and obtain orderly dynamic dataflow; Described computing unit 20 connects storage unit 30, and described storage unit 30 is in order to store orderly dynamic dataflow; Described computing unit 20 and described storage unit 30 connect detecting unit 40, and whether described detecting unit 40 calculates and store and finish in last grouping in order to the detecting ordering; And described grouped element 10, storage unit 30 and detecting unit 40 connect comparing unit 50, and whether described comparing unit 50 receives number that detecting judges the dynamic dataflow that storage unit 30 is interior behind the result greater than default value, and judged result is transferred to grouped element 10.
Please in conjunction with consulting Figure 1 and Figure 2, reaching, and described data processing method may further comprise the steps data processing method of the present invention by data processing equipment shown in Figure 1:
Step 201: grouped element 10 is divided into data group orderly some groupings and transfers to computing unit 20 by pre-defined rule;
Step 202: computing unit 20 calculates respectively in regular turn and respectively divides into groups and obtain orderly dynamic dataflow, and orderly dynamic dataflow is stored to storage unit 30;
Step 203: whether detecting unit 40 detecting orderings are calculated and are stored and finish in last grouping, if then notify comparing unit 50 execution in step 204; If not, then return step 202;
Step 204: comparing unit 50 judges that whether the number of the dynamic dataflow in the storage unit 30 is greater than default value; When the number of dynamic dataflow is not more than default value, execution in step 205; And when the number of dynamic dataflow during, execution in step 206 greater than default value;
Step 205: dynamic dataflow is taken out computing unit 20 to storage unit 50 and calculating obtains net result;
Step 206: grouped element 10 with dynamic dataflow (when returning by step 209, it then is the upper level dynamic dataflow, wherein, described upper level dynamic dataflow refers to the dynamic dataflow that a circulation is produced) be divided into orderly some next stage groupings (for a last circulation, meaning the new grouping that the epicycle circulation is produced) and transfer to computing unit 20 by pre-defined rule;
Step 207: computing unit 20 calculates each next stage grouping in regular turn respectively and obtains orderly next stage dynamic dataflow (for a last circulation, mean the new dynamic dataflow that epicycle circulation is produced), and orderly next stage dynamic dataflow is stored to storage unit 30;
Step 208: whether detecting unit 40 detecting orderings are calculated and are stored and finish in last next stage grouping, if then notify comparing unit 50 execution in step 209; If not, then return step 207;
Step 209: comparing unit 50 judges that whether the number of the next stage dynamic dataflow in the storage unit 30 is greater than default value; When the number of first-stage dynamic data stream is not more than default value instantly, execution in step 210; And when the number of first-stage dynamic data stream is greater than default value instantly, execution in step 206;
Step 210: the next stage dynamic dataflow is taken out computing unit 20 to storage unit 50 and calculating obtains net result.
For example, will include the data group of 10000 data, first round circulation is divided into 200 groups with it, each group has 50 data, once calculates 50 data simultaneously, is divided into 200 times and finishes, and obtain 200 new data and be dynamic dataflow, the circulation of the constipation bundle first round; Then, enter second and take turns circulation, again 200 new data are divided into 4 groups, each group has 50 data, once calculates 50 data simultaneously, is divided into 4 times and finishes, and obtain 4 new data, and constipation bundle second is taken turns circulation; At last, 4 data are calculated simultaneously just obtained net result.
Claims (8)
1. data processing equipment is arranged in the computer apparatus and is used to analyze data group, it is characterized in that described data processing equipment comprises:
Grouped element, it is in order to be divided into orderly some groupings with data group by pre-defined rule;
Computing unit is connected with grouped element, and described computing unit calculates respectively in regular turn and respectively divides into groups and obtain orderly dynamic dataflow;
Storage unit is connected with computing unit, and described storage unit is in order to store orderly dynamic dataflow;
Detecting unit is connected with computing unit and storage unit, and whether described detecting unit calculates and store and finish in last grouping in order to the detecting ordering;
Comparing unit is connected with grouped element, storage unit and detecting unit, and described comparing unit receive judge the dynamic dataflow that storage unit is interior behind the detecting result number whether greater than default value, and judged result transferred to grouped element.
2. data processing equipment according to claim 1 is characterized in that: described data group is a two-dimensional array.
3. data processing equipment according to claim 2 is characterized in that: described data group is for sorting with the sampling time.
4. data processing method, it analyzes data group by data processing equipment, wherein, described data processing equipment is arranged in the computer apparatus and comprises grouped element, computing unit, storage unit, detecting unit and comparing unit, it is characterized in that described data processing method may further comprise the steps:
Grouped element is divided into data group orderly some groupings and transfers to computing unit by pre-defined rule;
Computing unit calculates respectively in regular turn and respectively divides into groups and obtain orderly dynamic dataflow, and orderly dynamic dataflow is stored to storage unit;
Whether detecting unit detecting ordering is calculated and is stored and finish in last grouping;
When detecting unit detect finish after, judge that by comparing unit whether the number of the dynamic dataflow in the storage unit is greater than default value;
When the number of dynamic dataflow is not more than default value, dynamic dataflow taking-up and calculating are obtained net result by computing unit to storage unit.
5. data processing method according to claim 4, it is characterized in that: when the number of dynamic dataflow during greater than default value, by grouped element dynamic dataflow is divided into orderly some groupings and transfers to computing unit by pre-defined rule, and returning step, computing unit calculates respectively in regular turn and respectively divides into groups and obtain orderly dynamic dataflow.
6. data processing method according to claim 4 is characterized in that: described data group is a two-dimensional array.
7. data processing method according to claim 6 is characterized in that: described data group sorted with the sampling time.
8. data processing method according to claim 4 is characterized in that: when detecting unit detects imperfect tense, return described step, computing unit calculates respectively in regular turn and respectively divides into groups and obtain orderly dynamic dataflow.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN200810198113A CN101661385A (en) | 2008-08-29 | 2008-08-29 | Data processing device and data processing method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN200810198113A CN101661385A (en) | 2008-08-29 | 2008-08-29 | Data processing device and data processing method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN101661385A true CN101661385A (en) | 2010-03-03 |
Family
ID=41789434
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN200810198113A Pending CN101661385A (en) | 2008-08-29 | 2008-08-29 | Data processing device and data processing method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101661385A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105094747A (en) * | 2014-05-07 | 2015-11-25 | 阿里巴巴集团控股有限公司 | Central processing unit and device for detecting data dependency of instructions based on SMT |
| CN106815064A (en) * | 2015-11-27 | 2017-06-09 | 北京国双科技有限公司 | The detection method and device of ring-type data processing architecture |
| CN113408560A (en) * | 2020-03-17 | 2021-09-17 | 联合汽车电子有限公司 | Engine test data classification method, electronic device and readable storage medium |
-
2008
- 2008-08-29 CN CN200810198113A patent/CN101661385A/en active Pending
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105094747A (en) * | 2014-05-07 | 2015-11-25 | 阿里巴巴集团控股有限公司 | Central processing unit and device for detecting data dependency of instructions based on SMT |
| CN105094747B (en) * | 2014-05-07 | 2018-12-04 | 阿里巴巴集团控股有限公司 | The device of central processing unit based on SMT and the data dependence for detection instruction |
| CN106815064A (en) * | 2015-11-27 | 2017-06-09 | 北京国双科技有限公司 | The detection method and device of ring-type data processing architecture |
| CN106815064B (en) * | 2015-11-27 | 2020-02-07 | 北京国双科技有限公司 | Detection method and device of ring data processing architecture |
| CN113408560A (en) * | 2020-03-17 | 2021-09-17 | 联合汽车电子有限公司 | Engine test data classification method, electronic device and readable storage medium |
| CN113408560B (en) * | 2020-03-17 | 2024-04-16 | 联合汽车电子有限公司 | Engine test data classification method, electronic device, and readable storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105301991B (en) | Use the digital triggering of finite state machine | |
| CN100442069C (en) | Method for parallelly detecting multiple chips of synchronous communication | |
| CN101114253A (en) | Program crashing information report method and system thereof | |
| US8321476B2 (en) | Method and system for determining boundary values dynamically defining key value bounds of two or more disjoint subsets of sort run-based parallel processing of data from databases | |
| CN104731828B (en) | A kind of cross-cutting Documents Similarity computational methods and device | |
| CN103282892B (en) | Memory diagnosis device and memory diagnostic method | |
| CN111626360B (en) | Method, apparatus, device and storage medium for detecting boiler fault type | |
| CN101661385A (en) | Data processing device and data processing method | |
| CN110376503B (en) | AI acceleration chip performance test method and device | |
| CN107688589A (en) | The method and device of Database System Optimization | |
| CN109446740B (en) | System-on-chip architecture performance simulation platform | |
| CN104933105B (en) | The analysis method and device of database access request | |
| CN108494635A (en) | A kind of network flow detection system based on cloud computing | |
| CN103077080A (en) | Method and device for acquiring parallel program performance data based on high performance platform | |
| CN107688660A (en) | The execution method and device of parallel executive plan | |
| CN110716986B (en) | Big data analysis system and application method thereof | |
| CN110532104B (en) | Multi-channel data real-time sequencing method and system | |
| CN105956036A (en) | Transaction quality analysis device and transaction quality analysis method | |
| CN109272113B (en) | Convolutional neural network establishing device and method based on channel | |
| CN101520769B (en) | Method and system for data processing | |
| KR101958540B1 (en) | Apparatus and method of debugging post silicon using on-chip dram for multi-core design | |
| CN113806231B (en) | Code coverage rate analysis method, device, equipment and medium | |
| CN109829132A (en) | The quick spectral analysis method of long data sequence under a kind of embedded environment | |
| CN111722829B (en) | Double-concurrent pre-reading high-performance merging and sorting method and application | |
| CN100427902C (en) | Measuring and processing device for power balance parameter of multipath laser system and power balance method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C02 | Deemed withdrawal of patent application after publication (patent law 2001) | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Open date: 20100303 |