CN102541870A - Processing method and system of data sheet - Google Patents
Processing method and system of data sheet Download PDFInfo
- Publication number
- CN102541870A CN102541870A CN2010105899190A CN201010589919A CN102541870A CN 102541870 A CN102541870 A CN 102541870A CN 2010105899190 A CN2010105899190 A CN 2010105899190A CN 201010589919 A CN201010589919 A CN 201010589919A CN 102541870 A CN102541870 A CN 102541870A
- Authority
- CN
- China
- Prior art keywords
- data
- tables
- buffer
- extracting
- variance
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Abstract
The invention relates to a processing method of a data sheet, which comprises the following steps of: extracting data according to a format of the data sheet; caching the extracted data; and summarizing the cached data according to the format of the data sheet for generating the data sheet. According to the processing method and device of the data sheet, the data extracted according to the format of the data sheet is cached, and a user only needs to obtain the cached data in each access without extracting large-scale data, thus the processing efficiency of the data sheet is greatly increased.
Description
[technical field]
The present invention relates to data processing field, particularly relate to a kind of disposal route and system of tables of data.
[background technology]
In the application of tables of data, usually need come intuitively and systematically to embody data and variation thereof through a series of tables of data.Also be mutually related between the tables of data, the generation of a tables of data often need be extracted data from other tables of data.
Yet; For the tables of data of big data quantity, huge data volume and data area have been related to, the gathering of the detailed data that it took place data from every day; Therefore; The aggregation process of tables of data is very consuming time, visit and the speed that gathers very slow, the visit of a secondary burst or gather other operations that all can influence in the tables of data.
[summary of the invention]
Based on this, be necessary to provide a kind of disposal route of tables of data of raising the efficiency.
In addition, also be necessary to provide a kind of disposal system of tables of data of raising the efficiency.
A kind of disposal route of tables of data may further comprise the steps: extract data according to the tables of data form, and the data of extracting are carried out buffer memory; Data in buffer is gathered the generation tables of data according to the tables of data form.
Preferably, also comprise after the said step of the data of extracting being carried out buffer memory: the step that data in buffer is recomputated.
Preferably, the step that also comprises the record buffer memory timestamp in the said step of the data of extracting being carried out buffer memory; The step that said data with extraction are carried out buffer memory also comprises afterwards: stab the step of upgrading the variance data in the data in buffer according to said cache-time.
Preferably; Saidly stab the step of upgrading the variance data in the data in buffer according to said cache-time and be: judge said cache-time stab with the current time stamp between the time interval whether reach the update cycle, be then to extract data again according to the tables of data form; Otherwise, then finish; Contrast data in buffer and the said data of extracting again obtain the variance data in the data in buffer; The said data of extracting are again replaced said variance data.
Preferably, the said step that the said data of extraction are again replaced said variance data also comprises afterwards: data in buffer is gathered the generation tables of data again according to the tables of data form; Said tables of data is carried out buffer memory.
A kind of disposal system of tables of data comprises: data extraction module is used for extracting data according to the tables of data form; Cache module is used for the data of extracting are carried out buffer memory; Processing module is used for data in buffer is gathered the generation tables of data according to the tables of data form.
Preferably, said system also comprises: correction module is used for data in buffer is recomputated.
Preferably, said system also comprises: logging modle is used for the record buffer memory timestamp; Update module is used for stabbing the variance data of upgrading data in buffer according to said cache-time.
Preferably, said update module comprises: judging unit is used to judge whether the time interval between said cache-time stamp and the current time stamp reaches the update cycle; Be; Then notify said data extraction module to extract data again according to the tables of data form, otherwise, then stop to carry out; Comparing unit is used for contrasting the variance data that data in buffer and the data of extracting again obtain data in buffer; The replacement unit is used for the data replacement variance data of extracting again;
Preferably, said processing module is further used for data in buffer is gathered the generation tables of data again according to the tables of data form, and said cache module is further used for said tables of data is carried out buffer memory.
The disposal route of above-mentioned tables of data and system will carry out buffer memory according to the data that the tables of data form extracts, and each visit of user only need be obtained data in buffer and got final product, and no longer need carry out large-scale data extract, has improved the treatment effeciency of tables of data widely.
The disposal route of above-mentioned tables of data and system have improved updating efficiency effectively through the variance data that change has taken place in the data in buffer is upgraded, and have reduced system loading widely.
[description of drawings]
Fig. 1 is the process flow diagram of the disposal route of tables of data among the embodiment;
Fig. 2 stabs the process flow diagram that upgrades the variance data in the data in buffer according to cache-time among one embodiment;
Fig. 3 is the synoptic diagram of the disposal system of tables of data among the embodiment;
Fig. 4 is the synoptic diagram of update module among the embodiment.
[embodiment]
As shown in Figure 1, the disposal route of tables of data among the embodiment may further comprise the steps:
In step S10, extract data according to the tables of data form, and the data of extracting are carried out buffer memory.In the present embodiment, when visiting user's the first time,,, carry out the extraction of data, the row cache of going forward side by side according to the tables of data form that is provided with in advance to cause access speed defective slowly for the visit each time of avoiding the user all needs immediately to extract data.Among another embodiment, after the step of the data of extracting being carried out buffer memory, also comprise the step that data in buffer is recomputated.Through to the data cached mode that recomputates this buffer memory error correction, guaranteed the correctness of all data in the tables of data effectively.
In step S20, data in buffer is gathered the generation tables of data according to the tables of data form.In the present embodiment, existingly in the data in buffer can directly be used for the data that tables of data gathers, also be useful on the intermediate data that tables of data gathers.When the user visits for the first time,, data in buffer is gathered the tables of data that has met the tables of data form with generation according to the tables of data form.
Among other embodiment, also comprised the step of record buffer memory timestamp among the step S10 of the disposal route of above-mentioned tables of data, after step S10, also comprised according to cache-time and stabbed the step of upgrading the variance data in the data in buffer.In the present embodiment, owing in data in buffer, the change of data is taking place often; In all data movement, usually be that change has taken place partial data wherein, the data in buffer that upgrades in time can cause the process of repeatedly data extract; Thereby cause processing procedure very slow; Therefore, in the preset update cycle, only the data that change has taken place in data cached are upgraded and to be improved the efficient of processing effectively.
As shown in Figure 2, in a concrete embodiment, comprise according to the updating steps that cache-time stabs and the update cycle is carried out variance data in the data in buffer:
In step S210, judge whether the time interval between cache-time stamp and the current time stamp reaches the update cycle, be, then get among the step S220, otherwise, then finish.In the present embodiment; Mistiming through between cache-time stamp and the current time stamp calculates the time interval; Judge whether this time interval has reached the preset update cycle; Be, then can upgrade, so that the user can check in access process once in a while is up-to-date data cached the data in buffer that change has taken place.According to data in buffer, the update cycle can be adjusted flexibly, and for example the update cycle can be 3 months or 1 year.
In step S220, extract data again according to the tables of data form, and the data of extracting are carried out buffer memory.In the present embodiment, the data of being carried out according to the tables of data form are extracted as follow-up renewal again provides Data Source.
In step S230, data in buffer is recomputated.In the present embodiment, the process that data in buffer is recomputated has greatly strengthened the error correcting capability of tables of data in the processing of tables of data, has guaranteed the correctness of data.
In step S240, the contrast data in buffer obtains the variance data in the data in buffer with the data of extracting again.In the present embodiment,, can obtain in the time of update cycle, having taken place in data cached the variance data of change, thereby know the current part that need upgrade in data cached through contrast.
In step S250, with the data replacement variance data of extracting again.In the present embodiment, will pass through the variance data that obtains of contrast and replace with the data of extracting again, up-to-date data cached to make things convenient for the user to obtain rapidly.
Among another embodiment, after step S250, also comprised data in buffer has been gathered the step that generates tables of data again according to the tables of data form.In the present embodiment; Data cached after upgrading carried out gathering and obtain tables of data again according to the tables of data form; Having realized the renewal of tables of data, thereby effectively guaranteed the validity of data in the tables of data, the tables of data that makes the user when visit, viewed is up-to-date tables of data.
In other embodiments, comprised the step of tables of data being carried out buffer memory in the disposal route of above-mentioned tables of data.In the present embodiment,, be necessary tables of data is carried out buffer memory, thereby avoided user's visit each time all to carry out gathering of tables of data, improved the efficient of visit for improving the speed of visit.
In addition, as shown in Figure 3, also be necessary to provide a kind of disposal system of tables of data.This system comprises data extraction module 10, cache module 20 and processing module 30.
Among another embodiment, the disposal system of above-mentioned tables of data has also comprised correction module, and this correction module is used for data in buffer is recomputated.After the data of extracting were carried out buffer memory, correction module recomputated data in buffer.Through the data cached mode that recomputates this buffer memory error correction, guaranteed the correctness of all data in the tables of data effectively.
Among another embodiment, the disposal system of above-mentioned tables of data also comprises logging modle and update module, and logging modle is used for the record buffer memory timestamp, and update module is used for stabbing the variance data of upgrading data in buffer according to said cache-time.In the present embodiment, owing in data in buffer, the change of data is taking place often; In all data movement, usually be that change has taken place partial data wherein, the data in buffer that upgrades in time can cause the process of repeatedly data extract; Thereby cause processing procedure very slow; Therefore, in the preset update cycle, update module is only upgraded the data that change has taken place in data cached can improve the efficient of processing effectively.
In a concrete embodiment, update module 40 comprises judging unit 410, comparing unit 420 and replacement unit 430.
Comparing unit 420 is used for contrasting the variance data that data in buffer and the data of extracting again obtain data in buffer.In the present embodiment, comparing unit 420 is through contrast, can obtain the variance data of change having taken place in data cached in the time of update cycle, thereby know the current part that need upgrade in data cached.
Among another embodiment, the processing module 30 in the disposal system of above-mentioned tables of data is further used for data in buffer is gathered the generation tables of data again according to the tables of data form.In the present embodiment; Data cached after processing module 30 will be upgraded carried out gathering and obtain tables of data again according to the tables of data form; To have realized the renewal of tables of data; Thereby effectively guaranteed the validity of data in the tables of data, the tables of data that makes the user when visit, viewed is up-to-date tables of data.
Among other embodiment, cache module 20 is further used for tables of data is carried out buffer memory.
The disposal route of above-mentioned tables of data and system will carry out buffer memory according to the data that the tables of data form extracts, and each visit of user only need be obtained data in buffer and got final product, and no longer need carry out large-scale data extract, has improved the treatment effeciency of tables of data widely.
The disposal route of above-mentioned tables of data and system have improved updating efficiency effectively through the variance data that change has taken place in the data in buffer is upgraded, and have reduced system loading widely.
The above embodiment has only expressed several kinds of embodiments of the present invention, and it describes comparatively concrete and detailed, but can not therefore be interpreted as the restriction to claim of the present invention.Should be pointed out that for the person of ordinary skill of the art under the prerequisite that does not break away from the present invention's design, can also make some distortion and improvement, these all belong to protection scope of the present invention.Therefore, the protection domain of patent of the present invention should be as the criterion with accompanying claims.
Claims (10)
1. the disposal route of a tables of data may further comprise the steps:
Extract data according to the tables of data form, and the data of extracting are carried out buffer memory;
Data in buffer is gathered the generation tables of data according to the tables of data form.
2. tables of data disposal route according to claim 1 is characterized in that, the step that said data with extraction are carried out buffer memory also comprises afterwards:
The step that data in buffer is recomputated.
3. tables of data disposal route according to claim 1 is characterized in that, also comprises the step of record buffer memory timestamp in the said step of the data of extracting being carried out buffer memory;
The step that said data with extraction are carried out buffer memory also comprises afterwards:
Stab the step of upgrading the variance data in the data in buffer according to said cache-time.
4. tables of data disposal route according to claim 3 is characterized in that, the said step of upgrading the variance data in the data in buffer according to said cache-time stamp is:
Judge whether the time interval that said cache-time stabs between stabbing with the current time reach the update cycle, be, then extract data again according to the tables of data form, otherwise, then end;
Contrast data in buffer and the said data of extracting again obtain the variance data in the data in buffer;
The said data of extracting are again replaced said variance data.
5. tables of data disposal route according to claim 4 is characterized in that, the said step that the said data of extraction are again replaced said variance data also comprises afterwards:
Data in buffer is gathered the generation tables of data again according to the tables of data form;
Said tables of data is carried out buffer memory.
6. the disposal system of a tables of data is characterized in that, comprising:
Data extraction module is used for extracting data according to the tables of data form;
Cache module is used for the data of extracting are carried out buffer memory;
Processing module is used for data in buffer is gathered the generation tables of data according to the tables of data form.
7. the disposal system of tables of data according to claim 6 is characterized in that, said system also comprises:
Correction module is used for data in buffer is recomputated.
8. the disposal system of tables of data according to claim 6 is characterized in that, said system also comprises:
Logging modle is used for the record buffer memory timestamp;
Update module is used for stabbing the variance data of upgrading data in buffer according to said cache-time.
9. the disposal system of tables of data according to claim 8 is characterized in that, said update module comprises:
Judging unit is used to judge whether the time interval that said cache-time stabs between stabbing with the current time reach the update cycle, is, then notifies said data extraction module to extract data again according to the tables of data form, otherwise, then stop execution;
Comparing unit is used for contrasting the variance data that data in buffer and the data of extracting again obtain data in buffer;
The replacement unit is used for the data replacement variance data of extracting again;
10. tables of data disposal system according to claim 9; It is characterized in that; Said processing module is further used for data in buffer is gathered the generation tables of data again according to the tables of data form, and said cache module is further used for said tables of data is carried out buffer memory.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2010105899190A CN102541870A (en) | 2010-12-15 | 2010-12-15 | Processing method and system of data sheet |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2010105899190A CN102541870A (en) | 2010-12-15 | 2010-12-15 | Processing method and system of data sheet |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN102541870A true CN102541870A (en) | 2012-07-04 |
Family
ID=46348792
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2010105899190A Pending CN102541870A (en) | 2010-12-15 | 2010-12-15 | Processing method and system of data sheet |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102541870A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106648917A (en) * | 2016-09-19 | 2017-05-10 | 福建天泉教育科技有限公司 | Cache data differential updating method and system |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1659548A (en) * | 2002-07-17 | 2005-08-24 | 欧里科国际公司 | System and method for caching data for a mobile application |
| CN101308513A (en) * | 2008-06-27 | 2008-11-19 | 福建星网锐捷网络有限公司 | Distributed system cache data synchronous configuration method and apparatus |
| US20090089337A1 (en) * | 2007-10-01 | 2009-04-02 | Microsoft Corporation | Efficient file hash identifier computation |
| CN101510175A (en) * | 2009-04-02 | 2009-08-19 | 北京中星微电子有限公司 | Method for updating target data to memory and apparatus thereof |
| CN101853278A (en) * | 2010-05-19 | 2010-10-06 | 苏州迈科网络安全技术有限公司 | Application method of data storage system |
-
2010
- 2010-12-15 CN CN2010105899190A patent/CN102541870A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1659548A (en) * | 2002-07-17 | 2005-08-24 | 欧里科国际公司 | System and method for caching data for a mobile application |
| US20090089337A1 (en) * | 2007-10-01 | 2009-04-02 | Microsoft Corporation | Efficient file hash identifier computation |
| CN101308513A (en) * | 2008-06-27 | 2008-11-19 | 福建星网锐捷网络有限公司 | Distributed system cache data synchronous configuration method and apparatus |
| CN101510175A (en) * | 2009-04-02 | 2009-08-19 | 北京中星微电子有限公司 | Method for updating target data to memory and apparatus thereof |
| CN101853278A (en) * | 2010-05-19 | 2010-10-06 | 苏州迈科网络安全技术有限公司 | Application method of data storage system |
Non-Patent Citations (1)
| Title |
|---|
| 袁健: "基于Web的自适应上报系统技术的研究与实现", 《计算机工程与设计》 * |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106648917A (en) * | 2016-09-19 | 2017-05-10 | 福建天泉教育科技有限公司 | Cache data differential updating method and system |
| CN106648917B (en) * | 2016-09-19 | 2019-09-10 | 福建天泉教育科技有限公司 | A kind of method and system that difference update is data cached |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104182898B (en) | The method that banking system carries out amended record to the on-line transaction occurred during night mode | |
| CN100589418C (en) | The generation method and the generation system of alarm correlation rule | |
| CN102073527B (en) | Method and device for updating input method word stock | |
| CN103399888B (en) | The differential synchronization method of grid model data and system | |
| CN103297561B (en) | IP address source tracing method and device | |
| CN105653653A (en) | Order form data synchronization method and system | |
| CN1866833A (en) | Distributed data management system and its method for dynamically subscribing data | |
| WO2018099154A1 (en) | Event processing method, network management device, and server | |
| CN105808417A (en) | Automated testing method and proxy server | |
| CN102193920B (en) | A kind of name word stock generating method, device and character input system | |
| CN102801548B (en) | A kind of method of intelligent early-warning, device and information system | |
| CN111737355A (en) | MongoDB metadata management-based heterogeneous data source synchronization method and system | |
| CN105205189A (en) | BIM based on container and integrated method of high-speed data collecting system | |
| CN103905441A (en) | Data acquisition method and device | |
| CN110321142A (en) | A kind of interface document update method, device, electronic equipment and storage medium | |
| CN106599167A (en) | System and method capable of supporting incremental upgrading of database | |
| CN104317857A (en) | House information acquisition service system | |
| CN103702354B (en) | Base station engineering parameter collection and analysis method | |
| CN104636340A (en) | Webpage URL filtering method, device and system | |
| CN102541870A (en) | Processing method and system of data sheet | |
| CN106407233A (en) | A data processing method and apparatus | |
| CN103763336A (en) | Software update method oriented to complex network architecture | |
| CN103152263A (en) | Link status protocol data unit fragmentation updating method and router | |
| CN105975599A (en) | Method and device monitoring website page event tracking | |
| CN102737028A (en) | Synchronization method and synchronization system of database |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C12 | Rejection of a patent application after its publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20120704 |