CN102024062B - Device and method for realizing data dynamic cache - Google Patents

Device and method for realizing data dynamic cache Download PDF

Info

Publication number
CN102024062B
CN102024062B CN 201110001853 CN201110001853A CN102024062B CN 102024062 B CN102024062 B CN 102024062B CN 201110001853 CN201110001853 CN 201110001853 CN 201110001853 A CN201110001853 A CN 201110001853A CN 102024062 B CN102024062 B CN 102024062B
Authority
CN
China
Prior art keywords
index
data
report
order
unit
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN 201110001853
Other languages
Chinese (zh)
Other versions
CN102024062A (en
Inventor
张毅
李锐
凌晓珂
刘晗
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Industrial and Commercial Bank of China Ltd ICBC
Original Assignee
Industrial and Commercial Bank of China Ltd ICBC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Industrial and Commercial Bank of China Ltd ICBC filed Critical Industrial and Commercial Bank of China Ltd ICBC
Priority to CN 201110001853 priority Critical patent/CN102024062B/en
Publication of CN102024062A publication Critical patent/CN102024062A/en
Application granted granted Critical
Publication of CN102024062B publication Critical patent/CN102024062B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Abstract

The invention discloses a device and a method for realizing data dynamic cache. The device comprises an inquiry unit, a report processing decomposer, a data management unit, data processing unit, a data cache library and a report displaying unit wherein the report processing decomposer receives a report inquiry command input by the inquiry unit, decomposes the command into a plurality of index inquiry commands contained in the command, and then forms a string of inquiry command stream and transmits the same to the data processing unit; the data processing unit is used for carrying out index calculation in accordance with the string of inquiry command stream, calculating the higher-order index of an index result layer by layer in accordance with the index result, filling the high-order index dynamically, and storing the obtained report data in the data cache library; and the report displaying unit is used for displaying the report in accordance with the data in the data cache library and a report sample in the data management unit. The device and the method for realizing the data dynamic cache can be used to overcome the problems of repeated data processing and storage in the processing of the report data, and waste of system resources caused by low data processing efficiency and redundant storage.

Description

A kind of device and method of realizing the Data Dynamic caching process
Technical field
The present invention relates to technical field of data processing, particularly relate to a kind of device and method of realizing the Data Dynamic caching process.
Background technology
Continuous development along with infotech; Enterprise production and management is increasingly high to the degree of dependence of infosystem; The various forms of reflection enterprise operation are also more and more, and are more and more wider like the professional coverage rate of performance analysis class form, also increasingly high for the efficient requirement of report query.But, generally need carry out the processing of big data quantity for the form of performance analysis class, particularly for large enterprise units such as conglomerate, transregional companys, the processing of this type form often need be carried out the processing of mass data.Therefore, report processing system more and more can not satisfy the efficient requirement in carrying out report form processing at present, and the speed that how to improve report form processing becomes each enterprise in the problem of constantly studying.
At present; The caching function of report query disposal system is mainly stored with the form (like PDF, EXCEL, html format) of report form showing file through the form that history was clicked; When visiting the form of the same terms next time, directly represent from reading the report file of having preserved.Because this caching mechanism is to realize through the mode by file storage, the data of form is not carried out structurized storage, therefore exist following several respects not enough:
1, the situation of identical upstream data often appears using in different form; Often there are certain common data in the dimension of its processing and peek scope; The traditional report form processing mode of general employing must be handled respectively in different report form processing the common data in the above-mentioned report form processing during present report data was handled, and had produced certain double counting; Cause resource waste, and make system handles efficient not high.
2, often there is some relevant statistical property in the querying condition of same form on different dimensions; And present report data disposal system adopts on caching mechanism and traditional independently deposits data cachedly according to querying condition, causes the double counting of data and the redundancy of physics parking space easily.
Summary of the invention
The technical matters that (one) will solve
The present invention exists data re-treatment, repeated storage in order to overcome in the present report data processing, and the problem that data-handling efficiency is low, redundant storage causes system resource waste proposes a kind of device and method of realizing the Data Dynamic caching process.
(2) technical scheme
For achieving the above object; The invention provides a kind of device of realizing the Data Dynamic caching process; This device comprises inquiry unit 1, report form processing decomposer 2, data administrator 3, data processing equipment 4, metadata cache storehouse 5 and report form showing device 6, wherein:
Inquiry unit 1 is connected in report form processing decomposer 2, is used to realize mutual between report form processing decomposer 2 and report query user;
Report form processing decomposer 2; Be connected to inquiry unit 1, data administrator 3 and data processing equipment 4; Be used to receive the report query instruction of importing into from inquiry unit 1; Many the index query statements that it comprises are resolved in the instruction of this report query, then will many index query statements form a string query statement again and flow, and should go here and there query statement and spread into data processing equipment 4;
Data administrator 3 is connected to report form processing decomposer 2, data processing equipment 4 and report form showing device 6, is used to provide the foundation of logical process, data processing;
Data processing equipment 4 is connected to report form processing decomposer 2, data administrator 3, metadata cache storehouse 5 and report form showing device 6, is used for carrying out index calculating, high-order index according to query statement and dynamically fills and the report data storage operation;
Metadata cache storehouse 5 is connected to data processing equipment 4 and report form showing device 6, is used for the memory buffers data;
Report form showing device 6 is connected to data administrator 3, data processing equipment 4 and metadata cache storehouse 5, to the user report form showing interface is provided, and carries out report form showing according to the data in metadata cache storehouse 5 and the report form sample of data administrator 3.
In the such scheme; Said inquiry unit 1 provides the report query interface to the user; Receive the querying condition of user's input, this querying condition comprises form frequency, statement dates, organization names and report form showing unit at least, and imports this querying condition information into report form processing decomposer 2.
In the such scheme; After said report form processing decomposer 2 receives report query conditions; According to index inventory relevant in the report number reading of data management devices 3 with this form; According to the dimension numbering combination in the index numbering reading of data management devices 3 of each index, be combined into the index dimension values again, import data processing equipment 4 into the form of data processing query statement stream at last numbering corresponding value with dimension in the querying condition.
In the such scheme; Said data administrator 3 comprises that report form sample storage unit 301, form property store unit 302, index property store unit 303 and index concern storage unit 304; These 4 unit are separate; Be connected in report form processing decomposer 2, data processing equipment 4 and report form showing device 6 respectively, wherein:
Report form sample storage unit 301 is used to store the table appearance of form when empty data;
Form property store unit 302 is used to store the corresponding relation of form and index;
Index property store unit 303 is used to store the attribute information of index;
Index concerns storage unit 304, is used to store the corresponding relation of index and its high-order index.
In the such scheme; Said data processing equipment 4 is made up of with high-order index filler cells 402 interconnective index computing unit 401; Wherein, 401 pairs of achievement datas of this index computing unit calculate, and are sending to high-order index filler cells 402 and fill instruction achievement data being calculated the back that finishes, and are successively calculated by the index of the more high-order of 402 pairs of these indexs of high-order index filler cells.
In the such scheme, 401 pairs of achievement datas of said index computing unit calculate, and comprising: the query statement stream that data administrator 3 is imported into is that Partition of Unity becomes a plurality of instructions with the index, and is that unit calculates with the index; In index computation process, if this index in other forms, calculate, so then need not double counting, directly from metadata cache storehouse 5, read, to realize data sharing; For each index that newly calculates, it is initiatively inserted metadata cache storehouse 5, realize with the index being that unit stores, reduce data redundancy; In case all indexs of this form are calculated and are accomplished, and deposit report data in metadata cache storehouse 5.
In the such scheme; The achievement data that said high-order index filler cells 402 obtains according to index computing unit 401 successively calculates its high-order index; Comprise: its direct high-order index of mark sense to calculating completion is filled, and its direct high-order indication information is kept at metadata cache storehouse 5; Finish in case certain high-order index is filled, automatically it is saved to metadata cache storehouse 5, and deletes this high-order index all records in metadata cache storehouse 5, to reduce data redundancy; Continue simultaneously to fill, thereby realize of the successively filling of low order index to the high-order index to the direct high-order index of this high-order index.
In the such scheme, said filling is the computing formula according to the high-order index, utilizes its low order desired value that has obtained to calculate the process values of high-order index, all obtains until all low order indexs, calculates the end value of high-order index, then fills and accomplishes.
In the such scheme, said metadata cache storehouse 5 is made up of achievement data storage unit 501, padding data storage unit 502 and report data storage unit 503, and these 3 unit are separate, is connected in data processing equipment 4 and report form showing device 6 respectively, wherein:
Achievement data storage unit 501, being used for index and querying condition is unit storage index value, makes the identical index that uses in the different forms obtain data sharing;
Padding data storage unit 502 is used to store the intermediate result that current achievement data is filled to direct high-order achievement data;
Report data storage unit 503 is used to store the result data of current inquiry form, and retention cycle is that report form index is calculated to finish and finished to report query.
For achieving the above object, the present invention also provides a kind of method that realizes the Data Dynamic caching process, is applied to the device of described realization Data Dynamic caching process, and this method comprises:
Report form processing decomposer 2 receives the report query instruction of importing into from inquiry unit 1; Many the index query statements that it comprises are resolved in this report query instruction, then many index query statements are formed a string query statement again and spread into data processing equipment 4;
Data processing equipment 4 flows to row index according to this string query statement and calculates, and successively calculates its high-order index according to this index result of calculation, and this high-order index is dynamically filled, and then the report data that obtains is stored in the metadata cache storehouse 5; And
Report form showing device 6 is carried out report form showing according to the data in metadata cache storehouse 5 and the report form sample of data administrator 3.
In the such scheme; Said report form processing decomposer 2 receives the report query instruction of importing into from inquiry unit 1; Many the index query statements that it comprises are resolved in this report query instruction; Then many index query statements being formed a string query statement again spreads into data processing equipment 4; Comprise: after the report query that said report form processing decomposer 2 receptions are imported into from inquiry unit 1 instructs, according to index inventory relevant in the report number reading of data management devices 3, again according to the dimension numbering combination in the index numbering reading of data management devices 3 of each index with this form; Be combined into the index dimension values with numbering corresponding value with dimension in the querying condition, import data processing equipment 4 into the form of data processing query statement stream at last.
In the such scheme; Said data processing equipment 4 flows to row index according to this string query statement and calculates; Comprise: the query statement stream that data processing equipment 4 imports data administrator 3 into is that Partition of Unity becomes a plurality of instructions with the index, and is that unit calculates with the index; In index computation process, if this index in other forms, calculate, so then need not double counting, directly from metadata cache storehouse 5, read, to realize data sharing; For each index that newly calculates, it is initiatively inserted metadata cache storehouse 5, realize with the index being that unit stores, reduce data redundancy; In case all indexs of this form are calculated and are accomplished, and deposit report data in metadata cache storehouse 5.
In the such scheme; Said data processing equipment 4 successively calculates its high-order index according to this index result of calculation; And this high-order index dynamically filled; Comprise: 4 pairs of data processing equipments have calculated its direct high-order index of mark sense of completion and have filled, and its direct high-order indication information is kept at metadata cache storehouse 5; Finish in case certain high-order index is filled, automatically it is saved to metadata cache storehouse 5, and deletes this high-order index all records in metadata cache storehouse 5, to reduce data redundancy; Continue simultaneously to fill, thereby realize of the successively filling of low order index to the high-order index to the direct high-order index of this high-order index.
In the such scheme; Said data processing equipment 4 is made up of with high-order index filler cells 402 interconnective index computing unit 401; Said metadata cache storehouse 5 is made up of achievement data storage unit 501, padding data storage unit 502 and report data storage unit 503, and said data processing equipment 4 flows to row index according to this string query statement and calculates, and successively calculates its high-order index according to this index result of calculation; And this high-order index dynamically filled; Then the report data that obtains is stored in the metadata cache storehouse 5, comprising: index computing unit 401 receives the data processing query statement stream that report form processing decomposer 2 imports into, sequential read instruction fetch; The data that whether have this index, querying condition in the inquiry achievement data storage unit 501; If exist, then from achievement data storage unit 501, directly read the data of this index, and be stored in the form result cache unit 503; If do not exist; Then inquire about the padding data that whether has this index numbering in the padding data storage unit 502; If exist; Then calculate the remaining low order data of this index, accomplish the filling of this index, and with this achievement data store in the achievement data storage unit 501 with form result cache unit 503 in; If do not exist; Then should refer to target value according to the index algorithm of index property store unit 303 and the querying condition calculating in the instruction; Then this achievement data is stored in achievement data storage unit 501 and the form result cache unit 503; Index computing unit 401 imports this achievement data into high-order index filler cells 402 simultaneously, and the high-order index of 402 pairs of these indexs of high-order index filler cells is filled.
In the such scheme, the high-order index of 402 pairs of these indexs of said high-order index filler cells is filled, and comprising:
Step 300, high-order index filler cells 402 receives the achievement data that index computing unit 401 imports into;
Step 301, high-order index filler cells 402 are judged the direct high-order index that whether has this index, this querying condition in the padding data storage unit 502, if exist, change step 304; If do not exist, change step 302;
Step 302, high-order index filler cells 402 concerns that according to index storage unit 304 finds out the corresponding direct high-order index of this index;
Step 303, high-order index filler cells 402 judge whether this index exists direct high-order index, change step 304 if exist; If do not exist, change step 307;
Step 304, high-order index filler cells 402 just this index value are filled under the corresponding high-order index, and upgrade the high-order index and fill saturation degree;
Step 305, high-order index filler cells 402 judge whether this direct high-order index filling saturation degree is saturated, if change step 306; If, do not change step 307;
Step 306 stores the desired value of this high-order index into achievement data storage unit 501, and all data of this high-order index in the deletion padding data storage unit 502, changes step 301;
All there are not the situation that can continue to fill in step 307, all indexs, and flow process finishes.
(3) beneficial effect
Can find out that from technique scheme the present invention has following beneficial effect:
1, the device and method of realization Data Dynamic caching process provided by the invention; Press data target granularity layering processing through adopting; Common data is carried out buffer memory, shares; And press data target technical finesse means such as fillings upwards dynamically successively, overcome in the present report data processing and had data re-treatment, repeated storage, the problem that data-handling efficiency is low, redundant storage causes system resource waste.
2, the device and method of realization Data Dynamic caching process provided by the invention; Report form index is carried out logic split laggard line data processing; Avoided carrying out double counting for identical index in the different forms, it is fully shared that data are obtained, and improved report query efficient.
3, the device and method of realization Data Dynamic caching process provided by the invention; Index hierarchical system and dynamically filling mechanism have made full use of the common point between the different level indexs; Make existing low order achievement data obtain fully multiplexing; Reduce the cost that recomputates of high-order index, improved report query efficient.
4, the device and method of realization Data Dynamic caching process provided by the invention has been realized the indexing storage of report data, has effectively reduced data redundancy.
Description of drawings
Fig. 1 is the structural representation of realization Data Dynamic buffer processing device provided by the invention;
Fig. 2 is the structural representation according to the data administrator of the embodiment of the invention;
Fig. 3 is the structural representation according to the data processing equipment of the embodiment of the invention;
Fig. 4 is the structural representation according to the metadata cache storehouse of the embodiment of the invention;
Fig. 5 is the method flow diagram of realization Data Dynamic caching process provided by the invention;
Fig. 6 is the method flow diagram according to the data processing equipment of the embodiment of the invention;
Fig. 7 is the method flow diagram of dynamically filling according to the high-order index of the embodiment of the invention.
Embodiment
For making the object of the invention, technical scheme and advantage clearer, below in conjunction with specific embodiment, and with reference to accompanying drawing, to further explain of the present invention.
The device and method of realization Data Dynamic caching process provided by the invention, at first, this device generates statistical items parameter list and statistical rules parameter list according to the implication and the statistical rules of service logic definition operational indicator.Secondly, generate corresponding report form index according to different form logics, statistical rules, and computing formula and fill rule are provided.During report query; This device at first obtains the report messages of user inquiring through inquiry unit, the report form processing decomposer receives user's request, parsed query terms and visit data management devices; After obtaining predefine information such as the corresponding index of form, statistical rules; The visit data treating apparatus carries out the calculating of index and the filling of index, and the data after will handling at last are filled in the metadata cache storehouse, and represent through report form showing device.
At first the involved term of this paper is described:
Statistical items---refer to have data statistics item uniqueness, that professional implication is clear and definite, like amount, remaining sum, stroke count etc.
The index dimension---refer to be used for one type of statistical approach of counting statistics item, like date dimension, regional dimension etc.
Index---refer to have statistical items uniqueness, fixed in dimension, like personal loan normal balance, full row transaction stroke count etc.Statistical items is that professional implication is clear and definite, and index has definite dimension, therefore also has definite statistical rules.
The index rank---for the index with identical statistical items, (for example A is every month personal loan normal balance, and B is every month personal loan remaining sum if the index dimension of index A is gathered the index dimension set that really comprises index B; The as if statistics item is a remaining sum; The dimension of A is except every month, beyond the individual, Duoed one normal (Pyatyi classification) than B; There is such relation between them; Normal balance+secondary remaining sum+concern remaining sum+suspicious remaining sum+loss remaining sum=remaining sum), then A is the low order index of B, and B is the high-order index of A; If the index dimension of A and B not exclusively comprises (for example A is every month personal loan normal balance, and B is every month secondary remaining sum of personal loan) mutually, then A and B are the same order indexs.If the set of the index dimension of index A really comprises the index dimension set of index B; And in whole index set, there is not index C, makes the index dimension set of index A really comprise the index dimension set of index C; The index dimension set of index C really comprises the index dimension of index B and (for example gathers; The dimension set of index A is Z1, Z2, Z3, Z4, and the dimension set of index B is Z1, Z2, and does not have the index C of dimension set for Z1, Z2, Z3); Then index A is the direct low order index of index B, and index B is the direct high-order index of index A.
Index is filled---refer to the low order achievement data progressively is transformed into the process of high-order achievement data.
The contrast accompanying drawing specifically describes below:
Fig. 1 is the structural representation of realization Data Dynamic buffer processing device provided by the invention, and this device comprises inquiry unit 1, report form processing decomposer 2, data administrator 3, data processing equipment 4, metadata cache storehouse 5 and report form showing device 6.Wherein, inquiry unit 1 is connected in report form processing decomposer 2, is used to realize mutual between report form processing decomposer 2 and report query user.Report form processing decomposer 2; Be connected to inquiry unit 1, data administrator 3 and data processing equipment 4; Be used to receive the report query instruction of importing into from inquiry unit 1; Many the index query statements that it comprises are resolved in the instruction of this report query, then will many index query statements form a string query statement again and flow, and should go here and there query statement and spread into data processing equipment 4.Data administrator 3 is connected to report form processing decomposer 2, data processing equipment 4 and report form showing device 6, is used to provide the foundation of logical process, data processing.Data processing equipment 4 is connected to report form processing decomposer 2, data administrator 3, metadata cache storehouse 5 and report form showing device 6, is used for carrying out index calculating, high-order index according to query statement and dynamically fills and the report data storage operation.Metadata cache storehouse 5 is connected to data processing equipment 4 and report form showing device 6, is used for the memory buffers data.Report form showing device 6 is connected to data administrator 3, data processing equipment 4 and metadata cache storehouse 5, to the user report form showing interface is provided, and carries out report form showing according to the data in metadata cache storehouse 5 and the report form sample of data administrator 3.
Inquiry unit 1 provides the report query interface to the user; Receive the querying conditions (identical) such as form frequency, statement dates, organization names, report form showing unit of user's input, and import these querying condition information into report form processing decomposer 2 with index dimension implication.
Report form processing decomposer 2; Be connected to data administrator 3 and data processing equipment 4; Be used to receive the report query instruction of importing into from inquiry unit 1; Many the index query statements that it comprises are resolved in the instruction of this report query, then many index query statements are formed a string instruction stream again, and should go here and there instruction stream and import data processing equipment 4 into.Thereby will inquire about a form, become a plurality of indexs of inquiry.Like this, in follow-up processing, the identical index that just can utilize other forms to calculate realizes that achievement data is shared.Concrete treatment scheme is following:
After report form processing decomposer 2 receives report query conditions; The index inventory relevant in the report form index storage unit 303 according to report number reading of data management devices 3 with this form; Again according to the dimension numbering combination in the index storage unit 304 of the index of each index numbering reading of data management devices 3; Be combined into the index dimension values with numbering corresponding value with dimension in the querying condition, import data processing equipment 4 into the form of data processing instructions stream at last.
Illustrate: the form of being inquired about is an XX business day trading volume; Querying condition is date 20100101, area 9999, Currency Type 001, professional big type 01, sub category of business 02; This form relates to 2 indexs: big type amount (index numbering 1001), group amount (index numbering 1002); The dimension of wherein big type of amount is combined as: date, area, proportion, professional big class; The dimension of group amount is combined as: date, area, proportion, sub category of business, and then instruction stream is: 1001,20100101|9999|001|01; 1002,20100101|9999|001|02.
Fig. 2 is the structural representation according to the data administrator of the embodiment of the invention; Data administrator comprises that report form sample storage unit 301, form property store unit 302, index property store unit 303 and index concern storage unit 304; These 4 unit are separate, are connected in report form processing decomposer 2, data processing equipment 4 and report form showing device 6 respectively.
Report form sample storage unit 301 is used to store the table appearance of form when empty data.
Sequence number Domain name Remarks
1 Report number Major key
2 Report form sample
Form property store unit 302 is used to store the corresponding relation of form and index.
Sequence number Domain name Remarks
1 Report number Major key
2 The form English name
3 Report description (RD)
4 The index numbering Major key
Index property store unit 303 is used to store the attribute information of index.
Sequence number Domain name Remarks
1 The index numbering Major key
2 The statistical items numbering
3 The combination of dimension numbering
4 The statistical rules numbering
5 The index computing formula
Index concerns storage unit 304, is used to store the corresponding relation of index and its high-order index.
Sequence number Domain name Remarks
1 The index numbering Major key
2 Directly the high-order index is numbered Major key
Fig. 3 is the structural representation according to the data processing equipment of the embodiment of the invention; This data processing equipment 4 is made up of with high-order index filler cells 402 interconnective index computing unit 401; Wherein, 401 pairs of achievement datas of this index computing unit calculate, and are sending to high-order index filler cells 402 and fill instruction achievement data being calculated the back that finishes, and are successively calculated by the index of the more high-order of 402 pairs of these indexs of high-order index filler cells.
401 pairs of achievement datas of index computing unit calculate, and comprising: the query statement stream that data administrator 3 is imported into is that Partition of Unity becomes a plurality of instructions with the index, and is that unit calculates with the index; In index computation process, if this index in other forms, calculate, so then need not double counting, directly from metadata cache storehouse 5, read, to realize data sharing; For each index that newly calculates, it is initiatively inserted metadata cache storehouse 5, realize with the index being that unit stores, reduce data redundancy; In case all indexs of this form are calculated and are accomplished, and deposit report data in metadata cache storehouse 5.
The achievement data that high-order index filler cells 402 obtains according to index computing unit 401 successively calculates its high-order index; Comprise: its direct high-order index of mark sense to calculating completion is filled, and its direct high-order indication information is kept at metadata cache storehouse 5; Finish in case certain high-order index is filled, automatically it is saved to metadata cache storehouse 5, and deletes this high-order index all records in metadata cache storehouse 5, to reduce data redundancy; Continue simultaneously to fill, thereby realize of the successively filling of low order index to the high-order index to the direct high-order index of this high-order index.
Filling is meant the computing formula according to the high-order index, utilizes its low order desired value that has obtained to calculate the process values of high-order index, all obtains until all low order indexs, calculates the end value of high-order index, then fills and accomplishes.
Fig. 4 is the structural representation according to the metadata cache storehouse of the embodiment of the invention; This metadata cache storehouse 5 is made up of achievement data storage unit 501, padding data storage unit 502 and report data storage unit 503; These 3 unit are separate, are connected in data processing equipment 4 and report form showing device 6 respectively.
Achievement data storage unit 501, being used for index and querying condition is unit storage index value, makes the identical index that uses in the different forms obtain data sharing.Its storage format is following:
Figure BDA0000042885870000111
Padding data storage unit 502 is used to store the intermediate result that current achievement data is filled to direct high-order achievement data.Its major function is the results of intermediate calculations of storage index, makes carrying out the statistics that index can multiplexing other approach in calculating, and only to the calculating of different dimensions, it is minimum that time complexity is dropped to.Its storage format is following:
Figure BDA0000042885870000112
Report data storage unit 503 is used to store the result data of current inquiry form, and retention cycle is that report form index is calculated to finish and finished to report query.Its major function is the result that structured storage report form showing need be used.Its storage format is following:
Sequence number Domain name Remarks
1 Report number Major key
2 Querying condition Major key
3 The form result
Based on the device of Fig. 1 to realization Data Dynamic caching process shown in Figure 4; Fig. 5 shows the method flow diagram of realization Data Dynamic caching process provided by the invention; This method comprises: report form processing decomposer 2 receives the report query instruction of importing into from inquiry unit 1; Many the index query statements that it comprises are resolved in this report query instruction, then many index query statements are formed a string query statement again and spread into data processing equipment 4; Data processing equipment 4 flows to row index according to this string query statement and calculates, and successively calculates its high-order index according to this index result of calculation, and this high-order index is dynamically filled, and then the report data that obtains is stored in the metadata cache storehouse 5; And report form showing device 6 is carried out report form showing according to the data in metadata cache storehouse 5 and the report form sample of data administrator 3.Specify the step that the present invention realizes the Data Dynamic method for caching and processing below:
Step 100, the report query user imports report query conditions in inquiry unit 1.
Step 101, inquiry unit 1 receives the querying condition of user's input, imports in the report form processing decomposer 2.
Step 102; Report form processing decomposer 2 receives the report query conditions that imports into from inquiry unit 1; Visit form property store unit 302, the corresponding relation of acquisition form and index resolves into a plurality of index query statements that it comprises with this report query instruction; Then many index query statements are formed a string instruction stream again, import instruction stream into data processing equipment 4.
Step 103, data processing equipment 4 receives instruction streams, and visit data buffer memory storehouse 5 carries out that index is calculated and index is filled, and result of calculation is stored in metadata cache storehouse 5, and the desired value that will satisfy querying condition forms result set and is stored in the metadata cache storehouse 5.
Step 104, the caching report result in the report form showing device 6 visit data buffer memory storehouses 5 carries out report form showing.
Fig. 6 is the method flow diagram according to the data processing equipment of the embodiment of the invention, i.e. the refinement of step 103 among Fig. 5.
Step 200, index computing unit 401 receive the data processing instructions stream that imports in the report form processing decomposer 2.
Step 201, the 401 sequential read instruction fetch of index computing unit.
Step 202, whether index computing unit 401 decision instructions stream finishes, if finish, changes step 211, if do not finish, changes step 203.
Whether step 203 exists the data of this index, querying condition in the index computing unit 401 inquiry achievement data storage unit 501, if exist, then this index need not to calculate, and changes step 204; If do not exist, then this index needs further to calculate, and changes step 205.
Step 204, index computing unit 401 directly read the data of this index from achievement data storage unit 501, and are stored in the form result cache unit 503, change step 201.
Whether step 205 exists the padding data of this index numbering in the index computing unit 401 inquiry padding data storage unit 502, if exist, changes step 206; If do not exist, change step 207.
Step 206, index computing unit 401 calculates the remaining low order data of this index, accomplishes the filling of this index, changes step 208.
Step 207, index computing unit 401 should refer to target value according to the index algorithm of index property store unit 303 and the querying condition calculating in the instruction.
Step 208, index computing unit 401 with this achievement data store in the achievement data storage unit 501 with form result cache unit 503 in.
Step 209, index computing unit 401 imports this achievement data into high-order index filler cells 402, changes step 210.
Step 210, the high-order index of 402 pairs of these indexs of high-order index filler cells is filled, and changes step 201.
Step 211, all data processing instructions are finished, and flow process finishes.
Fig. 7 is the method flow diagram of dynamically filling according to the high-order index of the embodiment of the invention, i.e. the refinement of step 210 among Fig. 6.
Step 300, high-order index filler cells 402 receives the achievement data that index computing unit 401 imports into.
Step 301, high-order index filler cells 402 are judged the direct high-order index that whether has this index, this querying condition in the padding data storage unit 502, if exist, change step 304; If do not exist, change step 302.
Step 302, high-order index filler cells 402 concerns that according to index storage unit 304 finds out the corresponding direct high-order index of this index.
Step 303, high-order index filler cells 402 judge whether this index exists direct high-order index, change step 304 if exist; If do not exist, change step 307.
Step 304, high-order index filler cells 402 just this index value are filled under the corresponding high-order index, and upgrade the high-order index and fill saturation degree.
Step 305, high-order index filler cells 402 judge whether this direct high-order index filling saturation degree is saturated, if change step 306; If, do not change step 307.
Step 306 stores the desired value of this high-order index into achievement data storage unit 501, and all data of this high-order index in the deletion padding data storage unit 502, changes step 301.
All there are not the situation that can continue to fill in step 307, all indexs, and flow process finishes.
Below be an embodiment:
Personal loan traffic volume measurement daily sheet (report number is R1001), report query conditions is following:
Sequence number Querying condition (index dimension) Value
1 Statement dates ?20100101
2 The area ?8888
3 Currency Type ?0001
4 Loan limit ALL (full loan limit)
The index that this form is corresponding is following:
Indication information in the index property store unit 303 is following:
Sequence number Domain name Remarks
1 The index numbering ?Z1001
2 The statistical items numbering ?T1000
3 The combination of dimension numbering ?DATE|ZONE|CUR|RANGE
4 The statistical rules numbering ?R1001
5 The index computing formula ?DATE=:1&ZONE=:2&CUR=:3&RANGE=’01’
Sequence number Domain name Remarks
1 The index numbering ?Z1002
2 The statistical items numbering ?T1000
3 The combination of dimension numbering ?DATE|ZONE|CUR|RANGE
4 The statistical rules numbering ?R1002
5 The index computing formula ?DATE=:1&ZONE=:2&CUR=:3&RANGE=’02’
Sequence number Domain name Remarks
1 The index numbering ?Z2001
2 The statistical items numbering ?T1000
3 The combination of dimension numbering ?DATE|ZONE|CUR
4 The statistical rules numbering ?R2001
5 The index computing formula ?DATE=:1&ZONE=:2&CUR=’0001’
Sequence number Domain name Remarks
1 The index numbering ?Z2002
2 The statistical items numbering ?T1000
3 The combination of dimension numbering ?DATE|ZONE|CUR
4 The statistical rules numbering ?R2001
5 The index computing formula ?DATE=:1&ZONE=:2&CUR=’0002’
Sequence number Domain name Remarks
1 The index numbering ?Z3001
2 The statistical items numbering ?T1000
3 The combination of dimension numbering ?DATE|ZONE
4 The statistical rules numbering ?R3001
5 The index computing formula ?DATE=:1&ZONE=:2
Index concerns that the information of storage unit 304 is following:
Sequence number Domain name Remarks
1 The index numbering ?Z1001
2 Directly the high-order index is numbered ?Z2001
Sequence number Domain name Remarks
1 The index numbering ?Z1002
2 Directly the high-order index is numbered ?Z2001
Sequence number Domain name Remarks
1 The index numbering ?Z2001
2 Directly the high-order index is numbered ?Z3001
Sequence number Domain name Remarks
1 The index numbering ?Z2002
2 Directly the high-order index is numbered ?Z3001
Achievement data in the existing achievement data storage unit 501 is following:
Sequence number Domain name Value
1 The index numbering Z1001
2 Querying condition 20100101|8888|0001|01
3 Desired value 2000000
The index padding data that comprises in the existing padding data storage unit 502 is following:
Sequence number Domain name Value
1 Target index numbering Z2001
2 Source index numbering collection Z1001|Z1002
3 Querying condition 20100101|8888|0001
4 The index saturation degree 10
5 Current desired value 2000000
The step of this report query is following:
1, report form processing decomposer 2 generates data processing instructions stream:
Sequence number The index numbering Querying condition
1 Z1001 20100101|8888|0001|01
2 Z1002 20100101|8888|0001|02
3 Z2001 20100101|8888|0001
2, index computing unit 401 is accepted this 3 instruction streams.
3, index computing unit 401 is handled Z1001, the instruction of 20100101|8888|0001|01.
4, index computing unit 401 is searched achievement data storage unit 501; Find index to be numbered Z1001; Querying condition is the record of 20100101|8888|0001|01; Then this index need not recomputate, and directly the result is saved in (R1001,20100101|8888|0001|2000000 in the report data storage unit 503; ).
5, index computing unit 401 continues to handle next bar instruction Z1002,20100101|8888|0001|02.
6, index computing unit 401 is searched achievement data storage unit 501, does not find index to be numbered Z1002, and querying condition is the record of 20100101|8888|0001|02.
7, index computing unit 401 is searched padding data storage unit 502, does not find the target index to be numbered Z1002, and querying condition is the record of 20100101|8888|0001|02.
8, index computing unit 401 calculates the Z1002 index according to the computing formula of definition in the index property store unit 303; Draw desired value 3000000; And the result is saved in the report data storage unit 503 (R1001,20100101|8888|0001|2000000|3000000).
9, because the 20100101|8888|0001|02 dimension of index Z1002 has been accomplished calculating, index computing unit 401 is assigned to high-order index filler cells 402 and is filled instruction.
10, high-order index filler cells 402 is searched padding data storage unit 502, has found index numbering in source to concentrate to comprise Z1002 and querying condition is the record of 20100101|8888|0001, then this record is filled.
11, high-order index filler cells 402 will be filled the result and will be updated in the padding data storage unit 502, and the result is following:
Sequence number Domain name Value
1 Target index numbering Z2001
2 Source index numbering collection Z1001|Z1002
3 Querying condition 20100101|8888|0001
4 The index saturation degree 11
5 Current desired value 5000000
12, because the index saturation degree of target index numbering Z2001 is saturated; Then with Z2001; Querying condition is that the value of 20100101|8888|0001 stores in the achievement data storage unit 501, and the target index is numbered all records of Z2001 in the deletion padding data storage unit 502.
13, because the 20100101|8888|0001 dimension of index Z2001 has been accomplished calculating, index computing unit 401 is assigned to high-order index filler cells 402 and is filled instruction.
14, high-order index filler cells 402 is searched padding data storage unit 502, has not found index numbering in source to concentrate to comprise Z2001 and querying condition is the record of 20100101|8888.
15, high-order index filler cells 402 is searched index and is concerned storage unit 304, finds the direct high-order index Z3001 of Z2001, and all direct low order indexs of this high-order index: Z2001, Z2002.
16, high-order index filler cells 402 is with index Z2001, and querying condition is that the value of 20100101|8888 is filled, and the data of filling in the back padding data storage unit 502 are following:
Sequence number Domain name Value
1 Target index numbering Z3001
2 Source index numbering collection ?Z2001|Z2002
3 Querying condition ?20100101|8888
4 The index saturation degree ?10
5 Current desired value ?5000000
17, since the saturation degree of target index numbering Z3001 less than, then fill and stop.
18, index computing unit 401 continues to handle next bar instruction Z2001,20100101|8888|0001.
19, index computing unit 401 is searched achievement data storage unit 501; Find index to be numbered Z2001; Querying condition is the record of 20100101|8888|0001; Then this index need not recomputate, directly the result is saved in the report data storage unit 503 (R1001,20100101|8888|0001|2000000|3000000|5000000).
20, all data query instructions are finished; Report form showing device 6 reads report form sample storage unit 301 and obtains report form sample (masterplate form; Promptly do not have concrete data), and read report data in the report data storage unit 503, in proper order (from left to right; From top to bottom) numerical value is inserted in the report form sample, carried out report form showing.
Above-described specific embodiment; The object of the invention, technical scheme and beneficial effect have been carried out further explain, and institute it should be understood that the above is merely specific embodiment of the present invention; Be not limited to the present invention; All within spirit of the present invention and principle, any modification of being made, be equal to replacement, improvement etc., all should be included within protection scope of the present invention.

Claims (15)

1. a device of realizing the Data Dynamic caching process is characterized in that, this device comprises inquiry unit (1), report form processing decomposer (2), data administrator (3), data processing equipment (4), metadata cache storehouse (5) and report form showing device (6), wherein:
Inquiry unit (1) is connected in report form processing decomposer (2), is used to realize mutual between report form processing decomposer (2) and report query user;
Report form processing decomposer (2); Be connected to inquiry unit (1), data administrator (3) and data processing equipment (4); Be used for receiving the report query instruction of importing into from inquiry unit (1); Many the index query statements that it comprises are resolved in the instruction of this report query, then will many index query statements form a string query statement again and flow, and should go here and there query statement and spread into data processing equipment (4);
Data administrator (3) is connected to report form processing decomposer (2), data processing equipment (4) and report form showing device (6), is used to provide the foundation of logical process, data processing;
Data processing equipment (4); Be connected to report form processing decomposer (2), data administrator (3), metadata cache storehouse (5) and report form showing device (6), be used for carrying out index calculating, high-order index and dynamically fill and the report data storage operation according to query statement;
Metadata cache storehouse (5) is connected to data processing equipment (4) and report form showing device (6), is used for the memory buffers data;
Report form showing device (6); Be connected to data administrator (3), data processing equipment (4) and metadata cache storehouse (5); To the user report form showing interface is provided, carries out report form showing according to the data of metadata cache storehouse (5) and the report form sample of data administrator (3).
2. the device of realization Data Dynamic caching process according to claim 1; It is characterized in that; Said inquiry unit (1) provides the report query interface to the user; Receive the querying condition of user's input, this querying condition comprises form frequency, statement dates, organization names and report form showing unit at least, and imports this querying condition information into report form processing decomposer (2).
3. the device of realization Data Dynamic caching process according to claim 1; It is characterized in that; After said report form processing decomposer (2) receives report query conditions; According to index inventory relevant in the report number reading of data management devices (3) with this form; According to the dimension numbering combination in the index numbering reading of data management devices (3) of each index, be combined into the index dimension values again, import data processing equipment (4) into the form of data processing query statement stream at last numbering corresponding value with dimension in the querying condition.
4. the device of realization Data Dynamic caching process according to claim 1; It is characterized in that; Said data administrator (3) comprises that report form sample storage unit (301), form property store unit (302), index property store unit (303) and index concern storage unit (304); These 4 unit are separate, are connected in report form processing decomposer (2), data processing equipment (4) and report form showing device (6) respectively, wherein:
Report form sample storage unit (301) is used to store the table appearance of form when empty data;
Form property store unit (302) is used to store the corresponding relation of form and index;
Index property store unit (303) is used to store the attribute information of index;
Index concerns storage unit (304), is used to store the corresponding relation of index and its high-order index.
5. the device of realization Data Dynamic caching process according to claim 1; It is characterized in that; Said data processing equipment (4) is made up of interconnective index computing unit (401) and high-order index filler cells (402), and wherein, this index computing unit (401) calculates achievement data; In that the filling instruction is sent to high-order index filler cells (402) in achievement data calculating finishing back, the index of the more high-order of this index is successively calculated by high-order index filler cells (402).
6. the device of realization Data Dynamic caching process according to claim 5 is characterized in that, said index computing unit (401) calculates achievement data, comprising:
The query statement stream that data administrator (3) is imported into is that Partition of Unity becomes a plurality of instructions with the index, and is that unit calculates with the index; In index computation process, if this index in other forms, calculate, so then need not double counting, directly from metadata cache storehouse (5), read, to realize data sharing; For each index that newly calculates, it is initiatively inserted metadata cache storehouse (5), realize with the index being that unit stores, reduce data redundancy; In case all indexs of this form are calculated and are accomplished, and deposit report data in metadata cache storehouse (5).
7. the device of realization Data Dynamic caching process according to claim 5 is characterized in that, the achievement data that said high-order index filler cells (402) obtains according to index computing unit (401) successively calculates its high-order index, comprising:
Its direct high-order index of mark sense to calculating completion is filled, and its direct high-order indication information is kept at metadata cache storehouse (5); Finish in case certain high-order index is filled, automatically it is saved to metadata cache storehouse (5), and deletes this high-order index all records in metadata cache storehouse (5), to reduce data redundancy; Continue simultaneously to fill, thereby realize of the successively filling of low order index to the high-order index to the direct high-order index of this high-order index.
8. the device of realization Data Dynamic caching process according to claim 7; It is characterized in that; Said filling is the computing formula according to the high-order index; The achievement data that utilizes high-order index filler cells (402) to obtain successively calculates the high-order index corresponding with this layer achievement data, until calculating the high-order index corresponding with top achievement data, then fills and accomplishes.
9. the device of realization Data Dynamic caching process according to claim 1; It is characterized in that; Said metadata cache storehouse (5) is made up of achievement data storage unit (501), padding data storage unit (502) and report data storage unit (503); These 3 unit are separate, are connected in data processing equipment (4) and report form showing device (6) respectively, wherein:
Achievement data storage unit (501), being used for index and querying condition is unit storage index value, makes the identical index that uses in the different forms obtain data sharing;
Padding data storage unit (502) is used to store the intermediate result that current achievement data is filled to direct high-order achievement data;
Report data storage unit (503) is used to store the result data of current inquiry form, and retention cycle is that report form index is calculated to finish and finished to report query.
10. method that realizes the Data Dynamic caching process is applied to the device of the described realization Data Dynamic of claim 1 caching process, it is characterized in that this method comprises:
Report form processing decomposer (2) receives the report query instruction of importing into from inquiry unit (1); Many the index query statements that it comprises are resolved in this report query instruction, then many index query statements are formed a string query statement again and spread into data processing equipment (4);
Data processing equipment (4) flows to row index according to this string query statement and calculates, and successively calculates its high-order index according to this index result of calculation, and this high-order index is dynamically filled, and then the report data that obtains is stored in the metadata cache storehouse (5); And
Report form showing device (6) is carried out report form showing according to the data of metadata cache storehouse (5) and the report form sample of data administrator (3).
11. the method for realization Data Dynamic caching process according to claim 10; It is characterized in that; Said report form processing decomposer (2) receives the report query instruction of importing into from inquiry unit (1); Many the index query statements that it comprises are resolved in this report query instruction, then many index query statements are formed a string query statement again and spread, comprising into data processing equipment (4):
After the report query that said report form processing decomposer (2) reception is imported into from inquiry unit (1) instructs; According to index inventory relevant in the report number reading of data management devices (3) with this form; Again according to the dimension numbering combination in the index numbering reading of data management devices (3) of each index; Be combined into the index dimension values with numbering corresponding value with dimension in the querying condition, import data processing equipment (4) into the form of data processing query statement stream at last.
12. the method for realization Data Dynamic caching process according to claim 10 is characterized in that, said data processing equipment (4) flows to row index according to this string query statement and calculates, and comprising:
The query statement stream that data processing equipment (4) imports data administrator (3) into is that Partition of Unity becomes a plurality of instructions with the index, and is that unit calculates with the index; In index computation process, if this index in other forms, calculate, so then need not double counting, directly from metadata cache storehouse (5), read, to realize data sharing; For each index that newly calculates, it is initiatively inserted metadata cache storehouse (5), realize with the index being that unit stores, reduce data redundancy; In case all indexs of this form are calculated and are accomplished, and deposit report data in metadata cache storehouse (5).
13. the method for realization Data Dynamic caching process according to claim 10 is characterized in that, said data processing equipment (4) successively calculates its high-order index according to this index result of calculation, and this high-order index is dynamically filled, and comprising:
Data processing equipment (4) is filled its direct high-order index of mark sense of calculating completion, and its direct high-order indication information is kept at metadata cache storehouse (5); Finish in case certain high-order index is filled, automatically it is saved to metadata cache storehouse (5), and deletes this high-order index all records in metadata cache storehouse (5), to reduce data redundancy; Continue simultaneously to fill, thereby realize of the successively filling of low order index to the high-order index to the direct high-order index of this high-order index.
14. the method for realization Data Dynamic caching process according to claim 10; It is characterized in that; Said data processing equipment (4) is made up of interconnective index computing unit (401) and high-order index filler cells (402), and said metadata cache storehouse (5) is made up of achievement data storage unit (501), padding data storage unit (502) and report data storage unit (503), and said data processing equipment (4) flows to row index according to this string query statement and calculates; Successively calculate its high-order index according to this index result of calculation; And this high-order index dynamically filled, then the report data that obtains is stored in the metadata cache storehouse (5), comprising:
Index computing unit (401) receives the data processing query statement stream that report form processing decomposer (2) imports into; The sequential read instruction fetch; The data that whether have this index, querying condition in the inquiry achievement data storage unit (501); If exist, then from achievement data storage unit (501), directly read the data of this index, and be stored in the form result cache unit (503); If do not exist; Then inquire about the padding data that whether has this index numbering in the padding data storage unit (502); If exist; Then calculate the remaining low order data of this index, accomplish the filling of this index, and with this achievement data store in the achievement data storage unit (501) with form result cache unit (503) in; If do not exist; Then should refer to target value according to the index algorithm of index property store unit (303) and the querying condition calculating in the instruction; Then this achievement data is stored in achievement data storage unit (501) and the form result cache unit (503); Index computing unit (401) imports this achievement data into high-order index filler cells (402) simultaneously, and high-order index filler cells (402) is filled the high-order index of this index.
15. the method for realization Data Dynamic caching process according to claim 14 is characterized in that, said high-order index filler cells (402) is filled the high-order index of this index, comprising:
Step 300, high-order index filler cells (402) receives the achievement data that index computing unit (401) imports into;
Step 301, high-order index filler cells (402) are judged the direct high-order index that whether has this index, this querying condition in the padding data storage unit (502), if exist, change step 304; If do not exist, change step 302;
Step 302, high-order index filler cells (402) concerns that according to index storage unit (304) finds out the corresponding direct high-order index of this index;
Step 303, high-order index filler cells (402) judge whether this index exists direct high-order index, change step 304 if exist; If do not exist, change step 307;
Step 304, high-order index filler cells (402) just this index value are filled under the corresponding high-order index, and upgrade the high-order index and fill saturation degree;
Step 305, high-order index filler cells (402) judge whether this direct high-order index filling saturation degree is saturated, if change step 306; If, do not change step 307;
Step 306 stores the desired value of this high-order index into achievement data storage unit (501), and all data of this high-order index in the deletion padding data storage unit (502), changes step 301;
All there are not the situation that can continue to fill in step 307, all indexs, and flow process finishes.
CN 201110001853 2011-01-06 2011-01-06 Device and method for realizing data dynamic cache Active CN102024062B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN 201110001853 CN102024062B (en) 2011-01-06 2011-01-06 Device and method for realizing data dynamic cache

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN 201110001853 CN102024062B (en) 2011-01-06 2011-01-06 Device and method for realizing data dynamic cache

Publications (2)

Publication Number Publication Date
CN102024062A CN102024062A (en) 2011-04-20
CN102024062B true CN102024062B (en) 2012-12-12

Family

ID=43865359

Family Applications (1)

Application Number Title Priority Date Filing Date
CN 201110001853 Active CN102024062B (en) 2011-01-06 2011-01-06 Device and method for realizing data dynamic cache

Country Status (1)

Country Link
CN (1) CN102024062B (en)

Families Citing this family (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103488688A (en) * 2013-09-02 2014-01-01 用友软件股份有限公司 Cell data cache system and cell data cache method
CN103544259B (en) * 2013-10-16 2017-01-18 国家计算机网络与信息安全管理中心 Aggregating sorting TopK inquiry processing method and system
CN104809130B (en) * 2014-01-27 2019-03-08 腾讯科技(深圳)有限公司 Method, equipment and the system of data query
CN104933299A (en) * 2015-06-03 2015-09-23 浪潮软件集团有限公司 Data processing method and device
CN105357297A (en) * 2015-11-03 2016-02-24 国网技术学院 Data caching system and method
CN106933914A (en) * 2015-12-31 2017-07-07 北京国双科技有限公司 The data processing method and device of many tables of data
CN108572987B (en) * 2017-03-13 2021-10-22 国家新闻出版广电总局广播电视卫星直播管理中心 Business operation control device and method for satellite live television service
CN107038218B (en) * 2017-03-17 2023-11-17 腾讯科技(深圳)有限公司 Report processing method and system
CN108595681B (en) * 2018-05-02 2020-12-18 恒生电子股份有限公司 Method, device and system for displaying form
CN109634992B (en) * 2019-02-20 2019-10-15 北京虹晟信息科技有限公司 A kind of structure of report decomposition method, report form generation method, device
CN110209506B (en) * 2019-05-09 2021-08-17 上海联影医疗科技股份有限公司 Data processing system, method, computer device and readable storage medium
CN112527868A (en) * 2020-12-23 2021-03-19 东莞市盟大塑化科技有限公司 Data acquisition method, device, equipment and storage medium

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1588369A (en) * 2004-09-06 2005-03-02 杭州恒生电子股份有限公司 Relation type data base system and its search and report method
CN1770145A (en) * 2004-11-04 2006-05-10 北京神舟航天软件技术有限公司 Cursor processing system and method
CN1889557A (en) * 2006-07-10 2007-01-03 北京工业大学 Long-distance XML data updating method and system
CN101110074A (en) * 2007-01-30 2008-01-23 浪潮乐金信息系统有限公司 Data speedup query method based on file system caching

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1588369A (en) * 2004-09-06 2005-03-02 杭州恒生电子股份有限公司 Relation type data base system and its search and report method
CN1770145A (en) * 2004-11-04 2006-05-10 北京神舟航天软件技术有限公司 Cursor processing system and method
CN1889557A (en) * 2006-07-10 2007-01-03 北京工业大学 Long-distance XML data updating method and system
CN101110074A (en) * 2007-01-30 2008-01-23 浪潮乐金信息系统有限公司 Data speedup query method based on file system caching

Also Published As

Publication number Publication date
CN102024062A (en) 2011-04-20

Similar Documents

Publication Publication Date Title
CN102024062B (en) Device and method for realizing data dynamic cache
CN102999506B (en) A kind of method and apparatus obtaining user's independent access number
US10691646B2 (en) Split elimination in mapreduce systems
CN103748579B (en) Data are handled in MapReduce frame
US8978034B1 (en) System for dynamic batching at varying granularities using micro-batching to achieve both near real-time and batch processing characteristics
CN101916261B (en) Data partitioning method for distributed parallel database system
CN105989129B (en) Real time data statistical method and device
CN102214176B (en) Method for splitting and join of huge dimension table
Liang et al. Express supervision system based on NodeJS and MongoDB
CN107958080A (en) A kind of big data report processing method based on ElasticSearch
CN103345484A (en) Report form processing system based on dynamic domain and method
CN108376143A (en) A kind of novel OLAP precomputations model and the method for generating precomputation result
CN102402617A (en) Easily compressed database index storage system using fragments and sparse bitmap, and corresponding construction, scheduling and query processing methods
CN106528787A (en) Mass data multi-dimensional analysis-based query method and device
CN104679646B (en) A kind of method and apparatus for detecting SQL code defect
CN103995899A (en) Analysis system for KPI
CN102479217A (en) Method and device for realizing computation balance in distributed data warehouse
CN106844320A (en) A kind of financial statement integration method and equipment
CN102819589A (en) ETL (Extract Transform Load)-based data optimization method and equipment
CN104156505B (en) A kind of Hadoop cluster job scheduling method and devices based on user behavior analysis
CN110737727B (en) Data processing method and system
CN102521413B (en) Data reading device based on network reports and method
CN105468728A (en) Cross-section data acquisition method and system
CN103842990B (en) The method and apparatus of the virtual addressing based on index
US8700822B2 (en) Parallel aggregation system

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant