CN104123303A - Method and device for providing data - Google Patents
Method and device for providing data Download PDFInfo
- Publication number
- CN104123303A CN104123303A CN201310153297.0A CN201310153297A CN104123303A CN 104123303 A CN104123303 A CN 104123303A CN 201310153297 A CN201310153297 A CN 201310153297A CN 104123303 A CN104123303 A CN 104123303A
- Authority
- CN
- China
- Prior art keywords
- data
- index
- identification information
- ids
- common
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2453—Query optimisation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/28—Databases characterised by their database models, e.g. relational or object models
- G06F16/283—Multi-dimensional databases or data warehouses, e.g. MOLAP or ROLAP
Landscapes
- Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computational Linguistics (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a method and device for providing data. The method and device are used for solving the problems that computing resources in a data warehouse are wasted and the data providing efficiency is low in the prior art. The method comprises the steps that general index data are stored in an IDS of the data warehouse in advance; when the data warehouse receives a data obtaining request sent by a user, the general index data stored in the IDS in advance are directly searched for general index data corresponding to index identification information carried in the data obtaining request, and the general index data are provided for the user. According to the method, when the data warehouse provides the general index data for the user, the general index data stored in the IDS in advance can be directly provided for the user, and the steps that source data are processed from the ODS at the bottommost layer upwards layer by layer to obtain the index data, and then the obtained index data are provided for the user are not needed, so that the computing resources of the data warehouse are effectively saved, and the data providing efficiency is improved.
Description
Technical field
The application relates to field of computer technology, particularly a kind of method and device that data are provided.
Background technology
At present, data warehouse is mainly divided into four layers: source data layer (ODS), view layer (BDS), the wide top layer of theme (IDS), application layer (ADS).This logic hierarchical relationship of four layers is from top to bottom successively: ADS, IDS, BDS, ODS.
In the prior art, when user need to obtain some achievement data according to it, data warehouse needs first from ODS, to extract corresponding source data, by BDS, the source data of extracting is carried out to data cleansing again, then need to the data after cleaning be calculated and be gathered according to user by IDS, obtain the required achievement data of user, finally by ADS, the required achievement data of user being offered can be to user.
Wherein, achievement data refers to some source data in data warehouse is carried out to the data that counting statistics obtains according to certain dimension, as, according to the transaction data (source data) in data warehouse nearest 1 month, add up the order amount of money in nearest one month, this order amount of money is exactly the achievement data obtaining.
Yet, in the prior art, whether the achievement data no matter each user will obtain is identical, data warehouse all need to be from the ODS of the bottom, through ODS, BDS, IDS, ADS, corresponding achievement data could be offered to user successively, this obviously can waste a large amount of computational resource of data warehouse, has also reduced the efficiency that data are provided.
Summary of the invention
The embodiment of the present application provides a kind of method and device that data are provided, and in order to solve the computational resource of wasting data warehouse in prior art, provides the lower problem of efficiency of data.
A kind of method that data are provided that the embodiment of the present application provides, comprising:
In advance the source data of preserving in data warehouse is added up, obtain common index data, the common index data that obtain are kept in the wide top layer IDS of theme of described data warehouse;
When described data warehouse receives data acquisition request, determine the index identification information carrying in described data acquisition request; And
According to described index identification information, in the common index data of preserving at described IDS, search the common index data that described index identification information is corresponding; And
The common index data that find are offered to the user who sends described data acquisition request.
A kind of device that data are provided that the embodiment of the present application provides, comprising:
The wide top layer IDS of theme, in advance source data being added up, obtains common index data and preserves;
Receiver module, for receiving data acquisition request, and determines the index identification information carrying in described data acquisition request;
Search module, for according to described index identification information, in the common index data of preserving at described IDS, search the common index data that described index identification information is corresponding;
Provide module, for the common index data that find being offered to the user who sends described data acquisition request.
The embodiment of the present application provides a kind of method and device that data are provided, the method is preserved common index data in advance in the IDS of data warehouse, when data warehouse receives the data acquisition request of user's transmission, the common index data of directly preserving in advance from IDS, search the common index data corresponding to index identification information of carrying in this data acquisition request, and offer user.Pass through said method, data warehouse is when providing common index data to user, can directly the common index data that are kept in advance in IDS be offered to user, and without source data is started successively upwards to process to obtain achievement data from the ODS of the bottom, offer again user, therefore can effectively save the computational resource of data warehouse, also improve the efficiency that data are provided.
Accompanying drawing explanation
The data warehouse that Fig. 1 provides for the embodiment of the present application provides the process of data;
The apparatus structure schematic diagram that data are provided that Fig. 2 provides for the embodiment of the present application.
Embodiment
In order to save the computational resource of data warehouse, also improving data warehouse provides the efficiency of data, in the embodiment of the present application, in advance common index data are kept in IDS, when common index data are provided, the corresponding common index data that can directly IDS be preserved offer user.
Below in conjunction with accompanying drawing, the application is preferred embodiment elaborated.
The data warehouse that Fig. 1 provides for the embodiment of the present application provides the process of data, specifically comprises the following steps:
S101: in advance the source data of preserving in data warehouse is added up, obtain common index data, the common index data that obtain are kept in the IDS of data warehouse.
In the embodiment of the present application, data warehouse can be added up the source data being kept in ODS in advance, obtains common index data, and is kept in IDS.
Concrete, business-subject table can be set in advance in IDS, and the subordinate relation of each business-subject table and index identification information, source data is added up and obtained after common index data, can determine the affiliated business-subject table of index identification information of the common index data that obtain, and the common index data that obtain are kept in definite business-subject table.
Wherein, owing to being user's service data mostly in the source data of data warehouse, as user's payment operation, reimbursement operation, registration operation, register, clicking operation etc., and in service data, all can carry corresponding action type information, therefore, while presetting business-subject table in IDS, for a business-subject table, this business-subject table can be associated with at least one action type information, but a kind of action type information is only associated with a unique business-subject table, , different action type information is carried out to strict division according to the business-subject table under it.
For example, default business-subject table is transaction subject heading list, and payment operation and reimbursement operate these two action type information and be set to be associated with this transaction subject heading list.It should be noted that, once be provided with payment operation and reimbursement operation, be associated with this transaction subject heading list, these two action type information are just no longer associated with other business-subject table (as browse themes table).
Adopt said method to be provided with after the incidence relation of each business-subject table and action type information, can be for each default business-subject table, determine the action type information being associated with this business-subject table, index identification information corresponding to each common index data obtaining according to the source data statistics of carrying definite action type information is defined as to the index identification information under this business-subject table.
Continue along using example, because payment operation is associated with transaction subject heading list, index identification information corresponding to common index data that the source data that is payment operation according to the action type information of carrying statistics obtains comprises payment order numbers and Payment Amount, therefore, the subject heading list of concluding the business exactly of the business-subject table under payment order numbers and Payment Amount.Similarly, because reimbursement operation is associated with transaction subject heading list, index identification information corresponding to common index data that the source data statistics that is reimbursement operation according to the action type information of carrying obtains comprises reimbursement order numbers and refund amount, therefore the business-subject table under, reimbursement order numbers and refund amount is also transaction subject heading list.
Like this, each common index data is also strictly divided under business-subject table according to corresponding action type information.
Further, in IDS, preset after the index identification information under business-subject table, the action type information being associated and each business-subject table, can in each business-subject table of IDS, preserve the common index data that corresponding index identification information is corresponding.
Consider and in practical application scene, have many similar common index data, for example, the order numbers of applying for a refund of nearest 7 days, the order numbers of applying for a refund of nearest 30 days, the complaint reimbursement order numbers of nearest 7 days etc., if corresponding statistic algorithm is set for each common index data, add up common index data, once follow-up corresponding source data changes, statistic algorithm corresponding to all these similar common index data all will change so, this will make follow-up to the change of statistic algorithm very complicated comparatively, and, once miss the change to the statistic algorithm of certain common index data, will cause common index data to be made mistakes.
Therefore, in order to improve the efficiency of follow-up change statistic algorithm, improve the accuracy of statistics common index data, common index identification information in the embodiment of the present application comprises an indicator atom identification information, several index qualifiers and a temporal information, and in advance for indicator atom identification information is set statistic algorithm, be index qualifier and temporal information setting statistical condition.Accordingly, source data is added up, the method that obtains common index data can be: data warehouse is for an index identification information, according to the statistic algorithm of setting for the indicator atom identification information comprising in this index identification information in advance, and the statistical condition based on setting for the temporal information comprising in this index identification information and each index qualifier in advance, source data is added up, obtain the common index data that this index identification information is corresponding.
Continue along using example, because the action type information being associated with transaction subject heading list comprises reimbursement operation, therefore, can be set to " reimbursement order numbers ", " the reimbursement order amount of money " etc. by indicator atom identification information, index qualifier can be set to " application ", " complaint " etc., and temporal information can be set to " in nearest 7 days ", " in nearest 30 days " etc.
The statistic algorithm of setting for indicator atom identification information " reimbursement order numbers " can be that statistics is carried the quantity that action type information is the source data of reimbursement operation; The statistic algorithm of setting for indicator atom identification information " the reimbursement order amount of money " can be to add up that respectively to carry action type information be the amount of money sum comprising in the source data of reimbursement operation.
The statistical condition of setting for index qualifier " application " can be that to carry action type information be reimbursement, and reimbursement type is the source data of applying for a refund; The statistical condition of setting for index qualifier " complaint " can be that to carry action type information be reimbursement, and reimbursement type is for complaining the source data of reimbursement.
The statistical condition of setting for temporal information " in nearest 7 days " can be the rise time be nearest 7 days with interior source data; The statistical condition of setting for temporal information " in nearest 30 days " can be the rise time be nearest 30 days with interior source data.
For index identification information " order numbers of applying for a refund in nearest 7 days ", its indicator atom identification information is " reimbursement order numbers ", index qualifier is " application ", temporal information is " in nearest 7 days ", therefore, data warehouse adopts the statistic algorithm of setting for indicator atom identification information " reimbursement order numbers ", statistical condition based on for index qualifier " application " and temporal information " in nearest 7 days " setting, it is reimbursement operation that statistics is carried action type information, and reimbursement type is for applying for a refund, and the quantity of the source data generating in nearest 7 days, the common index data corresponding as index identification information " order numbers of applying for a refund in nearest 7 days " are kept in IDS.
Similarly, to be carrying action type information be that reimbursement operation and reimbursement type are to apply for a refund and the rise time is the result that the quantity of the source data in nearest 30 days is added up to common index data corresponding to " order numbers of applying for a refund in nearest 30 days ".
Like this, the statistic algorithm of the common index data that index identification information is corresponding has just been inherited statistic algorithm corresponding to indicator atom identification information that this index identification information comprises, as above in example, the statistic algorithm of " order numbers of applying for a refund in nearest 7 days " and " order numbers of applying for a refund in nearest 30 days " has all been inherited the statistic algorithm of the indicator atom identification information " reimbursement order numbers " comprising, if follow-up source data changes, only need change statistic algorithm corresponding to indicator atom identification information " reimbursement order numbers ", and without the statistic algorithm of " order numbers of applying for a refund in nearest 7 days " and " order numbers of applying for a refund in nearest 30 days " is all changed, realized the unification to the statistic algorithm of common index data corresponding to similar index identification information (comprising same atoms index identification information), can effectively improve the efficiency of follow-up change statistic algorithm, the accuracy of achievement data is provided.
In addition, for temporal information, also can set its corresponding measurement period, data warehouse, for the index identification information that comprises this temporal information, carries out the common index data corresponding to this index identification information of statistics in cycle according to measurement period corresponding to this temporal information.As, for temporal information " in nearest 7 days " and " in nearest 30 days ", can set these two measurement periods corresponding to temporal information and be 1 day, data warehouse is for " order numbers of applying for a refund in nearest 7 days " and " order numbers of applying for a refund in nearest 30 days " these two index identification informations, add up every day to common index data corresponding to these two index identification informations, and be kept in IDS.
S102: when data warehouse receives data acquisition request, determine the index identification information carrying in this data acquisition request.
In the embodiment of the present application, when user will obtain achievement data, first to data warehouse, send data acquisition request, wherein, in this data acquisition request, carry index identification information corresponding to achievement data that user will obtain, this index identification information can be index name, can be also index English words section.For example, when the achievement data that will obtain is nearest 7 days applying for a refund during order numbers, can send and carry the data acquisition request that index identification information is " order numbers of applying for a refund of nearest 7 days " to data warehouse.
Accordingly, data warehouse receives after this data acquisition request, determines and so that follow-up, to user, provides corresponding achievement data by the index identification information wherein carrying.
S103: according to this index identification information, in the common index data of preserving at IDS, search the common index data that this index identification information is corresponding.
In the embodiment of the present application, owing in advance each common index data being kept in each business-subject table in IDS, therefore, while searching common index data corresponding to this index identification information in IDS, can be first according to each business-subject table default in IDS, and the subordinate relation of each business-subject table and each index identification information, search the affiliated business-subject table of this index identification information carrying in data acquisition request, in each common index data in the business-subject table finding, search the common index data corresponding with this index identification information again.
S104: the common index data that find are offered to the user who sends this data acquisition request.
From IDS, find after the common index data that the index identification information that carries in data acquisition request is corresponding, data warehouse offers user by the common index data that find.
Pass through said method, data warehouse can directly offer user by the common index data that are kept in advance in IDS, and start successively upwards source data to be processed to obtain achievement data without the ODS from the bottom, offer again user, therefore can effectively save the computational resource of data warehouse, also improve the efficiency that data are provided.
And, said method in strict accordance with action type information definition business-subject table, and each index identification information under business-subject, the statistic algorithm of the common index data that each index identification information is corresponding has been inherited again statistic algorithm corresponding to indicator atom identification information comprising in this index identification information, realize the unification of business-subject, index identification information and statistic algorithm, can effectively improve the accuracy of the achievement data of statistics.
In addition, in the embodiment of the present application, data warehouse also can be supported the customized of common index data, also be, for certain common index data of preserving in IDS, data warehouse is except when receiving the data acquisition request for these common index data of user's transmission, these common index data are offered beyond user, can also these common index data have been offered the user of these common index data customized, and without just providing when receiving data acquisition request.
As, for the A of department in Yi Ge enterprise and the B of department, if common index data corresponding to index identification information a that the A of department is customized, common index data corresponding to index identification information b that the B of department is customized, data warehouse is according to the A of department and the customizing relation of index identification information a and the customizing relation of the B of department and index identification information b of preserving, the common index data corresponding to index identification information a of preserving in IDS can be offered to the A of department automatically, the common index data that index identification information b is corresponding offer the B of department automatically.If follow-up this enterprise is merged into the C of Liao Yige department by the A of department and the B of department, the customizing relation of the customizing relation of the A of department preserving in data warehouse and index identification information a and the B of department and index identification information b can be changed to the customizing relation of the C of department and index identification information a and b, data warehouse can offer the C of department by index identification information a and common index data corresponding to b, and without the C of department, again develops the model that obtains data.
Preferably, in the embodiment of the present application, can in IDS, preserve common index data corresponding to index identification information that versatility is stronger, and for some personalizations and personalized achievement data that can directly the common index data statistics based on preserving in IDS obtains, can be kept in ADS.Concrete, can at least one common index data of preserving in IDS, add up in advance, obtain personalized achievement data, and be kept in ADS.In the step S103 shown in Fig. 1, if when data warehouse does not find common index data corresponding to the index identification information that carries in data acquisition request in IDS, can search the personalized achievement data that this index identification information is corresponding in ADS.
For example, the achievement data corresponding due to " order numbers of applying for a refund in nearest 7 days " and " the pay invoice numbers in nearest 7 days " has stronger versatility, therefore these two common index data can be kept in IDS, personalization is stronger for achievement data corresponding to " rates of applying for a refund in nearest 7 days ", and, can directly based on " order numbers of applying for a refund in nearest 7 days " and the ratio of " the pay invoice numbers in nearest 7 days ", obtain, therefore, personalized achievement data corresponding to " rates of applying for a refund in nearest 7 days " can be kept in ADS.
Concrete, equally can be in ADS setting target identification information " rates of applying for a refund in nearest 7 days ", and set for this index identification information the ratio that its corresponding statistic algorithm is " order numbers of applying for a refund in nearest 7 days " of preserving in the IDS common index data corresponding with " the pay invoice numbers in nearest 7 days ", data warehouse can be directly using the ratio that is kept at " order numbers of applying for a refund in nearest 7 days " in the IDS common index data corresponding with " the pay invoice numbers in nearest 7 days " as personalized achievement data corresponding to " rates of applying for a refund in nearest 7 days ", and be kept in ADS.
Consider that the order of applying for a refund in nearest 7 days in practical application might not be that pay invoice in nearest 7 days is (as user paid an order before 8 days, but before 5 days to this order application reimbursement, this order is the order of applying for a refund in nearest 7 days, but not the pay invoice in nearest 7 days), therefore, in order to improve the accuracy of the personalized achievement data of " rates of applying for a refund in the nearest 7 days " correspondence of preserving in ADS, in upper example, can in IDS, preserve common index data corresponding to " order numbers of applying for a refund in the pay invoice in nearest 7 days ", , setting target identification information in ADS " rates of applying for a refund in nearest 7 days " afterwards, can set the ratio that its corresponding statistic algorithm is " order numbers of applying for a refund in the pay invoice in nearest 7 days " of preserving in the IDS common index data corresponding with " the pay invoice numbers in nearest 7 days " for this index identification information.
Accordingly, when the index identification information carrying in the data acquisition request that data warehouse receives is " rates of applying for a refund in nearest 7 days ", in IDS, do not find corresponding common index data, therefore in ADS, search, and the personalized achievement data finding is offered to user.Similarly, the personalized achievement data of preserving in ADS also can provide automatically according to customizing relation, just repeats no longer one by one here.
Further, for an achievement data, its versatility and personalization are comparatively speaking, if it is more to obtain the user of (or customized) this achievement data, or this achievement data is often acquired, can think that so the versatility of this achievement data is stronger, be exactly common index data, otherwise, if it is less to obtain the user of (or customized) this achievement data, or this achievement data is seldom acquired, can think that so the personalization of this achievement data is stronger, be exactly personalized achievement data.Therefore, data warehouse can be monitored the situation of obtaining of each common index data of preserving in IDS and ADS and personalized achievement data, and according to monitored results, the preservation position of this achievement data is adjusted.
As, for an achievement data, monitoring is at the appointed time obtained the user's of this achievement data quantity in section, or, monitor the at the appointed time number of times that is acquired in section of this achievement data, if obtain the user's of this achievement data quantity, be less than setting amount threshold, or, the number of times that this achievement data is acquired is less than set point number threshold value, can using it as personalized achievement data, be kept in ADS (if this achievement data has been kept in ADS, can keep it to preserve invariant position), otherwise, if obtain the user's of this achievement data quantity, be not less than setting amount threshold, the number of times that this achievement data is acquired is also not less than set point number threshold value, can using it as common index data, be kept in IDS (if this achievement data has been kept in IDS, can keep it to preserve invariant position), even, if obtain the number of users of this achievement data, be less than for a long time setting amount threshold, the number of times that this achievement data is acquired is less than set point number threshold value for a long time, can delete the index identification information that this achievement data and this achievement data are corresponding.Also, the achievement data of preserving in IDS and ADS can shift mutually, and only, this point, in the embodiment of the present application, the division limits of IDS and ADS is fuzzy.
Further, the achievement data that index identification information is corresponding that will obtain for user, if data warehouse does not all find the achievement data that this index identification information is corresponding in IDS and ADS, data warehouse can point out user this obtain the failure of this achievement data, and record this index identification information.Same index identification information for record, if record the number of times of this index identification information, surpassed predetermined number of times, data warehouse can send information to data base administrator, with reminder-data library manager, this index identification information of record is divided under some business-subjects, and set statistic algorithm (statistical condition that comprises statistic algorithm, index qualifier and the temporal information of indicator atom identification information) for it, and achievement data corresponding to this index identification information is kept in IDS or ADS.
It should be noted that, no matter whether in IDS and ADS, find the achievement data that user will obtain, data warehouse all will forbid that user directly obtains data from ODS or BDS, to guarantee the unitarity of the statistic algorithm of business-subject, index identification information, achievement data.
In addition, in the source data of data warehouse except comprising user's service data, also comprise the attribute datas such as user, commodity, shop, company, as user's attribute data comprises user's user class, user's contact method, address, the attribute data such as member whether.These attribute datas without carrying out statistical summaries, can directly offer user mostly, therefore, in the embodiment of the present invention, also can in IDS, preserve in advance attribute data.While carrying attribute-bit information in the data acquisition request that data warehouse receives, data warehouse also can be according to this attribute-bit information, in the attribute data of preserving at IDS, search attribute data corresponding to this attribute-bit information, and the attribute data finding is offered to the user who sends this data acquisition request.
Wherein, like common index data class, in the embodiment of the present application for a business-subject table default in IDS, can first define the Business Entity under this business-subject table, determine again each attribute-bit information under this Business Entity, and when searching, in the attribute data of the corresponding service entity under corresponding service subject heading list, search attribute data corresponding to attribute-bit information carrying in this data acquisition request.Certainly, similar with personalized achievement data, also attribute data can be kept in ADS, just repeat no longer one by one here.
The method that data are provided providing for the embodiment of the present application above, the thinking based on same, the embodiment of the present application also provides a kind of device that data are provided, as shown in Figure 2.
Fig. 2 is the apparatus structure schematic diagram that data are provided that the embodiment of the present application provides, and specifically comprises:
The wide top layer IDS201 of theme, in advance source data being added up, obtains common index data and preserves;
Receiver module 202, for receiving data acquisition request, and determines the index identification information carrying in described data acquisition request;
Search module 203, for according to described index identification information, in the common index data of preserving at described IDS201, search the common index data that described index identification information is corresponding;
Provide module 204, for the common index data that find being offered to the user who sends described data acquisition request.
Described IDS201 specifically for, preserve the business-subject table set in advance, and the subordinate relation of each business-subject table and index identification information; Determine the affiliated business-subject table of index identification information of the common index data that obtain, and described common index data are kept in definite business-subject table;
Described search module 203 specifically for, according to each business-subject table default in described IDS201, and the subordinate relation of each business-subject table and each index identification information, search the affiliated business-subject table of index identification information carrying in described data acquisition request; In each common index data in the business-subject table finding, search the common index data corresponding with the index identification information carrying in described data acquisition request.
The index identification information that described IDS201 preserves comprises an indicator atom identification information, several index qualifiers and a temporal information;
Described IDS201 specifically for, for an index identification information, according to the statistic algorithm of setting for the indicator atom identification information comprising in this index identification information in advance, and the statistical condition based on setting for the temporal information comprising in this index identification information and each index qualifier in advance, source data is added up, obtain the common index data that this index identification information is corresponding.
Described device also comprises:
Application layer ADS205, adds up at least one common index data of in advance described IDS201 being preserved, and obtains personalized achievement data and preserves;
Described while searching module 203 also for common index data corresponding to, the index identification information that carries when do not find described data acquisition request in IDS201 in, in described ADS205, search the personalized achievement data that described index identification information is corresponding.
Described IDS201 also for, preserve attribute data;
Described search module 203 also for, while carrying attribute-bit information in the described data acquisition request that described receiver module 202 receives, according to described attribute-bit information, in the attribute data of preserving at described IDS201, search attribute data corresponding to described attribute-bit information;
Described provide module 204 also for, the attribute data finding is offered to the user who sends described data acquisition request.
The concrete above-mentioned device of data that provides can be arranged in data warehouse.
The embodiment of the present application provides a kind of method and device that data are provided, the method is preserved common index data in advance in the IDS of data warehouse, when data warehouse receives the data acquisition request of user's transmission, the common index data of directly preserving in advance from IDS, search the common index data corresponding to index identification information of carrying in this data acquisition request, and offer user.Pass through said method, data warehouse is when providing common index data to user, can directly the common index data that are kept in advance in IDS be offered to user, and without source data is started successively upwards to process to obtain achievement data from the ODS of the bottom, offer again user, therefore can effectively save the computational resource of data warehouse, also improve the efficiency that data are provided.
Those skilled in the art should understand, the application's embodiment can be provided as method, system or computer program.Therefore, the application can adopt complete hardware implementation example, implement software example or in conjunction with the form of the embodiment of software and hardware aspect completely.And the application can adopt the form that wherein includes the upper computer program of implementing of computer-usable storage medium (including but not limited to magnetic disk memory, CD-ROM, optical memory etc.) of computer usable program code one or more.
The application is with reference to describing according to process flow diagram and/or the block scheme of the method for the embodiment of the present application, equipment (system) and computer program.Should understand can be in computer program instructions realization flow figure and/or block scheme each flow process and/or the flow process in square frame and process flow diagram and/or block scheme and/or the combination of square frame.Can provide these computer program instructions to the processor of multi-purpose computer, special purpose computer, Embedded Processor or other programmable data processing device to produce a machine, the instruction of carrying out by the processor of computing machine or other programmable data processing device is produced for realizing the device in the function of flow process of process flow diagram or a plurality of flow process and/or square frame of block scheme or a plurality of square frame appointments.
These computer program instructions also can be stored in energy vectoring computer or the computer-readable memory of other programmable data processing device with ad hoc fashion work, the instruction that makes to be stored in this computer-readable memory produces the manufacture that comprises command device, and this command device is realized the function of appointment in flow process of process flow diagram or a plurality of flow process and/or square frame of block scheme or a plurality of square frame.
These computer program instructions also can be loaded in computing machine or other programmable data processing device, make to carry out sequence of operations step to produce computer implemented processing on computing machine or other programmable devices, thereby the instruction of carrying out is provided for realizing the step of the function of appointment in flow process of process flow diagram or a plurality of flow process and/or square frame of block scheme or a plurality of square frame on computing machine or other programmable devices.
Although described the application's preferred embodiment, once those skilled in the art obtain the basic creative concept of cicada, can make other change and modification to these embodiment.So claims are intended to all changes and the modification that are interpreted as comprising preferred embodiment and fall into the application's scope.
Obviously, those skilled in the art can carry out various changes and modification and not depart from the spirit and scope of the embodiment of the present application the embodiment of the present application.Like this, if within these of the embodiment of the present application are revised and modification belongs to the scope of the application's claim and equivalent technologies thereof, the application is also intended to comprise these changes and modification interior.
Claims (10)
1. the method that data are provided, is characterized in that, comprising:
In advance the source data of preserving in data warehouse is added up, obtain common index data, the common index data that obtain are kept in the wide top layer IDS of theme of described data warehouse;
When described data warehouse receives data acquisition request, determine the index identification information carrying in described data acquisition request; And
According to described index identification information, in the common index data of preserving at described IDS, search the common index data that described index identification information is corresponding; And
The common index data that find are offered to the user who sends described data acquisition request.
2. the method for claim 1, is characterized in that, the common index data that obtain are kept in the IDS of described data warehouse, specifically comprises:
Business-subject table is set in advance in described IDS, and the subordinate relation of each business-subject table and index identification information;
Determine the affiliated business-subject table of index identification information of the common index data that obtain, and described common index data are kept in definite business-subject table;
In the common index data of preserving at described IDS, search the common index data that described index identification information is corresponding, specifically comprise:
According to each business-subject table default in described IDS, and the subordinate relation of each business-subject table and each index identification information, the affiliated business-subject table of index identification information carrying in described data acquisition request searched; And
In each common index data in the business-subject table finding, search the common index data corresponding with the index identification information carrying in described data acquisition request.
3. method as claimed in claim 2, is characterized in that, an index identification information comprises an indicator atom identification information, several index qualifiers and a temporal information;
In advance the source data of preserving in data warehouse is added up, obtains common index data, specifically comprise:
For an index identification information, according to the statistic algorithm of setting for the indicator atom identification information comprising in this index identification information in advance, and the statistical condition based on setting for the temporal information comprising in this index identification information and each index qualifier in advance, source data is added up, obtain the common index data that this index identification information is corresponding.
4. the method for claim 1, is characterized in that, in advance at least one common index data of preserving in described IDS is added up, and obtains personalized achievement data, and is kept in application layer ADS;
Described method also comprises:
During common index data corresponding to the index identification information that carries, in described ADS, search the personalized achievement data that described index identification information is corresponding when do not find described data acquisition request in IDS in.
5. the method for claim 1, is characterized in that, preserves attribute data in advance in described IDS;
Described method also comprises:
While carrying attribute-bit information in the data acquisition request that described data warehouse receives, described data warehouse, according to described attribute-bit information, in the attribute data of preserving, is searched attribute data corresponding to described attribute-bit information at described IDS; And
The attribute data finding is offered to the user who sends described data acquisition request.
6. the device that data are provided, is characterized in that, comprising:
The wide top layer IDS of theme, in advance source data being added up, obtains common index data and preserves;
Receiver module, for receiving data acquisition request, and determines the index identification information carrying in described data acquisition request;
Search module, for according to described index identification information, in the common index data of preserving at described IDS, search the common index data that described index identification information is corresponding;
Provide module, for the common index data that find being offered to the user who sends described data acquisition request.
7. device as claimed in claim 6, is characterized in that, described IDS specifically for, preserve the business-subject table set in advance, and the subordinate relation of each business-subject table and index identification information; Determine the affiliated business-subject table of index identification information of the common index data that obtain, and described common index data are kept in definite business-subject table;
Described search module specifically for, according to each business-subject table default in described IDS, and the subordinate relation of each business-subject table and each index identification information, search the affiliated business-subject table of index identification information carrying in described data acquisition request; In each common index data in the business-subject table finding, search the common index data corresponding with the index identification information carrying in described data acquisition request.
8. device as claimed in claim 7, is characterized in that, the index identification information that described IDS preserves comprises an indicator atom identification information, several index qualifiers and a temporal information;
Described IDS specifically for, for an index identification information, according to the statistic algorithm of setting for the indicator atom identification information comprising in this index identification information in advance, and the statistical condition based on setting for the temporal information comprising in this index identification information and each index qualifier in advance, source data is added up, obtain the common index data that this index identification information is corresponding.
9. device as claimed in claim 6, is characterized in that, described device also comprises:
Application layer ADS, adds up at least one common index data of in advance described IDS being preserved, and obtains personalized achievement data and preserves;
Described while searching module also for common index data corresponding to, the index identification information that carries when do not find described data acquisition request in IDS in, in described ADS, search the personalized achievement data that described index identification information is corresponding.
10. device as claimed in claim 6, is characterized in that, described IDS also for, preserve attribute data;
Described search module also for, while carrying attribute-bit information in the described data acquisition request that described receiver module receives, according to described attribute-bit information, in the attribute data of preserving at described IDS, search attribute data corresponding to described attribute-bit information;
Described provide module also for, the attribute data finding is offered to the user who sends described data acquisition request.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310153297.0A CN104123303B (en) | 2013-04-27 | 2013-04-27 | A kind of method and device that data are provided |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310153297.0A CN104123303B (en) | 2013-04-27 | 2013-04-27 | A kind of method and device that data are provided |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104123303A true CN104123303A (en) | 2014-10-29 |
| CN104123303B CN104123303B (en) | 2018-04-24 |
Family
ID=51768715
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201310153297.0A Active CN104123303B (en) | 2013-04-27 | 2013-04-27 | A kind of method and device that data are provided |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104123303B (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107025266A (en) * | 2017-02-28 | 2017-08-08 | 阿里巴巴集团控股有限公司 | The treating method and apparatus of business datum |
| CN108805376A (en) * | 2017-05-02 | 2018-11-13 | 北京京东尚科信息技术有限公司 | A kind of statistical method, device, electronic equipment and storage medium |
| CN109597846A (en) * | 2018-10-22 | 2019-04-09 | 平安科技（深圳）有限公司 | Big data platform data warehouse data processing method, device and computer equipment |
| CN112199393A (en) * | 2020-09-18 | 2021-01-08 | 深圳希施玛数据科技有限公司 | Data table generation method, device, equipment and storage medium based on cross-table query |
| CN112734480A (en) * | 2021-01-13 | 2021-04-30 | 上海群之脉信息科技有限公司 | Refund data processing intelligent system |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101150831A (en) * | 2007-10-24 | 2008-03-26 | 华为技术有限公司 | Network element data processing method and device |
| CN101980188A (en) * | 2010-10-14 | 2011-02-23 | 联动优势科技有限公司 | Data index storing method and device and data index analyzing method and device |
| CN102129425A (en) * | 2010-01-20 | 2011-07-20 | 阿里巴巴集团控股有限公司 | Method and device for accessing large-object set table in data warehouse |
| CN102298598A (en) * | 2010-06-23 | 2011-12-28 | 潘晓梅 | Method and device for analyzing patent information |
| US20120191649A1 (en) * | 2003-12-08 | 2012-07-26 | Hitachi, Ltd. | Data Transfer Method and Server Computer System |
| CN102831172A (en) * | 2012-07-26 | 2012-12-19 | 国网信息通信有限公司 | Method and device for processing data in enterprise patent databank |
-
2013
- 2013-04-27 CN CN201310153297.0A patent/CN104123303B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20120191649A1 (en) * | 2003-12-08 | 2012-07-26 | Hitachi, Ltd. | Data Transfer Method and Server Computer System |
| CN101150831A (en) * | 2007-10-24 | 2008-03-26 | 华为技术有限公司 | Network element data processing method and device |
| CN102129425A (en) * | 2010-01-20 | 2011-07-20 | 阿里巴巴集团控股有限公司 | Method and device for accessing large-object set table in data warehouse |
| CN102298598A (en) * | 2010-06-23 | 2011-12-28 | 潘晓梅 | Method and device for analyzing patent information |
| CN101980188A (en) * | 2010-10-14 | 2011-02-23 | 联动优势科技有限公司 | Data index storing method and device and data index analyzing method and device |
| CN102831172A (en) * | 2012-07-26 | 2012-12-19 | 国网信息通信有限公司 | Method and device for processing data in enterprise patent databank |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107025266A (en) * | 2017-02-28 | 2017-08-08 | 阿里巴巴集团控股有限公司 | The treating method and apparatus of business datum |
| CN108805376A (en) * | 2017-05-02 | 2018-11-13 | 北京京东尚科信息技术有限公司 | A kind of statistical method, device, electronic equipment and storage medium |
| CN109597846A (en) * | 2018-10-22 | 2019-04-09 | 平安科技（深圳）有限公司 | Big data platform data warehouse data processing method, device and computer equipment |
| CN109597846B (en) * | 2018-10-22 | 2024-05-07 | 平安科技（深圳）有限公司 | Data processing method, device and computer equipment for large data platform data warehouse |
| CN112199393A (en) * | 2020-09-18 | 2021-01-08 | 深圳希施玛数据科技有限公司 | Data table generation method, device, equipment and storage medium based on cross-table query |
| CN112199393B (en) * | 2020-09-18 | 2024-05-10 | 深圳希施玛数据科技有限公司 | Data table generation method, device, equipment and storage medium based on cross-table query |
| CN112734480A (en) * | 2021-01-13 | 2021-04-30 | 上海群之脉信息科技有限公司 | Refund data processing intelligent system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104123303B (en) | 2018-04-24 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| RU2488166C2 (en) | Service-oriented conveyor-based architecture | |
| US9329908B2 (en) | Proactive identification of hotspots in a cloud computing environment | |
| US20140344123A1 (en) | Dynamically modifying workload patterns in a cloud | |
| CN104123303A (en) | Method and device for providing data | |
| US11956330B2 (en) | Adaptive data fetching from network storage | |
| CN107633347A (en) | A kind of data target statistical method and device | |
| CN111160793A (en) | Method, device and equipment for configuring number of self-service equipment of service network point | |
| CN110515795A (en) | A kind of monitoring method of big data component, device, electronic equipment | |
| CN109977135A (en) | A kind of data query method, apparatus and server | |
| CN112749863A (en) | Keyword price adjusting method and device and electronic equipment | |
| CN110852559A (en) | Resource allocation method and device, storage medium and electronic device | |
| CN111784468A (en) | Account association method and device and electronic equipment | |
| CN111177562B (en) | Recommendation ordering processing method and device for target object and server | |
| CN101894317A (en) | System and method for driving business logic through data changes | |
| WO2023056793A1 (en) | Optimizing a just-in-time compilation process | |
| US11868349B2 (en) | Row secure table plan generation | |
| CN113672660A (en) | Data query method, device and equipment | |
| CN113901033A (en) | Data migration method, device, equipment and medium | |
| US9792326B1 (en) | Dynamically switching between execution paths for user-defined functions | |
| US20140114719A1 (en) | Allocating Service Consumers into Compatible Resource Pools | |
| CN112395366A (en) | Data processing and creating method and device of distributed database and electronic equipment | |
| CN110738806A (en) | Payment mode determination method, device and system and electronic equipment | |
| CN109919470B (en) | Method and device for distributing customer information | |
| US10339049B2 (en) | Garbage collection facility grouping infrequently accessed data units in designated transient memory area | |
| EP3971805A1 (en) | Generating workflow, report, interface, conversion, enhancement, and forms (wricef) objects for enterprise software |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20211115 Address after: Room 233, building 14, No. 788, Guangzhou Avenue South, Haizhu District, Guangzhou City, Guangdong Province Patentee after: Alibaba South China Technology Co., Ltd Address before: P.O. Box 847, 4th floor, capital building, Grand Cayman, British Cayman Islands Patentee before: Alibaba Group Holdings Limited |
|
| TR01 | Transfer of patent right |