CN104123303B - A kind of method and device that data are provided - Google Patents
A kind of method and device that data are provided Download PDFInfo
- Publication number
- CN104123303B CN104123303B CN201310153297.0A CN201310153297A CN104123303B CN 104123303 B CN104123303 B CN 104123303B CN 201310153297 A CN201310153297 A CN 201310153297A CN 104123303 B CN104123303 B CN 104123303B
- Authority
- CN
- China
- Prior art keywords
- data
- index
- identification information
- ids
- business
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2453—Query optimisation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/28—Databases characterised by their database models, e.g. relational or object models
- G06F16/283—Multi-dimensional databases or data warehouses, e.g. MOLAP or ROLAP
Landscapes
- Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computational Linguistics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
This application discloses it is a kind of provide data method and device, to solve to waste the computing resource of data warehouse in the prior art, there is provided data it is less efficient the problem of.This method preserves common index data in the IDS of data warehouse in advance, when data warehouse receives the data acquisition request of user's transmission, common index data corresponding to the index identification information carried in the data acquisition request are directly searched from the common index data that IDS is pre-saved, and are supplied to user.Pass through the above method, data warehouse is when providing a user common index data, the common index data being pre-stored in IDS directly can be supplied to user, without source data is successively handled upwards since the ODS of the bottom to obtain achievement data, it is available to user, therefore the computing resource of data warehouse can be effectively saved, also improves the efficiency that data are provided.
Description
Technical field
This application involves field of computer technology, more particularly to a kind of method and device that data are provided.
Background technology
At present, data warehouse is broadly divided into four layers：Source data layer（ODS）, view layer（BDS）, the wide top layer of theme（IDS）、
Application layer（ADS）.This four layers logical hierarchy relation is successively from top to bottom：ADS、IDS、BDS、ODS.
In the prior art, when user needs to obtain some achievement datas according to it, data warehouse is needed first from ODS
Corresponding source data is extracted, then data cleansing is carried out to the source data of extraction by BDS, then by IDS according to user's
Need that the data after cleaning are calculated and collected, obtain the achievement data needed for user, finally by ADS by needed for user
Achievement data be supplied to can be to user.
Wherein, achievement data refers to that carrying out counting statistics according to some dimension to some source datas in data warehouse obtains
Data, e.g., according to the transaction data in data warehouse nearest 1 month（Source data）, count the order in nearest one month
The amount of money, the achievement data which is exactly.
However, in the prior art, no matter whether each user achievement data to be obtained identical, data warehouse be required to from
The ODS of the bottom starts, and corresponding achievement data could be supplied to user by ODS, BDS, IDS, ADS successively, this is obvious
The substantial amounts of computing resource of data warehouse can be wasted, also reduces the efficiency that data are provided.
The content of the invention
The embodiment of the present application provides a kind of method and device for providing data, to solve to waste data bins in the prior art
The computing resource in storehouse, there is provided data it is less efficient the problem of.
A kind of method that data are provided provided by the embodiments of the present application, including：
The source data preserved in data warehouse is counted in advance, obtains common index data, the general finger that will be obtained
Mark data are stored in the wide top layer IDS of theme of the data warehouse；
When the data warehouse receives data acquisition request, the index mark carried in the data acquisition request is determined
Information；And
According to the index identification information, in the common index data that the IDS is preserved, the index mark letter is searched
Cease corresponding common index data；And
The common index data found are supplied to the user for sending the data acquisition request.
A kind of device that data are provided provided by the embodiments of the present application, including：
The wide top layer IDS of theme, for being counted in advance to source data, obtains common index data and preserves；
Receiving module, for receiving data acquisition request, and determines the index mark carried in the data acquisition request
Information；
Searching module, for according to the index identification information, in the common index data that the IDS is preserved, searching
Common index data corresponding to the index identification information；
Module is provided, the user of the data acquisition request is sent for the common index found data to be supplied to.
The embodiment of the present application provides a kind of method and device for providing data, and this method is in advance in the IDS of data warehouse
Common index data are preserved, when data warehouse receives the data acquisition request of user's transmission, are directly pre-saved from IDS
Common index data corresponding to the index identification information carried in the data acquisition request are searched in common index data, and are provided
To user.By the above method, data warehouse directly can will be pre-stored in IDS when providing a user common index data
In common index data be supplied to user, referred to without source data is successively handled upwards since the ODS of the bottom
Data are marked, are available to user, therefore can effectively save the computing resource of data warehouse, also improve the efficiency that data are provided.
Brief description of the drawings
Fig. 1 provides the process of data for data warehouse provided by the embodiments of the present application；
Fig. 2 is the apparatus structure schematic diagram of offer data provided by the embodiments of the present application.
Embodiment
In order to save the computing resource of data warehouse, the efficiency that data warehouse provides data, the embodiment of the present application are also improved
In common index data are stored in IDS in advance, when providing common index data, directly IDS can be preserved corresponding logical
User is supplied to achievement data.
The application preferred embodiment is described in detail below in conjunction with the accompanying drawings.
Fig. 1 provides the process of data for data warehouse provided by the embodiments of the present application, specifically includes following steps：
S101：The source data preserved in data warehouse is counted in advance, obtains common index data, it is logical by what is obtained
It is stored in achievement data in the IDS of data warehouse.
In the embodiment of the present application, data warehouse in advance can count the source data being stored in ODS, obtain general
Achievement data, and be stored in IDS.
Specifically, business-subject table can be set in IDS in advance, and each business-subject table and index identification information from
Category relation, after being counted to source data and obtaining common index data, then the index for the common index data that can determine that
Business-subject table belonging to identification information, and obtained common index data are stored in definite business-subject table.
Wherein, due to be mostly in the source data of data warehouse user operation data, payment operation, reimbursement such as user
Operation, registration operation, register, clicking operation etc., and corresponding action type information can be carried in operation data, because
This, in IDS during pre-set business subject heading list, for a business-subject table, can operate the business-subject table with least one
Type information is associated, but a kind of action type information is only associated with a unique business-subject table, i.e. to different behaviour
Make type information and stringent division is carried out according to the business-subject table belonging to it.
For example, default business-subject table is subject of transaction table, payment operation and reimbursement are operated into the two action types
Information is arranged to associated with the subject of transaction table.It should be noted that once it is provided with payment operation and reimbursement operation and is somebody's turn to do
Subject of transaction table is associated, the two action type information just no longer with other business-subject tables（Such as browse themes table）It is related
Connection.
Each business-subject table is provided with that after the incidence relation of action type information, then can be directed to default using the above method
Each business-subject table, determine the action type information associated with the business-subject table, the operation that will be determined according to carrying
The corresponding index identification information of each common index data that the source data of type information counts is determined as the business-subject table
Under index identification information.
Continue to use the example above, since payment operation is associated with subject of transaction table, the action type information according to carrying is
The corresponding index identification information of common index data that the source data of payment operation counts includes payment order numbers and payment
The amount of money, therefore, the business-subject table belonging to order numbers of paying the bill and Payment Amount is exactly subject of transaction table.Similar, due to reimbursement
Operation is associated with subject of transaction table, counts general according to the action type information of carrying for the source data that reimbursement operates
The corresponding index identification information of achievement data includes reimbursement order numbers and refund amount, therefore, reimbursement order numbers and refund amount
Affiliated business-subject table is also subject of transaction table.
In this way, each common index data are also strictly divided into business-subject table according to corresponding action type information
Under.
Further, business-subject table, associated action type information and each business-subject table have been preset in IDS
Under index identification information after, then general finger corresponding to corresponding index identification information can be preserved in each business-subject table of IDS
Mark data.
In view of in practical application scene there are many similar common index data, for example, nearest 7 days apply for a refund
Order numbers, the order numbers of applying for a refund of nearest 30 days, nearest 7 days complaint reimbursement order numbers etc., if for each general finger
Mark data all set corresponding statistic algorithm to count common index data, once then follow-up corresponding source data changes,
So all these similar corresponding statistic algorithms of common index data are intended to change, this will make subsequently to calculate statistics
The relatively complicated complexity of change of method, moreover, once missing the change of the statistic algorithm to some common index data, it will cause
Common index corrupt data.
Therefore, in order to improve the efficiency of follow-up change statistic algorithm, the accuracy of statistics common index data, this Shen are improved
Common index identification information that please be in embodiment includes an indicator atom identification information, several index qualifiers and one
Temporal information, and statistic algorithm is set for indicator atom identification information in advance, it is index qualifier and temporal information setting system
Meter condition.Correspondingly, being counted to source data, obtaining the method for common index data can be：Data warehouse is directed to one
Index identification information, is calculated according to the statistics for being directed to the indicator atom identification information setting included in the index identification information in advance
Method, and based on the statistics bar for being directed to the temporal information included in the index identification information and the setting of each index qualifier in advance
Part, counts source data, obtains common index data corresponding to the index identification information.
Continue to use the example above, since the action type information associated with subject of transaction table includes reimbursement operation, can
Indicator atom identification information is arranged to " reimbursement order numbers ", " the reimbursement order amount of money " etc., index qualifier may be configured as " Shen
Please ", " complaint " etc., temporal information may be configured as " in nearest 7 days ", " in nearest 30 days " etc..
Statistic algorithm for indicator atom identification information " reimbursement order numbers " setting can be that statistics carries action type letter
Cease the quantity of the source data for reimbursement operation；Statistic algorithm for indicator atom identification information " the reimbursement order amount of money " setting can be with
It is the sum of amount of money included in each source data for carrying action type information as reimbursement operation of statistics.
The statistical condition set for index qualifier " application " can carry action type information as reimbursement, and reimbursement class
Type is the source data applied for a refund；The statistical condition set for index qualifier " complaint " can be carry action type information as
Reimbursement, and reimbursement type is the source data of complaint reimbursement.
The statistical condition set for temporal information " in nearest 7 days " can be generated time as the source number within nearest 7 days
According to；The statistical condition set for temporal information " in nearest 30 days " can be generated time as the source data within nearest 30 days.
It is for index identification information " order numbers of applying for a refund in nearest 7 days ", its indicator atom identification information then
" reimbursement order numbers ", index qualifier as " is applied ", and temporal information is that therefore, data warehouse uses pin " in nearest 7 days "
To the statistic algorithm of indicator atom identification information " reimbursement order numbers " setting, based on for index qualifier " application " and time letter
The statistical condition that breath is set " in nearest 7 days ", it is that reimbursement operates and reimbursement type is that application is moved back that statistics, which carries action type information,
Money and it is 7 days nearest in the quantity of source data that generates, as index identification information " order numbers of applying for a refund in nearest 7 days "
Corresponding common index data are stored in IDS.
Similar, " order numbers of applying for a refund in nearest 30 days " corresponding common index data are to operate class to carrying
Type information be reimbursement operation and reimbursement type be apply for a refund and quantity that generated time is source data in nearest 30 days into
The result of row statistics.
In this way, the statistic algorithm of common index data corresponding to an index identification information just inherits index mark letter
Cease statistic algorithm corresponding to the indicator atom identification information that includes, as above in example " order numbers of applying for a refund in nearest 7 days " and
The statistic algorithm of " order numbers of applying for a refund in nearest 30 days " inherits indicator atom identification information " the reimbursement order included
The statistic algorithm of number ", only need to be corresponding to indicator atom identification information " reimbursement order numbers " if follow-up source data changes
Statistic algorithm make a change, without to " order numbers of applying for a refund in nearest 7 days " and " application in nearest 30 days is moved back
The equal make a change of statistic algorithm of money order numbers ", realizes to similar index identification information（Identify and believe comprising same atoms index
Breath）The unification of the statistic algorithm of corresponding common index data, can effectively improve the efficiency of follow-up change statistic algorithm, and raising carries
For the accuracy of achievement data.
In addition, for temporal information, its corresponding measurement period can be also set, then data warehouse is directed to believes comprising the time
The index identification information of breath, the statistics in cycle index identification information correspondence is carried out according to the corresponding measurement period of the temporal information
Common index data.Such as, for temporal information " in nearest 7 days " and " in nearest 30 days ", the two temporal informations can be set
Corresponding measurement period is 1 day, then data warehouse is for " order numbers of applying for a refund in nearest 7 days " and " in nearest 30 days
Order numbers of applying for a refund " the two index identification informations, common index number corresponding to the two index identification informations daily
According to being counted, and it is stored in IDS.
S102：When data warehouse receives data acquisition request, the index mark carried in the data acquisition request is determined
Information.
In the embodiment of the present application, when user will obtain achievement data, data acquisition request first is sent to data warehouse, its
In, the corresponding index identification information of user's achievement data to be obtained, index mark letter are carried in the data acquisition request
Breath can be index name or index English field.For example, when the application that the achievement data to be obtained is nearest 7 days
During reimbursement order numbers, then it can be sent to data warehouse and carry index identification information as " order numbers of applying for a refund of nearest 7 days "
Data acquisition request.
Correspondingly, after data warehouse receives the data acquisition request, it is determined that the index identification information wherein carried, with
Continue after an action of the bowels and provide a user corresponding achievement data.
S103：According to the index identification information, in the common index data that IDS is preserved, the index identification information is searched
Corresponding common index data.
In the embodiment of the present application, due to each business master being in advance stored in each common index data in IDS
Inscribe in table, therefore, can be first according to default in IDS when common index data corresponding to the index identification information are searched in IDS
Each business-subject table, and the subordinate relation of each business-subject table and each index identification information, searching data obtained in request
The business-subject table belonging to the index identification information carried, then each common index data in the business-subject table found
In, search the common index data corresponding with the index identification information.
S104：The common index data found are supplied to the user for sending the data acquisition request.
After common index data corresponding to the index identification information carried in data acquisition request are found from IDS, number
The common index data found are then supplied to user according to warehouse.
By the above method, the common index data being pre-stored in IDS directly can be supplied to user by data warehouse,
Without successively being handled source data to obtain achievement data upwards since the ODS of the bottom, user is available to, therefore
The computing resource of data warehouse can be effectively saved, also improves the efficiency that data are provided.
Also, the above method is each under business-subject table, and business-subject in strict accordance with action type information definition
Index identification information, the statistic algorithm of common index data corresponding to each index identification information inherit index mark letter again
Statistic algorithm corresponding to the indicator atom identification information that is included in breath, realizes business-subject, index identification information and statistics
The unification of algorithm, can effectively improve the accuracy of the achievement data of statistics.
In addition, data warehouse can also support the customized of common index data in the embodiment of the present application, that is, in IDS
Some the common index data preserved, data warehouse is except receiving the data for the common index data of user's transmission
When obtaining request, which is provided the user with outside, which can also be supplied to and have subscribed
The user of the common index data, without just being provided when receiving data acquisition request.
Such as, for the department A and department B in an enterprise, if department A have subscribed, index identification information a is corresponding to be led to
With achievement data, department B have subscribed the corresponding common index data of index identification information b, then data warehouse is according to the portion of preservation
The customizing relation of door A and index identification information a and the customizing relation of department B and index identification information b, will can preserve in IDS
The corresponding common index data of index identification information a be automatically provided to department A, by the corresponding general fingers of index identification information b
Mark data are automatically provided to department B.If department A and department B are incorporated into a department C by the follow-up enterprise, can be by number
According to the customizing relation of the department A preserved in warehouse and index identification information a and the customized pass of department B and index identification information b
System is changed to the customizing relation of department C and index identification information a and b, and data warehouse can then correspond to index identification information a and b
Common index data be supplied to department C, without department C again develop obtain data model.
Preferably, in the embodiment of the present application, corresponding logical of the stronger index identification information of versatility can be preserved in IDS
With achievement data, and it is personalized for some and the individual character that the common index data statistics preserved in IDS obtains can be directly based upon
Change achievement data, then can be stored in ADS.Specifically, at least one common index data preserved in IDS can be carried out in advance
Statistics, obtains personalized achievement data, and be stored in ADS.Then in the step S103 shown in Fig. 1, if data warehouse exists
, then can be in ADS when not finding common index data corresponding to the index identification information carried in data acquisition request in IDS
Search personalized achievement data corresponding to the index identification information.
For example, since " order numbers of applying for a refund in nearest 7 days " and " the pay invoice number in nearest 7 days " are corresponding
Achievement data has stronger versatility, therefore the two common index data can be stored in IDS, and " in nearest 7 days
Apply for a refund rate " corresponding achievement data is then personalized stronger, moreover, " the order of applying for a refund in nearest 7 days can be directly based upon
Number " and the ratio of " the pay invoice number in nearest 7 days " are worth to, therefore, can be corresponding by " rate of applying for a refund in nearest 7 days "
Personalized achievement data is stored in ADS.
Specifically, equally can in ADS setting target identification information " rate of applying for a refund in nearest 7 days ", and for should
" order numbers of applying for a refund in nearest 7 days " that index identification information preserves in setting its corresponding statistic algorithm as IDS with " most
The ratio of the corresponding common index data of pay invoice number in nearly 7 days ", then data warehouse directly can will have been saved in IDS
In " order numbers of applying for a refund in nearest 7 days " common index data corresponding with " the pay invoice number in nearest 7 days "
Ratio is stored in ADS as " rate of applying for a refund in nearest 7 days " corresponding personalized achievement data.
In view of the order of applying for a refund in practical application nearest 7 days it is 7 days not necessarily nearest in pay invoice
（As user paid an order before 8 days, but the reimbursement to the order application before 5 days, then this order is nearest 7 days
Interior order of applying for a refund, but be not the pay invoice in nearest 7 days）, therefore, in order to improve " nearest 7 days preserved in ADS
The accuracy of the corresponding personalized achievement data of interior rate of applying for a refund ", in upper example, can preserve " in nearest 7 days in IDS
Pay invoice in order numbers of applying for a refund " corresponding common index data, then, setting target identification information is " most in ADS
After rate of applying for a refund in nearly 7 days ", preserved during its corresponding statistic algorithm can be set as IDS for the index identification information
" order numbers of applying for a refund in pay invoice in nearest 7 days " it is corresponding general with " the pay invoice number in nearest 7 days "
The ratio of achievement data.
Correspondingly, when the index identification information carried in the data acquisition request that data warehouse receives is " in nearest 7 days
Rate of applying for a refund " when, then do not find corresponding common index data in IDS, therefore searched in ADS, and will search
To personalized achievement data be supplied to user.Similar, the personalized achievement data preserved in ADS can also be according to customized pass
System is automatically provided, and is just no longer repeated one by one here.
Further, for an achievement data, its versatility and personalization are in contrast, if obtained
（It is or customized）The user of the achievement data is more, or the achievement data is often acquired, then it is believed that this index number
According to versatility it is stronger, be exactly common index data, whereas if obtain（It is or customized）The user of the achievement data is less,
Or the achievement data is seldom acquired, then it is believed that the personalization of this achievement data is stronger, it is exactly personalized index number
According to.Therefore, data warehouse can be to the acquisition situation of each common index data for being preserved in IDS and ADS and personalized achievement data
It is monitored, and the save location of the achievement data is adjusted according to monitored results.
Such as, for an achievement data, monitoring at the appointed time obtains the quantity of the user of the achievement data in section, or
Person, monitors the number that the achievement data is at the appointed time acquired in section, if the quantity for obtaining the user of the achievement data is small
In setting amount threshold, alternatively, the number that the achievement data is acquired is less than setting frequency threshold value, then can be as personalization
Achievement data is stored in ADS（If the achievement data is had been saved in ADS, its save location can be kept constant）, instead
It, if the quantity for obtaining the user of the achievement data is not less than setting amount threshold, the number which is acquired
Not less than setting frequency threshold value, then can be stored in as common index data in IDS（If the achievement data has been saved in
In IDS, then its save location can be kept constant）, even, if the number of users for obtaining the achievement data is less than setting for a long time
Amount threshold, number which is acquired are less than setting frequency threshold value for a long time, then can delete the achievement data and
The corresponding index identification information of the achievement data.That is, the achievement data preserved in IDS and ADS can mutual phase transfer, only from this
For a bit upper, the division limits of IDS and ADS are fuzzy in the embodiment of the present application.
Further, for achievement data corresponding to user's index identification information to be obtained, if data bins
Storehouse does not find achievement data corresponding to the index identification information in IDS and ADS, then data warehouse can prompt user this
Achievement data failure is obtained, and records the index identification information.For the same index identification information of record, if record
The number of the index identification information alreadys exceed predetermined number of times, then data warehouse can send prompt message to database administrator,
To prompt database administrator that the index identification information of record is divided under some business-subject, and it is its setting statistics
Algorithm（The statistical condition of statistic algorithm including indicator atom identification information, index qualifier and temporal information）, and this is referred to
Achievement data corresponding to mark identification information is stored in IDS or ADS.
It should be noted that regardless of whether user's achievement data to be obtained, data warehouse are found in IDS and ADS
It is intended to forbid user directly to obtain data from ODS or BDS, to ensure the system of business-subject, index identification information, achievement data
The uniformity of calculating method.
In addition, in the source data of data warehouse in addition to the operation data including user, user, commodity, shop are further included
Whether the attribute datas such as paving, company, such as the user class of the attribute data including user of user, user contact details, address, can
The attribute datas such as member.These attribute datas need not carry out statistical summaries mostly, can be supplied directly to user, and therefore, the present invention is real
Attribute data can also be preserved in IDS in advance by applying in example.When carrying attribute mark in the data acquisition request that data warehouse receives
When knowing information, data warehouse also in the attribute data that IDS is preserved, can search the attribute-bit according to the attribute-bit information
The corresponding attribute data of information, and the attribute data found is supplied to the user for sending the data acquisition request.
Wherein, with as common index data class, a default business-subject in IDS is directed in the embodiment of the present application
Table, can first define the Business Entity under the business-subject table, then determine each attribute-bit information under the Business Entity, and look into
When looking for, in the corresponding service entity attributes data under corresponding service subject heading list, search what is carried in the data acquisition request
The corresponding attribute data of attribute-bit information.Certainly, it is similar with personalized achievement data, attribute data can be also stored in
In ADS, just no longer repeat one by one here.
It is above the method for offer data provided by the embodiments of the present application, based on same thinking, the embodiment of the present application is also
A kind of device that data are provided is provided, as shown in Figure 2.
Fig. 2 is the apparatus structure schematic diagram of offer data provided by the embodiments of the present application, is specifically included：
The wide top layer IDS201 of theme, for being counted in advance to source data, obtains common index data and preserves；
Receiving module 202, for receiving data acquisition request, and determines the index mark carried in the data acquisition request
Know information；
Searching module 203, for according to the index identification information, in the common index data that the IDS201 is preserved
In, search common index data corresponding to the index identification information；
Module 204 is provided, the use of the data acquisition request is sent for the common index found data to be supplied to
Family.
The IDS201 is specifically used for, and preserves pre-set business-subject table, and each business-subject table and index mark
Know the subordinate relation of information；Business-subject table belonging to the index identification information of the common index data determined, and by institute
Common index data are stated to be stored in definite business-subject table；
The searching module 203 is specifically used for, according to default each business-subject table in the IDS201, and each industry
The subordinate relation of business subject heading list and each index identification information, searches the index identification information institute carried in the data acquisition request
The business-subject table of category；In each common index data in the business-subject table found, searching please with the data acquisition
Seek common index data corresponding to the index identification information of middle carrying.
The index identification information that the IDS201 is preserved includes an indicator atom identification information, several indexs are repaiied
Excuse and a temporal information；
The IDS201 is specifically used for, for an index identification information, according in advance in the index identification information
Comprising the setting of indicator atom identification information statistic algorithm, and based on being directed to time for including in the index identification information in advance
Information and the statistical condition of each index qualifier setting, count source data, it is corresponding to obtain the index identification information
Common index data.
Described device further includes：
Application layer ADS205, for uniting in advance at least one common index data preserved in the IDS201
Meter, obtains personalized achievement data and preserves；
The searching module 203 is additionally operable to, when not finding the finger that is carried in the data acquisition request in IDS201
When marking common index data corresponding to identification information, personalization corresponding to the index identification information is searched in the ADS205
Achievement data.
The IDS201 is additionally operable to, and preserves attribute data；
The searching module 203 is additionally operable to, and is carried when in the data acquisition request that the receiving module 202 receives
During attribute-bit information, according to the attribute-bit information, in the attribute data that the IDS201 is preserved, the attribute is searched
Attribute data corresponding to identification information；
The offer module 204 is additionally operable to, and the attribute data found is supplied to and sends the data acquisition request
User.
The device of specific above-mentioned offer data can be located in data warehouse.
The embodiment of the present application provides a kind of method and device for providing data, and this method is in advance in the IDS of data warehouse
Common index data are preserved, when data warehouse receives the data acquisition request of user's transmission, are directly pre-saved from IDS
Common index data corresponding to the index identification information carried in the data acquisition request are searched in common index data, and are provided
To user.By the above method, data warehouse directly can will be pre-stored in IDS when providing a user common index data
In common index data be supplied to user, referred to without source data is successively handled upwards since the ODS of the bottom
Data are marked, are available to user, therefore can effectively save the computing resource of data warehouse, also improve the efficiency that data are provided.
It should be understood by those skilled in the art that, embodiments herein can be provided as method, system or computer program
Product.Therefore, the application can use the reality in terms of complete hardware embodiment, complete software embodiment or combination software and hardware
Apply the form of example.Moreover, the application can use the computer for wherein including computer usable program code in one or more
Usable storage medium（Including but not limited to magnetic disk storage, CD-ROM, optical memory etc.）The computer program production of upper implementation
The form of product.
The application is with reference to method, the equipment according to the embodiment of the present application（System）And the flow of computer program product
Figure and/or block diagram describe.It should be understood that it can be realized by computer program instructions every first-class in flowchart and/or the block diagram
The combination of flow and/or square frame in journey and/or square frame and flowchart and/or the block diagram.These computer programs can be provided
The processors of all-purpose computer, special purpose computer, Embedded Processor or other programmable data processing devices is instructed to produce
A raw machine so that the instruction performed by computer or the processor of other programmable data processing devices, which produces, to be used in fact
The device for the function of being specified in present one flow of flow chart or one square frame of multiple flows and/or block diagram or multiple square frames.
These computer program instructions, which may also be stored in, can guide computer or other programmable data processing devices with spy
Determine in the computer-readable memory that mode works so that the instruction being stored in the computer-readable memory, which produces, to be included referring to
Make the manufacture of device, the command device realize in one flow of flow chart or multiple flows and/or one square frame of block diagram or
The function of being specified in multiple square frames.
These computer program instructions can be also loaded into computer or other programmable data processing devices so that counted
Series of operation steps is performed on calculation machine or other programmable devices to produce computer implemented processing, thus in computer or
The instruction performed on other programmable devices is provided and is used for realization in one flow of flow chart or multiple flows and/or block diagram one
The step of function of being specified in a square frame or multiple square frames.
Although having been described for the preferred embodiment of the application, those skilled in the art once know basic creation
Property concept, then can make these embodiments other change and modification.So appended claims be intended to be construed to include it is excellent
Select embodiment and fall into all change and modification of the application scope.
Obviously, those skilled in the art can carry out the embodiment of the present application various modification and variations without departing from this Shen
Please embodiment spirit and scope.In this way, if these modifications and variations of the embodiment of the present application belong to the application claim
And its within the scope of equivalent technologies, then the application is also intended to comprising including these modification and variations.
Claims (10)
- A kind of 1. method that data are provided, it is characterised in that including：The source data preserved in data warehouse is counted in advance, obtains common index data, the common index number that will be obtained According in the wide top layer IDS of the theme for being stored in the data warehouse；When the data warehouse receives data acquisition request, the index mark letter carried in the data acquisition request is determined Breath；AndAccording to the index identification information, in the common index data that the IDS is preserved, the index identification information pair is searched The common index data answered；AndThe common index data found are supplied to the user for sending the data acquisition request.
- 2. the method as described in claim 1, it is characterised in that obtained common index data are stored in the data warehouse IDS in, specifically include：Business-subject table, and the subordinate relation of each business-subject table and index identification information are set in the IDS in advance；Business-subject table belonging to the index identification information of the common index data determined, and by the common index data It is stored in definite business-subject table；In the common index data that the IDS is preserved, common index data corresponding to the index identification information are searched, specifically Including：According to default each business-subject table in the IDS, and the subordinate of each business-subject table and each index identification information Relation, searches the business-subject table belonging to the index identification information carried in the data acquisition request；AndIn each common index data in the business-subject table found, the finger with being carried in the data acquisition request is searched Mark common index data corresponding to identification information.
- 3. method as claimed in claim 2, it is characterised in that an index identification information includes an indicator atom mark letter Breath, several index qualifiers and a temporal information；The source data preserved in data warehouse is counted in advance, common index data is obtained, specifically includes：For an index identification information, set according to the indicator atom identification information that is included in the index identification information is directed in advance Fixed statistic algorithm, and based in advance for the temporal information included in the index identification information and the setting of each index qualifier Statistical condition, source data is counted, obtains common index data corresponding to the index identification information.
- 4. the method as described in claim 1, it is characterised in that at least one common index to being preserved in the IDS in advance Data are counted, and obtain personalized achievement data, and are stored in application layer ADS；The method further includes：When not finding common index data corresponding to the index identification information that is carried in the data acquisition request in IDS When, personalized achievement data corresponding to the index identification information is searched in the ADS.
- 5. the method as described in claim 1, it is characterised in that preserve attribute data in the IDS in advance；The method further includes：When carrying attribute-bit information in the data acquisition request that the data warehouse receives, the data warehouse is according to institute Attribute-bit information is stated, in the attribute data that the IDS is preserved, searches the corresponding attribute data of the attribute-bit information； AndThe attribute data found is supplied to the user for sending the data acquisition request.
- A kind of 6. device that data are provided, it is characterised in that including：The wide top layer IDS of theme, for being counted in advance to source data, obtains common index data and preserves；Receiving module, for receiving data acquisition request, and determines the index identification information carried in the data acquisition request；Searching module, for according to the index identification information, in the common index data that the IDS is preserved, described in lookup Common index data corresponding to index identification information；Module is provided, the user of the data acquisition request is sent for the common index found data to be supplied to.
- 7. device as claimed in claim 6, it is characterised in that the IDS is specifically used for, and preserves pre-set business-subject Table, and the subordinate relation of each business-subject table and index identification information；The index mark of the common index data determined Business-subject table belonging to information, and the common index data are stored in definite business-subject table；The searching module is specifically used for, according to default each business-subject table in the IDS, and each business-subject table with The subordinate relation of each index identification information, searches the business master belonging to the index identification information carried in the data acquisition request Inscribe table；In each common index data in the business-subject table found, carried in lookup and the data acquisition request Common index data corresponding to index identification information.
- 8. device as claimed in claim 7, it is characterised in that the index identification information that the IDS is preserved includes one Indicator atom identification information, several index qualifiers and a temporal information；The IDS is specifically used for, for an index identification information, according in advance for the original included in the index identification information The statistic algorithm of sub- index identification information setting, and based on being directed to the temporal information that is included in the index identification information and every in advance The statistical condition of a index qualifier setting, counts source data, obtains common index corresponding to the index identification information Data.
- 9. device as claimed in claim 6, it is characterised in that described device further includes：Application layer ADS, for being counted in advance at least one common index data preserved in the IDS, obtains individual character Change achievement data and preserve；The searching module is additionally operable to, when not finding the index identification information that is carried in the data acquisition request in IDS During corresponding common index data, personalized achievement data corresponding to the index identification information is searched in the ADS.
- 10. device as claimed in claim 6, it is characterised in that the IDS is additionally operable to, and preserves attribute data；The searching module is additionally operable to, and is believed when carrying attribute-bit in the data acquisition request that the receiving module receives During breath, according to the attribute-bit information, in the attribute data that the IDS is preserved, search the attribute-bit information and correspond to Attribute data；The offer module is additionally operable to, and the attribute data found is supplied to the user for sending the data acquisition request.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310153297.0A CN104123303B (en) | 2013-04-27 | 2013-04-27 | A kind of method and device that data are provided |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310153297.0A CN104123303B (en) | 2013-04-27 | 2013-04-27 | A kind of method and device that data are provided |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104123303A CN104123303A (en) | 2014-10-29 |
| CN104123303B true CN104123303B (en) | 2018-04-24 |
Family
ID=51768715
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201310153297.0A Active CN104123303B (en) | 2013-04-27 | 2013-04-27 | A kind of method and device that data are provided |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104123303B (en) |
Families Citing this family (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107025266B (en) * | 2017-02-28 | 2020-10-30 | 创新先进技术有限公司 | Service data processing method and device |
| CN108805376A (en) * | 2017-05-02 | 2018-11-13 | 北京京东尚科信息技术有限公司 | A kind of statistical method, device, electronic equipment and storage medium |
| CN109597846B (en) * | 2018-10-22 | 2024-05-07 | 平安科技（深圳）有限公司 | Data processing method, device and computer equipment for large data platform data warehouse |
| CN112199393B (en) * | 2020-09-18 | 2024-05-10 | 深圳希施玛数据科技有限公司 | Data table generation method, device, equipment and storage medium based on cross-table query |
| CN112734480A (en) * | 2021-01-13 | 2021-04-30 | 上海群之脉信息科技有限公司 | Refund data processing intelligent system |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101150831A (en) * | 2007-10-24 | 2008-03-26 | 华为技术有限公司 | Network element data processing method and device |
| CN102129425A (en) * | 2010-01-20 | 2011-07-20 | 阿里巴巴集团控股有限公司 | Method and device for accessing large-object set table in data warehouse |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP4764596B2 (en) * | 2003-12-08 | 2011-09-07 | 株式会社日立製作所 | Data transfer method and server computer |
| CN102298598A (en) * | 2010-06-23 | 2011-12-28 | 潘晓梅 | Method and device for analyzing patent information |
| CN101980188A (en) * | 2010-10-14 | 2011-02-23 | 联动优势科技有限公司 | Data index storing method and device and data index analyzing method and device |
| CN102831172B (en) * | 2012-07-26 | 2015-01-21 | 国网信息通信有限公司 | Method and device for processing data in enterprise patent databank |
-
2013
- 2013-04-27 CN CN201310153297.0A patent/CN104123303B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101150831A (en) * | 2007-10-24 | 2008-03-26 | 华为技术有限公司 | Network element data processing method and device |
| CN102129425A (en) * | 2010-01-20 | 2011-07-20 | 阿里巴巴集团控股有限公司 | Method and device for accessing large-object set table in data warehouse |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104123303A (en) | 2014-10-29 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104123303B (en) | A kind of method and device that data are provided | |
| CN108090225A (en) | Operation method, device, system and the computer readable storage medium of database instance | |
| CN109961357A (en) | User data processing method, device, electronic equipment and storage medium | |
| CN109213802B (en) | User portrait construction method and device, terminal and computer readable storage medium | |
| US20120209997A1 (en) | Providing Page Navigation in Multirole-Enabled Network Application | |
| WO2022007592A1 (en) | Multidimensional data analysis method, apparatus, and system | |
| CN109118288A (en) | Target user's acquisition methods and device based on big data analysis | |
| US20200074509A1 (en) | Business data promotion method, device, terminal and computer-readable storage medium | |
| CN111414410B (en) | Data processing method, device, equipment and storage medium | |
| CN112380454A (en) | Training course recommendation method, device, equipment and medium | |
| US8707262B2 (en) | Code scoring | |
| CN106874293A (en) | A kind of data processing method and device | |
| CN107798558A (en) | User behavior data analysis method and server | |
| US8255253B2 (en) | Cross functional area service identification method and system | |
| CN109934523A (en) | Information processing method and device | |
| CN109918385A (en) | Tripartite's account checking method, electronic device and readable storage medium storing program for executing | |
| CN104866603A (en) | Calling method of metadata and metadata managing system | |
| CN114625975B (en) | Knowledge graph-based customer behavior analysis system | |
| CN106920124A (en) | A kind of Data acquisition and issuance method and device | |
| US20150073902A1 (en) | Financial Transaction Analytics | |
| CN114840660A (en) | Service recommendation model training method, device, equipment and storage medium | |
| CN114238777A (en) | Negative feedback flow distribution method, device, equipment and medium based on behavior analysis | |
| CN107844563A (en) | The creation method and device in a kind of electric business enterprise storehouse | |
| CN114238233A (en) | Automatic file cleaning method, device, equipment and storage medium | |
| CN108665345B (en) | Label mapping method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20211115 Address after: Room 233, building 14, No. 788, Guangzhou Avenue South, Haizhu District, Guangzhou City, Guangdong Province Patentee after: Alibaba South China Technology Co., Ltd Address before: P.O. Box 847, 4th floor, capital building, Grand Cayman, British Cayman Islands Patentee before: Alibaba Group Holdings Limited |
|
| TR01 | Transfer of patent right |