CN102279886B - Method and equipment for processing metadata - Google Patents
Method and equipment for processing metadata Download PDFInfo
- Publication number
- CN102279886B CN102279886B CN201110235136A CN201110235136A CN102279886B CN 102279886 B CN102279886 B CN 102279886B CN 201110235136 A CN201110235136 A CN 201110235136A CN 201110235136 A CN201110235136 A CN 201110235136A CN 102279886 B CN102279886 B CN 102279886B
- Authority
- CN
- China
- Prior art keywords
- metadata
- data
- order
- ddl
- treatment facility
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention provides a method and equipment for processing metadata. The method comprises the following steps that: the equipment for processing the metadata acquires an extraction-transformation-loading (ETL) execution log and acquires a first data definition language (DDL) command, wherein the first DDL command is used for performing node definition on a data object included by the ETL execution log; the equipment for processing the metadata analyzes the acquired ETL execution log to acquire a second DDL command and a data manipulation language (DML) command, wherein the second DDL command is used for performing node definition on a temporary object included by the ETL execution log, and the DML command is used for recording the conversion operation of the data object and/or the temporary object in an ETL execution process; and the equipment for processing the metadata acquires the metadata which is used for representing the data flow direction of the data object and/or the temporary object by analyzing the first DDL command, the second DDL command and the DML command. By the method and the equipment for processing the metadata, the metadata which reflects the real data flow direction can be acquired.
Description
Technical field
The present invention relates to the metadata treatment technology, relate in particular to a kind of metadata disposal route and equipment.
Background technology
Along with the fast development of office automation, information has become the valuable source of modern enterprise, is the basis of enterprise's utilization scientific management, decision analysis, is used to realize that the data warehouse of independent data management has also obtained using very widely.
Data pick-up, conversion and loading (Extraction-Transformation-Loading; ETL) be the important step that makes up data warehouse; It is responsible for data that distribute, in the heterogeneous data source, like relation data and flat data file etc., cleans, changes and load after being drawn into interim middle layer; And be incorporated in the data warehouse, become the basis of on-line analytical processing and data mining.The ETL process adopts metadata approach to manage concentratedly.Wherein, Metadata is the data (data about data) of data of description, and it concentrates on for ETL's: the position in definition of data source and the attribute of data source, the definite rule of correspondence, definite relevant service logic and other necessary preliminary works before the data actual loaded etc. from the source data to the target data.
In the prior art, when realizing data management based on data warehouse, the data flow in the time of need knowing the structure data warehouse through the metadata that before carrying out ETL, sets, thus set up data association, avoid producing data silo or information blind area.But owing in the ETL of reality process, possibly there are differences owing to some reasons make real data flow to the preset data flow direction.At this moment, if still carry out data management, just can't accurately know the flow direction relation between the data, thereby can't carry out reliably the data warehouse, effectively manage based on predefined metadata.
Summary of the invention
To above-mentioned defective, the present invention provides a kind of metadata disposal route and equipment, in order to realize obtaining the metadata that can reflect that True Data flows to.
According to an aspect of the present invention, a kind of metadata disposal route is provided, comprises:
The metadata treatment facility receives the metadata processing instruction that the user sends; Respond said metadata processing instruction and obtain data pick-up, conversion and loading ETL execution journal; And obtain the first database definition language DDL from data warehouse and order, wherein said DDL order is used for the data object that said ETL execution journal comprises is carried out node definition;
Said metadata treatment facility is resolved the ETL execution journal of being obtained; To obtain the 2nd DDL order and data manipulation language (DML) DML order; Wherein said the 2nd DDL order is used for the temporary object that said ETL execution journal comprises is carried out node definition, and said DML order is used to be recorded in the conversion operations of data object described in the ETL implementation and/or said temporary object;
Said metadata treatment facility obtains the metadata of the data flow that is used to represent said data object and said temporary object through resolving said DDL order, said the 2nd DDL order and said DML order, and to the said metadata of said user feedback.
According to a further aspect in the invention, a kind of metadata treatment facility is provided also, it is characterized in that, comprising:
Acquisition module is used to obtain the ETL execution journal, and obtains DDL order from data warehouse, and wherein said DDL order is used for the data object that said ETL execution journal comprises is carried out node definition;
Log analyzing module; Be used for the ETL execution journal of being obtained is resolved; To obtain the 2nd DDL order and data manipulation language (DML) DML order; Wherein said the 2nd DDL order is used for the temporary object that said ETL execution journal comprises is carried out node definition, and said DML order is used to be recorded in the conversion operations of data object described in the ETL implementation and/or said temporary object;
The metadata acquisition module is used for obtaining the metadata of the data flow that is used to represent said data object and said temporary object through resolving said DDL order, said the 2nd DDL order and said DML order.
According to metadata disposal route of the present invention and equipment; Owing to be that DDL resolves and DML resolves the flow direction relation of obtaining between the object through the ETL execution journal of true operation generation is carried out; So the metadata of the relation of the flow direction between the sign object that is obtained is consistent with true implementation status; Can reflect efficiently and accurately that the True Data in the ETL implementation flows to, thereby can carry out reliable data dependence analysis and system function optimization etc. based on this metadata.
Description of drawings
In order to be illustrated more clearly in the embodiment of the invention or technical scheme of the prior art; To do to introduce simply to the accompanying drawing of required use in embodiment or the description of the Prior Art below; Obviously, the accompanying drawing in describing below only is some embodiments of the present invention, for those of ordinary skills; Under the prerequisite of not paying creative work property, can also obtain other accompanying drawing according to these accompanying drawings.
Fig. 1 is the schematic flow sheet of metadata disposal route of the present invention.
Fig. 2 is for using the data warehouse Organization Chart of metadata disposal route of the present invention.
Fig. 3 is the structural representation of metadata treatment facility of the present invention.
Embodiment
To combine the accompanying drawing in the embodiment of the invention below, the technical scheme in the embodiment of the invention is carried out clear, intactly description, obviously, described embodiment only is the present invention's part embodiment, rather than whole embodiment.Based on the embodiment among the present invention, those of ordinary skills are not making the every other embodiment that is obtained under the creative work prerequisite, all belong to the scope of the present invention's protection.
Fig. 1 is the schematic flow sheet of metadata disposal route of the present invention.As shown in Figure 1, this metadata disposal route comprises:
Step S101; The metadata treatment facility obtains the ETL execution journal; And (wherein said DDL order is used for the data object that said ETL execution journal comprises is carried out node definition for Data Definition Language, DDL) order to obtain first database definition language from data warehouse;
Step S102; Said metadata treatment facility is resolved the ETL execution journal of being obtained; To obtain the 2nd DDL order and data manipulation language (DML) (Data Manipulation Language; DML) order, wherein said the 2nd DDL order is used for the temporary object that said ETL execution journal comprises is carried out node definition, and said DML order is used to be recorded in the conversion operations of data object described in the ETL implementation and/or said temporary object;
Step S103, said metadata treatment facility obtains the metadata of the data flow that is used to represent said data object and said temporary object through resolving said DDL order, said the 2nd DDL order and said DML order.
Fig. 2 is for using the data warehouse Organization Chart of metadata disposal route of the present invention.As shown in Figure 2; In data warehouse, comprise a plurality of data sources, a plurality of ETL equipment (being that example describes only among Fig. 2) and data warehouse with 2; Wherein ETL equipment is connected between data source and the data warehouse, is used for the data of data source are extracted, change and be loaded into data warehouse.
Wherein, Data warehouse is a kind of data organization mode of subject-oriented; It can the data to analytic target provide complete, consistent description on higher level; Each association of the enterprise that each analytic target of portrayal that can be complete, unified is related and the contact between the data, thus the business activity characteristics of each department of enterprise and the behavioral characteristics of business data adapted to, fundamentally realize separating of data and application.The extraction process of ETL equipment is meant data and promptly reads out in the data source from various original operation systems; Transfer process is meant according to pre-designed rule the data that extract is changed, cleaned; And the data of handling some redundancies, ambiguity; The data layout of original isomery can be united, and transformation rule and function for example comprise the symbol of selecting fields specific, translation coding, symbol, calculated value and the merging source etc. that coding is new; Loading procedure is meant the data importing that converts in data warehouse.
In data warehouse shown in Figure 2, also comprise the metadata treatment facility that is connected with each ETL equipment respectively.Above-mentioned steps S101～S103 is carried out by this metadata treatment facility.
Particularly; The metadata treatment facility for example receives the metadata processing instruction of user's input through self-contained human-computer interaction interface, or receives the metadata processing instruction that the user sends through the user terminal (not shown) that is arranged in the data warehouse, communicate with this metadata treatment facility.This metadata processing instruction of metadata treatment facility response obtains the ETL daily record from 1ETL equipment and 2ETL equipment respectively.Wherein, the ETL daily record is divided three classes: the first kind is an execution journal, is the record in one step of every execution in the ETL implementation, with the zero-time of day-to-day account form record each run, each step, influenced how many line data and carried out content; Second type is error log, when certain module is made mistakes, needs the write error daily record, the information that is used to write down the time of at every turn makeing mistakes, the module of makeing mistakes and makes mistakes; The 3rd type is overall daily record, only writes down ETL start time, concluding time information of successful whether.
The metadata treatment facility is ordered through DDL whole objects related in the ETL execution journal and is carried out node definition.Wherein, Whole objects related in the ETL execution journal comprise data object and temporary object; Wherein data object is the data object that defines in the data warehouse; Comprise former data object and target data object, temporary object is the intermediate virtual object of in the transfer process by former data object to target data object, setting up for performance optimization, for example variable temporary table.Particularly; When related whole objects carry out the DDL node definition in to the ETL execution journal; Need to obtain the node definition of data object from data warehouse; And from the log file of ETL execution journal, parse the DDL order in the ETL implementation, i.e. the node definition that temporary object carried out to being created, for example defined node structure etc.To order from the DDL that data warehouse obtains and resolve the 2nd DDL order merging that obtains and be stored as a ddl file through log.For example comprise the DDL order of from data warehouse, reading " create table T1 (F1x32; F2x10) " in this ddl file and from the log file, parse DDL order " create table t2 (f1x32; f2x10) "; Wherein, definition of data Object table T1 comprises data object F1 and F2, and definition temporary object table t2 comprises temporary object f1 and f2.
In addition, also need in the process that the log file of ETL execution journal is resolved, to extract the DML order that is comprised.Wherein, the DML order is the process that forms data stream.More particularly; For example adopt following mode from the log file, to extract the DML order: the metadata treatment facility word for word reads the log file; After having read a complete statement; Comprise the key word of DML order (for example being " INSERT " or " UPDATE ") and meet the statement condition for validity if know this statement, know that then this statement is that DML orders and it is stored to separately in the DML file.Wherein, Owing to also comprise non-exectorial multiple interfere information in the ETL execution journal; The notes content that for example starts and end up etc. with " */" with "/* "; So whether need to be used to distinguish this statement to the input of metadata treatment facility in advance is the condition for validity of interfere information, for example this statement is not to start with "/* ".In this way, for example find DML order " INSERT INTO T1 SELETE*from t2 ".
After obtaining ddl file and DML file, DML resolves and DLL resolves the data flow of obtaining data object and temporary object related in the ETL execution journal through carrying out.Particularly, the metadata treatment facility is at first handled each the bar DML order in the DML file, for example removes the operations such as data computation in the DML order according to the semanteme table that presets, thereby obtains object and relation between objects.Wherein, store a large amount of key words in the semantic table, for example comprise key word MAX, then when in the DML order, reading key word MAX, it is ignored, do not consider.Afterwards,, for example be table according to related object in the DML order, and the definition of from ddl file, searching this table, obtain the included concrete object of table, thereby set up the data flow of data object and temporary object.For example to DML order " INSERT INTO T1SELETE*from t2 " (promptly the object from t2 is inserted among the T1); The definition of the definition of look-up table T1 and table t2 from ddl file; Know that data object T1 comprises concrete object F1 and F2; Temporary object t2 comprises concrete object f1 and f2, and matees according to the order that concrete object defines in data object T1 and temporary object t2, then obtains data flow metadata " T1.F1＜-t2.f1 " and " T1.F2＜-t2.f2 ".The metadata treatment facility feeds back to the user terminal of transmission metadata processing instruction with the metadata that is obtained or shows to the user through human-computer interaction interface.
Metadata disposal route according to the foregoing description; Owing to be that DDL resolves and DML resolves the flow direction relation of obtaining between the object through the ETL execution journal of true operation generation is carried out; So the metadata of the relation of the flow direction between the sign object that is obtained is consistent with true implementation status; Can reflect efficiently and accurately that the True Data in the ETL implementation flows to, thereby can carry out reliable data dependence analysis and system function optimization etc. based on this metadata.
Further, in the metadata disposal route of the foregoing description, after the step of the metadata of obtaining the data flow that is used to represent said data object and said temporary object, also comprise:
Temporary object in the metadata of the data flow of said metadata treatment facility shielding said data object of expression and said temporary object is to obtain the metadata of the data flow that is used to represent said data object.
Particularly because in the ETL implementation, the naming rule of the temporary object of being created for " the script name. table. temporary object ", for example be " pl_name.t2.f1 " that wherein pl_name is the script name; And in data warehouse, the naming rule of defined data object be " library name. table/view. data object ", for example be " Db_name.T1.F1 " that wherein Db_name is a library name.Therefore, the metadata treatment facility can be distinguished data object and temporary object through the title of identifying object.
Next, the metadata of object relationship that is used to characterize in twos that the metadata disposal route through the foregoing description is obtained is put in order.Particularly, the metadata treatment facility detect each in twos the destination object in the relation whether be temporary object, for example object A is former object in relational expression " object A → object B " first-class, object B is a destination object, this moment, destination object was a temporary object; Then continuing to search with this temporary object is the relation in twos of former object, flows to relational expression " object B → object C " thereby find second; Detect once more whether second destination object that flow in the relational expression is temporary object this moment, carry out that this to search until the final objective object be not temporary object.For example C is a data object, then flows to the temporary object B shielding in the relational expression with first-class to relational expression and second this moment, thereby obtains the data flow relation of " object A → object C ".
More particularly; For example, through utilizing the metadata disposal route of the foregoing description, data flow " T1.F1＜-t2.f1 ", " T1.F2＜-t2.f2 ", " t2.f1＜-V1.f1 " and " t2.f2＜-V1.f2 " have been obtained; Wherein t2 is a temporary object; T1 and V1 are data object, then through shielding temporary object t2, can directly obtain flow direction relation " T1.F1＜-V1.f1 " and " T1.F2＜-V1.f2 " between the data object.
Metadata disposal route according to the foregoing description; Because temporary object only is the intermediate virtual object of in the transfer process by former data object to target data object, setting up for performance optimization; Do not possess essential meaning for the data management in the data warehouse in later stage, so the flow direction relation of directly setting up between the data object helps carrying out the data warehouse management that the later use metadata is carried out.
Further, in the metadata disposal route of the foregoing description, said data object comprises table and view; Correspondingly, after the step of the metadata of obtaining the data flow that is used to represent said data object, also comprise:
View in the metadata of the data flow of the said data object of expression that the shielding of said metadata treatment facility is generated is used for the metadata of the data flow of expression table with generation.
Wherein, the query-defined Virtual table that view is made up of the SELECT statement, it is made up of the data in one or more table, and it is the same with real table, comprises a series of row and line data that have title.But view does not exist with the data set form of storage in database.The table that number of lines and columns are quoted according to the inquiry that freely defines view, and when quoting view, dynamically generate.
For example; Flow direction relation between the data object " T1.F1＜-V1.f1 ", " T1.F2＜-V1.f2 ", " V1.f1＜-T3.f1 " and " V1.f2＜-T3.f2 " have been obtained; Wherein T1 and T3 are table; V1 is a view, then through shielding view V1, gets access to flow direction relation between table T1 and the table T3 " T1.F1＜-T3.f1 " and " T1.F2＜-T3.f2 ".
According to the metadata disposal route of the foregoing description, can directly obtain to be stored in table and the flow direction relation between the table in the data warehouse.
Further, in the metadata disposal route of the foregoing description, said metadata treatment facility comprises service end and browser end; Correspondingly, said metadata disposal route also comprises: the service end of said metadata treatment facility representes that with being used to of being generated the metadata of data flow is sent to said browser end and shows.
Fig. 3 is the structural representation of metadata treatment facility of the present invention.As shown in Figure 3, this metadata treatment facility comprises:
Acquisition module 11; Be used to receive the metadata processing instruction that the user sends; Respond said metadata processing instruction and obtain the ETL execution journal, and obtain DDL order from data warehouse, wherein said DDL order is used for the data object that said ETL execution journal comprises is carried out node definition;
Log analyzing module 12; Be used for the ETL execution journal of being obtained is resolved; To obtain the 2nd DDL order and data manipulation language (DML) DML order; Wherein said the 2nd DDL order is used for the temporary object that said ETL execution journal comprises is carried out node definition, and said DML order is used to be recorded in the conversion operations of data object described in the ETL implementation and/or said temporary object;
The metadata treatment facility of the foregoing description for example adopts the J2EE platform technology to realize; And the running environment of dependence Java Sdk more than 1.6; Its flow process of obtaining the metadata that is used to represent data flow is identical with the metadata disposal route of the foregoing description, so locate to repeat no more.
Metadata treatment facility according to the foregoing description; Owing to be that DDL resolves and DML resolves the flow direction relation of obtaining between the object through the ETL execution journal of true operation generation is carried out; So the metadata of the relation of the flow direction between the sign object that is obtained is consistent with true implementation status; Can reflect efficiently and accurately that the True Data in the ETL implementation flows to, thereby can carry out reliable data dependence analysis and system function optimization etc. based on this metadata.
Further, in the metadata treatment facility of the foregoing description, said metadata acquisition module also is used for shielding the temporary object of said data flow, to obtain the metadata of the data flow that is used to represent said data object.
Metadata treatment facility according to the foregoing description; Because temporary object only is the intermediate virtual object of in the transfer process by former data object to target data object, setting up for performance optimization; Do not possess essential meaning for the data management in the data warehouse in later stage, so the flow direction relation of directly setting up between the data object helps carrying out the data warehouse management that the later use metadata is carried out.
Further, in the metadata treatment facility of the foregoing description, said metadata acquisition module also is used for shielding the view of metadata of the data flow of the said data object of expression that is generated, and is used for the metadata of the data flow of expression table with generation.
According to the metadata treatment facility of the foregoing description, can directly obtain to be stored in table and the flow direction relation between the table in the data warehouse.
Further, in the metadata treatment facility of the foregoing description, comprise service end and browser end; Wherein, said acquisition module, said log analyzing module and said metadata acquisition module are arranged on said service end, and said metadata acquisition module also is used for being used to of being generated represented that the metadata of data flow is sent to said browser end and shows.
According to the metadata treatment facility of the foregoing description, can be simultaneously to the provide convenience friendly interface of the B/S pattern used of domestic consumer or business personnel.In addition, this metadata treatment facility also can adopt the current design of the relational database support of standard to store the metadata of being obtained, and with support several data storehouse, and can realize carrying out metadata query easily by the technician.
What should explain at last is: above embodiment is only in order to explaining technical scheme of the present invention, but not to its restriction; Although with reference to previous embodiment the present invention has been carried out detailed explanation, those of ordinary skill in the art is to be understood that: it still can be made amendment to the technical scheme that aforementioned each embodiment put down in writing, and perhaps part technical characterictic wherein is equal to replacement; And these are revised or replacement, do not make the spirit and the scope of the essence disengaging various embodiments of the present invention technical scheme of relevant art scheme.
Claims (8)
1. a metadata disposal route is characterized in that, comprising:
The metadata treatment facility receives the metadata processing instruction that the user sends; Respond said metadata processing instruction and obtain data pick-up, conversion and loading ETL execution journal; And obtain the first database definition language DDL from data warehouse and order, wherein said DDL order is used for the data object that said ETL execution journal comprises is carried out node definition;
Said metadata treatment facility is resolved the ETL execution journal of being obtained; To obtain the 2nd DDL order and data manipulation language (DML) DML order; Wherein said the 2nd DDL order is used for the temporary object that said ETL execution journal comprises is carried out node definition, and said DML order is used to be recorded in the conversion operations of data object described in the ETL implementation and/or said temporary object;
Said metadata treatment facility obtains the metadata of the data flow that is used to represent said data object and said temporary object through resolving said DDL order, said the 2nd DDL order and said DML order, and to the said metadata of said user feedback.
2. metadata disposal route according to claim 1 is characterized in that, after the step of the metadata of obtaining the data flow that is used to represent said data object and said temporary object, also comprises:
Temporary object in the metadata of the data flow of said metadata treatment facility shielding said data object of expression and said temporary object is to obtain the metadata of the data flow that is used to represent said data object.
3. metadata disposal route according to claim 2 is characterized in that, said data object comprises table and view; Correspondingly, after the step of the metadata of obtaining the data flow that is used to represent said data object, also comprise:
View in the metadata of the data flow of the said data object of expression that the shielding of said metadata treatment facility is generated is used for the metadata of the data flow of expression table with generation.
4. according to the arbitrary described metadata disposal route of claim 1 to 3, it is characterized in that said metadata treatment facility comprises service end and browser end; Correspondingly, said metadata disposal route also comprises: the service end of said metadata treatment facility representes that with being used to of being generated the metadata of data flow is sent to said browser end and shows.
5. a metadata treatment facility is characterized in that, comprising:
Acquisition module is used to obtain the ETL execution journal, and obtains DDL order from data warehouse, and wherein said DDL order is used for the data object that said ETL execution journal comprises is carried out node definition;
Log analyzing module; Be used for the ETL execution journal of being obtained is resolved; To obtain the 2nd DDL order and data manipulation language (DML) DML order; Wherein said the 2nd DDL order is used for the temporary object that said ETL execution journal comprises is carried out node definition, and said DML order is used to be recorded in the conversion operations of data object described in the ETL implementation and/or said temporary object;
The metadata acquisition module is used for obtaining the metadata of the data flow that is used to represent said data object and said temporary object through resolving said DDL order, said the 2nd DDL order and said DML order.
6. metadata treatment facility according to claim 5 is characterized in that said metadata acquisition module also is used for shielding the temporary object of said data flow, to obtain the metadata of the data flow that is used to represent said data object.
7. metadata treatment facility according to claim 6; It is characterized in that; Said metadata acquisition module also is used for shielding the view of metadata of the data flow of the said data object of expression that is generated, and is used for the metadata of the data flow of expression table with generation.
8. according to the arbitrary described metadata treatment facility of claim 5 to 7, it is characterized in that, comprise service end and browser end; Wherein, said acquisition module, said log analyzing module and said metadata acquisition module are arranged on said service end, and said metadata acquisition module also is used for being used to of being generated represented that the metadata of data flow is sent to said browser end and shows.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201110235136A CN102279886B (en) | 2011-08-16 | 2011-08-16 | Method and equipment for processing metadata |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201110235136A CN102279886B (en) | 2011-08-16 | 2011-08-16 | Method and equipment for processing metadata |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102279886A CN102279886A (en) | 2011-12-14 |
| CN102279886B true CN102279886B (en) | 2012-10-17 |
Family
ID=45105328
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201110235136A Active CN102279886B (en) | 2011-08-16 | 2011-08-16 | Method and equipment for processing metadata |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102279886B (en) |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103577586B (en) * | 2013-11-08 | 2017-03-15 | 北京国双科技有限公司 | The processing method and processing device of log recording |
| CN105205053A (en) * | 2014-05-30 | 2015-12-30 | 阿里巴巴集团控股有限公司 | Method and system for analyzing database incremental logs |
| CN105447014B (en) * | 2014-08-15 | 2019-03-15 | 阿里巴巴集团控股有限公司 | Metadata management method based on binlog and for providing the method and device of metadata |
| CN108427699B (en) * | 2017-09-22 | 2021-08-24 | 平安科技（深圳）有限公司 | Method, device and storage medium for quickly initializing system database |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101069200A (en) * | 2004-12-16 | 2007-11-07 | 国际商业机器公司 | Journaling to capture workflow and convert to workflow markup language |
| CN101105793A (en) * | 2006-07-11 | 2008-01-16 | 阿里巴巴公司 | Data processing method and system of data library |
| CN101305365A (en) * | 2004-12-17 | 2008-11-12 | 亚马逊科技公司 | Apparatus and method for data warehousing |
| US7512614B2 (en) * | 2003-06-12 | 2009-03-31 | International Business Machines Corporation | System and method for data ETL in a data warehouse environment |
| CN101477543A (en) * | 2008-01-03 | 2009-07-08 | 埃森哲环球服务有限公司 | System and method for automating ETL application |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20100280990A1 (en) * | 2009-04-30 | 2010-11-04 | Castellanos Maria G | Etl for process data warehouse |
-
2011
- 2011-08-16 CN CN201110235136A patent/CN102279886B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7512614B2 (en) * | 2003-06-12 | 2009-03-31 | International Business Machines Corporation | System and method for data ETL in a data warehouse environment |
| CN101069200A (en) * | 2004-12-16 | 2007-11-07 | 国际商业机器公司 | Journaling to capture workflow and convert to workflow markup language |
| CN101305365A (en) * | 2004-12-17 | 2008-11-12 | 亚马逊科技公司 | Apparatus and method for data warehousing |
| CN101105793A (en) * | 2006-07-11 | 2008-01-16 | 阿里巴巴公司 | Data processing method and system of data library |
| CN101477543A (en) * | 2008-01-03 | 2009-07-08 | 埃森哲环球服务有限公司 | System and method for automating ETL application |
Also Published As
| Publication number | Publication date |
|---|---|
| CN102279886A (en) | 2011-12-14 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107958057B (en) | Code generation method and device for data migration in heterogeneous database | |
| US11068439B2 (en) | Unsupervised method for enriching RDF data sources from denormalized data | |
| US20220342875A1 (en) | Data preparation context navigation | |
| CN101504672B (en) | Method and system for dynamically configuring physical data table | |
| CN104598376A (en) | Data driving layered automation test system and method | |
| CN103890709A (en) | Cache based key-value store mapping and replication | |
| CN102999537A (en) | System and method for data migration | |
| CN105094707A (en) | Method and device for storing and reading data | |
| CN101452487B (en) | Data loading method and system, and data loading unit | |
| CN101681377A (en) | User-defined relevance ranking for search | |
| US9406018B2 (en) | Systems and methods for semantic data integration | |
| CN105760520A (en) | Data control platform and architecture | |
| CN101675415B (en) | Program pattern analyzer, pattern appearance status information production method, pattern information generating device, and program | |
| CN101488086A (en) | Software generation method and apparatus based on field model | |
| CN102279886B (en) | Method and equipment for processing metadata | |
| CN104216961A (en) | Method and device for data processing | |
| CN103914290A (en) | Operating command processing method and device | |
| US20150052157A1 (en) | Data transfer content selection | |
| US11537785B1 (en) | Spreadsheet flat data extractor | |
| CN101727505A (en) | Efficient data processing method and device | |
| US10268644B2 (en) | Information processing apparatus, computer-readable recording medium having stored therein data conversion program, and data conversion method | |
| CN105354671A (en) | Universal configuration management system and enterprise-level information system comprising same | |
| US9852166B2 (en) | Task handling in a multisystem environment | |
| CN102043853A (en) | Method and device for updating stored data | |
| Hasan et al. | An approach for data transformation in homogeneous and heterogeneous information systems |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |