CN103186541A - Generation method and device for mapping relationship - Google Patents

Generation method and device for mapping relationship Download PDF

Info

Publication number
CN103186541A
CN103186541A CN201110445062XA CN201110445062A CN103186541A CN 103186541 A CN103186541 A CN 103186541A CN 201110445062X A CN201110445062X A CN 201110445062XA CN 201110445062 A CN201110445062 A CN 201110445062A CN 103186541 A CN103186541 A CN 103186541A
Authority
CN
China
Prior art keywords
sql
infrastructure elements
elements object
numbering
mapping relations
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201110445062XA
Other languages
Chinese (zh)
Other versions
CN103186541B (en
Inventor
张宗锋
李博源
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Advanced New Technologies Co Ltd
Original Assignee
Alibaba Group Holding Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Alibaba Group Holding Ltd filed Critical Alibaba Group Holding Ltd
Priority to CN201110445062.XA priority Critical patent/CN103186541B/en
Publication of CN103186541A publication Critical patent/CN103186541A/en
Application granted granted Critical
Publication of CN103186541B publication Critical patent/CN103186541B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Abstract

The invention discloses a generation method for a mapping relationship. The method is used for generating a field-stage mapping relationship so as to facilitate the automatic maintenance on element data in ETL (extraction transformation loading). The method comprises the following steps of: carrying out syntax analysis on a structured query language (SQL) program, and extracting SQL basic element objects in an SQL syntax tree; carrying out numbering and storing on the extracted SQL basic element objects according to an appearance sequence; replacing indefinite SQL basic element objects in the SQL basic element objects into definite SQL basic element objects, and storing according to numbers; and generating the mapping relationship according to the numbers of numbered SQL basic element objects and a corresponding rule. The invention further discloses a device for realizing the method.

Description

A kind of mapping relations generation method and device
Technical field
The present invention relates to computing machine and database field, particularly a kind of mapping relations generation method and device.
Background technology
ETL (Extraction-Transformation-Loading, data pick-up, conversion and loading) technology is cleaned after being responsible for data that distribute, in the heterogeneous data source such as relation data, flat data file etc. are drawn into interim middle layer, conversion, integrated, be loaded at last in data warehouse or the Data Mart, become the basis of on-line analytical processing, data mining.
With SQL (Structured Query Language, Structured Query Language (SQL)) script is in master's the ETL technology, whenever ETL program before exploitation or before revising, all need the table in table, field and the data warehouse of manual maintenance origin system, the relation between the field, be easy to cause maintenance information asynchronous with actual information like this, cause the relation information between these tables, the field inaccurate.
The present application people finds to exist in the prior art following technical matters at least in the process that realizes the embodiment of the present application technical scheme:
Concern with MAPPING (mapping) tool maintenance field mappings in the prior art, and generate the required SQL script of ETL automatically.But when the maintained personnel of SQL directly revised, the field mappings relation in the MAPPING instrument needed the maintainer to safeguard modification when having revised program, has increased cost of labor, and comparatively inconvenience of operation.
Summary of the invention
The embodiment of the invention provides a kind of mapping relations generation method and device, is used for generating the field level mappings relation, is convenient to the metadata among the ETL is safeguarded automatically.
A kind of mapping relations generation method may further comprise the steps:
Structured Query Language (SQL) SQL program is carried out grammatical analysis, extract the SQL infrastructure elements object in the SQL syntax tree;
The described SQL infrastructure elements object that extracts is numbered in proper order and stores according to appearance;
Non-definition SQL infrastructure elements object in the described SQL infrastructure elements object is replaced with definition SQL infrastructure elements object, and store according to described numbering;
Generate mapping relations according to the described SQL infrastructure elements object after the numbering and respective rule.
A kind of mapping relations generating apparatus comprises:
Analysis module is used for the SQL program is carried out grammatical analysis, extracts the SQL infrastructure elements object in the SQL syntax tree;
First processing module, the described SQL infrastructure elements object that is used for extracting is numbered in proper order and stores according to appearance;
Second processing module is used for the non-definition SQL infrastructure elements object of described SQL infrastructure elements object is replaced with definition SQL infrastructure elements object, and stores according to described numbering;
Matching module is used for generating mapping relations according to the described SQL infrastructure elements object after the numbering and respective rule.
Mapping relations generation method in the embodiment of the invention is extracted the SQL infrastructure elements object in the SQL syntax tree for the SQL program is carried out grammatical analysis; The described SQL infrastructure elements object that extracts is numbered in proper order and stores according to appearance; Non-definition SQL infrastructure elements object in the described SQL infrastructure elements object is replaced with definition SQL infrastructure elements object, and store according to described numbering; Generate mapping relations according to the described SQL infrastructure elements object after the numbering and respective rule.Infrastructure elements object in the SQL syntax tree is extracted, generate mapping relations according to respective rule again after handling, the mapping relations that generate can cover field level, such mapping relations granularity is thinner, can satisfy the demand of the analysis of field level influence property and consanguinity analysis, be convenient to the metadata information among the ETL is safeguarded automatically.
Description of drawings
Fig. 1 is the primary structure figure of mapping relations generating apparatus in the embodiment of the invention;
Fig. 2 is the main process flow diagram of mapping relations generation method in the embodiment of the invention.
Embodiment
Mapping relations generation method in the embodiment of the invention is extracted the SQL infrastructure elements object in the SQL syntax tree for the SQL program is carried out grammatical analysis; The described SQL infrastructure elements object that extracts is numbered in proper order and stores according to appearance; Non-definition SQL infrastructure elements object in the described SQL infrastructure elements object is replaced with definition SQL infrastructure elements object, and store according to described numbering; Generate mapping relations according to the described SQL infrastructure elements object after the numbering and respective rule.Infrastructure elements object in the SQL syntax tree is extracted, generate mapping relations according to respective rule again after handling, the mapping relations that generate can cover field level, such mapping relations concern that granularity is thinner, can satisfy the demand of the analysis of field level influence property and consanguinity analysis, be convenient to the metadata information among the ETL is safeguarded automatically.
The SQL of a complexity may be made up of a plurality of sub-SQL.The SQL of the most basic, atom may be made up of infrastructure elements such as SQL key word, field, table, functions.For each infrastructure elements among the complete documentation SQL as far as possible and between relation, thereby produce other mapping relations of field level, use original SQL, sub-SQL, table, field, scalar respectively, assert and infrastructure elements that these objects of condition are stored SQL.
Original SQL: the SQL of actual motion among the record ETL comprises information such as source code, working time, parsing situation.
Sub-SQL: original SQL is split as a plurality of sub-SQL step by step, as the SQL in the subquery.
Table: by the table that current SQL uses, be repeated to use table repeatedly to record repeatedly.The table of inquiry or influence is recorded in this object among each SQL.The type of this object may be physics table, view or a subquery ID.
Field: the field in the table that is used by current SQL, the field that is not used is record not, and reusable field can record repeatedly.
Scalar: can return field, function, the constant of SQL data type or the expression formula of being formed by the combination in any between them among the SQL.Because the combination scalar expression can comprise scalar, thereby has the multilayer recurrence, for the ease of analyzing, the scalar in the embodiment of the invention refers to outermost combination scalar.
Assert: by the logical expression that one or more scalar expressions and coupling key word are formed, the result that it returns is true or false.For example: select*from tableAwhere col1=2, wherein, col1=2 is one and asserts.
Condition: one or more asserting formed one group of filtercondition, is the expression formula that row collection data are filtered in the query statement.
Referring to Fig. 1, the mapping relations generating apparatus comprises analysis module 101, first processing module 102, second processing module 103 and matching module 104 in the embodiment of the invention.Described device can also comprise memory module 105.
Analysis module 101 is used for the SQL program is carried out grammatical analysis, extracts the SQL infrastructure elements object in the SQL syntax tree.The employed syntax tree of SQL that analysis module 101 makes up among the ETL, namely SQL is carried out grammatical analysis, when determining that SQL is errorless, be that the syntax tree structure finishes, continuation is reconstructed described syntax tree, namely extract the SQL infrastructure elements object in the SQL syntax tree, the described SQL infrastructure elements object that extracts can also be stored, can leave in the memory module 105.Described SQL infrastructure elements object refer among the SQL sub-SQL, table, field, scalar, assert etc.
The described SQL infrastructure elements object that first processing module 102 is used for extracting is numbered in proper order and stores according to appearance.When the SQL infrastructure elements object that analysis module 101 extracts in the SQL syntax tree, can there be the sequencing that extracts, first processing module 102 can be numbered described SQL infrastructure elements object according to this sequencing, SQL infrastructure elements object after will numbering is then stored, and can leave in the memory module 105.Concrete, first processing module 102 is after being numbered the SQL infrastructure elements object that extracts in the embodiment of the invention, it can be replaced with TMP (temporarily) element object respectively, and the TMP element object after will replacing stores according to described numbering, can leave in the memory module 105.For the expression formula that recurrence may occur, can only record its outer expression formula object, for example: func_a (func_b (col_1, col_2), then can record ": func_a (func_b (col_1, col_2) " whole as a scalar, and record its inner recurrence relation no longer respectively.
Second processing module 103 is used for the non-definition SQL infrastructure elements object of described SQL infrastructure elements object is replaced with definition SQL infrastructure elements object, and stores according to described numbering.Described non-definition SQL infrastructure elements object refers to not determine the SQL infrastructure elements object of meaning, and definition SQL infrastructure elements object refers to the SQL infrastructure elements object of definite meaning.For example, " * " in the described SQL infrastructure elements object is non-definition SQL infrastructure elements object, because indeterminate its refers to any content actually, then can be according to concrete SQL statement, this type of non-definition SQL infrastructure elements object is replaced with definition SQL infrastructure elements object, and leave the relevant position in according to the definition SQL infrastructure elements object after will replacing the number order of non-definition SQL infrastructure elements object before this.For example: table Ta (field: fa1 is arranged in the SQL running environment, fa2), then " * " in the sql like language " SELECT*FROM Ta " is non-definition SQL infrastructure elements object, need know that the Ta table comprises two field fa and fa2 according to the concrete environment of this SQL operation, and " * " represents all fields of Ta table, then " * " replaced with two definite SQL infrastructure elements objects of fa1 and fa2.Second processing module 103 can circular treatment TMP element object, replace the non-definition SQL infrastructure elements object in the described TMP element object, and create the corresponding SQL infrastructure elements of described TMP element object object, the described SQL infrastructure elements object after will numbering again after it is numbered is stored.
Concrete, in the embodiment of the invention, first processing module 102 replaces SQL infrastructure elements object for the TMP element object, then second processing module 103 can be that the non-definition TMP element object in the TMP element object is replaced with definition TMP element object, create the SQL infrastructure elements object corresponding with it respectively according to the TMP element object after replacing again, and the SQL infrastructure elements object of creating can be stored according to number order before, can leave in the memory module 105.
Matching module 104 is used for generating mapping relations according to the described SQL infrastructure elements object after the numbering and respective rule.Matching module 104 with the SQL infrastructure elements object of storage according to the algorithm of SQL standard engine processing list, field result set etc., the order that in SQL, occurs according to field, namely according to numbering SQL infrastructure elements object is mated one by one, generate the mapping relations of table mapping relations and field level respectively, and the mapping relations that generate can be stored in the memory module 105, be matching module 104 according to operation rule and the order of operation of SQL in database, generate table mapping relations and field mappings relation respectively.For example, matching module 104 can mate the mapping relations that generate between the SQL infrastructure elements object automatically according to the rule searching of SQL92 standard.
Below introduce mapping relations generation method in the embodiment of the invention by specific embodiment.
Referring to Fig. 2, the main method flow process that mapping relations generate in the embodiment of the invention is as follows:
Step 201: the SQL program is carried out grammatical analysis, extract the SQL infrastructure elements object in the SQL syntax tree.
Step 202: the described SQL infrastructure elements object that will extract is numbered in proper order and stores according to appearance.
Step 203: the non-definition SQL infrastructure elements object in the described SQL infrastructure elements object is replaced with definition SQL infrastructure elements object, and store according to described numbering.
Step 204: generate mapping relations according to the described SQL infrastructure elements object after the numbering and respective rule.
Mapping relations generation method in the embodiment of the invention is extracted the SQL infrastructure elements object in the SQL syntax tree for the SQL program is carried out grammatical analysis; The described SQL infrastructure elements object that extracts is numbered in proper order and stores according to appearance; Non-definition SQL infrastructure elements object in the described SQL infrastructure elements object is replaced with definition SQL infrastructure elements object, and store according to described numbering; Generate mapping relations according to the described SQL infrastructure elements object after the numbering and respective rule.Infrastructure elements object in the SQL syntax tree is extracted, generate mapping relations according to respective rule again after handling, the mapping relations that generate can cover field level, such mapping relations concern that granularity is thinner, can satisfy the demand of the analysis of field level influence property and consanguinity analysis, be convenient to the metadata information among the ETL is safeguarded automatically.
Those skilled in the art should understand that embodiments of the invention can be provided as method, system or computer program.Therefore, the present invention can adopt complete hardware embodiment, complete software embodiment or in conjunction with the form of the embodiment of software and hardware aspect.And the present invention can adopt the form of the computer program of implementing in one or more computer-usable storage medium (including but not limited to magnetic disk memory and optical memory etc.) that wherein include computer usable program code.
The present invention is that reference is described according to process flow diagram and/or the block scheme of method, equipment (system) and the computer program of the embodiment of the invention.Should understand can be by the flow process in each flow process in computer program instructions realization flow figure and/or the block scheme and/or square frame and process flow diagram and/or the block scheme and/or the combination of square frame.Can provide these computer program instructions to the processor of multi-purpose computer, special purpose computer, Embedded Processor or other programmable data processing device to produce a machine, make the instruction of carrying out by the processor of computing machine or other programmable data processing device produce to be used for the device of the function that is implemented in flow process of process flow diagram or a plurality of flow process and/or square frame of block scheme or a plurality of square frame appointments.
These computer program instructions also can be stored in energy vectoring computer or the computer-readable memory of other programmable data processing device with ad hoc fashion work, make the instruction that is stored in this computer-readable memory produce the manufacture that comprises command device, this command device is implemented in the function of appointment in flow process of process flow diagram or a plurality of flow process and/or square frame of block scheme or a plurality of square frame.
These computer program instructions also can be loaded on computing machine or other programmable data processing device, make and carry out the sequence of operations step producing computer implemented processing at computing machine or other programmable devices, thereby be provided for being implemented in the step of the function of appointment in flow process of process flow diagram or a plurality of flow process and/or square frame of block scheme or a plurality of square frame in the instruction that computing machine or other programmable devices are carried out.
Obviously, those skilled in the art can carry out various changes and modification to the present invention and not break away from the spirit and scope of the present invention.Like this, if of the present invention these are revised and modification belongs within the scope of claim of the present invention and equivalent technologies thereof, then the present invention also is intended to comprise these changes and modification interior.

Claims (10)

1. a mapping relations generation method is characterized in that, may further comprise the steps:
Structured Query Language (SQL) SQL program is carried out grammatical analysis, extract the SQL infrastructure elements object in the SQL syntax tree;
The described SQL infrastructure elements object that extracts is numbered in proper order and stores according to appearance;
Non-definition SQL infrastructure elements object in the described SQL infrastructure elements object is replaced with definition SQL infrastructure elements object, and store according to described numbering;
Generate mapping relations according to the described SQL infrastructure elements object after the numbering and respective rule.
2. the method for claim 1 is characterized in that, described SQL infrastructure elements object comprises sub-SQL, table, field, the scalar among the SQL at least and asserts.
3. the method for claim 1 is characterized in that, the step of extracting the SQL infrastructure elements object in the SQL syntax tree comprises: reconstruct SQL syntax tree obtains described SQL infrastructure elements object behind the implantation JAVA code in described SQL.
4. the method for claim 1, it is characterized in that, the step that the described SQL infrastructure elements object that extracts is numbered in proper order and stores according to appearance comprises: after the described SQL infrastructure elements object that will extract is numbered in proper order according to appearance, described SQL infrastructure elements object after the numbering is replaced with described TMP element object, and store according to described numbering.
5. method as claimed in claim 4, it is characterized in that, non-definition SQL infrastructure elements object in the described SQL infrastructure elements object is replaced with definition SQL infrastructure elements object, and the step of storing according to described numbering comprises: the non-definite TMP infrastructure elements object in the described TMP element object is replaced with determine TMP infrastructure elements object, according to the corresponding SQL infrastructure elements of the described definite TMP infrastructure elements Object Creation object after replacing, and store according to described numbering.
6. the method for claim 1, it is characterized in that, step according to described SQL infrastructure elements object and respective rule generation mapping relations comprises: according to operation rule and the order of operation of SQL in database, generate table mapping relations and field mappings relation respectively.
7. a mapping relations generating apparatus is characterized in that, comprising:
Analysis module is used for the SQL program is carried out grammatical analysis, extracts the SQL infrastructure elements object in the SQL syntax tree;
First processing module, the described SQL infrastructure elements object that is used for extracting is numbered in proper order and stores according to appearance;
Second processing module is used for the non-definition SQL infrastructure elements object of described SQL infrastructure elements object is replaced with definition SQL infrastructure elements object, and stores according to described numbering;
Matching module is used for generating mapping relations according to numbering and the respective rule of described SQL infrastructure elements object.
8. device as claimed in claim 7 is characterized in that, described SQL infrastructure elements object comprises sub-SQL, table, field, the scalar among the SQL at least and asserts.
9. device as claimed in claim 7 is characterized in that, described analysis module specifically is used for reconstruct SQL syntax tree, obtains described SQL infrastructure elements object behind the implantation JAVA code in described SQL.
10. device as claimed in claim 7, it is characterized in that, after the described SQL infrastructure elements object that described first processing module specifically is used for extracting is numbered in proper order according to appearance, described SQL infrastructure elements object after the numbering is replaced with described TMP element object, and store according to described numbering.
CN201110445062.XA 2011-12-27 2011-12-27 A kind of mapping relations generate method and device Active CN103186541B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201110445062.XA CN103186541B (en) 2011-12-27 2011-12-27 A kind of mapping relations generate method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201110445062.XA CN103186541B (en) 2011-12-27 2011-12-27 A kind of mapping relations generate method and device

Publications (2)

Publication Number Publication Date
CN103186541A true CN103186541A (en) 2013-07-03
CN103186541B CN103186541B (en) 2016-08-24

Family

ID=48677710

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201110445062.XA Active CN103186541B (en) 2011-12-27 2011-12-27 A kind of mapping relations generate method and device

Country Status (1)

Country Link
CN (1) CN103186541B (en)

Cited By (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103902653A (en) * 2014-02-28 2014-07-02 珠海多玩信息技术有限公司 Method and device for creating data warehouse table blood relationship graph
CN104252511A (en) * 2013-11-05 2014-12-31 深圳市华傲数据技术有限公司 SQL (Structural Query Language) command compiling method and SQL command compiling device
CN104951286A (en) * 2014-03-25 2015-09-30 阿里巴巴集团控股有限公司 Method and device for converting MapReduce into SQL
CN106484699A (en) * 2015-08-25 2017-03-08 北京国双科技有限公司 The generation method of data base querying field and device
CN106557470A (en) * 2015-09-24 2017-04-05 腾讯科技(北京)有限公司 data extraction method and device
CN106776639A (en) * 2015-11-24 2017-05-31 腾讯科技(深圳)有限公司 Data processing method and data processing equipment based on SQL
CN107169023A (en) * 2017-04-07 2017-09-15 广东精点数据科技股份有限公司 Data lineage analysis system and method based on sql semantic automatic analysis
CN107644073A (en) * 2017-09-18 2018-01-30 广东中标数据科技股份有限公司 A kind of field consanguinity analysis method, system and device based on depth-first traversal
WO2019019702A1 (en) * 2017-07-27 2019-01-31 平安科技(深圳)有限公司 Algorithm generation method and device, terminal device and storage medium
CN109344173A (en) * 2018-09-10 2019-02-15 阿里巴巴集团控股有限公司 Data managing method and device, data structure
CN109582691A (en) * 2018-11-15 2019-04-05 百度在线网络技术(北京)有限公司 Method and apparatus for controlling data query
CN109710703A (en) * 2019-01-03 2019-05-03 北京顺丰同城科技有限公司 A kind of generation method and device of genetic connection network
CN110096513A (en) * 2019-04-10 2019-08-06 阿里巴巴集团控股有限公司 A kind of data query, fund checking method and device
CN110147396A (en) * 2017-11-08 2019-08-20 中移(苏州)软件技术有限公司 A kind of mapping relations generation method and device
CN110362579A (en) * 2019-07-19 2019-10-22 联想(北京)有限公司 A kind of information processing method and electronic equipment
CN111798311A (en) * 2020-07-22 2020-10-20 睿智合创(北京)科技有限公司 Bank risk analysis library platform based on big data, building method and readable medium
WO2021179722A1 (en) * 2020-10-21 2021-09-16 平安科技(深圳)有限公司 Sql statement parsing method and system, and computer device and storage medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101021877A (en) * 2007-03-16 2007-08-22 华为技术有限公司 Method and apparatus for updating object local attribute to related data bank
CN101021874A (en) * 2007-03-21 2007-08-22 金蝶软件(中国)有限公司 Method and apparatus for optimizing request to poll SQL
US20080065592A1 (en) * 2006-09-08 2008-03-13 Blade Makai Doyle Method, system and computer-readable media for software object relationship traversal for object-relational query binding
CN101859303A (en) * 2009-04-07 2010-10-13 中国移动通信集团湖北有限公司 Metadata management method and management system
CN102156740A (en) * 2011-04-15 2011-08-17 国都兴业信息审计系统技术(北京)有限公司 SQL (structured query language) statement processing method and system

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080065592A1 (en) * 2006-09-08 2008-03-13 Blade Makai Doyle Method, system and computer-readable media for software object relationship traversal for object-relational query binding
CN101021877A (en) * 2007-03-16 2007-08-22 华为技术有限公司 Method and apparatus for updating object local attribute to related data bank
CN101021874A (en) * 2007-03-21 2007-08-22 金蝶软件(中国)有限公司 Method and apparatus for optimizing request to poll SQL
CN101859303A (en) * 2009-04-07 2010-10-13 中国移动通信集团湖北有限公司 Metadata management method and management system
CN102156740A (en) * 2011-04-15 2011-08-17 国都兴业信息审计系统技术(北京)有限公司 SQL (structured query language) statement processing method and system

Cited By (23)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104252511A (en) * 2013-11-05 2014-12-31 深圳市华傲数据技术有限公司 SQL (Structural Query Language) command compiling method and SQL command compiling device
CN103902653B (en) * 2014-02-28 2017-08-01 珠海多玩信息技术有限公司 A kind of method and apparatus for building data warehouse table genetic connection figure
CN103902653A (en) * 2014-02-28 2014-07-02 珠海多玩信息技术有限公司 Method and device for creating data warehouse table blood relationship graph
CN104951286A (en) * 2014-03-25 2015-09-30 阿里巴巴集团控股有限公司 Method and device for converting MapReduce into SQL
CN104951286B (en) * 2014-03-25 2018-07-06 阿里巴巴集团控股有限公司 A kind of method and apparatus that MapReduce is converted to SQL
CN106484699A (en) * 2015-08-25 2017-03-08 北京国双科技有限公司 The generation method of data base querying field and device
CN106484699B (en) * 2015-08-25 2020-04-17 北京国双科技有限公司 Method and device for generating database query field
CN106557470A (en) * 2015-09-24 2017-04-05 腾讯科技(北京)有限公司 data extraction method and device
CN106776639B (en) * 2015-11-24 2020-04-10 腾讯科技(深圳)有限公司 Data processing method and data processing device based on structured query language
CN106776639A (en) * 2015-11-24 2017-05-31 腾讯科技(深圳)有限公司 Data processing method and data processing equipment based on SQL
CN107169023A (en) * 2017-04-07 2017-09-15 广东精点数据科技股份有限公司 Data lineage analysis system and method based on sql semantic automatic analysis
WO2019019702A1 (en) * 2017-07-27 2019-01-31 平安科技(深圳)有限公司 Algorithm generation method and device, terminal device and storage medium
CN107644073A (en) * 2017-09-18 2018-01-30 广东中标数据科技股份有限公司 A kind of field consanguinity analysis method, system and device based on depth-first traversal
CN110147396A (en) * 2017-11-08 2019-08-20 中移(苏州)软件技术有限公司 A kind of mapping relations generation method and device
CN110147396B (en) * 2017-11-08 2021-08-31 中移(苏州)软件技术有限公司 Mapping relation generation method and device
CN109344173A (en) * 2018-09-10 2019-02-15 阿里巴巴集团控股有限公司 Data managing method and device, data structure
CN109344173B (en) * 2018-09-10 2022-03-15 创新先进技术有限公司 Data management method and device and data structure
CN109582691A (en) * 2018-11-15 2019-04-05 百度在线网络技术(北京)有限公司 Method and apparatus for controlling data query
CN109710703A (en) * 2019-01-03 2019-05-03 北京顺丰同城科技有限公司 A kind of generation method and device of genetic connection network
CN110096513A (en) * 2019-04-10 2019-08-06 阿里巴巴集团控股有限公司 A kind of data query, fund checking method and device
CN110362579A (en) * 2019-07-19 2019-10-22 联想(北京)有限公司 A kind of information processing method and electronic equipment
CN111798311A (en) * 2020-07-22 2020-10-20 睿智合创(北京)科技有限公司 Bank risk analysis library platform based on big data, building method and readable medium
WO2021179722A1 (en) * 2020-10-21 2021-09-16 平安科技(深圳)有限公司 Sql statement parsing method and system, and computer device and storage medium

Also Published As

Publication number Publication date
CN103186541B (en) 2016-08-24

Similar Documents

Publication Publication Date Title
CN103186541A (en) Generation method and device for mapping relationship
CN109947791B (en) Database statement optimization method, device, equipment and storage medium
CN104899295B (en) A kind of heterogeneous data source data relation analysis method
EP2608074A2 (en) Systems and methods for merging source records in accordance with survivorship rules
CN103430144A (en) Data source analytics
CN102033748A (en) Method for generating data processing flow codes
CN106202207A (en) A kind of index based on HBase ORM and searching system
CN105320680A (en) Data synchronization method and device
CN101859303A (en) Metadata management method and management system
US20110238711A1 (en) Method and module for creating a relational database schema from an ontology
WO2011090519A1 (en) Accessing large collection object tables in a database
Burgueño et al. On the concurrent execution of model transformations with linda
EP3979091A1 (en) Metadata automated system
CN101894317A (en) System and method for driving business logic through data changes
CN101908174A (en) Method, device and EAP (Enterprise Application Platform) system for processing part object information in drawing file
AL-Msie'deen et al. Detecting commonality and variability in use-case diagram variants
CN112269779A (en) Big data analysis system and method for defects of power equipment
CN116303336A (en) Data management method based on data braiding architecture
CN103809915B (en) The reading/writing method of a kind of disk file and device
CN103488693A (en) Data processing device and data processing method
Marotta et al. Managing source schema evolution in web warehouses
Dospinescu et al. Physical integration of heterogeneous web based data
CN110647518A (en) Data source fusion calculation method, component and device
CN110704421A (en) Data processing method, device, equipment and computer readable storage medium
Li et al. Commoncube-based conceptual modeling of ETL processes

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
REG Reference to a national code

Ref country code: HK

Ref legal event code: DE

Ref document number: 1182796

Country of ref document: HK

C14 Grant of patent or utility model
GR01 Patent grant
REG Reference to a national code

Ref country code: HK

Ref legal event code: GR

Ref document number: 1182796

Country of ref document: HK

TR01 Transfer of patent right
TR01 Transfer of patent right

Effective date of registration: 20191209

Address after: P.O. Box 31119, grand exhibition hall, hibiscus street, 802 West Bay Road, Grand Cayman, Cayman Islands

Patentee after: Innovative advanced technology Co., Ltd

Address before: Cayman Islands Grand Cayman capital building, a four storey No. 847 mailbox

Patentee before: Alibaba Group Holding Co., Ltd.