CN106709024A - Data table source-tracing method and device based on consanguinity analysis - Google Patents
Data table source-tracing method and device based on consanguinity analysis Download PDFInfo
- Publication number
- CN106709024A CN106709024A CN201611234097.8A CN201611234097A CN106709024A CN 106709024 A CN106709024 A CN 106709024A CN 201611234097 A CN201611234097 A CN 201611234097A CN 106709024 A CN106709024 A CN 106709024A
- Authority
- CN
- China
- Prior art keywords
- source
- data
- tables
- data table
- traced
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/21—Design, administration or maintenance of databases
- G06F16/215—Improving data quality; Data cleansing, e.g. de-duplication, removing invalid entries or correcting typographical errors
Landscapes
- Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Quality & Reliability (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Investigating Or Analysing Biological Materials (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention relates to a data table source-tracing method and device based on consanguinity analysis. The method includes the steps of S1, configuring the mapping relation conversion mode of a data table which needs source tracing; S2, making conversion rules according to the mapping relation conversion mode configured in S1; S3, building a mapping relation table according to the mapping relation conversion mode configure in S1 and the conversion rules made in S2; S4, tracing the source of the target data table according to the mapping relation table. The device comprises a mode configuring module, a rule making module, a mapping relation table building module and a source tracing module. The data table source-tracing method and device based on the consanguinity analysis has the advantages that the method can effectively trace the sources of data tables which belong to various different types of data sources, visually position the attribution of the data tables and fine data quality problems through the positioning; the method and device can efficiently and fast position data problems.
Description
Technical field
The present invention relates to field of computer technology, more particularly to method and the dress that tables of data is traced to the source are carried out based on consanguinity analysis
Put.
Background technology
Big data is after cloud computing, Internet of Things, the subversiveness technological change again of IT industry to be had become, to state
Family's administration way, decision-making, tissue and operation flow, the mode for providing public service etc. will all produce tremendous influence.And it is adjoint
Smart city and build requirement to information technologies such as internet, cloud computing, Internet of Things, the collection of mass data, storage, divide
Analysis, treatment and its application become more to facilitate, and the decision behavior of government or the public will be gradually based on data and analysis and make.Number
It is the description information of origin to data and data generating procedure according to tracing to the source, these information play important at many aspects
Effect.At present, in big data system development, without the tables of data source tracing method for various different data sources.
The content of the invention
For the defect of prior art, the present invention is intended to provide a kind of carry out the method that tables of data is traced to the source based on consanguinity analysis
And device, the tables of data for being under the jurisdiction of various different types of data sources can effectively be traced to the source, intuitively positioning is under the jurisdiction of not
With the ownership of the tables of data of data source, the quality problems that data occur can be found quickly through its is positioned.
In a first aspect, carry out the method that tables of data is traced to the source based on consanguinity analysis the invention provides a kind of, specifically include with
Lower step：
Step S1：Configuration need trace to the source operation tables of data mapping relations translative mode；
Step S2：Transformation rule is formulated according to the mapping relations translative mode that step S1 configurations are completed；
Step S3：The transformation rule that the mapping relations translative mode and step S2 configured according to step S1 are formulated is set up and is reflected
Penetrate relation table；
Step S4：Tracing to the source for target matrix is carried out according to the mapping table.
Further, judgement need to be carried out tracing to the source the tables of data of operation before step S1 carries out the configuration of mapping relations translative mode
The data source types being subordinate to.
Further, what the mapping relations translative mode and step S2 for being configured according to step S1 in the step S3 were formulated
The concrete operation step that transformation rule sets up mapping table is：
Step S301：It is that the mapping relations translative mode and transformation rule set up respective field, and is fixed in
In the field of mapping table；
Step S302：It is each field distribution field length fixed and field type and be every of the mapping table
The field addition remark information of individual fixation；
Further, the concrete operations traced to the source of target matrix are carried out in the step S4 according to the mapping table
Step is：
Step S401：With the tables of data to be traced to the source as target matrix, carry out retrieving the target matrix
Source data table；
Step S402：Judge whether source data table still suffers from source data table；
Step S403：It is to repeat the judgement operation of step S402 if being if judged result in step S402, until most
Enter step S404 after can not find source data table eventually；
Step S404：The source data table that record is retrieved, and be arranged in order and exported by the time order and function order for retrieving.
Further, judge that the determination methods whether source data table still suffers from source data table are in the step S402：Will
The source data table carries out the search operaqtion of step S401 as target matrix；Its retrieval result is sentenced after search complete
It is disconnected.
As shown from the above technical solution, what the present invention was provided carry out method that tables of data traces to the source based on consanguinity analysis can be right
The tables of data for being under the jurisdiction of various different types of data sources is effectively traced to the source, and intuitively positioning is under the jurisdiction of the data of different data sources
The ownership of table, can find the quality problems that data occur quickly through its is positioned.
Once there are quality problems in the metadata occurred in arbitrary data table, you can by of the invention based on consanguinity analysis
Carrying out the tables of data of method that tables of data traces to the source to going wrong carries out retrieval of tracing to the source, and by retrieving its source data table, positioning should
Where the root of problem.This method directly can objectively determine the problem place of the quality of data, orientation problem efficiency high, speed
Hurry up.User is set quickly to position the key point of the data for going wrong, so as to improve decision-making capability.Quick identification uses it
The factor of the influence decision-making that its analysis mode cannot find.
Second aspect, the device that tables of data is traced to the source is carried out the invention provides based on consanguinity analysis, including
Pattern configurations module：Mapping relations translative mode for configuring the tables of data of the operation that needs trace to the source；
Rulemaking module：For formulating transformation rule according to mapping relations translative mode；
Mapping table sets up module：For setting up mapping relations according to mapping relations translative mode and transformation rule
Table；
Trace to the source module：For carrying out tracing to the source for target matrix according to the mapping table.
Further, it is described the device that tables of data traces to the source is carried out based on consanguinity analysis also to include：
Judge module：For the data source types that the tables of data of operation that judges need to carry out tracing to the source is subordinate to.
Further, the mapping table is set up module and is included：
Field sets up unit：It is that the mapping relations translative mode and transformation rule set up respective field, and is consolidated
It is scheduled in the field of mapping table；
Field configuring unit：For the mapping table each fix field distribution field length and field type simultaneously
For each field fixed adds remark information.
Further, the module of tracing to the source includes：
Retrieval unit：, as target matrix, carry out retrieving the target data for the tables of data to be traced to the source
The source data table of table；
Judging unit：For judging whether source data table still suffers from source data table；
Recursive calculation unit：For judging whether source data table still suffers from source data table；It is to still provide for sentencing if being if result
Disconnected operation, enters recording unit when finally can not retrieve source number tables of data；
Record output unit：For recording the source data table that retrieves, and by the time order and function order for retrieving successively to
Preceding arrangement is simultaneously exported.
Further, the judging unit carries out judging that the method whether source data table still suffers from source data table is by the source
Tables of data carries out search operaqtion as target matrix in retrieval unit, if source data table is still retrieved result of determination be it is yes,
Result of determination is no if it can not retrieve source data table.
As shown from the above technical solution, what the present invention was provided carries out the device that tables of data is traced to the source based on consanguinity analysis, can be with
Tables of data to being under the jurisdiction of various different types of data sources is effectively traced to the source, and intuitively positioning is under the jurisdiction of the number of different data sources
According to the ownership of table, the quality problems that data occur can be found quickly through its is positioned.
Once there are quality problems in the metadata occurred in arbitrary data table, you can by of the invention based on consanguinity analysis
Carrying out the tables of data of device that tables of data traces to the source to going wrong carries out retrieval of tracing to the source, and by retrieving its source data table, positioning should
Where the root of problem.The present apparatus directly can objectively determine the problem place of the quality of data, orientation problem efficiency high, speed
Hurry up.User is set quickly to position the key point of the data for going wrong, so as to improve decision-making capability.Quick identification uses it
The factor of the influence decision-making that its analysis mode cannot find.
Brief description of the drawings
In order to illustrate more clearly of the specific embodiment of the invention or technical scheme of the prior art, below will be to specific
The accompanying drawing to be used needed for implementation method or description of the prior art is briefly described.In all of the figs, similar element
Or the general reference by being similar in part is identified.In accompanying drawing, each element or part might not draw according to actual ratio.
Fig. 1 shows the flow that the method that tables of data is traced to the source is carried out based on consanguinity analysis that the embodiment of the present invention is provided
Figure；
Fig. 2 shows the behaviour that traces to the source that the method that tables of data is traced to the source is carried out based on consanguinity analysis that the embodiment of the present invention is provided
Make the flow chart of specific steps；
Fig. 3 has gone out the module map that the device that tables of data is traced to the source is carried out based on consanguinity analysis that the embodiment of the present invention is provided；
Fig. 4 has gone out the mapping relations that the device that tables of data is traced to the source is carried out based on consanguinity analysis that the embodiment of the present invention is provided
Table sets up the cellular construction figure of module；
Fig. 5 has gone out the module of tracing to the source that the device that tables of data is traced to the source is carried out based on consanguinity analysis that the embodiment of the present invention is provided
Cellular construction figure.
Specific embodiment
The embodiment of technical solution of the present invention is described in detail below in conjunction with accompanying drawing.Following examples are only used for
Technical scheme is clearly illustrated, therefore is intended only as example, and protection of the invention can not be limited with this
Scope.It should be noted that unless otherwise indicated, technical term used in this application or scientific terminology should be institute of the present invention
The ordinary meaning that category art personnel are understood.
Data lineage (Lineage, Provenance, Pedigree) can also be translated and done (blood relationship, origin, pedigree, pedigree), right
In Database Systems, it is sometimes desirable to by the tracking of data lineage, data evolutionary process in a stream can be obtained.This
Evolutionary process is the consanguinity analysis of data.
The embodiment of the present invention one is provided and carries out the method that tables of data is traced to the source based on consanguinity analysis, as shown in figure 1, embodiment
Comprise the following steps：
Step S1：Configuration need trace to the source operation tables of data mapping relations translative mode；
Step S2：Transformation rule is formulated according to the mapping relations translative mode that step S1 configurations are completed；
Step S3：The transformation rule that the mapping relations translative mode and step S2 configured according to step S1 are formulated is set up and is reflected
Penetrate relation table；
Step S4：Tracing to the source for target matrix is carried out according to the mapping table.In step S1 described in the present embodiment
Operation of tracing to the source be the method traced to the source the source data table of tables of data in database based on data consanguinity analysis.
In the present embodiment, the form that mapping table is fixed is as shown in table 1：
Table 1
In the present embodiment, judgement need to be carried out tracing to the source the data of operation before step S1 carries out the configuration of mapping relations translative mode
The data source types that table is subordinate to.
In the present embodiment, the mapping relations translative mode and step S2 configured according to step S1 in the step S3 are formulated
Transformation rule set up the concrete operation step of mapping table and be：
Step S301：It is that the mapping relations translative mode and transformation rule set up respective field, and is fixed in
In the field of mapping table.
Step S302：It is each field distribution field length fixed and field type and be every of the mapping table
The field addition remark information of individual fixation.
In the present embodiment, the specific behaviour for tracing to the source of target matrix is carried out in the step S4 according to the mapping table
It is as step：
Step S401：With the tables of data to be traced to the source as target matrix, carry out retrieving the target matrix
Source data table.
Step S402：Judge whether source data table still suffers from source data table.
Step S403：It is to repeat the judgement operation of step S402 if being if judged result in step S402, until most
Enter step S404 after can not find source data table eventually.
Step S404：The source data table that record is retrieved, and by the time order and function order for retrieving successively forward permutations simultaneously
Output.
For example, existing PEOPLE, TEST, TEST1 are under the jurisdiction of three kinds of tables of data in different types of data source, if it is desired to finding out
The blood relationship of PEOPLE tables of data is then：
Using PEOPLE tables of data as target matrix first in step S401, retrieve the source of PEOPLE tables of data
Tables of data.
The source of the PEOPLE tables of data is retrieved according to source module, target pattern and transformation rule (as shown in table 2)
Tables of data is TEST tables of data.
Table 2
Judge whether TEST tables of data still suffers from source data table in step S402.Deterministic process need to be according to source module, mesh
Mark pattern and transformation rule (as shown in table 2) carry out TEST tables of data as target matrix to retrieve its source data table.This
The result for locating retrieval is the source data table TEST1 for retrieving TEST tables of data.
Repeat the judgement step of step S402 in step S403, judge whether tables of data TEST1 still suffers from source number
According to table.Deterministic process need to according to deterministic process need to according to source module, target pattern and transformation rule it is (as shown in table 2) will
TEST1 tables of data carries out retrieving its source data table as target matrix.Retrieval result herein does not exist for TEST1 tables of data
Source data table.
Record source data table TEST, the TEST1 for retrieving in step s 404, and by the time order and function order for retrieving according to
Secondary arrangement is simultaneously exported.The output result for drawing herein is TEST1 (3)-＞ TEST (2)-＞ PEOPLE (1).
What the embodiment of the present invention one was provided carry out method that tables of data traces to the source based on consanguinity analysis can be various to being under the jurisdiction of
The tables of data in different types of data source is effectively traced to the source, and intuitively positioning is under the jurisdiction of the ownership of the tables of data of different data sources,
The quality problems that data occur can be found quickly through its is positioned.
Once there are quality problems in the metadata occurred in arbitrary data table, you can by of the invention based on consanguinity analysis
Carrying out the tables of data of method that tables of data traces to the source to going wrong carries out retrieval of tracing to the source, and by retrieving its source data table, positioning should
Where the root of problem.This method directly can objectively determine the problem place of the quality of data, orientation problem efficiency high, speed
Hurry up.User is set quickly to position the key point of the data for going wrong, so as to improve decision-making capability.Quick identification uses it
The factor of the influence decision-making that its analysis mode cannot find.
The embodiment of the present invention two is provided and carries out the device that tables of data is traced to the source based on consanguinity analysis, including
Pattern configurations module：Mapping relations translative mode for configuring the tables of data of the operation that needs trace to the source.
Rulemaking module：For formulating transformation rule according to mapping relations translative mode.
Mapping table sets up module：For setting up mapping relations according to mapping relations translative mode and transformation rule
Table；
Trace to the source module：For carrying out tracing to the source for target matrix according to the mapping table.
It is described the device that tables of data traces to the source is carried out based on consanguinity analysis also to include in the present embodiment：
Judge module：For the data source types that the tables of data of operation that judges need to carry out tracing to the source is subordinate to.
In the present embodiment, the mapping table sets up module to be included：
Field sets up unit：It is that the mapping relations translative mode and transformation rule set up respective field, and is consolidated
It is scheduled in the field of mapping table.
Field configuring unit：For the mapping table each fix field distribution field length and field type simultaneously
For each field fixed adds remark information.
In the present embodiment, the module of tracing to the source includes：
Retrieval unit：, as target matrix, carry out retrieving the target data for the tables of data to be traced to the source
The source data table of table.
Judging unit：For judging whether source data table still suffers from source data table.
Recursive calculation unit：For judging whether source data table still suffers from source data table；It is to still provide for sentencing if being if result
Disconnected operation, enters recording unit when finally can not find source number tables of data.
Record output unit：For recording the source data table that retrieves, and by the time order and function order for retrieving successively to
Preceding arrangement is simultaneously exported.
In the present embodiment, the judging unit carries out judging that the method whether source data table still suffers from source data table is by this
Source data table carries out search operaqtion as target matrix in retrieval unit, and result of determination is if source data table is still retrieved
It is that result of determination is no if it can not retrieve source data table.
What the embodiment of the present invention two was provided carries out the device that tables of data is traced to the source based on consanguinity analysis, can be various to being under the jurisdiction of
The tables of data in different types of data source is effectively traced to the source, and intuitively positioning is under the jurisdiction of the ownership of the tables of data of different data sources,
The quality problems that data occur can be found quickly through its is positioned.
Once there are quality problems in the metadata occurred in arbitrary data table, you can by of the invention based on consanguinity analysis
Carrying out the tables of data of device that tables of data traces to the source to going wrong carries out retrieval of tracing to the source, and by retrieving its source data table, positioning should
Where the root of problem.The present apparatus directly can objectively determine the problem place of the quality of data, orientation problem efficiency high, speed
Hurry up.User is set quickly to position the key point of the data for going wrong, so as to improve decision-making capability.Quick identification uses it
The factor of the influence decision-making that its analysis mode cannot find.
Finally it should be noted that：Various embodiments above is merely illustrative of the technical solution of the present invention, rather than its limitations；To the greatest extent
Pipe has been described in detail with reference to foregoing embodiments to the present invention, it will be understood by those within the art that：Its according to
The technical scheme described in foregoing embodiments can so be modified, or which part or all technical characteristic are entered
Row equivalent；And these modifications or replacement, the essence of appropriate technical solution is departed from various embodiments of the present invention technology
The scope of scheme, it all should cover in the middle of the scope of claim of the invention and specification.
Claims (10)
1. the method that tables of data is traced to the source is carried out based on consanguinity analysis, it is characterised in that comprise the following steps：
Step S1：Configuration need trace to the source operation tables of data mapping relations translative mode；
Step S2：Transformation rule is formulated according to the mapping relations translative mode that step S1 configurations are completed；
Step S3：The transformation rule that the mapping relations translative mode and step S2 configured according to step S1 are formulated is set up mapping and is closed
It is table；
Step S4：Tracing to the source for target matrix is carried out according to the mapping table.
2. it is according to claim 1 that the method that tables of data is traced to the source is carried out based on consanguinity analysis, it is characterised in that in step S1
The data source types that the tables of data of operation that judge before the configuration of mapping relations translative mode need to carrying out tracing to the source is subordinate to.
3. it is according to claim 1 that the method that tables of data is traced to the source is carried out based on consanguinity analysis, it is characterised in that the step
The transformation rule that the mapping relations translative mode and step S2 configured according to step S1 in S3 are formulated sets up mapping table
Concrete operation step is：
Step S301：For the mapping relations translative mode and transformation rule set up respective field, and it is fixed in mapping
In the field of relation table；
Step S302：For the mapping table each field distribution field length fixed and field type and for each is solid
Fixed field addition remark information.
4. it is according to claim 1 that the method that tables of data is traced to the source is carried out based on consanguinity analysis, it is characterised in that the step
The concrete operation step traced to the source for carrying out target matrix according to the mapping table in S4 is：
Step S401：With the tables of data to be traced to the source as target matrix, retrieve the source number of the target matrix
According to table；
Step S402：Judge whether source data table still suffers from source data table；
Step S403：It is to repeat the judgement operation of step S402 if being if judged result in step S402, until final inspection
Rope enters step S404 after not going out source data table；
Step S404：The source data table that record is retrieved, and be arranged in order and exported by the time order and function order for retrieving.
5. it is according to claim 4 that the method that tables of data is traced to the source is carried out based on consanguinity analysis, it is characterised in that the step
Judge that the determination methods whether source data table still suffers from source data table are in S402：The source data table is entered as target matrix
The search operaqtion of row step S401, judges its retrieval result after search complete.
6. the device that tables of data is traced to the source is carried out based on consanguinity analysis, it is characterised in that including：
Pattern configurations module：Mapping relations translative mode for configuring the tables of data of the operation that needs trace to the source；
Rulemaking module：For formulating transformation rule according to mapping relations translative mode；
Mapping table sets up module：For setting up mapping table according to mapping relations translative mode and transformation rule；
Trace to the source module：For carrying out tracing to the source for target matrix according to the mapping table.
It is 7. according to claim 6 that the device that tables of data is traced to the source is carried out based on consanguinity analysis, it is characterised in that：It is described to be based on
Consanguinity analysis carries out the device that tables of data traces to the source also to be included：
Judge module：For the data source types that the tables of data of operation that judges need to carry out tracing to the source is subordinate to.
It is 8. according to claim 6 that the device that tables of data is traced to the source is carried out based on consanguinity analysis, it is characterised in that：The mapping
Relation table sets up module to be included：
Field sets up unit：It is that the mapping relations translative mode and transformation rule set up respective field, and is fixed in
In the field of mapping table；
Field configuring unit：It is each field distribution field length fixed and field type and be every of the mapping table
The field addition remark information of individual fixation.
It is 9. according to claim 6 that the device that tables of data is traced to the source is carried out based on consanguinity analysis, it is characterised in that：It is described to trace to the source
Module includes：
Retrieval unit：, as target matrix, carry out retrieving the target matrix for the tables of data to be traced to the source
Source data table；
Judging unit：For judging whether source data table still suffers from source data table；
Recursive calculation unit：For judging whether source data table still suffers from source data table；Grasped to still provide for judgement if being if result
Make, recording unit is entered when finally can not find source number tables of data；
Record output unit：For recording the source data table for retrieving, and it is arranged in order simultaneously by the time order and function order for retrieving
Output.
It is 10. according to claim 6 that the device that tables of data is traced to the source is carried out based on consanguinity analysis, it is characterised in that：It is described to sentence
Disconnected unit carries out judging that the method whether source data table still suffers from source data table is that the source data table exists as target matrix
Retrieval unit carries out search operaqtion, and result of determination is yes if source data table is still retrieved, and is sentenced if it can not retrieve source data table
It is no to determine result.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611234097.8A CN106709024B (en) | 2016-12-28 | 2016-12-28 | Method and device for tracing data table based on blood margin analysis |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611234097.8A CN106709024B (en) | 2016-12-28 | 2016-12-28 | Method and device for tracing data table based on blood margin analysis |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106709024A true CN106709024A (en) | 2017-05-24 |
| CN106709024B CN106709024B (en) | 2020-07-17 |
Family
ID=58902800
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201611234097.8A Active CN106709024B (en) | 2016-12-28 | 2016-12-28 | Method and device for tracing data table based on blood margin analysis |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106709024B (en) |
Cited By (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107545030A (en) * | 2017-07-17 | 2018-01-05 | 阿里巴巴集团控股有限公司 | Processing method, device and the equipment of data genetic connection |
| CN107643956A (en) * | 2017-08-22 | 2018-01-30 | 北京京东尚科信息技术有限公司 | The method and apparatus for positioning the abnormal origin of abnormal data |
| CN109241142A (en) * | 2018-09-07 | 2019-01-18 | 南京中新赛克科技有限责任公司 | Data genetic connection calculation method based on flow engine |
| CN109299073A (en) * | 2018-10-19 | 2019-02-01 | 杭州数梦工场科技有限公司 | A kind of generation method, system, electronic equipment and the storage medium of data blood relationship |
| CN109325078A (en) * | 2018-09-18 | 2019-02-12 | 拉扎斯网络科技（上海）有限公司 | Data blood margin determination method and device based on structural data |
| CN109739894A (en) * | 2019-01-04 | 2019-05-10 | 深圳前海微众银行股份有限公司 | Supplement method, apparatus, equipment and the storage medium of metadata description |
| CN109815378A (en) * | 2019-01-31 | 2019-05-28 | 三盟科技股份有限公司 | A kind of data tracing method and system based on metadata link |
| CN110019384A (en) * | 2017-08-15 | 2019-07-16 | 阿里巴巴集团控股有限公司 | A kind of acquisition methods of blood relationship data provide the method and device of blood relationship data |
| CN111008192A (en) * | 2019-11-14 | 2020-04-14 | 泰康保险集团股份有限公司 | Data management method, device, equipment and medium |
| CN111026568A (en) * | 2019-12-04 | 2020-04-17 | 深圳前海环融联易信息科技服务有限公司 | Data and task relation construction method and device, computer equipment and storage medium |
| CN111723087A (en) * | 2019-03-19 | 2020-09-29 | 北京沃东天骏信息技术有限公司 | Mining method and device of data blood relationship, storage medium and electronic equipment |
| CN112527796A (en) * | 2020-12-10 | 2021-03-19 | 中移（杭州）信息技术有限公司 | Data table processing method and device and computer readable storage medium |
| CN113220945A (en) * | 2021-04-28 | 2021-08-06 | 广州宸祺出行科技有限公司 | Method and system for field retrieval and path display of data blood margin |
| CN113535722A (en) * | 2021-07-12 | 2021-10-22 | 北京明略昭辉科技有限公司 | DAG (demand directed Access control) source tracing sampling method, system, equipment and storage medium based on mapping |
| CN115203277A (en) * | 2022-09-19 | 2022-10-18 | 北京必盈特信息技术有限公司 | Data decision method and device |
| CN116450710A (en) * | 2023-06-15 | 2023-07-18 | 南京哈卢信息科技有限公司 | Data analysis tracing method and system based on big data |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2006197252A (en) * | 2005-01-13 | 2006-07-27 | Meisei Chishiki Kagi Kofun Yugenkoshi | Electronic mail trace system |
| CN101916252A (en) * | 2002-12-10 | 2010-12-15 | 卡林戈公司 | The navigation of document sets content space |
| US20140280218A1 (en) * | 2013-03-15 | 2014-09-18 | Teradata Us, Inc. | Techniques for data integration |
| CN105893542A (en) * | 2016-03-31 | 2016-08-24 | 华中科技大学 | Method and system for redistributing cold data files in cloud storage system |
-
2016
- 2016-12-28 CN CN201611234097.8A patent/CN106709024B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101916252A (en) * | 2002-12-10 | 2010-12-15 | 卡林戈公司 | The navigation of document sets content space |
| JP2006197252A (en) * | 2005-01-13 | 2006-07-27 | Meisei Chishiki Kagi Kofun Yugenkoshi | Electronic mail trace system |
| US20140280218A1 (en) * | 2013-03-15 | 2014-09-18 | Teradata Us, Inc. | Techniques for data integration |
| CN105893542A (en) * | 2016-03-31 | 2016-08-24 | 华中科技大学 | Method and system for redistributing cold data files in cloud storage system |
Non-Patent Citations (2)
| Title |
|---|
| 戴超凡: "数据仓库中数据志跟踪的理论与方法研究", 《中国优秀博硕士学位论文全文数据库（博士）信息科技辑》 * |
| 毛瑞雪: "基于数据血缘的审计证据追踪技术研究及应用", 《中国优秀硕士学位论文全文数据库信息科技辑》 * |
Cited By (28)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107545030B (en) * | 2017-07-17 | 2020-08-21 | 阿里巴巴集团控股有限公司 | Method, device and equipment for processing data blood relationship |
| CN107545030A (en) * | 2017-07-17 | 2018-01-05 | 阿里巴巴集团控股有限公司 | Processing method, device and the equipment of data genetic connection |
| CN110019384B (en) * | 2017-08-15 | 2023-06-27 | 阿里巴巴集团控股有限公司 | Method for acquiring blood edge data, method and device for providing blood edge data |
| CN110019384A (en) * | 2017-08-15 | 2019-07-16 | 阿里巴巴集团控股有限公司 | A kind of acquisition methods of blood relationship data provide the method and device of blood relationship data |
| CN107643956A (en) * | 2017-08-22 | 2018-01-30 | 北京京东尚科信息技术有限公司 | The method and apparatus for positioning the abnormal origin of abnormal data |
| CN107643956B (en) * | 2017-08-22 | 2020-09-01 | 北京京东尚科信息技术有限公司 | Method and apparatus for locating the origin of an anomaly in anomaly data |
| CN109241142A (en) * | 2018-09-07 | 2019-01-18 | 南京中新赛克科技有限责任公司 | Data genetic connection calculation method based on flow engine |
| CN109325078A (en) * | 2018-09-18 | 2019-02-12 | 拉扎斯网络科技（上海）有限公司 | Data blood margin determination method and device based on structural data |
| CN109299073B (en) * | 2018-10-19 | 2019-12-24 | 杭州数梦工场科技有限公司 | Data blood margin generation method and system, electronic equipment and storage medium |
| CN109299073A (en) * | 2018-10-19 | 2019-02-01 | 杭州数梦工场科技有限公司 | A kind of generation method, system, electronic equipment and the storage medium of data blood relationship |
| CN109739894B (en) * | 2019-01-04 | 2022-12-09 | 深圳前海微众银行股份有限公司 | Method, device, equipment and storage medium for supplementing metadata description |
| CN109739894A (en) * | 2019-01-04 | 2019-05-10 | 深圳前海微众银行股份有限公司 | Supplement method, apparatus, equipment and the storage medium of metadata description |
| CN109815378A (en) * | 2019-01-31 | 2019-05-28 | 三盟科技股份有限公司 | A kind of data tracing method and system based on metadata link |
| CN111723087A (en) * | 2019-03-19 | 2020-09-29 | 北京沃东天骏信息技术有限公司 | Mining method and device of data blood relationship, storage medium and electronic equipment |
| CN111723087B (en) * | 2019-03-19 | 2023-11-10 | 北京沃东天骏信息技术有限公司 | Data blood relationship mining method and device, storage medium and electronic equipment |
| CN111008192B (en) * | 2019-11-14 | 2023-06-02 | 泰康保险集团股份有限公司 | Data management method, device, equipment and medium |
| CN111008192A (en) * | 2019-11-14 | 2020-04-14 | 泰康保险集团股份有限公司 | Data management method, device, equipment and medium |
| CN111026568A (en) * | 2019-12-04 | 2020-04-17 | 深圳前海环融联易信息科技服务有限公司 | Data and task relation construction method and device, computer equipment and storage medium |
| CN111026568B (en) * | 2019-12-04 | 2023-09-29 | 深圳前海环融联易信息科技服务有限公司 | Data and task relation construction method and device, computer equipment and storage medium |
| CN112527796B (en) * | 2020-12-10 | 2023-07-21 | 中移（杭州）信息技术有限公司 | Data table processing method and device and computer readable storage medium |
| CN112527796A (en) * | 2020-12-10 | 2021-03-19 | 中移（杭州）信息技术有限公司 | Data table processing method and device and computer readable storage medium |
| CN113220945A (en) * | 2021-04-28 | 2021-08-06 | 广州宸祺出行科技有限公司 | Method and system for field retrieval and path display of data blood margin |
| CN113220945B (en) * | 2021-04-28 | 2024-05-31 | 广州宸祺出行科技有限公司 | Method and system for field retrieval and path display of data blood edges |
| CN113535722A (en) * | 2021-07-12 | 2021-10-22 | 北京明略昭辉科技有限公司 | DAG (demand directed Access control) source tracing sampling method, system, equipment and storage medium based on mapping |
| CN115203277B (en) * | 2022-09-19 | 2023-01-06 | 北京必盈特信息技术有限公司 | Data decision method and device |
| CN115203277A (en) * | 2022-09-19 | 2022-10-18 | 北京必盈特信息技术有限公司 | Data decision method and device |
| CN116450710A (en) * | 2023-06-15 | 2023-07-18 | 南京哈卢信息科技有限公司 | Data analysis tracing method and system based on big data |
| CN116450710B (en) * | 2023-06-15 | 2023-09-26 | 南京哈卢信息科技有限公司 | Data analysis tracing method and system based on big data |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106709024B (en) | 2020-07-17 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106709024A (en) | Data table source-tracing method and device based on consanguinity analysis | |
| CN111611458B (en) | Method for realizing system data architecture carding based on metadata and data analysis technology in big data processing | |
| WO2015176526A1 (en) | Superimposed-relationship-based document identification, association, search, and display system | |
| CN107563153A (en) | A kind of PacBio microarray dataset IT architectures based on Hadoop structures | |
| CN112000773B (en) | Search engine technology-based data association relation mining method and application | |
| CN108984667A (en) | A kind of public sentiment monitoring system | |
| CN105893551A (en) | Method and device for processing data and knowledge graph | |
| CN110109908B (en) | Analysis system and method for mining potential relationship of person based on social basic information | |
| CN106227788A (en) | Database query method based on Lucene | |
| CN106933883B (en) | Method and device for classifying common search terms of interest points based on search logs | |
| JP7103496B2 (en) | Related score calculation system, method and program | |
| CN109033322A (en) | A kind of test method and device of multidimensional data | |
| CN103077255B (en) | Identification method and system for 3D (three-dimensional) model of nuclear power station | |
| CN108279013B (en) | Method and device for checking and correcting incremental data of electronic map and navigation system | |
| US20110289086A1 (en) | System, method and apparatus for data analysis | |
| CN110335641A (en) | Four individual combination Relationship iden- tification method and device of one kind | |
| CN106228453A (en) | A kind of method and apparatus obtaining user's occupational information | |
| CN113742498A (en) | Method for constructing and updating knowledge graph | |
| CN105488062A (en) | Accurate information system data searching method | |
| KR101985961B1 (en) | Similarity Quantification System of National Research and Development Program and Searching Cooperative Program using same | |
| CN109886844A (en) | House registration data association building chart method based on Bayesian network model | |
| CN106802931A (en) | The method and device of data table search is carried out based on impact analysis | |
| CN104239314A (en) | Search word expanding method and system | |
| CN112668836A (en) | Risk graph-oriented associated risk evidence efficient mining and monitoring method and device | |
| CN112380264A (en) | Policy analysis and matching method and device based on personal full life cycle |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CP02 | Change in the address of a patent holder | ||
| CP02 | Change in the address of a patent holder |
Address after: 518000 2203/2204, Building 1, Huide Building, Beizhan Community, Minzhi Street, Longhua District, Shenzhen, Guangdong Patentee after: SHENZHEN AUDAQUE DATA TECHNOLOGY Ltd. Address before: 518000 units J and K, 12 / F, block B, building 7, Baoneng Science Park, Qinghu Industrial Zone, Qingxiang Road, Longhua New District, Shenzhen City, Guangdong Province Patentee before: SHENZHEN AUDAQUE DATA TECHNOLOGY Ltd. |