CN113282678B - Data blood relationship display method and device - Google Patents

Data blood relationship display method and device Download PDF

Info

Publication number
CN113282678B
CN113282678B CN202110343323.0A CN202110343323A CN113282678B CN 113282678 B CN113282678 B CN 113282678B CN 202110343323 A CN202110343323 A CN 202110343323A CN 113282678 B CN113282678 B CN 113282678B
Authority
CN
China
Prior art keywords
information
blood
node
nodes
edge
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202110343323.0A
Other languages
Chinese (zh)
Other versions
CN113282678A (en
Inventor
牟宣理
华盈
闫军
孙旺旺
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hangzhou Dt Dream Technology Co Ltd
Original Assignee
Hangzhou Dt Dream Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hangzhou Dt Dream Technology Co Ltd filed Critical Hangzhou Dt Dream Technology Co Ltd
Priority to CN202110343323.0A priority Critical patent/CN113282678B/en
Publication of CN113282678A publication Critical patent/CN113282678A/en
Application granted granted Critical
Publication of CN113282678B publication Critical patent/CN113282678B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/28Databases characterised by their database models, e.g. relational or object models
    • G06F16/284Relational databases
    • G06F16/288Entity relationship models
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/22Indexing; Data structures therefor; Storage structures
    • G06F16/2282Tablespace storage structures; Management thereof
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/26Visual data mining; Browsing structured data

Abstract

The embodiment of the invention provides a data blood relationship display method and device. According to the embodiment of the invention, the blood-edge relation among the data tables on the processing link is obtained according to the processing information of the data table processing link, each data table in the blood-edge relation is a node, the level information and the attribute information of the nodes are determined according to the metadata information corresponding to each node in the blood-edge relation, the nodes in the blood-edge relation are subjected to aggregation processing according to the level information and the attribute information of the nodes, the aggregated blood-edge information is obtained and comprises the aggregation points and the connection relation between the aggregation points, the nodes aggregated in the aggregation points are identical in level and attribute, the blood-edge relation is displayed based on the level information of the nodes and the aggregated blood-edge information, and the data blood-edge relation can be displayed more clearly and intuitively by carrying out layering and attribute aggregation processing on the blood-edge information, so that convenience is provided for users.

Description

Data blood relationship display method and device
Technical Field
The present invention relates to the field of data processing technologies, and in particular, to a method and an apparatus for displaying a data blood relationship.
Background
In the field of big data, the data are generated, processed, fused, circulated and circulated until the final death, and a relationship is naturally formed between the data. This relationship between data is referred to as a data blood relationship by reference to a similar relationship in human society.
The data blood relationship plays an important role in data tracing, data quality evaluation, data value evaluation and the like. In applications, therefore, it is often desirable to demonstrate data blood-lineage relationships.
Disclosure of Invention
In order to overcome the problems in the related art, the invention provides a data blood-edge relationship display method and device, which can clearly display the hierarchy of each data table in the data blood-edge relationship.
According to a first aspect of an embodiment of the present invention, there is provided a data blood relationship display method, the method including:
acquiring blood edge relations among data tables on a processing link according to processing information of the data table processing link, wherein each data table in the blood edge relations is a node;
determining the level information and attribute information of the nodes according to the metadata information corresponding to each node in the blood relationship; the hierarchy information is used for indicating the hierarchy of the node, and the attribute information is used for indicating the attribute of the node;
according to the level information and attribute information of the nodes, carrying out aggregation treatment on each node in the blood-edge relationship to obtain summarized blood-edge information; the summarized blood edge information comprises a convergence point and a connection relation between the convergence points, wherein all the nodes converged in the convergence points are identical in hierarchy and attribute;
and displaying the blood edge relation based on the hierarchical information of the nodes and the summarized blood edge information.
According to a second aspect of an embodiment of the present invention, there is provided a data blood relationship display apparatus, the apparatus comprising:
the acquisition module is used for acquiring blood margin relations among the data tables on the processing link according to the processing information of the data table processing link, wherein each data table in the blood margin relations is a node;
the determining module is used for determining the level information and the attribute information of the nodes according to the metadata information corresponding to each node in the blood relationship; the hierarchy information is used for indicating the hierarchy of the node, and the attribute information is used for indicating the attribute of the node;
the aggregation module is used for carrying out aggregation processing on each node in the blood-edge relationship according to the level information and the attribute information of the nodes to obtain summarized blood-edge information; the summarized blood edge information comprises a convergence point and a connection relation between the convergence points, wherein all the nodes converged in the convergence points are identical in hierarchy and attribute;
and the display module is used for displaying the blood-edge relationship based on the hierarchical information of the nodes and the summarized blood-edge information.
The technical scheme provided by the embodiment of the invention can have the following beneficial effects:
according to the embodiment of the invention, the blood-edge relation among the data tables on the processing link is obtained according to the processing information of the processing link of the data tables, each data table in the blood-edge relation is a node, the level information and the attribute information of the node are determined according to the metadata information corresponding to each node in the blood-edge relation, the level information is used for indicating the level of the node, the attribute information is used for indicating the attribute of the node, the nodes in the blood-edge relation are subjected to gathering processing according to the level information and the attribute information of the node, the gathered blood-edge information comprises a gathering point and a connecting relation between the gathering point, the gathered nodes in the gathering point have the same level and the same attribute, the blood-edge relation is displayed based on the level information of the node and the gathered blood-edge information, and the data blood-edge relation can be displayed more clearly and intuitively by processing the level information and the attribute gathering of the node, so that convenience is provided for users.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the specification and together with the description, serve to explain the principles of the specification.
FIG. 1 is a diagram showing an exemplary data blood relationship according to an embodiment of the present invention.
Fig. 2 is a flowchart illustrating a method for displaying a data blood relationship according to an embodiment of the present invention.
Fig. 3 is an exemplary diagram of a node aggregation result provided in an embodiment of the present invention.
FIG. 4 is a diagram of an example summary blood margin provided by an embodiment of the present invention.
FIG. 5 is an exemplary diagram of a display interface at a partial view of a blood relationship provided by an embodiment of the present invention.
Fig. 6 is a diagram showing hierarchical statistics according to an embodiment of the present invention.
Fig. 7 is a diagram illustrating a result display of a viewing node according to an embodiment of the present invention.
Fig. 8 is a diagram showing an example of the result of expanding the convergence point according to the embodiment of the present invention.
Fig. 9 is a functional block diagram of a data blood relationship display device according to an embodiment of the invention.
Fig. 10 is a hardware configuration diagram of an electronic device according to an embodiment of the present invention.
Detailed Description
Reference will now be made in detail to exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, the same numbers in different drawings refer to the same or similar elements, unless otherwise indicated. The implementations described in the following exemplary examples do not represent all implementations consistent with the invention. Rather, they are merely examples of apparatus and methods consistent with aspects of embodiments of the invention as detailed in the accompanying claims.
The terminology used in the embodiments of the invention is for the purpose of describing particular embodiments of the invention only and is not intended to be limiting of embodiments of the invention. As used in this application and the appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It should also be understood that the term "and/or" as used herein refers to and encompasses any or all possible combinations of one or more of the associated listed items.
It should be understood that although the terms first, second, third, etc. may be used in embodiments of the present invention to describe various information, these information should not be limited to these terms. These terms are only used to distinguish one type of information from another. For example, the first information may also be referred to as second information, and similarly, the second information may also be referred to as first information, without departing from the scope of embodiments of the present invention. The word "if" as used herein may be interpreted as "at … …" or "at … …" or "responsive to a determination", depending on the context.
The data warehouse construction process involves a plurality of links: the method comprises the steps of data access, data cleaning, data modeling and data release, wherein the data are required to be processed in different systems, the construction of a data warehouse is completed under the cooperation of a plurality of systems, and the data value is mined for business intelligence and other applications.
In order to enable orderly data circulation, avoid data dependence confusion, an effective data organization and management method is needed, so that a data warehouse is generally built in layers. It is generally divided into an ODS (Operational Data Store) layer, an STD (adjacency list) layer, a DW (Data repository) layer, a DM (Data Mart) layer, and a DS (Data Service) layer. The table of the ODS layer stores data accessed from a data source, the table of the STD layer stores data conforming to standard specifications, the DW layer stores various basic data model tables established according to themes, the DM layer stores a complex data model table based on themes, and the table stored by the DS layer directly provides data for various applications.
The data blood relationship display method provided by the invention is described in detail by the following examples.
FIG. 1 is a diagram showing an exemplary data blood relationship according to an embodiment of the present invention. In this embodiment, as shown in fig. 1, the data blood-edge relationship is shown by a tree structure, and each node in the tree structure is a data table.
As can be seen from fig. 1, the source data table of the data table dm_a includes a data table a, a data table B and a data table C, and the data table a, the data table B and the data table C are all original service tables. The data table a is sequentially converted into a data table ods_a, a data table std_a, a data table tmp_a1, a data table tmp_a2, a data table dw_a and a data table dm_a through the processing link where the data table a is located; the data table B is sequentially converted into a data table ods_b, a data table std_b and a data table dm_a through the processing link where the data table B is positioned; the data table C is converted into the data table ods_c, the data table std_c, the data table std_d, the data table dw_c and the data table dm_a in sequence via the processing link in which it is located.
The data tables ods_a, ods_b, ods_c are data tables of the ODS layer, the data tables std_a, std_b, std_c, std_d are data tables of the STD (adjacent table) layer, the data tables tmp_a1, tmp_a2 are data tables of the TMP (temporary table) layer, the data tables dw_a, dw_c, DW layer, dm_a are data tables of the DM layer.
The tree structure shown in fig. 1 records the relationships between nodes in the data blood-lineage.
The embodiment of the invention also provides another data blood relationship display mode.
Fig. 2 is a flowchart illustrating a method for displaying a data blood relationship according to an embodiment of the present invention.
As shown in fig. 2, the data blood relationship display method may include:
s201, acquiring blood margin relations among data tables on a processing link according to processing information of the data table processing link, wherein each data table in the blood margin relations is a node.
S202, determining the level information and attribute information of the nodes according to the metadata information corresponding to each node in the blood relationship; the hierarchy information is used for indicating the hierarchy where the node is located, and the attribute information is used for indicating the attribute of the node.
S203, carrying out aggregation processing on each node in the blood edge relation according to the level information and the attribute information of the node to obtain summarized blood edge information; the summarized blood edge information comprises a convergence point and a connection relation between the convergence points, wherein all the nodes converged in the convergence points are identical in hierarchy and attribute.
S204, displaying the blood-edge relationship based on the hierarchical information of the nodes and the summarized blood-edge information.
In application, the processing information of each processing service can be received through a special blood edge service, and the upstream data table and the downstream data table of each data table are found through analyzing the processing information of each processing link, so that the blood edge relation of the whole link is formed. The blood-edge relationship includes table-level, field-level blood-edges.
Taking the processing link of data source ODS STD DW DS as an example, after analyzing each processing information, finding out the data table in each layer, and connecting the data tables according to the processing link to form a blood-edge relation of one link.
In actual processing, intermediate temporary tables, cross-level blood edges, and data table interrelationships in the same layer may occur.
For example, the data blood-edge relationship for the processing link of data table ods_a in FIG. 1 is as follows:
source data tables a-ods_a-std_a-tmp_a1-tmp_a2-dw_a-dm_a
In this data blood-lineage relationship, the data tables tmp_a1 and tmp_a2 are intermediate temporary tables.
The data blood relationship for the processing links of data table ods_b in FIG. 1 is as follows:
source data table b— ods_b-std_b-dm_a
Of the data blood-edge relationships, a cross-level blood-edge relationship is between the data table std_b and the data table dm_a.
The data blood relationship for the processing links of data table ods_c in FIG. 1 is as follows:
the source data tables C- -ods_c- -std_c- -std_d- -dw_c- -dm_a
In the data blood relationship, the data table std_c and the data table std_d are in the same layer of data table processing relationship.
If a common tree diagram (e.g., fig. 1) is used to show the blood-lineage relationships, the whole blood-lineage relationships are confusing, and specific hierarchical relationships cannot be identified. In order to make the whole blood edge relationship display clearer, the embodiment further processes the blood edge relationship obtained in step S201.
The data table at each node has corresponding metadata information, and the metadata information includes table names of the data tables and attribute information of the data tables, so that hierarchical information and attribute information of the nodes can be determined.
The hierarchy information may be, for example, an ODS layer (corresponding to an aggregation layer), an STD layer (corresponding to a division layer), a DW layer (corresponding to a topic layer), a DM layer (corresponding to a topic layer), a DS layer (corresponding to an application layer), a TMP layer (temporary layer), or the like.
The attribute information may include department information, topic information, application information, and the like.
In one example, the metadata information includes table names of data tables and attribute information of the data tables, and determining the hierarchy information and attribute information of the nodes according to the metadata information corresponding to each node in the blood relationship may include:
determining the level information of the nodes according to the table names of the data tables corresponding to the nodes in the blood relationship;
and determining the attribute information of the nodes according to the attribute information of the data table corresponding to each node in the blood relationship.
In one example, determining the hierarchical information of the node according to the table name of the data table corresponding to each node in the blood relationship may include:
searching a naming rule matched with the table name of the data table corresponding to the node;
extracting a hierarchical identifier from the table name according to the naming rule;
and determining the level information of the node according to the level identification.
Wherein naming rules for table names of the data table are known. When the naming rule of the table name enables the table name to comprise the hierarchy identifier, the hierarchy identifier can be extracted from the table name, so that the hierarchy information of the node where the data table is located is determined.
For example, the naming convention for table names of a data table is: hierarchy identification + connector + table name of source data table. At this time, table names of the data tables of the respective layers are as follows:
ODS layer: ods_
STD layer: std_, x
DW layer: dw_, x
DM layer: dm_, x
Temporary layer: tmp_, x
Wherein "_represents the table name of the source data table and" _represents the connector. The hierarchical identifier may be obtained by stripping the table name and the connector of the source data table from the table name of the data table. The extraction rules may be set in a rules system of the data warehouse.
For example, in fig. 1, in the data table std_b, b is the table name of the source data table, and "_is the connector, and the hierarchy identifier" ods "is obtained by removing the table name b and the connector" _of the source data table from the table name "std_b". Thus, the hierarchical information of the node corresponding to the data table std_b can be determined as follows: STD layer.
In the system, the correspondence between the hierarchy identifier and the hierarchy may be stored in advance, so that the hierarchy corresponding to the hierarchy identifier may be obtained according to the correspondence.
For example, the correspondence between the hierarchy identification and the hierarchy may be as shown in table 1.
TABLE 1
After the hierarchical information and the attribute information of the nodes are obtained, the embodiment further performs aggregation processing on the nodes to obtain summarized blood edge information. The summarized blood edge information comprises a convergence point and a connection relation between the convergence points, wherein all the nodes converged in the convergence points are identical in hierarchy and attribute.
In the aggregation process, the node hierarchy is further corresponding to the displayed hierarchy. The correspondence between the level of the node (for example, ODS layer) and the level after the presentation (for example, aggregation layer) may be preset in the system, for example, as shown in table 1.
The aggregation process of the nodes of each level according to the attribute information can be as follows:
a) ODS layer, corresponding to the aggregation layer, and not aggregation.
b) And the STD layer corresponds to the department layer and gathers according to the department information of the table. Multiple std tables may be included under each division.
c) And the DW layer corresponds to the theme layer and gathers the theme information. Each topic may contain a table of multiple DW layers.
d) And the DM layer corresponds to the thematic layer and gathers the thematic information. Each topic may contain a table of multiple DM layers.
e) DS layer, corresponding to application layer, gathers according to application of external service. Each application may contain a table of multiple DS layers.
f) TMP layer, which is temporary data, does not aggregate.
Fig. 3 is an exemplary diagram of a node aggregation result provided in an embodiment of the present invention. As shown in fig. 3, in the same hierarchy, nodes are aggregated according to node attributes, so that a user can more intuitively learn information contained in the blood-edge relationship. After the nodes (i.e. the data table) of a certain level are subjected to aggregation treatment according to the attribute, merging processing is carried out on the blood edge links to form aggregated summarized blood edges, as shown by the solid line added in fig. 4 relative to fig. 3.
FIG. 4 is a diagram of an example summary blood margin provided by an embodiment of the present invention. As shown in fig. 4, ods_a and ods_b form a summary blood margin with department a; a summary blood margin is formed between the department A and the theme B and between the department A and the theme C; when the DM layer is not displayed, the theme B and the application 1 form a summary blood margin; subject C forms a summary blood margin with application 1.
After the summarized blood-edge relationship is obtained, the embodiment displays the blood-edge relationship according to the hierarchy of the nodes and the summarized blood-edge relationship.
In one example, exposing the blood-edge relationship based on the hierarchical information of nodes and the summarized blood-edge information may include:
setting a corresponding display area for each layer;
distributing the nodes to display areas corresponding to the levels of the nodes according to the level information of the nodes;
and in each display area, if the node belongs to the convergence point, displaying the convergence point to which the node belongs in the display area, and if the node does not belong to any convergence point, displaying the node in the display area.
Wherein the display region may be a lane, a circular region, etc. When the display area is a ring-shaped area, the display area may be a ring, and of course, may be a ring of other shapes, such as a polygon, etc.
According to the embodiment, the nodes in different layers are displayed in different display areas, and the nodes in the same layer are displayed in the same display area, so that a user can conveniently and quickly understand the hierarchical relationship of the nodes.
FIG. 5 is an exemplary diagram of a display interface at a partial view of a blood relationship provided by an embodiment of the present invention. As shown in fig. 5, fig. 5 shows the blood relationship after aggregation by attribute. The blood margin information of 4 layers of the aggregation layer, the department bin, the theme layer and the application layer is displayed in a circular display area respectively. The blood margin relations after being summarized according to the attributes can be displayed among the layers, and the layers are connected through dotted lines to display the whole blood margin information. Meanwhile, the right side of the display interface of fig. 5 also provides summary display information of each level. The information illustrated in fig. 5 is part of an entire ring, and the ring of each level is part of an entire circle, so that the ring can be dragged flexibly to find a designated node.
The displayed hierarchy can be controlled in the background according to the scene. For temporary tables between layers, the presentation may be ignored.
In one example, the method may further comprise:
and displaying the statistical information of the hierarchy corresponding to the selected display area according to the received selection operation information of the display area.
Fig. 6 is a diagram showing hierarchical statistics according to an embodiment of the present invention. As shown in fig. 6, when a department bin is selected, statistical information of the department bin is displayed on the presentation interface.
The statistical information may include the number of attributes, the number of data tables, and the number of records included in the hierarchy corresponding to the selected presentation area.
In one example, the method may further comprise:
according to the received operation information for selecting the convergence point, the blood-margin link information and/or statistical information corresponding to the selected convergence point are displayed; and/or the number of the groups of groups,
and displaying the blood-edge link information corresponding to the selected node according to the received selection operation information of the node.
The selection operation information may be, for example, an operation of clicking on the node name.
The present embodiment provides a way to view the node or aggregate point blood edges.
Fig. 7 is a diagram illustrating a result display of a viewing node according to an embodiment of the present invention. As shown in fig. 7, taking the "province radio and television department" in the department store as an example, the upstream and downstream link information of the blood margin may be at different positions of the circular ring under the panoramic view or the partial view. When clicking and selecting a department node of 'province and broadcasting bureau', the information of the blood edge nodes at the upstream and downstream can be rapidly obtained according to the department node, and the information is optimally displayed at the central position of the circular ring. The data table of which aggregation layer is used by the provincial broadcasting and television office can be checked through the display result of fig. 7, meanwhile, the data table of the broadcasting and television office forms which topics, and each topic supports which applications of the application layer. It can be seen that this manner of presentation is closer to the business and easier for the user to understand.
In one example, the method may further comprise:
and displaying a data table corresponding to each node converged by the convergence point and blood-edge link information corresponding to the data table according to the received unfolding operation information of the convergence point.
In the application, a drop-down arrow may be set for each convergence point, where the expansion operation information may be an operation of clicking the drop-down arrow corresponding to the convergence point.
Fig. 8 is a diagram showing an example of the result of expanding the convergence point according to the embodiment of the present invention. As shown in fig. 8, when clicking the drop-down arrow of the convergence point "provincial and broadcasting bureau", a specific data table list under "provincial and broadcasting bureau" is expanded, and the blood-edge link where the specific data table is located is displayed.
In one example, the method may further comprise:
and displaying the clicked node or the clicked aggregation point in the central position of the display area according to the received click operation on the node or the aggregation point.
For example, the convergence point "province radio and television office" shown in fig. 7 may be located above or below the display area before being clicked, and after being clicked, the "province radio and television office" is centrally displayed, so that the user can conveniently view the convergence point.
In one example, the method may further comprise:
under the condition that a display area corresponding to a target level is selected, searching a node or a convergence point corresponding to the search information in the display area corresponding to the target level according to the received search information;
and rotating the display area corresponding to the target level, and displaying the searched nodes or the searched convergence points in the central position of the display area.
For example, in the case where the display area of the department store shown in fig. 6 is selected, when the search information "civil engineering hall" is input, the display area of the department store is rotated so that the convergence point "civil engineering hall" is displayed at the center position of the display area.
According to the data blood edge relation display method provided by the embodiment of the invention, the blood edge relation among the data tables on the processing link is obtained according to the processing information of the processing link of the data tables, each data table in the blood edge relation is a node, the level information and the attribute information of the node are determined according to the metadata information corresponding to each node in the blood edge relation, the level information is used for indicating the level of the node, the attribute information is used for indicating the attribute of the node, the nodes in the blood edge relation are subjected to aggregation processing according to the level information and the attribute information of the node to obtain the aggregated blood edge information, the aggregated blood edge information comprises the connection relation between the aggregation point and the aggregation point, the collected nodes in the aggregation point are identical in level and attribute, the blood edge relation is displayed based on the level information of the node and the aggregated blood edge information, and the data blood edge relation can be displayed more clearly and intuitively by carrying out layering and attribute aggregation processing on the blood edge information, so that convenience is provided for users.
Based on the method embodiment, the embodiment of the invention also provides a corresponding device, equipment and storage medium embodiment. For detailed implementation of the apparatus, device and storage medium embodiments of the present invention, please refer to the corresponding description of the method embodiment section.
Fig. 9 is a functional block diagram of a data blood relationship display device according to an embodiment of the invention. As shown in fig. 9, in this embodiment, the data blood relationship display apparatus may include:
an obtaining module 910, configured to obtain, according to processing information of a data table processing link, a blood-edge relationship between data tables on the processing link, where each data table in the blood-edge relationship is a node;
a determining module 920, configured to determine hierarchical information and attribute information of the nodes according to metadata information corresponding to each node in the blood-edge relationship; the hierarchy information is used for indicating the hierarchy of the node, and the attribute information is used for indicating the attribute of the node;
the aggregation module 930 is configured to aggregate each node in the blood-edge relationship according to the level information and the attribute information of the node, so as to obtain summarized blood-edge information; the summarized blood edge information comprises a convergence point and a connection relation between the convergence points, wherein all the nodes converged in the convergence points are identical in hierarchy and attribute;
and the display module 940 is configured to display the blood-edge relationship based on the hierarchical information of the node and the summarized blood-edge information.
In one example, the presentation module 940 may be specifically configured to:
setting a corresponding display area for each layer;
distributing the nodes to display areas corresponding to the levels of the nodes according to the level information of the nodes;
and in each display area, if the node belongs to the convergence point, displaying the convergence point to which the node belongs in the display area, and if the node does not belong to any convergence point, displaying the node in the display area.
In one example, further comprising:
and the display area display module is used for displaying the statistical information of the hierarchy corresponding to the selected display area according to the received selection operation information of the display area.
In one example, the statistical information includes a number of attributes, a number of data tables, and a number of records included in a hierarchy corresponding to the selected presentation area.
In one example, further comprising:
the convergence point display module is used for displaying blood edge link information and/or statistical information corresponding to the selected convergence point according to the received selection operation information of the convergence point;
the node display module is used for displaying the blood-edge link information corresponding to the selected node according to the received selection operation information of the node.
In one example, further comprising:
and the convergence point unfolding module is used for displaying a data table corresponding to each node converged by the convergence point and blood-edge link information corresponding to the data table according to the received unfolding operation information of the convergence point.
In one example, further comprising:
and the centering display module is used for displaying the clicked node or the clicked aggregation point at the center position of the display area according to the received click operation on the node or the aggregation point.
In one example, further comprising:
the searching module is used for searching nodes or convergence points corresponding to the search information in the display area corresponding to the target level according to the received search information under the condition that the display area corresponding to the target level is selected; and the display area is used for rotating the display area corresponding to the target level, and the searched nodes or the convergence points are displayed at the central position of the display area.
In one example, the metadata information includes table names and table attribute information of the data table, and the determining module 920 may specifically be configured to:
determining the level information of the nodes according to the table names of the data tables corresponding to the nodes in the blood relationship;
and determining the attribute information of the nodes according to the attribute information of the data table corresponding to each node in the blood relationship.
The embodiment of the invention also provides electronic equipment. Fig. 10 is a hardware configuration diagram of an electronic device according to an embodiment of the present invention. As shown in fig. 10, the electronic device includes: an internal bus 1001, and a memory 1002, a processor 1003, and an external interface 1004 which are connected by the internal bus.
The processor 1003 is configured to read machine readable instructions on the memory 1002 and execute the instructions to implement the following operations:
acquiring blood edge relations among data tables on a processing link according to processing information of the data table processing link, wherein each data table in the blood edge relations is a node;
determining the level information and attribute information of the nodes according to the metadata information corresponding to each node in the blood relationship; the hierarchy information is used for indicating the hierarchy of the node, and the attribute information is used for indicating the attribute of the node;
according to the level information and attribute information of the nodes, carrying out aggregation treatment on each node in the blood-edge relationship to obtain summarized blood-edge information; the summarized blood edge information comprises a convergence point and a connection relation between the convergence points, wherein all the nodes converged in the convergence points are identical in hierarchy and attribute;
and displaying the blood edge relation based on the hierarchical information of the nodes and the summarized blood edge information.
In one example, exposing the blood-edge relationship based on the hierarchical information of nodes and the summarized blood-edge information includes:
setting a corresponding display area for each layer;
distributing the nodes to display areas corresponding to the levels of the nodes according to the level information of the nodes;
and in each display area, if the node belongs to the convergence point, displaying the convergence point to which the node belongs in the display area, and if the node does not belong to any convergence point, displaying the node in the display area.
In one example, further comprising:
and displaying the statistical information of the hierarchy corresponding to the selected display area according to the received selection operation information of the display area.
In one example, the statistical information includes a number of attributes, a number of data tables, and a number of records included in a hierarchy corresponding to the selected presentation area.
In one example, further comprising:
according to the received operation information for selecting the convergence point, the blood-margin link information and/or statistical information corresponding to the selected convergence point are displayed; and/or the number of the groups of groups,
and displaying the blood-edge link information corresponding to the selected node according to the received selection operation information of the node.
In one example, further comprising:
and displaying a data table corresponding to each node converged by the convergence point and blood-edge link information corresponding to the data table according to the received unfolding operation information of the convergence point.
In one example, further comprising:
and displaying the clicked node or the clicked aggregation point in the central position of the display area according to the received click operation on the node or the aggregation point.
In one example, further comprising:
under the condition that a display area corresponding to a target level is selected, searching a node or a convergence point corresponding to the search information in the display area corresponding to the target level according to the received search information;
and rotating the display area corresponding to the target level, and displaying the searched nodes or the searched convergence points in the central position of the display area.
In one example, the metadata information includes table names and attribute information of a data table, and determining hierarchical information and attribute information of nodes according to metadata information corresponding to each node in the blood-edge relationship includes:
determining the level information of the nodes according to the table names of the data tables corresponding to the nodes in the blood relationship;
and determining the attribute information of the nodes according to the attribute information of the data table corresponding to each node in the blood relationship.
The embodiment of the invention also provides a computer readable storage medium, which stores a plurality of computer instructions, and the computer instructions when executed perform the following processes:
acquiring blood edge relations among data tables on a processing link according to processing information of the data table processing link, wherein each data table in the blood edge relations is a node;
determining the level information and attribute information of the nodes according to the metadata information corresponding to each node in the blood relationship; the hierarchy information is used for indicating the hierarchy of the node, and the attribute information is used for indicating the attribute of the node;
according to the level information and attribute information of the nodes, carrying out aggregation treatment on each node in the blood-edge relationship to obtain summarized blood-edge information; the summarized blood edge information comprises a convergence point and a connection relation between the convergence points, wherein all the nodes converged in the convergence points are identical in hierarchy and attribute;
and displaying the blood edge relation based on the hierarchical information of the nodes and the summarized blood edge information.
In one example, exposing the blood-edge relationship based on the hierarchical information of nodes and the summarized blood-edge information includes:
setting a corresponding display area for each layer;
distributing the nodes to display areas corresponding to the levels of the nodes according to the level information of the nodes;
and in each display area, if the node belongs to the convergence point, displaying the convergence point to which the node belongs in the display area, and if the node does not belong to any convergence point, displaying the node in the display area.
In one example, further comprising:
and displaying the statistical information of the hierarchy corresponding to the selected display area according to the received selection operation information of the display area.
In one example, the statistical information includes a number of attributes, a number of data tables, and a number of records included in a hierarchy corresponding to the selected presentation area.
In one example, further comprising:
according to the received operation information for selecting the convergence point, the blood-margin link information and/or statistical information corresponding to the selected convergence point are displayed; and/or the number of the groups of groups,
and displaying the blood-edge link information corresponding to the selected node according to the received selection operation information of the node.
In one example, further comprising:
and displaying a data table corresponding to each node converged by the convergence point and blood-edge link information corresponding to the data table according to the received unfolding operation information of the convergence point.
In one example, further comprising:
and displaying the clicked node or the clicked aggregation point in the central position of the display area according to the received click operation on the node or the aggregation point.
In one example, further comprising:
under the condition that a display area corresponding to a target level is selected, searching a node or a convergence point corresponding to the search information in the display area corresponding to the target level according to the received search information;
and rotating the display area corresponding to the target level, and displaying the searched nodes or the searched convergence points in the central position of the display area.
In one example, the metadata information includes table names and attribute information of a data table, and determining hierarchical information and attribute information of nodes according to metadata information corresponding to each node in the blood-edge relationship includes:
determining the level information of the nodes according to the table names of the data tables corresponding to the nodes in the blood relationship;
and determining the attribute information of the nodes according to the attribute information of the data table corresponding to each node in the blood relationship.
For the device and apparatus embodiments, reference is made to the description of the method embodiments for the relevant points, since they essentially correspond to the method embodiments. The apparatus embodiments described above are merely illustrative, wherein the modules illustrated as separate components may or may not be physically separate, and the components shown as modules may or may not be physical, i.e., may be located in one place, or may be distributed over a plurality of network modules. Some or all of the modules may be selected according to actual needs to achieve the purposes of the present description. Those of ordinary skill in the art will understand and implement the present invention without undue burden.
The foregoing describes specific embodiments of the present disclosure. Other embodiments are within the scope of the following claims. In some cases, the actions or steps recited in the claims can be performed in a different order than in the embodiments and still achieve desirable results. In addition, the processes depicted in the accompanying figures do not necessarily require the particular order shown, or sequential order, to achieve desirable results. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.
Other embodiments of the present description will be apparent to those skilled in the art from consideration of the specification and practice of the invention disclosed herein. This specification is intended to cover any variations, uses, or adaptations of the specification following, in general, the principles of the specification and including such departures from the present disclosure as come within known or customary practice within the art to which the specification pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the specification being indicated by the following claims.
It is to be understood that the present description is not limited to the precise arrangements and instrumentalities shown in the drawings, which have been described above, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present description is limited only by the appended claims.
The foregoing description of the preferred embodiments is provided for the purpose of illustration only, and is not intended to limit the scope of the disclosure, since any modifications, equivalents, improvements, etc. that fall within the spirit and principles of the disclosure are intended to be included within the scope of the disclosure.

Claims (8)

1. A method for displaying a data blood relationship, the method comprising:
acquiring blood edge relations among data tables on a processing link according to processing information of the data table processing link, wherein each data table in the blood edge relations is a node;
determining the level information and attribute information of the nodes according to the metadata information corresponding to each node in the blood relationship; the hierarchy information is used for indicating the hierarchy of the node, and the attribute information is used for indicating the attribute of the node;
according to the level information and attribute information of the nodes, carrying out aggregation processing on each node in the blood edge relation to obtain summarized blood edge information, wherein the aggregation processing comprises the following steps: after the nodes with the same layers and the same attribute are subjected to aggregation treatment to obtain an aggregation point, merging the nodes aiming at blood edge links to form aggregated summarized blood edge information; the summarized blood edge information comprises a convergence point and a connection relation between the convergence points, wherein all the nodes converged in the convergence points are identical in hierarchy and attribute;
and displaying the blood edge relation based on the level information of the nodes and the summarized blood edge information, wherein the method comprises the following steps: setting a corresponding display area for each layer; distributing the nodes to display areas corresponding to the levels of the nodes according to the level information of the nodes; in each display area, if the node belongs to the convergence point, the convergence point to which the node belongs is displayed in the display area, and if the node does not belong to any convergence point, the node is displayed in the display area;
and displaying a data table corresponding to each node converged by the convergence point and blood-edge link information corresponding to the data table according to the received unfolding operation information of the convergence point.
2. The method as recited in claim 1, further comprising:
and displaying the statistical information of the hierarchy corresponding to the selected display area according to the received selection operation information of the display area.
3. The method of claim 2, wherein the statistical information includes a number of attributes, a number of data tables, and a number of records included in a hierarchy corresponding to the selected presentation area.
4. The method as recited in claim 1, further comprising:
according to the received operation information for selecting the convergence point, the blood-margin link information and/or statistical information corresponding to the selected convergence point are displayed; and/or the number of the groups of groups,
and displaying the blood-edge link information corresponding to the selected node according to the received selection operation information of the node.
5. The method as recited in claim 1, further comprising:
and displaying the clicked node or the clicked aggregation point in the central position of the display area according to the received click operation on the node or the aggregation point.
6. The method as recited in claim 1, further comprising:
under the condition that a display area corresponding to a target level is selected, searching a node or a convergence point corresponding to the search information in the display area corresponding to the target level according to the received search information;
and rotating the display area corresponding to the target level, and displaying the searched nodes or the searched convergence points in the central position of the display area.
7. The method of claim 1, wherein the metadata information includes table names and table attribute information of a data table, and determining the level information and attribute information of the nodes according to the metadata information corresponding to each node in the blood-edge relationship includes:
determining the level information of the nodes according to the table names of the data tables corresponding to the nodes in the blood relationship;
and determining the attribute information of the nodes according to the attribute information of the data table corresponding to each node in the blood relationship.
8. A data blood relationship display apparatus, the apparatus comprising:
the acquisition module is used for acquiring blood margin relations among the data tables on the processing link according to the processing information of the data table processing link, wherein each data table in the blood margin relations is a node;
the determining module is used for determining the level information and the attribute information of the nodes according to the metadata information corresponding to each node in the blood relationship; the hierarchy information is used for indicating the hierarchy of the node, and the attribute information is used for indicating the attribute of the node;
the aggregation module is used for carrying out aggregation processing on each node in the blood edge relation according to the level information and the attribute information of the node to obtain summarized blood edge information, and comprises the following steps: after the nodes with the same layers and the same attribute are subjected to aggregation treatment to obtain an aggregation point, merging the nodes aiming at blood edge links to form aggregated summarized blood edge information; the summarized blood edge information comprises a convergence point and a connection relation between the convergence points, wherein all the nodes converged in the convergence points are identical in hierarchy and attribute;
the display module is used for displaying the blood-edge relationship based on the hierarchical information of the nodes and the summarized blood-edge information, and comprises the following steps: setting a corresponding display area for each layer; distributing the nodes to display areas corresponding to the levels of the nodes according to the level information of the nodes; in each display area, if the node belongs to the convergence point, the convergence point to which the node belongs is displayed in the display area, and if the node does not belong to any convergence point, the node is displayed in the display area; and displaying a data table corresponding to each node converged by the convergence point and blood-edge link information corresponding to the data table according to the received unfolding operation information of the convergence point.
CN202110343323.0A 2021-03-30 2021-03-30 Data blood relationship display method and device Active CN113282678B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110343323.0A CN113282678B (en) 2021-03-30 2021-03-30 Data blood relationship display method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110343323.0A CN113282678B (en) 2021-03-30 2021-03-30 Data blood relationship display method and device

Publications (2)

Publication Number Publication Date
CN113282678A CN113282678A (en) 2021-08-20
CN113282678B true CN113282678B (en) 2024-01-02

Family

ID=77276106

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110343323.0A Active CN113282678B (en) 2021-03-30 2021-03-30 Data blood relationship display method and device

Country Status (1)

Country Link
CN (1) CN113282678B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113760866A (en) * 2021-08-30 2021-12-07 中国铁道科学研究院集团有限公司电子计算技术研究所 Modeling assistance device and method

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100481878B1 (en) * 2000-07-19 2005-04-11 주식회사 바이오그랜드 Biological Blood-Relation Retrieving System and Method the same
US6965903B1 (en) * 2002-05-07 2005-11-15 Oracle International Corporation Techniques for managing hierarchical data with link attributes in a relational database
KR20090022519A (en) * 2007-08-30 2009-03-04 김정태 Service system of genealogical table using internet and method thereof
US9613086B1 (en) * 2014-08-15 2017-04-04 Tableau Software, Inc. Graphical user interface for generating and displaying data visualizations that use relationships
CN107463555B (en) * 2016-06-01 2020-09-04 北京京东尚科信息技术有限公司 Method, system and device for deleting intermediate layer data
US20190340272A1 (en) * 2018-05-02 2019-11-07 doTERRA Holdings, LLC Systems and related methods for updating attributes of nodes and links in a hierarchical data structure
CN110807026A (en) * 2019-10-24 2020-02-18 北京中科捷信信息技术有限公司 Automatic capture system for analyzing financial big data blood relationship
CN111639143B (en) * 2020-06-05 2020-12-22 广州市玄武无线科技股份有限公司 Data blood relationship display method and device of data warehouse and electronic equipment
CN111767320B (en) * 2020-06-29 2023-08-18 中国银行股份有限公司 Data blood relationship determination method and device
CN112487045A (en) * 2020-10-20 2021-03-12 广西盛源行大数据科技有限公司 Management platform based on big data
CN112328575A (en) * 2020-11-12 2021-02-05 杭州数梦工场科技有限公司 Data asset blood margin generation method and device and electronic equipment

Also Published As

Publication number Publication date
CN113282678A (en) 2021-08-20

Similar Documents

Publication Publication Date Title
CN108733713B (en) Data query method and device in data warehouse
CN107957957B (en) Test case obtaining method and device
US11132346B2 (en) Information processing method and apparatus
CN107092652B (en) Navigation method and device for target page
CN111639082B (en) Object storage management method and system of billion-level node scale knowledge graph based on Ceph
US20160239510A1 (en) Method for Extracting Useful Content from Setup Files of Mobile Applications
CN111008521A (en) Method and device for generating wide table and computer storage medium
CN108228657B (en) Method and device for realizing keyword retrieval
CN113282678B (en) Data blood relationship display method and device
CN111190962A (en) File synchronization method and device and local terminal
US20110179013A1 (en) Search Log Online Analytic Processing
CN108446308A (en) The system and method for scalable distributed database
CN105808627A (en) POI information updating method and device, POI information search method and device as well as POI data packet generation method and device
EP3249557B1 (en) Computer implemented and computer controlled method, computer program product and platform for arranging data for processing and storage at a data storage engine
CN111475511A (en) Data storage method, data access method, data storage device, data access device and data access equipment based on tree structure
CN112559913B (en) Data processing method, device, computing equipment and readable storage medium
CN106126681A (en) A kind of increment type stream data clustering method and system
CN113190947A (en) Feed line group dividing method and device
CN109947759A (en) A kind of data directory method for building up, indexed search method and device
CN111767282A (en) MongoDB-based storage system, data insertion method and storage medium
CN107451229B (en) Database query method and device
CN114840487A (en) Metadata management method and device for distributed file system
CN113778996A (en) Large data stream data processing method and device, electronic equipment and storage medium
CN111045997B (en) Centralized storage data deleting method and device
CN113590907A (en) Camera management method and device, electronic equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant